0s autopkgtest [20:36:29]: starting date and time: 2024-11-23 20:36:29+0000 0s autopkgtest [20:36:29]: git checkout: 6408f825 Correct logic in old-systemd fallback code 0s autopkgtest [20:36:29]: host juju-7f2275-prod-proposed-migration-environment-9; command line: /home/ubuntu/autopkgtest/runner/autopkgtest --output-dir /tmp/autopkgtest-work.s3axepm0/out --timeout-copy=6000 --setup-commands 'ln -s /dev/null /etc/systemd/system/bluetooth.service; printf "http_proxy=http://squid.internal:3128\nhttps_proxy=http://squid.internal:3128\nno_proxy=127.0.0.1,127.0.1.1,login.ubuntu.com,localhost,localdomain,novalocal,internal,archive.ubuntu.com,ports.ubuntu.com,security.ubuntu.com,ddebs.ubuntu.com,changelogs.ubuntu.com,keyserver.ubuntu.com,launchpadlibrarian.net,launchpadcontent.net,launchpad.net,10.24.0.0/24,keystone.ps5.canonical.com,objectstorage.prodstack5.canonical.com\n" >> /etc/environment' --apt-pocket=proposed=src:python3-defaults --apt-upgrade dask.distributed --timeout-short=300 --timeout-copy=20000 --timeout-build=20000 --env=ADT_TEST_TRIGGERS=python3-defaults/3.12.7-1 -- lxd -r lxd-armhf-10.145.243.232 lxd-armhf-10.145.243.232:autopkgtest/ubuntu/plucky/armhf 52s autopkgtest [20:37:21]: testbed dpkg architecture: armhf 54s autopkgtest [20:37:23]: testbed apt version: 2.9.8 54s autopkgtest [20:37:23]: @@@@@@@@@@@@@@@@@@@@ test bed setup 61s Get:1 http://ftpmaster.internal/ubuntu plucky-proposed InRelease [73.9 kB] 62s Get:2 http://ftpmaster.internal/ubuntu plucky-proposed/restricted Sources [9704 B] 62s Get:3 http://ftpmaster.internal/ubuntu plucky-proposed/universe Sources [930 kB] 62s Get:4 http://ftpmaster.internal/ubuntu plucky-proposed/multiverse Sources [13.6 kB] 62s Get:5 http://ftpmaster.internal/ubuntu plucky-proposed/main Sources [54.8 kB] 62s Get:6 http://ftpmaster.internal/ubuntu plucky-proposed/main armhf Packages [63.6 kB] 62s Get:7 http://ftpmaster.internal/ubuntu plucky-proposed/restricted armhf Packages [756 B] 62s Get:8 http://ftpmaster.internal/ubuntu plucky-proposed/universe armhf Packages [727 kB] 63s Get:9 http://ftpmaster.internal/ubuntu plucky-proposed/multiverse armhf Packages [5924 B] 63s Fetched 1879 kB in 2s (1244 kB/s) 63s Reading package lists... 81s tee: /proc/self/fd/2: Permission denied 104s Hit:1 http://ftpmaster.internal/ubuntu plucky-proposed InRelease 104s Hit:2 http://ftpmaster.internal/ubuntu plucky InRelease 104s Hit:3 http://ftpmaster.internal/ubuntu plucky-updates InRelease 104s Hit:4 http://ftpmaster.internal/ubuntu plucky-security InRelease 105s Reading package lists... 105s Reading package lists... 105s Building dependency tree... 105s Reading state information... 106s Calculating upgrade... 106s The following packages will be upgraded: 106s bash debconf debconf-i18n libpython3-stdlib python3 python3-blinker 106s python3-debconf python3-minimal vim-common vim-tiny xxd 107s 11 upgraded, 0 newly installed, 0 to remove and 0 not upgraded. 107s Need to get 2233 kB of archives. 107s After this operation, 1024 B disk space will be freed. 107s Get:1 http://ftpmaster.internal/ubuntu plucky/main armhf bash armhf 5.2.32-1ubuntu2 [673 kB] 107s Get:2 http://ftpmaster.internal/ubuntu plucky-proposed/main armhf python3-minimal armhf 3.12.7-1 [27.4 kB] 107s Get:3 http://ftpmaster.internal/ubuntu plucky-proposed/main armhf python3 armhf 3.12.7-1 [24.0 kB] 107s Get:4 http://ftpmaster.internal/ubuntu plucky-proposed/main armhf libpython3-stdlib armhf 3.12.7-1 [10.0 kB] 107s Get:5 http://ftpmaster.internal/ubuntu plucky/main armhf debconf-i18n all 1.5.87ubuntu1 [204 kB] 107s Get:6 http://ftpmaster.internal/ubuntu plucky/main armhf python3-debconf all 1.5.87ubuntu1 [4156 B] 107s Get:7 http://ftpmaster.internal/ubuntu plucky/main armhf debconf all 1.5.87ubuntu1 [124 kB] 107s Get:8 http://ftpmaster.internal/ubuntu plucky/main armhf vim-tiny armhf 2:9.1.0861-1ubuntu1 [694 kB] 107s Get:9 http://ftpmaster.internal/ubuntu plucky/main armhf vim-common all 2:9.1.0861-1ubuntu1 [395 kB] 107s Get:10 http://ftpmaster.internal/ubuntu plucky/main armhf xxd armhf 2:9.1.0861-1ubuntu1 [67.0 kB] 107s Get:11 http://ftpmaster.internal/ubuntu plucky/main armhf python3-blinker all 1.9.0-1 [10.7 kB] 107s Preconfiguring packages ... 108s Fetched 2233 kB in 1s (3183 kB/s) 108s (Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 59616 files and directories currently installed.) 108s Preparing to unpack .../bash_5.2.32-1ubuntu2_armhf.deb ... 108s Unpacking bash (5.2.32-1ubuntu2) over (5.2.32-1ubuntu1) ... 108s Setting up bash (5.2.32-1ubuntu2) ... 108s update-alternatives: using /usr/share/man/man7/bash-builtins.7.gz to provide /usr/share/man/man7/builtins.7.gz (builtins.7.gz) in auto mode 108s (Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 59616 files and directories currently installed.) 108s Preparing to unpack .../python3-minimal_3.12.7-1_armhf.deb ... 108s Unpacking python3-minimal (3.12.7-1) over (3.12.6-0ubuntu1) ... 108s Setting up python3-minimal (3.12.7-1) ... 108s (Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 59616 files and directories currently installed.) 108s Preparing to unpack .../python3_3.12.7-1_armhf.deb ... 108s Unpacking python3 (3.12.7-1) over (3.12.6-0ubuntu1) ... 108s Preparing to unpack .../libpython3-stdlib_3.12.7-1_armhf.deb ... 108s Unpacking libpython3-stdlib:armhf (3.12.7-1) over (3.12.6-0ubuntu1) ... 108s Preparing to unpack .../debconf-i18n_1.5.87ubuntu1_all.deb ... 108s Unpacking debconf-i18n (1.5.87ubuntu1) over (1.5.86ubuntu1) ... 108s Preparing to unpack .../python3-debconf_1.5.87ubuntu1_all.deb ... 108s Unpacking python3-debconf (1.5.87ubuntu1) over (1.5.86ubuntu1) ... 108s Preparing to unpack .../debconf_1.5.87ubuntu1_all.deb ... 108s Unpacking debconf (1.5.87ubuntu1) over (1.5.86ubuntu1) ... 109s Setting up debconf (1.5.87ubuntu1) ... 109s (Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 59616 files and directories currently installed.) 109s Preparing to unpack .../vim-tiny_2%3a9.1.0861-1ubuntu1_armhf.deb ... 109s Unpacking vim-tiny (2:9.1.0861-1ubuntu1) over (2:9.1.0777-1ubuntu1) ... 109s Preparing to unpack .../vim-common_2%3a9.1.0861-1ubuntu1_all.deb ... 109s Unpacking vim-common (2:9.1.0861-1ubuntu1) over (2:9.1.0777-1ubuntu1) ... 109s Preparing to unpack .../xxd_2%3a9.1.0861-1ubuntu1_armhf.deb ... 109s Unpacking xxd (2:9.1.0861-1ubuntu1) over (2:9.1.0777-1ubuntu1) ... 109s Preparing to unpack .../python3-blinker_1.9.0-1_all.deb ... 109s Unpacking python3-blinker (1.9.0-1) over (1.8.2-1) ... 109s Setting up debconf-i18n (1.5.87ubuntu1) ... 109s Setting up xxd (2:9.1.0861-1ubuntu1) ... 109s Setting up vim-common (2:9.1.0861-1ubuntu1) ... 109s Setting up libpython3-stdlib:armhf (3.12.7-1) ... 109s Setting up python3 (3.12.7-1) ... 109s Setting up vim-tiny (2:9.1.0861-1ubuntu1) ... 109s Setting up python3-blinker (1.9.0-1) ... 109s Setting up python3-debconf (1.5.87ubuntu1) ... 109s Processing triggers for debianutils (5.21) ... 110s Processing triggers for install-info (7.1.1-1) ... 110s Processing triggers for man-db (2.13.0-1) ... 111s Reading package lists... 111s Building dependency tree... 111s Reading state information... 112s 0 upgraded, 0 newly installed, 0 to remove and 0 not upgraded. 114s autopkgtest [20:38:23]: rebooting testbed after setup commands that affected boot 184s autopkgtest [20:39:33]: testbed running kernel: Linux 6.8.0-49-generic #49~22.04.1-Ubuntu SMP PREEMPT_DYNAMIC Wed Nov 6 18:12:14 UTC 2 215s autopkgtest [20:40:04]: @@@@@@@@@@@@@@@@@@@@ apt-source dask.distributed 232s Get:1 http://ftpmaster.internal/ubuntu plucky/universe dask.distributed 2024.5.2+ds.1-8 (dsc) [3390 B] 232s Get:2 http://ftpmaster.internal/ubuntu plucky/universe dask.distributed 2024.5.2+ds.1-8 (tar) [2131 kB] 232s Get:3 http://ftpmaster.internal/ubuntu plucky/universe dask.distributed 2024.5.2+ds.1-8 (diff) [2041 kB] 232s gpgv: Signature made Tue Nov 12 23:11:00 2024 UTC 232s gpgv: using RSA key D54C3BFAFFB042DE382DA5D741CE7F0B9F1B8B32 232s gpgv: Can't check signature: No public key 232s dpkg-source: warning: cannot verify inline signature for ./dask.distributed_2024.5.2+ds.1-8.dsc: no acceptable signature found 233s autopkgtest [20:40:22]: testing package dask.distributed version 2024.5.2+ds.1-8 236s autopkgtest [20:40:25]: build not needed 239s autopkgtest [20:40:28]: test pytest: preparing testbed 250s Reading package lists... 251s Building dependency tree... 251s Reading state information... 251s Starting pkgProblemResolver with broken count: 0 251s Starting 2 pkgProblemResolver with broken count: 0 251s Done 252s The following additional packages will be installed: 252s blt fontconfig-config fonts-dejavu-core fonts-dejavu-mono fonts-font-awesome 252s fonts-glyphicons-halflings fonts-lato fonts-lyx fonts-mathjax gdb libaec0 252s libargon2-1 libbabeltrace1 libblas3 libc6-dbg libcares2 libdebuginfod-common 252s libdebuginfod1t64 libdeflate0 libfontconfig1 libfreetype6 libgfortran5 252s libgomp1 libgraphite2-3 libharfbuzz0b libhdf5-103-1t64 libhdf5-hl-100t64 252s libimagequant0 libjbig0 libjpeg-turbo8 libjpeg8 libjs-bootstrap libjs-jquery 252s libjs-jquery-ui libjs-mathjax libjs-sphinxdoc libjs-sprintf-js 252s libjs-underscore liblapack3 liblbfgsb0 liblcms2-2 liblerc4 liblzf1 252s libnetcdf19t64 libnode115 libnorm1t64 libopenjp2-7 libpgm-5.3-0t64 252s libpython3.12t64 libpython3.13-minimal libpython3.13-stdlib libqhull-r8.0 252s libraqm0 libsharpyuv0 libsodium23 libsource-highlight-common 252s libsource-highlight4t64 libsz2 libtcl8.6 libtiff6 libtk8.6 libwebp7 252s libwebpdemux2 libwebpmux3 libxft2 libxrender1 libxslt1.1 libxss1 libzmq5 252s node-acorn node-argparse node-balanced-match node-brace-expansion 252s node-cjs-module-lexer node-esprima node-js-yaml node-minimatch 252s node-sprintf-js node-undici node-xtend nodejs python-dask-doc 252s python-distributed-doc python-fsspec-doc python-matplotlib-data 252s python-numpy-doc python-pandas-doc python-tinycss2-common python3-aiohttp 252s python3-aiosignal python3-all python3-anyio python3-appdirs python3-argon2 252s python3-arrow python3-asttokens python3-async-timeout python3-bcrypt 252s python3-bleach python3-brotli python3-bs4 python3-cftime python3-click 252s python3-cloudpickle python3-colorama python3-comm python3-contourpy 252s python3-coverage python3-cycler python3-dask python3-dateutil 252s python3-debugpy python3-decorator python3-defusedxml python3-dill 252s python3-distributed python3-doc python3-executing python3-fastjsonschema 252s python3-fonttools python3-fqdn python3-frozenlist python3-fs python3-fsspec 252s python3-h5py python3-h5py-serial python3-html5lib python3-iniconfig 252s python3-ipykernel python3-ipython python3-isoduration python3-jedi 252s python3-joblib python3-jupyter-client python3-jupyter-core 252s python3-jupyter-events python3-jupyter-server 252s python3-jupyter-server-terminals python3-jupyterlab-pygments 252s python3-kiwisolver python3-locket python3-lxml python3-lz4 252s python3-matplotlib python3-matplotlib-inline python3-mistune python3-mpmath 252s python3-msgpack python3-multidict python3-nacl python3-nbclient 252s python3-nbconvert python3-nbformat python3-nest-asyncio python3-netcdf4 252s python3-numpy python3-overrides python3-packaging python3-pandas 252s python3-pandas-lib python3-pandocfilters python3-paramiko python3-parso 252s python3-partd python3-pexpect python3-pil python3-pil.imagetk 252s python3-platformdirs python3-pluggy python3-prometheus-client 252s python3-prompt-toolkit python3-psutil python3-ptyprocess python3-pure-eval 252s python3-py python3-pytest python3-pytest-rerunfailures 252s python3-pytest-timeout python3-pythonjsonlogger python3-rfc3339-validator 252s python3-rfc3986-validator python3-scipy python3-send2trash python3-six 252s python3-sklearn python3-sklearn-lib python3-sniffio python3-sortedcontainers 252s python3-soupsieve python3-stack-data python3-sympy python3-tblib 252s python3-terminado python3-threadpoolctl python3-tinycss2 python3-tk 252s python3-toolz python3-tornado python3-traitlets python3-typeshed python3-tz 252s python3-ufolib2 python3-uritemplate python3-wcwidth python3-webcolors 252s python3-webencodings python3-websocket python3-yarl python3-zict python3-zmq 252s python3.12-doc python3.12-tk python3.13 python3.13-minimal python3.13-tk 252s sass-stylesheets-bulma sphinx-rtd-theme-common tk8.6-blt2.5 tzdata-legacy 252s unicode-data x11-common 252s Suggested packages: 252s blt-demo gdb-doc gdbserver libjs-jquery-ui-docs fonts-mathjax-extras 252s fonts-stix libjs-mathjax-doc libjs-angularjs liblcms2-utils tcl8.6 tk8.6 252s javascript-common npm node-corepack python-imageio-doc python-pytest-doc 252s python-scipy-doc python-skimage-doc python-argon2-doc python-arrow-doc 252s python-bleach-doc python-coverage-doc python-cycler-doc ipython 252s python3-blosc python3-boto3 python3-graphviz python3-skimage 252s python3-sqlalchemy python3-tables python3-objgraph python3-examples 252s python-fastjsonschema-doc python-h5py-doc python3-genshi python-ipython-doc 252s python-joblib-doc python-jupyter-client-doc python3-pip 252s python-jupyter-events-doc python-jupyter-server-doc python-lxml-doc 252s cm-super-minimal dvipng ffmpeg fonts-staypuft ghostscript gir1.2-gtk-3.0 252s inkscape ipython3 librsvg2-common python-matplotlib-doc python3-cairocffi 252s python3-gi-cairo python3-gobject python3-pyqt5 python3-sip 252s texlive-extra-utils texlive-latex-extra python-mpmath-doc python3-gmpy2 252s python-nacl-doc python-nbconvert-doc texlive-fonts-recommended 252s texlive-plain-generic texlive-xetex gcc gfortran python3-dev 252s python3-statsmodels python3-gssapi python3-invoke python-pexpect-doc 252s python-pil-doc subversion python3-dap python-sklearn-doc 252s python-sortedcontainers-doc texlive-fonts-extra python-sympy-doc 252s python-terminado-doc python-tinycss2-doc tix python3-tk-dbg python-toolz-doc 252s python3-pycurl python-tornado-doc python3-twisted python-traitlets-doc 252s python3.13-venv python3.13-doc binfmt-support 252s Recommended packages: 252s javascript-common nodejs-doc python3-aiodns git python3-dropbox 252s python3-fusepy python3-libarchive-c python3-pygit2 python3-simplejson 252s python3-cssselect pandoc python3-bottleneck python3-numexpr python3-odf 252s python3-openpyxl python3-tables python3-blosc python3-olefile g++ 252s | c++-compiler isympy-common 252s The following NEW packages will be installed: 252s autopkgtest-satdep blt fontconfig-config fonts-dejavu-core fonts-dejavu-mono 252s fonts-font-awesome fonts-glyphicons-halflings fonts-lato fonts-lyx 252s fonts-mathjax gdb libaec0 libargon2-1 libbabeltrace1 libblas3 libc6-dbg 252s libcares2 libdebuginfod-common libdebuginfod1t64 libdeflate0 libfontconfig1 252s libfreetype6 libgfortran5 libgomp1 libgraphite2-3 libharfbuzz0b 252s libhdf5-103-1t64 libhdf5-hl-100t64 libimagequant0 libjbig0 libjpeg-turbo8 252s libjpeg8 libjs-bootstrap libjs-jquery libjs-jquery-ui libjs-mathjax 252s libjs-sphinxdoc libjs-sprintf-js libjs-underscore liblapack3 liblbfgsb0 252s liblcms2-2 liblerc4 liblzf1 libnetcdf19t64 libnode115 libnorm1t64 252s libopenjp2-7 libpgm-5.3-0t64 libpython3.12t64 libpython3.13-minimal 252s libpython3.13-stdlib libqhull-r8.0 libraqm0 libsharpyuv0 libsodium23 252s libsource-highlight-common libsource-highlight4t64 libsz2 libtcl8.6 libtiff6 252s libtk8.6 libwebp7 libwebpdemux2 libwebpmux3 libxft2 libxrender1 libxslt1.1 252s libxss1 libzmq5 node-acorn node-argparse node-balanced-match 252s node-brace-expansion node-cjs-module-lexer node-esprima node-js-yaml 252s node-minimatch node-sprintf-js node-undici node-xtend nodejs python-dask-doc 252s python-distributed-doc python-fsspec-doc python-matplotlib-data 252s python-numpy-doc python-pandas-doc python-tinycss2-common python3-aiohttp 252s python3-aiosignal python3-all python3-anyio python3-appdirs python3-argon2 252s python3-arrow python3-asttokens python3-async-timeout python3-bcrypt 252s python3-bleach python3-brotli python3-bs4 python3-cftime python3-click 252s python3-cloudpickle python3-colorama python3-comm python3-contourpy 252s python3-coverage python3-cycler python3-dask python3-dateutil 252s python3-debugpy python3-decorator python3-defusedxml python3-dill 252s python3-distributed python3-doc python3-executing python3-fastjsonschema 252s python3-fonttools python3-fqdn python3-frozenlist python3-fs python3-fsspec 252s python3-h5py python3-h5py-serial python3-html5lib python3-iniconfig 252s python3-ipykernel python3-ipython python3-isoduration python3-jedi 252s python3-joblib python3-jupyter-client python3-jupyter-core 252s python3-jupyter-events python3-jupyter-server 252s python3-jupyter-server-terminals python3-jupyterlab-pygments 252s python3-kiwisolver python3-locket python3-lxml python3-lz4 252s python3-matplotlib python3-matplotlib-inline python3-mistune python3-mpmath 252s python3-msgpack python3-multidict python3-nacl python3-nbclient 252s python3-nbconvert python3-nbformat python3-nest-asyncio python3-netcdf4 252s python3-numpy python3-overrides python3-packaging python3-pandas 252s python3-pandas-lib python3-pandocfilters python3-paramiko python3-parso 252s python3-partd python3-pexpect python3-pil python3-pil.imagetk 252s python3-platformdirs python3-pluggy python3-prometheus-client 252s python3-prompt-toolkit python3-psutil python3-ptyprocess python3-pure-eval 252s python3-py python3-pytest python3-pytest-rerunfailures 252s python3-pytest-timeout python3-pythonjsonlogger python3-rfc3339-validator 252s python3-rfc3986-validator python3-scipy python3-send2trash python3-six 252s python3-sklearn python3-sklearn-lib python3-sniffio python3-sortedcontainers 252s python3-soupsieve python3-stack-data python3-sympy python3-tblib 252s python3-terminado python3-threadpoolctl python3-tinycss2 python3-tk 252s python3-toolz python3-tornado python3-traitlets python3-typeshed python3-tz 252s python3-ufolib2 python3-uritemplate python3-wcwidth python3-webcolors 252s python3-webencodings python3-websocket python3-yarl python3-zict python3-zmq 252s python3.12-doc python3.12-tk python3.13 python3.13-minimal python3.13-tk 252s sass-stylesheets-bulma sphinx-rtd-theme-common tk8.6-blt2.5 tzdata-legacy 252s unicode-data x11-common 252s 0 upgraded, 222 newly installed, 0 to remove and 0 not upgraded. 252s Need to get 179 MB/179 MB of archives. 252s After this operation, 1058 MB of additional disk space will be used. 252s Get:1 /tmp/autopkgtest.1vd31g/1-autopkgtest-satdep.deb autopkgtest-satdep armhf 0 [892 B] 252s Get:2 http://ftpmaster.internal/ubuntu plucky/main armhf fonts-lato all 2.015-1 [2781 kB] 253s Get:3 http://ftpmaster.internal/ubuntu plucky/main armhf libdebuginfod-common all 0.192-4 [15.4 kB] 253s Get:4 http://ftpmaster.internal/ubuntu plucky/main armhf libpython3.13-minimal armhf 3.13.0-2 [866 kB] 253s Get:5 http://ftpmaster.internal/ubuntu plucky/main armhf python3.13-minimal armhf 3.13.0-2 [1854 kB] 253s Get:6 http://ftpmaster.internal/ubuntu plucky/main armhf libtcl8.6 armhf 8.6.15+dfsg-2 [909 kB] 253s Get:7 http://ftpmaster.internal/ubuntu plucky/main armhf libfreetype6 armhf 2.13.3+dfsg-1 [330 kB] 253s Get:8 http://ftpmaster.internal/ubuntu plucky/main armhf fonts-dejavu-mono all 2.37-8 [502 kB] 253s Get:9 http://ftpmaster.internal/ubuntu plucky/main armhf fonts-dejavu-core all 2.37-8 [835 kB] 253s Get:10 http://ftpmaster.internal/ubuntu plucky/main armhf fontconfig-config armhf 2.15.0-1.1ubuntu2 [37.4 kB] 253s Get:11 http://ftpmaster.internal/ubuntu plucky/main armhf libfontconfig1 armhf 2.15.0-1.1ubuntu2 [113 kB] 253s Get:12 http://ftpmaster.internal/ubuntu plucky/main armhf libxrender1 armhf 1:0.9.10-1.1build1 [16.0 kB] 253s Get:13 http://ftpmaster.internal/ubuntu plucky/main armhf libxft2 armhf 2.3.6-1build1 [37.4 kB] 253s Get:14 http://ftpmaster.internal/ubuntu plucky/main armhf x11-common all 1:7.7+23ubuntu3 [21.7 kB] 253s Get:15 http://ftpmaster.internal/ubuntu plucky/main armhf libxss1 armhf 1:1.2.3-1build3 [6500 B] 253s Get:16 http://ftpmaster.internal/ubuntu plucky/main armhf libtk8.6 armhf 8.6.15-1 [685 kB] 253s Get:17 http://ftpmaster.internal/ubuntu plucky/main armhf tk8.6-blt2.5 armhf 2.5.3+dfsg-7build1 [525 kB] 253s Get:18 http://ftpmaster.internal/ubuntu plucky/main armhf blt armhf 2.5.3+dfsg-7build1 [4840 B] 253s Get:19 http://ftpmaster.internal/ubuntu plucky/main armhf fonts-font-awesome all 5.0.10+really4.7.0~dfsg-4.1 [516 kB] 253s Get:20 http://ftpmaster.internal/ubuntu plucky/universe armhf fonts-glyphicons-halflings all 1.009~3.4.1+dfsg-3 [118 kB] 253s Get:21 http://ftpmaster.internal/ubuntu plucky/universe armhf fonts-lyx all 2.4.2.1-1 [171 kB] 253s Get:22 http://ftpmaster.internal/ubuntu plucky/main armhf fonts-mathjax all 2.7.9+dfsg-1 [2208 kB] 253s Get:23 http://ftpmaster.internal/ubuntu plucky/main armhf libbabeltrace1 armhf 1.5.11-4build1 [153 kB] 253s Get:24 http://ftpmaster.internal/ubuntu plucky/main armhf libdebuginfod1t64 armhf 0.192-4 [19.6 kB] 253s Get:25 http://ftpmaster.internal/ubuntu plucky/main armhf libpython3.12t64 armhf 3.12.7-3 [2075 kB] 253s Get:26 http://ftpmaster.internal/ubuntu plucky/main armhf libsource-highlight-common all 3.1.9-4.3build1 [64.2 kB] 253s Get:27 http://ftpmaster.internal/ubuntu plucky/main armhf libsource-highlight4t64 armhf 3.1.9-4.3build1 [306 kB] 253s Get:28 http://ftpmaster.internal/ubuntu plucky/main armhf libc6-dbg armhf 2.40-1ubuntu3 [6138 kB] 253s Get:29 http://ftpmaster.internal/ubuntu plucky/main armhf gdb armhf 15.1-1ubuntu2 [3947 kB] 253s Get:30 http://ftpmaster.internal/ubuntu plucky/universe armhf libaec0 armhf 1.1.3-1 [20.8 kB] 253s Get:31 http://ftpmaster.internal/ubuntu plucky/main armhf libargon2-1 armhf 0~20190702+dfsg-4build1 [22.6 kB] 253s Get:32 http://ftpmaster.internal/ubuntu plucky/main armhf libblas3 armhf 3.12.0-3build2 [126 kB] 253s Get:33 http://ftpmaster.internal/ubuntu plucky/main armhf libcares2 armhf 1.34.2-1 [79.8 kB] 253s Get:34 http://ftpmaster.internal/ubuntu plucky/main armhf libdeflate0 armhf 1.22-1 [38.9 kB] 253s Get:35 http://ftpmaster.internal/ubuntu plucky/main armhf libgfortran5 armhf 14.2.0-8ubuntu1 [311 kB] 253s Get:36 http://ftpmaster.internal/ubuntu plucky/main armhf libgomp1 armhf 14.2.0-8ubuntu1 [125 kB] 253s Get:37 http://ftpmaster.internal/ubuntu plucky/main armhf libgraphite2-3 armhf 1.3.14-2ubuntu1 [64.8 kB] 253s Get:38 http://ftpmaster.internal/ubuntu plucky/main armhf libharfbuzz0b armhf 10.0.1-1 [463 kB] 253s Get:39 http://ftpmaster.internal/ubuntu plucky/universe armhf libsz2 armhf 1.1.3-1 [5302 B] 254s Get:40 http://ftpmaster.internal/ubuntu plucky/universe armhf libhdf5-103-1t64 armhf 1.10.10+repack-4ubuntu3 [1327 kB] 254s Get:41 http://ftpmaster.internal/ubuntu plucky/universe armhf libhdf5-hl-100t64 armhf 1.10.10+repack-4ubuntu3 [55.9 kB] 254s Get:42 http://ftpmaster.internal/ubuntu plucky/main armhf libimagequant0 armhf 2.18.0-1build1 [31.1 kB] 254s Get:43 http://ftpmaster.internal/ubuntu plucky/main armhf libjpeg-turbo8 armhf 2.1.5-3ubuntu2 [127 kB] 254s Get:44 http://ftpmaster.internal/ubuntu plucky/main armhf libjpeg8 armhf 8c-2ubuntu11 [2148 B] 254s Get:45 http://ftpmaster.internal/ubuntu plucky/universe armhf libjs-bootstrap all 3.4.1+dfsg-3 [129 kB] 254s Get:46 http://ftpmaster.internal/ubuntu plucky/main armhf libjs-jquery all 3.6.1+dfsg+~3.5.14-1 [328 kB] 254s Get:47 http://ftpmaster.internal/ubuntu plucky/universe armhf libjs-jquery-ui all 1.13.2+dfsg-1 [252 kB] 254s Get:48 http://ftpmaster.internal/ubuntu plucky/main armhf libjs-underscore all 1.13.4~dfsg+~1.11.4-3 [118 kB] 254s Get:49 http://ftpmaster.internal/ubuntu plucky/main armhf libjs-sphinxdoc all 7.4.7-4 [158 kB] 254s Get:50 http://ftpmaster.internal/ubuntu plucky/universe armhf libjs-sprintf-js all 1.1.2+ds1+~1.1.2-1 [12.8 kB] 254s Get:51 http://ftpmaster.internal/ubuntu plucky/main armhf liblapack3 armhf 3.12.0-3build2 [2086 kB] 254s Get:52 http://ftpmaster.internal/ubuntu plucky/universe armhf liblbfgsb0 armhf 3.0+dfsg.4-1build1 [27.4 kB] 254s Get:53 http://ftpmaster.internal/ubuntu plucky/main armhf liblcms2-2 armhf 2.16-2 [137 kB] 254s Get:54 http://ftpmaster.internal/ubuntu plucky/main armhf liblerc4 armhf 4.0.0+ds-5ubuntu1 [160 kB] 254s Get:55 http://ftpmaster.internal/ubuntu plucky/universe armhf liblzf1 armhf 3.6-4 [6554 B] 254s Get:56 http://ftpmaster.internal/ubuntu plucky/universe armhf libnetcdf19t64 armhf 1:4.9.2-6ubuntu1 [419 kB] 254s Get:57 http://ftpmaster.internal/ubuntu plucky/universe armhf node-xtend all 4.0.2-3 [3902 B] 254s Get:58 http://ftpmaster.internal/ubuntu plucky/universe armhf nodejs armhf 20.18.0+dfsg-2 [336 kB] 254s Get:59 http://ftpmaster.internal/ubuntu plucky/universe armhf node-acorn all 8.8.1+ds+~cs25.17.7-2 [115 kB] 254s Get:60 http://ftpmaster.internal/ubuntu plucky/universe armhf node-cjs-module-lexer all 1.2.3+dfsg-1 [32.1 kB] 254s Get:61 http://ftpmaster.internal/ubuntu plucky/universe armhf node-balanced-match all 2.0.0-1 [4910 B] 254s Get:62 http://ftpmaster.internal/ubuntu plucky/universe armhf node-brace-expansion all 2.0.1+~1.1.0-1 [8072 B] 254s Get:63 http://ftpmaster.internal/ubuntu plucky/universe armhf node-minimatch all 9.0.3-5 [78.2 kB] 254s Get:64 http://ftpmaster.internal/ubuntu plucky/universe armhf node-undici all 5.28.4+dfsg1+~cs23.12.11-2 [321 kB] 254s Get:65 http://ftpmaster.internal/ubuntu plucky/universe armhf libnode115 armhf 20.18.0+dfsg-2 [12.2 MB] 254s Get:66 http://ftpmaster.internal/ubuntu plucky/universe armhf libnorm1t64 armhf 1.5.9+dfsg-3.1build1 [206 kB] 254s Get:67 http://ftpmaster.internal/ubuntu plucky/universe armhf libpgm-5.3-0t64 armhf 5.3.128~dfsg-2.1build1 [171 kB] 254s Get:68 http://ftpmaster.internal/ubuntu plucky/main armhf libpython3.13-stdlib armhf 3.13.0-2 [1972 kB] 254s Get:69 http://ftpmaster.internal/ubuntu plucky/universe armhf libqhull-r8.0 armhf 2020.2-6build1 [173 kB] 254s Get:70 http://ftpmaster.internal/ubuntu plucky/main armhf libraqm0 armhf 0.10.1-1build1 [12.4 kB] 254s Get:71 http://ftpmaster.internal/ubuntu plucky/main armhf libsharpyuv0 armhf 1.4.0-0.1 [16.3 kB] 254s Get:72 http://ftpmaster.internal/ubuntu plucky/main armhf libsodium23 armhf 1.0.18-1build3 [139 kB] 254s Get:73 http://ftpmaster.internal/ubuntu plucky/main armhf libjbig0 armhf 2.1-6.1ubuntu2 [24.9 kB] 254s Get:74 http://ftpmaster.internal/ubuntu plucky/main armhf libwebp7 armhf 1.4.0-0.1 [184 kB] 254s Get:75 http://ftpmaster.internal/ubuntu plucky/main armhf libtiff6 armhf 4.5.1+git230720-4ubuntu4 [179 kB] 254s Get:76 http://ftpmaster.internal/ubuntu plucky/main armhf libwebpdemux2 armhf 1.4.0-0.1 [11.8 kB] 254s Get:77 http://ftpmaster.internal/ubuntu plucky/main armhf libwebpmux3 armhf 1.4.0-0.1 [22.5 kB] 254s Get:78 http://ftpmaster.internal/ubuntu plucky/main armhf libxslt1.1 armhf 1.1.39-0exp1ubuntu1 [150 kB] 254s Get:79 http://ftpmaster.internal/ubuntu plucky/universe armhf libzmq5 armhf 4.3.5-1build2 [262 kB] 254s Get:80 http://ftpmaster.internal/ubuntu plucky/universe armhf node-esprima all 4.0.1+ds+~4.0.3-2 [69.3 kB] 254s Get:81 http://ftpmaster.internal/ubuntu plucky/universe armhf node-sprintf-js all 1.1.2+ds1+~1.1.2-1 [3916 B] 254s Get:82 http://ftpmaster.internal/ubuntu plucky/universe armhf node-argparse all 2.0.1-2 [33.2 kB] 254s Get:83 http://ftpmaster.internal/ubuntu plucky/universe armhf node-js-yaml all 4.1.0+dfsg+~4.0.5-7 [61.9 kB] 254s Get:84 http://ftpmaster.internal/ubuntu plucky/main armhf libjs-mathjax all 2.7.9+dfsg-1 [5665 kB] 254s Get:85 http://ftpmaster.internal/ubuntu plucky/universe armhf python-dask-doc all 2024.5.2+dfsg-1 [10.8 MB] 255s Get:86 http://ftpmaster.internal/ubuntu plucky/main armhf sphinx-rtd-theme-common all 3.0.2+dfsg-1 [1014 kB] 255s Get:87 http://ftpmaster.internal/ubuntu plucky/universe armhf python-fsspec-doc all 2024.9.0-1 [313 kB] 255s Get:88 http://ftpmaster.internal/ubuntu plucky/main armhf python-numpy-doc all 1:1.26.4+ds-11ubuntu1 [5481 kB] 255s Get:89 http://ftpmaster.internal/ubuntu plucky/universe armhf python-pandas-doc all 2.2.3+dfsg-5ubuntu1 [9117 kB] 255s Get:90 http://ftpmaster.internal/ubuntu plucky/main armhf python3.12-doc all 3.12.7-3 [12.4 MB] 255s Get:91 http://ftpmaster.internal/ubuntu plucky-proposed/main armhf python3-doc all 3.12.7-1 [10.3 kB] 255s Get:92 http://ftpmaster.internal/ubuntu plucky/universe armhf sass-stylesheets-bulma all 0.9.4~ds-1 [113 kB] 255s Get:93 http://ftpmaster.internal/ubuntu plucky/universe armhf python-distributed-doc all 2024.5.2+ds.1-8 [3143 kB] 255s Get:94 http://ftpmaster.internal/ubuntu plucky/universe armhf python-matplotlib-data all 3.8.3-3ubuntu1 [2928 kB] 255s Get:95 http://ftpmaster.internal/ubuntu plucky/universe armhf python-tinycss2-common all 1.4.0-1 [47.0 kB] 255s Get:96 http://ftpmaster.internal/ubuntu plucky/universe armhf python3-multidict armhf 6.1.0-1build1 [34.6 kB] 255s Get:97 http://ftpmaster.internal/ubuntu plucky/universe armhf python3-yarl armhf 1.9.4-1 [67.1 kB] 255s Get:98 http://ftpmaster.internal/ubuntu plucky/universe armhf python3-async-timeout all 4.0.3-1 [6412 B] 255s Get:99 http://ftpmaster.internal/ubuntu plucky/universe armhf python3-frozenlist armhf 1.5.0-1build1 [56.1 kB] 255s Get:100 http://ftpmaster.internal/ubuntu plucky/universe armhf python3-aiosignal all 1.3.1-1 [5172 B] 255s Get:101 http://ftpmaster.internal/ubuntu plucky/universe armhf python3-aiohttp armhf 3.9.5-1 [274 kB] 255s Get:102 http://ftpmaster.internal/ubuntu plucky/main armhf python3.13 armhf 3.13.0-2 [719 kB] 255s Get:103 http://ftpmaster.internal/ubuntu plucky-proposed/main armhf python3-all armhf 3.12.7-1 [890 B] 256s Get:104 http://ftpmaster.internal/ubuntu plucky/universe armhf python3-sniffio all 1.3.1-1 [7262 B] 256s Get:105 http://ftpmaster.internal/ubuntu plucky/universe armhf python3-anyio all 4.6.2-4 [60.0 kB] 256s Get:106 http://ftpmaster.internal/ubuntu plucky/main armhf python3-appdirs all 1.4.4-4 [10.9 kB] 256s Get:107 http://ftpmaster.internal/ubuntu plucky/universe armhf python3-argon2 armhf 21.1.0-2build1 [19.9 kB] 256s Get:108 http://ftpmaster.internal/ubuntu plucky/main armhf python3-dateutil all 2.9.0-3 [80.2 kB] 256s Get:109 http://ftpmaster.internal/ubuntu plucky/main armhf python3-arrow all 1.3.0-1.1ubuntu1 [56.1 kB] 256s Get:110 http://ftpmaster.internal/ubuntu plucky/universe armhf python3-asttokens all 2.4.1-2 [20.8 kB] 256s Get:111 http://ftpmaster.internal/ubuntu plucky/main armhf python3-webencodings all 0.5.1-5 [11.5 kB] 256s Get:112 http://ftpmaster.internal/ubuntu plucky/main armhf python3-html5lib all 1.2-1 [90.8 kB] 256s Get:113 http://ftpmaster.internal/ubuntu plucky/universe armhf python3-bleach all 6.2.0-1 [43.9 kB] 256s Get:114 http://ftpmaster.internal/ubuntu plucky/universe armhf python3-brotli armhf 1.1.0-2build3 [324 kB] 256s Get:115 http://ftpmaster.internal/ubuntu plucky/main armhf python3-soupsieve all 2.6-1 [33.0 kB] 256s Get:116 http://ftpmaster.internal/ubuntu plucky/main armhf python3-bs4 all 4.12.3-3 [109 kB] 256s Get:117 http://ftpmaster.internal/ubuntu plucky/main armhf python3-numpy armhf 1:1.26.4+ds-11ubuntu1 [3975 kB] 256s Get:118 http://ftpmaster.internal/ubuntu plucky/universe armhf python3-cftime armhf 1.6.4-1build1 [304 kB] 256s Get:119 http://ftpmaster.internal/ubuntu plucky/main armhf python3-colorama all 0.4.6-4 [32.1 kB] 256s Get:120 http://ftpmaster.internal/ubuntu plucky/main armhf python3-click all 8.1.7-2 [79.5 kB] 256s Get:121 http://ftpmaster.internal/ubuntu plucky/universe armhf python3-cloudpickle all 3.0.0-2 [21.5 kB] 256s Get:122 http://ftpmaster.internal/ubuntu plucky/universe armhf python3-traitlets all 5.14.3+really5.14.3-1 [71.5 kB] 256s Get:123 http://ftpmaster.internal/ubuntu plucky/universe armhf python3-comm all 0.2.1-1 [7016 B] 256s Get:124 http://ftpmaster.internal/ubuntu plucky/universe armhf python3-contourpy armhf 1.3.0-2build1 [238 kB] 256s Get:125 http://ftpmaster.internal/ubuntu plucky/universe armhf python3-coverage armhf 7.4.4+dfsg1-0ubuntu3 [148 kB] 256s Get:126 http://ftpmaster.internal/ubuntu plucky/universe armhf python3-cycler all 0.12.1-1 [9716 B] 256s Get:127 http://ftpmaster.internal/ubuntu plucky/universe armhf python3-fsspec all 2024.9.0-1 [207 kB] 256s Get:128 http://ftpmaster.internal/ubuntu plucky/universe armhf python3-toolz all 1.0.0-1 [44.9 kB] 256s Get:129 http://ftpmaster.internal/ubuntu plucky/main armhf python3-packaging all 24.2-1 [51.5 kB] 256s Get:130 http://ftpmaster.internal/ubuntu plucky/universe armhf python3-locket all 1.0.0-2 [5872 B] 256s Get:131 http://ftpmaster.internal/ubuntu plucky/universe armhf python3-partd all 1.4.2-1 [15.7 kB] 256s Get:132 http://ftpmaster.internal/ubuntu plucky/universe armhf python3-dask all 2024.5.2+dfsg-1 [849 kB] 256s Get:133 http://ftpmaster.internal/ubuntu plucky/universe armhf python3-debugpy armhf 1.8.8+ds-2ubuntu1 [1077 kB] 256s Get:134 http://ftpmaster.internal/ubuntu plucky/main armhf python3-decorator all 5.1.1-5 [10.1 kB] 256s Get:135 http://ftpmaster.internal/ubuntu plucky/main armhf python3-defusedxml all 0.7.1-2 [42.0 kB] 256s Get:136 http://ftpmaster.internal/ubuntu plucky/universe armhf python3-dill all 0.3.9-1 [84.5 kB] 256s Get:137 http://ftpmaster.internal/ubuntu plucky/main armhf python3-msgpack armhf 1.0.3-3build3 [106 kB] 256s Get:138 http://ftpmaster.internal/ubuntu plucky/main armhf python3-psutil armhf 5.9.8-2build3 [194 kB] 256s Get:139 http://ftpmaster.internal/ubuntu plucky/main armhf python3-sortedcontainers all 2.4.0-2 [27.6 kB] 256s Get:140 http://ftpmaster.internal/ubuntu plucky/universe armhf python3-tblib all 3.0.0-5 [12.9 kB] 256s Get:141 http://ftpmaster.internal/ubuntu plucky/main armhf python3-tornado armhf 6.4.1-3 [298 kB] 256s Get:142 http://ftpmaster.internal/ubuntu plucky/universe armhf python3-zict all 3.0.0-2ubuntu1 [30.4 kB] 256s Get:143 http://ftpmaster.internal/ubuntu plucky/universe armhf python3-distributed all 2024.5.2+ds.1-8 [1006 kB] 256s Get:144 http://ftpmaster.internal/ubuntu plucky/universe armhf python3-executing all 2.1.0-0.1 [24.4 kB] 256s Get:145 http://ftpmaster.internal/ubuntu plucky/universe armhf python3-fastjsonschema all 2.20.0-1 [20.1 kB] 256s Get:146 http://ftpmaster.internal/ubuntu plucky/main armhf python3-tz all 2024.1-2 [31.4 kB] 256s Get:147 http://ftpmaster.internal/ubuntu plucky/main armhf python3-six all 1.16.0-7 [13.1 kB] 256s Get:148 http://ftpmaster.internal/ubuntu plucky/universe armhf python3-fs all 2.4.16-4 [91.3 kB] 256s Get:149 http://ftpmaster.internal/ubuntu plucky/main armhf python3-lxml armhf 5.3.0-1build1 [1630 kB] 256s Get:150 http://ftpmaster.internal/ubuntu plucky/universe armhf python3-lz4 armhf 4.0.2+dfsg-1build5 [25.5 kB] 256s Get:151 http://ftpmaster.internal/ubuntu plucky/universe armhf python3-scipy armhf 1.13.1-5ubuntu1 [19.1 MB] 257s Get:152 http://ftpmaster.internal/ubuntu plucky/universe armhf python3-mpmath all 1.3.0-1 [425 kB] 257s Get:153 http://ftpmaster.internal/ubuntu plucky/universe armhf python3-sympy all 1.13.3-1 [4228 kB] 257s Get:154 http://ftpmaster.internal/ubuntu plucky/universe armhf python3-ufolib2 all 0.16.1+dfsg1-1 [33.4 kB] 257s Get:155 http://ftpmaster.internal/ubuntu plucky/universe armhf unicode-data all 15.1.0-1 [8878 kB] 258s Get:156 http://ftpmaster.internal/ubuntu plucky/universe armhf python3-fonttools armhf 4.55.0-3 [1626 kB] 258s Get:157 http://ftpmaster.internal/ubuntu plucky/universe armhf python3-fqdn all 1.5.1-2 [7688 B] 258s Get:158 http://ftpmaster.internal/ubuntu plucky/universe armhf python3-h5py-serial armhf 3.11.0-5ubuntu1 [1061 kB] 258s Get:159 http://ftpmaster.internal/ubuntu plucky/universe armhf python3-h5py all 3.11.0-5ubuntu1 [7974 B] 258s Get:160 http://ftpmaster.internal/ubuntu plucky/universe armhf python3-iniconfig all 1.1.1-2 [6024 B] 258s Get:161 http://ftpmaster.internal/ubuntu plucky/universe armhf python3-parso all 0.8.3-1 [67.2 kB] 258s Get:162 http://ftpmaster.internal/ubuntu plucky/universe armhf python3-typeshed all 0.0~git20231111.6764465-3 [1274 kB] 258s Get:163 http://ftpmaster.internal/ubuntu plucky/universe armhf python3-jedi all 0.19.1+ds1-1 [693 kB] 258s Get:164 http://ftpmaster.internal/ubuntu plucky/universe armhf python3-matplotlib-inline all 0.1.6-2 [8784 B] 258s Get:165 http://ftpmaster.internal/ubuntu plucky/main armhf python3-wcwidth all 0.2.13+dfsg1-1 [26.3 kB] 258s Get:166 http://ftpmaster.internal/ubuntu plucky/universe armhf python3-prompt-toolkit all 3.0.48-1 [256 kB] 258s Get:167 http://ftpmaster.internal/ubuntu plucky/universe armhf python3-pure-eval all 0.2.3-1 [11.4 kB] 258s Get:168 http://ftpmaster.internal/ubuntu plucky/universe armhf python3-stack-data all 0.6.3-1 [22.0 kB] 258s Get:169 http://ftpmaster.internal/ubuntu plucky/main armhf python3-ptyprocess all 0.7.0-6 [14.8 kB] 258s Get:170 http://ftpmaster.internal/ubuntu plucky/main armhf python3-pexpect all 4.9-3 [48.1 kB] 258s Get:171 http://ftpmaster.internal/ubuntu plucky/universe armhf python3-ipython all 8.29.0-1 [569 kB] 258s Get:172 http://ftpmaster.internal/ubuntu plucky/main armhf python3-platformdirs all 4.3.6-1 [16.8 kB] 258s Get:173 http://ftpmaster.internal/ubuntu plucky/universe armhf python3-jupyter-core all 5.7.2-4 [28.0 kB] 258s Get:174 http://ftpmaster.internal/ubuntu plucky/universe armhf python3-py all 1.11.0-2 [72.7 kB] 258s Get:175 http://ftpmaster.internal/ubuntu plucky/universe armhf python3-zmq armhf 24.0.1-5build2 [352 kB] 258s Get:176 http://ftpmaster.internal/ubuntu plucky/universe armhf python3-jupyter-client all 8.6.3-1 [78.2 kB] 258s Get:177 http://ftpmaster.internal/ubuntu plucky/universe armhf python3-nest-asyncio all 1.5.4-1 [6256 B] 258s Get:178 http://ftpmaster.internal/ubuntu plucky/universe armhf python3-ipykernel all 6.29.5-1 [82.5 kB] 258s Get:179 http://ftpmaster.internal/ubuntu plucky/universe armhf python3-isoduration all 20.11.0+git20211126.ae0bd61-2 [12.5 kB] 258s Get:180 http://ftpmaster.internal/ubuntu plucky/universe armhf python3-joblib all 1.3.2-5 [206 kB] 258s Get:181 http://ftpmaster.internal/ubuntu plucky/universe armhf python3-pythonjsonlogger all 3.1.0-1 [11.8 kB] 258s Get:182 http://ftpmaster.internal/ubuntu plucky/universe armhf python3-rfc3339-validator all 0.1.4-2 [3930 B] 258s Get:183 http://ftpmaster.internal/ubuntu plucky/universe armhf python3-rfc3986-validator all 0.1.1-2 [4758 B] 258s Get:184 http://ftpmaster.internal/ubuntu plucky/universe armhf python3-uritemplate all 4.1.1-3 [9762 B] 258s Get:185 http://ftpmaster.internal/ubuntu plucky/universe armhf python3-webcolors all 1.13-1 [13.6 kB] 258s Get:186 http://ftpmaster.internal/ubuntu plucky/universe armhf python3-jupyter-events all 0.10.0-3 [15.5 kB] 258s Get:187 http://ftpmaster.internal/ubuntu plucky/universe armhf python3-terminado all 0.18.1-1 [13.2 kB] 258s Get:188 http://ftpmaster.internal/ubuntu plucky/universe armhf python3-jupyter-server-terminals all 0.5.3-2 [10.9 kB] 258s Get:189 http://ftpmaster.internal/ubuntu plucky/universe armhf python3-jupyterlab-pygments all 0.2.2-3 [6054 B] 258s Get:190 http://ftpmaster.internal/ubuntu plucky/universe armhf python3-mistune all 3.0.2-2 [32.9 kB] 258s Get:191 http://ftpmaster.internal/ubuntu plucky/universe armhf python3-nbformat all 5.9.1-1 [41.2 kB] 258s Get:192 http://ftpmaster.internal/ubuntu plucky/universe armhf python3-nbclient all 0.8.0-1 [55.6 kB] 258s Get:193 http://ftpmaster.internal/ubuntu plucky/universe armhf python3-pandocfilters all 1.5.1-1 [23.6 kB] 258s Get:194 http://ftpmaster.internal/ubuntu plucky/universe armhf python3-tinycss2 all 1.4.0-1 [22.5 kB] 258s Get:195 http://ftpmaster.internal/ubuntu plucky/universe armhf python3-nbconvert all 7.16.4-2 [139 kB] 258s Get:196 http://ftpmaster.internal/ubuntu plucky/universe armhf python3-overrides all 7.7.0-2 [14.4 kB] 258s Get:197 http://ftpmaster.internal/ubuntu plucky/main armhf python3-prometheus-client all 0.19.0+ds1-1 [41.7 kB] 258s Get:198 http://ftpmaster.internal/ubuntu plucky/universe armhf python3-send2trash all 1.8.3-1 [14.6 kB] 258s Get:199 http://ftpmaster.internal/ubuntu plucky/universe armhf python3-websocket all 1.8.0-2 [38.5 kB] 258s Get:200 http://ftpmaster.internal/ubuntu plucky/universe armhf python3-jupyter-server all 2.14.2-4 [183 kB] 258s Get:201 http://ftpmaster.internal/ubuntu plucky/universe armhf python3-kiwisolver armhf 1.4.7-2build1 [71.1 kB] 258s Get:202 http://ftpmaster.internal/ubuntu plucky/main armhf libopenjp2-7 armhf 2.5.0-2ubuntu1 [170 kB] 258s Get:203 http://ftpmaster.internal/ubuntu plucky/main armhf python3-pil armhf 10.4.0-1ubuntu2 [446 kB] 258s Get:204 http://ftpmaster.internal/ubuntu plucky/main armhf python3.12-tk armhf 3.12.7-3 [112 kB] 259s Get:205 http://ftpmaster.internal/ubuntu plucky/main armhf python3.13-tk armhf 3.13.0-2 [103 kB] 259s Get:206 http://ftpmaster.internal/ubuntu plucky/main armhf python3-tk armhf 3.12.7-1 [9752 B] 259s Get:207 http://ftpmaster.internal/ubuntu plucky/universe armhf python3-pil.imagetk armhf 10.4.0-1ubuntu2 [8970 B] 259s Get:208 http://ftpmaster.internal/ubuntu plucky/universe armhf python3-matplotlib armhf 3.8.3-3ubuntu1 [4597 kB] 260s Get:209 http://ftpmaster.internal/ubuntu plucky/main armhf python3-nacl armhf 1.5.0-6 [54.1 kB] 260s Get:210 http://ftpmaster.internal/ubuntu plucky/universe armhf python3-netcdf4 armhf 1.7.2-1build1 [849 kB] 260s Get:211 http://ftpmaster.internal/ubuntu plucky/universe armhf python3-pandas-lib armhf 2.2.3+dfsg-5ubuntu1 [7608 kB] 261s Get:212 http://ftpmaster.internal/ubuntu plucky/universe armhf python3-pandas all 2.2.3+dfsg-5ubuntu1 [3112 kB] 261s Get:213 http://ftpmaster.internal/ubuntu plucky/main armhf python3-bcrypt armhf 4.2.0-2.1 [239 kB] 261s Get:214 http://ftpmaster.internal/ubuntu plucky/main armhf python3-paramiko all 3.4.1-2ubuntu1 [146 kB] 262s Get:215 http://ftpmaster.internal/ubuntu plucky/universe armhf python3-pluggy all 1.5.0-1 [21.0 kB] 262s Get:216 http://ftpmaster.internal/ubuntu plucky/universe armhf python3-pytest all 8.3.3-1 [251 kB] 262s Get:217 http://ftpmaster.internal/ubuntu plucky/universe armhf python3-pytest-rerunfailures all 14.0-2 [13.7 kB] 262s Get:218 http://ftpmaster.internal/ubuntu plucky/universe armhf python3-pytest-timeout all 2.3.1-1 [22.1 kB] 262s Get:219 http://ftpmaster.internal/ubuntu plucky/universe armhf python3-threadpoolctl all 3.1.0-1 [21.3 kB] 262s Get:220 http://ftpmaster.internal/ubuntu plucky/universe armhf python3-sklearn-lib armhf 1.4.2+dfsg-6build1 [6321 kB] 262s Get:221 http://ftpmaster.internal/ubuntu plucky/universe armhf python3-sklearn all 1.4.2+dfsg-6build1 [2257 kB] 262s Get:222 http://ftpmaster.internal/ubuntu plucky/main armhf tzdata-legacy all 2024b-1ubuntu2 [99.9 kB] 263s Preconfiguring packages ... 263s Fetched 179 MB in 10s (17.8 MB/s) 263s Selecting previously unselected package fonts-lato. 263s (Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 59616 files and directories currently installed.) 263s Preparing to unpack .../000-fonts-lato_2.015-1_all.deb ... 263s Unpacking fonts-lato (2.015-1) ... 263s Selecting previously unselected package libdebuginfod-common. 263s Preparing to unpack .../001-libdebuginfod-common_0.192-4_all.deb ... 263s Unpacking libdebuginfod-common (0.192-4) ... 263s Selecting previously unselected package libpython3.13-minimal:armhf. 263s Preparing to unpack .../002-libpython3.13-minimal_3.13.0-2_armhf.deb ... 263s Unpacking libpython3.13-minimal:armhf (3.13.0-2) ... 263s Selecting previously unselected package python3.13-minimal. 263s Preparing to unpack .../003-python3.13-minimal_3.13.0-2_armhf.deb ... 263s Unpacking python3.13-minimal (3.13.0-2) ... 263s Selecting previously unselected package libtcl8.6:armhf. 263s Preparing to unpack .../004-libtcl8.6_8.6.15+dfsg-2_armhf.deb ... 263s Unpacking libtcl8.6:armhf (8.6.15+dfsg-2) ... 264s Selecting previously unselected package libfreetype6:armhf. 264s Preparing to unpack .../005-libfreetype6_2.13.3+dfsg-1_armhf.deb ... 264s Unpacking libfreetype6:armhf (2.13.3+dfsg-1) ... 264s Selecting previously unselected package fonts-dejavu-mono. 264s Preparing to unpack .../006-fonts-dejavu-mono_2.37-8_all.deb ... 264s Unpacking fonts-dejavu-mono (2.37-8) ... 264s Selecting previously unselected package fonts-dejavu-core. 264s Preparing to unpack .../007-fonts-dejavu-core_2.37-8_all.deb ... 264s Unpacking fonts-dejavu-core (2.37-8) ... 264s Selecting previously unselected package fontconfig-config. 264s Preparing to unpack .../008-fontconfig-config_2.15.0-1.1ubuntu2_armhf.deb ... 264s Unpacking fontconfig-config (2.15.0-1.1ubuntu2) ... 264s Selecting previously unselected package libfontconfig1:armhf. 264s Preparing to unpack .../009-libfontconfig1_2.15.0-1.1ubuntu2_armhf.deb ... 264s Unpacking libfontconfig1:armhf (2.15.0-1.1ubuntu2) ... 264s Selecting previously unselected package libxrender1:armhf. 264s Preparing to unpack .../010-libxrender1_1%3a0.9.10-1.1build1_armhf.deb ... 264s Unpacking libxrender1:armhf (1:0.9.10-1.1build1) ... 264s Selecting previously unselected package libxft2:armhf. 264s Preparing to unpack .../011-libxft2_2.3.6-1build1_armhf.deb ... 264s Unpacking libxft2:armhf (2.3.6-1build1) ... 264s Selecting previously unselected package x11-common. 264s Preparing to unpack .../012-x11-common_1%3a7.7+23ubuntu3_all.deb ... 264s Unpacking x11-common (1:7.7+23ubuntu3) ... 264s Selecting previously unselected package libxss1:armhf. 264s Preparing to unpack .../013-libxss1_1%3a1.2.3-1build3_armhf.deb ... 264s Unpacking libxss1:armhf (1:1.2.3-1build3) ... 264s Selecting previously unselected package libtk8.6:armhf. 264s Preparing to unpack .../014-libtk8.6_8.6.15-1_armhf.deb ... 264s Unpacking libtk8.6:armhf (8.6.15-1) ... 264s Selecting previously unselected package tk8.6-blt2.5. 265s Preparing to unpack .../015-tk8.6-blt2.5_2.5.3+dfsg-7build1_armhf.deb ... 265s Unpacking tk8.6-blt2.5 (2.5.3+dfsg-7build1) ... 265s Selecting previously unselected package blt. 265s Preparing to unpack .../016-blt_2.5.3+dfsg-7build1_armhf.deb ... 265s Unpacking blt (2.5.3+dfsg-7build1) ... 265s Selecting previously unselected package fonts-font-awesome. 265s Preparing to unpack .../017-fonts-font-awesome_5.0.10+really4.7.0~dfsg-4.1_all.deb ... 265s Unpacking fonts-font-awesome (5.0.10+really4.7.0~dfsg-4.1) ... 265s Selecting previously unselected package fonts-glyphicons-halflings. 265s Preparing to unpack .../018-fonts-glyphicons-halflings_1.009~3.4.1+dfsg-3_all.deb ... 265s Unpacking fonts-glyphicons-halflings (1.009~3.4.1+dfsg-3) ... 265s Selecting previously unselected package fonts-lyx. 265s Preparing to unpack .../019-fonts-lyx_2.4.2.1-1_all.deb ... 265s Unpacking fonts-lyx (2.4.2.1-1) ... 265s Selecting previously unselected package fonts-mathjax. 265s Preparing to unpack .../020-fonts-mathjax_2.7.9+dfsg-1_all.deb ... 265s Unpacking fonts-mathjax (2.7.9+dfsg-1) ... 265s Selecting previously unselected package libbabeltrace1:armhf. 265s Preparing to unpack .../021-libbabeltrace1_1.5.11-4build1_armhf.deb ... 265s Unpacking libbabeltrace1:armhf (1.5.11-4build1) ... 265s Selecting previously unselected package libdebuginfod1t64:armhf. 265s Preparing to unpack .../022-libdebuginfod1t64_0.192-4_armhf.deb ... 265s Unpacking libdebuginfod1t64:armhf (0.192-4) ... 265s Selecting previously unselected package libpython3.12t64:armhf. 265s Preparing to unpack .../023-libpython3.12t64_3.12.7-3_armhf.deb ... 265s Unpacking libpython3.12t64:armhf (3.12.7-3) ... 265s Selecting previously unselected package libsource-highlight-common. 265s Preparing to unpack .../024-libsource-highlight-common_3.1.9-4.3build1_all.deb ... 265s Unpacking libsource-highlight-common (3.1.9-4.3build1) ... 265s Selecting previously unselected package libsource-highlight4t64:armhf. 265s Preparing to unpack .../025-libsource-highlight4t64_3.1.9-4.3build1_armhf.deb ... 265s Unpacking libsource-highlight4t64:armhf (3.1.9-4.3build1) ... 265s Selecting previously unselected package libc6-dbg:armhf. 265s Preparing to unpack .../026-libc6-dbg_2.40-1ubuntu3_armhf.deb ... 265s Unpacking libc6-dbg:armhf (2.40-1ubuntu3) ... 265s Selecting previously unselected package gdb. 265s Preparing to unpack .../027-gdb_15.1-1ubuntu2_armhf.deb ... 265s Unpacking gdb (15.1-1ubuntu2) ... 265s Selecting previously unselected package libaec0:armhf. 265s Preparing to unpack .../028-libaec0_1.1.3-1_armhf.deb ... 265s Unpacking libaec0:armhf (1.1.3-1) ... 265s Selecting previously unselected package libargon2-1:armhf. 265s Preparing to unpack .../029-libargon2-1_0~20190702+dfsg-4build1_armhf.deb ... 265s Unpacking libargon2-1:armhf (0~20190702+dfsg-4build1) ... 266s Selecting previously unselected package libblas3:armhf. 266s Preparing to unpack .../030-libblas3_3.12.0-3build2_armhf.deb ... 266s Unpacking libblas3:armhf (3.12.0-3build2) ... 266s Selecting previously unselected package libcares2:armhf. 266s Preparing to unpack .../031-libcares2_1.34.2-1_armhf.deb ... 266s Unpacking libcares2:armhf (1.34.2-1) ... 266s Selecting previously unselected package libdeflate0:armhf. 266s Preparing to unpack .../032-libdeflate0_1.22-1_armhf.deb ... 266s Unpacking libdeflate0:armhf (1.22-1) ... 266s Selecting previously unselected package libgfortran5:armhf. 266s Preparing to unpack .../033-libgfortran5_14.2.0-8ubuntu1_armhf.deb ... 266s Unpacking libgfortran5:armhf (14.2.0-8ubuntu1) ... 266s Selecting previously unselected package libgomp1:armhf. 266s Preparing to unpack .../034-libgomp1_14.2.0-8ubuntu1_armhf.deb ... 266s Unpacking libgomp1:armhf (14.2.0-8ubuntu1) ... 266s Selecting previously unselected package libgraphite2-3:armhf. 266s Preparing to unpack .../035-libgraphite2-3_1.3.14-2ubuntu1_armhf.deb ... 266s Unpacking libgraphite2-3:armhf (1.3.14-2ubuntu1) ... 266s Selecting previously unselected package libharfbuzz0b:armhf. 266s Preparing to unpack .../036-libharfbuzz0b_10.0.1-1_armhf.deb ... 266s Unpacking libharfbuzz0b:armhf (10.0.1-1) ... 266s Selecting previously unselected package libsz2:armhf. 266s Preparing to unpack .../037-libsz2_1.1.3-1_armhf.deb ... 266s Unpacking libsz2:armhf (1.1.3-1) ... 266s Selecting previously unselected package libhdf5-103-1t64:armhf. 266s Preparing to unpack .../038-libhdf5-103-1t64_1.10.10+repack-4ubuntu3_armhf.deb ... 266s Unpacking libhdf5-103-1t64:armhf (1.10.10+repack-4ubuntu3) ... 266s Selecting previously unselected package libhdf5-hl-100t64:armhf. 266s Preparing to unpack .../039-libhdf5-hl-100t64_1.10.10+repack-4ubuntu3_armhf.deb ... 266s Unpacking libhdf5-hl-100t64:armhf (1.10.10+repack-4ubuntu3) ... 266s Selecting previously unselected package libimagequant0:armhf. 266s Preparing to unpack .../040-libimagequant0_2.18.0-1build1_armhf.deb ... 266s Unpacking libimagequant0:armhf (2.18.0-1build1) ... 266s Selecting previously unselected package libjpeg-turbo8:armhf. 266s Preparing to unpack .../041-libjpeg-turbo8_2.1.5-3ubuntu2_armhf.deb ... 266s Unpacking libjpeg-turbo8:armhf (2.1.5-3ubuntu2) ... 266s Selecting previously unselected package libjpeg8:armhf. 266s Preparing to unpack .../042-libjpeg8_8c-2ubuntu11_armhf.deb ... 266s Unpacking libjpeg8:armhf (8c-2ubuntu11) ... 266s Selecting previously unselected package libjs-bootstrap. 266s Preparing to unpack .../043-libjs-bootstrap_3.4.1+dfsg-3_all.deb ... 266s Unpacking libjs-bootstrap (3.4.1+dfsg-3) ... 266s Selecting previously unselected package libjs-jquery. 266s Preparing to unpack .../044-libjs-jquery_3.6.1+dfsg+~3.5.14-1_all.deb ... 266s Unpacking libjs-jquery (3.6.1+dfsg+~3.5.14-1) ... 266s Selecting previously unselected package libjs-jquery-ui. 266s Preparing to unpack .../045-libjs-jquery-ui_1.13.2+dfsg-1_all.deb ... 266s Unpacking libjs-jquery-ui (1.13.2+dfsg-1) ... 266s Selecting previously unselected package libjs-underscore. 266s Preparing to unpack .../046-libjs-underscore_1.13.4~dfsg+~1.11.4-3_all.deb ... 266s Unpacking libjs-underscore (1.13.4~dfsg+~1.11.4-3) ... 266s Selecting previously unselected package libjs-sphinxdoc. 266s Preparing to unpack .../047-libjs-sphinxdoc_7.4.7-4_all.deb ... 266s Unpacking libjs-sphinxdoc (7.4.7-4) ... 266s Selecting previously unselected package libjs-sprintf-js. 266s Preparing to unpack .../048-libjs-sprintf-js_1.1.2+ds1+~1.1.2-1_all.deb ... 266s Unpacking libjs-sprintf-js (1.1.2+ds1+~1.1.2-1) ... 266s Selecting previously unselected package liblapack3:armhf. 266s Preparing to unpack .../049-liblapack3_3.12.0-3build2_armhf.deb ... 266s Unpacking liblapack3:armhf (3.12.0-3build2) ... 266s Selecting previously unselected package liblbfgsb0:armhf. 266s Preparing to unpack .../050-liblbfgsb0_3.0+dfsg.4-1build1_armhf.deb ... 266s Unpacking liblbfgsb0:armhf (3.0+dfsg.4-1build1) ... 266s Selecting previously unselected package liblcms2-2:armhf. 266s Preparing to unpack .../051-liblcms2-2_2.16-2_armhf.deb ... 266s Unpacking liblcms2-2:armhf (2.16-2) ... 266s Selecting previously unselected package liblerc4:armhf. 266s Preparing to unpack .../052-liblerc4_4.0.0+ds-5ubuntu1_armhf.deb ... 266s Unpacking liblerc4:armhf (4.0.0+ds-5ubuntu1) ... 266s Selecting previously unselected package liblzf1:armhf. 267s Preparing to unpack .../053-liblzf1_3.6-4_armhf.deb ... 267s Unpacking liblzf1:armhf (3.6-4) ... 267s Selecting previously unselected package libnetcdf19t64:armhf. 267s Preparing to unpack .../054-libnetcdf19t64_1%3a4.9.2-6ubuntu1_armhf.deb ... 267s Unpacking libnetcdf19t64:armhf (1:4.9.2-6ubuntu1) ... 267s Selecting previously unselected package node-xtend. 267s Preparing to unpack .../055-node-xtend_4.0.2-3_all.deb ... 267s Unpacking node-xtend (4.0.2-3) ... 267s Selecting previously unselected package nodejs. 267s Preparing to unpack .../056-nodejs_20.18.0+dfsg-2_armhf.deb ... 267s Unpacking nodejs (20.18.0+dfsg-2) ... 267s Selecting previously unselected package node-acorn. 267s Preparing to unpack .../057-node-acorn_8.8.1+ds+~cs25.17.7-2_all.deb ... 267s Unpacking node-acorn (8.8.1+ds+~cs25.17.7-2) ... 267s Selecting previously unselected package node-cjs-module-lexer. 267s Preparing to unpack .../058-node-cjs-module-lexer_1.2.3+dfsg-1_all.deb ... 267s Unpacking node-cjs-module-lexer (1.2.3+dfsg-1) ... 267s Selecting previously unselected package node-balanced-match. 267s Preparing to unpack .../059-node-balanced-match_2.0.0-1_all.deb ... 267s Unpacking node-balanced-match (2.0.0-1) ... 267s Selecting previously unselected package node-brace-expansion. 267s Preparing to unpack .../060-node-brace-expansion_2.0.1+~1.1.0-1_all.deb ... 267s Unpacking node-brace-expansion (2.0.1+~1.1.0-1) ... 267s Selecting previously unselected package node-minimatch. 267s Preparing to unpack .../061-node-minimatch_9.0.3-5_all.deb ... 267s Unpacking node-minimatch (9.0.3-5) ... 267s Selecting previously unselected package node-undici. 267s Preparing to unpack .../062-node-undici_5.28.4+dfsg1+~cs23.12.11-2_all.deb ... 267s Unpacking node-undici (5.28.4+dfsg1+~cs23.12.11-2) ... 267s Selecting previously unselected package libnode115:armhf. 267s Preparing to unpack .../063-libnode115_20.18.0+dfsg-2_armhf.deb ... 267s Unpacking libnode115:armhf (20.18.0+dfsg-2) ... 268s Selecting previously unselected package libnorm1t64:armhf. 268s Preparing to unpack .../064-libnorm1t64_1.5.9+dfsg-3.1build1_armhf.deb ... 268s Unpacking libnorm1t64:armhf (1.5.9+dfsg-3.1build1) ... 268s Selecting previously unselected package libpgm-5.3-0t64:armhf. 268s Preparing to unpack .../065-libpgm-5.3-0t64_5.3.128~dfsg-2.1build1_armhf.deb ... 268s Unpacking libpgm-5.3-0t64:armhf (5.3.128~dfsg-2.1build1) ... 268s Selecting previously unselected package libpython3.13-stdlib:armhf. 268s Preparing to unpack .../066-libpython3.13-stdlib_3.13.0-2_armhf.deb ... 268s Unpacking libpython3.13-stdlib:armhf (3.13.0-2) ... 268s Selecting previously unselected package libqhull-r8.0:armhf. 268s Preparing to unpack .../067-libqhull-r8.0_2020.2-6build1_armhf.deb ... 268s Unpacking libqhull-r8.0:armhf (2020.2-6build1) ... 268s Selecting previously unselected package libraqm0:armhf. 268s Preparing to unpack .../068-libraqm0_0.10.1-1build1_armhf.deb ... 268s Unpacking libraqm0:armhf (0.10.1-1build1) ... 268s Selecting previously unselected package libsharpyuv0:armhf. 268s Preparing to unpack .../069-libsharpyuv0_1.4.0-0.1_armhf.deb ... 268s Unpacking libsharpyuv0:armhf (1.4.0-0.1) ... 268s Selecting previously unselected package libsodium23:armhf. 268s Preparing to unpack .../070-libsodium23_1.0.18-1build3_armhf.deb ... 268s Unpacking libsodium23:armhf (1.0.18-1build3) ... 268s Selecting previously unselected package libjbig0:armhf. 268s Preparing to unpack .../071-libjbig0_2.1-6.1ubuntu2_armhf.deb ... 268s Unpacking libjbig0:armhf (2.1-6.1ubuntu2) ... 268s Selecting previously unselected package libwebp7:armhf. 268s Preparing to unpack .../072-libwebp7_1.4.0-0.1_armhf.deb ... 268s Unpacking libwebp7:armhf (1.4.0-0.1) ... 268s Selecting previously unselected package libtiff6:armhf. 268s Preparing to unpack .../073-libtiff6_4.5.1+git230720-4ubuntu4_armhf.deb ... 268s Unpacking libtiff6:armhf (4.5.1+git230720-4ubuntu4) ... 268s Selecting previously unselected package libwebpdemux2:armhf. 268s Preparing to unpack .../074-libwebpdemux2_1.4.0-0.1_armhf.deb ... 268s Unpacking libwebpdemux2:armhf (1.4.0-0.1) ... 268s Selecting previously unselected package libwebpmux3:armhf. 268s Preparing to unpack .../075-libwebpmux3_1.4.0-0.1_armhf.deb ... 268s Unpacking libwebpmux3:armhf (1.4.0-0.1) ... 268s Selecting previously unselected package libxslt1.1:armhf. 268s Preparing to unpack .../076-libxslt1.1_1.1.39-0exp1ubuntu1_armhf.deb ... 268s Unpacking libxslt1.1:armhf (1.1.39-0exp1ubuntu1) ... 268s Selecting previously unselected package libzmq5:armhf. 268s Preparing to unpack .../077-libzmq5_4.3.5-1build2_armhf.deb ... 268s Unpacking libzmq5:armhf (4.3.5-1build2) ... 268s Selecting previously unselected package node-esprima. 268s Preparing to unpack .../078-node-esprima_4.0.1+ds+~4.0.3-2_all.deb ... 268s Unpacking node-esprima (4.0.1+ds+~4.0.3-2) ... 268s Selecting previously unselected package node-sprintf-js. 268s Preparing to unpack .../079-node-sprintf-js_1.1.2+ds1+~1.1.2-1_all.deb ... 268s Unpacking node-sprintf-js (1.1.2+ds1+~1.1.2-1) ... 268s Selecting previously unselected package node-argparse. 268s Preparing to unpack .../080-node-argparse_2.0.1-2_all.deb ... 268s Unpacking node-argparse (2.0.1-2) ... 268s Selecting previously unselected package node-js-yaml. 268s Preparing to unpack .../081-node-js-yaml_4.1.0+dfsg+~4.0.5-7_all.deb ... 268s Unpacking node-js-yaml (4.1.0+dfsg+~4.0.5-7) ... 269s Selecting previously unselected package libjs-mathjax. 269s Preparing to unpack .../082-libjs-mathjax_2.7.9+dfsg-1_all.deb ... 269s Unpacking libjs-mathjax (2.7.9+dfsg-1) ... 269s Selecting previously unselected package python-dask-doc. 269s Preparing to unpack .../083-python-dask-doc_2024.5.2+dfsg-1_all.deb ... 269s Unpacking python-dask-doc (2024.5.2+dfsg-1) ... 270s Selecting previously unselected package sphinx-rtd-theme-common. 270s Preparing to unpack .../084-sphinx-rtd-theme-common_3.0.2+dfsg-1_all.deb ... 270s Unpacking sphinx-rtd-theme-common (3.0.2+dfsg-1) ... 270s Selecting previously unselected package python-fsspec-doc. 270s Preparing to unpack .../085-python-fsspec-doc_2024.9.0-1_all.deb ... 270s Unpacking python-fsspec-doc (2024.9.0-1) ... 270s Selecting previously unselected package python-numpy-doc. 270s Preparing to unpack .../086-python-numpy-doc_1%3a1.26.4+ds-11ubuntu1_all.deb ... 270s Unpacking python-numpy-doc (1:1.26.4+ds-11ubuntu1) ... 271s Selecting previously unselected package python-pandas-doc. 271s Preparing to unpack .../087-python-pandas-doc_2.2.3+dfsg-5ubuntu1_all.deb ... 271s Unpacking python-pandas-doc (2.2.3+dfsg-5ubuntu1) ... 272s Selecting previously unselected package python3.12-doc. 272s Preparing to unpack .../088-python3.12-doc_3.12.7-3_all.deb ... 272s Unpacking python3.12-doc (3.12.7-3) ... 273s Selecting previously unselected package python3-doc. 273s Preparing to unpack .../089-python3-doc_3.12.7-1_all.deb ... 273s Unpacking python3-doc (3.12.7-1) ... 273s Selecting previously unselected package sass-stylesheets-bulma. 273s Preparing to unpack .../090-sass-stylesheets-bulma_0.9.4~ds-1_all.deb ... 273s Unpacking sass-stylesheets-bulma (0.9.4~ds-1) ... 273s Selecting previously unselected package python-distributed-doc. 273s Preparing to unpack .../091-python-distributed-doc_2024.5.2+ds.1-8_all.deb ... 273s Unpacking python-distributed-doc (2024.5.2+ds.1-8) ... 273s Selecting previously unselected package python-matplotlib-data. 273s Preparing to unpack .../092-python-matplotlib-data_3.8.3-3ubuntu1_all.deb ... 273s Unpacking python-matplotlib-data (3.8.3-3ubuntu1) ... 273s Selecting previously unselected package python-tinycss2-common. 273s Preparing to unpack .../093-python-tinycss2-common_1.4.0-1_all.deb ... 273s Unpacking python-tinycss2-common (1.4.0-1) ... 273s Selecting previously unselected package python3-multidict. 273s Preparing to unpack .../094-python3-multidict_6.1.0-1build1_armhf.deb ... 273s Unpacking python3-multidict (6.1.0-1build1) ... 273s Selecting previously unselected package python3-yarl. 273s Preparing to unpack .../095-python3-yarl_1.9.4-1_armhf.deb ... 273s Unpacking python3-yarl (1.9.4-1) ... 273s Selecting previously unselected package python3-async-timeout. 273s Preparing to unpack .../096-python3-async-timeout_4.0.3-1_all.deb ... 273s Unpacking python3-async-timeout (4.0.3-1) ... 273s Selecting previously unselected package python3-frozenlist. 273s Preparing to unpack .../097-python3-frozenlist_1.5.0-1build1_armhf.deb ... 273s Unpacking python3-frozenlist (1.5.0-1build1) ... 273s Selecting previously unselected package python3-aiosignal. 273s Preparing to unpack .../098-python3-aiosignal_1.3.1-1_all.deb ... 273s Unpacking python3-aiosignal (1.3.1-1) ... 273s Selecting previously unselected package python3-aiohttp. 273s Preparing to unpack .../099-python3-aiohttp_3.9.5-1_armhf.deb ... 273s Unpacking python3-aiohttp (3.9.5-1) ... 273s Selecting previously unselected package python3.13. 273s Preparing to unpack .../100-python3.13_3.13.0-2_armhf.deb ... 273s Unpacking python3.13 (3.13.0-2) ... 273s Selecting previously unselected package python3-all. 274s Preparing to unpack .../101-python3-all_3.12.7-1_armhf.deb ... 274s Unpacking python3-all (3.12.7-1) ... 274s Selecting previously unselected package python3-sniffio. 274s Preparing to unpack .../102-python3-sniffio_1.3.1-1_all.deb ... 274s Unpacking python3-sniffio (1.3.1-1) ... 274s Selecting previously unselected package python3-anyio. 274s Preparing to unpack .../103-python3-anyio_4.6.2-4_all.deb ... 274s Unpacking python3-anyio (4.6.2-4) ... 274s Selecting previously unselected package python3-appdirs. 274s Preparing to unpack .../104-python3-appdirs_1.4.4-4_all.deb ... 274s Unpacking python3-appdirs (1.4.4-4) ... 274s Selecting previously unselected package python3-argon2. 274s Preparing to unpack .../105-python3-argon2_21.1.0-2build1_armhf.deb ... 274s Unpacking python3-argon2 (21.1.0-2build1) ... 274s Selecting previously unselected package python3-dateutil. 274s Preparing to unpack .../106-python3-dateutil_2.9.0-3_all.deb ... 274s Unpacking python3-dateutil (2.9.0-3) ... 274s Selecting previously unselected package python3-arrow. 274s Preparing to unpack .../107-python3-arrow_1.3.0-1.1ubuntu1_all.deb ... 274s Unpacking python3-arrow (1.3.0-1.1ubuntu1) ... 274s Selecting previously unselected package python3-asttokens. 274s Preparing to unpack .../108-python3-asttokens_2.4.1-2_all.deb ... 274s Unpacking python3-asttokens (2.4.1-2) ... 274s Selecting previously unselected package python3-webencodings. 274s Preparing to unpack .../109-python3-webencodings_0.5.1-5_all.deb ... 274s Unpacking python3-webencodings (0.5.1-5) ... 274s Selecting previously unselected package python3-html5lib. 274s Preparing to unpack .../110-python3-html5lib_1.2-1_all.deb ... 274s Unpacking python3-html5lib (1.2-1) ... 274s Selecting previously unselected package python3-bleach. 274s Preparing to unpack .../111-python3-bleach_6.2.0-1_all.deb ... 275s Unpacking python3-bleach (6.2.0-1) ... 275s Selecting previously unselected package python3-brotli. 275s Preparing to unpack .../112-python3-brotli_1.1.0-2build3_armhf.deb ... 275s Unpacking python3-brotli (1.1.0-2build3) ... 275s Selecting previously unselected package python3-soupsieve. 275s Preparing to unpack .../113-python3-soupsieve_2.6-1_all.deb ... 275s Unpacking python3-soupsieve (2.6-1) ... 275s Selecting previously unselected package python3-bs4. 275s Preparing to unpack .../114-python3-bs4_4.12.3-3_all.deb ... 275s Unpacking python3-bs4 (4.12.3-3) ... 275s Selecting previously unselected package python3-numpy. 275s Preparing to unpack .../115-python3-numpy_1%3a1.26.4+ds-11ubuntu1_armhf.deb ... 275s Unpacking python3-numpy (1:1.26.4+ds-11ubuntu1) ... 275s Selecting previously unselected package python3-cftime. 275s Preparing to unpack .../116-python3-cftime_1.6.4-1build1_armhf.deb ... 275s Unpacking python3-cftime (1.6.4-1build1) ... 275s Selecting previously unselected package python3-colorama. 275s Preparing to unpack .../117-python3-colorama_0.4.6-4_all.deb ... 275s Unpacking python3-colorama (0.4.6-4) ... 275s Selecting previously unselected package python3-click. 275s Preparing to unpack .../118-python3-click_8.1.7-2_all.deb ... 275s Unpacking python3-click (8.1.7-2) ... 275s Selecting previously unselected package python3-cloudpickle. 275s Preparing to unpack .../119-python3-cloudpickle_3.0.0-2_all.deb ... 275s Unpacking python3-cloudpickle (3.0.0-2) ... 275s Selecting previously unselected package python3-traitlets. 275s Preparing to unpack .../120-python3-traitlets_5.14.3+really5.14.3-1_all.deb ... 275s Unpacking python3-traitlets (5.14.3+really5.14.3-1) ... 275s Selecting previously unselected package python3-comm. 275s Preparing to unpack .../121-python3-comm_0.2.1-1_all.deb ... 275s Unpacking python3-comm (0.2.1-1) ... 275s Selecting previously unselected package python3-contourpy. 275s Preparing to unpack .../122-python3-contourpy_1.3.0-2build1_armhf.deb ... 275s Unpacking python3-contourpy (1.3.0-2build1) ... 275s Selecting previously unselected package python3-coverage. 275s Preparing to unpack .../123-python3-coverage_7.4.4+dfsg1-0ubuntu3_armhf.deb ... 275s Unpacking python3-coverage (7.4.4+dfsg1-0ubuntu3) ... 275s Selecting previously unselected package python3-cycler. 275s Preparing to unpack .../124-python3-cycler_0.12.1-1_all.deb ... 275s Unpacking python3-cycler (0.12.1-1) ... 275s Selecting previously unselected package python3-fsspec. 275s Preparing to unpack .../125-python3-fsspec_2024.9.0-1_all.deb ... 275s Unpacking python3-fsspec (2024.9.0-1) ... 275s Selecting previously unselected package python3-toolz. 275s Preparing to unpack .../126-python3-toolz_1.0.0-1_all.deb ... 275s Unpacking python3-toolz (1.0.0-1) ... 276s Selecting previously unselected package python3-packaging. 276s Preparing to unpack .../127-python3-packaging_24.2-1_all.deb ... 276s Unpacking python3-packaging (24.2-1) ... 276s Selecting previously unselected package python3-locket. 276s Preparing to unpack .../128-python3-locket_1.0.0-2_all.deb ... 276s Unpacking python3-locket (1.0.0-2) ... 276s Selecting previously unselected package python3-partd. 276s Preparing to unpack .../129-python3-partd_1.4.2-1_all.deb ... 276s Unpacking python3-partd (1.4.2-1) ... 276s Selecting previously unselected package python3-dask. 276s Preparing to unpack .../130-python3-dask_2024.5.2+dfsg-1_all.deb ... 276s Unpacking python3-dask (2024.5.2+dfsg-1) ... 276s Selecting previously unselected package python3-debugpy. 276s Preparing to unpack .../131-python3-debugpy_1.8.8+ds-2ubuntu1_armhf.deb ... 276s Unpacking python3-debugpy (1.8.8+ds-2ubuntu1) ... 276s Selecting previously unselected package python3-decorator. 276s Preparing to unpack .../132-python3-decorator_5.1.1-5_all.deb ... 276s Unpacking python3-decorator (5.1.1-5) ... 276s Selecting previously unselected package python3-defusedxml. 276s Preparing to unpack .../133-python3-defusedxml_0.7.1-2_all.deb ... 276s Unpacking python3-defusedxml (0.7.1-2) ... 276s Selecting previously unselected package python3-dill. 276s Preparing to unpack .../134-python3-dill_0.3.9-1_all.deb ... 276s Unpacking python3-dill (0.3.9-1) ... 276s Selecting previously unselected package python3-msgpack. 276s Preparing to unpack .../135-python3-msgpack_1.0.3-3build3_armhf.deb ... 276s Unpacking python3-msgpack (1.0.3-3build3) ... 276s Selecting previously unselected package python3-psutil. 276s Preparing to unpack .../136-python3-psutil_5.9.8-2build3_armhf.deb ... 276s Unpacking python3-psutil (5.9.8-2build3) ... 276s Selecting previously unselected package python3-sortedcontainers. 276s Preparing to unpack .../137-python3-sortedcontainers_2.4.0-2_all.deb ... 276s Unpacking python3-sortedcontainers (2.4.0-2) ... 276s Selecting previously unselected package python3-tblib. 276s Preparing to unpack .../138-python3-tblib_3.0.0-5_all.deb ... 276s Unpacking python3-tblib (3.0.0-5) ... 276s Selecting previously unselected package python3-tornado. 276s Preparing to unpack .../139-python3-tornado_6.4.1-3_armhf.deb ... 276s Unpacking python3-tornado (6.4.1-3) ... 276s Selecting previously unselected package python3-zict. 276s Preparing to unpack .../140-python3-zict_3.0.0-2ubuntu1_all.deb ... 276s Unpacking python3-zict (3.0.0-2ubuntu1) ... 276s Selecting previously unselected package python3-distributed. 276s Preparing to unpack .../141-python3-distributed_2024.5.2+ds.1-8_all.deb ... 276s Unpacking python3-distributed (2024.5.2+ds.1-8) ... 277s Selecting previously unselected package python3-executing. 277s Preparing to unpack .../142-python3-executing_2.1.0-0.1_all.deb ... 277s Unpacking python3-executing (2.1.0-0.1) ... 277s Selecting previously unselected package python3-fastjsonschema. 277s Preparing to unpack .../143-python3-fastjsonschema_2.20.0-1_all.deb ... 277s Unpacking python3-fastjsonschema (2.20.0-1) ... 277s Selecting previously unselected package python3-tz. 277s Preparing to unpack .../144-python3-tz_2024.1-2_all.deb ... 277s Unpacking python3-tz (2024.1-2) ... 277s Selecting previously unselected package python3-six. 277s Preparing to unpack .../145-python3-six_1.16.0-7_all.deb ... 277s Unpacking python3-six (1.16.0-7) ... 277s Selecting previously unselected package python3-fs. 277s Preparing to unpack .../146-python3-fs_2.4.16-4_all.deb ... 277s Unpacking python3-fs (2.4.16-4) ... 277s Selecting previously unselected package python3-lxml:armhf. 277s Preparing to unpack .../147-python3-lxml_5.3.0-1build1_armhf.deb ... 277s Unpacking python3-lxml:armhf (5.3.0-1build1) ... 277s Selecting previously unselected package python3-lz4. 277s Preparing to unpack .../148-python3-lz4_4.0.2+dfsg-1build5_armhf.deb ... 277s Unpacking python3-lz4 (4.0.2+dfsg-1build5) ... 277s Selecting previously unselected package python3-scipy. 277s Preparing to unpack .../149-python3-scipy_1.13.1-5ubuntu1_armhf.deb ... 277s Unpacking python3-scipy (1.13.1-5ubuntu1) ... 278s Selecting previously unselected package python3-mpmath. 278s Preparing to unpack .../150-python3-mpmath_1.3.0-1_all.deb ... 278s Unpacking python3-mpmath (1.3.0-1) ... 278s Selecting previously unselected package python3-sympy. 278s Preparing to unpack .../151-python3-sympy_1.13.3-1_all.deb ... 278s Unpacking python3-sympy (1.13.3-1) ... 278s Selecting previously unselected package python3-ufolib2. 278s Preparing to unpack .../152-python3-ufolib2_0.16.1+dfsg1-1_all.deb ... 278s Unpacking python3-ufolib2 (0.16.1+dfsg1-1) ... 278s Selecting previously unselected package unicode-data. 278s Preparing to unpack .../153-unicode-data_15.1.0-1_all.deb ... 278s Unpacking unicode-data (15.1.0-1) ... 278s Selecting previously unselected package python3-fonttools. 278s Preparing to unpack .../154-python3-fonttools_4.55.0-3_armhf.deb ... 278s Unpacking python3-fonttools (4.55.0-3) ... 278s Selecting previously unselected package python3-fqdn. 278s Preparing to unpack .../155-python3-fqdn_1.5.1-2_all.deb ... 278s Unpacking python3-fqdn (1.5.1-2) ... 278s Selecting previously unselected package python3-h5py-serial. 279s Preparing to unpack .../156-python3-h5py-serial_3.11.0-5ubuntu1_armhf.deb ... 279s Unpacking python3-h5py-serial (3.11.0-5ubuntu1) ... 279s Selecting previously unselected package python3-h5py. 279s Preparing to unpack .../157-python3-h5py_3.11.0-5ubuntu1_all.deb ... 279s Unpacking python3-h5py (3.11.0-5ubuntu1) ... 279s Selecting previously unselected package python3-iniconfig. 279s Preparing to unpack .../158-python3-iniconfig_1.1.1-2_all.deb ... 279s Unpacking python3-iniconfig (1.1.1-2) ... 279s Selecting previously unselected package python3-parso. 279s Preparing to unpack .../159-python3-parso_0.8.3-1_all.deb ... 279s Unpacking python3-parso (0.8.3-1) ... 279s Selecting previously unselected package python3-typeshed. 279s Preparing to unpack .../160-python3-typeshed_0.0~git20231111.6764465-3_all.deb ... 279s Unpacking python3-typeshed (0.0~git20231111.6764465-3) ... 279s Selecting previously unselected package python3-jedi. 279s Preparing to unpack .../161-python3-jedi_0.19.1+ds1-1_all.deb ... 279s Unpacking python3-jedi (0.19.1+ds1-1) ... 280s Selecting previously unselected package python3-matplotlib-inline. 280s Preparing to unpack .../162-python3-matplotlib-inline_0.1.6-2_all.deb ... 280s Unpacking python3-matplotlib-inline (0.1.6-2) ... 280s Selecting previously unselected package python3-wcwidth. 280s Preparing to unpack .../163-python3-wcwidth_0.2.13+dfsg1-1_all.deb ... 280s Unpacking python3-wcwidth (0.2.13+dfsg1-1) ... 280s Selecting previously unselected package python3-prompt-toolkit. 280s Preparing to unpack .../164-python3-prompt-toolkit_3.0.48-1_all.deb ... 280s Unpacking python3-prompt-toolkit (3.0.48-1) ... 280s Selecting previously unselected package python3-pure-eval. 280s Preparing to unpack .../165-python3-pure-eval_0.2.3-1_all.deb ... 280s Unpacking python3-pure-eval (0.2.3-1) ... 280s Selecting previously unselected package python3-stack-data. 280s Preparing to unpack .../166-python3-stack-data_0.6.3-1_all.deb ... 280s Unpacking python3-stack-data (0.6.3-1) ... 280s Selecting previously unselected package python3-ptyprocess. 280s Preparing to unpack .../167-python3-ptyprocess_0.7.0-6_all.deb ... 280s Unpacking python3-ptyprocess (0.7.0-6) ... 280s Selecting previously unselected package python3-pexpect. 280s Preparing to unpack .../168-python3-pexpect_4.9-3_all.deb ... 280s Unpacking python3-pexpect (4.9-3) ... 280s Selecting previously unselected package python3-ipython. 280s Preparing to unpack .../169-python3-ipython_8.29.0-1_all.deb ... 280s Unpacking python3-ipython (8.29.0-1) ... 280s Selecting previously unselected package python3-platformdirs. 280s Preparing to unpack .../170-python3-platformdirs_4.3.6-1_all.deb ... 280s Unpacking python3-platformdirs (4.3.6-1) ... 280s Selecting previously unselected package python3-jupyter-core. 280s Preparing to unpack .../171-python3-jupyter-core_5.7.2-4_all.deb ... 280s Unpacking python3-jupyter-core (5.7.2-4) ... 280s Selecting previously unselected package python3-py. 280s Preparing to unpack .../172-python3-py_1.11.0-2_all.deb ... 280s Unpacking python3-py (1.11.0-2) ... 280s Selecting previously unselected package python3-zmq. 280s Preparing to unpack .../173-python3-zmq_24.0.1-5build2_armhf.deb ... 280s Unpacking python3-zmq (24.0.1-5build2) ... 281s Selecting previously unselected package python3-jupyter-client. 281s Preparing to unpack .../174-python3-jupyter-client_8.6.3-1_all.deb ... 281s Unpacking python3-jupyter-client (8.6.3-1) ... 281s Selecting previously unselected package python3-nest-asyncio. 281s Preparing to unpack .../175-python3-nest-asyncio_1.5.4-1_all.deb ... 281s Unpacking python3-nest-asyncio (1.5.4-1) ... 281s Selecting previously unselected package python3-ipykernel. 281s Preparing to unpack .../176-python3-ipykernel_6.29.5-1_all.deb ... 281s Unpacking python3-ipykernel (6.29.5-1) ... 281s Selecting previously unselected package python3-isoduration. 281s Preparing to unpack .../177-python3-isoduration_20.11.0+git20211126.ae0bd61-2_all.deb ... 281s Unpacking python3-isoduration (20.11.0+git20211126.ae0bd61-2) ... 281s Selecting previously unselected package python3-joblib. 281s Preparing to unpack .../178-python3-joblib_1.3.2-5_all.deb ... 281s Unpacking python3-joblib (1.3.2-5) ... 281s Selecting previously unselected package python3-pythonjsonlogger. 281s Preparing to unpack .../179-python3-pythonjsonlogger_3.1.0-1_all.deb ... 281s Unpacking python3-pythonjsonlogger (3.1.0-1) ... 281s Selecting previously unselected package python3-rfc3339-validator. 281s Preparing to unpack .../180-python3-rfc3339-validator_0.1.4-2_all.deb ... 281s Unpacking python3-rfc3339-validator (0.1.4-2) ... 281s Selecting previously unselected package python3-rfc3986-validator. 281s Preparing to unpack .../181-python3-rfc3986-validator_0.1.1-2_all.deb ... 281s Unpacking python3-rfc3986-validator (0.1.1-2) ... 281s Selecting previously unselected package python3-uritemplate. 281s Preparing to unpack .../182-python3-uritemplate_4.1.1-3_all.deb ... 281s Unpacking python3-uritemplate (4.1.1-3) ... 281s Selecting previously unselected package python3-webcolors. 281s Preparing to unpack .../183-python3-webcolors_1.13-1_all.deb ... 281s Unpacking python3-webcolors (1.13-1) ... 281s Selecting previously unselected package python3-jupyter-events. 281s Preparing to unpack .../184-python3-jupyter-events_0.10.0-3_all.deb ... 281s Unpacking python3-jupyter-events (0.10.0-3) ... 281s Selecting previously unselected package python3-terminado. 281s Preparing to unpack .../185-python3-terminado_0.18.1-1_all.deb ... 281s Unpacking python3-terminado (0.18.1-1) ... 281s Selecting previously unselected package python3-jupyter-server-terminals. 281s Preparing to unpack .../186-python3-jupyter-server-terminals_0.5.3-2_all.deb ... 281s Unpacking python3-jupyter-server-terminals (0.5.3-2) ... 281s Selecting previously unselected package python3-jupyterlab-pygments. 281s Preparing to unpack .../187-python3-jupyterlab-pygments_0.2.2-3_all.deb ... 281s Unpacking python3-jupyterlab-pygments (0.2.2-3) ... 281s Selecting previously unselected package python3-mistune. 281s Preparing to unpack .../188-python3-mistune_3.0.2-2_all.deb ... 281s Unpacking python3-mistune (3.0.2-2) ... 281s Selecting previously unselected package python3-nbformat. 281s Preparing to unpack .../189-python3-nbformat_5.9.1-1_all.deb ... 281s Unpacking python3-nbformat (5.9.1-1) ... 281s Selecting previously unselected package python3-nbclient. 281s Preparing to unpack .../190-python3-nbclient_0.8.0-1_all.deb ... 281s Unpacking python3-nbclient (0.8.0-1) ... 281s Selecting previously unselected package python3-pandocfilters. 281s Preparing to unpack .../191-python3-pandocfilters_1.5.1-1_all.deb ... 281s Unpacking python3-pandocfilters (1.5.1-1) ... 281s Selecting previously unselected package python3-tinycss2. 282s Preparing to unpack .../192-python3-tinycss2_1.4.0-1_all.deb ... 282s Unpacking python3-tinycss2 (1.4.0-1) ... 282s Selecting previously unselected package python3-nbconvert. 282s Preparing to unpack .../193-python3-nbconvert_7.16.4-2_all.deb ... 282s Unpacking python3-nbconvert (7.16.4-2) ... 282s Selecting previously unselected package python3-overrides. 282s Preparing to unpack .../194-python3-overrides_7.7.0-2_all.deb ... 282s Unpacking python3-overrides (7.7.0-2) ... 282s Selecting previously unselected package python3-prometheus-client. 282s Preparing to unpack .../195-python3-prometheus-client_0.19.0+ds1-1_all.deb ... 282s Unpacking python3-prometheus-client (0.19.0+ds1-1) ... 282s Selecting previously unselected package python3-send2trash. 282s Preparing to unpack .../196-python3-send2trash_1.8.3-1_all.deb ... 282s Unpacking python3-send2trash (1.8.3-1) ... 282s Selecting previously unselected package python3-websocket. 282s Preparing to unpack .../197-python3-websocket_1.8.0-2_all.deb ... 282s Unpacking python3-websocket (1.8.0-2) ... 282s Selecting previously unselected package python3-jupyter-server. 282s Preparing to unpack .../198-python3-jupyter-server_2.14.2-4_all.deb ... 282s Unpacking python3-jupyter-server (2.14.2-4) ... 282s Selecting previously unselected package python3-kiwisolver. 282s Preparing to unpack .../199-python3-kiwisolver_1.4.7-2build1_armhf.deb ... 282s Unpacking python3-kiwisolver (1.4.7-2build1) ... 282s Selecting previously unselected package libopenjp2-7:armhf. 282s Preparing to unpack .../200-libopenjp2-7_2.5.0-2ubuntu1_armhf.deb ... 282s Unpacking libopenjp2-7:armhf (2.5.0-2ubuntu1) ... 282s Selecting previously unselected package python3-pil:armhf. 282s Preparing to unpack .../201-python3-pil_10.4.0-1ubuntu2_armhf.deb ... 282s Unpacking python3-pil:armhf (10.4.0-1ubuntu2) ... 282s Selecting previously unselected package python3.12-tk. 282s Preparing to unpack .../202-python3.12-tk_3.12.7-3_armhf.deb ... 282s Unpacking python3.12-tk (3.12.7-3) ... 282s Selecting previously unselected package python3.13-tk. 282s Preparing to unpack .../203-python3.13-tk_3.13.0-2_armhf.deb ... 282s Unpacking python3.13-tk (3.13.0-2) ... 282s Selecting previously unselected package python3-tk:armhf. 282s Preparing to unpack .../204-python3-tk_3.12.7-1_armhf.deb ... 282s Unpacking python3-tk:armhf (3.12.7-1) ... 282s Selecting previously unselected package python3-pil.imagetk:armhf. 282s Preparing to unpack .../205-python3-pil.imagetk_10.4.0-1ubuntu2_armhf.deb ... 282s Unpacking python3-pil.imagetk:armhf (10.4.0-1ubuntu2) ... 282s Selecting previously unselected package python3-matplotlib. 282s Preparing to unpack .../206-python3-matplotlib_3.8.3-3ubuntu1_armhf.deb ... 282s Unpacking python3-matplotlib (3.8.3-3ubuntu1) ... 282s Selecting previously unselected package python3-nacl. 282s Preparing to unpack .../207-python3-nacl_1.5.0-6_armhf.deb ... 282s Unpacking python3-nacl (1.5.0-6) ... 283s Selecting previously unselected package python3-netcdf4. 283s Preparing to unpack .../208-python3-netcdf4_1.7.2-1build1_armhf.deb ... 283s Unpacking python3-netcdf4 (1.7.2-1build1) ... 283s Selecting previously unselected package python3-pandas-lib:armhf. 283s Preparing to unpack .../209-python3-pandas-lib_2.2.3+dfsg-5ubuntu1_armhf.deb ... 283s Unpacking python3-pandas-lib:armhf (2.2.3+dfsg-5ubuntu1) ... 283s Selecting previously unselected package python3-pandas. 283s Preparing to unpack .../210-python3-pandas_2.2.3+dfsg-5ubuntu1_all.deb ... 283s Unpacking python3-pandas (2.2.3+dfsg-5ubuntu1) ... 283s Selecting previously unselected package python3-bcrypt. 283s Preparing to unpack .../211-python3-bcrypt_4.2.0-2.1_armhf.deb ... 283s Unpacking python3-bcrypt (4.2.0-2.1) ... 283s Selecting previously unselected package python3-paramiko. 283s Preparing to unpack .../212-python3-paramiko_3.4.1-2ubuntu1_all.deb ... 283s Unpacking python3-paramiko (3.4.1-2ubuntu1) ... 283s Selecting previously unselected package python3-pluggy. 283s Preparing to unpack .../213-python3-pluggy_1.5.0-1_all.deb ... 283s Unpacking python3-pluggy (1.5.0-1) ... 283s Selecting previously unselected package python3-pytest. 283s Preparing to unpack .../214-python3-pytest_8.3.3-1_all.deb ... 283s Unpacking python3-pytest (8.3.3-1) ... 283s Selecting previously unselected package python3-pytest-rerunfailures. 283s Preparing to unpack .../215-python3-pytest-rerunfailures_14.0-2_all.deb ... 283s Unpacking python3-pytest-rerunfailures (14.0-2) ... 283s Selecting previously unselected package python3-pytest-timeout. 283s Preparing to unpack .../216-python3-pytest-timeout_2.3.1-1_all.deb ... 283s Unpacking python3-pytest-timeout (2.3.1-1) ... 283s Selecting previously unselected package python3-threadpoolctl. 284s Preparing to unpack .../217-python3-threadpoolctl_3.1.0-1_all.deb ... 284s Unpacking python3-threadpoolctl (3.1.0-1) ... 284s Selecting previously unselected package python3-sklearn-lib:armhf. 284s Preparing to unpack .../218-python3-sklearn-lib_1.4.2+dfsg-6build1_armhf.deb ... 284s Unpacking python3-sklearn-lib:armhf (1.4.2+dfsg-6build1) ... 284s Selecting previously unselected package python3-sklearn. 284s Preparing to unpack .../219-python3-sklearn_1.4.2+dfsg-6build1_all.deb ... 284s Unpacking python3-sklearn (1.4.2+dfsg-6build1) ... 284s Selecting previously unselected package tzdata-legacy. 284s Preparing to unpack .../220-tzdata-legacy_2024b-1ubuntu2_all.deb ... 284s Unpacking tzdata-legacy (2024b-1ubuntu2) ... 284s Selecting previously unselected package autopkgtest-satdep. 284s Preparing to unpack .../221-1-autopkgtest-satdep.deb ... 284s Unpacking autopkgtest-satdep (0) ... 284s Setting up libgraphite2-3:armhf (1.3.14-2ubuntu1) ... 284s Setting up liblcms2-2:armhf (2.16-2) ... 284s Setting up python3-iniconfig (1.1.1-2) ... 284s Setting up python3-sniffio (1.3.1-1) ... 285s Setting up python3-tornado (6.4.1-3) ... 285s Setting up libnorm1t64:armhf (1.5.9+dfsg-3.1build1) ... 285s Setting up libsharpyuv0:armhf (1.4.0-0.1) ... 285s Setting up python3-pure-eval (0.2.3-1) ... 286s Setting up python3-send2trash (1.8.3-1) ... 286s Setting up fonts-lato (2.015-1) ... 286s Setting up libjs-sprintf-js (1.1.2+ds1+~1.1.2-1) ... 286s Setting up fonts-mathjax (2.7.9+dfsg-1) ... 286s Setting up libsodium23:armhf (1.0.18-1build3) ... 286s Setting up liblerc4:armhf (4.0.0+ds-5ubuntu1) ... 286s Setting up libjs-mathjax (2.7.9+dfsg-1) ... 286s Setting up python3-tblib (3.0.0-5) ... 286s Setting up libxrender1:armhf (1:0.9.10-1.1build1) ... 286s Setting up python3-py (1.11.0-2) ... 286s Setting up libdebuginfod-common (0.192-4) ... 286s Setting up python3-anyio (4.6.2-4) ... 287s Setting up python3-joblib (1.3.2-5) ... 287s Setting up python3-pythonjsonlogger (3.1.0-1) ... 288s Setting up python3-parso (0.8.3-1) ... 288s Setting up python3-colorama (0.4.6-4) ... 288s Setting up python3-lz4 (4.0.2+dfsg-1build5) ... 288s Setting up python3-defusedxml (0.7.1-2) ... 288s Setting up python3-asttokens (2.4.1-2) ... 289s Setting up fonts-glyphicons-halflings (1.009~3.4.1+dfsg-3) ... 289s Setting up fonts-lyx (2.4.2.1-1) ... 289s Setting up libargon2-1:armhf (0~20190702+dfsg-4build1) ... 289s Setting up python3-overrides (7.7.0-2) ... 289s Setting up python3-bcrypt (4.2.0-2.1) ... 289s Setting up python3-fsspec (2024.9.0-1) ... 290s Setting up python3-rfc3339-validator (0.1.4-2) ... 290s Setting up python3-threadpoolctl (3.1.0-1) ... 290s Setting up x11-common (1:7.7+23ubuntu3) ... 291s Setting up libdeflate0:armhf (1.22-1) ... 291s Setting up libqhull-r8.0:armhf (2020.2-6build1) ... 291s Setting up node-cjs-module-lexer (1.2.3+dfsg-1) ... 291s Setting up python3-sortedcontainers (2.4.0-2) ... 291s Setting up python3-pandocfilters (1.5.1-1) ... 291s Setting up libgomp1:armhf (14.2.0-8ubuntu1) ... 291s Setting up python3-click (8.1.7-2) ... 291s Setting up libjbig0:armhf (2.1-6.1ubuntu2) ... 291s Setting up python3-webencodings (0.5.1-5) ... 292s Setting up libaec0:armhf (1.1.3-1) ... 292s Setting up python3-platformdirs (4.3.6-1) ... 292s Setting up python3-psutil (5.9.8-2build3) ... 292s Setting up python3-multidict (6.1.0-1build1) ... 293s Setting up libsource-highlight-common (3.1.9-4.3build1) ... 293s Setting up tzdata-legacy (2024b-1ubuntu2) ... 293s Setting up python3-tz (2024.1-2) ... 293s Setting up python3-cloudpickle (3.0.0-2) ... 293s Setting up python3-frozenlist (1.5.0-1build1) ... 293s Setting up libc6-dbg:armhf (2.40-1ubuntu3) ... 293s Setting up python3-aiosignal (1.3.1-1) ... 293s Setting up python3-uritemplate (4.1.1-3) ... 294s Setting up python3-async-timeout (4.0.3-1) ... 294s Setting up unicode-data (15.1.0-1) ... 294s Setting up python3-jupyterlab-pygments (0.2.2-3) ... 294s Setting up python3-six (1.16.0-7) ... 294s Setting up libpython3.12t64:armhf (3.12.7-3) ... 294s Setting up libpython3.13-minimal:armhf (3.13.0-2) ... 294s Setting up libpgm-5.3-0t64:armhf (5.3.128~dfsg-2.1build1) ... 294s Setting up python3-decorator (5.1.1-5) ... 294s Setting up python3-fqdn (1.5.1-2) ... 295s Setting up libblas3:armhf (3.12.0-3build2) ... 295s update-alternatives: using /usr/lib/arm-linux-gnueabihf/blas/libblas.so.3 to provide /usr/lib/arm-linux-gnueabihf/libblas.so.3 (libblas.so.3-arm-linux-gnueabihf) in auto mode 295s Setting up python3-webcolors (1.13-1) ... 295s Setting up python3-packaging (24.2-1) ... 295s Setting up python3-wcwidth (0.2.13+dfsg1-1) ... 295s Setting up node-sprintf-js (1.1.2+ds1+~1.1.2-1) ... 295s Setting up libfreetype6:armhf (2.13.3+dfsg-1) ... 295s Setting up python3-typeshed (0.0~git20231111.6764465-3) ... 295s Setting up python3-executing (2.1.0-0.1) ... 295s Setting up node-balanced-match (2.0.0-1) ... 295s Setting up node-brace-expansion (2.0.1+~1.1.0-1) ... 295s Setting up python3-nest-asyncio (1.5.4-1) ... 296s Setting up python3-dill (0.3.9-1) ... 296s Setting up python3-brotli (1.1.0-2build3) ... 296s Setting up liblzf1:armhf (3.6-4) ... 296s Setting up python3-cycler (0.12.1-1) ... 296s Setting up libimagequant0:armhf (2.18.0-1build1) ... 296s Setting up python3-rfc3986-validator (0.1.1-2) ... 296s Setting up fonts-dejavu-mono (2.37-8) ... 296s Setting up python3-kiwisolver (1.4.7-2build1) ... 297s Setting up libcares2:armhf (1.34.2-1) ... 297s Setting up libtcl8.6:armhf (8.6.15+dfsg-2) ... 297s Setting up fonts-dejavu-core (2.37-8) ... 297s Setting up libjpeg-turbo8:armhf (2.1.5-3ubuntu2) ... 297s Setting up python3-html5lib (1.2-1) ... 297s Setting up libbabeltrace1:armhf (1.5.11-4build1) ... 297s Setting up libgfortran5:armhf (14.2.0-8ubuntu1) ... 297s Setting up python3-pluggy (1.5.0-1) ... 297s Setting up libwebp7:armhf (1.4.0-0.1) ... 297s Setting up python3-fastjsonschema (2.20.0-1) ... 297s Setting up node-undici (5.28.4+dfsg1+~cs23.12.11-2) ... 297s Setting up python3-traitlets (5.14.3+really5.14.3-1) ... 298s Setting up python-tinycss2-common (1.4.0-1) ... 298s Setting up libxslt1.1:armhf (1.1.39-0exp1ubuntu1) ... 298s Setting up python3-argon2 (21.1.0-2build1) ... 298s Setting up libopenjp2-7:armhf (2.5.0-2ubuntu1) ... 298s Setting up python3.13-minimal (3.13.0-2) ... 299s Setting up python3-toolz (1.0.0-1) ... 299s Setting up libharfbuzz0b:armhf (10.0.1-1) ... 299s Setting up python3-dateutil (2.9.0-3) ... 299s Setting up python3-msgpack (1.0.3-3build3) ... 300s Setting up libxss1:armhf (1:1.2.3-1build3) ... 300s Setting up node-minimatch (9.0.3-5) ... 300s Setting up libjs-jquery (3.6.1+dfsg+~3.5.14-1) ... 300s Setting up sass-stylesheets-bulma (0.9.4~ds-1) ... 300s Setting up python3-mpmath (1.3.0-1) ... 301s Setting up node-xtend (4.0.2-3) ... 301s Setting up python3-zict (3.0.0-2ubuntu1) ... 301s Setting up python-matplotlib-data (3.8.3-3ubuntu1) ... 301s Setting up libwebpmux3:armhf (1.4.0-0.1) ... 301s Setting up python3-locket (1.0.0-2) ... 301s Setting up python3-appdirs (1.4.4-4) ... 301s Setting up python3-yarl (1.9.4-1) ... 302s Setting up python3-mistune (3.0.2-2) ... 302s Setting up libpython3.13-stdlib:armhf (3.13.0-2) ... 302s Setting up python3-stack-data (0.6.3-1) ... 302s Setting up python3-soupsieve (2.6-1) ... 302s Setting up fonts-font-awesome (5.0.10+really4.7.0~dfsg-4.1) ... 302s Setting up sphinx-rtd-theme-common (3.0.2+dfsg-1) ... 302s Setting up python3-websocket (1.8.0-2) ... 302s Setting up python3-jupyter-core (5.7.2-4) ... 303s Setting up python3-nacl (1.5.0-6) ... 303s Setting up libsz2:armhf (1.1.3-1) ... 303s Setting up libjs-bootstrap (3.4.1+dfsg-3) ... 303s Setting up libjs-underscore (1.13.4~dfsg+~1.11.4-3) ... 303s Setting up python3-ptyprocess (0.7.0-6) ... 303s Setting up libjpeg8:armhf (8c-2ubuntu11) ... 303s Setting up python3-prompt-toolkit (3.0.48-1) ... 304s Setting up python3-partd (1.4.2-1) ... 304s Setting up python3-sympy (1.13.3-1) ... 319s Setting up libdebuginfod1t64:armhf (0.192-4) ... 319s Setting up liblapack3:armhf (3.12.0-3build2) ... 319s update-alternatives: using /usr/lib/arm-linux-gnueabihf/lapack/liblapack.so.3 to provide /usr/lib/arm-linux-gnueabihf/liblapack.so.3 (liblapack.so.3-arm-linux-gnueabihf) in auto mode 319s Setting up python3-tinycss2 (1.4.0-1) ... 319s Setting up libzmq5:armhf (4.3.5-1build2) ... 319s Setting up python3-arrow (1.3.0-1.1ubuntu1) ... 319s Setting up python3-jedi (0.19.1+ds1-1) ... 320s Setting up python3.13 (3.13.0-2) ... 321s Setting up fontconfig-config (2.15.0-1.1ubuntu2) ... 322s Setting up python3-pytest (8.3.3-1) ... 322s Setting up libwebpdemux2:armhf (1.4.0-0.1) ... 322s Setting up python3-aiohttp (3.9.5-1) ... 323s Setting up python3-dask (2024.5.2+dfsg-1) ... 326s Setting up python3-isoduration (20.11.0+git20211126.ae0bd61-2) ... 326s Setting up python3-all (3.12.7-1) ... 326s Setting up python3-coverage (7.4.4+dfsg1-0ubuntu3) ... 327s Setting up libsource-highlight4t64:armhf (3.1.9-4.3build1) ... 327s Setting up python3-nbformat (5.9.1-1) ... 327s Setting up python3-bs4 (4.12.3-3) ... 327s Setting up python3-bleach (6.2.0-1) ... 327s Setting up python3-matplotlib-inline (0.1.6-2) ... 328s Setting up python3-comm (0.2.1-1) ... 328s Setting up python3-fs (2.4.16-4) ... 328s Setting up python3-prometheus-client (0.19.0+ds1-1) ... 328s Setting up python3-distributed (2024.5.2+ds.1-8) ... 331s Setting up gdb (15.1-1ubuntu2) ... 331s Setting up libjs-jquery-ui (1.13.2+dfsg-1) ... 331s Setting up python3-pexpect (4.9-3) ... 331s Setting up python3-zmq (24.0.1-5build2) ... 332s Setting up libraqm0:armhf (0.10.1-1build1) ... 332s Setting up python3-numpy (1:1.26.4+ds-11ubuntu1) ... 336s Setting up libjs-sphinxdoc (7.4.7-4) ... 336s Setting up python3-terminado (0.18.1-1) ... 336s Setting up python3-lxml:armhf (5.3.0-1build1) ... 337s Setting up libtiff6:armhf (4.5.1+git230720-4ubuntu4) ... 337s Setting up python3-jupyter-client (8.6.3-1) ... 337s Setting up python3-contourpy (1.3.0-2build1) ... 337s Setting up python3-jupyter-server-terminals (0.5.3-2) ... 337s Setting up libfontconfig1:armhf (2.15.0-1.1ubuntu2) ... 337s Setting up python3-paramiko (3.4.1-2ubuntu1) ... 338s Setting up python3.12-doc (3.12.7-3) ... 338s Setting up libhdf5-103-1t64:armhf (1.10.10+repack-4ubuntu3) ... 338s Setting up python3-jupyter-events (0.10.0-3) ... 338s Setting up python3-doc (3.12.7-1) ... 338s Setting up liblbfgsb0:armhf (3.0+dfsg.4-1build1) ... 338s Setting up python-numpy-doc (1:1.26.4+ds-11ubuntu1) ... 338s Setting up libhdf5-hl-100t64:armhf (1.10.10+repack-4ubuntu3) ... 338s Setting up python3-pytest-rerunfailures (14.0-2) ... 338s Setting up libnetcdf19t64:armhf (1:4.9.2-6ubuntu1) ... 338s Setting up libxft2:armhf (2.3.6-1build1) ... 338s Setting up python3-scipy (1.13.1-5ubuntu1) ... 346s Setting up python3-pytest-timeout (2.3.1-1) ... 346s Setting up python-pandas-doc (2.2.3+dfsg-5ubuntu1) ... 346s Setting up libtk8.6:armhf (8.6.15-1) ... 346s Setting up python3-pandas-lib:armhf (2.2.3+dfsg-5ubuntu1) ... 346s Setting up python3.12-tk (3.12.7-3) ... 346s Setting up python3-sklearn-lib:armhf (1.4.2+dfsg-6build1) ... 346s Setting up python3-h5py-serial (3.11.0-5ubuntu1) ... 347s Setting up python3-debugpy (1.8.8+ds-2ubuntu1) ... 348s Setting up python3.13-tk (3.13.0-2) ... 348s Setting up python3-nbclient (0.8.0-1) ... 348s Setting up python3-pil:armhf (10.4.0-1ubuntu2) ... 349s Setting up python3-pandas (2.2.3+dfsg-5ubuntu1) ... 362s Setting up python3-ipython (8.29.0-1) ... 364s Setting up python-fsspec-doc (2024.9.0-1) ... 364s Setting up python3-ipykernel (6.29.5-1) ... 364s Setting up python3-h5py (3.11.0-5ubuntu1) ... 364s Setting up python3-sklearn (1.4.2+dfsg-6build1) ... 369s Setting up python3-cftime (1.6.4-1build1) ... 369s Setting up python3-nbconvert (7.16.4-2) ... 369s Setting up python3-netcdf4 (1.7.2-1build1) ... 370s Setting up tk8.6-blt2.5 (2.5.3+dfsg-7build1) ... 370s Setting up python3-jupyter-server (2.14.2-4) ... 370s Setting up blt (2.5.3+dfsg-7build1) ... 370s Setting up python3-tk:armhf (3.12.7-1) ... 370s Setting up python3-pil.imagetk:armhf (10.4.0-1ubuntu2) ... 370s Setting up libnode115:armhf (20.18.0+dfsg-2) ... 370s Setting up nodejs (20.18.0+dfsg-2) ... 370s update-alternatives: using /usr/bin/nodejs to provide /usr/bin/js (js) in auto mode 370s Setting up node-argparse (2.0.1-2) ... 370s Setting up python3-fonttools (4.55.0-3) ... 372s Setting up python3-ufolib2 (0.16.1+dfsg1-1) ... 373s Setting up node-acorn (8.8.1+ds+~cs25.17.7-2) ... 373s Setting up node-esprima (4.0.1+ds+~4.0.3-2) ... 373s Setting up node-js-yaml (4.1.0+dfsg+~4.0.5-7) ... 373s Setting up python3-matplotlib (3.8.3-3ubuntu1) ... 376s Setting up python-dask-doc (2024.5.2+dfsg-1) ... 376s Setting up python-distributed-doc (2024.5.2+ds.1-8) ... 376s Setting up autopkgtest-satdep (0) ... 376s Processing triggers for libc-bin (2.40-1ubuntu3) ... 376s Processing triggers for systemd (256.5-2ubuntu4) ... 376s Processing triggers for man-db (2.13.0-1) ... 377s Processing triggers for install-info (7.1.1-1) ... 414s (Reading database ... 102431 files and directories currently installed.) 414s Removing autopkgtest-satdep (0) ... 420s autopkgtest [20:43:29]: test pytest: [----------------------- 422s ping6: connect: Network is unreachable 422s No external ipv6 connectivity 422s Testing with python3.13: 422s *** STARTING RUN 1: python3.13 -m pytest -m not avoid_ci --verbose --timeout-method=signal --timeout=300 --durations=20 --color=no --pyargs distributed -rsfE --deselect=cli/tests/test_dask_scheduler.py::test_no_dashboard --deselect=deploy/tests/test_local.py::test_localcluster_get_client --deselect=deploy/tests/test_old_ssh.py::test_cluster --deselect=deploy/tests/test_old_ssh.py::test_old_ssh_nprocs_renamed_to_n_workers --deselect=deploy/tests/test_old_ssh.py::test_nprocs_attribute_is_deprecated --deselect=deploy/tests/test_ssh.py::test_nprocs_attribute_is_deprecated --deselect=http/tests/test_core.py::test_prometheus_api_doc --deselect=tests/test_init.py::test_git_revision --deselect=tests/test_jupyter.py::test_jupyter_idle_timeout --deselect=tests/test_jupyter.py::test_jupyter_idle_timeout_returned --deselect=tests/test_jupyter.py::test_jupyter_server --deselect=tests/test_jupyter.py::test_shutsdown_cleanly --deselect=tests/test_profile.py::test_stack_overflow --deselect=tests/test_pubsub.py::test_client_worker --deselect=tests/test_queues.py::test_queue_in_task --deselect=tests/test_spill.py::test_spillbuffer_oserror --deselect=tests/test_steal.py::test_steal_twice --deselect=tests/test_utils_test.py::test_cluster --deselect=tests/test_variable.py::test_variable_in_task --deselect=tests/test_worker.py::test_process_executor_kills_process --deselect=tests/test_worker_memory.py::test_fail_to_pickle_execute_1 --deselect=tests/test_worker_state_machine.py::test_task_state_instance_are_garbage_collected --deselect=protocol/tests/test_protocol.py::test_deeply_nested_structures --deselect=protocol/tests/test_serialize.py::test_deeply_nested_structures --deselect=deploy/tests/test_local.py::test_local_cluster_redundant_kwarg --deselect=deploy/tests/test_slow_adaptive.py::test_adaptive --deselect=tests/test_client.py::test_futures_in_subgraphs --deselect=tests/test_dask_collections.py::test_dataframe_groupby_tasks --deselect=tests/test_dask_collections.py::test_dataframes --deselect=tests/test_dask_collections.py::test_rolling_sync --deselect=tests/test_scheduler.py::test_balance_many_workers_2 --deselect=tests/test_scheduler.py::test_default_task_duration_splits --deselect=tests/test_steal.py::test_blocklist_shuffle_split 424s ============================= test session starts ============================== 424s platform linux -- Python 3.13.0, pytest-8.3.3, pluggy-1.5.0 -- /usr/bin/python3.13 424s cachedir: .pytest_cache 424s rootdir: /tmp/autopkgtest.1vd31g/autopkgtest_tmp 424s configfile: pyproject.toml 424s plugins: typeguard-4.4.1, anyio-4.6.2, rerunfailures-14.0, timeout-2.3.1 424s timeout: 300.0s 424s timeout method: signal 424s timeout func_only: False 433s collecting ... collected 3601 items / 3 errors / 45 deselected / 25 skipped / 3556 selected 433s 433s ==================================== ERRORS ==================================== 433s _________________ ERROR collecting cli/tests/test_dask_ssh.py __________________ 433s /usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_ssh.py:9: in 433s pytest.importorskip("paramiko") 433s E pytest.PytestDeprecationWarning: 433s E Module 'paramiko' was found, but when imported by pytest it raised: 433s E ImportError("cannot import name 'exceptions' from 'cryptography.hazmat.bindings._rust' (unknown location)") 433s E In pytest 9.1 this warning will become an error by default. 433s E You can fix the underlying problem, or alternatively overwrite this behavior and silence this warning by passing exc_type=ImportError explicitly. 433s E See https://docs.pytest.org/en/stable/deprecations.html#pytest-importorskip-default-behavior-regarding-importerror 433s ________________ ERROR collecting deploy/tests/test_old_ssh.py _________________ 433s /usr/lib/python3/dist-packages/distributed/deploy/tests/test_old_ssh.py:7: in 433s pytest.importorskip("paramiko") 433s E pytest.PytestDeprecationWarning: 433s E Module 'paramiko' was found, but when imported by pytest it raised: 433s E ImportError("cannot import name 'exceptions' from 'cryptography.hazmat.bindings._rust' (unknown location)") 433s E In pytest 9.1 this warning will become an error by default. 433s E You can fix the underlying problem, or alternatively overwrite this behavior and silence this warning by passing exc_type=ImportError explicitly. 433s E See https://docs.pytest.org/en/stable/deprecations.html#pytest-importorskip-default-behavior-regarding-importerror 433s _________________ ERROR collecting protocol/tests/test_h5py.py _________________ 433s /usr/lib/python3/dist-packages/distributed/protocol/tests/test_h5py.py:8: in 433s h5py = pytest.importorskip("h5py") 433s E pytest.PytestDeprecationWarning: 433s E Module 'h5py' was found, but when imported by pytest it raised: 433s E ImportError("cannot import name '_debian_h5py_mpi' from partially initialized module 'h5py' (most likely due to a circular import) (/usr/lib/python3/dist-packages/h5py/__init__.py)") 433s E In pytest 9.1 this warning will become an error by default. 433s E You can fix the underlying problem, or alternatively overwrite this behavior and silence this warning by passing exc_type=ImportError explicitly. 433s E See https://docs.pytest.org/en/stable/deprecations.html#pytest-importorskip-default-behavior-regarding-importerror 433s =========================== short test summary info ============================ 433s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_ucx.py:15: could not import 'ucp': No module named 'ucp' 433s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_ucx_config.py:22: could not import 'ucp': No module named 'ucp' 433s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/dashboard/tests/test_components.py:5: could not import 'bokeh': No module named 'bokeh' 433s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/dashboard/tests/test_scheduler_bokeh.py:11: could not import 'bokeh': No module named 'bokeh' 433s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/dashboard/tests/test_worker_bokeh.py:10: could not import 'bokeh': No module named 'bokeh' 433s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_ssh.py:5: could not import 'asyncssh': No module named 'asyncssh' 433s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_cudf_diagnostics.py:20: could not import 'cudf': No module named 'cudf' 433s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_memray.py:5: could not import 'memray': No module named 'memray' 433s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_nvml.py:10: could not import 'pynvml': No module named 'pynvml' 433s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_progress_stream.py:5: could not import 'bokeh': No module named 'bokeh' 433s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_progress_widgets.py:14: could not import 'ipywidgets': No module named 'ipywidgets' 433s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_rmm_diagnostics.py:14: could not import 'dask_cuda': No module named 'dask_cuda' 433s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_arrow.py:5: could not import 'pyarrow': No module named 'pyarrow' 433s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_cupy.py:11: could not import 'cupy': No module named 'cupy' 433s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_keras.py:5: could not import 'keras': No module named 'keras' 433s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numba.py:11: could not import 'numba.cuda': No module named 'numba' 433s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_rmm.py:10: could not import 'numba.cuda': No module named 'numba' 433s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_sparse.py:6: could not import 'sparse': No module named 'sparse' 433s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_torch.py:8: could not import 'torch': No module named 'torch' 433s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_graph.py:9: could not import 'pyarrow': No module named 'pyarrow' 433s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_merge.py:71: could not import 'pyarrow': No module named 'pyarrow' 433s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_merge_column_and_index.py:110: could not import 'pyarrow': No module named 'pyarrow' 433s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_metrics.py:71: could not import 'pyarrow': No module named 'pyarrow' 433s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_shuffle.py:195: could not import 'pyarrow': No module named 'pyarrow' 433s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/tests/test_parse_stdout.py:14: could not import 'parse_stdout': No module named 'parse_stdout' 433s ERROR cli/tests/test_dask_ssh.py - pytest.PytestDeprecationWarning: 433s Module 'paramiko' was found, but when imported by pytest it raised: 433s ImportError("cannot import name 'exceptions' from 'cryptography.hazmat.bindings._rust' (unknown location)") 433s In pytest 9.1 this warning will become an error by default. 433s You can fix the underlying problem, or alternatively overwrite this behavior and silence this warning by passing exc_type=ImportError explicitly. 433s See https://docs.pytest.org/en/stable/deprecations.html#pytest-importorskip-default-behavior-regarding-importerror 433s ERROR deploy/tests/test_old_ssh.py - pytest.PytestDeprecationWarning: 433s Module 'paramiko' was found, but when imported by pytest it raised: 433s ImportError("cannot import name 'exceptions' from 'cryptography.hazmat.bindings._rust' (unknown location)") 433s In pytest 9.1 this warning will become an error by default. 433s You can fix the underlying problem, or alternatively overwrite this behavior and silence this warning by passing exc_type=ImportError explicitly. 433s See https://docs.pytest.org/en/stable/deprecations.html#pytest-importorskip-default-behavior-regarding-importerror 433s ERROR protocol/tests/test_h5py.py - pytest.PytestDeprecationWarning: 433s Module 'h5py' was found, but when imported by pytest it raised: 433s ImportError("cannot import name '_debian_h5py_mpi' from partially initialized module 'h5py' (most likely due to a circular import) (/usr/lib/python3/dist-packages/h5py/__init__.py)") 433s In pytest 9.1 this warning will become an error by default. 433s You can fix the underlying problem, or alternatively overwrite this behavior and silence this warning by passing exc_type=ImportError explicitly. 433s See https://docs.pytest.org/en/stable/deprecations.html#pytest-importorskip-default-behavior-regarding-importerror 433s !!!!!!!!!!!!!!!!!!! Interrupted: 3 errors during collection !!!!!!!!!!!!!!!!!!!! 433s ================= 25 skipped, 45 deselected, 3 errors in 9.72s ================= 434s *** END OF RUN 1: NOT ALL TESTS HAVE YET PASSED/XFAILED *** 434s *** STARTING RUN 2: python3.13 -m pytest -m not avoid_ci --verbose --timeout-method=signal --timeout=300 --durations=20 --color=no --pyargs distributed -rfE --last-failed --last-failed-no-failures none --deselect=cli/tests/test_dask_scheduler.py::test_no_dashboard --deselect=deploy/tests/test_local.py::test_localcluster_get_client --deselect=deploy/tests/test_old_ssh.py::test_cluster --deselect=deploy/tests/test_old_ssh.py::test_old_ssh_nprocs_renamed_to_n_workers --deselect=deploy/tests/test_old_ssh.py::test_nprocs_attribute_is_deprecated --deselect=deploy/tests/test_ssh.py::test_nprocs_attribute_is_deprecated --deselect=http/tests/test_core.py::test_prometheus_api_doc --deselect=tests/test_init.py::test_git_revision --deselect=tests/test_jupyter.py::test_jupyter_idle_timeout --deselect=tests/test_jupyter.py::test_jupyter_idle_timeout_returned --deselect=tests/test_jupyter.py::test_jupyter_server --deselect=tests/test_jupyter.py::test_shutsdown_cleanly --deselect=tests/test_profile.py::test_stack_overflow --deselect=tests/test_pubsub.py::test_client_worker --deselect=tests/test_queues.py::test_queue_in_task --deselect=tests/test_spill.py::test_spillbuffer_oserror --deselect=tests/test_steal.py::test_steal_twice --deselect=tests/test_utils_test.py::test_cluster --deselect=tests/test_variable.py::test_variable_in_task --deselect=tests/test_worker.py::test_process_executor_kills_process --deselect=tests/test_worker_memory.py::test_fail_to_pickle_execute_1 --deselect=tests/test_worker_state_machine.py::test_task_state_instance_are_garbage_collected --deselect=protocol/tests/test_protocol.py::test_deeply_nested_structures --deselect=protocol/tests/test_serialize.py::test_deeply_nested_structures --deselect=deploy/tests/test_local.py::test_local_cluster_redundant_kwarg --deselect=deploy/tests/test_slow_adaptive.py::test_adaptive --deselect=tests/test_client.py::test_futures_in_subgraphs --deselect=tests/test_dask_collections.py::test_dataframe_groupby_tasks --deselect=tests/test_dask_collections.py::test_dataframes --deselect=tests/test_dask_collections.py::test_rolling_sync --deselect=tests/test_scheduler.py::test_balance_many_workers_2 --deselect=tests/test_scheduler.py::test_default_task_duration_splits --deselect=tests/test_steal.py::test_blocklist_shuffle_split 435s ============================= test session starts ============================== 435s platform linux -- Python 3.13.0, pytest-8.3.3, pluggy-1.5.0 -- /usr/bin/python3.13 435s cachedir: .pytest_cache 435s rootdir: /tmp/autopkgtest.1vd31g/autopkgtest_tmp 435s configfile: pyproject.toml 435s plugins: typeguard-4.4.1, anyio-4.6.2, rerunfailures-14.0, timeout-2.3.1 435s timeout: 300.0s 435s timeout method: signal 435s timeout func_only: False 445s collecting ... collected 3601 items / 3 errors / 45 deselected / 25 skipped / 3556 selected 445s run-last-failure: 3 known failures not in selected tests 445s 445s ==================================== ERRORS ==================================== 445s _________________ ERROR collecting cli/tests/test_dask_ssh.py __________________ 445s /usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_ssh.py:9: in 445s pytest.importorskip("paramiko") 445s E pytest.PytestDeprecationWarning: 445s E Module 'paramiko' was found, but when imported by pytest it raised: 445s E ImportError("cannot import name 'exceptions' from 'cryptography.hazmat.bindings._rust' (unknown location)") 445s E In pytest 9.1 this warning will become an error by default. 445s E You can fix the underlying problem, or alternatively overwrite this behavior and silence this warning by passing exc_type=ImportError explicitly. 445s E See https://docs.pytest.org/en/stable/deprecations.html#pytest-importorskip-default-behavior-regarding-importerror 445s ________________ ERROR collecting deploy/tests/test_old_ssh.py _________________ 445s /usr/lib/python3/dist-packages/distributed/deploy/tests/test_old_ssh.py:7: in 445s pytest.importorskip("paramiko") 445s E pytest.PytestDeprecationWarning: 445s E Module 'paramiko' was found, but when imported by pytest it raised: 445s E ImportError("cannot import name 'exceptions' from 'cryptography.hazmat.bindings._rust' (unknown location)") 445s E In pytest 9.1 this warning will become an error by default. 445s E You can fix the underlying problem, or alternatively overwrite this behavior and silence this warning by passing exc_type=ImportError explicitly. 445s E See https://docs.pytest.org/en/stable/deprecations.html#pytest-importorskip-default-behavior-regarding-importerror 445s _________________ ERROR collecting protocol/tests/test_h5py.py _________________ 445s /usr/lib/python3/dist-packages/distributed/protocol/tests/test_h5py.py:8: in 445s h5py = pytest.importorskip("h5py") 445s E pytest.PytestDeprecationWarning: 445s E Module 'h5py' was found, but when imported by pytest it raised: 445s E ImportError("cannot import name '_debian_h5py_mpi' from partially initialized module 'h5py' (most likely due to a circular import) (/usr/lib/python3/dist-packages/h5py/__init__.py)") 445s E In pytest 9.1 this warning will become an error by default. 445s E You can fix the underlying problem, or alternatively overwrite this behavior and silence this warning by passing exc_type=ImportError explicitly. 445s E See https://docs.pytest.org/en/stable/deprecations.html#pytest-importorskip-default-behavior-regarding-importerror 445s =========================== short test summary info ============================ 445s ERROR cli/tests/test_dask_ssh.py - pytest.PytestDeprecationWarning: 445s Module 'paramiko' was found, but when imported by pytest it raised: 445s ImportError("cannot import name 'exceptions' from 'cryptography.hazmat.bindings._rust' (unknown location)") 445s In pytest 9.1 this warning will become an error by default. 445s You can fix the underlying problem, or alternatively overwrite this behavior and silence this warning by passing exc_type=ImportError explicitly. 445s See https://docs.pytest.org/en/stable/deprecations.html#pytest-importorskip-default-behavior-regarding-importerror 445s ERROR deploy/tests/test_old_ssh.py - pytest.PytestDeprecationWarning: 445s Module 'paramiko' was found, but when imported by pytest it raised: 445s ImportError("cannot import name 'exceptions' from 'cryptography.hazmat.bindings._rust' (unknown location)") 445s In pytest 9.1 this warning will become an error by default. 445s You can fix the underlying problem, or alternatively overwrite this behavior and silence this warning by passing exc_type=ImportError explicitly. 445s See https://docs.pytest.org/en/stable/deprecations.html#pytest-importorskip-default-behavior-regarding-importerror 445s ERROR protocol/tests/test_h5py.py - pytest.PytestDeprecationWarning: 445s Module 'h5py' was found, but when imported by pytest it raised: 445s ImportError("cannot import name '_debian_h5py_mpi' from partially initialized module 'h5py' (most likely due to a circular import) (/usr/lib/python3/dist-packages/h5py/__init__.py)") 445s In pytest 9.1 this warning will become an error by default. 445s You can fix the underlying problem, or alternatively overwrite this behavior and silence this warning by passing exc_type=ImportError explicitly. 445s See https://docs.pytest.org/en/stable/deprecations.html#pytest-importorskip-default-behavior-regarding-importerror 445s !!!!!!!!!!!!!!!!!!! Interrupted: 3 errors during collection !!!!!!!!!!!!!!!!!!!! 445s ================= 25 skipped, 45 deselected, 3 errors in 9.42s ================= 445s *** END OF RUN 2: NOT ALL TESTS HAVE YET PASSED/XFAILED *** 445s *** STARTING RUN 3: python3.13 -m pytest -m not avoid_ci --verbose --timeout-method=signal --timeout=300 --durations=20 --color=no --pyargs distributed -rfE --last-failed --last-failed-no-failures none --deselect=cli/tests/test_dask_scheduler.py::test_no_dashboard --deselect=deploy/tests/test_local.py::test_localcluster_get_client --deselect=deploy/tests/test_old_ssh.py::test_cluster --deselect=deploy/tests/test_old_ssh.py::test_old_ssh_nprocs_renamed_to_n_workers --deselect=deploy/tests/test_old_ssh.py::test_nprocs_attribute_is_deprecated --deselect=deploy/tests/test_ssh.py::test_nprocs_attribute_is_deprecated --deselect=http/tests/test_core.py::test_prometheus_api_doc --deselect=tests/test_init.py::test_git_revision --deselect=tests/test_jupyter.py::test_jupyter_idle_timeout --deselect=tests/test_jupyter.py::test_jupyter_idle_timeout_returned --deselect=tests/test_jupyter.py::test_jupyter_server --deselect=tests/test_jupyter.py::test_shutsdown_cleanly --deselect=tests/test_profile.py::test_stack_overflow --deselect=tests/test_pubsub.py::test_client_worker --deselect=tests/test_queues.py::test_queue_in_task --deselect=tests/test_spill.py::test_spillbuffer_oserror --deselect=tests/test_steal.py::test_steal_twice --deselect=tests/test_utils_test.py::test_cluster --deselect=tests/test_variable.py::test_variable_in_task --deselect=tests/test_worker.py::test_process_executor_kills_process --deselect=tests/test_worker_memory.py::test_fail_to_pickle_execute_1 --deselect=tests/test_worker_state_machine.py::test_task_state_instance_are_garbage_collected --deselect=protocol/tests/test_protocol.py::test_deeply_nested_structures --deselect=protocol/tests/test_serialize.py::test_deeply_nested_structures --deselect=deploy/tests/test_local.py::test_local_cluster_redundant_kwarg --deselect=deploy/tests/test_slow_adaptive.py::test_adaptive --deselect=tests/test_client.py::test_futures_in_subgraphs --deselect=tests/test_dask_collections.py::test_dataframe_groupby_tasks --deselect=tests/test_dask_collections.py::test_dataframes --deselect=tests/test_dask_collections.py::test_rolling_sync --deselect=tests/test_scheduler.py::test_balance_many_workers_2 --deselect=tests/test_scheduler.py::test_default_task_duration_splits --deselect=tests/test_steal.py::test_blocklist_shuffle_split 447s ============================= test session starts ============================== 447s platform linux -- Python 3.13.0, pytest-8.3.3, pluggy-1.5.0 -- /usr/bin/python3.13 447s cachedir: .pytest_cache 447s rootdir: /tmp/autopkgtest.1vd31g/autopkgtest_tmp 447s configfile: pyproject.toml 447s plugins: typeguard-4.4.1, anyio-4.6.2, rerunfailures-14.0, timeout-2.3.1 447s timeout: 300.0s 447s timeout method: signal 447s timeout func_only: False 456s collecting ... collected 3601 items / 3 errors / 45 deselected / 25 skipped / 3556 selected 456s run-last-failure: 3 known failures not in selected tests 456s 456s ==================================== ERRORS ==================================== 456s _________________ ERROR collecting cli/tests/test_dask_ssh.py __________________ 456s /usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_ssh.py:9: in 456s pytest.importorskip("paramiko") 456s E pytest.PytestDeprecationWarning: 456s E Module 'paramiko' was found, but when imported by pytest it raised: 456s E ImportError("cannot import name 'exceptions' from 'cryptography.hazmat.bindings._rust' (unknown location)") 456s E In pytest 9.1 this warning will become an error by default. 456s E You can fix the underlying problem, or alternatively overwrite this behavior and silence this warning by passing exc_type=ImportError explicitly. 456s E See https://docs.pytest.org/en/stable/deprecations.html#pytest-importorskip-default-behavior-regarding-importerror 456s ________________ ERROR collecting deploy/tests/test_old_ssh.py _________________ 456s /usr/lib/python3/dist-packages/distributed/deploy/tests/test_old_ssh.py:7: in 456s pytest.importorskip("paramiko") 456s E pytest.PytestDeprecationWarning: 456s E Module 'paramiko' was found, but when imported by pytest it raised: 456s E ImportError("cannot import name 'exceptions' from 'cryptography.hazmat.bindings._rust' (unknown location)") 456s E In pytest 9.1 this warning will become an error by default. 456s E You can fix the underlying problem, or alternatively overwrite this behavior and silence this warning by passing exc_type=ImportError explicitly. 456s E See https://docs.pytest.org/en/stable/deprecations.html#pytest-importorskip-default-behavior-regarding-importerror 456s _________________ ERROR collecting protocol/tests/test_h5py.py _________________ 456s /usr/lib/python3/dist-packages/distributed/protocol/tests/test_h5py.py:8: in 456s h5py = pytest.importorskip("h5py") 456s E pytest.PytestDeprecationWarning: 456s E Module 'h5py' was found, but when imported by pytest it raised: 456s E ImportError("cannot import name '_debian_h5py_mpi' from partially initialized module 'h5py' (most likely due to a circular import) (/usr/lib/python3/dist-packages/h5py/__init__.py)") 456s E In pytest 9.1 this warning will become an error by default. 456s E You can fix the underlying problem, or alternatively overwrite this behavior and silence this warning by passing exc_type=ImportError explicitly. 456s E See https://docs.pytest.org/en/stable/deprecations.html#pytest-importorskip-default-behavior-regarding-importerror 456s =========================== short test summary info ============================ 456s ERROR cli/tests/test_dask_ssh.py - pytest.PytestDeprecationWarning: 456s Module 'paramiko' was found, but when imported by pytest it raised: 456s ImportError("cannot import name 'exceptions' from 'cryptography.hazmat.bindings._rust' (unknown location)") 456s In pytest 9.1 this warning will become an error by default. 456s You can fix the underlying problem, or alternatively overwrite this behavior and silence this warning by passing exc_type=ImportError explicitly. 456s See https://docs.pytest.org/en/stable/deprecations.html#pytest-importorskip-default-behavior-regarding-importerror 456s ERROR deploy/tests/test_old_ssh.py - pytest.PytestDeprecationWarning: 456s Module 'paramiko' was found, but when imported by pytest it raised: 456s ImportError("cannot import name 'exceptions' from 'cryptography.hazmat.bindings._rust' (unknown location)") 456s In pytest 9.1 this warning will become an error by default. 456s You can fix the underlying problem, or alternatively overwrite this behavior and silence this warning by passing exc_type=ImportError explicitly. 456s See https://docs.pytest.org/en/stable/deprecations.html#pytest-importorskip-default-behavior-regarding-importerror 456s ERROR protocol/tests/test_h5py.py - pytest.PytestDeprecationWarning: 456s Module 'h5py' was found, but when imported by pytest it raised: 456s ImportError("cannot import name '_debian_h5py_mpi' from partially initialized module 'h5py' (most likely due to a circular import) (/usr/lib/python3/dist-packages/h5py/__init__.py)") 456s In pytest 9.1 this warning will become an error by default. 456s You can fix the underlying problem, or alternatively overwrite this behavior and silence this warning by passing exc_type=ImportError explicitly. 456s See https://docs.pytest.org/en/stable/deprecations.html#pytest-importorskip-default-behavior-regarding-importerror 456s !!!!!!!!!!!!!!!!!!! Interrupted: 3 errors during collection !!!!!!!!!!!!!!!!!!!! 456s ================= 25 skipped, 45 deselected, 3 errors in 9.46s ================= 457s *** END OF RUN 3: NOT ALL TESTS HAVE YET PASSED/XFAILED *** 457s *** STARTING RUN 4: python3.13 -m pytest -m not avoid_ci --verbose --timeout-method=signal --timeout=300 --durations=20 --color=no --pyargs distributed -rfE --last-failed --last-failed-no-failures none --deselect=cli/tests/test_dask_scheduler.py::test_no_dashboard --deselect=deploy/tests/test_local.py::test_localcluster_get_client --deselect=deploy/tests/test_old_ssh.py::test_cluster --deselect=deploy/tests/test_old_ssh.py::test_old_ssh_nprocs_renamed_to_n_workers --deselect=deploy/tests/test_old_ssh.py::test_nprocs_attribute_is_deprecated --deselect=deploy/tests/test_ssh.py::test_nprocs_attribute_is_deprecated --deselect=http/tests/test_core.py::test_prometheus_api_doc --deselect=tests/test_init.py::test_git_revision --deselect=tests/test_jupyter.py::test_jupyter_idle_timeout --deselect=tests/test_jupyter.py::test_jupyter_idle_timeout_returned --deselect=tests/test_jupyter.py::test_jupyter_server --deselect=tests/test_jupyter.py::test_shutsdown_cleanly --deselect=tests/test_profile.py::test_stack_overflow --deselect=tests/test_pubsub.py::test_client_worker --deselect=tests/test_queues.py::test_queue_in_task --deselect=tests/test_spill.py::test_spillbuffer_oserror --deselect=tests/test_steal.py::test_steal_twice --deselect=tests/test_utils_test.py::test_cluster --deselect=tests/test_variable.py::test_variable_in_task --deselect=tests/test_worker.py::test_process_executor_kills_process --deselect=tests/test_worker_memory.py::test_fail_to_pickle_execute_1 --deselect=tests/test_worker_state_machine.py::test_task_state_instance_are_garbage_collected --deselect=protocol/tests/test_protocol.py::test_deeply_nested_structures --deselect=protocol/tests/test_serialize.py::test_deeply_nested_structures --deselect=deploy/tests/test_local.py::test_local_cluster_redundant_kwarg --deselect=deploy/tests/test_slow_adaptive.py::test_adaptive --deselect=tests/test_client.py::test_futures_in_subgraphs --deselect=tests/test_dask_collections.py::test_dataframe_groupby_tasks --deselect=tests/test_dask_collections.py::test_dataframes --deselect=tests/test_dask_collections.py::test_rolling_sync --deselect=tests/test_scheduler.py::test_balance_many_workers_2 --deselect=tests/test_scheduler.py::test_default_task_duration_splits --deselect=tests/test_steal.py::test_blocklist_shuffle_split 458s ============================= test session starts ============================== 458s platform linux -- Python 3.13.0, pytest-8.3.3, pluggy-1.5.0 -- /usr/bin/python3.13 458s cachedir: .pytest_cache 458s rootdir: /tmp/autopkgtest.1vd31g/autopkgtest_tmp 458s configfile: pyproject.toml 458s plugins: typeguard-4.4.1, anyio-4.6.2, rerunfailures-14.0, timeout-2.3.1 458s timeout: 300.0s 458s timeout method: signal 458s timeout func_only: False 468s collecting ... collected 3601 items / 3 errors / 45 deselected / 25 skipped / 3556 selected 468s run-last-failure: 3 known failures not in selected tests 468s 468s ==================================== ERRORS ==================================== 468s _________________ ERROR collecting cli/tests/test_dask_ssh.py __________________ 468s /usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_ssh.py:9: in 468s pytest.importorskip("paramiko") 468s E pytest.PytestDeprecationWarning: 468s E Module 'paramiko' was found, but when imported by pytest it raised: 468s E ImportError("cannot import name 'exceptions' from 'cryptography.hazmat.bindings._rust' (unknown location)") 468s E In pytest 9.1 this warning will become an error by default. 468s E You can fix the underlying problem, or alternatively overwrite this behavior and silence this warning by passing exc_type=ImportError explicitly. 468s E See https://docs.pytest.org/en/stable/deprecations.html#pytest-importorskip-default-behavior-regarding-importerror 468s ________________ ERROR collecting deploy/tests/test_old_ssh.py _________________ 468s /usr/lib/python3/dist-packages/distributed/deploy/tests/test_old_ssh.py:7: in 468s pytest.importorskip("paramiko") 468s E pytest.PytestDeprecationWarning: 468s E Module 'paramiko' was found, but when imported by pytest it raised: 468s E ImportError("cannot import name 'exceptions' from 'cryptography.hazmat.bindings._rust' (unknown location)") 468s E In pytest 9.1 this warning will become an error by default. 468s E You can fix the underlying problem, or alternatively overwrite this behavior and silence this warning by passing exc_type=ImportError explicitly. 468s E See https://docs.pytest.org/en/stable/deprecations.html#pytest-importorskip-default-behavior-regarding-importerror 468s _________________ ERROR collecting protocol/tests/test_h5py.py _________________ 468s /usr/lib/python3/dist-packages/distributed/protocol/tests/test_h5py.py:8: in 468s h5py = pytest.importorskip("h5py") 468s E pytest.PytestDeprecationWarning: 468s E Module 'h5py' was found, but when imported by pytest it raised: 468s E ImportError("cannot import name '_debian_h5py_mpi' from partially initialized module 'h5py' (most likely due to a circular import) (/usr/lib/python3/dist-packages/h5py/__init__.py)") 468s E In pytest 9.1 this warning will become an error by default. 468s E You can fix the underlying problem, or alternatively overwrite this behavior and silence this warning by passing exc_type=ImportError explicitly. 468s E See https://docs.pytest.org/en/stable/deprecations.html#pytest-importorskip-default-behavior-regarding-importerror 468s =========================== short test summary info ============================ 468s ERROR cli/tests/test_dask_ssh.py - pytest.PytestDeprecationWarning: 468s Module 'paramiko' was found, but when imported by pytest it raised: 468s ImportError("cannot import name 'exceptions' from 'cryptography.hazmat.bindings._rust' (unknown location)") 468s In pytest 9.1 this warning will become an error by default. 468s You can fix the underlying problem, or alternatively overwrite this behavior and silence this warning by passing exc_type=ImportError explicitly. 468s See https://docs.pytest.org/en/stable/deprecations.html#pytest-importorskip-default-behavior-regarding-importerror 468s ERROR deploy/tests/test_old_ssh.py - pytest.PytestDeprecationWarning: 468s Module 'paramiko' was found, but when imported by pytest it raised: 468s ImportError("cannot import name 'exceptions' from 'cryptography.hazmat.bindings._rust' (unknown location)") 468s In pytest 9.1 this warning will become an error by default. 468s You can fix the underlying problem, or alternatively overwrite this behavior and silence this warning by passing exc_type=ImportError explicitly. 468s See https://docs.pytest.org/en/stable/deprecations.html#pytest-importorskip-default-behavior-regarding-importerror 468s ERROR protocol/tests/test_h5py.py - pytest.PytestDeprecationWarning: 468s Module 'h5py' was found, but when imported by pytest it raised: 468s ImportError("cannot import name '_debian_h5py_mpi' from partially initialized module 'h5py' (most likely due to a circular import) (/usr/lib/python3/dist-packages/h5py/__init__.py)") 468s In pytest 9.1 this warning will become an error by default. 468s You can fix the underlying problem, or alternatively overwrite this behavior and silence this warning by passing exc_type=ImportError explicitly. 468s See https://docs.pytest.org/en/stable/deprecations.html#pytest-importorskip-default-behavior-regarding-importerror 468s !!!!!!!!!!!!!!!!!!! Interrupted: 3 errors during collection !!!!!!!!!!!!!!!!!!!! 468s ================= 25 skipped, 45 deselected, 3 errors in 9.08s ================= 468s *** END OF RUN 4: NOT ALL TESTS HAVE YET PASSED/XFAILED *** 468s *** STARTING RUN 5: python3.13 -m pytest -m not avoid_ci --verbose --timeout-method=signal --timeout=300 --durations=20 --color=no --pyargs distributed -rfE --last-failed --last-failed-no-failures none --deselect=cli/tests/test_dask_scheduler.py::test_no_dashboard --deselect=deploy/tests/test_local.py::test_localcluster_get_client --deselect=deploy/tests/test_old_ssh.py::test_cluster --deselect=deploy/tests/test_old_ssh.py::test_old_ssh_nprocs_renamed_to_n_workers --deselect=deploy/tests/test_old_ssh.py::test_nprocs_attribute_is_deprecated --deselect=deploy/tests/test_ssh.py::test_nprocs_attribute_is_deprecated --deselect=http/tests/test_core.py::test_prometheus_api_doc --deselect=tests/test_init.py::test_git_revision --deselect=tests/test_jupyter.py::test_jupyter_idle_timeout --deselect=tests/test_jupyter.py::test_jupyter_idle_timeout_returned --deselect=tests/test_jupyter.py::test_jupyter_server --deselect=tests/test_jupyter.py::test_shutsdown_cleanly --deselect=tests/test_profile.py::test_stack_overflow --deselect=tests/test_pubsub.py::test_client_worker --deselect=tests/test_queues.py::test_queue_in_task --deselect=tests/test_spill.py::test_spillbuffer_oserror --deselect=tests/test_steal.py::test_steal_twice --deselect=tests/test_utils_test.py::test_cluster --deselect=tests/test_variable.py::test_variable_in_task --deselect=tests/test_worker.py::test_process_executor_kills_process --deselect=tests/test_worker_memory.py::test_fail_to_pickle_execute_1 --deselect=tests/test_worker_state_machine.py::test_task_state_instance_are_garbage_collected --deselect=protocol/tests/test_protocol.py::test_deeply_nested_structures --deselect=protocol/tests/test_serialize.py::test_deeply_nested_structures --deselect=deploy/tests/test_local.py::test_local_cluster_redundant_kwarg --deselect=deploy/tests/test_slow_adaptive.py::test_adaptive --deselect=tests/test_client.py::test_futures_in_subgraphs --deselect=tests/test_dask_collections.py::test_dataframe_groupby_tasks --deselect=tests/test_dask_collections.py::test_dataframes --deselect=tests/test_dask_collections.py::test_rolling_sync --deselect=tests/test_scheduler.py::test_balance_many_workers_2 --deselect=tests/test_scheduler.py::test_default_task_duration_splits --deselect=tests/test_steal.py::test_blocklist_shuffle_split 469s ============================= test session starts ============================== 469s platform linux -- Python 3.13.0, pytest-8.3.3, pluggy-1.5.0 -- /usr/bin/python3.13 469s cachedir: .pytest_cache 469s rootdir: /tmp/autopkgtest.1vd31g/autopkgtest_tmp 469s configfile: pyproject.toml 469s plugins: typeguard-4.4.1, anyio-4.6.2, rerunfailures-14.0, timeout-2.3.1 469s timeout: 300.0s 469s timeout method: signal 469s timeout func_only: False 479s collecting ... collected 3601 items / 3 errors / 45 deselected / 25 skipped / 3556 selected 479s run-last-failure: 3 known failures not in selected tests 479s 479s ==================================== ERRORS ==================================== 479s _________________ ERROR collecting cli/tests/test_dask_ssh.py __________________ 479s /usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_ssh.py:9: in 479s pytest.importorskip("paramiko") 479s E pytest.PytestDeprecationWarning: 479s E Module 'paramiko' was found, but when imported by pytest it raised: 479s E ImportError("cannot import name 'exceptions' from 'cryptography.hazmat.bindings._rust' (unknown location)") 479s E In pytest 9.1 this warning will become an error by default. 479s E You can fix the underlying problem, or alternatively overwrite this behavior and silence this warning by passing exc_type=ImportError explicitly. 479s E See https://docs.pytest.org/en/stable/deprecations.html#pytest-importorskip-default-behavior-regarding-importerror 479s ________________ ERROR collecting deploy/tests/test_old_ssh.py _________________ 479s /usr/lib/python3/dist-packages/distributed/deploy/tests/test_old_ssh.py:7: in 479s pytest.importorskip("paramiko") 479s E pytest.PytestDeprecationWarning: 479s E Module 'paramiko' was found, but when imported by pytest it raised: 479s E ImportError("cannot import name 'exceptions' from 'cryptography.hazmat.bindings._rust' (unknown location)") 479s E In pytest 9.1 this warning will become an error by default. 479s E You can fix the underlying problem, or alternatively overwrite this behavior and silence this warning by passing exc_type=ImportError explicitly. 479s E See https://docs.pytest.org/en/stable/deprecations.html#pytest-importorskip-default-behavior-regarding-importerror 479s _________________ ERROR collecting protocol/tests/test_h5py.py _________________ 479s /usr/lib/python3/dist-packages/distributed/protocol/tests/test_h5py.py:8: in 479s h5py = pytest.importorskip("h5py") 479s E pytest.PytestDeprecationWarning: 479s E Module 'h5py' was found, but when imported by pytest it raised: 479s E ImportError("cannot import name '_debian_h5py_mpi' from partially initialized module 'h5py' (most likely due to a circular import) (/usr/lib/python3/dist-packages/h5py/__init__.py)") 479s E In pytest 9.1 this warning will become an error by default. 479s E You can fix the underlying problem, or alternatively overwrite this behavior and silence this warning by passing exc_type=ImportError explicitly. 479s E See https://docs.pytest.org/en/stable/deprecations.html#pytest-importorskip-default-behavior-regarding-importerror 479s =========================== short test summary info ============================ 479s ERROR cli/tests/test_dask_ssh.py - pytest.PytestDeprecationWarning: 479s Module 'paramiko' was found, but when imported by pytest it raised: 479s ImportError("cannot import name 'exceptions' from 'cryptography.hazmat.bindings._rust' (unknown location)") 479s In pytest 9.1 this warning will become an error by default. 479s You can fix the underlying problem, or alternatively overwrite this behavior and silence this warning by passing exc_type=ImportError explicitly. 479s See https://docs.pytest.org/en/stable/deprecations.html#pytest-importorskip-default-behavior-regarding-importerror 479s ERROR deploy/tests/test_old_ssh.py - pytest.PytestDeprecationWarning: 479s Module 'paramiko' was found, but when imported by pytest it raised: 479s ImportError("cannot import name 'exceptions' from 'cryptography.hazmat.bindings._rust' (unknown location)") 479s In pytest 9.1 this warning will become an error by default. 479s You can fix the underlying problem, or alternatively overwrite this behavior and silence this warning by passing exc_type=ImportError explicitly. 479s See https://docs.pytest.org/en/stable/deprecations.html#pytest-importorskip-default-behavior-regarding-importerror 479s ERROR protocol/tests/test_h5py.py - pytest.PytestDeprecationWarning: 479s Module 'h5py' was found, but when imported by pytest it raised: 479s ImportError("cannot import name '_debian_h5py_mpi' from partially initialized module 'h5py' (most likely due to a circular import) (/usr/lib/python3/dist-packages/h5py/__init__.py)") 479s In pytest 9.1 this warning will become an error by default. 479s You can fix the underlying problem, or alternatively overwrite this behavior and silence this warning by passing exc_type=ImportError explicitly. 479s See https://docs.pytest.org/en/stable/deprecations.html#pytest-importorskip-default-behavior-regarding-importerror 479s !!!!!!!!!!!!!!!!!!! Interrupted: 3 errors during collection !!!!!!!!!!!!!!!!!!!! 479s ================= 25 skipped, 45 deselected, 3 errors in 9.58s ================= 479s *** END OF RUN 5: NOT ALL TESTS HAVE YET PASSED/XFAILED *** 479s *** SOME TESTS FAILED/ERRORED EVERY RUN, ABORTING *** 480s autopkgtest [20:44:29]: test pytest: -----------------------] 484s autopkgtest [20:44:33]: test pytest: - - - - - - - - - - results - - - - - - - - - - 484s pytest FLAKY non-zero exit status 1 488s autopkgtest [20:44:37]: test pybuild-autopkgtest: preparing testbed 541s autopkgtest [20:45:30]: testbed dpkg architecture: armhf 544s autopkgtest [20:45:33]: testbed apt version: 2.9.8 544s autopkgtest [20:45:33]: @@@@@@@@@@@@@@@@@@@@ test bed setup 552s Get:1 http://ftpmaster.internal/ubuntu plucky-proposed InRelease [73.9 kB] 553s Get:2 http://ftpmaster.internal/ubuntu plucky-proposed/multiverse Sources [13.6 kB] 553s Get:3 http://ftpmaster.internal/ubuntu plucky-proposed/main Sources [53.2 kB] 553s Get:4 http://ftpmaster.internal/ubuntu plucky-proposed/universe Sources [925 kB] 554s Get:5 http://ftpmaster.internal/ubuntu plucky-proposed/restricted Sources [9704 B] 554s Get:6 http://ftpmaster.internal/ubuntu plucky-proposed/main armhf Packages [61.7 kB] 554s Get:7 http://ftpmaster.internal/ubuntu plucky-proposed/restricted armhf Packages [756 B] 554s Get:8 http://ftpmaster.internal/ubuntu plucky-proposed/universe armhf Packages [721 kB] 554s Get:9 http://ftpmaster.internal/ubuntu plucky-proposed/multiverse armhf Packages [5924 B] 554s Fetched 1865 kB in 2s (1069 kB/s) 554s Reading package lists... 570s tee: /proc/self/fd/2: Permission denied 593s Hit:1 http://ftpmaster.internal/ubuntu plucky-proposed InRelease 593s Hit:2 http://ftpmaster.internal/ubuntu plucky InRelease 593s Hit:3 http://ftpmaster.internal/ubuntu plucky-updates InRelease 593s Hit:4 http://ftpmaster.internal/ubuntu plucky-security InRelease 595s Reading package lists... 595s Reading package lists... 595s Building dependency tree... 595s Reading state information... 596s Calculating upgrade... 596s The following packages will be upgraded: 596s bash debconf debconf-i18n dracut-install libpython3-stdlib pinentry-curses 596s python3 python3-blinker python3-debconf python3-minimal vim-common vim-tiny 596s xxd 597s 13 upgraded, 0 newly installed, 0 to remove and 0 not upgraded. 597s Need to get 2311 kB of archives. 597s After this operation, 4096 B of additional disk space will be used. 597s Get:1 http://ftpmaster.internal/ubuntu plucky/main armhf bash armhf 5.2.32-1ubuntu2 [673 kB] 597s Get:2 http://ftpmaster.internal/ubuntu plucky-proposed/main armhf python3-minimal armhf 3.12.7-1 [27.4 kB] 597s Get:3 http://ftpmaster.internal/ubuntu plucky-proposed/main armhf python3 armhf 3.12.7-1 [24.0 kB] 597s Get:4 http://ftpmaster.internal/ubuntu plucky-proposed/main armhf libpython3-stdlib armhf 3.12.7-1 [10.0 kB] 597s Get:5 http://ftpmaster.internal/ubuntu plucky/main armhf debconf-i18n all 1.5.87ubuntu1 [204 kB] 597s Get:6 http://ftpmaster.internal/ubuntu plucky/main armhf python3-debconf all 1.5.87ubuntu1 [4156 B] 597s Get:7 http://ftpmaster.internal/ubuntu plucky/main armhf debconf all 1.5.87ubuntu1 [124 kB] 597s Get:8 http://ftpmaster.internal/ubuntu plucky/main armhf vim-tiny armhf 2:9.1.0861-1ubuntu1 [694 kB] 597s Get:9 http://ftpmaster.internal/ubuntu plucky/main armhf vim-common all 2:9.1.0861-1ubuntu1 [395 kB] 597s Get:10 http://ftpmaster.internal/ubuntu plucky/main armhf xxd armhf 2:9.1.0861-1ubuntu1 [67.0 kB] 597s Get:11 http://ftpmaster.internal/ubuntu plucky/main armhf dracut-install armhf 105-2ubuntu2 [37.5 kB] 597s Get:12 http://ftpmaster.internal/ubuntu plucky/main armhf pinentry-curses armhf 1.3.1-0ubuntu2 [40.0 kB] 597s Get:13 http://ftpmaster.internal/ubuntu plucky/main armhf python3-blinker all 1.9.0-1 [10.7 kB] 598s Preconfiguring packages ... 598s Fetched 2311 kB in 1s (3416 kB/s) 598s (Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 59616 files and directories currently installed.) 598s Preparing to unpack .../bash_5.2.32-1ubuntu2_armhf.deb ... 598s Unpacking bash (5.2.32-1ubuntu2) over (5.2.32-1ubuntu1) ... 598s Setting up bash (5.2.32-1ubuntu2) ... 598s update-alternatives: using /usr/share/man/man7/bash-builtins.7.gz to provide /usr/share/man/man7/builtins.7.gz (builtins.7.gz) in auto mode 598s (Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 59616 files and directories currently installed.) 598s Preparing to unpack .../python3-minimal_3.12.7-1_armhf.deb ... 598s Unpacking python3-minimal (3.12.7-1) over (3.12.6-0ubuntu1) ... 598s Setting up python3-minimal (3.12.7-1) ... 598s (Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 59616 files and directories currently installed.) 598s Preparing to unpack .../python3_3.12.7-1_armhf.deb ... 598s Unpacking python3 (3.12.7-1) over (3.12.6-0ubuntu1) ... 598s Preparing to unpack .../libpython3-stdlib_3.12.7-1_armhf.deb ... 598s Unpacking libpython3-stdlib:armhf (3.12.7-1) over (3.12.6-0ubuntu1) ... 598s Preparing to unpack .../debconf-i18n_1.5.87ubuntu1_all.deb ... 598s Unpacking debconf-i18n (1.5.87ubuntu1) over (1.5.86ubuntu1) ... 598s Preparing to unpack .../python3-debconf_1.5.87ubuntu1_all.deb ... 598s Unpacking python3-debconf (1.5.87ubuntu1) over (1.5.86ubuntu1) ... 598s Preparing to unpack .../debconf_1.5.87ubuntu1_all.deb ... 598s Unpacking debconf (1.5.87ubuntu1) over (1.5.86ubuntu1) ... 599s Setting up debconf (1.5.87ubuntu1) ... 599s (Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 59616 files and directories currently installed.) 599s Preparing to unpack .../0-vim-tiny_2%3a9.1.0861-1ubuntu1_armhf.deb ... 599s Unpacking vim-tiny (2:9.1.0861-1ubuntu1) over (2:9.1.0777-1ubuntu1) ... 599s Preparing to unpack .../1-vim-common_2%3a9.1.0861-1ubuntu1_all.deb ... 599s Unpacking vim-common (2:9.1.0861-1ubuntu1) over (2:9.1.0777-1ubuntu1) ... 599s Preparing to unpack .../2-xxd_2%3a9.1.0861-1ubuntu1_armhf.deb ... 599s Unpacking xxd (2:9.1.0861-1ubuntu1) over (2:9.1.0777-1ubuntu1) ... 599s Preparing to unpack .../3-dracut-install_105-2ubuntu2_armhf.deb ... 599s Unpacking dracut-install (105-2ubuntu2) over (105-1ubuntu1) ... 599s Preparing to unpack .../4-pinentry-curses_1.3.1-0ubuntu2_armhf.deb ... 599s Unpacking pinentry-curses (1.3.1-0ubuntu2) over (1.2.1-3ubuntu5) ... 599s Preparing to unpack .../5-python3-blinker_1.9.0-1_all.deb ... 599s Unpacking python3-blinker (1.9.0-1) over (1.8.2-1) ... 599s Setting up pinentry-curses (1.3.1-0ubuntu2) ... 599s Setting up debconf-i18n (1.5.87ubuntu1) ... 599s Setting up xxd (2:9.1.0861-1ubuntu1) ... 599s Setting up vim-common (2:9.1.0861-1ubuntu1) ... 599s Setting up dracut-install (105-2ubuntu2) ... 599s Setting up libpython3-stdlib:armhf (3.12.7-1) ... 599s Setting up python3 (3.12.7-1) ... 599s Setting up vim-tiny (2:9.1.0861-1ubuntu1) ... 599s Setting up python3-blinker (1.9.0-1) ... 600s Setting up python3-debconf (1.5.87ubuntu1) ... 600s Processing triggers for debianutils (5.21) ... 600s Processing triggers for install-info (7.1.1-1) ... 600s Processing triggers for man-db (2.13.0-1) ... 602s Reading package lists... 602s Building dependency tree... 602s Reading state information... 603s 0 upgraded, 0 newly installed, 0 to remove and 0 not upgraded. 605s autopkgtest [20:46:34]: rebooting testbed after setup commands that affected boot 709s Reading package lists... 710s Building dependency tree... 710s Reading state information... 711s Starting pkgProblemResolver with broken count: 0 711s Starting 2 pkgProblemResolver with broken count: 0 711s Done 713s The following additional packages will be installed: 713s autoconf automake autopoint autotools-dev build-essential cpp cpp-14 713s cpp-14-arm-linux-gnueabihf cpp-arm-linux-gnueabihf debhelper debugedit 713s dh-autoreconf dh-python dh-strip-nondeterminism docutils-common dwz 713s fonts-font-awesome fonts-glyphicons-halflings fonts-lato fonts-mathjax g++ 713s g++-14 g++-14-arm-linux-gnueabihf g++-arm-linux-gnueabihf gcc gcc-14 713s gcc-14-arm-linux-gnueabihf gcc-arm-linux-gnueabihf gettext intltool-debian 713s libarchive-zip-perl libargon2-1 libasan8 libblas3 libc-dev-bin libc6-dev 713s libcares2 libcc1-0 libcrypt-dev libdebhelper-perl 713s libfile-stripnondeterminism-perl libgcc-14-dev libgfortran5 libgomp1 714s libisl23 libjs-bootstrap libjs-jquery libjs-mathjax libjs-sortable-tablesort 714s libjs-sphinxdoc libjs-sprintf-js libjs-underscore libjson-perl liblapack3 714s libmpc3 libnode115 libnorm1t64 libpgm-5.3-0t64 libpython3.13-minimal 714s libpython3.13-stdlib libsodium23 libstdc++-14-dev libtool libubsan1 libzmq5 714s linux-libc-dev m4 node-acorn node-argparse node-balanced-match 714s node-brace-expansion node-cjs-module-lexer node-esprima node-js-yaml 714s node-minimatch node-sprintf-js node-uglify-js node-undici node-xtend nodejs 714s po-debconf pybuild-plugin-autopkgtest pybuild-plugin-pyproject 714s python-dask-doc python-distributed-doc python-fsspec-doc python-numpy-doc 714s python-pandas-doc python-tinycss2-common python3-alabaster python3-all 714s python3-anyio python3-argon2 python3-arrow python3-async-generator 714s python3-bleach python3-bs4 python3-build python3-click python3-cloudpickle 714s python3-colorama python3-dask python3-dask-sphinx-theme python3-dateutil 714s python3-decorator python3-defusedxml python3-distributed python3-doc 714s python3-docutils python3-fastjsonschema python3-fqdn python3-fsspec 714s python3-html5lib python3-imagesize python3-iniconfig python3-installer 714s python3-isoduration python3-jupyter-client python3-jupyter-core 714s python3-jupyter-events python3-jupyter-server 714s python3-jupyter-server-terminals python3-jupyterlab-pygments python3-locket 714s python3-mistune python3-msgpack python3-nbclient python3-nbconvert 714s python3-nbformat python3-numpy python3-numpydoc python3-overrides 714s python3-packaging python3-pandas python3-pandas-lib python3-pandocfilters 714s python3-partd python3-platformdirs python3-pluggy python3-prometheus-client 714s python3-psutil python3-ptyprocess python3-py python3-pydata-sphinx-theme 714s python3-pyproject-hooks python3-pytest python3-pytest-asyncio 714s python3-pytest-rerunfailures python3-pytest-timeout python3-pythonjsonlogger 714s python3-rfc3339-validator python3-rfc3986-validator python3-roman 714s python3-send2trash python3-sniffio python3-snowballstemmer 714s python3-sortedcollections python3-sortedcontainers python3-soupsieve 714s python3-sphinx python3-sphinx-book-theme python3-sphinx-click 714s python3-sphinx-design python3-tabulate python3-tblib python3-terminado 714s python3-tinycss2 python3-toml python3-toolz python3-tornado 714s python3-traitlets python3-tz python3-uritemplate python3-versioneer 714s python3-webcolors python3-webencodings python3-websocket python3-wheel 714s python3-zict python3-zmq python3.12-doc python3.13 python3.13-minimal 714s rpcsvc-proto sass-stylesheets-bulma sgml-base sphinx-common 714s sphinx-rtd-theme-common tzdata-legacy uglifyjs xml-core 714s Suggested packages: 714s autoconf-archive gnu-standards autoconf-doc cpp-doc gcc-14-locales 714s cpp-14-doc dh-make flit gcc-14-doc gcc-multilib manpages-dev flex bison gdb 714s gcc-doc gdb-arm-linux-gnueabihf gettext-doc libasprintf-dev libgettextpo-dev 714s libc-devtools glibc-doc fonts-mathjax-extras fonts-stix libjs-mathjax-doc 714s libjs-angularjs libstdc++-14-doc libtool-doc gfortran | fortran95-compiler 714s gcj-jdk m4-doc javascript-common npm node-corepack libmail-box-perl 714s python-imageio-doc python-pytest-doc python-scipy-doc python-skimage-doc 714s python-argon2-doc python-arrow-doc python-bleach-doc python3-pip 714s python3-venv python-build-doc ipython python3-blosc python3-boto3 714s python3-graphviz python3-h5py python3-scipy python3-skimage python3-sklearn 714s python3-sqlalchemy python3-tables python3-examples docutils-doc 714s fonts-linuxlibertine | ttf-linux-libertine texlive-lang-french 714s texlive-latex-base texlive-latex-recommended python-fastjsonschema-doc 714s python3-genshi python3-lxml python-installer-doc python-jupyter-client-doc 714s python-jupyter-events-doc python-jupyter-server-doc python-nbconvert-doc 714s texlive-fonts-recommended texlive-plain-generic texlive-xetex gfortran 714s python3-dev python3-statsmodels subversion python3-stemmer 714s python-sortedcontainers-doc dvipng dvisvgm fonts-freefont-otf 714s imagemagick-6.q16 latexmk python3-sphinx-rtd-theme sphinx-doc tex-gyre 714s texlive-fonts-extra texlive-latex-extra python-sphinx-click-doc 714s python-terminado-doc python-tinycss2-doc python-toolz-doc python3-pycurl 714s python-tornado-doc python3-twisted python-traitlets-doc 714s python-python-versioneer-doc python3.13-venv python3.13-doc binfmt-support 714s sgml-base-doc 714s Recommended packages: 714s manpages manpages-dev libarchive-cpio-perl javascript-common libjson-xs-perl 714s libltdl-dev nodejs-doc libmail-sendmail-perl python3-lxml libpaper-utils 714s python3-pil git python3-dropbox python3-fusepy python3-libarchive-c 714s python3-paramiko python3-pygit2 pandoc python3-scipy python3-matplotlib 714s python3-bottleneck python3-numexpr python3-odf python3-openpyxl 714s python3-tables python3-blosc python3-accessible-pygments 714s The following NEW packages will be installed: 714s autoconf automake autopkgtest-satdep autopoint autotools-dev build-essential 714s cpp cpp-14 cpp-14-arm-linux-gnueabihf cpp-arm-linux-gnueabihf debhelper 714s debugedit dh-autoreconf dh-python dh-strip-nondeterminism docutils-common 714s dwz fonts-font-awesome fonts-glyphicons-halflings fonts-lato fonts-mathjax 714s g++ g++-14 g++-14-arm-linux-gnueabihf g++-arm-linux-gnueabihf gcc gcc-14 714s gcc-14-arm-linux-gnueabihf gcc-arm-linux-gnueabihf gettext intltool-debian 714s libarchive-zip-perl libargon2-1 libasan8 libblas3 libc-dev-bin libc6-dev 714s libcares2 libcc1-0 libcrypt-dev libdebhelper-perl 714s libfile-stripnondeterminism-perl libgcc-14-dev libgfortran5 libgomp1 714s libisl23 libjs-bootstrap libjs-jquery libjs-mathjax libjs-sortable-tablesort 714s libjs-sphinxdoc libjs-sprintf-js libjs-underscore libjson-perl liblapack3 714s libmpc3 libnode115 libnorm1t64 libpgm-5.3-0t64 libpython3.13-minimal 714s libpython3.13-stdlib libsodium23 libstdc++-14-dev libtool libubsan1 libzmq5 714s linux-libc-dev m4 node-acorn node-argparse node-balanced-match 714s node-brace-expansion node-cjs-module-lexer node-esprima node-js-yaml 714s node-minimatch node-sprintf-js node-uglify-js node-undici node-xtend nodejs 714s po-debconf pybuild-plugin-autopkgtest pybuild-plugin-pyproject 714s python-dask-doc python-distributed-doc python-fsspec-doc python-numpy-doc 714s python-pandas-doc python-tinycss2-common python3-alabaster python3-all 714s python3-anyio python3-argon2 python3-arrow python3-async-generator 714s python3-bleach python3-bs4 python3-build python3-click python3-cloudpickle 714s python3-colorama python3-dask python3-dask-sphinx-theme python3-dateutil 714s python3-decorator python3-defusedxml python3-distributed python3-doc 714s python3-docutils python3-fastjsonschema python3-fqdn python3-fsspec 714s python3-html5lib python3-imagesize python3-iniconfig python3-installer 714s python3-isoduration python3-jupyter-client python3-jupyter-core 714s python3-jupyter-events python3-jupyter-server 714s python3-jupyter-server-terminals python3-jupyterlab-pygments python3-locket 714s python3-mistune python3-msgpack python3-nbclient python3-nbconvert 714s python3-nbformat python3-numpy python3-numpydoc python3-overrides 714s python3-packaging python3-pandas python3-pandas-lib python3-pandocfilters 714s python3-partd python3-platformdirs python3-pluggy python3-prometheus-client 714s python3-psutil python3-ptyprocess python3-py python3-pydata-sphinx-theme 714s python3-pyproject-hooks python3-pytest python3-pytest-asyncio 714s python3-pytest-rerunfailures python3-pytest-timeout python3-pythonjsonlogger 714s python3-rfc3339-validator python3-rfc3986-validator python3-roman 714s python3-send2trash python3-sniffio python3-snowballstemmer 714s python3-sortedcollections python3-sortedcontainers python3-soupsieve 714s python3-sphinx python3-sphinx-book-theme python3-sphinx-click 714s python3-sphinx-design python3-tabulate python3-tblib python3-terminado 714s python3-tinycss2 python3-toml python3-toolz python3-tornado 714s python3-traitlets python3-tz python3-uritemplate python3-versioneer 714s python3-webcolors python3-webencodings python3-websocket python3-wheel 714s python3-zict python3-zmq python3.12-doc python3.13 python3.13-minimal 714s rpcsvc-proto sass-stylesheets-bulma sgml-base sphinx-common 714s sphinx-rtd-theme-common tzdata-legacy uglifyjs xml-core 714s 0 upgraded, 192 newly installed, 0 to remove and 0 not upgraded. 714s Need to get 155 MB/155 MB of archives. 714s After this operation, 907 MB of additional disk space will be used. 714s Get:1 /tmp/autopkgtest.1vd31g/2-autopkgtest-satdep.deb autopkgtest-satdep armhf 0 [1104 B] 714s Get:2 http://ftpmaster.internal/ubuntu plucky/main armhf fonts-lato all 2.015-1 [2781 kB] 714s Get:3 http://ftpmaster.internal/ubuntu plucky/main armhf libpython3.13-minimal armhf 3.13.0-2 [866 kB] 714s Get:4 http://ftpmaster.internal/ubuntu plucky/main armhf python3.13-minimal armhf 3.13.0-2 [1854 kB] 714s Get:5 http://ftpmaster.internal/ubuntu plucky/main armhf sgml-base all 1.31 [11.4 kB] 714s Get:6 http://ftpmaster.internal/ubuntu plucky/main armhf m4 armhf 1.4.19-4build1 [235 kB] 715s Get:7 http://ftpmaster.internal/ubuntu plucky/main armhf autoconf all 2.72-3 [382 kB] 715s Get:8 http://ftpmaster.internal/ubuntu plucky/main armhf autotools-dev all 20220109.1 [44.9 kB] 715s Get:9 http://ftpmaster.internal/ubuntu plucky/main armhf automake all 1:1.16.5-1.3ubuntu1 [558 kB] 715s Get:10 http://ftpmaster.internal/ubuntu plucky/main armhf autopoint all 0.22.5-2 [616 kB] 715s Get:11 http://ftpmaster.internal/ubuntu plucky/main armhf libc-dev-bin armhf 2.40-1ubuntu3 [19.2 kB] 715s Get:12 http://ftpmaster.internal/ubuntu plucky/main armhf linux-libc-dev armhf 6.11.0-8.8 [1628 kB] 715s Get:13 http://ftpmaster.internal/ubuntu plucky/main armhf libcrypt-dev armhf 1:4.4.36-5 [119 kB] 715s Get:14 http://ftpmaster.internal/ubuntu plucky/main armhf rpcsvc-proto armhf 1.4.2-0ubuntu7 [62.2 kB] 715s Get:15 http://ftpmaster.internal/ubuntu plucky/main armhf libc6-dev armhf 2.40-1ubuntu3 [1370 kB] 715s Get:16 http://ftpmaster.internal/ubuntu plucky/main armhf libisl23 armhf 0.27-1 [546 kB] 715s Get:17 http://ftpmaster.internal/ubuntu plucky/main armhf libmpc3 armhf 1.3.1-1build2 [47.1 kB] 715s Get:18 http://ftpmaster.internal/ubuntu plucky/main armhf cpp-14-arm-linux-gnueabihf armhf 14.2.0-8ubuntu1 [9219 kB] 715s Get:19 http://ftpmaster.internal/ubuntu plucky/main armhf cpp-14 armhf 14.2.0-8ubuntu1 [1032 B] 715s Get:20 http://ftpmaster.internal/ubuntu plucky/main armhf cpp-arm-linux-gnueabihf armhf 4:14.1.0-2ubuntu1 [5464 B] 715s Get:21 http://ftpmaster.internal/ubuntu plucky/main armhf cpp armhf 4:14.1.0-2ubuntu1 [22.4 kB] 715s Get:22 http://ftpmaster.internal/ubuntu plucky/main armhf libcc1-0 armhf 14.2.0-8ubuntu1 [43.3 kB] 715s Get:23 http://ftpmaster.internal/ubuntu plucky/main armhf libgomp1 armhf 14.2.0-8ubuntu1 [125 kB] 715s Get:24 http://ftpmaster.internal/ubuntu plucky/main armhf libasan8 armhf 14.2.0-8ubuntu1 [2901 kB] 715s Get:25 http://ftpmaster.internal/ubuntu plucky/main armhf libubsan1 armhf 14.2.0-8ubuntu1 [1150 kB] 715s Get:26 http://ftpmaster.internal/ubuntu plucky/main armhf libgcc-14-dev armhf 14.2.0-8ubuntu1 [897 kB] 715s Get:27 http://ftpmaster.internal/ubuntu plucky/main armhf gcc-14-arm-linux-gnueabihf armhf 14.2.0-8ubuntu1 [18.0 MB] 716s Get:28 http://ftpmaster.internal/ubuntu plucky/main armhf gcc-14 armhf 14.2.0-8ubuntu1 [498 kB] 716s Get:29 http://ftpmaster.internal/ubuntu plucky/main armhf gcc-arm-linux-gnueabihf armhf 4:14.1.0-2ubuntu1 [1222 B] 716s Get:30 http://ftpmaster.internal/ubuntu plucky/main armhf gcc armhf 4:14.1.0-2ubuntu1 [5002 B] 716s Get:31 http://ftpmaster.internal/ubuntu plucky/main armhf libstdc++-14-dev armhf 14.2.0-8ubuntu1 [2569 kB] 716s Get:32 http://ftpmaster.internal/ubuntu plucky/main armhf g++-14-arm-linux-gnueabihf armhf 14.2.0-8ubuntu1 [10.5 MB] 716s Get:33 http://ftpmaster.internal/ubuntu plucky/main armhf g++-14 armhf 14.2.0-8ubuntu1 [19.9 kB] 716s Get:34 http://ftpmaster.internal/ubuntu plucky/main armhf g++-arm-linux-gnueabihf armhf 4:14.1.0-2ubuntu1 [968 B] 716s Get:35 http://ftpmaster.internal/ubuntu plucky/main armhf g++ armhf 4:14.1.0-2ubuntu1 [1084 B] 716s Get:36 http://ftpmaster.internal/ubuntu plucky/main armhf build-essential armhf 12.10ubuntu1 [4928 B] 716s Get:37 http://ftpmaster.internal/ubuntu plucky/main armhf libdebhelper-perl all 13.20ubuntu1 [94.2 kB] 716s Get:38 http://ftpmaster.internal/ubuntu plucky/main armhf libtool all 2.4.7-8 [166 kB] 716s Get:39 http://ftpmaster.internal/ubuntu plucky/main armhf dh-autoreconf all 20 [16.1 kB] 716s Get:40 http://ftpmaster.internal/ubuntu plucky/main armhf libarchive-zip-perl all 1.68-1 [90.2 kB] 716s Get:41 http://ftpmaster.internal/ubuntu plucky/main armhf libfile-stripnondeterminism-perl all 1.14.0-1 [20.1 kB] 716s Get:42 http://ftpmaster.internal/ubuntu plucky/main armhf dh-strip-nondeterminism all 1.14.0-1 [5058 B] 716s Get:43 http://ftpmaster.internal/ubuntu plucky/main armhf debugedit armhf 1:5.1-1 [46.5 kB] 716s Get:44 http://ftpmaster.internal/ubuntu plucky/main armhf dwz armhf 0.15-1build6 [116 kB] 716s Get:45 http://ftpmaster.internal/ubuntu plucky/main armhf gettext armhf 0.22.5-2 [995 kB] 716s Get:46 http://ftpmaster.internal/ubuntu plucky/main armhf intltool-debian all 0.35.0+20060710.6 [23.2 kB] 716s Get:47 http://ftpmaster.internal/ubuntu plucky/main armhf po-debconf all 1.0.21+nmu1 [233 kB] 716s Get:48 http://ftpmaster.internal/ubuntu plucky/main armhf debhelper all 13.20ubuntu1 [893 kB] 716s Get:49 http://ftpmaster.internal/ubuntu plucky/universe armhf dh-python all 6.20241024 [112 kB] 716s Get:50 http://ftpmaster.internal/ubuntu plucky/main armhf xml-core all 0.19 [20.3 kB] 716s Get:51 http://ftpmaster.internal/ubuntu plucky/main armhf docutils-common all 0.21.2+dfsg-2 [131 kB] 717s Get:52 http://ftpmaster.internal/ubuntu plucky/main armhf fonts-font-awesome all 5.0.10+really4.7.0~dfsg-4.1 [516 kB] 717s Get:53 http://ftpmaster.internal/ubuntu plucky/universe armhf fonts-glyphicons-halflings all 1.009~3.4.1+dfsg-3 [118 kB] 717s Get:54 http://ftpmaster.internal/ubuntu plucky/main armhf fonts-mathjax all 2.7.9+dfsg-1 [2208 kB] 717s Get:55 http://ftpmaster.internal/ubuntu plucky/main armhf libargon2-1 armhf 0~20190702+dfsg-4build1 [22.6 kB] 717s Get:56 http://ftpmaster.internal/ubuntu plucky/main armhf libblas3 armhf 3.12.0-3build2 [126 kB] 717s Get:57 http://ftpmaster.internal/ubuntu plucky/main armhf libcares2 armhf 1.34.2-1 [79.8 kB] 717s Get:58 http://ftpmaster.internal/ubuntu plucky/main armhf libgfortran5 armhf 14.2.0-8ubuntu1 [311 kB] 717s Get:59 http://ftpmaster.internal/ubuntu plucky/universe armhf libjs-bootstrap all 3.4.1+dfsg-3 [129 kB] 717s Get:60 http://ftpmaster.internal/ubuntu plucky/main armhf libjs-jquery all 3.6.1+dfsg+~3.5.14-1 [328 kB] 717s Get:61 http://ftpmaster.internal/ubuntu plucky/universe armhf libjs-sortable-tablesort all 3.1.0+ds-2 [12.6 kB] 717s Get:62 http://ftpmaster.internal/ubuntu plucky/main armhf libjs-underscore all 1.13.4~dfsg+~1.11.4-3 [118 kB] 717s Get:63 http://ftpmaster.internal/ubuntu plucky/main armhf libjs-sphinxdoc all 7.4.7-4 [158 kB] 717s Get:64 http://ftpmaster.internal/ubuntu plucky/universe armhf libjs-sprintf-js all 1.1.2+ds1+~1.1.2-1 [12.8 kB] 717s Get:65 http://ftpmaster.internal/ubuntu plucky/main armhf libjson-perl all 4.10000-1 [81.9 kB] 717s Get:66 http://ftpmaster.internal/ubuntu plucky/main armhf liblapack3 armhf 3.12.0-3build2 [2086 kB] 717s Get:67 http://ftpmaster.internal/ubuntu plucky/universe armhf node-xtend all 4.0.2-3 [3902 B] 717s Get:68 http://ftpmaster.internal/ubuntu plucky/universe armhf nodejs armhf 20.18.0+dfsg-2 [336 kB] 717s Get:69 http://ftpmaster.internal/ubuntu plucky/universe armhf node-acorn all 8.8.1+ds+~cs25.17.7-2 [115 kB] 717s Get:70 http://ftpmaster.internal/ubuntu plucky/universe armhf node-cjs-module-lexer all 1.2.3+dfsg-1 [32.1 kB] 717s Get:71 http://ftpmaster.internal/ubuntu plucky/universe armhf node-balanced-match all 2.0.0-1 [4910 B] 717s Get:72 http://ftpmaster.internal/ubuntu plucky/universe armhf node-brace-expansion all 2.0.1+~1.1.0-1 [8072 B] 717s Get:73 http://ftpmaster.internal/ubuntu plucky/universe armhf node-minimatch all 9.0.3-5 [78.2 kB] 717s Get:74 http://ftpmaster.internal/ubuntu plucky/universe armhf node-undici all 5.28.4+dfsg1+~cs23.12.11-2 [321 kB] 717s Get:75 http://ftpmaster.internal/ubuntu plucky/universe armhf libnode115 armhf 20.18.0+dfsg-2 [12.2 MB] 717s Get:76 http://ftpmaster.internal/ubuntu plucky/universe armhf libnorm1t64 armhf 1.5.9+dfsg-3.1build1 [206 kB] 717s Get:77 http://ftpmaster.internal/ubuntu plucky/universe armhf libpgm-5.3-0t64 armhf 5.3.128~dfsg-2.1build1 [171 kB] 717s Get:78 http://ftpmaster.internal/ubuntu plucky/main armhf libpython3.13-stdlib armhf 3.13.0-2 [1972 kB] 717s Get:79 http://ftpmaster.internal/ubuntu plucky/main armhf libsodium23 armhf 1.0.18-1build3 [139 kB] 717s Get:80 http://ftpmaster.internal/ubuntu plucky/universe armhf libzmq5 armhf 4.3.5-1build2 [262 kB] 717s Get:81 http://ftpmaster.internal/ubuntu plucky/universe armhf node-esprima all 4.0.1+ds+~4.0.3-2 [69.3 kB] 717s Get:82 http://ftpmaster.internal/ubuntu plucky/universe armhf node-sprintf-js all 1.1.2+ds1+~1.1.2-1 [3916 B] 717s Get:83 http://ftpmaster.internal/ubuntu plucky/universe armhf node-argparse all 2.0.1-2 [33.2 kB] 717s Get:84 http://ftpmaster.internal/ubuntu plucky/universe armhf node-js-yaml all 4.1.0+dfsg+~4.0.5-7 [61.9 kB] 718s Get:85 http://ftpmaster.internal/ubuntu plucky/universe armhf node-uglify-js all 3.17.4-2 [205 kB] 718s Get:86 http://ftpmaster.internal/ubuntu plucky/universe armhf pybuild-plugin-autopkgtest all 6.20241024 [1746 B] 718s Get:87 http://ftpmaster.internal/ubuntu plucky/main armhf python3-packaging all 24.2-1 [51.5 kB] 718s Get:88 http://ftpmaster.internal/ubuntu plucky/universe armhf python3-pyproject-hooks all 1.2.0-1 [10.2 kB] 718s Get:89 http://ftpmaster.internal/ubuntu plucky/universe armhf python3-toml all 0.10.2-1 [16.5 kB] 718s Get:90 http://ftpmaster.internal/ubuntu plucky/universe armhf python3-wheel all 0.45.0-1 [57.7 kB] 718s Get:91 http://ftpmaster.internal/ubuntu plucky/universe armhf python3-build all 1.2.2-1 [31.0 kB] 718s Get:92 http://ftpmaster.internal/ubuntu plucky/universe armhf python3-installer all 0.7.0+dfsg1-3 [17.4 kB] 718s Get:93 http://ftpmaster.internal/ubuntu plucky/universe armhf pybuild-plugin-pyproject all 6.20241024 [1728 B] 718s Get:94 http://ftpmaster.internal/ubuntu plucky/main armhf libjs-mathjax all 2.7.9+dfsg-1 [5665 kB] 718s Get:95 http://ftpmaster.internal/ubuntu plucky/universe armhf python-dask-doc all 2024.5.2+dfsg-1 [10.8 MB] 718s Get:96 http://ftpmaster.internal/ubuntu plucky/main armhf sphinx-rtd-theme-common all 3.0.2+dfsg-1 [1014 kB] 718s Get:97 http://ftpmaster.internal/ubuntu plucky/universe armhf python-fsspec-doc all 2024.9.0-1 [313 kB] 718s Get:98 http://ftpmaster.internal/ubuntu plucky/main armhf python-numpy-doc all 1:1.26.4+ds-11ubuntu1 [5481 kB] 719s Get:99 http://ftpmaster.internal/ubuntu plucky/universe armhf python-pandas-doc all 2.2.3+dfsg-5ubuntu1 [9117 kB] 719s Get:100 http://ftpmaster.internal/ubuntu plucky/main armhf python3.12-doc all 3.12.7-3 [12.4 MB] 720s Get:101 http://ftpmaster.internal/ubuntu plucky-proposed/main armhf python3-doc all 3.12.7-1 [10.3 kB] 720s Get:102 http://ftpmaster.internal/ubuntu plucky/universe armhf sass-stylesheets-bulma all 0.9.4~ds-1 [113 kB] 720s Get:103 http://ftpmaster.internal/ubuntu plucky/universe armhf python-distributed-doc all 2024.5.2+ds.1-8 [3143 kB] 721s Get:104 http://ftpmaster.internal/ubuntu plucky/universe armhf python-tinycss2-common all 1.4.0-1 [47.0 kB] 721s Get:105 http://ftpmaster.internal/ubuntu plucky/main armhf python3.13 armhf 3.13.0-2 [719 kB] 721s Get:106 http://ftpmaster.internal/ubuntu plucky-proposed/main armhf python3-all armhf 3.12.7-1 [890 B] 721s Get:107 http://ftpmaster.internal/ubuntu plucky/universe armhf python3-sniffio all 1.3.1-1 [7262 B] 721s Get:108 http://ftpmaster.internal/ubuntu plucky/universe armhf python3-anyio all 4.6.2-4 [60.0 kB] 721s Get:109 http://ftpmaster.internal/ubuntu plucky/universe armhf python3-argon2 armhf 21.1.0-2build1 [19.9 kB] 721s Get:110 http://ftpmaster.internal/ubuntu plucky/main armhf python3-dateutil all 2.9.0-3 [80.2 kB] 721s Get:111 http://ftpmaster.internal/ubuntu plucky/main armhf python3-arrow all 1.3.0-1.1ubuntu1 [56.1 kB] 721s Get:112 http://ftpmaster.internal/ubuntu plucky/universe armhf python3-async-generator all 1.10-4 [17.5 kB] 721s Get:113 http://ftpmaster.internal/ubuntu plucky/main armhf python3-webencodings all 0.5.1-5 [11.5 kB] 721s Get:114 http://ftpmaster.internal/ubuntu plucky/main armhf python3-html5lib all 1.2-1 [90.8 kB] 721s Get:115 http://ftpmaster.internal/ubuntu plucky/universe armhf python3-bleach all 6.2.0-1 [43.9 kB] 721s Get:116 http://ftpmaster.internal/ubuntu plucky/main armhf python3-soupsieve all 2.6-1 [33.0 kB] 721s Get:117 http://ftpmaster.internal/ubuntu plucky/main armhf python3-bs4 all 4.12.3-3 [109 kB] 721s Get:118 http://ftpmaster.internal/ubuntu plucky/main armhf python3-colorama all 0.4.6-4 [32.1 kB] 721s Get:119 http://ftpmaster.internal/ubuntu plucky/main armhf python3-click all 8.1.7-2 [79.5 kB] 721s Get:120 http://ftpmaster.internal/ubuntu plucky/universe armhf python3-cloudpickle all 3.0.0-2 [21.5 kB] 721s Get:121 http://ftpmaster.internal/ubuntu plucky/universe armhf python3-fsspec all 2024.9.0-1 [207 kB] 721s Get:122 http://ftpmaster.internal/ubuntu plucky/universe armhf python3-toolz all 1.0.0-1 [44.9 kB] 721s Get:123 http://ftpmaster.internal/ubuntu plucky/universe armhf python3-locket all 1.0.0-2 [5872 B] 721s Get:124 http://ftpmaster.internal/ubuntu plucky/universe armhf python3-partd all 1.4.2-1 [15.7 kB] 721s Get:125 http://ftpmaster.internal/ubuntu plucky/universe armhf python3-dask all 2024.5.2+dfsg-1 [849 kB] 721s Get:126 http://ftpmaster.internal/ubuntu plucky/main armhf python3-roman all 4.2-1 [10.0 kB] 721s Get:127 http://ftpmaster.internal/ubuntu plucky/main armhf python3-docutils all 0.21.2+dfsg-2 [409 kB] 721s Get:128 http://ftpmaster.internal/ubuntu plucky/main armhf python3-defusedxml all 0.7.1-2 [42.0 kB] 721s Get:129 http://ftpmaster.internal/ubuntu plucky/main armhf sphinx-common all 7.4.7-4 [775 kB] 721s Get:130 http://ftpmaster.internal/ubuntu plucky/main armhf python3-alabaster all 0.7.16-0.1 [18.5 kB] 721s Get:131 http://ftpmaster.internal/ubuntu plucky/main armhf python3-imagesize all 1.4.1-1 [6844 B] 721s Get:132 http://ftpmaster.internal/ubuntu plucky/main armhf python3-snowballstemmer all 2.2.0-4build1 [59.8 kB] 721s Get:133 http://ftpmaster.internal/ubuntu plucky/main armhf python3-sphinx all 7.4.7-4 [593 kB] 721s Get:134 http://ftpmaster.internal/ubuntu plucky/universe armhf python3-pydata-sphinx-theme all 0.15.4+dfsg-2 [41.5 kB] 721s Get:135 http://ftpmaster.internal/ubuntu plucky/universe armhf python3-sphinx-book-theme all 0.1.7-3 [42.8 kB] 721s Get:136 http://ftpmaster.internal/ubuntu plucky/universe armhf python3-dask-sphinx-theme all 3.0.5-2 [15.9 kB] 721s Get:137 http://ftpmaster.internal/ubuntu plucky/main armhf python3-decorator all 5.1.1-5 [10.1 kB] 721s Get:138 http://ftpmaster.internal/ubuntu plucky/main armhf python3-msgpack armhf 1.0.3-3build3 [106 kB] 721s Get:139 http://ftpmaster.internal/ubuntu plucky/main armhf python3-psutil armhf 5.9.8-2build3 [194 kB] 721s Get:140 http://ftpmaster.internal/ubuntu plucky/main armhf python3-sortedcontainers all 2.4.0-2 [27.6 kB] 721s Get:141 http://ftpmaster.internal/ubuntu plucky/universe armhf python3-tblib all 3.0.0-5 [12.9 kB] 721s Get:142 http://ftpmaster.internal/ubuntu plucky/main armhf python3-tornado armhf 6.4.1-3 [298 kB] 721s Get:143 http://ftpmaster.internal/ubuntu plucky/universe armhf python3-zict all 3.0.0-2ubuntu1 [30.4 kB] 721s Get:144 http://ftpmaster.internal/ubuntu plucky/universe armhf python3-distributed all 2024.5.2+ds.1-8 [1006 kB] 722s Get:145 http://ftpmaster.internal/ubuntu plucky/universe armhf python3-fastjsonschema all 2.20.0-1 [20.1 kB] 722s Get:146 http://ftpmaster.internal/ubuntu plucky/universe armhf python3-fqdn all 1.5.1-2 [7688 B] 722s Get:147 http://ftpmaster.internal/ubuntu plucky/universe armhf python3-iniconfig all 1.1.1-2 [6024 B] 722s Get:148 http://ftpmaster.internal/ubuntu plucky/universe armhf python3-isoduration all 20.11.0+git20211126.ae0bd61-2 [12.5 kB] 722s Get:149 http://ftpmaster.internal/ubuntu plucky/main armhf python3-platformdirs all 4.3.6-1 [16.8 kB] 722s Get:150 http://ftpmaster.internal/ubuntu plucky/universe armhf python3-traitlets all 5.14.3+really5.14.3-1 [71.5 kB] 722s Get:151 http://ftpmaster.internal/ubuntu plucky/universe armhf python3-jupyter-core all 5.7.2-4 [28.0 kB] 722s Get:152 http://ftpmaster.internal/ubuntu plucky/universe armhf python3-py all 1.11.0-2 [72.7 kB] 722s Get:153 http://ftpmaster.internal/ubuntu plucky/universe armhf python3-zmq armhf 24.0.1-5build2 [352 kB] 722s Get:154 http://ftpmaster.internal/ubuntu plucky/universe armhf python3-jupyter-client all 8.6.3-1 [78.2 kB] 722s Get:155 http://ftpmaster.internal/ubuntu plucky/universe armhf python3-pythonjsonlogger all 3.1.0-1 [11.8 kB] 722s Get:156 http://ftpmaster.internal/ubuntu plucky/universe armhf python3-rfc3339-validator all 0.1.4-2 [3930 B] 722s Get:157 http://ftpmaster.internal/ubuntu plucky/universe armhf python3-rfc3986-validator all 0.1.1-2 [4758 B] 722s Get:158 http://ftpmaster.internal/ubuntu plucky/universe armhf python3-uritemplate all 4.1.1-3 [9762 B] 722s Get:159 http://ftpmaster.internal/ubuntu plucky/universe armhf python3-webcolors all 1.13-1 [13.6 kB] 722s Get:160 http://ftpmaster.internal/ubuntu plucky/universe armhf python3-jupyter-events all 0.10.0-3 [15.5 kB] 722s Get:161 http://ftpmaster.internal/ubuntu plucky/main armhf python3-ptyprocess all 0.7.0-6 [14.8 kB] 722s Get:162 http://ftpmaster.internal/ubuntu plucky/universe armhf python3-terminado all 0.18.1-1 [13.2 kB] 722s Get:163 http://ftpmaster.internal/ubuntu plucky/universe armhf python3-jupyter-server-terminals all 0.5.3-2 [10.9 kB] 722s Get:164 http://ftpmaster.internal/ubuntu plucky/universe armhf python3-jupyterlab-pygments all 0.2.2-3 [6054 B] 722s Get:165 http://ftpmaster.internal/ubuntu plucky/universe armhf python3-mistune all 3.0.2-2 [32.9 kB] 722s Get:166 http://ftpmaster.internal/ubuntu plucky/universe armhf python3-nbformat all 5.9.1-1 [41.2 kB] 722s Get:167 http://ftpmaster.internal/ubuntu plucky/universe armhf python3-nbclient all 0.8.0-1 [55.6 kB] 722s Get:168 http://ftpmaster.internal/ubuntu plucky/universe armhf python3-pandocfilters all 1.5.1-1 [23.6 kB] 722s Get:169 http://ftpmaster.internal/ubuntu plucky/universe armhf python3-tinycss2 all 1.4.0-1 [22.5 kB] 722s Get:170 http://ftpmaster.internal/ubuntu plucky/universe armhf python3-nbconvert all 7.16.4-2 [139 kB] 722s Get:171 http://ftpmaster.internal/ubuntu plucky/universe armhf python3-overrides all 7.7.0-2 [14.4 kB] 722s Get:172 http://ftpmaster.internal/ubuntu plucky/main armhf python3-prometheus-client all 0.19.0+ds1-1 [41.7 kB] 722s Get:173 http://ftpmaster.internal/ubuntu plucky/universe armhf python3-send2trash all 1.8.3-1 [14.6 kB] 722s Get:174 http://ftpmaster.internal/ubuntu plucky/universe armhf python3-websocket all 1.8.0-2 [38.5 kB] 722s Get:175 http://ftpmaster.internal/ubuntu plucky/universe armhf python3-jupyter-server all 2.14.2-4 [183 kB] 722s Get:176 http://ftpmaster.internal/ubuntu plucky/main armhf python3-numpy armhf 1:1.26.4+ds-11ubuntu1 [3975 kB] 723s Get:177 http://ftpmaster.internal/ubuntu plucky/main armhf python3-tabulate all 0.9.0-1 [45.3 kB] 724s Get:178 http://ftpmaster.internal/ubuntu plucky/universe armhf python3-numpydoc all 1.6.0-2 [50.5 kB] 724s Get:179 http://ftpmaster.internal/ubuntu plucky/main armhf python3-tz all 2024.1-2 [31.4 kB] 724s Get:180 http://ftpmaster.internal/ubuntu plucky/universe armhf python3-pandas-lib armhf 2.2.3+dfsg-5ubuntu1 [7608 kB] 727s Get:181 http://ftpmaster.internal/ubuntu plucky/universe armhf python3-pandas all 2.2.3+dfsg-5ubuntu1 [3112 kB] 729s Get:182 http://ftpmaster.internal/ubuntu plucky/universe armhf python3-pluggy all 1.5.0-1 [21.0 kB] 729s Get:183 http://ftpmaster.internal/ubuntu plucky/universe armhf python3-pytest all 8.3.3-1 [251 kB] 729s Get:184 http://ftpmaster.internal/ubuntu plucky/universe armhf python3-pytest-asyncio all 0.20.3-1.3 [10.7 kB] 729s Get:185 http://ftpmaster.internal/ubuntu plucky/universe armhf python3-pytest-rerunfailures all 14.0-2 [13.7 kB] 729s Get:186 http://ftpmaster.internal/ubuntu plucky/universe armhf python3-pytest-timeout all 2.3.1-1 [22.1 kB] 729s Get:187 http://ftpmaster.internal/ubuntu plucky/universe armhf python3-sortedcollections all 2.1.0-2 [9720 B] 729s Get:188 http://ftpmaster.internal/ubuntu plucky/universe armhf python3-sphinx-click all 5.1.0-1 [10.0 kB] 729s Get:189 http://ftpmaster.internal/ubuntu plucky/universe armhf python3-sphinx-design all 0.6.1-1 [894 kB] 729s Get:190 http://ftpmaster.internal/ubuntu plucky/universe armhf python3-versioneer all 0.29-1 [44.0 kB] 729s Get:191 http://ftpmaster.internal/ubuntu plucky/main armhf tzdata-legacy all 2024b-1ubuntu2 [99.9 kB] 729s Get:192 http://ftpmaster.internal/ubuntu plucky/universe armhf uglifyjs all 3.17.4-2 [10.1 kB] 730s Fetched 155 MB in 16s (9793 kB/s) 730s Selecting previously unselected package fonts-lato. 731s (Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 59616 files and directories currently installed.) 731s Preparing to unpack .../000-fonts-lato_2.015-1_all.deb ... 731s Unpacking fonts-lato (2.015-1) ... 731s Selecting previously unselected package libpython3.13-minimal:armhf. 731s Preparing to unpack .../001-libpython3.13-minimal_3.13.0-2_armhf.deb ... 731s Unpacking libpython3.13-minimal:armhf (3.13.0-2) ... 731s Selecting previously unselected package python3.13-minimal. 731s Preparing to unpack .../002-python3.13-minimal_3.13.0-2_armhf.deb ... 731s Unpacking python3.13-minimal (3.13.0-2) ... 731s Selecting previously unselected package sgml-base. 731s Preparing to unpack .../003-sgml-base_1.31_all.deb ... 731s Unpacking sgml-base (1.31) ... 731s Selecting previously unselected package m4. 731s Preparing to unpack .../004-m4_1.4.19-4build1_armhf.deb ... 731s Unpacking m4 (1.4.19-4build1) ... 731s Selecting previously unselected package autoconf. 731s Preparing to unpack .../005-autoconf_2.72-3_all.deb ... 731s Unpacking autoconf (2.72-3) ... 731s Selecting previously unselected package autotools-dev. 731s Preparing to unpack .../006-autotools-dev_20220109.1_all.deb ... 731s Unpacking autotools-dev (20220109.1) ... 731s Selecting previously unselected package automake. 731s Preparing to unpack .../007-automake_1%3a1.16.5-1.3ubuntu1_all.deb ... 731s Unpacking automake (1:1.16.5-1.3ubuntu1) ... 731s Selecting previously unselected package autopoint. 731s Preparing to unpack .../008-autopoint_0.22.5-2_all.deb ... 731s Unpacking autopoint (0.22.5-2) ... 732s Selecting previously unselected package libc-dev-bin. 732s Preparing to unpack .../009-libc-dev-bin_2.40-1ubuntu3_armhf.deb ... 732s Unpacking libc-dev-bin (2.40-1ubuntu3) ... 732s Selecting previously unselected package linux-libc-dev:armhf. 732s Preparing to unpack .../010-linux-libc-dev_6.11.0-8.8_armhf.deb ... 732s Unpacking linux-libc-dev:armhf (6.11.0-8.8) ... 732s Selecting previously unselected package libcrypt-dev:armhf. 732s Preparing to unpack .../011-libcrypt-dev_1%3a4.4.36-5_armhf.deb ... 732s Unpacking libcrypt-dev:armhf (1:4.4.36-5) ... 732s Selecting previously unselected package rpcsvc-proto. 732s Preparing to unpack .../012-rpcsvc-proto_1.4.2-0ubuntu7_armhf.deb ... 732s Unpacking rpcsvc-proto (1.4.2-0ubuntu7) ... 732s Selecting previously unselected package libc6-dev:armhf. 732s Preparing to unpack .../013-libc6-dev_2.40-1ubuntu3_armhf.deb ... 732s Unpacking libc6-dev:armhf (2.40-1ubuntu3) ... 732s Selecting previously unselected package libisl23:armhf. 732s Preparing to unpack .../014-libisl23_0.27-1_armhf.deb ... 732s Unpacking libisl23:armhf (0.27-1) ... 732s Selecting previously unselected package libmpc3:armhf. 732s Preparing to unpack .../015-libmpc3_1.3.1-1build2_armhf.deb ... 732s Unpacking libmpc3:armhf (1.3.1-1build2) ... 732s Selecting previously unselected package cpp-14-arm-linux-gnueabihf. 732s Preparing to unpack .../016-cpp-14-arm-linux-gnueabihf_14.2.0-8ubuntu1_armhf.deb ... 732s Unpacking cpp-14-arm-linux-gnueabihf (14.2.0-8ubuntu1) ... 733s Selecting previously unselected package cpp-14. 733s Preparing to unpack .../017-cpp-14_14.2.0-8ubuntu1_armhf.deb ... 733s Unpacking cpp-14 (14.2.0-8ubuntu1) ... 733s Selecting previously unselected package cpp-arm-linux-gnueabihf. 733s Preparing to unpack .../018-cpp-arm-linux-gnueabihf_4%3a14.1.0-2ubuntu1_armhf.deb ... 733s Unpacking cpp-arm-linux-gnueabihf (4:14.1.0-2ubuntu1) ... 733s Selecting previously unselected package cpp. 733s Preparing to unpack .../019-cpp_4%3a14.1.0-2ubuntu1_armhf.deb ... 733s Unpacking cpp (4:14.1.0-2ubuntu1) ... 733s Selecting previously unselected package libcc1-0:armhf. 733s Preparing to unpack .../020-libcc1-0_14.2.0-8ubuntu1_armhf.deb ... 733s Unpacking libcc1-0:armhf (14.2.0-8ubuntu1) ... 733s Selecting previously unselected package libgomp1:armhf. 733s Preparing to unpack .../021-libgomp1_14.2.0-8ubuntu1_armhf.deb ... 733s Unpacking libgomp1:armhf (14.2.0-8ubuntu1) ... 733s Selecting previously unselected package libasan8:armhf. 733s Preparing to unpack .../022-libasan8_14.2.0-8ubuntu1_armhf.deb ... 733s Unpacking libasan8:armhf (14.2.0-8ubuntu1) ... 733s Selecting previously unselected package libubsan1:armhf. 733s Preparing to unpack .../023-libubsan1_14.2.0-8ubuntu1_armhf.deb ... 733s Unpacking libubsan1:armhf (14.2.0-8ubuntu1) ... 733s Selecting previously unselected package libgcc-14-dev:armhf. 733s Preparing to unpack .../024-libgcc-14-dev_14.2.0-8ubuntu1_armhf.deb ... 733s Unpacking libgcc-14-dev:armhf (14.2.0-8ubuntu1) ... 733s Selecting previously unselected package gcc-14-arm-linux-gnueabihf. 733s Preparing to unpack .../025-gcc-14-arm-linux-gnueabihf_14.2.0-8ubuntu1_armhf.deb ... 733s Unpacking gcc-14-arm-linux-gnueabihf (14.2.0-8ubuntu1) ... 734s Selecting previously unselected package gcc-14. 734s Preparing to unpack .../026-gcc-14_14.2.0-8ubuntu1_armhf.deb ... 734s Unpacking gcc-14 (14.2.0-8ubuntu1) ... 734s Selecting previously unselected package gcc-arm-linux-gnueabihf. 734s Preparing to unpack .../027-gcc-arm-linux-gnueabihf_4%3a14.1.0-2ubuntu1_armhf.deb ... 734s Unpacking gcc-arm-linux-gnueabihf (4:14.1.0-2ubuntu1) ... 734s Selecting previously unselected package gcc. 734s Preparing to unpack .../028-gcc_4%3a14.1.0-2ubuntu1_armhf.deb ... 734s Unpacking gcc (4:14.1.0-2ubuntu1) ... 734s Selecting previously unselected package libstdc++-14-dev:armhf. 734s Preparing to unpack .../029-libstdc++-14-dev_14.2.0-8ubuntu1_armhf.deb ... 734s Unpacking libstdc++-14-dev:armhf (14.2.0-8ubuntu1) ... 734s Selecting previously unselected package g++-14-arm-linux-gnueabihf. 734s Preparing to unpack .../030-g++-14-arm-linux-gnueabihf_14.2.0-8ubuntu1_armhf.deb ... 734s Unpacking g++-14-arm-linux-gnueabihf (14.2.0-8ubuntu1) ... 734s Selecting previously unselected package g++-14. 735s Preparing to unpack .../031-g++-14_14.2.0-8ubuntu1_armhf.deb ... 735s Unpacking g++-14 (14.2.0-8ubuntu1) ... 735s Selecting previously unselected package g++-arm-linux-gnueabihf. 735s Preparing to unpack .../032-g++-arm-linux-gnueabihf_4%3a14.1.0-2ubuntu1_armhf.deb ... 735s Unpacking g++-arm-linux-gnueabihf (4:14.1.0-2ubuntu1) ... 735s Selecting previously unselected package g++. 735s Preparing to unpack .../033-g++_4%3a14.1.0-2ubuntu1_armhf.deb ... 735s Unpacking g++ (4:14.1.0-2ubuntu1) ... 735s Selecting previously unselected package build-essential. 735s Preparing to unpack .../034-build-essential_12.10ubuntu1_armhf.deb ... 735s Unpacking build-essential (12.10ubuntu1) ... 735s Selecting previously unselected package libdebhelper-perl. 735s Preparing to unpack .../035-libdebhelper-perl_13.20ubuntu1_all.deb ... 735s Unpacking libdebhelper-perl (13.20ubuntu1) ... 735s Selecting previously unselected package libtool. 735s Preparing to unpack .../036-libtool_2.4.7-8_all.deb ... 735s Unpacking libtool (2.4.7-8) ... 735s Selecting previously unselected package dh-autoreconf. 735s Preparing to unpack .../037-dh-autoreconf_20_all.deb ... 735s Unpacking dh-autoreconf (20) ... 735s Selecting previously unselected package libarchive-zip-perl. 735s Preparing to unpack .../038-libarchive-zip-perl_1.68-1_all.deb ... 735s Unpacking libarchive-zip-perl (1.68-1) ... 735s Selecting previously unselected package libfile-stripnondeterminism-perl. 735s Preparing to unpack .../039-libfile-stripnondeterminism-perl_1.14.0-1_all.deb ... 735s Unpacking libfile-stripnondeterminism-perl (1.14.0-1) ... 735s Selecting previously unselected package dh-strip-nondeterminism. 735s Preparing to unpack .../040-dh-strip-nondeterminism_1.14.0-1_all.deb ... 735s Unpacking dh-strip-nondeterminism (1.14.0-1) ... 735s Selecting previously unselected package debugedit. 735s Preparing to unpack .../041-debugedit_1%3a5.1-1_armhf.deb ... 735s Unpacking debugedit (1:5.1-1) ... 735s Selecting previously unselected package dwz. 735s Preparing to unpack .../042-dwz_0.15-1build6_armhf.deb ... 735s Unpacking dwz (0.15-1build6) ... 735s Selecting previously unselected package gettext. 735s Preparing to unpack .../043-gettext_0.22.5-2_armhf.deb ... 735s Unpacking gettext (0.22.5-2) ... 735s Selecting previously unselected package intltool-debian. 735s Preparing to unpack .../044-intltool-debian_0.35.0+20060710.6_all.deb ... 735s Unpacking intltool-debian (0.35.0+20060710.6) ... 735s Selecting previously unselected package po-debconf. 735s Preparing to unpack .../045-po-debconf_1.0.21+nmu1_all.deb ... 735s Unpacking po-debconf (1.0.21+nmu1) ... 736s Selecting previously unselected package debhelper. 736s Preparing to unpack .../046-debhelper_13.20ubuntu1_all.deb ... 736s Unpacking debhelper (13.20ubuntu1) ... 736s Selecting previously unselected package dh-python. 736s Preparing to unpack .../047-dh-python_6.20241024_all.deb ... 736s Unpacking dh-python (6.20241024) ... 736s Selecting previously unselected package xml-core. 736s Preparing to unpack .../048-xml-core_0.19_all.deb ... 736s Unpacking xml-core (0.19) ... 736s Selecting previously unselected package docutils-common. 736s Preparing to unpack .../049-docutils-common_0.21.2+dfsg-2_all.deb ... 736s Unpacking docutils-common (0.21.2+dfsg-2) ... 736s Selecting previously unselected package fonts-font-awesome. 736s Preparing to unpack .../050-fonts-font-awesome_5.0.10+really4.7.0~dfsg-4.1_all.deb ... 736s Unpacking fonts-font-awesome (5.0.10+really4.7.0~dfsg-4.1) ... 736s Selecting previously unselected package fonts-glyphicons-halflings. 736s Preparing to unpack .../051-fonts-glyphicons-halflings_1.009~3.4.1+dfsg-3_all.deb ... 736s Unpacking fonts-glyphicons-halflings (1.009~3.4.1+dfsg-3) ... 736s Selecting previously unselected package fonts-mathjax. 736s Preparing to unpack .../052-fonts-mathjax_2.7.9+dfsg-1_all.deb ... 736s Unpacking fonts-mathjax (2.7.9+dfsg-1) ... 736s Selecting previously unselected package libargon2-1:armhf. 736s Preparing to unpack .../053-libargon2-1_0~20190702+dfsg-4build1_armhf.deb ... 736s Unpacking libargon2-1:armhf (0~20190702+dfsg-4build1) ... 737s Selecting previously unselected package libblas3:armhf. 737s Preparing to unpack .../054-libblas3_3.12.0-3build2_armhf.deb ... 737s Unpacking libblas3:armhf (3.12.0-3build2) ... 737s Selecting previously unselected package libcares2:armhf. 737s Preparing to unpack .../055-libcares2_1.34.2-1_armhf.deb ... 737s Unpacking libcares2:armhf (1.34.2-1) ... 737s Selecting previously unselected package libgfortran5:armhf. 737s Preparing to unpack .../056-libgfortran5_14.2.0-8ubuntu1_armhf.deb ... 737s Unpacking libgfortran5:armhf (14.2.0-8ubuntu1) ... 737s Selecting previously unselected package libjs-bootstrap. 737s Preparing to unpack .../057-libjs-bootstrap_3.4.1+dfsg-3_all.deb ... 737s Unpacking libjs-bootstrap (3.4.1+dfsg-3) ... 737s Selecting previously unselected package libjs-jquery. 737s Preparing to unpack .../058-libjs-jquery_3.6.1+dfsg+~3.5.14-1_all.deb ... 737s Unpacking libjs-jquery (3.6.1+dfsg+~3.5.14-1) ... 737s Selecting previously unselected package libjs-sortable-tablesort. 737s Preparing to unpack .../059-libjs-sortable-tablesort_3.1.0+ds-2_all.deb ... 737s Unpacking libjs-sortable-tablesort (3.1.0+ds-2) ... 737s Selecting previously unselected package libjs-underscore. 737s Preparing to unpack .../060-libjs-underscore_1.13.4~dfsg+~1.11.4-3_all.deb ... 737s Unpacking libjs-underscore (1.13.4~dfsg+~1.11.4-3) ... 737s Selecting previously unselected package libjs-sphinxdoc. 737s Preparing to unpack .../061-libjs-sphinxdoc_7.4.7-4_all.deb ... 737s Unpacking libjs-sphinxdoc (7.4.7-4) ... 737s Selecting previously unselected package libjs-sprintf-js. 737s Preparing to unpack .../062-libjs-sprintf-js_1.1.2+ds1+~1.1.2-1_all.deb ... 737s Unpacking libjs-sprintf-js (1.1.2+ds1+~1.1.2-1) ... 737s Selecting previously unselected package libjson-perl. 737s Preparing to unpack .../063-libjson-perl_4.10000-1_all.deb ... 737s Unpacking libjson-perl (4.10000-1) ... 737s Selecting previously unselected package liblapack3:armhf. 737s Preparing to unpack .../064-liblapack3_3.12.0-3build2_armhf.deb ... 737s Unpacking liblapack3:armhf (3.12.0-3build2) ... 737s Selecting previously unselected package node-xtend. 737s Preparing to unpack .../065-node-xtend_4.0.2-3_all.deb ... 737s Unpacking node-xtend (4.0.2-3) ... 737s Selecting previously unselected package nodejs. 737s Preparing to unpack .../066-nodejs_20.18.0+dfsg-2_armhf.deb ... 737s Unpacking nodejs (20.18.0+dfsg-2) ... 737s Selecting previously unselected package node-acorn. 738s Preparing to unpack .../067-node-acorn_8.8.1+ds+~cs25.17.7-2_all.deb ... 738s Unpacking node-acorn (8.8.1+ds+~cs25.17.7-2) ... 738s Selecting previously unselected package node-cjs-module-lexer. 738s Preparing to unpack .../068-node-cjs-module-lexer_1.2.3+dfsg-1_all.deb ... 738s Unpacking node-cjs-module-lexer (1.2.3+dfsg-1) ... 738s Selecting previously unselected package node-balanced-match. 738s Preparing to unpack .../069-node-balanced-match_2.0.0-1_all.deb ... 738s Unpacking node-balanced-match (2.0.0-1) ... 738s Selecting previously unselected package node-brace-expansion. 738s Preparing to unpack .../070-node-brace-expansion_2.0.1+~1.1.0-1_all.deb ... 738s Unpacking node-brace-expansion (2.0.1+~1.1.0-1) ... 738s Selecting previously unselected package node-minimatch. 738s Preparing to unpack .../071-node-minimatch_9.0.3-5_all.deb ... 738s Unpacking node-minimatch (9.0.3-5) ... 738s Selecting previously unselected package node-undici. 738s Preparing to unpack .../072-node-undici_5.28.4+dfsg1+~cs23.12.11-2_all.deb ... 738s Unpacking node-undici (5.28.4+dfsg1+~cs23.12.11-2) ... 738s Selecting previously unselected package libnode115:armhf. 738s Preparing to unpack .../073-libnode115_20.18.0+dfsg-2_armhf.deb ... 738s Unpacking libnode115:armhf (20.18.0+dfsg-2) ... 738s Selecting previously unselected package libnorm1t64:armhf. 738s Preparing to unpack .../074-libnorm1t64_1.5.9+dfsg-3.1build1_armhf.deb ... 738s Unpacking libnorm1t64:armhf (1.5.9+dfsg-3.1build1) ... 738s Selecting previously unselected package libpgm-5.3-0t64:armhf. 738s Preparing to unpack .../075-libpgm-5.3-0t64_5.3.128~dfsg-2.1build1_armhf.deb ... 738s Unpacking libpgm-5.3-0t64:armhf (5.3.128~dfsg-2.1build1) ... 738s Selecting previously unselected package libpython3.13-stdlib:armhf. 739s Preparing to unpack .../076-libpython3.13-stdlib_3.13.0-2_armhf.deb ... 739s Unpacking libpython3.13-stdlib:armhf (3.13.0-2) ... 739s Selecting previously unselected package libsodium23:armhf. 739s Preparing to unpack .../077-libsodium23_1.0.18-1build3_armhf.deb ... 739s Unpacking libsodium23:armhf (1.0.18-1build3) ... 739s Selecting previously unselected package libzmq5:armhf. 739s Preparing to unpack .../078-libzmq5_4.3.5-1build2_armhf.deb ... 739s Unpacking libzmq5:armhf (4.3.5-1build2) ... 739s Selecting previously unselected package node-esprima. 739s Preparing to unpack .../079-node-esprima_4.0.1+ds+~4.0.3-2_all.deb ... 739s Unpacking node-esprima (4.0.1+ds+~4.0.3-2) ... 739s Selecting previously unselected package node-sprintf-js. 739s Preparing to unpack .../080-node-sprintf-js_1.1.2+ds1+~1.1.2-1_all.deb ... 739s Unpacking node-sprintf-js (1.1.2+ds1+~1.1.2-1) ... 739s Selecting previously unselected package node-argparse. 739s Preparing to unpack .../081-node-argparse_2.0.1-2_all.deb ... 739s Unpacking node-argparse (2.0.1-2) ... 739s Selecting previously unselected package node-js-yaml. 739s Preparing to unpack .../082-node-js-yaml_4.1.0+dfsg+~4.0.5-7_all.deb ... 739s Unpacking node-js-yaml (4.1.0+dfsg+~4.0.5-7) ... 739s Selecting previously unselected package node-uglify-js. 739s Preparing to unpack .../083-node-uglify-js_3.17.4-2_all.deb ... 739s Unpacking node-uglify-js (3.17.4-2) ... 739s Selecting previously unselected package pybuild-plugin-autopkgtest. 739s Preparing to unpack .../084-pybuild-plugin-autopkgtest_6.20241024_all.deb ... 739s Unpacking pybuild-plugin-autopkgtest (6.20241024) ... 739s Selecting previously unselected package python3-packaging. 739s Preparing to unpack .../085-python3-packaging_24.2-1_all.deb ... 739s Unpacking python3-packaging (24.2-1) ... 739s Selecting previously unselected package python3-pyproject-hooks. 739s Preparing to unpack .../086-python3-pyproject-hooks_1.2.0-1_all.deb ... 739s Unpacking python3-pyproject-hooks (1.2.0-1) ... 739s Selecting previously unselected package python3-toml. 739s Preparing to unpack .../087-python3-toml_0.10.2-1_all.deb ... 739s Unpacking python3-toml (0.10.2-1) ... 739s Selecting previously unselected package python3-wheel. 739s Preparing to unpack .../088-python3-wheel_0.45.0-1_all.deb ... 739s Unpacking python3-wheel (0.45.0-1) ... 739s Selecting previously unselected package python3-build. 739s Preparing to unpack .../089-python3-build_1.2.2-1_all.deb ... 739s Unpacking python3-build (1.2.2-1) ... 740s Selecting previously unselected package python3-installer. 740s Preparing to unpack .../090-python3-installer_0.7.0+dfsg1-3_all.deb ... 740s Unpacking python3-installer (0.7.0+dfsg1-3) ... 740s Selecting previously unselected package pybuild-plugin-pyproject. 740s Preparing to unpack .../091-pybuild-plugin-pyproject_6.20241024_all.deb ... 740s Unpacking pybuild-plugin-pyproject (6.20241024) ... 740s Selecting previously unselected package libjs-mathjax. 740s Preparing to unpack .../092-libjs-mathjax_2.7.9+dfsg-1_all.deb ... 740s Unpacking libjs-mathjax (2.7.9+dfsg-1) ... 741s Selecting previously unselected package python-dask-doc. 741s Preparing to unpack .../093-python-dask-doc_2024.5.2+dfsg-1_all.deb ... 741s Unpacking python-dask-doc (2024.5.2+dfsg-1) ... 742s Selecting previously unselected package sphinx-rtd-theme-common. 742s Preparing to unpack .../094-sphinx-rtd-theme-common_3.0.2+dfsg-1_all.deb ... 742s Unpacking sphinx-rtd-theme-common (3.0.2+dfsg-1) ... 742s Selecting previously unselected package python-fsspec-doc. 742s Preparing to unpack .../095-python-fsspec-doc_2024.9.0-1_all.deb ... 742s Unpacking python-fsspec-doc (2024.9.0-1) ... 742s Selecting previously unselected package python-numpy-doc. 742s Preparing to unpack .../096-python-numpy-doc_1%3a1.26.4+ds-11ubuntu1_all.deb ... 742s Unpacking python-numpy-doc (1:1.26.4+ds-11ubuntu1) ... 743s Selecting previously unselected package python-pandas-doc. 743s Preparing to unpack .../097-python-pandas-doc_2.2.3+dfsg-5ubuntu1_all.deb ... 743s Unpacking python-pandas-doc (2.2.3+dfsg-5ubuntu1) ... 746s Selecting previously unselected package python3.12-doc. 746s Preparing to unpack .../098-python3.12-doc_3.12.7-3_all.deb ... 746s Unpacking python3.12-doc (3.12.7-3) ... 746s Selecting previously unselected package python3-doc. 747s Preparing to unpack .../099-python3-doc_3.12.7-1_all.deb ... 747s Unpacking python3-doc (3.12.7-1) ... 747s Selecting previously unselected package sass-stylesheets-bulma. 747s Preparing to unpack .../100-sass-stylesheets-bulma_0.9.4~ds-1_all.deb ... 747s Unpacking sass-stylesheets-bulma (0.9.4~ds-1) ... 747s Selecting previously unselected package python-distributed-doc. 747s Preparing to unpack .../101-python-distributed-doc_2024.5.2+ds.1-8_all.deb ... 747s Unpacking python-distributed-doc (2024.5.2+ds.1-8) ... 747s Selecting previously unselected package python-tinycss2-common. 747s Preparing to unpack .../102-python-tinycss2-common_1.4.0-1_all.deb ... 747s Unpacking python-tinycss2-common (1.4.0-1) ... 747s Selecting previously unselected package python3.13. 747s Preparing to unpack .../103-python3.13_3.13.0-2_armhf.deb ... 747s Unpacking python3.13 (3.13.0-2) ... 747s Selecting previously unselected package python3-all. 747s Preparing to unpack .../104-python3-all_3.12.7-1_armhf.deb ... 747s Unpacking python3-all (3.12.7-1) ... 747s Selecting previously unselected package python3-sniffio. 747s Preparing to unpack .../105-python3-sniffio_1.3.1-1_all.deb ... 747s Unpacking python3-sniffio (1.3.1-1) ... 747s Selecting previously unselected package python3-anyio. 747s Preparing to unpack .../106-python3-anyio_4.6.2-4_all.deb ... 747s Unpacking python3-anyio (4.6.2-4) ... 747s Selecting previously unselected package python3-argon2. 747s Preparing to unpack .../107-python3-argon2_21.1.0-2build1_armhf.deb ... 747s Unpacking python3-argon2 (21.1.0-2build1) ... 747s Selecting previously unselected package python3-dateutil. 747s Preparing to unpack .../108-python3-dateutil_2.9.0-3_all.deb ... 747s Unpacking python3-dateutil (2.9.0-3) ... 747s Selecting previously unselected package python3-arrow. 747s Preparing to unpack .../109-python3-arrow_1.3.0-1.1ubuntu1_all.deb ... 747s Unpacking python3-arrow (1.3.0-1.1ubuntu1) ... 747s Selecting previously unselected package python3-async-generator. 747s Preparing to unpack .../110-python3-async-generator_1.10-4_all.deb ... 747s Unpacking python3-async-generator (1.10-4) ... 747s Selecting previously unselected package python3-webencodings. 747s Preparing to unpack .../111-python3-webencodings_0.5.1-5_all.deb ... 747s Unpacking python3-webencodings (0.5.1-5) ... 747s Selecting previously unselected package python3-html5lib. 747s Preparing to unpack .../112-python3-html5lib_1.2-1_all.deb ... 747s Unpacking python3-html5lib (1.2-1) ... 747s Selecting previously unselected package python3-bleach. 747s Preparing to unpack .../113-python3-bleach_6.2.0-1_all.deb ... 747s Unpacking python3-bleach (6.2.0-1) ... 748s Selecting previously unselected package python3-soupsieve. 748s Preparing to unpack .../114-python3-soupsieve_2.6-1_all.deb ... 748s Unpacking python3-soupsieve (2.6-1) ... 748s Selecting previously unselected package python3-bs4. 748s Preparing to unpack .../115-python3-bs4_4.12.3-3_all.deb ... 748s Unpacking python3-bs4 (4.12.3-3) ... 748s Selecting previously unselected package python3-colorama. 748s Preparing to unpack .../116-python3-colorama_0.4.6-4_all.deb ... 748s Unpacking python3-colorama (0.4.6-4) ... 748s Selecting previously unselected package python3-click. 748s Preparing to unpack .../117-python3-click_8.1.7-2_all.deb ... 748s Unpacking python3-click (8.1.7-2) ... 748s Selecting previously unselected package python3-cloudpickle. 748s Preparing to unpack .../118-python3-cloudpickle_3.0.0-2_all.deb ... 748s Unpacking python3-cloudpickle (3.0.0-2) ... 748s Selecting previously unselected package python3-fsspec. 748s Preparing to unpack .../119-python3-fsspec_2024.9.0-1_all.deb ... 748s Unpacking python3-fsspec (2024.9.0-1) ... 748s Selecting previously unselected package python3-toolz. 748s Preparing to unpack .../120-python3-toolz_1.0.0-1_all.deb ... 748s Unpacking python3-toolz (1.0.0-1) ... 748s Selecting previously unselected package python3-locket. 748s Preparing to unpack .../121-python3-locket_1.0.0-2_all.deb ... 748s Unpacking python3-locket (1.0.0-2) ... 748s Selecting previously unselected package python3-partd. 748s Preparing to unpack .../122-python3-partd_1.4.2-1_all.deb ... 748s Unpacking python3-partd (1.4.2-1) ... 748s Selecting previously unselected package python3-dask. 748s Preparing to unpack .../123-python3-dask_2024.5.2+dfsg-1_all.deb ... 748s Unpacking python3-dask (2024.5.2+dfsg-1) ... 748s Selecting previously unselected package python3-roman. 748s Preparing to unpack .../124-python3-roman_4.2-1_all.deb ... 748s Unpacking python3-roman (4.2-1) ... 748s Selecting previously unselected package python3-docutils. 748s Preparing to unpack .../125-python3-docutils_0.21.2+dfsg-2_all.deb ... 748s Unpacking python3-docutils (0.21.2+dfsg-2) ... 748s Selecting previously unselected package python3-defusedxml. 748s Preparing to unpack .../126-python3-defusedxml_0.7.1-2_all.deb ... 748s Unpacking python3-defusedxml (0.7.1-2) ... 749s Selecting previously unselected package sphinx-common. 749s Preparing to unpack .../127-sphinx-common_7.4.7-4_all.deb ... 749s Unpacking sphinx-common (7.4.7-4) ... 749s Selecting previously unselected package python3-alabaster. 749s Preparing to unpack .../128-python3-alabaster_0.7.16-0.1_all.deb ... 749s Unpacking python3-alabaster (0.7.16-0.1) ... 749s Selecting previously unselected package python3-imagesize. 749s Preparing to unpack .../129-python3-imagesize_1.4.1-1_all.deb ... 749s Unpacking python3-imagesize (1.4.1-1) ... 749s Selecting previously unselected package python3-snowballstemmer. 749s Preparing to unpack .../130-python3-snowballstemmer_2.2.0-4build1_all.deb ... 749s Unpacking python3-snowballstemmer (2.2.0-4build1) ... 749s Selecting previously unselected package python3-sphinx. 749s Preparing to unpack .../131-python3-sphinx_7.4.7-4_all.deb ... 749s Unpacking python3-sphinx (7.4.7-4) ... 749s Selecting previously unselected package python3-pydata-sphinx-theme. 749s Preparing to unpack .../132-python3-pydata-sphinx-theme_0.15.4+dfsg-2_all.deb ... 749s Unpacking python3-pydata-sphinx-theme (0.15.4+dfsg-2) ... 749s Selecting previously unselected package python3-sphinx-book-theme. 749s Preparing to unpack .../133-python3-sphinx-book-theme_0.1.7-3_all.deb ... 749s Unpacking python3-sphinx-book-theme (0.1.7-3) ... 749s Selecting previously unselected package python3-dask-sphinx-theme. 749s Preparing to unpack .../134-python3-dask-sphinx-theme_3.0.5-2_all.deb ... 749s Unpacking python3-dask-sphinx-theme (3.0.5-2) ... 749s Selecting previously unselected package python3-decorator. 749s Preparing to unpack .../135-python3-decorator_5.1.1-5_all.deb ... 749s Unpacking python3-decorator (5.1.1-5) ... 749s Selecting previously unselected package python3-msgpack. 749s Preparing to unpack .../136-python3-msgpack_1.0.3-3build3_armhf.deb ... 749s Unpacking python3-msgpack (1.0.3-3build3) ... 749s Selecting previously unselected package python3-psutil. 749s Preparing to unpack .../137-python3-psutil_5.9.8-2build3_armhf.deb ... 749s Unpacking python3-psutil (5.9.8-2build3) ... 749s Selecting previously unselected package python3-sortedcontainers. 749s Preparing to unpack .../138-python3-sortedcontainers_2.4.0-2_all.deb ... 749s Unpacking python3-sortedcontainers (2.4.0-2) ... 749s Selecting previously unselected package python3-tblib. 749s Preparing to unpack .../139-python3-tblib_3.0.0-5_all.deb ... 749s Unpacking python3-tblib (3.0.0-5) ... 750s Selecting previously unselected package python3-tornado. 750s Preparing to unpack .../140-python3-tornado_6.4.1-3_armhf.deb ... 750s Unpacking python3-tornado (6.4.1-3) ... 750s Selecting previously unselected package python3-zict. 750s Preparing to unpack .../141-python3-zict_3.0.0-2ubuntu1_all.deb ... 750s Unpacking python3-zict (3.0.0-2ubuntu1) ... 750s Selecting previously unselected package python3-distributed. 750s Preparing to unpack .../142-python3-distributed_2024.5.2+ds.1-8_all.deb ... 750s Unpacking python3-distributed (2024.5.2+ds.1-8) ... 750s Selecting previously unselected package python3-fastjsonschema. 750s Preparing to unpack .../143-python3-fastjsonschema_2.20.0-1_all.deb ... 750s Unpacking python3-fastjsonschema (2.20.0-1) ... 750s Selecting previously unselected package python3-fqdn. 750s Preparing to unpack .../144-python3-fqdn_1.5.1-2_all.deb ... 750s Unpacking python3-fqdn (1.5.1-2) ... 750s Selecting previously unselected package python3-iniconfig. 750s Preparing to unpack .../145-python3-iniconfig_1.1.1-2_all.deb ... 750s Unpacking python3-iniconfig (1.1.1-2) ... 750s Selecting previously unselected package python3-isoduration. 750s Preparing to unpack .../146-python3-isoduration_20.11.0+git20211126.ae0bd61-2_all.deb ... 750s Unpacking python3-isoduration (20.11.0+git20211126.ae0bd61-2) ... 750s Selecting previously unselected package python3-platformdirs. 750s Preparing to unpack .../147-python3-platformdirs_4.3.6-1_all.deb ... 750s Unpacking python3-platformdirs (4.3.6-1) ... 750s Selecting previously unselected package python3-traitlets. 750s Preparing to unpack .../148-python3-traitlets_5.14.3+really5.14.3-1_all.deb ... 750s Unpacking python3-traitlets (5.14.3+really5.14.3-1) ... 750s Selecting previously unselected package python3-jupyter-core. 750s Preparing to unpack .../149-python3-jupyter-core_5.7.2-4_all.deb ... 750s Unpacking python3-jupyter-core (5.7.2-4) ... 750s Selecting previously unselected package python3-py. 750s Preparing to unpack .../150-python3-py_1.11.0-2_all.deb ... 750s Unpacking python3-py (1.11.0-2) ... 750s Selecting previously unselected package python3-zmq. 750s Preparing to unpack .../151-python3-zmq_24.0.1-5build2_armhf.deb ... 750s Unpacking python3-zmq (24.0.1-5build2) ... 750s Selecting previously unselected package python3-jupyter-client. 750s Preparing to unpack .../152-python3-jupyter-client_8.6.3-1_all.deb ... 750s Unpacking python3-jupyter-client (8.6.3-1) ... 750s Selecting previously unselected package python3-pythonjsonlogger. 750s Preparing to unpack .../153-python3-pythonjsonlogger_3.1.0-1_all.deb ... 750s Unpacking python3-pythonjsonlogger (3.1.0-1) ... 751s Selecting previously unselected package python3-rfc3339-validator. 751s Preparing to unpack .../154-python3-rfc3339-validator_0.1.4-2_all.deb ... 751s Unpacking python3-rfc3339-validator (0.1.4-2) ... 751s Selecting previously unselected package python3-rfc3986-validator. 751s Preparing to unpack .../155-python3-rfc3986-validator_0.1.1-2_all.deb ... 751s Unpacking python3-rfc3986-validator (0.1.1-2) ... 751s Selecting previously unselected package python3-uritemplate. 751s Preparing to unpack .../156-python3-uritemplate_4.1.1-3_all.deb ... 751s Unpacking python3-uritemplate (4.1.1-3) ... 751s Selecting previously unselected package python3-webcolors. 751s Preparing to unpack .../157-python3-webcolors_1.13-1_all.deb ... 751s Unpacking python3-webcolors (1.13-1) ... 751s Selecting previously unselected package python3-jupyter-events. 751s Preparing to unpack .../158-python3-jupyter-events_0.10.0-3_all.deb ... 751s Unpacking python3-jupyter-events (0.10.0-3) ... 751s Selecting previously unselected package python3-ptyprocess. 751s Preparing to unpack .../159-python3-ptyprocess_0.7.0-6_all.deb ... 751s Unpacking python3-ptyprocess (0.7.0-6) ... 751s Selecting previously unselected package python3-terminado. 751s Preparing to unpack .../160-python3-terminado_0.18.1-1_all.deb ... 751s Unpacking python3-terminado (0.18.1-1) ... 751s Selecting previously unselected package python3-jupyter-server-terminals. 751s Preparing to unpack .../161-python3-jupyter-server-terminals_0.5.3-2_all.deb ... 751s Unpacking python3-jupyter-server-terminals (0.5.3-2) ... 751s Selecting previously unselected package python3-jupyterlab-pygments. 751s Preparing to unpack .../162-python3-jupyterlab-pygments_0.2.2-3_all.deb ... 751s Unpacking python3-jupyterlab-pygments (0.2.2-3) ... 751s Selecting previously unselected package python3-mistune. 751s Preparing to unpack .../163-python3-mistune_3.0.2-2_all.deb ... 751s Unpacking python3-mistune (3.0.2-2) ... 751s Selecting previously unselected package python3-nbformat. 751s Preparing to unpack .../164-python3-nbformat_5.9.1-1_all.deb ... 751s Unpacking python3-nbformat (5.9.1-1) ... 751s Selecting previously unselected package python3-nbclient. 751s Preparing to unpack .../165-python3-nbclient_0.8.0-1_all.deb ... 751s Unpacking python3-nbclient (0.8.0-1) ... 751s Selecting previously unselected package python3-pandocfilters. 751s Preparing to unpack .../166-python3-pandocfilters_1.5.1-1_all.deb ... 751s Unpacking python3-pandocfilters (1.5.1-1) ... 751s Selecting previously unselected package python3-tinycss2. 751s Preparing to unpack .../167-python3-tinycss2_1.4.0-1_all.deb ... 751s Unpacking python3-tinycss2 (1.4.0-1) ... 751s Selecting previously unselected package python3-nbconvert. 751s Preparing to unpack .../168-python3-nbconvert_7.16.4-2_all.deb ... 751s Unpacking python3-nbconvert (7.16.4-2) ... 751s Selecting previously unselected package python3-overrides. 751s Preparing to unpack .../169-python3-overrides_7.7.0-2_all.deb ... 751s Unpacking python3-overrides (7.7.0-2) ... 752s Selecting previously unselected package python3-prometheus-client. 752s Preparing to unpack .../170-python3-prometheus-client_0.19.0+ds1-1_all.deb ... 752s Unpacking python3-prometheus-client (0.19.0+ds1-1) ... 752s Selecting previously unselected package python3-send2trash. 752s Preparing to unpack .../171-python3-send2trash_1.8.3-1_all.deb ... 752s Unpacking python3-send2trash (1.8.3-1) ... 752s Selecting previously unselected package python3-websocket. 752s Preparing to unpack .../172-python3-websocket_1.8.0-2_all.deb ... 752s Unpacking python3-websocket (1.8.0-2) ... 752s Selecting previously unselected package python3-jupyter-server. 752s Preparing to unpack .../173-python3-jupyter-server_2.14.2-4_all.deb ... 752s Unpacking python3-jupyter-server (2.14.2-4) ... 752s Selecting previously unselected package python3-numpy. 752s Preparing to unpack .../174-python3-numpy_1%3a1.26.4+ds-11ubuntu1_armhf.deb ... 752s Unpacking python3-numpy (1:1.26.4+ds-11ubuntu1) ... 752s Selecting previously unselected package python3-tabulate. 752s Preparing to unpack .../175-python3-tabulate_0.9.0-1_all.deb ... 752s Unpacking python3-tabulate (0.9.0-1) ... 752s Selecting previously unselected package python3-numpydoc. 752s Preparing to unpack .../176-python3-numpydoc_1.6.0-2_all.deb ... 752s Unpacking python3-numpydoc (1.6.0-2) ... 752s Selecting previously unselected package python3-tz. 752s Preparing to unpack .../177-python3-tz_2024.1-2_all.deb ... 752s Unpacking python3-tz (2024.1-2) ... 752s Selecting previously unselected package python3-pandas-lib:armhf. 752s Preparing to unpack .../178-python3-pandas-lib_2.2.3+dfsg-5ubuntu1_armhf.deb ... 752s Unpacking python3-pandas-lib:armhf (2.2.3+dfsg-5ubuntu1) ... 753s Selecting previously unselected package python3-pandas. 753s Preparing to unpack .../179-python3-pandas_2.2.3+dfsg-5ubuntu1_all.deb ... 753s Unpacking python3-pandas (2.2.3+dfsg-5ubuntu1) ... 753s Selecting previously unselected package python3-pluggy. 753s Preparing to unpack .../180-python3-pluggy_1.5.0-1_all.deb ... 753s Unpacking python3-pluggy (1.5.0-1) ... 753s Selecting previously unselected package python3-pytest. 753s Preparing to unpack .../181-python3-pytest_8.3.3-1_all.deb ... 753s Unpacking python3-pytest (8.3.3-1) ... 754s Selecting previously unselected package python3-pytest-asyncio. 754s Preparing to unpack .../182-python3-pytest-asyncio_0.20.3-1.3_all.deb ... 754s Unpacking python3-pytest-asyncio (0.20.3-1.3) ... 754s Selecting previously unselected package python3-pytest-rerunfailures. 754s Preparing to unpack .../183-python3-pytest-rerunfailures_14.0-2_all.deb ... 754s Unpacking python3-pytest-rerunfailures (14.0-2) ... 754s Selecting previously unselected package python3-pytest-timeout. 754s Preparing to unpack .../184-python3-pytest-timeout_2.3.1-1_all.deb ... 754s Unpacking python3-pytest-timeout (2.3.1-1) ... 754s Selecting previously unselected package python3-sortedcollections. 754s Preparing to unpack .../185-python3-sortedcollections_2.1.0-2_all.deb ... 754s Unpacking python3-sortedcollections (2.1.0-2) ... 754s Selecting previously unselected package python3-sphinx-click. 754s Preparing to unpack .../186-python3-sphinx-click_5.1.0-1_all.deb ... 754s Unpacking python3-sphinx-click (5.1.0-1) ... 754s Selecting previously unselected package python3-sphinx-design. 754s Preparing to unpack .../187-python3-sphinx-design_0.6.1-1_all.deb ... 754s Unpacking python3-sphinx-design (0.6.1-1) ... 754s Selecting previously unselected package python3-versioneer. 754s Preparing to unpack .../188-python3-versioneer_0.29-1_all.deb ... 754s Unpacking python3-versioneer (0.29-1) ... 754s Selecting previously unselected package tzdata-legacy. 754s Preparing to unpack .../189-tzdata-legacy_2024b-1ubuntu2_all.deb ... 754s Unpacking tzdata-legacy (2024b-1ubuntu2) ... 754s Selecting previously unselected package uglifyjs. 754s Preparing to unpack .../190-uglifyjs_3.17.4-2_all.deb ... 754s Unpacking uglifyjs (3.17.4-2) ... 754s Selecting previously unselected package autopkgtest-satdep. 754s Preparing to unpack .../191-2-autopkgtest-satdep.deb ... 754s Unpacking autopkgtest-satdep (0) ... 754s Setting up dh-python (6.20241024) ... 755s Setting up node-uglify-js (3.17.4-2) ... 755s Setting up python3-iniconfig (1.1.1-2) ... 755s Setting up python3-sniffio (1.3.1-1) ... 755s Setting up python3-tornado (6.4.1-3) ... 756s Setting up libnorm1t64:armhf (1.5.9+dfsg-3.1build1) ... 756s Setting up python3-send2trash (1.8.3-1) ... 757s Setting up fonts-lato (2.015-1) ... 757s Setting up libjs-sprintf-js (1.1.2+ds1+~1.1.2-1) ... 757s Setting up fonts-mathjax (2.7.9+dfsg-1) ... 757s Setting up libsodium23:armhf (1.0.18-1build3) ... 757s Setting up python3-async-generator (1.10-4) ... 757s Setting up libjs-mathjax (2.7.9+dfsg-1) ... 757s Setting up python3-tblib (3.0.0-5) ... 757s Setting up python3-py (1.11.0-2) ... 758s Setting up python3-anyio (4.6.2-4) ... 758s Setting up python3-pythonjsonlogger (3.1.0-1) ... 759s Setting up python3-colorama (0.4.6-4) ... 759s Setting up python3-defusedxml (0.7.1-2) ... 759s Setting up libarchive-zip-perl (1.68-1) ... 759s Setting up fonts-glyphicons-halflings (1.009~3.4.1+dfsg-3) ... 759s Setting up python3-alabaster (0.7.16-0.1) ... 759s Setting up libargon2-1:armhf (0~20190702+dfsg-4build1) ... 759s Setting up python3-overrides (7.7.0-2) ... 760s Setting up libdebhelper-perl (13.20ubuntu1) ... 760s Setting up python3-fsspec (2024.9.0-1) ... 761s Setting up python3-rfc3339-validator (0.1.4-2) ... 761s Setting up linux-libc-dev:armhf (6.11.0-8.8) ... 761s Setting up python3-tabulate (0.9.0-1) ... 761s Setting up m4 (1.4.19-4build1) ... 761s Setting up node-cjs-module-lexer (1.2.3+dfsg-1) ... 761s Setting up python3-sortedcontainers (2.4.0-2) ... 762s Setting up python3-pandocfilters (1.5.1-1) ... 762s Setting up libgomp1:armhf (14.2.0-8ubuntu1) ... 762s Setting up python3-click (8.1.7-2) ... 762s Setting up python3-wheel (0.45.0-1) ... 763s Setting up python3-webencodings (0.5.1-5) ... 763s Setting up python3-platformdirs (4.3.6-1) ... 763s Setting up python3-psutil (5.9.8-2build3) ... 764s Setting up tzdata-legacy (2024b-1ubuntu2) ... 764s Setting up python3-tz (2024.1-2) ... 764s Setting up python3-cloudpickle (3.0.0-2) ... 765s Setting up python3-uritemplate (4.1.1-3) ... 765s Setting up python3-jupyterlab-pygments (0.2.2-3) ... 765s Setting up libpython3.13-minimal:armhf (3.13.0-2) ... 765s Setting up python3-roman (4.2-1) ... 766s Setting up libpgm-5.3-0t64:armhf (5.3.128~dfsg-2.1build1) ... 766s Setting up python3-decorator (5.1.1-5) ... 766s Setting up python3-fqdn (1.5.1-2) ... 766s Setting up autotools-dev (20220109.1) ... 766s Setting up libblas3:armhf (3.12.0-3build2) ... 766s update-alternatives: using /usr/lib/arm-linux-gnueabihf/blas/libblas.so.3 to provide /usr/lib/arm-linux-gnueabihf/libblas.so.3 (libblas.so.3-arm-linux-gnueabihf) in auto mode 766s Setting up python3-webcolors (1.13-1) ... 766s Setting up python3-packaging (24.2-1) ... 767s Setting up rpcsvc-proto (1.4.2-0ubuntu7) ... 767s Setting up python3-pyproject-hooks (1.2.0-1) ... 767s Setting up node-sprintf-js (1.1.2+ds1+~1.1.2-1) ... 767s Setting up python3-snowballstemmer (2.2.0-4build1) ... 768s Setting up node-balanced-match (2.0.0-1) ... 768s Setting up node-brace-expansion (2.0.1+~1.1.0-1) ... 768s Setting up python3-rfc3986-validator (0.1.1-2) ... 768s Setting up libcares2:armhf (1.34.2-1) ... 768s Setting up libmpc3:armhf (1.3.1-1build2) ... 768s Setting up autopoint (0.22.5-2) ... 768s Setting up python3-html5lib (1.2-1) ... 769s Setting up python3-toml (0.10.2-1) ... 769s Setting up python3-installer (0.7.0+dfsg1-3) ... 769s Setting up libgfortran5:armhf (14.2.0-8ubuntu1) ... 769s Setting up autoconf (2.72-3) ... 769s Setting up python3-pluggy (1.5.0-1) ... 770s Setting up libubsan1:armhf (14.2.0-8ubuntu1) ... 770s Setting up python3-fastjsonschema (2.20.0-1) ... 770s Setting up node-undici (5.28.4+dfsg1+~cs23.12.11-2) ... 770s Setting up dwz (0.15-1build6) ... 770s Setting up libcrypt-dev:armhf (1:4.4.36-5) ... 770s Setting up python3-traitlets (5.14.3+really5.14.3-1) ... 770s Setting up libasan8:armhf (14.2.0-8ubuntu1) ... 770s Setting up python-tinycss2-common (1.4.0-1) ... 770s Setting up libjson-perl (4.10000-1) ... 770s Setting up python3-argon2 (21.1.0-2build1) ... 771s Setting up debugedit (1:5.1-1) ... 771s Setting up python3.13-minimal (3.13.0-2) ... 772s Setting up python3-toolz (1.0.0-1) ... 772s Setting up python3-dateutil (2.9.0-3) ... 773s Setting up sgml-base (1.31) ... 773s Setting up python3-msgpack (1.0.3-3build3) ... 773s Setting up python3-versioneer (0.29-1) ... 774s Setting up node-minimatch (9.0.3-5) ... 774s Setting up libjs-jquery (3.6.1+dfsg+~3.5.14-1) ... 774s Setting up sass-stylesheets-bulma (0.9.4~ds-1) ... 774s Setting up libgcc-14-dev:armhf (14.2.0-8ubuntu1) ... 774s Setting up node-xtend (4.0.2-3) ... 774s Setting up libisl23:armhf (0.27-1) ... 774s Setting up python3-build (1.2.2-1) ... 774s Setting up libc-dev-bin (2.40-1ubuntu3) ... 774s Setting up python3-zict (3.0.0-2ubuntu1) ... 774s Setting up python3-locket (1.0.0-2) ... 775s Setting up python3-mistune (3.0.2-2) ... 775s Setting up libpython3.13-stdlib:armhf (3.13.0-2) ... 775s Setting up python3-soupsieve (2.6-1) ... 775s Setting up fonts-font-awesome (5.0.10+really4.7.0~dfsg-4.1) ... 775s Setting up sphinx-rtd-theme-common (3.0.2+dfsg-1) ... 775s Setting up python3-websocket (1.8.0-2) ... 776s Setting up libcc1-0:armhf (14.2.0-8ubuntu1) ... 776s Setting up libjs-sortable-tablesort (3.1.0+ds-2) ... 776s Setting up python3-jupyter-core (5.7.2-4) ... 776s Setting up libjs-bootstrap (3.4.1+dfsg-3) ... 776s Setting up cpp-14-arm-linux-gnueabihf (14.2.0-8ubuntu1) ... 776s Setting up libjs-underscore (1.13.4~dfsg+~1.11.4-3) ... 776s Setting up python3-imagesize (1.4.1-1) ... 776s Setting up python3-ptyprocess (0.7.0-6) ... 777s Setting up automake (1:1.16.5-1.3ubuntu1) ... 777s update-alternatives: using /usr/bin/automake-1.16 to provide /usr/bin/automake (automake) in auto mode 777s Setting up libfile-stripnondeterminism-perl (1.14.0-1) ... 777s Setting up python3-partd (1.4.2-1) ... 777s Setting up python3-sortedcollections (2.1.0-2) ... 777s Setting up liblapack3:armhf (3.12.0-3build2) ... 777s update-alternatives: using /usr/lib/arm-linux-gnueabihf/lapack/liblapack.so.3 to provide /usr/lib/arm-linux-gnueabihf/liblapack.so.3 (liblapack.so.3-arm-linux-gnueabihf) in auto mode 777s Setting up gettext (0.22.5-2) ... 777s Setting up python3-tinycss2 (1.4.0-1) ... 778s Setting up libzmq5:armhf (4.3.5-1build2) ... 778s Setting up python3-arrow (1.3.0-1.1ubuntu1) ... 778s Setting up python3.13 (3.13.0-2) ... 780s Setting up pybuild-plugin-pyproject (6.20241024) ... 780s Setting up python3-pytest (8.3.3-1) ... 781s Setting up python3-dask (2024.5.2+dfsg-1) ... 785s Setting up python3-isoduration (20.11.0+git20211126.ae0bd61-2) ... 785s Setting up gcc-14-arm-linux-gnueabihf (14.2.0-8ubuntu1) ... 785s Setting up python3-all (3.12.7-1) ... 785s Setting up python3-nbformat (5.9.1-1) ... 785s Setting up python3-bs4 (4.12.3-3) ... 786s Setting up intltool-debian (0.35.0+20060710.6) ... 786s Setting up python3-bleach (6.2.0-1) ... 786s Setting up python3-prometheus-client (0.19.0+ds1-1) ... 786s Setting up python3-distributed (2024.5.2+ds.1-8) ... 790s Setting up python3-zmq (24.0.1-5build2) ... 791s Setting up python3-numpy (1:1.26.4+ds-11ubuntu1) ... 796s Setting up libjs-sphinxdoc (7.4.7-4) ... 796s Setting up cpp-14 (14.2.0-8ubuntu1) ... 796s Setting up python3-pytest-asyncio (0.20.3-1.3) ... 796s Setting up dh-strip-nondeterminism (1.14.0-1) ... 796s Setting up python3-terminado (0.18.1-1) ... 797s Setting up xml-core (0.19) ... 797s Setting up libc6-dev:armhf (2.40-1ubuntu3) ... 797s Setting up python3-jupyter-client (8.6.3-1) ... 797s Setting up python3-jupyter-server-terminals (0.5.3-2) ... 798s Setting up python3.12-doc (3.12.7-3) ... 798s Setting up python3-jupyter-events (0.10.0-3) ... 798s Setting up libstdc++-14-dev:armhf (14.2.0-8ubuntu1) ... 798s Setting up python3-doc (3.12.7-1) ... 798s Setting up cpp-arm-linux-gnueabihf (4:14.1.0-2ubuntu1) ... 798s Setting up gcc-arm-linux-gnueabihf (4:14.1.0-2ubuntu1) ... 798s Setting up python-numpy-doc (1:1.26.4+ds-11ubuntu1) ... 798s Setting up g++-14-arm-linux-gnueabihf (14.2.0-8ubuntu1) ... 798s Setting up python3-pytest-rerunfailures (14.0-2) ... 798s Setting up python3-pytest-timeout (2.3.1-1) ... 799s Setting up python-pandas-doc (2.2.3+dfsg-5ubuntu1) ... 799s Setting up po-debconf (1.0.21+nmu1) ... 799s Setting up python3-pandas-lib:armhf (2.2.3+dfsg-5ubuntu1) ... 799s Setting up gcc-14 (14.2.0-8ubuntu1) ... 799s Setting up python3-nbclient (0.8.0-1) ... 799s Setting up python3-pandas (2.2.3+dfsg-5ubuntu1) ... 814s Setting up sphinx-common (7.4.7-4) ... 814s Setting up python-fsspec-doc (2024.9.0-1) ... 814s Setting up python3-nbconvert (7.16.4-2) ... 814s Setting up cpp (4:14.1.0-2ubuntu1) ... 814s Setting up g++-14 (14.2.0-8ubuntu1) ... 814s Setting up g++-arm-linux-gnueabihf (4:14.1.0-2ubuntu1) ... 814s Setting up python3-jupyter-server (2.14.2-4) ... 815s Setting up libtool (2.4.7-8) ... 815s Setting up gcc (4:14.1.0-2ubuntu1) ... 815s Setting up dh-autoreconf (20) ... 815s Setting up g++ (4:14.1.0-2ubuntu1) ... 815s update-alternatives: using /usr/bin/g++ to provide /usr/bin/c++ (c++) in auto mode 815s Setting up build-essential (12.10ubuntu1) ... 815s Setting up debhelper (13.20ubuntu1) ... 815s Setting up pybuild-plugin-autopkgtest (6.20241024) ... 815s Setting up node-acorn (8.8.1+ds+~cs25.17.7-2) ... 815s Setting up libnode115:armhf (20.18.0+dfsg-2) ... 815s Setting up nodejs (20.18.0+dfsg-2) ... 815s update-alternatives: using /usr/bin/nodejs to provide /usr/bin/js (js) in auto mode 815s Setting up node-argparse (2.0.1-2) ... 815s Setting up node-esprima (4.0.1+ds+~4.0.3-2) ... 815s Setting up node-js-yaml (4.1.0+dfsg+~4.0.5-7) ... 815s Setting up uglifyjs (3.17.4-2) ... 815s Setting up python-dask-doc (2024.5.2+dfsg-1) ... 815s Setting up python-distributed-doc (2024.5.2+ds.1-8) ... 815s Processing triggers for install-info (7.1.1-1) ... 816s Processing triggers for libc-bin (2.40-1ubuntu3) ... 816s Processing triggers for systemd (256.5-2ubuntu4) ... 816s Processing triggers for man-db (2.13.0-1) ... 817s Processing triggers for sgml-base (1.31) ... 817s Setting up docutils-common (0.21.2+dfsg-2) ... 817s Processing triggers for sgml-base (1.31) ... 817s Setting up python3-docutils (0.21.2+dfsg-2) ... 819s Setting up python3-sphinx (7.4.7-4) ... 821s Setting up python3-sphinx-click (5.1.0-1) ... 821s Setting up python3-sphinx-design (0.6.1-1) ... 821s Setting up python3-numpydoc (1.6.0-2) ... 822s Setting up python3-pydata-sphinx-theme (0.15.4+dfsg-2) ... 822s Setting up python3-sphinx-book-theme (0.1.7-3) ... 822s Setting up python3-dask-sphinx-theme (3.0.5-2) ... 822s Setting up autopkgtest-satdep (0) ... 858s (Reading database ... 91464 files and directories currently installed.) 858s Removing autopkgtest-satdep (0) ... 871s autopkgtest [20:51:00]: test pybuild-autopkgtest: pybuild-autopkgtest 871s autopkgtest [20:51:00]: test pybuild-autopkgtest: [----------------------- 873s pybuild-autopkgtest 874s I: pybuild pybuild:308: mkdir -pv /tmp/autopkgtest.1vd31g/autopkgtest_tmp/.config && printf '\173 "dataframe": \173 "query-planning": False \175 \175\n' > /tmp/autopkgtest.1vd31g/autopkgtest_tmp/.config/dask 874s mkdir: created directory '/tmp/autopkgtest.1vd31g/autopkgtest_tmp/.config' 874s I: pybuild base:311: cd /tmp/autopkgtest.1vd31g/autopkgtest_tmp/build; cd /tmp/autopkgtest.1vd31g/autopkgtest_tmp/build; /tmp/autopkgtest.1vd31g/build.jio/src/debian/run-tests /tmp/autopkgtest.1vd31g/build.jio/src/debian/get-test-exclusions rules python3.13 -m pytest --pyargs distributed --verbose --color=no --timeout-method=signal --timeout=300 -m "not avoid_ci" 874s *** STARTING RUN 1: python3.13 -m pytest --pyargs distributed --verbose --color=no --timeout-method=signal --timeout=300 -m not avoid_ci -rsfE --ignore=../../../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_comms.py --ignore=../../../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_ws.py --ignore=../../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_adaptive.py --ignore=../../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py --ignore=../../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_slow_adaptive.py --ignore=../../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_spec_cluster.py --deselect=cli/tests/test_dask_scheduler.py::test_no_dashboard --deselect=deploy/tests/test_local.py::test_localcluster_get_client --deselect=deploy/tests/test_old_ssh.py::test_cluster --deselect=deploy/tests/test_old_ssh.py::test_old_ssh_nprocs_renamed_to_n_workers --deselect=deploy/tests/test_old_ssh.py::test_nprocs_attribute_is_deprecated --deselect=deploy/tests/test_ssh.py::test_nprocs_attribute_is_deprecated --deselect=http/tests/test_core.py::test_prometheus_api_doc --deselect=tests/test_init.py::test_git_revision --deselect=tests/test_jupyter.py::test_jupyter_idle_timeout --deselect=tests/test_jupyter.py::test_jupyter_idle_timeout_returned --deselect=tests/test_jupyter.py::test_jupyter_server --deselect=tests/test_jupyter.py::test_shutsdown_cleanly --deselect=tests/test_profile.py::test_stack_overflow --deselect=tests/test_pubsub.py::test_client_worker --deselect=tests/test_queues.py::test_queue_in_task --deselect=tests/test_spill.py::test_spillbuffer_oserror --deselect=tests/test_steal.py::test_steal_twice --deselect=tests/test_utils_test.py::test_cluster --deselect=tests/test_variable.py::test_variable_in_task --deselect=tests/test_worker.py::test_process_executor_kills_process --deselect=tests/test_worker_memory.py::test_fail_to_pickle_execute_1 --deselect=tests/test_worker_state_machine.py::test_task_state_instance_are_garbage_collected --deselect=protocol/tests/test_protocol.py::test_deeply_nested_structures --deselect=protocol/tests/test_serialize.py::test_deeply_nested_structures --deselect=deploy/tests/test_local.py::test_local_cluster_redundant_kwarg --deselect=deploy/tests/test_slow_adaptive.py::test_adaptive --deselect=tests/test_client.py::test_futures_in_subgraphs --deselect=tests/test_dask_collections.py::test_dataframe_groupby_tasks --deselect=tests/test_dask_collections.py::test_dataframes --deselect=tests/test_dask_collections.py::test_rolling_sync --deselect=tests/test_scheduler.py::test_balance_many_workers_2 --deselect=tests/test_scheduler.py::test_default_task_duration_splits --deselect=tests/test_steal.py::test_blocklist_shuffle_split --deselect=cli/tests/test_dask_scheduler.py::test_defaults --deselect=cli/tests/test_dask_scheduler.py::test_hostport --deselect=cli/tests/test_dask_spec.py::test_errors --deselect=cli/tests/test_dask_worker.py::test_scheduler_file --deselect=cli/tests/test_dask_worker.py::test_scheduler_file --deselect=cli/tests/test_dask_worker.py::test_scheduler_file --deselect=dashboard/tests/test_scheduler_bokeh.py::test_counters --deselect=dashboard/tests/test_worker_bokeh.py::test_counters --deselect=deploy/tests/test_local.py::test_adapt_then_manual --deselect=deploy/tests/test_local.py::test_async_with --deselect=deploy/tests/test_local.py::test_close_twice --deselect=deploy/tests/test_local.py::test_cluster_info_sync --deselect=deploy/tests/test_local.py::test_local_tls --deselect=deploy/tests/test_local.py::test_no_dangling_asyncio_tasks --deselect=deploy/tests/test_local.py::test_only_local_access --deselect=deploy/tests/test_local.py::test_remote_access --deselect=diagnostics/tests/test_progress_widgets.py::test_serializers --deselect=diagnostics/tests/test_scheduler_plugin.py::test_lifecycle --deselect=http/scheduler/tests/test_missing_bokeh.py::test_missing_bokeh --deselect=http/scheduler/tests/test_scheduler_http.py::test_metrics_when_prometheus_client_not_installed --deselect=protocol/tests/test_serialize.py::test_errors --deselect=tests/test_batched.py::test_BatchedSend --deselect=tests/test_batched.py::test_close_closed --deselect=tests/test_batched.py::test_close_twice --deselect=tests/test_batched.py::test_send_after_stream_start --deselect=tests/test_batched.py::test_send_before_close --deselect=tests/test_batched.py::test_send_before_start --deselect=tests/test_batched.py::test_sending_traffic_jam --deselect=tests/test_batched.py::test_serializers --deselect=tests/test_client.py::TestClientSecurityLoader::test_security_loader --deselect=tests/test_client.py::TestClientSecurityLoader::test_security_loader_ignored_if_explicit_security_provided --deselect=tests/test_client.py::TestClientSecurityLoader::test_security_loader_ignored_if_returns_none --deselect=tests/test_client.py::test_async_with --deselect=tests/test_client.py::test_client_is_quiet_cluster_close --deselect=tests/test_client.py::test_dashboard_link_cluster --deselect=tests/test_client.py::test_dashboard_link_inproc --deselect=tests/test_client.py::test_file_descriptors_dont_leak --deselect=tests/test_client.py::test_mixing_clients_different_scheduler --deselect=tests/test_client.py::test_quiet_client_close --deselect=tests/test_client.py::test_rebalance_sync --deselect=tests/test_client.py::test_repr_localcluster --deselect=tests/test_client.py::test_security_loader --deselect=tests/test_client.py::test_security_loader_ignored_if_explicit_security_provided --deselect=tests/test_client.py::test_security_loader_ignored_if_returns_none --deselect=tests/test_client.py::test_shutdown --deselect=tests/test_client.py::test_shutdown_is_quiet_with_cluster --deselect=tests/test_client.py::test_shutdown_localcluster --deselect=tests/test_client.py::test_shutdown_stops_callbacks --deselect=tests/test_client_loop.py::test_close_loop_sync_start_new_loop --deselect=tests/test_client_loop.py::test_close_loop_sync_use_running_loop --deselect=tests/test_core.py::test_close_fast_without_active_handlers --deselect=tests/test_core.py::test_close_grace_period_for_handlers --deselect=tests/test_core.py::test_close_properly --deselect=tests/test_core.py::test_compression --deselect=tests/test_core.py::test_connection_pool --deselect=tests/test_core.py::test_connection_pool_close_while_connecting --deselect=tests/test_core.py::test_connection_pool_detects_remote_close --deselect=tests/test_core.py::test_connection_pool_outside_cancellation --deselect=tests/test_core.py::test_connection_pool_remove --deselect=tests/test_core.py::test_connection_pool_respects_limit --deselect=tests/test_core.py::test_connection_pool_tls --deselect=tests/test_core.py::test_counters --deselect=tests/test_core.py::test_deserialize_error --deselect=tests/test_core.py::test_errors --deselect=tests/test_core.py::test_identity_inproc --deselect=tests/test_core.py::test_identity_tcp --deselect=tests/test_core.py::test_large_packets_inproc --deselect=tests/test_core.py::test_messages_are_ordered_bsend --deselect=tests/test_core.py::test_messages_are_ordered_raw --deselect=tests/test_core.py::test_ports --deselect=tests/test_core.py::test_rpc_default --deselect=tests/test_core.py::test_rpc_inproc --deselect=tests/test_core.py::test_rpc_message_lifetime_default --deselect=tests/test_core.py::test_rpc_message_lifetime_inproc --deselect=tests/test_core.py::test_rpc_message_lifetime_tcp --deselect=tests/test_core.py::test_rpc_serialization --deselect=tests/test_core.py::test_rpc_tcp --deselect=tests/test_core.py::test_rpc_tls --deselect=tests/test_core.py::test_rpc_with_many_connections_inproc --deselect=tests/test_core.py::test_rpc_with_many_connections_tcp --deselect=tests/test_core.py::test_send_recv_args --deselect=tests/test_core.py::test_send_recv_cancelled --deselect=tests/test_core.py::test_server --deselect=tests/test_core.py::test_server_comms_mark_active_handlers --deselect=tests/test_core.py::test_server_raises_on_blocked_handlers --deselect=tests/test_jupyter.py::test_jupyter_idle_timeout --deselect=tests/test_jupyter.py::test_jupyter_server --deselect=tests/test_locks.py::test_errors --deselect=tests/test_nanny.py::test_scheduler_file --deselect=tests/test_nanny.py::test_scheduler_file --deselect=tests/test_nanny.py::test_scheduler_file --deselect=tests/test_nanny.py::test_worker_uses_same_host_as_nanny --deselect=tests/test_preload.py::test_failure_doesnt_crash_scheduler --deselect=tests/test_preload.py::test_preload_import_time --deselect=tests/test_preload.py::test_preload_manager_sequence --deselect=tests/test_preload.py::test_worker_preload_text --deselect=tests/test_scheduler.py::test_allowed_failures_config --deselect=tests/test_scheduler.py::test_async_context_manager --deselect=tests/test_scheduler.py::test_dashboard_host --deselect=tests/test_scheduler.py::test_file_descriptors_dont_leak --deselect=tests/test_scheduler.py::test_finished --deselect=tests/test_scheduler.py::test_multiple_listeners --deselect=tests/test_scheduler.py::test_no_dangling_asyncio_tasks --deselect=tests/test_scheduler.py::test_scheduler_file --deselect=tests/test_scheduler.py::test_scheduler_file --deselect=tests/test_scheduler.py::test_scheduler_file --deselect=tests/test_security.py::test_require_encryption --deselect=tests/test_security.py::test_tls_listen_connect --deselect=tests/test_security.py::test_tls_temporary_credentials_functional --deselect=tests/test_semaphore.py::test_threadpoolworkers_pick_correct_ioloop --deselect=tests/test_tls_functional.py::test_security_dict_input_no_security --deselect=tests/test_utils_test.py::test_ensure_no_new_clients --deselect=tests/test_utils_test.py::test_freeze_batched_send --deselect=tests/test_utils_test.py::test_locked_comm_drop_in_replacement --deselect=tests/test_utils_test.py::test_locked_comm_intercept_read --deselect=tests/test_utils_test.py::test_locked_comm_intercept_write --deselect=tests/test_worker.py::test_host_uses_scheduler_protocol --deselect=tests/test_worker.py::test_plugin_exception --deselect=tests/test_worker.py::test_plugin_internal_exception --deselect=tests/test_worker.py::test_plugin_multiple_exceptions --deselect=tests/test_worker.py::test_scheduler_file --deselect=tests/test_worker.py::test_scheduler_file --deselect=tests/test_worker.py::test_scheduler_file --deselect=tests/test_worker_client.py::test_dont_override_default_get 876s ============================= test session starts ============================== 876s platform linux -- Python 3.13.0, pytest-8.3.3, pluggy-1.5.0 -- /usr/bin/python3.13 876s cachedir: .pytest_cache 876s rootdir: /tmp/autopkgtest.1vd31g/autopkgtest_tmp/build 876s configfile: pyproject.toml 876s plugins: typeguard-4.4.1, anyio-4.6.2, rerunfailures-14.0, timeout-2.3.1 876s timeout: 300.0s 876s timeout method: signal 876s timeout func_only: False 887s collecting ... collected 3349 items / 166 deselected / 30 skipped / 3183 selected 887s 887s cli/tests/test_dask_scheduler.py::test_dashboard <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py SKIPPED [ 0%] 887s cli/tests/test_dask_scheduler.py::test_dashboard_non_standard_ports <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py SKIPPED [ 0%] 888s cli/tests/test_dask_scheduler.py::test_multiple_protocols <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py PASSED [ 0%] 888s cli/tests/test_dask_scheduler.py::test_dashboard_allowlist <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py SKIPPED [ 0%] 892s cli/tests/test_dask_scheduler.py::test_interface <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py PASSED [ 0%] 897s cli/tests/test_dask_scheduler.py::test_pid_file <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py PASSED [ 0%] 899s cli/tests/test_dask_scheduler.py::test_scheduler_port_zero <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py PASSED [ 0%] 899s cli/tests/test_dask_scheduler.py::test_dashboard_port_zero <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py SKIPPED [ 0%] 901s cli/tests/test_dask_scheduler.py::test_preload_file <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py FAILED [ 0%] 903s cli/tests/test_dask_scheduler.py::test_preload_module <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py FAILED [ 0%] 905s cli/tests/test_dask_scheduler.py::test_preload_remote_module <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py FAILED [ 0%] 907s cli/tests/test_dask_scheduler.py::test_preload_config <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py FAILED [ 0%] 909s cli/tests/test_dask_scheduler.py::test_preload_command <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py FAILED [ 0%] 911s cli/tests/test_dask_scheduler.py::test_preload_command_default <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py FAILED [ 0%] 911s cli/tests/test_dask_scheduler.py::test_version_option <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py PASSED [ 0%] 911s cli/tests/test_dask_scheduler.py::test_idle_timeout <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py SKIPPED [ 0%] 911s cli/tests/test_dask_scheduler.py::test_restores_signal_handler <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py SKIPPED [ 0%] 915s cli/tests/test_dask_scheduler.py::test_multiple_workers_2 <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py FAILED [ 0%] 919s cli/tests/test_dask_scheduler.py::test_multiple_workers <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py PASSED [ 0%] 919s cli/tests/test_dask_scheduler.py::test_signal_handling[2] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py SKIPPED [ 0%] 919s cli/tests/test_dask_scheduler.py::test_signal_handling[15] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py SKIPPED [ 0%] 922s cli/tests/test_dask_scheduler.py::test_single_executable_deprecated <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py PASSED [ 0%] 924s cli/tests/test_dask_spec.py::test_text <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_spec.py PASSED [ 0%] 926s cli/tests/test_dask_spec.py::test_file <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_spec.py PASSED [ 0%] 929s cli/tests/test_dask_spec.py::test_signal_handling_worker[2-Nanny] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_spec.py PASSED [ 0%] 930s cli/tests/test_dask_spec.py::test_signal_handling_worker[2-Worker] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_spec.py PASSED [ 0%] 933s cli/tests/test_dask_spec.py::test_signal_handling_worker[15-Nanny] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_spec.py PASSED [ 0%] 935s cli/tests/test_dask_spec.py::test_signal_handling_worker[15-Worker] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_spec.py PASSED [ 0%] 937s cli/tests/test_dask_spec.py::test_signal_handling_scheduler[2] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_spec.py PASSED [ 0%] 938s cli/tests/test_dask_spec.py::test_signal_handling_scheduler[15] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_spec.py PASSED [ 0%] 938s cli/tests/test_dask_worker.py::test_apportion_ports[args0-expect0] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 0%] 938s cli/tests/test_dask_worker.py::test_apportion_ports[args1-expect1] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 938s cli/tests/test_dask_worker.py::test_apportion_ports[args2-expect2] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 938s cli/tests/test_dask_worker.py::test_apportion_ports[args3-expect3] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 938s cli/tests/test_dask_worker.py::test_apportion_ports[args4-expect4] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 938s cli/tests/test_dask_worker.py::test_apportion_ports[args5-expect5] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 938s cli/tests/test_dask_worker.py::test_apportion_ports[args6-expect6] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 938s cli/tests/test_dask_worker.py::test_apportion_ports[args7-expect7] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 938s cli/tests/test_dask_worker.py::test_apportion_ports[args8-expect8] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 938s cli/tests/test_dask_worker.py::test_apportion_ports[args9-expect9] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 938s cli/tests/test_dask_worker.py::test_apportion_ports[args10-expect10] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 938s cli/tests/test_dask_worker.py::test_apportion_ports[args11-expect11] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 938s cli/tests/test_dask_worker.py::test_apportion_ports[args12-expect12] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 938s cli/tests/test_dask_worker.py::test_apportion_ports[args13-expect13] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 938s cli/tests/test_dask_worker.py::test_apportion_ports[args14-expect14] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 938s cli/tests/test_dask_worker.py::test_apportion_ports[args15-expect15] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 938s cli/tests/test_dask_worker.py::test_apportion_ports[args16-expect16] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 938s cli/tests/test_dask_worker.py::test_apportion_ports[args17-expect17] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 938s cli/tests/test_dask_worker.py::test_apportion_ports_bad <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 938s cli/tests/test_dask_worker.py::test_nanny_worker_ports <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 1%] 938s cli/tests/test_dask_worker.py::test_nanny_worker_port_range <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 1%] 943s cli/tests/test_dask_worker.py::test_nanny_worker_port_range_too_many_workers_raises <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 943s cli/tests/test_dask_worker.py::test_memory_limit <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 1%] 945s cli/tests/test_dask_worker.py::test_no_nanny <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 945s cli/tests/test_dask_worker.py::test_resources <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 1%] 945s cli/tests/test_dask_worker.py::test_local_directory[--nanny] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 1%] 945s cli/tests/test_dask_worker.py::test_local_directory[--no-nanny] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 1%] 945s cli/tests/test_dask_worker.py::test_scheduler_address_env <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 1%] 945s cli/tests/test_dask_worker.py::test_nworkers_requires_nanny <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 945s cli/tests/test_dask_worker.py::test_nworkers_negative <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 1%] 945s cli/tests/test_dask_worker.py::test_nworkers_auto <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 1%] 945s cli/tests/test_dask_worker.py::test_nworkers_expands_name <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 1%] 945s cli/tests/test_dask_worker.py::test_contact_listen_address[tcp://0.0.0.0:---nanny] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 1%] 946s cli/tests/test_dask_worker.py::test_contact_listen_address[tcp://0.0.0.0:---no-nanny] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 2%] 946s cli/tests/test_dask_worker.py::test_contact_listen_address[tcp://127.0.0.2:---nanny] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 2%] 946s cli/tests/test_dask_worker.py::test_contact_listen_address[tcp://127.0.0.2:---no-nanny] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 2%] 946s cli/tests/test_dask_worker.py::test_listen_address_ipv6[tcp://:---nanny] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 2%] 946s cli/tests/test_dask_worker.py::test_listen_address_ipv6[tcp://:---no-nanny] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 2%] 946s cli/tests/test_dask_worker.py::test_listen_address_ipv6[tcp://[::1]:---nanny] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 2%] 946s cli/tests/test_dask_worker.py::test_listen_address_ipv6[tcp://[::1]:---no-nanny] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 2%] 946s cli/tests/test_dask_worker.py::test_respect_host_listen_address[127.0.0.2---nanny] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 2%] 946s cli/tests/test_dask_worker.py::test_respect_host_listen_address[127.0.0.2---no-nanny] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 2%] 946s cli/tests/test_dask_worker.py::test_respect_host_listen_address[0.0.0.0---nanny] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 2%] 946s cli/tests/test_dask_worker.py::test_respect_host_listen_address[0.0.0.0---no-nanny] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 2%] 946s cli/tests/test_dask_worker.py::test_dashboard_non_standard_ports <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 2%] 946s cli/tests/test_dask_worker.py::test_version_option <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 2%] 946s cli/tests/test_dask_worker.py::test_worker_timeout[True] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 2%] 946s cli/tests/test_dask_worker.py::test_worker_timeout[False] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 2%] 946s cli/tests/test_dask_worker.py::test_integer_names <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 2%] 946s cli/tests/test_dask_worker.py::test_worker_class[--nanny] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 2%] 946s cli/tests/test_dask_worker.py::test_worker_class[--no-nanny] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 2%] 946s cli/tests/test_dask_worker.py::test_preload_config <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 2%] 946s cli/tests/test_dask_worker.py::test_set_lifetime_stagger_via_env_var <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 2%] 946s cli/tests/test_dask_worker.py::test_set_lifetime_restart_via_env_var <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 2%] 946s cli/tests/test_dask_worker.py::test_timeout[--nanny] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 2%] 946s cli/tests/test_dask_worker.py::test_timeout[--no-nanny] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 2%] 949s cli/tests/test_dask_worker.py::test_signal_handling[2---nanny] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 2%] 951s cli/tests/test_dask_worker.py::test_signal_handling[2---no-nanny] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 2%] 954s cli/tests/test_dask_worker.py::test_signal_handling[15---nanny] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 2%] 956s cli/tests/test_dask_worker.py::test_signal_handling[15---no-nanny] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 2%] 963s cli/tests/test_dask_worker.py::test_error_during_startup[--nanny] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 2%] 970s cli/tests/test_dask_worker.py::test_error_during_startup[--no-nanny] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 2%] 975s cli/tests/test_dask_worker.py::test_single_executable_deprecated <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 2%] 975s cli/tests/test_dask_worker.py::test_single_executable_works <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 2%] 979s cli/tests/test_tls_cli.py::test_basic <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_tls_cli.py FAILED [ 2%] 983s cli/tests/test_tls_cli.py::test_sni <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_tls_cli.py FAILED [ 3%] 987s cli/tests/test_tls_cli.py::test_nanny <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_tls_cli.py FAILED [ 3%] 991s cli/tests/test_tls_cli.py::test_separate_key_cert <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_tls_cli.py FAILED [ 3%] 996s cli/tests/test_tls_cli.py::test_use_config_file <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_tls_cli.py FAILED [ 3%] 996s comm/tests/test_tcp.py::test_getaddrinfo_invalid_af <- ../../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_tcp.py PASSED [ 3%] 996s dashboard/tests/test_bokeh.py::test_old_import <- ../../../../usr/lib/python3/dist-packages/distributed/dashboard/tests/test_bokeh.py PASSED [ 3%] 996s deploy/tests/test_adaptive_core.py::test_safe_target <- ../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_adaptive_core.py PASSED [ 3%] 996s deploy/tests/test_adaptive_core.py::test_scale_up <- ../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_adaptive_core.py PASSED [ 3%] 996s deploy/tests/test_adaptive_core.py::test_scale_down <- ../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_adaptive_core.py PASSED [ 3%] 996s deploy/tests/test_adaptive_core.py::test_interval <- ../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_adaptive_core.py PASSED [ 3%] 996s deploy/tests/test_adaptive_core.py::test_adapt_oserror_safe_target <- ../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_adaptive_core.py PASSED [ 3%] 996s deploy/tests/test_adaptive_core.py::test_adapt_oserror_scale <- ../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_adaptive_core.py PASSED [ 3%] 996s deploy/tests/test_adaptive_core.py::test_adapt_stop_del <- ../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_adaptive_core.py PASSED [ 3%] 996s deploy/tests/test_cluster.py::test_eq <- ../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_cluster.py PASSED [ 3%] 996s deploy/tests/test_cluster.py::test_repr <- ../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_cluster.py PASSED [ 3%] 1000s deploy/tests/test_cluster.py::test_cluster_wait_for_worker <- ../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_cluster.py PASSED [ 3%] 1000s deploy/tests/test_cluster.py::test_deprecated_loop_properties <- ../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_cluster.py PASSED [ 3%] 1000s deploy/tests/test_cluster.py::test_exponential_backoff <- ../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_cluster.py PASSED [ 3%] 1000s deploy/tests/test_cluster.py::test_sync_context_manager_used_with_async_cluster <- ../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_cluster.py PASSED [ 3%] 1000s deploy/tests/test_deploy_utils.py::test_default_process_thread_breakdown <- ../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_deploy_utils.py PASSED [ 3%] 1003s deploy/tests/test_subprocess.py::test_basic <- ../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_subprocess.py FAILED [ 3%] 1006s deploy/tests/test_subprocess.py::test_n_workers <- ../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_subprocess.py FAILED [ 3%] 1010s deploy/tests/test_subprocess.py::test_scale_up_and_down <- ../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_subprocess.py PASSED [ 3%] 1015s deploy/tests/test_subprocess.py::test_raise_if_scheduler_fails_to_start <- ../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_subprocess.py PASSED [ 3%] 1015s deploy/tests/test_subprocess.py::test_subprocess_cluster_does_not_depend_on_logging <- ../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_subprocess.py SKIPPED [ 3%] 1015s deploy/tests/test_subprocess.py::test_raise_on_windows <- ../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_subprocess.py SKIPPED [ 3%] 1017s diagnostics/tests/test_cluster_dump_plugin.py::test_cluster_dump_plugin <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_cluster_dump_plugin.py PASSED [ 3%] 1017s diagnostics/tests/test_eventstream.py::test_eventstream <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_eventstream.py SKIPPED [ 3%] 1017s diagnostics/tests/test_eventstream.py::test_eventstream_remote <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_eventstream.py PASSED [ 3%] 1018s diagnostics/tests/test_graph_layout.py::test_basic <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_graph_layout.py PASSED [ 3%] 1018s diagnostics/tests/test_graph_layout.py::test_construct_after_call <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_graph_layout.py PASSED [ 3%] 1018s diagnostics/tests/test_graph_layout.py::test_states <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_graph_layout.py PASSED [ 3%] 1018s diagnostics/tests/test_graph_layout.py::test_release_tasks <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_graph_layout.py PASSED [ 4%] 1018s diagnostics/tests/test_graph_layout.py::test_forget <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_graph_layout.py PASSED [ 4%] 1018s diagnostics/tests/test_graph_layout.py::test_unique_positions <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_graph_layout.py PASSED [ 4%] 1018s diagnostics/tests/test_graph_layout.py::test_layout_scatter <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_graph_layout.py PASSED [ 4%] 1019s diagnostics/tests/test_install_plugin.py::test_pip_install <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_install_plugin.py PASSED [ 4%] 1019s diagnostics/tests/test_install_plugin.py::test_conda_install <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_install_plugin.py PASSED [ 4%] 1019s diagnostics/tests/test_install_plugin.py::test_pip_install_fails <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_install_plugin.py PASSED [ 4%] 1019s diagnostics/tests/test_install_plugin.py::test_conda_install_fails_when_conda_not_found <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_install_plugin.py PASSED [ 4%] 1019s diagnostics/tests/test_install_plugin.py::test_conda_install_fails_when_conda_raises <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_install_plugin.py PASSED [ 4%] 1019s diagnostics/tests/test_install_plugin.py::test_conda_install_fails_on_returncode <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_install_plugin.py PASSED [ 4%] 1019s diagnostics/tests/test_install_plugin.py::test_package_install_restarts_on_nanny <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_install_plugin.py SKIPPED [ 4%] 1021s diagnostics/tests/test_install_plugin.py::test_package_install_failing_does_not_restart_on_nanny <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_install_plugin.py PASSED [ 4%] 1022s diagnostics/tests/test_memory_sampler.py::test_async <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_memory_sampler.py PASSED [ 4%] 1024s diagnostics/tests/test_memory_sampler.py::test_sync <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_memory_sampler.py PASSED [ 4%] 1024s diagnostics/tests/test_memory_sampler.py::test_at_least_one_sample <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_memory_sampler.py PASSED [ 4%] 1024s diagnostics/tests/test_memory_sampler.py::test_multi_sample <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_memory_sampler.py SKIPPED [ 4%] 1025s diagnostics/tests/test_memory_sampler.py::test_pandas[False] <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_memory_sampler.py SKIPPED [ 4%] 1025s diagnostics/tests/test_memory_sampler.py::test_pandas[True] <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_memory_sampler.py SKIPPED [ 4%] 1025s diagnostics/tests/test_memory_sampler.py::test_pandas_multiseries[False] <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_memory_sampler.py SKIPPED [ 4%] 1025s diagnostics/tests/test_memory_sampler.py::test_pandas_multiseries[True] <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_memory_sampler.py SKIPPED [ 4%] 1027s diagnostics/tests/test_nanny_plugin.py::test_register_worker_plugin_is_deprecated <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_nanny_plugin.py PASSED [ 4%] 1029s diagnostics/tests/test_nanny_plugin.py::test_register_worker_plugin_typing_over_nanny_keyword <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_nanny_plugin.py PASSED [ 4%] 1031s diagnostics/tests/test_nanny_plugin.py::test_duck_typed_register_nanny_plugin_is_deprecated <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_nanny_plugin.py PASSED [ 4%] 1033s diagnostics/tests/test_nanny_plugin.py::test_register_idempotent_plugin <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_nanny_plugin.py PASSED [ 4%] 1035s diagnostics/tests/test_nanny_plugin.py::test_register_non_idempotent_plugin <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_nanny_plugin.py PASSED [ 4%] 1037s diagnostics/tests/test_nanny_plugin.py::test_register_plugin_with_idempotent_keyword_is_deprecated <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_nanny_plugin.py PASSED [ 4%] 1037s diagnostics/tests/test_progress.py::test_many_Progress <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_progress.py PASSED [ 4%] 1037s diagnostics/tests/test_progress.py::test_multiprogress <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_progress.py PASSED [ 4%] 1037s diagnostics/tests/test_progress.py::test_multiprogress_cancel <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_progress.py PASSED [ 4%] 1037s diagnostics/tests/test_progress.py::test_multiprogress_with_spans <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_progress.py PASSED [ 4%] 1038s diagnostics/tests/test_progress.py::test_multiprogress_with_prefix <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_progress.py PASSED [ 4%] 1038s diagnostics/tests/test_progress.py::test_multiprogress_warns <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_progress.py PASSED [ 4%] 1038s diagnostics/tests/test_progress.py::test_robust_to_bad_plugin <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_progress.py PASSED [ 5%] 1044s diagnostics/tests/test_progress.py::test_AllProgress <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_progress.py PASSED [ 5%] 1046s diagnostics/tests/test_progress.py::test_AllProgress_lost_key <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_progress.py PASSED [ 5%] 1053s diagnostics/tests/test_progress.py::test_group_timing <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_progress.py PASSED [ 5%] 1055s diagnostics/tests/test_progressbar.py::test_text_progressbar <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_progressbar.py PASSED [ 5%] 1055s diagnostics/tests/test_progressbar.py::test_TextProgressBar_error <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_progressbar.py PASSED [ 5%] 1055s diagnostics/tests/test_progressbar.py::test_TextProgressBar_empty <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_progressbar.py PASSED [ 5%] 1058s diagnostics/tests/test_progressbar.py::test_progress_function <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_progressbar.py PASSED [ 5%] 1060s diagnostics/tests/test_progressbar.py::test_progress_function_w_kwargs <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_progressbar.py PASSED [ 5%] 1062s diagnostics/tests/test_progressbar.py::test_progress_function_warns <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_progressbar.py PASSED [ 5%] 1062s diagnostics/tests/test_progressbar.py::test_progress_function_raises <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_progressbar.py PASSED [ 5%] 1062s diagnostics/tests/test_progressbar.py::test_deprecated_loop_properties <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_progressbar.py PASSED [ 5%] 1062s diagnostics/tests/test_scheduler_plugin.py::test_simple <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_scheduler_plugin.py PASSED [ 5%] 1063s diagnostics/tests/test_scheduler_plugin.py::test_add_remove_worker <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_scheduler_plugin.py PASSED [ 5%] 1063s diagnostics/tests/test_scheduler_plugin.py::test_remove_worker_renamed_kwargs_allowed <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_scheduler_plugin.py PASSED [ 5%] 1063s diagnostics/tests/test_scheduler_plugin.py::test_remove_worker_without_kwargs_deprecated <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_scheduler_plugin.py PASSED [ 5%] 1063s diagnostics/tests/test_scheduler_plugin.py::test_async_add_remove_worker <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_scheduler_plugin.py PASSED [ 5%] 1063s diagnostics/tests/test_scheduler_plugin.py::test_async_and_sync_add_remove_worker <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_scheduler_plugin.py PASSED [ 5%] 1063s diagnostics/tests/test_scheduler_plugin.py::test_failing_async_add_remove_worker <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_scheduler_plugin.py PASSED [ 5%] 1063s diagnostics/tests/test_scheduler_plugin.py::test_failing_sync_add_remove_worker <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_scheduler_plugin.py PASSED [ 5%] 1063s diagnostics/tests/test_scheduler_plugin.py::test_register_plugin <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_scheduler_plugin.py PASSED [ 5%] 1063s diagnostics/tests/test_scheduler_plugin.py::test_register_scheduler_plugin_deprecated <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_scheduler_plugin.py PASSED [ 5%] 1063s diagnostics/tests/test_scheduler_plugin.py::test_unregister_scheduler_plugin <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_scheduler_plugin.py PASSED [ 5%] 1063s diagnostics/tests/test_scheduler_plugin.py::test_unregister_scheduler_plugin_from_client <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_scheduler_plugin.py PASSED [ 5%] 1063s diagnostics/tests/test_scheduler_plugin.py::test_log_event_plugin <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_scheduler_plugin.py PASSED [ 5%] 1063s diagnostics/tests/test_scheduler_plugin.py::test_register_plugin_on_scheduler <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_scheduler_plugin.py PASSED [ 5%] 1066s diagnostics/tests/test_scheduler_plugin.py::test_closing_errors_ok <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_scheduler_plugin.py PASSED [ 5%] 1066s diagnostics/tests/test_scheduler_plugin.py::test_update_graph_hook_simple <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_scheduler_plugin.py PASSED [ 5%] 1066s diagnostics/tests/test_scheduler_plugin.py::test_update_graph_hook_complex <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_scheduler_plugin.py PASSED [ 5%] 1066s diagnostics/tests/test_scheduler_plugin.py::test_scheduler_plugin_in_register_worker_plugin_overrides <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_scheduler_plugin.py PASSED [ 5%] 1068s diagnostics/tests/test_scheduler_plugin.py::test_scheduler_plugin_in_register_worker_plugin_overrides_nanny <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_scheduler_plugin.py PASSED [ 5%] 1068s diagnostics/tests/test_scheduler_plugin.py::test_register_idempotent_plugin <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_scheduler_plugin.py PASSED [ 6%] 1068s diagnostics/tests/test_scheduler_plugin.py::test_register_non_idempotent_plugin <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_scheduler_plugin.py PASSED [ 6%] 1068s diagnostics/tests/test_scheduler_plugin.py::test_register_plugin_with_idempotent_keyword_is_deprecated <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_scheduler_plugin.py PASSED [ 6%] 1068s diagnostics/tests/test_scheduler_plugin.py::test_register_idempotent_plugins_directly <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_scheduler_plugin.py PASSED [ 6%] 1068s diagnostics/tests/test_scheduler_plugin.py::test_register_non_idempotent_plugins_directly <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_scheduler_plugin.py PASSED [ 6%] 1069s diagnostics/tests/test_task_stream.py::test_TaskStreamPlugin <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_task_stream.py PASSED [ 6%] 1069s diagnostics/tests/test_task_stream.py::test_maxlen <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_task_stream.py PASSED [ 6%] 1069s diagnostics/tests/test_task_stream.py::test_collect <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_task_stream.py PASSED [ 6%] 1069s diagnostics/tests/test_task_stream.py::test_no_startstops <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_task_stream.py PASSED [ 6%] 1070s diagnostics/tests/test_task_stream.py::test_client <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_task_stream.py PASSED [ 6%] 1072s diagnostics/tests/test_task_stream.py::test_client_sync <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_task_stream.py PASSED [ 6%] 1072s diagnostics/tests/test_task_stream.py::test_get_task_stream_plot <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_task_stream.py SKIPPED [ 6%] 1075s diagnostics/tests/test_task_stream.py::test_get_task_stream_save <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_task_stream.py SKIPPED [ 6%] 1075s diagnostics/tests/test_worker_plugin.py::test_create_with_client <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_worker_plugin.py PASSED [ 6%] 1075s diagnostics/tests/test_worker_plugin.py::test_remove_with_client <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_worker_plugin.py PASSED [ 6%] 1075s diagnostics/tests/test_worker_plugin.py::test_remove_with_client_raises <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_worker_plugin.py PASSED [ 6%] 1075s diagnostics/tests/test_worker_plugin.py::test_create_on_construction <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_worker_plugin.py PASSED [ 6%] 1075s diagnostics/tests/test_worker_plugin.py::test_normal_task_transitions_called <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_worker_plugin.py PASSED [ 6%] 1075s diagnostics/tests/test_worker_plugin.py::test_failing_task_transitions_called <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_worker_plugin.py PASSED [ 6%] 1075s diagnostics/tests/test_worker_plugin.py::test_superseding_task_transitions_called <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_worker_plugin.py PASSED [ 6%] 1075s diagnostics/tests/test_worker_plugin.py::test_dependent_tasks <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_worker_plugin.py PASSED [ 6%] 1075s diagnostics/tests/test_worker_plugin.py::test_empty_plugin <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_worker_plugin.py PASSED [ 6%] 1076s diagnostics/tests/test_worker_plugin.py::test_default_name <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_worker_plugin.py PASSED [ 6%] 1076s diagnostics/tests/test_worker_plugin.py::test_assert_no_warning_no_overload <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_worker_plugin.py PASSED [ 6%] 1076s diagnostics/tests/test_worker_plugin.py::test_WorkerPlugin_overwrite <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_worker_plugin.py PASSED [ 6%] 1076s diagnostics/tests/test_worker_plugin.py::test_register_worker_plugin_is_deprecated <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_worker_plugin.py PASSED [ 6%] 1076s diagnostics/tests/test_worker_plugin.py::test_register_worker_plugin_typing_over_nanny_keyword <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_worker_plugin.py PASSED [ 6%] 1076s diagnostics/tests/test_worker_plugin.py::test_duck_typed_register_worker_plugin_is_deprecated <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_worker_plugin.py PASSED [ 6%] 1076s diagnostics/tests/test_worker_plugin.py::test_register_idempotent_plugin <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_worker_plugin.py PASSED [ 6%] 1076s diagnostics/tests/test_worker_plugin.py::test_register_non_idempotent_plugin <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_worker_plugin.py PASSED [ 6%] 1076s diagnostics/tests/test_worker_plugin.py::test_register_plugin_with_idempotent_keyword_is_deprecated <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_worker_plugin.py PASSED [ 6%] 1076s http/scheduler/tests/test_missing_bokeh.py::test_bokeh_version_too_low <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_missing_bokeh.py SKIPPED [ 6%] 1076s http/scheduler/tests/test_missing_bokeh.py::test_bokeh_version_too_high <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_missing_bokeh.py SKIPPED [ 7%] 1077s http/scheduler/tests/test_scheduler_http.py::test_connect <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 7%] 1077s http/scheduler/tests/test_scheduler_http.py::test_worker_404 <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 7%] 1077s http/scheduler/tests/test_scheduler_http.py::test_prefix <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py SKIPPED [ 7%] 1077s http/scheduler/tests/test_scheduler_http.py::test_prometheus <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 7%] 1077s http/scheduler/tests/test_scheduler_http.py::test_prometheus_collect_task_states <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 7%] 1078s http/scheduler/tests/test_scheduler_http.py::test_prometheus_collect_task_prefix_counts <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 7%] 1078s http/scheduler/tests/test_scheduler_http.py::test_prometheus_collect_worker_states <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 7%] 1078s http/scheduler/tests/test_scheduler_http.py::test_health <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py SKIPPED [ 7%] 1078s http/scheduler/tests/test_scheduler_http.py::test_sitemap <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 7%] 1078s http/scheduler/tests/test_scheduler_http.py::test_task_page[1_0] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 7%] 1079s http/scheduler/tests/test_scheduler_http.py::test_task_page[1_1] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 7%] 1079s http/scheduler/tests/test_scheduler_http.py::test_task_page[x] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 7%] 1079s http/scheduler/tests/test_scheduler_http.py::test_task_page[a+b] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 7%] 1079s http/scheduler/tests/test_scheduler_http.py::test_task_page[a b] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 7%] 1079s http/scheduler/tests/test_scheduler_http.py::test_task_page[key5] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 7%] 1079s http/scheduler/tests/test_scheduler_http.py::test_task_page[key6] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 7%] 1079s http/scheduler/tests/test_scheduler_http.py::test_task_page[key7] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 7%] 1079s http/scheduler/tests/test_scheduler_http.py::test_task_page[key8] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 7%] 1080s http/scheduler/tests/test_scheduler_http.py::test_task_page[(] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 7%] 1080s http/scheduler/tests/test_scheduler_http.py::test_task_page[[] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 7%] 1080s http/scheduler/tests/test_scheduler_http.py::test_task_page['] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 7%] 1080s http/scheduler/tests/test_scheduler_http.py::test_task_page["] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 7%] 1080s http/scheduler/tests/test_scheduler_http.py::test_task_page[123] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 7%] 1080s http/scheduler/tests/test_scheduler_http.py::test_task_page[key14] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 7%] 1080s http/scheduler/tests/test_scheduler_http.py::test_task_page[key15] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 7%] 1080s http/scheduler/tests/test_scheduler_http.py::test_task_page[key16] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 7%] 1081s http/scheduler/tests/test_scheduler_http.py::test_task_page[key17] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 7%] 1081s http/scheduler/tests/test_scheduler_http.py::test_task_page[key18] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 7%] 1081s http/scheduler/tests/test_scheduler_http.py::test_call_stack_page[1_0] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 7%] 1081s http/scheduler/tests/test_scheduler_http.py::test_call_stack_page[1_1] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 7%] 1081s http/scheduler/tests/test_scheduler_http.py::test_call_stack_page[x] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 7%] 1081s http/scheduler/tests/test_scheduler_http.py::test_call_stack_page[a+b] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 8%] 1081s http/scheduler/tests/test_scheduler_http.py::test_call_stack_page[a b] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 8%] 1082s http/scheduler/tests/test_scheduler_http.py::test_call_stack_page[key5] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 8%] 1082s http/scheduler/tests/test_scheduler_http.py::test_call_stack_page[key6] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 8%] 1082s http/scheduler/tests/test_scheduler_http.py::test_call_stack_page[key7] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 8%] 1082s http/scheduler/tests/test_scheduler_http.py::test_call_stack_page[key8] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 8%] 1082s http/scheduler/tests/test_scheduler_http.py::test_call_stack_page[(] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 8%] 1082s http/scheduler/tests/test_scheduler_http.py::test_call_stack_page[[] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 8%] 1083s http/scheduler/tests/test_scheduler_http.py::test_call_stack_page['] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 8%] 1083s http/scheduler/tests/test_scheduler_http.py::test_call_stack_page["] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 8%] 1083s http/scheduler/tests/test_scheduler_http.py::test_call_stack_page[123] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 8%] 1083s http/scheduler/tests/test_scheduler_http.py::test_call_stack_page[key14] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 8%] 1083s http/scheduler/tests/test_scheduler_http.py::test_call_stack_page[key15] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 8%] 1083s http/scheduler/tests/test_scheduler_http.py::test_call_stack_page[key16] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 8%] 1084s http/scheduler/tests/test_scheduler_http.py::test_call_stack_page[key17] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 8%] 1084s http/scheduler/tests/test_scheduler_http.py::test_call_stack_page[key18] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 8%] 1084s http/scheduler/tests/test_scheduler_http.py::test_allow_websocket_origin <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py SKIPPED [ 8%] 1084s http/scheduler/tests/test_scheduler_http.py::test_eventstream <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 8%] 1084s http/scheduler/tests/test_scheduler_http.py::test_api_disabled_by_default <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 8%] 1084s http/scheduler/tests/test_scheduler_http.py::test_api <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py SKIPPED [ 8%] 1084s http/scheduler/tests/test_scheduler_http.py::test_retire_workers <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py SKIPPED [ 8%] 1084s http/scheduler/tests/test_scheduler_http.py::test_get_workers <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py SKIPPED [ 8%] 1084s http/scheduler/tests/test_scheduler_http.py::test_adaptive_target <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py SKIPPED [ 8%] 1084s http/scheduler/tests/test_scheduler_http.py::test_check_idle <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py SKIPPED [ 8%] 1085s http/scheduler/tests/test_semaphore_http.py::test_prometheus <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_semaphore_http.py PASSED [ 8%] 1085s http/scheduler/tests/test_semaphore_http.py::test_prometheus_without_semaphore_extension <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_semaphore_http.py PASSED [ 8%] 1085s http/scheduler/tests/test_stealing_http.py::test_prometheus <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_stealing_http.py PASSED [ 8%] 1085s http/scheduler/tests/test_stealing_http.py::test_prometheus_collect_count_total_by_cost_multipliers <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_stealing_http.py PASSED [ 8%] 1086s http/scheduler/tests/test_stealing_http.py::test_prometheus_collect_cost_total_by_cost_multipliers <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_stealing_http.py PASSED [ 8%] 1086s http/scheduler/tests/test_stealing_http.py::test_prometheus_without_stealing_extension <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_stealing_http.py PASSED [ 8%] 1086s http/tests/test_core.py::test_scheduler <- ../../../../usr/lib/python3/dist-packages/distributed/http/tests/test_core.py PASSED [ 8%] 1086s http/tests/test_routing.py::test_basic <- ../../../../usr/lib/python3/dist-packages/distributed/http/tests/test_routing.py PASSED [ 8%] 1086s http/worker/tests/test_worker_http.py::test_prometheus <- ../../../../usr/lib/python3/dist-packages/distributed/http/worker/tests/test_worker_http.py PASSED [ 9%] 1087s http/worker/tests/test_worker_http.py::test_metrics_when_prometheus_client_not_installed <- ../../../../usr/lib/python3/dist-packages/distributed/http/worker/tests/test_worker_http.py PASSED [ 9%] 1087s http/worker/tests/test_worker_http.py::test_prometheus_collect_task_states <- ../../../../usr/lib/python3/dist-packages/distributed/http/worker/tests/test_worker_http.py PASSED [ 9%] 1087s http/worker/tests/test_worker_http.py::test_health <- ../../../../usr/lib/python3/dist-packages/distributed/http/worker/tests/test_worker_http.py SKIPPED [ 9%] 1087s http/worker/tests/test_worker_http.py::test_sitemap <- ../../../../usr/lib/python3/dist-packages/distributed/http/worker/tests/test_worker_http.py SKIPPED [ 9%] 1087s http/worker/tests/test_worker_http.py::test_prometheus_collect_memory_metrics <- ../../../../usr/lib/python3/dist-packages/distributed/http/worker/tests/test_worker_http.py PASSED [ 9%] 1087s http/worker/tests/test_worker_http.py::test_prometheus_collect_memory_metrics_spill_disabled <- ../../../../usr/lib/python3/dist-packages/distributed/http/worker/tests/test_worker_http.py PASSED [ 9%] 1087s http/worker/tests/test_worker_http.py::test_prometheus_collect_memory_metrics_bogus_sizeof <- ../../../../usr/lib/python3/dist-packages/distributed/http/worker/tests/test_worker_http.py SKIPPED [ 9%] 1087s protocol/tests/test_collection.py::test_serialize_collection[y0-dask-tuple] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_collection.py PASSED [ 9%] 1087s protocol/tests/test_collection.py::test_serialize_collection[y0-dask-dict] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_collection.py PASSED [ 9%] 1087s protocol/tests/test_collection.py::test_serialize_collection[y0-dask-list] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_collection.py PASSED [ 9%] 1087s protocol/tests/test_collection.py::test_serialize_collection[y1-pickle-tuple] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_collection.py PASSED [ 9%] 1087s protocol/tests/test_collection.py::test_serialize_collection[y1-pickle-dict] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_collection.py PASSED [ 9%] 1087s protocol/tests/test_collection.py::test_serialize_collection[y1-pickle-list] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_collection.py PASSED [ 9%] 1087s protocol/tests/test_collection.py::test_serialize_collection[None-pickle-tuple] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_collection.py PASSED [ 9%] 1087s protocol/tests/test_collection.py::test_serialize_collection[None-pickle-dict] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_collection.py PASSED [ 9%] 1087s protocol/tests/test_collection.py::test_serialize_collection[None-pickle-list] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_collection.py PASSED [ 9%] 1087s protocol/tests/test_collection.py::test_large_collections_serialize_simply <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_collection.py PASSED [ 9%] 1087s protocol/tests/test_collection.py::test_nested_types <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_collection.py PASSED [ 9%] 1087s protocol/tests/test_collection_cuda.py::test_serialize_cupy[50-cuda-tuple] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_collection_cuda.py SKIPPED [ 9%] 1087s protocol/tests/test_collection_cuda.py::test_serialize_cupy[50-cuda-dict] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_collection_cuda.py SKIPPED [ 9%] 1087s protocol/tests/test_collection_cuda.py::test_serialize_cupy[None-pickle-tuple] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_collection_cuda.py SKIPPED [ 9%] 1087s protocol/tests/test_collection_cuda.py::test_serialize_cupy[None-pickle-dict] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_collection_cuda.py SKIPPED [ 9%] 1087s protocol/tests/test_collection_cuda.py::test_serialize_pandas_pandas[df20-cuda-tuple] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_collection_cuda.py SKIPPED [ 9%] 1087s protocol/tests/test_collection_cuda.py::test_serialize_pandas_pandas[df20-cuda-dict] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_collection_cuda.py SKIPPED [ 9%] 1087s protocol/tests/test_collection_cuda.py::test_serialize_pandas_pandas[None-pickle-tuple] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_collection_cuda.py SKIPPED [ 9%] 1087s protocol/tests/test_collection_cuda.py::test_serialize_pandas_pandas[None-pickle-dict] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_collection_cuda.py SKIPPED [ 9%] 1087s protocol/tests/test_compression.py::test_get_compression_settings <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py PASSED [ 9%] 1087s protocol/tests/test_compression.py::test_auto_compression <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py PASSED [ 9%] 1087s protocol/tests/test_compression.py::test_compression_1 <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py PASSED [ 9%] 1087s protocol/tests/test_compression.py::test_compression_2 <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py PASSED [ 9%] 1087s protocol/tests/test_compression.py::test_compression_3 <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py PASSED [ 9%] 1088s protocol/tests/test_compression.py::test_compression_without_deserialization <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py PASSED [ 10%] 1088s protocol/tests/test_compression.py::test_lz4_decompression_avoids_deep_copy <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py SKIPPED [ 10%] 1088s protocol/tests/test_compression.py::test_maybe_compress[None-bytes] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py PASSED [ 10%] 1088s protocol/tests/test_compression.py::test_maybe_compress[None-memoryview] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py PASSED [ 10%] 1088s protocol/tests/test_compression.py::test_maybe_compress[zlib-bytes] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py PASSED [ 10%] 1088s protocol/tests/test_compression.py::test_maybe_compress[zlib-memoryview] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py PASSED [ 10%] 1088s protocol/tests/test_compression.py::test_maybe_compress[lz4-bytes] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py SKIPPED [ 10%] 1088s protocol/tests/test_compression.py::test_maybe_compress[lz4-memoryview] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py SKIPPED [ 10%] 1088s protocol/tests/test_compression.py::test_maybe_compress[snappy-bytes] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py SKIPPED [ 10%] 1088s protocol/tests/test_compression.py::test_maybe_compress[snappy-memoryview] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py SKIPPED [ 10%] 1088s protocol/tests/test_compression.py::test_maybe_compress[zstd-bytes] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py SKIPPED [ 10%] 1088s protocol/tests/test_compression.py::test_maybe_compress[zstd-memoryview] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py SKIPPED [ 10%] 1088s protocol/tests/test_compression.py::test_maybe_compress_sample[None] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py PASSED [ 10%] 1088s protocol/tests/test_compression.py::test_maybe_compress_sample[zlib] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py PASSED [ 10%] 1088s protocol/tests/test_compression.py::test_maybe_compress_sample[lz4] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py SKIPPED [ 10%] 1088s protocol/tests/test_compression.py::test_maybe_compress_sample[snappy] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py SKIPPED [ 10%] 1088s protocol/tests/test_compression.py::test_maybe_compress_sample[zstd] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py SKIPPED [ 10%] 1088s protocol/tests/test_compression.py::test_maybe_compress_memoryviews[None] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py PASSED [ 10%] 1088s protocol/tests/test_compression.py::test_maybe_compress_memoryviews[zlib] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py PASSED [ 10%] 1088s protocol/tests/test_compression.py::test_maybe_compress_memoryviews[lz4] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py SKIPPED [ 10%] 1088s protocol/tests/test_compression.py::test_maybe_compress_memoryviews[snappy] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py SKIPPED [ 10%] 1088s protocol/tests/test_compression.py::test_maybe_compress_memoryviews[zstd] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py SKIPPED [ 10%] 1088s protocol/tests/test_compression.py::test_maybe_compress_auto <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py PASSED [ 10%] 1088s protocol/tests/test_compression.py::test_compression_thread_safety[None-bytes] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py SKIPPED [ 10%] 1088s protocol/tests/test_compression.py::test_compression_thread_safety[None-memoryview] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py SKIPPED [ 10%] 1088s protocol/tests/test_compression.py::test_compression_thread_safety[zlib-bytes] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py SKIPPED [ 10%] 1088s protocol/tests/test_compression.py::test_compression_thread_safety[zlib-memoryview] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py SKIPPED [ 10%] 1088s protocol/tests/test_compression.py::test_compression_thread_safety[lz4-bytes] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py SKIPPED [ 10%] 1088s protocol/tests/test_compression.py::test_compression_thread_safety[lz4-memoryview] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py SKIPPED [ 10%] 1088s protocol/tests/test_compression.py::test_compression_thread_safety[snappy-bytes] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py SKIPPED [ 10%] 1088s protocol/tests/test_compression.py::test_compression_thread_safety[snappy-memoryview] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py SKIPPED [ 10%] 1088s protocol/tests/test_compression.py::test_compression_thread_safety[zstd-bytes] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py SKIPPED [ 10%] 1088s protocol/tests/test_compression.py::test_compression_thread_safety[zstd-memoryview] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py SKIPPED [ 11%] 1088s protocol/tests/test_compression.py::test_large_messages[None] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py SKIPPED [ 11%] 1088s protocol/tests/test_compression.py::test_large_messages[zlib] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py SKIPPED [ 11%] 1088s protocol/tests/test_compression.py::test_large_messages[lz4] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py SKIPPED [ 11%] 1088s protocol/tests/test_compression.py::test_large_messages[snappy] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py SKIPPED [ 11%] 1088s protocol/tests/test_compression.py::test_large_messages[zstd] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py SKIPPED [ 11%] 1088s protocol/tests/test_compression.py::test_loads_without_deserialization_avoids_compression <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py PASSED [ 11%] 1088s protocol/tests/test_compression.py::test_compress_remote_comms <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py PASSED [ 11%] 1089s protocol/tests/test_compression.py::test_disable_compression_on_localhost[None] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py PASSED [ 11%] 1089s protocol/tests/test_compression.py::test_disable_compression_on_localhost[127.0.0.1] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py PASSED [ 11%] 1089s protocol/tests/test_compression.py::test_disable_compression_on_localhost[localhost] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py PASSED [ 11%] 1090s protocol/tests/test_highlevelgraph.py::test_combo_of_layer_types <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_highlevelgraph.py PASSED [ 11%] 1090s protocol/tests/test_highlevelgraph.py::test_blockwise <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_highlevelgraph.py PASSED [ 11%] 1091s protocol/tests/test_highlevelgraph.py::test_shuffle <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_highlevelgraph.py PASSED [ 11%] 1091s protocol/tests/test_highlevelgraph.py::test_array_annotations <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_highlevelgraph.py PASSED [ 11%] 1092s protocol/tests/test_highlevelgraph.py::test_dataframe_annotations <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_highlevelgraph.py PASSED [ 11%] 1092s protocol/tests/test_numpy.py::test_serialize <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 11%] 1092s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x0] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 11%] 1092s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x1] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 11%] 1092s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x2] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 11%] 1092s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x3] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 11%] 1092s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x4] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 11%] 1092s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x5] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 11%] 1092s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x6] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 11%] 1092s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x7] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 11%] 1092s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x8] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 11%] 1092s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x9] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 11%] 1092s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x10] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 11%] 1092s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x11] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 11%] 1092s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x12] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 11%] 1092s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x13] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 11%] 1092s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x14] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 12%] 1092s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x15] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 12%] 1092s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x16] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 12%] 1092s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x17] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 12%] 1092s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x18] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 12%] 1092s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x19] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 12%] 1092s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x20] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 12%] 1092s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x21] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 12%] 1092s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x22] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 12%] 1092s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x23] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 12%] 1092s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x24] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 12%] 1092s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x25] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 12%] 1092s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x26] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 12%] 1092s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x27] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 12%] 1092s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x28] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 12%] 1092s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x29] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 12%] 1092s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x30] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 12%] 1092s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x31] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 12%] 1092s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x32] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 12%] 1092s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x33] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 12%] 1092s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x34] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 12%] 1092s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x35] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 12%] 1092s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x36] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 12%] 1092s protocol/tests/test_numpy.py::test_dumps_numpy_writable[True] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 12%] 1092s protocol/tests/test_numpy.py::test_dumps_numpy_writable[False] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 12%] 1092s protocol/tests/test_numpy.py::test_serialize_numpy_ma_masked_array[x0] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 12%] 1092s protocol/tests/test_numpy.py::test_serialize_numpy_ma_masked_array[x1] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 12%] 1092s protocol/tests/test_numpy.py::test_serialize_numpy_ma_masked_array[x2] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 12%] 1092s protocol/tests/test_numpy.py::test_serialize_numpy_ma_masked_array[x3] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 12%] 1092s protocol/tests/test_numpy.py::test_serialize_numpy_ma_masked_array[x4] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 12%] 1092s protocol/tests/test_numpy.py::test_serialize_numpy_ma_masked_array[x5] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 12%] 1092s protocol/tests/test_numpy.py::test_serialize_numpy_ma_masked <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 12%] 1092s protocol/tests/test_numpy.py::test_dumps_serialize_numpy_custom_dtype <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py SKIPPED [ 13%] 1092s protocol/tests/test_numpy.py::test_memmap <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 13%] 1092s protocol/tests/test_numpy.py::test_dumps_serialize_numpy_large <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py SKIPPED [ 13%] 1092s protocol/tests/test_numpy.py::test_itemsize[f8-8] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 13%] 1092s protocol/tests/test_numpy.py::test_itemsize[i4-4] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 13%] 1092s protocol/tests/test_numpy.py::test_itemsize[c16-16] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 13%] 1092s protocol/tests/test_numpy.py::test_itemsize[b-1] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 13%] 1092s protocol/tests/test_numpy.py::test_itemsize[S3-3] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 13%] 1092s protocol/tests/test_numpy.py::test_itemsize[M8[us]-8] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 13%] 1092s protocol/tests/test_numpy.py::test_itemsize[M8[s]-8] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 13%] 1092s protocol/tests/test_numpy.py::test_itemsize[U3-12] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 13%] 1092s protocol/tests/test_numpy.py::test_itemsize[dt8-12] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 13%] 1092s protocol/tests/test_numpy.py::test_itemsize[dt9-4] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 13%] 1092s protocol/tests/test_numpy.py::test_itemsize[dt10-8] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 13%] 1092s protocol/tests/test_numpy.py::test_itemsize[dt11-88] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 13%] 1092s protocol/tests/test_numpy.py::test_itemsize[dt12-8] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 13%] 1093s protocol/tests/test_numpy.py::test_compress_numpy <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 13%] 1093s protocol/tests/test_numpy.py::test_compress_memoryview <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 13%] 1093s protocol/tests/test_numpy.py::test_dumps_large <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 13%] 1093s protocol/tests/test_numpy.py::test_zero_strided_numpy_array[True-x0] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 13%] 1093s protocol/tests/test_numpy.py::test_zero_strided_numpy_array[True-x1] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 13%] 1093s protocol/tests/test_numpy.py::test_zero_strided_numpy_array[True-x2] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 13%] 1093s protocol/tests/test_numpy.py::test_zero_strided_numpy_array[True-x3] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 13%] 1093s protocol/tests/test_numpy.py::test_zero_strided_numpy_array[False-x0] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 13%] 1093s protocol/tests/test_numpy.py::test_zero_strided_numpy_array[False-x1] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 13%] 1093s protocol/tests/test_numpy.py::test_zero_strided_numpy_array[False-x2] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 13%] 1093s protocol/tests/test_numpy.py::test_zero_strided_numpy_array[False-x3] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 13%] 1093s protocol/tests/test_numpy.py::test_non_zero_strided_array <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 13%] 1093s protocol/tests/test_numpy.py::test_serialize_writeable_array_readonly_base_object <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 13%] 1093s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df0] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 13%] 1093s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df1] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 13%] 1093s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df2] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 13%] 1093s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df3] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 14%] 1093s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df4] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 14%] 1093s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df5] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 14%] 1093s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df6] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 14%] 1093s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df7] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 14%] 1093s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df8] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 14%] 1093s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df9] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 14%] 1093s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df10] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 14%] 1093s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df11] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 14%] 1093s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df12] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 14%] 1093s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df13] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 14%] 1093s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df14] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 14%] 1093s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df15] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 14%] 1093s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df16] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 14%] 1093s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df17] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 14%] 1093s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df18] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 14%] 1093s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df19] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 14%] 1093s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df20] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 14%] 1093s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df21] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 14%] 1093s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df22] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 14%] 1093s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df23] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 14%] 1093s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df24] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 14%] 1093s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df25] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 14%] 1093s protocol/tests/test_pandas.py::test_dumps_pandas_writable <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 14%] 1093s protocol/tests/test_pickle.py::test_pickle_data[4] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pickle.py PASSED [ 14%] 1093s protocol/tests/test_pickle.py::test_pickle_data[5] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pickle.py PASSED [ 14%] 1093s protocol/tests/test_pickle.py::test_pickle_out_of_band[4] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pickle.py PASSED [ 14%] 1093s protocol/tests/test_pickle.py::test_pickle_out_of_band[5] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pickle.py PASSED [ 14%] 1093s protocol/tests/test_pickle.py::test_pickle_empty[4] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pickle.py PASSED [ 14%] 1093s protocol/tests/test_pickle.py::test_pickle_empty[5] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pickle.py PASSED [ 14%] 1093s protocol/tests/test_pickle.py::test_pickle_numpy[4] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pickle.py PASSED [ 14%] 1093s protocol/tests/test_pickle.py::test_pickle_numpy[5] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pickle.py PASSED [ 14%] 1093s protocol/tests/test_pickle.py::test_pickle_functions[4] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pickle.py PASSED [ 15%] 1093s protocol/tests/test_pickle.py::test_pickle_functions[5] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pickle.py PASSED [ 15%] 1093s protocol/tests/test_pickle.py::test_pickle_by_value_when_registered <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pickle.py PASSED [ 15%] 1093s protocol/tests/test_pickle.py::test_allow_pickle_if_registered_in_dask_serialize <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pickle.py PASSED [ 15%] 1093s protocol/tests/test_pickle.py::test_nopickle_nested <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pickle.py PASSED [ 15%] 1093s protocol/tests/test_pickle.py::test_pickle_functions_in_main <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pickle.py SKIPPED [ 15%] 1093s protocol/tests/test_pickle.py::test_pickle_zero_copy_read_only_flag[dask] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pickle.py PASSED [ 15%] 1093s protocol/tests/test_pickle.py::test_pickle_zero_copy_read_only_flag[pickle] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pickle.py PASSED [ 15%] 1093s protocol/tests/test_protocol.py::test_protocol <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol.py PASSED [ 15%] 1093s protocol/tests/test_protocol.py::test_small <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol.py PASSED [ 15%] 1093s protocol/tests/test_protocol.py::test_small_and_big <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol.py PASSED [ 15%] 1093s protocol/tests/test_protocol.py::test_large_bytes[bytes] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol.py PASSED [ 15%] 1093s protocol/tests/test_protocol.py::test_large_bytes[memoryview] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol.py PASSED [ 15%] 1093s protocol/tests/test_protocol.py::test_large_messages_map <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol.py PASSED [ 15%] 1093s protocol/tests/test_protocol.py::test_loads_deserialize_False <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol.py PASSED [ 15%] 1093s protocol/tests/test_protocol.py::test_dumps_loads_Serialize <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol.py PASSED [ 15%] 1093s protocol/tests/test_protocol.py::test_dumps_loads_Serialized <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol.py PASSED [ 15%] 1093s protocol/tests/test_protocol.py::test_preserve_header[serializers0] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol.py PASSED [ 15%] 1093s protocol/tests/test_protocol.py::test_preserve_header[serializers1] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol.py PASSED [ 15%] 1093s protocol/tests/test_protocol.py::test_sizeof_serialize[Serialize-Serialized0] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol.py PASSED [ 15%] 1093s protocol/tests/test_protocol.py::test_sizeof_serialize[Serialize-Serialized1] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol.py PASSED [ 15%] 1093s protocol/tests/test_protocol.py::test_sizeof_serialize[ToPickle-Pickled] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol.py PASSED [ 15%] 1093s protocol/tests/test_protocol.py::test_fallback_to_pickle <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol.py PASSED [ 15%] 1093s protocol/tests/test_protocol.py::test_large_payload[bytes] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol.py SKIPPED [ 15%] 1093s protocol/tests/test_protocol.py::test_large_payload[str] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol.py SKIPPED [ 15%] 1093s protocol/tests/test_protocol.py::test_large_payload[ext] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol.py SKIPPED [ 15%] 1093s protocol/tests/test_protocol_utils.py::test_pack_frames <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 15%] 1093s protocol/tests/test_protocol_utils.py::test_unpack_frames_remainder[456] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 15%] 1093s protocol/tests/test_protocol_utils.py::test_unpack_frames_remainder[] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 15%] 1093s protocol/tests/test_protocol_utils.py::test_unpack_frames_partial <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 15%] 1093s protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_empty <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 15%] 1093s protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_one <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 15%] 1093s protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_parts[slices0] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 16%] 1093s protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_parts[slices1] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 16%] 1093s protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_parts[slices2] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 16%] 1093s protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_parts[slices3] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 16%] 1093s protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_parts[slices4] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 16%] 1093s protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_parts[slices5] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 16%] 1093s protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_parts[slices6] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 16%] 1093s protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_parts[slices7] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 16%] 1093s protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_parts[slices8] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 16%] 1093s protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_parts[slices9] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 16%] 1093s protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_readonly_buffer <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 16%] 1093s protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_catch_non_memoryview <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 16%] 1094s protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_catch_gaps[slices0] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 16%] 1094s protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_catch_gaps[slices1] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 16%] 1094s protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_catch_gaps[slices2] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 16%] 1094s protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_catch_different_buffer <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 16%] 1094s protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_catch_different_non_contiguous <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 16%] 1094s protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_catch_multidimensional <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 16%] 1094s protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_catch_different_formats <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 16%] 1094s protocol/tests/test_serialize.py::test_dumps_serialize <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 16%] 1094s protocol/tests/test_serialize.py::test_serialize_bytestrings <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 16%] 1094s protocol/tests/test_serialize.py::test_serialize_empty_array <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 16%] 1094s protocol/tests/test_serialize.py::test_serialize_arrays[b] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 16%] 1094s protocol/tests/test_serialize.py::test_serialize_arrays[B] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 16%] 1094s protocol/tests/test_serialize.py::test_serialize_arrays[h] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 16%] 1094s protocol/tests/test_serialize.py::test_serialize_arrays[H] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 16%] 1094s protocol/tests/test_serialize.py::test_serialize_arrays[i] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 16%] 1094s protocol/tests/test_serialize.py::test_serialize_arrays[I] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 16%] 1094s protocol/tests/test_serialize.py::test_serialize_arrays[l] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 16%] 1094s protocol/tests/test_serialize.py::test_serialize_arrays[L] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 16%] 1094s protocol/tests/test_serialize.py::test_serialize_arrays[q] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 16%] 1094s protocol/tests/test_serialize.py::test_serialize_arrays[Q] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 16%] 1094s protocol/tests/test_serialize.py::test_serialize_arrays[f] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 17%] 1094s protocol/tests/test_serialize.py::test_serialize_arrays[d] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 17%] 1094s protocol/tests/test_serialize.py::test_Serialize <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 17%] 1094s protocol/tests/test_serialize.py::test_Serialized <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 17%] 1094s protocol/tests/test_serialize.py::test_nested_deserialize <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 17%] 1094s protocol/tests/test_serialize.py::test_serialize_iterate_collection <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 17%] 1094s protocol/tests/test_serialize.py::test_object_in_graph <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 17%] 1094s protocol/tests/test_serialize.py::test_scatter <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 17%] 1094s protocol/tests/test_serialize.py::test_inter_worker_comms <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 17%] 1094s protocol/tests/test_serialize.py::test_empty <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 17%] 1094s protocol/tests/test_serialize.py::test_empty_loads <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 17%] 1094s protocol/tests/test_serialize.py::test_empty_loads_deep <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 17%] 1095s protocol/tests/test_serialize.py::test_serialize_bytes[kwargs0] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 17%] 1096s protocol/tests/test_serialize.py::test_serialize_bytes[kwargs1] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 17%] 1096s protocol/tests/test_serialize.py::test_serialize_bytes_numpy[kwargs0] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 17%] 1096s protocol/tests/test_serialize.py::test_serialize_bytes_numpy[kwargs1] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 17%] 1096s protocol/tests/test_serialize.py::test_deserialize_bytes_zero_copy_read_only <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 17%] 1096s protocol/tests/test_serialize.py::test_deserialize_bytes_zero_copy_writeable <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 17%] 1096s protocol/tests/test_serialize.py::test_serialize_list_compress <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 17%] 1096s protocol/tests/test_serialize.py::test_malicious_exception <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 17%] 1096s protocol/tests/test_serialize.py::test_err_on_bad_deserializer <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 17%] 1096s protocol/tests/test_serialize.py::test_context_specific_serialization <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 17%] 1097s protocol/tests/test_serialize.py::test_context_specific_serialization_class <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 17%] 1097s protocol/tests/test_serialize.py::test_serialize_raises <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 17%] 1097s protocol/tests/test_serialize.py::test_different_compression_families <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 17%] 1097s protocol/tests/test_serialize.py::test_frame_split <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 17%] 1097s protocol/tests/test_serialize.py::test_check_dask_serializable[data0-False] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 17%] 1097s protocol/tests/test_serialize.py::test_check_dask_serializable[data1-False] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 17%] 1097s protocol/tests/test_serialize.py::test_check_dask_serializable[data2-False] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 17%] 1097s protocol/tests/test_serialize.py::test_check_dask_serializable[data3-False] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 17%] 1097s protocol/tests/test_serialize.py::test_check_dask_serializable[data4-False] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 17%] 1097s protocol/tests/test_serialize.py::test_check_dask_serializable[data5-True] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 18%] 1097s protocol/tests/test_serialize.py::test_check_dask_serializable[data6-True] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 18%] 1097s protocol/tests/test_serialize.py::test_check_dask_serializable[data7-True] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py XFAIL [ 18%] 1097s protocol/tests/test_serialize.py::test_check_dask_serializable[data8-True] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 18%] 1097s protocol/tests/test_serialize.py::test_check_dask_serializable[data9-True] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 18%] 1097s protocol/tests/test_serialize.py::test_check_dask_serializable[data10-True] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 18%] 1097s protocol/tests/test_serialize.py::test_check_dask_serializable[data11-True] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 18%] 1097s protocol/tests/test_serialize.py::test_check_dask_serializable[data12-True] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 18%] 1097s protocol/tests/test_serialize.py::test_serialize_lists[serializers0] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 18%] 1097s protocol/tests/test_serialize.py::test_serialize_lists[serializers1] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 18%] 1097s protocol/tests/test_serialize.py::test_serialize_lists[serializers2] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 18%] 1097s protocol/tests/test_serialize.py::test_serialize_lists[serializers3] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 18%] 1097s protocol/tests/test_serialize.py::test_deser_memoryview[data_in0] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 18%] 1097s protocol/tests/test_serialize.py::test_deser_memoryview[data_in1] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 18%] 1097s protocol/tests/test_serialize.py::test_ser_memoryview_object <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 18%] 1097s protocol/tests/test_serialize.py::test_ser_empty_1d_memoryview <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 18%] 1097s protocol/tests/test_serialize.py::test_ser_empty_nd_memoryview <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 18%] 1100s protocol/tests/test_serialize.py::test_large_pickled_object <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 18%] 1100s protocol/tests/test_serialize.py::test__is_msgpack_serializable <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 18%] 1100s protocol/tests/test_to_pickle.py::test_ToPickle <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_to_pickle.py PASSED [ 18%] 1100s protocol/tests/test_utils.py::test_host_array <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_utils.py PASSED [ 18%] 1100s protocol/tests/test_utils.py::test_host_array_from_buffers <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_utils.py PASSED [ 18%] 1100s protocol/tests/test_utils.py::test_host_array_from_buffers_numpy <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_utils.py PASSED [ 18%] 1100s protocol/tests/test_utils_test.py::test_get_host_array <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_utils_test.py PASSED [ 18%] 1100s shuffle/tests/test_buffer.py::test_memory_limit[big_payloads0] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_buffer.py PASSED [ 18%] 1101s shuffle/tests/test_buffer.py::test_memory_limit[big_payloads1] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_buffer.py PASSED [ 18%] 1101s shuffle/tests/test_buffer.py::test_memory_limit[big_payloads2] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_buffer.py PASSED [ 18%] 1102s shuffle/tests/test_buffer.py::test_memory_limit[big_payloads3] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_buffer.py PASSED [ 18%] 1102s shuffle/tests/test_buffer.py::test_memory_limit_blocked_exception <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_buffer.py PASSED [ 18%] 1102s shuffle/tests/test_comm_buffer.py::test_basic <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_comm_buffer.py PASSED [ 18%] 1102s shuffle/tests/test_comm_buffer.py::test_exceptions <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_comm_buffer.py PASSED [ 18%] 1102s shuffle/tests/test_comm_buffer.py::test_slow_send <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_comm_buffer.py PASSED [ 18%] 1102s shuffle/tests/test_comm_buffer.py::test_concurrent_puts <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_comm_buffer.py PASSED [ 19%] 1102s shuffle/tests/test_comm_buffer.py::test_concurrent_puts_error <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_comm_buffer.py PASSED [ 19%] 1102s shuffle/tests/test_core.py::test_mean_shard_size <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_core.py PASSED [ 19%] 1102s shuffle/tests/test_core.py::test_mean_shard_size_numpy <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_core.py PASSED [ 19%] 1102s shuffle/tests/test_disk_buffer.py::test_basic <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_disk_buffer.py PASSED [ 19%] 1102s shuffle/tests/test_disk_buffer.py::test_read_before_flush <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_disk_buffer.py PASSED [ 19%] 1102s shuffle/tests/test_disk_buffer.py::test_many[2] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_disk_buffer.py PASSED [ 19%] 1102s shuffle/tests/test_disk_buffer.py::test_many[100] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_disk_buffer.py PASSED [ 19%] 1103s shuffle/tests/test_disk_buffer.py::test_many[1000] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_disk_buffer.py PASSED [ 19%] 1103s shuffle/tests/test_disk_buffer.py::test_exceptions <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_disk_buffer.py PASSED [ 19%] 1103s shuffle/tests/test_disk_buffer.py::test_high_pressure_flush_with_exception <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_disk_buffer.py PASSED [ 19%] 1103s shuffle/tests/test_limiter.py::test_limiter_basic <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_limiter.py PASSED [ 19%] 1103s shuffle/tests/test_limiter.py::test_unlimited_limiter <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_limiter.py PASSED [ 19%] 1103s shuffle/tests/test_limiter.py::test_limiter_concurrent_decrease_releases_waiter <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_limiter.py PASSED [ 19%] 1103s shuffle/tests/test_limiter.py::test_limiter_statistics <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_limiter.py PASSED [ 19%] 1103s shuffle/tests/test_limiter.py::test_limiter_no_limit_no_statistics <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_limiter.py PASSED [ 19%] 1103s shuffle/tests/test_memory_buffer.py::test_basic <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_memory_buffer.py PASSED [ 19%] 1103s shuffle/tests/test_memory_buffer.py::test_read_before_flush <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_memory_buffer.py PASSED [ 19%] 1103s shuffle/tests/test_memory_buffer.py::test_many[2] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_memory_buffer.py PASSED [ 19%] 1104s shuffle/tests/test_memory_buffer.py::test_many[100] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_memory_buffer.py PASSED [ 19%] 1104s shuffle/tests/test_memory_buffer.py::test_many[1000] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_memory_buffer.py PASSED [ 19%] 1104s shuffle/tests/test_pickle.py::test_pickle <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_pickle.py PASSED [ 19%] 1104s shuffle/tests/test_pickle.py::test_pickle_numpy <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_pickle.py PASSED [ 19%] 1104s shuffle/tests/test_pickle.py::test_pickle_zero_copy <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_pickle.py PASSED [ 19%] 1104s shuffle/tests/test_read_write_lock.py::test_basic <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_read_write_lock.py PASSED [ 19%] 1104s shuffle/tests/test_read_write_lock.py::test_lock_timeout <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_read_write_lock.py PASSED [ 19%] 1104s shuffle/tests/test_read_write_lock.py::test_concurrent_reads_are_allowed <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_read_write_lock.py PASSED [ 19%] 1104s shuffle/tests/test_read_write_lock.py::test_read_blocks_write <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_read_write_lock.py PASSED [ 19%] 1104s shuffle/tests/test_read_write_lock.py::test_write_blocks_read <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_read_write_lock.py PASSED [ 19%] 1104s shuffle/tests/test_read_write_lock.py::test_write_blocks_write <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_read_write_lock.py PASSED [ 19%] 1104s shuffle/tests/test_read_write_lock.py::test_write_preferred_over_read <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_read_write_lock.py PASSED [ 19%] 1104s shuffle/tests/test_rechunk.py::test_lowlevel_rechunk[True-True-1] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 19%] 1104s shuffle/tests/test_rechunk.py::test_lowlevel_rechunk[True-True-10] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 20%] 1105s shuffle/tests/test_rechunk.py::test_lowlevel_rechunk[True-False-1] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 20%] 1105s shuffle/tests/test_rechunk.py::test_lowlevel_rechunk[True-False-10] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 20%] 1105s shuffle/tests/test_rechunk.py::test_lowlevel_rechunk[False-True-1] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 20%] 1105s shuffle/tests/test_rechunk.py::test_lowlevel_rechunk[False-True-10] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 20%] 1105s shuffle/tests/test_rechunk.py::test_lowlevel_rechunk[False-False-1] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 20%] 1105s shuffle/tests/test_rechunk.py::test_lowlevel_rechunk[False-False-10] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 20%] 1105s shuffle/tests/test_rechunk.py::test_rechunk_configuration[tasks-tasks] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 20%] 1105s shuffle/tests/test_rechunk.py::test_rechunk_configuration[tasks-p2p] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 20%] 1106s shuffle/tests/test_rechunk.py::test_rechunk_configuration[tasks-None] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 20%] 1106s shuffle/tests/test_rechunk.py::test_rechunk_configuration[p2p-tasks] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 20%] 1106s shuffle/tests/test_rechunk.py::test_rechunk_configuration[p2p-p2p] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 20%] 1107s shuffle/tests/test_rechunk.py::test_rechunk_configuration[p2p-None] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 20%] 1107s shuffle/tests/test_rechunk.py::test_rechunk_configuration[None-tasks] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 20%] 1107s shuffle/tests/test_rechunk.py::test_rechunk_configuration[None-p2p] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 20%] 1107s shuffle/tests/test_rechunk.py::test_rechunk_configuration[None-None] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 20%] 1109s shuffle/tests/test_rechunk.py::test_cull_p2p_rechunk_independent_partitions <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 20%] 1109s shuffle/tests/test_rechunk.py::test_cull_p2p_rechunk_overlapping_partitions <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 20%] 1110s shuffle/tests/test_rechunk.py::test_rechunk_2d[True] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 20%] 1110s shuffle/tests/test_rechunk.py::test_rechunk_2d[False] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 20%] 1110s shuffle/tests/test_rechunk.py::test_rechunk_4d[True] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 20%] 1111s shuffle/tests/test_rechunk.py::test_rechunk_4d[False] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 20%] 1111s shuffle/tests/test_rechunk.py::test_rechunk_expand <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 20%] 1112s shuffle/tests/test_rechunk.py::test_rechunk_expand2 <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 20%] 1128s shuffle/tests/test_rechunk.py::test_rechunk_method <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 20%] 1128s shuffle/tests/test_rechunk.py::test_rechunk_blockshape <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 20%] 1128s shuffle/tests/test_rechunk.py::test_dtype <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 20%] 1129s shuffle/tests/test_rechunk.py::test_rechunk_with_dict <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 20%] 1129s shuffle/tests/test_rechunk.py::test_rechunk_with_empty_input <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 20%] 1129s shuffle/tests/test_rechunk.py::test_rechunk_with_null_dimensions <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 20%] 1129s shuffle/tests/test_rechunk.py::test_rechunk_with_integer <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 20%] 1129s shuffle/tests/test_rechunk.py::test_rechunk_0d <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 20%] 1129s shuffle/tests/test_rechunk.py::test_rechunk_empty_array[arr0] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 21%] 1129s shuffle/tests/test_rechunk.py::test_rechunk_empty_array[arr1] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 21%] 1129s shuffle/tests/test_rechunk.py::test_rechunk_empty_array[arr2] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 21%] 1129s shuffle/tests/test_rechunk.py::test_rechunk_empty <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 21%] 1130s shuffle/tests/test_rechunk.py::test_rechunk_zero_dim_array <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 21%] 1130s shuffle/tests/test_rechunk.py::test_rechunk_zero_dim_array_II <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 21%] 1130s shuffle/tests/test_rechunk.py::test_rechunk_same <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 21%] 1130s shuffle/tests/test_rechunk.py::test_rechunk_same_fully_unknown <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 21%] 1130s shuffle/tests/test_rechunk.py::test_rechunk_same_fully_unknown_floats <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 21%] 1130s shuffle/tests/test_rechunk.py::test_rechunk_same_partially_unknown <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 21%] 1131s shuffle/tests/test_rechunk.py::test_rechunk_with_zero_placeholders <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 21%] 1131s shuffle/tests/test_rechunk.py::test_rechunk_minus_one <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 21%] 1131s shuffle/tests/test_rechunk.py::test_rechunk_warning <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 21%] 1131s shuffle/tests/test_rechunk.py::test_rechunk_unknown_from_pandas <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 21%] 1132s shuffle/tests/test_rechunk.py::test_rechunk_unknown_from_array <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 21%] 1132s shuffle/tests/test_rechunk.py::test_rechunk_with_fully_unknown_dimension[x0-chunks0] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 21%] 1133s shuffle/tests/test_rechunk.py::test_rechunk_with_fully_unknown_dimension[x1-chunks1] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 21%] 1133s shuffle/tests/test_rechunk.py::test_rechunk_with_fully_unknown_dimension[x2-chunks2] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 21%] 1136s shuffle/tests/test_rechunk.py::test_rechunk_with_fully_unknown_dimension[x3-chunks3] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 21%] 1140s shuffle/tests/test_rechunk.py::test_rechunk_with_fully_unknown_dimension[x4-chunks4] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 21%] 1143s shuffle/tests/test_rechunk.py::test_rechunk_with_fully_unknown_dimension[x5-chunks5] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 21%] 1143s shuffle/tests/test_rechunk.py::test_rechunk_with_fully_unknown_dimension[x6-chunks6] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 21%] 1143s shuffle/tests/test_rechunk.py::test_rechunk_with_fully_unknown_dimension[x7-chunks7] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 21%] 1144s shuffle/tests/test_rechunk.py::test_rechunk_with_fully_unknown_dimension[x8-chunks8] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 21%] 1144s shuffle/tests/test_rechunk.py::test_rechunk_with_fully_unknown_dimension[x9-chunks9] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 21%] 1144s shuffle/tests/test_rechunk.py::test_rechunk_with_fully_unknown_dimension[x10-chunks10] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 21%] 1145s shuffle/tests/test_rechunk.py::test_rechunk_with_fully_unknown_dimension[x11-chunks11] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 21%] 1146s shuffle/tests/test_rechunk.py::test_rechunk_with_partially_unknown_dimension[x0-chunks0] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 21%] 1146s shuffle/tests/test_rechunk.py::test_rechunk_with_partially_unknown_dimension[x1-chunks1] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 21%] 1147s shuffle/tests/test_rechunk.py::test_rechunk_with_partially_unknown_dimension[x2-chunks2] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 21%] 1154s shuffle/tests/test_rechunk.py::test_rechunk_with_partially_unknown_dimension[x3-chunks3] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 21%] 1160s shuffle/tests/test_rechunk.py::test_rechunk_with_partially_unknown_dimension[x4-chunks4] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 21%] 1166s shuffle/tests/test_rechunk.py::test_rechunk_with_partially_unknown_dimension[x5-chunks5] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 22%] 1167s shuffle/tests/test_rechunk.py::test_rechunk_with_partially_unknown_dimension[x6-chunks6] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 22%] 1167s shuffle/tests/test_rechunk.py::test_rechunk_with_partially_unknown_dimension[x7-chunks7] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 22%] 1168s shuffle/tests/test_rechunk.py::test_rechunk_with_partially_unknown_dimension[x8-chunks8] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 22%] 1168s shuffle/tests/test_rechunk.py::test_rechunk_with_partially_unknown_dimension[x9-chunks9] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 22%] 1168s shuffle/tests/test_rechunk.py::test_rechunk_with_partially_unknown_dimension[x10-chunks10] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 22%] 1169s shuffle/tests/test_rechunk.py::test_rechunk_with_partially_unknown_dimension[x11-chunks11] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 22%] 1169s shuffle/tests/test_rechunk.py::test_rechunk_with_fully_unknown_dimension_explicit[new_chunks0] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 22%] 1170s shuffle/tests/test_rechunk.py::test_rechunk_with_fully_unknown_dimension_explicit[new_chunks1] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 22%] 1170s shuffle/tests/test_rechunk.py::test_rechunk_with_fully_unknown_dimension_explicit[new_chunks2] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 22%] 1170s shuffle/tests/test_rechunk.py::test_rechunk_unknown_raises <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 22%] 1171s shuffle/tests/test_rechunk.py::test_rechunk_zero_dim <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 22%] 1171s shuffle/tests/test_rechunk.py::test_rechunk_empty_chunks <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 22%] 1172s shuffle/tests/test_rechunk.py::test_rechunk_avoid_needless_chunking <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 22%] 1172s shuffle/tests/test_rechunk.py::test_rechunk_auto_1d[100-1-10-expected0] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 22%] 1172s shuffle/tests/test_rechunk.py::test_rechunk_auto_1d[100-50-10-expected1] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 22%] 1172s shuffle/tests/test_rechunk.py::test_rechunk_auto_1d[100-100-10-expected2] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 22%] 1172s shuffle/tests/test_rechunk.py::test_rechunk_auto_1d[20-7-10-expected3] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 22%] 1172s shuffle/tests/test_rechunk.py::test_rechunk_auto_1d[20-chunks4-5-expected4] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 22%] 1172s shuffle/tests/test_rechunk.py::test_rechunk_auto_2d <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 22%] 1172s shuffle/tests/test_rechunk.py::test_rechunk_auto_3d <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 22%] 1173s shuffle/tests/test_rechunk.py::test_rechunk_auto_image_stack[100] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 22%] 1173s shuffle/tests/test_rechunk.py::test_rechunk_auto_image_stack[1000] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 22%] 1173s shuffle/tests/test_rechunk.py::test_rechunk_down <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 22%] 1173s shuffle/tests/test_rechunk.py::test_rechunk_zero <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 22%] 1173s shuffle/tests/test_rechunk.py::test_rechunk_bad_keys <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 22%] 1173s shuffle/tests/test_rechunk.py::test_rechunk_with_zero <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 22%] 1173s shuffle/tests/test_rechunk.py::test_split_axes_1 <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 22%] 1173s shuffle/tests/test_rechunk.py::test_split_axes_2 <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 22%] 1173s shuffle/tests/test_rechunk.py::test_split_axes_nan <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 22%] 1173s shuffle/tests/test_rechunk.py::test_split_axes_nan_single <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 22%] 1174s shuffle/tests/test_rechunk.py::test_split_axes_nan_long <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 22%] 1174s shuffle/tests/test_rechunk.py::test_split_axes_with_nonzero <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 23%] 1174s shuffle/tests/test_rechunk.py::test_split_axes_with_zero <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 23%] 1174s shuffle/tests/test_rechunk.py::test_preserve_writeable_flag <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 23%] 1175s shuffle/tests/test_rechunk.py::test_rechunk_in_memory_shards_dont_share_buffer <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 23%] 1175s shuffle/tests/test_rechunk.py::test_pick_worker_homogeneous_distribution[1] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 23%] 1175s shuffle/tests/test_rechunk.py::test_pick_worker_homogeneous_distribution[2] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 23%] 1175s shuffle/tests/test_rechunk.py::test_pick_worker_homogeneous_distribution[41] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 23%] 1175s shuffle/tests/test_rechunk.py::test_pick_worker_homogeneous_distribution[50] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 23%] 1175s shuffle/tests/test_rechunk.py::test_partial_rechunk_homogeneous_distribution <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py SKIPPED [ 23%] 1175s shuffle/tests/test_rechunk.py::test_partial_rechunk_taskgroups <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 23%] 1175s shuffle/tests/test_shuffle_plugins.py::test_installation_on_worker <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_shuffle_plugins.py PASSED [ 23%] 1175s shuffle/tests/test_shuffle_plugins.py::test_installation_on_scheduler <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_shuffle_plugins.py PASSED [ 23%] 1175s tests/test_active_memory_manager.py::test_no_policies <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 23%] 1176s tests/test_active_memory_manager.py::test_drop <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 23%] 1177s tests/test_active_memory_manager.py::test_start_stop <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 23%] 1178s tests/test_active_memory_manager.py::test_auto_start <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 23%] 1178s tests/test_active_memory_manager.py::test_add_policy <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 23%] 1178s tests/test_active_memory_manager.py::test_multi_start <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 23%] 1179s tests/test_active_memory_manager.py::test_not_registered <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 23%] 1181s tests/test_active_memory_manager.py::test_client_proxy_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 23%] 1181s tests/test_active_memory_manager.py::test_client_proxy_async <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 23%] 1181s tests/test_active_memory_manager.py::test_drop_not_in_memory <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 23%] 1182s tests/test_active_memory_manager.py::test_drop_with_waiter <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 23%] 1182s tests/test_active_memory_manager.py::test_double_drop <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 23%] 1183s tests/test_active_memory_manager.py::test_double_drop_stress <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 23%] 1183s tests/test_active_memory_manager.py::test_drop_from_worker_with_least_free_memory <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 23%] 1183s tests/test_active_memory_manager.py::test_drop_with_candidates <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 23%] 1183s tests/test_active_memory_manager.py::test_drop_with_empty_candidates <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 23%] 1184s tests/test_active_memory_manager.py::test_drop_from_candidates_without_key <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 23%] 1184s tests/test_active_memory_manager.py::test_drop_with_bad_candidates <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 23%] 1185s tests/test_active_memory_manager.py::test_drop_prefers_paused_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 23%] 1185s tests/test_active_memory_manager.py::test_drop_with_paused_workers_with_running_tasks_1 <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 24%] 1185s tests/test_active_memory_manager.py::test_drop_with_paused_workers_with_running_tasks_2 <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 24%] 1185s tests/test_active_memory_manager.py::test_drop_with_paused_workers_with_running_tasks_3_4[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 24%] 1185s tests/test_active_memory_manager.py::test_drop_with_paused_workers_with_running_tasks_3_4[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 24%] 1186s tests/test_active_memory_manager.py::test_drop_with_paused_workers_with_running_tasks_5 <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 24%] 1186s tests/test_active_memory_manager.py::test_replicate <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 24%] 1186s tests/test_active_memory_manager.py::test_replicate_not_in_memory <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 24%] 1186s tests/test_active_memory_manager.py::test_double_replicate_stress <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 24%] 1187s tests/test_active_memory_manager.py::test_replicate_to_worker_with_most_free_memory <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 24%] 1187s tests/test_active_memory_manager.py::test_replicate_with_candidates <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 24%] 1187s tests/test_active_memory_manager.py::test_replicate_with_empty_candidates <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 24%] 1188s tests/test_active_memory_manager.py::test_replicate_to_candidates_with_key <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 24%] 1188s tests/test_active_memory_manager.py::test_replicate_avoids_paused_workers_1 <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 24%] 1188s tests/test_active_memory_manager.py::test_replicate_avoids_paused_workers_2 <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 24%] 1188s tests/test_active_memory_manager.py::test_bad_measure <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 24%] 1189s tests/test_active_memory_manager.py::test_ReduceReplicas <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 24%] 1189s tests/test_active_memory_manager.py::test_ReduceReplicas_with_waiters[0-0-0-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 24%] 1189s tests/test_active_memory_manager.py::test_ReduceReplicas_with_waiters[1-0-0-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 24%] 1190s tests/test_active_memory_manager.py::test_ReduceReplicas_with_waiters[0-0-1-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 24%] 1190s tests/test_active_memory_manager.py::test_ReduceReplicas_with_waiters[2-0-0-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 24%] 1191s tests/test_active_memory_manager.py::test_ReduceReplicas_with_waiters[1-1-0-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 24%] 1191s tests/test_active_memory_manager.py::test_ReduceReplicas_with_waiters[1-1-1-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 24%] 1192s tests/test_active_memory_manager.py::test_ReduceReplicas_with_waiters[1-1-2-4] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 24%] 1192s tests/test_active_memory_manager.py::test_ReduceReplicas_with_waiters[2-1-1-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 24%] 1193s tests/test_active_memory_manager.py::test_ReduceReplicas_with_waiters[1-1-17-4] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 24%] 1193s tests/test_active_memory_manager.py::test_ReduceReplicas_with_waiters[17-1-1-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 24%] 1194s tests/test_active_memory_manager.py::test_ReduceReplicas_with_waiters[18-1-1-4] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 24%] 1194s tests/test_active_memory_manager.py::test_RetireWorker_amm_on_off[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 24%] 1194s tests/test_active_memory_manager.py::test_RetireWorker_amm_on_off[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 24%] 1194s tests/test_active_memory_manager.py::test_RetireWorker_no_extension <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 24%] 1195s tests/test_active_memory_manager.py::test_RetireWorker_no_remove <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 24%] 1195s tests/test_active_memory_manager.py::test_RetireWorker_with_ReduceReplicas[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 24%] 1195s tests/test_active_memory_manager.py::test_RetireWorker_with_ReduceReplicas[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 25%] 1195s tests/test_active_memory_manager.py::test_RetireWorker_all_replicas_are_being_retired <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 25%] 1195s tests/test_active_memory_manager.py::test_RetireWorker_no_recipients <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 25%] 1196s tests/test_active_memory_manager.py::test_RetireWorker_all_recipients_are_paused <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 25%] 1197s tests/test_active_memory_manager.py::test_RetireWorker_new_keys_arrive_after_all_keys_moved_away <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 25%] 1197s tests/test_active_memory_manager.py::test_RetireWorker_faulty_recipient <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 25%] 1198s tests/test_active_memory_manager.py::test_RetireWorker_mass <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 25%] 1198s tests/test_active_memory_manager.py::test_RetireWorker_incremental <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 25%] 1198s tests/test_active_memory_manager.py::test_dont_drop_actors <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 25%] 1199s tests/test_active_memory_manager.py::test_dont_replicate_actors <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 25%] 1199s tests/test_active_memory_manager.py::test_RetireWorker_with_actor[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 25%] 1199s tests/test_active_memory_manager.py::test_RetireWorker_with_actor[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 25%] 1199s tests/test_active_memory_manager.py::test_RetireWorker_with_actor_proxy <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 25%] 1199s tests/test_active_memory_manager.py::test_noamm_stress <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py SKIPPED [ 25%] 1199s tests/test_active_memory_manager.py::test_drop_stress <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py SKIPPED [ 25%] 1199s tests/test_active_memory_manager.py::test_ReduceReplicas_stress <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py SKIPPED [ 25%] 1199s tests/test_active_memory_manager.py::test_RetireWorker_stress[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py SKIPPED [ 25%] 1199s tests/test_active_memory_manager.py::test_RetireWorker_stress[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py SKIPPED [ 25%] 1199s tests/test_actor.py::test_client_actions[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 25%] 1200s tests/test_actor.py::test_client_actions[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 25%] 1200s tests/test_actor.py::test_worker_actions[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 25%] 1200s tests/test_actor.py::test_worker_actions[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 25%] 1200s tests/test_actor.py::test_Actor <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 25%] 1202s tests/test_actor.py::test_linear_access <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py XFAILges rather than 1202s rpc) [ 25%] 1202s tests/test_actor.py::test_exceptions_create <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 25%] 1202s tests/test_actor.py::test_exceptions_method <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 25%] 1202s tests/test_actor.py::test_gc <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 25%] 1203s tests/test_actor.py::test_track_dependencies <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 25%] 1203s tests/test_actor.py::test_future <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 25%] 1203s tests/test_actor.py::test_future_dependencies <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 25%] 1205s tests/test_actor.py::test_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 25%] 1208s tests/test_actor.py::test_timeout <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 25%] 1208s tests/test_actor.py::test_failed_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 26%] 1208s tests/test_actor.py::test_numpy_roundtrip <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 26%] 1208s tests/test_actor.py::test_numpy_roundtrip_getattr <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 26%] 1208s tests/test_actor.py::test_repr <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 26%] 1208s tests/test_actor.py::test_dir <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 26%] 1209s tests/test_actor.py::test_many_computations <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 26%] 1209s tests/test_actor.py::test_thread_safety <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 26%] 1209s tests/test_actor.py::test_Actors_create_dependencies <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 26%] 1209s tests/test_actor.py::test_load_balance <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 26%] 1210s tests/test_actor.py::test_load_balance_map <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 26%] 1210s tests/test_actor.py::test_compute <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 26%] 1212s tests/test_actor.py::test_compute_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 26%] 1213s tests/test_actor.py::test_actors_in_profile <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 26%] 1213s tests/test_actor.py::test_waiter <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 26%] 1213s tests/test_actor.py::test_worker_actor_handle_is_weakref <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 26%] 1216s tests/test_actor.py::test_worker_actor_handle_is_weakref_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 26%] 1218s tests/test_actor.py::test_worker_actor_handle_is_weakref_from_compute_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 26%] 1220s tests/test_actor.py::test_one_thread_deadlock <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 26%] 1223s tests/test_actor.py::test_one_thread_deadlock_timeout <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 26%] 1225s tests/test_actor.py::test_one_thread_deadlock_sync_client <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 26%] 1225s tests/test_actor.py::test_async_deadlock <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 26%] 1228s tests/test_actor.py::test_exception <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 26%] 1228s tests/test_actor.py::test_exception_async <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 26%] 1230s tests/test_actor.py::test_as_completed <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 26%] 1230s tests/test_actor.py::test_actor_future_awaitable <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 26%] 1231s tests/test_actor.py::test_actor_future_awaitable_deadlock <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 26%] 1231s tests/test_actor.py::test_serialize_with_pickle <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 26%] 1231s tests/test_actor.py::test_worker_client_async <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 26%] 1231s tests/test_actor.py::test_worker_client_separate_thread <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 26%] 1231s tests/test_actor.py::test_get_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 26%] 1232s tests/test_as_completed.py::test_as_completed_async <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_as_completed.py PASSED [ 26%] 1233s tests/test_as_completed.py::test_as_completed_timeout_async <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_as_completed.py PASSED [ 26%] 1236s tests/test_as_completed.py::test_as_completed_timeout_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_as_completed.py PASSED [ 27%] 1238s tests/test_as_completed.py::test_as_completed_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_as_completed.py PASSED [ 27%] 1240s tests/test_as_completed.py::test_as_completed_with_non_futures <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_as_completed.py PASSED [ 27%] 1243s tests/test_as_completed.py::test_as_completed_add <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_as_completed.py PASSED [ 27%] 1245s tests/test_as_completed.py::test_as_completed_update <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_as_completed.py PASSED [ 27%] 1248s tests/test_as_completed.py::test_as_completed_repeats <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_as_completed.py PASSED [ 27%] 1250s tests/test_as_completed.py::test_as_completed_is_empty <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_as_completed.py PASSED [ 27%] 1253s tests/test_as_completed.py::test_as_completed_cancel <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_as_completed.py PASSED [ 27%] 1255s tests/test_as_completed.py::test_as_completed_cancel_last <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_as_completed.py PASSED [ 27%] 1255s tests/test_as_completed.py::test_async_for_py2_equivalent <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_as_completed.py PASSED [ 27%] 1255s tests/test_as_completed.py::test_as_completed_error_async <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_as_completed.py PASSED [ 27%] 1258s tests/test_as_completed.py::test_as_completed_error <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_as_completed.py PASSED [ 27%] 1260s tests/test_as_completed.py::test_as_completed_with_results <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_as_completed.py PASSED [ 27%] 1260s tests/test_as_completed.py::test_as_completed_with_results_async <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_as_completed.py PASSED [ 27%] 1263s tests/test_as_completed.py::test_as_completed_with_results_no_raise <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_as_completed.py PASSED [ 27%] 1263s tests/test_as_completed.py::test_str <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_as_completed.py PASSED [ 27%] 1263s tests/test_as_completed.py::test_as_completed_with_results_no_raise_async <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_as_completed.py PASSED [ 27%] 1264s tests/test_as_completed.py::test_clear <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_as_completed.py PASSED [ 27%] 1264s tests/test_asyncio.py::test_rlock <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_asyncio.py PASSED [ 27%] 1264s tests/test_asyncio.py::test_rlock_nonreentrant <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_asyncio.py PASSED [ 27%] 1264s tests/test_asyncio.py::test_rlock_none <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_asyncio.py PASSED [ 27%] 1264s tests/test_asyncio.py::test_rlock_release_on_raise <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_asyncio.py PASSED [ 27%] 1266s tests/test_asyncprocess.py::test_simple <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_asyncprocess.py PASSED [ 27%] 1267s tests/test_asyncprocess.py::test_exitcode <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_asyncprocess.py PASSED [ 27%] 1269s tests/test_asyncprocess.py::test_sigint_from_same_process <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_asyncprocess.py PASSED [ 27%] 1269s tests/test_asyncprocess.py::test_sigterm_from_parent_process <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_asyncprocess.py PASSED [ 27%] 1269s tests/test_asyncprocess.py::test_terminate <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_asyncprocess.py PASSED [ 27%] 1271s tests/test_asyncprocess.py::test_close <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_asyncprocess.py PASSED [ 27%] 1272s tests/test_asyncprocess.py::test_exit_callback <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_asyncprocess.py PASSED [ 27%] 1274s tests/test_asyncprocess.py::test_child_main_thread <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_asyncprocess.py PASSED [ 27%] 1277s tests/test_asyncprocess.py::test_num_fds <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_asyncprocess.py PASSED [ 27%] 1278s tests/test_asyncprocess.py::test_terminate_after_stop <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_asyncprocess.py PASSED [ 27%] 1279s tests/test_asyncprocess.py::test_kill <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_asyncprocess.py PASSED [ 28%] 1281s tests/test_asyncprocess.py::test_asyncprocess_child_teardown_on_parent_exit <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_asyncprocess.py PASSED [ 28%] 1281s tests/test_batched.py::test_close_not_started <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_batched.py PASSED [ 28%] 1281s tests/test_batched.py::test_stress <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_batched.py SKIPPED [ 28%] 1281s tests/test_batched.py::test_large_traffic_jam <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_batched.py SKIPPED [ 28%] 1281s tests/test_cancelled_state.py::test_abort_execution_release <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 28%] 1282s tests/test_cancelled_state.py::test_abort_execution_reschedule <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 28%] 1282s tests/test_cancelled_state.py::test_abort_execution_add_as_dependency <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 28%] 1282s tests/test_cancelled_state.py::test_abort_execution_to_fetch <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 28%] 1282s tests/test_cancelled_state.py::test_worker_stream_died_during_comm <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 28%] 1282s tests/test_cancelled_state.py::test_flight_to_executing_via_cancelled_resumed <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 28%] 1283s tests/test_cancelled_state.py::test_executing_cancelled_error <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 28%] 1283s tests/test_cancelled_state.py::test_flight_cancelled_error <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 28%] 1283s tests/test_cancelled_state.py::test_in_flight_lost_after_resumed <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 28%] 1283s tests/test_cancelled_state.py::test_cancelled_error <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 28%] 1283s tests/test_cancelled_state.py::test_cancelled_error_with_resources <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 28%] 1283s tests/test_cancelled_state.py::test_cancelled_resumed_after_flight_with_dependencies <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 28%] 1283s tests/test_cancelled_state.py::test_cancelled_resumed_after_flight_with_dependencies_workerstate <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 28%] 1284s tests/test_cancelled_state.py::test_resumed_cancelled_handle_compute[True-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 28%] 1284s tests/test_cancelled_state.py::test_resumed_cancelled_handle_compute[True-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 28%] 1284s tests/test_cancelled_state.py::test_resumed_cancelled_handle_compute[False-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 28%] 1285s tests/test_cancelled_state.py::test_resumed_cancelled_handle_compute[False-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 28%] 1285s tests/test_cancelled_state.py::test_cancelled_handle_compute[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 28%] 1285s tests/test_cancelled_state.py::test_cancelled_handle_compute[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 28%] 1286s tests/test_cancelled_state.py::test_cancelled_task_error_rejected <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 28%] 1286s tests/test_cancelled_state.py::test_deadlock_cancelled_after_inflight_before_gather_from_worker[False-resumed] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 28%] 1286s tests/test_cancelled_state.py::test_deadlock_cancelled_after_inflight_before_gather_from_worker[False-cancelled] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 28%] 1287s tests/test_cancelled_state.py::test_deadlock_cancelled_after_inflight_before_gather_from_worker[True-resumed] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 28%] 1288s tests/test_cancelled_state.py::test_deadlock_cancelled_after_inflight_before_gather_from_worker[True-cancelled] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 28%] 1288s tests/test_cancelled_state.py::test_workerstate_executing_to_executing[executing] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 28%] 1288s tests/test_cancelled_state.py::test_workerstate_executing_to_executing[long-running] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 28%] 1288s tests/test_cancelled_state.py::test_workerstate_flight_to_flight <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 28%] 1288s tests/test_cancelled_state.py::test_workerstate_executing_skips_fetch_on_success[executing] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 29%] 1288s tests/test_cancelled_state.py::test_workerstate_executing_skips_fetch_on_success[long-running] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 29%] 1288s tests/test_cancelled_state.py::test_workerstate_executing_failure_to_fetch[executing] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 29%] 1288s tests/test_cancelled_state.py::test_workerstate_executing_failure_to_fetch[long-running] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 29%] 1288s tests/test_cancelled_state.py::test_workerstate_flight_skips_executing_on_success <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 29%] 1288s tests/test_cancelled_state.py::test_workerstate_flight_failure_to_executing[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 29%] 1288s tests/test_cancelled_state.py::test_workerstate_flight_failure_to_executing[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 29%] 1288s tests/test_cancelled_state.py::test_workerstate_resumed_fetch_to_cancelled_to_executing[executing] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 29%] 1288s tests/test_cancelled_state.py::test_workerstate_resumed_fetch_to_cancelled_to_executing[long-running] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 29%] 1288s tests/test_cancelled_state.py::test_workerstate_resumed_fetch_to_executing[executing] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 29%] 1288s tests/test_cancelled_state.py::test_workerstate_resumed_fetch_to_executing[long-running] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 29%] 1288s tests/test_cancelled_state.py::test_workerstate_resumed_waiting_to_flight <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 29%] 1288s tests/test_cancelled_state.py::test_execute_preamble_early_cancel[executing-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 29%] 1288s tests/test_cancelled_state.py::test_execute_preamble_early_cancel[executing-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 29%] 1289s tests/test_cancelled_state.py::test_execute_preamble_early_cancel[resumed-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 29%] 1289s tests/test_cancelled_state.py::test_execute_preamble_early_cancel[resumed-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 29%] 1289s tests/test_cancelled_state.py::test_cancel_with_dependencies_in_memory[ExecuteSuccessEvent-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 29%] 1289s tests/test_cancelled_state.py::test_cancel_with_dependencies_in_memory[ExecuteSuccessEvent-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 29%] 1289s tests/test_cancelled_state.py::test_cancel_with_dependencies_in_memory[ExecuteFailureEvent-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 29%] 1289s tests/test_cancelled_state.py::test_cancel_with_dependencies_in_memory[ExecuteFailureEvent-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 29%] 1289s tests/test_cancelled_state.py::test_cancel_with_dependencies_in_memory[RescheduleEvent-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 29%] 1289s tests/test_cancelled_state.py::test_cancel_with_dependencies_in_memory[RescheduleEvent-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 29%] 1289s tests/test_cancelled_state.py::test_secede_cancelled_or_resumed_workerstate[ExecuteSuccessEvent-False-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 29%] 1289s tests/test_cancelled_state.py::test_secede_cancelled_or_resumed_workerstate[ExecuteSuccessEvent-False-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 29%] 1289s tests/test_cancelled_state.py::test_secede_cancelled_or_resumed_workerstate[ExecuteSuccessEvent-True-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 29%] 1289s tests/test_cancelled_state.py::test_secede_cancelled_or_resumed_workerstate[ExecuteSuccessEvent-True-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 29%] 1289s tests/test_cancelled_state.py::test_secede_cancelled_or_resumed_workerstate[ExecuteFailureEvent-False-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 29%] 1289s tests/test_cancelled_state.py::test_secede_cancelled_or_resumed_workerstate[ExecuteFailureEvent-False-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 29%] 1289s tests/test_cancelled_state.py::test_secede_cancelled_or_resumed_workerstate[ExecuteFailureEvent-True-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 29%] 1289s tests/test_cancelled_state.py::test_secede_cancelled_or_resumed_workerstate[ExecuteFailureEvent-True-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 29%] 1289s tests/test_cancelled_state.py::test_secede_cancelled_or_resumed_workerstate[RescheduleEvent-False-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 29%] 1289s tests/test_cancelled_state.py::test_secede_cancelled_or_resumed_workerstate[RescheduleEvent-False-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 30%] 1289s tests/test_cancelled_state.py::test_secede_cancelled_or_resumed_workerstate[RescheduleEvent-True-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 30%] 1289s tests/test_cancelled_state.py::test_secede_cancelled_or_resumed_workerstate[RescheduleEvent-True-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 30%] 1289s tests/test_cancelled_state.py::test_secede_cancelled_or_resumed_scheduler <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 30%] 1289s tests/test_cancelled_state.py::test_workerstate_remove_replica_of_cancelled_task_dependency <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 30%] 1295s tests/test_chaos.py::test_KillWorker[sys.exit] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_chaos.py PASSED [ 30%] 1297s tests/test_chaos.py::test_KillWorker[graceful] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_chaos.py PASSED [ 30%] 1301s tests/test_chaos.py::test_KillWorker[segfault] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_chaos.py PASSED [ 30%] 1301s tests/test_client.py::test_submit <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 30%] 1302s tests/test_client.py::test_map <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 30%] 1302s tests/test_client.py::test_map_empty <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 30%] 1302s tests/test_client.py::test_map_keynames <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 30%] 1302s tests/test_client.py::test_map_retries <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 30%] 1303s tests/test_client.py::test_map_batch_size <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 30%] 1304s tests/test_client.py::test_custom_key_with_batches <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 30%] 1304s tests/test_client.py::test_compute_retries <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 30%] 1304s tests/test_client.py::test_compute_retries_annotations <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 30%] 1307s tests/test_client.py::test_retries_get <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 30%] 1307s tests/test_client.py::test_persist_retries <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 30%] 1307s tests/test_client.py::test_persist_retries_annotations <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 30%] 1307s tests/test_client.py::test_retries_dask_array <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 30%] 1308s tests/test_client.py::test_future_repr <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 30%] 1308s tests/test_client.py::test_future_tuple_repr <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 30%] 1308s tests/test_client.py::test_Future_exception <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 30%] 1310s tests/test_client.py::test_Future_exception_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 30%] 1311s tests/test_client.py::test_Future_release <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 30%] 1314s tests/test_client.py::test_Future_release_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 30%] 1316s tests/test_client.py::test_short_tracebacks[result] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 30%] 1318s tests/test_client.py::test_short_tracebacks[gather] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 30%] 1319s tests/test_client.py::test_short_tracebacks_async[await] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 30%] 1319s tests/test_client.py::test_short_tracebacks_async[result] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 30%] 1319s tests/test_client.py::test_short_tracebacks_async[gather] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 30%] 1319s tests/test_client.py::test_map_naming <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 31%] 1319s tests/test_client.py::test_submit_naming <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 31%] 1319s tests/test_client.py::test_exceptions <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 31%] 1320s tests/test_client.py::test_gc <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 31%] 1322s tests/test_client.py::test_thread <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 31%] 1325s tests/test_client.py::test_sync_exceptions <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 31%] 1325s tests/test_client.py::test_gather <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 31%] 1325s tests/test_client.py::test_gather_mismatched_client <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 31%] 1325s tests/test_client.py::test_gather_lost <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 31%] 1328s tests/test_client.py::test_gather_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 31%] 1328s tests/test_client.py::test_gather_strict <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 31%] 1329s tests/test_client.py::test_gather_skip <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 31%] 1329s tests/test_client.py::test_limit_concurrent_gathering <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 31%] 1329s tests/test_client.py::test_get <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 31%] 1332s tests/test_client.py::test_get_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 31%] 1334s tests/test_client.py::test_no_future_references <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 31%] 1337s tests/test_client.py::test_get_sync_optimize_graph_passes_through <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 31%] 1337s tests/test_client.py::test_gather_errors <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 31%] 1337s tests/test_client.py::test_wait <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 31%] 1337s tests/test_client.py::test_wait_first_completed <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 31%] 1338s tests/test_client.py::test_wait_timeout <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 31%] 1340s tests/test_client.py::test_wait_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 31%] 1342s tests/test_client.py::test_wait_informative_error_for_timeouts <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 31%] 1343s tests/test_client.py::test_garbage_collection <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 31%] 1343s tests/test_client.py::test_garbage_collection_with_scatter <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 31%] 1343s tests/test_client.py::test_recompute_released_key <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 31%] 1343s tests/test_client.py::test_long_tasks_dont_trigger_timeout <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 31%] 1343s tests/test_client.py::test_tokenize_on_futures <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 31%] 1344s tests/test_client.py::test_restrictions_submit <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 31%] 1344s tests/test_client.py::test_restrictions_ip_port <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 31%] 1344s tests/test_client.py::test_restrictions_map <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 31%] 1344s tests/test_client.py::test_restrictions_get <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 31%] 1344s tests/test_client.py::test_restrictions_get_annotate <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 32%] 1345s tests/test_client.py::test_remove_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 32%] 1345s tests/test_client.py::test_errors_dont_block <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 32%] 1345s tests/test_client.py::test_submit_quotes <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 32%] 1345s tests/test_client.py::test_map_quotes <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 32%] 1345s tests/test_client.py::test_two_consecutive_clients_share_results <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 32%] 1346s tests/test_client.py::test_submit_then_get_with_Future <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 32%] 1346s tests/test_client.py::test_aliases <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 32%] 1346s tests/test_client.py::test_aliases_2 <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 32%] 1346s tests/test_client.py::test_scatter <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 32%] 1346s tests/test_client.py::test_scatter_types <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 32%] 1347s tests/test_client.py::test_scatter_non_list <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 32%] 1347s tests/test_client.py::test_scatter_tokenize_local <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 32%] 1347s tests/test_client.py::test_scatter_singletons <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 32%] 1347s tests/test_client.py::test_scatter_typename <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 32%] 1347s tests/test_client.py::test_scatter_hash <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 32%] 1347s tests/test_client.py::test_scatter_hash_2 <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 32%] 1348s tests/test_client.py::test_get_releases_data <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 32%] 1350s tests/test_client.py::test_current <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 32%] 1353s tests/test_client.py::test_current_nested <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 32%] 1353s tests/test_client.py::test_current_nested_async <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 32%] 1353s tests/test_client.py::test_current_concurrent <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 32%] 1353s tests/test_client.py::test_context_manager_used_from_different_tasks <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 32%] 1356s tests/test_client.py::test_context_manager_used_from_different_threads <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 32%] 1358s tests/test_client.py::test_global_clients <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 32%] 1358s tests/test_client.py::test_exception_on_exception <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 32%] 1359s tests/test_client.py::test_get_task_prefix_states <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 32%] 1359s tests/test_client.py::test_get_nbytes <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 32%] 1359s tests/test_client.py::test_nbytes_determines_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 32%] 1359s tests/test_client.py::test_if_intermediates_clear_on_error <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 32%] 1359s tests/test_client.py::test_pragmatic_move_small_data_to_large_data <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 32%] 1360s tests/test_client.py::test_get_with_non_list_key <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 32%] 1360s tests/test_client.py::test_get_with_error <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 33%] 1362s tests/test_client.py::test_get_with_error_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 33%] 1362s tests/test_client.py::test_directed_scatter <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 33%] 1362s tests/test_client.py::test_scatter_direct <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 33%] 1363s tests/test_client.py::test_scatter_direct_2 <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 33%] 1363s tests/test_client.py::test_scatter_direct_numpy <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 33%] 1363s tests/test_client.py::test_scatter_direct_broadcast <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 33%] 1363s tests/test_client.py::test_scatter_direct_balanced <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 33%] 1364s tests/test_client.py::test_scatter_direct_broadcast_target <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 33%] 1364s tests/test_client.py::test_scatter_direct_empty <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 33%] 1364s tests/test_client.py::test_scatter_direct_spread_evenly <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 33%] 1366s tests/test_client.py::test_scatter_gather_sync[True-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 33%] 1369s tests/test_client.py::test_scatter_gather_sync[True-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 33%] 1371s tests/test_client.py::test_scatter_gather_sync[False-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 33%] 1374s tests/test_client.py::test_scatter_gather_sync[False-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 33%] 1374s tests/test_client.py::test_gather_direct <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 33%] 1374s tests/test_client.py::test_many_submits_spread_evenly <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 33%] 1374s tests/test_client.py::test_traceback <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 33%] 1374s tests/test_client.py::test_get_traceback <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 33%] 1375s tests/test_client.py::test_gather_traceback <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 33%] 1377s tests/test_client.py::test_traceback_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 33%] 1377s tests/test_client.py::test_upload_file <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 33%] 1378s tests/test_client.py::test_upload_file_refresh_delayed <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 33%] 1378s tests/test_client.py::test_upload_file_no_extension <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 33%] 1379s tests/test_client.py::test_upload_file_zip <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py FAILED [ 33%] 1379s tests/test_client.py::test_upload_file_egg <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 33%] 1379s tests/test_client.py::test_upload_large_file <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 33%] 1381s tests/test_client.py::test_upload_file_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 33%] 1382s tests/test_client.py::test_upload_file_exception <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 33%] 1384s tests/test_client.py::test_upload_file_exception_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 33%] 1384s tests/test_client.py::test_upload_file_load <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 33%] 1384s tests/test_client.py::test_upload_file_new_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 33%] 1384s tests/test_client.py::test_multiple_clients <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 34%] 1385s tests/test_client.py::test_async_compute <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 34%] 1385s tests/test_client.py::test_async_compute_with_scatter <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 34%] 1387s tests/test_client.py::test_sync_compute <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 34%] 1387s tests/test_client.py::test_remote_scatter_gather <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 34%] 1387s tests/test_client.py::test_remote_submit_on_Future <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 34%] 1390s tests/test_client.py::test_start_is_idempotent <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 34%] 1390s tests/test_client.py::test_client_with_scheduler <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 34%] 1390s tests/test_client.py::test_allow_restrictions <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 34%] 1391s tests/test_client.py::test_bad_address <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 34%] 1391s tests/test_client.py::test_informative_error_on_cluster_type <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 34%] 1391s tests/test_client.py::test_long_error <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 34%] 1391s tests/test_client.py::test_map_on_futures_with_kwargs <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 34%] 1391s tests/test_client.py::test_badly_serialized_input_stderr <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 34%] 1393s tests/test_client.py::test_repr[str] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 34%] 1396s tests/test_client.py::test_repr[repr] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 34%] 1399s tests/test_client.py::test_repr[func2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 34%] 1399s tests/test_client.py::test_repr_async <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 34%] 1399s tests/test_client.py::test_repr_no_memory_limit <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 34%] 1399s tests/test_client.py::test_forget_simple <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 34%] 1400s tests/test_client.py::test_forget_complex <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 34%] 1400s tests/test_client.py::test_forget_in_flight <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 34%] 1400s tests/test_client.py::test_forget_errors <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 34%] 1402s tests/test_client.py::test_repr_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 34%] 1403s tests/test_client.py::test_multi_client <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 34%] 1405s tests/test_client.py::test_cleanup_after_broken_client_connection <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 34%] 1405s tests/test_client.py::test_multi_garbage_collection <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 34%] 1405s tests/test_client.py::test__broadcast <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 34%] 1405s tests/test_client.py::test__broadcast_integer <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 34%] 1406s tests/test_client.py::test__broadcast_dict <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 34%] 1406s tests/test_client.py::test_proxy <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 34%] 1406s tests/test_client.py::test_cancel <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 34%] 1406s tests/test_client.py::test_cancel_tuple_key <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 1406s tests/test_client.py::test_cancel_multi_client <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 1407s tests/test_client.py::test_cancel_before_known_to_scheduler <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 1407s tests/test_client.py::test_cancel_collection <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 1409s tests/test_client.py::test_cancel_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 1409s tests/test_client.py::test_future_type <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 1409s tests/test_client.py::test_traceback_clean <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 1410s tests/test_client.py::test_map_differnet_lengths <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 1412s tests/test_client.py::test_Future_exception_sync_2 <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 1412s tests/test_client.py::test_async_persist <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 1412s tests/test_client.py::test__persist <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 1415s tests/test_client.py::test_persist <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 1415s tests/test_client.py::test_long_traceback <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 1415s tests/test_client.py::test_wait_on_collections <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 1416s tests/test_client.py::test_futures_of_get <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 1416s tests/test_client.py::test_futures_of_class <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 1416s tests/test_client.py::test_futures_of_cancelled_raises <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 1416s tests/test_client.py::test_dont_delete_recomputed_results <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 35%] 1416s tests/test_client.py::test_balance_tasks_by_stacks <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 35%] 1416s tests/test_client.py::test_run <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 1416s tests/test_client.py::test_run_handles_picklable_data <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 1419s tests/test_client.py::test_run_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 1419s tests/test_client.py::test_run_coroutine <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 1422s tests/test_client.py::test_run_coroutine_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 1422s tests/test_client.py::test_run_exception <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 1423s tests/test_client.py::test_run_rpc_error <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 1425s tests/test_client.py::test_diagnostic_ui <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 1428s tests/test_client.py::test_diagnostic_nbytes_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 1428s tests/test_client.py::test_diagnostic_nbytes <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 1428s tests/test_client.py::test_worker_aliases <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 1430s tests/test_client.py::test_persist_get_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 1431s tests/test_client.py::test_persist_get <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 1435s tests/test_client.py::test_client_num_fds <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 1435s tests/test_client.py::test_startup_close_startup <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 1437s tests/test_client.py::test_startup_close_startup_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 1437s tests/test_client.py::test_badly_serialized_exceptions <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 1437s tests/test_client.py::test_rebalance <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 1437s tests/test_client.py::test_rebalance_workers_and_keys <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 1438s tests/test_client.py::test_rebalance_unprepared <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 1438s tests/test_client.py::test_rebalance_raises_on_explicit_missing_data <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 1438s tests/test_client.py::test_receive_lost_key <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 1439s tests/test_client.py::test_unrunnable_task_runs <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 1441s tests/test_client.py::test_add_worker_after_tasks <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 1441s tests/test_client.py::test_workers_register_indirect_data <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 1441s tests/test_client.py::test_submit_on_cancelled_future <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 1442s tests/test_client.py::test_replicate <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 1442s tests/test_client.py::test_replicate_tuple_keys <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 1443s tests/test_client.py::test_replicate_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 1443s tests/test_client.py::test_replicate_tree_branching <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 1444s tests/test_client.py::test_client_replicate <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 1444s tests/test_client.py::test_client_replicate_host <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 1447s tests/test_client.py::test_client_replicate_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 1447s tests/test_client.py::test_task_load_adapts_quickly <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 1447s tests/test_client.py::test_even_load_after_fast_functions <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 1447s tests/test_client.py::test_even_load_on_startup <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 1447s tests/test_client.py::test_contiguous_load <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 36%] 1448s tests/test_client.py::test_balanced_with_submit <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 1448s tests/test_client.py::test_balanced_with_submit_and_resident_data <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 1449s tests/test_client.py::test_scheduler_saturates_cores <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 1449s tests/test_client.py::test_scheduler_saturates_cores_random <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 1449s tests/test_client.py::test_cancel_clears_processing <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 1452s tests/test_client.py::test_default_get <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 1453s tests/test_client.py::test_get_scheduler_default_client_config_interleaving <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 1453s tests/test_client.py::test_ensure_default_client <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 1453s tests/test_client.py::test_set_as_default <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 1453s tests/test_client.py::test_get_foo <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 1454s tests/test_client.py::test_get_foo_lost_keys <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 1454s tests/test_client.py::test_bad_tasks_fail <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 37%] 1456s tests/test_client.py::test_get_processing_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 1459s tests/test_client.py::test_close_idempotent <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 1461s tests/test_client.py::test_get_returns_early <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 1461s tests/test_client.py::test_Client_clears_references_after_restart <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 37%] 1464s tests/test_client.py::test_get_stops_work_after_error <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 1466s tests/test_client.py::test_as_completed_list <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 1468s tests/test_client.py::test_as_completed_results <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 1471s tests/test_client.py::test_as_completed_batches[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 1474s tests/test_client.py::test_as_completed_batches[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 1477s tests/test_client.py::test_as_completed_next_batch <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 1477s tests/test_client.py::test_status <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 1477s tests/test_client.py::test_persist_optimize_graph <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 1477s tests/test_client.py::test_scatter_raises_if_no_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 1477s tests/test_client.py::test_reconnect <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 37%] 1478s tests/test_client.py::test_reconnect_timeout <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 1479s tests/test_client.py::test_idempotence <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 1481s tests/test_client.py::test_scheduler_info <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 1483s tests/test_client.py::test_write_scheduler_file <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 1487s tests/test_client.py::test_get_versions_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 1487s tests/test_client.py::test_get_versions_async <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 1487s tests/test_client.py::test_get_versions_rpc_error <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 1490s tests/test_client.py::test_threaded_get_within_distributed <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 1490s tests/test_client.py::test_lose_scattered_data <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 1491s tests/test_client.py::test_partially_lose_scattered_data <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 1491s tests/test_client.py::test_scatter_compute_lose <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 1491s tests/test_client.py::test_scatter_compute_store_lose <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 1492s tests/test_client.py::test_scatter_compute_store_lose_processing <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 1492s tests/test_client.py::test_serialize_future <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 1492s tests/test_client.py::test_serialize_future_without_client <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 1492s tests/test_client.py::test_temp_default_client <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 1492s tests/test_client.py::test_as_current <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 1494s tests/test_client.py::test_as_current_is_thread_local <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 1495s tests/test_client.py::test_as_current_is_task_local <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 1495s tests/test_client.py::test_persist_workers_annotate <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 1495s tests/test_client.py::test_persist_workers_annotate2 <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 1495s tests/test_client.py::test_persist_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 1496s tests/test_client.py::test_compute_workers_annotate <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 1496s tests/test_client.py::test_compute_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 1496s tests/test_client.py::test_compute_nested_containers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 1496s tests/test_client.py::test_scatter_type <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 1496s tests/test_client.py::test_retire_workers_2 <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 1497s tests/test_client.py::test_retire_many_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 1497s tests/test_client.py::test_weight_occupancy_against_data_movement <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 1498s tests/test_client.py::test_distribute_tasks_by_nthreads <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 1498s tests/test_client.py::test_add_done_callback <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 1498s tests/test_client.py::test_normalize_collection <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 1498s tests/test_client.py::test_normalize_collection_dask_array <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 1498s tests/test_client.py::test_normalize_collection_with_released_futures <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 38%] 1499s tests/test_client.py::test_auto_normalize_collection <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py XPASS [ 38%] 1501s tests/test_client.py::test_auto_normalize_collection_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py XPASS [ 38%] 1502s tests/test_client.py::test_interleave_computations <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 1502s tests/test_client.py::test_interleave_computations_map <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 38%] 1502s tests/test_client.py::test_scatter_dict_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 1502s tests/test_client.py::test_client_timeout <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 38%] 1502s tests/test_client.py::test_submit_list_kwargs <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 1502s tests/test_client.py::test_map_list_kwargs <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 1503s tests/test_client.py::test_recreate_error_delayed <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 1503s tests/test_client.py::test_recreate_error_futures <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 1503s tests/test_client.py::test_recreate_error_collection <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 1503s tests/test_client.py::test_recreate_error_array <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 39%] 1506s tests/test_client.py::test_recreate_error_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 1508s tests/test_client.py::test_recreate_error_not_error <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 1508s tests/test_client.py::test_recreate_task_delayed <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 1508s tests/test_client.py::test_recreate_task_futures <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 1509s tests/test_client.py::test_recreate_task_collection <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 1509s tests/test_client.py::test_recreate_task_array <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 1511s tests/test_client.py::test_recreate_task_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 1511s tests/test_client.py::test_retire_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 1511s tests/test_client.py::test_restart_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 39%] 1511s tests/test_client.py::test_restart_workers_no_nanny_raises <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 1511s tests/test_client.py::test_restart_workers_kill_timeout[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 39%] 1511s tests/test_client.py::test_restart_workers_kill_timeout[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 39%] 1511s tests/test_client.py::test_restart_workers_restart_timeout[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 39%] 1511s tests/test_client.py::test_restart_workers_restart_timeout[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 39%] 1512s tests/test_client.py::test_restart_workers_exception <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 39%] 1512s tests/test_client.py::test_restart_workers_by_name[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 39%] 1512s tests/test_client.py::test_restart_workers_by_name[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 39%] 1512s tests/test_client.py::test_robust_unserializable <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 1512s tests/test_client.py::test_robust_undeserializable <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 1512s tests/test_client.py::test_robust_undeserializable_function <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 1512s tests/test_client.py::test_fire_and_forget <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 1513s tests/test_client.py::test_fire_and_forget_err <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 1513s tests/test_client.py::test_close <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 1516s tests/test_client.py::test_threadsafe <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 1516s tests/test_client.py::test_threadsafe_get <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 39%] 1516s tests/test_client.py::test_threadsafe_compute <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 39%] 1516s tests/test_client.py::test_identity <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 1516s tests/test_client.py::test_get_client <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 1516s tests/test_client.py::test_get_client_no_cluster <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 1517s tests/test_client.py::test_serialize_collections <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 1517s tests/test_client.py::test_secede_simple <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 1518s tests/test_client.py::test_secede_balances <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 1518s tests/test_client.py::test_long_running_not_in_occupancy[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 1518s tests/test_client.py::test_long_running_not_in_occupancy[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 1518s tests/test_client.py::test_long_running_removal_clean[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 1518s tests/test_client.py::test_long_running_removal_clean[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 1519s tests/test_client.py::test_sub_submit_priority <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 1521s tests/test_client.py::test_get_client_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 1521s tests/test_client.py::test_serialize_collections_of_futures <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 1524s tests/test_client.py::test_serialize_collections_of_futures_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 1527s tests/test_client.py::test_dynamic_workloads_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 1527s tests/test_client.py::test_dynamic_workloads_sync_random <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 40%] 1528s tests/test_client.py::test_bytes_keys <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 1528s tests/test_client.py::test_unicode_ascii_keys <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 1528s tests/test_client.py::test_unicode_keys <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 1530s tests/test_client.py::test_use_synchronous_client_in_async_context <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 1533s tests/test_client.py::test_quiet_quit_when_cluster_leaves <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 1534s tests/test_client.py::test_call_stack_future <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 1534s tests/test_client.py::test_call_stack_all <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 1536s tests/test_client.py::test_call_stack_collections <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 1537s tests/test_client.py::test_call_stack_collections_all <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 1538s tests/test_client.py::test_profile <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 1539s tests/test_client.py::test_profile_disabled <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 1540s tests/test_client.py::test_profile_keys <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 1540s tests/test_client.py::test_client_with_name <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 1541s tests/test_client.py::test_future_defaults_to_default_client <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 1541s tests/test_client.py::test_future_auto_inform <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 1541s tests/test_client.py::test_client_async_before_loop_starts <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 1541s tests/test_client.py::test_nested_compute <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 40%] 1541s tests/test_client.py::test_task_metadata <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 1544s tests/test_client.py::test_logs <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 1545s tests/test_client.py::test_logs_from_worker_submodules <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 1546s tests/test_client.py::test_avoid_delayed_finalize <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 1546s tests/test_client.py::test_config_scheduler_address <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 1546s tests/test_client.py::test_warn_when_submitting_large_values <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 1546s tests/test_client.py::test_warn_when_submitting_large_values_memoryview <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 1547s tests/test_client.py::test_unhashable_function <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 1547s tests/test_client.py::test_client_name <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 1549s tests/test_client.py::test_client_doesnt_close_given_loop <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 1549s tests/test_client.py::test_quiet_scheduler_loss <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 41%] 1551s tests/test_client.py::test_dashboard_link <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 1551s tests/test_client.py::test_client_timeout_2 <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 1552s tests/test_client.py::test_turn_off_pickle[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 1552s tests/test_client.py::test_turn_off_pickle[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 1552s tests/test_client.py::test_de_serialization <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 1553s tests/test_client.py::test_de_serialization_none <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 1553s tests/test_client.py::test_client_repr_closed <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 1553s tests/test_client.py::test_client_repr_closed_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 41%] 1553s tests/test_client.py::test_nested_prioritization <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py XPASS [ 41%] 1553s tests/test_client.py::test_scatter_error_cancel <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 1554s tests/test_client.py::test_scatter_and_replicate_avoid_paused_workers[False-False-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 1554s tests/test_client.py::test_scatter_and_replicate_avoid_paused_workers[False-False-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 1555s tests/test_client.py::test_scatter_and_replicate_avoid_paused_workers[False-True-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 1555s tests/test_client.py::test_scatter_and_replicate_avoid_paused_workers[False-True-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 1556s tests/test_client.py::test_scatter_and_replicate_avoid_paused_workers[True-False-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 1557s tests/test_client.py::test_scatter_and_replicate_avoid_paused_workers[True-False-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 1557s tests/test_client.py::test_scatter_and_replicate_avoid_paused_workers[True-True-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 1558s tests/test_client.py::test_scatter_and_replicate_avoid_paused_workers[True-True-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 1558s tests/test_client.py::test_scatter_and_replicate_avoid_paused_workers[10-False-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 1559s tests/test_client.py::test_scatter_and_replicate_avoid_paused_workers[10-False-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 1560s tests/test_client.py::test_scatter_and_replicate_avoid_paused_workers[10-True-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 1560s tests/test_client.py::test_scatter_and_replicate_avoid_paused_workers[10-True-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 1560s tests/test_client.py::test_no_threads_lingering <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py XPASS [ 41%] 1560s tests/test_client.py::test_direct_async <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 1563s tests/test_client.py::test_direct_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 1563s tests/test_client.py::test_mixing_clients_same_scheduler <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 1563s tests/test_client.py::test_tuple_keys <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 1563s tests/test_client.py::test_multiple_scatter <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 1566s tests/test_client.py::test_map_large_kwargs_in_graph <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 1566s tests/test_client.py::test_retry <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 1566s tests/test_client.py::test_retry_dependencies <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 1566s tests/test_client.py::test_released_dependencies <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 1566s tests/test_client.py::test_profile_bokeh <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 42%] 1567s tests/test_client.py::test_get_mix_futures_and_SubgraphCallable <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 1567s tests/test_client.py::test_get_mix_futures_and_SubgraphCallable_dask_dataframe <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 1569s tests/test_client.py::test_direct_to_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 1569s tests/test_client.py::test_instances <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 1570s tests/test_client.py::test_wait_for_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 1572s tests/test_client.py::test_config_inherited_by_subprocess <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 1572s tests/test_client.py::test_futures_of_sorted <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 1574s tests/test_client.py::test_profile_server <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 1576s tests/test_client.py::test_profile_server_disabled <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 1576s tests/test_client.py::test_await_future <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 1577s tests/test_client.py::test_as_completed_async_for <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 1577s tests/test_client.py::test_as_completed_async_for_results <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 1577s tests/test_client.py::test_as_completed_async_for_cancel <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 1579s tests/test_client.py::test_client_sync_with_async_def <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 1579s tests/test_client.py::test_dont_hold_on_to_large_messages <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 42%] 1579s tests/test_client.py::test_run_on_scheduler_async_def <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 1580s tests/test_client.py::test_run_on_scheduler_async_def_wait <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 1580s tests/test_client.py::test_performance_report[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 42%] 1580s tests/test_client.py::test_performance_report[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 42%] 1580s tests/test_client.py::test_client_gather_semaphore_loop <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 42%] 1580s tests/test_client.py::test_as_completed_condition_loop <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 1580s tests/test_client.py::test_client_connectionpool_semaphore_loop <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 42%] 1580s tests/test_client.py::test_mixed_compression <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 42%] 1580s tests/test_client.py::test_get_task_metadata <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 1580s tests/test_client.py::test_get_task_metadata_multiple <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 1580s tests/test_client.py::test_register_worker_plugin_exception <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 1581s tests/test_client.py::test_log_event <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 1581s tests/test_client.py::test_log_event_multiple_clients <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 1581s tests/test_client.py::test_annotations_task_state <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 1581s tests/test_client.py::test_annotations_compute_time[compute] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 1581s tests/test_client.py::test_annotations_compute_time[persist] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 1582s tests/test_client.py::test_annotations_survive_optimization <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py XFAIL [ 43%] 1582s tests/test_client.py::test_annotations_priorities <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 1582s tests/test_client.py::test_annotations_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 1582s tests/test_client.py::test_annotations_retries <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 1583s tests/test_client.py::test_annotations_blockwise_unpack <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 1583s tests/test_client.py::test_annotations_resources <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 1583s tests/test_client.py::test_annotations_resources_culled <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 1583s tests/test_client.py::test_annotations_loose_restrictions <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 1584s tests/test_client.py::test_annotations_submit_map <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 1584s tests/test_client.py::test_annotations_global_vs_local <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 1584s tests/test_client.py::test_workers_collection_restriction <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 1584s tests/test_client.py::test_get_client_functions_spawn_clusters <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 43%] 1584s tests/test_client.py::test_computation_code_walk_frames <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 1584s tests/test_client.py::test_computation_ignore_ipython_frames[2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 43%] 1584s tests/test_client.py::test_computation_ignore_ipython_frames[3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 43%] 1585s tests/test_client.py::test_computation_store_annotations <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 1587s tests/test_client.py::test_computation_object_code_dask_compute <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 1589s tests/test_client.py::test_computation_object_code_dask_compute_no_frames_default <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 1592s tests/test_client.py::test_computation_object_code_not_available <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 43%] 1592s tests/test_client.py::test_computation_object_code_dask_persist <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 1592s tests/test_client.py::test_computation_object_code_client_submit_simple <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 1592s tests/test_client.py::test_computation_object_code_client_submit_list_comp <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 1593s tests/test_client.py::test_computation_object_code_client_submit_dict_comp <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 1593s tests/test_client.py::test_computation_object_code_client_map <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 1593s tests/test_client.py::test_computation_object_code_client_compute <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 1593s tests/test_client.py::test_upload_directory <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 44%] 1593s tests/test_client.py::test_duck_typed_register_plugin_raises <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 1593s tests/test_client.py::test_exception_text <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 1594s tests/test_client.py::test_async_task <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 1594s tests/test_client.py::test_async_task_with_partial <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 1594s tests/test_client.py::test_events_subscribe_topic <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 1594s tests/test_client.py::test_events_subscribe_topic_cancelled <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 1596s tests/test_client.py::test_events_all_servers_use_same_channel <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 1597s tests/test_client.py::test_events_unsubscribe_raises_if_unknown <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 1597s tests/test_client.py::test_log_event_warn <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 1599s tests/test_client.py::test_log_event_msgpack <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 1599s tests/test_client.py::test_log_event_warn_dask_warns <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 1602s tests/test_client.py::test_print_remote <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 1604s tests/test_client.py::test_print_manual <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 1606s tests/test_client.py::test_print_manual_bad_args <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 1608s tests/test_client.py::test_print_non_msgpack_serializable <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 1608s tests/test_client.py::test_print_local <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 1611s tests/test_client.py::test_forward_logging <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 1613s tests/test_client.py::test_dump_cluster_state_write_from_scheduler <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 1616s tests/test_client.py::test_dump_cluster_state_sync[msgpack-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 1618s tests/test_client.py::test_dump_cluster_state_sync[msgpack-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 1621s tests/test_client.py::test_dump_cluster_state_sync[yaml-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 1624s tests/test_client.py::test_dump_cluster_state_sync[yaml-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 1624s tests/test_client.py::test_dump_cluster_state_async[msgpack-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 1624s tests/test_client.py::test_dump_cluster_state_async[msgpack-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 1625s tests/test_client.py::test_dump_cluster_state_async[yaml-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 1625s tests/test_client.py::test_dump_cluster_state_async[yaml-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 1625s tests/test_client.py::test_dump_cluster_state_json[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 1625s tests/test_client.py::test_dump_cluster_state_json[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 1627s tests/test_client.py::test_dump_cluster_state_exclude_default <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 1627s tests/test_client.py::test_benchmark_hardware_no_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 1627s tests/test_client.py::test_wait_for_workers_updates_info <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 45%] 1627s tests/test_client.py::test_quiet_close_process[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 45%] 1627s tests/test_client.py::test_quiet_close_process[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 45%] 1627s tests/test_client.py::test_deprecated_loop_properties <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 45%] 1627s tests/test_client.py::test_fast_close_on_aexit_failure <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 45%] 1627s tests/test_client.py::test_wait_for_workers_n_workers_value_check[None-ValueError] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 45%] 1627s tests/test_client.py::test_wait_for_workers_n_workers_value_check[0-ValueError] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 45%] 1628s tests/test_client.py::test_wait_for_workers_n_workers_value_check[1.0-ValueError] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 45%] 1628s tests/test_client.py::test_wait_for_workers_n_workers_value_check[1-None] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 45%] 1628s tests/test_client.py::test_wait_for_workers_n_workers_value_check[2-None] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 45%] 1628s tests/test_client.py::test_unpacks_remotedata_namedtuple[PlainNamedTuple-args0-kwargs0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 45%] 1628s tests/test_client.py::test_unpacks_remotedata_namedtuple[NewArgsNamedTuple-args1-kwargs1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 45%] 1629s tests/test_client.py::test_unpacks_remotedata_namedtuple[NewArgsExNamedTuple-args2-kwargs2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 45%] 1629s tests/test_client.py::test_resolves_future_in_namedtuple[PlainNamedTuple-args0-kwargs0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 45%] 1629s tests/test_client.py::test_resolves_future_in_namedtuple[NewArgsNamedTuple-args1-kwargs1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 45%] 1629s tests/test_client.py::test_resolves_future_in_namedtuple[NewArgsExNamedTuple-args2-kwargs2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 45%] 1630s tests/test_client.py::test_resolves_future_in_dict <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 45%] 1630s tests/test_client.py::test_gather_race_vs_AMM[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 45%] 1630s tests/test_client.py::test_gather_race_vs_AMM[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 45%] 1633s tests/test_client_executor.py::test_submit <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client_executor.py PASSED [ 45%] 1636s tests/test_client_executor.py::test_as_completed <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client_executor.py PASSED [ 45%] 1639s tests/test_client_executor.py::test_wait <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client_executor.py PASSED [ 45%] 1641s tests/test_client_executor.py::test_cancellation <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client_executor.py PASSED [ 45%] 1645s tests/test_client_executor.py::test_cancellation_wait <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client_executor.py PASSED [ 45%] 1648s tests/test_client_executor.py::test_cancellation_as_completed <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client_executor.py PASSED [ 45%] 1648s tests/test_client_executor.py::test_map <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client_executor.py SKIPPED [ 45%] 1651s tests/test_client_executor.py::test_pure <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client_executor.py PASSED [ 45%] 1654s tests/test_client_executor.py::test_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client_executor.py PASSED [ 45%] 1656s tests/test_client_executor.py::test_unsupported_arguments <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client_executor.py PASSED [ 45%] 1658s tests/test_client_executor.py::test_retries <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client_executor.py PASSED [ 45%] 1662s tests/test_client_executor.py::test_shutdown_wait <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client_executor.py PASSED [ 45%] 1664s tests/test_client_executor.py::test_shutdown_nowait <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client_executor.py PASSED [ 45%] 1664s tests/test_cluster_dump.py::test_tuple_to_list[input0-expected0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cluster_dump.py PASSED [ 46%] 1664s tests/test_cluster_dump.py::test_tuple_to_list[input1-expected1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cluster_dump.py PASSED [ 46%] 1664s tests/test_cluster_dump.py::test_tuple_to_list[input2-expected2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cluster_dump.py PASSED [ 46%] 1664s tests/test_cluster_dump.py::test_tuple_to_list[foo-foo] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cluster_dump.py PASSED [ 46%] 1664s tests/test_cluster_dump.py::test_write_state_msgpack <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cluster_dump.py PASSED [ 46%] 1664s tests/test_cluster_dump.py::test_write_state_yaml <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cluster_dump.py PASSED [ 46%] 1665s tests/test_cluster_dump.py::test_cluster_dump_state <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cluster_dump.py PASSED [ 46%] 1665s tests/test_cluster_dump.py::test_cluster_dump_story <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cluster_dump.py PASSED [ 46%] 1665s tests/test_cluster_dump.py::test_cluster_dump_to_yamls <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cluster_dump.py PASSED [ 46%] 1665s tests/test_collections.py::test_lru <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_collections.py PASSED [ 46%] 1665s tests/test_collections.py::test_heapset <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_collections.py PASSED [ 46%] 1665s tests/test_collections.py::test_heapset_sorted_flag_left <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_collections.py PASSED [ 46%] 1665s tests/test_collections.py::test_heapset_sorted_flag_right <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_collections.py PASSED [ 46%] 1665s tests/test_collections.py::test_heapset_popright[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_collections.py PASSED [ 46%] 1665s tests/test_collections.py::test_heapset_popright[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_collections.py PASSED [ 46%] 1665s tests/test_collections.py::test_heapset_pickle <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_collections.py PASSED [ 46%] 1665s tests/test_collections.py::test_heapset_sort_duplicate <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_collections.py PASSED [ 46%] 1665s tests/test_collections.py::test_sum_mappings <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_collections.py PASSED [ 46%] 1665s tests/test_compatibility.py::test_randbytes <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_compatibility.py PASSED [ 46%] 1665s tests/test_compatibility.py::test_randbytes_seed <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_compatibility.py PASSED [ 46%] 1666s tests/test_computations.py::test_computations <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_computations.py PASSED [ 46%] 1666s tests/test_computations.py::test_computations_futures <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_computations.py PASSED [ 46%] 1666s tests/test_computations.py::test_computations_no_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_computations.py PASSED [ 46%] 1666s tests/test_computations.py::test_computations_no_resources <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_computations.py PASSED [ 46%] 1667s tests/test_computations.py::test_computations_long_running <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_computations.py PASSED [ 46%] 1667s tests/test_config.py::test_logging_default[config0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_config.py PASSED [ 46%] 1667s tests/test_config.py::test_logging_default[None] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_config.py PASSED [ 46%] 1668s tests/test_config.py::test_logging_simple_under_distributed <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_config.py PASSED [ 46%] 1669s tests/test_config.py::test_logging_simple <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_config.py PASSED [ 46%] 1671s tests/test_config.py::test_logging_extended <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_config.py PASSED [ 46%] 1672s tests/test_config.py::test_default_logging_does_not_override_basic_config <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_config.py PASSED [ 46%] 1673s tests/test_config.py::test_basic_config_does_not_override_default_logging <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_config.py PASSED [ 46%] 1673s tests/test_config.py::test_logging_mutual_exclusive <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_config.py PASSED [ 47%] 1674s tests/test_config.py::test_logging_file_config <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_config.py PASSED [ 47%] 1675s tests/test_config.py::test_schema <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_config.py PASSED [ 47%] 1675s tests/test_config.py::test_schema_is_complete <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_config.py PASSED [ 47%] 1675s tests/test_config.py::test_uvloop_event_loop <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_config.py SKIPPED [ 47%] 1675s tests/test_config.py::test_deprecations_on_set[args0-kwargs0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_config.py PASSED [ 47%] 1675s tests/test_config.py::test_deprecations_on_set[args1-kwargs1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_config.py PASSED [ 47%] 1675s tests/test_config.py::test_deprecations_on_set[args2-kwargs2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_config.py PASSED [ 47%] 1675s tests/test_config.py::test_deprecations_on_env_variables <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_config.py PASSED [ 47%] 1675s tests/test_config.py::test_deprecations_on_yaml[allowed-failures] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_config.py PASSED [ 47%] 1675s tests/test_config.py::test_deprecations_on_yaml[allowed_failures] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_config.py PASSED [ 47%] 1675s tests/test_core.py::test_async_task_group_initialization <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 47%] 1675s tests/test_core.py::test_async_task_group_call_soon_executes_task_in_background <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 47%] 1676s tests/test_core.py::test_async_task_group_call_later_executes_delayed_task_in_background <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 47%] 1676s tests/test_core.py::test_async_task_group_close_closes <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 47%] 1676s tests/test_core.py::test_async_task_group_close_does_not_cancel_existing_tasks <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 47%] 1676s tests/test_core.py::test_async_task_group_close_prohibits_new_tasks <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 47%] 1676s tests/test_core.py::test_async_task_group_stop_disallows_shutdown <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 47%] 1676s tests/test_core.py::test_async_task_group_stop_cancels_long_running <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 47%] 1676s tests/test_core.py::test_rpc_inputs <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 47%] 1676s tests/test_core.py::test_large_packets_tcp <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py SKIPPED [ 47%] 1676s tests/test_core.py::test_connect_raises <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 47%] 1676s tests/test_core.py::test_coerce_to_address <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 47%] 1676s tests/test_core.py::test_remove_cancels_connect_attempts <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 47%] 1676s tests/test_core.py::test_remove_cancels_connect_before_task_running <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 47%] 1676s tests/test_core.py::test_ticks <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py SKIPPED [ 47%] 1677s tests/test_core.py::test_tick_logging <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py SKIPPED [ 47%] 1677s tests/test_core.py::test_thread_id <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 47%] 1677s tests/test_core.py::test_expects_comm <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 47%] 1677s tests/test_core.py::test_async_listener_stop <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 47%] 1677s tests/test_core.py::test_large_payload <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py SKIPPED [ 47%] 1677s tests/test_counter.py::test_digest[Counter-] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_counter.py PASSED [ 48%] 1677s tests/test_counter.py::test_digest[None-] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_counter.py SKIPPED [ 48%] 1677s tests/test_counter.py::test_counter <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_counter.py PASSED [ 48%] 1678s tests/test_dask_collections.py::test_dask_array_collections <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_dask_collections.py PASSED [ 48%] 1678s tests/test_dask_collections.py::test_bag_groupby_tasks_default <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_dask_collections.py PASSED [ 48%] 1680s tests/test_dask_collections.py::test_bag_groupby_key_hashing <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_dask_collections.py PASSED [ 48%] 1684s tests/test_dask_collections.py::test_dataframe_set_index_sync[wait] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_dask_collections.py PASSED [ 48%] 1688s tests/test_dask_collections.py::test_dataframe_set_index_sync[] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_dask_collections.py PASSED [ 48%] 1691s tests/test_dask_collections.py::test_loc_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_dask_collections.py PASSED [ 48%] 1691s tests/test_dask_collections.py::test_loc <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_dask_collections.py PASSED [ 48%] 1692s tests/test_dask_collections.py::test_sparse_arrays <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_dask_collections.py SKIPPED [ 48%] 1692s tests/test_dask_collections.py::test_delayed_none <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_dask_collections.py PASSED [ 48%] 1695s tests/test_dask_collections.py::test_tuple_futures_arg[tuple] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_dask_collections.py PASSED [ 48%] 1698s tests/test_dask_collections.py::test_tuple_futures_arg[list] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_dask_collections.py PASSED [ 48%] 1698s tests/test_deadline.py::test_deadline <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_deadline.py PASSED [ 48%] 1698s tests/test_deadline.py::test_infinite_deadline <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_deadline.py PASSED [ 48%] 1698s tests/test_deadline.py::test_deadline_progress <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_deadline.py PASSED [ 48%] 1698s tests/test_deadline.py::test_deadline_expiration <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_deadline.py PASSED [ 48%] 1698s tests/test_deadline.py::test_deadline_expiration_async <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_deadline.py PASSED [ 48%] 1699s tests/test_diskutils.py::test_workdir_simple <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_diskutils.py PASSED [ 48%] 1699s tests/test_diskutils.py::test_two_workspaces_in_same_directory <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_diskutils.py PASSED [ 48%] 1700s tests/test_diskutils.py::test_workspace_process_crash <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_diskutils.py PASSED [ 48%] 1700s tests/test_diskutils.py::test_workspace_rmtree_failure <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_diskutils.py PASSED [ 48%] 1701s tests/test_diskutils.py::test_locking_disabled <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_diskutils.py PASSED [ 48%] 1701s tests/test_diskutils.py::test_workspace_concurrency <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_diskutils.py SKIPPED [ 48%] 1701s tests/test_diskutils.py::test_unwritable_base_dir <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_diskutils.py PASSED [ 48%] 1701s tests/test_events.py::test_event_on_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_events.py PASSED [ 48%] 1701s tests/test_events.py::test_default_event <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_events.py PASSED [ 48%] 1701s tests/test_events.py::test_set_not_set <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_events.py PASSED [ 48%] 1702s tests/test_events.py::test_set_not_set_many_events <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_events.py PASSED [ 48%] 1703s tests/test_events.py::test_timeout <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_events.py PASSED [ 48%] 1707s tests/test_events.py::test_event_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_events.py PASSED [ 48%] 1707s tests/test_events.py::test_event_types <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_events.py PASSED [ 49%] 1707s tests/test_events.py::test_serializable <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_events.py PASSED [ 49%] 1707s tests/test_events.py::test_two_events_on_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_events.py PASSED [ 49%] 1707s tests/test_events.py::test_unpickle_without_client <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_events.py PASSED [ 49%] 1707s tests/test_failed_workers.py::test_submit_after_failed_worker_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py SKIPPED [ 49%] 1707s tests/test_failed_workers.py::test_submit_after_failed_worker_async[False-False-closing] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py PASSED [ 49%] 1707s tests/test_failed_workers.py::test_submit_after_failed_worker_async[False-False-closed] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py PASSED [ 49%] 1708s tests/test_failed_workers.py::test_submit_after_failed_worker_async[False-True-closing] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py PASSED [ 49%] 1708s tests/test_failed_workers.py::test_submit_after_failed_worker_async[False-True-closed] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py PASSED [ 49%] 1708s tests/test_failed_workers.py::test_submit_after_failed_worker_async[True-False-closing] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py PASSED [ 49%] 1708s tests/test_failed_workers.py::test_submit_after_failed_worker_async[True-False-closed] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py PASSED [ 49%] 1709s tests/test_failed_workers.py::test_submit_after_failed_worker_async[True-True-closing] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py PASSED [ 49%] 1709s tests/test_failed_workers.py::test_submit_after_failed_worker_async[True-True-closed] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py PASSED [ 49%] 1709s tests/test_failed_workers.py::test_submit_after_failed_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py PASSED [ 49%] 1709s tests/test_failed_workers.py::test_gather_after_failed_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py SKIPPED [ 49%] 1709s tests/test_failed_workers.py::test_gather_then_submit_after_failed_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py SKIPPED [ 49%] 1714s tests/test_failed_workers.py::test_restart <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py PASSED [ 49%] 1718s tests/test_failed_workers.py::test_restart_cleared <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py PASSED [ 49%] 1725s tests/test_failed_workers.py::test_restart_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py PASSED [ 49%] 1732s tests/test_failed_workers.py::test_worker_doesnt_await_task_completion <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py PASSED [ 49%] 1737s tests/test_failed_workers.py::test_multiple_clients_restart <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py PASSED [ 49%] 1742s tests/test_failed_workers.py::test_restart_scheduler <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py PASSED [ 49%] 1746s tests/test_failed_workers.py::test_forgotten_futures_dont_clean_up_new_futures <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py PASSED [ 49%] 1746s tests/test_failed_workers.py::test_broken_worker_during_computation <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py SKIPPED [ 49%] 1751s tests/test_failed_workers.py::test_restart_during_computation <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py PASSED [ 49%] 1751s tests/test_failed_workers.py::test_worker_who_has_clears_after_failed_connection <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py SKIPPED [ 49%] 1753s tests/test_failed_workers.py::test_worker_same_host_replicas_missing <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py PASSED [ 49%] 1753s tests/test_failed_workers.py::test_restart_timeout_on_long_running_task <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py SKIPPED [ 49%] 1753s tests/test_failed_workers.py::test_worker_time_to_live <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py SKIPPED [ 49%] 1753s tests/test_failed_workers.py::test_worker_ttl_restarts_worker[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py SKIPPED [ 49%] 1753s tests/test_failed_workers.py::test_worker_ttl_restarts_worker[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py SKIPPED [ 49%] 1753s tests/test_failed_workers.py::test_restart_hung_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py SKIPPED [ 49%] 1753s tests/test_failed_workers.py::test_forget_data_not_supposed_to_have <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py PASSED [ 50%] 1755s tests/test_failed_workers.py::test_failing_worker_with_additional_replicas_on_cluster <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py PASSED [ 50%] 1756s tests/test_imports.py::test_can_import_distributed_in_background_thread <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_imports.py PASSED [ 50%] 1756s tests/test_init.py::test_version <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_init.py PASSED [ 50%] 1756s tests/test_itertools.py::test_ffill <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_itertools.py PASSED [ 50%] 1756s tests/test_jupyter.py::test_jupyter_cli <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_jupyter.py SKIPPED [ 50%] 1758s tests/test_locks.py::test_lock <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_locks.py PASSED [ 50%] 1758s tests/test_locks.py::test_timeout <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_locks.py PASSED [ 50%] 1759s tests/test_locks.py::test_acquires_with_zero_timeout <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_locks.py PASSED [ 50%] 1759s tests/test_locks.py::test_acquires_blocking <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_locks.py PASSED [ 50%] 1761s tests/test_locks.py::test_timeout_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_locks.py PASSED [ 50%] 1764s tests/test_locks.py::test_lock_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_locks.py PASSED [ 50%] 1764s tests/test_locks.py::test_lock_types <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_locks.py PASSED [ 50%] 1765s tests/test_locks.py::test_serializable <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_locks.py PASSED [ 50%] 1765s tests/test_locks.py::test_locks <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_locks.py PASSED [ 50%] 1765s tests/test_metrics.py::test_wall_clock[time] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_metrics.py PASSED [ 50%] 1765s tests/test_metrics.py::test_wall_clock[monotonic] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_metrics.py PASSED [ 50%] 1765s tests/test_metrics.py::test_monotonic <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_metrics.py SKIPPED [ 50%] 1765s tests/test_metrics.py::test_meter <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_metrics.py PASSED [ 50%] 1765s tests/test_metrics.py::test_meter_raise <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_metrics.py PASSED [ 50%] 1765s tests/test_metrics.py::test_meter_floor[kwargs0-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_metrics.py PASSED [ 50%] 1765s tests/test_metrics.py::test_meter_floor[kwargs1-0.1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_metrics.py PASSED [ 50%] 1765s tests/test_metrics.py::test_meter_floor[kwargs2--1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_metrics.py PASSED [ 50%] 1765s tests/test_metrics.py::test_context_meter <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_metrics.py PASSED [ 50%] 1765s tests/test_metrics.py::test_context_meter_raise <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_metrics.py PASSED [ 50%] 1765s tests/test_metrics.py::test_context_meter_nested <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_metrics.py PASSED [ 50%] 1765s tests/test_metrics.py::test_context_meter_decorator <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_metrics.py PASSED [ 50%] 1765s tests/test_metrics.py::test_context_meter_nested_floor <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_metrics.py PASSED [ 50%] 1765s tests/test_metrics.py::test_context_meter_pickle <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_metrics.py PASSED [ 50%] 1765s tests/test_metrics.py::test_context_meter_clear_callbacks <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_metrics.py PASSED [ 50%] 1765s tests/test_metrics.py::test_context_meter_clear_callbacks_raises <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_metrics.py PASSED [ 50%] 1765s tests/test_metrics.py::test_context_meter_allow_offload <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_metrics.py PASSED [ 50%] 1765s tests/test_metrics.py::test_delayed_metrics_ledger <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_metrics.py PASSED [ 51%] 1765s tests/test_metrics.py::test_context_meter_keyed <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_metrics.py PASSED [ 51%] 1765s tests/test_metrics.py::test_delayed_metrics_ledger_keyed <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_metrics.py PASSED [ 51%] 1766s tests/test_multi_locks.py::test_single_lock <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_multi_locks.py PASSED [ 51%] 1767s tests/test_multi_locks.py::test_timeout <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_multi_locks.py PASSED [ 51%] 1768s tests/test_multi_locks.py::test_timeout_wake_waiter <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_multi_locks.py PASSED [ 51%] 1768s tests/test_multi_locks.py::test_multiple_locks <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_multi_locks.py PASSED [ 51%] 1768s tests/test_multi_locks.py::test_num_locks <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_multi_locks.py PASSED [ 51%] 1770s tests/test_nanny.py::test_str <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 51%] 1774s tests/test_nanny.py::test_nanny_process_failure <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 51%] 1776s tests/test_nanny.py::test_run <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 51%] 1776s tests/test_nanny.py::test_no_hang_when_scheduler_closes <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py SKIPPED [ 51%] 1776s tests/test_nanny.py::test_close_on_disconnect <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py SKIPPED [ 51%] 1778s tests/test_nanny.py::test_nanny_worker_class <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 51%] 1782s tests/test_nanny.py::test_nanny_alt_worker_class <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 51%] 1782s tests/test_nanny.py::test_nanny_death_timeout <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py SKIPPED [ 51%] 1784s tests/test_nanny.py::test_random_seed <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 51%] 1793s tests/test_nanny.py::test_num_fds <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 51%] 1795s tests/test_nanny.py::test_nanny_timeout <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 51%] 1796s tests/test_nanny.py::test_throttle_outgoing_transfers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 51%] 1798s tests/test_nanny.py::test_scheduler_address_config <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 51%] 1798s tests/test_nanny.py::test_wait_for_scheduler <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py SKIPPED [ 51%] 1800s tests/test_nanny.py::test_environment_variable <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 51%] 1803s tests/test_nanny.py::test_environment_variable_by_config <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 51%] 1805s tests/test_nanny.py::test_environment_variable_config <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 51%] 1807s tests/test_nanny.py::test_environment_variable_pre_post_spawn <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 51%] 1809s tests/test_nanny.py::test_environment_variable_overlay <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 51%] 1811s tests/test_nanny.py::test_config_param_overlays <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 51%] 1813s tests/test_nanny.py::test_local_directory <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 51%] 1816s tests/test_nanny.py::test_unwriteable_dask_worker_space <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 51%] 1819s tests/test_nanny.py::test_mp_process_worker_no_daemon <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 51%] 1823s tests/test_nanny.py::test_mp_pool_worker_no_daemon <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 51%] 1825s tests/test_nanny.py::test_nanny_closes_cleanly <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 52%] 1825s tests/test_nanny.py::test_lifetime <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py SKIPPED [ 52%] 1829s tests/test_nanny.py::test_nanny_closes_cleanly_if_worker_is_terminated <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 52%] 1831s tests/test_nanny.py::test_config <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 52%] 1835s tests/test_nanny.py::test_nanny_port_range <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 52%] 1835s tests/test_nanny.py::test_nanny_closed_by_keyboard_interrupt[tcp] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py SKIPPED [ 52%] 1835s tests/test_nanny.py::test_nanny_closed_by_keyboard_interrupt[ucx] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py SKIPPED [ 52%] 1837s tests/test_nanny.py::test_worker_start_exception <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 52%] 1838s tests/test_nanny.py::test_failure_during_worker_initialization <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 52%] 1845s tests/test_nanny.py::test_environ_plugin <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 52%] 1847s tests/test_nanny.py::test_no_unnecessary_imports_on_worker[scipy] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 52%] 1849s tests/test_nanny.py::test_no_unnecessary_imports_on_worker[pandas] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py XFAIL [ 52%] 1849s tests/test_nanny.py::test_repeated_restarts <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py SKIPPED [ 52%] 1849s tests/test_nanny.py::test_restart_memory <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py SKIPPED [ 52%] 1849s tests/test_nanny.py::test_close_joins <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py SKIPPED [ 52%] 1854s tests/test_nanny.py::test_scheduler_crash_doesnt_restart <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 52%] 1854s tests/test_nanny.py::test_malloc_trim_threshold <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py SKIPPED [ 52%] 1856s tests/test_nanny.py::test_default_client_does_not_propagate_to_subprocess <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 52%] 1858s tests/test_nanny.py::test_worker_inherits_temp_config <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 52%] 1860s tests/test_nanny.py::test_log_event <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 52%] 1864s tests/test_nanny.py::test_nanny_plugin_simple <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 52%] 1868s tests/test_nanny.py::test_nanny_plugin_register_during_start_success[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 52%] 1871s tests/test_nanny.py::test_nanny_plugin_register_during_start_success[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 52%] 1871s tests/test_nanny.py::test_nanny_plugin_register_during_start_failure[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 52%] 1871s tests/test_nanny.py::test_nanny_plugin_register_during_start_failure[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 52%] 1872s tests/test_nanny.py::test_nanny_plugin_register_nanny_killed[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 52%] 1874s tests/test_nanny.py::test_nanny_plugin_register_nanny_killed[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 52%] 1876s tests/test_preload.py::test_worker_preload_file <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_preload.py PASSED [ 52%] 1878s tests/test_preload.py::test_worker_preload_config <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_preload.py PASSED [ 52%] 1881s tests/test_preload.py::test_worker_preload_module <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_preload.py PASSED [ 52%] 1881s tests/test_preload.py::test_worker_preload_click <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_preload.py PASSED [ 52%] 1881s tests/test_preload.py::test_worker_preload_click_async <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_preload.py PASSED [ 53%] 1881s tests/test_preload.py::test_web_preload <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_preload.py PASSED [ 53%] 1881s tests/test_preload.py::test_scheduler_startup <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_preload.py PASSED [ 53%] 1883s tests/test_preload.py::test_scheduler_startup_nanny <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_preload.py PASSED [ 53%] 1886s tests/test_preload.py::test_web_preload_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_preload.py PASSED [ 53%] 1886s tests/test_preload.py::test_client_preload_text <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_preload.py XFAIL [ 53%] 1886s tests/test_preload.py::test_client_preload_config <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_preload.py PASSED [ 53%] 1886s tests/test_preload.py::test_client_preload_click <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_preload.py XFAIL [ 53%] 1886s tests/test_preload.py::test_failure_doesnt_crash_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_preload.py PASSED [ 53%] 1888s tests/test_preload.py::test_failure_doesnt_crash_nanny <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_preload.py PASSED [ 53%] 1888s tests/test_preload.py::test_failure_doesnt_crash_client <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_preload.py PASSED [ 53%] 1888s tests/test_preload.py::test_client_preload_config_click <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_preload.py PASSED [ 53%] 1888s tests/test_priorities.py::test_submit[queue on worker] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_priorities.py PASSED [ 53%] 1888s tests/test_priorities.py::test_submit[queue on scheduler] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_priorities.py PASSED [ 53%] 1889s tests/test_priorities.py::test_map[queue on worker] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_priorities.py PASSED [ 53%] 1889s tests/test_priorities.py::test_map[queue on scheduler] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_priorities.py PASSED [ 53%] 1889s tests/test_priorities.py::test_compute[queue on worker] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_priorities.py PASSED [ 53%] 1889s tests/test_priorities.py::test_compute[queue on scheduler] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_priorities.py PASSED [ 53%] 1889s tests/test_priorities.py::test_persist[queue on worker] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_priorities.py PASSED [ 53%] 1890s tests/test_priorities.py::test_persist[queue on scheduler] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_priorities.py PASSED [ 53%] 1890s tests/test_priorities.py::test_annotate_compute[queue on worker] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_priorities.py PASSED [ 53%] 1890s tests/test_priorities.py::test_annotate_compute[queue on scheduler] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_priorities.py PASSED [ 53%] 1890s tests/test_priorities.py::test_annotate_persist[queue on worker] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_priorities.py PASSED [ 53%] 1890s tests/test_priorities.py::test_annotate_persist[queue on scheduler] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_priorities.py PASSED [ 53%] 1891s tests/test_priorities.py::test_repeated_persists_same_priority[queue on worker] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_priorities.py PASSED [ 53%] 1892s tests/test_priorities.py::test_repeated_persists_same_priority[queue on scheduler] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_priorities.py PASSED [ 53%] 1892s tests/test_priorities.py::test_last_in_first_out[queue on worker] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_priorities.py PASSED [ 53%] 1892s tests/test_priorities.py::test_last_in_first_out[queue on scheduler] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_priorities.py PASSED [ 53%] 1895s tests/test_profile.py::test_basic <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 53%] 1895s tests/test_profile.py::test_basic_low_level <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py SKIPPED [ 53%] 1895s tests/test_profile.py::test_merge <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 53%] 1895s tests/test_profile.py::test_merge_empty <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 53%] 1895s tests/test_profile.py::test_call_stack <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 54%] 1895s tests/test_profile.py::test_identifier <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 54%] 1895s tests/test_profile.py::test_watch <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 54%] 1896s tests/test_profile.py::test_watch_requires_lock_to_run <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 54%] 1896s tests/test_profile.py::test_info_frame_f_lineno[-1-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 54%] 1896s tests/test_profile.py::test_info_frame_f_lineno[0-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 54%] 1896s tests/test_profile.py::test_info_frame_f_lineno[1-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 54%] 1896s tests/test_profile.py::test_info_frame_f_lineno[11-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 54%] 1896s tests/test_profile.py::test_info_frame_f_lineno[12-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 54%] 1896s tests/test_profile.py::test_info_frame_f_lineno[21-4] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 54%] 1896s tests/test_profile.py::test_info_frame_f_lineno[22-4] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py FAILED [ 54%] 1896s tests/test_profile.py::test_info_frame_f_lineno[23-4] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py FAILED [ 54%] 1896s tests/test_profile.py::test_info_frame_f_lineno[24-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 54%] 1896s tests/test_profile.py::test_info_frame_f_lineno[25-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 54%] 1896s tests/test_profile.py::test_info_frame_f_lineno[26-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 54%] 1896s tests/test_profile.py::test_info_frame_f_lineno[27-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 54%] 1896s tests/test_profile.py::test_info_frame_f_lineno[100-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 54%] 1896s tests/test_profile.py::test_call_stack_f_lineno[-1-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 54%] 1896s tests/test_profile.py::test_call_stack_f_lineno[0-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 54%] 1896s tests/test_profile.py::test_call_stack_f_lineno[1-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 54%] 1896s tests/test_profile.py::test_call_stack_f_lineno[11-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 54%] 1896s tests/test_profile.py::test_call_stack_f_lineno[12-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 54%] 1896s tests/test_profile.py::test_call_stack_f_lineno[21-4] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 54%] 1896s tests/test_profile.py::test_call_stack_f_lineno[22-4] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py FAILED [ 54%] 1896s tests/test_profile.py::test_call_stack_f_lineno[23-4] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py FAILED [ 54%] 1896s tests/test_profile.py::test_call_stack_f_lineno[24-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 54%] 1896s tests/test_profile.py::test_call_stack_f_lineno[25-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 54%] 1896s tests/test_profile.py::test_call_stack_f_lineno[26-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 54%] 1896s tests/test_profile.py::test_call_stack_f_lineno[27-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 54%] 1896s tests/test_profile.py::test_call_stack_f_lineno[100-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 54%] 1896s tests/test_profile.py::test_builtin <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 54%] 1896s tests/test_publish.py::test_publish_simple <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_publish.py PASSED [ 54%] 1896s tests/test_publish.py::test_publish_non_string_key <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_publish.py PASSED [ 55%] 1896s tests/test_publish.py::test_publish_roundtrip <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_publish.py PASSED [ 55%] 1897s tests/test_publish.py::test_unpublish <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_publish.py PASSED [ 55%] 1899s tests/test_publish.py::test_unpublish_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_publish.py PASSED [ 55%] 1900s tests/test_publish.py::test_publish_multiple_datasets <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_publish.py PASSED [ 55%] 1901s tests/test_publish.py::test_unpublish_multiple_datasets_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_publish.py PASSED [ 55%] 1902s tests/test_publish.py::test_publish_bag <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_publish.py PASSED [ 55%] 1904s tests/test_publish.py::test_datasets_setitem <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_publish.py PASSED [ 55%] 1906s tests/test_publish.py::test_datasets_getitem <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_publish.py PASSED [ 55%] 1909s tests/test_publish.py::test_datasets_getitem_default <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_publish.py PASSED [ 55%] 1911s tests/test_publish.py::test_datasets_delitem <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_publish.py PASSED [ 55%] 1913s tests/test_publish.py::test_datasets_keys <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_publish.py PASSED [ 55%] 1916s tests/test_publish.py::test_datasets_contains <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_publish.py PASSED [ 55%] 1918s tests/test_publish.py::test_datasets_republish <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_publish.py PASSED [ 55%] 1920s tests/test_publish.py::test_datasets_iter <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_publish.py PASSED [ 55%] 1920s tests/test_publish.py::test_datasets_async <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_publish.py PASSED [ 55%] 1921s tests/test_publish.py::test_pickle_safe <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_publish.py PASSED [ 55%] 1921s tests/test_publish.py::test_deserialize_client <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_publish.py PASSED [ 55%] 1921s tests/test_publish.py::test_publish_submit_ordering <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_publish.py PASSED [ 55%] 1922s tests/test_pubsub.py::test_speed <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_pubsub.py PASSED [ 55%] 1922s tests/test_pubsub.py::test_client <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_pubsub.py PASSED [ 55%] 1922s tests/test_pubsub.py::test_timeouts <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_pubsub.py PASSED [ 55%] 1922s tests/test_pubsub.py::test_repr <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_pubsub.py PASSED [ 55%] 1923s tests/test_pubsub.py::test_basic <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_pubsub.py XPASS [ 55%] 1923s tests/test_queues.py::test_queue <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_queues.py PASSED [ 55%] 1923s tests/test_queues.py::test_queue_with_data <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_queues.py PASSED [ 55%] 1926s tests/test_queues.py::test_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_queues.py PASSED [ 55%] 1926s tests/test_queues.py::test_hold_futures <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_queues.py PASSED [ 55%] 1927s tests/test_queues.py::test_picklability <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_queues.py PASSED [ 55%] 1929s tests/test_queues.py::test_picklability_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_queues.py PASSED [ 55%] 1929s tests/test_queues.py::test_race <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_queues.py SKIPPED [ 55%] 1929s tests/test_queues.py::test_same_futures <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_queues.py PASSED [ 55%] 1929s tests/test_queues.py::test_get_many <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_queues.py PASSED [ 56%] 1930s tests/test_queues.py::test_Future_knows_status_immediately <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_queues.py PASSED [ 56%] 1930s tests/test_queues.py::test_erred_future <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_queues.py PASSED [ 56%] 1930s tests/test_queues.py::test_close <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_queues.py PASSED [ 56%] 1931s tests/test_queues.py::test_timeout <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_queues.py PASSED [ 56%] 1931s tests/test_queues.py::test_2220 <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_queues.py PASSED [ 56%] 1931s tests/test_queues.py::test_unpickle_without_client <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_queues.py PASSED [ 56%] 1932s tests/test_reschedule.py::test_scheduler_reschedule_warns <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_reschedule.py PASSED [ 56%] 1932s tests/test_reschedule.py::test_raise_reschedule[executing] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_reschedule.py PASSED [ 56%] 1933s tests/test_reschedule.py::test_raise_reschedule[long-running] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_reschedule.py PASSED [ 56%] 1933s tests/test_reschedule.py::test_cancelled_reschedule[executing] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_reschedule.py PASSED [ 56%] 1933s tests/test_reschedule.py::test_cancelled_reschedule[long-running] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_reschedule.py PASSED [ 56%] 1933s tests/test_reschedule.py::test_cancelled_reschedule_worker_state[executing] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_reschedule.py PASSED [ 56%] 1933s tests/test_reschedule.py::test_cancelled_reschedule_worker_state[long-running] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_reschedule.py PASSED [ 56%] 1933s tests/test_reschedule.py::test_reschedule_releases[executing] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_reschedule.py PASSED [ 56%] 1933s tests/test_reschedule.py::test_reschedule_releases[long-running] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_reschedule.py PASSED [ 56%] 1933s tests/test_reschedule.py::test_reschedule_cancelled[executing] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_reschedule.py PASSED [ 56%] 1933s tests/test_reschedule.py::test_reschedule_cancelled[long-running] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_reschedule.py PASSED [ 56%] 1933s tests/test_reschedule.py::test_reschedule_resumed[executing] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_reschedule.py PASSED [ 56%] 1933s tests/test_reschedule.py::test_reschedule_resumed[long-running] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_reschedule.py PASSED [ 56%] 1934s tests/test_resources.py::test_resource_submit <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 56%] 1934s tests/test_resources.py::test_submit_many_non_overlapping <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 56%] 1935s tests/test_resources.py::test_submit_many_non_overlapping_2 <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 56%] 1935s tests/test_resources.py::test_move <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 56%] 1936s tests/test_resources.py::test_dont_work_steal <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 56%] 1936s tests/test_resources.py::test_map <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 56%] 1937s tests/test_resources.py::test_persist <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 56%] 1937s tests/test_resources.py::test_compute <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 56%] 1937s tests/test_resources.py::test_get <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 56%] 1937s tests/test_resources.py::test_persist_multiple_collections <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 56%] 1937s tests/test_resources.py::test_resources_str <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 56%] 1938s tests/test_resources.py::test_minimum_resource <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 56%] 1938s tests/test_resources.py::test_constrained_vs_ready_priority_1[1-0-y-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 57%] 1938s tests/test_resources.py::test_constrained_vs_ready_priority_1[1-0-y-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 57%] 1938s tests/test_resources.py::test_constrained_vs_ready_priority_1[0-1-x-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 57%] 1938s tests/test_resources.py::test_constrained_vs_ready_priority_1[0-1-x-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 57%] 1938s tests/test_resources.py::test_constrained_vs_ready_priority_2[1-0-y-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 57%] 1938s tests/test_resources.py::test_constrained_vs_ready_priority_2[1-0-y-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 57%] 1938s tests/test_resources.py::test_constrained_vs_ready_priority_2[0-1-x-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 57%] 1938s tests/test_resources.py::test_constrained_vs_ready_priority_2[0-1-x-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 57%] 1938s tests/test_resources.py::test_constrained_tasks_respect_priority <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 57%] 1938s tests/test_resources.py::test_task_cancelled_and_readded_with_resources <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 57%] 1938s tests/test_resources.py::test_balance_resources <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py SKIPPED [ 57%] 1939s tests/test_resources.py::test_set_resources <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 57%] 1939s tests/test_resources.py::test_persist_collections <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 57%] 1939s tests/test_resources.py::test_dont_optimize_out <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py SKIPPED [ 57%] 1939s tests/test_resources.py::test_full_collections <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py SKIPPED [ 57%] 1941s tests/test_resources.py::test_collections_get[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py XFAIL [ 57%] 1944s tests/test_resources.py::test_collections_get[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 57%] 1944s tests/test_resources.py::test_resources_from_config <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 57%] 1944s tests/test_resources.py::test_resources_from_python_override_config <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 57%] 1944s tests/test_resources.py::test_cancelled_with_resources[executing-ExecuteSuccessEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 57%] 1944s tests/test_resources.py::test_cancelled_with_resources[executing-ExecuteFailureEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 57%] 1944s tests/test_resources.py::test_cancelled_with_resources[executing-RescheduleEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 57%] 1944s tests/test_resources.py::test_cancelled_with_resources[long-running-ExecuteSuccessEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 57%] 1944s tests/test_resources.py::test_cancelled_with_resources[long-running-ExecuteFailureEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 57%] 1944s tests/test_resources.py::test_cancelled_with_resources[long-running-RescheduleEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 57%] 1944s tests/test_resources.py::test_resumed_with_resources[executing-ExecuteSuccessEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 57%] 1944s tests/test_resources.py::test_resumed_with_resources[executing-ExecuteFailureEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 57%] 1944s tests/test_resources.py::test_resumed_with_resources[executing-RescheduleEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 57%] 1944s tests/test_resources.py::test_resumed_with_resources[long-running-ExecuteSuccessEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 57%] 1944s tests/test_resources.py::test_resumed_with_resources[long-running-ExecuteFailureEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 57%] 1944s tests/test_resources.py::test_resumed_with_resources[long-running-RescheduleEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 57%] 1944s tests/test_resources.py::test_resumed_with_different_resources[executing-ExecuteSuccessEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 57%] 1944s tests/test_resources.py::test_resumed_with_different_resources[executing-ExecuteFailureEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 58%] 1944s tests/test_resources.py::test_resumed_with_different_resources[executing-RescheduleEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 58%] 1944s tests/test_resources.py::test_resumed_with_different_resources[long-running-ExecuteSuccessEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 58%] 1944s tests/test_resources.py::test_resumed_with_different_resources[long-running-ExecuteFailureEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 58%] 1944s tests/test_resources.py::test_resumed_with_different_resources[long-running-RescheduleEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 58%] 1944s tests/test_scheduler.py::test_administration <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 58%] 1944s tests/test_scheduler.py::test_respect_data_in_memory <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 58%] 1945s tests/test_scheduler.py::test_recompute_released_results <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 58%] 1945s tests/test_scheduler.py::test_decide_worker_with_many_independent_leaves <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 58%] 1947s tests/test_scheduler.py::test_decide_worker_with_restrictions <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 58%] 1947s tests/test_scheduler.py::test_decide_worker_coschedule_order_neighbors[nthreads0-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 58%] 1948s tests/test_scheduler.py::test_decide_worker_coschedule_order_neighbors[nthreads0-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 58%] 1949s tests/test_scheduler.py::test_decide_worker_coschedule_order_neighbors[nthreads0-4] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 58%] 1950s tests/test_scheduler.py::test_decide_worker_coschedule_order_neighbors[nthreads1-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 58%] 1951s tests/test_scheduler.py::test_decide_worker_coschedule_order_neighbors[nthreads1-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 58%] 1952s tests/test_scheduler.py::test_decide_worker_coschedule_order_neighbors[nthreads1-4] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 58%] 1952s tests/test_scheduler.py::test_override_is_rootish <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 58%] 1952s tests/test_scheduler.py::test_decide_worker_rootish_while_last_worker_is_retiring <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py SKIPPED [ 58%] 1953s tests/test_scheduler.py::test_graph_execution_width <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 58%] 1956s tests/test_scheduler.py::test_forget_tasks_while_processing <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 58%] 1956s tests/test_scheduler.py::test_restart_while_processing <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py SKIPPED [ 58%] 1956s tests/test_scheduler.py::test_queued_release_multiple_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 58%] 1956s tests/test_scheduler.py::test_queued_paused_new_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 58%] 1957s tests/test_scheduler.py::test_queued_paused_unpaused[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 58%] 1957s tests/test_scheduler.py::test_queued_paused_unpaused[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 58%] 1958s tests/test_scheduler.py::test_queued_remove_add_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 58%] 1958s tests/test_scheduler.py::test_secede_opens_slot <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 58%] 1958s tests/test_scheduler.py::test_saturation_factor[2.5-expected_task_counts0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 58%] 1958s tests/test_scheduler.py::test_saturation_factor[2.0-expected_task_counts1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 58%] 1959s tests/test_scheduler.py::test_saturation_factor[1.1-expected_task_counts2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 58%] 1959s tests/test_scheduler.py::test_saturation_factor[1.0-expected_task_counts3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 58%] 1959s tests/test_scheduler.py::test_saturation_factor[0.1-expected_task_counts4] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 59%] 1960s tests/test_scheduler.py::test_saturation_factor[inf-expected_task_counts5] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 59%] 1960s tests/test_scheduler.py::test_saturation_factor[inf-expected_task_counts6] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 59%] 1960s tests/test_scheduler.py::test_bad_saturation_factor <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 59%] 1960s tests/test_scheduler.py::test_move_data_over_break_restrictions <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 59%] 1961s tests/test_scheduler.py::test_balance_with_restrictions <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 59%] 1961s tests/test_scheduler.py::test_no_valid_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 59%] 1961s tests/test_scheduler.py::test_no_valid_workers_loose_restrictions <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 59%] 1961s tests/test_scheduler.py::test_no_workers[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 59%] 1961s tests/test_scheduler.py::test_no_workers[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 59%] 1961s tests/test_scheduler.py::test_retire_workers_empty <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 59%] 1962s tests/test_scheduler.py::test_retire_workers_lock <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 59%] 1963s tests/test_scheduler.py::test_retire_workers_concurrently <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 59%] 1963s tests/test_scheduler.py::test_server_listens_to_other_ops <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 59%] 1963s tests/test_scheduler.py::test_remove_worker_from_scheduler <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 59%] 1963s tests/test_scheduler.py::test_remove_worker_by_name_from_scheduler <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 59%] 1964s tests/test_scheduler.py::test_clear_events_worker_removal <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 59%] 1964s tests/test_scheduler.py::test_clear_events_client_removal <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 59%] 1964s tests/test_scheduler.py::test_add_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 59%] 1965s tests/test_scheduler.py::test_blocked_handlers_are_respected <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 59%] 1965s tests/test_scheduler.py::test_scheduler_init_pulls_blocked_handlers_from_config <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 59%] 1965s tests/test_scheduler.py::test_feed <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 59%] 1965s tests/test_scheduler.py::test_feed_setup_teardown <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 59%] 1966s tests/test_scheduler.py::test_feed_large_bytestring <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 59%] 1966s tests/test_scheduler.py::test_delete_data <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 59%] 1966s tests/test_scheduler.py::test_delete <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 59%] 1966s tests/test_scheduler.py::test_dumps_function <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 59%] 1967s tests/test_scheduler.py::test_ready_remove_worker[1.0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 59%] 1967s tests/test_scheduler.py::test_ready_remove_worker[inf] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 59%] 1967s tests/test_scheduler.py::test_restart <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py SKIPPED [ 59%] 1967s tests/test_scheduler.py::test_restart_waits_for_new_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py SKIPPED [ 59%] 1967s tests/test_scheduler.py::test_restart_nanny_timeout_exceeded <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py SKIPPED [ 59%] 1968s tests/test_scheduler.py::test_restart_not_all_workers_return <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 60%] 1968s tests/test_scheduler.py::test_restart_worker_rejoins_after_timeout_expired <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 60%] 1969s tests/test_scheduler.py::test_restart_no_wait_for_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 60%] 1969s tests/test_scheduler.py::test_restart_some_nannies_some_not <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py SKIPPED [ 60%] 1969s tests/test_scheduler.py::test_restart_heartbeat_before_closing <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py SKIPPED [ 60%] 1969s tests/test_scheduler.py::test_broadcast <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 60%] 2029s tests/test_scheduler.py::test_broadcast_tls <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py FAILED [ 60%] 2031s tests/test_scheduler.py::test_broadcast_nanny <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 60%] 2033s tests/test_scheduler.py::test_broadcast_on_error <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 60%] 2033s tests/test_scheduler.py::test_broadcast_deprecation <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 60%] 2033s tests/test_scheduler.py::test_worker_name <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 60%] 2033s tests/test_scheduler.py::test_coerce_address <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 60%] 2033s tests/test_scheduler.py::test_config_stealing <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 60%] 2033s tests/test_scheduler.py::test_config_no_stealing <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 60%] 2033s tests/test_scheduler.py::test_update_graph_culls <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 60%] 2033s tests/test_scheduler.py::test_io_loop <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 60%] 2034s tests/test_scheduler.py::test_story <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 60%] 2035s tests/test_scheduler.py::test_scatter_no_workers[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 60%] 2035s tests/test_scheduler.py::test_scatter_no_workers[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 60%] 2035s tests/test_scheduler.py::test_scheduler_sees_memory_limits <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 60%] 2035s tests/test_scheduler.py::test_retire_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 60%] 2035s tests/test_scheduler.py::test_retire_workers_n <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 60%] 2036s tests/test_scheduler.py::test_workers_to_close <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 60%] 2036s tests/test_scheduler.py::test_workers_to_close_grouped <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 60%] 2036s tests/test_scheduler.py::test_workers_to_close_never_close_long_running[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 60%] 2037s tests/test_scheduler.py::test_workers_to_close_never_close_long_running[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 60%] 2037s tests/test_scheduler.py::test_retire_workers_no_suspicious_tasks <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 60%] 2037s tests/test_scheduler.py::test_file_descriptors <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py SKIPPED [ 60%] 2037s tests/test_scheduler.py::test_learn_occupancy <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py SKIPPED [ 60%] 2037s tests/test_scheduler.py::test_learn_occupancy_2 <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py SKIPPED [ 60%] 2040s tests/test_scheduler.py::test_balance_many_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 60%] 2042s tests/test_scheduler.py::test_include_communication_in_occupancy <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 60%] 2042s tests/test_scheduler.py::test_nonempty_data_is_rejected <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 61%] 2043s tests/test_scheduler.py::test_worker_arrives_with_data_is_rejected <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 61%] 2046s tests/test_scheduler.py::test_run_on_scheduler_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 61%] 2046s tests/test_scheduler.py::test_run_on_scheduler <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 61%] 2046s tests/test_scheduler.py::test_allow_pickle_false <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 61%] 2046s tests/test_scheduler.py::test_close_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 61%] 2046s tests/test_scheduler.py::test_close_nanny <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py SKIPPED [ 61%] 2046s tests/test_scheduler.py::test_retire_workers_close <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 61%] 2046s tests/test_scheduler.py::test_retire_nannies_close <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py SKIPPED [ 61%] 2048s tests/test_scheduler.py::test_fifo_submission <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 61%] 2049s tests/test_scheduler.py::test_profile_metadata <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 61%] 2050s tests/test_scheduler.py::test_profile_metadata_timeout <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 61%] 2050s tests/test_scheduler.py::test_profile_metadata_keys <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 61%] 2051s tests/test_scheduler.py::test_statistical_profiling <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 61%] 2052s tests/test_scheduler.py::test_statistical_profiling_failure <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 61%] 2052s tests/test_scheduler.py::test_cancel_fire_and_forget <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 61%] 2052s tests/test_scheduler.py::test_log_tasks_during_restart <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py SKIPPED [ 61%] 2052s tests/test_scheduler.py::test_get_task_status <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 61%] 2052s tests/test_scheduler.py::test_deque_handler <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 61%] 2052s tests/test_scheduler.py::test_retries <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 61%] 2053s tests/test_scheduler.py::test_missing_data_errant_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 61%] 2053s tests/test_scheduler.py::test_dont_recompute_if_persisted <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 61%] 2054s tests/test_scheduler.py::test_dont_recompute_if_persisted_2 <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 61%] 2055s tests/test_scheduler.py::test_dont_recompute_if_persisted_3 <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 61%] 2055s tests/test_scheduler.py::test_dont_recompute_if_persisted_4 <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 61%] 2055s tests/test_scheduler.py::test_dont_forget_released_keys <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 61%] 2055s tests/test_scheduler.py::test_dont_recompute_if_erred <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 61%] 2055s tests/test_scheduler.py::test_closing_scheduler_closes_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 61%] 2056s tests/test_scheduler.py::test_resources_reset_after_cancelled_task <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 61%] 2056s tests/test_scheduler.py::test_gh2187 <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 61%] 2056s tests/test_scheduler.py::test_collect_versions <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 61%] 2056s tests/test_scheduler.py::test_idle_timeout <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py SKIPPED [ 61%] 2057s tests/test_scheduler.py::test_idle_timeout_no_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 62%] 2059s tests/test_scheduler.py::test_no_workers_timeout_disabled <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 62%] 2059s tests/test_scheduler.py::test_no_workers_timeout_without_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py SKIPPED [ 62%] 2059s tests/test_scheduler.py::test_no_workers_timeout_bad_restrictions <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py SKIPPED [ 62%] 2060s tests/test_scheduler.py::test_no_workers_timeout_queued <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 62%] 2060s tests/test_scheduler.py::test_no_workers_timeout_processing <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py SKIPPED [ 62%] 2060s tests/test_scheduler.py::test_bandwidth <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 62%] 2060s tests/test_scheduler.py::test_bandwidth_clear <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py SKIPPED [ 62%] 2060s tests/test_scheduler.py::test_workerstate_clean <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 62%] 2061s tests/test_scheduler.py::test_result_type <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 62%] 2061s tests/test_scheduler.py::test_close_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 62%] 2061s tests/test_scheduler.py::test_host_address <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 62%] 2061s tests/test_scheduler.py::test_dashboard_address <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py SKIPPED [ 62%] 2062s tests/test_scheduler.py::test_adaptive_target <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 62%] 2062s tests/test_scheduler.py::test_adaptive_target_empty_cluster[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 62%] 2062s tests/test_scheduler.py::test_adaptive_target_empty_cluster[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 62%] 2062s tests/test_scheduler.py::test_retire_names_str <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 62%] 2063s tests/test_scheduler.py::test_retire_workers_bad_params <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 62%] 2063s tests/test_scheduler.py::test_get_task_duration <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 62%] 2064s tests/test_scheduler.py::test_task_groups <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 62%] 2064s tests/test_scheduler.py::test_task_groups_update_start_stop <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 62%] 2064s tests/test_scheduler.py::test_task_group_done <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 62%] 2065s tests/test_scheduler.py::test_task_group_not_done_waiting <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 62%] 2065s tests/test_scheduler.py::test_task_group_not_done_noworker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 62%] 2065s tests/test_scheduler.py::test_task_group_not_done_queued <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 62%] 2065s tests/test_scheduler.py::test_task_group_not_done_processing <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 62%] 2066s tests/test_scheduler.py::test_task_prefix <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 62%] 2066s tests/test_scheduler.py::test_failing_task_increments_suspicious <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py SKIPPED [ 62%] 2066s tests/test_scheduler.py::test_task_group_non_tuple_key <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 62%] 2066s tests/test_scheduler.py::test_task_unique_groups <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 62%] 2067s tests/test_scheduler.py::test_task_group_on_fire_and_forget <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 62%] 2068s tests/test_scheduler.py::test_gather_failing_can_recover <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 62%] 2068s tests/test_scheduler.py::test_gather_failing_cnn_error <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 2069s tests/test_scheduler.py::test_gather_no_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 2069s tests/test_scheduler.py::test_gather_bad_worker[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 2069s tests/test_scheduler.py::test_gather_bad_worker[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 2070s tests/test_scheduler.py::test_too_many_groups <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 2070s tests/test_scheduler.py::test_worker_name_collision <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 2070s tests/test_scheduler.py::test_unknown_task_duration_config <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 2070s tests/test_scheduler.py::test_unknown_task_duration_config_2 <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 2071s tests/test_scheduler.py::test_retire_state_change <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 2071s tests/test_scheduler.py::test_configurable_events_log_length <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 2071s tests/test_scheduler.py::test_get_worker_monitor_info <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 2071s tests/test_scheduler.py::test_quiet_cluster_round_robin <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 2071s tests/test_scheduler.py::test_memorystate <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 2071s tests/test_scheduler.py::test_memorystate_sum <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 2071s tests/test_scheduler.py::test_memorystate_adds_up[0-0-0-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 2071s tests/test_scheduler.py::test_memorystate_adds_up[0-0-0-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 2071s tests/test_scheduler.py::test_memorystate_adds_up[0-0-0-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 2071s tests/test_scheduler.py::test_memorystate_adds_up[0-0-0-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 2071s tests/test_scheduler.py::test_memorystate_adds_up[0-0-1-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 2071s tests/test_scheduler.py::test_memorystate_adds_up[0-0-1-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 2071s tests/test_scheduler.py::test_memorystate_adds_up[0-0-1-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 2071s tests/test_scheduler.py::test_memorystate_adds_up[0-0-1-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 2071s tests/test_scheduler.py::test_memorystate_adds_up[0-0-2-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 2071s tests/test_scheduler.py::test_memorystate_adds_up[0-0-2-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 2071s tests/test_scheduler.py::test_memorystate_adds_up[0-0-2-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 2071s tests/test_scheduler.py::test_memorystate_adds_up[0-0-2-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 2071s tests/test_scheduler.py::test_memorystate_adds_up[0-0-3-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 2071s tests/test_scheduler.py::test_memorystate_adds_up[0-0-3-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 2071s tests/test_scheduler.py::test_memorystate_adds_up[0-0-3-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 2071s tests/test_scheduler.py::test_memorystate_adds_up[0-0-3-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 2071s tests/test_scheduler.py::test_memorystate_adds_up[0-1-0-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 2071s tests/test_scheduler.py::test_memorystate_adds_up[0-1-0-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 2071s tests/test_scheduler.py::test_memorystate_adds_up[0-1-0-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 2071s tests/test_scheduler.py::test_memorystate_adds_up[0-1-0-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 2071s tests/test_scheduler.py::test_memorystate_adds_up[0-1-1-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 2071s tests/test_scheduler.py::test_memorystate_adds_up[0-1-1-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 2071s tests/test_scheduler.py::test_memorystate_adds_up[0-1-1-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 2071s tests/test_scheduler.py::test_memorystate_adds_up[0-1-1-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 2071s tests/test_scheduler.py::test_memorystate_adds_up[0-1-2-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 2071s tests/test_scheduler.py::test_memorystate_adds_up[0-1-2-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 2071s tests/test_scheduler.py::test_memorystate_adds_up[0-1-2-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 2071s tests/test_scheduler.py::test_memorystate_adds_up[0-1-2-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 2071s tests/test_scheduler.py::test_memorystate_adds_up[0-1-3-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 2071s tests/test_scheduler.py::test_memorystate_adds_up[0-1-3-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 2071s tests/test_scheduler.py::test_memorystate_adds_up[0-1-3-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 2071s tests/test_scheduler.py::test_memorystate_adds_up[0-1-3-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 2071s tests/test_scheduler.py::test_memorystate_adds_up[0-2-0-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 2071s tests/test_scheduler.py::test_memorystate_adds_up[0-2-0-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 2071s tests/test_scheduler.py::test_memorystate_adds_up[0-2-0-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 2071s tests/test_scheduler.py::test_memorystate_adds_up[0-2-0-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 2071s tests/test_scheduler.py::test_memorystate_adds_up[0-2-1-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 2071s tests/test_scheduler.py::test_memorystate_adds_up[0-2-1-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 2071s tests/test_scheduler.py::test_memorystate_adds_up[0-2-1-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 2071s tests/test_scheduler.py::test_memorystate_adds_up[0-2-1-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 2071s tests/test_scheduler.py::test_memorystate_adds_up[0-2-2-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 2071s tests/test_scheduler.py::test_memorystate_adds_up[0-2-2-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 2071s tests/test_scheduler.py::test_memorystate_adds_up[0-2-2-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 2071s tests/test_scheduler.py::test_memorystate_adds_up[0-2-2-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 2071s tests/test_scheduler.py::test_memorystate_adds_up[0-2-3-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 2071s tests/test_scheduler.py::test_memorystate_adds_up[0-2-3-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 2071s tests/test_scheduler.py::test_memorystate_adds_up[0-2-3-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 2071s tests/test_scheduler.py::test_memorystate_adds_up[0-2-3-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 2071s tests/test_scheduler.py::test_memorystate_adds_up[0-3-0-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 2071s tests/test_scheduler.py::test_memorystate_adds_up[0-3-0-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 2071s tests/test_scheduler.py::test_memorystate_adds_up[0-3-0-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 2071s tests/test_scheduler.py::test_memorystate_adds_up[0-3-0-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 2071s tests/test_scheduler.py::test_memorystate_adds_up[0-3-1-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 2071s tests/test_scheduler.py::test_memorystate_adds_up[0-3-1-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 2071s tests/test_scheduler.py::test_memorystate_adds_up[0-3-1-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 2071s tests/test_scheduler.py::test_memorystate_adds_up[0-3-1-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 2071s tests/test_scheduler.py::test_memorystate_adds_up[0-3-2-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 2071s tests/test_scheduler.py::test_memorystate_adds_up[0-3-2-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 2071s tests/test_scheduler.py::test_memorystate_adds_up[0-3-2-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 2071s tests/test_scheduler.py::test_memorystate_adds_up[0-3-2-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 2071s tests/test_scheduler.py::test_memorystate_adds_up[0-3-3-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 2071s tests/test_scheduler.py::test_memorystate_adds_up[0-3-3-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 2071s tests/test_scheduler.py::test_memorystate_adds_up[0-3-3-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 2071s tests/test_scheduler.py::test_memorystate_adds_up[0-3-3-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 2071s tests/test_scheduler.py::test_memorystate_adds_up[1-0-0-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 2071s tests/test_scheduler.py::test_memorystate_adds_up[1-0-0-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 2071s tests/test_scheduler.py::test_memorystate_adds_up[1-0-0-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 2071s tests/test_scheduler.py::test_memorystate_adds_up[1-0-0-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 2071s tests/test_scheduler.py::test_memorystate_adds_up[1-0-1-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 2071s tests/test_scheduler.py::test_memorystate_adds_up[1-0-1-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 2071s tests/test_scheduler.py::test_memorystate_adds_up[1-0-1-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 2071s tests/test_scheduler.py::test_memorystate_adds_up[1-0-1-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 2071s tests/test_scheduler.py::test_memorystate_adds_up[1-0-2-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 2071s tests/test_scheduler.py::test_memorystate_adds_up[1-0-2-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 2071s tests/test_scheduler.py::test_memorystate_adds_up[1-0-2-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 2071s tests/test_scheduler.py::test_memorystate_adds_up[1-0-2-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 2071s tests/test_scheduler.py::test_memorystate_adds_up[1-0-3-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 2071s tests/test_scheduler.py::test_memorystate_adds_up[1-0-3-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 2071s tests/test_scheduler.py::test_memorystate_adds_up[1-0-3-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 2071s tests/test_scheduler.py::test_memorystate_adds_up[1-0-3-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 2071s tests/test_scheduler.py::test_memorystate_adds_up[1-1-0-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 2071s tests/test_scheduler.py::test_memorystate_adds_up[1-1-0-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 2071s tests/test_scheduler.py::test_memorystate_adds_up[1-1-0-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 2071s tests/test_scheduler.py::test_memorystate_adds_up[1-1-0-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 2071s tests/test_scheduler.py::test_memorystate_adds_up[1-1-1-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 2071s tests/test_scheduler.py::test_memorystate_adds_up[1-1-1-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 2071s tests/test_scheduler.py::test_memorystate_adds_up[1-1-1-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 2071s tests/test_scheduler.py::test_memorystate_adds_up[1-1-1-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 2071s tests/test_scheduler.py::test_memorystate_adds_up[1-1-2-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 2071s tests/test_scheduler.py::test_memorystate_adds_up[1-1-2-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 2071s tests/test_scheduler.py::test_memorystate_adds_up[1-1-2-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 2071s tests/test_scheduler.py::test_memorystate_adds_up[1-1-2-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 2071s tests/test_scheduler.py::test_memorystate_adds_up[1-1-3-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 2071s tests/test_scheduler.py::test_memorystate_adds_up[1-1-3-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 2071s tests/test_scheduler.py::test_memorystate_adds_up[1-1-3-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 2071s tests/test_scheduler.py::test_memorystate_adds_up[1-1-3-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 2071s tests/test_scheduler.py::test_memorystate_adds_up[1-2-0-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 2071s tests/test_scheduler.py::test_memorystate_adds_up[1-2-0-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 2071s tests/test_scheduler.py::test_memorystate_adds_up[1-2-0-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 2071s tests/test_scheduler.py::test_memorystate_adds_up[1-2-0-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 2071s tests/test_scheduler.py::test_memorystate_adds_up[1-2-1-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 2071s tests/test_scheduler.py::test_memorystate_adds_up[1-2-1-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 2071s tests/test_scheduler.py::test_memorystate_adds_up[1-2-1-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 2071s tests/test_scheduler.py::test_memorystate_adds_up[1-2-1-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 2071s tests/test_scheduler.py::test_memorystate_adds_up[1-2-2-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 2071s tests/test_scheduler.py::test_memorystate_adds_up[1-2-2-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 2071s tests/test_scheduler.py::test_memorystate_adds_up[1-2-2-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 2071s tests/test_scheduler.py::test_memorystate_adds_up[1-2-2-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 2071s tests/test_scheduler.py::test_memorystate_adds_up[1-2-3-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 2071s tests/test_scheduler.py::test_memorystate_adds_up[1-2-3-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 2071s tests/test_scheduler.py::test_memorystate_adds_up[1-2-3-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 2071s tests/test_scheduler.py::test_memorystate_adds_up[1-2-3-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 2071s tests/test_scheduler.py::test_memorystate_adds_up[1-3-0-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 2071s tests/test_scheduler.py::test_memorystate_adds_up[1-3-0-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 2071s tests/test_scheduler.py::test_memorystate_adds_up[1-3-0-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 2071s tests/test_scheduler.py::test_memorystate_adds_up[1-3-0-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 2071s tests/test_scheduler.py::test_memorystate_adds_up[1-3-1-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 2071s tests/test_scheduler.py::test_memorystate_adds_up[1-3-1-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 2071s tests/test_scheduler.py::test_memorystate_adds_up[1-3-1-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 2071s tests/test_scheduler.py::test_memorystate_adds_up[1-3-1-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 2071s tests/test_scheduler.py::test_memorystate_adds_up[1-3-2-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 2071s tests/test_scheduler.py::test_memorystate_adds_up[1-3-2-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 2071s tests/test_scheduler.py::test_memorystate_adds_up[1-3-2-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 2071s tests/test_scheduler.py::test_memorystate_adds_up[1-3-2-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 2071s tests/test_scheduler.py::test_memorystate_adds_up[1-3-3-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 2071s tests/test_scheduler.py::test_memorystate_adds_up[1-3-3-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 2071s tests/test_scheduler.py::test_memorystate_adds_up[1-3-3-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 2071s tests/test_scheduler.py::test_memorystate_adds_up[1-3-3-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 2071s tests/test_scheduler.py::test_memorystate_adds_up[2-0-0-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 2071s tests/test_scheduler.py::test_memorystate_adds_up[2-0-0-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 2072s tests/test_scheduler.py::test_memorystate_adds_up[2-0-0-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 2072s tests/test_scheduler.py::test_memorystate_adds_up[2-0-0-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 2072s tests/test_scheduler.py::test_memorystate_adds_up[2-0-1-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 2072s tests/test_scheduler.py::test_memorystate_adds_up[2-0-1-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 2072s tests/test_scheduler.py::test_memorystate_adds_up[2-0-1-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 2072s tests/test_scheduler.py::test_memorystate_adds_up[2-0-1-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 2072s tests/test_scheduler.py::test_memorystate_adds_up[2-0-2-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 2072s tests/test_scheduler.py::test_memorystate_adds_up[2-0-2-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 2072s tests/test_scheduler.py::test_memorystate_adds_up[2-0-2-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 2072s tests/test_scheduler.py::test_memorystate_adds_up[2-0-2-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 2072s tests/test_scheduler.py::test_memorystate_adds_up[2-0-3-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 2072s tests/test_scheduler.py::test_memorystate_adds_up[2-0-3-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 2072s tests/test_scheduler.py::test_memorystate_adds_up[2-0-3-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 2072s tests/test_scheduler.py::test_memorystate_adds_up[2-0-3-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 2072s tests/test_scheduler.py::test_memorystate_adds_up[2-1-0-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 2072s tests/test_scheduler.py::test_memorystate_adds_up[2-1-0-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 2072s tests/test_scheduler.py::test_memorystate_adds_up[2-1-0-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 2072s tests/test_scheduler.py::test_memorystate_adds_up[2-1-0-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 2072s tests/test_scheduler.py::test_memorystate_adds_up[2-1-1-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 2072s tests/test_scheduler.py::test_memorystate_adds_up[2-1-1-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 2072s tests/test_scheduler.py::test_memorystate_adds_up[2-1-1-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 2072s tests/test_scheduler.py::test_memorystate_adds_up[2-1-1-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 2072s tests/test_scheduler.py::test_memorystate_adds_up[2-1-2-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 2072s tests/test_scheduler.py::test_memorystate_adds_up[2-1-2-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 2072s tests/test_scheduler.py::test_memorystate_adds_up[2-1-2-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 2072s tests/test_scheduler.py::test_memorystate_adds_up[2-1-2-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 2072s tests/test_scheduler.py::test_memorystate_adds_up[2-1-3-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 2072s tests/test_scheduler.py::test_memorystate_adds_up[2-1-3-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 2072s tests/test_scheduler.py::test_memorystate_adds_up[2-1-3-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 2072s tests/test_scheduler.py::test_memorystate_adds_up[2-1-3-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 2072s tests/test_scheduler.py::test_memorystate_adds_up[2-2-0-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 2072s tests/test_scheduler.py::test_memorystate_adds_up[2-2-0-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 2072s tests/test_scheduler.py::test_memorystate_adds_up[2-2-0-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 2072s tests/test_scheduler.py::test_memorystate_adds_up[2-2-0-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 2072s tests/test_scheduler.py::test_memorystate_adds_up[2-2-1-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 2072s tests/test_scheduler.py::test_memorystate_adds_up[2-2-1-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 2072s tests/test_scheduler.py::test_memorystate_adds_up[2-2-1-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 2072s tests/test_scheduler.py::test_memorystate_adds_up[2-2-1-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 2072s tests/test_scheduler.py::test_memorystate_adds_up[2-2-2-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 2072s tests/test_scheduler.py::test_memorystate_adds_up[2-2-2-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 2072s tests/test_scheduler.py::test_memorystate_adds_up[2-2-2-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 2072s tests/test_scheduler.py::test_memorystate_adds_up[2-2-2-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 2072s tests/test_scheduler.py::test_memorystate_adds_up[2-2-3-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 2072s tests/test_scheduler.py::test_memorystate_adds_up[2-2-3-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 2072s tests/test_scheduler.py::test_memorystate_adds_up[2-2-3-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 2072s tests/test_scheduler.py::test_memorystate_adds_up[2-2-3-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 2072s tests/test_scheduler.py::test_memorystate_adds_up[2-3-0-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 2072s tests/test_scheduler.py::test_memorystate_adds_up[2-3-0-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 2072s tests/test_scheduler.py::test_memorystate_adds_up[2-3-0-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 2072s tests/test_scheduler.py::test_memorystate_adds_up[2-3-0-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 2072s tests/test_scheduler.py::test_memorystate_adds_up[2-3-1-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 2072s tests/test_scheduler.py::test_memorystate_adds_up[2-3-1-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 2072s tests/test_scheduler.py::test_memorystate_adds_up[2-3-1-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 2072s tests/test_scheduler.py::test_memorystate_adds_up[2-3-1-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 2072s tests/test_scheduler.py::test_memorystate_adds_up[2-3-2-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 2072s tests/test_scheduler.py::test_memorystate_adds_up[2-3-2-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 2072s tests/test_scheduler.py::test_memorystate_adds_up[2-3-2-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 2072s tests/test_scheduler.py::test_memorystate_adds_up[2-3-2-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 2072s tests/test_scheduler.py::test_memorystate_adds_up[2-3-3-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 2072s tests/test_scheduler.py::test_memorystate_adds_up[2-3-3-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 2072s tests/test_scheduler.py::test_memorystate_adds_up[2-3-3-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 2072s tests/test_scheduler.py::test_memorystate_adds_up[2-3-3-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 2072s tests/test_scheduler.py::test_memorystate_adds_up[3-0-0-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 2072s tests/test_scheduler.py::test_memorystate_adds_up[3-0-0-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 2072s tests/test_scheduler.py::test_memorystate_adds_up[3-0-0-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 2072s tests/test_scheduler.py::test_memorystate_adds_up[3-0-0-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 2072s tests/test_scheduler.py::test_memorystate_adds_up[3-0-1-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 2072s tests/test_scheduler.py::test_memorystate_adds_up[3-0-1-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 2072s tests/test_scheduler.py::test_memorystate_adds_up[3-0-1-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 2072s tests/test_scheduler.py::test_memorystate_adds_up[3-0-1-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 2072s tests/test_scheduler.py::test_memorystate_adds_up[3-0-2-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 2072s tests/test_scheduler.py::test_memorystate_adds_up[3-0-2-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 2072s tests/test_scheduler.py::test_memorystate_adds_up[3-0-2-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 2072s tests/test_scheduler.py::test_memorystate_adds_up[3-0-2-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 2072s tests/test_scheduler.py::test_memorystate_adds_up[3-0-3-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 2072s tests/test_scheduler.py::test_memorystate_adds_up[3-0-3-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 2072s tests/test_scheduler.py::test_memorystate_adds_up[3-0-3-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 2072s tests/test_scheduler.py::test_memorystate_adds_up[3-0-3-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 2072s tests/test_scheduler.py::test_memorystate_adds_up[3-1-0-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 2072s tests/test_scheduler.py::test_memorystate_adds_up[3-1-0-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 2072s tests/test_scheduler.py::test_memorystate_adds_up[3-1-0-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 2072s tests/test_scheduler.py::test_memorystate_adds_up[3-1-0-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 2072s tests/test_scheduler.py::test_memorystate_adds_up[3-1-1-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 2072s tests/test_scheduler.py::test_memorystate_adds_up[3-1-1-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 2072s tests/test_scheduler.py::test_memorystate_adds_up[3-1-1-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 2072s tests/test_scheduler.py::test_memorystate_adds_up[3-1-1-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 2072s tests/test_scheduler.py::test_memorystate_adds_up[3-1-2-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 2072s tests/test_scheduler.py::test_memorystate_adds_up[3-1-2-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 2072s tests/test_scheduler.py::test_memorystate_adds_up[3-1-2-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 2072s tests/test_scheduler.py::test_memorystate_adds_up[3-1-2-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 2072s tests/test_scheduler.py::test_memorystate_adds_up[3-1-3-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 2072s tests/test_scheduler.py::test_memorystate_adds_up[3-1-3-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 2072s tests/test_scheduler.py::test_memorystate_adds_up[3-1-3-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 2072s tests/test_scheduler.py::test_memorystate_adds_up[3-1-3-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 2072s tests/test_scheduler.py::test_memorystate_adds_up[3-2-0-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 2072s tests/test_scheduler.py::test_memorystate_adds_up[3-2-0-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 2072s tests/test_scheduler.py::test_memorystate_adds_up[3-2-0-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 2072s tests/test_scheduler.py::test_memorystate_adds_up[3-2-0-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 2072s tests/test_scheduler.py::test_memorystate_adds_up[3-2-1-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 2072s tests/test_scheduler.py::test_memorystate_adds_up[3-2-1-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 2072s tests/test_scheduler.py::test_memorystate_adds_up[3-2-1-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 2072s tests/test_scheduler.py::test_memorystate_adds_up[3-2-1-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 2072s tests/test_scheduler.py::test_memorystate_adds_up[3-2-2-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 2072s tests/test_scheduler.py::test_memorystate_adds_up[3-2-2-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 2072s tests/test_scheduler.py::test_memorystate_adds_up[3-2-2-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 2072s tests/test_scheduler.py::test_memorystate_adds_up[3-2-2-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 2072s tests/test_scheduler.py::test_memorystate_adds_up[3-2-3-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 2072s tests/test_scheduler.py::test_memorystate_adds_up[3-2-3-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 2072s tests/test_scheduler.py::test_memorystate_adds_up[3-2-3-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 2072s tests/test_scheduler.py::test_memorystate_adds_up[3-2-3-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 2072s tests/test_scheduler.py::test_memorystate_adds_up[3-3-0-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 2072s tests/test_scheduler.py::test_memorystate_adds_up[3-3-0-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 2072s tests/test_scheduler.py::test_memorystate_adds_up[3-3-0-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 2072s tests/test_scheduler.py::test_memorystate_adds_up[3-3-0-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 2072s tests/test_scheduler.py::test_memorystate_adds_up[3-3-1-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 2072s tests/test_scheduler.py::test_memorystate_adds_up[3-3-1-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 2072s tests/test_scheduler.py::test_memorystate_adds_up[3-3-1-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 2072s tests/test_scheduler.py::test_memorystate_adds_up[3-3-1-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 2072s tests/test_scheduler.py::test_memorystate_adds_up[3-3-2-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 2072s tests/test_scheduler.py::test_memorystate_adds_up[3-3-2-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 2072s tests/test_scheduler.py::test_memorystate_adds_up[3-3-2-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 2072s tests/test_scheduler.py::test_memorystate_adds_up[3-3-2-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 2072s tests/test_scheduler.py::test_memorystate_adds_up[3-3-3-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 2072s tests/test_scheduler.py::test_memorystate_adds_up[3-3-3-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 2072s tests/test_scheduler.py::test_memorystate_adds_up[3-3-3-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 2072s tests/test_scheduler.py::test_memorystate_adds_up[3-3-3-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 2072s tests/test_scheduler.py::test_memorystate__to_dict <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 2072s tests/test_scheduler.py::test_memory <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py SKIPPED [ 71%] 2072s tests/test_scheduler.py::test_memory_no_zict <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 2072s tests/test_scheduler.py::test_memory_no_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 2072s tests/test_scheduler.py::test_infrequent_sysmon <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 2072s tests/test_scheduler.py::test_close_scheduler__close_workers_Worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 2072s tests/test_scheduler.py::test_close_scheduler__close_workers_Nanny <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py SKIPPED [ 71%] 2072s tests/test_scheduler.py::test_rebalance <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py SKIPPED [ 71%] 2073s tests/test_scheduler.py::test_rebalance_managed_memory <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 2073s tests/test_scheduler.py::test_rebalance_workers_and_keys <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 2073s tests/test_scheduler.py::test_rebalance_missing_data1 <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 2073s tests/test_scheduler.py::test_rebalance_missing_data2 <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 2074s tests/test_scheduler.py::test_rebalance_raises_missing_data3[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 2074s tests/test_scheduler.py::test_rebalance_raises_missing_data3[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py XFAIL subject to a race 2074s condition. This test assumes that the data is freed before 2074s the rebalance get_data requests come in but merely deleting 2074s the futures is not sufficient to guarantee this) [ 71%] 2074s tests/test_scheduler.py::test_rebalance_no_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 2074s tests/test_scheduler.py::test_rebalance_no_limit <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 2074s tests/test_scheduler.py::test_rebalance_no_recipients <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py SKIPPED [ 72%] 2075s tests/test_scheduler.py::test_rebalance_skip_recipient <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 2075s tests/test_scheduler.py::test_rebalance_skip_all_recipients <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 2075s tests/test_scheduler.py::test_rebalance_sender_below_mean <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py SKIPPED [ 72%] 2075s tests/test_scheduler.py::test_rebalance_least_recently_inserted_sender_min <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py SKIPPED [ 72%] 2075s tests/test_scheduler.py::test_gather_on_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 2075s tests/test_scheduler.py::test_gather_on_worker_bad_recipient <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 2076s tests/test_scheduler.py::test_gather_on_worker_bad_sender <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 2076s tests/test_scheduler.py::test_gather_on_worker_bad_sender_replicated[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 2076s tests/test_scheduler.py::test_gather_on_worker_bad_sender_replicated[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 2077s tests/test_scheduler.py::test_gather_on_worker_key_not_on_sender <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 2077s tests/test_scheduler.py::test_gather_on_worker_key_not_on_sender_replicated[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 2077s tests/test_scheduler.py::test_gather_on_worker_key_not_on_sender_replicated[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 2077s tests/test_scheduler.py::test_gather_on_worker_duplicate_task <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 2078s tests/test_scheduler.py::test_rebalance_dead_recipient <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 2078s tests/test_scheduler.py::test_delete_worker_data <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 2078s tests/test_scheduler.py::test_delete_worker_data_double_delete <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 2078s tests/test_scheduler.py::test_delete_worker_data_bad_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 2079s tests/test_scheduler.py::test_delete_worker_data_bad_task[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 2079s tests/test_scheduler.py::test_delete_worker_data_bad_task[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 2079s tests/test_scheduler.py::test_transition_counter <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 2079s tests/test_scheduler.py::test_transition_counter_max_scheduler <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py SKIPPED [ 72%] 2079s tests/test_scheduler.py::test_transition_counter_max_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 2082s tests/test_scheduler.py::test_disable_transition_counter_max <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 2083s tests/test_scheduler.py::test_worker_heartbeat_after_cancel <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 2083s tests/test_scheduler.py::test_set_restrictions <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 2084s tests/test_scheduler.py::test_avoid_paused_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 2084s tests/test_scheduler.py::test_Scheduler__to_dict <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 2084s tests/test_scheduler.py::test_TaskState__to_dict <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 2084s tests/test_scheduler.py::test_get_cluster_state <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 2084s tests/test_scheduler.py::test_get_cluster_state_worker_error <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 2085s tests/test_scheduler.py::test_dump_cluster_state[msgpack] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 2085s tests/test_scheduler.py::test_dump_cluster_state[yaml] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 2085s tests/test_scheduler.py::test_repr <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 2086s tests/test_scheduler.py::test_ensure_events_dont_include_taskstate_objects <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 2087s tests/test_scheduler.py::test_worker_state_unique_regardless_of_address <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 2087s tests/test_scheduler.py::test_scheduler_close_fast_deprecated <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 2090s tests/test_scheduler.py::test_runspec_regression_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 2090s tests/test_scheduler.py::test_KilledWorker_informative_message <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 2090s tests/test_scheduler.py::test_count_task_prefix <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 2090s tests/test_scheduler.py::test_transition_waiting_memory <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 2091s tests/test_scheduler.py::test_deadlock_resubmit_queued_tasks_fast[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 2091s tests/test_scheduler.py::test_deadlock_resubmit_queued_tasks_fast[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 2092s tests/test_scheduler.py::test_submit_dependency_of_erred_task <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 2092s tests/test_scheduler.py::test_tell_workers_when_peers_have_left <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 2092s tests/test_scheduler.py::test_client_desires_keys_creates_ts <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 2093s tests/test_scheduler.py::test_scatter_creates_ts <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 2093s tests/test_scheduler.py::test_refuse_to_schedule_huge_task[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 2093s tests/test_scheduler.py::test_refuse_to_schedule_huge_task[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 2094s tests/test_scheduler.py::test_html_repr <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 2094s tests/test_scheduler.py::test_resubmit_different_task_same_key_before_previous_is_done[same] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 2094s tests/test_scheduler.py::test_resubmit_different_task_same_key_before_previous_is_done[less] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 2095s tests/test_scheduler.py::test_resubmit_different_task_same_key_before_previous_is_done[more] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 2095s tests/test_scheduler.py::test_resubmit_different_task_same_key_after_previous_is_done[False-same] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 2095s tests/test_scheduler.py::test_resubmit_different_task_same_key_after_previous_is_done[False-less] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 2095s tests/test_scheduler.py::test_resubmit_different_task_same_key_after_previous_is_done[False-more] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 2096s tests/test_scheduler.py::test_resubmit_different_task_same_key_after_previous_is_done[True-same] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 2096s tests/test_scheduler.py::test_resubmit_different_task_same_key_after_previous_is_done[True-less] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 2096s tests/test_scheduler.py::test_resubmit_different_task_same_key_after_previous_is_done[True-more] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 2097s tests/test_scheduler.py::test_resubmit_different_task_same_key_many_clients <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 2097s tests/test_scheduler.py::test_resubmit_nondeterministic_task_same_deps[before0-123-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 2097s tests/test_scheduler.py::test_resubmit_nondeterministic_task_same_deps[123-after1-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 2098s tests/test_scheduler.py::test_resubmit_nondeterministic_task_same_deps[before2-after2-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 2098s tests/test_scheduler.py::test_resubmit_nondeterministic_task_different_deps[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 2098s tests/test_scheduler.py::test_resubmit_nondeterministic_task_different_deps[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 74%] 2099s tests/test_scheduler.py::test_resubmit_different_task_same_key_warns_only_once[10-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 74%] 2099s tests/test_scheduler.py::test_resubmit_different_task_same_key_warns_only_once[30-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 74%] 2099s tests/test_scheduler.py::test_fan_out_pattern_deadlock <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 74%] 2100s tests/test_scheduler.py::test_stimulus_from_erred_task <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 74%] 2100s tests/test_security.py::test_defaults <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 74%] 2100s tests/test_security.py::test_constructor_errors <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 74%] 2100s tests/test_security.py::test_attribute_error <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 74%] 2100s tests/test_security.py::test_from_config <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 74%] 2100s tests/test_security.py::test_min_max_version_from_config[None-None] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 74%] 2100s tests/test_security.py::test_min_max_version_from_config[None-1.2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 74%] 2100s tests/test_security.py::test_min_max_version_from_config[None-1.3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 74%] 2100s tests/test_security.py::test_min_max_version_from_config[1.2-None] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 74%] 2100s tests/test_security.py::test_min_max_version_from_config[1.2-1.2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 74%] 2100s tests/test_security.py::test_min_max_version_from_config[1.2-1.3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 74%] 2100s tests/test_security.py::test_min_max_version_from_config[1.3-None] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 74%] 2100s tests/test_security.py::test_min_max_version_from_config[1.3-1.2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 74%] 2100s tests/test_security.py::test_min_max_version_from_config[1.3-1.3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 74%] 2100s tests/test_security.py::test_min_max_version_config_errors[min-version] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 74%] 2100s tests/test_security.py::test_min_max_version_config_errors[max-version] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 74%] 2100s tests/test_security.py::test_invalid_min_version_from_config_errors <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 74%] 2100s tests/test_security.py::test_kwargs <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 74%] 2100s tests/test_security.py::test_min_max_version_kwarg_errors[tls_min_version] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 74%] 2100s tests/test_security.py::test_min_max_version_kwarg_errors[tls_max_version] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 74%] 2100s tests/test_security.py::test_repr_temp_keys <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py FAILED [ 74%] 2100s tests/test_security.py::test_repr_local_keys <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 74%] 2100s tests/test_security.py::test_tls_config_for_role <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 74%] 2100s tests/test_security.py::test_connection_args <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 74%] 2100s tests/test_security.py::test_extra_conn_args_connection_args <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 74%] 2100s tests/test_security.py::test_listen_args <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 74%] 2100s tests/test_security.py::test_temporary_credentials <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py FAILED [ 74%] 2100s tests/test_security.py::test_extra_conn_args_in_temporary_credentials <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py FAILED [ 74%] 2100s tests/test_semaphore.py::test_semaphore_trivial <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_semaphore.py PASSED [ 75%] 2100s tests/test_semaphore.py::test_serializable <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_semaphore.py PASSED [ 75%] 2101s tests/test_semaphore.py::test_release_simple <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_semaphore.py PASSED [ 75%] 2101s tests/test_semaphore.py::test_acquires_with_timeout <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_semaphore.py PASSED [ 75%] 2103s tests/test_semaphore.py::test_timeout_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_semaphore.py PASSED [ 75%] 2104s tests/test_semaphore.py::test_release_semaphore_after_timeout <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_semaphore.py PASSED [ 75%] 2104s tests/test_semaphore.py::test_async_ctx <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_semaphore.py PASSED [ 75%] 2107s tests/test_semaphore.py::test_worker_dies <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_semaphore.py PASSED [ 75%] 2108s tests/test_semaphore.py::test_access_semaphore_by_name <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_semaphore.py PASSED [ 75%] 2108s tests/test_semaphore.py::test_close_async <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_semaphore.py PASSED [ 75%] 2111s tests/test_semaphore.py::test_close_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_semaphore.py PASSED [ 75%] 2111s tests/test_semaphore.py::test_release_once_too_many <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_semaphore.py PASSED [ 75%] 2112s tests/test_semaphore.py::test_release_once_too_many_resilience <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_semaphore.py PASSED [ 75%] 2112s tests/test_semaphore.py::test_retry_acquire <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_semaphore.py PASSED [ 75%] 2113s tests/test_semaphore.py::test_oversubscribing_leases <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_semaphore.py PASSED [ 75%] 2113s tests/test_semaphore.py::test_timeout_zero <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_semaphore.py PASSED [ 75%] 2113s tests/test_semaphore.py::test_getvalue <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_semaphore.py PASSED [ 75%] 2114s tests/test_semaphore.py::test_metrics <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_semaphore.py PASSED [ 75%] 2114s tests/test_semaphore.py::test_release_retry <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_semaphore.py PASSED [ 75%] 2114s tests/test_semaphore.py::test_release_failure <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_semaphore.py PASSED [ 75%] 2114s tests/test_semaphore.py::test_unpickle_without_client <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_semaphore.py PASSED [ 75%] 2114s tests/test_sizeof.py::test_safe_sizeof[obj0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_sizeof.py PASSED [ 75%] 2114s tests/test_sizeof.py::test_safe_sizeof[obj1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_sizeof.py PASSED [ 75%] 2114s tests/test_sizeof.py::test_safe_sizeof[obj2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_sizeof.py PASSED [ 75%] 2114s tests/test_sizeof.py::test_safe_sizeof_logs_on_failure <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_sizeof.py PASSED [ 75%] 2115s tests/test_spans.py::test_spans <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 75%] 2115s tests/test_spans.py::test_submit <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 75%] 2115s tests/test_spans.py::test_multiple_tags <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 75%] 2115s tests/test_spans.py::test_repeat_span <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 75%] 2116s tests/test_spans.py::test_default_span <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 75%] 2118s tests/test_spans.py::test_no_extension <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 75%] 2119s tests/test_spans.py::test_task_groups[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 75%] 2119s tests/test_spans.py::test_task_groups[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 76%] 2119s tests/test_spans.py::test_before_first_task_finished <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 76%] 2120s tests/test_spans.py::test_duplicate_task_group <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 76%] 2120s tests/test_spans.py::test_mismatched_span[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 76%] 2120s tests/test_spans.py::test_mismatched_span[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 76%] 2120s tests/test_spans.py::test_no_tags <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 76%] 2120s tests/test_spans.py::test_client_desires_keys_creates_ts <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 76%] 2121s tests/test_spans.py::test_client_desires_keys_creates_tg <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 76%] 2121s tests/test_spans.py::test_scatter_creates_ts <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 76%] 2121s tests/test_spans.py::test_scatter_creates_tg <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 76%] 2122s tests/test_spans.py::test_worker_metrics <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 76%] 2122s tests/test_spans.py::test_merge_by_tags <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 76%] 2122s tests/test_spans.py::test_merge_by_tags_metrics <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 76%] 2123s tests/test_spans.py::test_code <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 76%] 2123s tests/test_spans.py::test_no_code_by_default <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 76%] 2123s tests/test_spans.py::test_merge_all <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 76%] 2123s tests/test_spans.py::test_merge_nothing <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 76%] 2124s tests/test_spans.py::test_active_cpu_seconds_trivial <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 76%] 2124s tests/test_spans.py::test_active_cpu_seconds_not_done[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 76%] 2124s tests/test_spans.py::test_active_cpu_seconds_not_done[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 76%] 2125s tests/test_spans.py::test_active_cpu_seconds_change_nthreads <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 76%] 2126s tests/test_spans.py::test_active_cpu_seconds_merged <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 76%] 2126s tests/test_spans.py::test_spans_are_visible_from_tasks <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 76%] 2126s tests/test_spans.py::test_span_on_persist <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 76%] 2127s tests/test_spans.py::test_collections_metadata <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py XPASS [ 76%] 2127s tests/test_spec.py::test_address_default_none <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spec.py PASSED [ 76%] 2127s tests/test_spec.py::test_child_address_persists <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spec.py PASSED [ 76%] 2127s tests/test_spill.py::test_psize <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spill.py PASSED [ 76%] 2127s tests/test_spill.py::test_spillbuffer <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spill.py PASSED [ 76%] 2127s tests/test_spill.py::test_disk_size_calculation <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spill.py PASSED [ 76%] 2127s tests/test_spill.py::test_spillbuffer_maxlim <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spill.py PASSED [ 76%] 2127s tests/test_spill.py::test_spillbuffer_fail_to_serialize <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spill.py PASSED [ 77%] 2127s tests/test_spill.py::test_spillbuffer_evict <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spill.py PASSED [ 77%] 2127s tests/test_spill.py::test_no_pop <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spill.py PASSED [ 77%] 2127s tests/test_spill.py::test_weakref_cache[60-SupportsWeakRef-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spill.py PASSED [ 77%] 2127s tests/test_spill.py::test_weakref_cache[60-NoWeakRef-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spill.py PASSED [ 77%] 2127s tests/test_spill.py::test_weakref_cache[110-SupportsWeakRef-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spill.py PASSED [ 77%] 2127s tests/test_spill.py::test_weakref_cache[110-NoWeakRef-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spill.py PASSED [ 77%] 2127s tests/test_spill.py::test_metrics <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spill.py PASSED [ 77%] 2127s tests/test_spill.py::test_compression_settings[zlib-100-500] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spill.py PASSED [ 77%] 2127s tests/test_spill.py::test_compression_settings[None-20000-20500] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spill.py PASSED [ 77%] 2127s tests/test_spill.py::test_str_collision <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spill.py PASSED [ 77%] 2127s tests/test_steal.py::test_work_stealing <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 77%] 2128s tests/test_steal.py::test_dont_steal_expensive_data_fast_computation <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 77%] 2129s tests/test_steal.py::test_steal_cheap_data_slow_computation <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 77%] 2129s tests/test_steal.py::test_steal_expensive_data_slow_computation <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py SKIPPED [ 77%] 2131s tests/test_steal.py::test_worksteal_many_thieves <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 77%] 2132s tests/test_steal.py::test_stop_plugin <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 77%] 2132s tests/test_steal.py::test_stop_in_flight <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 77%] 2134s tests/test_steal.py::test_allow_tasks_stolen_before_first_completes <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 77%] 2135s tests/test_steal.py::test_eventually_steal_unknown_functions <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 77%] 2135s tests/test_steal.py::test_steal_related_tasks <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py SKIPPED [ 77%] 2137s tests/test_steal.py::test_dont_steal_fast_tasks_compute_time <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 77%] 2138s tests/test_steal.py::test_dont_steal_fast_tasks_blocklist <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 77%] 2141s tests/test_steal.py::test_new_worker_steals <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 77%] 2143s tests/test_steal.py::test_work_steal_allow_other_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 77%] 2144s tests/test_steal.py::test_dont_steal_worker_restrictions <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 77%] 2145s tests/test_steal.py::test_steal_worker_restrictions <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 77%] 2145s tests/test_steal.py::test_dont_steal_host_restrictions <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 77%] 2146s tests/test_steal.py::test_steal_host_restrictions <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 77%] 2146s tests/test_steal.py::test_dont_steal_resource_restrictions <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 77%] 2147s tests/test_steal.py::test_steal_resource_restrictions <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 77%] 2147s tests/test_steal.py::test_steal_resource_restrictions_asym_diff <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 77%] 2149s tests/test_steal.py::test_balance_without_dependencies <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 78%] 2150s tests/test_steal.py::test_dont_steal_executing_tasks <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 78%] 2150s tests/test_steal.py::test_dont_steal_executing_tasks_2 <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 78%] 2152s tests/test_steal.py::test_dont_steal_few_saturated_tasks_many_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 78%] 2153s tests/test_steal.py::test_steal_when_more_tasks <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 78%] 2154s tests/test_steal.py::test_steal_more_attractive_tasks <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 78%] 2155s tests/test_steal.py::test_balance[don't move unnecessarily] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 78%] 2155s tests/test_steal.py::test_balance[balance] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 78%] 2155s tests/test_steal.py::test_balance[balance even if results in even] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 78%] 2156s tests/test_steal.py::test_balance[don't over balance] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 78%] 2156s tests/test_steal.py::test_balance[move from larger] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 78%] 2157s tests/test_steal.py::test_balance[move to smaller] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 78%] 2157s tests/test_steal.py::test_balance[choose easier first] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 78%] 2158s tests/test_steal.py::test_balance[spread evenly] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 78%] 2158s tests/test_steal.py::test_balance[move easier] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 78%] 2159s tests/test_steal.py::test_balance[be willing to move costly items] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 78%] 2159s tests/test_steal.py::test_balance[but don't move too many] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 78%] 2159s tests/test_steal.py::test_balance[no one clearly saturated] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 78%] 2160s tests/test_steal.py::test_balance[balance multiple saturated workers] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 78%] 2166s tests/test_steal.py::test_restart <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 78%] 2167s tests/test_steal.py::test_paused_workers_must_not_steal <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 78%] 2167s tests/test_steal.py::test_dont_steal_already_released <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 78%] 2168s tests/test_steal.py::test_dont_steal_long_running_tasks <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 78%] 2169s tests/test_steal.py::test_cleanup_repeated_tasks <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 78%] 2171s tests/test_steal.py::test_lose_task <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 78%] 2171s tests/test_steal.py::test_parse_stealing_interval[None-100] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 78%] 2171s tests/test_steal.py::test_parse_stealing_interval[500ms-500] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 78%] 2171s tests/test_steal.py::test_parse_stealing_interval[2-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 78%] 2176s tests/test_steal.py::test_balance_with_longer_task <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 78%] 2178s tests/test_steal.py::test_steal_concurrent_simple <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 78%] 2178s tests/test_steal.py::test_steal_reschedule_reset_in_flight_occupancy <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 78%] 2179s tests/test_steal.py::test_get_story <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 78%] 2180s tests/test_steal.py::test_steal_worker_dies_same_ip <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 79%] 2180s tests/test_steal.py::test_reschedule_concurrent_requests_deadlock <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 79%] 2180s tests/test_steal.py::test_correct_bad_time_estimate <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py SKIPPED [ 79%] 2181s tests/test_steal.py::test_steal_stimulus_id_unique <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 79%] 2181s tests/test_steal.py::test_steal_worker_state[executing] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 79%] 2181s tests/test_steal.py::test_steal_worker_state[long-running] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 79%] 2181s tests/test_steal.py::test_steal_very_fast_tasks <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py SKIPPED [ 79%] 2182s tests/test_steal.py::test_balance_expensive_tasks[not enough work to steal] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 79%] 2183s tests/test_steal.py::test_balance_expensive_tasks[enough work to steal] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 79%] 2184s tests/test_steal.py::test_balance_expensive_tasks[not enough work for increased cost] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 79%] 2184s tests/test_steal.py::test_balance_uneven_without_replica <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 79%] 2185s tests/test_steal.py::test_balance_eventually_steals_large_dependency_without_replica <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 79%] 2186s tests/test_steal.py::test_balance_even_with_replica <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 79%] 2189s tests/test_steal.py::test_balance_to_replica <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 79%] 2192s tests/test_steal.py::test_balance_multiple_to_replica <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 79%] 2194s tests/test_steal.py::test_balance_to_larger_dependency <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 79%] 2197s tests/test_steal.py::test_balance_prefers_busier_with_dependency <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 79%] 2203s tests/test_steal.py::test_trivial_workload_should_not_cause_work_stealing <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 79%] 2203s tests/test_stories.py::test_scheduler_story_stimulus_success <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_stories.py PASSED [ 79%] 2203s tests/test_stories.py::test_scheduler_story_stimulus_retry <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_stories.py PASSED [ 79%] 2204s tests/test_stories.py::test_client_story <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_stories.py PASSED [ 79%] 2204s tests/test_stories.py::test_client_story_failed_worker[ignore] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_stories.py PASSED [ 79%] 2204s tests/test_stories.py::test_client_story_failed_worker[raise] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_stories.py PASSED [ 79%] 2204s tests/test_stories.py::test_worker_story_with_deps <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_stories.py PASSED [ 79%] 2205s tests/test_stress.py::test_stress_1 <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_stress.py PASSED [ 79%] 2205s tests/test_stress.py::test_stress_gc[slowinc-100] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_stress.py SKIPPED [ 79%] 2205s tests/test_stress.py::test_stress_gc[inc-1000] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_stress.py SKIPPED [ 79%] 2212s tests/test_stress.py::test_cancel_stress <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_stress.py PASSED [ 79%] 2221s tests/test_stress.py::test_cancel_stress_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_stress.py PASSED [ 79%] 2221s tests/test_stress.py::test_stress_creation_and_deletion <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_stress.py SKIPPED [ 79%] 2224s tests/test_stress.py::test_stress_scatter_death <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_stress.py PASSED [ 79%] 2224s tests/test_stress.py::test_stress_steal <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_stress.py SKIPPED [ 79%] 2224s tests/test_stress.py::test_close_connections <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_stress.py SKIPPED [ 80%] 2224s tests/test_stress.py::test_no_delay_during_large_transfer <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_stress.py SKIPPED [ 80%] 2224s tests/test_stress.py::test_chaos_rechunk <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_stress.py SKIPPED [ 80%] 2224s tests/test_system.py::test_memory_limit <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_system.py PASSED [ 80%] 2224s tests/test_system.py::test_hard_memory_limit_cgroups <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_system.py PASSED [ 80%] 2224s tests/test_system.py::test_soft_memory_limit_cgroups <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_system.py PASSED [ 80%] 2224s tests/test_system.py::test_hard_memory_limit_cgroups2 <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_system.py PASSED [ 80%] 2224s tests/test_system.py::test_soft_memory_limit_cgroups2 <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_system.py PASSED [ 80%] 2224s tests/test_system.py::test_softest_memory_limit_cgroups2 <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_system.py PASSED [ 80%] 2224s tests/test_system.py::test_rlimit <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_system.py PASSED [ 80%] 2224s tests/test_system_monitor.py::test_SystemMonitor <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_system_monitor.py PASSED [ 80%] 2224s tests/test_system_monitor.py::test_maxlen_zero <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_system_monitor.py PASSED [ 80%] 2224s tests/test_system_monitor.py::test_count <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_system_monitor.py PASSED [ 80%] 2224s tests/test_system_monitor.py::test_range_query <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_system_monitor.py PASSED [ 80%] 2224s tests/test_system_monitor.py::test_disk_config <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_system_monitor.py PASSED [ 80%] 2224s tests/test_system_monitor.py::test_host_cpu <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_system_monitor.py PASSED [ 80%] 2224s tests/test_system_monitor.py::test_gil_contention <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_system_monitor.py SKIPPED [ 80%] 2224s tests/test_threadpoolexecutor.py::test_tpe <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_threadpoolexecutor.py PASSED [ 80%] 2225s tests/test_threadpoolexecutor.py::test_shutdown_timeout <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_threadpoolexecutor.py PASSED [ 80%] 2225s tests/test_threadpoolexecutor.py::test_shutdown_timeout_raises <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_threadpoolexecutor.py PASSED [ 80%] 2225s tests/test_threadpoolexecutor.py::test_shutdown_wait <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_threadpoolexecutor.py PASSED [ 80%] 2226s tests/test_threadpoolexecutor.py::test_secede_rejoin_busy <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_threadpoolexecutor.py PASSED [ 80%] 2226s tests/test_threadpoolexecutor.py::test_secede_rejoin_quiet <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_threadpoolexecutor.py PASSED [ 80%] 2226s tests/test_threadpoolexecutor.py::test_rejoin_idempotent <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_threadpoolexecutor.py PASSED [ 80%] 2226s tests/test_threadpoolexecutor.py::test_thread_name <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_threadpoolexecutor.py PASSED [ 80%] 2287s tests/test_tls_functional.py::test_basic <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_tls_functional.py FAILED [ 80%] 2348s tests/test_tls_functional.py::test_Queue <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_tls_functional.py FAILED [ 80%] 2409s tests/test_tls_functional.py::test_client_submit <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_tls_functional.py FAILED [ 80%] 2469s tests/test_tls_functional.py::test_gather <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_tls_functional.py FAILED [ 80%] 2530s tests/test_tls_functional.py::test_scatter <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_tls_functional.py FAILED [ 80%] 2590s tests/test_tls_functional.py::test_nanny <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_tls_functional.py FAILED [ 80%] 2651s tests/test_tls_functional.py::test_rebalance <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_tls_functional.py FAILED [ 80%] 2711s tests/test_tls_functional.py::test_work_stealing <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_tls_functional.py FAILED [ 81%] 2772s tests/test_tls_functional.py::test_worker_client <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_tls_functional.py FAILED [ 81%] 2832s tests/test_tls_functional.py::test_worker_client_gather <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_tls_functional.py FAILED [ 81%] 2893s tests/test_tls_functional.py::test_worker_client_executor <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_tls_functional.py FAILED [ 81%] 2954s tests/test_tls_functional.py::test_retire_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_tls_functional.py FAILED [ 81%] 2985s tests/test_tls_functional.py::test_security_dict_input <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_tls_functional.py FAILED [ 81%] 2985s tests/test_utils.py::test_All <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 81%] 2985s tests/test_utils.py::test_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 81%] 2985s tests/test_utils.py::test_sync_error <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 81%] 2985s tests/test_utils.py::test_sync_timeout <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 81%] 2985s tests/test_utils.py::test_sync_closed_loop <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 81%] 2985s tests/test_utils.py::test_sync_contextvars <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 81%] 2985s tests/test_utils.py::test_is_kernel <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py SKIPPED [ 81%] 2985s tests/test_utils.py::test_ensure_ip <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 81%] 2985s tests/test_utils.py::test_get_ip_interface <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 81%] 2985s tests/test_utils.py::test_get_mp_context <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 81%] 2985s tests/test_utils.py::test_truncate_exception <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 81%] 2985s tests/test_utils.py::test_get_traceback <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 81%] 2985s tests/test_utils.py::test_maybe_complex <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 81%] 2985s tests/test_utils.py::test_read_block <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 81%] 2985s tests/test_utils.py::test_seek_delimiter_endline <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 81%] 2985s tests/test_utils.py::test_ensure_memoryview[] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 81%] 2985s tests/test_utils.py::test_ensure_memoryview[data1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 81%] 2985s tests/test_utils.py::test_ensure_memoryview[1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 81%] 2985s tests/test_utils.py::test_ensure_memoryview[data3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 81%] 2985s tests/test_utils.py::test_ensure_memoryview[data4] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 81%] 2985s tests/test_utils.py::test_ensure_memoryview[data5] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 81%] 2985s tests/test_utils.py::test_ensure_memoryview[data6] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 81%] 2985s tests/test_utils.py::test_ensure_memoryview[data7] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 81%] 2985s tests/test_utils.py::test_ensure_memoryview[data8] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 81%] 2985s tests/test_utils.py::test_ensure_memoryview[data9] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 81%] 2985s tests/test_utils.py::test_ensure_memoryview[data10] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 81%] 2985s tests/test_utils.py::test_ensure_memoryview[data11] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 82%] 2985s tests/test_utils.py::test_ensure_memoryview[data12] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 82%] 2985s tests/test_utils.py::test_ensure_memoryview[data13] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 82%] 2985s tests/test_utils.py::test_ensure_memoryview[data14] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 82%] 2985s tests/test_utils.py::test_ensure_memoryview_ndarray[i8-12-shape0-strides0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 82%] 2985s tests/test_utils.py::test_ensure_memoryview_ndarray[i8-12-shape1-strides1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 82%] 2985s tests/test_utils.py::test_ensure_memoryview_ndarray[i8-12-shape2-strides2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 82%] 2985s tests/test_utils.py::test_ensure_memoryview_ndarray[i8-12-shape3-strides3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 82%] 2985s tests/test_utils.py::test_ensure_memoryview_ndarray[i8-12-shape4-strides4] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 82%] 2985s tests/test_utils.py::test_ensure_memoryview_pyarrow_buffer <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py SKIPPED [ 82%] 2985s tests/test_utils.py::test_nbytes <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 82%] 2985s tests/test_utils.py::test_open_port <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 82%] 2985s tests/test_utils.py::test_set_thread_state <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 82%] 2985s tests/test_utils.py::test_loop_runner <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 82%] 2985s tests/test_utils.py::test_two_loop_runners <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 82%] 2985s tests/test_utils.py::test_loop_runner_gen <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 82%] 2985s tests/test_utils.py::test_loop_runner_exception_in_start <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 82%] 2985s tests/test_utils.py::test_loop_runner_exception_in_teardown <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 82%] 2985s tests/test_utils.py::test_all_quiet_exceptions <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 82%] 2985s tests/test_utils.py::test_warn_on_duration <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 82%] 2985s tests/test_utils.py::test_logs <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 82%] 2985s tests/test_utils.py::test_is_valid_xml <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 82%] 2985s tests/test_utils.py::test_format_dashboard_link <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 82%] 2985s tests/test_utils.py::test_parse_ports <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 82%] 2985s tests/test_utils.py::test_run_in_executor_with_context <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 82%] 2985s tests/test_utils.py::test_run_in_executor_with_context_preserves_contextvars <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 82%] 2985s tests/test_utils.py::test_offload <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 82%] 2985s tests/test_utils.py::test_offload_preserves_contextvars <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 82%] 2985s tests/test_utils.py::test_no_default_deprecated <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 82%] 2985s tests/test_utils.py::test_iscoroutinefunction_unhashable_input <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 82%] 2985s tests/test_utils.py::test_iscoroutinefunction_nested_partial <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 82%] 2985s tests/test_utils.py::test_recursive_to_dict <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 83%] 2985s tests/test_utils.py::test_recursive_to_dict_no_nest <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 83%] 2985s tests/test_utils.py::test_log_errors <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 83%] 2985s tests/test_utils.py::test_log_errors_unroll_stack[0-test_utils] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 83%] 2985s tests/test_utils.py::test_log_errors_unroll_stack[1-a.b.c] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 83%] 2986s tests/test_utils.py::test_load_json_robust_timeout <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 83%] 2986s tests/test_utils.py::test_rate_limiter_filter <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 83%] 2986s tests/test_utils.py::test_tuple_comparable_lt[obj10-obj20-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 83%] 2986s tests/test_utils.py::test_tuple_comparable_lt[obj11-obj21-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 83%] 2986s tests/test_utils.py::test_tuple_comparable_lt[1-1-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 83%] 2986s tests/test_utils.py::test_tuple_comparable_lt[1-2-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 83%] 2986s tests/test_utils.py::test_tuple_comparable_lt[None-0-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 83%] 2986s tests/test_utils.py::test_tuple_comparable_lt[None-obj25-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 83%] 2986s tests/test_utils.py::test_tuple_comparable_eq[obj10-obj20-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 83%] 2986s tests/test_utils.py::test_tuple_comparable_eq[obj11-obj21-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 83%] 2986s tests/test_utils.py::test_tuple_comparable_eq[1-1-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 83%] 2986s tests/test_utils.py::test_tuple_comparable_eq[1-2-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 83%] 2986s tests/test_utils.py::test_tuple_comparable_eq[None-0-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 83%] 2986s tests/test_utils.py::test_tuple_comparable_eq[None-obj25-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 83%] 2986s tests/test_utils.py::test_tuple_comparable_error <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 83%] 2986s tests/test_utils_comm.py::test_pack_data <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_comm.py PASSED [ 83%] 2986s tests/test_utils_comm.py::test_subs_multiple <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_comm.py PASSED [ 83%] 2986s tests/test_utils_comm.py::test_gather_from_workers_missing_replicas <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_comm.py PASSED [ 83%] 2987s tests/test_utils_comm.py::test_gather_from_workers_permissive <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_comm.py PASSED [ 83%] 2987s tests/test_utils_comm.py::test_gather_from_workers_permissive_flaky <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_comm.py PASSED [ 83%] 2987s tests/test_utils_comm.py::test_gather_from_workers_busy <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_comm.py PASSED [ 83%] 2987s tests/test_utils_comm.py::test_gather_from_workers_serialization_error[pickle] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_comm.py PASSED [ 83%] 2988s tests/test_utils_comm.py::test_gather_from_workers_serialization_error[unpickle] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_comm.py PASSED [ 83%] 2988s tests/test_utils_comm.py::test_retry_no_exception <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_comm.py PASSED [ 83%] 2988s tests/test_utils_comm.py::test_retry0_raises_immediately <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_comm.py PASSED [ 83%] 2988s tests/test_utils_comm.py::test_retry_does_retry_and_sleep <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_comm.py PASSED [ 83%] 2988s tests/test_utils_comm.py::test_unpack_remotedata <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_comm.py PASSED [ 83%] 2988s tests/test_utils_perf.py::test_fractional_timer <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_perf.py PASSED [ 84%] 2988s tests/test_utils_perf.py::test_gc_diagnosis_cpu_time <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_perf.py SKIPPED [ 84%] 2989s tests/test_utils_perf.py::test_gc_diagnosis_rss_win <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_perf.py XFAIL [ 84%] 2993s tests/test_utils_test.py::test_bare_cluster <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 84%] 2993s tests/test_utils_test.py::test_gen_cluster <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 84%] 2993s tests/test_utils_test.py::test_gen_cluster_pytest_fixture <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 84%] 2993s tests/test_utils_test.py::test_gen_cluster_parametrized[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 84%] 2994s tests/test_utils_test.py::test_gen_cluster_multi_parametrized[a-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 84%] 2994s tests/test_utils_test.py::test_gen_cluster_multi_parametrized[b-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 84%] 2994s tests/test_utils_test.py::test_gen_cluster_parametrized_variadic_workers[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 84%] 2997s tests/test_utils_test.py::test_gen_cluster_set_config_nanny <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 84%] 2997s tests/test_utils_test.py::test_gen_cluster_cleans_up_client <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py SKIPPED [ 84%] 2997s tests/test_utils_test.py::test_gen_cluster_without_client <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 84%] 3058s tests/test_utils_test.py::test_gen_cluster_tls <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py FAILED [ 84%] 3058s tests/test_utils_test.py::test_gen_cluster_validate <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 84%] 3058s tests/test_utils_test.py::test_gen_cluster_validate_override <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 84%] 3058s tests/test_utils_test.py::test_gen_test <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py XFAILn) [ 84%] 3059s tests/test_utils_test.py::test_gen_test_legacy_implicit <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py XFAIL [ 84%] 3059s tests/test_utils_test.py::test_gen_test_legacy_explicit <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py XFAIL [ 84%] 3059s tests/test_utils_test.py::test_gen_test_parametrized[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 84%] 3059s tests/test_utils_test.py::test_gen_test_double_parametrized[False-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 84%] 3059s tests/test_utils_test.py::test_gen_test_pytest_fixture <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 84%] 3059s tests/test_utils_test.py::test_gen_test_config <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 84%] 3059s tests/test_utils_test.py::test_gen_test_config_default <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 84%] 3059s tests/test_utils_test.py::test_new_config <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 84%] 3059s tests/test_utils_test.py::test_lingering_client <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 84%] 3062s tests/test_utils_test.py::test_lingering_client_2 <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 84%] 3362s tests/test_utils_test.py::test_tls_cluster <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py +++++++++++++++++++++++++++++++++++ Timeout ++++++++++++++++++++++++++++++++++++ 3362s ~~~~~~~~~~~~~~~~~~~~~ Stack of test IOLoop_0 (3745510400) ~~~~~~~~~~~~~~~~~~~~~~ 3362s File "/usr/lib/python3.13/threading.py", line 1012, in _bootstrap 3362s self._bootstrap_inner() 3362s File "/usr/lib/python3.13/threading.py", line 1041, in _bootstrap_inner 3362s self.run() 3362s File "/usr/lib/python3.13/threading.py", line 992, in run 3362s self._target(*self._args, **self._kwargs) 3362s File "/usr/lib/python3.13/concurrent/futures/thread.py", line 92, in _worker 3362s work_item.run() 3362s File "/usr/lib/python3.13/concurrent/futures/thread.py", line 58, in run 3362s result = self.fn(*self.args, **self.kwargs) 3362s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 378, in _run_and_close_tornado 3362s return asyncio_run(inner_fn(), loop_factory=get_loop_factory()) 3362s File "/usr/lib/python3.13/asyncio/runners.py", line 194, in run 3362s return runner.run(main) 3362s File "/usr/lib/python3.13/asyncio/runners.py", line 118, in run 3362s return self._loop.run_until_complete(task) 3362s File "/usr/lib/python3.13/asyncio/base_events.py", line 707, in run_until_complete 3362s self.run_forever() 3362s File "/usr/lib/python3.13/asyncio/base_events.py", line 678, in run_forever 3362s self._run_once() 3362s File "/usr/lib/python3.13/asyncio/base_events.py", line 1995, in _run_once 3362s event_list = self._selector.select(timeout) 3362s File "/usr/lib/python3.13/selectors.py", line 452, in select 3362s fd_event_list = self._selector.poll(timeout, max_ev) 3362s ~~~~~~~~~~~~~~~~~ Stack of Dask-Callback-Thread_0 (3766481920) ~~~~~~~~~~~~~~~~~ 3362s File "/usr/lib/python3.13/threading.py", line 1012, in _bootstrap 3362s self._bootstrap_inner() 3362s File "/usr/lib/python3.13/threading.py", line 1041, in _bootstrap_inner 3362s self.run() 3362s File "/usr/lib/python3.13/threading.py", line 992, in run 3362s self._target(*self._args, **self._kwargs) 3362s File "/usr/lib/python3.13/concurrent/futures/thread.py", line 89, in _worker 3362s work_item = work_queue.get(block=True) 3362s ~~~~~~~~~~~~~~~~~~~~~ Stack of Dask-Offload_0 (3916579840) ~~~~~~~~~~~~~~~~~~~~~ 3362s File "/usr/lib/python3.13/threading.py", line 1012, in _bootstrap 3362s self._bootstrap_inner() 3362s File "/usr/lib/python3.13/threading.py", line 1041, in _bootstrap_inner 3362s self.run() 3362s File "/usr/lib/python3.13/threading.py", line 992, in run 3362s self._target(*self._args, **self._kwargs) 3362s File "/usr/lib/python3.13/concurrent/futures/thread.py", line 89, in _worker 3362s work_item = work_queue.get(block=True) 3362s +++++++++++++++++++++++++++++++++++ Timeout ++++++++++++++++++++++++++++++++++++ 3362s ERROR [ 84%] 3362s tests/test_utils_test.py::test_tls_scheduler <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 84%] 3362s tests/test_utils_test.py::test__UnhashableCallable <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 84%] 3362s tests/test_utils_test.py::test_dump_cluster_state_timeout <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py SKIPPED [ 84%] 3362s tests/test_utils_test.py::test_assert_story <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 84%] 3362s tests/test_utils_test.py::test_assert_story_malformed_story[Missing payload, stimulus_id, ts] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 85%] 3362s tests/test_utils_test.py::test_assert_story_malformed_story[Missing (stimulus_id, ts)] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 85%] 3362s tests/test_utils_test.py::test_assert_story_malformed_story[Missing ts] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 85%] 3362s tests/test_utils_test.py::test_assert_story_malformed_story[ts is not a float] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 85%] 3362s tests/test_utils_test.py::test_assert_story_malformed_story[ts is in the future] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 85%] 3362s tests/test_utils_test.py::test_assert_story_malformed_story[ts is too old] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 85%] 3362s tests/test_utils_test.py::test_assert_story_malformed_story[stimulus_id is not a str] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 85%] 3362s tests/test_utils_test.py::test_assert_story_malformed_story[stimulus_id is an empty str] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 85%] 3362s tests/test_utils_test.py::test_assert_story_malformed_story[no payload] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 85%] 3362s tests/test_utils_test.py::test_assert_story_malformed_story[timestamps out of order] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 85%] 3362s tests/test_utils_test.py::test_assert_story_identity[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 85%] 3363s tests/test_utils_test.py::test_assert_story_identity[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 85%] 3363s tests/test_utils_test.py::test_dump_cluster_state <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 85%] 3363s tests/test_utils_test.py::test_dump_cluster_state_no_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 85%] 3365s tests/test_utils_test.py::test_dump_cluster_state_nannies <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 85%] 3366s tests/test_utils_test.py::test_dump_cluster_state_unresponsive_local_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 85%] 3366s tests/test_utils_test.py::test_dump_cluster_unresponsive_remote_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py SKIPPED [ 85%] 3367s tests/test_utils_test.py::test_check_process_leak <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 85%] 3369s tests/test_utils_test.py::test_check_process_leak_slow_cleanup <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 85%] 3370s tests/test_utils_test.py::test_check_process_leak_pre_cleanup[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 85%] 3372s tests/test_utils_test.py::test_check_process_leak_pre_cleanup[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 85%] 3373s tests/test_utils_test.py::test_check_process_leak_post_cleanup[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 85%] 3375s tests/test_utils_test.py::test_check_process_leak_post_cleanup[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 85%] 3378s tests/test_utils_test.py::test_start_failure_worker[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 85%] 3379s tests/test_utils_test.py::test_start_failure_worker[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 85%] 3380s tests/test_utils_test.py::test_start_failure_scheduler <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 85%] 3381s tests/test_utils_test.py::test_invalid_transitions <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 85%] 3381s tests/test_utils_test.py::test_invalid_worker_state <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 85%] 3381s tests/test_utils_test.py::test_raises_with_cause <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 85%] 3381s tests/test_utils_test.py::test_check_thread_leak <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py SKIPPED [ 85%] 3381s tests/test_utils_test.py::test_fail_hard[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 85%] 3381s tests/test_utils_test.py::test_fail_hard[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 85%] 3381s tests/test_utils_test.py::test_popen_write_during_terminate_deadlock <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 86%] 3391s tests/test_utils_test.py::test_popen_timeout <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 86%] 3392s tests/test_utils_test.py::test_popen_always_prints_output <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 86%] 3392s tests/test_utils_test.py::test_wait_for_state <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 86%] 3392s tests/test_utils_test.py::test_wait_for_stimulus <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 86%] 3392s tests/test_utils_test.py::test_ws_with_running_task[executing] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 86%] 3392s tests/test_utils_test.py::test_ws_with_running_task[long-running] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 86%] 3392s tests/test_utils_test.py::test_sizeof <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 86%] 3392s tests/test_utils_test.py::test_sizeof_error[12345.0-TypeError-Expected integer] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 86%] 3392s tests/test_utils_test.py::test_sizeof_error[-1-ValueError-larger than] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 86%] 3392s tests/test_utils_test.py::test_sizeof_error[0-ValueError-larger than] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 86%] 3392s tests/test_utils_test.py::test_sizeof_error[10-ValueError-larger than] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 86%] 3392s tests/test_utils_test.py::test_captured_logger <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 86%] 3392s tests/test_utils_test.py::test_captured_context_meter <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 86%] 3392s tests/test_variable.py::test_variable <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_variable.py PASSED [ 86%] 3393s tests/test_variable.py::test_delete_unset_variable <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_variable.py PASSED [ 86%] 3393s tests/test_variable.py::test_queue_with_data <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_variable.py PASSED [ 86%] 3396s tests/test_variable.py::test_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_variable.py PASSED [ 86%] 3396s tests/test_variable.py::test_hold_futures <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_variable.py PASSED [ 86%] 3396s tests/test_variable.py::test_timeout <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_variable.py PASSED [ 86%] 3399s tests/test_variable.py::test_timeout_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_variable.py PASSED [ 86%] 3400s tests/test_variable.py::test_cleanup <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_variable.py PASSED [ 86%] 3402s tests/test_variable.py::test_pickleable <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_variable.py PASSED [ 86%] 3403s tests/test_variable.py::test_timeout_get <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_variable.py PASSED [ 86%] 3403s tests/test_variable.py::test_race <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_variable.py SKIPPED [ 86%] 3403s tests/test_variable.py::test_Future_knows_status_immediately <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_variable.py PASSED [ 86%] 3403s tests/test_variable.py::test_erred_future <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_variable.py PASSED [ 86%] 3406s tests/test_variable.py::test_future_erred_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_variable.py PASSED [ 86%] 3406s tests/test_variable.py::test_variables_do_not_leak_client <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_variable.py PASSED [ 86%] 3406s tests/test_variable.py::test_unpickle_without_client <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_variable.py PASSED [ 86%] 3407s tests/test_versions.py::test_versions_match <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_versions.py PASSED [ 86%] 3407s tests/test_versions.py::test_version_mismatch[source-MISMATCHED] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_versions.py PASSED [ 86%] 3407s tests/test_versions.py::test_version_mismatch[source-MISSING] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_versions.py PASSED [ 87%] 3407s tests/test_versions.py::test_version_mismatch[source-KEY_ERROR] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_versions.py PASSED [ 87%] 3407s tests/test_versions.py::test_version_mismatch[source-NONE] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_versions.py PASSED [ 87%] 3407s tests/test_versions.py::test_version_mismatch[scheduler-MISMATCHED] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_versions.py PASSED [ 87%] 3407s tests/test_versions.py::test_version_mismatch[scheduler-MISSING] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_versions.py PASSED [ 87%] 3408s tests/test_versions.py::test_version_mismatch[scheduler-KEY_ERROR] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_versions.py PASSED [ 87%] 3408s tests/test_versions.py::test_version_mismatch[scheduler-NONE] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_versions.py PASSED [ 87%] 3408s tests/test_versions.py::test_version_mismatch[worker-1-MISMATCHED] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_versions.py PASSED [ 87%] 3408s tests/test_versions.py::test_version_mismatch[worker-1-MISSING] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_versions.py PASSED [ 87%] 3408s tests/test_versions.py::test_version_mismatch[worker-1-KEY_ERROR] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_versions.py PASSED [ 87%] 3408s tests/test_versions.py::test_version_mismatch[worker-1-NONE] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_versions.py PASSED [ 87%] 3408s tests/test_versions.py::test_scheduler_mismatched_irrelevant_package <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_versions.py PASSED [ 87%] 3408s tests/test_versions.py::test_scheduler_additional_irrelevant_package <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_versions.py PASSED [ 87%] 3409s tests/test_versions.py::test_python_mismatch[source] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_versions.py PASSED [ 87%] 3409s tests/test_versions.py::test_python_mismatch[scheduler] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_versions.py PASSED [ 87%] 3409s tests/test_versions.py::test_python_mismatch[worker-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_versions.py PASSED [ 87%] 3409s tests/test_versions.py::test_version_warning_in_cluster <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_versions.py PASSED [ 87%] 3409s tests/test_versions.py::test_python_version <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_versions.py PASSED [ 87%] 3409s tests/test_versions.py::test_version_custom_pkgs <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_versions.py PASSED [ 87%] 3409s tests/test_worker.py::test_worker_nthreads <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 87%] 3409s tests/test_worker.py::test_str <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 87%] 3410s tests/test_worker.py::test_identity <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 87%] 3410s tests/test_worker.py::test_worker_bad_args <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 87%] 3412s tests/test_worker.py::test_upload_file <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 87%] 3412s tests/test_worker.py::test_upload_file_pyc <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py SKIPPED [ 87%] 3413s tests/test_worker.py::test_upload_egg <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 87%] 3413s tests/test_worker.py::test_upload_pyz <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 87%] 3413s tests/test_worker.py::test_upload_large_file <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py SKIPPED [ 87%] 3413s tests/test_worker.py::test_broadcast <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 87%] 3413s tests/test_worker.py::test_worker_with_port_zero <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 87%] 3414s tests/test_worker.py::test_worker_port_range <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 87%] 3414s tests/test_worker.py::test_worker_waits_for_scheduler <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py SKIPPED [ 87%] 3414s tests/test_worker.py::test_worker_task_data <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 88%] 3414s tests/test_worker.py::test_error_message <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 88%] 3414s tests/test_worker.py::test_chained_error_message <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 88%] 3414s tests/test_worker.py::test_base_exception_in_task[BaseException-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py SKIPPED [ 88%] 3414s tests/test_worker.py::test_base_exception_in_task[BaseException-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py SKIPPED [ 88%] 3414s tests/test_worker.py::test_base_exception_in_task[SystemExit-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py SKIPPED [ 88%] 3414s tests/test_worker.py::test_base_exception_in_task[SystemExit-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py SKIPPED [ 88%] 3414s tests/test_worker.py::test_base_exception_in_task[KeyboardInterrupt-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py SKIPPED [ 88%] 3414s tests/test_worker.py::test_base_exception_in_task[KeyboardInterrupt-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py SKIPPED [ 88%] 3414s tests/test_worker.py::test_base_exception_in_task[CancelledError-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py SKIPPED [ 88%] 3414s tests/test_worker.py::test_base_exception_in_task[CancelledError-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py SKIPPED [ 88%] 3414s tests/test_worker.py::test_gather <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 88%] 3415s tests/test_worker.py::test_gather_missing_keys <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 88%] 3415s tests/test_worker.py::test_gather_missing_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 88%] 3415s tests/test_worker.py::test_gather_missing_workers_replicated[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py SKIPPED [ 88%] 3415s tests/test_worker.py::test_gather_missing_workers_replicated[True0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py SKIPPED [ 88%] 3415s tests/test_worker.py::test_gather_missing_workers_replicated[True1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py SKIPPED [ 88%] 3415s tests/test_worker.py::test_gather_missing_workers_replicated[True2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py SKIPPED [ 88%] 3415s tests/test_worker.py::test_gather_missing_workers_replicated[True3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py SKIPPED [ 88%] 3415s tests/test_worker.py::test_io_loop <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 88%] 3415s tests/test_worker.py::test_io_loop_alternate_loop <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 88%] 3415s tests/test_worker.py::test_access_key <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 88%] 3416s tests/test_worker.py::test_run_dask_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 88%] 3416s tests/test_worker.py::test_run_dask_worker_kwonlyarg <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 88%] 3416s tests/test_worker.py::test_run_coroutine_dask_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 88%] 3416s tests/test_worker.py::test_Executor <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 88%] 3417s tests/test_worker.py::test_close_on_disconnect <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 88%] 3417s tests/test_worker.py::test_memory_limit_auto <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 88%] 3417s tests/test_worker.py::test_inter_worker_communication <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 88%] 3417s tests/test_worker.py::test_clean <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 88%] 3418s tests/test_worker.py::test_message_breakup <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 88%] 3418s tests/test_worker.py::test_types <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 3418s tests/test_worker.py::test_system_monitor <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 3419s tests/test_worker.py::test_restrictions <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 3420s tests/test_worker.py::test_clean_nbytes <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 3422s tests/test_worker.py::test_gather_many_small[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 3424s tests/test_worker.py::test_gather_many_small[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 3424s tests/test_worker.py::test_multiple_transfers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 3425s tests/test_worker.py::test_share_communication <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py XFAIL [ 89%] 3425s tests/test_worker.py::test_dont_overlap_communications_to_same_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py XFAIL [ 89%] 3425s tests/test_worker.py::test_log_event <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 3426s tests/test_worker.py::test_log_exception_on_failed_task <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 3426s tests/test_worker.py::test_clean_up_dependencies <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 3426s tests/test_worker.py::test_hold_onto_dependents <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 3427s tests/test_worker.py::test_worker_death_timeout <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py XPASS [ 89%] 3427s tests/test_worker.py::test_stop_doing_unnecessary_work <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 3427s tests/test_worker.py::test_priorities <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 3429s tests/test_worker.py::test_heartbeats <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 3429s tests/test_worker.py::test_worker_dir[Worker] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 3429s tests/test_worker.py::test_worker_dir[Nanny] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 3432s tests/test_worker.py::test_default_worker_dir <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 3432s tests/test_worker.py::test_dataframe_attribute_error <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 3432s tests/test_worker.py::test_pid <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 3433s tests/test_worker.py::test_get_client <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 3435s tests/test_worker.py::test_get_client_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 3435s tests/test_worker.py::test_get_client_coroutine <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 3438s tests/test_worker.py::test_get_client_coroutine_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py XFAIL/distributed/pull/7339) [ 89%] 3438s tests/test_worker.py::test_global_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 3438s tests/test_worker.py::test_worker_fds <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 3439s tests/test_worker.py::test_service_hosts_match_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 3439s tests/test_worker.py::test_start_services <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 3441s tests/test_worker.py::test_scheduler_delay <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 3441s tests/test_worker.py::test_statistical_profiling <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 3441s tests/test_worker.py::test_statistical_profiling_2 <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py SKIPPED [ 90%] 3442s tests/test_worker.py::test_statistical_profiling_cycle <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 3442s tests/test_worker.py::test_get_current_task <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 3442s tests/test_worker.py::test_deque_handler <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 3443s tests/test_worker.py::test_scheduler_address_config <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 3443s tests/test_worker.py::test_wait_for_outgoing <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py SKIPPED [ 90%] 3443s tests/test_worker.py::test_prefer_gather_from_local_address <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 3445s tests/test_worker.py::test_avoid_oversubscription <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 3445s tests/test_worker.py::test_custom_metrics <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 3446s tests/test_worker.py::test_register_worker_callbacks <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 3446s tests/test_worker.py::test_register_worker_callbacks_err <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 3446s tests/test_worker.py::test_local_directory <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 3446s tests/test_worker.py::test_local_directory_make_new_directory <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 3449s tests/test_worker.py::test_host_address <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 3449s tests/test_worker.py::test_interface_async[Worker] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 3451s tests/test_worker.py::test_interface_async[Nanny] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 3451s tests/test_worker.py::test_protocol_from_scheduler_address[Worker] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py SKIPPED [ 90%] 3451s tests/test_worker.py::test_protocol_from_scheduler_address[Nanny] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py SKIPPED [ 90%] 3451s tests/test_worker.py::test_worker_listens_on_same_interface_by_default[Worker] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 3453s tests/test_worker.py::test_worker_listens_on_same_interface_by_default[Nanny] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 3453s tests/test_worker.py::test_close_gracefully <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py SKIPPED [ 90%] 3453s tests/test_worker.py::test_close_gracefully_no_suspicious_tasks <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py SKIPPED [ 90%] 3454s tests/test_worker.py::test_close_while_executing[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 3454s tests/test_worker.py::test_close_while_executing[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py SKIPPED [ 90%] 3454s tests/test_worker.py::test_close_async_task_handles_cancellation <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py SKIPPED [ 90%] 3454s tests/test_worker.py::test_lifetime <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py SKIPPED [ 90%] 3454s tests/test_worker.py::test_lifetime_stagger <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 3454s tests/test_worker.py::test_bad_metrics <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 3454s tests/test_worker.py::test_bad_startup <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 3454s tests/test_worker.py::test_update_latency <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 3454s tests/test_worker.py::test_workerstate_executing <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py SKIPPED [ 90%] 3454s tests/test_worker.py::test_shutdown_on_scheduler_comm_closed <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 3454s tests/test_worker.py::test_heartbeat_comm_closed <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 3454s tests/test_worker.py::test_heartbeat_missing <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 3454s tests/test_worker.py::test_heartbeat_missing_real_cluster <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 3454s tests/test_worker.py::test_heartbeat_missing_doesnt_restart <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py SKIPPED [ 91%] 3455s tests/test_worker.py::test_bad_local_directory <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 3455s tests/test_worker.py::test_taskstate_metadata <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 3455s tests/test_worker.py::test_executor_offload <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 3455s tests/test_worker.py::test_story <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 3455s tests/test_worker.py::test_stimulus_story <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 3456s tests/test_worker.py::test_worker_descopes_data <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 3457s tests/test_worker.py::test_gather_dep_one_worker_always_busy <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 3458s tests/test_worker.py::test_gather_dep_local_workers_first <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 3459s tests/test_worker.py::test_gather_dep_from_remote_workers_if_all_local_workers_are_busy <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 3459s tests/test_worker.py::test_worker_client_uses_default_no_close <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 3460s tests/test_worker.py::test_worker_client_closes_if_created_on_worker_one_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 3460s tests/test_worker.py::test_worker_client_closes_if_created_on_worker_last_worker_alive <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 3460s tests/test_worker.py::test_multiple_executors <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 3461s tests/test_worker.py::test_bad_executor_annotation <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 3461s tests/test_worker.py::test_process_executor <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 3461s tests/test_worker.py::test_process_executor_raise_exception <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 3462s tests/test_worker.py::test_worker_state_error_release_error_last <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 3462s tests/test_worker.py::test_worker_state_error_release_error_first <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 3462s tests/test_worker.py::test_worker_state_error_release_error_int <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 3463s tests/test_worker.py::test_worker_state_error_long_chain <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 3464s tests/test_worker.py::test_hold_on_to_replicas <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 3464s tests/test_worker.py::test_forget_dependents_after_release <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 3464s tests/test_worker.py::test_acquire_replicas <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 3464s tests/test_worker.py::test_acquire_replicas_same_channel <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 3465s tests/test_worker.py::test_acquire_replicas_many <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 3466s tests/test_worker.py::test_acquire_replicas_already_in_flight <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 3466s tests/test_worker.py::test_forget_acquire_replicas <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py SKIPPED [ 91%] 3466s tests/test_worker.py::test_remove_replicas_simple <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 3466s tests/test_worker.py::test_who_has_consistent_remove_replicas <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 3467s tests/test_worker.py::test_acquire_replicas_with_no_priority <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 3467s tests/test_worker.py::test_acquire_replicas_large_data <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 3467s tests/test_worker.py::test_missing_released_zombie_tasks <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 3467s tests/test_worker.py::test_missing_released_zombie_tasks_2 <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 3468s tests/test_worker.py::test_worker_status_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 3468s tests/test_worker.py::test_log_remove_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 3469s tests/test_worker.py::test_task_flight_compute_oserror <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 3469s tests/test_worker.py::test_gather_dep_cancelled_rescheduled <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 3469s tests/test_worker.py::test_gather_dep_do_not_handle_response_of_not_requested_tasks <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 3470s tests/test_worker.py::test_gather_dep_no_longer_in_flight_tasks <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 3472s tests/test_worker.py::test_get_data_cancelled_error <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 3472s tests/test_worker.py::test_Worker__to_dict <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 3472s tests/test_worker.py::test_extension_methods <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 3472s tests/test_worker.py::test_benchmark_hardware <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 3472s tests/test_worker.py::test_tick_interval <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py SKIPPED [ 92%] 3472s tests/test_worker.py::test_broken_comm <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py SKIPPED [ 92%] 3472s tests/test_worker.py::test_do_not_block_event_loop_during_shutdown <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 3473s tests/test_worker.py::test_reconnect_argument_deprecated <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 3473s tests/test_worker.py::test_worker_running_before_running_plugins <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 3473s tests/test_worker.py::test_execute_preamble_abort_retirement <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 3473s tests/test_worker.py::test_deprecation_of_renamed_worker_attributes <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 3476s tests/test_worker.py::test_forward_output <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 3477s tests/test_worker.py::test_offload_getdata <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 3477s tests/test_worker.py::test_startstops <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 3477s tests/test_worker.py::test_suppress_keyerror_for_cancelled_tasks[cancelled] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 3478s tests/test_worker.py::test_suppress_keyerror_for_cancelled_tasks[resumed] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 3478s tests/test_worker_client.py::test_submit_from_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_client.py PASSED [ 92%] 3479s tests/test_worker_client.py::test_submit_from_worker_async <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_client.py PASSED [ 92%] 3480s tests/test_worker_client.py::test_scatter_from_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_client.py PASSED [ 92%] 3480s tests/test_worker_client.py::test_scatter_singleton <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_client.py PASSED [ 92%] 3480s tests/test_worker_client.py::test_gather_multi_machine <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_client.py PASSED [ 92%] 3480s tests/test_worker_client.py::test_same_loop <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_client.py PASSED [ 93%] 3484s tests/test_worker_client.py::test_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_client.py PASSED [ 93%] 3485s tests/test_worker_client.py::test_async <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_client.py PASSED [ 93%] 3485s tests/test_worker_client.py::test_separate_thread_false <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_client.py PASSED [ 93%] 3486s tests/test_worker_client.py::test_client_executor <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_client.py PASSED [ 93%] 3486s tests/test_worker_client.py::test_local_client_warning <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_client.py PASSED [ 93%] 3486s tests/test_worker_client.py::test_closing_worker_doesnt_close_client <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_client.py PASSED [ 93%] 3489s tests/test_worker_client.py::test_timeout <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_client.py PASSED [ 93%] 3489s tests/test_worker_client.py::test_secede_without_stealing_issue_1262 <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_client.py PASSED [ 93%] 3489s tests/test_worker_client.py::test_compute_within_worker_client <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_client.py PASSED [ 93%] 3490s tests/test_worker_client.py::test_worker_client_rejoins <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_client.py PASSED [ 93%] 3490s tests/test_worker_client.py::test_submit_different_names <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_client.py XPASS [ 93%] 3491s tests/test_worker_client.py::test_secede_does_not_claim_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_client.py PASSED [ 93%] 3491s tests/test_worker_memory.py::test_parse_memory_limit_zero <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 93%] 3491s tests/test_worker_memory.py::test_resource_limit <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 93%] 3491s tests/test_worker_memory.py::test_parse_memory_limit_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 93%] 3492s tests/test_worker_memory.py::test_parse_memory_limit_worker_relative <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 93%] 3494s tests/test_worker_memory.py::test_parse_memory_limit_nanny <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 93%] 3494s tests/test_worker_memory.py::test_dict_data_if_no_spill_to_disk <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 93%] 3494s tests/test_worker_memory.py::test_worker_data_callable_local_directory <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 93%] 3494s tests/test_worker_memory.py::test_worker_data_callable_local_directory_kwargs <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 93%] 3494s tests/test_worker_memory.py::test_worker_data_callable_kwargs <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 93%] 3494s tests/test_worker_memory.py::test_workerstate_fail_to_pickle_execute_1[executing] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 93%] 3494s tests/test_worker_memory.py::test_workerstate_fail_to_pickle_execute_1[long-running] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 93%] 3494s tests/test_worker_memory.py::test_workerstate_fail_to_pickle_flight <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 93%] 3494s tests/test_worker_memory.py::test_fail_to_pickle_execute_2 <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 93%] 3495s tests/test_worker_memory.py::test_fail_to_pickle_spill <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 93%] 3495s tests/test_worker_memory.py::test_spill_target_threshold <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 93%] 3495s tests/test_worker_memory.py::test_spill_constrained <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 93%] 3495s tests/test_worker_memory.py::test_spill_spill_threshold <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 93%] 3496s tests/test_worker_memory.py::test_spill_hysteresis[False-10000000000-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 93%] 3496s tests/test_worker_memory.py::test_spill_hysteresis[0.7-0-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 93%] 3497s tests/test_worker_memory.py::test_spill_hysteresis[0.4-0-7] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 3497s tests/test_worker_memory.py::test_pause_executor_manual <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 3498s tests/test_worker_memory.py::test_pause_executor_with_memory_monitor <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 3498s tests/test_worker_memory.py::test_pause_prevents_deps_fetch <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 3498s tests/test_worker_memory.py::test_avoid_memory_monitor_if_zero_limit_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 3501s tests/test_worker_memory.py::test_avoid_memory_monitor_if_zero_limit_nanny <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 3501s tests/test_worker_memory.py::test_override_data_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 3503s tests/test_worker_memory.py::test_override_data_nanny <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 3504s tests/test_worker_memory.py::test_override_data_vs_memory_monitor <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 3504s tests/test_worker_memory.py::test_manual_evict_proto <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 3504s tests/test_worker_memory.py::test_nanny_terminate <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py SKIPPED [ 94%] 3504s tests/test_worker_memory.py::test_disk_cleanup_on_terminate[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py SKIPPED [ 94%] 3504s tests/test_worker_memory.py::test_disk_cleanup_on_terminate[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py SKIPPED [ 94%] 3505s tests/test_worker_memory.py::test_pause_while_spilling <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 3505s tests/test_worker_memory.py::test_release_evloop_while_spilling <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py SKIPPED [ 94%] 3505s tests/test_worker_memory.py::test_deprecated_attributes[Worker-memory_limit-123000000000.0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 3505s tests/test_worker_memory.py::test_deprecated_attributes[Worker-memory_target_fraction-0.789] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 3505s tests/test_worker_memory.py::test_deprecated_attributes[Worker-memory_spill_fraction-0.789] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 3505s tests/test_worker_memory.py::test_deprecated_attributes[Worker-memory_pause_fraction-0.789] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 3507s tests/test_worker_memory.py::test_deprecated_attributes[Nanny-memory_limit-123000000000.0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 3509s tests/test_worker_memory.py::test_deprecated_attributes[Nanny-memory_terminate_fraction-0.789] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 3510s tests/test_worker_memory.py::test_deprecated_memory_monitor_method_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 3512s tests/test_worker_memory.py::test_deprecated_memory_monitor_method_nanny <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 3512s tests/test_worker_memory.py::test_deprecated_params[memory_target_fraction] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 3512s tests/test_worker_memory.py::test_deprecated_params[memory_spill_fraction] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 3512s tests/test_worker_memory.py::test_deprecated_params[memory_pause_fraction] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 3513s tests/test_worker_memory.py::test_pause_while_idle <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 3513s tests/test_worker_memory.py::test_pause_while_saturated <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 3513s tests/test_worker_memory.py::test_worker_log_memory_limit_too_high <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 3514s tests/test_worker_memory.py::test_high_unmanaged_memory_warning <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 3514s tests/test_worker_memory.py::test_delete_spilled_keys <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 3514s tests/test_worker_metrics.py::test_task_lifecycle <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_metrics.py PASSED [ 95%] 3515s tests/test_worker_metrics.py::test_async_task <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_metrics.py PASSED [ 95%] 3515s tests/test_worker_metrics.py::test_custom_executor <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_metrics.py PASSED [ 95%] 3515s tests/test_worker_metrics.py::test_offload <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_metrics.py PASSED [ 95%] 3515s tests/test_worker_metrics.py::test_execute_failed <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_metrics.py PASSED [ 95%] 3516s tests/test_worker_metrics.py::test_cancelled_execute <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_metrics.py PASSED [ 95%] 3516s tests/test_worker_metrics.py::test_cancelled_flight <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_metrics.py PASSED [ 95%] 3517s tests/test_worker_metrics.py::test_gather_dep_busy <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_metrics.py PASSED [ 95%] 3518s tests/test_worker_metrics.py::test_gather_dep_no_task <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_metrics.py PASSED [ 95%] 3518s tests/test_worker_metrics.py::test_gather_dep_failed <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_metrics.py PASSED [ 95%] 3519s tests/test_worker_metrics.py::test_gather_dep_network_error <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_metrics.py PASSED [ 95%] 3519s tests/test_worker_metrics.py::test_memory_monitor <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_metrics.py PASSED [ 95%] 3520s tests/test_worker_metrics.py::test_user_metrics_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_metrics.py PASSED [ 95%] 3520s tests/test_worker_metrics.py::test_user_metrics_async <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_metrics.py PASSED [ 95%] 3520s tests/test_worker_metrics.py::test_user_metrics_fail <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_metrics.py PASSED [ 95%] 3521s tests/test_worker_metrics.py::test_user_metrics_weird <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_metrics.py PASSED [ 95%] 3524s tests/test_worker_metrics.py::test_do_not_leak_metrics <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_metrics.py PASSED [ 95%] 3525s tests/test_worker_metrics.py::test_reschedule <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_metrics.py PASSED [ 95%] 3525s tests/test_worker_metrics.py::test_send_metrics_to_scheduler <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_metrics.py PASSED [ 95%] 3525s tests/test_worker_metrics.py::test_no_spans_extension <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_metrics.py PASSED [ 95%] 3526s tests/test_worker_metrics.py::test_new_metrics_during_heartbeat <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_metrics.py PASSED [ 95%] 3529s tests/test_worker_metrics.py::test_delayed_ledger_is_not_reentrant <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_metrics.py PASSED [ 95%] 3529s tests/test_worker_metrics.py::test_int_metrics <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_metrics.py PASSED [ 95%] 3529s tests/test_worker_state_machine.py::test_instruction_match <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 95%] 3530s tests/test_worker_state_machine.py::test_TaskState_tracking <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 95%] 3530s tests/test_worker_state_machine.py::test_TaskState_get_nbytes <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 95%] 3530s tests/test_worker_state_machine.py::test_TaskState_eq <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 95%] 3530s tests/test_worker_state_machine.py::test_TaskState__to_dict <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 95%] 3530s tests/test_worker_state_machine.py::test_TaskState_repr <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 95%] 3530s tests/test_worker_state_machine.py::test_WorkerState__to_dict <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 95%] 3530s tests/test_worker_state_machine.py::test_WorkerState_pickle <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 95%] 3530s tests/test_worker_state_machine.py::test_pickle_exceptions[False-InvalidTransition-kwargs0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 95%] 3530s tests/test_worker_state_machine.py::test_pickle_exceptions[False-TransitionCounterMaxExceeded-kwargs1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 3530s tests/test_worker_state_machine.py::test_pickle_exceptions[False-InvalidTaskState-kwargs2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 3530s tests/test_worker_state_machine.py::test_pickle_exceptions[True-InvalidTransition-kwargs0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 3530s tests/test_worker_state_machine.py::test_pickle_exceptions[True-TransitionCounterMaxExceeded-kwargs1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 3530s tests/test_worker_state_machine.py::test_pickle_exceptions[True-InvalidTaskState-kwargs2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 3530s tests/test_worker_state_machine.py::test_slots[TaskState] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 3530s tests/test_worker_state_machine.py::test_slots[Instruction] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 3530s tests/test_worker_state_machine.py::test_slots[GatherDep] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 3530s tests/test_worker_state_machine.py::test_slots[Execute] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 3530s tests/test_worker_state_machine.py::test_slots[RetryBusyWorkerLater] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 3530s tests/test_worker_state_machine.py::test_slots[SendMessageToScheduler] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 3530s tests/test_worker_state_machine.py::test_slots[TaskFinishedMsg] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 3530s tests/test_worker_state_machine.py::test_slots[TaskErredMsg] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 3530s tests/test_worker_state_machine.py::test_slots[ReleaseWorkerDataMsg] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 3530s tests/test_worker_state_machine.py::test_slots[RescheduleMsg] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 3530s tests/test_worker_state_machine.py::test_slots[LongRunningMsg] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 3530s tests/test_worker_state_machine.py::test_slots[AddKeysMsg] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 3530s tests/test_worker_state_machine.py::test_slots[RequestRefreshWhoHasMsg] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 3530s tests/test_worker_state_machine.py::test_slots[StealResponseMsg] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 3530s tests/test_worker_state_machine.py::test_slots[StateMachineEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 3530s tests/test_worker_state_machine.py::test_slots[PauseEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 3530s tests/test_worker_state_machine.py::test_slots[UnpauseEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 3530s tests/test_worker_state_machine.py::test_slots[RetryBusyWorkerEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 3530s tests/test_worker_state_machine.py::test_slots[GatherDepDoneEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 3530s tests/test_worker_state_machine.py::test_slots[GatherDepSuccessEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 3530s tests/test_worker_state_machine.py::test_slots[GatherDepBusyEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 3530s tests/test_worker_state_machine.py::test_slots[GatherDepNetworkFailureEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 3530s tests/test_worker_state_machine.py::test_slots[GatherDepFailureEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 3530s tests/test_worker_state_machine.py::test_slots[RemoveWorkerEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 3530s tests/test_worker_state_machine.py::test_slots[ComputeTaskEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 3530s tests/test_worker_state_machine.py::test_slots[ExecuteDoneEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 3530s tests/test_worker_state_machine.py::test_slots[ExecuteSuccessEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 3530s tests/test_worker_state_machine.py::test_slots[ExecuteFailureEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 3530s tests/test_worker_state_machine.py::test_slots[RescheduleEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 3530s tests/test_worker_state_machine.py::test_slots[CancelComputeEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 3530s tests/test_worker_state_machine.py::test_slots[FindMissingEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 3530s tests/test_worker_state_machine.py::test_slots[RefreshWhoHasEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 3530s tests/test_worker_state_machine.py::test_slots[AcquireReplicasEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 3530s tests/test_worker_state_machine.py::test_slots[RemoveReplicasEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 3530s tests/test_worker_state_machine.py::test_slots[FreeKeysEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 3530s tests/test_worker_state_machine.py::test_slots[StealRequestEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 3530s tests/test_worker_state_machine.py::test_slots[UpdateDataEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 3530s tests/test_worker_state_machine.py::test_slots[SecedeEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 3530s tests/test_worker_state_machine.py::test_sendmsg_to_dict <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 3530s tests/test_worker_state_machine.py::test_merge_recs_instructions <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 3530s tests/test_worker_state_machine.py::test_event_to_dict_with_annotations <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 3530s tests/test_worker_state_machine.py::test_event_to_dict_without_annotations <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 3530s tests/test_worker_state_machine.py::test_computetask_to_dict <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 3530s tests/test_worker_state_machine.py::test_computetask_dummy <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 3530s tests/test_worker_state_machine.py::test_updatedata_to_dict <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 3530s tests/test_worker_state_machine.py::test_executesuccess_to_dict <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 3530s tests/test_worker_state_machine.py::test_executesuccess_dummy <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 3530s tests/test_worker_state_machine.py::test_executefailure_to_dict <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 3530s tests/test_worker_state_machine.py::test_executefailure_dummy <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 3530s tests/test_worker_state_machine.py::test_fetch_to_compute <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 3530s tests/test_worker_state_machine.py::test_fetch_via_amm_to_compute <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 3531s tests/test_worker_state_machine.py::test_lose_replica_during_fetch[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 3531s tests/test_worker_state_machine.py::test_lose_replica_during_fetch[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 3531s tests/test_worker_state_machine.py::test_fetch_to_missing_on_busy <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 3531s tests/test_worker_state_machine.py::test_new_replica_while_all_workers_in_flight <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 3532s tests/test_worker_state_machine.py::test_cancelled_while_in_flight <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 3532s tests/test_worker_state_machine.py::test_in_memory_while_in_flight <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 3532s tests/test_worker_state_machine.py::test_forget_data_needed <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 3533s tests/test_worker_state_machine.py::test_missing_handle_compute_dependency <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 3533s tests/test_worker_state_machine.py::test_missing_to_waiting <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 3534s tests/test_worker_state_machine.py::test_fetch_to_missing_on_refresh_who_has <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 3534s tests/test_worker_state_machine.py::test_fetch_to_missing_on_network_failure <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 3534s tests/test_worker_state_machine.py::test_deprecated_worker_attributes <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 3534s tests/test_worker_state_machine.py::test_aggregate_gather_deps[10000000-3-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 3534s tests/test_worker_state_machine.py::test_aggregate_gather_deps[10000000-3-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 3534s tests/test_worker_state_machine.py::test_aggregate_gather_deps[20000000-2-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 3534s tests/test_worker_state_machine.py::test_aggregate_gather_deps[20000000-2-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 3534s tests/test_worker_state_machine.py::test_aggregate_gather_deps[30000000-1-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 3534s tests/test_worker_state_machine.py::test_aggregate_gather_deps[30000000-1-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 3534s tests/test_worker_state_machine.py::test_aggregate_gather_deps[60000000-1-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 3534s tests/test_worker_state_machine.py::test_aggregate_gather_deps[60000000-1-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 3534s tests/test_worker_state_machine.py::test_gather_priority <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 3534s tests/test_worker_state_machine.py::test_task_acquires_resources[executing] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 3534s tests/test_worker_state_machine.py::test_task_acquires_resources[long-running] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 3534s tests/test_worker_state_machine.py::test_task_releases_resources[executing-ExecuteSuccessEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 3534s tests/test_worker_state_machine.py::test_task_releases_resources[executing-ExecuteFailureEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 3534s tests/test_worker_state_machine.py::test_task_releases_resources[executing-RescheduleEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 3534s tests/test_worker_state_machine.py::test_task_releases_resources[long-running-ExecuteSuccessEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 3534s tests/test_worker_state_machine.py::test_task_releases_resources[long-running-ExecuteFailureEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 3534s tests/test_worker_state_machine.py::test_task_releases_resources[long-running-RescheduleEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 3534s tests/test_worker_state_machine.py::test_task_with_dependencies_acquires_resources <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 3534s tests/test_worker_state_machine.py::test_resumed_task_releases_resources[executing-ExecuteSuccessEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 3534s tests/test_worker_state_machine.py::test_resumed_task_releases_resources[executing-ExecuteFailureEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 3534s tests/test_worker_state_machine.py::test_resumed_task_releases_resources[executing-RescheduleEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 3534s tests/test_worker_state_machine.py::test_resumed_task_releases_resources[long-running-ExecuteSuccessEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 3534s tests/test_worker_state_machine.py::test_resumed_task_releases_resources[long-running-ExecuteFailureEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 3534s tests/test_worker_state_machine.py::test_resumed_task_releases_resources[long-running-RescheduleEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 3534s tests/test_worker_state_machine.py::test_clean_log <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 3534s tests/test_worker_state_machine.py::test_running_task_in_all_running_tasks[executing] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 3534s tests/test_worker_state_machine.py::test_running_task_in_all_running_tasks[long-running] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 3534s tests/test_worker_state_machine.py::test_done_task_not_in_all_running_tasks[executing-ExecuteSuccessEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 3534s tests/test_worker_state_machine.py::test_done_task_not_in_all_running_tasks[executing-ExecuteFailureEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 3534s tests/test_worker_state_machine.py::test_done_task_not_in_all_running_tasks[executing-RescheduleEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 3534s tests/test_worker_state_machine.py::test_done_task_not_in_all_running_tasks[long-running-ExecuteSuccessEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 3534s tests/test_worker_state_machine.py::test_done_task_not_in_all_running_tasks[long-running-ExecuteFailureEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 3534s tests/test_worker_state_machine.py::test_done_task_not_in_all_running_tasks[long-running-RescheduleEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 3534s tests/test_worker_state_machine.py::test_done_resumed_task_not_in_all_running_tasks[executing-ExecuteSuccessEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 3534s tests/test_worker_state_machine.py::test_done_resumed_task_not_in_all_running_tasks[executing-ExecuteFailureEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 3534s tests/test_worker_state_machine.py::test_done_resumed_task_not_in_all_running_tasks[executing-RescheduleEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 3534s tests/test_worker_state_machine.py::test_done_resumed_task_not_in_all_running_tasks[long-running-ExecuteSuccessEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 3534s tests/test_worker_state_machine.py::test_done_resumed_task_not_in_all_running_tasks[long-running-ExecuteFailureEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 3534s tests/test_worker_state_machine.py::test_done_resumed_task_not_in_all_running_tasks[long-running-RescheduleEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 3534s tests/test_worker_state_machine.py::test_gather_dep_failure <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 3534s tests/test_worker_state_machine.py::test_recompute_erred_task <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 3534s tests/test_worker_state_machine.py::test_transfer_incoming_metrics <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 3534s tests/test_worker_state_machine.py::test_throttling_does_not_affect_first_transfer <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 3534s tests/test_worker_state_machine.py::test_message_target_does_not_affect_first_transfer_on_different_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 3534s tests/test_worker_state_machine.py::test_throttle_incoming_transfers_on_count_limit <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 3534s tests/test_worker_state_machine.py::test_throttling_incoming_transfer_on_transfer_bytes_same_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 3534s tests/test_worker_state_machine.py::test_throttling_incoming_transfer_on_transfer_bytes_different_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 3534s tests/test_worker_state_machine.py::test_do_not_throttle_connections_while_below_threshold <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 3534s tests/test_worker_state_machine.py::test_throttle_on_transfer_bytes_regardless_of_threshold <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 3534s tests/test_worker_state_machine.py::test_worker_nbytes[executing] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 3534s tests/test_worker_state_machine.py::test_worker_nbytes[long-running] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 3534s tests/test_worker_state_machine.py::test_fetch_count <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 3535s tests/test_worker_state_machine.py::test_task_counter <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 3535s tests/test_worker_state_machine.py::test_remove_worker_while_in_flight[fail] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 3535s tests/test_worker_state_machine.py::test_remove_worker_while_in_flight[success] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 3535s tests/test_worker_state_machine.py::test_remove_worker_while_in_flight[no-key] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 3535s tests/test_worker_state_machine.py::test_remove_worker_while_in_flight[busy] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 3535s tests/test_worker_state_machine.py::test_remove_worker_while_in_flight_unused_peer <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 3535s tests/test_worker_state_machine.py::test_remove_worker_while_in_fetch <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 3535s tests/test_worker_state_machine.py::test_remove_worker_unknown <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [100%] 3535s 3535s ==================================== ERRORS ==================================== 3535s ______________________ ERROR at setup of test_tls_cluster ______________________ 3535s 3535s loop = 3535s security = Security(require_encryption=True, tls_ca_file=Local (/usr/lib/python3/dist-packages/distributed/tests/tls-ca-cert.pem)...ted/tests/tls-key-cert.pem), tls_worker_cert=Local (/usr/lib/python3/dist-packages/distributed/tests/tls-key-cert.pem)) 3535s 3535s @pytest.fixture 3535s def tls_cluster(loop, security): 3535s > with tls_cluster_context(security=security) as (scheduler, workers): 3535s 3535s /usr/lib/python3/dist-packages/distributed/utils_test.py:573: 3535s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3535s /usr/lib/python3.13/contextlib.py:141: in __enter__ 3535s return next(self.gen) 3535s /usr/lib/python3/dist-packages/distributed/utils_test.py:565: in tls_cluster_context 3535s with cluster( 3535s /usr/lib/python3.13/contextlib.py:141: in __enter__ 3535s return next(self.gen) 3535s /usr/lib/python3/dist-packages/distributed/utils_test.py:672: in cluster 3535s pid, addr_or_exception = q.get() 3535s /usr/lib/python3.13/multiprocessing/queues.py:101: in get 3535s res = self._recv_bytes() 3535s /usr/lib/python3.13/multiprocessing/connection.py:216: in recv_bytes 3535s buf = self._recv_bytes(maxlength) 3535s /usr/lib/python3.13/multiprocessing/connection.py:430: in _recv_bytes 3535s buf = self._recv(4) 3535s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3535s 3535s self = , size = 4 3535s read = 3535s 3535s def _recv(self, size, read=_read): 3535s buf = io.BytesIO() 3535s handle = self._handle 3535s remaining = size 3535s while remaining > 0: 3535s > chunk = read(handle, remaining) 3535s E Failed: Timeout >300.0s 3535s 3535s /usr/lib/python3.13/multiprocessing/connection.py:395: Failed 3535s ---------------------------- Captured stderr setup ----------------------------- 3535s 2024-11-23 21:27:32,564 - distributed.http.proxy - INFO - To route to workers diagnostics web server please install jupyter-server-proxy: python -m pip install jupyter-server-proxy 3535s 2024-11-23 21:27:32,567 - distributed.scheduler - INFO - State start 3535s 2024-11-23 21:27:32,569 - distributed.diskutils - INFO - Found stale lock file and directory '/tmp/dask-scratch-space/scheduler-4_39divu', purging 3535s 2024-11-23 21:27:32,570 - distributed.diskutils - INFO - Found stale lock file and directory '/tmp/dask-scratch-space/worker-09ncce7p', purging 3535s 2024-11-23 21:27:32,570 - distributed.diskutils - INFO - Found stale lock file and directory '/tmp/dask-scratch-space/worker-g3t98mub', purging 3535s 2024-11-23 21:27:32,579 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:32,580 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:8787/status 3535s 2024-11-23 21:27:32,580 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3535s 2024-11-23 21:27:32,594 - distributed.worker.memory - WARNING - Ignoring provided memory limit 16729014272 due to system memory limit of 15.58 GiB 3535s 2024-11-23 21:27:32,622 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46231 3535s 2024-11-23 21:27:32,622 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46231 3535s 2024-11-23 21:27:32,622 - distributed.worker - INFO - dashboard at: 127.0.0.1:46347 3535s 2024-11-23 21:27:32,622 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:32,622 - distributed.worker - INFO - ------------------------------------------------- 3535s 2024-11-23 21:27:32,622 - distributed.worker - INFO - Threads: 1 3535s 2024-11-23 21:27:32,623 - distributed.worker - INFO - Memory: 15.58 GiB 3535s 2024-11-23 21:27:32,623 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-1trr9kjm 3535s 2024-11-23 21:27:32,623 - distributed.worker - INFO - ------------------------------------------------- 3535s 2024-11-23 21:27:32,632 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56174': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:32,632 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:32,739 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56176': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:32,739 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:32,847 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56182': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:32,847 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:32,955 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56186': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:32,955 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:32,993 - distributed.worker.memory - WARNING - Ignoring provided memory limit 16729014272 due to system memory limit of 15.58 GiB 3535s 2024-11-23 21:27:33,030 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34261 3535s 2024-11-23 21:27:33,031 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34261 3535s 2024-11-23 21:27:33,031 - distributed.worker - INFO - dashboard at: 127.0.0.1:37223 3535s 2024-11-23 21:27:33,031 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:33,031 - distributed.worker - INFO - ------------------------------------------------- 3535s 2024-11-23 21:27:33,031 - distributed.worker - INFO - Threads: 1 3535s 2024-11-23 21:27:33,032 - distributed.worker - INFO - Memory: 15.58 GiB 3535s 2024-11-23 21:27:33,032 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ciwzh_3p 3535s 2024-11-23 21:27:33,032 - distributed.worker - INFO - ------------------------------------------------- 3535s 2024-11-23 21:27:33,040 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56194': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:33,040 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:33,062 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56210': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:33,063 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:33,149 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56212': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:33,149 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:33,169 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56224': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:33,169 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:33,259 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56234': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:33,259 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:33,276 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56242': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:33,276 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:33,368 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56250': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:33,368 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:33,383 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56260': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:33,383 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:33,476 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56270': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:33,477 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:33,490 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56280': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:33,490 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:33,585 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:33,588 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56294': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:33,597 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56304': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:33,597 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:33,694 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56306': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:33,694 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:33,704 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56310': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:33,704 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:33,802 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56326': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:33,803 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:33,810 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56336': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:33,810 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:33,911 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56346': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:33,911 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:33,917 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56348': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:33,917 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:34,020 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:34,023 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56352': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:34,023 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56356': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:34,024 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:34,128 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:34,132 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56362': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:34,132 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56366': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:34,132 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:34,237 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:34,240 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56380': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:34,241 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56382': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:34,241 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:34,346 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:34,349 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56386': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:34,350 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56400': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:34,350 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:34,455 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:34,458 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56404': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:34,459 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56406': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:34,459 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:34,564 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:34,568 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56414': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:34,568 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56420': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:34,568 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:34,673 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:34,676 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56434': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:34,677 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56440': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:34,677 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:34,781 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:34,785 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56444': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:34,786 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56448': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:34,786 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:34,890 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:34,894 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56456': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:34,894 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56462': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:34,894 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:34,999 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:35,003 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56468': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:35,003 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56482': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:35,003 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:35,108 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:35,111 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56498': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:35,112 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56506': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:35,112 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:35,217 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:35,220 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56510': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:35,221 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56524': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:35,221 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:35,325 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:35,329 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56528': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:35,329 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56536': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:35,329 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:35,434 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:35,437 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56550': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:35,438 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56566': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:35,438 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:35,543 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:35,546 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56570': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:35,547 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56582': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:35,547 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:35,651 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:35,655 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56592': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:35,656 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56608': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:35,656 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:35,760 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:35,763 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56612': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:35,764 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56626': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:35,764 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:35,869 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:35,872 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56638': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:35,873 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56640': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:35,873 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:35,977 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:35,982 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:35,982 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56650': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:35,982 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56662': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:36,086 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:36,093 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56676': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:36,094 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56690': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:36,094 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:36,194 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56704': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:36,195 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:36,202 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56712': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:36,202 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:36,304 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:36,308 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56716': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:36,308 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56722': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:36,309 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:36,412 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:36,416 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56736': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:36,416 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56750': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:36,417 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:36,521 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:36,524 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56756': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:36,525 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56772': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:36,525 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:36,629 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:36,632 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56776': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:36,633 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56786': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:36,633 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:36,738 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:36,741 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56792': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:36,742 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:36,742 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:36,848 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:36,850 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56812': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:36,850 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56828': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:36,850 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:36,956 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:36,959 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56840': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:36,960 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56856': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:36,960 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:37,064 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:37,068 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56868': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:37,068 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56870': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:37,068 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:37,173 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:37,176 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56874': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:37,177 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56884': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:37,177 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:37,281 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:37,284 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56900': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:37,285 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56912': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:37,285 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:37,389 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:37,393 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56926': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:37,393 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56928': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:37,393 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:37,498 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:37,501 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56940': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:37,502 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:37,502 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56952': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:37,606 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:37,610 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56954': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:37,611 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56956': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:37,611 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:37,715 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:37,718 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56958': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:37,719 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56974': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:37,719 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:37,823 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:37,827 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56982': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:37,828 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56986': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:37,828 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:37,932 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:37,935 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56996': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:37,936 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57006': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:37,936 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:38,050 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:38,052 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57018': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:38,053 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57024': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:38,053 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:38,159 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:38,163 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57038': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:38,164 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57042': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:38,164 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:38,268 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:38,271 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57052': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:38,272 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57064': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:38,272 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:38,376 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:38,380 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57078': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:38,381 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57088': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:38,381 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:38,484 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:38,488 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57102': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:38,488 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57104': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:38,488 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:38,592 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:38,595 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57118': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:38,596 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57128': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:38,596 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:38,700 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:38,704 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57144': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:38,704 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57148': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:38,704 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:38,808 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:38,812 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57154': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:38,813 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57166': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:38,813 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:38,916 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:38,920 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57176': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:38,920 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57178': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:38,921 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:39,025 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:39,028 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57194': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:39,029 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57196': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:39,029 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:39,133 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:39,136 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57204': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:39,137 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57216': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:39,137 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:39,241 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:39,245 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57228': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:39,245 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57240': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:39,245 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:39,349 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:39,353 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57242': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:39,354 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57256': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:39,354 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:39,457 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:39,461 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57268': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:39,462 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57278': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:39,462 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:39,566 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:39,569 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57292': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:39,570 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57298': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:39,570 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:39,674 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:39,678 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57300': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:39,679 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57310': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:39,679 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:39,784 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:39,787 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57326': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:39,788 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57342': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:39,788 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:39,892 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:39,895 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57358': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:39,896 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57368': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:39,896 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:40,000 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:40,004 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57370': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:40,005 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57378': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:40,005 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:40,109 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:40,112 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57394': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:40,113 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57404': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:40,113 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:40,218 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:40,221 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57408': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:40,222 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57420': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:40,222 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:40,326 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:40,330 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57428': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:40,330 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57430': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:40,330 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:40,435 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:40,438 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57440': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:40,439 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57446': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:40,439 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:40,543 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:40,547 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57454': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:40,547 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:40,559 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57466': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:40,652 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:40,655 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57476': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:40,656 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57488': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:40,656 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:40,760 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:40,764 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57496': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:40,764 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57502': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:40,764 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:40,869 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57510': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:40,869 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:40,882 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57522': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:40,882 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:40,977 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57524': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:40,977 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:40,989 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57538': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:40,989 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:41,086 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:41,088 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57544': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:41,096 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57548': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:41,096 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:41,194 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57564': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:41,203 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57572': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:41,203 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:41,194 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:41,311 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:41,311 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57574': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:41,317 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57576': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:41,317 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:41,418 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57578': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:41,418 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:41,425 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57582': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:41,425 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:41,526 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57592': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:41,526 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:41,533 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46980': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:41,533 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:41,633 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46988': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:41,633 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:41,641 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47004': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:41,641 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:41,741 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47008': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:41,741 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:41,749 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47012': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:41,750 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:41,848 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47016': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:41,848 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:41,858 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47020': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:41,858 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:41,955 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47034': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:41,955 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:41,966 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47038': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:41,966 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:42,063 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47048': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:42,063 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:42,074 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47062': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:42,074 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:42,170 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47074': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:42,170 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:42,182 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47090': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:42,182 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:42,277 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47092': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:42,277 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:42,290 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47094': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:42,290 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:42,385 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47108': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:42,385 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:42,398 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47112': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:42,398 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:42,492 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:42,492 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:42,506 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47126': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:42,506 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:42,599 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47142': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:42,599 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:42,614 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47154': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:42,615 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:42,707 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47162': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:42,707 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:42,723 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47178': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:42,723 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:42,815 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47186': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:42,815 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:42,831 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47188': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:42,831 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:42,922 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47196': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:42,922 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:42,940 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47208': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:42,940 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:43,030 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47224': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:43,030 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:43,047 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47226': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:43,047 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:43,137 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:43,137 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47242': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:43,155 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47250': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:43,155 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:43,246 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:43,246 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47264': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:43,262 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47272': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:43,262 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:43,353 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:43,354 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47284': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:43,370 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47298': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:43,370 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:43,461 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47312': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:43,461 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:43,478 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47318': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:43,478 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:43,569 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:43,569 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47330': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:43,585 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:43,589 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47340': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:43,677 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:43,677 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47346': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:43,693 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47354': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:43,693 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:43,784 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:43,784 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47364': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:43,801 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47380': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:43,801 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:43,892 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:43,892 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47392': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:43,908 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47406': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:43,908 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:43,999 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:44,000 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47410': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:44,016 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47426': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:44,016 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:44,107 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:44,107 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47438': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:44,124 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47444': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:44,124 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:44,215 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:44,215 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47460': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:44,231 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47466': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:44,231 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:44,322 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47482': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:44,322 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:44,339 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47484': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:44,339 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:44,430 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47490': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:44,430 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:44,446 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47498': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:44,446 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:44,538 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47510': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:44,538 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:44,554 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47522': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:44,554 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:44,646 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47526': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:44,646 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:44,661 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47538': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:44,661 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:44,754 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47542': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:44,754 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:44,769 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47546': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:44,769 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:44,861 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:44,862 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47560': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:44,877 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47568': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:44,877 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:44,970 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47578': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:44,970 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:44,986 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47592': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:44,986 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:45,079 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47604': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:45,079 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:45,094 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47606': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:45,094 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:45,198 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:45,199 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47620': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:45,211 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47634': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:45,211 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:45,307 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47646': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:45,307 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:45,320 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47662': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:45,320 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:45,415 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47676': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:45,415 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:45,428 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47686': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:45,428 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:45,522 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47698': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:45,522 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:45,536 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47714': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:45,537 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:45,630 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:45,630 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:45,644 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47728': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:45,645 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:45,737 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47742': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:45,737 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:45,755 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47752': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:45,756 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:45,844 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47754': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:45,844 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:45,863 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47758': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:45,864 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:45,951 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47768': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:45,951 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:45,972 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47770': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:45,972 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:46,058 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47782': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:46,058 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:46,080 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47786': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:46,080 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:46,165 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47802': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:46,165 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:46,188 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47816': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:46,188 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:46,272 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47820': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:46,272 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:46,296 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47826': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:46,296 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:46,379 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47838': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:46,379 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:46,404 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47852': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:46,404 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:46,486 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47866': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:46,486 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:46,512 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47872': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:46,512 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:46,594 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:46,594 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47876': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:46,620 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47886': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:46,621 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:46,702 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47902': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:46,702 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:46,728 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47918': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:46,728 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:46,810 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47926': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:46,810 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:46,836 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47938': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:46,837 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:46,917 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47946': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:46,917 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:46,944 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47952': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:46,945 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:47,025 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47960': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:47,025 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:47,053 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47972': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:47,053 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:47,133 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47988': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:47,133 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:47,161 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48000': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:47,162 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:47,240 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48016': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:47,240 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:47,270 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48032': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:47,270 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:47,347 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48040': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:47,347 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:47,378 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48048': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:47,378 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:47,454 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48064': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:47,454 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:47,486 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48070': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:47,486 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:47,562 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48082': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:47,562 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:47,595 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48086': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:47,595 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:47,669 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48100': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:47,669 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:47,702 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:47,702 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48116': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:47,776 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:47,776 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:47,809 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48128': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:47,809 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:47,883 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48136': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:47,883 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:47,916 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48152': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:47,916 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:47,990 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48166': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:47,990 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:48,023 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48172': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:48,023 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:48,098 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48174': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:48,098 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:48,130 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48178': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:48,130 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:48,204 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48184': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:48,204 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:48,238 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48198': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:48,238 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:48,312 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48212': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:48,312 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:48,346 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48222': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:48,347 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:48,420 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48236': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:48,420 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:48,455 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48238': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:48,455 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:48,527 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48242': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:48,527 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:48,564 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48244': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:48,564 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:48,634 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48252': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:48,635 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:48,672 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48264': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:48,672 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:48,742 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48278': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:48,742 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:48,780 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48292': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:48,781 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:48,849 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48294': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:48,849 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:48,889 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48308': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:48,889 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:48,957 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48320': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:48,957 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:48,997 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48324': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:48,997 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:49,064 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48338': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:49,064 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:49,106 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48344': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:49,106 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:49,171 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48358': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:49,171 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:49,214 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48372': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:49,214 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:49,279 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48386': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:49,279 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:49,322 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48394': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:49,323 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:49,387 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48398': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:49,387 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:49,431 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48402': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:49,431 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:49,494 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48418': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:49,494 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:49,539 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48430': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:49,539 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:49,602 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48446': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:49,602 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:49,647 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48450': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:49,647 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:49,710 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48452': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:49,710 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:49,756 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48456': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:49,756 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:49,817 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48468': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:49,817 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:49,864 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48476': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:49,864 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:49,925 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48480': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:49,925 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:49,973 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48486': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:49,973 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:50,032 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48502': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:50,032 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:50,081 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48504': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:50,081 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:50,141 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48508': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:50,141 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:50,192 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48512': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:50,192 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:50,248 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48526': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:50,248 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:50,300 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48534': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:50,301 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:50,356 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48546': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:50,356 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:50,409 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48560': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:50,409 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:50,463 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48562': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:50,464 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:50,517 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48566': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:50,517 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:50,571 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48580': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:50,571 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:50,625 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48586': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:50,626 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:50,679 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48594': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:50,679 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:50,734 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48604': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:50,734 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:50,786 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48608': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:50,786 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:50,842 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48610': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:50,843 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:50,894 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48616': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:50,894 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:50,951 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48632': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:50,951 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:51,001 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48642': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:51,001 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:51,059 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48648': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:51,059 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:51,108 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48660': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:51,109 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:51,168 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48674': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:51,168 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:51,216 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48676': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:51,216 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:51,276 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48682': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:51,276 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:51,324 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48684': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:51,324 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:51,384 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48688': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:51,385 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:51,431 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48694': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:51,431 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:51,493 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48706': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:51,493 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:51,539 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56104': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:51,539 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:51,601 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56110': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:51,601 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:51,646 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56114': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:51,646 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:51,709 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56118': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:51,709 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:51,754 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56132': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:51,754 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:51,818 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56134': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:51,818 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:51,862 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56142': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:51,862 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:51,926 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56150': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:51,926 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:51,970 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56154': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:51,970 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:52,034 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56166': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:52,034 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:52,078 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56172': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:52,078 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:52,143 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56184': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:52,143 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:52,185 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56194': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:52,185 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:52,251 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56210': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:52,251 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:52,293 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56224': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:52,293 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:52,359 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56234': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:52,359 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:52,400 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56248': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:52,401 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:52,468 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56258': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:52,468 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:52,508 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56260': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:52,508 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:52,576 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56268': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:52,576 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:52,616 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56284': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:52,616 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:52,685 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56288': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:52,685 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:52,723 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56300': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:52,723 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:52,793 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56306': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:52,793 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:52,831 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56318': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:52,831 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:52,901 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56330': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:52,901 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:52,939 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56334': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:52,939 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:53,009 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56350': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:53,010 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:53,047 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56360': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:53,047 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:53,118 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56372': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:53,118 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:53,154 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56380': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:53,154 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:53,226 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56382': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:53,226 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:53,261 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56396': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:53,261 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:53,334 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56402': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:53,334 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:53,369 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56404': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:53,369 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:53,442 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56410': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:53,442 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:53,476 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56414': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:53,477 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:53,549 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56416': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:53,550 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:53,585 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:53,587 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56432': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:53,657 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56446': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:53,657 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:53,692 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56462': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:53,692 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:53,764 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56476': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:53,764 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:53,799 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56478': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:53,799 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:53,872 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56480': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:53,872 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:53,907 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56484': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:53,907 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:53,979 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56488': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:53,979 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:54,014 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56494': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:54,014 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:54,086 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:54,091 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56506': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:54,122 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56522': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:54,122 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:54,194 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56536': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:54,194 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:54,230 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56538': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:54,230 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:54,301 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56546': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:54,301 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:54,338 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56556': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:54,338 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:54,408 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56562': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:54,408 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:54,445 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56578': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:54,445 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:54,516 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56594': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:54,516 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:54,553 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56610': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:54,553 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:54,624 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56626': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:54,624 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:54,660 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56640': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:54,660 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:54,731 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56644': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:54,731 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:54,767 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56658': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:54,767 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:54,838 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56674': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:54,838 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:54,875 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56684': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:54,875 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:54,945 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56698': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:54,945 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:54,982 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56706': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:54,982 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:55,053 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56714': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:55,053 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:55,105 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:55,105 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:55,160 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56730': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:55,160 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:55,213 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56740': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:55,213 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:55,267 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56748': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:55,267 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:55,321 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56760': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:55,321 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:55,374 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56776': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:55,374 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:55,429 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56784': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:55,429 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:55,482 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:55,482 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:55,536 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56808': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:55,536 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:55,594 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56814': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:55,594 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:55,644 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56828': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:55,644 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:55,701 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56844': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:55,701 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:55,751 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56858': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:55,751 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:55,809 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56866': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:55,809 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:55,859 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56878': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:55,859 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:55,916 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56886': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:55,916 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:55,966 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56900': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:55,966 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:56,023 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56904': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:56,023 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:56,074 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56910': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:56,074 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:56,131 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56914': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:56,131 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:56,181 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56926': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:56,181 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:56,238 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56938': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:56,238 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:56,289 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56950': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:56,289 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:56,345 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56952': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:56,346 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:56,396 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56956': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:56,396 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:56,453 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56964': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:56,453 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:56,504 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56974': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:56,504 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:56,560 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56982': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:56,560 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:56,611 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56990': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:56,611 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:56,667 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56992': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:56,667 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:56,718 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56998': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:56,718 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:56,775 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57014': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:56,775 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:56,826 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57030': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:56,826 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:56,882 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57046': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:56,882 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:56,933 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57052': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:56,933 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:56,989 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57062': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:56,989 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:57,041 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57068': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:57,041 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:57,097 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57076': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:57,097 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:57,149 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57088': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:57,149 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:57,204 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57090': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:57,204 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:57,256 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57106': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:57,256 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:57,311 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57116': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:57,312 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:57,364 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57124': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:57,364 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:57,419 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57138': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:57,419 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:57,471 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57148': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:57,471 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:57,526 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57154': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:57,526 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:57,578 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57166': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:57,578 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:57,633 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57182': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:57,633 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:57,686 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57194': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:57,686 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:57,741 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57204': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:57,741 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:57,794 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57208': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:57,794 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:57,848 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57216': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:57,848 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:57,901 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57224': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:57,901 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:57,955 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57236': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:57,955 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:58,008 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57252': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:58,008 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:58,063 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57254': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:58,063 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:58,117 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:58,117 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57270': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:58,170 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57274': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:58,170 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:58,224 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57276': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:58,224 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:58,277 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57280': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:58,277 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:58,331 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57296': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:58,331 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:58,384 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57302': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:58,384 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:58,438 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57304': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:58,439 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:58,495 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:58,495 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57320': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:58,547 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57330': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:58,547 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:58,602 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57338': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:58,602 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:58,654 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57340': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:58,654 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:58,710 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57346': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:58,710 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:58,762 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57356': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:58,762 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:58,817 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57372': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:58,817 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:58,869 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57386': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:58,869 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:58,925 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57390': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:58,925 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:58,977 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57394': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:58,977 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:59,032 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57400': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:59,032 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:59,084 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:59,088 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57410': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:59,139 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57418': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:59,139 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:59,192 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57420': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:59,192 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:59,247 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57434': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:59,247 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:59,299 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57444': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:59,299 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:59,354 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:59,354 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57460': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:59,407 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57472': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:59,407 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:59,462 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57478': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:59,462 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:59,514 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57480': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:59,514 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:59,569 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57488': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:59,569 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:59,621 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57494': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:59,621 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:59,676 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57508': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:59,676 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:59,729 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57512': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:59,729 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:59,783 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57520': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:59,783 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:59,836 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57532': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:59,836 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:59,891 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57534': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:59,891 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:59,944 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57548': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:59,944 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:27:59,998 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57550': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:27:59,998 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:00,051 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57552': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:00,051 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:00,106 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57556': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:00,106 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:00,159 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57568': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:00,159 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:00,213 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57582': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:00,213 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:00,266 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57584': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:00,266 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:00,321 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57592': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:00,321 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:00,373 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57608': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:00,373 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:00,428 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57620': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:00,428 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:00,482 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57630': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:00,482 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:00,536 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:00,536 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57640': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:00,591 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57642': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:00,591 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:00,643 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57644': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:00,643 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:00,698 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57658': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:00,698 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:00,751 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:00,751 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57672': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:00,805 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57684': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:00,805 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:00,858 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57694': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:00,858 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:00,913 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57700': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:00,913 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:00,965 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57716': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:00,965 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:01,020 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57730': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:01,020 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:01,073 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57742': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:01,073 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:01,128 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57744': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:01,128 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:01,180 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57758': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:01,180 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:01,236 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57768': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:01,236 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:01,288 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57772': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:01,288 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:01,343 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57782': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:01,344 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:01,395 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57794': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:01,396 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:01,451 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57802': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:01,451 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:01,503 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:01,503 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57818': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:01,559 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38528': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:01,559 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:01,610 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38544': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:01,610 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:01,666 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38560': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:01,666 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:01,717 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38564': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:01,717 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:01,773 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38570': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:01,773 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:01,824 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38574': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:01,824 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:01,880 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38576': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:01,880 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:01,931 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38590': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:01,931 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:01,987 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38592': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:01,987 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:02,038 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38598': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:02,038 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:02,094 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38608': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:02,094 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:02,145 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38610': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:02,145 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:02,202 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38620': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:02,202 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:02,253 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38622': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:02,253 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:02,310 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38636': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:02,310 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:02,360 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38646': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:02,360 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:02,417 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38650': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:02,417 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:02,468 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38652': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:02,468 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:02,525 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38668': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:02,525 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:02,575 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38676': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:02,575 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:02,632 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38680': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:02,632 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:02,682 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38684': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:02,682 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:02,740 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38688': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:02,740 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:02,790 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38702': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:02,790 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:02,847 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38710': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:02,847 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:02,897 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38716': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:02,897 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:02,954 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38726': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:02,955 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:03,005 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38730': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:03,005 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:03,063 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38746': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:03,063 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:03,113 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38756': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:03,113 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:03,170 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38764': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:03,170 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:03,220 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38774': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:03,220 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:03,277 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38782': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:03,278 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:03,327 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38798': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:03,327 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:03,385 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38808': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:03,385 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:03,434 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38810': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:03,434 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:03,492 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38816': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:03,492 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:03,543 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38826': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:03,543 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:03,600 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38828': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:03,600 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:03,650 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38840': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:03,650 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:03,707 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38856': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:03,707 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:03,758 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38858': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:03,758 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:03,815 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38860': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:03,815 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:03,866 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38872': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:03,866 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:03,924 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38876': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:03,924 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:03,974 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38884': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:03,974 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:04,031 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38900': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:04,032 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:04,081 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:04,085 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38906': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:04,139 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:04,139 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38920': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:04,189 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38936': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:04,189 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:04,247 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38942': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:04,247 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:04,297 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38944': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:04,297 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:04,355 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38948': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:04,355 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:04,404 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38954': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:04,404 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:04,469 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:04,469 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38956': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:04,513 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:04,513 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38964': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:04,579 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:04,579 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38974': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:04,621 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38988': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:04,621 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:04,686 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39002': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:04,687 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:04,729 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39010': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:04,729 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:04,794 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39022': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:04,794 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:04,836 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39024': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:04,836 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:04,902 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39026': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:04,902 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:04,944 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39036': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:04,944 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:05,010 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39040': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:05,010 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:05,051 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39050': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:05,051 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:05,117 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39060': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:05,117 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:05,159 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39070': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:05,159 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:05,225 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39072': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:05,225 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:05,267 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39076': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:05,267 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:05,332 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39078': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:05,332 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:05,374 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39084': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:05,374 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:05,440 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39088': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:05,440 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:05,482 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39100': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:05,482 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:05,548 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39102': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:05,548 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:05,591 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39112': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:05,591 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:05,656 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39116': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:05,656 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:05,699 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39124': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:05,699 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:05,764 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39130': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:05,764 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:05,806 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39144': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:05,806 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:05,872 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39158': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:05,872 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:05,914 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39162': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:05,914 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:05,979 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39170': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:05,979 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:06,021 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39178': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:06,021 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:06,091 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39190': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:06,091 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:06,129 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39204': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:06,129 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:06,199 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39216': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:06,199 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:06,236 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39222': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:06,236 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:06,306 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39238': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:06,307 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:06,344 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39240': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:06,344 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:06,414 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39246': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:06,414 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:06,451 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39252': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:06,451 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:06,522 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39264': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:06,522 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:06,559 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39278': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:06,559 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:06,629 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39290': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:06,629 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:06,666 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39302': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:06,666 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:06,737 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39308': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:06,737 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:06,774 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39318': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:06,774 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:06,845 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39332': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:06,845 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:06,881 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:06,881 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39348': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:06,952 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39358': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:06,952 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:06,989 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39374': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:06,989 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:07,060 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39380': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:07,060 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:07,096 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39392': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:07,096 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:07,168 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39402': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:07,168 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:07,204 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39404': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:07,204 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:07,276 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39414': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:07,276 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:07,311 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39430': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:07,311 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:07,384 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39442': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:07,384 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:07,419 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39448': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:07,419 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:07,493 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39464': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:07,493 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:07,527 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39478': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:07,527 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:07,600 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39488': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:07,600 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:07,634 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39496': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:07,634 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:07,708 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39502': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:07,708 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:07,742 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39506': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:07,742 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:07,816 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39518': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:07,816 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:07,850 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39530': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:07,850 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:07,924 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39540': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:07,924 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:07,958 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:07,958 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39550': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:08,031 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39552': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:08,031 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:08,065 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39554': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:08,065 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:08,139 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39562': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:08,139 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:08,173 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39574': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:08,173 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:08,246 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39580': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:08,246 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:08,280 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39596': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:08,280 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:08,354 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39608': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:08,354 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:08,387 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39612': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:08,387 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:08,461 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39618': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:08,461 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:08,495 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39630': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:08,495 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:08,569 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39632': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:08,569 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:08,602 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39644': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:08,602 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:08,676 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39654': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:08,676 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:08,710 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39662': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:08,710 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:08,784 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39678': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:08,784 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:08,817 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39690': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:08,817 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:08,891 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39694': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:08,891 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:08,925 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39710': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:08,925 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:08,999 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39714': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:08,999 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:09,032 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39726': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:09,032 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:09,107 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39728': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:09,107 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:09,140 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39744': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:09,140 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:09,215 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39760': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:09,215 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:09,247 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39772': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:09,247 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:09,322 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39786': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:09,322 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:09,355 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:09,355 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39794': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:09,430 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39802': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:09,430 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:09,462 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39818': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:09,462 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:09,538 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:09,538 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39830': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:09,569 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39834': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:09,569 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:09,645 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39836': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:09,646 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:09,677 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39846': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:09,677 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:09,753 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39862': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:09,753 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:09,784 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39878': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:09,784 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:09,861 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39882': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:09,861 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:09,891 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39894': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:09,891 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:09,968 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39908': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:09,968 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:09,999 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39912': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:09,999 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:10,076 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39920': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:10,076 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:10,106 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39930': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:10,106 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:10,184 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39944': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:10,184 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:10,214 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39958': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:10,214 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:10,291 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39964': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:10,291 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:10,321 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39972': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:10,321 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:10,399 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39986': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:10,399 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:10,428 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39998': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:10,428 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:10,507 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:40014': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:10,507 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:10,536 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:40016': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:10,536 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:10,615 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:10,615 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:40022': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:10,644 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:40034': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:10,644 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:10,722 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:40042': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:10,722 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:10,751 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:40056': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:10,751 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:10,830 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:10,831 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:40070': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:10,858 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:40076': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:10,858 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:10,938 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:40084': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:10,938 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:10,966 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:40096': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:10,966 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:11,045 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:40106': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:11,045 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:11,073 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:40114': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:11,073 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:11,153 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:40130': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:11,153 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:11,180 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:40134': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:11,180 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:11,260 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:40140': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:11,260 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:11,287 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:40146': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:11,287 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:11,368 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:40154': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:11,368 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:11,394 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:40162': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:11,395 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:11,476 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:40176': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:11,476 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:11,502 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:40192': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:11,502 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:11,583 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:11,586 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35092': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:11,609 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35096': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:11,609 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:11,691 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35108': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:11,691 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:11,717 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35112': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:11,717 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:11,798 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35126': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:11,798 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:11,824 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35140': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:11,824 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:11,907 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35142': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:11,907 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:11,931 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35146': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:11,932 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:12,014 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35152': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:12,015 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:12,039 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35160': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:12,039 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:12,122 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35170': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:12,123 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:12,147 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35176': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:12,147 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:12,230 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35180': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:12,230 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:12,254 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35186': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:12,254 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:12,338 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35192': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:12,338 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:12,362 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35208': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:12,362 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:12,445 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:12,445 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35214': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:12,470 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:12,470 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35222': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:12,554 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35226': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:12,554 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:12,577 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:12,577 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35236': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:12,661 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35250': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:12,661 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:12,685 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35264': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:12,685 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:12,768 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35276': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:12,769 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:12,792 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35288': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:12,792 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:12,876 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35304': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:12,876 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:12,900 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35320': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:12,900 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:12,984 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35328': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:12,984 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:13,007 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35338': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:13,007 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:13,091 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35340': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:13,091 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:13,114 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35354': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:13,114 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:13,199 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35370': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:13,199 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:13,222 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35386': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:13,222 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:13,306 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35390': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:13,306 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:13,329 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35394': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:13,329 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:13,414 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35398': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:13,414 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:13,436 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35400': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:13,436 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:13,522 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35404': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:13,522 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:13,543 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35414': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:13,543 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:13,629 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35428': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:13,629 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:13,651 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35438': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:13,651 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:13,737 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35454': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:13,737 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:13,758 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35470': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:13,758 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:13,844 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35480': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:13,845 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:13,866 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35490': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:13,866 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:13,952 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35494': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:13,952 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:13,973 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35508': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:13,973 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:14,060 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35522': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:14,060 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:14,080 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35538': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:14,080 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:14,167 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35552': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:14,167 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:14,188 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35562': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:14,188 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:14,276 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35570': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:14,276 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:14,295 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35572': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:14,295 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:14,383 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35584': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:14,383 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:14,403 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35594': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:14,403 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:14,491 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35610': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:14,491 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:14,510 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:14,510 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35618': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:14,598 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35622': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:14,598 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:14,618 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:14,618 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35626': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:14,706 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35632': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:14,706 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:14,725 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35636': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:14,725 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:14,814 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35640': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:14,814 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:14,833 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35642': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:14,833 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:14,921 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35648': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:14,921 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:14,940 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35658': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:14,940 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:15,029 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35672': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:15,029 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:15,047 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35674': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:15,047 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:15,136 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35678': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:15,136 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:15,155 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35694': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:15,155 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:15,244 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35708': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:15,244 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:15,262 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35722': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:15,262 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:15,351 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35738': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:15,351 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:15,369 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35750': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:15,369 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:15,459 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35762': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:15,459 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:15,477 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35764': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:15,477 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:15,567 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35770': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:15,567 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:15,584 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:15,587 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35776': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:15,674 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35778': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:15,674 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:15,691 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35780': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:15,691 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:15,781 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35788': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:15,782 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:15,799 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35794': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:15,799 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:15,889 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35810': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:15,889 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:15,906 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35818': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:15,906 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:15,998 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35822': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:15,998 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:16,013 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35830': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:16,013 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:16,106 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35836': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:16,106 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:16,121 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35852': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:16,121 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:16,213 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35866': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:16,213 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:16,229 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35868': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:16,229 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:16,321 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35876': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:16,321 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:16,336 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35886': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:16,336 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:16,429 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35896': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:16,429 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:16,444 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35906': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:16,444 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:16,537 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35908': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:16,537 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:16,551 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35910': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:16,551 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:16,644 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35916': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:16,644 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:16,658 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35928': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:16,658 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:16,752 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35938': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:16,752 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:16,766 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35954': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:16,766 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:16,859 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35964': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:16,859 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:16,873 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35970': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:16,873 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:16,967 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35986': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:16,967 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:16,981 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35998': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:16,981 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:17,075 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36000': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:17,075 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:17,090 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36002': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:17,090 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:17,183 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36014': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:17,183 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:17,198 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36018': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:17,198 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:17,291 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36026': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:17,291 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:17,306 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36042': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:17,306 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:17,399 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36056': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:17,399 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:17,413 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36068': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:17,413 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:17,506 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36074': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:17,507 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:17,521 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36090': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:17,521 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:17,614 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36096': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:17,614 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:17,628 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36106': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:17,628 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:17,722 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36120': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:17,722 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:17,735 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36134': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:17,735 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:17,830 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36142': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:17,830 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:17,843 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36144': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:17,843 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:17,938 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36152': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:17,938 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:17,950 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36164': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:17,950 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:18,046 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36170': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:18,046 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:18,057 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36176': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:18,057 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:18,153 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36184': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:18,153 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:18,165 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36196': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:18,165 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:18,261 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36210': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:18,261 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:18,272 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36222': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:18,272 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:18,368 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36234': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:18,368 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:18,379 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36238': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:18,379 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:18,476 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36242': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:18,476 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:18,487 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36246': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:18,487 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:18,583 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:18,586 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36260': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:18,594 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36274': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:18,594 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:18,691 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36282': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:18,691 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:18,701 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36286': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:18,701 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:18,798 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36294': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:18,798 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:18,808 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36300': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:18,808 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:18,906 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36312': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:18,906 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:18,915 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36314': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:18,915 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:19,014 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36328': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:19,014 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:19,023 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36336': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:19,023 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:19,122 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36352': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:19,122 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:19,130 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36358': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:19,130 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:19,229 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36374': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:19,229 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:19,237 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36388': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:19,237 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:19,336 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36392': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:19,337 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:19,344 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36404': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:19,344 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:19,446 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:19,447 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36418': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:19,452 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36428': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:19,452 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:19,554 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:19,554 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36434': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:19,560 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:19,560 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36444': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:19,661 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:19,661 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36458': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:19,667 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:19,667 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36474': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:19,769 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:19,773 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36488': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:19,774 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:19,774 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36492': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:19,876 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36506': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:19,876 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:19,882 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:19,882 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36516': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:19,985 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:19,989 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36530': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:19,990 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36532': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:19,989 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:20,093 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:20,097 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36538': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:20,097 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36540': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:20,097 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:20,200 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:20,205 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36544': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:20,205 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36546': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:20,205 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:20,308 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:20,312 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36558': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:20,313 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36560': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:20,313 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:20,416 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:20,420 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36566': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:20,420 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36568': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:20,420 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:20,523 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:20,527 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36570': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:20,528 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36576': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:20,528 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:20,631 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:20,635 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36580': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:20,636 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36590': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:20,636 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:20,738 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:20,743 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36596': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:20,743 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36604': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:20,743 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:20,847 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:20,852 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36612': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:20,852 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36618': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:20,852 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:20,955 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:20,959 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36630': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:20,960 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36632': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:20,960 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:21,063 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:21,067 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36648': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:21,067 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36650': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:21,067 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:21,171 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:21,175 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36654': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:21,176 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36668': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:21,176 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:21,279 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:21,284 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36676': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:21,284 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36692': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:21,284 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:21,386 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:21,387 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36698': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:21,392 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:21,392 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36700': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:21,494 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:21,495 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36706': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:21,500 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36722': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:21,500 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:21,602 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:21,602 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41532': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:21,608 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41536': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:21,608 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:21,710 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:21,710 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41548': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:21,716 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:21,716 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41562': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:21,817 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:21,818 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41572': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:21,824 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:21,824 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41584': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:21,925 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:21,925 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41598': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:21,931 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:21,931 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41612': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:22,033 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:22,033 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41614': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:22,039 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:22,039 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41620': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:22,141 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:22,146 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41634': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:22,147 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41644': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:22,147 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:22,249 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:22,253 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41652': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:22,254 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:22,254 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41656': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:22,356 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:22,356 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41660': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:22,362 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:22,362 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41662': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:22,464 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:22,469 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41672': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:22,470 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:22,470 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41676': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:22,572 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:22,576 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41690': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:22,577 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41706': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:22,577 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:22,679 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:22,684 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41720': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:22,684 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:22,684 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:22,787 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:22,792 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41734': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:22,792 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41742': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:22,792 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:22,896 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:22,900 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41748': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:22,901 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41762': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:22,901 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:23,004 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:23,008 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41766': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:23,009 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41774': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:23,009 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:23,112 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:23,116 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41778': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:23,117 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41780': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:23,117 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:23,220 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:23,224 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41786': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:23,225 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:23,225 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:23,328 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:23,332 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41798': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:23,333 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:23,333 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41804': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:23,436 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:23,440 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41806': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:23,441 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41822': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:23,441 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:23,544 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:23,548 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41836': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:23,549 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41850': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:23,549 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:23,653 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:23,657 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41854': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:23,657 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41856': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:23,657 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:23,762 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:23,766 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41862': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:23,767 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41870': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:23,767 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:23,871 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:23,875 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41886': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:23,875 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41902': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:23,875 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:23,980 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:23,984 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41904': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:23,984 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:23,984 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41912': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:24,091 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:24,095 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41928': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:24,095 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41930': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:24,095 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:24,200 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:24,204 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41944': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:24,205 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41960': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:24,205 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:24,309 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:24,312 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41964': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:24,313 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41978': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:24,313 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:24,417 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:24,421 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41982': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:24,421 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:24,422 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:24,526 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:24,530 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41998': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:24,530 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42006': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:24,530 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:24,635 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:24,639 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42014': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:24,640 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42024': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:24,640 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:24,743 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:24,747 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42028': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:24,748 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42038': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:24,748 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:24,851 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:24,855 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42054': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:24,855 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:24,856 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42064': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:24,958 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:24,963 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42080': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:24,964 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42094': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:24,964 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:25,067 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:25,071 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42100': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:25,071 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42104': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:25,071 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:25,174 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:25,179 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42116': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:25,179 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:25,179 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42128': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:25,283 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:25,288 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42136': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:25,288 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42140': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:25,288 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:25,391 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:25,395 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42154': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:25,396 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42158': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:25,396 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:25,499 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:25,503 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42162': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:25,504 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42170': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:25,504 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:25,607 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:25,611 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42176': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:25,611 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42178': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:25,611 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:25,715 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:25,720 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42188': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:25,721 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42190': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:25,721 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:25,822 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:25,827 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42196': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:25,828 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:25,828 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42198': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:25,930 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:25,934 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42214': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:25,935 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:25,935 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42220': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:26,038 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:26,042 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42234': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:26,043 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42238': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:26,043 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:26,146 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:26,150 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42242': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:26,150 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42244': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:26,150 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:26,253 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:26,258 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42258': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:26,258 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:26,258 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42270': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:26,362 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:26,366 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42278': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:26,367 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42282': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:26,367 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:26,469 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:26,474 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42296': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:26,474 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:26,475 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42302': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:26,577 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:26,582 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42308': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:26,582 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:26,586 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42322': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:26,685 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:26,689 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42334': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:26,690 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42350': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:26,690 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:26,793 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:26,797 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42360': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:26,797 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42364': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:26,797 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:26,900 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:26,905 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42378': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:26,905 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42384': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:26,905 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:27,008 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:27,013 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42398': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:27,013 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42412': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:27,013 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:27,116 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:27,120 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42426': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:27,121 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42438': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:27,121 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:27,224 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:27,228 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42440': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:27,229 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42452': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:27,229 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:27,332 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:27,336 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42464': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:27,337 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42480': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:27,337 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:27,440 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:27,444 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42486': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:27,444 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42500': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:27,445 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:27,547 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:27,552 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42502': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:27,552 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42508': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:27,552 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:27,655 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:27,660 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42510': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:27,660 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42512': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:27,660 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:27,763 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:27,767 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42518': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:27,768 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42528': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:27,768 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:27,871 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:27,875 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42540': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:27,875 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42546': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:27,875 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:27,978 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:27,983 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42558': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:27,983 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:27,983 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42568': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:28,087 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:28,094 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42582': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:28,095 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42592': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:28,095 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:28,195 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42606': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:28,195 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:28,202 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42620': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:28,202 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:28,302 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42624': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:28,302 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:28,309 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42632': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:28,309 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:28,410 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:28,410 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42640': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:28,416 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42654': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:28,417 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:28,517 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42660': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:28,517 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:28,524 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42672': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:28,524 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:28,625 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:28,626 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42676': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:28,631 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42690': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:28,631 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:28,733 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:28,733 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42704': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:28,739 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42720': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:28,739 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:28,840 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:28,840 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42722': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:28,846 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42734': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:28,846 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:28,948 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:28,948 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42742': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:28,954 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42746': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:28,954 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:29,055 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42760': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:29,055 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:29,061 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42772': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:29,061 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:29,163 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42778': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:29,163 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:29,168 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42788': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:29,168 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:29,270 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:29,270 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42802': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:29,276 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42816': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:29,276 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:29,377 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:29,378 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42826': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:29,383 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42834': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:29,383 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:29,485 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42846': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:29,485 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:29,490 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42848': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:29,490 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:29,592 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:29,592 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42856': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:29,598 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42868': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:29,598 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:29,700 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42870': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:29,700 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:29,705 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42886': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:29,705 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:29,808 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:29,812 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42892': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:29,813 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:29,813 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42902': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:29,917 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:29,919 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42918': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:29,920 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42926': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:29,920 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:30,024 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:30,028 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42928': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:30,029 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42938': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:30,029 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:30,132 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:30,136 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42952': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:30,136 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42954': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:30,136 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:30,239 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:30,243 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42966': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:30,243 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:30,243 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42974': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:30,346 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:30,350 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42986': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:30,351 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42996': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:30,352 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:30,454 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:30,454 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43008': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:30,460 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:30,461 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43016': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:30,561 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:30,561 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43026': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:30,567 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:30,568 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43038': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:30,668 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:30,668 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43050': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:30,674 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:30,675 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43066': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:30,776 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:30,781 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43068': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:30,781 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:30,781 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43082': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:30,883 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:30,887 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43098': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:30,888 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:30,888 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43106': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:30,990 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:30,995 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:30,995 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:30,995 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43138': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:31,097 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:31,102 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43142': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:31,102 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:31,102 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43152': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:31,204 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:31,209 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43168': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:31,209 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:31,209 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43178': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:31,311 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:31,316 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43194': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:31,316 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43208': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:31,316 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:31,419 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:31,423 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43224': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:31,423 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:31,423 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43226': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:31,527 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:31,531 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43236': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:31,531 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48204': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:31,531 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:31,634 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:31,638 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48206': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:31,639 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:31,639 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48210': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:31,741 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:31,745 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48212': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:31,746 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:31,746 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48216': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:31,848 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:31,853 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48230': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:31,853 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:31,853 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48242': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:31,955 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:31,960 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48244': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:31,961 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48254': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:31,960 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:32,063 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:32,067 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48260': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:32,068 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:32,068 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48274': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:32,170 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:32,175 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48290': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:32,175 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:32,175 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48296': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:32,277 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:32,282 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48304': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:32,283 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:32,283 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48314': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:32,385 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:32,389 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48320': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:32,390 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:32,390 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48322': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:32,492 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:32,496 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48336': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:32,497 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:32,497 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48342': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:32,599 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:32,603 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48344': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:32,604 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:32,604 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48356': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:32,706 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:32,710 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48372': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:32,711 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48376': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:32,711 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:32,813 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:32,818 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48380': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:32,818 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48390': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:32,818 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:32,920 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:32,925 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48392': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:32,926 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48394': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:32,926 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:33,028 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:33,032 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48398': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:33,033 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48406': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:33,033 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:33,135 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:33,140 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48420': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:33,140 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:33,140 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48424': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:33,243 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:33,248 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48436': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:33,248 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48442': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:33,248 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:33,351 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:33,355 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48450': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:33,356 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48464': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:33,356 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:33,458 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:33,462 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48478': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:33,463 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48484': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:33,463 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:33,565 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:33,570 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48494': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:33,571 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48504': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:33,571 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:33,673 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:33,677 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48516': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:33,678 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48520': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:33,678 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:33,780 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:33,785 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48536': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:33,785 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:33,786 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48552': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:33,887 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:33,892 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48568': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:33,892 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:33,892 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48584': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:33,994 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:33,999 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48590': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:33,999 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:33,999 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48596': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:34,102 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:34,106 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48602': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:34,107 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48610': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:34,107 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:34,210 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:34,214 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48618': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:34,215 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48632': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:34,215 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:34,318 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:34,322 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48648': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:34,322 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48652': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:34,322 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:34,425 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:34,429 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48668': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:34,430 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:34,430 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48684': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:34,533 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:34,537 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48690': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:34,537 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48700': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:34,537 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:34,641 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:34,645 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48704': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:34,645 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48708': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:34,645 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:34,750 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:34,754 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48718': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:34,755 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48726': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:34,755 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:34,858 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:34,862 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48734': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:34,863 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48738': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:34,863 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:34,966 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:34,971 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48744': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:34,971 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48756': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:34,971 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:35,074 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:35,078 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48772': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:35,079 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:35,079 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48786': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:35,182 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48798': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:35,182 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:35,188 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:35,188 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48810': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:35,290 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:35,295 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48826': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:35,295 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:35,296 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48834': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:35,397 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:35,398 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48836': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:35,403 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:35,403 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48840': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:35,505 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:35,510 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48846': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:35,511 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:35,511 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48852': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:35,613 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48868': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:35,613 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:35,619 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:35,619 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48872': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:35,721 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:35,721 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48880': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:35,727 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:35,727 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48888': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:35,829 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48894': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:35,829 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:35,834 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:35,834 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48902': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:35,937 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:35,941 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48904': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:35,942 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48910': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:35,942 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:36,044 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:36,048 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48912': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:36,049 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48926': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:36,049 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:36,152 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:36,156 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48938': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:36,157 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48946': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:36,157 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:36,259 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:36,263 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48956': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:36,264 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48966': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:36,264 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:36,367 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:36,371 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48974': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:36,372 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:36,372 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:36,475 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:36,479 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48992': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:36,480 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48998': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:36,480 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:36,583 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:36,592 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:49000': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:36,592 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:49004': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:36,592 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:36,692 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:36,692 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:49014': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:36,700 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:36,700 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:49022': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:36,800 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:36,800 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:49032': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:36,808 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:36,808 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:49040': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:36,908 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:36,908 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:49048': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:36,916 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:36,916 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:49054': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:37,016 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:37,016 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:49060': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:37,023 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:37,023 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:49064': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:37,124 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:37,124 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:49066': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:37,131 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:37,131 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:49076': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:37,232 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:37,232 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:49090': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:37,239 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:37,239 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:49092': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:37,340 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:37,340 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:49098': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:37,346 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:37,346 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:49102': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:37,448 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:37,448 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:49106': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:37,454 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:49122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:37,454 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:37,555 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:49128': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:37,555 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:37,562 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:37,562 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:49138': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:37,663 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:37,664 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:49144': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:37,670 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:37,670 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:49154': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:37,771 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:37,771 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:49168': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:37,778 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:37,778 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:49180': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:37,879 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:37,879 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:49196': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:37,886 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:37,886 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:49200': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:37,987 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:37,987 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:49216': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:37,994 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:37,994 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:49232': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:38,095 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:38,095 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:49242': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:38,102 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:38,102 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:49244': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:38,202 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:38,202 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:49254': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:38,209 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:38,209 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:49260': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:38,310 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:38,310 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:49264': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:38,317 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:38,317 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:49270': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:38,419 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:38,419 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:49272': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:38,425 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:38,425 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:49274': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:38,527 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:38,531 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:49282': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:38,532 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:49292': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:38,532 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:38,634 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:38,634 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:49306': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:38,640 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:38,640 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:49316': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:38,742 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:38,747 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:49324': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:38,748 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:38,748 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:49338': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:38,850 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:38,850 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:49352': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:38,855 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:38,856 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:49360': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:38,957 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:49374': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:38,958 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:38,963 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:38,963 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:49390': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:39,065 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:39,070 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:49396': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:39,071 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:49412': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:39,071 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:39,173 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:39,173 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:49426': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:39,179 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:49436': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:39,179 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:39,281 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:39,286 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:49450': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:39,287 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:39,287 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:49460': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:39,388 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:39,389 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:49462': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:39,395 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:39,395 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:49472': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:39,496 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:39,496 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:49476': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:39,502 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:39,502 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:49482': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:39,605 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:39,609 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:49494': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:39,610 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:49508': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:39,610 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:39,713 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:39,717 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:49524': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:39,717 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:49530': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:39,717 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:39,820 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:39,825 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:49534': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:39,825 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:49538': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:39,825 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:39,928 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:39,932 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:49550': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:39,933 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:49566': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:39,933 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:40,036 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:40,036 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:49574': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:40,042 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:40,042 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:49588': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:40,144 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:40,145 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:49600': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:40,150 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:40,150 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:49616': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:40,252 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:40,253 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:49632': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:40,258 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:40,259 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:49640': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:40,360 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:40,361 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:49650': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:40,366 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:49666': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:40,366 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:40,468 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:40,469 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:49670': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:40,474 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:40,474 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:49686': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:40,576 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:40,576 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:49694': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:40,583 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:40,586 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:49710': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:40,684 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:40,684 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:49726': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:40,691 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:40,691 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:49738': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:40,792 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:40,792 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:49750': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:40,799 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:40,799 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:49760': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:40,899 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:40,899 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:49768': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:40,906 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:40,906 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:49782': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:41,007 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:41,007 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:49796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:41,014 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:41,014 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:49808': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:41,115 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:49820': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:41,115 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:41,122 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:41,122 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:49832': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:41,222 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:41,222 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:49848': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:41,230 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:41,230 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:49860': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:41,330 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:41,330 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:49864': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:41,337 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:41,337 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:49872': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:41,438 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:41,438 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:49882': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:41,444 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:41,444 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:49896': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:41,546 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:41,546 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35992': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:41,552 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:41,552 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36002': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:41,653 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:41,653 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36016': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:41,659 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:41,659 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36032': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:41,761 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:41,766 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36036': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:41,767 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36050': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:41,767 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:41,869 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:41,874 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36060': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:41,874 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36064': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:41,874 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:41,977 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:41,982 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36078': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:41,982 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:41,982 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36084': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:42,085 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:42,095 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36088': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:42,095 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36092': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:42,095 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:42,193 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:42,193 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36104': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:42,203 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:42,203 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36116': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:42,300 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36124': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:42,300 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:42,311 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:42,311 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36128': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:42,408 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36130': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:42,408 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:42,418 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:42,418 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36144': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:42,516 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:42,517 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36150': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:42,526 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:42,526 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36154': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:42,624 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:42,624 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36160': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:42,633 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:42,633 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36174': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:42,732 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36178': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:42,732 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:42,741 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:42,741 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36186': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:42,840 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:42,840 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36202': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:42,848 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:42,848 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36210': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:42,948 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36222': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:42,948 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:42,955 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:42,956 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36232': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:43,056 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:43,056 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36238': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:43,063 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:43,063 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36248': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:43,164 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:43,164 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36252': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:43,170 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:43,170 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36256': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:43,272 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:43,277 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36272': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:43,278 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:43,278 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36280': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:43,380 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:43,385 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36288': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:43,385 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:43,386 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36298': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:43,488 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:43,492 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36308': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:43,493 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36318': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:43,493 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:43,596 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:43,601 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36330': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:43,601 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36340': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:43,601 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:43,704 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:43,708 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36344': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:43,709 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36350': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:43,709 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:43,812 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:43,816 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36356': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:43,816 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36370': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:43,817 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:43,919 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:43,924 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36378': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:43,924 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36390': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:43,924 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:44,027 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:44,031 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36404': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:44,032 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:44,032 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36414': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:44,135 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:44,139 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36422': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:44,140 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36438': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:44,140 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:44,243 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:44,247 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36444': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:44,248 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36452': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:44,248 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:44,350 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:44,355 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36466': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:44,355 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36468': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:44,355 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:44,459 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:44,464 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36474': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:44,464 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36490': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:44,464 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:44,567 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:44,571 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36498': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:44,572 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36510': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:44,572 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:44,675 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:44,679 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36526': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:44,680 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36536': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:44,680 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:44,782 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:44,787 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36550': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:44,787 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36554': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:44,788 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:44,890 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:44,891 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36568': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:44,897 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36574': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:44,897 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:44,998 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:44,999 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36578': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:45,004 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:45,004 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36592': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:45,106 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:45,111 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36604': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:45,112 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:45,112 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36612': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:45,214 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:45,218 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36628': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:45,219 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36640': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:45,219 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:45,323 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:45,327 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36650': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:45,327 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36664': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:45,327 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:45,430 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:45,435 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36670': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:45,435 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:45,435 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36672': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:45,538 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:45,542 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36684': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:45,543 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:45,543 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36694': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:45,646 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:45,650 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36696': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:45,651 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36700': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:45,651 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:45,754 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:45,758 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36714': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:45,758 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36728': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:45,759 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:45,861 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:45,865 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36730': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:45,866 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36744': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:45,866 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:45,969 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:45,973 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36752': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:45,974 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36760': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:45,974 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:46,077 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:46,081 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36764': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:46,081 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:46,085 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36772': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:46,184 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:46,189 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36786': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:46,189 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36800': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:46,189 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:46,292 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:46,296 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36804': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:46,297 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36808': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:46,297 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:46,400 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:46,404 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36810': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:46,404 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36814': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:46,404 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:46,507 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:46,512 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36828': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:46,512 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36840': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:46,512 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:46,615 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:46,619 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36842': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:46,620 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36852': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:46,620 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:46,723 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:46,727 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36868': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:46,728 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36872': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:46,728 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:46,830 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:46,835 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36874': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:46,835 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:46,836 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36886': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:46,938 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:46,942 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36888': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:46,943 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36902': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:46,943 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:47,047 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:47,051 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36914': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:47,052 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36920': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:47,052 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:47,154 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:47,159 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36924': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:47,159 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36930': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:47,159 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:47,262 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:47,266 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36934': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:47,266 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36946': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:47,266 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:47,369 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:47,374 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36952': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:47,374 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36960': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:47,374 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:47,477 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:47,482 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36964': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:47,482 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:47,483 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36966': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:47,585 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:47,593 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36976': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:47,594 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36978': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:47,594 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:47,693 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:47,693 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36992': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:47,701 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:47,702 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37002': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:47,801 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:47,801 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37012': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:47,809 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:47,809 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37026': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:47,909 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:47,909 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37032': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:47,916 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:47,916 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37048': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:48,016 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:48,016 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37054': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:48,024 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:48,024 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37060': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:48,124 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:48,124 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37064': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:48,131 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:48,131 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37072': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:48,232 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:48,232 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37080': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:48,238 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:48,238 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37082': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:48,339 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:48,339 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37098': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:48,346 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:48,346 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37104': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:48,447 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:48,447 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37118': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:48,453 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:48,453 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37128': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:48,555 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:48,555 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37136': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:48,561 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:48,561 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37148': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:48,663 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:48,667 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37154': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:48,668 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:48,669 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37158': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:48,771 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:48,775 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37174': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:48,776 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37190': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:48,776 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:48,879 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:48,883 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37206': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:48,884 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37222': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:48,884 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:48,987 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:48,991 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37236': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:48,992 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37238': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:48,992 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:49,095 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:49,099 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37240': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:49,100 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37250': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:49,100 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:49,203 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:49,207 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37260': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:49,208 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37270': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:49,208 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:49,312 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:49,316 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37278': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:49,317 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37280': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:49,317 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:49,419 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:49,424 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37290': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:49,424 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37298': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:49,424 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:49,527 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:49,531 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37306': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:49,532 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37312': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:49,532 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:49,635 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:49,639 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37314': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:49,640 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:49,640 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37322': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:49,743 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:49,743 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37326': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:49,749 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:49,749 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37340': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:49,851 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:49,851 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37346': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:49,857 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:49,857 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37348': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:49,958 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37360': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:49,959 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:49,964 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:49,964 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37366': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:50,067 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37370': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:50,067 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:50,072 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37378': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:50,072 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:50,174 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:50,174 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37388': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:50,180 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:50,181 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37396': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:50,282 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:50,282 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37412': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:50,288 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:50,288 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37418': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:50,390 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:50,390 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37432': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:50,396 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37444': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:50,396 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:50,498 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:50,499 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37456': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:50,504 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:50,504 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37466': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:50,606 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:50,607 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37478': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:50,612 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:50,613 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37486': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:50,714 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:50,715 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37488': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:50,720 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:50,720 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37500': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:50,822 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:50,827 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37510': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:50,828 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37518': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:50,828 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:50,930 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:50,930 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37522': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:50,936 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:50,936 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37536': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:51,038 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:51,038 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37546': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:51,044 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:51,044 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37562': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:51,146 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:51,151 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37572': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:51,152 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:51,152 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37586': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:51,254 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:51,259 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37594': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:51,260 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:51,260 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37596': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:51,362 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37608': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:51,362 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:51,367 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:51,367 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37622': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:51,470 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37626': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:51,470 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:51,476 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:51,476 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37638': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:51,578 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:51,578 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35950': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:51,584 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:51,587 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35954': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:51,686 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35966': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:51,686 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:51,691 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:51,691 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35972': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:51,794 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:51,798 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:51,799 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:51,799 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35992': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:51,902 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:51,906 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36006': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:51,907 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36012': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:51,907 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:52,010 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:52,014 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36024': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:52,015 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36036': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:52,015 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:52,118 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:52,122 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36052': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:52,123 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36066': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:52,123 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:52,227 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:52,231 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36080': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:52,231 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36082': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:52,232 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:52,334 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:52,339 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36084': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:52,340 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36088': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:52,340 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:52,442 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:52,442 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36094': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:52,447 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:52,448 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36096': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:52,549 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:52,550 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36110': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:52,555 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:52,555 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36112': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:52,657 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:52,662 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36128': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:52,663 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36136': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:52,663 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:52,765 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:52,769 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36148': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:52,770 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:52,771 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36164': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:52,872 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:52,873 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36172': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:52,878 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36180': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:52,878 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:52,980 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:52,985 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36192': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:52,986 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36194': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:52,986 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:53,091 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:53,095 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36200': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:53,095 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36214': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:53,096 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:53,198 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36228': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:53,198 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:53,204 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:53,204 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36240': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:53,306 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36254': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:53,306 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:53,312 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:53,312 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36256': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:53,414 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:53,418 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36268': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:53,419 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:53,419 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36278': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:53,521 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:53,521 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36280': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:53,527 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:53,527 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36292': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:53,629 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:53,634 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36294': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:53,635 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:53,635 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36304': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:53,737 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36314': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:53,737 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:53,743 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:53,743 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36330': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:53,845 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36334': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:53,845 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:53,851 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:53,851 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36348': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:53,953 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:53,957 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36356': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:53,958 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:53,958 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36360': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:54,061 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:54,065 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36368': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:54,066 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36372': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:54,066 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:54,169 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:54,174 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36378': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:54,174 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36382': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:54,174 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:54,276 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:54,281 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36394': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:54,281 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:54,282 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36396': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:54,384 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:54,388 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36404': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:54,389 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36410': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:54,389 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:54,491 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:54,496 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36416': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:54,496 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:54,496 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36420': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:54,599 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:54,599 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36422': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:54,605 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:54,605 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36432': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:54,706 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:54,711 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36448': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:54,712 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:54,712 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36458': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:54,814 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:54,818 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36462': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:54,819 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:54,819 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36474': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:54,921 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:54,926 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36482': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:54,926 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:54,926 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36488': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:55,029 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:55,033 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36490': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:55,034 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36494': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:55,034 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:55,136 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:55,141 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36508': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:55,141 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:55,141 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36516': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:55,244 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:55,248 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36518': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:55,249 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:55,249 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36524': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:55,351 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:55,356 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36530': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:55,356 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36542': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:55,357 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:55,459 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:55,463 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36550': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:55,464 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36558': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:55,464 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:55,566 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:55,572 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36568': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:55,573 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36584': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:55,573 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:55,675 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:55,679 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36598': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:55,680 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36608': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:55,680 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:55,782 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:55,787 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36622': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:55,787 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:55,787 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36634': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:55,890 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:55,894 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36650': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:55,895 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36662': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:55,895 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:55,998 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:56,002 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36676': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:56,003 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36692': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:56,003 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:56,106 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:56,110 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36698': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:56,111 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36702': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:56,111 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:56,214 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:56,218 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36712': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:56,219 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36714': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:56,219 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:56,322 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:56,326 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36718': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:56,326 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:56,326 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:56,429 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:56,433 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36738': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:56,434 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36746': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:56,434 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:56,537 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:56,541 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36748': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:56,542 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36762': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:56,542 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:56,644 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:56,649 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36766': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:56,649 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36778': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:56,649 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:56,752 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36792': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:56,752 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:56,757 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:56,757 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36798': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:56,860 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:56,860 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36810': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:56,866 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:56,866 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36814': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:56,967 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:56,967 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36816': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:56,974 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:56,974 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36820': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:57,075 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:57,075 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36836': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:57,081 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:57,084 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36838': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:57,183 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:57,183 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36844': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:57,189 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:57,189 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36848': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:57,291 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:57,292 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36864': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:57,297 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:57,297 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36874': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:57,400 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:57,400 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36876': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:57,405 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:57,405 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36884': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:57,507 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:57,507 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36894': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:57,513 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:57,513 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36910': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:57,615 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:57,620 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36916': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:57,621 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:57,621 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36920': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:57,723 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36928': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:57,723 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:57,728 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:57,728 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36940': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:57,830 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:57,831 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36952': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:57,837 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:57,837 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36966': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:57,938 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:57,939 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36974': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:57,944 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:57,944 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:58,046 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:58,051 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36994': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:58,052 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:58,052 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37000': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:58,154 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:58,158 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37008': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:58,159 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:58,159 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37012': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:58,261 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:58,266 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37022': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:58,267 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:58,267 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37030': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:58,369 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:58,369 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37034': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:58,375 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:58,375 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37048': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:58,477 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37050': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:58,477 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:58,482 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:58,482 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37064': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:58,585 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:58,593 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37080': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:58,594 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37086': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:58,594 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:58,693 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:58,693 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37090': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:58,702 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:58,702 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37102': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:58,800 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:58,800 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37110': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:58,809 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:58,809 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37114': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:58,908 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37130': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:58,908 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:58,917 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:58,917 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37132': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:59,017 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37140': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:59,017 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:59,024 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:59,025 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37148': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:59,126 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:59,131 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37162': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:59,132 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:59,132 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37164': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:59,234 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37180': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:59,234 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:59,240 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:59,240 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37186': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:59,342 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37194': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:59,342 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:59,348 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37206': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:59,348 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:59,450 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:59,450 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37214': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:59,457 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:59,457 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37228': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:59,558 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37244': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:59,558 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:59,564 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37260': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:59,564 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:59,666 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:59,670 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37266': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:59,671 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:59,671 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37282': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:59,774 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37284': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:59,774 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:59,780 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:59,780 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37294': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:59,882 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:59,882 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37298': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:59,888 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:59,888 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37302': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:59,990 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:59,990 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37304': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:28:59,995 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:28:59,995 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37318': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:00,097 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:00,102 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37320': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:00,103 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37334': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:00,103 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:00,205 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:00,205 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37346': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:00,211 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:00,211 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37362': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:00,313 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:00,317 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37364': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:00,318 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:00,319 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37366': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:00,421 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:00,425 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37380': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:00,427 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37396': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:00,427 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:00,529 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:00,534 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37404': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:00,534 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37420': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:00,534 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:00,637 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:00,642 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37426': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:00,642 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:00,642 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37436': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:00,745 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:00,750 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37448': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:00,750 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:00,750 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37458': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:00,855 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:00,859 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37460': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:00,860 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37472': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:00,860 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:00,963 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:00,967 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37482': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:00,968 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37496': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:00,968 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:01,070 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:01,075 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37502': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:01,076 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37508': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:01,076 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:01,178 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:01,178 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37516': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:01,184 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:01,184 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37528': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:01,286 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:01,286 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37536': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:01,292 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:01,292 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37552': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:01,394 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:01,398 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37562': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:01,399 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:01,399 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37572': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:01,501 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:01,506 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37588': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:01,507 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:01,507 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37590': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:01,609 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:01,609 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41894': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:01,615 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:01,615 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41902': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:01,716 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:01,716 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41910': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:01,723 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:01,723 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41914': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:01,824 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:01,824 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41918': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:01,830 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:01,830 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41932': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:01,932 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:01,932 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41940': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:01,938 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:01,938 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41948': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:02,039 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:02,039 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41956': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:02,046 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:02,046 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41970': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:02,147 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:02,148 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:02,153 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:02,153 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41990': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:02,255 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:02,255 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41994': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:02,261 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:02,261 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42004': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:02,363 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:02,363 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42014': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:02,369 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:02,369 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42022': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:02,470 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:02,470 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42038': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:02,477 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:02,477 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42052': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:02,579 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:02,579 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42054': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:02,585 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:02,588 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42060': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:02,687 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:02,687 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42062': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:02,693 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:02,693 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42074': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:02,794 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:02,795 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42078': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:02,801 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:02,801 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42082': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:02,902 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:02,907 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42098': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:02,908 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:02,908 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42102': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:03,010 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:03,015 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42112': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:03,016 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:03,016 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42118': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:03,118 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:03,122 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42126': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:03,124 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:03,124 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42142': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:03,225 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:03,226 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42150': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:03,232 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:03,232 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42154': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:03,333 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:03,333 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42156': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:03,339 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:03,339 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42162': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:03,440 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:03,440 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42170': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:03,447 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:03,447 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42174': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:03,548 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:03,548 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42176': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:03,555 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:03,555 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42180': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:03,655 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:03,655 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42192': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:03,662 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42198': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:03,662 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:03,763 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:03,763 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42206': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:03,770 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:03,770 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42208': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:03,872 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:03,872 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42214': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:03,878 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:03,878 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42216': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:03,979 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:03,980 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42224': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:03,986 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:03,986 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42232': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:04,091 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:04,095 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42244': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:04,096 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42246': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:04,096 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:04,198 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:04,198 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42250': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:04,204 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:04,204 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42264': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:04,307 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:04,307 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42272': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:04,313 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:04,313 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42288': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:04,415 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:04,415 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42304': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:04,421 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:04,421 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42308': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:04,522 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:04,522 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42314': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:04,529 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:04,529 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42318': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:04,630 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:04,630 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42334': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:04,636 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:04,636 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42336': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:04,738 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:04,738 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42340': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:04,744 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:04,744 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42346': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:04,845 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:04,845 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42348': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:04,851 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:04,852 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42356': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:04,953 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:04,953 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42366': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:04,959 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:04,959 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42378': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:05,061 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:05,065 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42384': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:05,066 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:05,066 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42396': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:05,169 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:05,173 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42406': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:05,174 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42414': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:05,174 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:05,276 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:05,276 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42418': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:05,282 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:05,282 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42424': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:05,384 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:05,384 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42438': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:05,390 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:05,390 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42444': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:05,492 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:05,496 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42448': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:05,497 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:05,497 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42456': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:05,599 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:05,600 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42464': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:05,606 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:05,606 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42468': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:05,707 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:05,712 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42474': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:05,713 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42478': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:05,713 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:05,815 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:05,820 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42488': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:05,821 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42494': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:05,821 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:05,923 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:05,923 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42510': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:05,929 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:05,929 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42516': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:06,032 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:06,036 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42530': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:06,037 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42542': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:06,037 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:06,140 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:06,144 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42550': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:06,145 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42556': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:06,145 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:06,248 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:06,252 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42560': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:06,253 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42568': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:06,253 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:06,356 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:06,360 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42570': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:06,361 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42576': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:06,361 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:06,463 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:06,468 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42578': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:06,469 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42588': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:06,469 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:06,571 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:06,575 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42596': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:06,576 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42604': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:06,576 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:06,679 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:06,683 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42616': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:06,684 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:06,684 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42624': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:06,787 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:06,791 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42630': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:06,792 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42634': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:06,792 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:06,894 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:06,899 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42644': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:06,900 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42658': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:06,900 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:07,002 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:07,006 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42660': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:07,007 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42670': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:07,007 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:07,110 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:07,114 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42682': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:07,115 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42690': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:07,115 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:07,218 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:07,222 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42704': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:07,223 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42712': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:07,223 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:07,326 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:07,330 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42720': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:07,331 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:07,331 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42734': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:07,434 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:07,438 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42746': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:07,439 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42760': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:07,439 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:07,541 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:07,546 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42766': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:07,546 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42776': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:07,546 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:07,649 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:07,653 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42784': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:07,654 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42788': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:07,654 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:07,758 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:07,762 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:07,763 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42810': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:07,763 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:07,865 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:07,870 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42816': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:07,871 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42830': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:07,871 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:07,973 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:07,977 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42832': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:07,978 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42836': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:07,978 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:08,081 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:08,081 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42848': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:08,087 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:08,090 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42860': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:08,188 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:08,193 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42866': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:08,194 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:08,194 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42870': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:08,295 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:08,300 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42886': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:08,301 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42900': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:08,301 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:08,403 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:08,408 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42904': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:08,409 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:08,409 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42914': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:08,511 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:08,516 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42918': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:08,517 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:08,517 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42920': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:08,618 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:08,619 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42926': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:08,624 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:08,625 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42940': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:08,727 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:08,732 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42946': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:08,732 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42950': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:08,732 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:08,835 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:08,839 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42966': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:08,840 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42974': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:08,840 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:08,942 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:08,947 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42980': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:08,948 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42990': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:08,948 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:09,050 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:09,054 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43004': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:09,055 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43006': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:09,055 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:09,158 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:09,158 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43014': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:09,164 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:09,164 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43020': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:09,265 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:09,265 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43030': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:09,272 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:09,272 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43044': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:09,373 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:09,373 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43060': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:09,379 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:09,379 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43076': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:09,482 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:09,482 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43080': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:09,487 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:09,487 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43094': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:09,591 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:09,596 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43098': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:09,596 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43106': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:09,596 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:09,699 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:09,703 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43112': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:09,704 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43126': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:09,704 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:09,807 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:09,811 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43142': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:09,812 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43154': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:09,812 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:09,914 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:09,918 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43156': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:09,919 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43172': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:09,919 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:10,022 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:10,026 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43188': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:10,027 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43198': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:10,027 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:10,129 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:10,134 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43200': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:10,134 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43214': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:10,134 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:10,237 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:10,241 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43216': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:10,242 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43222': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:10,242 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:10,345 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:10,349 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43226': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:10,350 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43230': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:10,350 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:10,452 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:10,456 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43234': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:10,457 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43242': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:10,457 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:10,560 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:10,566 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43254': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:10,566 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43266': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:10,566 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:10,668 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:10,668 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43278': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:10,674 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:10,674 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43288': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:10,776 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:10,780 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43290': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:10,781 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:10,782 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43304': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:10,884 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:10,884 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43308': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:10,889 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:10,890 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43316': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:10,991 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:10,992 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43322': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:10,997 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:10,997 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43334': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:11,099 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:11,099 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43340': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:11,105 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:11,105 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43350': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:11,207 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:11,212 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43358': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:11,212 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43364': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:11,213 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:11,315 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:11,320 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43376': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:11,320 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43386': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:11,320 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:11,423 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:11,427 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43400': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:11,428 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43410': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:11,428 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:11,531 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:11,535 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:45716': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:11,536 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:45720': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:11,536 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:11,639 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:11,643 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:45722': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:11,644 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:45730': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:11,644 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:11,746 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:45746': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:11,746 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:11,752 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:11,752 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:45748': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:11,854 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:11,859 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:45750': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:11,860 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:45758': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:11,860 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:11,962 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:11,966 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:45764': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:11,967 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:11,967 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:45778': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:12,070 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:45794': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:12,070 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:12,076 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:12,076 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:45804': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:12,178 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:12,178 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:45820': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:12,184 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:12,184 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:45826': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:12,285 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:12,286 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:45834': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:12,291 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:12,292 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:45848': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:12,393 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:12,394 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:45852': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:12,399 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:45860': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:12,399 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:12,501 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:12,506 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:45876': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:12,507 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:45888': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:12,507 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:12,609 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:45890': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:12,609 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:12,615 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:45906': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:12,615 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:12,717 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:12,717 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:45918': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:12,723 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:12,723 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:45926': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:12,825 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:12,825 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:45942': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:12,831 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:12,831 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:45944': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:12,933 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:12,938 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:45958': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:12,939 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:45972': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:12,939 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:13,041 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:13,045 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:45974': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:13,046 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:45980': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:13,046 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:13,149 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:13,153 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:45988': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:13,154 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46002': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:13,154 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:13,257 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:13,261 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46006': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:13,262 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46018': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:13,262 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:13,365 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:13,369 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46034': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:13,370 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46038': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:13,370 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:13,473 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:13,477 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46042': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:13,477 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:13,477 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:13,582 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:13,590 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46064': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:13,590 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46078': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:13,590 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:13,689 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46080': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:13,689 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:13,698 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:13,698 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46092': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:13,797 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:13,797 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46096': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:13,805 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:13,805 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46106': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:13,905 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:13,905 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46112': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:13,913 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:13,913 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46128': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:14,013 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:14,013 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46132': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:14,022 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:14,022 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46138': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:14,121 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:14,121 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46152': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:14,130 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:14,130 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46156': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:14,229 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:14,229 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46164': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:14,237 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:14,237 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46180': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:14,337 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:14,337 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46184': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:14,344 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:14,345 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46196': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:14,445 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:14,445 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46212': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:14,452 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:14,452 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46224': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:14,553 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:14,553 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46238': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:14,559 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:14,559 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46250': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:14,662 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:14,666 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46266': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:14,667 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46270': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:14,667 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:14,770 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:14,774 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46282': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:14,775 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46290': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:14,775 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:14,878 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:14,882 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46292': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:14,883 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:14,883 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46300': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:14,986 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:14,990 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46316': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:14,990 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46320': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:14,991 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:15,093 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:15,098 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46328': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:15,098 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46330': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:15,098 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:15,201 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:15,205 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46340': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:15,206 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46346': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:15,206 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:15,309 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:15,313 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46350': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:15,314 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46362': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:15,314 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:15,417 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:15,421 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46378': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:15,421 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46386': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:15,421 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:15,525 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:15,529 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46398': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:15,530 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46400': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:15,530 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:15,632 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:15,637 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46408': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:15,637 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46418': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:15,637 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:15,740 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:15,744 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46430': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:15,745 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46446': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:15,745 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:15,848 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:15,852 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46452': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:15,853 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46466': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:15,853 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:15,956 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:15,960 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46480': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:15,961 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46492': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:15,961 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:16,064 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:16,068 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46506': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:16,068 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46512': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:16,068 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:16,171 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:16,175 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46520': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:16,176 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46526': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:16,176 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:16,279 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:16,283 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46528': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:16,284 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:16,284 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46534': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:16,388 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:16,392 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46542': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:16,392 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46552': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:16,392 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:16,495 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:16,499 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46554': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:16,500 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46570': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:16,500 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:16,603 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:16,607 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46576': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:16,608 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46592': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:16,608 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:16,711 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:16,715 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46598': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:16,716 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46604': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:16,716 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:16,819 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:16,823 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46616': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:16,824 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46632': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:16,824 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:16,927 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:16,931 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46634': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:16,931 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:16,931 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46648': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:17,034 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:17,039 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46662': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:17,039 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46678': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:17,039 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:17,142 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:17,146 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46680': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:17,147 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46690': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:17,147 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:17,249 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:17,254 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46692': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:17,255 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46702': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:17,255 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:17,357 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:17,361 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46706': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:17,362 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46712': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:17,362 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:17,464 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:17,469 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46720': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:17,470 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46734': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:17,470 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:17,572 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:17,576 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46736': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:17,577 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46746': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:17,577 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:17,680 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:17,684 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46754': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:17,685 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:17,685 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46764': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:17,787 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:17,792 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46772': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:17,792 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46774': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:17,792 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:17,895 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:17,899 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46786': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:17,900 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46788': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:17,900 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:18,002 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:18,007 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46792': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:18,008 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46798': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:18,008 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:18,111 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:18,115 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46812': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:18,116 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:18,116 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46818': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:18,218 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:18,223 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46830': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:18,223 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:18,223 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46844': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:18,326 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:18,330 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46848': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:18,331 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46858': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:18,331 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:18,435 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:18,439 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46860': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:18,440 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46876': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:18,440 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:18,543 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:18,547 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46890': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:18,548 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46896': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:18,548 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:18,650 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:18,655 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46910': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:18,655 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46912': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:18,655 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:18,758 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:18,762 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46914': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:18,763 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46918': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:18,763 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:18,866 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:18,867 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46934': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:18,872 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:18,873 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46936': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:18,974 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:18,974 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46940': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:18,980 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:18,980 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46944': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:19,082 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:19,086 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46956': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:19,091 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:19,092 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46968': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:19,190 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:19,190 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46970': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:19,199 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:19,199 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46976': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:19,298 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:19,298 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46978': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:19,307 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:19,307 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46982': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:19,406 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:19,406 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46990': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:19,415 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:19,415 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46992': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:19,514 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:19,514 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47004': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:19,522 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:19,522 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47012': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:19,622 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:19,622 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47014': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:19,630 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:19,630 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47026': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:19,730 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:19,730 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47040': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:19,737 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:19,737 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47042': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:19,838 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:19,838 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47054': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:19,845 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:19,845 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:19,946 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:19,951 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47066': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:19,952 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:19,952 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47070': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:20,054 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:20,059 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47076': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:20,059 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47088': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:20,059 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:20,162 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:20,166 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47104': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:20,167 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47118': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:20,167 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:20,270 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:20,274 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47126': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:20,275 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47136': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:20,275 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:20,378 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:20,382 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47152': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:20,383 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:20,383 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47164': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:20,486 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:20,491 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47180': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:20,492 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:20,492 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47192': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:20,594 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:20,594 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47202': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:20,600 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47214': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:20,600 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:20,702 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:20,702 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47224': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:20,708 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:20,708 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47236': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:20,809 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:20,814 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47248': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:20,815 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:20,816 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47258': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:20,917 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:20,917 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47264': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:20,923 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:20,923 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47268': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:21,024 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:21,025 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47272': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:21,031 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:21,031 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47278': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:21,132 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:21,132 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47284': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:21,139 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:21,139 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47300': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:21,240 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:21,240 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47314': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:21,247 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:21,247 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47328': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:21,347 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:21,348 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47344': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:21,354 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:21,354 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47356': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:21,454 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47366': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:21,455 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:21,462 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47372': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:21,462 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:21,562 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52040': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:21,562 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:21,569 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52042': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:21,569 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:21,669 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:21,669 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:21,677 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52074': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:21,677 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:21,776 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52078': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:21,776 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:21,784 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52086': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:21,785 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:21,884 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52096': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:21,884 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:21,892 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52098': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:21,892 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:21,991 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52104': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:21,991 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:22,000 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52120': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:22,000 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:22,098 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:22,098 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:22,107 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52134': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:22,107 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:22,204 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52138': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:22,204 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:22,215 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52142': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:22,215 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:22,311 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52152': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:22,311 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:22,322 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52160': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:22,322 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:22,418 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52172': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:22,418 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:22,430 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52178': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:22,430 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:22,526 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52192': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:22,526 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:22,538 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52202': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:22,538 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:22,634 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52204': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:22,634 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:22,646 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52216': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:22,646 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:22,742 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52230': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:22,742 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:22,753 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52238': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:22,753 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:22,849 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:22,849 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52248': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:22,861 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52264': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:22,861 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:22,957 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52278': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:22,957 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:22,969 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52290': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:22,969 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:23,065 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52296': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:23,065 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:23,077 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52312': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:23,077 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:23,172 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52314': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:23,172 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:23,185 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52318': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:23,185 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:23,282 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52326': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:23,282 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:23,292 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52342': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:23,292 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:23,389 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52346': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:23,389 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:23,400 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52352': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:23,400 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:23,496 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52356': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:23,496 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:23,507 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52360': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:23,507 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:23,604 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52374': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:23,604 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:23,615 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52388': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:23,615 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:23,711 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52396': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:23,712 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:23,724 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52402': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:23,724 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:23,819 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52406': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:23,819 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:23,831 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52422': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:23,831 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:23,927 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52428': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:23,927 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:23,938 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52438': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:23,938 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:24,034 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52448': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:24,034 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:24,046 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52452': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:24,046 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:24,141 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52468': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:24,141 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:24,153 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52482': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:24,153 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:24,249 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52494': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:24,249 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:24,261 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52506': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:24,261 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:24,356 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52512': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:24,356 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:24,368 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52524': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:24,368 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:24,464 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52530': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:24,464 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:24,475 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52544': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:24,475 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:24,571 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52552': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:24,571 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:24,583 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:24,586 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52560': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:24,678 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52564': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:24,678 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:24,690 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52574': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:24,690 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:24,786 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:24,786 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52582': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:24,798 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52596': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:24,798 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:24,893 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52608': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:24,893 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:24,905 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52622': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:24,905 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:25,001 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52624': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:25,001 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:25,013 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52630': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:25,013 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:25,109 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52646': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:25,109 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:25,120 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52650': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:25,120 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:25,216 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52660': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:25,216 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:25,228 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52672': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:25,228 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:25,324 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52680': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:25,324 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:25,335 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52694': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:25,335 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:25,431 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52710': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:25,431 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:25,442 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52716': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:25,442 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:25,539 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52732': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:25,539 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:25,550 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52740': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:25,550 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:25,646 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52746': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:25,647 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:25,657 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52750': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:25,657 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:25,754 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52752': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:25,754 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:25,764 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52768': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:25,764 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:25,861 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52772': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:25,861 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:25,872 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52776': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:25,872 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:25,968 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52790': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:25,968 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:25,979 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52798': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:25,979 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:26,076 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:26,076 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52810': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:26,091 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:26,091 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52812': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:26,184 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:26,184 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52824': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:26,198 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:26,198 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52832': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:26,291 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:26,292 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52844': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:26,306 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:26,306 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52854': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:26,399 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:26,399 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52864': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:26,414 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:26,414 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52880': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:26,507 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:26,507 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52890': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:26,522 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:26,522 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52892': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:26,614 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:26,614 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52902': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:26,629 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:26,629 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52904': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:26,723 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:26,723 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52910': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:26,737 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:26,737 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52924': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:26,830 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:26,830 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52932': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:26,845 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:26,845 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52948': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:26,938 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:26,938 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52952': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:26,952 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:26,953 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52962': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:27,046 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:27,046 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52966': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:27,060 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:27,060 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52982': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:27,153 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:27,153 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52996': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:27,168 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:27,168 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53008': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:27,261 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:27,261 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53020': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:27,276 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:27,276 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53036': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:27,368 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:27,369 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53042': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:27,383 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:27,383 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:27,476 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:27,476 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53062': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:27,491 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:27,491 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53066': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:27,584 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:27,587 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53080': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:27,598 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:27,599 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53096': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:27,691 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53102': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:27,691 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:27,706 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:27,706 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53114': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:27,799 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:27,799 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:27,813 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:27,814 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53128': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:27,907 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:27,907 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53140': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:27,921 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:27,921 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53156': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:28,015 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:28,015 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53172': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:28,029 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:28,029 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53186': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:28,124 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:28,124 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53192': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:28,136 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:28,136 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53200': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:28,232 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:28,232 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53212': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:28,244 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:28,244 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53216': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:28,340 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:28,340 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53228': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:28,351 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:28,351 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53242': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:28,448 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:28,448 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53252': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:28,459 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:28,459 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53260': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:28,555 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:28,556 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53266': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:28,567 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:28,567 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53268': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:28,663 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:28,663 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53270': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:28,675 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:28,675 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53284': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:28,771 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:28,771 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53294': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:28,783 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:28,783 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53304': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:28,879 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:28,879 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53318': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:28,890 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:28,891 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53330': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:28,986 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:28,986 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53332': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:28,998 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:28,998 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53346': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:29,094 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:29,094 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53362': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:29,105 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:29,105 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53374': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:29,202 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:29,202 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53390': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:29,213 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:29,213 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53398': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:29,309 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53408': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:29,309 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:29,320 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:29,320 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53414': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:29,417 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:29,417 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53428': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:29,428 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:29,428 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53436': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:29,525 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:29,525 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53438': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:29,535 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:29,536 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53450': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:29,632 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:29,633 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53460': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:29,643 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:29,643 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53472': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:29,740 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:29,740 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53478': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:29,750 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:29,750 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53484': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:29,848 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:29,848 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53496': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:29,858 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:29,858 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53508': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:29,956 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53518': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:29,956 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:29,966 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:29,966 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53528': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:30,064 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:30,064 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53536': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:30,073 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:30,073 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53538': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:30,173 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:30,173 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53548': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:30,181 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:30,181 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53554': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:30,280 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:30,280 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53564': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:30,288 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:30,288 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53574': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:30,388 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:30,388 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53588': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:30,396 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:30,396 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53600': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:30,495 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:30,495 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53616': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:30,503 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:30,503 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53628': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:30,603 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:30,603 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53636': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:30,611 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:30,611 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53646': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:30,710 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:30,710 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53648': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:30,718 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:30,718 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53652': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:30,818 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:30,818 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53660': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:30,825 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:30,825 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53676': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:30,925 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:30,925 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53692': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:30,933 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:30,933 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53696': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:31,033 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:31,033 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53700': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:31,040 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:31,040 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53710': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:31,141 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53720': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:31,141 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:31,147 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:31,147 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53726': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:31,248 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:31,249 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53728': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:31,254 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:31,254 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53742': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:31,356 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:31,360 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53744': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:31,362 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:31,362 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53756': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:31,463 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:31,464 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53772': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:31,469 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53776': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:31,469 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:31,571 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:31,571 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34394': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:31,577 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:31,577 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34406': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:31,679 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34420': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:31,679 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:31,684 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:31,685 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34428': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:31,786 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34436': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:31,786 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:31,792 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:31,792 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34452': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:31,895 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:31,899 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34462': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:31,900 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34472': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:31,900 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:32,003 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:32,007 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34484': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:32,007 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:32,007 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34486': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:32,110 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:32,115 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34496': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:32,115 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34500': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:32,115 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:32,218 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:32,222 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34508': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:32,223 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34524': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:32,223 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:32,326 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:32,330 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34536': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:32,331 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34542': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:32,331 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:32,433 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:32,438 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34548': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:32,438 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34552': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:32,438 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:32,541 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:32,545 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34564': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:32,546 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34576': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:32,546 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:32,648 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:32,653 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34580': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:32,653 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:32,653 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34584': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:32,756 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:32,760 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34598': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:32,761 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34600': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:32,761 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:32,863 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:32,867 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34606': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:32,868 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34616': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:32,868 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:32,973 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:32,977 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34626': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:32,978 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34630': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:32,978 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:33,081 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:33,085 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34632': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:33,086 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:33,090 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34638': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:33,188 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:33,192 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34648': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:33,193 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34658': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:33,193 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:33,296 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:33,300 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34664': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:33,301 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34680': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:33,301 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:33,404 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:33,405 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34686': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:33,410 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:33,410 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34692': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:33,512 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:33,512 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34694': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:33,518 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:33,518 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34710': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:33,620 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34712': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:33,620 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:33,625 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:33,626 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34728': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:33,727 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34732': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:33,727 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:33,733 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:33,733 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34734': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:33,835 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:33,839 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34750': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:33,840 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:33,840 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34754': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:33,943 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:33,947 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34758': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:33,948 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:33,948 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34768': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:34,050 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:34,054 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34778': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:34,055 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34788': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:34,055 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:34,158 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:34,162 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34794': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:34,163 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34798': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:34,163 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:34,265 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:34,270 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34808': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:34,270 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34816': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:34,270 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:34,373 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:34,377 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34826': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:34,378 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34842': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:34,378 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:34,481 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:34,485 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34856': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:34,485 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:34,486 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34862': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:34,590 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:34,594 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34874': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:34,595 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34888': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:34,595 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:34,697 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34894': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:34,697 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:34,703 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:34,703 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34900': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:34,805 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:34,809 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34916': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:34,810 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:34,810 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34918': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:34,913 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:34,917 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34924': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:34,917 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:34,917 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34930': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:35,021 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:35,025 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34936': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:35,025 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34952': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:35,026 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:35,129 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:35,133 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34960': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:35,133 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34970': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:35,133 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:35,236 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:35,240 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:35,241 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34988': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:35,241 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:35,345 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:35,349 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35002': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:35,350 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35008': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:35,350 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:35,453 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:35,457 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35018': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:35,458 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:35,458 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35026': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:35,563 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:35,567 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35032': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:35,567 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35040': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:35,568 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:35,671 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:35,675 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35048': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:35,676 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35050': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:35,676 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:35,779 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:35,783 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35062': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:35,784 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:35,784 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35068': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:35,887 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:35,891 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35076': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:35,892 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35080': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:35,892 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:35,995 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:35,999 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35090': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:35,999 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35096': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:35,999 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:36,103 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:36,107 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35102': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:36,107 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35110': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:36,107 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:36,211 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:36,215 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:36,215 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35126': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:36,215 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:36,318 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:36,322 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35136': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:36,323 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35148': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:36,323 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:36,426 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:36,430 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35154': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:36,431 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35156': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:36,431 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:36,534 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:36,538 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35170': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:36,539 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35174': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:36,539 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:36,642 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:36,646 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35188': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:36,647 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35192': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:36,647 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:36,750 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:36,754 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35208': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:36,755 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35224': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:36,755 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:36,857 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:36,861 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35232': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:36,862 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35236': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:36,862 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:36,965 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:36,969 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35248': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:36,970 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35260': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:36,970 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:37,073 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:37,078 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35262': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:37,078 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35266': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:37,078 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:37,181 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:37,186 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35270': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:37,186 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:37,186 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35272': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:37,288 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:37,293 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35288': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:37,293 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35298': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:37,293 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:37,396 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:37,400 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35304': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:37,401 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35316': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:37,401 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:37,504 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:37,508 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35320': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:37,509 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35336': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:37,509 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:37,612 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:37,616 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35344': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:37,617 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35358': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:37,617 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:37,720 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:37,724 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35362': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:37,724 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35370': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:37,724 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:37,829 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:37,833 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35380': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:37,833 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:37,834 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35386': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:37,936 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:37,941 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35394': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:37,941 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:37,941 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35410': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:38,043 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:38,048 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35420': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:38,048 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35426': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:38,049 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:38,151 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:38,155 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35430': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:38,156 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35434': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:38,156 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:38,259 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:38,259 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35444': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:38,265 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:38,265 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35452': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:38,367 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:38,371 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35456': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:38,372 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:38,372 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35466': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:38,474 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:38,474 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35478': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:38,480 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:38,480 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35486': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:38,582 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:38,586 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35500': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:38,592 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:38,592 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35504': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:38,690 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:38,690 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35514': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:38,699 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:38,699 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35524': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:38,798 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:38,798 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35540': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:38,807 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:38,807 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35554': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:38,906 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:38,906 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35566': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:38,914 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:38,914 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35576': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:39,014 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:39,014 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35588': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:39,021 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:39,021 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35602': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:39,122 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:39,122 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35608': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:39,128 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:39,128 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35618': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:39,229 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:39,229 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35630': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:39,236 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:39,236 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35634': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:39,337 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:39,337 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35646': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:39,344 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:39,344 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35652': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:39,445 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:39,445 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35658': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:39,451 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:39,451 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35660': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:39,553 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:39,553 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35676': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:39,559 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:39,559 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35686': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:39,660 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:39,660 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35694': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:39,667 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:39,667 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35700': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:39,768 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:39,773 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35706': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:39,774 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:39,774 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35722': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:39,876 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:39,876 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35726': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:39,882 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:39,882 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35738': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:39,983 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:39,984 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35748': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:39,989 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:39,990 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35752': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:40,091 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:40,096 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35756': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:40,097 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:40,097 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35768': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:40,199 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:40,203 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35772': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:40,204 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35782': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:40,203 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:40,306 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:40,310 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35792': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:40,311 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35800': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:40,311 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:40,413 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:40,418 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35804': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:40,418 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35814': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:40,418 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:40,522 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:40,526 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35826': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:40,527 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35828': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:40,527 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:40,629 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35836': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:40,629 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:40,635 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:40,635 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35846': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:40,737 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:40,741 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35850': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:40,741 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:40,742 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35860': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:40,845 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:40,849 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35866': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:40,850 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:40,850 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35878': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:40,952 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:40,957 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35892': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:40,957 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35902': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:40,957 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:41,059 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:41,064 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35916': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:41,065 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35922': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:41,065 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:41,167 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:41,171 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35936': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:41,172 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35938': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:41,172 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:41,274 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:41,274 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35940': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:41,280 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:41,280 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35952': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:41,381 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:41,386 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35968': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:41,387 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:41,387 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35982': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:41,489 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:41,494 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35990': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:41,495 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36004': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:41,495 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:41,596 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:41,596 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52222': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:41,602 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:41,602 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52234': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:41,703 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:41,704 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52240': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:41,710 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:41,710 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52242': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:41,811 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:41,811 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52246': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:41,818 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:41,818 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52256': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:41,919 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:41,919 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52270': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:41,925 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52276': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:41,925 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:42,026 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:42,026 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52288': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:42,033 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:42,033 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52292': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:42,134 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:42,134 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52296': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:42,140 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52302': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:42,140 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:42,242 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:42,247 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52314': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:42,248 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:42,248 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52326': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:42,350 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:42,350 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52330': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:42,356 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:42,356 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52336': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:42,458 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:42,463 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52338': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:42,464 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:42,464 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52354': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:42,565 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:42,570 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52366': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:42,571 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52372': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:42,571 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:42,674 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:42,679 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52376': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:42,679 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:42,679 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52384': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:42,781 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52394': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:42,781 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:42,787 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52408': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:42,787 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:42,888 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:42,888 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52418': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:42,894 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52422': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:42,894 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:42,996 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:43,001 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52430': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:43,002 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52440': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:43,002 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:43,103 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:43,103 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52456': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:43,111 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:43,111 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52468': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:43,211 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:43,211 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52476': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:43,218 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:43,218 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52478': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:43,319 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:43,319 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52482': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:43,326 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:43,326 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52496': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:43,426 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:43,426 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52502': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:43,433 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:43,433 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52510': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:43,534 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:43,534 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52522': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:43,540 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:43,540 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52538': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:43,642 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:43,642 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52554': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:43,648 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:43,648 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52558': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:43,749 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:43,750 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52572': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:43,756 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:43,756 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52584': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:43,857 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:43,858 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52592': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:43,863 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52596': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:43,863 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:43,965 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:43,966 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52600': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:43,971 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:43,971 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52608': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:44,073 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:44,078 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52614': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:44,079 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:44,079 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52624': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:44,181 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:44,181 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52638': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:44,186 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:44,186 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52654': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:44,288 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:44,293 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52660': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:44,294 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52666': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:44,294 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:44,396 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:44,396 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52668': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:44,402 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:44,402 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52672': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:44,504 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:44,508 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52686': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:44,509 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:44,509 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52690': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:44,611 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:44,611 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52692': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:44,617 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:44,617 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52696': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:44,719 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:44,724 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52698': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:44,725 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:44,725 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52704': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:44,827 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52706': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:44,827 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:44,833 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:44,833 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52708': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:44,935 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52722': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:44,935 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:44,941 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:44,941 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52738': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:45,043 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:45,047 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52746': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:45,048 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52754': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:45,048 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:45,150 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:45,155 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52758': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:45,156 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52762': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:45,156 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:45,258 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:45,262 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52776': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:45,263 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52788': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:45,263 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:45,365 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52800': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:45,365 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:45,371 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:45,371 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52814': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:45,473 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:45,473 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52820': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:45,479 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52828': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:45,479 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:45,581 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:45,587 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52840': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:45,588 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:45,592 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52854': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:45,689 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:45,694 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52868': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:45,695 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52876': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:45,695 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:45,797 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:45,802 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52892': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:45,803 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:45,803 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52896': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:45,905 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:45,905 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52908': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:45,911 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:45,911 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52910': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:46,012 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:46,017 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52918': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:46,018 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:46,018 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52928': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:46,120 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:46,120 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52944': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:46,126 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:46,126 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52946': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:46,227 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:46,232 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52958': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:46,233 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:46,233 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52966': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:46,335 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:46,340 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52968': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:46,341 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:46,341 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52976': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:46,443 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52980': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:46,443 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:46,449 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:46,449 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52982': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:46,550 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:46,555 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52998': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:46,556 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:46,556 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53002': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:46,658 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53012': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:46,658 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:46,663 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:46,663 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53022': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:46,765 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:46,765 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53026': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:46,771 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:46,771 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53034': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:46,873 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:46,873 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53046': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:46,879 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:46,879 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53052': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:46,981 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:46,981 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:46,987 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:46,987 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53068': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:47,091 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:47,096 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53076': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:47,096 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53078': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:47,096 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:47,199 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:47,203 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53082': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:47,204 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53086': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:47,204 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:47,306 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:47,311 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53090': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:47,311 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:47,311 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53094': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:47,415 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:47,419 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53110': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:47,420 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53124': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:47,420 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:47,524 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:47,528 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53136': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:47,529 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53142': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:47,529 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:47,632 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:47,636 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53150': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:47,637 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53154': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:47,637 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:47,739 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53160': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:47,739 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:47,744 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53164': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:47,745 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:47,846 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53172': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:47,847 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:47,852 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53174': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:47,852 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:47,954 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53184': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:47,954 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:47,961 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53188': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:47,961 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:48,062 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53196': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:48,062 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:48,068 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53206': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:48,068 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:48,169 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53214': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:48,169 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:48,175 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53224': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:48,175 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:48,277 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:48,277 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53226': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:48,282 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53240': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:48,282 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:48,384 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:48,384 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53242': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:48,390 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53258': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:48,390 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:48,492 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53266': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:48,492 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:48,497 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53272': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:48,497 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3535s 2024-11-23 21:29:48,599 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53284': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3535s 2024-11-23 21:29:48,599 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:48,605 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53288': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:48,605 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:48,707 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53296': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:48,707 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:48,712 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53306': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:48,712 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:48,814 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53316': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:48,814 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:48,819 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53332': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:48,819 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:48,921 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53338': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:48,921 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:48,926 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53340': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:48,926 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:49,029 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:49,033 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53356': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:49,033 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53368': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:49,033 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:49,137 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:49,141 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53378': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:49,141 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53392': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:49,141 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:49,244 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:49,248 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53394': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:49,249 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53398': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:49,249 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:49,352 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:49,356 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53406': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:49,356 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53408': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:49,356 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:49,459 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:49,463 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53412': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:49,463 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53428': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:49,463 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:49,567 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:49,570 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53430': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:49,571 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53432': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:49,571 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:49,674 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:49,678 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53440': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:49,679 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53450': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:49,679 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:49,782 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:49,786 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53462': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:49,786 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53478': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:49,786 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:49,889 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:49,893 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53482': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:49,893 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53494': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:49,894 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:49,996 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:50,000 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53508': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:50,001 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53512': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:50,001 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:50,104 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:50,108 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53524': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:50,108 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53534': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:50,108 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:50,211 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:50,215 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53540': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:50,216 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53542': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:50,216 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:50,320 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:50,324 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53544': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:50,325 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53560': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:50,325 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:50,427 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53574': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:50,427 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:50,432 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53578': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:50,432 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:50,534 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53594': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:50,535 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:50,540 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53598': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:50,540 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:50,643 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:50,647 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53614': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:50,647 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53626': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:50,647 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:50,751 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:50,754 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53636': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:50,755 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53648': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:50,755 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:50,859 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:50,863 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53660': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:50,864 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53676': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:50,864 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:50,967 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:50,971 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53690': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:50,971 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53702': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:50,971 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:51,075 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:51,079 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53706': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:51,080 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53712': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:51,080 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:51,183 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:51,188 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53728': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:51,188 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53736': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:51,188 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:51,291 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:51,291 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53746': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:51,297 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:51,297 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53752': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:51,399 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:51,403 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53754': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:51,404 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:51,404 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53762': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:51,506 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:51,511 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53774': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:51,512 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:51,512 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53784': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:51,614 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:51,619 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34456': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:51,620 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:51,620 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34472': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:51,721 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:51,726 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34488': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:51,727 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34498': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:51,727 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:51,829 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:51,830 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34500': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:51,835 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:51,835 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34514': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:51,937 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:51,942 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34524': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:51,943 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34538': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:51,943 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:52,045 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:52,045 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34550': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:52,051 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:52,051 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34552': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:52,153 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:52,153 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34554': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:52,159 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34566': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:52,159 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:52,261 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:52,266 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34568': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:52,267 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:52,267 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34576': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:52,370 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:52,374 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34586': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:52,375 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34596': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:52,375 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:52,478 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:52,482 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34608': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:52,483 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:52,483 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34618': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:52,586 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:52,595 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34620': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:52,595 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34624': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:52,595 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:52,694 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:52,694 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34628': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:52,703 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:52,703 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34630': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:52,802 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:52,802 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34640': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:52,812 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:52,812 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34646': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:52,910 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34652': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:52,910 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:52,920 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:52,920 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34656': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:53,018 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:53,018 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34666': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:53,028 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:53,028 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34670': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:53,125 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:53,125 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34682': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:53,136 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:53,136 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34684': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:53,233 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:53,233 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34688': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:53,243 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:53,243 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34690': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:53,341 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:53,341 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34698': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:53,351 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:53,351 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34706': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:53,449 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:53,449 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34716': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:53,459 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:53,459 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34730': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:53,557 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34738': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:53,557 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:53,567 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:53,567 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34746': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:53,665 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34750': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:53,665 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:53,674 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:53,674 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34762': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:53,773 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34770': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:53,773 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:53,782 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34774': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:53,782 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:53,881 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34782': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:53,881 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:53,890 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34798': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:53,890 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:53,989 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34810': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:53,989 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:53,997 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:53,998 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34824': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:54,097 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34836': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:54,097 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:54,105 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:54,105 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34844': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:54,205 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34854': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:54,205 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:54,213 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34858': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:54,213 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:54,314 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:54,314 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34864': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:54,321 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:54,321 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34870': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:54,422 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:54,422 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34872': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:54,428 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34888': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:54,428 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:54,530 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:54,535 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34890': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:54,536 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:54,536 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34896': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:54,637 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:54,638 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34902': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:54,643 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:54,643 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34912': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:54,745 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:54,750 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34918': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:54,751 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:54,751 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34924': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:54,852 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34930': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:54,853 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:54,858 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34944': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:54,858 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:54,960 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:54,965 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34954': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:54,966 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:54,966 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34958': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:55,068 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34970': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:55,068 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:55,074 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:55,074 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:55,176 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:55,180 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34994': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:55,181 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:55,181 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34996': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:55,283 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:55,288 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35008': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:55,288 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:55,289 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35020': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:55,391 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:55,391 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35030': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:55,396 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:55,396 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35042': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:55,498 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:55,503 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35056': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:55,504 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35072': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:55,504 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:55,606 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:55,611 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35086': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:55,611 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35090': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:55,611 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:55,714 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:55,718 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35092': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:55,719 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35104': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:55,719 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:55,821 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:55,825 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35110': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:55,826 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:55,826 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:55,928 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:55,933 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35126': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:55,933 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:55,933 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35136': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:56,037 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:56,041 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35138': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:56,042 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35142': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:56,042 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:56,144 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:56,149 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35150': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:56,149 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:56,149 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35162': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:56,252 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:56,256 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35176': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:56,257 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35178': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:56,256 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:56,359 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:56,363 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35180': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:56,364 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35184': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:56,364 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:56,466 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:56,471 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35196': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:56,471 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:56,471 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35212': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:56,574 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:56,578 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35228': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:56,579 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:56,579 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35244': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:56,681 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:56,685 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35260': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:56,686 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35270': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:56,686 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:56,788 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:56,792 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35276': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:56,793 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35280': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:56,793 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:56,895 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:56,900 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35294': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:56,900 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:56,900 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35300': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:57,003 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:57,007 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35314': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:57,007 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:57,008 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35322': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:57,110 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:57,114 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35326': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:57,115 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35332': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:57,115 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:57,218 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:57,223 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35338': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:57,223 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35346': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:57,223 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:57,326 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:57,330 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35360': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:57,331 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:57,331 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35368': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:57,433 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:57,437 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35382': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:57,438 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:57,438 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35388': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:57,540 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:57,545 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35394': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:57,545 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35402': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:57,545 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:57,647 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:57,648 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35404': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:57,654 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:57,654 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35410': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:57,756 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:57,760 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35424': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:57,761 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:57,761 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35440': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:57,863 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:57,863 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35444': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:57,868 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:57,869 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35460': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:57,970 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:57,975 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35464': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:57,976 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:57,976 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35478': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:58,077 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:58,082 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35492': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:58,082 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:58,086 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35504': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:58,185 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:58,190 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35520': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:58,190 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35524': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:58,190 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:58,292 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:58,297 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35532': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:58,297 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:58,297 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35542': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:58,399 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:58,404 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35546': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:58,404 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:58,404 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35548': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:58,506 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:58,511 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35554': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:58,511 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35566': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:58,512 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:58,614 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:58,618 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35574': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:58,619 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:58,619 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35576': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:58,721 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:58,725 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35592': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:58,726 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35600': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:58,726 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:58,828 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:58,833 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35610': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:58,833 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:58,834 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35612': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:58,935 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:58,940 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35622': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:58,940 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35636': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:58,940 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:59,043 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35640': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:59,043 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:59,048 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35648': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:59,049 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:59,150 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:59,151 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35656': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:59,156 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35666': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:59,156 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:59,258 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:59,258 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35680': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:59,264 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35688': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:59,264 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:59,365 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:59,365 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35692': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:59,372 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:59,372 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35706': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:59,474 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:59,478 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35714': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:59,480 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35722': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:59,479 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:59,581 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:59,585 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35736': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:59,591 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35748': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:59,591 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:59,689 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:59,689 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35756': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:59,699 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:59,699 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35762': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:59,796 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:59,796 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35770': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:59,806 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:59,806 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35782': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:59,904 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:59,904 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35792': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:29:59,914 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:29:59,914 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35802': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:00,012 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:00,012 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35812': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:00,022 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:00,022 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35814': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:00,120 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:00,120 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35818': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:00,129 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:00,129 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35826': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:00,227 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:00,227 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35838': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:00,237 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:00,237 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35852': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:00,335 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:00,335 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35854': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:00,345 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:00,345 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35860': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:00,442 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:00,443 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35870': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:00,453 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:00,453 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35874': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:00,550 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:00,550 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35876': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:00,562 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:00,562 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35878': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:00,658 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:00,658 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35892': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:00,670 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:00,670 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35906': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:00,766 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:00,766 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35920': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:00,778 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:00,778 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35930': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:00,873 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35940': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:00,873 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:00,885 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:00,886 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35944': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:00,981 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:00,981 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35958': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:00,993 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:00,993 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35964': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:01,092 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:01,092 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35966': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:01,100 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:01,100 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35968': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:01,201 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:01,201 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:01,208 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:01,208 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35988': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:01,309 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:01,309 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36002': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:01,316 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:01,316 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36016': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:01,417 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:01,417 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36022': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:01,423 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:01,423 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36036': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:01,525 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:01,525 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36044': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:01,531 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:01,531 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:33668': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:01,632 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:33674': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:01,632 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:01,638 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:01,638 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:33680': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:01,740 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:01,745 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:33682': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:01,746 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:33692': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:01,746 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:01,848 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:01,848 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:33696': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:01,853 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:01,853 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:33710': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:01,955 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:01,955 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:33714': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:01,961 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:33720': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:01,961 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:02,064 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:02,068 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:33724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:02,069 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:33734': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:02,069 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:02,172 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:02,176 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:33736': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:02,177 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:33742': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:02,177 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:02,280 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:02,284 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:33746': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:02,284 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:02,285 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:33760': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:02,387 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:02,391 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:33770': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:02,392 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:33782': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:02,392 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:02,495 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:02,499 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:33784': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:02,500 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:33796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:02,500 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:02,603 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:02,607 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:33800': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:02,607 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:33812': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:02,608 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:02,710 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:02,714 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:33822': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:02,715 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:33824': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:02,715 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:02,818 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:02,822 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:33840': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:02,823 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:33848': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:02,823 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:02,926 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:02,931 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:33850': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:02,932 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:33858': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:02,931 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:03,034 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:03,038 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:33868': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:03,039 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:33870': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:03,039 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:03,142 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:03,146 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:33876': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:03,147 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:33880': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:03,147 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:03,250 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:03,254 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:33882': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:03,255 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:33894': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:03,255 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:03,358 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:03,362 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:33900': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:03,363 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:03,363 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:33908': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:03,465 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:03,469 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:33910': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:03,470 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:33916': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:03,470 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:03,573 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:03,577 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:33918': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:03,578 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:33934': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:03,578 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:03,681 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:03,685 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:33940': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:03,686 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:33942': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:03,686 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:03,789 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:03,793 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:33950': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:03,794 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:33964': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:03,794 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:03,897 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:03,901 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:33978': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:03,902 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:33992': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:03,902 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:04,004 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:04,008 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:33998': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:04,009 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34004': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:04,009 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:04,112 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:04,116 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34018': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:04,117 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34026': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:04,117 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:04,220 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:04,224 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34036': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:04,225 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34040': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:04,225 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:04,328 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:04,332 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34046': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:04,333 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:04,333 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:04,436 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:04,440 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34074': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:04,441 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34084': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:04,441 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:04,544 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:04,548 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34096': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:04,548 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34100': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:04,549 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:04,652 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:04,657 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34110': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:04,657 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:04,658 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34116': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:04,760 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:04,765 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34120': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:04,765 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34124': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:04,765 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:04,868 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:04,873 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34136': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:04,874 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34142': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:04,874 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:04,976 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:04,980 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34154': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:04,981 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:04,981 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34160': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:05,084 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:05,092 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34168': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:05,093 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34170': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:05,093 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:05,192 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:05,192 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34176': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:05,200 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:05,200 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34180': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:05,300 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:05,300 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34194': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:05,308 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:05,308 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34206': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:05,408 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:05,408 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34208': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:05,415 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:05,415 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34218': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:05,516 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:05,517 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34226': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:05,522 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:05,522 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34236': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:05,624 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:05,629 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34246': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:05,630 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:05,630 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34254': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:05,732 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:05,732 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34260': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:05,738 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:05,738 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34268': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:05,840 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:05,844 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34276': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:05,845 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:05,845 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34290': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:05,948 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:05,952 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34304': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:05,953 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:05,953 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34312': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:06,056 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:06,060 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34316': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:06,061 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34324': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:06,061 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:06,164 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:06,168 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34336': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:06,168 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34350': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:06,168 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:06,271 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:06,276 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34352': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:06,276 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34358': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:06,276 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:06,380 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:06,384 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34372': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:06,385 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:06,385 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34378': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:06,488 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:06,492 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34388': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:06,493 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:06,493 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34394': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:06,595 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:06,600 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34408': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:06,600 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:06,600 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34424': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:06,703 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:06,707 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34432': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:06,708 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34434': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:06,708 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:06,811 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:06,815 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34438': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:06,815 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:06,816 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34452': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:06,919 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:06,924 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34460': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:06,925 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34466': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:06,924 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:07,027 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:07,031 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34474': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:07,032 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:07,032 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34478': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:07,135 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:07,139 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34490': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:07,140 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34496': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:07,140 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:07,242 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:07,246 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34506': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:07,247 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34518': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:07,247 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:07,349 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:07,350 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34534': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:07,356 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:07,356 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34548': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:07,457 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:07,458 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34554': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:07,463 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:07,463 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34560': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:07,565 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:07,570 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34566': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:07,571 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:07,571 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34570': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:07,673 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:07,673 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34574': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:07,679 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:07,679 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34588': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:07,780 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:07,785 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34602': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:07,786 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:07,786 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34604': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:07,888 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:07,888 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34608': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:07,894 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:07,894 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34616': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:07,996 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:07,996 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34624': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:08,002 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:08,002 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34626': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:08,104 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:08,104 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34642': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:08,110 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:08,110 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34644': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:08,212 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:08,216 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34654': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:08,217 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:08,217 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34662': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:08,320 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34668': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:08,320 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:08,326 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:08,326 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34682': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:08,428 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34694': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:08,428 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:08,433 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:08,434 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34702': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:08,536 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:08,536 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34718': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:08,541 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:08,541 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34732': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:08,643 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:08,648 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34742': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:08,649 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:08,649 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34744': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:08,751 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:08,755 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34748': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:08,756 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34756': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:08,756 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:08,859 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:08,863 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34766': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:08,864 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34778': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:08,864 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:08,967 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:08,971 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34782': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:08,971 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:08,972 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:09,074 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:09,078 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34810': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:09,079 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34820': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:09,079 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:09,182 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:09,186 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34830': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:09,187 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34842': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:09,187 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:09,290 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:09,294 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34856': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:09,294 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34866': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:09,294 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:09,397 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:09,401 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34878': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:09,402 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34880': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:09,402 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:09,505 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:09,509 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34886': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:09,509 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34896': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:09,510 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:09,612 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:09,617 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34900': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:09,617 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:09,617 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34912': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:09,720 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:09,724 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34928': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:09,725 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34930': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:09,725 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:09,828 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:09,833 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34938': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:09,833 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:09,833 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34940': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:09,936 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:09,940 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34944': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:09,941 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34948': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:09,941 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:10,043 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:10,048 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34958': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:10,049 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34960': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:10,049 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:10,151 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:10,155 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34974': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:10,156 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34986': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:10,156 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:10,259 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:10,263 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:34992': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:10,264 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:10,264 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35006': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:10,367 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:10,371 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35018': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:10,371 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35026': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:10,371 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:10,474 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:10,478 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35030': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:10,479 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35046': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:10,479 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:10,581 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:10,591 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35050': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:10,592 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35052': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:10,592 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:10,689 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35054': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:10,689 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:10,699 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35062': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:10,699 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:10,797 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:10,797 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35074': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:10,807 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:10,807 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35090': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:10,905 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35098': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:10,905 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:10,915 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35100': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:10,915 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:11,012 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:11,013 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35112': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:11,022 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:11,022 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35126': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:11,120 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:11,120 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35142': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:11,130 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:11,130 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35152': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:11,228 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:11,228 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35166': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:11,237 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:11,237 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35180': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:11,335 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:11,335 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35186': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:11,345 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:11,345 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35192': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:11,443 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:11,443 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35208': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:11,452 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:11,452 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35214': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:11,552 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:11,552 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:51638': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:11,559 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:11,560 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:51652': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:11,659 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:51656': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:11,659 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:11,667 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:11,667 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:51666': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:11,768 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:11,769 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:51682': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:11,775 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:11,775 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:51698': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:11,876 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:11,877 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:51708': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:11,883 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:11,883 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:51714': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:11,984 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:11,984 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:51730': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:11,990 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:11,990 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:51740': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:12,091 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:12,092 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:51754': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:12,098 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:12,098 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:51764': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:12,199 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:12,199 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:51778': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:12,207 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:12,207 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:51794': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:12,307 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:12,307 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:51800': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:12,314 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:12,314 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:51810': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:12,415 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:12,415 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:51816': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:12,422 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:12,422 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:51826': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:12,523 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:12,523 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:51834': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:12,529 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:12,529 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:51840': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:12,630 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:12,631 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:51856': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:12,637 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:12,637 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:51858': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:12,738 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:12,738 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:51860': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:12,745 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:12,745 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:51862': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:12,846 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:12,847 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:51868': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:12,852 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:12,852 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:51884': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:12,954 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:12,954 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:51892': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:12,960 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:12,960 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:51898': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:13,061 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:13,061 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:51906': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:13,068 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:13,068 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:51912': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:13,169 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:13,169 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:51928': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:13,175 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:13,175 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:51930': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:13,277 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:13,282 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:51932': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:13,283 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:51944': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:13,283 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:13,385 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:13,389 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:51958': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:13,390 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:13,390 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:51972': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:13,492 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:13,497 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:51984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:13,497 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:51998': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:13,498 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:13,600 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:13,604 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52006': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:13,605 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:13,605 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52020': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:13,707 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:13,712 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52028': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:13,712 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52034': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:13,712 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:13,815 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:13,819 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52038': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:13,820 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52048': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:13,820 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:13,922 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:13,927 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:13,927 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52074': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:13,927 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:14,030 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:14,034 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52086': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:14,035 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52092': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:14,035 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:14,137 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:14,142 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52108': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:14,142 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52118': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:14,142 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:14,245 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:14,249 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52126': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:14,250 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52128': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:14,250 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:14,353 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:14,357 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52142': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:14,358 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52158': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:14,358 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:14,460 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:14,465 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52174': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:14,465 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52176': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:14,465 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:14,568 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:14,572 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52182': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:14,573 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52190': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:14,573 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:14,676 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:14,680 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52196': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:14,681 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:14,681 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52202': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:14,784 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:14,788 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52206': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:14,789 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52212': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:14,789 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:14,891 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:14,896 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52228': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:14,896 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52230': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:14,896 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:15,000 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:15,004 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52242': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:15,005 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52248': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:15,005 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:15,108 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:15,112 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52254': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:15,112 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52256': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:15,112 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:15,216 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:15,220 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52270': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:15,221 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52276': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:15,221 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:15,323 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:15,327 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52286': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:15,328 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52296': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:15,328 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:15,431 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:15,435 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52302': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:15,436 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:15,436 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52312': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:15,538 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:15,543 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52326': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:15,543 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52338': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:15,543 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:15,646 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:15,650 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52352': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:15,651 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52358': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:15,651 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:15,753 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:15,758 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52362': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:15,758 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52378': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:15,758 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:15,861 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:15,865 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52386': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:15,867 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52388': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:15,866 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:15,969 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52402': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:15,969 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:15,975 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:15,975 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52410': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:16,077 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52412': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:16,077 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:16,083 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:16,086 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52422': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:16,185 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:16,189 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52426': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:16,190 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52428': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:16,190 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:16,293 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:16,297 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52436': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:16,298 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52442': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:16,298 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:16,401 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:16,405 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52444': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:16,405 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52458': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:16,406 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:16,508 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:16,513 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52464': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:16,514 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52472': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:16,514 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:16,617 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:16,622 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52476': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:16,622 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52484': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:16,622 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:16,726 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:16,730 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52486': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:16,731 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52492': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:16,731 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:16,834 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:16,838 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52506': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:16,839 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52508': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:16,839 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:16,942 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:16,946 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52510': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:16,947 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52518': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:16,947 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:17,050 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:17,054 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52534': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:17,055 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:17,055 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52548': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:17,157 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:17,162 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52558': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:17,163 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52568': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:17,163 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:17,265 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:17,265 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52582': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:17,270 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:17,271 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52598': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:17,372 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:17,377 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52612': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:17,378 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:17,378 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52618': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:17,480 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52632': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:17,480 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:17,487 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:17,487 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52636': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:17,591 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:17,596 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52648': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:17,596 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52660': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:17,596 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:17,699 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:17,703 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52662': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:17,704 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52664': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:17,704 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:17,807 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:17,811 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52676': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:17,812 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52688': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:17,812 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:17,914 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:17,918 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52696': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:17,919 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52698': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:17,919 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:18,022 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:18,026 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52704': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:18,027 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52706': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:18,027 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:18,129 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:18,133 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52708': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:18,134 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52710': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:18,134 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:18,237 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:18,241 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52722': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:18,242 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52736': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:18,242 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:18,344 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:18,349 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52752': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:18,349 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52756': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:18,349 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:18,453 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:18,457 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52764': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:18,458 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52780': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:18,458 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:18,561 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:18,565 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52782': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:18,565 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:18,565 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:18,668 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:18,672 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52802': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:18,673 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52808': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:18,673 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:18,776 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:18,780 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52818': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:18,781 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52830': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:18,781 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:18,884 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:18,888 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52836': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:18,889 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52848': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:18,889 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:18,991 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52864': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:18,991 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:18,997 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:18,997 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52870': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:19,099 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:19,099 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52882': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:19,105 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:19,105 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52884': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:19,207 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:19,212 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52888': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:19,213 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:19,213 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52890': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:19,315 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52900': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:19,315 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:19,320 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:19,320 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52904': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:19,423 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52916': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:19,423 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:19,428 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:19,428 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52922': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:19,530 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:19,531 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52936': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:19,536 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:19,536 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52946': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:19,638 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:19,643 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52952': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:19,644 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:19,644 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52960': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:19,746 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52966': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:19,746 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:19,751 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:19,751 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52982': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:19,853 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:19,853 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52988': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:19,859 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:19,859 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52990': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:19,961 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:19,961 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53000': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:19,967 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:19,967 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53002': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:20,069 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:20,074 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53012': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:20,075 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:20,075 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53014': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:20,177 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:20,182 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53026': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:20,182 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:20,182 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53032': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:20,285 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:20,289 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53042': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:20,290 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53050': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:20,290 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:20,393 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:20,397 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53056': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:20,397 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:20,398 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:20,500 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:20,505 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53062': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:20,505 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53068': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:20,505 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:20,608 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:20,612 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53076': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:20,613 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53080': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:20,613 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:20,716 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:20,720 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53086': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:20,721 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53100': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:20,721 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:20,823 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:20,828 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53116': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:20,828 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53120': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:20,828 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:20,931 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:20,935 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53132': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:20,936 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53134': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:20,936 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:21,038 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:21,042 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53146': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:21,043 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53152': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:21,043 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:21,146 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:21,150 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53164': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:21,151 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:21,151 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53176': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:21,253 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:21,258 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53178': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:21,258 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:21,258 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53186': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:21,361 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:21,365 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53192': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:21,366 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53204': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:21,366 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:21,470 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:21,474 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53212': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:21,475 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53216': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:21,475 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:21,578 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:21,582 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35416': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:21,583 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:21,587 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35426': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:21,685 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:21,690 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35438': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:21,691 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:21,691 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35440': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:21,793 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:21,797 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35444': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:21,798 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:21,798 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35458': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:21,902 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:21,906 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35470': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:21,907 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35484': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:21,907 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:22,010 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:22,014 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35496': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:22,015 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35502': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:22,015 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:22,118 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:22,122 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35508': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:22,123 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35510': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:22,123 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:22,225 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:22,229 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35522': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:22,230 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35536': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:22,230 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:22,333 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:22,338 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35550': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:22,338 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35554': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:22,338 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:22,441 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:22,445 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35560': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:22,446 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35564': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:22,446 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:22,548 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:22,553 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35576': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:22,553 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:22,553 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35578': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:22,656 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:22,660 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35582': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:22,661 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35584': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:22,661 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:22,764 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:22,768 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35588': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:22,769 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35594': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:22,769 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:22,872 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:22,876 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35606': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:22,876 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35620': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:22,876 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:22,980 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:22,984 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35630': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:22,984 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35634': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:22,984 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:23,090 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:23,094 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35638': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:23,094 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35650': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:23,095 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:23,197 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:23,201 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35662': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:23,202 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35664': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:23,202 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:23,305 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:23,309 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35674': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:23,309 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35690': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:23,309 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:23,412 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:23,416 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35698': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:23,417 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35700': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:23,417 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:23,520 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:23,524 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35704': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:23,524 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35718': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:23,524 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:23,628 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:23,632 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35722': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:23,633 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35728': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:23,633 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:23,736 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:23,740 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35730': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:23,740 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35732': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:23,740 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:23,843 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:23,847 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35734': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:23,848 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35738': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:23,848 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:23,950 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:23,954 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35752': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:23,955 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35754': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:23,955 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:24,058 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:24,062 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35758': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:24,063 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35766': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:24,063 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:24,165 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:24,169 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35776': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:24,170 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35790': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:24,170 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:24,273 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:24,277 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:24,278 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35808': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:24,278 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:24,380 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:24,384 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35812': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:24,385 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35826': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:24,385 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:24,488 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:24,492 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35840': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:24,492 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35850': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:24,492 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:24,595 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:24,599 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35862': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:24,600 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35870': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:24,600 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:24,703 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:24,706 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35884': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:24,707 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35898': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:24,707 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:24,810 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:24,814 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35900': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:24,814 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35914': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:24,815 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:24,918 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:24,921 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35924': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:24,922 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35930': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:24,922 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:25,025 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:25,029 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35940': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:25,029 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35950': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:25,029 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:25,132 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:25,136 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35962': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:25,137 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35964': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:25,137 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:25,240 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:25,244 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35966': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:25,244 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35970': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:25,244 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:25,348 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:25,352 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35976': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:25,353 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35978': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:25,353 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:25,456 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:25,460 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35990': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:25,460 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35992': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:25,460 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:25,563 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:25,568 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36000': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:25,569 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36010': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:25,569 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:25,671 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:25,676 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36018': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:25,677 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:25,677 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36030': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:25,779 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36032': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:25,779 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:25,785 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:25,785 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36042': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:25,887 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36046': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:25,887 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:25,893 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:25,893 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36062': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:25,994 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:25,999 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36074': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:26,000 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:26,000 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36086': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:26,102 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36096': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:26,102 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:26,108 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:26,108 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36110': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:26,210 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:26,215 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:26,215 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36124': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:26,215 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:26,319 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:26,323 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36126': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:26,324 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36128': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:26,324 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:26,427 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:26,431 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36140': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:26,432 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36154': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:26,432 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:26,535 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:26,539 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36162': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:26,540 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36172': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:26,540 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:26,642 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:26,646 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36174': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:26,647 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36180': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:26,647 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:26,750 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:26,751 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36188': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:26,756 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:26,756 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36192': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:26,858 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:26,863 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36202': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:26,864 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:26,864 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36210': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:26,966 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36224': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:26,966 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:26,971 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36238': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:26,971 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:27,074 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:27,078 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36250': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:27,079 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:27,079 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36260': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:27,182 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:27,187 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36270': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:27,187 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36280': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:27,187 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:27,290 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:27,294 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36282': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:27,295 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36298': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:27,295 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:27,397 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:27,402 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36304': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:27,402 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36310': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:27,402 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:27,505 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:27,509 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36324': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:27,510 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36332': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:27,510 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:27,613 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:27,617 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36342': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:27,618 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36344': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:27,618 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:27,721 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:27,725 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36360': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:27,725 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36374': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:27,725 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:27,829 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:27,833 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36388': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:27,834 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:27,834 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36390': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:27,937 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:27,941 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36400': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:27,942 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36412': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:27,942 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:28,045 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:28,049 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36426': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:28,050 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36436': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:28,050 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:28,153 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:28,157 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36450': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:28,158 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36458': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:28,158 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:28,260 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:28,265 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36472': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:28,266 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36486': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:28,266 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:28,368 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:28,372 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36502': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:28,373 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36512': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:28,373 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:28,476 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:28,480 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36520': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:28,481 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36524': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:28,481 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:28,584 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:28,592 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36536': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:28,593 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36552': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:28,593 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:28,692 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36560': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:28,692 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:28,701 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:28,701 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36564': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:28,801 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:28,801 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36574': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:28,808 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:28,808 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36580': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:28,909 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:28,909 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36596': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:28,916 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36612': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:28,916 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:29,017 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:29,017 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36628': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:29,024 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:29,024 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36634': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:29,125 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:29,130 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36640': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:29,131 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36652': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:29,131 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:29,233 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:29,234 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36666': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:29,240 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:29,240 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36682': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:29,341 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:29,346 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36694': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:29,347 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36704': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:29,347 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:29,449 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:29,449 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36706': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:29,455 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:29,455 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36708': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:29,557 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:29,557 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36714': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:29,563 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:29,563 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36728': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:29,664 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:29,665 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36738': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:29,671 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36742': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:29,671 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:29,772 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:29,772 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36744': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:29,779 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:29,779 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36748': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:29,880 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:29,881 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36764': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:29,887 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:29,887 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36770': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:29,988 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:29,988 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36774': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:29,995 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:29,995 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36790': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:30,096 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:30,097 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36798': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:30,103 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:30,103 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36806': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:30,205 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:30,205 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36820': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:30,210 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:30,211 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36824': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:30,312 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:30,317 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36828': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:30,318 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:30,318 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36834': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:30,420 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:30,420 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36844': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:30,426 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:30,427 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36848': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:30,528 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:30,533 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36854': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:30,534 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36856': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:30,534 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:30,636 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:30,640 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36866': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:30,641 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36874': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:30,641 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:30,743 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:30,747 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36888': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:30,748 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36894': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:30,748 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:30,851 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:30,854 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36910': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:30,855 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36926': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:30,855 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:30,958 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:30,962 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36936': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:30,963 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36938': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:30,963 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:31,066 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:31,069 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36944': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:31,070 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36948': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:31,070 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:31,175 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:31,179 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36962': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:31,179 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36972': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:31,180 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:31,283 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:31,287 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36974': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:31,287 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36986': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:31,287 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:31,390 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:31,394 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37000': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:31,394 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37008': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:31,394 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:31,497 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:31,501 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37020': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:31,502 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37028': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:31,502 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:31,605 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38294': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:31,605 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:31,611 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38302': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:31,611 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:31,713 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:31,713 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38318': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:31,718 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:31,718 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38320': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:31,820 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38334': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:31,820 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:31,826 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38336': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:31,826 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:31,928 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:31,932 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38350': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:31,933 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38356': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:31,933 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:32,036 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:32,040 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38364': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:32,040 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38380': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:32,040 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:32,143 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:32,147 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38386': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:32,148 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38390': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:32,148 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:32,252 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:32,256 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38394': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:32,256 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38398': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:32,257 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:32,359 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:32,363 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38410': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:32,364 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38424': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:32,364 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:32,467 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:32,471 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38430': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:32,471 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38446': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:32,472 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:32,574 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:32,578 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38454': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:32,579 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38458': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:32,579 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:32,682 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:32,686 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38464': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:32,687 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38472': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:32,687 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:32,789 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:32,793 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38482': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:32,794 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38486': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:32,794 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:32,896 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:32,900 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38500': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:32,901 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38512': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:32,901 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:33,004 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:33,007 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38526': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:33,008 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38542': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:33,008 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:33,111 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:33,115 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38548': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:33,116 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38556': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:33,116 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:33,219 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:33,223 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38572': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:33,223 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38578': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:33,224 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:33,327 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:33,330 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38594': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:33,331 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38604': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:33,331 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:33,434 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:33,438 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38614': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:33,439 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38618': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:33,439 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:33,541 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:33,545 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38630': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:33,546 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38644': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:33,546 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:33,649 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:33,653 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38660': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:33,654 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38670': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:33,654 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:33,756 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:33,760 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38686': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:33,761 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38688': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:33,761 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:33,864 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38694': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:33,864 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:33,869 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38698': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:33,869 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:33,972 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:33,976 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38708': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:33,977 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38722': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:33,977 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:34,079 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:34,084 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38728': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:34,085 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:34,088 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38740': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:34,187 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:34,191 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38744': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:34,192 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38758': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:34,192 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:34,294 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38774': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:34,294 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:34,300 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38780': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:34,300 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:34,402 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38792': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:34,402 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:34,407 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:34,407 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:34,509 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:34,509 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38806': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:34,515 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:34,515 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38816': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:34,617 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:34,617 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38830': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:34,623 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38842': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:34,623 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:34,724 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38846': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:34,724 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:34,730 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38848': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:34,730 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:34,832 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38858': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:34,832 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:34,837 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38874': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:34,838 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:34,939 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:34,939 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38884': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:34,945 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38888': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:34,945 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:35,047 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:35,047 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38902': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:35,052 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38908': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:35,052 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:35,154 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38920': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:35,154 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:35,160 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38934': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:35,160 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:35,262 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:35,262 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38946': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:35,267 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38954': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:35,267 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:35,369 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:35,369 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38956': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:35,375 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38970': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:35,375 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:35,477 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:35,477 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38976': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:35,483 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38988': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:35,483 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:35,584 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:35,589 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39002': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:35,594 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39006': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:35,594 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:35,693 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39020': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:35,693 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:35,702 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39036': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:35,702 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:35,800 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39040': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:35,800 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:35,809 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39044': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:35,809 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:35,908 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39052': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:35,908 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:35,917 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39068': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:35,917 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:36,025 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39070': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:36,025 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:36,090 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39072': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:36,090 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:36,132 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39074': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:36,132 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:36,197 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39082': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:36,197 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:36,240 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39096': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:36,240 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:36,305 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39100': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:36,305 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:36,348 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39112': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:36,348 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:36,413 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39118': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:36,413 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:36,520 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39120': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:36,520 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:36,531 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39136': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:36,531 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:36,627 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39148': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:36,627 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:36,638 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39162': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:36,639 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:36,735 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39176': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:36,735 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:36,746 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39178': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:36,746 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:36,842 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:36,842 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39184': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:36,854 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39188': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:36,854 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:36,950 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39204': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:36,950 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:36,962 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39206': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:36,962 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:37,057 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39220': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:37,057 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:37,069 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39232': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:37,069 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:37,165 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39248': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:37,165 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:37,177 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39250': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:37,177 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:37,272 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:37,272 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39256': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:37,285 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39258': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:37,285 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:37,380 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39270': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:37,380 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:37,392 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39286': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:37,392 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:37,488 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39296': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:37,488 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:37,500 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39308': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:37,500 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:37,595 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39318': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:37,595 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:37,608 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39332': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:37,608 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:37,703 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39340': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:37,703 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:37,715 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39350': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:37,715 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:37,810 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39356': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:37,810 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:37,823 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39360': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:37,823 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:37,919 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39372': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:37,919 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:37,931 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39376': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:37,931 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:38,027 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39386': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:38,027 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:38,039 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39388': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:38,039 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:38,134 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39404': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:38,134 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:38,147 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39414': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:38,147 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:38,242 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39430': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:38,242 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:38,255 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39438': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:38,255 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:38,350 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39452': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:38,350 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:38,362 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39468': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:38,362 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:38,457 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39474': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:38,457 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:38,470 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39482': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:38,470 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:38,565 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39498': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:38,565 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:38,578 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39514': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:38,578 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:38,673 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39530': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:38,673 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:38,685 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39534': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:38,685 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:38,781 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39548': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:38,781 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:38,793 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39564': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:38,793 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:38,888 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39572': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:38,888 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:38,901 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39588': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:38,901 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:38,996 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39600': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:38,996 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:39,009 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39610': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:39,009 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:39,104 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39618': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:39,104 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:39,116 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39628': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:39,116 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:39,212 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39638': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:39,212 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:39,224 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39646': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:39,224 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:39,320 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39652': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:39,320 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:39,332 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39656': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:39,332 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:39,427 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39658': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:39,427 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:39,439 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39660': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:39,439 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:39,534 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39676': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:39,535 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:39,547 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39690': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:39,547 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:39,643 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39698': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:39,643 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:39,654 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39706': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:39,654 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:39,751 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39722': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:39,751 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:39,762 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39730': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:39,762 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:39,858 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39734': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:39,858 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:39,869 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39740': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:39,869 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:39,966 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39746': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:39,966 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:39,977 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39762': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:39,978 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:40,073 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39776': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:40,073 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:40,086 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:40,089 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39792': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:40,181 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:40,181 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39800': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:40,194 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39814': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:40,194 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:40,288 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:40,288 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39828': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:40,301 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39838': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:40,301 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:40,395 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39846': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:40,395 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:40,409 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39850': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:40,409 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:40,503 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:40,503 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39862': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:40,516 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39878': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:40,516 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:40,657 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:40,660 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39888': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:40,661 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39896': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:40,661 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:40,765 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:40,768 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39900': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:40,769 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39916': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:40,769 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:40,872 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:40,876 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39930': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:40,877 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39938': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:40,877 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:40,980 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:40,984 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39954': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:40,985 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39966': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:40,985 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:41,091 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:41,095 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39968': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:41,095 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39980': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:41,095 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:41,198 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:41,202 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39988': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:41,203 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:40004': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:41,203 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:41,306 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:41,310 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:40012': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:41,311 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:40016': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:41,311 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:41,413 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:41,413 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:40032': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:41,418 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:40044': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:41,419 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:41,521 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:40058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:41,521 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:41,526 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:40068': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:41,526 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:41,628 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:55896': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:41,628 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:41,634 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:55908': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:41,634 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:41,736 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:41,736 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:55916': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:41,741 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:55930': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:41,742 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:41,843 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:41,843 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:55946': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:41,849 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:55954': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:41,849 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:41,950 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:41,951 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:55968': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:41,956 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:55982': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:41,956 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:42,058 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:42,058 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:55992': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:42,064 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56000': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:42,064 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:42,165 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56008': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:42,166 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:42,171 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56016': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:42,171 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:42,273 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:42,273 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56024': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:42,278 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56040': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:42,279 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:42,380 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:42,380 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56050': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:42,386 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56054': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:42,386 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:42,488 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:42,488 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56068': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:42,494 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56084': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:42,494 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:42,595 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:42,595 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56088': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:42,601 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56094': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:42,601 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:42,703 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:42,707 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56098': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:42,708 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56102': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:42,708 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:42,811 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:42,815 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56112': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:42,816 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56120': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:42,816 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:42,918 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:42,922 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56128': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:42,923 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56134': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:42,923 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:43,025 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56138': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:43,025 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:43,031 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56154': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:43,031 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:43,133 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56164': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:43,133 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:43,138 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56178': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:43,138 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:43,240 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56192': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:43,241 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:43,246 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56200': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:43,246 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:43,348 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:43,348 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56212': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:43,354 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56216': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:43,354 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:43,456 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56226': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:43,456 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:43,461 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56228': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:43,461 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:43,563 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:43,563 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56240': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:43,568 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56242': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:43,569 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:43,670 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56248': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:43,670 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:43,676 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56250': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:43,676 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:43,778 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56256': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:43,778 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:43,783 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56258': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:43,783 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:43,885 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56262': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:43,886 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:43,891 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56278': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:43,891 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:43,994 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:43,998 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56290': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:43,999 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56296': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:43,999 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:44,101 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:44,105 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56300': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:44,106 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56308': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:44,106 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:44,209 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:44,212 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56312': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:44,214 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56322': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:44,214 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:44,316 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:44,320 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56334': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:44,321 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56350': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:44,322 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:44,424 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56360': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:44,424 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:44,430 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56368': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:44,430 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:44,532 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:44,532 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56372': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:44,538 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56380': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:44,538 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:44,640 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56382': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:44,640 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:44,645 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56392': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:44,645 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:44,747 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:44,747 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56406': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:44,753 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56420': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:44,753 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:44,855 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56422': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:44,855 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:44,860 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56436': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:44,860 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:44,962 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56442': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:44,962 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:44,967 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56448': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:44,968 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:45,069 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56458': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:45,069 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:45,075 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56474': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:45,075 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:45,177 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56484': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:45,177 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:45,182 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56488': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:45,182 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:45,284 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:45,284 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56496': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:45,290 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56498': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:45,290 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:45,391 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:45,392 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56510': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:45,397 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56520': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:45,397 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:45,499 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56524': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:45,499 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:45,504 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56532': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:45,504 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:45,606 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:45,606 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56546': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:45,612 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56550': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:45,612 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:45,714 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:45,714 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56554': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:45,720 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56556': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:45,720 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:45,821 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:45,822 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56566': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:45,827 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56578': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:45,827 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:45,929 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:45,929 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56590': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:45,935 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56596': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:45,935 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:46,036 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56598': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:46,036 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:46,042 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56600': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:46,042 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:46,145 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:46,149 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56602': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:46,149 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56604': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:46,149 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:46,252 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:46,256 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56616': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:46,257 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56632': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:46,257 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:46,360 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:46,364 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56634': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:46,364 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56636': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:46,364 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:46,467 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:46,471 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56640': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:46,472 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56656': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:46,472 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:46,575 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:46,579 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56668': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:46,580 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56670': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:46,580 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:46,682 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:46,686 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56680': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:46,687 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56690': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:46,687 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:46,790 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:46,794 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56694': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:46,795 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56704': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:46,795 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:46,897 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56720': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:46,897 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:46,903 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:46,903 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:47,004 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56734': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:47,004 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:47,010 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56748': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:47,010 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:47,112 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:47,112 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56752': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:47,117 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56758': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:47,117 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:47,219 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:47,219 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56774': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:47,225 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56776': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:47,225 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:47,326 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56784': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:47,326 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:47,332 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56798': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:47,332 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:47,434 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:47,434 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56802': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:47,440 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56806': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:47,440 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:47,541 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:47,542 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56814': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:47,547 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:47,548 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56822': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:47,649 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:47,649 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56832': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:47,655 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56842': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:47,655 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:47,756 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:47,757 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56846': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:47,762 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56856': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:47,762 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:47,865 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:47,869 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56864': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:47,869 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56874': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:47,869 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:47,972 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:47,976 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56882': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:47,977 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56884': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:47,977 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:48,079 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:48,083 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56896': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:48,084 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:48,087 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56900': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:48,187 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:48,191 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56904': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:48,191 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56910': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:48,191 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:48,295 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:48,298 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56920': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:48,298 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56930': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:48,299 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:48,403 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:48,407 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56938': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:48,407 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56952': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:48,408 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:48,510 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:48,514 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56964': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:48,515 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56980': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:48,515 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:48,618 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:48,622 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56992': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:48,622 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56998': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:48,622 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:48,725 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:48,729 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57000': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:48,730 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57010': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:48,731 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:48,833 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57024': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:48,833 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:48,838 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57034': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:48,838 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:48,940 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57038': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:48,940 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:48,946 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57042': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:48,946 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:49,048 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:49,052 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57052': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:49,053 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57054': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:49,053 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:49,155 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:49,159 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:49,160 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:49,160 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57062': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:49,263 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:49,267 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57064': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:49,267 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57080': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:49,267 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:49,370 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:49,374 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57084': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:49,375 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57090': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:49,375 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:49,478 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:49,482 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57106': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:49,482 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57116': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:49,483 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:49,591 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:49,595 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57126': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:49,596 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57136': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:49,596 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:49,698 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:49,702 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57140': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:49,703 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57144': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:49,703 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:49,806 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:49,810 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57158': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:49,810 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57162': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:49,811 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:49,913 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:49,917 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57168': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:49,918 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57182': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:49,918 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:50,021 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:50,025 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57190': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:50,025 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57192': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:50,026 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:50,128 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:50,132 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57202': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:50,133 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57208': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:50,133 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:50,236 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:50,239 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57224': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:50,240 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57238': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:50,240 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:50,343 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:50,347 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57246': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:50,347 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57254': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:50,347 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:50,450 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:50,454 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57264': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:50,455 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57268': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:50,455 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:50,558 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:50,561 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57276': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:50,562 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57282': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:50,562 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:50,665 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:50,669 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57290': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:50,669 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57304': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:50,670 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:50,773 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:50,777 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57308': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:50,777 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57322': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:50,778 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:50,880 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:50,884 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57324': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:50,885 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57338': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:50,885 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:50,988 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:50,992 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57346': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:50,992 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57358': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:50,993 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:51,095 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:51,099 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57374': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:51,100 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57378': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:51,100 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:51,203 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:51,207 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57382': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:51,208 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57386': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:51,208 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:51,311 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:51,315 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57390': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:51,316 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:51,316 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57398': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:51,419 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:51,423 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57414': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:51,423 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57418': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:51,423 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:51,526 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:51,530 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57432': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:51,530 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42770': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:51,530 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:51,633 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:51,637 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42774': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:51,637 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42790': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:51,637 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:51,740 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:51,744 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42798': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:51,744 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42800': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:51,744 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:51,847 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:51,851 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42802': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:51,851 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42818': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:51,852 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:51,954 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:51,958 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42832': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:51,959 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42836': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:51,959 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:52,061 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:52,065 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42848': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:52,066 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42852': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:52,066 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:52,169 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:52,173 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42868': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:52,173 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42876': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:52,173 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:52,276 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:52,280 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42882': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:52,281 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42886': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:52,280 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:52,383 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:52,387 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42898': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:52,388 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42906': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:52,388 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:52,490 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:52,494 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42908': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:52,495 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42914': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:52,495 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:52,597 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:52,601 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42926': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:52,602 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42936': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:52,602 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:52,704 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:52,708 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42942': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:52,709 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42952': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:52,709 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:52,813 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:52,817 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42966': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:52,817 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42972': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:52,818 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:52,921 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:52,926 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42976': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:52,927 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:52,927 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:53,029 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:53,033 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43000': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:53,033 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43010': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:53,034 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:53,136 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:53,140 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43020': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:53,140 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43022': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:53,140 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:53,243 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:53,243 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43030': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:53,249 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:53,249 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43042': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:53,351 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:53,355 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43046': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:53,355 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43062': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:53,355 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:53,458 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:53,462 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43068': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:53,462 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43072': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:53,462 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:53,565 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:53,569 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43080': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:53,569 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43090': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:53,570 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:53,672 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:53,676 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43106': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:53,677 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43116': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:53,677 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:53,779 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:53,783 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43118': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:53,784 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43124': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:53,784 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:53,887 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:53,891 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43138': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:53,891 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43146': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:53,891 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:53,994 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:53,997 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43152': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:53,998 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43164': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:53,998 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:54,101 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:54,105 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43180': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:54,105 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43184': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:54,106 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:54,208 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:54,212 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43190': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:54,212 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43196': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:54,213 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:54,315 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:54,319 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43208': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:54,319 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43224': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:54,319 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:54,422 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:54,426 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43240': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:54,427 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43242': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:54,427 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:54,529 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:54,533 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43256': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:54,534 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43268': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:54,534 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:54,636 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:54,640 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43278': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:54,641 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43290': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:54,641 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:54,744 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:54,748 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43296': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:54,749 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43302': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:54,749 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:54,851 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:54,855 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43304': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:54,856 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43320': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:54,856 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:54,959 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:54,963 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43330': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:54,964 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43344': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:54,964 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:55,066 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:55,070 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43352': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:55,071 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43366': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:55,071 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:55,173 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:55,177 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43370': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:55,178 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43374': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:55,178 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:55,280 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:55,284 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43384': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:55,285 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:55,285 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43400': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:55,387 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:55,391 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43406': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:55,392 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43412': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:55,392 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:55,494 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:55,499 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43428': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:55,499 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43444': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:55,499 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:55,602 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:55,606 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43450': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:55,607 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43454': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:55,607 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:55,709 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:55,713 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43456': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:55,714 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:55,714 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43460': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:55,817 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:55,821 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43472': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:55,821 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43476': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:55,821 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:55,924 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:55,928 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43492': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:55,929 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43500': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:55,929 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:56,031 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:56,035 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43516': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:56,036 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43532': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:56,036 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:56,139 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:56,143 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43542': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:56,143 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43554': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:56,143 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:56,246 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:56,250 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43560': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:56,250 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43574': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:56,250 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:56,353 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:56,357 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43576': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:56,358 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43588': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:56,358 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:56,461 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:56,465 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43590': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:56,466 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43604': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:56,466 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:56,568 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:56,572 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43620': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:56,573 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43634': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:56,573 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:56,675 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:56,679 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43638': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:56,680 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:56,680 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43644': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:56,782 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:56,787 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43652': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:56,787 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43660': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:56,787 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:56,890 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:56,894 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43670': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:56,894 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43682': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:56,894 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:56,997 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:57,001 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43692': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:57,002 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43708': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:57,002 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:57,104 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:57,108 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43722': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:57,109 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43736': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:57,109 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:57,212 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:57,216 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43742': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:57,217 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43746': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:57,217 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:57,320 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:57,324 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43748': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:57,324 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43764': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:57,324 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:57,427 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:57,431 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43774': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:57,432 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43782': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:57,432 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:57,534 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:57,538 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43792': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:57,539 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43794': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:57,539 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:57,642 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43802': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:57,642 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:57,647 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:57,647 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43806': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:57,750 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:57,753 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43822': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:57,754 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43834': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:57,754 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:57,857 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:57,861 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43844': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:57,862 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43858': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:57,862 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:57,965 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:57,969 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43862': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:57,969 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43874': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:57,969 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:58,072 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:58,076 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43876': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:58,077 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43886': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:58,077 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:58,180 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:58,184 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43896': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:58,185 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43910': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:58,185 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:58,288 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:58,291 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43924': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:58,292 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43928': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:58,292 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:58,395 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:58,399 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43940': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:58,400 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43942': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:58,400 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:58,503 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:58,506 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43952': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:58,507 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43966': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:58,507 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:58,610 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:58,614 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43980': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:58,615 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:58,615 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:58,718 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:58,721 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:43986': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:58,722 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:44000': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:58,722 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:58,825 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:58,829 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:44006': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:58,829 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:44020': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:58,829 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:58,932 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:58,936 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:44024': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:58,937 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:44034': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:58,937 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:59,040 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:59,044 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:44050': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:59,044 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:44058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:59,044 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:59,147 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:59,151 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:44064': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:59,152 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:44076': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:59,152 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:59,255 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:59,259 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:44086': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:59,259 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:44102': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:59,259 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:59,362 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:59,366 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:44118': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:59,366 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:44128': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:59,367 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:59,469 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:59,473 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:44134': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:59,474 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:59,474 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:44146': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:59,577 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:59,581 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:44152': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:59,581 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:59,585 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:44166': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:59,684 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:59,688 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:44180': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:59,689 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:44186': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:59,689 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:59,791 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:59,796 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:44196': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:59,796 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:44204': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:59,796 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:59,900 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:30:59,904 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:44212': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:59,904 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:44220': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:30:59,904 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:00,007 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:00,011 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:44230': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:00,012 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:44246': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:00,012 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:00,115 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:00,119 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:44252': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:00,119 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:44254': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:00,119 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:00,222 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:00,226 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:44268': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:00,227 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:44272': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:00,227 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:00,330 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:00,334 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:44284': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:00,334 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:00,335 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:44292': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:00,438 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:00,442 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:44302': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:00,442 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:44308': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:00,442 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:00,545 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:00,549 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:44310': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:00,550 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:00,550 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:44314': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:00,653 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:00,657 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:44318': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:00,657 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:44320': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:00,657 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:00,760 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:00,764 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:44330': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:00,765 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:44334': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:00,765 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:00,868 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:00,872 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:44338': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:00,872 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:44344': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:00,872 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:00,975 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:00,979 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:44356': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:00,980 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:44362': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:00,980 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:01,083 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:01,090 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:44378': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:01,091 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:44390': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:01,091 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:01,190 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:44394': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:01,191 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:01,198 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:44404': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:01,198 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:01,298 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:44406': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:01,298 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:01,305 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:44418': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:01,305 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:01,406 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:44430': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:01,406 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:01,413 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:44440': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:01,413 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:01,513 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:44446': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:01,513 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:01,520 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:44454': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:01,520 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:01,623 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:01,627 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46450': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:01,627 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46456': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:01,627 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:01,731 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:01,735 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46460': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:01,735 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46464': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:01,735 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:01,838 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:01,842 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46468': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:01,842 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46470': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:01,843 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:01,946 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:01,949 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46484': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:01,950 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46496': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:01,950 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:02,053 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46502': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:02,053 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:02,058 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46514': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:02,059 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:02,161 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:02,165 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46524': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:02,165 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46528': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:02,165 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:02,268 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:02,272 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46540': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:02,273 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46546': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:02,273 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:02,376 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:02,379 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46562': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:02,380 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46574': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:02,380 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:02,483 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:02,487 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46584': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:02,488 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46590': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:02,488 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:02,591 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:02,594 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46592': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:02,595 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46600': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:02,595 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:02,698 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:02,702 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46616': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:02,702 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46622': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:02,702 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:02,806 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:02,809 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46626': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:02,810 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46642': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:02,810 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:02,913 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:02,917 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46654': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:02,918 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46670': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:02,918 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:03,021 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:03,025 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46680': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:03,025 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46690': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:03,025 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:03,129 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:03,132 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46696': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:03,133 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46704': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:03,133 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:03,236 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:03,240 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46710': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:03,240 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46722': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:03,240 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:03,345 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:03,348 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46728': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:03,349 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46742': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:03,349 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:03,452 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:03,455 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46746': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:03,456 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46758': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:03,456 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:03,560 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:03,563 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46774': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:03,564 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46784': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:03,564 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:03,667 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:03,671 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46790': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:03,671 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:03,671 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:03,775 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:03,778 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46806': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:03,779 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46812': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:03,779 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:03,882 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:03,886 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46824': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:03,886 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46840': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:03,886 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:03,990 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:03,993 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46842': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:03,994 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46850': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:03,994 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:04,097 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:04,101 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46864': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:04,102 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46872': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:04,102 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:04,205 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:04,209 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46884': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:04,209 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46890': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:04,209 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:04,313 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:04,316 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46892': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:04,317 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46906': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:04,317 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:04,421 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:04,424 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46910': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:04,425 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46916': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:04,425 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:04,528 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:04,532 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46926': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:04,532 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46930': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:04,532 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:04,636 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:04,640 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46938': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:04,640 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46948': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:04,640 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:04,744 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:04,748 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46964': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:04,748 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46970': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:04,748 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:04,851 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:04,855 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46976': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:04,855 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:04,856 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:04,959 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:04,962 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:46998': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:04,963 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47014': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:04,963 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:05,067 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:05,071 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47028': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:05,072 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47040': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:05,072 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:05,175 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:05,179 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47052': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:05,179 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47062': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:05,180 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:05,283 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:05,286 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47064': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:05,287 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47066': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:05,287 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:05,390 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:05,394 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47074': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:05,394 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47086': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:05,394 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:05,498 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:05,502 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47098': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:05,502 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47110': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:05,502 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:05,605 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:05,609 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47116': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:05,610 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47120': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:05,610 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:05,713 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:05,717 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47128': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:05,718 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47136': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:05,718 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:05,820 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:05,824 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47140': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:05,825 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47146': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:05,825 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:05,928 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:05,932 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47150': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:05,932 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47154': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:05,932 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:06,035 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:06,039 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47160': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:06,040 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47176': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:06,040 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:06,143 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:06,147 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47178': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:06,147 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47194': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:06,147 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:06,250 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:06,254 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47202': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:06,255 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47206': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:06,255 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:06,358 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:06,362 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47218': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:06,362 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47232': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:06,362 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:06,465 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:06,469 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47242': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:06,470 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47246': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:06,470 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:06,573 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:06,576 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47260': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:06,577 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47268': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:06,577 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:06,680 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:06,684 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47272': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:06,684 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47282': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:06,685 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:06,788 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:06,792 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47284': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:06,793 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47296': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:06,793 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:06,896 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:06,900 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47306': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:06,901 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47308': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:06,901 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:07,003 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:07,007 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47320': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:07,008 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47330': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:07,008 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:07,111 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:07,115 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47346': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:07,115 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47352': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:07,115 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:07,218 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:07,222 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47364': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:07,223 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47378': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:07,223 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:07,326 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:07,330 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47380': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:07,330 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47396': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:07,330 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:07,433 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:07,437 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47402': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:07,438 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47404': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:07,438 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:07,541 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:07,544 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47408': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:07,545 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47420': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:07,545 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:07,648 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:07,652 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47436': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:07,653 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47450': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:07,653 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:07,756 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:07,760 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47456': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:07,761 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47466': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:07,761 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:07,863 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:07,867 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47482': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:07,867 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47488': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:07,867 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:07,970 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:07,974 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47504': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:07,975 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47516': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:07,975 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:08,078 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:08,082 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47532': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:08,083 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:08,086 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47534': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:08,186 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:08,190 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47542': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:08,190 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47554': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:08,190 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:08,293 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:08,297 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47570': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:08,298 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47572': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:08,298 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:08,401 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:08,405 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47586': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:08,405 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47600': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:08,405 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:08,509 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:08,513 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47606': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:08,514 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47614': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:08,514 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:08,617 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:08,620 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47616': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:08,621 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47622': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:08,621 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:08,724 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:08,728 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47638': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:08,729 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47654': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:08,729 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:08,832 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:08,836 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47660': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:08,836 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:08,836 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47668': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:08,939 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:08,943 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47670': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:08,944 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47678': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:08,944 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:09,047 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:09,050 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47694': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:09,051 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47710': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:09,051 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:09,154 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:09,158 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47726': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:09,159 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47736': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:09,159 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:09,262 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47746': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:09,262 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:09,268 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47750': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:09,268 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:09,370 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47752': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:09,370 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:09,376 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47762': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:09,376 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:09,477 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47776': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:09,477 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:09,483 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47790': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:09,483 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:09,585 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:09,593 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47806': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:09,594 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47820': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:09,594 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:09,693 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47828': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:09,693 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:09,702 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47844': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:09,702 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:09,800 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47848': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:09,800 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:09,809 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47860': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:09,809 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:09,908 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:09,908 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47876': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:09,917 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47886': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:09,917 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:10,016 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47902': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:10,016 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:10,024 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47914': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:10,024 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:10,123 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47924': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:10,123 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:10,132 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47936': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:10,132 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:10,232 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47946': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:10,232 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:10,239 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47958': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:10,239 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:10,339 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47962': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:10,339 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:10,347 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47966': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:10,347 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:10,447 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47976': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:10,447 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:10,454 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47978': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:10,454 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:10,556 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:10,556 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:10,562 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:47998': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:10,562 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:10,663 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48004': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:10,663 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:10,669 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48012': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:10,669 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:10,771 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48026': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:10,771 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:10,776 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48038': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:10,777 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:10,878 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:10,878 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48054': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:10,884 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48060': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:10,884 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:10,986 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48076': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:10,986 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:10,992 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48086': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:10,993 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:11,093 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48088': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:11,093 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:11,100 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48098': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:11,100 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:11,200 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48114': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:11,200 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:11,207 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:11,207 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:11,308 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48134': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:11,308 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:11,314 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48144': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:11,314 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:11,415 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48158': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:11,415 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:11,421 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48168': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:11,421 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:11,523 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48174': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:11,523 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:11,529 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:48178': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:11,529 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:11,630 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:54698': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:11,630 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:11,636 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:54704': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:11,636 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:11,738 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:11,738 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:54716': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:11,744 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:54720': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:11,744 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:11,845 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:54726': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:11,845 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:11,851 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:54736': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:11,851 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:11,954 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:11,958 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:54744': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:11,958 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:54754': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:11,958 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:12,061 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:12,065 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:54770': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:12,066 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:54786': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:12,066 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:12,169 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:12,172 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:54788': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:12,173 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:54792': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:12,173 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:12,276 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:12,280 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:54806': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:12,281 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:54818': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:12,281 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:12,383 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:12,387 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:54828': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:12,388 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:54836': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:12,388 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:12,491 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:12,495 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:54842': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:12,495 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:54846': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:12,496 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:12,599 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:12,602 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:54850': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:12,603 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:54858': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:12,603 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:12,706 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:12,710 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:54870': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:12,711 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:54884': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:12,711 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:12,813 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:12,817 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:54890': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:12,818 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:54902': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:12,818 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:12,921 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:12,924 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:54916': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:12,925 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:54918': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:12,925 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:13,028 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:13,031 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:54924': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:13,032 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:54926': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:13,032 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:13,135 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:13,139 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:54928': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:13,139 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:54936': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:13,140 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:13,242 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:13,246 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:54948': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:13,247 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:54958': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:13,247 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:13,350 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:13,354 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:54974': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:13,354 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:54988': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:13,354 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:13,457 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:13,461 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:54996': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:13,462 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:55008': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:13,462 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:13,565 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:13,569 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:55018': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:13,570 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:55034': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:13,569 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:13,673 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:13,677 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:55046': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:13,678 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:55048': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:13,678 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:13,781 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:13,785 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:55058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:13,785 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:55072': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:13,786 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:13,888 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:13,892 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:55076': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:13,893 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:55078': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:13,893 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:13,996 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:13,999 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:55088': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:14,000 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:55094': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:14,000 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:14,103 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:14,107 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:55106': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:14,107 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:55110': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:14,107 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:14,211 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:14,214 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:55114': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:14,215 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:55128': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:14,215 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:14,318 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:14,322 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:55140': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:14,323 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:55152': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:14,323 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:14,425 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:14,429 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:55162': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:14,430 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:55170': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:14,430 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:14,533 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:14,537 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:55186': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:14,538 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:55202': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:14,538 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:14,641 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:14,644 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:55212': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:14,645 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:55214': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:14,646 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:14,748 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:14,752 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:55216': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:14,753 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:55232': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:14,753 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:14,855 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:14,859 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:55234': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:14,860 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:55244': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:14,860 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:14,964 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:14,968 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:55246': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:14,969 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:55250': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:14,969 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:15,072 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:15,075 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:55252': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:15,076 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:55258': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:15,076 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:15,179 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:15,183 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:55272': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:15,184 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:55278': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:15,184 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:15,286 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:15,290 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:55284': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:15,291 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:55294': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:15,291 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:15,395 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:15,398 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:55310': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:15,399 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:55314': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:15,399 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:15,502 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:15,506 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:55328': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:15,506 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:55336': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:15,507 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:15,610 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:15,614 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:55338': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:15,614 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:55348': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:15,614 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:15,717 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:15,721 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:55356': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:15,722 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:55358': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:15,722 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:15,825 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:15,828 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:55360': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:15,829 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:55364': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:15,829 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:15,932 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:15,936 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:55378': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:15,936 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:55388': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:15,936 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:16,039 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:16,043 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:55404': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:16,044 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:55416': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:16,044 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:16,146 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:16,150 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:55424': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:16,151 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:55432': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:16,151 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:16,254 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:16,258 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:55434': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:16,258 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:55450': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:16,259 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:16,362 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:16,365 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:55462': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:16,366 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:55464': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:16,366 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:16,469 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:16,473 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:55476': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:16,474 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:55492': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:16,474 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:16,576 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:16,580 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:55498': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:16,581 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:16,585 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:55512': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:16,683 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:16,687 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:55524': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:16,688 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:55528': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:16,688 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:16,791 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:16,795 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:55532': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:16,795 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:55540': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:16,795 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:16,898 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:16,902 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:55554': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:16,903 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:55558': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:16,903 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:17,005 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:17,009 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:55572': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:17,010 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:55582': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:17,010 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:17,114 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:17,118 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:55584': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:17,118 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:55598': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:17,118 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:17,221 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:17,225 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:55614': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:17,225 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:55618': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:17,226 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:17,328 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:17,332 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:55628': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:17,333 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:55640': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:17,333 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:17,436 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:17,440 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:55648': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:17,440 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:55652': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:17,440 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:17,543 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:17,547 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:55654': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:17,547 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:55670': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:17,547 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:17,650 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:17,654 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:55684': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:17,655 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:55688': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:17,655 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:17,757 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:17,761 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:55692': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:17,762 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:55698': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:17,762 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:17,865 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:17,868 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:55708': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:17,869 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:55712': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:17,869 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:17,972 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:17,976 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:55722': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:17,977 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:55736': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:17,977 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:18,079 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:18,083 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:55744': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:18,084 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:18,088 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:55754': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:18,187 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:18,191 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:55760': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:18,191 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:55774': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:18,191 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:18,294 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:18,298 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:55782': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:18,298 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:55788': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:18,299 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:18,401 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:18,405 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:55796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:18,406 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:55802': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:18,406 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:18,509 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:18,512 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:55816': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:18,513 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:55820': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:18,513 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:18,616 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:18,620 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:55824': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:18,621 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:55830': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:18,621 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:18,723 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:18,727 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:55832': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:18,728 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:55848': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:18,728 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:18,831 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:18,836 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:55858': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:18,836 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:55860': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:18,836 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:18,939 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:18,943 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:55864': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:18,943 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:55868': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:18,943 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:19,046 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:19,050 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:55880': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:19,051 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:55888': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:19,051 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:19,153 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:19,157 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:55894': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:19,158 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:55908': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:19,158 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:19,260 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:19,264 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:55920': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:19,265 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:55930': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:19,265 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:19,369 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:19,373 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:55944': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:19,373 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:55952': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:19,374 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:19,476 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:19,480 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:55966': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:19,480 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:55978': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:19,481 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:19,583 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:19,591 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:55984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:19,592 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:55988': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:19,592 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:19,690 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:55998': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:19,690 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:19,699 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56006': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:19,699 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:19,797 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56016': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:19,798 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:19,808 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56028': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:19,808 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:19,905 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56036': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:19,905 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:19,915 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56038': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:19,915 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:20,012 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56050': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:20,012 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:20,022 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56060': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:20,022 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:20,119 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56074': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:20,119 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:20,130 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56090': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:20,130 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:20,227 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56102': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:20,227 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:20,237 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56106': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:20,237 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:20,334 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56108': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:20,334 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:20,344 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:20,344 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56116': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:20,442 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:20,442 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:20,451 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:20,451 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56124': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:20,550 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56126': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:20,550 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:20,558 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56138': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:20,558 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:20,657 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56150': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:20,657 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:20,666 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:20,666 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56158': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:20,765 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56168': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:20,765 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:20,773 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:20,773 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56184': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:20,872 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56188': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:20,872 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:20,881 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56202': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:20,881 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:20,980 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56206': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:20,980 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:20,989 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56208': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:20,989 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:21,090 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:21,090 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56218': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:21,096 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56220': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:21,096 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:21,197 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:21,198 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56234': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:21,203 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56248': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:21,203 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:21,304 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56262': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:21,304 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:21,310 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56270': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:21,310 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:21,412 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:21,412 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56272': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:21,417 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56274': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:21,418 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:21,519 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:21,519 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56288': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:21,525 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:56302': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:21,525 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:21,627 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:21,627 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:58846': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:21,632 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:58860': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:21,632 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:21,734 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:21,734 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:58870': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:21,740 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:58882': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:21,740 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:21,841 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:58898': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:21,841 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:21,847 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:58906': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:21,847 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:21,949 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:58910': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:21,949 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:21,954 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:58914': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:21,954 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:22,056 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:22,056 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:58916': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:22,062 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:58924': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:22,062 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:22,163 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:22,164 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:58940': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:22,169 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:58944': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:22,169 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:22,272 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:22,276 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:58956': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:22,276 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:58960': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:22,277 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:22,380 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:22,384 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:58976': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:22,384 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:58984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:22,384 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:22,487 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:22,491 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:58998': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:22,492 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:59012': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:22,492 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:22,595 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:22,598 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:59020': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:22,599 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:59034': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:22,599 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:22,702 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:22,706 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:59046': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:22,707 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:59048': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:22,707 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:22,810 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:22,814 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:59060': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:22,815 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:59068': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:22,815 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:22,918 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:22,921 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:59078': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:22,922 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:59088': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:22,922 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:23,025 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:23,029 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:59098': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:23,029 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:59112': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:23,029 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:23,132 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:23,136 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:59122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:23,137 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:59126': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:23,137 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:23,240 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:23,244 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:59134': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:23,244 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:59142': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:23,244 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:23,348 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:23,351 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:59154': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:23,352 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:59162': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:23,352 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:23,455 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:23,459 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:59178': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:23,460 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:59188': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:23,460 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:23,562 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:23,566 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:59192': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:23,567 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:59206': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:23,567 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:23,670 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:23,674 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:59222': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:23,675 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:59230': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:23,675 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:23,778 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:23,781 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:59238': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:23,782 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:59252': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:23,782 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:23,885 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:23,889 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:59262': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:23,890 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:59264': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:23,890 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:23,994 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:23,997 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:59272': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:23,998 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:59284': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:23,998 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:24,101 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:24,105 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:59290': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:24,106 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:59302': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:24,106 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:24,208 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:24,212 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:59318': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:24,213 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:59334': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:24,213 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:24,316 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:24,320 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:59350': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:24,320 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:59352': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:24,320 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:24,423 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:24,427 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:59354': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:24,428 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:59358': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:24,428 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:24,531 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:24,534 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:59368': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:24,535 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:59382': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:24,535 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:24,638 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:24,642 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:59388': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:24,642 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:59392': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:24,642 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:24,745 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:24,749 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:59400': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:24,750 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:59414': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:24,750 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:24,853 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:24,856 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:59418': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:24,857 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:59428': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:24,857 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:24,960 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:24,964 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:59438': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:24,965 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:24,965 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:59448': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:25,067 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:25,071 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:59456': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:25,072 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:59470': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:25,072 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:25,175 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:25,179 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:59482': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:25,179 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:59488': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:25,179 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:25,282 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:25,286 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:59490': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:25,287 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:59494': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:25,287 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:25,389 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:25,393 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:59510': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:25,394 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:59524': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:25,394 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:25,497 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:25,501 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:59538': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:25,501 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:59546': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:25,501 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:25,604 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:25,608 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:59548': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:25,608 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:59562': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:25,608 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:25,712 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:25,716 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:59572': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:25,717 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:59574': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:25,717 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:25,819 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:25,823 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:59584': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:25,824 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:59588': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:25,824 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:25,926 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:25,930 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:59596': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:25,931 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:59610': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:25,931 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:26,034 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:26,038 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:59624': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:26,038 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:59634': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:26,038 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:26,141 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:26,145 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:59642': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:26,146 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:59656': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:26,146 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:26,248 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:26,252 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:59668': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:26,253 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:59682': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:26,253 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:26,356 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:26,359 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:59690': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:26,360 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:59698': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:26,360 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:26,463 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:26,467 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:59706': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:26,468 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:59716': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:26,468 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:26,570 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:26,574 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:59718': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:26,575 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:59726': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:26,575 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:26,678 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:26,682 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:59728': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:26,682 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:59742': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:26,683 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:26,785 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:26,789 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:59750': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:26,790 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:59760': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:26,790 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:26,893 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:26,897 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:59762': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:26,897 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:59774': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:26,897 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:27,000 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:27,004 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:59778': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:27,004 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:59790': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:27,004 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:27,107 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:27,111 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:59802': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:27,112 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:59816': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:27,112 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:27,215 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:27,219 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:59828': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:27,219 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:59830': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:27,219 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:27,322 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:27,326 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:59840': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:27,327 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:59854': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:27,327 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:27,430 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:27,434 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:59866': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:27,435 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:59878': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:27,435 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:27,537 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:27,541 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:59892': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:27,542 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:59908': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:27,542 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:27,645 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:27,649 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:59920': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:27,650 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:59924': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:27,650 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:27,752 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:27,756 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:59934': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:27,757 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:59946': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:27,757 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:27,860 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:27,864 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:59948': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:27,864 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:59952': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:27,864 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:27,967 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:27,971 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:59968': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:27,971 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:59980': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:27,972 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:28,074 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:28,078 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:59992': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:28,079 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:60006': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:28,079 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:28,182 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:28,186 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:60014': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:28,187 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:60030': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:28,187 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:28,291 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:28,295 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:60044': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:28,296 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:60050': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:28,296 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:28,399 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:28,403 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:60066': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:28,403 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:60078': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:28,404 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:28,506 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:28,510 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:60094': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:28,511 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:60096': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:28,511 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:28,614 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:28,618 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:60110': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:28,618 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:60126': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:28,618 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:28,721 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:60132': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:28,721 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:28,727 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:60138': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:28,727 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:28,828 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:60152': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:28,828 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:28,834 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:60156': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:28,834 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:28,936 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:28,936 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:60162': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:28,941 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:60176': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:28,941 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:29,043 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:60184': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:29,043 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:29,048 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:60186': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:29,048 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:29,151 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:29,155 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:60188': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:29,156 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:60200': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:29,156 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:29,259 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:29,263 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:60216': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:29,263 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:60220': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:29,263 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:29,366 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:29,370 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:60230': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:29,371 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:60236': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:29,371 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:29,474 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:29,477 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:60238': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:29,478 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:60240': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:29,478 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:29,581 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:29,590 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:60242': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:29,591 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:60254': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:29,591 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:29,689 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:60266': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:29,689 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:29,698 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:29,698 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:60276': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:29,797 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:60290': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:29,797 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:29,805 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:60302': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:29,805 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:29,904 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:60304': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:29,904 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:29,913 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:60314': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:29,913 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:30,012 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:60320': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:30,012 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:30,020 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:60330': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:30,020 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:30,120 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:60336': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:30,120 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:30,127 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:60350': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:30,127 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:30,227 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:60362': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:30,227 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:30,234 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:60378': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:30,234 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:30,335 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:60380': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:30,335 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:30,341 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:60392': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:30,341 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:30,443 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:30,443 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:60398': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:30,448 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:60414': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:30,448 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:30,550 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:60424': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:30,550 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:30,556 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:60432': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:30,556 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:30,658 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:30,662 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:60440': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:30,663 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:60452': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:30,663 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:30,765 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:30,769 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:60454': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:30,770 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:60466': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:30,770 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:30,874 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:30,877 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:60470': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:30,878 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:60482': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:30,878 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:30,981 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:30,985 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:60490': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:30,986 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:60504': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:30,986 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:31,090 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:31,094 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:60514': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:31,094 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:60528': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:31,095 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:31,198 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:31,202 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:60542': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:31,202 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:60544': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:31,202 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:31,305 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:31,309 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:60558': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:31,310 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:60568': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:31,310 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:31,413 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:31,416 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:60576': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:31,417 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:60586': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:31,417 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:31,520 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:31,524 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:60602': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:31,525 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:60606': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:31,525 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:31,628 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:31,632 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52270': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:31,633 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52274': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:31,633 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:31,735 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:31,739 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52276': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:31,740 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52278': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:31,740 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:31,843 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:31,847 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52290': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:31,848 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52296': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:31,848 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:31,951 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:31,954 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52310': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:31,955 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52314': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:31,955 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:32,058 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:32,062 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52330': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:32,063 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52342': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:32,063 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:32,166 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:32,170 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52344': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:32,170 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52350': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:32,170 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:32,273 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:32,277 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52354': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:32,278 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52356': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:32,278 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:32,381 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:32,384 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52360': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:32,385 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52372': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:32,385 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:32,488 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:32,492 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52376': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:32,492 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52384': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:32,492 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:32,596 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:32,600 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52400': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:32,601 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52414': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:32,601 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:32,703 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:32,707 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52420': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:32,708 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52428': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:32,708 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:32,811 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:32,814 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52442': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:32,815 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52446': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:32,815 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:32,919 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:32,923 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52448': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:32,924 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52450': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:32,924 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:33,027 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:33,030 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52454': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:33,031 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52460': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:33,031 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:33,134 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:33,137 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52476': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:33,138 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52490': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:33,138 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:33,241 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:33,245 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52498': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:33,245 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52504': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:33,245 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:33,348 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52506': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:33,349 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:33,354 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52514': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:33,354 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:33,456 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:33,460 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52518': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:33,461 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52532': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:33,461 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:33,564 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52542': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:33,564 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:33,569 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52552': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:33,569 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:33,671 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52568': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:33,671 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:33,677 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52584': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:33,677 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:33,778 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52594': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:33,778 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:33,784 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52604': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:33,784 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:33,886 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52610': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:33,886 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:33,891 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52624': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:33,891 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:33,993 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52638': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:33,993 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:33,999 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52646': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:33,999 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:34,101 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:34,101 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52650': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:34,107 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52656': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:34,107 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:34,208 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:34,214 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52664': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:34,215 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52668': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:34,215 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:34,317 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52682': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:34,317 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:34,322 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52694': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:34,322 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:34,424 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:34,424 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52710': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:34,430 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52716': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:34,430 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:34,532 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:34,532 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52726': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:34,537 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:34,537 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52740': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:34,639 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52750': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:34,639 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:34,644 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52758': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:34,644 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:34,747 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:34,751 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52764': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:34,751 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52776': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:34,751 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:34,854 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:34,858 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52788': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:34,859 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:34,859 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:34,962 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:34,966 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52810': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:34,966 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52814': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:34,966 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:35,070 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:35,073 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52818': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:35,074 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52832': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:35,074 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:35,177 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:35,181 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52846': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:35,182 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52850': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:35,182 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:35,285 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:35,289 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52860': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:35,289 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52870': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:35,289 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:35,392 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:35,396 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52878': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:35,397 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52890': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:35,397 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:35,500 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:35,504 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52906': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:35,504 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52920': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:35,504 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:35,607 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:35,611 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52932': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:35,612 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52940': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:35,612 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:35,715 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:35,719 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52952': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:35,719 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52958': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:35,720 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:35,822 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:35,826 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52964': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:35,827 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52966': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:35,827 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:35,930 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:35,933 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52982': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:35,934 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52988': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:35,934 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:36,038 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:36,042 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52990': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:36,042 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53002': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:36,042 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:36,145 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:36,149 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53014': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:36,150 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53030': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:36,150 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:36,253 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:36,257 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53042': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:36,257 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53056': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:36,257 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:36,360 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:36,364 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53064': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:36,365 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53068': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:36,365 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:36,467 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:36,471 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53074': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:36,472 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53082': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:36,472 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:36,575 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:36,579 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53086': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:36,579 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53088': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:36,580 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:36,682 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:36,686 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53094': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:36,687 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53100': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:36,687 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:36,790 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:36,794 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53108': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:36,794 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53110': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:36,794 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:36,897 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:36,901 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53116': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:36,902 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53132': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:36,902 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:37,005 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:37,008 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53136': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:37,009 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53140': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:37,009 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:37,112 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:37,116 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53152': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:37,116 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53166': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:37,117 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:37,219 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:37,223 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53174': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:37,224 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53186': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:37,224 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:37,327 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:37,331 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53198': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:37,331 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53208': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:37,332 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:37,435 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:37,438 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53220': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:37,439 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53230': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:37,439 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:37,542 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:37,546 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53242': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:37,546 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53256': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:37,547 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:37,650 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:37,653 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53270': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:37,654 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53286': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:37,654 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:37,759 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:37,763 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53288': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:37,764 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53290': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:37,764 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:37,867 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:37,871 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53292': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:37,871 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53308': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:37,871 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:37,974 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:37,978 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53318': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:37,979 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53326': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:37,979 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:38,082 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:38,090 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53334': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:38,090 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53348': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:38,090 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:38,189 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53362': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:38,189 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:38,199 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53364': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:38,199 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:38,297 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53366': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:38,297 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:38,306 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53372': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:38,306 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:38,404 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53386': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:38,404 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:38,413 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53398': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:38,413 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:38,512 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53406': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:38,512 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:38,520 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53410': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:38,521 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:38,619 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53414': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:38,619 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:38,628 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53424': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:38,628 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:38,727 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53432': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:38,727 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:38,735 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53446': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:38,735 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:38,834 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53452': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:38,834 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:38,842 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53460': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:38,842 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:38,942 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53476': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:38,942 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:38,949 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53484': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:38,949 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:39,049 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53488': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:39,049 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:39,056 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53494': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:39,056 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:39,157 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53502': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:39,157 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:39,163 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53514': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:39,163 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:39,265 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53518': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:39,265 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:39,271 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53520': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:39,271 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:39,373 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53528': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:39,373 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:39,378 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53544': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:39,379 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:39,481 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:39,485 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53548': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:39,486 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53554': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:39,486 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:39,591 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:39,594 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53560': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:39,595 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53576': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:39,595 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:39,698 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:39,702 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53586': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:39,703 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53594': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:39,703 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:39,805 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:39,809 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53600': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:39,810 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53606': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:39,810 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:39,913 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:39,916 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53620': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:39,917 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53626': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:39,917 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:40,020 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:40,024 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53634': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:40,024 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53650': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:40,024 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:40,127 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:40,131 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53662': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:40,132 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53666': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:40,132 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:40,235 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:40,238 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53668': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:40,239 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53670': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:40,239 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:40,342 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:40,346 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53676': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:40,346 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53690': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:40,346 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:40,449 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:40,453 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53706': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:40,454 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53714': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:40,454 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:40,556 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:40,560 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53718': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:40,561 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53728': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:40,561 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:40,664 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:40,668 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53730': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:40,668 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53736': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:40,668 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:40,771 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:40,775 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53738': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:40,776 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53742': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:40,776 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:40,878 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:40,882 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53744': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:40,883 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53760': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:40,883 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:40,986 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:40,990 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53772': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:40,990 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53784': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:40,990 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:41,093 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:41,097 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:41,097 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53802': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:41,098 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:41,201 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:41,205 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53814': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:41,206 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53830': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:41,206 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:41,308 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:41,312 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53842': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:41,313 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53846': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:41,313 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:41,416 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:41,420 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53858': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:41,420 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53870': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:41,420 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:41,523 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:41,527 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53880': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:41,527 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53896': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:41,528 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:41,630 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:41,634 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57290': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:41,635 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57292': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:41,635 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:41,737 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:41,741 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57306': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:41,742 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57318': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:41,742 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:41,845 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:41,849 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57326': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:41,849 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57332': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:41,849 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:41,952 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:41,956 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57334': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:41,957 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57342': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:41,957 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:42,059 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:42,063 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57348': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:42,064 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57352': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:42,064 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:42,167 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:42,171 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57368': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:42,171 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57370': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:42,171 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:42,274 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:42,278 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57382': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:42,278 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57394': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:42,279 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:42,381 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:42,385 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57404': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:42,385 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57410': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:42,386 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:42,488 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57422': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:42,488 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:42,493 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57430': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:42,493 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:42,596 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:42,599 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57444': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:42,600 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57452': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:42,600 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:42,703 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:42,707 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57458': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:42,707 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57472': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:42,708 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:42,810 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:42,814 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57478': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:42,815 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57482': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:42,815 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:42,918 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:42,921 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57496': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:42,922 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57510': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:42,922 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:43,024 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57526': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:43,024 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:43,031 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57542': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:43,031 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:43,131 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57544': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:43,132 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:43,138 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57548': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:43,138 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:43,238 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57554': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:43,238 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:43,245 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57566': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:43,245 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:43,345 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57574': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:43,345 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:43,352 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57590': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:43,352 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:43,452 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57600': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:43,452 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:43,460 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57612': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:43,460 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:43,559 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57620': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:43,559 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:43,567 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57628': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:43,567 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:43,667 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57630': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:43,667 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:43,674 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57646': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:43,674 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:43,774 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57656': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:43,774 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:43,781 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57658': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:43,781 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:43,881 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57670': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:43,881 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:43,889 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57680': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:43,889 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:43,987 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57684': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:43,987 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:43,996 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57688': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:43,996 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:44,094 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57702': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:44,094 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:44,103 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57706': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:44,103 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:44,201 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57714': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:44,201 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:44,210 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57728': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:44,210 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:44,308 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57732': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:44,308 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:44,318 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57736': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:44,318 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:44,416 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57748': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:44,416 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:44,425 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57760': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:44,425 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:44,523 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57762': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:44,523 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:44,533 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57766': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:44,533 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:44,631 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57780': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:44,631 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:44,640 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57784': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:44,640 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:44,737 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57786': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:44,737 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:44,747 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57800': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:44,747 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:44,844 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57802': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:44,844 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:44,855 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57812': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:44,855 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:44,951 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57828': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:44,951 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:44,962 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57834': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:44,962 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:45,058 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57850': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:45,058 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:45,069 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57858': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:45,069 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:45,165 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57862': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:45,165 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:45,177 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57872': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:45,177 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:45,272 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57880': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:45,272 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:45,284 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57886': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:45,284 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:45,379 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57888': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:45,380 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:45,391 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57902': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:45,392 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:45,486 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57910': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:45,486 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:45,499 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57914': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:45,499 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:45,593 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57918': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:45,593 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:45,606 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57934': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:45,606 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:45,700 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57942': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:45,701 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:45,713 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57956': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:45,713 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:45,807 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57970': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:45,808 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:45,821 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:45,821 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:45,914 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:57994': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:45,914 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:45,928 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:58002': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:45,928 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:46,021 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:58004': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:46,021 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:46,036 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:58012': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:46,036 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:46,128 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:58014': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:46,128 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:46,143 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:58028': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:46,143 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:46,235 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:58036': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:46,235 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:46,250 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:58046': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:46,250 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:46,343 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:58058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:46,343 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:46,357 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:58064': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:46,357 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:46,450 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:58066': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:46,450 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:46,464 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:58080': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:46,464 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:46,557 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:58086': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:46,557 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:46,571 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:58102': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:46,571 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:46,665 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:58108': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:46,665 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:46,677 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:58116': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:46,677 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:46,772 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:58122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:46,772 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:46,784 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:58128': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:46,784 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:46,880 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:58140': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:46,880 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:46,891 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:58146': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:46,891 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:46,987 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:58162': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:46,987 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:46,998 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:58176': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:46,998 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:47,095 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:58184': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:47,095 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:47,105 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:58198': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:47,105 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:47,202 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:58210': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:47,202 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:47,212 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:58212': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:47,212 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:47,309 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:58216': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:47,309 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:47,319 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:58222': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:47,319 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:47,418 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:58224': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:47,418 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:47,426 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:58226': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:47,426 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:47,526 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:58232': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:47,526 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:47,533 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:58240': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:47,533 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:47,633 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:58252': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:47,633 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:47,639 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:58256': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:47,639 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:47,741 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:58258': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:47,741 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:47,746 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:58262': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:47,746 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:47,849 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:58268': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:47,849 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:47,855 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:58272': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:47,855 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:47,956 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:47,956 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:58274': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:47,961 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:58280': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:47,961 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:48,064 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:48,068 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:58282': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:48,069 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:58294': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:48,069 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:48,172 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:48,176 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:58298': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:48,176 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:58300': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:48,176 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:48,280 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:48,283 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:58314': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:48,284 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:58320': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:48,284 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:48,387 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:48,391 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:58336': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:48,392 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:48,392 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:58340': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:48,495 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:48,498 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:58342': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:48,499 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:58348': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:48,499 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:48,602 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:48,606 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:58360': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:48,607 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:58364': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:48,607 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:48,710 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:48,713 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:58378': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:48,714 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:58380': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:48,714 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:48,817 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:48,821 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:58382': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:48,821 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:58386': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:48,822 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:48,925 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:48,928 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:58390': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:48,929 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:58404': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:48,929 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:49,032 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:49,036 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:58412': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:49,036 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:58424': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:49,036 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:49,140 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:49,143 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:58440': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:49,144 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:58450': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:49,144 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:49,247 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:49,251 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:58464': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:49,251 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:58474': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:49,251 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:49,355 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:49,358 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:58490': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:49,359 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:58494': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:49,359 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:49,462 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:49,466 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:58508': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:49,466 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:58514': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:49,466 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:49,570 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:49,573 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:58518': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:49,574 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:58524': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:49,574 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:49,677 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:49,681 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:58538': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:49,681 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:58546': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:49,681 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:49,786 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:49,789 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:58556': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:49,790 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:58560': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:49,790 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:49,893 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:49,897 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:58572': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:49,897 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:58586': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:49,897 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:50,001 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:50,004 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:58596': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:50,005 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:58610': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:50,005 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:50,108 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:50,112 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:58614': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:50,112 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:58626': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:50,112 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:50,216 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:50,219 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:58640': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:50,220 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:58644': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:50,220 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:50,323 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:50,327 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:58646': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:50,327 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:58648': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:50,327 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:50,430 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:50,434 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:58660': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:50,435 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:58662': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:50,435 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:50,538 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:50,542 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:58668': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:50,542 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:58672': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:50,542 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:50,646 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:50,649 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:58682': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:50,650 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:58698': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:50,650 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:50,753 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:50,757 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:58712': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:50,758 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:58714': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:50,758 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:50,861 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:50,865 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:58724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:50,866 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:58732': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:50,866 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:50,969 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:50,973 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:58738': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:50,974 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:58740': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:50,974 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:51,077 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:51,081 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:58746': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:51,081 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:51,085 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:58758': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:51,184 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:51,188 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:58766': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:51,189 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:58782': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:51,189 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:51,292 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:51,296 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:58792': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:51,296 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:58794': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:51,297 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:51,400 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:51,404 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:58796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:51,404 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:58802': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:51,404 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:51,508 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:51,512 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:58804': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:51,513 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:58812': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:51,513 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:51,616 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:51,620 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:51894': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:51,620 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:51898': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:51,620 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:51,723 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:51,727 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:51900': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:51,728 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:51916': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:51,728 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:51,831 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:51,835 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:51922': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:51,835 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:51926': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:51,835 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:51,938 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:51,942 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:51932': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:51,943 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:51936': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:51,943 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:52,046 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:52,049 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:51950': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:52,050 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:51960': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:52,050 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:52,153 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:52,157 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:51968': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:52,158 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:51970': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:52,158 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:52,262 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:52,266 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:51982': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:52,267 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:51992': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:52,267 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:52,370 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:52,373 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52004': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:52,374 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52012': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:52,374 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:52,477 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:52,481 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52014': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:52,482 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52018': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:52,482 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:52,584 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:52,593 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52028': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:52,593 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52040': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:52,593 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:52,692 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52052': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:52,692 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:52,702 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:52,702 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:52,800 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52062': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:52,800 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:52,810 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52068': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:52,810 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:52,908 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52082': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:52,908 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:52,917 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52084': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:52,917 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:53,015 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52092': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:53,015 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:53,025 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52102': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:53,025 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:53,123 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52118': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:53,123 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:53,132 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:53,132 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:53,232 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52124': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:53,232 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:53,240 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52126': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:53,240 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:53,339 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52128': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:53,339 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:53,347 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52130': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:53,347 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:53,447 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52136': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:53,447 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:53,454 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52152': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:53,454 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:53,555 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52168': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:53,555 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:53,561 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52182': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:53,561 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:53,663 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:53,663 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52194': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:53,668 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52210': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:53,668 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:53,770 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:53,770 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52216': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:53,776 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52224': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:53,776 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:53,878 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:53,878 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52228': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:53,884 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52230': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:53,884 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:53,985 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:53,986 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52244': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:53,991 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52254': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:53,991 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:54,093 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52258': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:54,093 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:54,098 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52262': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:54,098 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:54,200 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52272': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:54,200 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:54,206 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52280': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:54,206 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:54,308 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52294': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:54,308 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:54,313 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52306': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:54,313 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:54,416 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52310': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:54,416 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:54,421 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52314': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:54,421 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:54,523 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:54,523 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52318': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:54,529 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52322': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:54,529 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:54,630 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:54,631 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52336': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:54,636 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52340': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:54,636 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:54,738 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:54,738 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52342': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:54,744 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52358': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:54,744 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:54,845 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:54,846 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52362': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:54,851 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52368': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:54,851 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:54,954 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:54,958 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52370': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:54,958 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52372': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:54,958 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:55,061 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:55,065 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52382': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:55,066 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52384': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:55,066 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:55,169 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:55,172 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52396': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:55,173 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52410': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:55,173 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:55,276 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:55,280 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52420': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:55,281 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52422': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:55,281 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:55,383 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:55,387 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52438': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:55,388 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52440': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:55,388 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:55,491 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:55,495 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52446': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:55,495 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52462': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:55,495 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:55,598 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:55,602 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52466': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:55,602 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52476': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:55,602 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:55,705 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:55,709 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52490': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:55,710 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:55,710 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52492': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:55,812 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:55,816 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52506': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:55,817 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52514': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:55,817 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:55,919 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:55,924 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52528': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:55,925 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52542': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:55,925 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:56,027 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:56,027 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52556': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:56,033 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52570': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:56,033 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:56,134 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:56,135 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52574': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:56,140 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52576': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:56,140 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:56,242 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:56,242 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52584': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:56,247 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52594': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:56,247 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:56,349 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:56,349 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52600': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:56,355 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52616': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:56,355 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:56,456 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:56,456 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52628': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:56,462 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52640': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:56,462 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:56,564 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:56,564 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52652': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:56,569 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52658': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:56,569 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:56,672 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:56,676 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52660': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:56,677 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52662': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:56,677 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:56,779 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52666': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:56,779 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:56,784 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52676': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:56,785 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:56,886 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52678': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:56,887 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:56,892 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52692': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:56,892 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:56,994 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52696': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:56,994 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:56,999 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52702': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:56,999 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:57,103 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:57,107 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52706': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:57,108 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52720': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:57,108 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:57,211 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:57,215 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52726': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:57,215 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52732': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:57,215 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:57,318 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:57,322 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52740': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:57,323 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52744': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:57,323 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:57,426 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:57,429 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52746': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:57,430 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52758': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:57,430 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:57,533 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52764': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:57,533 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:57,538 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52776': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:57,538 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:57,640 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52782': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:57,640 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:57,645 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52784': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:57,645 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:57,748 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:57,748 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:57,753 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52808': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:57,753 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:57,855 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52818': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:57,855 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:57,860 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52826': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:57,860 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:57,962 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52840': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:57,962 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:57,967 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52856': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:57,967 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:58,069 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52860': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:58,069 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:58,074 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52866': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:58,074 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:58,177 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52868': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:58,177 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:58,182 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52880': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:58,182 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:58,284 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52890': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:58,284 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:58,289 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52900': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:58,289 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:58,392 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:58,396 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52914': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:58,397 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52924': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:58,397 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:58,500 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:58,503 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52926': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:58,504 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52942': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:58,504 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:58,607 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:58,611 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52954': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:58,611 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52956': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:58,611 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:58,714 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:58,718 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52958': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:58,719 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52960': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:58,719 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:58,822 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:58,826 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52962': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:58,826 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52970': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:58,826 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:58,930 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:58,933 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:52984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:58,934 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53000': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:58,934 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:59,037 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:59,042 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53014': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:59,043 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53028': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:59,043 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:59,145 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:59,145 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53032': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:59,150 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53038': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:59,150 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:59,252 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:59,252 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53054': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:59,258 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53066': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:59,258 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:59,359 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:59,359 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53072': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:59,365 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53080': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:59,365 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:59,467 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:59,467 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53094': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:59,472 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53108': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:59,472 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:59,574 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:59,574 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53114': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:59,580 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53128': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:59,580 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:59,681 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53140': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:59,681 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:59,688 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53144': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:59,688 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:59,789 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53156': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:59,789 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:59,796 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53164': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:59,796 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:59,896 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53166': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:59,896 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:31:59,904 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53172': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:31:59,904 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:00,004 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53186': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:00,004 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:00,012 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53188': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:00,012 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:00,112 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53198': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:00,112 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:00,120 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53210': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:00,120 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:00,220 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53226': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:00,220 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:00,228 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53232': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:00,228 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:00,328 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53238': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:00,328 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:00,336 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53254': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:00,336 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:00,436 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53268': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:00,436 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:00,444 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53274': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:00,444 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:00,544 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53288': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:00,544 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:00,552 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53290': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:00,552 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:00,652 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53300': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:00,652 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:00,660 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53308': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:00,660 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:00,759 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53312': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:00,760 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:00,768 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53318': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:00,768 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:00,867 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53328': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:00,867 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:00,876 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53338': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:00,876 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:00,975 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53342': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:00,975 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:00,984 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53358': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:00,984 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:01,083 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:01,086 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53362': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:01,092 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53364': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:01,092 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:01,191 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53378': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:01,191 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:01,201 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53380': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:01,201 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:01,299 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53382': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:01,299 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:01,309 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53392': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:01,309 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:01,406 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53394': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:01,407 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:01,417 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53402': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:01,417 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:01,514 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53404': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:01,514 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:01,525 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:53410': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:01,525 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:01,622 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38586': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:01,622 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:01,633 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38600': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:01,634 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:01,730 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38616': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:01,730 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:01,742 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38624': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:01,742 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:01,839 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38628': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:01,839 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:01,850 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38638': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:01,850 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:01,948 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38642': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:01,948 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:01,958 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38652': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:01,959 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:02,056 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38668': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:02,056 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:02,066 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38674': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:02,067 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:02,164 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38688': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:02,164 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:02,174 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38698': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:02,175 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:02,272 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38708': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:02,272 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:02,283 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38714': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:02,283 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:02,380 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38716': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:02,380 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:02,393 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38732': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:02,393 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:02,487 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38746': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:02,487 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:02,501 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38762': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:02,501 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:02,595 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38768': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:02,595 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:02,609 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38784': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:02,609 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:02,703 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38792': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:02,703 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:02,717 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38806': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:02,717 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:02,811 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38820': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:02,811 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:02,826 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38832': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:02,826 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:02,918 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38844': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:02,918 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:02,934 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38846': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:02,934 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:03,026 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38852': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:03,026 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:03,042 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38864': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:03,042 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:03,134 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38876': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:03,134 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:03,151 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38890': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:03,151 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:03,242 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38894': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:03,242 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:03,259 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38906': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:03,259 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:03,350 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38912': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:03,350 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:03,367 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38920': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:03,367 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:03,457 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38924': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:03,458 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:03,475 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38934': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:03,476 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:03,566 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38936': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:03,566 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:03,584 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:03,587 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38942': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:03,674 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38952': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:03,674 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:03,692 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38954': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:03,692 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:03,782 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38958': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:03,782 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:03,800 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38962': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:03,800 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:03,890 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38964': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:03,890 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:03,908 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38978': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:03,908 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:03,997 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38982': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:03,997 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:04,016 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38990': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:04,017 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:04,105 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:38992': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:04,105 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:04,125 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39008': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:04,125 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:04,213 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39010': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:04,213 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:04,233 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39016': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:04,233 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:04,322 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39024': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:04,322 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:04,341 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39040': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:04,341 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:04,429 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39056': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:04,430 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:04,450 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39070': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:04,450 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:04,537 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39076': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:04,537 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:04,558 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39084': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:04,558 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:04,645 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39096': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:04,645 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:04,666 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39110': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:04,666 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:04,753 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39126': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:04,753 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:04,774 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39132': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:04,774 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:04,861 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39148': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:04,861 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:04,882 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39156': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:04,883 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:04,969 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39160': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:04,969 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:04,990 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39166': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:04,991 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:05,077 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39176': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:05,077 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:05,099 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39180': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:05,099 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:05,185 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39182': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:05,185 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:05,207 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39198': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:05,207 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:05,293 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39200': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:05,293 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:05,316 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39202': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:05,316 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:05,401 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39212': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:05,401 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:05,424 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39216': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:05,424 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:05,508 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39218': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:05,508 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:05,533 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39230': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:05,533 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:05,616 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39244': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:05,616 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:05,641 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39254': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:05,641 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:05,723 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39264': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:05,723 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:05,749 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39270': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:05,749 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:05,831 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39274': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:05,831 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:05,858 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39276': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:05,858 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:05,939 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39290': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:05,939 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:05,966 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39294': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:05,966 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:06,047 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39300': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:06,047 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:06,074 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39310': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:06,074 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:06,155 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39314': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:06,155 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:06,182 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39320': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:06,182 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:06,263 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39324': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:06,263 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:06,290 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39326': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:06,290 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:06,371 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39342': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:06,371 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:06,398 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39354': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:06,398 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:06,479 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39368': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:06,479 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:06,506 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39382': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:06,507 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:06,590 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39386': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:06,590 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:06,615 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39398': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:06,615 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:06,697 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39408': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:06,697 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:06,723 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39412': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:06,723 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:06,806 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39426': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:06,806 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:06,831 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39430': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:06,831 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:06,914 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39446': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:06,914 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:06,940 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39448': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:06,940 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:07,023 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39458': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:07,023 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:07,048 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39460': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:07,048 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:07,130 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39466': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:07,130 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:07,157 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39468': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:07,157 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:07,238 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39470': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:07,238 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:07,267 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39486': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:07,267 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:07,346 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39496': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:07,346 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:07,375 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39512': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:07,375 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:07,454 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39526': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:07,454 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:07,483 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39534': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:07,484 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:07,562 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39550': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:07,562 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:07,592 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39566': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:07,592 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:07,670 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39578': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:07,670 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:07,700 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39588': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:07,700 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:07,778 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39592': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:07,778 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:07,809 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39594': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:07,809 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:07,885 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39598': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:07,885 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:07,917 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39608': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:07,917 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:07,993 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39620': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:07,993 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:08,026 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39622': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:08,026 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:08,101 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39628': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:08,101 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:08,134 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39638': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:08,134 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:08,209 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39654': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:08,209 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:08,242 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39656': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:08,243 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:08,317 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39670': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:08,317 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:08,351 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39672': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:08,351 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:08,425 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39680': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:08,425 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:08,459 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39684': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:08,459 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:08,533 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39698': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:08,533 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:08,568 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39708': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:08,568 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:08,641 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39720': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:08,641 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:08,676 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39728': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:08,676 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:08,750 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39742': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:08,750 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:08,785 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39754': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:08,785 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:08,858 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39756': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:08,858 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:08,893 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39766': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:08,893 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:08,965 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39768': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:08,965 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:09,002 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39778': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:09,002 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:09,074 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39782': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:09,074 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:09,110 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39792': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:09,110 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:09,182 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39806': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:09,182 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:09,218 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39812': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:09,219 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:09,290 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39820': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:09,290 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:09,327 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39826': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:09,327 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:09,397 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39836': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:09,397 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:09,436 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39838': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:09,436 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:09,505 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39848': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:09,505 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:09,544 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39850': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:09,544 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:09,612 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:09,612 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39860': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:09,652 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39866': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:09,653 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:09,720 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39868': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:09,720 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:09,761 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39874': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:09,761 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:09,828 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39886': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:09,828 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:09,869 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39888': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:09,869 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:09,935 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39896': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:09,936 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:09,978 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39900': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:09,978 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:10,043 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39916': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:10,043 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:10,086 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:10,089 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39920': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:10,151 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39934': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:10,151 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:10,195 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39936': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:10,195 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:10,259 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39938': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:10,259 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:10,303 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39950': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:10,303 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:10,366 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39964': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:10,366 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:10,411 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39968': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:10,412 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:10,475 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:10,475 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:10,520 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:39990': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:10,520 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:10,583 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:10,585 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:40004': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:10,628 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:40018': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:10,629 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:10,690 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:40024': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:10,690 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:10,737 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:40028': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:10,737 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:10,798 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:40032': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:10,798 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:10,845 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:40048': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:10,845 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:10,905 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:40060': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:10,905 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:10,953 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:40070': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:10,953 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:11,013 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:40078': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:11,013 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:11,062 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:40090': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:11,062 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:11,120 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:40106': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:11,120 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:11,170 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:40118': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:11,170 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:11,228 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:40126': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:11,228 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:11,278 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:40128': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:11,278 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:11,336 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:40144': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:11,336 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:11,386 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:40150': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:11,387 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:11,443 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:40164': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:11,443 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:11,495 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:40176': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:11,495 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:11,551 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35906': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:11,551 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:11,604 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35922': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:11,604 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:11,660 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35930': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:11,660 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:11,712 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35944': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:11,712 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:11,768 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35950': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:11,768 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:11,821 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35956': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:11,821 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:11,875 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35966': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:11,875 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:11,929 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35982': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:11,929 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:11,983 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:11,983 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:12,037 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:35996': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:12,038 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:12,091 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36008': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:12,091 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:12,148 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36022': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:12,148 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:12,200 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36032': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:12,200 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:12,256 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36042': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:12,256 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:12,307 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36046': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:12,307 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:12,365 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36048': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:12,365 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:12,415 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36056': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:12,415 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:12,473 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36070': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:12,473 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:12,523 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36082': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:12,523 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:12,581 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36096': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:12,582 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:12,631 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36098': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:12,631 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:12,690 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36104': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:12,690 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:12,738 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36114': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:12,738 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:12,798 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:12,798 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:12,846 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36138': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:12,846 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:12,906 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36144': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:12,906 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:12,953 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36160': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:12,954 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:13,015 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36172': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:13,015 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:13,061 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36188': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:13,061 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:13,123 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36200': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:13,123 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:13,169 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36216': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:13,169 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:13,231 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36232': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:13,231 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:13,276 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36236': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:13,276 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:13,339 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36246': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:13,340 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:13,384 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36258': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:13,384 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:13,448 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36272': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:13,448 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:13,491 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36288': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:13,491 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:13,556 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36294': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:13,556 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:13,599 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36310': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:13,599 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:13,664 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36312': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:13,664 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:13,706 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36320': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:13,706 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:13,772 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36332': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:13,773 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:13,814 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36348': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:13,814 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:13,881 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36354': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:13,881 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:13,923 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36356': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:13,923 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:13,989 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36366': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:13,989 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:14,031 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36372': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:14,031 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:14,097 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36382': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:14,098 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:14,139 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36394': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:14,139 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:14,205 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36396': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:14,206 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:14,246 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36402': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:14,246 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:14,314 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36406': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:14,314 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:14,354 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36422': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:14,354 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:14,422 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36428': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:14,422 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:14,462 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36432': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:14,462 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:14,531 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36438': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:14,531 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:14,569 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36440': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:14,569 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:14,639 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36450': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:14,639 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:14,677 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36458': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:14,677 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:14,747 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36466': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:14,748 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:14,784 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36482': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:14,784 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:14,856 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36496': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:14,856 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:14,892 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36506': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:14,892 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:14,964 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36516': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:14,964 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:14,999 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36528': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:14,999 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:15,072 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36534': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:15,072 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:15,107 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36536': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:15,107 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:15,180 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36548': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:15,180 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:15,215 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36550': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:15,215 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:15,289 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36556': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:15,289 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:15,323 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36564': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:15,323 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:15,397 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36570': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:15,397 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:15,431 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36576': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:15,431 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:15,505 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36588': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:15,505 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:15,538 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36590': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:15,538 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:15,613 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36598': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:15,613 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:15,647 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36600': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:15,647 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:15,721 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36612': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:15,721 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:15,754 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36622': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:15,754 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:15,830 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36628': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:15,830 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:15,861 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36640': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:15,861 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:15,938 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36656': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:15,938 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:15,969 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36672': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:15,969 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:16,046 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36680': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:16,046 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:16,076 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36694': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:16,076 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:16,154 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36696': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:16,155 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:16,183 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36710': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:16,183 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:16,263 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36726': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:16,263 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:16,290 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36738': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:16,290 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:16,371 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36752': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:16,371 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:16,397 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36762': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:16,397 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:16,479 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36764': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:16,479 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:16,506 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36768': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:16,506 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:16,590 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36776': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:16,590 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:16,613 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36782': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:16,613 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:16,698 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36792': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:16,698 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:16,721 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36804': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:16,721 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:16,806 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36812': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:16,807 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:16,828 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36824': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:16,828 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:16,915 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36826': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:16,915 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:16,935 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36842': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:16,935 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:17,025 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36844': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:17,025 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:17,042 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36846': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:17,042 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:17,133 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36852': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:17,134 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:17,149 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36854': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:17,149 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:17,242 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36864': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:17,242 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:17,256 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36876': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:17,256 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:17,350 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36878': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:17,350 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:17,364 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36882': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:17,364 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:17,458 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36888': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:17,459 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:17,471 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36892': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:17,471 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:17,567 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36898': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:17,567 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:17,578 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36906': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:17,578 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:17,675 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36922': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:17,676 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:17,685 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36924': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:17,686 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:17,784 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36928': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:17,784 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:17,793 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36932': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:17,793 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:17,892 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36942': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:17,893 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:17,900 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36952': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:17,900 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:18,001 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36954': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:18,001 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:18,008 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36962': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:18,008 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:18,109 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36968': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:18,109 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:18,115 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36976': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:18,115 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:18,217 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36988': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:18,218 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:18,223 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:36996': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:18,223 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:18,326 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:18,330 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37010': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:18,330 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37022': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:18,330 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:18,435 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:18,438 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37024': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:18,439 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37038': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:18,439 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:18,543 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:18,546 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37044': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:18,547 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37060': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:18,547 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:18,651 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:18,654 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37076': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:18,655 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37078': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:18,655 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:18,760 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:18,763 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37082': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:18,764 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37098': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:18,764 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:18,868 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:18,872 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37106': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:18,873 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:18,873 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:18,977 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:18,980 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37132': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:18,981 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37134': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:18,981 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:19,086 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:19,095 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37142': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:19,095 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37156': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:19,095 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:19,194 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37170': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:19,194 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:19,203 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37184': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:19,203 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:19,302 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37194': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:19,303 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:19,311 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37202': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:19,311 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:19,411 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37206': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:19,411 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:19,418 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37218': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:19,418 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:19,520 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37222': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:19,520 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:19,525 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37224': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:19,525 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:19,628 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:19,632 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37232': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:19,633 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37236': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:19,633 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:19,736 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:19,740 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37244': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:19,741 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37252': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:19,741 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:19,844 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:19,848 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37260': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:19,849 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37274': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:19,849 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:19,953 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:19,956 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37276': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:19,957 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37288': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:19,957 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:20,061 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:20,064 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37300': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:20,065 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37310': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:20,065 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:20,169 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:20,172 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37324': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:20,173 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37326': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:20,173 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:20,277 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:20,281 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37332': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:20,282 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37348': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:20,282 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:20,386 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:20,389 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37358': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:20,390 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37374': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:20,390 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:20,494 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:20,497 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37386': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:20,498 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37390': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:20,498 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:20,602 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:20,606 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37400': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:20,606 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37408': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:20,606 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:20,710 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:20,714 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37410': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:20,715 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37422': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:20,715 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:20,819 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:20,823 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37430': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:20,824 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37446': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:20,824 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:20,927 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:20,930 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37448': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:20,931 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37454': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:20,931 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:21,035 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:21,039 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37464': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:21,039 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37474': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:21,039 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:21,144 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:21,147 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37476': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:21,148 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37484': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:21,148 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:21,252 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:21,256 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37492': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:21,256 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37500': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:21,257 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:21,361 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:21,364 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37504': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:21,365 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37518': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:21,365 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:21,469 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:21,472 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37522': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:21,473 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:37532': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:21,473 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:21,577 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:21,581 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:40426': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:21,582 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:21,585 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:40436': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:21,686 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:21,690 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:40450': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:21,690 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:40460': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:21,690 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:21,794 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:21,798 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:40476': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:21,799 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:40484': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:21,799 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:21,905 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:21,908 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:40494': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:21,909 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:40504': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:21,909 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:22,013 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:22,016 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:40518': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:22,017 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:40532': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:22,017 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:22,121 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:22,125 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:40548': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:22,126 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:40554': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:22,126 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:22,230 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:22,233 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:40568': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:22,234 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:40572': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:22,234 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:22,338 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:22,341 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:40580': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:22,342 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:40596': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:22,342 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:22,446 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:22,450 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:40600': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:22,451 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:40602': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:22,451 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:22,555 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:22,559 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:40604': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:22,560 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:40608': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:22,560 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:22,663 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:22,667 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:40624': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:22,667 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:40638': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:22,667 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:22,771 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:22,775 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:40652': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:22,776 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:40668': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:22,776 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:22,880 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:22,883 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:40676': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:22,884 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:40688': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:22,884 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:22,988 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:22,991 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:40704': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:22,992 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:40716': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:22,992 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:23,095 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:23,099 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:40732': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:23,100 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:40740': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:23,100 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:23,204 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:23,207 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:40748': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:23,208 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:40754': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:23,208 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:23,312 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:23,316 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:40762': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:23,317 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:40766': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:23,317 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:23,421 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:23,424 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:40778': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:23,425 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:40786': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:23,425 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:23,529 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:23,533 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:40790': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:23,533 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:40800': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:23,534 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:23,638 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:23,641 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:40814': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:23,642 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:40828': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:23,642 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:23,746 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:23,749 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:40834': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:23,750 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:40840': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:23,750 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:23,854 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:23,857 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:40854': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:23,858 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:40856': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:23,858 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:23,963 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:23,966 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:40868': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:23,967 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:40882': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:23,967 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:24,071 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:24,074 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:40898': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:24,075 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:40902': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:24,075 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:24,179 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:24,183 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:40910': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:24,183 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:40926': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:24,183 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:24,287 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:24,292 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:40928': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:24,292 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:40940': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:24,293 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:24,395 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:24,399 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:40950': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:24,400 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:40964': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:24,400 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:24,504 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:24,507 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:40972': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:24,508 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:40978': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:24,508 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:24,612 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:24,616 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:40986': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:24,616 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41002': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:24,616 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:24,720 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:24,724 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41006': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:24,725 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41020': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:24,725 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:24,829 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:24,832 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41034': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:24,833 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41038': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:24,833 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:24,937 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:24,940 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41050': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:24,941 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41062': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:24,941 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:25,045 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:25,049 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41072': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:25,049 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41088': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:25,050 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:25,153 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:25,157 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41092': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:25,158 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41106': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:25,158 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:25,262 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:25,265 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:25,266 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41126': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:25,266 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:25,370 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:25,373 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41142': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:25,374 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41154': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:25,374 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:25,478 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:25,482 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41156': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:25,483 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41158': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:25,483 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:25,590 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:25,593 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41164': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:25,594 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41172': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:25,594 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:25,698 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:25,702 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41178': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:25,702 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41188': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:25,703 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:25,806 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:25,810 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41196': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:25,811 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41208': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:25,811 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:25,915 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:25,918 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41216': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:25,919 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41222': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:25,919 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:26,023 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:26,027 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41234': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:26,028 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41244': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:26,028 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:26,131 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:26,134 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41252': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:26,135 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41256': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:26,135 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:26,239 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:26,239 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41268': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:26,245 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41280': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:26,245 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:26,347 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:26,351 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41288': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:26,352 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41290': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:26,352 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:26,455 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:26,459 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41302': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:26,459 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41314': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:26,460 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:26,564 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:26,567 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41324': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:26,568 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41340': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:26,568 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:26,672 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:26,675 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41346': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:26,676 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41358': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:26,676 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:26,783 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:26,786 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41370': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:26,787 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41380': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:26,787 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:26,891 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:26,894 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41392': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:26,895 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41404': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:26,895 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:26,999 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:27,002 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41418': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:27,003 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41430': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:27,003 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:27,107 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:27,111 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41436': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:27,112 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41438': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:27,112 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:27,216 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:27,219 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41442': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:27,220 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41446': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:27,220 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:27,324 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:27,327 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41456': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:27,328 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41460': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:27,328 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:27,432 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:27,436 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41462': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:27,436 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41476': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:27,436 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:27,540 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:27,544 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41486': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:27,545 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41502': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:27,545 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:27,649 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:27,652 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41510': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:27,653 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41522': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:27,653 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:27,757 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:27,762 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41528': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:27,762 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41530': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:27,763 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:27,866 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:27,869 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41540': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:27,870 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41548': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:27,870 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:27,974 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:27,978 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41554': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:27,978 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41566': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:27,979 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:28,083 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:28,090 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41582': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:28,090 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41596': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:28,090 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:28,191 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41608': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:28,191 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:28,197 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41612': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:28,197 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:28,299 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:28,299 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41626': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:28,305 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41634': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:28,305 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:28,407 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:28,411 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41642': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:28,412 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41658': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:28,412 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:28,516 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:28,519 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41666': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:28,520 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41676': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:28,520 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:28,624 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:28,627 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41680': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:28,629 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41690': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:28,629 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:28,732 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:28,736 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41704': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:28,737 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41718': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:28,737 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:28,841 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:28,844 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41730': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:28,845 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41746': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:28,845 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:28,949 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:28,952 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41748': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:28,953 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41758': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:28,953 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:29,057 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:29,061 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41762': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:29,062 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41774': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:29,062 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:29,165 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:29,169 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41790': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:29,170 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41800': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:29,170 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:29,274 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:29,278 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41812': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:29,278 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41818': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:29,278 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:29,382 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:29,386 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41832': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:29,387 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41834': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:29,387 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:29,490 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:29,495 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41838': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:29,495 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41842': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:29,495 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:29,598 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:29,602 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41850': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:29,603 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:29,603 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41856': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:29,707 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:29,710 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41866': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:29,711 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41878': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:29,711 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:29,815 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:29,818 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41892': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:29,819 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41894': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:29,819 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:29,923 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:29,927 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41902': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:29,928 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41918': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:29,927 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:30,031 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:30,035 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41932': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:30,036 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41936': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:30,036 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:30,139 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:30,143 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41940': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:30,144 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41946': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:30,144 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:30,248 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:30,251 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41952': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:30,252 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41962': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:30,252 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:30,356 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:30,360 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41976': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:30,360 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41980': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:30,360 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:30,464 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:30,468 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41988': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:30,469 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:41990': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:30,469 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:30,572 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:30,576 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42002': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:30,577 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42010': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:30,577 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:30,681 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:30,684 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42018': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:30,685 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42020': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:30,685 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:30,789 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:30,792 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42022': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:30,793 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42026': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:30,793 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:30,897 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:30,901 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42036': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:30,901 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42046': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:30,901 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:31,005 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:31,009 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:31,010 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42062': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:31,010 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:31,113 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42072': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:31,113 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s 2024-11-23 21:32:31,119 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36677': TLS handshake failed with remote 'tls://127.0.0.1:42084': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:32:31,119 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36677 3536s =================================== FAILURES =================================== 3536s ______________________________ test_preload_file _______________________________ 3536s 3536s self = 3536s deserializers = None 3536s 3536s async def read(self, deserializers=None): 3536s stream = self.stream 3536s if stream is None: 3536s raise CommClosedError() 3536s 3536s fmt = "Q" 3536s fmt_size = struct.calcsize(fmt) 3536s 3536s try: 3536s # Don't store multiple numpy or parquet buffers into the same buffer, or 3536s # none will be released until all are released. 3536s > frames_nosplit_nbytes_bin = await stream.read_bytes(fmt_size) 3536s E tornado.iostream.StreamClosedError: Stream is closed 3536s 3536s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:225: StreamClosedError 3536s 3536s The above exception was the direct cause of the following exception: 3536s 3536s loop = 3536s tmp_path = PosixPath('/tmp/pytest-of-ubuntu/pytest-0/test_preload_file0') 3536s 3536s def test_preload_file(loop, tmp_path): 3536s def check_scheduler(): 3536s import scheduler_info 3536s 3536s return scheduler_info.get_scheduler_address() 3536s 3536s path = tmp_path / "scheduler_info.py" 3536s with open(path, "w") as f: 3536s f.write(PRELOAD_TEXT) 3536s with tmpfile() as fn: 3536s with popen( 3536s [ 3536s "dask", 3536s "scheduler", 3536s "--scheduler-file", 3536s fn, 3536s "--preload", 3536s path, 3536s f"--port={open_port()}", 3536s ] 3536s ): 3536s with Client(scheduler_file=fn, loop=loop) as c: 3536s > assert c.run_on_scheduler(check_scheduler) == c.scheduler.address 3536s 3536s /usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py:342: 3536s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3536s /usr/lib/python3/dist-packages/distributed/client.py:2858: in run_on_scheduler 3536s return self.sync(self._run_on_scheduler, function, *args, **kwargs) 3536s /usr/lib/python3/dist-packages/distributed/utils.py:362: in sync 3536s return sync( 3536s /usr/lib/python3/dist-packages/distributed/utils.py:438: in sync 3536s raise error 3536s /usr/lib/python3/dist-packages/distributed/utils.py:412: in f 3536s result = yield future 3536s /usr/lib/python3/dist-packages/tornado/gen.py:766: in run 3536s value = future.result() 3536s /usr/lib/python3/dist-packages/distributed/client.py:2809: in _run_on_scheduler 3536s response = await self.scheduler.run_function( 3536s /usr/lib/python3/dist-packages/distributed/core.py:1395: in send_recv_from_rpc 3536s return await send_recv(comm=comm, op=key, **kwargs) 3536s /usr/lib/python3/dist-packages/distributed/core.py:1154: in send_recv 3536s response = await comm.read(deserializers=deserializers) 3536s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:236: in read 3536s convert_stream_closed_error(self, e) 3536s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3536s 3536s obj = 3536s exc = StreamClosedError('Stream is closed') 3536s 3536s def convert_stream_closed_error(obj, exc): 3536s """ 3536s Re-raise StreamClosedError as CommClosedError. 3536s """ 3536s if exc.real_error is not None: 3536s # The stream was closed because of an underlying OS error 3536s exc = exc.real_error 3536s if isinstance(exc, ssl.SSLError): 3536s if exc.reason and "UNKNOWN_CA" in exc.reason: 3536s raise FatalCommClosedError(f"in {obj}: {exc.__class__.__name__}: {exc}") 3536s raise CommClosedError(f"in {obj}: {exc.__class__.__name__}: {exc}") from exc 3536s else: 3536s > raise CommClosedError(f"in {obj}: {exc}") from exc 3536s E distributed.comm.core.CommClosedError: in : Stream is closed 3536s 3536s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:142: CommClosedError 3536s ----------------------------- Captured stderr call ----------------------------- 3536s 2024-11-23 20:51:28,983 - distributed.utils - INFO - Reload module scheduler_info from .py file 3536s 2024-11-23 20:51:28,985 - distributed.preloading - INFO - Import preload module: /tmp/pytest-of-ubuntu/pytest-0/test_preload_file0/scheduler_info.py 3536s 2024-11-23 20:51:28,986 - distributed.scheduler - INFO - ----------------------------------------------- 3536s 2024-11-23 20:51:28,989 - distributed.preloading - INFO - Creating preload: /tmp/pytest-of-ubuntu/pytest-0/test_preload_file0/scheduler_info.py 3536s 2024-11-23 20:51:28,990 - distributed.utils - INFO - Reload module scheduler_info from .py file 3536s 2024-11-23 20:51:28,991 - distributed.preloading - INFO - Import preload module: /tmp/pytest-of-ubuntu/pytest-0/test_preload_file0/scheduler_info.py 3536s 2024-11-23 20:51:29,026 - distributed.http.proxy - INFO - To route to workers diagnostics web server please install jupyter-server-proxy: python -m pip install jupyter-server-proxy 3536s 2024-11-23 20:51:29,031 - distributed.scheduler - INFO - State start 3536s 2024-11-23 20:51:29,041 - distributed.scheduler - INFO - ----------------------------------------------- 3536s 2024-11-23 20:51:29,043 - distributed.scheduler - INFO - Scheduler at: tcp://10.0.4.73:43639 3536s 2024-11-23 20:51:29,044 - distributed.scheduler - INFO - dashboard at: http://10.0.4.73:8787/status 3536s 2024-11-23 20:51:29,044 - distributed.preloading - INFO - Run preload setup: /tmp/pytest-of-ubuntu/pytest-0/test_preload_file0/scheduler_info.py 3536s 2024-11-23 20:51:29,045 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3536s 2024-11-23 20:51:29,059 - distributed.scheduler - INFO - Receive client connection: Client-b5dbad63-a9dc-11ef-8ed0-00163e4db70f 3536s 2024-11-23 20:51:29,508 - distributed.core - INFO - Starting established connection to tcp://10.0.4.73:36380 3536s 2024-11-23 20:51:29,513 - distributed.worker - INFO - Run out-of-band function 'check_scheduler' 3536s 2024-11-23 20:51:29,992 - distributed.client - ERROR - 3536s ConnectionRefusedError: [Errno 111] Connection refused 3536s 3536s The above exception was the direct cause of the following exception: 3536s 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3536s comm = await wait_for( 3536s ^^^^^^^^^^^^^^^ 3536s ...<2 lines>... 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3536s return await fut 3536s ^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 559, in connect 3536s convert_stream_closed_error(self, e) 3536s ~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 140, in convert_stream_closed_error 3536s raise CommClosedError(f"in {obj}: {exc.__class__.__name__}: {exc}") from exc 3536s distributed.comm.core.CommClosedError: in : ConnectionRefusedError: [Errno 111] Connection refused 3536s 3536s During handling of the above exception, another exception occurred: 3536s 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 836, in wrapper 3536s return await func(*args, **kwargs) 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/client.py", line 1331, in _reconnect 3536s await self._ensure_connected(timeout=timeout) 3536s File "/usr/lib/python3/dist-packages/distributed/client.py", line 1361, in _ensure_connected 3536s comm = await connect( 3536s ^^^^^^^^^^^^^^ 3536s self.scheduler.address, timeout=timeout, **self.connection_args 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 366, in connect 3536s await asyncio.sleep(backoff) 3536s File "/usr/lib/python3.13/asyncio/tasks.py", line 718, in sleep 3536s return await future 3536s ^^^^^^^^^^^^ 3536s asyncio.exceptions.CancelledError 3536s _____________________________ test_preload_module ______________________________ 3536s 3536s self = 3536s deserializers = None 3536s 3536s async def read(self, deserializers=None): 3536s stream = self.stream 3536s if stream is None: 3536s raise CommClosedError() 3536s 3536s fmt = "Q" 3536s fmt_size = struct.calcsize(fmt) 3536s 3536s try: 3536s # Don't store multiple numpy or parquet buffers into the same buffer, or 3536s # none will be released until all are released. 3536s > frames_nosplit_nbytes_bin = await stream.read_bytes(fmt_size) 3536s E tornado.iostream.StreamClosedError: Stream is closed 3536s 3536s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:225: StreamClosedError 3536s 3536s The above exception was the direct cause of the following exception: 3536s 3536s loop = 3536s tmp_path = PosixPath('/tmp/pytest-of-ubuntu/pytest-0/test_preload_module0') 3536s 3536s def test_preload_module(loop, tmp_path): 3536s def check_scheduler(): 3536s import scheduler_info 3536s 3536s return scheduler_info.get_scheduler_address() 3536s 3536s path = tmp_path / "scheduler_info.py" 3536s with open(path, "w") as f: 3536s f.write(PRELOAD_TEXT) 3536s env = os.environ.copy() 3536s if "PYTHONPATH" in env: 3536s env["PYTHONPATH"] = str(tmp_path) + ":" + env["PYTHONPATH"] 3536s else: 3536s env["PYTHONPATH"] = str(tmp_path) 3536s with tmpfile() as fn: 3536s with popen( 3536s [ 3536s "dask", 3536s "scheduler", 3536s "--scheduler-file", 3536s fn, 3536s "--preload", 3536s "scheduler_info", 3536s f"--port={open_port()}", 3536s ], 3536s env=env, 3536s ): 3536s with Client(scheduler_file=fn, loop=loop) as c: 3536s > assert c.run_on_scheduler(check_scheduler) == c.scheduler.address 3536s 3536s /usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py:373: 3536s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3536s /usr/lib/python3/dist-packages/distributed/client.py:2858: in run_on_scheduler 3536s return self.sync(self._run_on_scheduler, function, *args, **kwargs) 3536s /usr/lib/python3/dist-packages/distributed/utils.py:362: in sync 3536s return sync( 3536s /usr/lib/python3/dist-packages/distributed/utils.py:438: in sync 3536s raise error 3536s /usr/lib/python3/dist-packages/distributed/utils.py:412: in f 3536s result = yield future 3536s /usr/lib/python3/dist-packages/tornado/gen.py:766: in run 3536s value = future.result() 3536s /usr/lib/python3/dist-packages/distributed/client.py:2809: in _run_on_scheduler 3536s response = await self.scheduler.run_function( 3536s /usr/lib/python3/dist-packages/distributed/core.py:1395: in send_recv_from_rpc 3536s return await send_recv(comm=comm, op=key, **kwargs) 3536s /usr/lib/python3/dist-packages/distributed/core.py:1154: in send_recv 3536s response = await comm.read(deserializers=deserializers) 3536s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:236: in read 3536s convert_stream_closed_error(self, e) 3536s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3536s 3536s obj = 3536s exc = StreamClosedError('Stream is closed') 3536s 3536s def convert_stream_closed_error(obj, exc): 3536s """ 3536s Re-raise StreamClosedError as CommClosedError. 3536s """ 3536s if exc.real_error is not None: 3536s # The stream was closed because of an underlying OS error 3536s exc = exc.real_error 3536s if isinstance(exc, ssl.SSLError): 3536s if exc.reason and "UNKNOWN_CA" in exc.reason: 3536s raise FatalCommClosedError(f"in {obj}: {exc.__class__.__name__}: {exc}") 3536s raise CommClosedError(f"in {obj}: {exc.__class__.__name__}: {exc}") from exc 3536s else: 3536s > raise CommClosedError(f"in {obj}: {exc}") from exc 3536s E distributed.comm.core.CommClosedError: in : Stream is closed 3536s 3536s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:142: CommClosedError 3536s ----------------------------- Captured stderr call ----------------------------- 3536s 2024-11-23 20:51:31,083 - distributed.preloading - INFO - Import preload module: scheduler_info 3536s 2024-11-23 20:51:31,085 - distributed.scheduler - INFO - ----------------------------------------------- 3536s 2024-11-23 20:51:31,087 - distributed.preloading - INFO - Creating preload: scheduler_info 3536s 2024-11-23 20:51:31,087 - distributed.preloading - INFO - Import preload module: scheduler_info 3536s 2024-11-23 20:51:31,111 - distributed.http.proxy - INFO - To route to workers diagnostics web server please install jupyter-server-proxy: python -m pip install jupyter-server-proxy 3536s 2024-11-23 20:51:31,115 - distributed.scheduler - INFO - State start 3536s 2024-11-23 20:51:31,117 - distributed.diskutils - INFO - Found stale lock file and directory '/tmp/dask-scratch-space/scheduler-0a1zaqpb', purging 3536s 2024-11-23 20:51:31,126 - distributed.scheduler - INFO - ----------------------------------------------- 3536s 2024-11-23 20:51:31,127 - distributed.scheduler - INFO - Scheduler at: tcp://10.0.4.73:35511 3536s 2024-11-23 20:51:31,128 - distributed.scheduler - INFO - dashboard at: http://10.0.4.73:8787/status 3536s 2024-11-23 20:51:31,128 - distributed.preloading - INFO - Run preload setup: scheduler_info 3536s 2024-11-23 20:51:31,129 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3536s 2024-11-23 20:51:31,142 - distributed.scheduler - INFO - Receive client connection: Client-b73aa864-a9dc-11ef-8ed0-00163e4db70f 3536s 2024-11-23 20:51:31,489 - distributed.core - INFO - Starting established connection to tcp://10.0.4.73:49456 3536s 2024-11-23 20:51:31,496 - distributed.worker - INFO - Run out-of-band function 'check_scheduler' 3536s 2024-11-23 20:51:32,040 - distributed.client - ERROR - 3536s ConnectionRefusedError: [Errno 111] Connection refused 3536s 3536s The above exception was the direct cause of the following exception: 3536s 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3536s comm = await wait_for( 3536s ^^^^^^^^^^^^^^^ 3536s ...<2 lines>... 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3536s return await fut 3536s ^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 559, in connect 3536s convert_stream_closed_error(self, e) 3536s ~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 140, in convert_stream_closed_error 3536s raise CommClosedError(f"in {obj}: {exc.__class__.__name__}: {exc}") from exc 3536s distributed.comm.core.CommClosedError: in : ConnectionRefusedError: [Errno 111] Connection refused 3536s 3536s During handling of the above exception, another exception occurred: 3536s 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 836, in wrapper 3536s return await func(*args, **kwargs) 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/client.py", line 1331, in _reconnect 3536s await self._ensure_connected(timeout=timeout) 3536s File "/usr/lib/python3/dist-packages/distributed/client.py", line 1361, in _ensure_connected 3536s comm = await connect( 3536s ^^^^^^^^^^^^^^ 3536s self.scheduler.address, timeout=timeout, **self.connection_args 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 366, in connect 3536s await asyncio.sleep(backoff) 3536s File "/usr/lib/python3.13/asyncio/tasks.py", line 718, in sleep 3536s return await future 3536s ^^^^^^^^^^^^ 3536s asyncio.exceptions.CancelledError 3536s __________________________ test_preload_remote_module __________________________ 3536s 3536s self = 3536s deserializers = None 3536s 3536s async def read(self, deserializers=None): 3536s stream = self.stream 3536s if stream is None: 3536s raise CommClosedError() 3536s 3536s fmt = "Q" 3536s fmt_size = struct.calcsize(fmt) 3536s 3536s try: 3536s # Don't store multiple numpy or parquet buffers into the same buffer, or 3536s # none will be released until all are released. 3536s > frames_nosplit_nbytes_bin = await stream.read_bytes(fmt_size) 3536s E tornado.iostream.StreamClosedError: Stream is closed 3536s 3536s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:225: StreamClosedError 3536s 3536s The above exception was the direct cause of the following exception: 3536s 3536s loop = 3536s tmp_path = PosixPath('/tmp/pytest-of-ubuntu/pytest-0/test_preload_remote_module0') 3536s 3536s def test_preload_remote_module(loop, tmp_path): 3536s with open(tmp_path / "scheduler_info.py", "w") as f: 3536s f.write(PRELOAD_TEXT) 3536s http_server_port = open_port() 3536s with popen( 3536s [sys.executable, "-m", "http.server", str(http_server_port)], cwd=tmp_path 3536s ): 3536s with popen( 3536s [ 3536s "dask", 3536s "scheduler", 3536s "--scheduler-file", 3536s str(tmp_path / "scheduler-file.json"), 3536s "--preload", 3536s f"http://localhost:{http_server_port}/scheduler_info.py", 3536s f"--port={open_port()}", 3536s ] 3536s ) as proc: 3536s with Client( 3536s scheduler_file=tmp_path / "scheduler-file.json", loop=loop 3536s ) as c: 3536s > assert ( 3536s c.run_on_scheduler( 3536s lambda dask_scheduler: getattr(dask_scheduler, "foo", None) 3536s ) 3536s == "bar" 3536s ) 3536s 3536s /usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py:397: 3536s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3536s /usr/lib/python3/dist-packages/distributed/client.py:2858: in run_on_scheduler 3536s return self.sync(self._run_on_scheduler, function, *args, **kwargs) 3536s /usr/lib/python3/dist-packages/distributed/utils.py:362: in sync 3536s return sync( 3536s /usr/lib/python3/dist-packages/distributed/utils.py:438: in sync 3536s raise error 3536s /usr/lib/python3/dist-packages/distributed/utils.py:412: in f 3536s result = yield future 3536s /usr/lib/python3/dist-packages/tornado/gen.py:766: in run 3536s value = future.result() 3536s /usr/lib/python3/dist-packages/distributed/client.py:2809: in _run_on_scheduler 3536s response = await self.scheduler.run_function( 3536s /usr/lib/python3/dist-packages/distributed/core.py:1395: in send_recv_from_rpc 3536s return await send_recv(comm=comm, op=key, **kwargs) 3536s /usr/lib/python3/dist-packages/distributed/core.py:1154: in send_recv 3536s response = await comm.read(deserializers=deserializers) 3536s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:236: in read 3536s convert_stream_closed_error(self, e) 3536s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3536s 3536s obj = 3536s exc = StreamClosedError('Stream is closed') 3536s 3536s def convert_stream_closed_error(obj, exc): 3536s """ 3536s Re-raise StreamClosedError as CommClosedError. 3536s """ 3536s if exc.real_error is not None: 3536s # The stream was closed because of an underlying OS error 3536s exc = exc.real_error 3536s if isinstance(exc, ssl.SSLError): 3536s if exc.reason and "UNKNOWN_CA" in exc.reason: 3536s raise FatalCommClosedError(f"in {obj}: {exc.__class__.__name__}: {exc}") 3536s raise CommClosedError(f"in {obj}: {exc.__class__.__name__}: {exc}") from exc 3536s else: 3536s > raise CommClosedError(f"in {obj}: {exc}") from exc 3536s E distributed.comm.core.CommClosedError: in : Stream is closed 3536s 3536s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:142: CommClosedError 3536s ----------------------------- Captured stdout call ----------------------------- 3536s Serving HTTP on 0.0.0.0 port 39473 (http://0.0.0.0:39473/) ... 3536s 3536s Keyboard interrupt received, exiting. 3536s ----------------------------- Captured stderr call ----------------------------- 3536s 2024-11-23 20:51:33,216 - distributed.scheduler - INFO - ----------------------------------------------- 3536s 2024-11-23 20:51:33,219 - distributed.preloading - INFO - Creating preload: http://localhost:39473/scheduler_info.py 3536s 2024-11-23 20:51:33,219 - distributed.preloading - INFO - Downloading preload at http://localhost:39473/scheduler_info.py 3536s 127.0.0.1 - - [23/Nov/2024 20:51:33] "GET /scheduler_info.py HTTP/1.1" 200 - 3536s 2024-11-23 20:51:33,287 - distributed.http.proxy - INFO - To route to workers diagnostics web server please install jupyter-server-proxy: python -m pip install jupyter-server-proxy 3536s 2024-11-23 20:51:33,290 - distributed.scheduler - INFO - State start 3536s 2024-11-23 20:51:33,292 - distributed.diskutils - INFO - Found stale lock file and directory '/tmp/dask-scratch-space/scheduler-g70udiwi', purging 3536s 2024-11-23 20:51:33,304 - distributed.scheduler - INFO - ----------------------------------------------- 3536s 2024-11-23 20:51:33,306 - distributed.scheduler - INFO - Scheduler at: tcp://10.0.4.73:38541 3536s 2024-11-23 20:51:33,306 - distributed.scheduler - INFO - dashboard at: http://10.0.4.73:8787/status 3536s 2024-11-23 20:51:33,307 - distributed.preloading - INFO - Run preload setup: http://localhost:39473/scheduler_info.py 3536s 2024-11-23 20:51:33,307 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3536s 2024-11-23 20:51:33,322 - distributed.scheduler - INFO - Receive client connection: Client-b8689bc5-a9dc-11ef-8ed0-00163e4db70f 3536s 2024-11-23 20:51:33,773 - distributed.core - INFO - Starting established connection to tcp://10.0.4.73:33392 3536s 2024-11-23 20:51:33,779 - distributed.worker - INFO - Run out-of-band function 'lambda' 3536s 2024-11-23 20:51:34,288 - distributed.client - ERROR - 3536s ConnectionRefusedError: [Errno 111] Connection refused 3536s 3536s The above exception was the direct cause of the following exception: 3536s 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3536s comm = await wait_for( 3536s ^^^^^^^^^^^^^^^ 3536s ...<2 lines>... 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3536s return await fut 3536s ^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 559, in connect 3536s convert_stream_closed_error(self, e) 3536s ~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 140, in convert_stream_closed_error 3536s raise CommClosedError(f"in {obj}: {exc.__class__.__name__}: {exc}") from exc 3536s distributed.comm.core.CommClosedError: in : ConnectionRefusedError: [Errno 111] Connection refused 3536s 3536s During handling of the above exception, another exception occurred: 3536s 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 836, in wrapper 3536s return await func(*args, **kwargs) 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/client.py", line 1331, in _reconnect 3536s await self._ensure_connected(timeout=timeout) 3536s File "/usr/lib/python3/dist-packages/distributed/client.py", line 1361, in _ensure_connected 3536s comm = await connect( 3536s ^^^^^^^^^^^^^^ 3536s self.scheduler.address, timeout=timeout, **self.connection_args 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 366, in connect 3536s await asyncio.sleep(backoff) 3536s File "/usr/lib/python3.13/asyncio/tasks.py", line 718, in sleep 3536s return await future 3536s ^^^^^^^^^^^^ 3536s asyncio.exceptions.CancelledError 3536s _____________________________ test_preload_config ______________________________ 3536s 3536s loop = 3536s 3536s def test_preload_config(loop): 3536s # Ensure dask scheduler pulls the preload from the Dask config if 3536s # not specified via a command line option 3536s with tmpfile() as fn: 3536s env = os.environ.copy() 3536s env["DASK_DISTRIBUTED__SCHEDULER__PRELOAD"] = PRELOAD_TEXT 3536s with popen(["dask", "scheduler", "--scheduler-file", fn], env=env): 3536s with Client(scheduler_file=fn, loop=loop) as c: 3536s > assert ( 3536s c.run_on_scheduler(lambda dask_scheduler: dask_scheduler.foo) 3536s == "bar" 3536s ) 3536s 3536s /usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py:413: 3536s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3536s /usr/lib/python3/dist-packages/distributed/client.py:2858: in run_on_scheduler 3536s return self.sync(self._run_on_scheduler, function, *args, **kwargs) 3536s /usr/lib/python3/dist-packages/distributed/utils.py:362: in sync 3536s return sync( 3536s /usr/lib/python3/dist-packages/distributed/utils.py:438: in sync 3536s raise error 3536s /usr/lib/python3/dist-packages/distributed/utils.py:412: in f 3536s result = yield future 3536s /usr/lib/python3/dist-packages/tornado/gen.py:766: in run 3536s value = future.result() 3536s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3536s 3536s self = 3536s function = . at 0xe1d8e708> 3536s wait = True, args = (), kwargs = {} 3536s response = {'exception': b'\x80\x05\x953\x02\x00\x00\x00\x00\x00\x00\x8c\x16tblib.pickling_support\x94\x8c\x12unpickle_exception\...ext': "SystemError('no locals found when setting up annotations')", 'status': 'error', 'traceback': b'\x80\x05N.', ...} 3536s typ = 3536s exc = SystemError('no locals found when setting up annotations'), tb = None 3536s 3536s async def _run_on_scheduler(self, function, *args, wait=True, **kwargs): 3536s response = await self.scheduler.run_function( 3536s function=dumps(function), 3536s args=dumps(args), 3536s kwargs=dumps(kwargs), 3536s wait=wait, 3536s ) 3536s if response["status"] == "error": 3536s typ, exc, tb = clean_exception(**response) 3536s > raise exc.with_traceback(tb) 3536s E SystemError: no locals found when setting up annotations 3536s 3536s /usr/lib/python3/dist-packages/distributed/client.py:2817: SystemError 3536s ----------------------------- Captured stderr call ----------------------------- 3536s 2024-11-23 20:51:35,380 - distributed.scheduler - INFO - ----------------------------------------------- 3536s 2024-11-23 20:51:35,383 - distributed.preloading - INFO - Creating preload: 3536s _scheduler_info = {} 3536s 3536s def dask_setup(scheduler): 3536s _scheduler_info['address'] = scheduler.address 3536s scheduler.foo = "bar" 3536s 3536s def get_scheduler_address(): 3536s return _scheduler_info['address'] 3536s 3536s 2024-11-23 20:51:35,384 - distributed.utils - INFO - Reload module tmpnd7z445d from .py file 3536s 2024-11-23 20:51:35,386 - distributed.preloading - INFO - Import preload module: /tmp/tmpnd7z445d.py 3536s 2024-11-23 20:51:35,413 - distributed.http.proxy - INFO - To route to workers diagnostics web server please install jupyter-server-proxy: python -m pip install jupyter-server-proxy 3536s 2024-11-23 20:51:35,417 - distributed.scheduler - INFO - State start 3536s 2024-11-23 20:51:35,418 - distributed.diskutils - INFO - Found stale lock file and directory '/tmp/dask-scratch-space/scheduler-2gbnwt4k', purging 3536s 2024-11-23 20:51:35,427 - distributed.scheduler - INFO - ----------------------------------------------- 3536s 2024-11-23 20:51:35,428 - distributed.scheduler - INFO - Scheduler at: tcp://10.0.4.73:8786 3536s 2024-11-23 20:51:35,429 - distributed.scheduler - INFO - dashboard at: http://10.0.4.73:8787/status 3536s 2024-11-23 20:51:35,429 - distributed.preloading - INFO - Run preload setup: 3536s _scheduler_info = {} 3536s 3536s def dask_setup(scheduler): 3536s _scheduler_info['address'] = scheduler.address 3536s scheduler.foo = "bar" 3536s 3536s def get_scheduler_address(): 3536s return _scheduler_info['address'] 3536s 3536s 2024-11-23 20:51:35,430 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3536s 2024-11-23 20:51:35,444 - distributed.scheduler - INFO - Receive client connection: Client-b9c6f0cf-a9dc-11ef-8ed0-00163e4db70f 3536s 2024-11-23 20:51:35,818 - distributed.core - INFO - Starting established connection to tcp://10.0.4.73:47462 3536s 2024-11-23 20:51:35,824 - distributed.worker - INFO - Run out-of-band function 'lambda' 3536s 2024-11-23 20:51:35,824 - distributed.worker - WARNING - Run Failed 3536s Function: lambda 3536s args: () 3536s kwargs: {'dask_scheduler': } 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 3182, in run 3536s result = function(*args, **kwargs) 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s SystemError: no locals found when setting up annotations 3536s 2024-11-23 20:51:35,833 - distributed.scheduler - INFO - Remove client Client-b9c6f0cf-a9dc-11ef-8ed0-00163e4db70f 3536s 2024-11-23 20:51:35,833 - distributed.core - INFO - Received 'close-stream' from tcp://10.0.4.73:47462; closing. 3536s 2024-11-23 20:51:35,834 - distributed.scheduler - INFO - Remove client Client-b9c6f0cf-a9dc-11ef-8ed0-00163e4db70f 3536s 2024-11-23 20:51:35,834 - distributed.scheduler - INFO - Close client connection: Client-b9c6f0cf-a9dc-11ef-8ed0-00163e4db70f 3536s 2024-11-23 20:51:35,835 - distributed._signals - INFO - Received signal SIGINT (2) 3536s 2024-11-23 20:51:35,835 - distributed.scheduler - INFO - Scheduler closing due to signal-2... 3536s 2024-11-23 20:51:35,836 - distributed.scheduler - INFO - Scheduler closing all comms 3536s 2024-11-23 20:51:35,837 - distributed.scheduler - INFO - Stopped scheduler at 'tcp://10.0.4.73:8786' 3536s 2024-11-23 20:51:35,837 - distributed.scheduler - INFO - End scheduler 3536s _____________________________ test_preload_command _____________________________ 3536s 3536s self = 3536s deserializers = None 3536s 3536s async def read(self, deserializers=None): 3536s stream = self.stream 3536s if stream is None: 3536s raise CommClosedError() 3536s 3536s fmt = "Q" 3536s fmt_size = struct.calcsize(fmt) 3536s 3536s try: 3536s # Don't store multiple numpy or parquet buffers into the same buffer, or 3536s # none will be released until all are released. 3536s > frames_nosplit_nbytes_bin = await stream.read_bytes(fmt_size) 3536s E tornado.iostream.StreamClosedError: Stream is closed 3536s 3536s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:225: StreamClosedError 3536s 3536s The above exception was the direct cause of the following exception: 3536s 3536s loop = 3536s 3536s def test_preload_command(loop): 3536s def check_passthrough(): 3536s import passthrough_info 3536s 3536s return passthrough_info.get_passthrough() 3536s 3536s tmpdir = tempfile.mkdtemp() 3536s try: 3536s path = os.path.join(tmpdir, "passthrough_info.py") 3536s with open(path, "w") as f: 3536s f.write(PRELOAD_COMMAND_TEXT) 3536s 3536s with tmpfile() as fn: 3536s print(fn) 3536s with popen( 3536s [ 3536s "dask", 3536s "scheduler", 3536s "--scheduler-file", 3536s fn, 3536s "--preload", 3536s path, 3536s "--passthrough", 3536s "foobar", 3536s ] 3536s ): 3536s with Client(scheduler_file=fn, loop=loop) as c: 3536s > assert c.run_on_scheduler(check_passthrough) == "foobar" 3536s 3536s /usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py:460: 3536s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3536s /usr/lib/python3/dist-packages/distributed/client.py:2858: in run_on_scheduler 3536s return self.sync(self._run_on_scheduler, function, *args, **kwargs) 3536s /usr/lib/python3/dist-packages/distributed/utils.py:362: in sync 3536s return sync( 3536s /usr/lib/python3/dist-packages/distributed/utils.py:438: in sync 3536s raise error 3536s /usr/lib/python3/dist-packages/distributed/utils.py:412: in f 3536s result = yield future 3536s /usr/lib/python3/dist-packages/tornado/gen.py:766: in run 3536s value = future.result() 3536s /usr/lib/python3/dist-packages/distributed/client.py:2809: in _run_on_scheduler 3536s response = await self.scheduler.run_function( 3536s /usr/lib/python3/dist-packages/distributed/core.py:1395: in send_recv_from_rpc 3536s return await send_recv(comm=comm, op=key, **kwargs) 3536s /usr/lib/python3/dist-packages/distributed/core.py:1154: in send_recv 3536s response = await comm.read(deserializers=deserializers) 3536s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:236: in read 3536s convert_stream_closed_error(self, e) 3536s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3536s 3536s obj = 3536s exc = StreamClosedError('Stream is closed') 3536s 3536s def convert_stream_closed_error(obj, exc): 3536s """ 3536s Re-raise StreamClosedError as CommClosedError. 3536s """ 3536s if exc.real_error is not None: 3536s # The stream was closed because of an underlying OS error 3536s exc = exc.real_error 3536s if isinstance(exc, ssl.SSLError): 3536s if exc.reason and "UNKNOWN_CA" in exc.reason: 3536s raise FatalCommClosedError(f"in {obj}: {exc.__class__.__name__}: {exc}") 3536s raise CommClosedError(f"in {obj}: {exc.__class__.__name__}: {exc}") from exc 3536s else: 3536s > raise CommClosedError(f"in {obj}: {exc}") from exc 3536s E distributed.comm.core.CommClosedError: in : Stream is closed 3536s 3536s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:142: CommClosedError 3536s ----------------------------- Captured stdout call ----------------------------- 3536s /tmp/tmpu8_a8hv3 3536s ----------------------------- Captured stderr call ----------------------------- 3536s 2024-11-23 20:51:37,162 - distributed.utils - INFO - Reload module passthrough_info from .py file 3536s 2024-11-23 20:51:37,164 - distributed.preloading - INFO - Import preload module: /tmp/tmp4ho6snkn/passthrough_info.py 3536s 2024-11-23 20:51:37,166 - distributed.scheduler - INFO - ----------------------------------------------- 3536s 2024-11-23 20:51:37,168 - distributed.preloading - INFO - Creating preload: /tmp/tmp4ho6snkn/passthrough_info.py 3536s 2024-11-23 20:51:37,169 - distributed.utils - INFO - Reload module passthrough_info from .py file 3536s 2024-11-23 20:51:37,170 - distributed.preloading - INFO - Import preload module: /tmp/tmp4ho6snkn/passthrough_info.py 3536s 2024-11-23 20:51:37,195 - distributed.http.proxy - INFO - To route to workers diagnostics web server please install jupyter-server-proxy: python -m pip install jupyter-server-proxy 3536s 2024-11-23 20:51:37,199 - distributed.scheduler - INFO - State start 3536s 2024-11-23 20:51:37,210 - distributed.scheduler - INFO - ----------------------------------------------- 3536s 2024-11-23 20:51:37,211 - distributed.scheduler - INFO - Scheduler at: tcp://10.0.4.73:8786 3536s 2024-11-23 20:51:37,211 - distributed.scheduler - INFO - dashboard at: http://10.0.4.73:8787/status 3536s 2024-11-23 20:51:37,212 - distributed.preloading - INFO - Run preload setup: /tmp/tmp4ho6snkn/passthrough_info.py 3536s 2024-11-23 20:51:37,213 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3536s 2024-11-23 20:51:37,228 - distributed.scheduler - INFO - Receive client connection: Client-bad8978c-a9dc-11ef-8ed0-00163e4db70f 3536s 2024-11-23 20:51:37,588 - distributed.core - INFO - Starting established connection to tcp://10.0.4.73:47486 3536s 2024-11-23 20:51:37,596 - distributed.worker - INFO - Run out-of-band function 'check_passthrough' 3536s 2024-11-23 20:51:38,081 - distributed.client - ERROR - 3536s ConnectionRefusedError: [Errno 111] Connection refused 3536s 3536s The above exception was the direct cause of the following exception: 3536s 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3536s comm = await wait_for( 3536s ^^^^^^^^^^^^^^^ 3536s ...<2 lines>... 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3536s return await fut 3536s ^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 559, in connect 3536s convert_stream_closed_error(self, e) 3536s ~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 140, in convert_stream_closed_error 3536s raise CommClosedError(f"in {obj}: {exc.__class__.__name__}: {exc}") from exc 3536s distributed.comm.core.CommClosedError: in : ConnectionRefusedError: [Errno 111] Connection refused 3536s 3536s During handling of the above exception, another exception occurred: 3536s 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 836, in wrapper 3536s return await func(*args, **kwargs) 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/client.py", line 1331, in _reconnect 3536s await self._ensure_connected(timeout=timeout) 3536s File "/usr/lib/python3/dist-packages/distributed/client.py", line 1361, in _ensure_connected 3536s comm = await connect( 3536s ^^^^^^^^^^^^^^ 3536s self.scheduler.address, timeout=timeout, **self.connection_args 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 366, in connect 3536s await asyncio.sleep(backoff) 3536s File "/usr/lib/python3.13/asyncio/tasks.py", line 718, in sleep 3536s return await future 3536s ^^^^^^^^^^^^ 3536s asyncio.exceptions.CancelledError 3536s _________________________ test_preload_command_default _________________________ 3536s 3536s self = 3536s deserializers = None 3536s 3536s async def read(self, deserializers=None): 3536s stream = self.stream 3536s if stream is None: 3536s raise CommClosedError() 3536s 3536s fmt = "Q" 3536s fmt_size = struct.calcsize(fmt) 3536s 3536s try: 3536s # Don't store multiple numpy or parquet buffers into the same buffer, or 3536s # none will be released until all are released. 3536s > frames_nosplit_nbytes_bin = await stream.read_bytes(fmt_size) 3536s E tornado.iostream.StreamClosedError: Stream is closed 3536s 3536s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:225: StreamClosedError 3536s 3536s The above exception was the direct cause of the following exception: 3536s 3536s loop = 3536s 3536s def test_preload_command_default(loop): 3536s def check_passthrough(): 3536s import passthrough_info 3536s 3536s return passthrough_info.get_passthrough() 3536s 3536s tmpdir = tempfile.mkdtemp() 3536s try: 3536s path = os.path.join(tmpdir, "passthrough_info.py") 3536s with open(path, "w") as f: 3536s f.write(PRELOAD_COMMAND_TEXT) 3536s 3536s with tmpfile() as fn2: 3536s print(fn2) 3536s with popen( 3536s ["dask", "scheduler", "--scheduler-file", fn2, "--preload", path], 3536s stdout=sys.stdout, 3536s stderr=sys.stderr, 3536s ): 3536s with Client(scheduler_file=fn2, loop=loop) as c: 3536s > assert c.run_on_scheduler(check_passthrough) == "default" 3536s 3536s /usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py:485: 3536s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3536s /usr/lib/python3/dist-packages/distributed/client.py:2858: in run_on_scheduler 3536s return self.sync(self._run_on_scheduler, function, *args, **kwargs) 3536s /usr/lib/python3/dist-packages/distributed/utils.py:362: in sync 3536s return sync( 3536s /usr/lib/python3/dist-packages/distributed/utils.py:438: in sync 3536s raise error 3536s /usr/lib/python3/dist-packages/distributed/utils.py:412: in f 3536s result = yield future 3536s /usr/lib/python3/dist-packages/tornado/gen.py:766: in run 3536s value = future.result() 3536s /usr/lib/python3/dist-packages/distributed/client.py:2809: in _run_on_scheduler 3536s response = await self.scheduler.run_function( 3536s /usr/lib/python3/dist-packages/distributed/core.py:1395: in send_recv_from_rpc 3536s return await send_recv(comm=comm, op=key, **kwargs) 3536s /usr/lib/python3/dist-packages/distributed/core.py:1154: in send_recv 3536s response = await comm.read(deserializers=deserializers) 3536s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:236: in read 3536s convert_stream_closed_error(self, e) 3536s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3536s 3536s obj = 3536s exc = StreamClosedError('Stream is closed') 3536s 3536s def convert_stream_closed_error(obj, exc): 3536s """ 3536s Re-raise StreamClosedError as CommClosedError. 3536s """ 3536s if exc.real_error is not None: 3536s # The stream was closed because of an underlying OS error 3536s exc = exc.real_error 3536s if isinstance(exc, ssl.SSLError): 3536s if exc.reason and "UNKNOWN_CA" in exc.reason: 3536s raise FatalCommClosedError(f"in {obj}: {exc.__class__.__name__}: {exc}") 3536s raise CommClosedError(f"in {obj}: {exc.__class__.__name__}: {exc}") from exc 3536s else: 3536s > raise CommClosedError(f"in {obj}: {exc}") from exc 3536s E distributed.comm.core.CommClosedError: in : Stream is closed 3536s 3536s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:142: CommClosedError 3536s ----------------------------- Captured stdout call ----------------------------- 3536s /tmp/tmpm4wavu88 3536s ----------------------------- Captured stderr call ----------------------------- 3536s 2024-11-23 20:51:39,562 - distributed.utils - INFO - Reload module passthrough_info from .py file 3536s 2024-11-23 20:51:39,564 - distributed.preloading - INFO - Import preload module: /tmp/tmp814c6whm/passthrough_info.py 3536s 2024-11-23 20:51:39,566 - distributed.scheduler - INFO - ----------------------------------------------- 3536s 2024-11-23 20:51:39,568 - distributed.preloading - INFO - Creating preload: /tmp/tmp814c6whm/passthrough_info.py 3536s 2024-11-23 20:51:39,569 - distributed.utils - INFO - Reload module passthrough_info from .py file 3536s 2024-11-23 20:51:39,570 - distributed.preloading - INFO - Import preload module: /tmp/tmp814c6whm/passthrough_info.py 3536s 2024-11-23 20:51:39,599 - distributed.http.proxy - INFO - To route to workers diagnostics web server please install jupyter-server-proxy: python -m pip install jupyter-server-proxy 3536s 2024-11-23 20:51:39,604 - distributed.scheduler - INFO - State start 3536s 2024-11-23 20:51:39,606 - distributed.diskutils - INFO - Found stale lock file and directory '/tmp/dask-scratch-space/scheduler-8y2x2v3a', purging 3536s 2024-11-23 20:51:39,616 - distributed.scheduler - INFO - ----------------------------------------------- 3536s 2024-11-23 20:51:39,618 - distributed.scheduler - INFO - Scheduler at: tcp://10.0.4.73:8786 3536s 2024-11-23 20:51:39,618 - distributed.scheduler - INFO - dashboard at: http://10.0.4.73:8787/status 3536s 2024-11-23 20:51:39,619 - distributed.preloading - INFO - Run preload setup: /tmp/tmp814c6whm/passthrough_info.py 3536s 2024-11-23 20:51:39,620 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3536s 2024-11-23 20:51:39,628 - distributed.scheduler - INFO - Receive client connection: Client-bc3070e7-a9dc-11ef-8ed0-00163e4db70f 3536s 2024-11-23 20:51:40,048 - distributed.core - INFO - Starting established connection to tcp://10.0.4.73:47544 3536s 2024-11-23 20:51:40,054 - distributed.worker - INFO - Run out-of-band function 'check_passthrough' 3536s 2024-11-23 20:51:40,566 - distributed.client - ERROR - 3536s ConnectionRefusedError: [Errno 111] Connection refused 3536s 3536s The above exception was the direct cause of the following exception: 3536s 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3536s comm = await wait_for( 3536s ^^^^^^^^^^^^^^^ 3536s ...<2 lines>... 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3536s return await fut 3536s ^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 559, in connect 3536s convert_stream_closed_error(self, e) 3536s ~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 140, in convert_stream_closed_error 3536s raise CommClosedError(f"in {obj}: {exc.__class__.__name__}: {exc}") from exc 3536s distributed.comm.core.CommClosedError: in : ConnectionRefusedError: [Errno 111] Connection refused 3536s 3536s During handling of the above exception, another exception occurred: 3536s 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 836, in wrapper 3536s return await func(*args, **kwargs) 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/client.py", line 1331, in _reconnect 3536s await self._ensure_connected(timeout=timeout) 3536s File "/usr/lib/python3/dist-packages/distributed/client.py", line 1361, in _ensure_connected 3536s comm = await connect( 3536s ^^^^^^^^^^^^^^ 3536s self.scheduler.address, timeout=timeout, **self.connection_args 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 366, in connect 3536s await asyncio.sleep(backoff) 3536s File "/usr/lib/python3.13/asyncio/tasks.py", line 718, in sleep 3536s return await future 3536s ^^^^^^^^^^^^ 3536s asyncio.exceptions.CancelledError 3536s ___________________________ test_multiple_workers_2 ____________________________ 3536s 3536s loop = 3536s 3536s def test_multiple_workers_2(loop): 3536s text = """ 3536s def dask_setup(worker): 3536s worker.foo = 'setup' 3536s """ 3536s port = open_port() 3536s with popen( 3536s ["dask", "scheduler", "--no-dashboard", "--host", f"127.0.0.1:{port}"] 3536s ) as s: 3536s with popen( 3536s [ 3536s "dask", 3536s "worker", 3536s f"localhost:{port}", 3536s "--no-dashboard", 3536s "--preload", 3536s text, 3536s "--preload-nanny", 3536s text, 3536s ] 3536s ) as a: 3536s with Client(f"127.0.0.1:{port}", loop=loop) as c: 3536s c.wait_for_workers(1) 3536s > [foo] = c.run(lambda dask_worker: dask_worker.foo).values() 3536s 3536s /usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py:549: 3536s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3536s /usr/lib/python3/dist-packages/distributed/client.py:2993: in run 3536s return self.sync( 3536s /usr/lib/python3/dist-packages/distributed/utils.py:362: in sync 3536s return sync( 3536s /usr/lib/python3/dist-packages/distributed/utils.py:438: in sync 3536s raise error 3536s /usr/lib/python3/dist-packages/distributed/utils.py:412: in f 3536s result = yield future 3536s /usr/lib/python3/dist-packages/tornado/gen.py:766: in run 3536s value = future.result() 3536s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3536s 3536s self = 3536s function = . at 0xe216dde8> 3536s nanny = False, workers = None, wait = True, on_error = 'raise', args = () 3536s kwargs = {} 3536s responses = {'tcp://127.0.0.1:44027': {'exception': b'\x80\x05\x953\x02\x00\x00\x00\x00\x00\x00\x8c\x16tblib.pickling_support\x94\...xt': "SystemError('no locals found when setting up annotations')", 'status': 'error', 'traceback': b'\x80\x05N.', ...}} 3536s results = {}, key = 'tcp://127.0.0.1:44027' 3536s resp = {'exception': b'\x80\x05\x953\x02\x00\x00\x00\x00\x00\x00\x8c\x16tblib.pickling_support\x94\x8c\x12unpickle_exception\...ext': "SystemError('no locals found when setting up annotations')", 'status': 'error', 'traceback': b'\x80\x05N.', ...} 3536s exc = SystemError('no locals found when setting up annotations') 3536s _ = 3536s 3536s async def _run( 3536s self, 3536s function, 3536s *args, 3536s nanny: bool = False, 3536s workers: list[str] | None = None, 3536s wait: bool = True, 3536s on_error: Literal["raise", "return", "ignore"] = "raise", 3536s **kwargs, 3536s ): 3536s responses = await self.scheduler.broadcast( 3536s msg=dict( 3536s op="run", 3536s function=dumps(function), 3536s args=dumps(args), 3536s wait=wait, 3536s kwargs=dumps(kwargs), 3536s ), 3536s workers=workers, 3536s nanny=nanny, 3536s on_error="return_pickle", 3536s ) 3536s results = {} 3536s for key, resp in responses.items(): 3536s if isinstance(resp, bytes): 3536s # Pickled RPC exception 3536s exc = loads(resp) 3536s assert isinstance(exc, Exception) 3536s elif resp["status"] == "error": 3536s # Exception raised by the remote function 3536s _, exc, tb = clean_exception(**resp) 3536s exc = exc.with_traceback(tb) 3536s else: 3536s assert resp["status"] == "OK" 3536s results[key] = resp["result"] 3536s continue 3536s 3536s if on_error == "raise": 3536s > raise exc 3536s E SystemError: no locals found when setting up annotations 3536s 3536s /usr/lib/python3/dist-packages/distributed/client.py:2898: SystemError 3536s ----------------------------- Captured stderr call ----------------------------- 3536s 2024-11-23 20:51:41,676 - distributed.scheduler - INFO - ----------------------------------------------- 3536s 2024-11-23 20:51:41,686 - distributed.utils - INFO - Reload module tmp_1ayzl8p from .py file 3536s 2024-11-23 20:51:41,687 - distributed.preloading - INFO - Import preload module: /tmp/tmp_1ayzl8p.py 3536s 2024-11-23 20:51:41,702 - distributed.preloading - INFO - Creating preload: 3536s def dask_setup(worker): 3536s worker.foo = 'setup' 3536s 3536s 2024-11-23 20:51:41,704 - distributed.utils - INFO - Reload module tmpmbace92q from .py file 3536s 2024-11-23 20:51:41,705 - distributed.http.proxy - INFO - To route to workers diagnostics web server please install jupyter-server-proxy: python -m pip install jupyter-server-proxy 3536s 2024-11-23 20:51:41,705 - distributed.preloading - INFO - Import preload module: /tmp/tmpmbace92q.py 3536s 2024-11-23 20:51:41,708 - distributed.preloading - INFO - Run preload setup: 3536s def dask_setup(worker): 3536s worker.foo = 'setup' 3536s 3536s 2024-11-23 20:51:41,709 - distributed.scheduler - INFO - State start 3536s 2024-11-23 20:51:41,711 - distributed.diskutils - INFO - Found stale lock file and directory '/tmp/dask-scratch-space/scheduler-c4__h2jk', purging 3536s 2024-11-23 20:51:41,720 - distributed.scheduler - INFO - ----------------------------------------------- 3536s 2024-11-23 20:51:41,721 - distributed.scheduler - INFO - Scheduler at: tcp://127.0.0.1:60509 3536s 2024-11-23 20:51:41,722 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:8787/status 3536s 2024-11-23 20:51:41,722 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3536s 2024-11-23 20:51:41,734 - distributed.nanny - INFO - Start Nanny at: 'tcp://127.0.0.1:34397' 3536s 2024-11-23 20:51:41,993 - distributed.scheduler - INFO - Receive client connection: Client-bd80b1db-a9dc-11ef-8ed0-00163e4db70f 3536s 2024-11-23 20:51:42,401 - distributed.core - INFO - Starting established connection to tcp://127.0.0.1:46356 3536s 2024-11-23 20:51:42,540 - distributed.preloading - INFO - Creating preload: 3536s def dask_setup(worker): 3536s worker.foo = 'setup' 3536s 3536s 2024-11-23 20:51:42,541 - distributed.utils - INFO - Reload module tmpr2h8j726 from .py file 3536s 2024-11-23 20:51:42,543 - distributed.preloading - INFO - Import preload module: /tmp/tmpr2h8j726.py 3536s 2024-11-23 20:51:42,578 - distributed.preloading - INFO - Run preload setup: 3536s def dask_setup(worker): 3536s worker.foo = 'setup' 3536s 3536s 2024-11-23 20:51:42,578 - distributed.worker - INFO - Start worker at: tcp://127.0.0.1:44027 3536s 2024-11-23 20:51:42,579 - distributed.worker - INFO - Listening to: tcp://127.0.0.1:44027 3536s 2024-11-23 20:51:42,579 - distributed.worker - INFO - dashboard at: 127.0.0.1:45243 3536s 2024-11-23 20:51:42,579 - distributed.worker - INFO - Waiting to connect to: tcp://localhost:60509 3536s 2024-11-23 20:51:42,579 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 20:51:42,579 - distributed.worker - INFO - Threads: 8 3536s 2024-11-23 20:51:42,579 - distributed.worker - INFO - Memory: 15.58 GiB 3536s 2024-11-23 20:51:42,579 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-4trwpepl 3536s 2024-11-23 20:51:42,579 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 20:51:42,999 - distributed.scheduler - INFO - Register worker 3536s 2024-11-23 20:51:43,000 - distributed.scheduler - INFO - Starting worker compute stream, tcp://127.0.0.1:44027 3536s 2024-11-23 20:51:43,000 - distributed.core - INFO - Starting established connection to tcp://127.0.0.1:46370 3536s 2024-11-23 20:51:43,001 - distributed.worker - INFO - Starting Worker plugin shuffle 3536s 2024-11-23 20:51:43,002 - distributed.worker - INFO - Registered to: tcp://localhost:60509 3536s 2024-11-23 20:51:43,003 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 20:51:43,005 - distributed.core - INFO - Starting established connection to tcp://localhost:60509 3536s 2024-11-23 20:51:43,031 - distributed.worker - INFO - Run out-of-band function 'lambda' 3536s 2024-11-23 20:51:43,031 - distributed.worker - WARNING - Run Failed 3536s Function: lambda 3536s args: () 3536s kwargs: {'dask_worker': } 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 3182, in run 3536s result = function(*args, **kwargs) 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s SystemError: no locals found when setting up annotations 3536s 2024-11-23 20:51:43,039 - distributed.scheduler - INFO - Remove client Client-bd80b1db-a9dc-11ef-8ed0-00163e4db70f 3536s 2024-11-23 20:51:43,040 - distributed.core - INFO - Received 'close-stream' from tcp://127.0.0.1:46356; closing. 3536s 2024-11-23 20:51:43,040 - distributed.scheduler - INFO - Remove client Client-bd80b1db-a9dc-11ef-8ed0-00163e4db70f 3536s 2024-11-23 20:51:43,041 - distributed.scheduler - INFO - Close client connection: Client-bd80b1db-a9dc-11ef-8ed0-00163e4db70f 3536s 2024-11-23 20:51:43,041 - distributed._signals - INFO - Received signal SIGINT (2) 3536s 2024-11-23 20:51:43,042 - distributed.nanny - INFO - Closing Nanny at 'tcp://127.0.0.1:34397'. Reason: signal-2 3536s 2024-11-23 20:51:43,042 - distributed.nanny - INFO - Nanny asking worker to close. Reason: signal-2 3536s 2024-11-23 20:51:43,044 - distributed.worker - INFO - Stopping worker at tcp://127.0.0.1:44027. Reason: signal-2 3536s 2024-11-23 20:51:43,047 - distributed.core - INFO - Received 'close-stream' from tcp://127.0.0.1:46370; closing. 3536s 2024-11-23 20:51:43,047 - distributed.core - INFO - Connection to tcp://localhost:60509 has been closed. 3536s 2024-11-23 20:51:43,047 - distributed.scheduler - INFO - Remove worker (stimulus_id='handle-worker-cleanup-1732395103.0477197') 3536s 2024-11-23 20:51:43,048 - distributed.scheduler - INFO - Lost all workers 3536s 2024-11-23 20:51:43,049 - distributed.nanny - INFO - Worker closed 3536s 2024-11-23 20:51:43,407 - distributed.dask_worker - INFO - End worker 3536s 2024-11-23 20:51:43,658 - distributed._signals - INFO - Received signal SIGINT (2) 3536s 2024-11-23 20:51:43,658 - distributed.scheduler - INFO - Scheduler closing due to signal-2... 3536s 2024-11-23 20:51:43,659 - distributed.scheduler - INFO - Scheduler closing all comms 3536s 2024-11-23 20:51:43,660 - distributed.scheduler - INFO - Stopped scheduler at 'tcp://127.0.0.1:60509' 3536s 2024-11-23 20:51:43,660 - distributed.scheduler - INFO - End scheduler 3536s __________________________________ test_basic __________________________________ 3536s 3536s self = 3536s address = '127.0.0.1:8786', deserialize = True 3536s connection_args = {'extra_conn_args': {}, 'require_encryption': False, 'ssl_context': } 3536s ip = '127.0.0.1', port = 8786 3536s kwargs = {'ssl_options': } 3536s 3536s async def connect(self, address, deserialize=True, **connection_args): 3536s self._check_encryption(address, connection_args) 3536s ip, port = parse_host_port(address) 3536s kwargs = self._get_connect_args(**connection_args) 3536s 3536s try: 3536s # server_hostname option (for SNI) only works with tornado.iostream.IOStream 3536s if "server_hostname" in kwargs: 3536s stream = await self.client.connect( 3536s ip, port, max_buffer_size=MAX_BUFFER_SIZE 3536s ) 3536s stream = await stream.start_tls(False, **kwargs) 3536s else: 3536s > stream = await self.client.connect( 3536s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3536s ) 3536s 3536s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:546: 3536s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3536s /usr/lib/python3/dist-packages/tornado/tcpclient.py:292: in connect 3536s stream = await stream.start_tls( 3536s /usr/lib/python3/dist-packages/tornado/iostream.py:1367: in _do_ssl_handshake 3536s self.socket.do_handshake() 3536s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3536s 3536s self = , block = False 3536s 3536s @_sslcopydoc 3536s def do_handshake(self, block=False): 3536s self._check_connected() 3536s timeout = self.gettimeout() 3536s try: 3536s if timeout == 0.0 and block: 3536s self.settimeout(None) 3536s > self._sslobj.do_handshake() 3536s E ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 3536s 3536s /usr/lib/python3.13/ssl.py:1372: SSLCertVerificationError 3536s 3536s The above exception was the direct cause of the following exception: 3536s 3536s loop = 3536s requires_default_ports = None 3536s 3536s def test_basic(loop, requires_default_ports): 3536s with ( 3536s popen(["dask", "scheduler", "--no-dashboard"] + tls_args), 3536s popen(["dask", "worker", "--no-dashboard", "tls://127.0.0.1:8786"] + tls_args), 3536s > Client("tls://127.0.0.1:8786", loop=loop, security=tls_security()) as c, 3536s ): 3536s 3536s /usr/lib/python3/dist-packages/distributed/cli/tests/test_tls_cli.py:37: 3536s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3536s /usr/lib/python3/dist-packages/distributed/client.py:1018: in __init__ 3536s self.start(timeout=timeout) 3536s /usr/lib/python3/dist-packages/distributed/client.py:1220: in start 3536s sync(self.loop, self._start, **kwargs) 3536s /usr/lib/python3/dist-packages/distributed/utils.py:438: in sync 3536s raise error 3536s /usr/lib/python3/dist-packages/distributed/utils.py:412: in f 3536s result = yield future 3536s /usr/lib/python3/dist-packages/tornado/gen.py:766: in run 3536s value = future.result() 3536s /usr/lib/python3/dist-packages/distributed/client.py:1299: in _start 3536s await self._ensure_connected(timeout=timeout) 3536s /usr/lib/python3/dist-packages/distributed/client.py:1361: in _ensure_connected 3536s comm = await connect( 3536s /usr/lib/python3/dist-packages/distributed/comm/core.py:342: in connect 3536s comm = await wait_for( 3536s /usr/lib/python3/dist-packages/distributed/utils.py:1960: in wait_for 3536s return await fut 3536s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3536s 3536s self = 3536s address = '127.0.0.1:8786', deserialize = True 3536s connection_args = {'extra_conn_args': {}, 'require_encryption': False, 'ssl_context': } 3536s ip = '127.0.0.1', port = 8786 3536s kwargs = {'ssl_options': } 3536s 3536s async def connect(self, address, deserialize=True, **connection_args): 3536s self._check_encryption(address, connection_args) 3536s ip, port = parse_host_port(address) 3536s kwargs = self._get_connect_args(**connection_args) 3536s 3536s try: 3536s # server_hostname option (for SNI) only works with tornado.iostream.IOStream 3536s if "server_hostname" in kwargs: 3536s stream = await self.client.connect( 3536s ip, port, max_buffer_size=MAX_BUFFER_SIZE 3536s ) 3536s stream = await stream.start_tls(False, **kwargs) 3536s else: 3536s stream = await self.client.connect( 3536s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3536s ) 3536s 3536s # Under certain circumstances tornado will have a closed connection with an 3536s # error and not raise a StreamClosedError. 3536s # 3536s # This occurs with tornado 5.x and openssl 1.1+ 3536s if stream.closed() and stream.error: 3536s raise StreamClosedError(stream.error) 3536s 3536s except StreamClosedError as e: 3536s # The socket connect() call failed 3536s convert_stream_closed_error(self, e) 3536s except SSLCertVerificationError as err: 3536s > raise FatalCommClosedError( 3536s "TLS certificate does not match. Check your security settings. " 3536s "More info at https://distributed.dask.org/en/latest/tls.html" 3536s ) from err 3536s E distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 3536s 3536s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:561: FatalCommClosedError 3536s ----------------------------- Captured stderr call ----------------------------- 3536s 2024-11-23 20:52:45,003 - distributed.scheduler - INFO - ----------------------------------------------- 3536s 2024-11-23 20:52:45,037 - distributed.http.proxy - INFO - To route to workers diagnostics web server please install jupyter-server-proxy: python -m pip install jupyter-server-proxy 3536s 2024-11-23 20:52:45,042 - distributed.scheduler - INFO - State start 3536s 2024-11-23 20:52:45,054 - distributed.scheduler - INFO - ----------------------------------------------- 3536s 2024-11-23 20:52:45,057 - distributed.scheduler - INFO - Scheduler at: tls://10.0.4.73:8786 3536s 2024-11-23 20:52:45,057 - distributed.scheduler - INFO - dashboard at: http://10.0.4.73:8787/status 3536s 2024-11-23 20:52:45,058 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3536s 2024-11-23 20:52:45,083 - distributed.nanny - INFO - Start Nanny at: 'tls://127.0.0.1:35925' 3536s 2024-11-23 20:52:45,950 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44709 3536s 2024-11-23 20:52:45,950 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44709 3536s 2024-11-23 20:52:45,950 - distributed.worker - INFO - dashboard at: 127.0.0.1:38809 3536s 2024-11-23 20:52:45,950 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:8786 3536s 2024-11-23 20:52:45,950 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 20:52:45,950 - distributed.worker - INFO - Threads: 8 3536s 2024-11-23 20:52:45,950 - distributed.worker - INFO - Memory: 15.58 GiB 3536s 2024-11-23 20:52:45,950 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-i1l4cyba 3536s 2024-11-23 20:52:45,950 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 20:52:46,087 - distributed.comm.tcp - WARNING - Listener on 'tls://0.0.0.0:8786': TLS handshake failed with remote 'tls://127.0.0.1:38246': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1000) 3536s 2024-11-23 20:52:46,089 - distributed._signals - INFO - Received signal SIGINT (2) 3536s 2024-11-23 20:52:46,089 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:35925'. Reason: signal-2 3536s 2024-11-23 20:52:46,372 - distributed.scheduler - INFO - Register worker 3536s 2024-11-23 20:52:46,781 - distributed.scheduler - INFO - Starting worker compute stream, tls://127.0.0.1:44709 3536s 2024-11-23 20:52:46,782 - distributed.core - INFO - Starting established connection to tls://127.0.0.1:38238 3536s 2024-11-23 20:52:46,784 - distributed.worker - INFO - Starting Worker plugin shuffle 3536s 2024-11-23 20:52:46,786 - distributed.worker - INFO - Registered to: tls://127.0.0.1:8786 3536s 2024-11-23 20:52:46,786 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 20:52:46,788 - distributed.core - INFO - Starting established connection to tls://127.0.0.1:8786 3536s 2024-11-23 20:52:46,816 - distributed.nanny - INFO - Nanny asking worker to close. Reason: signal-2 3536s 2024-11-23 20:52:46,818 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44709. Reason: signal-2 3536s 2024-11-23 20:52:46,821 - distributed.core - INFO - Received 'close-stream' from tls://127.0.0.1:38238; closing. 3536s 2024-11-23 20:52:46,821 - distributed.core - INFO - Connection to tls://127.0.0.1:8786 has been closed. 3536s 2024-11-23 20:52:46,821 - distributed.scheduler - INFO - Remove worker (stimulus_id='handle-worker-cleanup-1732395166.8217452') 3536s 2024-11-23 20:52:46,822 - distributed.scheduler - INFO - Lost all workers 3536s 2024-11-23 20:52:46,825 - distributed.nanny - INFO - Worker closed 3536s 2024-11-23 20:52:47,241 - distributed.dask_worker - INFO - End worker 3536s 2024-11-23 20:52:47,512 - distributed._signals - INFO - Received signal SIGINT (2) 3536s 2024-11-23 20:52:47,512 - distributed.scheduler - INFO - Scheduler closing due to signal-2... 3536s 2024-11-23 20:52:47,513 - distributed.scheduler - INFO - Scheduler closing all comms 3536s 2024-11-23 20:52:47,514 - distributed.scheduler - INFO - Stopped scheduler at 'tls://10.0.4.73:8786' 3536s 2024-11-23 20:52:47,514 - distributed.scheduler - INFO - End scheduler 3536s ___________________________________ test_sni ___________________________________ 3536s 3536s self = 3536s address = '127.0.0.1:40387', deserialize = True 3536s connection_args = {'extra_conn_args': {}, 'require_encryption': False, 'ssl_context': } 3536s ip = '127.0.0.1', port = 40387 3536s kwargs = {'ssl_options': } 3536s 3536s async def connect(self, address, deserialize=True, **connection_args): 3536s self._check_encryption(address, connection_args) 3536s ip, port = parse_host_port(address) 3536s kwargs = self._get_connect_args(**connection_args) 3536s 3536s try: 3536s # server_hostname option (for SNI) only works with tornado.iostream.IOStream 3536s if "server_hostname" in kwargs: 3536s stream = await self.client.connect( 3536s ip, port, max_buffer_size=MAX_BUFFER_SIZE 3536s ) 3536s stream = await stream.start_tls(False, **kwargs) 3536s else: 3536s > stream = await self.client.connect( 3536s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3536s ) 3536s 3536s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:546: 3536s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3536s /usr/lib/python3/dist-packages/tornado/tcpclient.py:292: in connect 3536s stream = await stream.start_tls( 3536s /usr/lib/python3/dist-packages/tornado/iostream.py:1367: in _do_ssl_handshake 3536s self.socket.do_handshake() 3536s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3536s 3536s self = , block = False 3536s 3536s @_sslcopydoc 3536s def do_handshake(self, block=False): 3536s self._check_connected() 3536s timeout = self.gettimeout() 3536s try: 3536s if timeout == 0.0 and block: 3536s self.settimeout(None) 3536s > self._sslobj.do_handshake() 3536s E ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 3536s 3536s /usr/lib/python3.13/ssl.py:1372: SSLCertVerificationError 3536s 3536s The above exception was the direct cause of the following exception: 3536s 3536s loop = 3536s 3536s def test_sni(loop): 3536s port = open_port() 3536s with popen( 3536s ["dask", "scheduler", "--no-dashboard", f"--port={port}"] + tls_args 3536s ) as s: 3536s with popen( 3536s [ 3536s "dask", 3536s "worker", 3536s "--no-dashboard", 3536s "--scheduler-sni", 3536s "localhost", 3536s f"tls://127.0.0.1:{port}", 3536s ] 3536s + tls_args 3536s ) as w: 3536s > with Client( 3536s f"tls://127.0.0.1:{port}", loop=loop, security=tls_security() 3536s ) as c: 3536s 3536s /usr/lib/python3/dist-packages/distributed/cli/tests/test_tls_cli.py:58: 3536s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3536s /usr/lib/python3/dist-packages/distributed/client.py:1018: in __init__ 3536s self.start(timeout=timeout) 3536s /usr/lib/python3/dist-packages/distributed/client.py:1220: in start 3536s sync(self.loop, self._start, **kwargs) 3536s /usr/lib/python3/dist-packages/distributed/utils.py:438: in sync 3536s raise error 3536s /usr/lib/python3/dist-packages/distributed/utils.py:412: in f 3536s result = yield future 3536s /usr/lib/python3/dist-packages/tornado/gen.py:766: in run 3536s value = future.result() 3536s /usr/lib/python3/dist-packages/distributed/client.py:1299: in _start 3536s await self._ensure_connected(timeout=timeout) 3536s /usr/lib/python3/dist-packages/distributed/client.py:1361: in _ensure_connected 3536s comm = await connect( 3536s /usr/lib/python3/dist-packages/distributed/comm/core.py:342: in connect 3536s comm = await wait_for( 3536s /usr/lib/python3/dist-packages/distributed/utils.py:1960: in wait_for 3536s return await fut 3536s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3536s 3536s self = 3536s address = '127.0.0.1:40387', deserialize = True 3536s connection_args = {'extra_conn_args': {}, 'require_encryption': False, 'ssl_context': } 3536s ip = '127.0.0.1', port = 40387 3536s kwargs = {'ssl_options': } 3536s 3536s async def connect(self, address, deserialize=True, **connection_args): 3536s self._check_encryption(address, connection_args) 3536s ip, port = parse_host_port(address) 3536s kwargs = self._get_connect_args(**connection_args) 3536s 3536s try: 3536s # server_hostname option (for SNI) only works with tornado.iostream.IOStream 3536s if "server_hostname" in kwargs: 3536s stream = await self.client.connect( 3536s ip, port, max_buffer_size=MAX_BUFFER_SIZE 3536s ) 3536s stream = await stream.start_tls(False, **kwargs) 3536s else: 3536s stream = await self.client.connect( 3536s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3536s ) 3536s 3536s # Under certain circumstances tornado will have a closed connection with an 3536s # error and not raise a StreamClosedError. 3536s # 3536s # This occurs with tornado 5.x and openssl 1.1+ 3536s if stream.closed() and stream.error: 3536s raise StreamClosedError(stream.error) 3536s 3536s except StreamClosedError as e: 3536s # The socket connect() call failed 3536s convert_stream_closed_error(self, e) 3536s except SSLCertVerificationError as err: 3536s > raise FatalCommClosedError( 3536s "TLS certificate does not match. Check your security settings. " 3536s "More info at https://distributed.dask.org/en/latest/tls.html" 3536s ) from err 3536s E distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 3536s 3536s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:561: FatalCommClosedError 3536s ----------------------------- Captured stderr call ----------------------------- 3536s 2024-11-23 20:52:49,225 - distributed.scheduler - INFO - ----------------------------------------------- 3536s 2024-11-23 20:52:49,257 - distributed.http.proxy - INFO - To route to workers diagnostics web server please install jupyter-server-proxy: python -m pip install jupyter-server-proxy 3536s 2024-11-23 20:52:49,261 - distributed.scheduler - INFO - State start 3536s 2024-11-23 20:52:49,271 - distributed.scheduler - INFO - ----------------------------------------------- 3536s 2024-11-23 20:52:49,274 - distributed.scheduler - INFO - Scheduler at: tls://10.0.4.73:40387 3536s 2024-11-23 20:52:49,275 - distributed.scheduler - INFO - dashboard at: http://10.0.4.73:8787/status 3536s 2024-11-23 20:52:49,276 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3536s 2024-11-23 20:52:49,298 - distributed.nanny - INFO - Start Nanny at: 'tls://127.0.0.1:38715' 3536s 2024-11-23 20:52:49,768 - distributed.comm.tcp - WARNING - Listener on 'tls://0.0.0.0:40387': TLS handshake failed with remote 'tls://127.0.0.1:35980': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1000) 3536s 2024-11-23 20:52:49,769 - distributed._signals - INFO - Received signal SIGINT (2) 3536s 2024-11-23 20:52:49,770 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:38715'. Reason: signal-2 3536s 2024-11-23 20:52:50,158 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37781 3536s 2024-11-23 20:52:50,158 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37781 3536s 2024-11-23 20:52:50,158 - distributed.worker - INFO - dashboard at: 127.0.0.1:39029 3536s 2024-11-23 20:52:50,159 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40387 3536s 2024-11-23 20:52:50,159 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 20:52:50,159 - distributed.worker - INFO - Threads: 8 3536s 2024-11-23 20:52:50,159 - distributed.worker - INFO - Memory: 15.58 GiB 3536s 2024-11-23 20:52:50,159 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-yp98ygeg 3536s 2024-11-23 20:52:50,159 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 20:52:50,581 - distributed.scheduler - INFO - Register worker 3536s 2024-11-23 20:52:50,985 - distributed.scheduler - INFO - Starting worker compute stream, tls://127.0.0.1:37781 3536s 2024-11-23 20:52:50,985 - distributed.core - INFO - Starting established connection to tls://127.0.0.1:35990 3536s 2024-11-23 20:52:50,986 - distributed.worker - INFO - Starting Worker plugin shuffle 3536s 2024-11-23 20:52:50,987 - distributed.worker - INFO - Registered to: tls://127.0.0.1:40387 3536s 2024-11-23 20:52:50,988 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 20:52:50,989 - distributed.core - INFO - Starting established connection to tls://127.0.0.1:40387 3536s 2024-11-23 20:52:51,027 - distributed.nanny - INFO - Nanny asking worker to close. Reason: signal-2 3536s 2024-11-23 20:52:51,029 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37781. Reason: signal-2 3536s 2024-11-23 20:52:51,032 - distributed.core - INFO - Received 'close-stream' from tls://127.0.0.1:35990; closing. 3536s 2024-11-23 20:52:51,032 - distributed.core - INFO - Connection to tls://127.0.0.1:40387 has been closed. 3536s 2024-11-23 20:52:51,033 - distributed.scheduler - INFO - Remove worker (stimulus_id='handle-worker-cleanup-1732395171.0332744') 3536s 2024-11-23 20:52:51,033 - distributed.scheduler - INFO - Lost all workers 3536s 2024-11-23 20:52:51,037 - distributed.nanny - INFO - Worker closed 3536s 2024-11-23 20:52:51,402 - distributed.dask_worker - INFO - End worker 3536s 2024-11-23 20:52:51,692 - distributed._signals - INFO - Received signal SIGINT (2) 3536s 2024-11-23 20:52:51,692 - distributed.scheduler - INFO - Scheduler closing due to signal-2... 3536s 2024-11-23 20:52:51,693 - distributed.scheduler - INFO - Scheduler closing all comms 3536s 2024-11-23 20:52:51,694 - distributed.scheduler - INFO - Stopped scheduler at 'tls://10.0.4.73:40387' 3536s 2024-11-23 20:52:51,694 - distributed.scheduler - INFO - End scheduler 3536s __________________________________ test_nanny __________________________________ 3536s 3536s self = 3536s address = '127.0.0.1:57227', deserialize = True 3536s connection_args = {'extra_conn_args': {}, 'require_encryption': False, 'ssl_context': } 3536s ip = '127.0.0.1', port = 57227 3536s kwargs = {'ssl_options': } 3536s 3536s async def connect(self, address, deserialize=True, **connection_args): 3536s self._check_encryption(address, connection_args) 3536s ip, port = parse_host_port(address) 3536s kwargs = self._get_connect_args(**connection_args) 3536s 3536s try: 3536s # server_hostname option (for SNI) only works with tornado.iostream.IOStream 3536s if "server_hostname" in kwargs: 3536s stream = await self.client.connect( 3536s ip, port, max_buffer_size=MAX_BUFFER_SIZE 3536s ) 3536s stream = await stream.start_tls(False, **kwargs) 3536s else: 3536s > stream = await self.client.connect( 3536s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3536s ) 3536s 3536s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:546: 3536s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3536s /usr/lib/python3/dist-packages/tornado/tcpclient.py:292: in connect 3536s stream = await stream.start_tls( 3536s /usr/lib/python3/dist-packages/tornado/iostream.py:1367: in _do_ssl_handshake 3536s self.socket.do_handshake() 3536s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3536s 3536s self = , block = False 3536s 3536s @_sslcopydoc 3536s def do_handshake(self, block=False): 3536s self._check_connected() 3536s timeout = self.gettimeout() 3536s try: 3536s if timeout == 0.0 and block: 3536s self.settimeout(None) 3536s > self._sslobj.do_handshake() 3536s E ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 3536s 3536s /usr/lib/python3.13/ssl.py:1372: SSLCertVerificationError 3536s 3536s The above exception was the direct cause of the following exception: 3536s 3536s loop = 3536s 3536s def test_nanny(loop): 3536s port = open_port() 3536s with popen( 3536s [ 3536s "dask", 3536s "scheduler", 3536s "--no-dashboard", 3536s f"--port={port}", 3536s ] 3536s + tls_args 3536s ) as s: 3536s with popen( 3536s ["dask", "worker", "--no-dashboard", "--nanny", f"tls://127.0.0.1:{port}"] 3536s + tls_args 3536s ) as w: 3536s > with Client( 3536s f"tls://127.0.0.1:{port}", loop=loop, security=tls_security() 3536s ) as c: 3536s 3536s /usr/lib/python3/dist-packages/distributed/cli/tests/test_tls_cli.py:79: 3536s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3536s /usr/lib/python3/dist-packages/distributed/client.py:1018: in __init__ 3536s self.start(timeout=timeout) 3536s /usr/lib/python3/dist-packages/distributed/client.py:1220: in start 3536s sync(self.loop, self._start, **kwargs) 3536s /usr/lib/python3/dist-packages/distributed/utils.py:438: in sync 3536s raise error 3536s /usr/lib/python3/dist-packages/distributed/utils.py:412: in f 3536s result = yield future 3536s /usr/lib/python3/dist-packages/tornado/gen.py:766: in run 3536s value = future.result() 3536s /usr/lib/python3/dist-packages/distributed/client.py:1299: in _start 3536s await self._ensure_connected(timeout=timeout) 3536s /usr/lib/python3/dist-packages/distributed/client.py:1361: in _ensure_connected 3536s comm = await connect( 3536s /usr/lib/python3/dist-packages/distributed/comm/core.py:342: in connect 3536s comm = await wait_for( 3536s /usr/lib/python3/dist-packages/distributed/utils.py:1960: in wait_for 3536s return await fut 3536s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3536s 3536s self = 3536s address = '127.0.0.1:57227', deserialize = True 3536s connection_args = {'extra_conn_args': {}, 'require_encryption': False, 'ssl_context': } 3536s ip = '127.0.0.1', port = 57227 3536s kwargs = {'ssl_options': } 3536s 3536s async def connect(self, address, deserialize=True, **connection_args): 3536s self._check_encryption(address, connection_args) 3536s ip, port = parse_host_port(address) 3536s kwargs = self._get_connect_args(**connection_args) 3536s 3536s try: 3536s # server_hostname option (for SNI) only works with tornado.iostream.IOStream 3536s if "server_hostname" in kwargs: 3536s stream = await self.client.connect( 3536s ip, port, max_buffer_size=MAX_BUFFER_SIZE 3536s ) 3536s stream = await stream.start_tls(False, **kwargs) 3536s else: 3536s stream = await self.client.connect( 3536s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3536s ) 3536s 3536s # Under certain circumstances tornado will have a closed connection with an 3536s # error and not raise a StreamClosedError. 3536s # 3536s # This occurs with tornado 5.x and openssl 1.1+ 3536s if stream.closed() and stream.error: 3536s raise StreamClosedError(stream.error) 3536s 3536s except StreamClosedError as e: 3536s # The socket connect() call failed 3536s convert_stream_closed_error(self, e) 3536s except SSLCertVerificationError as err: 3536s > raise FatalCommClosedError( 3536s "TLS certificate does not match. Check your security settings. " 3536s "More info at https://distributed.dask.org/en/latest/tls.html" 3536s ) from err 3536s E distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 3536s 3536s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:561: FatalCommClosedError 3536s ----------------------------- Captured stderr call ----------------------------- 3536s 2024-11-23 20:52:53,322 - distributed.scheduler - INFO - ----------------------------------------------- 3536s 2024-11-23 20:52:53,354 - distributed.http.proxy - INFO - To route to workers diagnostics web server please install jupyter-server-proxy: python -m pip install jupyter-server-proxy 3536s 2024-11-23 20:52:53,358 - distributed.scheduler - INFO - State start 3536s 2024-11-23 20:52:53,369 - distributed.scheduler - INFO - ----------------------------------------------- 3536s 2024-11-23 20:52:53,372 - distributed.scheduler - INFO - Scheduler at: tls://10.0.4.73:57227 3536s 2024-11-23 20:52:53,372 - distributed.scheduler - INFO - dashboard at: http://10.0.4.73:8787/status 3536s 2024-11-23 20:52:53,373 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3536s 2024-11-23 20:52:53,421 - distributed.nanny - INFO - Start Nanny at: 'tls://127.0.0.1:35445' 3536s 2024-11-23 20:52:53,885 - distributed.comm.tcp - WARNING - Listener on 'tls://0.0.0.0:57227': TLS handshake failed with remote 'tls://127.0.0.1:53214': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1000) 3536s 2024-11-23 20:52:53,887 - distributed._signals - INFO - Received signal SIGINT (2) 3536s 2024-11-23 20:52:53,887 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:35445'. Reason: signal-2 3536s 2024-11-23 20:52:54,250 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43495 3536s 2024-11-23 20:52:54,251 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43495 3536s 2024-11-23 20:52:54,251 - distributed.worker - INFO - dashboard at: 127.0.0.1:43841 3536s 2024-11-23 20:52:54,251 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:57227 3536s 2024-11-23 20:52:54,251 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 20:52:54,251 - distributed.worker - INFO - Threads: 8 3536s 2024-11-23 20:52:54,251 - distributed.worker - INFO - Memory: 15.58 GiB 3536s 2024-11-23 20:52:54,251 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-rf1x7f1n 3536s 2024-11-23 20:52:54,251 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 20:52:54,664 - distributed.scheduler - INFO - Register worker 3536s 2024-11-23 20:52:55,052 - distributed.scheduler - INFO - Starting worker compute stream, tls://127.0.0.1:43495 3536s 2024-11-23 20:52:55,053 - distributed.core - INFO - Starting established connection to tls://127.0.0.1:53224 3536s 2024-11-23 20:52:55,053 - distributed.worker - INFO - Starting Worker plugin shuffle 3536s 2024-11-23 20:52:55,055 - distributed.worker - INFO - Registered to: tls://127.0.0.1:57227 3536s 2024-11-23 20:52:55,055 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 20:52:55,057 - distributed.core - INFO - Starting established connection to tls://127.0.0.1:57227 3536s 2024-11-23 20:52:55,099 - distributed.nanny - INFO - Nanny asking worker to close. Reason: signal-2 3536s 2024-11-23 20:52:55,100 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43495. Reason: signal-2 3536s 2024-11-23 20:52:55,103 - distributed.core - INFO - Received 'close-stream' from tls://127.0.0.1:53224; closing. 3536s 2024-11-23 20:52:55,103 - distributed.core - INFO - Connection to tls://127.0.0.1:57227 has been closed. 3536s 2024-11-23 20:52:55,104 - distributed.scheduler - INFO - Remove worker (stimulus_id='handle-worker-cleanup-1732395175.1043844') 3536s 2024-11-23 20:52:55,104 - distributed.scheduler - INFO - Lost all workers 3536s 2024-11-23 20:52:55,107 - distributed.nanny - INFO - Worker closed 3536s 2024-11-23 20:52:55,502 - distributed.dask_worker - INFO - End worker 3536s 2024-11-23 20:52:55,807 - distributed._signals - INFO - Received signal SIGINT (2) 3536s 2024-11-23 20:52:55,807 - distributed.scheduler - INFO - Scheduler closing due to signal-2... 3536s 2024-11-23 20:52:55,808 - distributed.scheduler - INFO - Scheduler closing all comms 3536s 2024-11-23 20:52:55,809 - distributed.scheduler - INFO - Stopped scheduler at 'tls://10.0.4.73:57227' 3536s 2024-11-23 20:52:55,809 - distributed.scheduler - INFO - End scheduler 3536s ____________________________ test_separate_key_cert ____________________________ 3536s 3536s self = 3536s address = '127.0.0.1:37313', deserialize = True 3536s connection_args = {'extra_conn_args': {}, 'require_encryption': False, 'ssl_context': } 3536s ip = '127.0.0.1', port = 37313 3536s kwargs = {'ssl_options': } 3536s 3536s async def connect(self, address, deserialize=True, **connection_args): 3536s self._check_encryption(address, connection_args) 3536s ip, port = parse_host_port(address) 3536s kwargs = self._get_connect_args(**connection_args) 3536s 3536s try: 3536s # server_hostname option (for SNI) only works with tornado.iostream.IOStream 3536s if "server_hostname" in kwargs: 3536s stream = await self.client.connect( 3536s ip, port, max_buffer_size=MAX_BUFFER_SIZE 3536s ) 3536s stream = await stream.start_tls(False, **kwargs) 3536s else: 3536s > stream = await self.client.connect( 3536s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3536s ) 3536s 3536s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:546: 3536s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3536s /usr/lib/python3/dist-packages/tornado/tcpclient.py:292: in connect 3536s stream = await stream.start_tls( 3536s /usr/lib/python3/dist-packages/tornado/iostream.py:1367: in _do_ssl_handshake 3536s self.socket.do_handshake() 3536s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3536s 3536s self = , block = False 3536s 3536s @_sslcopydoc 3536s def do_handshake(self, block=False): 3536s self._check_connected() 3536s timeout = self.gettimeout() 3536s try: 3536s if timeout == 0.0 and block: 3536s self.settimeout(None) 3536s > self._sslobj.do_handshake() 3536s E ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 3536s 3536s /usr/lib/python3.13/ssl.py:1372: SSLCertVerificationError 3536s 3536s The above exception was the direct cause of the following exception: 3536s 3536s loop = 3536s 3536s def test_separate_key_cert(loop): 3536s port = open_port() 3536s with popen( 3536s [ 3536s "dask", 3536s "scheduler", 3536s "--no-dashboard", 3536s f"--port={port}", 3536s ] 3536s + tls_args_2 3536s ) as s: 3536s with popen( 3536s ["dask", "worker", "--no-dashboard", f"tls://127.0.0.1:{port}"] + tls_args_2 3536s ) as w: 3536s > with Client( 3536s f"tls://127.0.0.1:{port}", loop=loop, security=tls_security() 3536s ) as c: 3536s 3536s /usr/lib/python3/dist-packages/distributed/cli/tests/test_tls_cli.py:99: 3536s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3536s /usr/lib/python3/dist-packages/distributed/client.py:1018: in __init__ 3536s self.start(timeout=timeout) 3536s /usr/lib/python3/dist-packages/distributed/client.py:1220: in start 3536s sync(self.loop, self._start, **kwargs) 3536s /usr/lib/python3/dist-packages/distributed/utils.py:438: in sync 3536s raise error 3536s /usr/lib/python3/dist-packages/distributed/utils.py:412: in f 3536s result = yield future 3536s /usr/lib/python3/dist-packages/tornado/gen.py:766: in run 3536s value = future.result() 3536s /usr/lib/python3/dist-packages/distributed/client.py:1299: in _start 3536s await self._ensure_connected(timeout=timeout) 3536s /usr/lib/python3/dist-packages/distributed/client.py:1361: in _ensure_connected 3536s comm = await connect( 3536s /usr/lib/python3/dist-packages/distributed/comm/core.py:342: in connect 3536s comm = await wait_for( 3536s /usr/lib/python3/dist-packages/distributed/utils.py:1960: in wait_for 3536s return await fut 3536s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3536s 3536s self = 3536s address = '127.0.0.1:37313', deserialize = True 3536s connection_args = {'extra_conn_args': {}, 'require_encryption': False, 'ssl_context': } 3536s ip = '127.0.0.1', port = 37313 3536s kwargs = {'ssl_options': } 3536s 3536s async def connect(self, address, deserialize=True, **connection_args): 3536s self._check_encryption(address, connection_args) 3536s ip, port = parse_host_port(address) 3536s kwargs = self._get_connect_args(**connection_args) 3536s 3536s try: 3536s # server_hostname option (for SNI) only works with tornado.iostream.IOStream 3536s if "server_hostname" in kwargs: 3536s stream = await self.client.connect( 3536s ip, port, max_buffer_size=MAX_BUFFER_SIZE 3536s ) 3536s stream = await stream.start_tls(False, **kwargs) 3536s else: 3536s stream = await self.client.connect( 3536s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3536s ) 3536s 3536s # Under certain circumstances tornado will have a closed connection with an 3536s # error and not raise a StreamClosedError. 3536s # 3536s # This occurs with tornado 5.x and openssl 1.1+ 3536s if stream.closed() and stream.error: 3536s raise StreamClosedError(stream.error) 3536s 3536s except StreamClosedError as e: 3536s # The socket connect() call failed 3536s convert_stream_closed_error(self, e) 3536s except SSLCertVerificationError as err: 3536s > raise FatalCommClosedError( 3536s "TLS certificate does not match. Check your security settings. " 3536s "More info at https://distributed.dask.org/en/latest/tls.html" 3536s ) from err 3536s E distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 3536s 3536s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:561: FatalCommClosedError 3536s ----------------------------- Captured stderr call ----------------------------- 3536s 2024-11-23 20:52:57,372 - distributed.scheduler - INFO - ----------------------------------------------- 3536s 2024-11-23 20:52:57,403 - distributed.http.proxy - INFO - To route to workers diagnostics web server please install jupyter-server-proxy: python -m pip install jupyter-server-proxy 3536s 2024-11-23 20:52:57,408 - distributed.scheduler - INFO - State start 3536s 2024-11-23 20:52:57,418 - distributed.scheduler - INFO - ----------------------------------------------- 3536s 2024-11-23 20:52:57,421 - distributed.scheduler - INFO - Scheduler at: tls://10.0.4.73:37313 3536s 2024-11-23 20:52:57,421 - distributed.scheduler - INFO - dashboard at: http://10.0.4.73:8787/status 3536s 2024-11-23 20:52:57,422 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3536s 2024-11-23 20:52:57,557 - distributed.nanny - INFO - Start Nanny at: 'tls://127.0.0.1:38251' 3536s 2024-11-23 20:52:57,871 - distributed.comm.tcp - WARNING - Listener on 'tls://0.0.0.0:37313': TLS handshake failed with remote 'tls://127.0.0.1:50748': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1000) 3536s 2024-11-23 20:52:57,872 - distributed._signals - INFO - Received signal SIGINT (2) 3536s 2024-11-23 20:52:57,873 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:38251'. Reason: signal-2 3536s 2024-11-23 20:52:58,455 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33279 3536s 2024-11-23 20:52:58,455 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33279 3536s 2024-11-23 20:52:58,455 - distributed.worker - INFO - dashboard at: 127.0.0.1:46303 3536s 2024-11-23 20:52:58,455 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37313 3536s 2024-11-23 20:52:58,455 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 20:52:58,455 - distributed.worker - INFO - Threads: 8 3536s 2024-11-23 20:52:58,455 - distributed.worker - INFO - Memory: 15.58 GiB 3536s 2024-11-23 20:52:58,455 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-niegrjw0 3536s 2024-11-23 20:52:58,455 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 20:52:58,884 - distributed.scheduler - INFO - Register worker 3536s 2024-11-23 20:52:59,303 - distributed.scheduler - INFO - Starting worker compute stream, tls://127.0.0.1:33279 3536s 2024-11-23 20:52:59,304 - distributed.core - INFO - Starting established connection to tls://127.0.0.1:50750 3536s 2024-11-23 20:52:59,305 - distributed.worker - INFO - Starting Worker plugin shuffle 3536s 2024-11-23 20:52:59,306 - distributed.worker - INFO - Registered to: tls://127.0.0.1:37313 3536s 2024-11-23 20:52:59,306 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 20:52:59,308 - distributed.core - INFO - Starting established connection to tls://127.0.0.1:37313 3536s 2024-11-23 20:52:59,334 - distributed.nanny - INFO - Nanny asking worker to close. Reason: signal-2 3536s 2024-11-23 20:52:59,336 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33279. Reason: signal-2 3536s 2024-11-23 20:52:59,339 - distributed.core - INFO - Received 'close-stream' from tls://127.0.0.1:50750; closing. 3536s 2024-11-23 20:52:59,339 - distributed.core - INFO - Connection to tls://127.0.0.1:37313 has been closed. 3536s 2024-11-23 20:52:59,340 - distributed.scheduler - INFO - Remove worker (stimulus_id='handle-worker-cleanup-1732395179.3399994') 3536s 2024-11-23 20:52:59,340 - distributed.scheduler - INFO - Lost all workers 3536s 2024-11-23 20:52:59,343 - distributed.nanny - INFO - Worker closed 3536s 2024-11-23 20:52:59,713 - distributed.dask_worker - INFO - End worker 3536s 2024-11-23 20:53:00,042 - distributed._signals - INFO - Received signal SIGINT (2) 3536s 2024-11-23 20:53:00,043 - distributed.scheduler - INFO - Scheduler closing due to signal-2... 3536s 2024-11-23 20:53:00,043 - distributed.scheduler - INFO - Scheduler closing all comms 3536s 2024-11-23 20:53:00,045 - distributed.scheduler - INFO - Stopped scheduler at 'tls://10.0.4.73:37313' 3536s 2024-11-23 20:53:00,045 - distributed.scheduler - INFO - End scheduler 3536s _____________________________ test_use_config_file _____________________________ 3536s 3536s self = 3536s address = '127.0.0.1:47331', deserialize = True 3536s connection_args = {'extra_conn_args': {}, 'require_encryption': False, 'ssl_context': } 3536s ip = '127.0.0.1', port = 47331 3536s kwargs = {'ssl_options': } 3536s 3536s async def connect(self, address, deserialize=True, **connection_args): 3536s self._check_encryption(address, connection_args) 3536s ip, port = parse_host_port(address) 3536s kwargs = self._get_connect_args(**connection_args) 3536s 3536s try: 3536s # server_hostname option (for SNI) only works with tornado.iostream.IOStream 3536s if "server_hostname" in kwargs: 3536s stream = await self.client.connect( 3536s ip, port, max_buffer_size=MAX_BUFFER_SIZE 3536s ) 3536s stream = await stream.start_tls(False, **kwargs) 3536s else: 3536s > stream = await self.client.connect( 3536s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3536s ) 3536s 3536s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:546: 3536s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3536s /usr/lib/python3/dist-packages/tornado/tcpclient.py:292: in connect 3536s stream = await stream.start_tls( 3536s /usr/lib/python3/dist-packages/tornado/iostream.py:1367: in _do_ssl_handshake 3536s self.socket.do_handshake() 3536s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3536s 3536s self = , block = False 3536s 3536s @_sslcopydoc 3536s def do_handshake(self, block=False): 3536s self._check_connected() 3536s timeout = self.gettimeout() 3536s try: 3536s if timeout == 0.0 and block: 3536s self.settimeout(None) 3536s > self._sslobj.do_handshake() 3536s E ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 3536s 3536s /usr/lib/python3.13/ssl.py:1372: SSLCertVerificationError 3536s 3536s The above exception was the direct cause of the following exception: 3536s 3536s loop = 3536s 3536s def test_use_config_file(loop): 3536s port = open_port() 3536s with new_config_file(tls_only_config()): 3536s with popen( 3536s [ 3536s "dask", 3536s "scheduler", 3536s "--no-dashboard", 3536s "--host", 3536s "tls://", 3536s "--port", 3536s str(port), 3536s ] 3536s ) as s: 3536s with popen( 3536s ["dask", "worker", "--no-dashboard", f"tls://127.0.0.1:{port}"] 3536s ) as w: 3536s > with Client( 3536s f"tls://127.0.0.1:{port}", loop=loop, security=tls_security() 3536s ) as c: 3536s 3536s /usr/lib/python3/dist-packages/distributed/cli/tests/test_tls_cli.py:122: 3536s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3536s /usr/lib/python3/dist-packages/distributed/client.py:1018: in __init__ 3536s self.start(timeout=timeout) 3536s /usr/lib/python3/dist-packages/distributed/client.py:1220: in start 3536s sync(self.loop, self._start, **kwargs) 3536s /usr/lib/python3/dist-packages/distributed/utils.py:438: in sync 3536s raise error 3536s /usr/lib/python3/dist-packages/distributed/utils.py:412: in f 3536s result = yield future 3536s /usr/lib/python3/dist-packages/tornado/gen.py:766: in run 3536s value = future.result() 3536s /usr/lib/python3/dist-packages/distributed/client.py:1299: in _start 3536s await self._ensure_connected(timeout=timeout) 3536s /usr/lib/python3/dist-packages/distributed/client.py:1361: in _ensure_connected 3536s comm = await connect( 3536s /usr/lib/python3/dist-packages/distributed/comm/core.py:342: in connect 3536s comm = await wait_for( 3536s /usr/lib/python3/dist-packages/distributed/utils.py:1960: in wait_for 3536s return await fut 3536s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3536s 3536s self = 3536s address = '127.0.0.1:47331', deserialize = True 3536s connection_args = {'extra_conn_args': {}, 'require_encryption': False, 'ssl_context': } 3536s ip = '127.0.0.1', port = 47331 3536s kwargs = {'ssl_options': } 3536s 3536s async def connect(self, address, deserialize=True, **connection_args): 3536s self._check_encryption(address, connection_args) 3536s ip, port = parse_host_port(address) 3536s kwargs = self._get_connect_args(**connection_args) 3536s 3536s try: 3536s # server_hostname option (for SNI) only works with tornado.iostream.IOStream 3536s if "server_hostname" in kwargs: 3536s stream = await self.client.connect( 3536s ip, port, max_buffer_size=MAX_BUFFER_SIZE 3536s ) 3536s stream = await stream.start_tls(False, **kwargs) 3536s else: 3536s stream = await self.client.connect( 3536s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3536s ) 3536s 3536s # Under certain circumstances tornado will have a closed connection with an 3536s # error and not raise a StreamClosedError. 3536s # 3536s # This occurs with tornado 5.x and openssl 1.1+ 3536s if stream.closed() and stream.error: 3536s raise StreamClosedError(stream.error) 3536s 3536s except StreamClosedError as e: 3536s # The socket connect() call failed 3536s convert_stream_closed_error(self, e) 3536s except SSLCertVerificationError as err: 3536s > raise FatalCommClosedError( 3536s "TLS certificate does not match. Check your security settings. " 3536s "More info at https://distributed.dask.org/en/latest/tls.html" 3536s ) from err 3536s E distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 3536s 3536s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:561: FatalCommClosedError 3536s ----------------------------- Captured stderr call ----------------------------- 3536s 2024-11-23 20:53:01,732 - distributed.scheduler - INFO - ----------------------------------------------- 3536s 2024-11-23 20:53:01,762 - distributed.http.proxy - INFO - To route to workers diagnostics web server please install jupyter-server-proxy: python -m pip install jupyter-server-proxy 3536s 2024-11-23 20:53:01,767 - distributed.scheduler - INFO - State start 3536s 2024-11-23 20:53:01,777 - distributed.scheduler - INFO - ----------------------------------------------- 3536s 2024-11-23 20:53:01,780 - distributed.scheduler - INFO - Scheduler at: tls://10.0.4.73:47331 3536s 2024-11-23 20:53:01,781 - distributed.scheduler - INFO - dashboard at: http://10.0.4.73:8787/status 3536s 2024-11-23 20:53:01,781 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3536s 2024-11-23 20:53:01,823 - distributed.nanny - INFO - Start Nanny at: 'tls://127.0.0.1:33521' 3536s 2024-11-23 20:53:02,463 - distributed.comm.tcp - WARNING - Listener on 'tls://0.0.0.0:47331': TLS handshake failed with remote 'tls://127.0.0.1:49032': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1000) 3536s 2024-11-23 20:53:02,464 - distributed._signals - INFO - Received signal SIGINT (2) 3536s 2024-11-23 20:53:02,464 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:33521'. Reason: signal-2 3536s 2024-11-23 20:53:02,680 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36459 3536s 2024-11-23 20:53:02,680 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36459 3536s 2024-11-23 20:53:02,680 - distributed.worker - INFO - dashboard at: 127.0.0.1:36561 3536s 2024-11-23 20:53:02,680 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:47331 3536s 2024-11-23 20:53:02,680 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 20:53:02,680 - distributed.worker - INFO - Threads: 8 3536s 2024-11-23 20:53:02,680 - distributed.worker - INFO - Memory: 15.58 GiB 3536s 2024-11-23 20:53:02,680 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-6o0oinpz 3536s 2024-11-23 20:53:02,680 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 20:53:03,103 - distributed.scheduler - INFO - Register worker 3536s 2024-11-23 20:53:03,516 - distributed.scheduler - INFO - Starting worker compute stream, tls://127.0.0.1:36459 3536s 2024-11-23 20:53:03,517 - distributed.core - INFO - Starting established connection to tls://127.0.0.1:49044 3536s 2024-11-23 20:53:03,518 - distributed.worker - INFO - Starting Worker plugin shuffle 3536s 2024-11-23 20:53:03,519 - distributed.worker - INFO - Registered to: tls://127.0.0.1:47331 3536s 2024-11-23 20:53:03,520 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 20:53:03,521 - distributed.core - INFO - Starting established connection to tls://127.0.0.1:47331 3536s 2024-11-23 20:53:03,549 - distributed.nanny - INFO - Nanny asking worker to close. Reason: signal-2 3536s 2024-11-23 20:53:03,551 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36459. Reason: signal-2 3536s 2024-11-23 20:53:03,554 - distributed.core - INFO - Received 'close-stream' from tls://127.0.0.1:49044; closing. 3536s 2024-11-23 20:53:03,554 - distributed.core - INFO - Connection to tls://127.0.0.1:47331 has been closed. 3536s 2024-11-23 20:53:03,555 - distributed.scheduler - INFO - Remove worker (stimulus_id='handle-worker-cleanup-1732395183.555145') 3536s 2024-11-23 20:53:03,555 - distributed.scheduler - INFO - Lost all workers 3536s 2024-11-23 20:53:03,558 - distributed.nanny - INFO - Worker closed 3536s 2024-11-23 20:53:03,947 - distributed.dask_worker - INFO - End worker 3536s 2024-11-23 20:53:04,235 - distributed._signals - INFO - Received signal SIGINT (2) 3536s 2024-11-23 20:53:04,235 - distributed.scheduler - INFO - Scheduler closing due to signal-2... 3536s 2024-11-23 20:53:04,236 - distributed.scheduler - INFO - Scheduler closing all comms 3536s 2024-11-23 20:53:04,237 - distributed.scheduler - INFO - Stopped scheduler at 'tls://10.0.4.73:47331' 3536s 2024-11-23 20:53:04,237 - distributed.scheduler - INFO - End scheduler 3536s __________________________________ test_basic __________________________________ 3536s 3536s @pytest.mark.skipif(WINDOWS, reason="distributed#7434") 3536s @gen_test() 3536s async def test_basic(): 3536s async with SubprocessCluster( 3536s asynchronous=True, 3536s dashboard_address=":0", 3536s scheduler_kwargs={"idle_timeout": "5s"}, 3536s worker_kwargs={"death_timeout": "5s"}, 3536s ) as cluster: 3536s async with Client(cluster, asynchronous=True) as client: 3536s > result = await client.submit(lambda x: x + 1, 10) 3536s 3536s /usr/lib/python3/dist-packages/distributed/deploy/tests/test_subprocess.py:27: 3536s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3536s 3536s self = 3536s raiseit = True 3536s 3536s async def _result(self, raiseit=True): 3536s await self._state.wait() 3536s if self.status == "error": 3536s exc = clean_exception(self._state.exception, self._state.traceback) 3536s if raiseit: 3536s typ, exc, tb = exc 3536s > raise exc.with_traceback(tb) 3536s E SystemError: no locals found when setting up annotations 3536s 3536s /usr/lib/python3/dist-packages/distributed/client.py:337: SystemError 3536s ----------------------------- Captured stderr call ----------------------------- 3536s 2024-11-23 20:53:12,035 - distributed.worker - WARNING - Compute Failed 3536s Key: lambda-f3b41d234e8d3805a39c193d3564145c 3536s Function: lambda 3536s args: (10) 3536s kwargs: {} 3536s Exception: "SystemError('no locals found when setting up annotations')" 3536s 3536s ________________________________ test_n_workers ________________________________ 3536s 3536s @pytest.mark.skipif(WINDOWS, reason="distributed#7434") 3536s @gen_test() 3536s async def test_n_workers(): 3536s async with SubprocessCluster( 3536s asynchronous=True, dashboard_address=":0", n_workers=2 3536s ) as cluster: 3536s async with Client(cluster, asynchronous=True) as client: 3536s assert len(cluster.workers) == 2 3536s > result = await client.submit(lambda x: x + 1, 10) 3536s 3536s /usr/lib/python3/dist-packages/distributed/deploy/tests/test_subprocess.py:41: 3536s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3536s 3536s self = 3536s raiseit = True 3536s 3536s async def _result(self, raiseit=True): 3536s await self._state.wait() 3536s if self.status == "error": 3536s exc = clean_exception(self._state.exception, self._state.traceback) 3536s if raiseit: 3536s typ, exc, tb = exc 3536s > raise exc.with_traceback(tb) 3536s E SystemError: no locals found when setting up annotations 3536s 3536s /usr/lib/python3/dist-packages/distributed/client.py:337: SystemError 3536s ----------------------------- Captured stderr call ----------------------------- 3536s 2024-11-23 20:53:15,332 - distributed.worker - WARNING - Compute Failed 3536s Key: lambda-181b28c0c705f6e48fbf22b0c3a995c6 3536s Function: lambda 3536s args: (10) 3536s kwargs: {} 3536s Exception: "SystemError('no locals found when setting up annotations')" 3536s 3536s _____________________________ test_upload_file_zip _____________________________ 3536s 3536s c = 3536s s = 3536s a = 3536s b = 3536s 3536s @gen_cluster(client=True) 3536s async def test_upload_file_zip(c, s, a, b): 3536s def g(): 3536s import myfile 3536s 3536s return myfile.f() 3536s 3536s with save_sys_modules(): 3536s try: 3536s for value in [123, 456]: 3536s with tmp_text( 3536s "myfile.py", f"def f():\n return {value}" 3536s ) as fn_my_file: 3536s with zipfile.ZipFile("myfile.zip", "w") as z: 3536s z.write(fn_my_file, arcname=os.path.basename(fn_my_file)) 3536s > await c.upload_file("myfile.zip") 3536s 3536s /usr/lib/python3/dist-packages/distributed/tests/test_client.py:1716: 3536s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3536s /usr/lib/python3/dist-packages/distributed/client.py:3824: in _ 3536s results = await asyncio.gather( 3536s /usr/lib/python3/dist-packages/distributed/client.py:4939: in _register_scheduler_plugin 3536s return await self.scheduler.register_scheduler_plugin( 3536s /usr/lib/python3/dist-packages/distributed/core.py:1395: in send_recv_from_rpc 3536s return await send_recv(comm=comm, op=key, **kwargs) 3536s /usr/lib/python3/dist-packages/distributed/core.py:1179: in send_recv 3536s raise exc.with_traceback(tb) 3536s /usr/lib/python3/dist-packages/distributed/core.py:970: in _handle_comm 3536s result = await result 3536s /usr/lib/python3/dist-packages/distributed/scheduler.py:6035: in register_scheduler_plugin 3536s await result 3536s /usr/lib/python3/dist-packages/distributed/diagnostics/plugin.py:396: in start 3536s await scheduler.upload_file(self.filename, self.data, load=self.load) 3536s /usr/lib/python3/dist-packages/distributed/core.py:563: in upload_file 3536s raise e 3536s /usr/lib/python3/dist-packages/distributed/core.py:560: in upload_file 3536s import_file(out_filename) 3536s /usr/lib/python3/dist-packages/distributed/utils.py:1162: in import_file 3536s names_to_import.extend(names) 3536s /usr/lib/python3/dist-packages/distributed/utils.py:1161: in 3536s names = (mod_info.name for mod_info in pkgutil.iter_modules([path])) 3536s /usr/lib/python3.13/pkgutil.py:116: in iter_modules 3536s for name, ispkg in iter_importer_modules(i, prefix): 3536s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3536s 3536s """Utilities to support packages.""" 3536s 3536s from collections import namedtuple 3536s from functools import singledispatch as simplegeneric 3536s import importlib 3536s import importlib.util 3536s import importlib.machinery 3536s import os 3536s import os.path 3536s import sys 3536s from types import ModuleType 3536s import warnings 3536s 3536s __all__ = [ 3536s 'get_importer', 'iter_importers', 'get_loader', 'find_loader', 3536s 'walk_packages', 'iter_modules', 'get_data', 3536s 'read_code', 'extend_path', 3536s 'ModuleInfo', 3536s ] 3536s 3536s 3536s ModuleInfo = namedtuple('ModuleInfo', 'module_finder name ispkg') 3536s ModuleInfo.__doc__ = 'A namedtuple with minimal info about a module.' 3536s 3536s 3536s def read_code(stream): 3536s # This helper is needed in order for the PEP 302 emulation to 3536s # correctly handle compiled files 3536s import marshal 3536s 3536s magic = stream.read(4) 3536s if magic != importlib.util.MAGIC_NUMBER: 3536s return None 3536s 3536s stream.read(12) # Skip rest of the header 3536s return marshal.load(stream) 3536s 3536s 3536s def walk_packages(path=None, prefix='', onerror=None): 3536s """Yields ModuleInfo for all modules recursively 3536s on path, or, if path is None, all accessible modules. 3536s 3536s 'path' should be either None or a list of paths to look for 3536s modules in. 3536s 3536s 'prefix' is a string to output on the front of every module name 3536s on output. 3536s 3536s Note that this function must import all *packages* (NOT all 3536s modules!) on the given path, in order to access the __path__ 3536s attribute to find submodules. 3536s 3536s 'onerror' is a function which gets called with one argument (the 3536s name of the package which was being imported) if any exception 3536s occurs while trying to import a package. If no onerror function is 3536s supplied, ImportErrors are caught and ignored, while all other 3536s exceptions are propagated, terminating the search. 3536s 3536s Examples: 3536s 3536s # list all modules python can access 3536s walk_packages() 3536s 3536s # list all submodules of ctypes 3536s walk_packages(ctypes.__path__, ctypes.__name__+'.') 3536s """ 3536s 3536s def seen(p, m={}): 3536s if p in m: 3536s return True 3536s m[p] = True 3536s 3536s for info in iter_modules(path, prefix): 3536s yield info 3536s 3536s if info.ispkg: 3536s try: 3536s __import__(info.name) 3536s except ImportError: 3536s if onerror is not None: 3536s onerror(info.name) 3536s except Exception: 3536s if onerror is not None: 3536s onerror(info.name) 3536s else: 3536s raise 3536s else: 3536s path = getattr(sys.modules[info.name], '__path__', None) or [] 3536s 3536s # don't traverse path items we've seen before 3536s path = [p for p in path if not seen(p)] 3536s 3536s yield from walk_packages(path, info.name+'.', onerror) 3536s 3536s 3536s def iter_modules(path=None, prefix=''): 3536s """Yields ModuleInfo for all submodules on path, 3536s or, if path is None, all top-level modules on sys.path. 3536s 3536s 'path' should be either None or a list of paths to look for 3536s modules in. 3536s 3536s 'prefix' is a string to output on the front of every module name 3536s on output. 3536s """ 3536s if path is None: 3536s importers = iter_importers() 3536s elif isinstance(path, str): 3536s raise ValueError("path must be None or list of paths to look for " 3536s "modules in") 3536s else: 3536s importers = map(get_importer, path) 3536s 3536s yielded = {} 3536s for i in importers: 3536s for name, ispkg in iter_importer_modules(i, prefix): 3536s if name not in yielded: 3536s yielded[name] = 1 3536s yield ModuleInfo(i, name, ispkg) 3536s 3536s 3536s @simplegeneric 3536s def iter_importer_modules(importer, prefix=''): 3536s if not hasattr(importer, 'iter_modules'): 3536s return [] 3536s return importer.iter_modules(prefix) 3536s 3536s 3536s # Implement a file walker for the normal importlib path hook 3536s def _iter_file_finder_modules(importer, prefix=''): 3536s if importer.path is None or not os.path.isdir(importer.path): 3536s return 3536s 3536s yielded = {} 3536s import inspect 3536s try: 3536s filenames = os.listdir(importer.path) 3536s except OSError: 3536s # ignore unreadable directories like import does 3536s filenames = [] 3536s filenames.sort() # handle packages before same-named modules 3536s 3536s for fn in filenames: 3536s modname = inspect.getmodulename(fn) 3536s if modname=='__init__' or modname in yielded: 3536s continue 3536s 3536s path = os.path.join(importer.path, fn) 3536s ispkg = False 3536s 3536s if not modname and os.path.isdir(path) and '.' not in fn: 3536s modname = fn 3536s try: 3536s dircontents = os.listdir(path) 3536s except OSError: 3536s # ignore unreadable directories like import does 3536s dircontents = [] 3536s for fn in dircontents: 3536s subname = inspect.getmodulename(fn) 3536s if subname=='__init__': 3536s ispkg = True 3536s break 3536s else: 3536s continue # not a package 3536s 3536s if modname and '.' not in modname: 3536s yielded[modname] = 1 3536s yield prefix + modname, ispkg 3536s 3536s iter_importer_modules.register( 3536s importlib.machinery.FileFinder, _iter_file_finder_modules) 3536s 3536s 3536s try: 3536s import zipimport 3536s from zipimport import zipimporter 3536s 3536s def iter_zipimport_modules(importer, prefix=''): 3536s > dirlist = sorted(zipimport._zip_directory_cache[importer.archive]) 3536s E KeyError: '/tmp/dask-scratch-space/scheduler-uym9plud/myfile.zip' 3536s 3536s /usr/lib/python3.13/pkgutil.py:179: KeyError 3536s ----------------------------- Captured stdout call ----------------------------- 3536s Dumped cluster state to test_cluster_dump/test_upload_file_zip.yaml 3536s ----------------------------- Captured stderr call ----------------------------- 3536s 2024-11-23 20:59:27,217 - distributed.scheduler - INFO - State start 3536s 2024-11-23 20:59:27,226 - distributed.scheduler - INFO - Scheduler at: tcp://127.0.0.1:33949 3536s 2024-11-23 20:59:27,227 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40201/status 3536s 2024-11-23 20:59:27,227 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3536s 2024-11-23 20:59:27,245 - distributed.worker - INFO - Start worker at: tcp://127.0.0.1:37313 3536s 2024-11-23 20:59:27,245 - distributed.worker - INFO - Listening to: tcp://127.0.0.1:37313 3536s 2024-11-23 20:59:27,245 - distributed.worker - INFO - Worker name: 0 3536s 2024-11-23 20:59:27,245 - distributed.worker - INFO - dashboard at: 127.0.0.1:46731 3536s 2024-11-23 20:59:27,246 - distributed.worker - INFO - Waiting to connect to: tcp://127.0.0.1:33949 3536s 2024-11-23 20:59:27,246 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 20:59:27,246 - distributed.worker - INFO - Threads: 1 3536s 2024-11-23 20:59:27,246 - distributed.worker - INFO - Memory: 15.58 GiB 3536s 2024-11-23 20:59:27,246 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ue9fhhk7 3536s 2024-11-23 20:59:27,246 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 20:59:27,248 - distributed.worker - INFO - Start worker at: tcp://127.0.0.1:36615 3536s 2024-11-23 20:59:27,248 - distributed.worker - INFO - Listening to: tcp://127.0.0.1:36615 3536s 2024-11-23 20:59:27,248 - distributed.worker - INFO - Worker name: 1 3536s 2024-11-23 20:59:27,248 - distributed.worker - INFO - dashboard at: 127.0.0.1:35245 3536s 2024-11-23 20:59:27,248 - distributed.worker - INFO - Waiting to connect to: tcp://127.0.0.1:33949 3536s 2024-11-23 20:59:27,248 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 20:59:27,249 - distributed.worker - INFO - Threads: 2 3536s 2024-11-23 20:59:27,249 - distributed.worker - INFO - Memory: 15.58 GiB 3536s 2024-11-23 20:59:27,249 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-_h_qja6w 3536s 2024-11-23 20:59:27,249 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 20:59:27,277 - distributed.scheduler - INFO - Register worker 3536s 2024-11-23 20:59:27,287 - distributed.scheduler - INFO - Starting worker compute stream, tcp://127.0.0.1:37313 3536s 2024-11-23 20:59:27,288 - distributed.core - INFO - Starting established connection to tcp://127.0.0.1:37656 3536s 2024-11-23 20:59:27,291 - distributed.scheduler - INFO - Register worker 3536s 2024-11-23 20:59:27,301 - distributed.scheduler - INFO - Starting worker compute stream, tcp://127.0.0.1:36615 3536s 2024-11-23 20:59:27,301 - distributed.core - INFO - Starting established connection to tcp://127.0.0.1:37668 3536s 2024-11-23 20:59:27,303 - distributed.worker - INFO - Starting Worker plugin shuffle 3536s 2024-11-23 20:59:27,303 - distributed.worker - INFO - Starting Worker plugin shuffle 3536s 2024-11-23 20:59:27,304 - distributed.worker - INFO - Registered to: tcp://127.0.0.1:33949 3536s 2024-11-23 20:59:27,304 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 20:59:27,305 - distributed.worker - INFO - Registered to: tcp://127.0.0.1:33949 3536s 2024-11-23 20:59:27,305 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 20:59:27,306 - distributed.core - INFO - Starting established connection to tcp://127.0.0.1:33949 3536s 2024-11-23 20:59:27,306 - distributed.core - INFO - Starting established connection to tcp://127.0.0.1:33949 3536s 2024-11-23 20:59:27,322 - distributed.scheduler - INFO - Receive client connection: Client-d380ac5f-a9dd-11ef-8ed0-00163e4db70f 3536s 2024-11-23 20:59:27,332 - distributed.core - INFO - Starting established connection to tcp://127.0.0.1:37678 3536s 2024-11-23 20:59:27,341 - distributed.utils - INFO - Reload module myfile from .zip file 3536s 2024-11-23 20:59:27,345 - distributed.scheduler - INFO - Registering Worker plugin myfile.zip7743d762-fd13-4e8b-8e55-0d3f8f5ba738 3536s 2024-11-23 20:59:27,349 - distributed.worker - INFO - Starting Worker plugin myfile.zip7743d762-fd13-4e8b-8e55-0d3f8f5ba738 3536s 2024-11-23 20:59:27,353 - distributed.utils - INFO - Reload module myfile from .zip file 3536s 2024-11-23 20:59:27,355 - distributed.worker - INFO - Starting Worker plugin myfile.zip7743d762-fd13-4e8b-8e55-0d3f8f5ba738 3536s 2024-11-23 20:59:27,359 - distributed.utils - INFO - Reload module myfile from .zip file 3536s 2024-11-23 20:59:27,382 - distributed.core - ERROR - '/tmp/dask-scratch-space/scheduler-uym9plud/myfile.zip' 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/core.py", line 560, in upload_file 3536s import_file(out_filename) 3536s ~~~~~~~~~~~^^^^^^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1162, in import_file 3536s names_to_import.extend(names) 3536s ~~~~~~~~~~~~~~~~~~~~~~^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1161, in 3536s names = (mod_info.name for mod_info in pkgutil.iter_modules([path])) 3536s ~~~~~~~~~~~~~~~~~~~~^^^^^^^^ 3536s File "/usr/lib/python3.13/pkgutil.py", line 116, in iter_modules 3536s for name, ispkg in iter_importer_modules(i, prefix): 3536s ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^ 3536s File "/usr/lib/python3.13/pkgutil.py", line 179, in iter_zipimport_modules 3536s dirlist = sorted(zipimport._zip_directory_cache[importer.archive]) 3536s ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^ 3536s KeyError: '/tmp/dask-scratch-space/scheduler-uym9plud/myfile.zip' 3536s 2024-11-23 20:59:27,384 - distributed.core - ERROR - Exception while handling op register_scheduler_plugin 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/core.py", line 970, in _handle_comm 3536s result = await result 3536s ^^^^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/scheduler.py", line 6035, in register_scheduler_plugin 3536s await result 3536s File "/usr/lib/python3/dist-packages/distributed/diagnostics/plugin.py", line 396, in start 3536s await scheduler.upload_file(self.filename, self.data, load=self.load) 3536s File "/usr/lib/python3/dist-packages/distributed/core.py", line 563, in upload_file 3536s raise e 3536s File "/usr/lib/python3/dist-packages/distributed/core.py", line 560, in upload_file 3536s import_file(out_filename) 3536s ~~~~~~~~~~~^^^^^^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1162, in import_file 3536s names_to_import.extend(names) 3536s ~~~~~~~~~~~~~~~~~~~~~~^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1161, in 3536s names = (mod_info.name for mod_info in pkgutil.iter_modules([path])) 3536s ~~~~~~~~~~~~~~~~~~~~^^^^^^^^ 3536s File "/usr/lib/python3.13/pkgutil.py", line 116, in iter_modules 3536s for name, ispkg in iter_importer_modules(i, prefix): 3536s ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^ 3536s File "/usr/lib/python3.13/pkgutil.py", line 179, in iter_zipimport_modules 3536s dirlist = sorted(zipimport._zip_directory_cache[importer.archive]) 3536s ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^ 3536s KeyError: '/tmp/dask-scratch-space/scheduler-uym9plud/myfile.zip' 3536s 2024-11-23 20:59:27,391 - distributed.scheduler - INFO - Registering Worker plugin myfile.zip028095b0-43a2-4a9c-9dc6-23c7373c699a 3536s 2024-11-23 20:59:27,395 - distributed.worker - INFO - Starting Worker plugin myfile.zip028095b0-43a2-4a9c-9dc6-23c7373c699a 3536s 2024-11-23 20:59:27,397 - distributed.core - ERROR - '/tmp/dask-scratch-space/worker-_h_qja6w/myfile.zip' 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/core.py", line 560, in upload_file 3536s import_file(out_filename) 3536s ~~~~~~~~~~~^^^^^^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1162, in import_file 3536s names_to_import.extend(names) 3536s ~~~~~~~~~~~~~~~~~~~~~~^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1161, in 3536s names = (mod_info.name for mod_info in pkgutil.iter_modules([path])) 3536s ~~~~~~~~~~~~~~~~~~~~^^^^^^^^ 3536s File "/usr/lib/python3.13/pkgutil.py", line 116, in iter_modules 3536s for name, ispkg in iter_importer_modules(i, prefix): 3536s ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^ 3536s File "/usr/lib/python3.13/pkgutil.py", line 179, in iter_zipimport_modules 3536s dirlist = sorted(zipimport._zip_directory_cache[importer.archive]) 3536s ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^ 3536s KeyError: '/tmp/dask-scratch-space/worker-_h_qja6w/myfile.zip' 3536s 2024-11-23 20:59:27,494 - distributed.worker - INFO - Starting Worker plugin myfile.zip028095b0-43a2-4a9c-9dc6-23c7373c699a 3536s 2024-11-23 20:59:27,498 - distributed.utils - INFO - Reload module myfile from .zip file 3536s 2024-11-23 20:59:27,501 - distributed.scheduler - INFO - Remove client Client-d380ac5f-a9dd-11ef-8ed0-00163e4db70f 3536s 2024-11-23 20:59:27,502 - distributed.core - INFO - Received 'close-stream' from tcp://127.0.0.1:37678; closing. 3536s 2024-11-23 20:59:27,502 - distributed.scheduler - INFO - Remove client Client-d380ac5f-a9dd-11ef-8ed0-00163e4db70f 3536s 2024-11-23 20:59:27,505 - distributed.scheduler - INFO - Close client connection: Client-d380ac5f-a9dd-11ef-8ed0-00163e4db70f 3536s 2024-11-23 20:59:27,507 - distributed.worker - INFO - Stopping worker at tcp://127.0.0.1:37313. Reason: worker-close 3536s 2024-11-23 20:59:27,508 - distributed.worker - INFO - Stopping worker at tcp://127.0.0.1:36615. Reason: worker-close 3536s 2024-11-23 20:59:27,512 - distributed.core - INFO - Received 'close-stream' from tcp://127.0.0.1:37668; closing. 3536s 2024-11-23 20:59:27,513 - distributed.scheduler - INFO - Remove worker (stimulus_id='handle-worker-cleanup-1732395567.5129182') 3536s 2024-11-23 20:59:27,513 - distributed.core - INFO - Connection to tcp://127.0.0.1:33949 has been closed. 3536s 2024-11-23 20:59:27,515 - distributed.core - INFO - Received 'close-stream' from tcp://127.0.0.1:37656; closing. 3536s 2024-11-23 20:59:27,516 - distributed.scheduler - INFO - Remove worker (stimulus_id='handle-worker-cleanup-1732395567.5158994') 3536s 2024-11-23 20:59:27,516 - distributed.scheduler - INFO - Lost all workers 3536s 2024-11-23 20:59:27,516 - distributed.core - INFO - Connection to tcp://127.0.0.1:33949 has been closed. 3536s 2024-11-23 20:59:27,520 - distributed.scheduler - INFO - Scheduler closing due to unknown reason... 3536s 2024-11-23 20:59:27,521 - distributed.scheduler - INFO - Scheduler closing all comms 3536s ________________________ test_info_frame_f_lineno[22-4] ________________________ 3536s 3536s f_lasti = 22, f_lineno = 4 3536s 3536s @pytest.mark.parametrize( 3536s "f_lasti,f_lineno", 3536s [ 3536s (-1, 1), 3536s (0, 2), 3536s (1, 2), 3536s (11, 2), 3536s (12, 3), 3536s (21, 4), 3536s (22, 4), 3536s (23, 4), 3536s (24, 2), 3536s (25, 2), 3536s (26, 2), 3536s (27, 2), 3536s (100, 2), 3536s ], 3536s ) 3536s def test_info_frame_f_lineno(f_lasti: int, f_lineno: int) -> None: 3536s > assert info_frame(FakeFrame(f_lasti=f_lasti, f_code=FAKE_CODE)) == { # type: ignore 3536s "filename": "", 3536s "name": "example", 3536s "line_number": f_lineno, 3536s "line": "", 3536s } 3536s 3536s /usr/lib/python3/dist-packages/distributed/tests/test_profile.py:327: 3536s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3536s /usr/lib/python3/dist-packages/distributed/profile.py:115: in info_frame 3536s line = linecache.getline(co.co_filename, f_lineno, frame.f_globals).lstrip() 3536s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3536s 3536s filename = '', lineno = None, module_globals = {} 3536s 3536s def getline(filename, lineno, module_globals=None): 3536s """Get a line for a Python source file from the cache. 3536s Update the cache if it doesn't contain an entry for this file already.""" 3536s 3536s lines = getlines(filename, module_globals) 3536s > if 1 <= lineno <= len(lines): 3536s E TypeError: '<=' not supported between instances of 'int' and 'NoneType' 3536s 3536s /usr/lib/python3.13/linecache.py:26: TypeError 3536s ________________________ test_info_frame_f_lineno[23-4] ________________________ 3536s 3536s f_lasti = 23, f_lineno = 4 3536s 3536s @pytest.mark.parametrize( 3536s "f_lasti,f_lineno", 3536s [ 3536s (-1, 1), 3536s (0, 2), 3536s (1, 2), 3536s (11, 2), 3536s (12, 3), 3536s (21, 4), 3536s (22, 4), 3536s (23, 4), 3536s (24, 2), 3536s (25, 2), 3536s (26, 2), 3536s (27, 2), 3536s (100, 2), 3536s ], 3536s ) 3536s def test_info_frame_f_lineno(f_lasti: int, f_lineno: int) -> None: 3536s > assert info_frame(FakeFrame(f_lasti=f_lasti, f_code=FAKE_CODE)) == { # type: ignore 3536s "filename": "", 3536s "name": "example", 3536s "line_number": f_lineno, 3536s "line": "", 3536s } 3536s 3536s /usr/lib/python3/dist-packages/distributed/tests/test_profile.py:327: 3536s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3536s /usr/lib/python3/dist-packages/distributed/profile.py:115: in info_frame 3536s line = linecache.getline(co.co_filename, f_lineno, frame.f_globals).lstrip() 3536s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3536s 3536s filename = '', lineno = None, module_globals = {} 3536s 3536s def getline(filename, lineno, module_globals=None): 3536s """Get a line for a Python source file from the cache. 3536s Update the cache if it doesn't contain an entry for this file already.""" 3536s 3536s lines = getlines(filename, module_globals) 3536s > if 1 <= lineno <= len(lines): 3536s E TypeError: '<=' not supported between instances of 'int' and 'NoneType' 3536s 3536s /usr/lib/python3.13/linecache.py:26: TypeError 3536s ________________________ test_call_stack_f_lineno[22-4] ________________________ 3536s 3536s f_lasti = 22, f_lineno = 4 3536s 3536s @pytest.mark.parametrize( 3536s "f_lasti,f_lineno", 3536s [ 3536s (-1, 1), 3536s (0, 2), 3536s (1, 2), 3536s (11, 2), 3536s (12, 3), 3536s (21, 4), 3536s (22, 4), 3536s (23, 4), 3536s (24, 2), 3536s (25, 2), 3536s (26, 2), 3536s (27, 2), 3536s (100, 2), 3536s ], 3536s ) 3536s def test_call_stack_f_lineno(f_lasti: int, f_lineno: int) -> None: 3536s > assert call_stack(FakeFrame(f_lasti=f_lasti, f_code=FAKE_CODE)) == [ # type: ignore 3536s f' File "", line {f_lineno}, in example\n\t' 3536s ] 3536s 3536s /usr/lib/python3/dist-packages/distributed/tests/test_profile.py:354: 3536s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3536s /usr/lib/python3/dist-packages/distributed/profile.py:263: in call_stack 3536s L.append(repr_frame(cur_frame)) 3536s /usr/lib/python3/dist-packages/distributed/profile.py:105: in repr_frame 3536s line = linecache.getline(co.co_filename, f_lineno, frame.f_globals).lstrip() 3536s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3536s 3536s filename = '', lineno = None, module_globals = {} 3536s 3536s def getline(filename, lineno, module_globals=None): 3536s """Get a line for a Python source file from the cache. 3536s Update the cache if it doesn't contain an entry for this file already.""" 3536s 3536s lines = getlines(filename, module_globals) 3536s > if 1 <= lineno <= len(lines): 3536s E TypeError: '<=' not supported between instances of 'int' and 'NoneType' 3536s 3536s /usr/lib/python3.13/linecache.py:26: TypeError 3536s ________________________ test_call_stack_f_lineno[23-4] ________________________ 3536s 3536s f_lasti = 23, f_lineno = 4 3536s 3536s @pytest.mark.parametrize( 3536s "f_lasti,f_lineno", 3536s [ 3536s (-1, 1), 3536s (0, 2), 3536s (1, 2), 3536s (11, 2), 3536s (12, 3), 3536s (21, 4), 3536s (22, 4), 3536s (23, 4), 3536s (24, 2), 3536s (25, 2), 3536s (26, 2), 3536s (27, 2), 3536s (100, 2), 3536s ], 3536s ) 3536s def test_call_stack_f_lineno(f_lasti: int, f_lineno: int) -> None: 3536s > assert call_stack(FakeFrame(f_lasti=f_lasti, f_code=FAKE_CODE)) == [ # type: ignore 3536s f' File "", line {f_lineno}, in example\n\t' 3536s ] 3536s 3536s /usr/lib/python3/dist-packages/distributed/tests/test_profile.py:354: 3536s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3536s /usr/lib/python3/dist-packages/distributed/profile.py:263: in call_stack 3536s L.append(repr_frame(cur_frame)) 3536s /usr/lib/python3/dist-packages/distributed/profile.py:105: in repr_frame 3536s line = linecache.getline(co.co_filename, f_lineno, frame.f_globals).lstrip() 3536s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3536s 3536s filename = '', lineno = None, module_globals = {} 3536s 3536s def getline(filename, lineno, module_globals=None): 3536s """Get a line for a Python source file from the cache. 3536s Update the cache if it doesn't contain an entry for this file already.""" 3536s 3536s lines = getlines(filename, module_globals) 3536s > if 1 <= lineno <= len(lines): 3536s E TypeError: '<=' not supported between instances of 'int' and 'NoneType' 3536s 3536s /usr/lib/python3.13/linecache.py:26: TypeError 3536s ______________________________ test_broadcast_tls ______________________________ 3536s 3536s fut = , timeout = 0 3536s 3536s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 3536s async with asyncio.timeout(timeout): 3536s > return await fut 3536s 3536s /usr/lib/python3/dist-packages/distributed/utils.py:1960: 3536s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3536s /usr/lib/python3/dist-packages/distributed/worker.py:1480: in start_unsafe 3536s await self._register_with_scheduler() 3536s /usr/lib/python3/dist-packages/distributed/worker.py:1179: in _register_with_scheduler 3536s comm = await connect(self.scheduler.address, **self.connection_args) 3536s /usr/lib/python3/dist-packages/distributed/comm/core.py:342: in connect 3536s comm = await wait_for( 3536s /usr/lib/python3/dist-packages/distributed/utils.py:1960: in wait_for 3536s return await fut 3536s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:546: in connect 3536s stream = await self.client.connect( 3536s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3536s 3536s self = , host = '127.0.0.1' 3536s port = 42613, af = 3536s ssl_options = 3536s max_buffer_size = 8364507136.0, source_ip = None, source_port = None 3536s timeout = None 3536s 3536s async def connect( 3536s self, 3536s host: str, 3536s port: int, 3536s af: socket.AddressFamily = socket.AF_UNSPEC, 3536s ssl_options: Optional[Union[Dict[str, Any], ssl.SSLContext]] = None, 3536s max_buffer_size: Optional[int] = None, 3536s source_ip: Optional[str] = None, 3536s source_port: Optional[int] = None, 3536s timeout: Optional[Union[float, datetime.timedelta]] = None, 3536s ) -> IOStream: 3536s """Connect to the given host and port. 3536s 3536s Asynchronously returns an `.IOStream` (or `.SSLIOStream` if 3536s ``ssl_options`` is not None). 3536s 3536s Using the ``source_ip`` kwarg, one can specify the source 3536s IP address to use when establishing the connection. 3536s In case the user needs to resolve and 3536s use a specific interface, it has to be handled outside 3536s of Tornado as this depends very much on the platform. 3536s 3536s Raises `TimeoutError` if the input future does not complete before 3536s ``timeout``, which may be specified in any form allowed by 3536s `.IOLoop.add_timeout` (i.e. a `datetime.timedelta` or an absolute time 3536s relative to `.IOLoop.time`) 3536s 3536s Similarly, when the user requires a certain source port, it can 3536s be specified using the ``source_port`` arg. 3536s 3536s .. versionchanged:: 4.5 3536s Added the ``source_ip`` and ``source_port`` arguments. 3536s 3536s .. versionchanged:: 5.0 3536s Added the ``timeout`` argument. 3536s """ 3536s if timeout is not None: 3536s if isinstance(timeout, numbers.Real): 3536s timeout = IOLoop.current().time() + timeout 3536s elif isinstance(timeout, datetime.timedelta): 3536s timeout = IOLoop.current().time() + timeout.total_seconds() 3536s else: 3536s raise TypeError("Unsupported timeout %r" % timeout) 3536s if timeout is not None: 3536s addrinfo = await gen.with_timeout( 3536s timeout, self.resolver.resolve(host, port, af) 3536s ) 3536s else: 3536s addrinfo = await self.resolver.resolve(host, port, af) 3536s connector = _Connector( 3536s addrinfo, 3536s functools.partial( 3536s self._create_stream, 3536s max_buffer_size, 3536s source_ip=source_ip, 3536s source_port=source_port, 3536s ), 3536s ) 3536s > af, addr, stream = await connector.start(connect_timeout=timeout) 3536s E asyncio.exceptions.CancelledError 3536s 3536s /usr/lib/python3/dist-packages/tornado/tcpclient.py:279: CancelledError 3536s 3536s The above exception was the direct cause of the following exception: 3536s 3536s self = 3536s 3536s @final 3536s async def start(self): 3536s async with self._startup_lock: 3536s if self.status == Status.failed: 3536s assert self.__startup_exc is not None 3536s raise self.__startup_exc 3536s elif self.status != Status.init: 3536s return self 3536s timeout = getattr(self, "death_timeout", None) 3536s 3536s async def _close_on_failure(exc: Exception) -> None: 3536s await self.close(reason=f"failure-to-start-{str(type(exc))}") 3536s self.status = Status.failed 3536s self.__startup_exc = exc 3536s 3536s try: 3536s > await wait_for(self.start_unsafe(), timeout=timeout) 3536s 3536s /usr/lib/python3/dist-packages/distributed/core.py:664: 3536s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3536s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 3536s async with asyncio.timeout(timeout): 3536s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3536s 3536s self = 3536s exc_type = 3536s exc_val = CancelledError(), exc_tb = 3536s 3536s async def __aexit__( 3536s self, 3536s exc_type: Optional[Type[BaseException]], 3536s exc_val: Optional[BaseException], 3536s exc_tb: Optional[TracebackType], 3536s ) -> Optional[bool]: 3536s assert self._state in (_State.ENTERED, _State.EXPIRING) 3536s 3536s if self._timeout_handler is not None: 3536s self._timeout_handler.cancel() 3536s self._timeout_handler = None 3536s 3536s if self._state is _State.EXPIRING: 3536s self._state = _State.EXPIRED 3536s 3536s if self._task.uncancel() <= self._cancelling and exc_type is not None: 3536s # Since there are no new cancel requests, we're 3536s # handling this. 3536s if issubclass(exc_type, exceptions.CancelledError): 3536s > raise TimeoutError from exc_val 3536s E TimeoutError 3536s 3536s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 3536s 3536s The above exception was the direct cause of the following exception: 3536s 3536s @contextlib.asynccontextmanager 3536s async def _cluster_factory(): 3536s workers = [] 3536s s = None 3536s try: 3536s for _ in range(60): 3536s try: 3536s > s, ws = await start_cluster( 3536s nthreads, 3536s scheduler, 3536s security=security, 3536s Worker=Worker, 3536s scheduler_kwargs=scheduler_kwargs, 3536s worker_kwargs=merge( 3536s {"death_timeout": min(15, int(deadline.remaining))}, 3536s worker_kwargs, 3536s ), 3536s ) 3536s 3536s /usr/lib/python3/dist-packages/distributed/utils_test.py:966: 3536s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3536s /usr/lib/python3/dist-packages/distributed/utils_test.py:789: in start_cluster 3536s await asyncio.gather(*workers) 3536s /usr/lib/python3.13/asyncio/tasks.py:737: in _wrap_awaitable 3536s return await awaitable 3536s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3536s 3536s self = 3536s 3536s @final 3536s async def start(self): 3536s async with self._startup_lock: 3536s if self.status == Status.failed: 3536s assert self.__startup_exc is not None 3536s raise self.__startup_exc 3536s elif self.status != Status.init: 3536s return self 3536s timeout = getattr(self, "death_timeout", None) 3536s 3536s async def _close_on_failure(exc: Exception) -> None: 3536s await self.close(reason=f"failure-to-start-{str(type(exc))}") 3536s self.status = Status.failed 3536s self.__startup_exc = exc 3536s 3536s try: 3536s await wait_for(self.start_unsafe(), timeout=timeout) 3536s except asyncio.TimeoutError as exc: 3536s await _close_on_failure(exc) 3536s > raise asyncio.TimeoutError( 3536s f"{type(self).__name__} start timed out after {timeout}s." 3536s ) from exc 3536s E TimeoutError: Worker start timed out after 0s. 3536s 3536s /usr/lib/python3/dist-packages/distributed/core.py:667: TimeoutError 3536s 3536s During handling of the above exception, another exception occurred: 3536s 3536s fut = ._..test_func..async_fn at 0xe247c598> 3536s timeout = 60 3536s 3536s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 3536s async with asyncio.timeout(timeout): 3536s > return await fut 3536s 3536s /usr/lib/python3/dist-packages/distributed/utils.py:1960: 3536s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3536s /usr/lib/python3/dist-packages/distributed/utils_test.py:999: in async_fn 3536s _cluster_factory() as (s, workers), 3536s /usr/lib/python3.13/contextlib.py:214: in __aenter__ 3536s return await anext(self.gen) 3536s /usr/lib/python3/dist-packages/distributed/utils_test.py:983: in _cluster_factory 3536s await asyncio.sleep(1) 3536s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3536s 3536s delay = 1, result = None 3536s 3536s async def sleep(delay, result=None): 3536s """Coroutine that completes after a given time (in seconds).""" 3536s if delay <= 0: 3536s await __sleep0() 3536s return result 3536s 3536s if math.isnan(delay): 3536s raise ValueError("Invalid delay: NaN (not a number)") 3536s 3536s loop = events.get_running_loop() 3536s future = loop.create_future() 3536s h = loop.call_later(delay, 3536s futures._set_result_unless_cancelled, 3536s future, result) 3536s try: 3536s > return await future 3536s E asyncio.exceptions.CancelledError 3536s 3536s /usr/lib/python3.13/asyncio/tasks.py:718: CancelledError 3536s 3536s The above exception was the direct cause of the following exception: 3536s 3536s args = (), kwds = {} 3536s 3536s @wraps(func) 3536s def inner(*args, **kwds): 3536s with self._recreate_cm(): 3536s > return func(*args, **kwds) 3536s 3536s /usr/lib/python3.13/contextlib.py:85: 3536s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3536s /usr/lib/python3.13/contextlib.py:85: in inner 3536s return func(*args, **kwds) 3536s /usr/lib/python3/dist-packages/distributed/utils_test.py:1102: in test_func 3536s return _run_and_close_tornado(async_fn_outer) 3536s /usr/lib/python3/dist-packages/distributed/utils_test.py:378: in _run_and_close_tornado 3536s return asyncio_run(inner_fn(), loop_factory=get_loop_factory()) 3536s /usr/lib/python3.13/asyncio/runners.py:194: in run 3536s return runner.run(main) 3536s /usr/lib/python3.13/asyncio/runners.py:118: in run 3536s return self._loop.run_until_complete(task) 3536s /usr/lib/python3.13/asyncio/base_events.py:720: in run_until_complete 3536s return future.result() 3536s /usr/lib/python3/dist-packages/distributed/utils_test.py:375: in inner_fn 3536s return await async_fn(*args, **kwargs) 3536s /usr/lib/python3/dist-packages/distributed/utils_test.py:1099: in async_fn_outer 3536s return await utils_wait_for(async_fn(), timeout=timeout * 2) 3536s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 3536s async with asyncio.timeout(timeout): 3536s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3536s 3536s self = 3536s exc_type = 3536s exc_val = CancelledError(), exc_tb = 3536s 3536s async def __aexit__( 3536s self, 3536s exc_type: Optional[Type[BaseException]], 3536s exc_val: Optional[BaseException], 3536s exc_tb: Optional[TracebackType], 3536s ) -> Optional[bool]: 3536s assert self._state in (_State.ENTERED, _State.EXPIRING) 3536s 3536s if self._timeout_handler is not None: 3536s self._timeout_handler.cancel() 3536s self._timeout_handler = None 3536s 3536s if self._state is _State.EXPIRING: 3536s self._state = _State.EXPIRED 3536s 3536s if self._task.uncancel() <= self._cancelling and exc_type is not None: 3536s # Since there are no new cancel requests, we're 3536s # handling this. 3536s if issubclass(exc_type, exceptions.CancelledError): 3536s > raise TimeoutError from exc_val 3536s E TimeoutError 3536s 3536s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 3536s ----------------------------- Captured stderr call ----------------------------- 3536s 2024-11-23 21:09:18,172 - distributed.scheduler - INFO - State start 3536s 2024-11-23 21:09:18,181 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:18,182 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46089/status 3536s 2024-11-23 21:09:18,182 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3536s 2024-11-23 21:09:18,200 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41223 3536s 2024-11-23 21:09:18,200 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41223 3536s 2024-11-23 21:09:18,200 - distributed.worker - INFO - Worker name: 0 3536s 2024-11-23 21:09:18,200 - distributed.worker - INFO - dashboard at: 127.0.0.1:46155 3536s 2024-11-23 21:09:18,200 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:18,200 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:09:18,200 - distributed.worker - INFO - Threads: 1 3536s 2024-11-23 21:09:18,200 - distributed.worker - INFO - Memory: 15.58 GiB 3536s 2024-11-23 21:09:18,200 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-yr8ia1ps 3536s 2024-11-23 21:09:18,200 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:09:18,203 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36155 3536s 2024-11-23 21:09:18,203 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36155 3536s 2024-11-23 21:09:18,204 - distributed.worker - INFO - Worker name: 1 3536s 2024-11-23 21:09:18,204 - distributed.worker - INFO - dashboard at: 127.0.0.1:43165 3536s 2024-11-23 21:09:18,204 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:18,204 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:09:18,204 - distributed.worker - INFO - Threads: 2 3536s 2024-11-23 21:09:18,204 - distributed.worker - INFO - Memory: 15.58 GiB 3536s 2024-11-23 21:09:18,204 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-qgexegqv 3536s 2024-11-23 21:09:18,204 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:09:18,219 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:18,219 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:18,220 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:42992': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:18,220 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:42996': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:18,334 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:18,334 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:18,335 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:43004': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:18,335 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:43014': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:18,451 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:18,451 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:18,452 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:43022': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:18,452 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:43026': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:18,565 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:18,565 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:18,566 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:43042': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:18,566 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:43048': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:18,679 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:18,679 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:18,680 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:43060': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:18,680 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:43072': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:18,794 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:18,794 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:18,795 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:43088': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:18,795 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:43104': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:18,908 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:18,908 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:18,909 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:43110': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:18,909 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:43124': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:19,023 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:19,023 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:19,024 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:43126': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:19,024 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:43142': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:19,137 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:19,137 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:19,138 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:43154': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:19,138 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:43156': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:19,253 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:19,253 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:19,254 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:43170': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:19,254 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:43186': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:19,367 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:19,367 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:19,368 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:43200': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:19,368 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:43212': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:19,481 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:19,482 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:19,482 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:43216': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:19,482 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:43228': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:19,596 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:19,596 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:19,597 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:43236': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:19,597 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:43248': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:19,711 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:19,711 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:19,712 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:43250': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:19,712 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:43256': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:19,825 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:19,826 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:19,826 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:43266': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:19,826 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:43282': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:19,940 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:19,940 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:19,941 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:43286': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:19,941 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:43288': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:20,057 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:20,057 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:20,058 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:43302': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:20,058 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:43314': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:20,171 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:20,171 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:20,172 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:43328': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:20,172 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:43342': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:20,285 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:20,286 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:20,286 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:43350': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:20,286 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:43352': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:20,399 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:20,400 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:20,400 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:43358': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:20,400 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:43368': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:20,515 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:20,515 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:20,516 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:43382': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:20,516 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:43398': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:20,630 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:20,630 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:20,631 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:43412': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:20,631 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:43420': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:20,744 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:20,744 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:20,745 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:43436': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:20,745 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:43452': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:20,858 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:20,859 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:20,859 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:43468': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:20,859 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:43476': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:20,974 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:20,974 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:20,975 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:43488': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:20,975 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:43500': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:21,088 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:21,088 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:21,089 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:43508': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:21,089 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:43520': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:21,202 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:21,203 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:21,203 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:43524': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:21,203 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:43526': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:21,316 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:21,317 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:21,317 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:43528': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:21,317 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:43542': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:21,430 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:21,430 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:21,431 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:43546': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:21,431 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:43558': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:21,545 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:21,545 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:21,545 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:45864': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:21,546 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:45868': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:21,659 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:21,659 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:21,660 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:45870': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:21,660 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:45874': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:21,776 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:21,776 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:21,777 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:45876': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:21,777 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:45892': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:21,891 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:21,892 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:21,892 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:45894': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:21,892 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:45904': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:22,006 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:22,006 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:22,007 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:45916': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:22,007 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:45918': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:22,121 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:22,121 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:22,122 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:45928': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:22,122 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:45938': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:22,235 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:22,236 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:22,236 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:45952': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:22,236 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:45960': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:22,350 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:22,350 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:22,350 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:45976': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:22,351 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:45986': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:22,464 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:22,464 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:22,465 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:46002': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:22,465 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:46012': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:22,578 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:22,579 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:22,579 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:46028': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:22,579 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:46044': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:22,692 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:22,693 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:22,698 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:46048': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:22,698 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:46052': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:22,807 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:22,807 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:22,808 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:46068': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:22,808 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:46080': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:22,921 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:22,921 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:22,922 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:46088': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:22,922 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:46092': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:23,035 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:23,036 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:23,036 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:46100': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:23,036 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:46108': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:23,150 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:23,150 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:23,150 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:46114': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:23,151 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:46118': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:23,264 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:23,264 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:23,265 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:46134': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:23,265 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:46148': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:23,378 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:23,378 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:23,379 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:46152': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:23,379 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:46154': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:23,495 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:23,495 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:23,496 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:46162': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:23,496 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:46174': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:23,609 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:23,609 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:23,610 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:46180': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:23,610 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:46186': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:23,724 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:23,724 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:23,724 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:46200': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:23,725 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:46216': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:23,838 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:23,838 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:23,839 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:46230': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:23,839 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:46232': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:23,952 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:23,953 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:23,953 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:46242': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:23,953 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:46248': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:24,067 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:24,067 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:24,068 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:46262': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:24,068 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:46266': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:24,181 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:24,181 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:24,182 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:46276': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:24,182 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:46280': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:24,295 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:24,295 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:24,296 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:46294': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:24,296 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:46306': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:24,410 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:24,410 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:24,411 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:46322': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:24,411 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:46326': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:24,525 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:24,525 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:24,526 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:46342': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:24,526 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:46348': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:24,639 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:24,639 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:24,640 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:46354': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:24,640 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:46358': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:24,754 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:24,755 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:24,755 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:46372': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:24,755 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:46382': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:24,869 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:24,870 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:24,870 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:46392': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:24,870 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:46396': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:24,983 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:24,984 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:24,984 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:46408': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:24,984 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:46410': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:25,099 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:25,099 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:25,100 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:46422': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:25,100 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:46438': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:25,214 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:25,214 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:25,215 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:46452': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:25,215 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:46466': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:25,328 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:25,328 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:25,329 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:46478': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:25,329 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:46490': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:25,442 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:25,442 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:25,443 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:46504': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:25,443 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:46508': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:25,556 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:25,557 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:25,557 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:46510': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:25,557 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:46522': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:25,670 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:25,670 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:25,671 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:46538': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:25,671 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:46550': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:25,784 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:25,784 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:25,785 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:46564': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:25,785 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:46574': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:25,898 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:25,898 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:25,899 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:46588': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:25,899 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:46590': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:26,013 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:26,013 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:26,014 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:46602': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:26,014 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:46606': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:26,127 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:26,127 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:26,128 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:46610': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:26,128 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:46624': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:26,241 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:26,242 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:26,242 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:46628': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:26,242 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:46636': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:26,357 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:26,357 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:26,357 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:46642': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:26,358 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:46650': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:26,471 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:26,471 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:26,472 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:46656': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:26,472 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:46660': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:26,585 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:26,585 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:26,586 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:46674': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:26,586 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:46686': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:26,700 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:26,700 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:26,701 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:46690': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:26,701 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:46700': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:26,817 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:26,817 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:26,818 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:46706': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:26,818 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:46714': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:26,931 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:26,931 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:26,932 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:46718': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:26,932 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:46730': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:27,045 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:27,046 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:27,046 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:46732': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:27,046 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:46746': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:27,159 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:27,159 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:27,160 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:46754': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:27,160 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:46770': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:27,273 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:27,273 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:27,274 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:46784': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:27,274 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:46786': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:27,388 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:27,388 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:27,389 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:46800': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:27,389 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:46816': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:27,502 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:27,502 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:27,503 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:46826': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:27,503 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:46832': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:27,616 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:27,616 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:27,617 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:46838': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:27,617 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:46852': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:27,731 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:27,731 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:27,732 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:46858': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:27,732 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:46872': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:27,845 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:27,846 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:27,846 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:46884': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:27,846 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:46894': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:27,961 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:27,961 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:27,962 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:46900': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:27,962 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:46908': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:28,075 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:28,075 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:28,076 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:46918': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:28,076 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:46934': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:28,190 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:28,190 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:28,195 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:46950': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:28,195 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:46960': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:28,304 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:28,305 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:28,305 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:46962': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:28,306 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:46974': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:28,419 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:28,419 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:28,421 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:46980': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:28,421 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:46994': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:28,533 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:28,533 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:28,534 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:47004': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:28,534 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:47016': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:28,647 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:28,647 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:28,648 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:47030': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:28,648 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:47038': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:28,761 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:28,761 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:28,762 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:47046': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:28,762 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:47054': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:28,875 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:28,876 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:28,876 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:47064': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:28,876 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:47074': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:28,990 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:28,990 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:28,991 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:47082': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:28,991 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:47088': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:29,106 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:29,106 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:29,107 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:47100': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:29,107 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:47114': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:29,220 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:29,221 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:29,221 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:47124': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:29,221 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:47132': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:29,334 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:29,334 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:29,335 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:47138': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:29,335 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:47154': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:29,448 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:29,448 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:29,449 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:47166': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:29,449 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:47176': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:29,562 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:29,562 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:29,562 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:47184': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:29,563 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:47198': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:29,675 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:29,676 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:29,676 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:47208': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:29,676 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:47218': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:29,789 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:29,789 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:29,790 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:47230': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:29,790 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:47232': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:29,902 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:29,903 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:29,903 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:47242': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:29,903 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:47254': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:30,016 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:30,017 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:30,017 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:47262': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:30,017 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:47270': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:30,132 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:30,132 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:30,132 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:47278': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:30,132 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:47282': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:30,245 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:30,246 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:30,246 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:47284': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:30,246 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:47290': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:30,359 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:30,359 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:30,359 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:47294': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:30,360 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:47304': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:30,473 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:30,473 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:30,473 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:47306': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:30,474 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:47308': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:30,586 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:30,587 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:30,587 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:47322': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:30,587 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:47328': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:30,700 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:30,700 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:30,701 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:47336': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:30,701 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:47352': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:30,815 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:30,816 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:30,816 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:47354': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:30,816 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:47368': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:30,929 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:30,930 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:30,930 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:47380': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:30,930 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:47384': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:31,045 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:31,045 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:31,045 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:47396': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:31,046 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:47406': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:31,159 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:31,159 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:31,159 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:47416': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:31,160 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:47432': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:31,273 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:31,273 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:31,274 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:47446': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:31,274 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:47452': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:31,387 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:31,388 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:31,388 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:47460': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:31,388 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:47474': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:31,501 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:31,501 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:31,502 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:47478': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:31,502 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:47486': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:31,615 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:31,615 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:31,616 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:34538': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:31,616 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:34554': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:31,730 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:31,730 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:31,731 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:34566': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:31,731 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:34578': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:31,844 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:31,844 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:31,845 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:34590': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:31,845 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:34604': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:31,959 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:31,959 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:31,960 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:34608': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:31,960 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:34620': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:32,073 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:32,073 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:32,074 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:34634': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:32,074 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:34648': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:32,187 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:32,188 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:32,192 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:34654': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:32,192 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:34656': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:32,301 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:32,301 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:32,302 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:34664': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:32,302 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:34676': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:32,415 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:32,415 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:32,416 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:34682': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:32,416 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:34684': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:32,529 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:32,529 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:32,530 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:34686': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:32,530 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:34696': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:32,643 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:32,643 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:32,644 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:34712': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:32,644 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:34714': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:32,757 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:32,758 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:32,758 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:34728': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:32,758 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:34734': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:32,872 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:32,872 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:32,873 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:34744': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:32,873 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:34760': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:32,992 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:32,992 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:32,993 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:34770': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:32,993 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:34778': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:33,107 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:33,108 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39459 3536s 2024-11-23 21:09:33,108 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:34780': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:33,108 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39459': TLS handshake failed with remote 'tls://127.0.0.1:34784': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:33,198 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41223. Reason: failure-to-start- 3536s 2024-11-23 21:09:33,198 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3536s 2024-11-23 21:09:33,202 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 15s.; retrying 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3536s stream = await self.client.connect( 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 3536s stream = await stream.start_tls( 3536s ^^^^^^^^^^^^^^^^^^^^^^^ 3536s False, ssl_options=ssl_options, server_hostname=host 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 3536s self.socket.do_handshake() 3536s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 3536s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 3536s self._sslobj.do_handshake() 3536s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 3536s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 3536s 3536s The above exception was the direct cause of the following exception: 3536s 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3536s comm = await connect(self.scheduler.address, **self.connection_args) 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3536s comm = await wait_for( 3536s ^^^^^^^^^^^^^^^ 3536s ...<2 lines>... 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3536s return await fut 3536s ^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 3536s raise FatalCommClosedError( 3536s ...<2 lines>... 3536s ) from err 3536s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 3536s 3536s During handling of the above exception, another exception occurred: 3536s 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3536s return await fut 3536s ^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3536s await self._register_with_scheduler() 3536s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1218, in _register_with_scheduler 3536s await asyncio.sleep(0.1) 3536s File "/usr/lib/python3.13/asyncio/tasks.py", line 718, in sleep 3536s return await future 3536s ^^^^^^^^^^^^ 3536s asyncio.exceptions.CancelledError 3536s 3536s The above exception was the direct cause of the following exception: 3536s 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3536s await wait_for(self.start_unsafe(), timeout=timeout) 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3536s async with asyncio.timeout(timeout): 3536s ~~~~~~~~~~~~~~~^^^^^^^^^ 3536s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3536s raise TimeoutError from exc_val 3536s TimeoutError 3536s 3536s The above exception was the direct cause of the following exception: 3536s 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3536s s, ws = await start_cluster( 3536s ^^^^^^^^^^^^^^^^^^^^ 3536s ...<9 lines>... 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3536s await asyncio.gather(*workers) 3536s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3536s return await awaitable 3536s ^^^^^^^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3536s raise asyncio.TimeoutError( 3536s f"{type(self).__name__} start timed out after {timeout}s." 3536s ) from exc 3536s TimeoutError: Worker start timed out after 15s. 3536s 2024-11-23 21:09:33,207 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36155. Reason: failure-to-start- 3536s 2024-11-23 21:09:33,208 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3536s 2024-11-23 21:09:34,212 - distributed.scheduler - INFO - State start 3536s 2024-11-23 21:09:34,224 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:34,224 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38005/status 3536s 2024-11-23 21:09:34,224 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3536s 2024-11-23 21:09:34,245 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46471 3536s 2024-11-23 21:09:34,246 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46471 3536s 2024-11-23 21:09:34,246 - distributed.worker - INFO - Worker name: 0 3536s 2024-11-23 21:09:34,246 - distributed.worker - INFO - dashboard at: 127.0.0.1:45419 3536s 2024-11-23 21:09:34,246 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:34,246 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:09:34,246 - distributed.worker - INFO - Threads: 1 3536s 2024-11-23 21:09:34,246 - distributed.worker - INFO - Memory: 15.58 GiB 3536s 2024-11-23 21:09:34,246 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-8xr4siyl 3536s 2024-11-23 21:09:34,246 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:09:34,249 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46249 3536s 2024-11-23 21:09:34,250 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46249 3536s 2024-11-23 21:09:34,250 - distributed.worker - INFO - Worker name: 1 3536s 2024-11-23 21:09:34,250 - distributed.worker - INFO - dashboard at: 127.0.0.1:37493 3536s 2024-11-23 21:09:34,250 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:34,250 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:09:34,250 - distributed.worker - INFO - Threads: 2 3536s 2024-11-23 21:09:34,250 - distributed.worker - INFO - Memory: 15.58 GiB 3536s 2024-11-23 21:09:34,250 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ir38whjz 3536s 2024-11-23 21:09:34,250 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:09:34,265 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:34,266 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:34,266 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:35688': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:34,266 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:35692': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:34,381 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:34,382 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:34,382 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:35696': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:34,382 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:35698': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:34,497 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:34,497 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:34,498 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:35710': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:34,498 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:35714': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:34,613 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:34,613 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:34,614 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:35724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:34,614 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:35728': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:34,729 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:34,729 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:34,734 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:35730': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:34,734 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:35732': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:34,844 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:34,845 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:34,846 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:35734': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:34,846 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:35746': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:34,969 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:34,969 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:34,970 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:35758': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:34,970 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:35766': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:35,084 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:35,084 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:35,085 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:35776': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:35,085 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:35792': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:35,202 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:35,202 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:35,203 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:35796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:35,203 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:35804': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:35,318 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:35,318 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:35,319 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:35810': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:35,319 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:35812': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:35,434 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:35,435 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:35,436 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:35826': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:35,436 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:35840': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:35,550 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:35,550 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:35,551 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:35848': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:35,551 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:35854': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:35,667 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:35,667 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:35,668 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:35870': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:35,668 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:35878': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:35,783 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:35,783 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:35,784 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:35888': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:35,784 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:35900': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:35,893 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:35,898 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:35906': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:35,900 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:35,901 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:35918': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:36,002 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:36,003 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:35920': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:36,011 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:36,011 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:35934': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:36,112 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:36,113 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:35938': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:36,121 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:36,121 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:35946': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:36,222 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:36,223 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:35962': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:36,236 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:36,236 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:35970': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:36,331 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:36,332 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:35984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:36,345 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:36,345 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:35988': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:36,441 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:36,441 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:35994': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:36,454 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:36,454 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:36008': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:36,550 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:36,550 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:36020': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:36,565 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:36,566 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:36036': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:36,659 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:36,660 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:36044': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:36,674 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:36,675 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:36060': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:36,769 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:36,769 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:36070': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:36,783 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:36,784 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:36076': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:36,878 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:36,878 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:36088': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:36,892 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:36,893 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:36102': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:36,987 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:36,987 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:36108': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:37,001 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:37,002 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:36120': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:37,096 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:37,097 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:36136': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:37,110 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:37,111 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:36150': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:37,206 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:37,206 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:36152': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:37,219 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:37,219 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:36164': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:37,314 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:37,315 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:36170': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:37,328 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:37,329 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:36186': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:37,424 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:37,425 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:36190': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:37,437 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:37,438 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:36202': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:37,533 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:37,534 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:36208': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:37,546 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:37,547 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:36220': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:37,643 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:37,644 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:36228': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:37,655 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:37,656 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:36240': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:37,752 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:37,753 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:36256': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:37,764 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:37,765 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:36266': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:37,863 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:37,864 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:36270': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:37,873 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:37,874 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:36274': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:37,972 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:37,973 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:36290': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:37,982 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:37,983 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:36294': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:38,081 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:38,082 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:36296': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:38,091 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:38,092 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:36298': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:38,194 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:38,196 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:36310': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:38,203 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:38,204 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:36326': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:38,305 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:38,305 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:36328': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:38,313 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:38,314 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:36340': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:38,414 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:38,415 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:36346': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:38,422 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:38,423 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:36356': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:38,522 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:38,523 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:36370': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:38,531 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:38,532 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:36378': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:38,632 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:38,633 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:36384': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:38,641 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:38,642 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:36392': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:38,741 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:38,741 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:36398': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:38,749 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:38,750 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:36410': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:38,850 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:38,851 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:36424': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:38,859 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:38,860 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:36432': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:38,961 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:38,963 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:36446': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:38,971 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:38,971 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:36454': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:39,071 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:39,072 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:36456': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:39,079 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:39,080 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:36468': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:39,180 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:39,181 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:36470': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:39,194 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:39,195 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:36478': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:39,290 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:39,291 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:36488': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:39,303 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:39,304 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:36490': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:39,399 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:39,400 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:36494': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:39,412 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:39,413 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:36508': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:39,509 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:39,510 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:36510': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:39,521 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:39,522 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:36520': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:39,619 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:39,620 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:36536': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:39,630 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:39,631 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:36544': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:39,728 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:39,733 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:36546': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:39,741 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:39,742 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:36550': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:39,837 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:39,838 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:36560': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:39,850 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:39,851 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:36562': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:39,947 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:39,948 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:36576': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:39,958 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:39,959 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:36580': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:40,056 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:40,056 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:36596': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:40,066 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:40,066 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:36604': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:40,164 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:40,165 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:36606': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:40,174 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:40,175 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:36614': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:40,273 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:40,273 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:36620': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:40,282 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:40,282 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:36634': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:40,382 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:40,383 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:36642': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:40,390 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:40,390 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:36658': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:40,490 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:40,490 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:36668': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:40,497 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:40,498 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:36684': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:40,598 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:40,599 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:36688': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:40,606 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:40,606 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:36694': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:40,706 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:40,707 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:36702': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:40,714 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:40,714 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:36716': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:40,815 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:40,816 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:36724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:40,823 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:40,823 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:36738': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:40,924 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:40,924 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:36748': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:40,931 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:40,932 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:36760': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:41,033 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:41,033 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:36770': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:41,040 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:41,041 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:36772': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:41,141 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:41,142 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:36780': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:41,149 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:41,149 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:36782': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:41,251 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:41,252 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:36796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:41,258 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:41,259 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:36806': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:41,359 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:41,360 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:36820': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:41,367 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:41,367 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:36832': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:41,467 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:41,468 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:36840': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:41,475 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:41,476 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:36844': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:41,575 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:41,576 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:59974': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:41,585 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:41,586 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:59978': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:41,684 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:41,688 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:59992': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:41,695 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:41,695 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:59996': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:41,791 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:41,792 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:60006': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:41,802 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:41,803 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:60010': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:41,901 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:41,901 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:60012': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:41,911 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:41,911 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:60014': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:42,010 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:42,010 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:60018': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:42,019 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:42,019 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:60032': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:42,118 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:42,118 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:60036': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:42,127 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:42,127 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:60040': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:42,226 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:42,230 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:60056': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:42,237 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:42,238 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:60066': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:42,334 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:42,335 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:60070': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:42,345 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:42,346 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:60086': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:42,443 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:42,443 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:60102': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:42,453 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:42,453 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:60104': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:42,552 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:42,553 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:60120': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:42,561 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:42,562 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:60136': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:42,661 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:42,661 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:60140': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:42,668 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:42,669 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:60148': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:42,769 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:42,769 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:60154': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:42,776 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:42,777 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:60160': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:42,878 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:42,878 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:60164': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:42,885 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:42,886 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:60172': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:42,986 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:42,987 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:60182': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:42,994 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:42,995 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:60184': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:43,096 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:43,097 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:60192': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:43,104 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:43,104 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:60194': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:43,204 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:43,205 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:60210': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:43,214 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:43,214 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:60226': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:43,313 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:43,314 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:60238': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:43,322 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:43,322 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:60246': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:43,421 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:43,421 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:60250': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:43,430 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:43,430 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:60252': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:43,529 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:43,530 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:60262': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:43,538 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:43,538 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:60268': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:43,638 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:43,638 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:60276': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:43,645 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:43,646 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:60290': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:43,746 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:43,747 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:60300': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:43,754 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:43,754 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:60312': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:43,855 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:43,856 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:60318': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:43,862 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:43,863 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:60328': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:43,964 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:43,964 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:60336': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:43,971 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:43,972 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:60346': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:44,072 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:44,073 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:60352': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:44,080 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:44,080 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:60368': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:44,181 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:44,182 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:60372': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:44,192 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:44,193 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:60386': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:44,289 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:44,290 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:60394': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:44,300 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:44,301 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:60408': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:44,398 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:44,398 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:60412': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:44,408 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:44,408 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:60422': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:44,506 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:44,506 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:60428': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:44,516 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:44,516 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:60440': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:44,614 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:44,615 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:60444': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:44,624 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:44,625 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:60460': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:44,722 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:44,723 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:60462': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:44,736 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:44,737 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:60474': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:44,832 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:44,833 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:60488': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:44,844 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:44,844 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:60504': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:44,942 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:44,943 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:60508': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:44,952 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:44,953 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:60518': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:45,052 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:45,053 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:60530': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:45,060 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:45,060 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:60544': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:45,160 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:45,160 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:60560': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:45,167 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:45,168 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:60566': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:45,268 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:45,269 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:60572': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:45,276 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:45,276 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:60576': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:45,377 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:45,377 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:60590': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:45,384 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:45,385 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:60600': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:45,485 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:45,486 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:60604': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:45,493 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:45,493 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:60620': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:45,594 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:45,594 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:60624': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:45,601 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:45,602 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:60632': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:45,702 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:45,702 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:60646': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:45,709 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:45,710 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:60660': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:45,810 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:45,811 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:60666': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:45,818 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:45,818 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:60670': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:45,919 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:45,919 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:60674': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:45,926 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:45,927 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:60678': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:46,027 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:46,028 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:60692': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:46,035 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:46,035 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:60698': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:46,135 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:46,136 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:60708': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:46,143 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:46,144 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:60724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:46,244 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:46,245 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:60736': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:46,252 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:46,253 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:60738': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:46,353 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:46,353 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:60740': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:46,360 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:46,361 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:60754': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:46,461 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:46,462 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:60756': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:46,469 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:46,469 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:60764': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:46,571 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:46,574 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:60780': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:46,581 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:46,582 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:60786': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:46,679 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:46,679 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:60800': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:46,693 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:46,693 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:60816': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:46,788 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:46,789 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:60822': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:46,801 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:46,801 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:60824': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:46,897 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:46,898 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:60834': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:46,909 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:46,910 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:60848': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:47,006 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:47,006 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:60862': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:47,017 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:47,017 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:60866': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:47,114 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:47,115 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:60870': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:47,125 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:47,126 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:60872': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:47,223 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:47,224 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:60878': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:47,235 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45599 3536s 2024-11-23 21:09:47,236 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:60880': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:09:47,243 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46471. Reason: failure-to-start- 3536s 2024-11-23 21:09:47,244 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3536s 2024-11-23 21:09:47,246 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 13s.; retrying 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3536s stream = await self.client.connect( 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 3536s stream = await stream.start_tls( 3536s ^^^^^^^^^^^^^^^^^^^^^^^ 3536s False, ssl_options=ssl_options, server_hostname=host 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 3536s self.socket.do_handshake() 3536s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 3536s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 3536s self._sslobj.do_handshake() 3536s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 3536s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 3536s 3536s The above exception was the direct cause of the following exception: 3536s 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3536s comm = await connect(self.scheduler.address, **self.connection_args) 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3536s comm = await wait_for( 3536s ^^^^^^^^^^^^^^^ 3536s ...<2 lines>... 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3536s return await fut 3536s ^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 3536s raise FatalCommClosedError( 3536s ...<2 lines>... 3536s ) from err 3536s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 3536s 3536s During handling of the above exception, another exception occurred: 3536s 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3536s return await fut 3536s ^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3536s await self._register_with_scheduler() 3536s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1218, in _register_with_scheduler 3536s await asyncio.sleep(0.1) 3536s File "/usr/lib/python3.13/asyncio/tasks.py", line 718, in sleep 3536s return await future 3536s ^^^^^^^^^^^^ 3536s asyncio.exceptions.CancelledError 3536s 3536s The above exception was the direct cause of the following exception: 3536s 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3536s await wait_for(self.start_unsafe(), timeout=timeout) 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3536s async with asyncio.timeout(timeout): 3536s ~~~~~~~~~~~~~~~^^^^^^^^^ 3536s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3536s raise TimeoutError from exc_val 3536s TimeoutError 3536s 3536s The above exception was the direct cause of the following exception: 3536s 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3536s s, ws = await start_cluster( 3536s ^^^^^^^^^^^^^^^^^^^^ 3536s ...<9 lines>... 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3536s await asyncio.gather(*workers) 3536s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3536s return await awaitable 3536s ^^^^^^^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3536s raise asyncio.TimeoutError( 3536s f"{type(self).__name__} start timed out after {timeout}s." 3536s ) from exc 3536s TimeoutError: Worker start timed out after 13s. 3536s 2024-11-23 21:09:47,250 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46249. Reason: failure-to-start- 3536s 2024-11-23 21:09:47,250 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3536s 2024-11-23 21:09:48,254 - distributed.scheduler - INFO - State start 3536s 2024-11-23 21:09:48,263 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36367 3536s 2024-11-23 21:09:48,264 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34313/status 3536s 2024-11-23 21:09:48,264 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3536s 2024-11-23 21:09:48,283 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36777 3536s 2024-11-23 21:09:48,284 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36777 3536s 2024-11-23 21:09:48,284 - distributed.worker - INFO - Worker name: 0 3536s 2024-11-23 21:09:48,284 - distributed.worker - INFO - dashboard at: 127.0.0.1:44153 3536s 2024-11-23 21:09:48,284 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36367 3536s 2024-11-23 21:09:48,284 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:09:48,284 - distributed.worker - INFO - Threads: 1 3536s 2024-11-23 21:09:48,284 - distributed.worker - INFO - Memory: 15.58 GiB 3536s 2024-11-23 21:09:48,284 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-tog1o6cu 3536s 2024-11-23 21:09:48,284 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:09:48,287 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35015 3536s 2024-11-23 21:09:48,287 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35015 3536s 2024-11-23 21:09:48,287 - distributed.worker - INFO - Worker name: 1 3536s 2024-11-23 21:09:48,287 - distributed.worker - INFO - dashboard at: 127.0.0.1:43569 3536s 2024-11-23 21:09:48,287 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36367 3536s 2024-11-23 21:09:48,288 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:09:48,288 - distributed.worker - INFO - Threads: 2 3536s 2024-11-23 21:09:48,288 - distributed.worker - INFO - Memory: 15.58 GiB 3536s 2024-11-23 21:09:48,288 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-jui24vk0 3536s 2024-11-23 21:09:48,288 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:09:48,289 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36777. Reason: failure-to-start- 3536s 2024-11-23 21:09:48,289 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3536s 2024-11-23 21:09:48,290 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35015. Reason: failure-to-start- 3536s 2024-11-23 21:09:48,290 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3536s 2024-11-23 21:09:48,292 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36367': TLS handshake failed with remote 'tls://127.0.0.1:60344': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3536s 2024-11-23 21:09:48,292 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36367': TLS handshake failed with remote 'tls://127.0.0.1:60356': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3536s 2024-11-23 21:09:48,294 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3536s return await fut 3536s ^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3536s await self._register_with_scheduler() 3536s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3536s comm = await connect(self.scheduler.address, **self.connection_args) 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3536s comm = await wait_for( 3536s ^^^^^^^^^^^^^^^ 3536s ...<2 lines>... 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3536s return await fut 3536s ^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3536s stream = await self.client.connect( 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3536s af, addr, stream = await connector.start(connect_timeout=timeout) 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s asyncio.exceptions.CancelledError 3536s 3536s The above exception was the direct cause of the following exception: 3536s 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3536s await wait_for(self.start_unsafe(), timeout=timeout) 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3536s async with asyncio.timeout(timeout): 3536s ~~~~~~~~~~~~~~~^^^^^^^^^ 3536s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3536s raise TimeoutError from exc_val 3536s TimeoutError 3536s 3536s The above exception was the direct cause of the following exception: 3536s 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3536s s, ws = await start_cluster( 3536s ^^^^^^^^^^^^^^^^^^^^ 3536s ...<9 lines>... 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3536s await asyncio.gather(*workers) 3536s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3536s return await awaitable 3536s ^^^^^^^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3536s raise asyncio.TimeoutError( 3536s f"{type(self).__name__} start timed out after {timeout}s." 3536s ) from exc 3536s TimeoutError: Worker start timed out after 0s. 3536s 2024-11-23 21:09:49,300 - distributed.scheduler - INFO - State start 3536s 2024-11-23 21:09:49,309 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38911 3536s 2024-11-23 21:09:49,310 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40783/status 3536s 2024-11-23 21:09:49,310 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3536s 2024-11-23 21:09:49,328 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44827 3536s 2024-11-23 21:09:49,328 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44827 3536s 2024-11-23 21:09:49,328 - distributed.worker - INFO - Worker name: 0 3536s 2024-11-23 21:09:49,328 - distributed.worker - INFO - dashboard at: 127.0.0.1:35981 3536s 2024-11-23 21:09:49,328 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38911 3536s 2024-11-23 21:09:49,328 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:09:49,328 - distributed.worker - INFO - Threads: 1 3536s 2024-11-23 21:09:49,328 - distributed.worker - INFO - Memory: 15.58 GiB 3536s 2024-11-23 21:09:49,328 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-zi6kbv56 3536s 2024-11-23 21:09:49,328 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:09:49,331 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33439 3536s 2024-11-23 21:09:49,331 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33439 3536s 2024-11-23 21:09:49,331 - distributed.worker - INFO - Worker name: 1 3536s 2024-11-23 21:09:49,331 - distributed.worker - INFO - dashboard at: 127.0.0.1:43555 3536s 2024-11-23 21:09:49,331 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38911 3536s 2024-11-23 21:09:49,331 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:09:49,331 - distributed.worker - INFO - Threads: 2 3536s 2024-11-23 21:09:49,331 - distributed.worker - INFO - Memory: 15.58 GiB 3536s 2024-11-23 21:09:49,331 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-d6mgl8lk 3536s 2024-11-23 21:09:49,332 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:09:49,333 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44827. Reason: failure-to-start- 3536s 2024-11-23 21:09:49,333 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3536s 2024-11-23 21:09:49,334 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33439. Reason: failure-to-start- 3536s 2024-11-23 21:09:49,334 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3536s 2024-11-23 21:09:49,335 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38911': TLS handshake failed with remote 'tls://127.0.0.1:36900': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3536s 2024-11-23 21:09:49,336 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38911': TLS handshake failed with remote 'tls://127.0.0.1:36904': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3536s 2024-11-23 21:09:49,337 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3536s return await fut 3536s ^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3536s await self._register_with_scheduler() 3536s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3536s comm = await connect(self.scheduler.address, **self.connection_args) 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3536s comm = await wait_for( 3536s ^^^^^^^^^^^^^^^ 3536s ...<2 lines>... 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3536s return await fut 3536s ^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3536s stream = await self.client.connect( 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3536s af, addr, stream = await connector.start(connect_timeout=timeout) 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s asyncio.exceptions.CancelledError 3536s 3536s The above exception was the direct cause of the following exception: 3536s 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3536s await wait_for(self.start_unsafe(), timeout=timeout) 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3536s async with asyncio.timeout(timeout): 3536s ~~~~~~~~~~~~~~~^^^^^^^^^ 3536s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3536s raise TimeoutError from exc_val 3536s TimeoutError 3536s 3536s The above exception was the direct cause of the following exception: 3536s 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3536s s, ws = await start_cluster( 3536s ^^^^^^^^^^^^^^^^^^^^ 3536s ...<9 lines>... 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3536s await asyncio.gather(*workers) 3536s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3536s return await awaitable 3536s ^^^^^^^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3536s raise asyncio.TimeoutError( 3536s f"{type(self).__name__} start timed out after {timeout}s." 3536s ) from exc 3536s TimeoutError: Worker start timed out after 0s. 3536s 2024-11-23 21:09:50,344 - distributed.scheduler - INFO - State start 3536s 2024-11-23 21:09:50,354 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44219 3536s 2024-11-23 21:09:50,355 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35059/status 3536s 2024-11-23 21:09:50,355 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3536s 2024-11-23 21:09:50,372 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40115 3536s 2024-11-23 21:09:50,372 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40115 3536s 2024-11-23 21:09:50,372 - distributed.worker - INFO - Worker name: 0 3536s 2024-11-23 21:09:50,372 - distributed.worker - INFO - dashboard at: 127.0.0.1:35569 3536s 2024-11-23 21:09:50,372 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44219 3536s 2024-11-23 21:09:50,373 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:09:50,373 - distributed.worker - INFO - Threads: 1 3536s 2024-11-23 21:09:50,373 - distributed.worker - INFO - Memory: 15.58 GiB 3536s 2024-11-23 21:09:50,373 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-brq01fym 3536s 2024-11-23 21:09:50,373 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:09:50,376 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43789 3536s 2024-11-23 21:09:50,376 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43789 3536s 2024-11-23 21:09:50,376 - distributed.worker - INFO - Worker name: 1 3536s 2024-11-23 21:09:50,376 - distributed.worker - INFO - dashboard at: 127.0.0.1:33215 3536s 2024-11-23 21:09:50,376 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44219 3536s 2024-11-23 21:09:50,376 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:09:50,376 - distributed.worker - INFO - Threads: 2 3536s 2024-11-23 21:09:50,376 - distributed.worker - INFO - Memory: 15.58 GiB 3536s 2024-11-23 21:09:50,376 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-y2axzxzw 3536s 2024-11-23 21:09:50,376 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:09:50,378 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40115. Reason: failure-to-start- 3536s 2024-11-23 21:09:50,378 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3536s 2024-11-23 21:09:50,379 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43789. Reason: failure-to-start- 3536s 2024-11-23 21:09:50,379 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3536s 2024-11-23 21:09:50,380 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44219': TLS handshake failed with remote 'tls://127.0.0.1:53640': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3536s 2024-11-23 21:09:50,381 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44219': TLS handshake failed with remote 'tls://127.0.0.1:53648': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3536s 2024-11-23 21:09:50,382 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3536s return await fut 3536s ^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3536s await self._register_with_scheduler() 3536s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3536s comm = await connect(self.scheduler.address, **self.connection_args) 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3536s comm = await wait_for( 3536s ^^^^^^^^^^^^^^^ 3536s ...<2 lines>... 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3536s return await fut 3536s ^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3536s stream = await self.client.connect( 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3536s af, addr, stream = await connector.start(connect_timeout=timeout) 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s asyncio.exceptions.CancelledError 3536s 3536s The above exception was the direct cause of the following exception: 3536s 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3536s await wait_for(self.start_unsafe(), timeout=timeout) 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3536s async with asyncio.timeout(timeout): 3536s ~~~~~~~~~~~~~~~^^^^^^^^^ 3536s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3536s raise TimeoutError from exc_val 3536s TimeoutError 3536s 3536s The above exception was the direct cause of the following exception: 3536s 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3536s s, ws = await start_cluster( 3536s ^^^^^^^^^^^^^^^^^^^^ 3536s ...<9 lines>... 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3536s await asyncio.gather(*workers) 3536s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3536s return await awaitable 3536s ^^^^^^^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3536s raise asyncio.TimeoutError( 3536s f"{type(self).__name__} start timed out after {timeout}s." 3536s ) from exc 3536s TimeoutError: Worker start timed out after 0s. 3536s 2024-11-23 21:09:51,389 - distributed.scheduler - INFO - State start 3536s 2024-11-23 21:09:51,398 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41331 3536s 2024-11-23 21:09:51,398 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33851/status 3536s 2024-11-23 21:09:51,399 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3536s 2024-11-23 21:09:51,418 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39997 3536s 2024-11-23 21:09:51,419 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39997 3536s 2024-11-23 21:09:51,419 - distributed.worker - INFO - Worker name: 0 3536s 2024-11-23 21:09:51,419 - distributed.worker - INFO - dashboard at: 127.0.0.1:45699 3536s 2024-11-23 21:09:51,419 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41331 3536s 2024-11-23 21:09:51,419 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:09:51,419 - distributed.worker - INFO - Threads: 1 3536s 2024-11-23 21:09:51,419 - distributed.worker - INFO - Memory: 15.58 GiB 3536s 2024-11-23 21:09:51,419 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-nscs0kdr 3536s 2024-11-23 21:09:51,419 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:09:51,422 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33557 3536s 2024-11-23 21:09:51,422 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33557 3536s 2024-11-23 21:09:51,422 - distributed.worker - INFO - Worker name: 1 3536s 2024-11-23 21:09:51,422 - distributed.worker - INFO - dashboard at: 127.0.0.1:32841 3536s 2024-11-23 21:09:51,422 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41331 3536s 2024-11-23 21:09:51,422 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:09:51,422 - distributed.worker - INFO - Threads: 2 3536s 2024-11-23 21:09:51,422 - distributed.worker - INFO - Memory: 15.58 GiB 3536s 2024-11-23 21:09:51,422 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-t0tucwos 3536s 2024-11-23 21:09:51,422 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:09:51,424 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39997. Reason: failure-to-start- 3536s 2024-11-23 21:09:51,424 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3536s 2024-11-23 21:09:51,424 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33557. Reason: failure-to-start- 3536s 2024-11-23 21:09:51,425 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3536s 2024-11-23 21:09:51,426 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41331': TLS handshake failed with remote 'tls://127.0.0.1:60320': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3536s 2024-11-23 21:09:51,426 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41331': TLS handshake failed with remote 'tls://127.0.0.1:60336': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3536s 2024-11-23 21:09:51,428 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3536s return await fut 3536s ^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3536s await self._register_with_scheduler() 3536s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3536s comm = await connect(self.scheduler.address, **self.connection_args) 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3536s comm = await wait_for( 3536s ^^^^^^^^^^^^^^^ 3536s ...<2 lines>... 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3536s return await fut 3536s ^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3536s stream = await self.client.connect( 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3536s af, addr, stream = await connector.start(connect_timeout=timeout) 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s asyncio.exceptions.CancelledError 3536s 3536s The above exception was the direct cause of the following exception: 3536s 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3536s await wait_for(self.start_unsafe(), timeout=timeout) 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3536s async with asyncio.timeout(timeout): 3536s ~~~~~~~~~~~~~~~^^^^^^^^^ 3536s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3536s raise TimeoutError from exc_val 3536s TimeoutError 3536s 3536s The above exception was the direct cause of the following exception: 3536s 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3536s s, ws = await start_cluster( 3536s ^^^^^^^^^^^^^^^^^^^^ 3536s ...<9 lines>... 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3536s await asyncio.gather(*workers) 3536s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3536s return await awaitable 3536s ^^^^^^^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3536s raise asyncio.TimeoutError( 3536s f"{type(self).__name__} start timed out after {timeout}s." 3536s ) from exc 3536s TimeoutError: Worker start timed out after 0s. 3536s 2024-11-23 21:09:52,435 - distributed.scheduler - INFO - State start 3536s 2024-11-23 21:09:52,445 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35997 3536s 2024-11-23 21:09:52,445 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42171/status 3536s 2024-11-23 21:09:52,446 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3536s 2024-11-23 21:09:52,464 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38525 3536s 2024-11-23 21:09:52,464 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38525 3536s 2024-11-23 21:09:52,464 - distributed.worker - INFO - Worker name: 0 3536s 2024-11-23 21:09:52,464 - distributed.worker - INFO - dashboard at: 127.0.0.1:39609 3536s 2024-11-23 21:09:52,464 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35997 3536s 2024-11-23 21:09:52,464 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:09:52,464 - distributed.worker - INFO - Threads: 1 3536s 2024-11-23 21:09:52,464 - distributed.worker - INFO - Memory: 15.58 GiB 3536s 2024-11-23 21:09:52,464 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-5zmy3wq6 3536s 2024-11-23 21:09:52,465 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:09:52,468 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46295 3536s 2024-11-23 21:09:52,469 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46295 3536s 2024-11-23 21:09:52,469 - distributed.worker - INFO - Worker name: 1 3536s 2024-11-23 21:09:52,469 - distributed.worker - INFO - dashboard at: 127.0.0.1:40045 3536s 2024-11-23 21:09:52,469 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35997 3536s 2024-11-23 21:09:52,469 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:09:52,469 - distributed.worker - INFO - Threads: 2 3536s 2024-11-23 21:09:52,469 - distributed.worker - INFO - Memory: 15.58 GiB 3536s 2024-11-23 21:09:52,469 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-zxs3u1lw 3536s 2024-11-23 21:09:52,469 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:09:52,471 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38525. Reason: failure-to-start- 3536s 2024-11-23 21:09:52,471 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3536s 2024-11-23 21:09:52,471 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46295. Reason: failure-to-start- 3536s 2024-11-23 21:09:52,472 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3536s 2024-11-23 21:09:52,473 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35997': TLS handshake failed with remote 'tls://127.0.0.1:41962': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3536s 2024-11-23 21:09:52,473 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35997': TLS handshake failed with remote 'tls://127.0.0.1:41964': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3536s 2024-11-23 21:09:52,475 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3536s return await fut 3536s ^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3536s await self._register_with_scheduler() 3536s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3536s comm = await connect(self.scheduler.address, **self.connection_args) 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3536s comm = await wait_for( 3536s ^^^^^^^^^^^^^^^ 3536s ...<2 lines>... 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3536s return await fut 3536s ^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3536s stream = await self.client.connect( 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3536s af, addr, stream = await connector.start(connect_timeout=timeout) 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s asyncio.exceptions.CancelledError 3536s 3536s The above exception was the direct cause of the following exception: 3536s 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3536s await wait_for(self.start_unsafe(), timeout=timeout) 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3536s async with asyncio.timeout(timeout): 3536s ~~~~~~~~~~~~~~~^^^^^^^^^ 3536s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3536s raise TimeoutError from exc_val 3536s TimeoutError 3536s 3536s The above exception was the direct cause of the following exception: 3536s 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3536s s, ws = await start_cluster( 3536s ^^^^^^^^^^^^^^^^^^^^ 3536s ...<9 lines>... 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3536s await asyncio.gather(*workers) 3536s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3536s return await awaitable 3536s ^^^^^^^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3536s raise asyncio.TimeoutError( 3536s f"{type(self).__name__} start timed out after {timeout}s." 3536s ) from exc 3536s TimeoutError: Worker start timed out after 0s. 3536s 2024-11-23 21:09:53,482 - distributed.scheduler - INFO - State start 3536s 2024-11-23 21:09:53,491 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44729 3536s 2024-11-23 21:09:53,492 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42355/status 3536s 2024-11-23 21:09:53,492 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3536s 2024-11-23 21:09:53,510 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46357 3536s 2024-11-23 21:09:53,510 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46357 3536s 2024-11-23 21:09:53,510 - distributed.worker - INFO - Worker name: 0 3536s 2024-11-23 21:09:53,510 - distributed.worker - INFO - dashboard at: 127.0.0.1:43037 3536s 2024-11-23 21:09:53,511 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44729 3536s 2024-11-23 21:09:53,511 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:09:53,511 - distributed.worker - INFO - Threads: 1 3536s 2024-11-23 21:09:53,511 - distributed.worker - INFO - Memory: 15.58 GiB 3536s 2024-11-23 21:09:53,511 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-okc0tfav 3536s 2024-11-23 21:09:53,511 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:09:53,514 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44431 3536s 2024-11-23 21:09:53,514 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44431 3536s 2024-11-23 21:09:53,514 - distributed.worker - INFO - Worker name: 1 3536s 2024-11-23 21:09:53,514 - distributed.worker - INFO - dashboard at: 127.0.0.1:36235 3536s 2024-11-23 21:09:53,514 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44729 3536s 2024-11-23 21:09:53,514 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:09:53,514 - distributed.worker - INFO - Threads: 2 3536s 2024-11-23 21:09:53,514 - distributed.worker - INFO - Memory: 15.58 GiB 3536s 2024-11-23 21:09:53,514 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ilm4uoil 3536s 2024-11-23 21:09:53,514 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:09:53,516 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46357. Reason: failure-to-start- 3536s 2024-11-23 21:09:53,516 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3536s 2024-11-23 21:09:53,517 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44431. Reason: failure-to-start- 3536s 2024-11-23 21:09:53,517 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3536s 2024-11-23 21:09:53,519 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44729': TLS handshake failed with remote 'tls://127.0.0.1:35140': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3536s 2024-11-23 21:09:53,519 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44729': TLS handshake failed with remote 'tls://127.0.0.1:35150': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3536s 2024-11-23 21:09:53,521 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3536s return await fut 3536s ^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3536s await self._register_with_scheduler() 3536s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3536s comm = await connect(self.scheduler.address, **self.connection_args) 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3536s comm = await wait_for( 3536s ^^^^^^^^^^^^^^^ 3536s ...<2 lines>... 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3536s return await fut 3536s ^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3536s stream = await self.client.connect( 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3536s af, addr, stream = await connector.start(connect_timeout=timeout) 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s asyncio.exceptions.CancelledError 3536s 3536s The above exception was the direct cause of the following exception: 3536s 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3536s await wait_for(self.start_unsafe(), timeout=timeout) 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3536s async with asyncio.timeout(timeout): 3536s ~~~~~~~~~~~~~~~^^^^^^^^^ 3536s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3536s raise TimeoutError from exc_val 3536s TimeoutError 3536s 3536s The above exception was the direct cause of the following exception: 3536s 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3536s s, ws = await start_cluster( 3536s ^^^^^^^^^^^^^^^^^^^^ 3536s ...<9 lines>... 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3536s await asyncio.gather(*workers) 3536s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3536s return await awaitable 3536s ^^^^^^^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3536s raise asyncio.TimeoutError( 3536s f"{type(self).__name__} start timed out after {timeout}s." 3536s ) from exc 3536s TimeoutError: Worker start timed out after 0s. 3536s 2024-11-23 21:09:54,538 - distributed.scheduler - INFO - State start 3536s 2024-11-23 21:09:54,548 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33257 3536s 2024-11-23 21:09:54,548 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44977/status 3536s 2024-11-23 21:09:54,549 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3536s 2024-11-23 21:09:54,567 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38347 3536s 2024-11-23 21:09:54,567 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38347 3536s 2024-11-23 21:09:54,567 - distributed.worker - INFO - Worker name: 0 3536s 2024-11-23 21:09:54,567 - distributed.worker - INFO - dashboard at: 127.0.0.1:33937 3536s 2024-11-23 21:09:54,567 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33257 3536s 2024-11-23 21:09:54,568 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:09:54,568 - distributed.worker - INFO - Threads: 1 3536s 2024-11-23 21:09:54,568 - distributed.worker - INFO - Memory: 15.58 GiB 3536s 2024-11-23 21:09:54,568 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-jzn18bfi 3536s 2024-11-23 21:09:54,568 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:09:54,570 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37905 3536s 2024-11-23 21:09:54,571 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37905 3536s 2024-11-23 21:09:54,571 - distributed.worker - INFO - Worker name: 1 3536s 2024-11-23 21:09:54,571 - distributed.worker - INFO - dashboard at: 127.0.0.1:43823 3536s 2024-11-23 21:09:54,571 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33257 3536s 2024-11-23 21:09:54,571 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:09:54,571 - distributed.worker - INFO - Threads: 2 3536s 2024-11-23 21:09:54,571 - distributed.worker - INFO - Memory: 15.58 GiB 3536s 2024-11-23 21:09:54,571 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-x745t0n3 3536s 2024-11-23 21:09:54,571 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:09:54,573 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38347. Reason: failure-to-start- 3536s 2024-11-23 21:09:54,573 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3536s 2024-11-23 21:09:54,573 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37905. Reason: failure-to-start- 3536s 2024-11-23 21:09:54,574 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3536s 2024-11-23 21:09:54,576 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33257': TLS handshake failed with remote 'tls://127.0.0.1:34890': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3536s 2024-11-23 21:09:54,576 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33257': TLS handshake failed with remote 'tls://127.0.0.1:34902': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3536s 2024-11-23 21:09:54,578 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3536s return await fut 3536s ^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3536s await self._register_with_scheduler() 3536s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3536s comm = await connect(self.scheduler.address, **self.connection_args) 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3536s comm = await wait_for( 3536s ^^^^^^^^^^^^^^^ 3536s ...<2 lines>... 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3536s return await fut 3536s ^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3536s stream = await self.client.connect( 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3536s af, addr, stream = await connector.start(connect_timeout=timeout) 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s asyncio.exceptions.CancelledError 3536s 3536s The above exception was the direct cause of the following exception: 3536s 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3536s await wait_for(self.start_unsafe(), timeout=timeout) 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3536s async with asyncio.timeout(timeout): 3536s ~~~~~~~~~~~~~~~^^^^^^^^^ 3536s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3536s raise TimeoutError from exc_val 3536s TimeoutError 3536s 3536s The above exception was the direct cause of the following exception: 3536s 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3536s s, ws = await start_cluster( 3536s ^^^^^^^^^^^^^^^^^^^^ 3536s ...<9 lines>... 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3536s await asyncio.gather(*workers) 3536s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3536s return await awaitable 3536s ^^^^^^^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3536s raise asyncio.TimeoutError( 3536s f"{type(self).__name__} start timed out after {timeout}s." 3536s ) from exc 3536s TimeoutError: Worker start timed out after 0s. 3536s 2024-11-23 21:09:55,584 - distributed.scheduler - INFO - State start 3536s 2024-11-23 21:09:55,593 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43977 3536s 2024-11-23 21:09:55,594 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34241/status 3536s 2024-11-23 21:09:55,594 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3536s 2024-11-23 21:09:55,615 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37225 3536s 2024-11-23 21:09:55,615 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37225 3536s 2024-11-23 21:09:55,615 - distributed.worker - INFO - Worker name: 0 3536s 2024-11-23 21:09:55,615 - distributed.worker - INFO - dashboard at: 127.0.0.1:38113 3536s 2024-11-23 21:09:55,615 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43977 3536s 2024-11-23 21:09:55,615 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:09:55,615 - distributed.worker - INFO - Threads: 1 3536s 2024-11-23 21:09:55,615 - distributed.worker - INFO - Memory: 15.58 GiB 3536s 2024-11-23 21:09:55,615 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-pkk3e3hk 3536s 2024-11-23 21:09:55,615 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:09:55,618 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46351 3536s 2024-11-23 21:09:55,618 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46351 3536s 2024-11-23 21:09:55,618 - distributed.worker - INFO - Worker name: 1 3536s 2024-11-23 21:09:55,618 - distributed.worker - INFO - dashboard at: 127.0.0.1:34491 3536s 2024-11-23 21:09:55,618 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43977 3536s 2024-11-23 21:09:55,618 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:09:55,618 - distributed.worker - INFO - Threads: 2 3536s 2024-11-23 21:09:55,618 - distributed.worker - INFO - Memory: 15.58 GiB 3536s 2024-11-23 21:09:55,618 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-raxauzz8 3536s 2024-11-23 21:09:55,619 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:09:55,620 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37225. Reason: failure-to-start- 3536s 2024-11-23 21:09:55,620 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3536s 2024-11-23 21:09:55,621 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46351. Reason: failure-to-start- 3536s 2024-11-23 21:09:55,621 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3536s 2024-11-23 21:09:55,623 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43977': TLS handshake failed with remote 'tls://127.0.0.1:50588': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3536s 2024-11-23 21:09:55,623 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43977': TLS handshake failed with remote 'tls://127.0.0.1:50598': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3536s 2024-11-23 21:09:55,624 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3536s return await fut 3536s ^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3536s await self._register_with_scheduler() 3536s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3536s comm = await connect(self.scheduler.address, **self.connection_args) 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3536s comm = await wait_for( 3536s ^^^^^^^^^^^^^^^ 3536s ...<2 lines>... 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3536s return await fut 3536s ^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3536s stream = await self.client.connect( 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3536s af, addr, stream = await connector.start(connect_timeout=timeout) 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s asyncio.exceptions.CancelledError 3536s 3536s The above exception was the direct cause of the following exception: 3536s 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3536s await wait_for(self.start_unsafe(), timeout=timeout) 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3536s async with asyncio.timeout(timeout): 3536s ~~~~~~~~~~~~~~~^^^^^^^^^ 3536s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3536s raise TimeoutError from exc_val 3536s TimeoutError 3536s 3536s The above exception was the direct cause of the following exception: 3536s 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3536s s, ws = await start_cluster( 3536s ^^^^^^^^^^^^^^^^^^^^ 3536s ...<9 lines>... 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3536s await asyncio.gather(*workers) 3536s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3536s return await awaitable 3536s ^^^^^^^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3536s raise asyncio.TimeoutError( 3536s f"{type(self).__name__} start timed out after {timeout}s." 3536s ) from exc 3536s TimeoutError: Worker start timed out after 0s. 3536s 2024-11-23 21:09:56,631 - distributed.scheduler - INFO - State start 3536s 2024-11-23 21:09:56,640 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34019 3536s 2024-11-23 21:09:56,641 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42209/status 3536s 2024-11-23 21:09:56,641 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3536s 2024-11-23 21:09:56,659 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:32927 3536s 2024-11-23 21:09:56,660 - distributed.worker - INFO - Listening to: tls://127.0.0.1:32927 3536s 2024-11-23 21:09:56,660 - distributed.worker - INFO - Worker name: 0 3536s 2024-11-23 21:09:56,660 - distributed.worker - INFO - dashboard at: 127.0.0.1:35487 3536s 2024-11-23 21:09:56,660 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34019 3536s 2024-11-23 21:09:56,660 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:09:56,660 - distributed.worker - INFO - Threads: 1 3536s 2024-11-23 21:09:56,660 - distributed.worker - INFO - Memory: 15.58 GiB 3536s 2024-11-23 21:09:56,660 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-aku7ct4e 3536s 2024-11-23 21:09:56,660 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:09:56,664 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36087 3536s 2024-11-23 21:09:56,665 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36087 3536s 2024-11-23 21:09:56,665 - distributed.worker - INFO - Worker name: 1 3536s 2024-11-23 21:09:56,665 - distributed.worker - INFO - dashboard at: 127.0.0.1:33831 3536s 2024-11-23 21:09:56,665 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34019 3536s 2024-11-23 21:09:56,665 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:09:56,665 - distributed.worker - INFO - Threads: 2 3536s 2024-11-23 21:09:56,665 - distributed.worker - INFO - Memory: 15.58 GiB 3536s 2024-11-23 21:09:56,665 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-yjrluz8j 3536s 2024-11-23 21:09:56,665 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:09:56,667 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:32927. Reason: failure-to-start- 3536s 2024-11-23 21:09:56,667 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3536s 2024-11-23 21:09:56,668 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36087. Reason: failure-to-start- 3536s 2024-11-23 21:09:56,668 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3536s 2024-11-23 21:09:56,669 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34019': TLS handshake failed with remote 'tls://127.0.0.1:43790': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3536s 2024-11-23 21:09:56,670 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34019': TLS handshake failed with remote 'tls://127.0.0.1:43796': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3536s 2024-11-23 21:09:56,672 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3536s return await fut 3536s ^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3536s await self._register_with_scheduler() 3536s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3536s comm = await connect(self.scheduler.address, **self.connection_args) 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3536s comm = await wait_for( 3536s ^^^^^^^^^^^^^^^ 3536s ...<2 lines>... 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3536s return await fut 3536s ^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3536s stream = await self.client.connect( 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3536s af, addr, stream = await connector.start(connect_timeout=timeout) 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s asyncio.exceptions.CancelledError 3536s 3536s The above exception was the direct cause of the following exception: 3536s 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3536s await wait_for(self.start_unsafe(), timeout=timeout) 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3536s async with asyncio.timeout(timeout): 3536s ~~~~~~~~~~~~~~~^^^^^^^^^ 3536s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3536s raise TimeoutError from exc_val 3536s TimeoutError 3536s 3536s The above exception was the direct cause of the following exception: 3536s 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3536s s, ws = await start_cluster( 3536s ^^^^^^^^^^^^^^^^^^^^ 3536s ...<9 lines>... 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3536s await asyncio.gather(*workers) 3536s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3536s return await awaitable 3536s ^^^^^^^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3536s raise asyncio.TimeoutError( 3536s f"{type(self).__name__} start timed out after {timeout}s." 3536s ) from exc 3536s TimeoutError: Worker start timed out after 0s. 3536s 2024-11-23 21:09:57,679 - distributed.scheduler - INFO - State start 3536s 2024-11-23 21:09:57,688 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41891 3536s 2024-11-23 21:09:57,689 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37197/status 3536s 2024-11-23 21:09:57,689 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3536s 2024-11-23 21:09:57,710 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39695 3536s 2024-11-23 21:09:57,710 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39695 3536s 2024-11-23 21:09:57,710 - distributed.worker - INFO - Worker name: 0 3536s 2024-11-23 21:09:57,710 - distributed.worker - INFO - dashboard at: 127.0.0.1:34139 3536s 2024-11-23 21:09:57,710 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41891 3536s 2024-11-23 21:09:57,710 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:09:57,710 - distributed.worker - INFO - Threads: 1 3536s 2024-11-23 21:09:57,710 - distributed.worker - INFO - Memory: 15.58 GiB 3536s 2024-11-23 21:09:57,710 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-fwwut9ft 3536s 2024-11-23 21:09:57,710 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:09:57,713 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34877 3536s 2024-11-23 21:09:57,713 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34877 3536s 2024-11-23 21:09:57,713 - distributed.worker - INFO - Worker name: 1 3536s 2024-11-23 21:09:57,714 - distributed.worker - INFO - dashboard at: 127.0.0.1:39381 3536s 2024-11-23 21:09:57,714 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41891 3536s 2024-11-23 21:09:57,714 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:09:57,714 - distributed.worker - INFO - Threads: 2 3536s 2024-11-23 21:09:57,714 - distributed.worker - INFO - Memory: 15.58 GiB 3536s 2024-11-23 21:09:57,714 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-t545lqa9 3536s 2024-11-23 21:09:57,714 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:09:57,716 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39695. Reason: failure-to-start- 3536s 2024-11-23 21:09:57,716 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3536s 2024-11-23 21:09:57,716 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34877. Reason: failure-to-start- 3536s 2024-11-23 21:09:57,717 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3536s 2024-11-23 21:09:57,718 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41891': TLS handshake failed with remote 'tls://127.0.0.1:48366': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3536s 2024-11-23 21:09:57,719 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41891': TLS handshake failed with remote 'tls://127.0.0.1:48370': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3536s 2024-11-23 21:09:57,721 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3536s return await fut 3536s ^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3536s await self._register_with_scheduler() 3536s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3536s comm = await connect(self.scheduler.address, **self.connection_args) 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3536s comm = await wait_for( 3536s ^^^^^^^^^^^^^^^ 3536s ...<2 lines>... 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3536s return await fut 3536s ^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3536s stream = await self.client.connect( 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3536s af, addr, stream = await connector.start(connect_timeout=timeout) 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s asyncio.exceptions.CancelledError 3536s 3536s The above exception was the direct cause of the following exception: 3536s 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3536s await wait_for(self.start_unsafe(), timeout=timeout) 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3536s async with asyncio.timeout(timeout): 3536s ~~~~~~~~~~~~~~~^^^^^^^^^ 3536s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3536s raise TimeoutError from exc_val 3536s TimeoutError 3536s 3536s The above exception was the direct cause of the following exception: 3536s 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3536s s, ws = await start_cluster( 3536s ^^^^^^^^^^^^^^^^^^^^ 3536s ...<9 lines>... 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3536s await asyncio.gather(*workers) 3536s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3536s return await awaitable 3536s ^^^^^^^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3536s raise asyncio.TimeoutError( 3536s f"{type(self).__name__} start timed out after {timeout}s." 3536s ) from exc 3536s TimeoutError: Worker start timed out after 0s. 3536s 2024-11-23 21:09:58,730 - distributed.scheduler - INFO - State start 3536s 2024-11-23 21:09:58,739 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43873 3536s 2024-11-23 21:09:58,740 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43223/status 3536s 2024-11-23 21:09:58,743 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3536s 2024-11-23 21:09:58,761 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33079 3536s 2024-11-23 21:09:58,762 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33079 3536s 2024-11-23 21:09:58,762 - distributed.worker - INFO - Worker name: 0 3536s 2024-11-23 21:09:58,762 - distributed.worker - INFO - dashboard at: 127.0.0.1:39929 3536s 2024-11-23 21:09:58,762 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43873 3536s 2024-11-23 21:09:58,762 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:09:58,762 - distributed.worker - INFO - Threads: 1 3536s 2024-11-23 21:09:58,762 - distributed.worker - INFO - Memory: 15.58 GiB 3536s 2024-11-23 21:09:58,762 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-0ydf7nxf 3536s 2024-11-23 21:09:58,762 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:09:58,765 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34401 3536s 2024-11-23 21:09:58,765 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34401 3536s 2024-11-23 21:09:58,765 - distributed.worker - INFO - Worker name: 1 3536s 2024-11-23 21:09:58,765 - distributed.worker - INFO - dashboard at: 127.0.0.1:44279 3536s 2024-11-23 21:09:58,765 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43873 3536s 2024-11-23 21:09:58,765 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:09:58,765 - distributed.worker - INFO - Threads: 2 3536s 2024-11-23 21:09:58,765 - distributed.worker - INFO - Memory: 15.58 GiB 3536s 2024-11-23 21:09:58,765 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-uk2u98on 3536s 2024-11-23 21:09:58,765 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:09:58,767 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33079. Reason: failure-to-start- 3536s 2024-11-23 21:09:58,767 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3536s 2024-11-23 21:09:58,768 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34401. Reason: failure-to-start- 3536s 2024-11-23 21:09:58,768 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3536s 2024-11-23 21:09:58,772 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43873': TLS handshake failed with remote 'tls://127.0.0.1:50578': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3536s 2024-11-23 21:09:58,772 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43873': TLS handshake failed with remote 'tls://127.0.0.1:50586': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3536s 2024-11-23 21:09:58,774 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3536s return await fut 3536s ^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3536s await self._register_with_scheduler() 3536s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3536s comm = await connect(self.scheduler.address, **self.connection_args) 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3536s comm = await wait_for( 3536s ^^^^^^^^^^^^^^^ 3536s ...<2 lines>... 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3536s return await fut 3536s ^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3536s stream = await self.client.connect( 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3536s af, addr, stream = await connector.start(connect_timeout=timeout) 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s asyncio.exceptions.CancelledError 3536s 3536s The above exception was the direct cause of the following exception: 3536s 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3536s await wait_for(self.start_unsafe(), timeout=timeout) 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3536s async with asyncio.timeout(timeout): 3536s ~~~~~~~~~~~~~~~^^^^^^^^^ 3536s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3536s raise TimeoutError from exc_val 3536s TimeoutError 3536s 3536s The above exception was the direct cause of the following exception: 3536s 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3536s s, ws = await start_cluster( 3536s ^^^^^^^^^^^^^^^^^^^^ 3536s ...<9 lines>... 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3536s await asyncio.gather(*workers) 3536s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3536s return await awaitable 3536s ^^^^^^^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3536s raise asyncio.TimeoutError( 3536s f"{type(self).__name__} start timed out after {timeout}s." 3536s ) from exc 3536s TimeoutError: Worker start timed out after 0s. 3536s 2024-11-23 21:09:59,780 - distributed.scheduler - INFO - State start 3536s 2024-11-23 21:09:59,789 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41277 3536s 2024-11-23 21:09:59,789 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39137/status 3536s 2024-11-23 21:09:59,790 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3536s 2024-11-23 21:09:59,809 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33997 3536s 2024-11-23 21:09:59,810 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33997 3536s 2024-11-23 21:09:59,810 - distributed.worker - INFO - Worker name: 0 3536s 2024-11-23 21:09:59,810 - distributed.worker - INFO - dashboard at: 127.0.0.1:39363 3536s 2024-11-23 21:09:59,810 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41277 3536s 2024-11-23 21:09:59,810 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:09:59,810 - distributed.worker - INFO - Threads: 1 3536s 2024-11-23 21:09:59,810 - distributed.worker - INFO - Memory: 15.58 GiB 3536s 2024-11-23 21:09:59,810 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-5ed28rab 3536s 2024-11-23 21:09:59,810 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:09:59,813 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44049 3536s 2024-11-23 21:09:59,813 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44049 3536s 2024-11-23 21:09:59,813 - distributed.worker - INFO - Worker name: 1 3536s 2024-11-23 21:09:59,813 - distributed.worker - INFO - dashboard at: 127.0.0.1:44705 3536s 2024-11-23 21:09:59,813 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41277 3536s 2024-11-23 21:09:59,813 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:09:59,813 - distributed.worker - INFO - Threads: 2 3536s 2024-11-23 21:09:59,813 - distributed.worker - INFO - Memory: 15.58 GiB 3536s 2024-11-23 21:09:59,813 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-fdr96rb6 3536s 2024-11-23 21:09:59,814 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:09:59,815 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33997. Reason: failure-to-start- 3536s 2024-11-23 21:09:59,815 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3536s 2024-11-23 21:09:59,816 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44049. Reason: failure-to-start- 3536s 2024-11-23 21:09:59,816 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3536s 2024-11-23 21:09:59,821 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41277': TLS handshake failed with remote 'tls://127.0.0.1:56412': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3536s 2024-11-23 21:09:59,821 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41277': TLS handshake failed with remote 'tls://127.0.0.1:56428': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3536s 2024-11-23 21:09:59,823 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3536s return await fut 3536s ^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3536s await self._register_with_scheduler() 3536s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3536s comm = await connect(self.scheduler.address, **self.connection_args) 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3536s comm = await wait_for( 3536s ^^^^^^^^^^^^^^^ 3536s ...<2 lines>... 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3536s return await fut 3536s ^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3536s stream = await self.client.connect( 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3536s af, addr, stream = await connector.start(connect_timeout=timeout) 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s asyncio.exceptions.CancelledError 3536s 3536s The above exception was the direct cause of the following exception: 3536s 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3536s await wait_for(self.start_unsafe(), timeout=timeout) 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3536s async with asyncio.timeout(timeout): 3536s ~~~~~~~~~~~~~~~^^^^^^^^^ 3536s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3536s raise TimeoutError from exc_val 3536s TimeoutError 3536s 3536s The above exception was the direct cause of the following exception: 3536s 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3536s s, ws = await start_cluster( 3536s ^^^^^^^^^^^^^^^^^^^^ 3536s ...<9 lines>... 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3536s await asyncio.gather(*workers) 3536s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3536s return await awaitable 3536s ^^^^^^^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3536s raise asyncio.TimeoutError( 3536s f"{type(self).__name__} start timed out after {timeout}s." 3536s ) from exc 3536s TimeoutError: Worker start timed out after 0s. 3536s 2024-11-23 21:10:00,830 - distributed.scheduler - INFO - State start 3536s 2024-11-23 21:10:00,839 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46591 3536s 2024-11-23 21:10:00,839 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37341/status 3536s 2024-11-23 21:10:00,840 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3536s 2024-11-23 21:10:00,857 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33159 3536s 2024-11-23 21:10:00,858 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33159 3536s 2024-11-23 21:10:00,858 - distributed.worker - INFO - Worker name: 0 3536s 2024-11-23 21:10:00,858 - distributed.worker - INFO - dashboard at: 127.0.0.1:42211 3536s 2024-11-23 21:10:00,858 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46591 3536s 2024-11-23 21:10:00,858 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:10:00,858 - distributed.worker - INFO - Threads: 1 3536s 2024-11-23 21:10:00,858 - distributed.worker - INFO - Memory: 15.58 GiB 3536s 2024-11-23 21:10:00,858 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-32ih_8hi 3536s 2024-11-23 21:10:00,858 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:10:00,862 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36501 3536s 2024-11-23 21:10:00,863 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36501 3536s 2024-11-23 21:10:00,863 - distributed.worker - INFO - Worker name: 1 3536s 2024-11-23 21:10:00,863 - distributed.worker - INFO - dashboard at: 127.0.0.1:34629 3536s 2024-11-23 21:10:00,863 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46591 3536s 2024-11-23 21:10:00,863 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:10:00,863 - distributed.worker - INFO - Threads: 2 3536s 2024-11-23 21:10:00,863 - distributed.worker - INFO - Memory: 15.58 GiB 3536s 2024-11-23 21:10:00,863 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-90iduc3l 3536s 2024-11-23 21:10:00,863 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:10:00,868 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33159. Reason: failure-to-start- 3536s 2024-11-23 21:10:00,868 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3536s 2024-11-23 21:10:00,869 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36501. Reason: failure-to-start- 3536s 2024-11-23 21:10:00,869 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3536s 2024-11-23 21:10:00,870 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46591': TLS handshake failed with remote 'tls://127.0.0.1:41350': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3536s 2024-11-23 21:10:00,870 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46591': TLS handshake failed with remote 'tls://127.0.0.1:41362': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3536s 2024-11-23 21:10:00,872 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3536s return await fut 3536s ^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3536s await self._register_with_scheduler() 3536s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3536s comm = await connect(self.scheduler.address, **self.connection_args) 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3536s comm = await wait_for( 3536s ^^^^^^^^^^^^^^^ 3536s ...<2 lines>... 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3536s return await fut 3536s ^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3536s stream = await self.client.connect( 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3536s af, addr, stream = await connector.start(connect_timeout=timeout) 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s asyncio.exceptions.CancelledError 3536s 3536s The above exception was the direct cause of the following exception: 3536s 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3536s await wait_for(self.start_unsafe(), timeout=timeout) 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3536s async with asyncio.timeout(timeout): 3536s ~~~~~~~~~~~~~~~^^^^^^^^^ 3536s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3536s raise TimeoutError from exc_val 3536s TimeoutError 3536s 3536s The above exception was the direct cause of the following exception: 3536s 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3536s s, ws = await start_cluster( 3536s ^^^^^^^^^^^^^^^^^^^^ 3536s ...<9 lines>... 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3536s await asyncio.gather(*workers) 3536s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3536s return await awaitable 3536s ^^^^^^^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3536s raise asyncio.TimeoutError( 3536s f"{type(self).__name__} start timed out after {timeout}s." 3536s ) from exc 3536s TimeoutError: Worker start timed out after 0s. 3536s 2024-11-23 21:10:01,879 - distributed.scheduler - INFO - State start 3536s 2024-11-23 21:10:01,887 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45863 3536s 2024-11-23 21:10:01,888 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46337/status 3536s 2024-11-23 21:10:01,888 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3536s 2024-11-23 21:10:01,905 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44569 3536s 2024-11-23 21:10:01,906 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44569 3536s 2024-11-23 21:10:01,906 - distributed.worker - INFO - Worker name: 0 3536s 2024-11-23 21:10:01,906 - distributed.worker - INFO - dashboard at: 127.0.0.1:43857 3536s 2024-11-23 21:10:01,906 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45863 3536s 2024-11-23 21:10:01,906 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:10:01,906 - distributed.worker - INFO - Threads: 1 3536s 2024-11-23 21:10:01,906 - distributed.worker - INFO - Memory: 15.58 GiB 3536s 2024-11-23 21:10:01,906 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-gl6kvgqh 3536s 2024-11-23 21:10:01,906 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:10:01,909 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44725 3536s 2024-11-23 21:10:01,909 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44725 3536s 2024-11-23 21:10:01,909 - distributed.worker - INFO - Worker name: 1 3536s 2024-11-23 21:10:01,909 - distributed.worker - INFO - dashboard at: 127.0.0.1:40817 3536s 2024-11-23 21:10:01,909 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45863 3536s 2024-11-23 21:10:01,909 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:10:01,909 - distributed.worker - INFO - Threads: 2 3536s 2024-11-23 21:10:01,909 - distributed.worker - INFO - Memory: 15.58 GiB 3536s 2024-11-23 21:10:01,909 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-p0dfm6f4 3536s 2024-11-23 21:10:01,909 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:10:01,915 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44569. Reason: failure-to-start- 3536s 2024-11-23 21:10:01,915 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3536s 2024-11-23 21:10:01,916 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44725. Reason: failure-to-start- 3536s 2024-11-23 21:10:01,916 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3536s 2024-11-23 21:10:01,918 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45863': TLS handshake failed with remote 'tls://127.0.0.1:53934': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3536s 2024-11-23 21:10:01,918 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45863': TLS handshake failed with remote 'tls://127.0.0.1:53940': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3536s 2024-11-23 21:10:01,919 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3536s return await fut 3536s ^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3536s await self._register_with_scheduler() 3536s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3536s comm = await connect(self.scheduler.address, **self.connection_args) 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3536s comm = await wait_for( 3536s ^^^^^^^^^^^^^^^ 3536s ...<2 lines>... 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3536s return await fut 3536s ^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3536s stream = await self.client.connect( 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3536s af, addr, stream = await connector.start(connect_timeout=timeout) 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s asyncio.exceptions.CancelledError 3536s 3536s The above exception was the direct cause of the following exception: 3536s 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3536s await wait_for(self.start_unsafe(), timeout=timeout) 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3536s async with asyncio.timeout(timeout): 3536s ~~~~~~~~~~~~~~~^^^^^^^^^ 3536s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3536s raise TimeoutError from exc_val 3536s TimeoutError 3536s 3536s The above exception was the direct cause of the following exception: 3536s 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3536s s, ws = await start_cluster( 3536s ^^^^^^^^^^^^^^^^^^^^ 3536s ...<9 lines>... 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3536s await asyncio.gather(*workers) 3536s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3536s return await awaitable 3536s ^^^^^^^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3536s raise asyncio.TimeoutError( 3536s f"{type(self).__name__} start timed out after {timeout}s." 3536s ) from exc 3536s TimeoutError: Worker start timed out after 0s. 3536s 2024-11-23 21:10:02,925 - distributed.scheduler - INFO - State start 3536s 2024-11-23 21:10:02,934 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36115 3536s 2024-11-23 21:10:02,935 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37109/status 3536s 2024-11-23 21:10:02,935 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3536s 2024-11-23 21:10:02,954 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45017 3536s 2024-11-23 21:10:02,954 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45017 3536s 2024-11-23 21:10:02,954 - distributed.worker - INFO - Worker name: 0 3536s 2024-11-23 21:10:02,954 - distributed.worker - INFO - dashboard at: 127.0.0.1:46425 3536s 2024-11-23 21:10:02,954 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36115 3536s 2024-11-23 21:10:02,954 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:10:02,955 - distributed.worker - INFO - Threads: 1 3536s 2024-11-23 21:10:02,955 - distributed.worker - INFO - Memory: 15.58 GiB 3536s 2024-11-23 21:10:02,955 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-p0yke3__ 3536s 2024-11-23 21:10:02,955 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:10:02,957 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34961 3536s 2024-11-23 21:10:02,957 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34961 3536s 2024-11-23 21:10:02,958 - distributed.worker - INFO - Worker name: 1 3536s 2024-11-23 21:10:02,958 - distributed.worker - INFO - dashboard at: 127.0.0.1:46143 3536s 2024-11-23 21:10:02,958 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36115 3536s 2024-11-23 21:10:02,958 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:10:02,958 - distributed.worker - INFO - Threads: 2 3536s 2024-11-23 21:10:02,958 - distributed.worker - INFO - Memory: 15.58 GiB 3536s 2024-11-23 21:10:02,958 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ail3gjhw 3536s 2024-11-23 21:10:02,958 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:10:02,963 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45017. Reason: failure-to-start- 3536s 2024-11-23 21:10:02,963 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3536s 2024-11-23 21:10:02,963 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34961. Reason: failure-to-start- 3536s 2024-11-23 21:10:02,964 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3536s 2024-11-23 21:10:02,965 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36115': TLS handshake failed with remote 'tls://127.0.0.1:40540': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3536s 2024-11-23 21:10:02,966 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36115': TLS handshake failed with remote 'tls://127.0.0.1:40546': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3536s 2024-11-23 21:10:02,967 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3536s return await fut 3536s ^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3536s await self._register_with_scheduler() 3536s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3536s comm = await connect(self.scheduler.address, **self.connection_args) 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3536s comm = await wait_for( 3536s ^^^^^^^^^^^^^^^ 3536s ...<2 lines>... 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3536s return await fut 3536s ^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3536s stream = await self.client.connect( 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3536s af, addr, stream = await connector.start(connect_timeout=timeout) 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s asyncio.exceptions.CancelledError 3536s 3536s The above exception was the direct cause of the following exception: 3536s 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3536s await wait_for(self.start_unsafe(), timeout=timeout) 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3536s async with asyncio.timeout(timeout): 3536s ~~~~~~~~~~~~~~~^^^^^^^^^ 3536s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3536s raise TimeoutError from exc_val 3536s TimeoutError 3536s 3536s The above exception was the direct cause of the following exception: 3536s 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3536s s, ws = await start_cluster( 3536s ^^^^^^^^^^^^^^^^^^^^ 3536s ...<9 lines>... 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3536s await asyncio.gather(*workers) 3536s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3536s return await awaitable 3536s ^^^^^^^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3536s raise asyncio.TimeoutError( 3536s f"{type(self).__name__} start timed out after {timeout}s." 3536s ) from exc 3536s TimeoutError: Worker start timed out after 0s. 3536s 2024-11-23 21:10:03,974 - distributed.scheduler - INFO - State start 3536s 2024-11-23 21:10:03,986 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40053 3536s 2024-11-23 21:10:03,986 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43835/status 3536s 2024-11-23 21:10:03,986 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3536s 2024-11-23 21:10:04,005 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38961 3536s 2024-11-23 21:10:04,005 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38961 3536s 2024-11-23 21:10:04,005 - distributed.worker - INFO - Worker name: 0 3536s 2024-11-23 21:10:04,005 - distributed.worker - INFO - dashboard at: 127.0.0.1:34809 3536s 2024-11-23 21:10:04,005 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40053 3536s 2024-11-23 21:10:04,005 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:10:04,005 - distributed.worker - INFO - Threads: 1 3536s 2024-11-23 21:10:04,005 - distributed.worker - INFO - Memory: 15.58 GiB 3536s 2024-11-23 21:10:04,005 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-328lod9b 3536s 2024-11-23 21:10:04,006 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:10:04,008 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37289 3536s 2024-11-23 21:10:04,008 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37289 3536s 2024-11-23 21:10:04,009 - distributed.worker - INFO - Worker name: 1 3536s 2024-11-23 21:10:04,009 - distributed.worker - INFO - dashboard at: 127.0.0.1:37299 3536s 2024-11-23 21:10:04,009 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40053 3536s 2024-11-23 21:10:04,009 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:10:04,009 - distributed.worker - INFO - Threads: 2 3536s 2024-11-23 21:10:04,009 - distributed.worker - INFO - Memory: 15.58 GiB 3536s 2024-11-23 21:10:04,009 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-8430fauw 3536s 2024-11-23 21:10:04,009 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:10:04,014 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38961. Reason: failure-to-start- 3536s 2024-11-23 21:10:04,014 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3536s 2024-11-23 21:10:04,015 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37289. Reason: failure-to-start- 3536s 2024-11-23 21:10:04,015 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3536s 2024-11-23 21:10:04,017 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40053': TLS handshake failed with remote 'tls://127.0.0.1:60792': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3536s 2024-11-23 21:10:04,017 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40053': TLS handshake failed with remote 'tls://127.0.0.1:60804': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3536s 2024-11-23 21:10:04,020 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3536s return await fut 3536s ^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3536s await self._register_with_scheduler() 3536s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3536s comm = await connect(self.scheduler.address, **self.connection_args) 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3536s comm = await wait_for( 3536s ^^^^^^^^^^^^^^^ 3536s ...<2 lines>... 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3536s return await fut 3536s ^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3536s stream = await self.client.connect( 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3536s af, addr, stream = await connector.start(connect_timeout=timeout) 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s asyncio.exceptions.CancelledError 3536s 3536s The above exception was the direct cause of the following exception: 3536s 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3536s await wait_for(self.start_unsafe(), timeout=timeout) 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3536s async with asyncio.timeout(timeout): 3536s ~~~~~~~~~~~~~~~^^^^^^^^^ 3536s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3536s raise TimeoutError from exc_val 3536s TimeoutError 3536s 3536s The above exception was the direct cause of the following exception: 3536s 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3536s s, ws = await start_cluster( 3536s ^^^^^^^^^^^^^^^^^^^^ 3536s ...<9 lines>... 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3536s await asyncio.gather(*workers) 3536s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3536s return await awaitable 3536s ^^^^^^^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3536s raise asyncio.TimeoutError( 3536s f"{type(self).__name__} start timed out after {timeout}s." 3536s ) from exc 3536s TimeoutError: Worker start timed out after 0s. 3536s 2024-11-23 21:10:05,026 - distributed.scheduler - INFO - State start 3536s 2024-11-23 21:10:05,035 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34639 3536s 2024-11-23 21:10:05,035 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46753/status 3536s 2024-11-23 21:10:05,035 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3536s 2024-11-23 21:10:05,056 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42151 3536s 2024-11-23 21:10:05,056 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42151 3536s 2024-11-23 21:10:05,056 - distributed.worker - INFO - Worker name: 0 3536s 2024-11-23 21:10:05,056 - distributed.worker - INFO - dashboard at: 127.0.0.1:37955 3536s 2024-11-23 21:10:05,056 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34639 3536s 2024-11-23 21:10:05,056 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:10:05,056 - distributed.worker - INFO - Threads: 1 3536s 2024-11-23 21:10:05,056 - distributed.worker - INFO - Memory: 15.58 GiB 3536s 2024-11-23 21:10:05,057 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ca56l0n8 3536s 2024-11-23 21:10:05,057 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:10:05,059 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42623 3536s 2024-11-23 21:10:05,060 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42623 3536s 2024-11-23 21:10:05,060 - distributed.worker - INFO - Worker name: 1 3536s 2024-11-23 21:10:05,060 - distributed.worker - INFO - dashboard at: 127.0.0.1:44543 3536s 2024-11-23 21:10:05,060 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34639 3536s 2024-11-23 21:10:05,060 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:10:05,060 - distributed.worker - INFO - Threads: 2 3536s 2024-11-23 21:10:05,060 - distributed.worker - INFO - Memory: 15.58 GiB 3536s 2024-11-23 21:10:05,060 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-58f5g8l9 3536s 2024-11-23 21:10:05,060 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:10:05,065 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42151. Reason: failure-to-start- 3536s 2024-11-23 21:10:05,065 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3536s 2024-11-23 21:10:05,066 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42623. Reason: failure-to-start- 3536s 2024-11-23 21:10:05,066 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3536s 2024-11-23 21:10:05,068 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34639': TLS handshake failed with remote 'tls://127.0.0.1:59796': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3536s 2024-11-23 21:10:05,068 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34639': TLS handshake failed with remote 'tls://127.0.0.1:59806': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3536s 2024-11-23 21:10:05,070 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3536s return await fut 3536s ^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3536s await self._register_with_scheduler() 3536s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3536s comm = await connect(self.scheduler.address, **self.connection_args) 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3536s comm = await wait_for( 3536s ^^^^^^^^^^^^^^^ 3536s ...<2 lines>... 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3536s return await fut 3536s ^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3536s stream = await self.client.connect( 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3536s af, addr, stream = await connector.start(connect_timeout=timeout) 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s asyncio.exceptions.CancelledError 3536s 3536s The above exception was the direct cause of the following exception: 3536s 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3536s await wait_for(self.start_unsafe(), timeout=timeout) 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3536s async with asyncio.timeout(timeout): 3536s ~~~~~~~~~~~~~~~^^^^^^^^^ 3536s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3536s raise TimeoutError from exc_val 3536s TimeoutError 3536s 3536s The above exception was the direct cause of the following exception: 3536s 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3536s s, ws = await start_cluster( 3536s ^^^^^^^^^^^^^^^^^^^^ 3536s ...<9 lines>... 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3536s await asyncio.gather(*workers) 3536s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3536s return await awaitable 3536s ^^^^^^^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3536s raise asyncio.TimeoutError( 3536s f"{type(self).__name__} start timed out after {timeout}s." 3536s ) from exc 3536s TimeoutError: Worker start timed out after 0s. 3536s 2024-11-23 21:10:06,077 - distributed.scheduler - INFO - State start 3536s 2024-11-23 21:10:06,086 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38855 3536s 2024-11-23 21:10:06,087 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38621/status 3536s 2024-11-23 21:10:06,087 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3536s 2024-11-23 21:10:06,106 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41691 3536s 2024-11-23 21:10:06,107 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41691 3536s 2024-11-23 21:10:06,107 - distributed.worker - INFO - Worker name: 0 3536s 2024-11-23 21:10:06,107 - distributed.worker - INFO - dashboard at: 127.0.0.1:37589 3536s 2024-11-23 21:10:06,107 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3536s 2024-11-23 21:10:06,107 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:10:06,107 - distributed.worker - INFO - Threads: 1 3536s 2024-11-23 21:10:06,107 - distributed.worker - INFO - Memory: 15.58 GiB 3536s 2024-11-23 21:10:06,107 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-21c7ndg8 3536s 2024-11-23 21:10:06,107 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:10:06,111 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33011 3536s 2024-11-23 21:10:06,112 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33011 3536s 2024-11-23 21:10:06,112 - distributed.worker - INFO - Worker name: 1 3536s 2024-11-23 21:10:06,112 - distributed.worker - INFO - dashboard at: 127.0.0.1:33251 3536s 2024-11-23 21:10:06,112 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3536s 2024-11-23 21:10:06,112 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:10:06,112 - distributed.worker - INFO - Threads: 2 3536s 2024-11-23 21:10:06,112 - distributed.worker - INFO - Memory: 15.58 GiB 3536s 2024-11-23 21:10:06,112 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-klry5v_b 3536s 2024-11-23 21:10:06,112 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:10:06,117 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41691. Reason: failure-to-start- 3536s 2024-11-23 21:10:06,117 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3536s 2024-11-23 21:10:06,118 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33011. Reason: failure-to-start- 3536s 2024-11-23 21:10:06,118 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3536s 2024-11-23 21:10:06,120 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:36732': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3536s 2024-11-23 21:10:06,120 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:36744': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3536s 2024-11-23 21:10:06,122 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3536s return await fut 3536s ^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3536s await self._register_with_scheduler() 3536s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3536s comm = await connect(self.scheduler.address, **self.connection_args) 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3536s comm = await wait_for( 3536s ^^^^^^^^^^^^^^^ 3536s ...<2 lines>... 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3536s return await fut 3536s ^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3536s stream = await self.client.connect( 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3536s af, addr, stream = await connector.start(connect_timeout=timeout) 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s asyncio.exceptions.CancelledError 3536s 3536s The above exception was the direct cause of the following exception: 3536s 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3536s await wait_for(self.start_unsafe(), timeout=timeout) 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3536s async with asyncio.timeout(timeout): 3536s ~~~~~~~~~~~~~~~^^^^^^^^^ 3536s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3536s raise TimeoutError from exc_val 3536s TimeoutError 3536s 3536s The above exception was the direct cause of the following exception: 3536s 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3536s s, ws = await start_cluster( 3536s ^^^^^^^^^^^^^^^^^^^^ 3536s ...<9 lines>... 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3536s await asyncio.gather(*workers) 3536s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3536s return await awaitable 3536s ^^^^^^^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3536s raise asyncio.TimeoutError( 3536s f"{type(self).__name__} start timed out after {timeout}s." 3536s ) from exc 3536s TimeoutError: Worker start timed out after 0s. 3536s 2024-11-23 21:10:07,128 - distributed.scheduler - INFO - State start 3536s 2024-11-23 21:10:07,138 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44381 3536s 2024-11-23 21:10:07,139 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46339/status 3536s 2024-11-23 21:10:07,139 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3536s 2024-11-23 21:10:07,158 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44903 3536s 2024-11-23 21:10:07,159 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44903 3536s 2024-11-23 21:10:07,159 - distributed.worker - INFO - Worker name: 0 3536s 2024-11-23 21:10:07,159 - distributed.worker - INFO - dashboard at: 127.0.0.1:41541 3536s 2024-11-23 21:10:07,159 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44381 3536s 2024-11-23 21:10:07,159 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:10:07,159 - distributed.worker - INFO - Threads: 1 3536s 2024-11-23 21:10:07,159 - distributed.worker - INFO - Memory: 15.58 GiB 3536s 2024-11-23 21:10:07,159 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-7xagzxgv 3536s 2024-11-23 21:10:07,159 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:10:07,162 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45801 3536s 2024-11-23 21:10:07,162 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45801 3536s 2024-11-23 21:10:07,162 - distributed.worker - INFO - Worker name: 1 3536s 2024-11-23 21:10:07,162 - distributed.worker - INFO - dashboard at: 127.0.0.1:40473 3536s 2024-11-23 21:10:07,162 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44381 3536s 2024-11-23 21:10:07,162 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:10:07,162 - distributed.worker - INFO - Threads: 2 3536s 2024-11-23 21:10:07,163 - distributed.worker - INFO - Memory: 15.58 GiB 3536s 2024-11-23 21:10:07,163 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-lhifu8hl 3536s 2024-11-23 21:10:07,163 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:10:07,169 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44903. Reason: failure-to-start- 3536s 2024-11-23 21:10:07,169 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3536s 2024-11-23 21:10:07,170 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45801. Reason: failure-to-start- 3536s 2024-11-23 21:10:07,170 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3536s 2024-11-23 21:10:07,171 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44381': TLS handshake failed with remote 'tls://127.0.0.1:58610': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3536s 2024-11-23 21:10:07,171 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44381': TLS handshake failed with remote 'tls://127.0.0.1:58626': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3536s 2024-11-23 21:10:07,173 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3536s return await fut 3536s ^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3536s await self._register_with_scheduler() 3536s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3536s comm = await connect(self.scheduler.address, **self.connection_args) 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3536s comm = await wait_for( 3536s ^^^^^^^^^^^^^^^ 3536s ...<2 lines>... 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3536s return await fut 3536s ^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3536s stream = await self.client.connect( 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3536s af, addr, stream = await connector.start(connect_timeout=timeout) 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s asyncio.exceptions.CancelledError 3536s 3536s The above exception was the direct cause of the following exception: 3536s 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3536s await wait_for(self.start_unsafe(), timeout=timeout) 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3536s async with asyncio.timeout(timeout): 3536s ~~~~~~~~~~~~~~~^^^^^^^^^ 3536s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3536s raise TimeoutError from exc_val 3536s TimeoutError 3536s 3536s The above exception was the direct cause of the following exception: 3536s 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3536s s, ws = await start_cluster( 3536s ^^^^^^^^^^^^^^^^^^^^ 3536s ...<9 lines>... 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3536s await asyncio.gather(*workers) 3536s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3536s return await awaitable 3536s ^^^^^^^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3536s raise asyncio.TimeoutError( 3536s f"{type(self).__name__} start timed out after {timeout}s." 3536s ) from exc 3536s TimeoutError: Worker start timed out after 0s. 3536s 2024-11-23 21:10:08,179 - distributed.scheduler - INFO - State start 3536s 2024-11-23 21:10:08,188 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34183 3536s 2024-11-23 21:10:08,188 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36497/status 3536s 2024-11-23 21:10:08,189 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3536s 2024-11-23 21:10:08,211 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41853 3536s 2024-11-23 21:10:08,211 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41853 3536s 2024-11-23 21:10:08,211 - distributed.worker - INFO - Worker name: 0 3536s 2024-11-23 21:10:08,211 - distributed.worker - INFO - dashboard at: 127.0.0.1:46699 3536s 2024-11-23 21:10:08,211 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34183 3536s 2024-11-23 21:10:08,212 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:10:08,212 - distributed.worker - INFO - Threads: 1 3536s 2024-11-23 21:10:08,212 - distributed.worker - INFO - Memory: 15.58 GiB 3536s 2024-11-23 21:10:08,212 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-lfu6xjzu 3536s 2024-11-23 21:10:08,212 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:10:08,214 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38379 3536s 2024-11-23 21:10:08,215 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38379 3536s 2024-11-23 21:10:08,215 - distributed.worker - INFO - Worker name: 1 3536s 2024-11-23 21:10:08,215 - distributed.worker - INFO - dashboard at: 127.0.0.1:38893 3536s 2024-11-23 21:10:08,215 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34183 3536s 2024-11-23 21:10:08,215 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:10:08,215 - distributed.worker - INFO - Threads: 2 3536s 2024-11-23 21:10:08,215 - distributed.worker - INFO - Memory: 15.58 GiB 3536s 2024-11-23 21:10:08,215 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-cqaio96d 3536s 2024-11-23 21:10:08,215 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:10:08,220 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41853. Reason: failure-to-start- 3536s 2024-11-23 21:10:08,220 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3536s 2024-11-23 21:10:08,221 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38379. Reason: failure-to-start- 3536s 2024-11-23 21:10:08,221 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3536s 2024-11-23 21:10:08,222 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34183': TLS handshake failed with remote 'tls://127.0.0.1:57978': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3536s 2024-11-23 21:10:08,222 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34183': TLS handshake failed with remote 'tls://127.0.0.1:57992': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3536s 2024-11-23 21:10:08,224 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3536s return await fut 3536s ^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3536s await self._register_with_scheduler() 3536s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3536s comm = await connect(self.scheduler.address, **self.connection_args) 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3536s comm = await wait_for( 3536s ^^^^^^^^^^^^^^^ 3536s ...<2 lines>... 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3536s return await fut 3536s ^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3536s stream = await self.client.connect( 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3536s af, addr, stream = await connector.start(connect_timeout=timeout) 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s asyncio.exceptions.CancelledError 3536s 3536s The above exception was the direct cause of the following exception: 3536s 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3536s await wait_for(self.start_unsafe(), timeout=timeout) 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3536s async with asyncio.timeout(timeout): 3536s ~~~~~~~~~~~~~~~^^^^^^^^^ 3536s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3536s raise TimeoutError from exc_val 3536s TimeoutError 3536s 3536s The above exception was the direct cause of the following exception: 3536s 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3536s s, ws = await start_cluster( 3536s ^^^^^^^^^^^^^^^^^^^^ 3536s ...<9 lines>... 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3536s await asyncio.gather(*workers) 3536s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3536s return await awaitable 3536s ^^^^^^^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3536s raise asyncio.TimeoutError( 3536s f"{type(self).__name__} start timed out after {timeout}s." 3536s ) from exc 3536s TimeoutError: Worker start timed out after 0s. 3536s 2024-11-23 21:10:09,233 - distributed.scheduler - INFO - State start 3536s 2024-11-23 21:10:09,244 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42401 3536s 2024-11-23 21:10:09,244 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37177/status 3536s 2024-11-23 21:10:09,245 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3536s 2024-11-23 21:10:09,267 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43991 3536s 2024-11-23 21:10:09,267 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43991 3536s 2024-11-23 21:10:09,267 - distributed.worker - INFO - Worker name: 0 3536s 2024-11-23 21:10:09,267 - distributed.worker - INFO - dashboard at: 127.0.0.1:34617 3536s 2024-11-23 21:10:09,268 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42401 3536s 2024-11-23 21:10:09,268 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:10:09,268 - distributed.worker - INFO - Threads: 1 3536s 2024-11-23 21:10:09,268 - distributed.worker - INFO - Memory: 15.58 GiB 3536s 2024-11-23 21:10:09,268 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-vjxmjumn 3536s 2024-11-23 21:10:09,268 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:10:09,271 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38881 3536s 2024-11-23 21:10:09,271 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38881 3536s 2024-11-23 21:10:09,271 - distributed.worker - INFO - Worker name: 1 3536s 2024-11-23 21:10:09,271 - distributed.worker - INFO - dashboard at: 127.0.0.1:42351 3536s 2024-11-23 21:10:09,271 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42401 3536s 2024-11-23 21:10:09,271 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:10:09,271 - distributed.worker - INFO - Threads: 2 3536s 2024-11-23 21:10:09,271 - distributed.worker - INFO - Memory: 15.58 GiB 3536s 2024-11-23 21:10:09,271 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-v0mwe6t_ 3536s 2024-11-23 21:10:09,272 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:10:09,278 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43991. Reason: failure-to-start- 3536s 2024-11-23 21:10:09,278 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3536s 2024-11-23 21:10:09,279 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38881. Reason: failure-to-start- 3536s 2024-11-23 21:10:09,279 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3536s 2024-11-23 21:10:09,281 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42401': TLS handshake failed with remote 'tls://127.0.0.1:60986': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3536s 2024-11-23 21:10:09,281 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42401': TLS handshake failed with remote 'tls://127.0.0.1:60988': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3536s 2024-11-23 21:10:09,283 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3536s return await fut 3536s ^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3536s await self._register_with_scheduler() 3536s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3536s comm = await connect(self.scheduler.address, **self.connection_args) 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3536s comm = await wait_for( 3536s ^^^^^^^^^^^^^^^ 3536s ...<2 lines>... 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3536s return await fut 3536s ^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3536s stream = await self.client.connect( 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3536s af, addr, stream = await connector.start(connect_timeout=timeout) 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s asyncio.exceptions.CancelledError 3536s 3536s The above exception was the direct cause of the following exception: 3536s 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3536s await wait_for(self.start_unsafe(), timeout=timeout) 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3536s async with asyncio.timeout(timeout): 3536s ~~~~~~~~~~~~~~~^^^^^^^^^ 3536s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3536s raise TimeoutError from exc_val 3536s TimeoutError 3536s 3536s The above exception was the direct cause of the following exception: 3536s 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3536s s, ws = await start_cluster( 3536s ^^^^^^^^^^^^^^^^^^^^ 3536s ...<9 lines>... 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3536s await asyncio.gather(*workers) 3536s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3536s return await awaitable 3536s ^^^^^^^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3536s raise asyncio.TimeoutError( 3536s f"{type(self).__name__} start timed out after {timeout}s." 3536s ) from exc 3536s TimeoutError: Worker start timed out after 0s. 3536s 2024-11-23 21:10:10,289 - distributed.scheduler - INFO - State start 3536s 2024-11-23 21:10:10,298 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45027 3536s 2024-11-23 21:10:10,299 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35261/status 3536s 2024-11-23 21:10:10,299 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3536s 2024-11-23 21:10:10,345 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46625 3536s 2024-11-23 21:10:10,345 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46625 3536s 2024-11-23 21:10:10,345 - distributed.worker - INFO - Worker name: 0 3536s 2024-11-23 21:10:10,345 - distributed.worker - INFO - dashboard at: 127.0.0.1:43415 3536s 2024-11-23 21:10:10,345 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45027 3536s 2024-11-23 21:10:10,345 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:10:10,345 - distributed.worker - INFO - Threads: 1 3536s 2024-11-23 21:10:10,345 - distributed.worker - INFO - Memory: 15.58 GiB 3536s 2024-11-23 21:10:10,346 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-9mmfeljq 3536s 2024-11-23 21:10:10,346 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:10:10,348 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37801 3536s 2024-11-23 21:10:10,349 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37801 3536s 2024-11-23 21:10:10,349 - distributed.worker - INFO - Worker name: 1 3536s 2024-11-23 21:10:10,349 - distributed.worker - INFO - dashboard at: 127.0.0.1:44065 3536s 2024-11-23 21:10:10,349 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45027 3536s 2024-11-23 21:10:10,349 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:10:10,349 - distributed.worker - INFO - Threads: 2 3536s 2024-11-23 21:10:10,349 - distributed.worker - INFO - Memory: 15.58 GiB 3536s 2024-11-23 21:10:10,349 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-jmr7o368 3536s 2024-11-23 21:10:10,349 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:10:10,357 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46625. Reason: failure-to-start- 3536s 2024-11-23 21:10:10,357 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3536s 2024-11-23 21:10:10,358 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37801. Reason: failure-to-start- 3536s 2024-11-23 21:10:10,358 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3536s 2024-11-23 21:10:10,360 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45027': TLS handshake failed with remote 'tls://127.0.0.1:60646': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3536s 2024-11-23 21:10:10,360 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45027': TLS handshake failed with remote 'tls://127.0.0.1:60658': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3536s 2024-11-23 21:10:10,365 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3536s return await fut 3536s ^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3536s await self._register_with_scheduler() 3536s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3536s comm = await connect(self.scheduler.address, **self.connection_args) 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3536s comm = await wait_for( 3536s ^^^^^^^^^^^^^^^ 3536s ...<2 lines>... 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3536s return await fut 3536s ^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3536s stream = await self.client.connect( 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3536s af, addr, stream = await connector.start(connect_timeout=timeout) 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s asyncio.exceptions.CancelledError 3536s 3536s The above exception was the direct cause of the following exception: 3536s 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3536s await wait_for(self.start_unsafe(), timeout=timeout) 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3536s async with asyncio.timeout(timeout): 3536s ~~~~~~~~~~~~~~~^^^^^^^^^ 3536s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3536s raise TimeoutError from exc_val 3536s TimeoutError 3536s 3536s The above exception was the direct cause of the following exception: 3536s 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3536s s, ws = await start_cluster( 3536s ^^^^^^^^^^^^^^^^^^^^ 3536s ...<9 lines>... 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3536s await asyncio.gather(*workers) 3536s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3536s return await awaitable 3536s ^^^^^^^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3536s raise asyncio.TimeoutError( 3536s f"{type(self).__name__} start timed out after {timeout}s." 3536s ) from exc 3536s TimeoutError: Worker start timed out after 0s. 3536s 2024-11-23 21:10:11,372 - distributed.scheduler - INFO - State start 3536s 2024-11-23 21:10:11,381 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35113 3536s 2024-11-23 21:10:11,382 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36899/status 3536s 2024-11-23 21:10:11,382 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3536s 2024-11-23 21:10:11,401 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36641 3536s 2024-11-23 21:10:11,401 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36641 3536s 2024-11-23 21:10:11,401 - distributed.worker - INFO - Worker name: 0 3536s 2024-11-23 21:10:11,402 - distributed.worker - INFO - dashboard at: 127.0.0.1:33973 3536s 2024-11-23 21:10:11,402 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 3536s 2024-11-23 21:10:11,402 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:10:11,402 - distributed.worker - INFO - Threads: 1 3536s 2024-11-23 21:10:11,402 - distributed.worker - INFO - Memory: 15.58 GiB 3536s 2024-11-23 21:10:11,402 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-j4oljili 3536s 2024-11-23 21:10:11,402 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:10:11,406 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36223 3536s 2024-11-23 21:10:11,407 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36223 3536s 2024-11-23 21:10:11,407 - distributed.worker - INFO - Worker name: 1 3536s 2024-11-23 21:10:11,407 - distributed.worker - INFO - dashboard at: 127.0.0.1:38413 3536s 2024-11-23 21:10:11,407 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 3536s 2024-11-23 21:10:11,407 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:10:11,407 - distributed.worker - INFO - Threads: 2 3536s 2024-11-23 21:10:11,407 - distributed.worker - INFO - Memory: 15.58 GiB 3536s 2024-11-23 21:10:11,407 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-1ykjgr0e 3536s 2024-11-23 21:10:11,407 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:10:11,412 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36641. Reason: failure-to-start- 3536s 2024-11-23 21:10:11,412 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3536s 2024-11-23 21:10:11,413 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36223. Reason: failure-to-start- 3536s 2024-11-23 21:10:11,413 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3536s 2024-11-23 21:10:11,418 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:53666': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3536s 2024-11-23 21:10:11,418 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:53680': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3536s 2024-11-23 21:10:11,420 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3536s return await fut 3536s ^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3536s await self._register_with_scheduler() 3536s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3536s comm = await connect(self.scheduler.address, **self.connection_args) 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3536s comm = await wait_for( 3536s ^^^^^^^^^^^^^^^ 3536s ...<2 lines>... 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3536s return await fut 3536s ^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3536s stream = await self.client.connect( 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3536s af, addr, stream = await connector.start(connect_timeout=timeout) 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s asyncio.exceptions.CancelledError 3536s 3536s The above exception was the direct cause of the following exception: 3536s 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3536s await wait_for(self.start_unsafe(), timeout=timeout) 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3536s async with asyncio.timeout(timeout): 3536s ~~~~~~~~~~~~~~~^^^^^^^^^ 3536s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3536s raise TimeoutError from exc_val 3536s TimeoutError 3536s 3536s The above exception was the direct cause of the following exception: 3536s 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3536s s, ws = await start_cluster( 3536s ^^^^^^^^^^^^^^^^^^^^ 3536s ...<9 lines>... 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3536s await asyncio.gather(*workers) 3536s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3536s return await awaitable 3536s ^^^^^^^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3536s raise asyncio.TimeoutError( 3536s f"{type(self).__name__} start timed out after {timeout}s." 3536s ) from exc 3536s TimeoutError: Worker start timed out after 0s. 3536s 2024-11-23 21:10:12,428 - distributed.scheduler - INFO - State start 3536s 2024-11-23 21:10:12,437 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44137 3536s 2024-11-23 21:10:12,437 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44473/status 3536s 2024-11-23 21:10:12,438 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3536s 2024-11-23 21:10:12,459 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44723 3536s 2024-11-23 21:10:12,459 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44723 3536s 2024-11-23 21:10:12,459 - distributed.worker - INFO - Worker name: 0 3536s 2024-11-23 21:10:12,459 - distributed.worker - INFO - dashboard at: 127.0.0.1:36487 3536s 2024-11-23 21:10:12,459 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44137 3536s 2024-11-23 21:10:12,459 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:10:12,459 - distributed.worker - INFO - Threads: 1 3536s 2024-11-23 21:10:12,459 - distributed.worker - INFO - Memory: 15.58 GiB 3536s 2024-11-23 21:10:12,459 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-_jrq83xd 3536s 2024-11-23 21:10:12,459 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:10:12,462 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37973 3536s 2024-11-23 21:10:12,462 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37973 3536s 2024-11-23 21:10:12,462 - distributed.worker - INFO - Worker name: 1 3536s 2024-11-23 21:10:12,462 - distributed.worker - INFO - dashboard at: 127.0.0.1:33865 3536s 2024-11-23 21:10:12,462 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44137 3536s 2024-11-23 21:10:12,462 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:10:12,462 - distributed.worker - INFO - Threads: 2 3536s 2024-11-23 21:10:12,462 - distributed.worker - INFO - Memory: 15.58 GiB 3536s 2024-11-23 21:10:12,463 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-7w16vg4t 3536s 2024-11-23 21:10:12,463 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:10:12,469 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44723. Reason: failure-to-start- 3536s 2024-11-23 21:10:12,469 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3536s 2024-11-23 21:10:12,470 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37973. Reason: failure-to-start- 3536s 2024-11-23 21:10:12,470 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3536s 2024-11-23 21:10:12,472 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44137': TLS handshake failed with remote 'tls://127.0.0.1:36508': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3536s 2024-11-23 21:10:12,472 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44137': TLS handshake failed with remote 'tls://127.0.0.1:36518': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3536s 2024-11-23 21:10:12,474 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3536s return await fut 3536s ^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3536s await self._register_with_scheduler() 3536s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3536s comm = await connect(self.scheduler.address, **self.connection_args) 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3536s comm = await wait_for( 3536s ^^^^^^^^^^^^^^^ 3536s ...<2 lines>... 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3536s return await fut 3536s ^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3536s stream = await self.client.connect( 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3536s af, addr, stream = await connector.start(connect_timeout=timeout) 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s asyncio.exceptions.CancelledError 3536s 3536s The above exception was the direct cause of the following exception: 3536s 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3536s await wait_for(self.start_unsafe(), timeout=timeout) 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3536s async with asyncio.timeout(timeout): 3536s ~~~~~~~~~~~~~~~^^^^^^^^^ 3536s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3536s raise TimeoutError from exc_val 3536s TimeoutError 3536s 3536s The above exception was the direct cause of the following exception: 3536s 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3536s s, ws = await start_cluster( 3536s ^^^^^^^^^^^^^^^^^^^^ 3536s ...<9 lines>... 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3536s await asyncio.gather(*workers) 3536s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3536s return await awaitable 3536s ^^^^^^^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3536s raise asyncio.TimeoutError( 3536s f"{type(self).__name__} start timed out after {timeout}s." 3536s ) from exc 3536s TimeoutError: Worker start timed out after 0s. 3536s 2024-11-23 21:10:13,480 - distributed.scheduler - INFO - State start 3536s 2024-11-23 21:10:13,489 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:32981 3536s 2024-11-23 21:10:13,489 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42399/status 3536s 2024-11-23 21:10:13,490 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3536s 2024-11-23 21:10:13,512 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33403 3536s 2024-11-23 21:10:13,512 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33403 3536s 2024-11-23 21:10:13,512 - distributed.worker - INFO - Worker name: 0 3536s 2024-11-23 21:10:13,512 - distributed.worker - INFO - dashboard at: 127.0.0.1:39699 3536s 2024-11-23 21:10:13,512 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:32981 3536s 2024-11-23 21:10:13,512 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:10:13,512 - distributed.worker - INFO - Threads: 1 3536s 2024-11-23 21:10:13,512 - distributed.worker - INFO - Memory: 15.58 GiB 3536s 2024-11-23 21:10:13,512 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-hrb6rocf 3536s 2024-11-23 21:10:13,513 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:10:13,515 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46141 3536s 2024-11-23 21:10:13,516 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46141 3536s 2024-11-23 21:10:13,516 - distributed.worker - INFO - Worker name: 1 3536s 2024-11-23 21:10:13,516 - distributed.worker - INFO - dashboard at: 127.0.0.1:34559 3536s 2024-11-23 21:10:13,516 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:32981 3536s 2024-11-23 21:10:13,516 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:10:13,516 - distributed.worker - INFO - Threads: 2 3536s 2024-11-23 21:10:13,516 - distributed.worker - INFO - Memory: 15.58 GiB 3536s 2024-11-23 21:10:13,516 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-i2b24nsr 3536s 2024-11-23 21:10:13,516 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:10:13,521 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33403. Reason: failure-to-start- 3536s 2024-11-23 21:10:13,521 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3536s 2024-11-23 21:10:13,522 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46141. Reason: failure-to-start- 3536s 2024-11-23 21:10:13,522 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3536s 2024-11-23 21:10:13,524 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:32981': TLS handshake failed with remote 'tls://127.0.0.1:36326': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3536s 2024-11-23 21:10:13,524 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:32981': TLS handshake failed with remote 'tls://127.0.0.1:36338': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3536s 2024-11-23 21:10:13,525 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3536s return await fut 3536s ^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3536s await self._register_with_scheduler() 3536s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3536s comm = await connect(self.scheduler.address, **self.connection_args) 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3536s comm = await wait_for( 3536s ^^^^^^^^^^^^^^^ 3536s ...<2 lines>... 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3536s return await fut 3536s ^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3536s stream = await self.client.connect( 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3536s af, addr, stream = await connector.start(connect_timeout=timeout) 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s asyncio.exceptions.CancelledError 3536s 3536s The above exception was the direct cause of the following exception: 3536s 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3536s await wait_for(self.start_unsafe(), timeout=timeout) 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3536s async with asyncio.timeout(timeout): 3536s ~~~~~~~~~~~~~~~^^^^^^^^^ 3536s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3536s raise TimeoutError from exc_val 3536s TimeoutError 3536s 3536s The above exception was the direct cause of the following exception: 3536s 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3536s s, ws = await start_cluster( 3536s ^^^^^^^^^^^^^^^^^^^^ 3536s ...<9 lines>... 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3536s await asyncio.gather(*workers) 3536s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3536s return await awaitable 3536s ^^^^^^^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3536s raise asyncio.TimeoutError( 3536s f"{type(self).__name__} start timed out after {timeout}s." 3536s ) from exc 3536s TimeoutError: Worker start timed out after 0s. 3536s 2024-11-23 21:10:14,532 - distributed.scheduler - INFO - State start 3536s 2024-11-23 21:10:14,543 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34617 3536s 2024-11-23 21:10:14,544 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38207/status 3536s 2024-11-23 21:10:14,544 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3536s 2024-11-23 21:10:14,565 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33731 3536s 2024-11-23 21:10:14,566 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33731 3536s 2024-11-23 21:10:14,566 - distributed.worker - INFO - Worker name: 0 3536s 2024-11-23 21:10:14,566 - distributed.worker - INFO - dashboard at: 127.0.0.1:37231 3536s 2024-11-23 21:10:14,566 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34617 3536s 2024-11-23 21:10:14,566 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:10:14,566 - distributed.worker - INFO - Threads: 1 3536s 2024-11-23 21:10:14,566 - distributed.worker - INFO - Memory: 15.58 GiB 3536s 2024-11-23 21:10:14,566 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-e503scsm 3536s 2024-11-23 21:10:14,566 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:10:14,569 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34923 3536s 2024-11-23 21:10:14,569 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34923 3536s 2024-11-23 21:10:14,569 - distributed.worker - INFO - Worker name: 1 3536s 2024-11-23 21:10:14,569 - distributed.worker - INFO - dashboard at: 127.0.0.1:34033 3536s 2024-11-23 21:10:14,569 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34617 3536s 2024-11-23 21:10:14,569 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:10:14,569 - distributed.worker - INFO - Threads: 2 3536s 2024-11-23 21:10:14,569 - distributed.worker - INFO - Memory: 15.58 GiB 3536s 2024-11-23 21:10:14,569 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-b66vqm0d 3536s 2024-11-23 21:10:14,569 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:10:14,574 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33731. Reason: failure-to-start- 3536s 2024-11-23 21:10:14,574 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3536s 2024-11-23 21:10:14,575 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34923. Reason: failure-to-start- 3536s 2024-11-23 21:10:14,575 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3536s 2024-11-23 21:10:14,577 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34617': TLS handshake failed with remote 'tls://127.0.0.1:39502': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3536s 2024-11-23 21:10:14,577 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34617': TLS handshake failed with remote 'tls://127.0.0.1:39518': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3536s 2024-11-23 21:10:14,579 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3536s return await fut 3536s ^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3536s await self._register_with_scheduler() 3536s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3536s comm = await connect(self.scheduler.address, **self.connection_args) 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3536s comm = await wait_for( 3536s ^^^^^^^^^^^^^^^ 3536s ...<2 lines>... 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3536s return await fut 3536s ^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3536s stream = await self.client.connect( 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3536s af, addr, stream = await connector.start(connect_timeout=timeout) 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s asyncio.exceptions.CancelledError 3536s 3536s The above exception was the direct cause of the following exception: 3536s 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3536s await wait_for(self.start_unsafe(), timeout=timeout) 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3536s async with asyncio.timeout(timeout): 3536s ~~~~~~~~~~~~~~~^^^^^^^^^ 3536s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3536s raise TimeoutError from exc_val 3536s TimeoutError 3536s 3536s The above exception was the direct cause of the following exception: 3536s 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3536s s, ws = await start_cluster( 3536s ^^^^^^^^^^^^^^^^^^^^ 3536s ...<9 lines>... 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3536s await asyncio.gather(*workers) 3536s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3536s return await awaitable 3536s ^^^^^^^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3536s raise asyncio.TimeoutError( 3536s f"{type(self).__name__} start timed out after {timeout}s." 3536s ) from exc 3536s TimeoutError: Worker start timed out after 0s. 3536s 2024-11-23 21:10:15,585 - distributed.scheduler - INFO - State start 3536s 2024-11-23 21:10:15,596 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35999 3536s 2024-11-23 21:10:15,597 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39921/status 3536s 2024-11-23 21:10:15,597 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3536s 2024-11-23 21:10:15,628 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43207 3536s 2024-11-23 21:10:15,628 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43207 3536s 2024-11-23 21:10:15,628 - distributed.worker - INFO - Worker name: 0 3536s 2024-11-23 21:10:15,628 - distributed.worker - INFO - dashboard at: 127.0.0.1:44575 3536s 2024-11-23 21:10:15,628 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35999 3536s 2024-11-23 21:10:15,628 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:10:15,628 - distributed.worker - INFO - Threads: 1 3536s 2024-11-23 21:10:15,629 - distributed.worker - INFO - Memory: 15.58 GiB 3536s 2024-11-23 21:10:15,629 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-6xy_uy1i 3536s 2024-11-23 21:10:15,629 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:10:15,632 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38509 3536s 2024-11-23 21:10:15,632 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38509 3536s 2024-11-23 21:10:15,632 - distributed.worker - INFO - Worker name: 1 3536s 2024-11-23 21:10:15,632 - distributed.worker - INFO - dashboard at: 127.0.0.1:45873 3536s 2024-11-23 21:10:15,632 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35999 3536s 2024-11-23 21:10:15,632 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:10:15,632 - distributed.worker - INFO - Threads: 2 3536s 2024-11-23 21:10:15,633 - distributed.worker - INFO - Memory: 15.58 GiB 3536s 2024-11-23 21:10:15,633 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-dx_l94ff 3536s 2024-11-23 21:10:15,633 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:10:15,635 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43207. Reason: failure-to-start- 3536s 2024-11-23 21:10:15,635 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3536s 2024-11-23 21:10:15,635 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38509. Reason: failure-to-start- 3536s 2024-11-23 21:10:15,636 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3536s 2024-11-23 21:10:15,638 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35999': TLS handshake failed with remote 'tls://127.0.0.1:52670': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3536s 2024-11-23 21:10:15,638 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35999': TLS handshake failed with remote 'tls://127.0.0.1:52672': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3536s 2024-11-23 21:10:15,641 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3536s return await fut 3536s ^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3536s await self._register_with_scheduler() 3536s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3536s comm = await connect(self.scheduler.address, **self.connection_args) 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3536s comm = await wait_for( 3536s ^^^^^^^^^^^^^^^ 3536s ...<2 lines>... 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3536s return await fut 3536s ^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3536s stream = await self.client.connect( 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3536s af, addr, stream = await connector.start(connect_timeout=timeout) 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s asyncio.exceptions.CancelledError 3536s 3536s The above exception was the direct cause of the following exception: 3536s 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3536s await wait_for(self.start_unsafe(), timeout=timeout) 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3536s async with asyncio.timeout(timeout): 3536s ~~~~~~~~~~~~~~~^^^^^^^^^ 3536s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3536s raise TimeoutError from exc_val 3536s TimeoutError 3536s 3536s The above exception was the direct cause of the following exception: 3536s 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3536s s, ws = await start_cluster( 3536s ^^^^^^^^^^^^^^^^^^^^ 3536s ...<9 lines>... 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3536s await asyncio.gather(*workers) 3536s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3536s return await awaitable 3536s ^^^^^^^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3536s raise asyncio.TimeoutError( 3536s f"{type(self).__name__} start timed out after {timeout}s." 3536s ) from exc 3536s TimeoutError: Worker start timed out after 0s. 3536s 2024-11-23 21:10:16,650 - distributed.scheduler - INFO - State start 3536s 2024-11-23 21:10:16,659 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35477 3536s 2024-11-23 21:10:16,660 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39679/status 3536s 2024-11-23 21:10:16,660 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3536s 2024-11-23 21:10:16,681 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42691 3536s 2024-11-23 21:10:16,681 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42691 3536s 2024-11-23 21:10:16,682 - distributed.worker - INFO - Worker name: 0 3536s 2024-11-23 21:10:16,682 - distributed.worker - INFO - dashboard at: 127.0.0.1:45467 3536s 2024-11-23 21:10:16,682 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35477 3536s 2024-11-23 21:10:16,682 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:10:16,682 - distributed.worker - INFO - Threads: 1 3536s 2024-11-23 21:10:16,682 - distributed.worker - INFO - Memory: 15.58 GiB 3536s 2024-11-23 21:10:16,682 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-oomsw361 3536s 2024-11-23 21:10:16,682 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:10:16,688 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39381 3536s 2024-11-23 21:10:16,688 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39381 3536s 2024-11-23 21:10:16,689 - distributed.worker - INFO - Worker name: 1 3536s 2024-11-23 21:10:16,689 - distributed.worker - INFO - dashboard at: 127.0.0.1:43165 3536s 2024-11-23 21:10:16,689 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35477 3536s 2024-11-23 21:10:16,689 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:10:16,689 - distributed.worker - INFO - Threads: 2 3536s 2024-11-23 21:10:16,689 - distributed.worker - INFO - Memory: 15.58 GiB 3536s 2024-11-23 21:10:16,689 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-yx5qf_9d 3536s 2024-11-23 21:10:16,689 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:10:16,691 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42691. Reason: failure-to-start- 3536s 2024-11-23 21:10:16,691 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3536s 2024-11-23 21:10:16,692 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39381. Reason: failure-to-start- 3536s 2024-11-23 21:10:16,692 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3536s 2024-11-23 21:10:16,698 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35477': TLS handshake failed with remote 'tls://127.0.0.1:47570': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3536s 2024-11-23 21:10:16,698 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35477': TLS handshake failed with remote 'tls://127.0.0.1:47586': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3536s 2024-11-23 21:10:16,707 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3536s return await fut 3536s ^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3536s await self._register_with_scheduler() 3536s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3536s comm = await connect(self.scheduler.address, **self.connection_args) 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3536s comm = await wait_for( 3536s ^^^^^^^^^^^^^^^ 3536s ...<2 lines>... 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3536s return await fut 3536s ^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3536s stream = await self.client.connect( 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3536s af, addr, stream = await connector.start(connect_timeout=timeout) 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s asyncio.exceptions.CancelledError 3536s 3536s The above exception was the direct cause of the following exception: 3536s 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3536s await wait_for(self.start_unsafe(), timeout=timeout) 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3536s async with asyncio.timeout(timeout): 3536s ~~~~~~~~~~~~~~~^^^^^^^^^ 3536s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3536s raise TimeoutError from exc_val 3536s TimeoutError 3536s 3536s The above exception was the direct cause of the following exception: 3536s 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3536s s, ws = await start_cluster( 3536s ^^^^^^^^^^^^^^^^^^^^ 3536s ...<9 lines>... 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3536s await asyncio.gather(*workers) 3536s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3536s return await awaitable 3536s ^^^^^^^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3536s raise asyncio.TimeoutError( 3536s f"{type(self).__name__} start timed out after {timeout}s." 3536s ) from exc 3536s TimeoutError: Worker start timed out after 0s. 3536s 2024-11-23 21:10:17,715 - distributed.scheduler - INFO - State start 3536s 2024-11-23 21:10:17,727 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42613 3536s 2024-11-23 21:10:17,727 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36541/status 3536s 2024-11-23 21:10:17,728 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3536s 2024-11-23 21:10:17,754 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37247 3536s 2024-11-23 21:10:17,755 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37247 3536s 2024-11-23 21:10:17,755 - distributed.worker - INFO - Worker name: 0 3536s 2024-11-23 21:10:17,755 - distributed.worker - INFO - dashboard at: 127.0.0.1:36449 3536s 2024-11-23 21:10:17,755 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42613 3536s 2024-11-23 21:10:17,755 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:10:17,755 - distributed.worker - INFO - Threads: 1 3536s 2024-11-23 21:10:17,755 - distributed.worker - INFO - Memory: 15.58 GiB 3536s 2024-11-23 21:10:17,755 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-yob84fyw 3536s 2024-11-23 21:10:17,755 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:10:17,758 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37987 3536s 2024-11-23 21:10:17,759 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37987 3536s 2024-11-23 21:10:17,759 - distributed.worker - INFO - Worker name: 1 3536s 2024-11-23 21:10:17,759 - distributed.worker - INFO - dashboard at: 127.0.0.1:43571 3536s 2024-11-23 21:10:17,759 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42613 3536s 2024-11-23 21:10:17,759 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:10:17,759 - distributed.worker - INFO - Threads: 2 3536s 2024-11-23 21:10:17,759 - distributed.worker - INFO - Memory: 15.58 GiB 3536s 2024-11-23 21:10:17,759 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-o0oaayxd 3536s 2024-11-23 21:10:17,759 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:10:17,771 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37247. Reason: failure-to-start- 3536s 2024-11-23 21:10:17,771 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3536s 2024-11-23 21:10:17,772 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37987. Reason: failure-to-start- 3536s 2024-11-23 21:10:17,772 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3536s 2024-11-23 21:10:17,775 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42613': TLS handshake failed with remote 'tls://127.0.0.1:41060': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3536s 2024-11-23 21:10:17,775 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42613': TLS handshake failed with remote 'tls://127.0.0.1:41068': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3536s 2024-11-23 21:10:17,781 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3536s return await fut 3536s ^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3536s await self._register_with_scheduler() 3536s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3536s comm = await connect(self.scheduler.address, **self.connection_args) 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3536s comm = await wait_for( 3536s ^^^^^^^^^^^^^^^ 3536s ...<2 lines>... 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3536s return await fut 3536s ^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3536s stream = await self.client.connect( 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3536s af, addr, stream = await connector.start(connect_timeout=timeout) 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s asyncio.exceptions.CancelledError 3536s 3536s The above exception was the direct cause of the following exception: 3536s 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3536s await wait_for(self.start_unsafe(), timeout=timeout) 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3536s async with asyncio.timeout(timeout): 3536s ~~~~~~~~~~~~~~~^^^^^^^^^ 3536s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3536s raise TimeoutError from exc_val 3536s TimeoutError 3536s 3536s The above exception was the direct cause of the following exception: 3536s 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3536s s, ws = await start_cluster( 3536s ^^^^^^^^^^^^^^^^^^^^ 3536s ...<9 lines>... 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3536s await asyncio.gather(*workers) 3536s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3536s return await awaitable 3536s ^^^^^^^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3536s raise asyncio.TimeoutError( 3536s f"{type(self).__name__} start timed out after {timeout}s." 3536s ) from exc 3536s TimeoutError: Worker start timed out after 0s. 3536s _____________________________ test_repr_temp_keys ______________________________ 3536s 3536s cls = , kwargs = {} 3536s 3536s @classmethod 3536s def temporary(cls, **kwargs): 3536s """Create a new temporary Security object. 3536s 3536s This creates a new self-signed key/cert pair suitable for securing 3536s communication for all roles in a Dask cluster. These keys/certs exist 3536s only in memory, and are stored in this object. 3536s 3536s This method requires the library ``cryptography`` be installed. 3536s """ 3536s try: 3536s > from cryptography import x509 3536s 3536s /usr/lib/python3/dist-packages/distributed/security.py:165: 3536s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3536s /usr/lib/python3/dist-packages/cryptography/x509/__init__.py:7: in 3536s from cryptography.x509 import certificate_transparency, verification 3536s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3536s 3536s # This file is dual licensed under the terms of the Apache License, Version 3536s # 2.0, and the BSD License. See the LICENSE file in the root of this repository 3536s # for complete details. 3536s 3536s from __future__ import annotations 3536s 3536s import abc 3536s import datetime 3536s 3536s from cryptography import utils 3536s > from cryptography.hazmat.bindings._rust import x509 as rust_x509 3536s E ImportError: cannot import name 'x509' from 'cryptography.hazmat.bindings._rust' (unknown location) 3536s 3536s /usr/lib/python3/dist-packages/cryptography/x509/certificate_transparency.py:11: ImportError 3536s 3536s During handling of the above exception, another exception occurred: 3536s 3536s def test_repr_temp_keys(): 3536s > xfail_ssl_issue5601() 3536s 3536s /usr/lib/python3/dist-packages/distributed/tests/test_security.py:155: 3536s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3536s /usr/lib/python3/dist-packages/distributed/utils_test.py:1945: in xfail_ssl_issue5601 3536s Security.temporary() 3536s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3536s 3536s cls = , kwargs = {} 3536s 3536s @classmethod 3536s def temporary(cls, **kwargs): 3536s """Create a new temporary Security object. 3536s 3536s This creates a new self-signed key/cert pair suitable for securing 3536s communication for all roles in a Dask cluster. These keys/certs exist 3536s only in memory, and are stored in this object. 3536s 3536s This method requires the library ``cryptography`` be installed. 3536s """ 3536s try: 3536s from cryptography import x509 3536s from cryptography.hazmat.backends import default_backend 3536s from cryptography.hazmat.primitives import hashes, serialization 3536s from cryptography.hazmat.primitives.asymmetric import rsa 3536s from cryptography.x509.oid import NameOID 3536s except ImportError: 3536s > raise ImportError( 3536s "Using `Security.temporary` requires `cryptography`, please " 3536s "install it using either pip or conda" 3536s ) 3536s E ImportError: Using `Security.temporary` requires `cryptography`, please install it using either pip or conda 3536s 3536s /usr/lib/python3/dist-packages/distributed/security.py:171: ImportError 3536s __________________________ test_temporary_credentials __________________________ 3536s 3536s cls = , kwargs = {} 3536s 3536s @classmethod 3536s def temporary(cls, **kwargs): 3536s """Create a new temporary Security object. 3536s 3536s This creates a new self-signed key/cert pair suitable for securing 3536s communication for all roles in a Dask cluster. These keys/certs exist 3536s only in memory, and are stored in this object. 3536s 3536s This method requires the library ``cryptography`` be installed. 3536s """ 3536s try: 3536s > from cryptography import x509 3536s 3536s /usr/lib/python3/dist-packages/distributed/security.py:165: 3536s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3536s /usr/lib/python3/dist-packages/cryptography/x509/__init__.py:7: in 3536s from cryptography.x509 import certificate_transparency, verification 3536s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3536s 3536s # This file is dual licensed under the terms of the Apache License, Version 3536s # 2.0, and the BSD License. See the LICENSE file in the root of this repository 3536s # for complete details. 3536s 3536s from __future__ import annotations 3536s 3536s import abc 3536s import datetime 3536s 3536s from cryptography import utils 3536s > from cryptography.hazmat.bindings._rust import x509 as rust_x509 3536s E ImportError: cannot import name 'x509' from 'cryptography.hazmat.bindings._rust' (unknown location) 3536s 3536s /usr/lib/python3/dist-packages/cryptography/x509/certificate_transparency.py:11: ImportError 3536s 3536s During handling of the above exception, another exception occurred: 3536s 3536s def test_temporary_credentials(): 3536s > xfail_ssl_issue5601() 3536s 3536s /usr/lib/python3/dist-packages/distributed/tests/test_security.py:448: 3536s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3536s /usr/lib/python3/dist-packages/distributed/utils_test.py:1945: in xfail_ssl_issue5601 3536s Security.temporary() 3536s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3536s 3536s cls = , kwargs = {} 3536s 3536s @classmethod 3536s def temporary(cls, **kwargs): 3536s """Create a new temporary Security object. 3536s 3536s This creates a new self-signed key/cert pair suitable for securing 3536s communication for all roles in a Dask cluster. These keys/certs exist 3536s only in memory, and are stored in this object. 3536s 3536s This method requires the library ``cryptography`` be installed. 3536s """ 3536s try: 3536s from cryptography import x509 3536s from cryptography.hazmat.backends import default_backend 3536s from cryptography.hazmat.primitives import hashes, serialization 3536s from cryptography.hazmat.primitives.asymmetric import rsa 3536s from cryptography.x509.oid import NameOID 3536s except ImportError: 3536s > raise ImportError( 3536s "Using `Security.temporary` requires `cryptography`, please " 3536s "install it using either pip or conda" 3536s ) 3536s E ImportError: Using `Security.temporary` requires `cryptography`, please install it using either pip or conda 3536s 3536s /usr/lib/python3/dist-packages/distributed/security.py:171: ImportError 3536s ________________ test_extra_conn_args_in_temporary_credentials _________________ 3536s 3536s cls = , kwargs = {} 3536s 3536s @classmethod 3536s def temporary(cls, **kwargs): 3536s """Create a new temporary Security object. 3536s 3536s This creates a new self-signed key/cert pair suitable for securing 3536s communication for all roles in a Dask cluster. These keys/certs exist 3536s only in memory, and are stored in this object. 3536s 3536s This method requires the library ``cryptography`` be installed. 3536s """ 3536s try: 3536s > from cryptography import x509 3536s 3536s /usr/lib/python3/dist-packages/distributed/security.py:165: 3536s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3536s /usr/lib/python3/dist-packages/cryptography/x509/__init__.py:7: in 3536s from cryptography.x509 import certificate_transparency, verification 3536s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3536s 3536s # This file is dual licensed under the terms of the Apache License, Version 3536s # 2.0, and the BSD License. See the LICENSE file in the root of this repository 3536s # for complete details. 3536s 3536s from __future__ import annotations 3536s 3536s import abc 3536s import datetime 3536s 3536s from cryptography import utils 3536s > from cryptography.hazmat.bindings._rust import x509 as rust_x509 3536s E ImportError: cannot import name 'x509' from 'cryptography.hazmat.bindings._rust' (unknown location) 3536s 3536s /usr/lib/python3/dist-packages/cryptography/x509/certificate_transparency.py:11: ImportError 3536s 3536s During handling of the above exception, another exception occurred: 3536s 3536s def test_extra_conn_args_in_temporary_credentials(): 3536s > xfail_ssl_issue5601() 3536s 3536s /usr/lib/python3/dist-packages/distributed/tests/test_security.py:466: 3536s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3536s /usr/lib/python3/dist-packages/distributed/utils_test.py:1945: in xfail_ssl_issue5601 3536s Security.temporary() 3536s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3536s 3536s cls = , kwargs = {} 3536s 3536s @classmethod 3536s def temporary(cls, **kwargs): 3536s """Create a new temporary Security object. 3536s 3536s This creates a new self-signed key/cert pair suitable for securing 3536s communication for all roles in a Dask cluster. These keys/certs exist 3536s only in memory, and are stored in this object. 3536s 3536s This method requires the library ``cryptography`` be installed. 3536s """ 3536s try: 3536s from cryptography import x509 3536s from cryptography.hazmat.backends import default_backend 3536s from cryptography.hazmat.primitives import hashes, serialization 3536s from cryptography.hazmat.primitives.asymmetric import rsa 3536s from cryptography.x509.oid import NameOID 3536s except ImportError: 3536s > raise ImportError( 3536s "Using `Security.temporary` requires `cryptography`, please " 3536s "install it using either pip or conda" 3536s ) 3536s E ImportError: Using `Security.temporary` requires `cryptography`, please install it using either pip or conda 3536s 3536s /usr/lib/python3/dist-packages/distributed/security.py:171: ImportError 3536s __________________________________ test_basic __________________________________ 3536s 3536s fut = , timeout = 0 3536s 3536s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 3536s async with asyncio.timeout(timeout): 3536s > return await fut 3536s 3536s /usr/lib/python3/dist-packages/distributed/utils.py:1960: 3536s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3536s /usr/lib/python3/dist-packages/distributed/worker.py:1480: in start_unsafe 3536s await self._register_with_scheduler() 3536s /usr/lib/python3/dist-packages/distributed/worker.py:1179: in _register_with_scheduler 3536s comm = await connect(self.scheduler.address, **self.connection_args) 3536s /usr/lib/python3/dist-packages/distributed/comm/core.py:342: in connect 3536s comm = await wait_for( 3536s /usr/lib/python3/dist-packages/distributed/utils.py:1960: in wait_for 3536s return await fut 3536s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:546: in connect 3536s stream = await self.client.connect( 3536s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3536s 3536s self = , host = '127.0.0.1' 3536s port = 37661, af = 3536s ssl_options = 3536s max_buffer_size = 8364507136.0, source_ip = None, source_port = None 3536s timeout = None 3536s 3536s async def connect( 3536s self, 3536s host: str, 3536s port: int, 3536s af: socket.AddressFamily = socket.AF_UNSPEC, 3536s ssl_options: Optional[Union[Dict[str, Any], ssl.SSLContext]] = None, 3536s max_buffer_size: Optional[int] = None, 3536s source_ip: Optional[str] = None, 3536s source_port: Optional[int] = None, 3536s timeout: Optional[Union[float, datetime.timedelta]] = None, 3536s ) -> IOStream: 3536s """Connect to the given host and port. 3536s 3536s Asynchronously returns an `.IOStream` (or `.SSLIOStream` if 3536s ``ssl_options`` is not None). 3536s 3536s Using the ``source_ip`` kwarg, one can specify the source 3536s IP address to use when establishing the connection. 3536s In case the user needs to resolve and 3536s use a specific interface, it has to be handled outside 3536s of Tornado as this depends very much on the platform. 3536s 3536s Raises `TimeoutError` if the input future does not complete before 3536s ``timeout``, which may be specified in any form allowed by 3536s `.IOLoop.add_timeout` (i.e. a `datetime.timedelta` or an absolute time 3536s relative to `.IOLoop.time`) 3536s 3536s Similarly, when the user requires a certain source port, it can 3536s be specified using the ``source_port`` arg. 3536s 3536s .. versionchanged:: 4.5 3536s Added the ``source_ip`` and ``source_port`` arguments. 3536s 3536s .. versionchanged:: 5.0 3536s Added the ``timeout`` argument. 3536s """ 3536s if timeout is not None: 3536s if isinstance(timeout, numbers.Real): 3536s timeout = IOLoop.current().time() + timeout 3536s elif isinstance(timeout, datetime.timedelta): 3536s timeout = IOLoop.current().time() + timeout.total_seconds() 3536s else: 3536s raise TypeError("Unsupported timeout %r" % timeout) 3536s if timeout is not None: 3536s addrinfo = await gen.with_timeout( 3536s timeout, self.resolver.resolve(host, port, af) 3536s ) 3536s else: 3536s addrinfo = await self.resolver.resolve(host, port, af) 3536s connector = _Connector( 3536s addrinfo, 3536s functools.partial( 3536s self._create_stream, 3536s max_buffer_size, 3536s source_ip=source_ip, 3536s source_port=source_port, 3536s ), 3536s ) 3536s > af, addr, stream = await connector.start(connect_timeout=timeout) 3536s E asyncio.exceptions.CancelledError 3536s 3536s /usr/lib/python3/dist-packages/tornado/tcpclient.py:279: CancelledError 3536s 3536s The above exception was the direct cause of the following exception: 3536s 3536s self = 3536s 3536s @final 3536s async def start(self): 3536s async with self._startup_lock: 3536s if self.status == Status.failed: 3536s assert self.__startup_exc is not None 3536s raise self.__startup_exc 3536s elif self.status != Status.init: 3536s return self 3536s timeout = getattr(self, "death_timeout", None) 3536s 3536s async def _close_on_failure(exc: Exception) -> None: 3536s await self.close(reason=f"failure-to-start-{str(type(exc))}") 3536s self.status = Status.failed 3536s self.__startup_exc = exc 3536s 3536s try: 3536s > await wait_for(self.start_unsafe(), timeout=timeout) 3536s 3536s /usr/lib/python3/dist-packages/distributed/core.py:664: 3536s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3536s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 3536s async with asyncio.timeout(timeout): 3536s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3536s 3536s self = 3536s exc_type = 3536s exc_val = CancelledError(), exc_tb = 3536s 3536s async def __aexit__( 3536s self, 3536s exc_type: Optional[Type[BaseException]], 3536s exc_val: Optional[BaseException], 3536s exc_tb: Optional[TracebackType], 3536s ) -> Optional[bool]: 3536s assert self._state in (_State.ENTERED, _State.EXPIRING) 3536s 3536s if self._timeout_handler is not None: 3536s self._timeout_handler.cancel() 3536s self._timeout_handler = None 3536s 3536s if self._state is _State.EXPIRING: 3536s self._state = _State.EXPIRED 3536s 3536s if self._task.uncancel() <= self._cancelling and exc_type is not None: 3536s # Since there are no new cancel requests, we're 3536s # handling this. 3536s if issubclass(exc_type, exceptions.CancelledError): 3536s > raise TimeoutError from exc_val 3536s E TimeoutError 3536s 3536s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 3536s 3536s The above exception was the direct cause of the following exception: 3536s 3536s @contextlib.asynccontextmanager 3536s async def _cluster_factory(): 3536s workers = [] 3536s s = None 3536s try: 3536s for _ in range(60): 3536s try: 3536s > s, ws = await start_cluster( 3536s nthreads, 3536s scheduler, 3536s security=security, 3536s Worker=Worker, 3536s scheduler_kwargs=scheduler_kwargs, 3536s worker_kwargs=merge( 3536s {"death_timeout": min(15, int(deadline.remaining))}, 3536s worker_kwargs, 3536s ), 3536s ) 3536s 3536s /usr/lib/python3/dist-packages/distributed/utils_test.py:966: 3536s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3536s /usr/lib/python3/dist-packages/distributed/utils_test.py:789: in start_cluster 3536s await asyncio.gather(*workers) 3536s /usr/lib/python3.13/asyncio/tasks.py:737: in _wrap_awaitable 3536s return await awaitable 3536s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3536s 3536s self = 3536s 3536s @final 3536s async def start(self): 3536s async with self._startup_lock: 3536s if self.status == Status.failed: 3536s assert self.__startup_exc is not None 3536s raise self.__startup_exc 3536s elif self.status != Status.init: 3536s return self 3536s timeout = getattr(self, "death_timeout", None) 3536s 3536s async def _close_on_failure(exc: Exception) -> None: 3536s await self.close(reason=f"failure-to-start-{str(type(exc))}") 3536s self.status = Status.failed 3536s self.__startup_exc = exc 3536s 3536s try: 3536s await wait_for(self.start_unsafe(), timeout=timeout) 3536s except asyncio.TimeoutError as exc: 3536s await _close_on_failure(exc) 3536s > raise asyncio.TimeoutError( 3536s f"{type(self).__name__} start timed out after {timeout}s." 3536s ) from exc 3536s E TimeoutError: Worker start timed out after 0s. 3536s 3536s /usr/lib/python3/dist-packages/distributed/core.py:667: TimeoutError 3536s 3536s During handling of the above exception, another exception occurred: 3536s 3536s fut = ._..test_func..async_fn at 0xe247c028> 3536s timeout = 60 3536s 3536s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 3536s async with asyncio.timeout(timeout): 3536s > return await fut 3536s 3536s /usr/lib/python3/dist-packages/distributed/utils.py:1960: 3536s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3536s /usr/lib/python3/dist-packages/distributed/utils_test.py:999: in async_fn 3536s _cluster_factory() as (s, workers), 3536s /usr/lib/python3.13/contextlib.py:214: in __aenter__ 3536s return await anext(self.gen) 3536s /usr/lib/python3/dist-packages/distributed/utils_test.py:983: in _cluster_factory 3536s await asyncio.sleep(1) 3536s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3536s 3536s delay = 1, result = None 3536s 3536s async def sleep(delay, result=None): 3536s """Coroutine that completes after a given time (in seconds).""" 3536s if delay <= 0: 3536s await __sleep0() 3536s return result 3536s 3536s if math.isnan(delay): 3536s raise ValueError("Invalid delay: NaN (not a number)") 3536s 3536s loop = events.get_running_loop() 3536s future = loop.create_future() 3536s h = loop.call_later(delay, 3536s futures._set_result_unless_cancelled, 3536s future, result) 3536s try: 3536s > return await future 3536s E asyncio.exceptions.CancelledError 3536s 3536s /usr/lib/python3.13/asyncio/tasks.py:718: CancelledError 3536s 3536s The above exception was the direct cause of the following exception: 3536s 3536s args = (), kwds = {} 3536s 3536s @wraps(func) 3536s def inner(*args, **kwds): 3536s with self._recreate_cm(): 3536s > return func(*args, **kwds) 3536s 3536s /usr/lib/python3.13/contextlib.py:85: 3536s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3536s /usr/lib/python3.13/contextlib.py:85: in inner 3536s return func(*args, **kwds) 3536s /usr/lib/python3/dist-packages/distributed/utils_test.py:1102: in test_func 3536s return _run_and_close_tornado(async_fn_outer) 3536s /usr/lib/python3/dist-packages/distributed/utils_test.py:378: in _run_and_close_tornado 3536s return asyncio_run(inner_fn(), loop_factory=get_loop_factory()) 3536s /usr/lib/python3.13/asyncio/runners.py:194: in run 3536s return runner.run(main) 3536s /usr/lib/python3.13/asyncio/runners.py:118: in run 3536s return self._loop.run_until_complete(task) 3536s /usr/lib/python3.13/asyncio/base_events.py:720: in run_until_complete 3536s return future.result() 3536s /usr/lib/python3/dist-packages/distributed/utils_test.py:375: in inner_fn 3536s return await async_fn(*args, **kwargs) 3536s /usr/lib/python3/dist-packages/distributed/utils_test.py:1099: in async_fn_outer 3536s return await utils_wait_for(async_fn(), timeout=timeout * 2) 3536s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 3536s async with asyncio.timeout(timeout): 3536s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3536s 3536s self = 3536s exc_type = 3536s exc_val = CancelledError(), exc_tb = 3536s 3536s async def __aexit__( 3536s self, 3536s exc_type: Optional[Type[BaseException]], 3536s exc_val: Optional[BaseException], 3536s exc_tb: Optional[TracebackType], 3536s ) -> Optional[bool]: 3536s assert self._state in (_State.ENTERED, _State.EXPIRING) 3536s 3536s if self._timeout_handler is not None: 3536s self._timeout_handler.cancel() 3536s self._timeout_handler = None 3536s 3536s if self._state is _State.EXPIRING: 3536s self._state = _State.EXPIRED 3536s 3536s if self._task.uncancel() <= self._cancelling and exc_type is not None: 3536s # Since there are no new cancel requests, we're 3536s # handling this. 3536s if issubclass(exc_type, exceptions.CancelledError): 3536s > raise TimeoutError from exc_val 3536s E TimeoutError 3536s 3536s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 3536s ----------------------------- Captured stderr call ----------------------------- 3536s 2024-11-23 21:13:35,720 - distributed.scheduler - INFO - State start 3536s 2024-11-23 21:13:35,733 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:35,733 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43207/status 3536s 2024-11-23 21:13:35,734 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3536s 2024-11-23 21:13:35,782 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45743 3536s 2024-11-23 21:13:35,782 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45743 3536s 2024-11-23 21:13:35,782 - distributed.worker - INFO - Worker name: 0 3536s 2024-11-23 21:13:35,783 - distributed.worker - INFO - dashboard at: 127.0.0.1:36859 3536s 2024-11-23 21:13:35,783 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:35,783 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:13:35,783 - distributed.worker - INFO - Threads: 1 3536s 2024-11-23 21:13:35,783 - distributed.worker - INFO - Memory: 15.58 GiB 3536s 2024-11-23 21:13:35,783 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-evm5k70q 3536s 2024-11-23 21:13:35,783 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:13:35,787 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42443 3536s 2024-11-23 21:13:35,787 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42443 3536s 2024-11-23 21:13:35,787 - distributed.worker - INFO - Worker name: 1 3536s 2024-11-23 21:13:35,787 - distributed.worker - INFO - dashboard at: 127.0.0.1:35753 3536s 2024-11-23 21:13:35,787 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:35,788 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:13:35,788 - distributed.worker - INFO - Threads: 2 3536s 2024-11-23 21:13:35,788 - distributed.worker - INFO - Memory: 15.58 GiB 3536s 2024-11-23 21:13:35,788 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-bvf03gsp 3536s 2024-11-23 21:13:35,788 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:13:35,804 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:35,805 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:35,805 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:38672': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:35,806 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:38680': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:35,922 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:35,922 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:35,923 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:38694': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:35,923 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:38708': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:36,039 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:36,039 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:36,040 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:38722': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:36,040 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:38726': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:36,154 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:36,155 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:36,156 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:38738': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:36,156 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:38750': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:36,270 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:36,271 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:36,271 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:38752': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:36,272 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:38760': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:36,387 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:36,388 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:36,388 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:38776': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:36,389 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:38784': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:36,503 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:36,503 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:36,504 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:38788': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:36,504 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:38802': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:36,620 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:36,620 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:36,621 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:38814': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:36,621 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:38830': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:36,736 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:36,737 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:36,738 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:38838': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:36,738 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:38854': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:36,853 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:36,854 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:36,854 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:38858': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:36,854 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:38872': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:36,969 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:36,970 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:36,971 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:38884': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:36,971 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:38888': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:37,088 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:37,088 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:37,089 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:38894': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:37,089 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:38906': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:37,204 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:37,204 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:37,205 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:38912': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:37,205 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:38926': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:37,320 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:37,321 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:37,322 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:38940': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:37,322 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:38946': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:37,438 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:37,438 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:37,439 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:38956': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:37,439 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:38966': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:37,554 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:37,555 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:37,556 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:38972': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:37,556 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:38978': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:37,671 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:37,672 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:37,672 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:38986': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:37,673 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:39000': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:37,787 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:37,788 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:37,789 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:39008': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:37,789 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:39012': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:37,903 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:37,904 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:37,904 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:39026': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:37,905 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:39038': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:38,020 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:38,020 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:38,021 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:39040': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:38,021 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:39052': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:38,136 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:38,137 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:38,138 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:39058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:38,138 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:39074': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:38,255 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:38,255 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:38,256 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:39090': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:38,256 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:39100': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:38,372 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:38,372 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:38,373 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:39108': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:38,373 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:39114': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:38,488 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:38,489 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:38,490 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:39130': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:38,490 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:39132': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:38,605 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:38,606 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:38,607 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:39144': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:38,607 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:39158': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:38,723 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:38,724 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:38,724 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:39168': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:38,725 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:39172': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:38,841 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:38,842 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:38,842 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:39186': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:38,842 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:39188': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:38,957 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:38,958 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:38,958 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:39200': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:38,959 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:39208': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:39,073 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:39,074 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:39,075 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:39210': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:39,075 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:39214': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:39,190 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:39,190 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:39,191 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:39222': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:39,191 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:39238': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:39,306 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:39,306 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:39,307 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:39240': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:39,307 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:39244': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:39,423 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:39,423 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:39,424 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:39246': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:39,424 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:39248': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:39,539 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:39,540 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:39,540 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:39264': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:39,541 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:39270': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:39,655 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:39,656 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:39,657 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:39272': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:39,657 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:39276': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:39,771 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:39,771 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:39,772 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:39286': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:39,772 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:39288': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:39,887 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:39,888 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:39,888 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:39290': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:39,889 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:39302': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:40,003 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:40,004 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:40,004 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:39304': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:40,004 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:39308': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:40,119 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:40,120 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:40,120 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:39316': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:40,121 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:39330': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:40,236 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:40,236 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:40,237 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:39346': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:40,237 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:39350': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:40,351 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:40,352 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:40,352 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:39360': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:40,352 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:39376': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:40,467 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:40,468 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:40,468 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:39386': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:40,468 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:39390': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:40,586 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:40,587 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:40,588 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:39396': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:40,588 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:39404': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:40,703 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:40,703 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:40,704 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:39406': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:40,704 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:39420': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:40,818 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:40,819 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:40,820 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:39436': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:40,820 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:39438': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:40,935 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:40,935 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:40,936 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:39444': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:40,936 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:39454': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:41,051 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:41,052 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:41,052 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:39466': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:41,052 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:39468': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:41,168 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:41,168 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:41,169 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:39482': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:41,169 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:39498': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:41,283 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:41,285 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:41,285 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:39504': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:41,286 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:39518': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:41,395 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:41,397 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:39532': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:41,403 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:41,404 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:39546': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:41,505 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:41,506 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:39548': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:41,514 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:41,515 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:39564': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:41,615 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:41,616 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:48990': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:41,624 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:41,625 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:49002': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:41,725 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:41,726 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:49018': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:41,734 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:41,735 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:49030': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:41,834 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:41,835 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:49034': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:41,844 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:41,845 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:49044': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:41,944 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:41,945 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:49060': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:41,953 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:41,954 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:49062': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:42,054 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:42,055 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:49064': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:42,063 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:42,064 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:49066': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:42,163 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:42,164 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:49072': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:42,172 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:42,174 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:49086': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:42,273 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:42,274 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:49100': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:42,282 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:42,283 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:49104': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:42,385 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:42,387 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:49112': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:42,394 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:42,395 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:49124': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:42,495 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:42,496 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:49136': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:42,504 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:42,505 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:49142': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:42,605 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:42,606 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:49154': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:42,614 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:42,615 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:49170': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:42,715 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:42,716 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:49184': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:42,724 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:42,725 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:49190': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:42,825 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:42,826 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:49192': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:42,835 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:42,836 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:49202': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:42,935 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:42,936 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:49204': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:42,945 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:42,945 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:49210': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:43,045 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:43,046 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:49218': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:43,055 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:43,056 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:49230': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:43,156 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:43,157 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:49238': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:43,165 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:43,166 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:49240': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:43,267 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:43,268 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:49242': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:43,276 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:43,277 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:49248': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:43,376 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:43,377 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:49252': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:43,386 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:43,387 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:49266': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:43,486 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:43,487 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:49276': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:43,496 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:43,496 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:49292': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:43,597 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:43,598 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:49300': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:43,606 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:43,607 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:49310': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:43,707 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:43,708 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:49324': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:43,716 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:43,717 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:49330': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:43,817 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:43,818 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:49332': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:43,826 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:43,827 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:49334': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:43,926 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:43,927 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:49348': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:43,935 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:43,936 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:49360': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:44,036 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:44,038 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:49362': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:44,048 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:44,049 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:49378': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:44,146 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:44,147 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:49392': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:44,158 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:44,159 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:49400': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:44,255 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:44,256 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:49408': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:44,267 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:44,268 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:49420': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:44,365 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:44,366 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:49428': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:44,376 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:44,377 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:49434': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:44,474 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:44,475 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:49436': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:44,486 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:44,487 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:49438': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:44,584 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:44,585 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:49454': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:44,595 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:44,596 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:49464': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:44,694 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:44,695 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:49470': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:44,704 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:44,705 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:49484': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:44,804 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:44,805 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:49494': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:44,813 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:44,814 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:49508': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:44,915 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:44,916 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:49522': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:44,924 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:44,924 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:49524': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:45,024 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:45,025 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:49536': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:45,033 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:45,034 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:49538': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:45,134 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:45,134 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:49554': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:45,143 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:45,143 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:49568': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:45,249 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:45,251 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:49576': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:45,259 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:45,260 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:49580': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:45,359 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:45,360 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:49592': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:45,368 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:45,369 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:49608': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:45,469 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:45,470 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:49618': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:45,478 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:45,479 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:49634': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:45,578 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:45,579 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:49644': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:45,587 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:45,588 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:49656': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:45,687 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:45,688 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:49664': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:45,696 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:45,697 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:49678': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:45,797 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:45,797 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:49686': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:45,806 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:45,807 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:49696': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:45,906 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:45,907 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:49702': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:45,915 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:45,916 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:49706': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:46,016 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:46,017 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:49722': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:46,025 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:46,026 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:49728': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:46,125 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:46,126 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:49734': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:46,134 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:46,135 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:49748': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:46,234 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:46,235 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:49758': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:46,249 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:46,250 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:49766': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:46,343 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:46,344 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:49778': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:46,359 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:46,360 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:49788': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:46,453 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:46,454 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:49800': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:46,468 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:46,469 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:49812': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:46,562 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:46,563 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:49822': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:46,577 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:46,578 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:49834': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:46,673 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:46,674 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:49846': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:46,687 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:46,688 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:49850': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:46,783 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:46,784 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:49858': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:46,796 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:46,797 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:49860': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:46,893 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:46,894 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:49866': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:46,905 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:46,906 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:49878': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:47,003 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:47,004 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:49892': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:47,015 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:47,016 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:49896': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:47,113 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:47,114 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:49912': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:47,124 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:47,125 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:49928': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:47,223 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:47,224 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:49932': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:47,234 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:47,235 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:49944': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:47,332 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:47,333 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:49952': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:47,343 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:47,344 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:49954': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:47,442 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:47,446 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:49964': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:47,454 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:47,455 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:49970': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:47,555 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:47,555 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:49976': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:47,564 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:47,565 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:49986': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:47,664 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:47,665 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:50000': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:47,673 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:47,674 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:50002': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:47,774 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:47,775 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:50014': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:47,783 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:47,784 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:50024': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:47,884 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:47,885 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:50036': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:47,893 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:47,894 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:50040': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:47,994 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:47,995 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:50044': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:48,003 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:48,004 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:50060': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:48,103 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:48,104 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:50068': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:48,113 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:48,114 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:50070': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:48,213 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:48,214 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:50072': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:48,222 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:48,223 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:50088': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:48,323 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:48,324 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:50102': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:48,332 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:48,333 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:50106': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:48,433 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:48,434 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:50108': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:48,442 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:48,443 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:50120': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:48,543 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:48,544 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:50122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:48,552 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:48,553 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:50126': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:48,653 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:48,654 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:50134': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:48,662 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:48,663 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:50138': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:48,764 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:48,765 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:50144': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:48,773 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:48,774 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:50148': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:48,873 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:48,874 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:50160': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:48,883 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:48,883 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:50176': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:48,983 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:48,984 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:50188': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:48,992 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:48,993 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:50200': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:49,093 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:49,094 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:50210': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:49,102 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:49,105 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:50226': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:49,204 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:49,205 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:50234': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:49,213 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:49,214 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:50236': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:49,314 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:49,315 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:50248': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:49,323 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:49,324 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:50258': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:49,424 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:49,425 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:50270': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:49,433 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:49,434 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:50280': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:49,533 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:49,534 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:50284': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:49,543 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:49,544 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:50290': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:49,643 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:49,644 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:50306': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:49,652 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:49,653 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:50308': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:49,753 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:49,754 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:50320': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:49,762 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:49,763 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:50324': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:49,862 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:49,863 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:50338': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:49,872 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:49,873 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:50344': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:49,972 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:49,973 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:50352': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:49,981 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:49,982 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:50360': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:50,082 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:50,083 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:50368': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:50,091 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:50,092 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:50384': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:50,192 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:50,193 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:50398': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:50,202 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:50,202 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:50412': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:50,302 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:50,303 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:50424': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:50,311 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:50,312 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:50426': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:50,411 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:50,412 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:50442': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:50,421 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:50,422 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:50458': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:50,522 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:50,523 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:50470': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:50,531 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:50,532 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:50480': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:50,631 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:50,632 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:50484': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:50,641 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:50,642 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:50492': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:50,744 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:50,745 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:50508': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:50,751 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42787 3536s 2024-11-23 21:13:50,752 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42787': TLS handshake failed with remote 'tls://127.0.0.1:50520': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:50,780 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45743. Reason: failure-to-start- 3536s 2024-11-23 21:13:50,781 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3536s 2024-11-23 21:13:50,783 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 15s.; retrying 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3536s stream = await self.client.connect( 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 3536s stream = await stream.start_tls( 3536s ^^^^^^^^^^^^^^^^^^^^^^^ 3536s False, ssl_options=ssl_options, server_hostname=host 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 3536s self.socket.do_handshake() 3536s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 3536s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 3536s self._sslobj.do_handshake() 3536s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 3536s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 3536s 3536s The above exception was the direct cause of the following exception: 3536s 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3536s comm = await connect(self.scheduler.address, **self.connection_args) 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3536s comm = await wait_for( 3536s ^^^^^^^^^^^^^^^ 3536s ...<2 lines>... 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3536s return await fut 3536s ^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 3536s raise FatalCommClosedError( 3536s ...<2 lines>... 3536s ) from err 3536s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 3536s 3536s During handling of the above exception, another exception occurred: 3536s 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3536s return await fut 3536s ^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3536s await self._register_with_scheduler() 3536s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1218, in _register_with_scheduler 3536s await asyncio.sleep(0.1) 3536s File "/usr/lib/python3.13/asyncio/tasks.py", line 718, in sleep 3536s return await future 3536s ^^^^^^^^^^^^ 3536s asyncio.exceptions.CancelledError 3536s 3536s The above exception was the direct cause of the following exception: 3536s 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3536s await wait_for(self.start_unsafe(), timeout=timeout) 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3536s async with asyncio.timeout(timeout): 3536s ~~~~~~~~~~~~~~~^^^^^^^^^ 3536s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3536s raise TimeoutError from exc_val 3536s TimeoutError 3536s 3536s The above exception was the direct cause of the following exception: 3536s 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3536s s, ws = await start_cluster( 3536s ^^^^^^^^^^^^^^^^^^^^ 3536s ...<9 lines>... 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3536s await asyncio.gather(*workers) 3536s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3536s return await awaitable 3536s ^^^^^^^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3536s raise asyncio.TimeoutError( 3536s f"{type(self).__name__} start timed out after {timeout}s." 3536s ) from exc 3536s TimeoutError: Worker start timed out after 15s. 3536s 2024-11-23 21:13:50,789 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42443. Reason: failure-to-start- 3536s 2024-11-23 21:13:50,789 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3536s 2024-11-23 21:13:51,793 - distributed.scheduler - INFO - State start 3536s 2024-11-23 21:13:51,804 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41507 3536s 2024-11-23 21:13:51,805 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39039/status 3536s 2024-11-23 21:13:51,805 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3536s 2024-11-23 21:13:51,829 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46113 3536s 2024-11-23 21:13:51,829 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46113 3536s 2024-11-23 21:13:51,830 - distributed.worker - INFO - Worker name: 0 3536s 2024-11-23 21:13:51,830 - distributed.worker - INFO - dashboard at: 127.0.0.1:41995 3536s 2024-11-23 21:13:51,830 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:13:51,830 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:13:51,830 - distributed.worker - INFO - Threads: 1 3536s 2024-11-23 21:13:51,830 - distributed.worker - INFO - Memory: 15.58 GiB 3536s 2024-11-23 21:13:51,830 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-fqrzi9k5 3536s 2024-11-23 21:13:51,830 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:13:51,834 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36647 3536s 2024-11-23 21:13:51,834 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36647 3536s 2024-11-23 21:13:51,834 - distributed.worker - INFO - Worker name: 1 3536s 2024-11-23 21:13:51,834 - distributed.worker - INFO - dashboard at: 127.0.0.1:37569 3536s 2024-11-23 21:13:51,834 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:13:51,835 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:13:51,835 - distributed.worker - INFO - Threads: 2 3536s 2024-11-23 21:13:51,835 - distributed.worker - INFO - Memory: 15.58 GiB 3536s 2024-11-23 21:13:51,835 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-cj6g84kb 3536s 2024-11-23 21:13:51,835 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:13:51,851 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:13:51,851 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:13:51,852 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:54172': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:51,852 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:54182': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:51,967 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:13:51,968 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:13:51,968 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:54192': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:51,968 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:54198': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:52,083 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:13:52,084 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:13:52,084 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:54212': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:52,085 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:54218': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:52,199 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:13:52,200 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:13:52,201 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:54232': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:52,201 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:54236': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:52,322 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:13:52,322 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:13:52,323 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:54250': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:52,323 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:54258': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:52,438 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:13:52,439 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:13:52,439 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:54262': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:52,440 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:54270': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:52,553 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:13:52,554 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:13:52,555 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:54276': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:52,555 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:54278': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:52,669 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:13:52,669 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:13:52,670 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:54288': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:52,670 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:54302': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:52,784 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:13:52,785 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:13:52,785 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:54318': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:52,785 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:54326': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:52,900 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:13:52,900 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:13:52,901 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:54328': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:52,901 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:54342': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:53,015 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:13:53,016 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:13:53,016 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:54344': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:53,017 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:54346': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:53,131 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:13:53,132 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:13:53,132 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:54350': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:53,132 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:54358': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:53,252 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:13:53,253 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:13:53,253 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:54370': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:53,253 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:54386': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:53,368 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:13:53,369 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:13:53,370 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:54398': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:53,370 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:54400': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:53,484 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:13:53,485 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:13:53,486 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:54404': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:53,486 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:54420': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:53,600 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:13:53,601 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:13:53,602 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:54422': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:53,602 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:54434': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:53,716 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:13:53,719 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:13:53,719 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:54450': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:53,719 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:54462': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:53,828 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:13:53,829 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:54468': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:53,835 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:13:53,836 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:54480': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:53,937 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:13:53,937 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:54494': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:53,945 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:13:53,946 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:54508': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:54,046 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:13:54,047 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:54514': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:54,055 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:13:54,056 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:54524': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:54,155 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:13:54,156 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:54536': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:54,164 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:13:54,165 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:54550': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:54,264 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:13:54,265 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:54560': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:54,273 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:13:54,274 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:54566': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:54,374 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:13:54,374 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:54576': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:54,382 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:13:54,383 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:54586': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:54,482 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:13:54,483 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:54592': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:54,491 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:13:54,492 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:54602': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:54,592 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:13:54,593 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:54610': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:54,601 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:13:54,602 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:54626': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:54,703 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:13:54,704 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:54632': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:54,712 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:13:54,713 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:54636': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:54,817 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:13:54,818 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:54646': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:54,826 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:13:54,827 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:54658': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:54,926 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:13:54,927 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:54666': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:54,936 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:13:54,937 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:54670': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:55,037 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:13:55,038 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:54674': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:55,046 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:13:55,047 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:54680': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:55,146 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:13:55,147 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:54688': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:55,156 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:13:55,157 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:54696': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:55,256 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:13:55,257 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:54704': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:55,266 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:13:55,267 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:54706': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:55,366 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:13:55,367 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:54710': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:55,376 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:13:55,376 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:54716': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:55,477 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:13:55,478 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:54726': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:55,486 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:13:55,487 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:54738': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:55,587 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:13:55,588 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:54750': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:55,596 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:13:55,597 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:54752': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:55,696 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:13:55,697 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:54762': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:55,705 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:13:55,706 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:54764': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:55,807 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:13:55,808 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:54778': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:55,821 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:13:55,822 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:54788': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:55,916 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:13:55,916 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:54804': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:55,930 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:13:55,931 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:54816': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:56,025 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:13:56,026 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:54828': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:56,040 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:13:56,041 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:54834': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:56,135 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:13:56,136 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:54846': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:56,149 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:13:56,150 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:54862': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:56,247 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:13:56,248 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:54876': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:56,258 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:13:56,259 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:54884': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:56,357 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:13:56,358 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:54898': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:56,368 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:13:56,369 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:54906': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:56,467 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:13:56,467 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:54916': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:56,477 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:13:56,478 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:54922': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:56,576 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:13:56,577 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:54926': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:56,586 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:13:56,586 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:54938': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:56,686 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:13:56,687 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:54946': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:56,695 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:13:56,696 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:54956': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:56,796 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:13:56,797 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:54972': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:56,805 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:13:56,806 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:54988': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:56,905 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:13:56,906 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:54994': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:56,914 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:13:56,915 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:54996': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:57,015 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:13:57,015 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:55004': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:57,023 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:13:57,024 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:55014': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:57,125 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:13:57,126 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:55016': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:57,134 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:13:57,135 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:55020': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:57,236 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:13:57,241 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:55024': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:57,250 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:13:57,251 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:55032': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:57,346 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:13:57,347 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:55048': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:57,359 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:13:57,360 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:55056': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:57,457 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:13:57,458 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:55072': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:57,469 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:13:57,470 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:55086': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:57,567 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:13:57,568 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:55094': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:57,578 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:13:57,579 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:55096': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:57,676 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:13:57,677 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:55108': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:57,688 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:13:57,689 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:55118': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:57,786 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:13:57,787 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:55120': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:57,796 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:13:57,797 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:55122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:57,897 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:13:57,898 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:55134': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:57,906 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:13:57,907 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:55148': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:58,008 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:13:58,009 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:55156': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:58,017 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:13:58,018 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:55160': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:58,117 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:13:58,118 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:55166': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:58,126 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:13:58,127 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:55168': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:58,226 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:13:58,227 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:55180': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:58,236 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:13:58,242 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:55188': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:58,336 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:13:58,337 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:55194': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:58,345 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:13:58,346 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:55198': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:58,446 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:13:58,447 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:55210': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:58,455 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:13:58,455 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:55226': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:58,555 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:13:58,556 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:55228': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:58,564 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:13:58,565 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:55238': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:58,665 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:13:58,666 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:55244': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:58,674 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:13:58,675 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:55254': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:58,774 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:13:58,775 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:55264': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:58,783 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:13:58,784 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:55280': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:58,884 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:13:58,885 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:55296': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:58,893 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:13:58,894 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:55304': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:58,995 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:13:58,996 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:55312': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:59,004 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:13:59,005 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:55322': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:59,104 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:13:59,105 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:55336': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:59,116 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:13:59,117 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:55348': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:59,214 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:13:59,215 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:55358': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:59,225 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:13:59,226 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:55370': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:59,323 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:13:59,324 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:55386': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:59,336 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:13:59,337 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:55392': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:59,434 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:13:59,436 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:55408': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:59,445 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:13:59,446 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:55416': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:59,544 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:13:59,545 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:55420': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:59,554 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:13:59,555 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:55432': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:59,653 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:13:59,654 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:55446': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:59,664 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:13:59,665 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:55454': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:59,763 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:13:59,764 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:55462': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:59,773 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:13:59,774 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:55478': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:59,873 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:13:59,874 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:55488': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:59,882 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:13:59,883 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:55494': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:59,983 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:13:59,984 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:55496': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:13:59,993 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:13:59,994 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:55498': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:00,093 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:14:00,093 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:55504': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:00,102 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:14:00,103 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:55510': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:00,203 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:14:00,204 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:55520': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:00,213 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:14:00,214 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:55526': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:00,318 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:14:00,319 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:55542': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:00,327 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:14:00,327 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:55554': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:00,427 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:14:00,428 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:55566': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:00,436 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:14:00,437 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:55582': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:00,537 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:14:00,538 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:55592': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:00,546 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:14:00,546 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:55608': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:00,646 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:14:00,647 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:55620': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:00,656 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:14:00,656 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:55624': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:00,757 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:14:00,758 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:55626': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:00,766 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:14:00,767 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:55634': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:00,867 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:14:00,868 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:55640': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:00,876 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:14:00,877 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:55650': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:00,977 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:14:00,978 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:55654': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:00,986 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:14:00,987 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:55664': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:01,087 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:14:01,088 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:55676': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:01,096 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:14:01,097 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:55680': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:01,197 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:14:01,198 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:55696': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:01,206 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:14:01,207 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:55700': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:01,307 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:14:01,308 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:55702': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:01,322 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:14:01,323 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:55706': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:01,417 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:14:01,418 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:55722': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:01,432 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:14:01,433 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:55732': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:01,527 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:14:01,528 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:55746': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:01,541 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:14:01,542 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:35482': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:01,637 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:14:01,638 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:35490': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:01,651 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:14:01,652 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:35494': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:01,748 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:14:01,749 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:35502': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:01,760 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:14:01,761 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:35510': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:01,857 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:14:01,858 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:35512': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:01,870 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:14:01,871 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:35524': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:01,966 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:14:01,967 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:35530': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:01,979 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:14:01,980 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:35538': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:02,076 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:14:02,077 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:35552': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:02,088 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:14:02,088 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:35560': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:02,186 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:14:02,187 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:35574': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:02,197 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:14:02,198 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:35582': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:02,296 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:14:02,297 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:35594': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:02,307 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:14:02,308 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:35596': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:02,406 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:14:02,407 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:35606': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:02,416 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:14:02,417 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:35622': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:02,518 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:14:02,519 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:35636': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:02,527 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:14:02,528 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:35650': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:02,627 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:14:02,628 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:35664': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:02,636 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:14:02,637 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:35676': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:02,738 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:14:02,743 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:35684': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:02,752 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:14:02,753 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:35692': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:02,847 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:14:02,848 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:35700': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:02,862 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:14:02,862 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:35704': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:02,957 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:14:02,958 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:35718': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:02,971 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:14:02,972 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:35720': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:03,067 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:14:03,068 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:35730': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:03,080 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:14:03,081 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:35732': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:03,176 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:14:03,177 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:35744': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:03,190 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:14:03,191 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:35746': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:03,287 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:14:03,288 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:35754': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:03,299 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:14:03,300 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:35766': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:03,397 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:14:03,398 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:35776': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:03,409 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:14:03,410 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:35778': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:03,508 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:14:03,509 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:35786': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:03,517 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:14:03,518 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:35790': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:03,618 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:14:03,618 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:35802': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:03,627 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:14:03,627 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:35818': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:03,728 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:14:03,729 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:35830': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:03,737 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:14:03,744 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:35838': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:03,839 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:14:03,840 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:35846': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:03,848 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:14:03,849 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:35854': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:03,948 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:14:03,949 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:35864': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:03,958 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:14:03,958 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:35868': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:04,058 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:14:04,059 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:35876': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:04,067 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:14:04,068 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:35888': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:04,167 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:14:04,168 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:35900': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:04,179 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:14:04,180 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:35904': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:04,278 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:14:04,279 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:35910': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:04,288 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:14:04,289 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:35922': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:04,387 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:14:04,388 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:35930': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:04,398 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:14:04,399 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:35946': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:04,497 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:14:04,498 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:35948': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:04,508 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:14:04,509 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:35962': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:04,607 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:14:04,608 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:35972': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:04,618 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:14:04,619 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:35982': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:04,717 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:14:04,718 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:35996': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:04,728 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:14:04,728 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:36006': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:04,827 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 3536s 2024-11-23 21:14:04,828 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:36016': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:04,828 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46113. Reason: failure-to-start- 3536s 2024-11-23 21:14:04,828 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3536s 2024-11-23 21:14:04,833 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36647. Reason: failure-to-start- 3536s 2024-11-23 21:14:04,833 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3536s 2024-11-23 21:14:04,839 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 13s.; retrying 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3536s stream = await self.client.connect( 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 3536s stream = await stream.start_tls( 3536s ^^^^^^^^^^^^^^^^^^^^^^^ 3536s False, ssl_options=ssl_options, server_hostname=host 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 3536s self.socket.do_handshake() 3536s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 3536s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 3536s self._sslobj.do_handshake() 3536s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 3536s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 3536s 3536s The above exception was the direct cause of the following exception: 3536s 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3536s comm = await connect(self.scheduler.address, **self.connection_args) 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3536s comm = await wait_for( 3536s ^^^^^^^^^^^^^^^ 3536s ...<2 lines>... 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3536s return await fut 3536s ^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 3536s raise FatalCommClosedError( 3536s ...<2 lines>... 3536s ) from err 3536s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 3536s 3536s During handling of the above exception, another exception occurred: 3536s 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3536s return await fut 3536s ^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3536s await self._register_with_scheduler() 3536s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1218, in _register_with_scheduler 3536s await asyncio.sleep(0.1) 3536s File "/usr/lib/python3.13/asyncio/tasks.py", line 718, in sleep 3536s return await future 3536s ^^^^^^^^^^^^ 3536s asyncio.exceptions.CancelledError 3536s 3536s The above exception was the direct cause of the following exception: 3536s 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3536s await wait_for(self.start_unsafe(), timeout=timeout) 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3536s async with asyncio.timeout(timeout): 3536s ~~~~~~~~~~~~~~~^^^^^^^^^ 3536s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3536s raise TimeoutError from exc_val 3536s TimeoutError 3536s 3536s The above exception was the direct cause of the following exception: 3536s 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3536s s, ws = await start_cluster( 3536s ^^^^^^^^^^^^^^^^^^^^ 3536s ...<9 lines>... 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3536s await asyncio.gather(*workers) 3536s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3536s return await awaitable 3536s ^^^^^^^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3536s raise asyncio.TimeoutError( 3536s f"{type(self).__name__} start timed out after {timeout}s." 3536s ) from exc 3536s TimeoutError: Worker start timed out after 13s. 3536s 2024-11-23 21:14:04,850 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:36018': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:05,849 - distributed.scheduler - INFO - State start 3536s 2024-11-23 21:14:05,862 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37331 3536s 2024-11-23 21:14:05,862 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45205/status 3536s 2024-11-23 21:14:05,863 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3536s 2024-11-23 21:14:05,887 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42985 3536s 2024-11-23 21:14:05,887 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42985 3536s 2024-11-23 21:14:05,888 - distributed.worker - INFO - Worker name: 0 3536s 2024-11-23 21:14:05,888 - distributed.worker - INFO - dashboard at: 127.0.0.1:35841 3536s 2024-11-23 21:14:05,888 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37331 3536s 2024-11-23 21:14:05,888 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:14:05,888 - distributed.worker - INFO - Threads: 1 3536s 2024-11-23 21:14:05,888 - distributed.worker - INFO - Memory: 15.58 GiB 3536s 2024-11-23 21:14:05,888 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-c9zky0h7 3536s 2024-11-23 21:14:05,888 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:14:05,894 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41805 3536s 2024-11-23 21:14:05,895 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41805 3536s 2024-11-23 21:14:05,895 - distributed.worker - INFO - Worker name: 1 3536s 2024-11-23 21:14:05,895 - distributed.worker - INFO - dashboard at: 127.0.0.1:38743 3536s 2024-11-23 21:14:05,895 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37331 3536s 2024-11-23 21:14:05,895 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:14:05,895 - distributed.worker - INFO - Threads: 2 3536s 2024-11-23 21:14:05,895 - distributed.worker - INFO - Memory: 15.58 GiB 3536s 2024-11-23 21:14:05,895 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-hcg_0caj 3536s 2024-11-23 21:14:05,896 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:14:05,897 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42985. Reason: failure-to-start- 3536s 2024-11-23 21:14:05,898 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3536s 2024-11-23 21:14:05,898 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41805. Reason: failure-to-start- 3536s 2024-11-23 21:14:05,899 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3536s 2024-11-23 21:14:05,901 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37331': TLS handshake failed with remote 'tls://127.0.0.1:44632': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3536s 2024-11-23 21:14:05,901 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37331': TLS handshake failed with remote 'tls://127.0.0.1:44642': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3536s 2024-11-23 21:14:05,904 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3536s return await fut 3536s ^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3536s await self._register_with_scheduler() 3536s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3536s comm = await connect(self.scheduler.address, **self.connection_args) 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3536s comm = await wait_for( 3536s ^^^^^^^^^^^^^^^ 3536s ...<2 lines>... 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3536s return await fut 3536s ^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3536s stream = await self.client.connect( 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3536s af, addr, stream = await connector.start(connect_timeout=timeout) 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s asyncio.exceptions.CancelledError 3536s 3536s The above exception was the direct cause of the following exception: 3536s 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3536s await wait_for(self.start_unsafe(), timeout=timeout) 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3536s async with asyncio.timeout(timeout): 3536s ~~~~~~~~~~~~~~~^^^^^^^^^ 3536s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3536s raise TimeoutError from exc_val 3536s TimeoutError 3536s 3536s The above exception was the direct cause of the following exception: 3536s 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3536s s, ws = await start_cluster( 3536s ^^^^^^^^^^^^^^^^^^^^ 3536s ...<9 lines>... 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3536s await asyncio.gather(*workers) 3536s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3536s return await awaitable 3536s ^^^^^^^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3536s raise asyncio.TimeoutError( 3536s f"{type(self).__name__} start timed out after {timeout}s." 3536s ) from exc 3536s TimeoutError: Worker start timed out after 0s. 3536s 2024-11-23 21:14:06,913 - distributed.scheduler - INFO - State start 3536s 2024-11-23 21:14:06,926 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45135 3536s 2024-11-23 21:14:06,927 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36259/status 3536s 2024-11-23 21:14:06,927 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3536s 2024-11-23 21:14:06,952 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37425 3536s 2024-11-23 21:14:06,953 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37425 3536s 2024-11-23 21:14:06,953 - distributed.worker - INFO - Worker name: 0 3536s 2024-11-23 21:14:06,953 - distributed.worker - INFO - dashboard at: 127.0.0.1:43965 3536s 2024-11-23 21:14:06,953 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45135 3536s 2024-11-23 21:14:06,953 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:14:06,953 - distributed.worker - INFO - Threads: 1 3536s 2024-11-23 21:14:06,953 - distributed.worker - INFO - Memory: 15.58 GiB 3536s 2024-11-23 21:14:06,954 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-lyry2psm 3536s 2024-11-23 21:14:06,954 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:14:06,957 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40265 3536s 2024-11-23 21:14:06,957 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40265 3536s 2024-11-23 21:14:06,958 - distributed.worker - INFO - Worker name: 1 3536s 2024-11-23 21:14:06,958 - distributed.worker - INFO - dashboard at: 127.0.0.1:41993 3536s 2024-11-23 21:14:06,958 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45135 3536s 2024-11-23 21:14:06,958 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:14:06,958 - distributed.worker - INFO - Threads: 2 3536s 2024-11-23 21:14:06,958 - distributed.worker - INFO - Memory: 15.58 GiB 3536s 2024-11-23 21:14:06,958 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ap_0ntx3 3536s 2024-11-23 21:14:06,958 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:14:06,960 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37425. Reason: failure-to-start- 3536s 2024-11-23 21:14:06,961 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3536s 2024-11-23 21:14:06,961 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40265. Reason: failure-to-start- 3536s 2024-11-23 21:14:06,962 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3536s 2024-11-23 21:14:06,964 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45135': TLS handshake failed with remote 'tls://127.0.0.1:45942': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3536s 2024-11-23 21:14:06,964 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45135': TLS handshake failed with remote 'tls://127.0.0.1:45946': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3536s 2024-11-23 21:14:06,966 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3536s return await fut 3536s ^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3536s await self._register_with_scheduler() 3536s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3536s comm = await connect(self.scheduler.address, **self.connection_args) 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3536s comm = await wait_for( 3536s ^^^^^^^^^^^^^^^ 3536s ...<2 lines>... 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3536s return await fut 3536s ^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3536s stream = await self.client.connect( 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3536s af, addr, stream = await connector.start(connect_timeout=timeout) 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s asyncio.exceptions.CancelledError 3536s 3536s The above exception was the direct cause of the following exception: 3536s 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3536s await wait_for(self.start_unsafe(), timeout=timeout) 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3536s async with asyncio.timeout(timeout): 3536s ~~~~~~~~~~~~~~~^^^^^^^^^ 3536s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3536s raise TimeoutError from exc_val 3536s TimeoutError 3536s 3536s The above exception was the direct cause of the following exception: 3536s 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3536s s, ws = await start_cluster( 3536s ^^^^^^^^^^^^^^^^^^^^ 3536s ...<9 lines>... 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3536s await asyncio.gather(*workers) 3536s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3536s return await awaitable 3536s ^^^^^^^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3536s raise asyncio.TimeoutError( 3536s f"{type(self).__name__} start timed out after {timeout}s." 3536s ) from exc 3536s TimeoutError: Worker start timed out after 0s. 3536s 2024-11-23 21:14:07,972 - distributed.scheduler - INFO - State start 3536s 2024-11-23 21:14:07,983 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42275 3536s 2024-11-23 21:14:07,984 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39689/status 3536s 2024-11-23 21:14:07,984 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3536s 2024-11-23 21:14:08,000 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41505 3536s 2024-11-23 21:14:08,001 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41505 3536s 2024-11-23 21:14:08,001 - distributed.worker - INFO - Worker name: 0 3536s 2024-11-23 21:14:08,001 - distributed.worker - INFO - dashboard at: 127.0.0.1:37091 3536s 2024-11-23 21:14:08,002 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42275 3536s 2024-11-23 21:14:08,002 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:14:08,002 - distributed.worker - INFO - Threads: 1 3536s 2024-11-23 21:14:08,002 - distributed.worker - INFO - Memory: 15.58 GiB 3536s 2024-11-23 21:14:08,002 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-hgi4fwh3 3536s 2024-11-23 21:14:08,002 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:14:08,006 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45793 3536s 2024-11-23 21:14:08,007 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45793 3536s 2024-11-23 21:14:08,007 - distributed.worker - INFO - Worker name: 1 3536s 2024-11-23 21:14:08,007 - distributed.worker - INFO - dashboard at: 127.0.0.1:38319 3536s 2024-11-23 21:14:08,007 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42275 3536s 2024-11-23 21:14:08,007 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:14:08,007 - distributed.worker - INFO - Threads: 2 3536s 2024-11-23 21:14:08,007 - distributed.worker - INFO - Memory: 15.58 GiB 3536s 2024-11-23 21:14:08,007 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-baev7d84 3536s 2024-11-23 21:14:08,007 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:14:08,009 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41505. Reason: failure-to-start- 3536s 2024-11-23 21:14:08,009 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3536s 2024-11-23 21:14:08,010 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45793. Reason: failure-to-start- 3536s 2024-11-23 21:14:08,011 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3536s 2024-11-23 21:14:08,013 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42275': TLS handshake failed with remote 'tls://127.0.0.1:41968': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3536s 2024-11-23 21:14:08,014 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42275': TLS handshake failed with remote 'tls://127.0.0.1:41984': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3536s 2024-11-23 21:14:08,016 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3536s return await fut 3536s ^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3536s await self._register_with_scheduler() 3536s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3536s comm = await connect(self.scheduler.address, **self.connection_args) 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3536s comm = await wait_for( 3536s ^^^^^^^^^^^^^^^ 3536s ...<2 lines>... 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3536s return await fut 3536s ^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3536s stream = await self.client.connect( 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3536s af, addr, stream = await connector.start(connect_timeout=timeout) 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s asyncio.exceptions.CancelledError 3536s 3536s The above exception was the direct cause of the following exception: 3536s 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3536s await wait_for(self.start_unsafe(), timeout=timeout) 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3536s async with asyncio.timeout(timeout): 3536s ~~~~~~~~~~~~~~~^^^^^^^^^ 3536s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3536s raise TimeoutError from exc_val 3536s TimeoutError 3536s 3536s The above exception was the direct cause of the following exception: 3536s 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3536s s, ws = await start_cluster( 3536s ^^^^^^^^^^^^^^^^^^^^ 3536s ...<9 lines>... 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3536s await asyncio.gather(*workers) 3536s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3536s return await awaitable 3536s ^^^^^^^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3536s raise asyncio.TimeoutError( 3536s f"{type(self).__name__} start timed out after {timeout}s." 3536s ) from exc 3536s TimeoutError: Worker start timed out after 0s. 3536s 2024-11-23 21:14:09,025 - distributed.scheduler - INFO - State start 3536s 2024-11-23 21:14:09,036 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41137 3536s 2024-11-23 21:14:09,036 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46713/status 3536s 2024-11-23 21:14:09,037 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3536s 2024-11-23 21:14:09,061 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40207 3536s 2024-11-23 21:14:09,061 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40207 3536s 2024-11-23 21:14:09,061 - distributed.worker - INFO - Worker name: 0 3536s 2024-11-23 21:14:09,061 - distributed.worker - INFO - dashboard at: 127.0.0.1:37843 3536s 2024-11-23 21:14:09,061 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41137 3536s 2024-11-23 21:14:09,061 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:14:09,061 - distributed.worker - INFO - Threads: 1 3536s 2024-11-23 21:14:09,061 - distributed.worker - INFO - Memory: 15.58 GiB 3536s 2024-11-23 21:14:09,062 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-gvbwxx6c 3536s 2024-11-23 21:14:09,062 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:14:09,065 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45929 3536s 2024-11-23 21:14:09,065 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45929 3536s 2024-11-23 21:14:09,065 - distributed.worker - INFO - Worker name: 1 3536s 2024-11-23 21:14:09,066 - distributed.worker - INFO - dashboard at: 127.0.0.1:39755 3536s 2024-11-23 21:14:09,066 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41137 3536s 2024-11-23 21:14:09,066 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:14:09,066 - distributed.worker - INFO - Threads: 2 3536s 2024-11-23 21:14:09,066 - distributed.worker - INFO - Memory: 15.58 GiB 3536s 2024-11-23 21:14:09,066 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-mywkd44p 3536s 2024-11-23 21:14:09,066 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:14:09,068 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40207. Reason: failure-to-start- 3536s 2024-11-23 21:14:09,068 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3536s 2024-11-23 21:14:09,069 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45929. Reason: failure-to-start- 3536s 2024-11-23 21:14:09,070 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3536s 2024-11-23 21:14:09,072 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41137': TLS handshake failed with remote 'tls://127.0.0.1:49606': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3536s 2024-11-23 21:14:09,072 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41137': TLS handshake failed with remote 'tls://127.0.0.1:49610': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3536s 2024-11-23 21:14:09,074 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3536s return await fut 3536s ^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3536s await self._register_with_scheduler() 3536s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3536s comm = await connect(self.scheduler.address, **self.connection_args) 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3536s comm = await wait_for( 3536s ^^^^^^^^^^^^^^^ 3536s ...<2 lines>... 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3536s return await fut 3536s ^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3536s stream = await self.client.connect( 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3536s af, addr, stream = await connector.start(connect_timeout=timeout) 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s asyncio.exceptions.CancelledError 3536s 3536s The above exception was the direct cause of the following exception: 3536s 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3536s await wait_for(self.start_unsafe(), timeout=timeout) 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3536s async with asyncio.timeout(timeout): 3536s ~~~~~~~~~~~~~~~^^^^^^^^^ 3536s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3536s raise TimeoutError from exc_val 3536s TimeoutError 3536s 3536s The above exception was the direct cause of the following exception: 3536s 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3536s s, ws = await start_cluster( 3536s ^^^^^^^^^^^^^^^^^^^^ 3536s ...<9 lines>... 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3536s await asyncio.gather(*workers) 3536s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3536s return await awaitable 3536s ^^^^^^^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3536s raise asyncio.TimeoutError( 3536s f"{type(self).__name__} start timed out after {timeout}s." 3536s ) from exc 3536s TimeoutError: Worker start timed out after 0s. 3536s 2024-11-23 21:14:10,083 - distributed.scheduler - INFO - State start 3536s 2024-11-23 21:14:10,094 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45593 3536s 2024-11-23 21:14:10,094 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39565/status 3536s 2024-11-23 21:14:10,095 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3536s 2024-11-23 21:14:10,117 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34757 3536s 2024-11-23 21:14:10,118 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34757 3536s 2024-11-23 21:14:10,118 - distributed.worker - INFO - Worker name: 0 3536s 2024-11-23 21:14:10,118 - distributed.worker - INFO - dashboard at: 127.0.0.1:44761 3536s 2024-11-23 21:14:10,118 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45593 3536s 2024-11-23 21:14:10,118 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:14:10,118 - distributed.worker - INFO - Threads: 1 3536s 2024-11-23 21:14:10,118 - distributed.worker - INFO - Memory: 15.58 GiB 3536s 2024-11-23 21:14:10,118 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-c87it_c5 3536s 2024-11-23 21:14:10,118 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:14:10,122 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43211 3536s 2024-11-23 21:14:10,122 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43211 3536s 2024-11-23 21:14:10,123 - distributed.worker - INFO - Worker name: 1 3536s 2024-11-23 21:14:10,123 - distributed.worker - INFO - dashboard at: 127.0.0.1:36665 3536s 2024-11-23 21:14:10,123 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45593 3536s 2024-11-23 21:14:10,123 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:14:10,123 - distributed.worker - INFO - Threads: 2 3536s 2024-11-23 21:14:10,123 - distributed.worker - INFO - Memory: 15.58 GiB 3536s 2024-11-23 21:14:10,123 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-z8ig9tnp 3536s 2024-11-23 21:14:10,123 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:14:10,127 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34757. Reason: failure-to-start- 3536s 2024-11-23 21:14:10,127 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3536s 2024-11-23 21:14:10,128 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43211. Reason: failure-to-start- 3536s 2024-11-23 21:14:10,128 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3536s 2024-11-23 21:14:10,130 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45593': TLS handshake failed with remote 'tls://127.0.0.1:45170': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3536s 2024-11-23 21:14:10,131 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45593': TLS handshake failed with remote 'tls://127.0.0.1:45176': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3536s 2024-11-23 21:14:10,133 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3536s return await fut 3536s ^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3536s await self._register_with_scheduler() 3536s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3536s comm = await connect(self.scheduler.address, **self.connection_args) 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3536s comm = await wait_for( 3536s ^^^^^^^^^^^^^^^ 3536s ...<2 lines>... 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3536s return await fut 3536s ^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3536s stream = await self.client.connect( 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3536s af, addr, stream = await connector.start(connect_timeout=timeout) 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s asyncio.exceptions.CancelledError 3536s 3536s The above exception was the direct cause of the following exception: 3536s 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3536s await wait_for(self.start_unsafe(), timeout=timeout) 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3536s async with asyncio.timeout(timeout): 3536s ~~~~~~~~~~~~~~~^^^^^^^^^ 3536s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3536s raise TimeoutError from exc_val 3536s TimeoutError 3536s 3536s The above exception was the direct cause of the following exception: 3536s 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3536s s, ws = await start_cluster( 3536s ^^^^^^^^^^^^^^^^^^^^ 3536s ...<9 lines>... 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3536s await asyncio.gather(*workers) 3536s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3536s return await awaitable 3536s ^^^^^^^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3536s raise asyncio.TimeoutError( 3536s f"{type(self).__name__} start timed out after {timeout}s." 3536s ) from exc 3536s TimeoutError: Worker start timed out after 0s. 3536s 2024-11-23 21:14:11,141 - distributed.scheduler - INFO - State start 3536s 2024-11-23 21:14:11,153 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45971 3536s 2024-11-23 21:14:11,154 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40283/status 3536s 2024-11-23 21:14:11,154 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3536s 2024-11-23 21:14:11,177 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38395 3536s 2024-11-23 21:14:11,178 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38395 3536s 2024-11-23 21:14:11,178 - distributed.worker - INFO - Worker name: 0 3536s 2024-11-23 21:14:11,178 - distributed.worker - INFO - dashboard at: 127.0.0.1:43937 3536s 2024-11-23 21:14:11,178 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45971 3536s 2024-11-23 21:14:11,178 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:14:11,178 - distributed.worker - INFO - Threads: 1 3536s 2024-11-23 21:14:11,178 - distributed.worker - INFO - Memory: 15.58 GiB 3536s 2024-11-23 21:14:11,178 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-xx7s2hm_ 3536s 2024-11-23 21:14:11,179 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:14:11,182 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34673 3536s 2024-11-23 21:14:11,182 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34673 3536s 2024-11-23 21:14:11,182 - distributed.worker - INFO - Worker name: 1 3536s 2024-11-23 21:14:11,183 - distributed.worker - INFO - dashboard at: 127.0.0.1:40617 3536s 2024-11-23 21:14:11,183 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45971 3536s 2024-11-23 21:14:11,183 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:14:11,183 - distributed.worker - INFO - Threads: 2 3536s 2024-11-23 21:14:11,183 - distributed.worker - INFO - Memory: 15.58 GiB 3536s 2024-11-23 21:14:11,183 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-pzddg708 3536s 2024-11-23 21:14:11,183 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:14:11,185 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38395. Reason: failure-to-start- 3536s 2024-11-23 21:14:11,185 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3536s 2024-11-23 21:14:11,186 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34673. Reason: failure-to-start- 3536s 2024-11-23 21:14:11,186 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3536s 2024-11-23 21:14:11,188 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45971': TLS handshake failed with remote 'tls://127.0.0.1:39248': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3536s 2024-11-23 21:14:11,189 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45971': TLS handshake failed with remote 'tls://127.0.0.1:39258': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3536s 2024-11-23 21:14:11,191 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3536s return await fut 3536s ^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3536s await self._register_with_scheduler() 3536s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3536s comm = await connect(self.scheduler.address, **self.connection_args) 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3536s comm = await wait_for( 3536s ^^^^^^^^^^^^^^^ 3536s ...<2 lines>... 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3536s return await fut 3536s ^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3536s stream = await self.client.connect( 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3536s af, addr, stream = await connector.start(connect_timeout=timeout) 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s asyncio.exceptions.CancelledError 3536s 3536s The above exception was the direct cause of the following exception: 3536s 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3536s await wait_for(self.start_unsafe(), timeout=timeout) 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3536s async with asyncio.timeout(timeout): 3536s ~~~~~~~~~~~~~~~^^^^^^^^^ 3536s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3536s raise TimeoutError from exc_val 3536s TimeoutError 3536s 3536s The above exception was the direct cause of the following exception: 3536s 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3536s s, ws = await start_cluster( 3536s ^^^^^^^^^^^^^^^^^^^^ 3536s ...<9 lines>... 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3536s await asyncio.gather(*workers) 3536s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3536s return await awaitable 3536s ^^^^^^^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3536s raise asyncio.TimeoutError( 3536s f"{type(self).__name__} start timed out after {timeout}s." 3536s ) from exc 3536s TimeoutError: Worker start timed out after 0s. 3536s 2024-11-23 21:14:12,198 - distributed.scheduler - INFO - State start 3536s 2024-11-23 21:14:12,211 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39001 3536s 2024-11-23 21:14:12,211 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44943/status 3536s 2024-11-23 21:14:12,212 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3536s 2024-11-23 21:14:12,233 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40961 3536s 2024-11-23 21:14:12,233 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40961 3536s 2024-11-23 21:14:12,233 - distributed.worker - INFO - Worker name: 0 3536s 2024-11-23 21:14:12,234 - distributed.worker - INFO - dashboard at: 127.0.0.1:36109 3536s 2024-11-23 21:14:12,234 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39001 3536s 2024-11-23 21:14:12,234 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:14:12,234 - distributed.worker - INFO - Threads: 1 3536s 2024-11-23 21:14:12,234 - distributed.worker - INFO - Memory: 15.58 GiB 3536s 2024-11-23 21:14:12,234 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-1edhvasn 3536s 2024-11-23 21:14:12,234 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:14:12,237 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44005 3536s 2024-11-23 21:14:12,238 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44005 3536s 2024-11-23 21:14:12,238 - distributed.worker - INFO - Worker name: 1 3536s 2024-11-23 21:14:12,238 - distributed.worker - INFO - dashboard at: 127.0.0.1:35439 3536s 2024-11-23 21:14:12,238 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39001 3536s 2024-11-23 21:14:12,238 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:14:12,238 - distributed.worker - INFO - Threads: 2 3536s 2024-11-23 21:14:12,238 - distributed.worker - INFO - Memory: 15.58 GiB 3536s 2024-11-23 21:14:12,238 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-sqo9rdne 3536s 2024-11-23 21:14:12,238 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:14:12,240 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40961. Reason: failure-to-start- 3536s 2024-11-23 21:14:12,241 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3536s 2024-11-23 21:14:12,241 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44005. Reason: failure-to-start- 3536s 2024-11-23 21:14:12,242 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3536s 2024-11-23 21:14:12,247 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39001': TLS handshake failed with remote 'tls://127.0.0.1:44638': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3536s 2024-11-23 21:14:12,248 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39001': TLS handshake failed with remote 'tls://127.0.0.1:44640': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3536s 2024-11-23 21:14:12,250 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3536s return await fut 3536s ^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3536s await self._register_with_scheduler() 3536s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3536s comm = await connect(self.scheduler.address, **self.connection_args) 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3536s comm = await wait_for( 3536s ^^^^^^^^^^^^^^^ 3536s ...<2 lines>... 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3536s return await fut 3536s ^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3536s stream = await self.client.connect( 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3536s af, addr, stream = await connector.start(connect_timeout=timeout) 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s asyncio.exceptions.CancelledError 3536s 3536s The above exception was the direct cause of the following exception: 3536s 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3536s await wait_for(self.start_unsafe(), timeout=timeout) 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3536s async with asyncio.timeout(timeout): 3536s ~~~~~~~~~~~~~~~^^^^^^^^^ 3536s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3536s raise TimeoutError from exc_val 3536s TimeoutError 3536s 3536s The above exception was the direct cause of the following exception: 3536s 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3536s s, ws = await start_cluster( 3536s ^^^^^^^^^^^^^^^^^^^^ 3536s ...<9 lines>... 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3536s await asyncio.gather(*workers) 3536s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3536s return await awaitable 3536s ^^^^^^^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3536s raise asyncio.TimeoutError( 3536s f"{type(self).__name__} start timed out after {timeout}s." 3536s ) from exc 3536s TimeoutError: Worker start timed out after 0s. 3536s 2024-11-23 21:14:13,257 - distributed.scheduler - INFO - State start 3536s 2024-11-23 21:14:13,268 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43731 3536s 2024-11-23 21:14:13,269 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45049/status 3536s 2024-11-23 21:14:13,269 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3536s 2024-11-23 21:14:13,294 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42887 3536s 2024-11-23 21:14:13,294 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42887 3536s 2024-11-23 21:14:13,295 - distributed.worker - INFO - Worker name: 0 3536s 2024-11-23 21:14:13,295 - distributed.worker - INFO - dashboard at: 127.0.0.1:35913 3536s 2024-11-23 21:14:13,295 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43731 3536s 2024-11-23 21:14:13,295 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:14:13,295 - distributed.worker - INFO - Threads: 1 3536s 2024-11-23 21:14:13,295 - distributed.worker - INFO - Memory: 15.58 GiB 3536s 2024-11-23 21:14:13,295 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-o9xglpkh 3536s 2024-11-23 21:14:13,295 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:14:13,299 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42725 3536s 2024-11-23 21:14:13,299 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42725 3536s 2024-11-23 21:14:13,299 - distributed.worker - INFO - Worker name: 1 3536s 2024-11-23 21:14:13,299 - distributed.worker - INFO - dashboard at: 127.0.0.1:41987 3536s 2024-11-23 21:14:13,299 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43731 3536s 2024-11-23 21:14:13,300 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:14:13,300 - distributed.worker - INFO - Threads: 2 3536s 2024-11-23 21:14:13,300 - distributed.worker - INFO - Memory: 15.58 GiB 3536s 2024-11-23 21:14:13,300 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-sgf62yk4 3536s 2024-11-23 21:14:13,300 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:14:13,302 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42887. Reason: failure-to-start- 3536s 2024-11-23 21:14:13,303 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3536s 2024-11-23 21:14:13,303 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42725. Reason: failure-to-start- 3536s 2024-11-23 21:14:13,304 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3536s 2024-11-23 21:14:13,306 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43731': TLS handshake failed with remote 'tls://127.0.0.1:44664': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3536s 2024-11-23 21:14:13,306 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43731': TLS handshake failed with remote 'tls://127.0.0.1:44670': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3536s 2024-11-23 21:14:13,312 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3536s return await fut 3536s ^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3536s await self._register_with_scheduler() 3536s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3536s comm = await connect(self.scheduler.address, **self.connection_args) 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3536s comm = await wait_for( 3536s ^^^^^^^^^^^^^^^ 3536s ...<2 lines>... 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3536s return await fut 3536s ^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3536s stream = await self.client.connect( 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3536s af, addr, stream = await connector.start(connect_timeout=timeout) 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s asyncio.exceptions.CancelledError 3536s 3536s The above exception was the direct cause of the following exception: 3536s 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3536s await wait_for(self.start_unsafe(), timeout=timeout) 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3536s async with asyncio.timeout(timeout): 3536s ~~~~~~~~~~~~~~~^^^^^^^^^ 3536s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3536s raise TimeoutError from exc_val 3536s TimeoutError 3536s 3536s The above exception was the direct cause of the following exception: 3536s 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3536s s, ws = await start_cluster( 3536s ^^^^^^^^^^^^^^^^^^^^ 3536s ...<9 lines>... 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3536s await asyncio.gather(*workers) 3536s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3536s return await awaitable 3536s ^^^^^^^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3536s raise asyncio.TimeoutError( 3536s f"{type(self).__name__} start timed out after {timeout}s." 3536s ) from exc 3536s TimeoutError: Worker start timed out after 0s. 3536s 2024-11-23 21:14:14,319 - distributed.scheduler - INFO - State start 3536s 2024-11-23 21:14:14,331 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44215 3536s 2024-11-23 21:14:14,332 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:32769/status 3536s 2024-11-23 21:14:14,332 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3536s 2024-11-23 21:14:14,356 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45113 3536s 2024-11-23 21:14:14,356 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45113 3536s 2024-11-23 21:14:14,356 - distributed.worker - INFO - Worker name: 0 3536s 2024-11-23 21:14:14,356 - distributed.worker - INFO - dashboard at: 127.0.0.1:38985 3536s 2024-11-23 21:14:14,357 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44215 3536s 2024-11-23 21:14:14,357 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:14:14,357 - distributed.worker - INFO - Threads: 1 3536s 2024-11-23 21:14:14,357 - distributed.worker - INFO - Memory: 15.58 GiB 3536s 2024-11-23 21:14:14,357 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-mj7zdd4r 3536s 2024-11-23 21:14:14,357 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:14:14,360 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40445 3536s 2024-11-23 21:14:14,361 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40445 3536s 2024-11-23 21:14:14,361 - distributed.worker - INFO - Worker name: 1 3536s 2024-11-23 21:14:14,361 - distributed.worker - INFO - dashboard at: 127.0.0.1:33153 3536s 2024-11-23 21:14:14,361 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44215 3536s 2024-11-23 21:14:14,361 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:14:14,361 - distributed.worker - INFO - Threads: 2 3536s 2024-11-23 21:14:14,361 - distributed.worker - INFO - Memory: 15.58 GiB 3536s 2024-11-23 21:14:14,361 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-n3if6nm0 3536s 2024-11-23 21:14:14,361 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:14:14,377 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45113. Reason: failure-to-start- 3536s 2024-11-23 21:14:14,378 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3536s 2024-11-23 21:14:14,379 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40445. Reason: failure-to-start- 3536s 2024-11-23 21:14:14,379 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3536s 2024-11-23 21:14:14,382 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44215': TLS handshake failed with remote 'tls://127.0.0.1:41750': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3536s 2024-11-23 21:14:14,382 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44215': TLS handshake failed with remote 'tls://127.0.0.1:41756': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3536s 2024-11-23 21:14:14,388 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3536s return await fut 3536s ^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3536s await self._register_with_scheduler() 3536s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3536s comm = await connect(self.scheduler.address, **self.connection_args) 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3536s comm = await wait_for( 3536s ^^^^^^^^^^^^^^^ 3536s ...<2 lines>... 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3536s return await fut 3536s ^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3536s stream = await self.client.connect( 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3536s af, addr, stream = await connector.start(connect_timeout=timeout) 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s asyncio.exceptions.CancelledError 3536s 3536s The above exception was the direct cause of the following exception: 3536s 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3536s await wait_for(self.start_unsafe(), timeout=timeout) 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3536s async with asyncio.timeout(timeout): 3536s ~~~~~~~~~~~~~~~^^^^^^^^^ 3536s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3536s raise TimeoutError from exc_val 3536s TimeoutError 3536s 3536s The above exception was the direct cause of the following exception: 3536s 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3536s s, ws = await start_cluster( 3536s ^^^^^^^^^^^^^^^^^^^^ 3536s ...<9 lines>... 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3536s await asyncio.gather(*workers) 3536s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3536s return await awaitable 3536s ^^^^^^^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3536s raise asyncio.TimeoutError( 3536s f"{type(self).__name__} start timed out after {timeout}s." 3536s ) from exc 3536s TimeoutError: Worker start timed out after 0s. 3536s 2024-11-23 21:14:15,395 - distributed.scheduler - INFO - State start 3536s 2024-11-23 21:14:15,406 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43189 3536s 2024-11-23 21:14:15,407 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33619/status 3536s 2024-11-23 21:14:15,407 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3536s 2024-11-23 21:14:15,432 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35401 3536s 2024-11-23 21:14:15,432 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35401 3536s 2024-11-23 21:14:15,433 - distributed.worker - INFO - Worker name: 0 3536s 2024-11-23 21:14:15,433 - distributed.worker - INFO - dashboard at: 127.0.0.1:46667 3536s 2024-11-23 21:14:15,433 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43189 3536s 2024-11-23 21:14:15,433 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:14:15,433 - distributed.worker - INFO - Threads: 1 3536s 2024-11-23 21:14:15,433 - distributed.worker - INFO - Memory: 15.58 GiB 3536s 2024-11-23 21:14:15,433 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-6nv2ifqp 3536s 2024-11-23 21:14:15,433 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:14:15,437 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41075 3536s 2024-11-23 21:14:15,437 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41075 3536s 2024-11-23 21:14:15,437 - distributed.worker - INFO - Worker name: 1 3536s 2024-11-23 21:14:15,437 - distributed.worker - INFO - dashboard at: 127.0.0.1:39299 3536s 2024-11-23 21:14:15,437 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43189 3536s 2024-11-23 21:14:15,437 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:14:15,438 - distributed.worker - INFO - Threads: 2 3536s 2024-11-23 21:14:15,438 - distributed.worker - INFO - Memory: 15.58 GiB 3536s 2024-11-23 21:14:15,438 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-m3mi13ah 3536s 2024-11-23 21:14:15,438 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:14:15,444 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35401. Reason: failure-to-start- 3536s 2024-11-23 21:14:15,444 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3536s 2024-11-23 21:14:15,445 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41075. Reason: failure-to-start- 3536s 2024-11-23 21:14:15,445 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3536s 2024-11-23 21:14:15,447 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43189': TLS handshake failed with remote 'tls://127.0.0.1:45546': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3536s 2024-11-23 21:14:15,447 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43189': TLS handshake failed with remote 'tls://127.0.0.1:45548': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3536s 2024-11-23 21:14:15,450 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3536s return await fut 3536s ^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3536s await self._register_with_scheduler() 3536s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3536s comm = await connect(self.scheduler.address, **self.connection_args) 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3536s comm = await wait_for( 3536s ^^^^^^^^^^^^^^^ 3536s ...<2 lines>... 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3536s return await fut 3536s ^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3536s stream = await self.client.connect( 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3536s af, addr, stream = await connector.start(connect_timeout=timeout) 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s asyncio.exceptions.CancelledError 3536s 3536s The above exception was the direct cause of the following exception: 3536s 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3536s await wait_for(self.start_unsafe(), timeout=timeout) 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3536s async with asyncio.timeout(timeout): 3536s ~~~~~~~~~~~~~~~^^^^^^^^^ 3536s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3536s raise TimeoutError from exc_val 3536s TimeoutError 3536s 3536s The above exception was the direct cause of the following exception: 3536s 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3536s s, ws = await start_cluster( 3536s ^^^^^^^^^^^^^^^^^^^^ 3536s ...<9 lines>... 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3536s await asyncio.gather(*workers) 3536s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3536s return await awaitable 3536s ^^^^^^^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3536s raise asyncio.TimeoutError( 3536s f"{type(self).__name__} start timed out after {timeout}s." 3536s ) from exc 3536s TimeoutError: Worker start timed out after 0s. 3536s 2024-11-23 21:14:16,456 - distributed.scheduler - INFO - State start 3536s 2024-11-23 21:14:16,464 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44711 3536s 2024-11-23 21:14:16,464 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38213/status 3536s 2024-11-23 21:14:16,465 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3536s 2024-11-23 21:14:16,484 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33501 3536s 2024-11-23 21:14:16,484 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33501 3536s 2024-11-23 21:14:16,484 - distributed.worker - INFO - Worker name: 0 3536s 2024-11-23 21:14:16,484 - distributed.worker - INFO - dashboard at: 127.0.0.1:42171 3536s 2024-11-23 21:14:16,484 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44711 3536s 2024-11-23 21:14:16,484 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:14:16,484 - distributed.worker - INFO - Threads: 1 3536s 2024-11-23 21:14:16,485 - distributed.worker - INFO - Memory: 15.58 GiB 3536s 2024-11-23 21:14:16,485 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-67c_szcv 3536s 2024-11-23 21:14:16,485 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:14:16,487 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44845 3536s 2024-11-23 21:14:16,487 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44845 3536s 2024-11-23 21:14:16,487 - distributed.worker - INFO - Worker name: 1 3536s 2024-11-23 21:14:16,487 - distributed.worker - INFO - dashboard at: 127.0.0.1:40723 3536s 2024-11-23 21:14:16,487 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44711 3536s 2024-11-23 21:14:16,487 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:14:16,488 - distributed.worker - INFO - Threads: 2 3536s 2024-11-23 21:14:16,488 - distributed.worker - INFO - Memory: 15.58 GiB 3536s 2024-11-23 21:14:16,488 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-xq4ud6s9 3536s 2024-11-23 21:14:16,488 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:14:16,489 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33501. Reason: failure-to-start- 3536s 2024-11-23 21:14:16,489 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3536s 2024-11-23 21:14:16,490 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44845. Reason: failure-to-start- 3536s 2024-11-23 21:14:16,490 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3536s 2024-11-23 21:14:16,495 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44711': TLS handshake failed with remote 'tls://127.0.0.1:60226': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3536s 2024-11-23 21:14:16,495 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44711': TLS handshake failed with remote 'tls://127.0.0.1:60232': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3536s 2024-11-23 21:14:16,497 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3536s return await fut 3536s ^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3536s await self._register_with_scheduler() 3536s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3536s comm = await connect(self.scheduler.address, **self.connection_args) 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3536s comm = await wait_for( 3536s ^^^^^^^^^^^^^^^ 3536s ...<2 lines>... 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3536s return await fut 3536s ^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3536s stream = await self.client.connect( 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3536s af, addr, stream = await connector.start(connect_timeout=timeout) 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s asyncio.exceptions.CancelledError 3536s 3536s The above exception was the direct cause of the following exception: 3536s 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3536s await wait_for(self.start_unsafe(), timeout=timeout) 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3536s async with asyncio.timeout(timeout): 3536s ~~~~~~~~~~~~~~~^^^^^^^^^ 3536s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3536s raise TimeoutError from exc_val 3536s TimeoutError 3536s 3536s The above exception was the direct cause of the following exception: 3536s 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3536s s, ws = await start_cluster( 3536s ^^^^^^^^^^^^^^^^^^^^ 3536s ...<9 lines>... 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3536s await asyncio.gather(*workers) 3536s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3536s return await awaitable 3536s ^^^^^^^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3536s raise asyncio.TimeoutError( 3536s f"{type(self).__name__} start timed out after {timeout}s." 3536s ) from exc 3536s TimeoutError: Worker start timed out after 0s. 3536s 2024-11-23 21:14:17,503 - distributed.scheduler - INFO - State start 3536s 2024-11-23 21:14:17,511 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46321 3536s 2024-11-23 21:14:17,512 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34481/status 3536s 2024-11-23 21:14:17,512 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3536s 2024-11-23 21:14:17,530 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35139 3536s 2024-11-23 21:14:17,531 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35139 3536s 2024-11-23 21:14:17,531 - distributed.worker - INFO - Worker name: 0 3536s 2024-11-23 21:14:17,531 - distributed.worker - INFO - dashboard at: 127.0.0.1:37765 3536s 2024-11-23 21:14:17,531 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46321 3536s 2024-11-23 21:14:17,531 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:14:17,531 - distributed.worker - INFO - Threads: 1 3536s 2024-11-23 21:14:17,531 - distributed.worker - INFO - Memory: 15.58 GiB 3536s 2024-11-23 21:14:17,531 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-vbs397qr 3536s 2024-11-23 21:14:17,531 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:14:17,534 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40003 3536s 2024-11-23 21:14:17,534 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40003 3536s 2024-11-23 21:14:17,534 - distributed.worker - INFO - Worker name: 1 3536s 2024-11-23 21:14:17,534 - distributed.worker - INFO - dashboard at: 127.0.0.1:45949 3536s 2024-11-23 21:14:17,534 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46321 3536s 2024-11-23 21:14:17,534 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:14:17,534 - distributed.worker - INFO - Threads: 2 3536s 2024-11-23 21:14:17,534 - distributed.worker - INFO - Memory: 15.58 GiB 3536s 2024-11-23 21:14:17,534 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-vgpygetr 3536s 2024-11-23 21:14:17,535 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:14:17,536 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35139. Reason: failure-to-start- 3536s 2024-11-23 21:14:17,536 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3536s 2024-11-23 21:14:17,537 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40003. Reason: failure-to-start- 3536s 2024-11-23 21:14:17,537 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3536s 2024-11-23 21:14:17,538 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46321': TLS handshake failed with remote 'tls://127.0.0.1:43284': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3536s 2024-11-23 21:14:17,539 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46321': TLS handshake failed with remote 'tls://127.0.0.1:43286': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3536s 2024-11-23 21:14:17,543 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3536s return await fut 3536s ^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3536s await self._register_with_scheduler() 3536s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3536s comm = await connect(self.scheduler.address, **self.connection_args) 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3536s comm = await wait_for( 3536s ^^^^^^^^^^^^^^^ 3536s ...<2 lines>... 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3536s return await fut 3536s ^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3536s stream = await self.client.connect( 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3536s af, addr, stream = await connector.start(connect_timeout=timeout) 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s asyncio.exceptions.CancelledError 3536s 3536s The above exception was the direct cause of the following exception: 3536s 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3536s await wait_for(self.start_unsafe(), timeout=timeout) 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3536s async with asyncio.timeout(timeout): 3536s ~~~~~~~~~~~~~~~^^^^^^^^^ 3536s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3536s raise TimeoutError from exc_val 3536s TimeoutError 3536s 3536s The above exception was the direct cause of the following exception: 3536s 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3536s s, ws = await start_cluster( 3536s ^^^^^^^^^^^^^^^^^^^^ 3536s ...<9 lines>... 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3536s await asyncio.gather(*workers) 3536s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3536s return await awaitable 3536s ^^^^^^^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3536s raise asyncio.TimeoutError( 3536s f"{type(self).__name__} start timed out after {timeout}s." 3536s ) from exc 3536s TimeoutError: Worker start timed out after 0s. 3536s 2024-11-23 21:14:18,550 - distributed.scheduler - INFO - State start 3536s 2024-11-23 21:14:18,560 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40219 3536s 2024-11-23 21:14:18,561 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:32877/status 3536s 2024-11-23 21:14:18,561 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3536s 2024-11-23 21:14:18,584 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44897 3536s 2024-11-23 21:14:18,584 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44897 3536s 2024-11-23 21:14:18,584 - distributed.worker - INFO - Worker name: 0 3536s 2024-11-23 21:14:18,585 - distributed.worker - INFO - dashboard at: 127.0.0.1:46267 3536s 2024-11-23 21:14:18,585 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40219 3536s 2024-11-23 21:14:18,585 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:14:18,585 - distributed.worker - INFO - Threads: 1 3536s 2024-11-23 21:14:18,585 - distributed.worker - INFO - Memory: 15.58 GiB 3536s 2024-11-23 21:14:18,585 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-dn6v050b 3536s 2024-11-23 21:14:18,585 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:14:18,588 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35609 3536s 2024-11-23 21:14:18,589 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35609 3536s 2024-11-23 21:14:18,589 - distributed.worker - INFO - Worker name: 1 3536s 2024-11-23 21:14:18,589 - distributed.worker - INFO - dashboard at: 127.0.0.1:38129 3536s 2024-11-23 21:14:18,589 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40219 3536s 2024-11-23 21:14:18,589 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:14:18,589 - distributed.worker - INFO - Threads: 2 3536s 2024-11-23 21:14:18,589 - distributed.worker - INFO - Memory: 15.58 GiB 3536s 2024-11-23 21:14:18,589 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-hkxq2obu 3536s 2024-11-23 21:14:18,590 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:14:18,592 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44897. Reason: failure-to-start- 3536s 2024-11-23 21:14:18,592 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3536s 2024-11-23 21:14:18,593 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35609. Reason: failure-to-start- 3536s 2024-11-23 21:14:18,593 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3536s 2024-11-23 21:14:18,595 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40219': TLS handshake failed with remote 'tls://127.0.0.1:38594': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3536s 2024-11-23 21:14:18,596 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40219': TLS handshake failed with remote 'tls://127.0.0.1:38608': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3536s 2024-11-23 21:14:18,602 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3536s return await fut 3536s ^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3536s await self._register_with_scheduler() 3536s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3536s comm = await connect(self.scheduler.address, **self.connection_args) 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3536s comm = await wait_for( 3536s ^^^^^^^^^^^^^^^ 3536s ...<2 lines>... 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3536s return await fut 3536s ^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3536s stream = await self.client.connect( 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3536s af, addr, stream = await connector.start(connect_timeout=timeout) 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s asyncio.exceptions.CancelledError 3536s 3536s The above exception was the direct cause of the following exception: 3536s 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3536s await wait_for(self.start_unsafe(), timeout=timeout) 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3536s async with asyncio.timeout(timeout): 3536s ~~~~~~~~~~~~~~~^^^^^^^^^ 3536s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3536s raise TimeoutError from exc_val 3536s TimeoutError 3536s 3536s The above exception was the direct cause of the following exception: 3536s 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3536s s, ws = await start_cluster( 3536s ^^^^^^^^^^^^^^^^^^^^ 3536s ...<9 lines>... 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3536s await asyncio.gather(*workers) 3536s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3536s return await awaitable 3536s ^^^^^^^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3536s raise asyncio.TimeoutError( 3536s f"{type(self).__name__} start timed out after {timeout}s." 3536s ) from exc 3536s TimeoutError: Worker start timed out after 0s. 3536s 2024-11-23 21:14:19,612 - distributed.scheduler - INFO - State start 3536s 2024-11-23 21:14:19,623 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44447 3536s 2024-11-23 21:14:19,623 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39615/status 3536s 2024-11-23 21:14:19,624 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3536s 2024-11-23 21:14:19,647 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45377 3536s 2024-11-23 21:14:19,647 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45377 3536s 2024-11-23 21:14:19,647 - distributed.worker - INFO - Worker name: 0 3536s 2024-11-23 21:14:19,647 - distributed.worker - INFO - dashboard at: 127.0.0.1:45125 3536s 2024-11-23 21:14:19,647 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44447 3536s 2024-11-23 21:14:19,647 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:14:19,647 - distributed.worker - INFO - Threads: 1 3536s 2024-11-23 21:14:19,647 - distributed.worker - INFO - Memory: 15.58 GiB 3536s 2024-11-23 21:14:19,648 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-0p38gw3i 3536s 2024-11-23 21:14:19,648 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:14:19,651 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44041 3536s 2024-11-23 21:14:19,651 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44041 3536s 2024-11-23 21:14:19,651 - distributed.worker - INFO - Worker name: 1 3536s 2024-11-23 21:14:19,651 - distributed.worker - INFO - dashboard at: 127.0.0.1:35975 3536s 2024-11-23 21:14:19,651 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44447 3536s 2024-11-23 21:14:19,652 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:14:19,652 - distributed.worker - INFO - Threads: 2 3536s 2024-11-23 21:14:19,652 - distributed.worker - INFO - Memory: 15.58 GiB 3536s 2024-11-23 21:14:19,652 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-fp6teos_ 3536s 2024-11-23 21:14:19,652 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:14:19,654 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45377. Reason: failure-to-start- 3536s 2024-11-23 21:14:19,654 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3536s 2024-11-23 21:14:19,655 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44041. Reason: failure-to-start- 3536s 2024-11-23 21:14:19,655 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3536s 2024-11-23 21:14:19,657 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44447': TLS handshake failed with remote 'tls://127.0.0.1:37602': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3536s 2024-11-23 21:14:19,657 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44447': TLS handshake failed with remote 'tls://127.0.0.1:37618': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3536s 2024-11-23 21:14:19,663 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3536s return await fut 3536s ^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3536s await self._register_with_scheduler() 3536s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3536s comm = await connect(self.scheduler.address, **self.connection_args) 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3536s comm = await wait_for( 3536s ^^^^^^^^^^^^^^^ 3536s ...<2 lines>... 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3536s return await fut 3536s ^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3536s stream = await self.client.connect( 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3536s af, addr, stream = await connector.start(connect_timeout=timeout) 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s asyncio.exceptions.CancelledError 3536s 3536s The above exception was the direct cause of the following exception: 3536s 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3536s await wait_for(self.start_unsafe(), timeout=timeout) 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3536s async with asyncio.timeout(timeout): 3536s ~~~~~~~~~~~~~~~^^^^^^^^^ 3536s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3536s raise TimeoutError from exc_val 3536s TimeoutError 3536s 3536s The above exception was the direct cause of the following exception: 3536s 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3536s s, ws = await start_cluster( 3536s ^^^^^^^^^^^^^^^^^^^^ 3536s ...<9 lines>... 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3536s await asyncio.gather(*workers) 3536s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3536s return await awaitable 3536s ^^^^^^^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3536s raise asyncio.TimeoutError( 3536s f"{type(self).__name__} start timed out after {timeout}s." 3536s ) from exc 3536s TimeoutError: Worker start timed out after 0s. 3536s 2024-11-23 21:14:20,671 - distributed.scheduler - INFO - State start 3536s 2024-11-23 21:14:20,682 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46425 3536s 2024-11-23 21:14:20,682 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39945/status 3536s 2024-11-23 21:14:20,683 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3536s 2024-11-23 21:14:20,708 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33069 3536s 2024-11-23 21:14:20,708 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33069 3536s 2024-11-23 21:14:20,708 - distributed.worker - INFO - Worker name: 0 3536s 2024-11-23 21:14:20,708 - distributed.worker - INFO - dashboard at: 127.0.0.1:38819 3536s 2024-11-23 21:14:20,708 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46425 3536s 2024-11-23 21:14:20,708 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:14:20,709 - distributed.worker - INFO - Threads: 1 3536s 2024-11-23 21:14:20,709 - distributed.worker - INFO - Memory: 15.58 GiB 3536s 2024-11-23 21:14:20,709 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-3i37hjox 3536s 2024-11-23 21:14:20,709 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:14:20,712 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41637 3536s 2024-11-23 21:14:20,712 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41637 3536s 2024-11-23 21:14:20,713 - distributed.worker - INFO - Worker name: 1 3536s 2024-11-23 21:14:20,713 - distributed.worker - INFO - dashboard at: 127.0.0.1:41235 3536s 2024-11-23 21:14:20,713 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46425 3536s 2024-11-23 21:14:20,713 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:14:20,713 - distributed.worker - INFO - Threads: 2 3536s 2024-11-23 21:14:20,713 - distributed.worker - INFO - Memory: 15.58 GiB 3536s 2024-11-23 21:14:20,713 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-k0l9ljrm 3536s 2024-11-23 21:14:20,713 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:14:20,715 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33069. Reason: failure-to-start- 3536s 2024-11-23 21:14:20,716 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3536s 2024-11-23 21:14:20,716 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41637. Reason: failure-to-start- 3536s 2024-11-23 21:14:20,717 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3536s 2024-11-23 21:14:20,722 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46425': TLS handshake failed with remote 'tls://127.0.0.1:38260': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3536s 2024-11-23 21:14:20,723 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46425': TLS handshake failed with remote 'tls://127.0.0.1:38266': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3536s 2024-11-23 21:14:20,725 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3536s return await fut 3536s ^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3536s await self._register_with_scheduler() 3536s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3536s comm = await connect(self.scheduler.address, **self.connection_args) 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3536s comm = await wait_for( 3536s ^^^^^^^^^^^^^^^ 3536s ...<2 lines>... 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3536s return await fut 3536s ^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3536s stream = await self.client.connect( 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3536s af, addr, stream = await connector.start(connect_timeout=timeout) 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s asyncio.exceptions.CancelledError 3536s 3536s The above exception was the direct cause of the following exception: 3536s 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3536s await wait_for(self.start_unsafe(), timeout=timeout) 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3536s async with asyncio.timeout(timeout): 3536s ~~~~~~~~~~~~~~~^^^^^^^^^ 3536s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3536s raise TimeoutError from exc_val 3536s TimeoutError 3536s 3536s The above exception was the direct cause of the following exception: 3536s 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3536s s, ws = await start_cluster( 3536s ^^^^^^^^^^^^^^^^^^^^ 3536s ...<9 lines>... 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3536s await asyncio.gather(*workers) 3536s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3536s return await awaitable 3536s ^^^^^^^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3536s raise asyncio.TimeoutError( 3536s f"{type(self).__name__} start timed out after {timeout}s." 3536s ) from exc 3536s TimeoutError: Worker start timed out after 0s. 3536s 2024-11-23 21:14:21,732 - distributed.scheduler - INFO - State start 3536s 2024-11-23 21:14:21,744 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42903 3536s 2024-11-23 21:14:21,745 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46867/status 3536s 2024-11-23 21:14:21,745 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3536s 2024-11-23 21:14:21,776 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45413 3536s 2024-11-23 21:14:21,776 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45413 3536s 2024-11-23 21:14:21,776 - distributed.worker - INFO - Worker name: 0 3536s 2024-11-23 21:14:21,776 - distributed.worker - INFO - dashboard at: 127.0.0.1:39045 3536s 2024-11-23 21:14:21,776 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42903 3536s 2024-11-23 21:14:21,776 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:14:21,777 - distributed.worker - INFO - Threads: 1 3536s 2024-11-23 21:14:21,777 - distributed.worker - INFO - Memory: 15.58 GiB 3536s 2024-11-23 21:14:21,777 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-4h0fd216 3536s 2024-11-23 21:14:21,777 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:14:21,780 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46799 3536s 2024-11-23 21:14:21,781 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46799 3536s 2024-11-23 21:14:21,781 - distributed.worker - INFO - Worker name: 1 3536s 2024-11-23 21:14:21,781 - distributed.worker - INFO - dashboard at: 127.0.0.1:37003 3536s 2024-11-23 21:14:21,781 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42903 3536s 2024-11-23 21:14:21,781 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:14:21,781 - distributed.worker - INFO - Threads: 2 3536s 2024-11-23 21:14:21,781 - distributed.worker - INFO - Memory: 15.58 GiB 3536s 2024-11-23 21:14:21,781 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-0oaihgos 3536s 2024-11-23 21:14:21,782 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:14:21,788 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45413. Reason: failure-to-start- 3536s 2024-11-23 21:14:21,788 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3536s 2024-11-23 21:14:21,789 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46799. Reason: failure-to-start- 3536s 2024-11-23 21:14:21,789 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3536s 2024-11-23 21:14:21,792 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42903': TLS handshake failed with remote 'tls://127.0.0.1:53130': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3536s 2024-11-23 21:14:21,792 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42903': TLS handshake failed with remote 'tls://127.0.0.1:53144': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3536s 2024-11-23 21:14:21,795 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3536s return await fut 3536s ^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3536s await self._register_with_scheduler() 3536s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3536s comm = await connect(self.scheduler.address, **self.connection_args) 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3536s comm = await wait_for( 3536s ^^^^^^^^^^^^^^^ 3536s ...<2 lines>... 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3536s return await fut 3536s ^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3536s stream = await self.client.connect( 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3536s af, addr, stream = await connector.start(connect_timeout=timeout) 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s asyncio.exceptions.CancelledError 3536s 3536s The above exception was the direct cause of the following exception: 3536s 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3536s await wait_for(self.start_unsafe(), timeout=timeout) 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3536s async with asyncio.timeout(timeout): 3536s ~~~~~~~~~~~~~~~^^^^^^^^^ 3536s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3536s raise TimeoutError from exc_val 3536s TimeoutError 3536s 3536s The above exception was the direct cause of the following exception: 3536s 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3536s s, ws = await start_cluster( 3536s ^^^^^^^^^^^^^^^^^^^^ 3536s ...<9 lines>... 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3536s await asyncio.gather(*workers) 3536s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3536s return await awaitable 3536s ^^^^^^^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3536s raise asyncio.TimeoutError( 3536s f"{type(self).__name__} start timed out after {timeout}s." 3536s ) from exc 3536s TimeoutError: Worker start timed out after 0s. 3536s 2024-11-23 21:14:22,802 - distributed.scheduler - INFO - State start 3536s 2024-11-23 21:14:22,815 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36679 3536s 2024-11-23 21:14:22,815 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35147/status 3536s 2024-11-23 21:14:22,816 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3536s 2024-11-23 21:14:22,838 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40417 3536s 2024-11-23 21:14:22,838 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40417 3536s 2024-11-23 21:14:22,838 - distributed.worker - INFO - Worker name: 0 3536s 2024-11-23 21:14:22,838 - distributed.worker - INFO - dashboard at: 127.0.0.1:44391 3536s 2024-11-23 21:14:22,838 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36679 3536s 2024-11-23 21:14:22,838 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:14:22,838 - distributed.worker - INFO - Threads: 1 3536s 2024-11-23 21:14:22,838 - distributed.worker - INFO - Memory: 15.58 GiB 3536s 2024-11-23 21:14:22,838 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-4_eonq14 3536s 2024-11-23 21:14:22,839 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:14:22,841 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45339 3536s 2024-11-23 21:14:22,841 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45339 3536s 2024-11-23 21:14:22,841 - distributed.worker - INFO - Worker name: 1 3536s 2024-11-23 21:14:22,841 - distributed.worker - INFO - dashboard at: 127.0.0.1:39597 3536s 2024-11-23 21:14:22,841 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36679 3536s 2024-11-23 21:14:22,841 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:14:22,841 - distributed.worker - INFO - Threads: 2 3536s 2024-11-23 21:14:22,841 - distributed.worker - INFO - Memory: 15.58 GiB 3536s 2024-11-23 21:14:22,842 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-l6dohtty 3536s 2024-11-23 21:14:22,842 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:14:22,847 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40417. Reason: failure-to-start- 3536s 2024-11-23 21:14:22,847 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3536s 2024-11-23 21:14:22,848 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45339. Reason: failure-to-start- 3536s 2024-11-23 21:14:22,848 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3536s 2024-11-23 21:14:22,850 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36679': TLS handshake failed with remote 'tls://127.0.0.1:48968': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3536s 2024-11-23 21:14:22,850 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36679': TLS handshake failed with remote 'tls://127.0.0.1:48984': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3536s 2024-11-23 21:14:22,852 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3536s return await fut 3536s ^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3536s await self._register_with_scheduler() 3536s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3536s comm = await connect(self.scheduler.address, **self.connection_args) 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3536s comm = await wait_for( 3536s ^^^^^^^^^^^^^^^ 3536s ...<2 lines>... 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3536s return await fut 3536s ^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3536s stream = await self.client.connect( 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3536s af, addr, stream = await connector.start(connect_timeout=timeout) 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s asyncio.exceptions.CancelledError 3536s 3536s The above exception was the direct cause of the following exception: 3536s 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3536s await wait_for(self.start_unsafe(), timeout=timeout) 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3536s async with asyncio.timeout(timeout): 3536s ~~~~~~~~~~~~~~~^^^^^^^^^ 3536s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3536s raise TimeoutError from exc_val 3536s TimeoutError 3536s 3536s The above exception was the direct cause of the following exception: 3536s 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3536s s, ws = await start_cluster( 3536s ^^^^^^^^^^^^^^^^^^^^ 3536s ...<9 lines>... 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3536s await asyncio.gather(*workers) 3536s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3536s return await awaitable 3536s ^^^^^^^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3536s raise asyncio.TimeoutError( 3536s f"{type(self).__name__} start timed out after {timeout}s." 3536s ) from exc 3536s TimeoutError: Worker start timed out after 0s. 3536s 2024-11-23 21:14:23,859 - distributed.scheduler - INFO - State start 3536s 2024-11-23 21:14:23,867 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41015 3536s 2024-11-23 21:14:23,868 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45777/status 3536s 2024-11-23 21:14:23,868 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3536s 2024-11-23 21:14:23,886 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33149 3536s 2024-11-23 21:14:23,886 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33149 3536s 2024-11-23 21:14:23,886 - distributed.worker - INFO - Worker name: 0 3536s 2024-11-23 21:14:23,886 - distributed.worker - INFO - dashboard at: 127.0.0.1:42889 3536s 2024-11-23 21:14:23,886 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41015 3536s 2024-11-23 21:14:23,887 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:14:23,887 - distributed.worker - INFO - Threads: 1 3536s 2024-11-23 21:14:23,887 - distributed.worker - INFO - Memory: 15.58 GiB 3536s 2024-11-23 21:14:23,887 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-4ekhv4sn 3536s 2024-11-23 21:14:23,887 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:14:23,889 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34631 3536s 2024-11-23 21:14:23,889 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34631 3536s 2024-11-23 21:14:23,889 - distributed.worker - INFO - Worker name: 1 3536s 2024-11-23 21:14:23,889 - distributed.worker - INFO - dashboard at: 127.0.0.1:42491 3536s 2024-11-23 21:14:23,889 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41015 3536s 2024-11-23 21:14:23,889 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:14:23,890 - distributed.worker - INFO - Threads: 2 3536s 2024-11-23 21:14:23,890 - distributed.worker - INFO - Memory: 15.58 GiB 3536s 2024-11-23 21:14:23,890 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-akyrvff4 3536s 2024-11-23 21:14:23,890 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:14:23,891 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33149. Reason: failure-to-start- 3536s 2024-11-23 21:14:23,891 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3536s 2024-11-23 21:14:23,892 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34631. Reason: failure-to-start- 3536s 2024-11-23 21:14:23,892 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3536s 2024-11-23 21:14:23,893 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41015': TLS handshake failed with remote 'tls://127.0.0.1:42512': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3536s 2024-11-23 21:14:23,893 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41015': TLS handshake failed with remote 'tls://127.0.0.1:42516': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3536s 2024-11-23 21:14:23,895 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3536s return await fut 3536s ^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3536s await self._register_with_scheduler() 3536s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3536s comm = await connect(self.scheduler.address, **self.connection_args) 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3536s comm = await wait_for( 3536s ^^^^^^^^^^^^^^^ 3536s ...<2 lines>... 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3536s return await fut 3536s ^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3536s stream = await self.client.connect( 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3536s af, addr, stream = await connector.start(connect_timeout=timeout) 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s asyncio.exceptions.CancelledError 3536s 3536s The above exception was the direct cause of the following exception: 3536s 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3536s await wait_for(self.start_unsafe(), timeout=timeout) 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3536s async with asyncio.timeout(timeout): 3536s ~~~~~~~~~~~~~~~^^^^^^^^^ 3536s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3536s raise TimeoutError from exc_val 3536s TimeoutError 3536s 3536s The above exception was the direct cause of the following exception: 3536s 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3536s s, ws = await start_cluster( 3536s ^^^^^^^^^^^^^^^^^^^^ 3536s ...<9 lines>... 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3536s await asyncio.gather(*workers) 3536s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3536s return await awaitable 3536s ^^^^^^^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3536s raise asyncio.TimeoutError( 3536s f"{type(self).__name__} start timed out after {timeout}s." 3536s ) from exc 3536s TimeoutError: Worker start timed out after 0s. 3536s 2024-11-23 21:14:24,901 - distributed.scheduler - INFO - State start 3536s 2024-11-23 21:14:24,912 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37139 3536s 2024-11-23 21:14:24,912 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44865/status 3536s 2024-11-23 21:14:24,913 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3536s 2024-11-23 21:14:24,932 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46251 3536s 2024-11-23 21:14:24,933 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46251 3536s 2024-11-23 21:14:24,933 - distributed.worker - INFO - Worker name: 0 3536s 2024-11-23 21:14:24,933 - distributed.worker - INFO - dashboard at: 127.0.0.1:46799 3536s 2024-11-23 21:14:24,933 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37139 3536s 2024-11-23 21:14:24,933 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:14:24,933 - distributed.worker - INFO - Threads: 1 3536s 2024-11-23 21:14:24,933 - distributed.worker - INFO - Memory: 15.58 GiB 3536s 2024-11-23 21:14:24,933 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-om9zfv7z 3536s 2024-11-23 21:14:24,933 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:14:24,936 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33777 3536s 2024-11-23 21:14:24,936 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33777 3536s 2024-11-23 21:14:24,936 - distributed.worker - INFO - Worker name: 1 3536s 2024-11-23 21:14:24,936 - distributed.worker - INFO - dashboard at: 127.0.0.1:39391 3536s 2024-11-23 21:14:24,936 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37139 3536s 2024-11-23 21:14:24,936 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:14:24,936 - distributed.worker - INFO - Threads: 2 3536s 2024-11-23 21:14:24,936 - distributed.worker - INFO - Memory: 15.58 GiB 3536s 2024-11-23 21:14:24,936 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-r01tdis_ 3536s 2024-11-23 21:14:24,936 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:14:24,941 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46251. Reason: failure-to-start- 3536s 2024-11-23 21:14:24,941 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3536s 2024-11-23 21:14:24,942 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33777. Reason: failure-to-start- 3536s 2024-11-23 21:14:24,942 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3536s 2024-11-23 21:14:24,944 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37139': TLS handshake failed with remote 'tls://127.0.0.1:38686': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3536s 2024-11-23 21:14:24,944 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37139': TLS handshake failed with remote 'tls://127.0.0.1:38700': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3536s 2024-11-23 21:14:24,946 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3536s return await fut 3536s ^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3536s await self._register_with_scheduler() 3536s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3536s comm = await connect(self.scheduler.address, **self.connection_args) 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3536s comm = await wait_for( 3536s ^^^^^^^^^^^^^^^ 3536s ...<2 lines>... 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3536s return await fut 3536s ^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3536s stream = await self.client.connect( 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3536s af, addr, stream = await connector.start(connect_timeout=timeout) 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s asyncio.exceptions.CancelledError 3536s 3536s The above exception was the direct cause of the following exception: 3536s 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3536s await wait_for(self.start_unsafe(), timeout=timeout) 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3536s async with asyncio.timeout(timeout): 3536s ~~~~~~~~~~~~~~~^^^^^^^^^ 3536s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3536s raise TimeoutError from exc_val 3536s TimeoutError 3536s 3536s The above exception was the direct cause of the following exception: 3536s 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3536s s, ws = await start_cluster( 3536s ^^^^^^^^^^^^^^^^^^^^ 3536s ...<9 lines>... 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3536s await asyncio.gather(*workers) 3536s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3536s return await awaitable 3536s ^^^^^^^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3536s raise asyncio.TimeoutError( 3536s f"{type(self).__name__} start timed out after {timeout}s." 3536s ) from exc 3536s TimeoutError: Worker start timed out after 0s. 3536s 2024-11-23 21:14:25,951 - distributed.scheduler - INFO - State start 3536s 2024-11-23 21:14:25,960 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38959 3536s 2024-11-23 21:14:25,960 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43255/status 3536s 2024-11-23 21:14:25,961 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3536s 2024-11-23 21:14:25,978 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39851 3536s 2024-11-23 21:14:25,979 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39851 3536s 2024-11-23 21:14:25,979 - distributed.worker - INFO - Worker name: 0 3536s 2024-11-23 21:14:25,979 - distributed.worker - INFO - dashboard at: 127.0.0.1:45961 3536s 2024-11-23 21:14:25,979 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38959 3536s 2024-11-23 21:14:25,979 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:14:25,979 - distributed.worker - INFO - Threads: 1 3536s 2024-11-23 21:14:25,979 - distributed.worker - INFO - Memory: 15.58 GiB 3536s 2024-11-23 21:14:25,979 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-mx83lwi4 3536s 2024-11-23 21:14:25,979 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:14:25,981 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45963 3536s 2024-11-23 21:14:25,982 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45963 3536s 2024-11-23 21:14:25,982 - distributed.worker - INFO - Worker name: 1 3536s 2024-11-23 21:14:25,982 - distributed.worker - INFO - dashboard at: 127.0.0.1:34405 3536s 2024-11-23 21:14:25,982 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38959 3536s 2024-11-23 21:14:25,982 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:14:25,982 - distributed.worker - INFO - Threads: 2 3536s 2024-11-23 21:14:25,982 - distributed.worker - INFO - Memory: 15.58 GiB 3536s 2024-11-23 21:14:25,982 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-syy7t8ly 3536s 2024-11-23 21:14:25,982 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:14:25,986 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39851. Reason: failure-to-start- 3536s 2024-11-23 21:14:25,986 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3536s 2024-11-23 21:14:25,987 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45963. Reason: failure-to-start- 3536s 2024-11-23 21:14:25,987 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3536s 2024-11-23 21:14:25,989 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38959': TLS handshake failed with remote 'tls://127.0.0.1:44856': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3536s 2024-11-23 21:14:25,989 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38959': TLS handshake failed with remote 'tls://127.0.0.1:44870': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3536s 2024-11-23 21:14:25,994 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3536s return await fut 3536s ^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3536s await self._register_with_scheduler() 3536s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3536s comm = await connect(self.scheduler.address, **self.connection_args) 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3536s comm = await wait_for( 3536s ^^^^^^^^^^^^^^^ 3536s ...<2 lines>... 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3536s return await fut 3536s ^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3536s stream = await self.client.connect( 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3536s af, addr, stream = await connector.start(connect_timeout=timeout) 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s asyncio.exceptions.CancelledError 3536s 3536s The above exception was the direct cause of the following exception: 3536s 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3536s await wait_for(self.start_unsafe(), timeout=timeout) 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3536s async with asyncio.timeout(timeout): 3536s ~~~~~~~~~~~~~~~^^^^^^^^^ 3536s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3536s raise TimeoutError from exc_val 3536s TimeoutError 3536s 3536s The above exception was the direct cause of the following exception: 3536s 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3536s s, ws = await start_cluster( 3536s ^^^^^^^^^^^^^^^^^^^^ 3536s ...<9 lines>... 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3536s await asyncio.gather(*workers) 3536s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3536s return await awaitable 3536s ^^^^^^^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3536s raise asyncio.TimeoutError( 3536s f"{type(self).__name__} start timed out after {timeout}s." 3536s ) from exc 3536s TimeoutError: Worker start timed out after 0s. 3536s 2024-11-23 21:14:27,000 - distributed.scheduler - INFO - State start 3536s 2024-11-23 21:14:27,009 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46737 3536s 2024-11-23 21:14:27,009 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38617/status 3536s 2024-11-23 21:14:27,009 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3536s 2024-11-23 21:14:27,027 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34175 3536s 2024-11-23 21:14:27,027 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34175 3536s 2024-11-23 21:14:27,027 - distributed.worker - INFO - Worker name: 0 3536s 2024-11-23 21:14:27,027 - distributed.worker - INFO - dashboard at: 127.0.0.1:36115 3536s 2024-11-23 21:14:27,027 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46737 3536s 2024-11-23 21:14:27,027 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:14:27,027 - distributed.worker - INFO - Threads: 1 3536s 2024-11-23 21:14:27,027 - distributed.worker - INFO - Memory: 15.58 GiB 3536s 2024-11-23 21:14:27,028 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-v6qubzaf 3536s 2024-11-23 21:14:27,028 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:14:27,030 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:32835 3536s 2024-11-23 21:14:27,030 - distributed.worker - INFO - Listening to: tls://127.0.0.1:32835 3536s 2024-11-23 21:14:27,030 - distributed.worker - INFO - Worker name: 1 3536s 2024-11-23 21:14:27,030 - distributed.worker - INFO - dashboard at: 127.0.0.1:37753 3536s 2024-11-23 21:14:27,030 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46737 3536s 2024-11-23 21:14:27,031 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:14:27,031 - distributed.worker - INFO - Threads: 2 3536s 2024-11-23 21:14:27,031 - distributed.worker - INFO - Memory: 15.58 GiB 3536s 2024-11-23 21:14:27,031 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-m0akp82p 3536s 2024-11-23 21:14:27,032 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:14:27,037 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34175. Reason: failure-to-start- 3536s 2024-11-23 21:14:27,037 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3536s 2024-11-23 21:14:27,038 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:32835. Reason: failure-to-start- 3536s 2024-11-23 21:14:27,038 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3536s 2024-11-23 21:14:27,040 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46737': TLS handshake failed with remote 'tls://127.0.0.1:59736': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3536s 2024-11-23 21:14:27,040 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46737': TLS handshake failed with remote 'tls://127.0.0.1:59746': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3536s 2024-11-23 21:14:27,045 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3536s return await fut 3536s ^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3536s await self._register_with_scheduler() 3536s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3536s comm = await connect(self.scheduler.address, **self.connection_args) 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3536s comm = await wait_for( 3536s ^^^^^^^^^^^^^^^ 3536s ...<2 lines>... 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3536s return await fut 3536s ^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3536s stream = await self.client.connect( 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3536s af, addr, stream = await connector.start(connect_timeout=timeout) 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s asyncio.exceptions.CancelledError 3536s 3536s The above exception was the direct cause of the following exception: 3536s 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3536s await wait_for(self.start_unsafe(), timeout=timeout) 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3536s async with asyncio.timeout(timeout): 3536s ~~~~~~~~~~~~~~~^^^^^^^^^ 3536s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3536s raise TimeoutError from exc_val 3536s TimeoutError 3536s 3536s The above exception was the direct cause of the following exception: 3536s 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3536s s, ws = await start_cluster( 3536s ^^^^^^^^^^^^^^^^^^^^ 3536s ...<9 lines>... 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3536s await asyncio.gather(*workers) 3536s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3536s return await awaitable 3536s ^^^^^^^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3536s raise asyncio.TimeoutError( 3536s f"{type(self).__name__} start timed out after {timeout}s." 3536s ) from exc 3536s TimeoutError: Worker start timed out after 0s. 3536s 2024-11-23 21:14:28,052 - distributed.scheduler - INFO - State start 3536s 2024-11-23 21:14:28,064 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34341 3536s 2024-11-23 21:14:28,065 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39925/status 3536s 2024-11-23 21:14:28,065 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3536s 2024-11-23 21:14:28,091 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43419 3536s 2024-11-23 21:14:28,092 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43419 3536s 2024-11-23 21:14:28,092 - distributed.worker - INFO - Worker name: 0 3536s 2024-11-23 21:14:28,092 - distributed.worker - INFO - dashboard at: 127.0.0.1:35477 3536s 2024-11-23 21:14:28,092 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34341 3536s 2024-11-23 21:14:28,092 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:14:28,092 - distributed.worker - INFO - Threads: 1 3536s 2024-11-23 21:14:28,092 - distributed.worker - INFO - Memory: 15.58 GiB 3536s 2024-11-23 21:14:28,092 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-vp8f4z0d 3536s 2024-11-23 21:14:28,093 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:14:28,096 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45779 3536s 2024-11-23 21:14:28,096 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45779 3536s 2024-11-23 21:14:28,096 - distributed.worker - INFO - Worker name: 1 3536s 2024-11-23 21:14:28,096 - distributed.worker - INFO - dashboard at: 127.0.0.1:41865 3536s 2024-11-23 21:14:28,096 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34341 3536s 2024-11-23 21:14:28,096 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:14:28,097 - distributed.worker - INFO - Threads: 2 3536s 2024-11-23 21:14:28,097 - distributed.worker - INFO - Memory: 15.58 GiB 3536s 2024-11-23 21:14:28,097 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-xa5ofohj 3536s 2024-11-23 21:14:28,097 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:14:28,099 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43419. Reason: failure-to-start- 3536s 2024-11-23 21:14:28,099 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3536s 2024-11-23 21:14:28,100 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45779. Reason: failure-to-start- 3536s 2024-11-23 21:14:28,101 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3536s 2024-11-23 21:14:28,106 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34341': TLS handshake failed with remote 'tls://127.0.0.1:37346': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3536s 2024-11-23 21:14:28,106 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34341': TLS handshake failed with remote 'tls://127.0.0.1:37358': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3536s 2024-11-23 21:14:28,109 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3536s return await fut 3536s ^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3536s await self._register_with_scheduler() 3536s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3536s comm = await connect(self.scheduler.address, **self.connection_args) 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3536s comm = await wait_for( 3536s ^^^^^^^^^^^^^^^ 3536s ...<2 lines>... 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3536s return await fut 3536s ^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3536s stream = await self.client.connect( 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3536s af, addr, stream = await connector.start(connect_timeout=timeout) 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s asyncio.exceptions.CancelledError 3536s 3536s The above exception was the direct cause of the following exception: 3536s 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3536s await wait_for(self.start_unsafe(), timeout=timeout) 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3536s async with asyncio.timeout(timeout): 3536s ~~~~~~~~~~~~~~~^^^^^^^^^ 3536s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3536s raise TimeoutError from exc_val 3536s TimeoutError 3536s 3536s The above exception was the direct cause of the following exception: 3536s 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3536s s, ws = await start_cluster( 3536s ^^^^^^^^^^^^^^^^^^^^ 3536s ...<9 lines>... 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3536s await asyncio.gather(*workers) 3536s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3536s return await awaitable 3536s ^^^^^^^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3536s raise asyncio.TimeoutError( 3536s f"{type(self).__name__} start timed out after {timeout}s." 3536s ) from exc 3536s TimeoutError: Worker start timed out after 0s. 3536s 2024-11-23 21:14:29,116 - distributed.scheduler - INFO - State start 3536s 2024-11-23 21:14:29,129 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44527 3536s 2024-11-23 21:14:29,129 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40819/status 3536s 2024-11-23 21:14:29,130 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3536s 2024-11-23 21:14:29,156 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38069 3536s 2024-11-23 21:14:29,156 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38069 3536s 2024-11-23 21:14:29,156 - distributed.worker - INFO - Worker name: 0 3536s 2024-11-23 21:14:29,156 - distributed.worker - INFO - dashboard at: 127.0.0.1:33863 3536s 2024-11-23 21:14:29,156 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44527 3536s 2024-11-23 21:14:29,156 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:14:29,157 - distributed.worker - INFO - Threads: 1 3536s 2024-11-23 21:14:29,157 - distributed.worker - INFO - Memory: 15.58 GiB 3536s 2024-11-23 21:14:29,157 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-d1nafyem 3536s 2024-11-23 21:14:29,157 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:14:29,160 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42697 3536s 2024-11-23 21:14:29,160 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42697 3536s 2024-11-23 21:14:29,161 - distributed.worker - INFO - Worker name: 1 3536s 2024-11-23 21:14:29,161 - distributed.worker - INFO - dashboard at: 127.0.0.1:41645 3536s 2024-11-23 21:14:29,161 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44527 3536s 2024-11-23 21:14:29,161 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:14:29,161 - distributed.worker - INFO - Threads: 2 3536s 2024-11-23 21:14:29,161 - distributed.worker - INFO - Memory: 15.58 GiB 3536s 2024-11-23 21:14:29,161 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-2qo8qyy4 3536s 2024-11-23 21:14:29,161 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:14:29,164 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38069. Reason: failure-to-start- 3536s 2024-11-23 21:14:29,164 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3536s 2024-11-23 21:14:29,165 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42697. Reason: failure-to-start- 3536s 2024-11-23 21:14:29,165 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3536s 2024-11-23 21:14:29,171 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44527': TLS handshake failed with remote 'tls://127.0.0.1:55488': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3536s 2024-11-23 21:14:29,171 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44527': TLS handshake failed with remote 'tls://127.0.0.1:55492': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3536s 2024-11-23 21:14:29,174 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3536s return await fut 3536s ^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3536s await self._register_with_scheduler() 3536s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3536s comm = await connect(self.scheduler.address, **self.connection_args) 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3536s comm = await wait_for( 3536s ^^^^^^^^^^^^^^^ 3536s ...<2 lines>... 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3536s return await fut 3536s ^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3536s stream = await self.client.connect( 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3536s af, addr, stream = await connector.start(connect_timeout=timeout) 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s asyncio.exceptions.CancelledError 3536s 3536s The above exception was the direct cause of the following exception: 3536s 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3536s await wait_for(self.start_unsafe(), timeout=timeout) 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3536s async with asyncio.timeout(timeout): 3536s ~~~~~~~~~~~~~~~^^^^^^^^^ 3536s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3536s raise TimeoutError from exc_val 3536s TimeoutError 3536s 3536s The above exception was the direct cause of the following exception: 3536s 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3536s s, ws = await start_cluster( 3536s ^^^^^^^^^^^^^^^^^^^^ 3536s ...<9 lines>... 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3536s await asyncio.gather(*workers) 3536s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3536s return await awaitable 3536s ^^^^^^^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3536s raise asyncio.TimeoutError( 3536s f"{type(self).__name__} start timed out after {timeout}s." 3536s ) from exc 3536s TimeoutError: Worker start timed out after 0s. 3536s 2024-11-23 21:14:30,181 - distributed.scheduler - INFO - State start 3536s 2024-11-23 21:14:30,192 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44193 3536s 2024-11-23 21:14:30,192 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35081/status 3536s 2024-11-23 21:14:30,193 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3536s 2024-11-23 21:14:30,222 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36647 3536s 2024-11-23 21:14:30,222 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36647 3536s 2024-11-23 21:14:30,222 - distributed.worker - INFO - Worker name: 0 3536s 2024-11-23 21:14:30,222 - distributed.worker - INFO - dashboard at: 127.0.0.1:42075 3536s 2024-11-23 21:14:30,223 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 3536s 2024-11-23 21:14:30,223 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:14:30,223 - distributed.worker - INFO - Threads: 1 3536s 2024-11-23 21:14:30,223 - distributed.worker - INFO - Memory: 15.58 GiB 3536s 2024-11-23 21:14:30,223 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-tk9oahyf 3536s 2024-11-23 21:14:30,223 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:14:30,226 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45095 3536s 2024-11-23 21:14:30,227 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45095 3536s 2024-11-23 21:14:30,227 - distributed.worker - INFO - Worker name: 1 3536s 2024-11-23 21:14:30,227 - distributed.worker - INFO - dashboard at: 127.0.0.1:35473 3536s 2024-11-23 21:14:30,227 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 3536s 2024-11-23 21:14:30,227 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:14:30,227 - distributed.worker - INFO - Threads: 2 3536s 2024-11-23 21:14:30,228 - distributed.worker - INFO - Memory: 15.58 GiB 3536s 2024-11-23 21:14:30,228 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-8tz_i1vb 3536s 2024-11-23 21:14:30,228 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:14:30,233 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36647. Reason: failure-to-start- 3536s 2024-11-23 21:14:30,234 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3536s 2024-11-23 21:14:30,235 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45095. Reason: failure-to-start- 3536s 2024-11-23 21:14:30,235 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3536s 2024-11-23 21:14:30,237 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:52098': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3536s 2024-11-23 21:14:30,238 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:52112': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3536s 2024-11-23 21:14:30,243 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3536s return await fut 3536s ^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3536s await self._register_with_scheduler() 3536s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3536s comm = await connect(self.scheduler.address, **self.connection_args) 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3536s comm = await wait_for( 3536s ^^^^^^^^^^^^^^^ 3536s ...<2 lines>... 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3536s return await fut 3536s ^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3536s stream = await self.client.connect( 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3536s af, addr, stream = await connector.start(connect_timeout=timeout) 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s asyncio.exceptions.CancelledError 3536s 3536s The above exception was the direct cause of the following exception: 3536s 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3536s await wait_for(self.start_unsafe(), timeout=timeout) 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3536s async with asyncio.timeout(timeout): 3536s ~~~~~~~~~~~~~~~^^^^^^^^^ 3536s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3536s raise TimeoutError from exc_val 3536s TimeoutError 3536s 3536s The above exception was the direct cause of the following exception: 3536s 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3536s s, ws = await start_cluster( 3536s ^^^^^^^^^^^^^^^^^^^^ 3536s ...<9 lines>... 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3536s await asyncio.gather(*workers) 3536s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3536s return await awaitable 3536s ^^^^^^^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3536s raise asyncio.TimeoutError( 3536s f"{type(self).__name__} start timed out after {timeout}s." 3536s ) from exc 3536s TimeoutError: Worker start timed out after 0s. 3536s 2024-11-23 21:14:31,250 - distributed.scheduler - INFO - State start 3536s 2024-11-23 21:14:31,262 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44883 3536s 2024-11-23 21:14:31,262 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40805/status 3536s 2024-11-23 21:14:31,263 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3536s 2024-11-23 21:14:31,291 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43939 3536s 2024-11-23 21:14:31,291 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43939 3536s 2024-11-23 21:14:31,292 - distributed.worker - INFO - Worker name: 0 3536s 2024-11-23 21:14:31,292 - distributed.worker - INFO - dashboard at: 127.0.0.1:41923 3536s 2024-11-23 21:14:31,292 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44883 3536s 2024-11-23 21:14:31,292 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:14:31,292 - distributed.worker - INFO - Threads: 1 3536s 2024-11-23 21:14:31,292 - distributed.worker - INFO - Memory: 15.58 GiB 3536s 2024-11-23 21:14:31,317 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ej_p47gz 3536s 2024-11-23 21:14:31,318 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:14:31,322 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42363 3536s 2024-11-23 21:14:31,322 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42363 3536s 2024-11-23 21:14:31,322 - distributed.worker - INFO - Worker name: 1 3536s 2024-11-23 21:14:31,322 - distributed.worker - INFO - dashboard at: 127.0.0.1:34295 3536s 2024-11-23 21:14:31,322 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44883 3536s 2024-11-23 21:14:31,322 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:14:31,322 - distributed.worker - INFO - Threads: 2 3536s 2024-11-23 21:14:31,322 - distributed.worker - INFO - Memory: 15.58 GiB 3536s 2024-11-23 21:14:31,322 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-mmw0a0js 3536s 2024-11-23 21:14:31,323 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:14:31,329 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43939. Reason: failure-to-start- 3536s 2024-11-23 21:14:31,330 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3536s 2024-11-23 21:14:31,330 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42363. Reason: failure-to-start- 3536s 2024-11-23 21:14:31,331 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3536s 2024-11-23 21:14:31,340 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44883': TLS handshake failed with remote 'tls://127.0.0.1:51980': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3536s 2024-11-23 21:14:31,341 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44883': TLS handshake failed with remote 'tls://127.0.0.1:51992': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3536s 2024-11-23 21:14:31,348 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3536s return await fut 3536s ^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3536s await self._register_with_scheduler() 3536s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3536s comm = await connect(self.scheduler.address, **self.connection_args) 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3536s comm = await wait_for( 3536s ^^^^^^^^^^^^^^^ 3536s ...<2 lines>... 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3536s return await fut 3536s ^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3536s stream = await self.client.connect( 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3536s af, addr, stream = await connector.start(connect_timeout=timeout) 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s asyncio.exceptions.CancelledError 3536s 3536s The above exception was the direct cause of the following exception: 3536s 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3536s await wait_for(self.start_unsafe(), timeout=timeout) 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3536s async with asyncio.timeout(timeout): 3536s ~~~~~~~~~~~~~~~^^^^^^^^^ 3536s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3536s raise TimeoutError from exc_val 3536s TimeoutError 3536s 3536s The above exception was the direct cause of the following exception: 3536s 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3536s s, ws = await start_cluster( 3536s ^^^^^^^^^^^^^^^^^^^^ 3536s ...<9 lines>... 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3536s await asyncio.gather(*workers) 3536s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3536s return await awaitable 3536s ^^^^^^^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3536s raise asyncio.TimeoutError( 3536s f"{type(self).__name__} start timed out after {timeout}s." 3536s ) from exc 3536s TimeoutError: Worker start timed out after 0s. 3536s 2024-11-23 21:14:32,355 - distributed.scheduler - INFO - State start 3536s 2024-11-23 21:14:32,363 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35165 3536s 2024-11-23 21:14:32,363 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38463/status 3536s 2024-11-23 21:14:32,363 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3536s 2024-11-23 21:14:32,382 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38585 3536s 2024-11-23 21:14:32,382 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38585 3536s 2024-11-23 21:14:32,382 - distributed.worker - INFO - Worker name: 0 3536s 2024-11-23 21:14:32,383 - distributed.worker - INFO - dashboard at: 127.0.0.1:36927 3536s 2024-11-23 21:14:32,383 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35165 3536s 2024-11-23 21:14:32,383 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:14:32,383 - distributed.worker - INFO - Threads: 1 3536s 2024-11-23 21:14:32,383 - distributed.worker - INFO - Memory: 15.58 GiB 3536s 2024-11-23 21:14:32,383 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-e7vj0eie 3536s 2024-11-23 21:14:32,383 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:14:32,385 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35611 3536s 2024-11-23 21:14:32,385 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35611 3536s 2024-11-23 21:14:32,386 - distributed.worker - INFO - Worker name: 1 3536s 2024-11-23 21:14:32,386 - distributed.worker - INFO - dashboard at: 127.0.0.1:45203 3536s 2024-11-23 21:14:32,386 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35165 3536s 2024-11-23 21:14:32,386 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:14:32,386 - distributed.worker - INFO - Threads: 2 3536s 2024-11-23 21:14:32,386 - distributed.worker - INFO - Memory: 15.58 GiB 3536s 2024-11-23 21:14:32,386 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-gezz6bil 3536s 2024-11-23 21:14:32,386 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:14:32,390 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38585. Reason: failure-to-start- 3536s 2024-11-23 21:14:32,390 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3536s 2024-11-23 21:14:32,391 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35611. Reason: failure-to-start- 3536s 2024-11-23 21:14:32,391 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3536s 2024-11-23 21:14:32,392 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35165': TLS handshake failed with remote 'tls://127.0.0.1:45444': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3536s 2024-11-23 21:14:32,393 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35165': TLS handshake failed with remote 'tls://127.0.0.1:45456': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3536s 2024-11-23 21:14:32,394 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3536s return await fut 3536s ^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3536s await self._register_with_scheduler() 3536s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3536s comm = await connect(self.scheduler.address, **self.connection_args) 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3536s comm = await wait_for( 3536s ^^^^^^^^^^^^^^^ 3536s ...<2 lines>... 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3536s return await fut 3536s ^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3536s stream = await self.client.connect( 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3536s af, addr, stream = await connector.start(connect_timeout=timeout) 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s asyncio.exceptions.CancelledError 3536s 3536s The above exception was the direct cause of the following exception: 3536s 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3536s await wait_for(self.start_unsafe(), timeout=timeout) 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3536s async with asyncio.timeout(timeout): 3536s ~~~~~~~~~~~~~~~^^^^^^^^^ 3536s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3536s raise TimeoutError from exc_val 3536s TimeoutError 3536s 3536s The above exception was the direct cause of the following exception: 3536s 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3536s s, ws = await start_cluster( 3536s ^^^^^^^^^^^^^^^^^^^^ 3536s ...<9 lines>... 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3536s await asyncio.gather(*workers) 3536s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3536s return await awaitable 3536s ^^^^^^^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3536s raise asyncio.TimeoutError( 3536s f"{type(self).__name__} start timed out after {timeout}s." 3536s ) from exc 3536s TimeoutError: Worker start timed out after 0s. 3536s 2024-11-23 21:14:33,400 - distributed.scheduler - INFO - State start 3536s 2024-11-23 21:14:33,410 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39097 3536s 2024-11-23 21:14:33,411 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42693/status 3536s 2024-11-23 21:14:33,411 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3536s 2024-11-23 21:14:33,431 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38249 3536s 2024-11-23 21:14:33,431 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38249 3536s 2024-11-23 21:14:33,431 - distributed.worker - INFO - Worker name: 0 3536s 2024-11-23 21:14:33,431 - distributed.worker - INFO - dashboard at: 127.0.0.1:39057 3536s 2024-11-23 21:14:33,431 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39097 3536s 2024-11-23 21:14:33,431 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:14:33,431 - distributed.worker - INFO - Threads: 1 3536s 2024-11-23 21:14:33,431 - distributed.worker - INFO - Memory: 15.58 GiB 3536s 2024-11-23 21:14:33,431 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-7a85nvz8 3536s 2024-11-23 21:14:33,431 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:14:33,434 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39117 3536s 2024-11-23 21:14:33,434 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39117 3536s 2024-11-23 21:14:33,434 - distributed.worker - INFO - Worker name: 1 3536s 2024-11-23 21:14:33,434 - distributed.worker - INFO - dashboard at: 127.0.0.1:46023 3536s 2024-11-23 21:14:33,434 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39097 3536s 2024-11-23 21:14:33,434 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:14:33,434 - distributed.worker - INFO - Threads: 2 3536s 2024-11-23 21:14:33,434 - distributed.worker - INFO - Memory: 15.58 GiB 3536s 2024-11-23 21:14:33,434 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-_y1p6qky 3536s 2024-11-23 21:14:33,434 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:14:33,441 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38249. Reason: failure-to-start- 3536s 2024-11-23 21:14:33,441 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3536s 2024-11-23 21:14:33,441 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39117. Reason: failure-to-start- 3536s 2024-11-23 21:14:33,441 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3536s 2024-11-23 21:14:33,443 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39097': TLS handshake failed with remote 'tls://127.0.0.1:60800': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3536s 2024-11-23 21:14:33,443 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39097': TLS handshake failed with remote 'tls://127.0.0.1:60816': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3536s 2024-11-23 21:14:33,445 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3536s return await fut 3536s ^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3536s await self._register_with_scheduler() 3536s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3536s comm = await connect(self.scheduler.address, **self.connection_args) 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3536s comm = await wait_for( 3536s ^^^^^^^^^^^^^^^ 3536s ...<2 lines>... 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3536s return await fut 3536s ^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3536s stream = await self.client.connect( 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3536s af, addr, stream = await connector.start(connect_timeout=timeout) 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s asyncio.exceptions.CancelledError 3536s 3536s The above exception was the direct cause of the following exception: 3536s 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3536s await wait_for(self.start_unsafe(), timeout=timeout) 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3536s async with asyncio.timeout(timeout): 3536s ~~~~~~~~~~~~~~~^^^^^^^^^ 3536s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3536s raise TimeoutError from exc_val 3536s TimeoutError 3536s 3536s The above exception was the direct cause of the following exception: 3536s 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3536s s, ws = await start_cluster( 3536s ^^^^^^^^^^^^^^^^^^^^ 3536s ...<9 lines>... 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3536s await asyncio.gather(*workers) 3536s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3536s return await awaitable 3536s ^^^^^^^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3536s raise asyncio.TimeoutError( 3536s f"{type(self).__name__} start timed out after {timeout}s." 3536s ) from exc 3536s TimeoutError: Worker start timed out after 0s. 3536s 2024-11-23 21:14:34,451 - distributed.scheduler - INFO - State start 3536s 2024-11-23 21:14:34,460 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45683 3536s 2024-11-23 21:14:34,460 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38675/status 3536s 2024-11-23 21:14:34,461 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3536s 2024-11-23 21:14:34,484 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36745 3536s 2024-11-23 21:14:34,485 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36745 3536s 2024-11-23 21:14:34,485 - distributed.worker - INFO - Worker name: 0 3536s 2024-11-23 21:14:34,485 - distributed.worker - INFO - dashboard at: 127.0.0.1:42841 3536s 2024-11-23 21:14:34,485 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45683 3536s 2024-11-23 21:14:34,485 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:14:34,485 - distributed.worker - INFO - Threads: 1 3536s 2024-11-23 21:14:34,485 - distributed.worker - INFO - Memory: 15.58 GiB 3536s 2024-11-23 21:14:34,485 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-4hmye5a8 3536s 2024-11-23 21:14:34,485 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:14:34,488 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34259 3536s 2024-11-23 21:14:34,488 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34259 3536s 2024-11-23 21:14:34,488 - distributed.worker - INFO - Worker name: 1 3536s 2024-11-23 21:14:34,488 - distributed.worker - INFO - dashboard at: 127.0.0.1:42653 3536s 2024-11-23 21:14:34,488 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45683 3536s 2024-11-23 21:14:34,488 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:14:34,488 - distributed.worker - INFO - Threads: 2 3536s 2024-11-23 21:14:34,488 - distributed.worker - INFO - Memory: 15.58 GiB 3536s 2024-11-23 21:14:34,489 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-w1yi29te 3536s 2024-11-23 21:14:34,489 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:14:34,494 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36745. Reason: failure-to-start- 3536s 2024-11-23 21:14:34,494 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3536s 2024-11-23 21:14:34,495 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34259. Reason: failure-to-start- 3536s 2024-11-23 21:14:34,495 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3536s 2024-11-23 21:14:34,501 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45683': TLS handshake failed with remote 'tls://127.0.0.1:59216': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3536s 2024-11-23 21:14:34,501 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45683': TLS handshake failed with remote 'tls://127.0.0.1:59220': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3536s 2024-11-23 21:14:34,503 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3536s return await fut 3536s ^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3536s await self._register_with_scheduler() 3536s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3536s comm = await connect(self.scheduler.address, **self.connection_args) 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3536s comm = await wait_for( 3536s ^^^^^^^^^^^^^^^ 3536s ...<2 lines>... 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3536s return await fut 3536s ^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3536s stream = await self.client.connect( 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3536s af, addr, stream = await connector.start(connect_timeout=timeout) 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s asyncio.exceptions.CancelledError 3536s 3536s The above exception was the direct cause of the following exception: 3536s 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3536s await wait_for(self.start_unsafe(), timeout=timeout) 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3536s async with asyncio.timeout(timeout): 3536s ~~~~~~~~~~~~~~~^^^^^^^^^ 3536s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3536s raise TimeoutError from exc_val 3536s TimeoutError 3536s 3536s The above exception was the direct cause of the following exception: 3536s 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3536s s, ws = await start_cluster( 3536s ^^^^^^^^^^^^^^^^^^^^ 3536s ...<9 lines>... 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3536s await asyncio.gather(*workers) 3536s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3536s return await awaitable 3536s ^^^^^^^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3536s raise asyncio.TimeoutError( 3536s f"{type(self).__name__} start timed out after {timeout}s." 3536s ) from exc 3536s TimeoutError: Worker start timed out after 0s. 3536s 2024-11-23 21:14:35,508 - distributed.scheduler - INFO - State start 3536s 2024-11-23 21:14:35,517 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37661 3536s 2024-11-23 21:14:35,517 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36125/status 3536s 2024-11-23 21:14:35,518 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3536s 2024-11-23 21:14:35,542 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40371 3536s 2024-11-23 21:14:35,542 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40371 3536s 2024-11-23 21:14:35,542 - distributed.worker - INFO - Worker name: 0 3536s 2024-11-23 21:14:35,542 - distributed.worker - INFO - dashboard at: 127.0.0.1:33189 3536s 2024-11-23 21:14:35,542 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37661 3536s 2024-11-23 21:14:35,543 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:14:35,543 - distributed.worker - INFO - Threads: 1 3536s 2024-11-23 21:14:35,543 - distributed.worker - INFO - Memory: 15.58 GiB 3536s 2024-11-23 21:14:35,543 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-citl9vhf 3536s 2024-11-23 21:14:35,543 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:14:35,545 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42901 3536s 2024-11-23 21:14:35,545 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42901 3536s 2024-11-23 21:14:35,545 - distributed.worker - INFO - Worker name: 1 3536s 2024-11-23 21:14:35,545 - distributed.worker - INFO - dashboard at: 127.0.0.1:42607 3536s 2024-11-23 21:14:35,546 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37661 3536s 2024-11-23 21:14:35,546 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:14:35,546 - distributed.worker - INFO - Threads: 2 3536s 2024-11-23 21:14:35,546 - distributed.worker - INFO - Memory: 15.58 GiB 3536s 2024-11-23 21:14:35,546 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-_7c7sbp_ 3536s 2024-11-23 21:14:35,546 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:14:35,550 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40371. Reason: failure-to-start- 3536s 2024-11-23 21:14:35,551 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3536s 2024-11-23 21:14:35,551 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42901. Reason: failure-to-start- 3536s 2024-11-23 21:14:35,551 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3536s 2024-11-23 21:14:35,553 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37661': TLS handshake failed with remote 'tls://127.0.0.1:34570': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3536s 2024-11-23 21:14:35,553 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37661': TLS handshake failed with remote 'tls://127.0.0.1:34580': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3536s 2024-11-23 21:14:35,555 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3536s return await fut 3536s ^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3536s await self._register_with_scheduler() 3536s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3536s comm = await connect(self.scheduler.address, **self.connection_args) 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3536s comm = await wait_for( 3536s ^^^^^^^^^^^^^^^ 3536s ...<2 lines>... 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3536s return await fut 3536s ^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3536s stream = await self.client.connect( 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3536s af, addr, stream = await connector.start(connect_timeout=timeout) 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s asyncio.exceptions.CancelledError 3536s 3536s The above exception was the direct cause of the following exception: 3536s 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3536s await wait_for(self.start_unsafe(), timeout=timeout) 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3536s async with asyncio.timeout(timeout): 3536s ~~~~~~~~~~~~~~~^^^^^^^^^ 3536s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3536s raise TimeoutError from exc_val 3536s TimeoutError 3536s 3536s The above exception was the direct cause of the following exception: 3536s 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3536s s, ws = await start_cluster( 3536s ^^^^^^^^^^^^^^^^^^^^ 3536s ...<9 lines>... 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3536s await asyncio.gather(*workers) 3536s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3536s return await awaitable 3536s ^^^^^^^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3536s raise asyncio.TimeoutError( 3536s f"{type(self).__name__} start timed out after {timeout}s." 3536s ) from exc 3536s TimeoutError: Worker start timed out after 0s. 3536s ------------------------------ Captured log call ------------------------------- 3536s ERROR asyncio:base_events.py:1864 Exception in callback None() 3536s handle: 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 3536s self.socket.do_handshake() 3536s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 3536s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 3536s self._sslobj.do_handshake() 3536s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 3536s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 3536s 3536s During handling of the above exception, another exception occurred: 3536s 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3.13/asyncio/events.py", line 89, in _run 3536s self._context.run(self._callback, *self._args) 3536s ~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/tornado/platform/asyncio.py", line 202, in _handle_events 3536s handler_func(fileobj, events) 3536s ~~~~~~~~~~~~^^^^^^^^^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 691, in _handle_events 3536s self._handle_read() 3536s ~~~~~~~~~~~~~~~~~^^ 3536s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1427, in _handle_read 3536s self._do_ssl_handshake() 3536s ~~~~~~~~~~~~~~~~~~~~~~^^ 3536s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1385, in _do_ssl_handshake 3536s return self.close(exc_info=err) 3536s ~~~~~~~~~~^^^^^^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 606, in close 3536s self._signal_closed() 3536s ~~~~~~~~~~~~~~~~~~~^^ 3536s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 636, in _signal_closed 3536s self._ssl_connect_future.exception() 3536s ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^ 3536s asyncio.exceptions.CancelledError 3536s __________________________________ test_Queue __________________________________ 3536s 3536s fut = , timeout = 0 3536s 3536s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 3536s async with asyncio.timeout(timeout): 3536s > return await fut 3536s 3536s /usr/lib/python3/dist-packages/distributed/utils.py:1960: 3536s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3536s /usr/lib/python3/dist-packages/distributed/worker.py:1480: in start_unsafe 3536s await self._register_with_scheduler() 3536s /usr/lib/python3/dist-packages/distributed/worker.py:1179: in _register_with_scheduler 3536s comm = await connect(self.scheduler.address, **self.connection_args) 3536s /usr/lib/python3/dist-packages/distributed/comm/core.py:342: in connect 3536s comm = await wait_for( 3536s /usr/lib/python3/dist-packages/distributed/utils.py:1960: in wait_for 3536s return await fut 3536s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:546: in connect 3536s stream = await self.client.connect( 3536s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3536s 3536s self = , host = '127.0.0.1' 3536s port = 41441, af = 3536s ssl_options = 3536s max_buffer_size = 8364507136.0, source_ip = None, source_port = None 3536s timeout = None 3536s 3536s async def connect( 3536s self, 3536s host: str, 3536s port: int, 3536s af: socket.AddressFamily = socket.AF_UNSPEC, 3536s ssl_options: Optional[Union[Dict[str, Any], ssl.SSLContext]] = None, 3536s max_buffer_size: Optional[int] = None, 3536s source_ip: Optional[str] = None, 3536s source_port: Optional[int] = None, 3536s timeout: Optional[Union[float, datetime.timedelta]] = None, 3536s ) -> IOStream: 3536s """Connect to the given host and port. 3536s 3536s Asynchronously returns an `.IOStream` (or `.SSLIOStream` if 3536s ``ssl_options`` is not None). 3536s 3536s Using the ``source_ip`` kwarg, one can specify the source 3536s IP address to use when establishing the connection. 3536s In case the user needs to resolve and 3536s use a specific interface, it has to be handled outside 3536s of Tornado as this depends very much on the platform. 3536s 3536s Raises `TimeoutError` if the input future does not complete before 3536s ``timeout``, which may be specified in any form allowed by 3536s `.IOLoop.add_timeout` (i.e. a `datetime.timedelta` or an absolute time 3536s relative to `.IOLoop.time`) 3536s 3536s Similarly, when the user requires a certain source port, it can 3536s be specified using the ``source_port`` arg. 3536s 3536s .. versionchanged:: 4.5 3536s Added the ``source_ip`` and ``source_port`` arguments. 3536s 3536s .. versionchanged:: 5.0 3536s Added the ``timeout`` argument. 3536s """ 3536s if timeout is not None: 3536s if isinstance(timeout, numbers.Real): 3536s timeout = IOLoop.current().time() + timeout 3536s elif isinstance(timeout, datetime.timedelta): 3536s timeout = IOLoop.current().time() + timeout.total_seconds() 3536s else: 3536s raise TypeError("Unsupported timeout %r" % timeout) 3536s if timeout is not None: 3536s addrinfo = await gen.with_timeout( 3536s timeout, self.resolver.resolve(host, port, af) 3536s ) 3536s else: 3536s addrinfo = await self.resolver.resolve(host, port, af) 3536s connector = _Connector( 3536s addrinfo, 3536s functools.partial( 3536s self._create_stream, 3536s max_buffer_size, 3536s source_ip=source_ip, 3536s source_port=source_port, 3536s ), 3536s ) 3536s > af, addr, stream = await connector.start(connect_timeout=timeout) 3536s E asyncio.exceptions.CancelledError 3536s 3536s /usr/lib/python3/dist-packages/tornado/tcpclient.py:279: CancelledError 3536s 3536s The above exception was the direct cause of the following exception: 3536s 3536s self = 3536s 3536s @final 3536s async def start(self): 3536s async with self._startup_lock: 3536s if self.status == Status.failed: 3536s assert self.__startup_exc is not None 3536s raise self.__startup_exc 3536s elif self.status != Status.init: 3536s return self 3536s timeout = getattr(self, "death_timeout", None) 3536s 3536s async def _close_on_failure(exc: Exception) -> None: 3536s await self.close(reason=f"failure-to-start-{str(type(exc))}") 3536s self.status = Status.failed 3536s self.__startup_exc = exc 3536s 3536s try: 3536s > await wait_for(self.start_unsafe(), timeout=timeout) 3536s 3536s /usr/lib/python3/dist-packages/distributed/core.py:664: 3536s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3536s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 3536s async with asyncio.timeout(timeout): 3536s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3536s 3536s self = 3536s exc_type = 3536s exc_val = CancelledError(), exc_tb = 3536s 3536s async def __aexit__( 3536s self, 3536s exc_type: Optional[Type[BaseException]], 3536s exc_val: Optional[BaseException], 3536s exc_tb: Optional[TracebackType], 3536s ) -> Optional[bool]: 3536s assert self._state in (_State.ENTERED, _State.EXPIRING) 3536s 3536s if self._timeout_handler is not None: 3536s self._timeout_handler.cancel() 3536s self._timeout_handler = None 3536s 3536s if self._state is _State.EXPIRING: 3536s self._state = _State.EXPIRED 3536s 3536s if self._task.uncancel() <= self._cancelling and exc_type is not None: 3536s # Since there are no new cancel requests, we're 3536s # handling this. 3536s if issubclass(exc_type, exceptions.CancelledError): 3536s > raise TimeoutError from exc_val 3536s E TimeoutError 3536s 3536s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 3536s 3536s The above exception was the direct cause of the following exception: 3536s 3536s @contextlib.asynccontextmanager 3536s async def _cluster_factory(): 3536s workers = [] 3536s s = None 3536s try: 3536s for _ in range(60): 3536s try: 3536s > s, ws = await start_cluster( 3536s nthreads, 3536s scheduler, 3536s security=security, 3536s Worker=Worker, 3536s scheduler_kwargs=scheduler_kwargs, 3536s worker_kwargs=merge( 3536s {"death_timeout": min(15, int(deadline.remaining))}, 3536s worker_kwargs, 3536s ), 3536s ) 3536s 3536s /usr/lib/python3/dist-packages/distributed/utils_test.py:966: 3536s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3536s /usr/lib/python3/dist-packages/distributed/utils_test.py:789: in start_cluster 3536s await asyncio.gather(*workers) 3536s /usr/lib/python3.13/asyncio/tasks.py:737: in _wrap_awaitable 3536s return await awaitable 3536s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3536s 3536s self = 3536s 3536s @final 3536s async def start(self): 3536s async with self._startup_lock: 3536s if self.status == Status.failed: 3536s assert self.__startup_exc is not None 3536s raise self.__startup_exc 3536s elif self.status != Status.init: 3536s return self 3536s timeout = getattr(self, "death_timeout", None) 3536s 3536s async def _close_on_failure(exc: Exception) -> None: 3536s await self.close(reason=f"failure-to-start-{str(type(exc))}") 3536s self.status = Status.failed 3536s self.__startup_exc = exc 3536s 3536s try: 3536s await wait_for(self.start_unsafe(), timeout=timeout) 3536s except asyncio.TimeoutError as exc: 3536s await _close_on_failure(exc) 3536s > raise asyncio.TimeoutError( 3536s f"{type(self).__name__} start timed out after {timeout}s." 3536s ) from exc 3536s E TimeoutError: Worker start timed out after 0s. 3536s 3536s /usr/lib/python3/dist-packages/distributed/core.py:667: TimeoutError 3536s 3536s During handling of the above exception, another exception occurred: 3536s 3536s fut = ._..test_func..async_fn at 0xe247c768> 3536s timeout = 60 3536s 3536s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 3536s async with asyncio.timeout(timeout): 3536s > return await fut 3536s 3536s /usr/lib/python3/dist-packages/distributed/utils.py:1960: 3536s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3536s /usr/lib/python3/dist-packages/distributed/utils_test.py:999: in async_fn 3536s _cluster_factory() as (s, workers), 3536s /usr/lib/python3.13/contextlib.py:214: in __aenter__ 3536s return await anext(self.gen) 3536s /usr/lib/python3/dist-packages/distributed/utils_test.py:983: in _cluster_factory 3536s await asyncio.sleep(1) 3536s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3536s 3536s delay = 1, result = None 3536s 3536s async def sleep(delay, result=None): 3536s """Coroutine that completes after a given time (in seconds).""" 3536s if delay <= 0: 3536s await __sleep0() 3536s return result 3536s 3536s if math.isnan(delay): 3536s raise ValueError("Invalid delay: NaN (not a number)") 3536s 3536s loop = events.get_running_loop() 3536s future = loop.create_future() 3536s h = loop.call_later(delay, 3536s futures._set_result_unless_cancelled, 3536s future, result) 3536s try: 3536s > return await future 3536s E asyncio.exceptions.CancelledError 3536s 3536s /usr/lib/python3.13/asyncio/tasks.py:718: CancelledError 3536s 3536s The above exception was the direct cause of the following exception: 3536s 3536s args = (), kwds = {} 3536s 3536s @wraps(func) 3536s def inner(*args, **kwds): 3536s with self._recreate_cm(): 3536s > return func(*args, **kwds) 3536s 3536s /usr/lib/python3.13/contextlib.py:85: 3536s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3536s /usr/lib/python3.13/contextlib.py:85: in inner 3536s return func(*args, **kwds) 3536s /usr/lib/python3/dist-packages/distributed/utils_test.py:1102: in test_func 3536s return _run_and_close_tornado(async_fn_outer) 3536s /usr/lib/python3/dist-packages/distributed/utils_test.py:378: in _run_and_close_tornado 3536s return asyncio_run(inner_fn(), loop_factory=get_loop_factory()) 3536s /usr/lib/python3.13/asyncio/runners.py:194: in run 3536s return runner.run(main) 3536s /usr/lib/python3.13/asyncio/runners.py:118: in run 3536s return self._loop.run_until_complete(task) 3536s /usr/lib/python3.13/asyncio/base_events.py:720: in run_until_complete 3536s return future.result() 3536s /usr/lib/python3/dist-packages/distributed/utils_test.py:375: in inner_fn 3536s return await async_fn(*args, **kwargs) 3536s /usr/lib/python3/dist-packages/distributed/utils_test.py:1099: in async_fn_outer 3536s return await utils_wait_for(async_fn(), timeout=timeout * 2) 3536s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 3536s async with asyncio.timeout(timeout): 3536s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3536s 3536s self = 3536s exc_type = 3536s exc_val = CancelledError(), exc_tb = 3536s 3536s async def __aexit__( 3536s self, 3536s exc_type: Optional[Type[BaseException]], 3536s exc_val: Optional[BaseException], 3536s exc_tb: Optional[TracebackType], 3536s ) -> Optional[bool]: 3536s assert self._state in (_State.ENTERED, _State.EXPIRING) 3536s 3536s if self._timeout_handler is not None: 3536s self._timeout_handler.cancel() 3536s self._timeout_handler = None 3536s 3536s if self._state is _State.EXPIRING: 3536s self._state = _State.EXPIRED 3536s 3536s if self._task.uncancel() <= self._cancelling and exc_type is not None: 3536s # Since there are no new cancel requests, we're 3536s # handling this. 3536s if issubclass(exc_type, exceptions.CancelledError): 3536s > raise TimeoutError from exc_val 3536s E TimeoutError 3536s 3536s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 3536s ----------------------------- Captured stderr call ----------------------------- 3536s 2024-11-23 21:14:36,874 - distributed.scheduler - INFO - State start 3536s 2024-11-23 21:14:36,884 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:36,884 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41473/status 3536s 2024-11-23 21:14:36,884 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3536s 2024-11-23 21:14:36,901 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43007 3536s 2024-11-23 21:14:36,901 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43007 3536s 2024-11-23 21:14:36,901 - distributed.worker - INFO - Worker name: 0 3536s 2024-11-23 21:14:36,901 - distributed.worker - INFO - dashboard at: 127.0.0.1:38045 3536s 2024-11-23 21:14:36,901 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:36,901 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:14:36,901 - distributed.worker - INFO - Threads: 1 3536s 2024-11-23 21:14:36,901 - distributed.worker - INFO - Memory: 15.58 GiB 3536s 2024-11-23 21:14:36,901 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-y8992ym4 3536s 2024-11-23 21:14:36,901 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:14:36,904 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33801 3536s 2024-11-23 21:14:36,904 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33801 3536s 2024-11-23 21:14:36,904 - distributed.worker - INFO - Worker name: 1 3536s 2024-11-23 21:14:36,904 - distributed.worker - INFO - dashboard at: 127.0.0.1:45317 3536s 2024-11-23 21:14:36,904 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:36,904 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:14:36,904 - distributed.worker - INFO - Threads: 2 3536s 2024-11-23 21:14:36,904 - distributed.worker - INFO - Memory: 15.58 GiB 3536s 2024-11-23 21:14:36,904 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-8x4z68v4 3536s 2024-11-23 21:14:36,904 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:14:36,917 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:36,917 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:36,919 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:46698': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:36,919 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:46714': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:37,025 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:37,026 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:46728': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:37,032 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:37,032 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:46732': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:37,133 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:37,134 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:46748': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:37,141 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:37,141 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:46758': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:37,241 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:37,241 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:46774': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:37,248 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:37,248 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:46786': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:37,349 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:37,349 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:46790': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:37,356 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:37,356 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:46792': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:37,456 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:37,457 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:46794': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:37,464 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:37,464 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:46802': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:37,565 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:37,566 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:46812': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:37,572 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:37,572 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:46828': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:37,673 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:37,673 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:46836': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:37,679 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:37,680 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:46842': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:37,781 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:37,781 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:46858': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:37,788 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:37,788 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:46862': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:37,889 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:37,893 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:46864': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:37,900 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:37,901 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:46868': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:37,996 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:37,997 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:46876': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:38,008 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:38,008 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:46878': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:38,104 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:38,105 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:46886': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:38,116 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:38,116 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:46888': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:38,214 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:38,214 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:46898': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:38,223 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:38,223 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:46904': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:38,321 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:38,321 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:46906': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:38,330 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:38,331 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:46910': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:38,429 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:38,429 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:46926': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:38,437 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:38,438 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:46938': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:38,537 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:38,538 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:46948': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:38,544 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:38,544 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:46960': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:38,646 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:38,646 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:46976': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:38,652 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:38,653 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:46986': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:38,754 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:38,754 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:46994': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:38,761 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:38,761 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:46998': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:38,862 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:38,862 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:47006': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:38,869 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:38,869 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:47014': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:38,970 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:38,970 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:47024': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:38,976 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:38,977 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:47036': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:39,078 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:39,078 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:47038': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:39,085 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:39,086 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:47048': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:39,186 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:39,186 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:47058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:39,192 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:39,193 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:47074': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:39,293 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:39,294 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:47086': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:39,300 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:39,300 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:47094': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:39,401 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:39,402 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:47100': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:39,408 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:39,408 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:47114': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:39,509 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:39,510 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:47130': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:39,516 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:39,516 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:47132': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:39,617 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:39,618 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:47134': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:39,624 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:39,626 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:47138': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:39,725 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:39,725 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:47144': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:39,733 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:39,734 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:47156': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:39,833 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:39,833 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:47170': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:39,841 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:39,842 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:47174': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:39,941 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:39,941 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:47190': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:39,948 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:39,948 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:47204': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:40,049 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:40,050 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:47208': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:40,056 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:40,057 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:47210': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:40,157 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:40,157 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:47220': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:40,164 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:40,164 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:47230': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:40,265 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:40,266 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:47232': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:40,272 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:40,273 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:47246': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:40,374 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:40,375 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:47252': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:40,381 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:40,382 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:47262': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:40,484 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:40,485 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:47276': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:40,491 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:40,491 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:47282': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:40,592 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:40,593 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:47286': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:40,599 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:40,600 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:47302': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:40,700 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:40,701 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:47314': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:40,707 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:40,707 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:47322': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:40,808 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:40,809 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:47326': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:40,815 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:40,815 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:47328': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:40,916 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:40,916 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:47334': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:40,922 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:40,923 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:47336': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:41,024 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:41,025 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:47350': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:41,032 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:41,032 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:47362': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:41,134 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:41,135 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:47364': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:41,146 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:41,146 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:47374': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:41,242 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:41,242 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:47388': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:41,253 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:41,253 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:47394': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:41,349 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:41,349 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:47396': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:41,360 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:41,361 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:47404': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:41,457 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:41,457 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:47418': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:41,468 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:41,468 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:47434': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:41,565 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:41,566 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:42064': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:41,575 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:41,576 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:42076': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:41,673 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:41,673 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:42092': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:41,683 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:41,683 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:42100': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:41,781 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:41,781 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:42102': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:41,790 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:41,791 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:42110': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:41,889 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:41,893 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:42124': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:41,900 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:41,900 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:42132': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:41,997 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:41,997 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:42146': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:42,007 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:42,008 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:42154': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:42,107 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:42,107 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:42168': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:42,115 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:42,116 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:42170': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:42,215 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:42,216 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:42180': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:42,222 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:42,223 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:42188': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:42,323 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:42,324 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:42204': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:42,330 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:42,331 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:42212': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:42,431 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:42,432 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:42218': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:42,438 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:42,439 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:42230': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:42,539 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:42,539 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:42240': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:42,546 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:42,546 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:42248': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:42,646 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:42,647 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:42262': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:42,655 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:42,655 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:42274': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:42,754 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:42,755 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:42278': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:42,761 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:42,762 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:42294': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:42,863 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:42,864 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:42298': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:42,870 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:42,870 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:42304': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:42,970 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:42,971 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:42320': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:42,977 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:42,978 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:42326': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:43,078 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:43,079 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:42338': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:43,085 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:43,086 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:42348': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:43,186 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:43,187 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:42350': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:43,193 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:43,194 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:42366': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:43,295 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:43,295 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:42370': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:43,302 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:43,302 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:42376': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:43,402 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:43,402 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:42392': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:43,409 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:43,409 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:42398': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:43,511 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:43,512 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:42406': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:43,518 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:43,519 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:42418': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:43,619 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:43,620 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:42428': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:43,626 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:43,627 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:42438': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:43,727 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:43,727 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:42448': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:43,734 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:43,734 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:42452': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:43,838 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:43,840 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:42458': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:43,847 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:43,848 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:42470': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:43,948 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:43,949 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:42484': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:43,957 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:43,957 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:42500': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:44,058 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:44,059 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:42512': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:44,067 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:44,068 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:42524': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:44,167 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:44,168 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:42528': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:44,178 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:44,179 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:42530': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:44,277 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:44,278 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:42538': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:44,287 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:44,288 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:42554': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:44,387 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:44,392 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:42564': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:44,401 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:44,401 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:42568': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:44,497 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:44,498 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:42576': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:44,509 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:44,510 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:42578': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:44,608 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:44,609 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:42594': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:44,619 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:44,620 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:42604': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:44,718 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:44,719 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:42618': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:44,728 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:44,729 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:42622': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:44,828 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:44,829 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:42624': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:44,838 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:44,839 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:42634': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:44,938 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:44,939 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:42644': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:44,947 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:44,948 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:42650': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:45,048 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:45,049 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:42658': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:45,058 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:45,059 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:42666': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:45,158 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:45,159 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:42674': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:45,167 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:45,168 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:42680': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:45,268 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:45,269 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:42696': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:45,277 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:45,278 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:42698': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:45,377 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:45,378 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:42714': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:45,387 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:45,393 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:42728': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:45,488 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:45,489 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:42730': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:45,497 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:45,498 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:42746': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:45,598 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:45,599 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:42754': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:45,607 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:45,608 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:42770': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:45,707 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:45,708 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:42784': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:45,718 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:45,719 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:42786': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:45,817 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:45,818 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:42802': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:45,827 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:45,828 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:42806': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:45,927 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:45,927 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:42812': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:45,936 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:45,936 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:42828': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:46,036 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:46,037 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:42842': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:46,046 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:46,047 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:42852': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:46,146 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:46,146 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:42866': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:46,155 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:46,156 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:42880': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:46,255 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:46,256 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:42888': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:46,265 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:46,265 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:42890': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:46,366 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:46,367 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:42894': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:46,375 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:46,376 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:42910': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:46,476 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:46,477 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:42918': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:46,485 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:46,486 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:42920': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:46,586 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:46,587 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:42936': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:46,596 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:46,596 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:42950': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:46,696 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:46,697 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:42966': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:46,705 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:46,706 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:42974': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:46,805 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:46,806 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:42976': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:46,814 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:46,815 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:42988': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:46,915 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:46,916 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:43004': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:46,924 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:46,925 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:43014': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:47,024 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:47,025 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:43020': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:47,033 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:47,034 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:43034': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:47,133 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:47,134 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:43046': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:47,142 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:47,143 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:43054': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:47,242 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:47,243 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:43066': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:47,253 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:47,254 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:43070': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:47,352 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:47,353 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:43078': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:47,361 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:47,362 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:43080': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:47,462 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:47,463 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:43082': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:47,471 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:47,472 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:43086': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:47,571 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:47,572 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:43090': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:47,580 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:47,581 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:43092': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:47,681 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:47,682 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:43096': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:47,691 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:47,691 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:43098': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:47,792 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:47,792 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:43104': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:47,801 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:47,802 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:43108': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:47,901 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:47,902 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:43124': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:47,910 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:47,911 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:43134': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:48,011 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:48,011 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:43136': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:48,020 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:48,020 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:43142': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:48,121 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:48,122 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:43144': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:48,130 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:48,131 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:43158': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:48,231 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:48,231 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:43160': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:48,240 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:48,241 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:43170': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:48,340 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:48,341 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:43182': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:48,349 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:48,350 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:43184': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:48,449 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:48,450 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:43194': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:48,458 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:48,459 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:43206': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:48,558 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:48,559 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:43222': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:48,568 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:48,568 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:43234': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:48,668 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:48,669 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:43240': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:48,677 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:48,678 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:43242': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:48,777 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:48,778 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:43258': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:48,788 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:48,789 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:43268': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:48,887 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:48,893 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:43270': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:48,902 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:48,902 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:43282': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:48,997 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:48,997 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:43294': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:49,011 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:49,012 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:43300': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:49,107 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:49,108 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:43312': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:49,120 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:49,121 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:43328': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:49,217 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:49,218 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:43342': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:49,229 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:49,230 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:43356': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:49,326 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:49,327 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:43360': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:49,338 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:49,339 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:43374': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:49,436 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:49,437 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:43386': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:49,448 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:49,449 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:43390': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:49,545 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:49,546 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:43398': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:49,557 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:49,558 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:43406': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:49,655 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:49,655 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:43414': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:49,667 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:49,668 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:43428': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:49,764 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:49,764 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:43438': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:49,776 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:49,777 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:43442': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:49,873 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:49,874 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:43456': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:49,886 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:49,887 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:43468': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:49,983 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:49,984 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:43472': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:49,994 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:49,995 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:43478': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:50,092 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:50,093 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:43492': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:50,104 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:50,105 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:43494': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:50,202 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:50,203 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:43498': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:50,213 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:50,214 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:43512': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:50,311 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:50,312 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:43522': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:50,324 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:50,325 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:43528': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:50,420 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:50,421 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:43530': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:50,434 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:50,434 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:43542': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:50,531 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:50,531 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:43554': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:50,543 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:50,543 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:43562': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:50,641 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:50,641 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:43564': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:50,652 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:50,653 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:43566': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:50,750 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:50,751 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:43582': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:50,761 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:50,762 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:43584': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:50,860 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:50,861 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:43594': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:50,870 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:50,871 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:43604': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:50,971 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:50,972 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:43620': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:50,980 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:50,980 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:43626': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:51,082 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:51,083 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:43628': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:51,091 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:51,092 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:43634': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:51,191 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:51,192 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:43638': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:51,200 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:51,201 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:43644': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:51,300 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:51,301 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:43660': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:51,309 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:51,310 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:43676': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:51,410 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:51,410 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:43680': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:51,419 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:51,419 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:43688': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:51,518 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:51,519 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:43698': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:51,527 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:51,528 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:43700': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:51,627 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:51,628 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:52422': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:51,636 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:51,637 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:52432': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:51,736 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:51,737 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:52444': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:51,745 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:51,746 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:52454': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:51,847 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:51,849 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:52470': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:51,858 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 3536s 2024-11-23 21:14:51,858 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:52474': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:51,901 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43007. Reason: failure-to-start- 3536s 2024-11-23 21:14:51,901 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3536s 2024-11-23 21:14:51,903 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33801. Reason: failure-to-start- 3536s 2024-11-23 21:14:51,904 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3536s 2024-11-23 21:14:51,906 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 15s.; retrying 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3536s stream = await self.client.connect( 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 3536s stream = await stream.start_tls( 3536s ^^^^^^^^^^^^^^^^^^^^^^^ 3536s False, ssl_options=ssl_options, server_hostname=host 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 3536s self.socket.do_handshake() 3536s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 3536s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 3536s self._sslobj.do_handshake() 3536s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 3536s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 3536s 3536s The above exception was the direct cause of the following exception: 3536s 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3536s comm = await connect(self.scheduler.address, **self.connection_args) 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3536s comm = await wait_for( 3536s ^^^^^^^^^^^^^^^ 3536s ...<2 lines>... 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3536s return await fut 3536s ^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 3536s raise FatalCommClosedError( 3536s ...<2 lines>... 3536s ) from err 3536s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 3536s 3536s During handling of the above exception, another exception occurred: 3536s 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3536s return await fut 3536s ^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3536s await self._register_with_scheduler() 3536s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1218, in _register_with_scheduler 3536s await asyncio.sleep(0.1) 3536s File "/usr/lib/python3.13/asyncio/tasks.py", line 718, in sleep 3536s return await future 3536s ^^^^^^^^^^^^ 3536s asyncio.exceptions.CancelledError 3536s 3536s The above exception was the direct cause of the following exception: 3536s 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3536s await wait_for(self.start_unsafe(), timeout=timeout) 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3536s async with asyncio.timeout(timeout): 3536s ~~~~~~~~~~~~~~~^^^^^^^^^ 3536s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3536s raise TimeoutError from exc_val 3536s TimeoutError 3536s 3536s The above exception was the direct cause of the following exception: 3536s 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3536s s, ws = await start_cluster( 3536s ^^^^^^^^^^^^^^^^^^^^ 3536s ...<9 lines>... 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3536s await asyncio.gather(*workers) 3536s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3536s return await awaitable 3536s ^^^^^^^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3536s raise asyncio.TimeoutError( 3536s f"{type(self).__name__} start timed out after {timeout}s." 3536s ) from exc 3536s TimeoutError: Worker start timed out after 15s. 3536s 2024-11-23 21:14:52,916 - distributed.scheduler - INFO - State start 3536s 2024-11-23 21:14:52,928 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46069 3536s 2024-11-23 21:14:52,928 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44959/status 3536s 2024-11-23 21:14:52,929 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3536s 2024-11-23 21:14:52,954 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40015 3536s 2024-11-23 21:14:52,954 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40015 3536s 2024-11-23 21:14:52,954 - distributed.worker - INFO - Worker name: 0 3536s 2024-11-23 21:14:52,954 - distributed.worker - INFO - dashboard at: 127.0.0.1:46007 3536s 2024-11-23 21:14:52,954 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:14:52,954 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:14:52,954 - distributed.worker - INFO - Threads: 1 3536s 2024-11-23 21:14:52,954 - distributed.worker - INFO - Memory: 15.58 GiB 3536s 2024-11-23 21:14:52,954 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-j32w1hq1 3536s 2024-11-23 21:14:52,954 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:14:52,958 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46601 3536s 2024-11-23 21:14:52,958 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46601 3536s 2024-11-23 21:14:52,958 - distributed.worker - INFO - Worker name: 1 3536s 2024-11-23 21:14:52,958 - distributed.worker - INFO - dashboard at: 127.0.0.1:44969 3536s 2024-11-23 21:14:52,958 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:14:52,959 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:14:52,959 - distributed.worker - INFO - Threads: 2 3536s 2024-11-23 21:14:52,959 - distributed.worker - INFO - Memory: 15.58 GiB 3536s 2024-11-23 21:14:52,959 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-1v0x9xxq 3536s 2024-11-23 21:14:52,959 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:14:52,974 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:14:52,975 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:14:52,975 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:58650': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:52,975 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:58662': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:53,090 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:14:53,091 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:14:53,092 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:58670': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:53,092 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:58682': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:53,208 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:14:53,208 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:14:53,209 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:58690': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:53,209 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:58702': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:53,323 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:14:53,324 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:14:53,331 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:58706': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:53,331 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:58708': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:53,433 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:14:53,439 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:58722': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:53,446 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:14:53,447 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:58724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:53,542 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:14:53,543 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:58734': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:53,556 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:14:53,557 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:58750': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:53,652 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:14:53,653 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:58760': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:53,666 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:14:53,666 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:58772': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:53,762 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:14:53,763 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:58786': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:53,775 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:14:53,776 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:58802': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:53,872 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:14:53,872 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:58812': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:53,884 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:14:53,885 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:58816': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:53,981 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:14:53,982 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:58832': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:53,994 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:14:53,995 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:58842': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:54,092 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:14:54,093 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:58844': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:54,102 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:14:54,103 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:58854': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:54,202 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:14:54,203 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:58864': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:54,211 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:14:54,212 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:58870': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:54,312 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:14:54,313 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:58886': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:54,321 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:14:54,322 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:58902': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:54,422 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:14:54,423 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:58904': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:54,431 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:14:54,436 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:58920': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:54,532 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:14:54,533 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:58930': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:54,542 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:14:54,542 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:58936': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:54,642 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:14:54,642 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:58938': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:54,651 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:14:54,652 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:58946': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:54,751 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:14:54,752 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:58948': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:54,760 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:14:54,761 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:58962': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:54,862 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:14:54,862 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:58968': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:54,871 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:14:54,872 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:58976': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:54,972 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:14:54,973 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:58978': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:54,981 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:14:54,982 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:58982': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:55,082 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:14:55,083 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:58988': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:55,092 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:14:55,092 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:59004': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:55,192 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:14:55,193 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:59016': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:55,202 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:14:55,203 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:59032': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:55,304 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:14:55,304 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:59048': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:55,313 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:14:55,314 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:59062': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:55,413 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:14:55,414 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:59070': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:55,423 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:14:55,424 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:59086': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:55,524 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:14:55,525 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:59094': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:55,533 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:14:55,535 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:59100': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:55,634 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:14:55,635 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:59102': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:55,643 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:14:55,644 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:59108': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:55,743 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:14:55,744 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:59122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:55,753 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:14:55,754 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:59130': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:55,853 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:14:55,854 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:59142': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:55,863 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:14:55,864 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:59150': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:55,964 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:14:55,965 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:59152': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:55,974 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:14:55,974 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:59154': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:56,074 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:14:56,075 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:59170': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:56,083 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:14:56,084 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:59172': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:56,184 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:14:56,185 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:59186': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:56,193 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:14:56,194 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:59192': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:56,294 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:14:56,295 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:59208': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:56,304 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:14:56,305 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:59224': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:56,404 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:14:56,405 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:59234': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:56,414 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:14:56,414 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:59250': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:56,515 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:14:56,516 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:59252': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:56,525 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:14:56,526 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:59258': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:56,625 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:14:56,626 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:59268': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:56,634 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:14:56,635 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:59282': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:56,735 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:14:56,736 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:59294': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:56,744 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:14:56,745 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:59304': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:56,845 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:14:56,846 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:59316': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:56,855 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:14:56,856 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:59328': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:56,955 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:14:56,956 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:59332': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:56,965 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:14:56,966 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:59340': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:57,066 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:14:57,067 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:59344': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:57,075 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:14:57,076 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:59350': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:57,176 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:14:57,177 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:59366': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:57,186 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:14:57,186 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:59382': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:57,286 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:14:57,287 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:59392': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:57,296 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:14:57,296 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:59408': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:57,399 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:14:57,401 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:59410': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:57,409 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:14:57,410 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:59414': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:57,509 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:14:57,510 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:59422': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:57,518 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:14:57,519 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:59428': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:57,619 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:14:57,620 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:59444': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:57,628 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:14:57,629 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:59458': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:57,729 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:14:57,729 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:59470': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:57,738 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:14:57,739 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:59472': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:57,839 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:14:57,840 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:59474': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:57,848 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:14:57,849 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:59486': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:57,949 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:14:57,950 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:59492': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:57,958 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:14:57,959 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:59500': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:58,059 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:14:58,060 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:59508': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:58,068 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:14:58,069 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:59510': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:58,171 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:14:58,173 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:59520': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:58,180 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:14:58,181 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:59536': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:58,282 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:14:58,283 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:59546': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:58,292 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:14:58,292 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:59550': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:58,396 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:14:58,398 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:59558': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:58,406 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:14:58,406 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:59562': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:58,506 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:14:58,507 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:59576': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:58,516 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:14:58,516 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:59586': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:58,617 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:14:58,618 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:59590': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:58,626 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:14:58,627 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:59592': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:58,727 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:14:58,728 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:59598': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:58,736 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:14:58,737 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:59612': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:58,837 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:14:58,838 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:59628': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:58,846 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:14:58,847 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:59630': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:58,947 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:14:58,948 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:59640': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:58,957 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:14:58,957 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:59644': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:59,058 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:14:59,059 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:59650': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:59,067 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:14:59,068 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:59654': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:59,168 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:14:59,168 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:59670': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:59,177 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:14:59,178 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:59684': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:59,278 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:14:59,279 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:59688': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:59,288 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:14:59,289 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:59704': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:59,389 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:14:59,395 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:59718': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:59,403 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:14:59,404 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:59726': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:59,499 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:14:59,500 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:59742': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:59,513 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:14:59,514 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:59754': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:59,609 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:14:59,610 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:59770': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:59,623 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:14:59,623 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:59784': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:59,719 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:14:59,719 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:59800': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:59,732 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:14:59,733 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:59816': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:59,829 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:14:59,829 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:59830': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:59,844 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:14:59,845 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:59840': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:59,944 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:14:59,945 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:59850': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:14:59,953 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:14:59,954 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:59866': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:15:00,054 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:15:00,055 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:59870': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:15:00,064 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:15:00,065 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:59876': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:15:00,164 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:15:00,165 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:59892': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:15:00,173 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:15:00,174 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:59908': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:15:00,274 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:15:00,275 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:59920': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:15:00,284 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:15:00,285 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:59932': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:15:00,385 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:15:00,386 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:59944': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:15:00,399 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:15:00,400 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:59954': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:15:00,494 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:15:00,495 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:59968': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:15:00,509 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:15:00,510 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:59982': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:15:00,604 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:15:00,605 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:59992': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:15:00,619 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:15:00,620 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:59994': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:15:00,713 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:15:00,714 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:60008': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:15:00,728 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:15:00,729 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:60012': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:15:00,823 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:15:00,824 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:60014': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:15:00,838 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:15:00,839 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:60018': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:15:00,933 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:15:00,939 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:60028': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:15:00,947 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:15:00,948 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:60030': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:15:01,043 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:15:01,044 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:60034': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:15:01,057 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:15:01,058 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:60038': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:15:01,154 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:15:01,155 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:60048': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:15:01,167 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:15:01,168 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:60056': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:15:01,264 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:15:01,264 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:60062': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:15:01,276 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:15:01,277 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:60064': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:15:01,373 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:15:01,374 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:60080': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:15:01,386 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:15:01,387 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:60084': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:15:01,483 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:15:01,484 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:60098': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:15:01,497 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:15:01,498 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:60104': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:15:01,593 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:15:01,594 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:51660': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:15:01,607 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:15:01,608 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:51664': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:15:01,703 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:15:01,703 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:51674': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:15:01,717 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:15:01,718 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:51690': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:15:01,814 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:15:01,814 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:51706': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:15:01,826 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:15:01,827 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:51708': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:15:01,923 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:15:01,924 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:51724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:15:01,941 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:15:01,942 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:51730': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:15:02,034 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:15:02,035 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:51744': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:15:02,050 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:15:02,051 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:51752': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:15:02,143 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:15:02,144 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:51762': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:15:02,160 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:15:02,161 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:51764': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:15:02,252 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:15:02,253 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:51774': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:15:02,269 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:15:02,270 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:51776': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:15:02,363 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:15:02,364 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:51786': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:15:02,378 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:15:02,379 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:51796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:15:02,472 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:15:02,473 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:51798': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:15:02,488 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:15:02,489 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:51812': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:15:02,582 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:15:02,583 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:51814': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:15:02,597 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:15:02,598 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:51824': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:15:02,692 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:15:02,693 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:51834': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:15:02,707 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:15:02,708 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:51836': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:15:02,801 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:15:02,802 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:51852': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:15:02,816 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:15:02,817 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:51858': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:15:02,911 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:15:02,911 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:51864': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:15:02,925 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:15:02,926 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:51880': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:15:03,022 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:15:03,022 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:51886': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:15:03,036 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:15:03,036 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:51894': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:15:03,131 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:15:03,132 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:51904': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:15:03,146 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:15:03,146 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:51906': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:15:03,241 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:15:03,242 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:51908': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:15:03,255 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:15:03,256 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:51922': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:15:03,351 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:15:03,352 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:51924': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:15:03,364 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:15:03,365 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:51928': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:15:03,461 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:15:03,462 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:51936': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:15:03,474 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:15:03,475 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:51944': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:15:03,571 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:15:03,572 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:51950': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:15:03,583 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:15:03,584 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:51954': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:15:03,682 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:15:03,683 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:51966': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:15:03,692 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:15:03,693 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:51976': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:15:03,791 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:15:03,792 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:51990': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:15:03,802 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:15:03,803 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:52000': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:15:03,901 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:15:03,901 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:52014': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:15:03,911 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:15:03,912 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:52020': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:15:04,010 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:15:04,011 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:52036': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:15:04,021 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:15:04,022 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:52044': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:15:04,121 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:15:04,122 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:52050': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:15:04,130 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:15:04,131 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:52052': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:15:04,232 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:15:04,233 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:52054': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:15:04,241 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:15:04,242 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:52064': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:15:04,341 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:15:04,342 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:52080': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:15:04,350 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:15:04,351 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:52088': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:15:04,450 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:15:04,451 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:52090': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:15:04,460 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:15:04,460 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:52104': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:15:04,561 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:15:04,561 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:52116': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:15:04,570 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:15:04,571 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:52130': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:15:04,671 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:15:04,672 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:52140': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:15:04,680 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:15:04,681 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:52152': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:15:04,780 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:15:04,781 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:52158': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:15:04,790 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:15:04,791 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:52162': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:15:04,901 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:15:04,902 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:52170': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:15:04,909 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:15:04,910 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:52172': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:15:05,010 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:15:05,011 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:52188': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:15:05,019 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:15:05,020 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:52204': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:15:05,119 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:15:05,120 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:52212': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:15:05,129 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:15:05,130 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:52218': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:15:05,229 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:15:05,230 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:52234': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:15:05,238 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:15:05,239 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:52236': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:15:05,339 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:15:05,340 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:52238': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:15:05,349 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:15:05,349 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:52254': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:15:05,449 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:15:05,450 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:52268': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:15:05,458 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:15:05,459 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:52274': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:15:05,559 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:15:05,560 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:52288': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:15:05,568 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:15:05,569 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:52302': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:15:05,668 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:15:05,669 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:52304': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:15:05,677 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:15:05,678 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:52314': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:15:05,776 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:15:05,776 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:52326': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:15:05,785 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:15:05,786 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:52328': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:15:05,884 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:15:05,884 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:52338': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:15:05,895 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 3536s 2024-11-23 21:15:05,896 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:52340': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3536s 2024-11-23 21:15:05,952 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40015. Reason: failure-to-start- 3536s 2024-11-23 21:15:05,953 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3536s 2024-11-23 21:15:05,955 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 13s.; retrying 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3536s stream = await self.client.connect( 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 3536s stream = await stream.start_tls( 3536s ^^^^^^^^^^^^^^^^^^^^^^^ 3536s False, ssl_options=ssl_options, server_hostname=host 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 3536s self.socket.do_handshake() 3536s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 3536s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 3536s self._sslobj.do_handshake() 3536s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 3536s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 3536s 3536s The above exception was the direct cause of the following exception: 3536s 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3536s comm = await connect(self.scheduler.address, **self.connection_args) 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3536s comm = await wait_for( 3536s ^^^^^^^^^^^^^^^ 3536s ...<2 lines>... 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3536s return await fut 3536s ^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 3536s raise FatalCommClosedError( 3536s ...<2 lines>... 3536s ) from err 3536s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 3536s 3536s During handling of the above exception, another exception occurred: 3536s 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3536s return await fut 3536s ^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3536s await self._register_with_scheduler() 3536s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1218, in _register_with_scheduler 3536s await asyncio.sleep(0.1) 3536s File "/usr/lib/python3.13/asyncio/tasks.py", line 718, in sleep 3536s return await future 3536s ^^^^^^^^^^^^ 3536s asyncio.exceptions.CancelledError 3536s 3536s The above exception was the direct cause of the following exception: 3536s 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3536s await wait_for(self.start_unsafe(), timeout=timeout) 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3536s async with asyncio.timeout(timeout): 3536s ~~~~~~~~~~~~~~~^^^^^^^^^ 3536s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3536s raise TimeoutError from exc_val 3536s TimeoutError 3536s 3536s The above exception was the direct cause of the following exception: 3536s 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3536s s, ws = await start_cluster( 3536s ^^^^^^^^^^^^^^^^^^^^ 3536s ...<9 lines>... 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3536s await asyncio.gather(*workers) 3536s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3536s return await awaitable 3536s ^^^^^^^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3536s raise asyncio.TimeoutError( 3536s f"{type(self).__name__} start timed out after {timeout}s." 3536s ) from exc 3536s TimeoutError: Worker start timed out after 13s. 3536s 2024-11-23 21:15:05,960 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46601. Reason: failure-to-start- 3536s 2024-11-23 21:15:05,960 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3536s 2024-11-23 21:15:06,965 - distributed.scheduler - INFO - State start 3536s 2024-11-23 21:15:06,976 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44485 3536s 2024-11-23 21:15:06,977 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34921/status 3536s 2024-11-23 21:15:06,977 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3536s 2024-11-23 21:15:07,004 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44411 3536s 2024-11-23 21:15:07,005 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44411 3536s 2024-11-23 21:15:07,005 - distributed.worker - INFO - Worker name: 0 3536s 2024-11-23 21:15:07,005 - distributed.worker - INFO - dashboard at: 127.0.0.1:41611 3536s 2024-11-23 21:15:07,005 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44485 3536s 2024-11-23 21:15:07,005 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:15:07,005 - distributed.worker - INFO - Threads: 1 3536s 2024-11-23 21:15:07,005 - distributed.worker - INFO - Memory: 15.58 GiB 3536s 2024-11-23 21:15:07,005 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-r2tiowk8 3536s 2024-11-23 21:15:07,005 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:15:07,009 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46039 3536s 2024-11-23 21:15:07,009 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46039 3536s 2024-11-23 21:15:07,009 - distributed.worker - INFO - Worker name: 1 3536s 2024-11-23 21:15:07,009 - distributed.worker - INFO - dashboard at: 127.0.0.1:36263 3536s 2024-11-23 21:15:07,009 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44485 3536s 2024-11-23 21:15:07,009 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:15:07,009 - distributed.worker - INFO - Threads: 2 3536s 2024-11-23 21:15:07,010 - distributed.worker - INFO - Memory: 15.58 GiB 3536s 2024-11-23 21:15:07,010 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-3log5mzh 3536s 2024-11-23 21:15:07,010 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:15:07,012 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44411. Reason: failure-to-start- 3536s 2024-11-23 21:15:07,012 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3536s 2024-11-23 21:15:07,013 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46039. Reason: failure-to-start- 3536s 2024-11-23 21:15:07,013 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3536s 2024-11-23 21:15:07,015 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44485': TLS handshake failed with remote 'tls://127.0.0.1:50796': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3536s 2024-11-23 21:15:07,015 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44485': TLS handshake failed with remote 'tls://127.0.0.1:50812': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3536s 2024-11-23 21:15:07,018 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3536s return await fut 3536s ^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3536s await self._register_with_scheduler() 3536s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3536s comm = await connect(self.scheduler.address, **self.connection_args) 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3536s comm = await wait_for( 3536s ^^^^^^^^^^^^^^^ 3536s ...<2 lines>... 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3536s return await fut 3536s ^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3536s stream = await self.client.connect( 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3536s af, addr, stream = await connector.start(connect_timeout=timeout) 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s asyncio.exceptions.CancelledError 3536s 3536s The above exception was the direct cause of the following exception: 3536s 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3536s await wait_for(self.start_unsafe(), timeout=timeout) 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3536s async with asyncio.timeout(timeout): 3536s ~~~~~~~~~~~~~~~^^^^^^^^^ 3536s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3536s raise TimeoutError from exc_val 3536s TimeoutError 3536s 3536s The above exception was the direct cause of the following exception: 3536s 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3536s s, ws = await start_cluster( 3536s ^^^^^^^^^^^^^^^^^^^^ 3536s ...<9 lines>... 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3536s await asyncio.gather(*workers) 3536s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3536s return await awaitable 3536s ^^^^^^^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3536s raise asyncio.TimeoutError( 3536s f"{type(self).__name__} start timed out after {timeout}s." 3536s ) from exc 3536s TimeoutError: Worker start timed out after 0s. 3536s 2024-11-23 21:15:08,026 - distributed.scheduler - INFO - State start 3536s 2024-11-23 21:15:08,038 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34151 3536s 2024-11-23 21:15:08,038 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33519/status 3536s 2024-11-23 21:15:08,039 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3536s 2024-11-23 21:15:08,060 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46261 3536s 2024-11-23 21:15:08,061 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46261 3536s 2024-11-23 21:15:08,061 - distributed.worker - INFO - Worker name: 0 3536s 2024-11-23 21:15:08,061 - distributed.worker - INFO - dashboard at: 127.0.0.1:46389 3536s 2024-11-23 21:15:08,061 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34151 3536s 2024-11-23 21:15:08,061 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:15:08,061 - distributed.worker - INFO - Threads: 1 3536s 2024-11-23 21:15:08,061 - distributed.worker - INFO - Memory: 15.58 GiB 3536s 2024-11-23 21:15:08,061 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ux6iti1b 3536s 2024-11-23 21:15:08,061 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:15:08,066 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41999 3536s 2024-11-23 21:15:08,066 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41999 3536s 2024-11-23 21:15:08,066 - distributed.worker - INFO - Worker name: 1 3536s 2024-11-23 21:15:08,066 - distributed.worker - INFO - dashboard at: 127.0.0.1:36431 3536s 2024-11-23 21:15:08,066 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34151 3536s 2024-11-23 21:15:08,066 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:15:08,066 - distributed.worker - INFO - Threads: 2 3536s 2024-11-23 21:15:08,066 - distributed.worker - INFO - Memory: 15.58 GiB 3536s 2024-11-23 21:15:08,066 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-8_d1ym85 3536s 2024-11-23 21:15:08,067 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:15:08,068 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46261. Reason: failure-to-start- 3536s 2024-11-23 21:15:08,068 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3536s 2024-11-23 21:15:08,068 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41999. Reason: failure-to-start- 3536s 2024-11-23 21:15:08,069 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3536s 2024-11-23 21:15:08,070 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34151': TLS handshake failed with remote 'tls://127.0.0.1:59498': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3536s 2024-11-23 21:15:08,070 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34151': TLS handshake failed with remote 'tls://127.0.0.1:59500': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3536s 2024-11-23 21:15:08,072 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3536s return await fut 3536s ^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3536s await self._register_with_scheduler() 3536s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3536s comm = await connect(self.scheduler.address, **self.connection_args) 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3536s comm = await wait_for( 3536s ^^^^^^^^^^^^^^^ 3536s ...<2 lines>... 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3536s return await fut 3536s ^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3536s stream = await self.client.connect( 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3536s af, addr, stream = await connector.start(connect_timeout=timeout) 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s asyncio.exceptions.CancelledError 3536s 3536s The above exception was the direct cause of the following exception: 3536s 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3536s await wait_for(self.start_unsafe(), timeout=timeout) 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3536s async with asyncio.timeout(timeout): 3536s ~~~~~~~~~~~~~~~^^^^^^^^^ 3536s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3536s raise TimeoutError from exc_val 3536s TimeoutError 3536s 3536s The above exception was the direct cause of the following exception: 3536s 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3536s s, ws = await start_cluster( 3536s ^^^^^^^^^^^^^^^^^^^^ 3536s ...<9 lines>... 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3536s await asyncio.gather(*workers) 3536s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3536s return await awaitable 3536s ^^^^^^^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3536s raise asyncio.TimeoutError( 3536s f"{type(self).__name__} start timed out after {timeout}s." 3536s ) from exc 3536s TimeoutError: Worker start timed out after 0s. 3536s 2024-11-23 21:15:09,078 - distributed.scheduler - INFO - State start 3536s 2024-11-23 21:15:09,086 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40361 3536s 2024-11-23 21:15:09,086 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42389/status 3536s 2024-11-23 21:15:09,086 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3536s 2024-11-23 21:15:09,101 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37299 3536s 2024-11-23 21:15:09,102 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37299 3536s 2024-11-23 21:15:09,102 - distributed.worker - INFO - Worker name: 0 3536s 2024-11-23 21:15:09,102 - distributed.worker - INFO - dashboard at: 127.0.0.1:37977 3536s 2024-11-23 21:15:09,102 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40361 3536s 2024-11-23 21:15:09,102 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:15:09,102 - distributed.worker - INFO - Threads: 1 3536s 2024-11-23 21:15:09,102 - distributed.worker - INFO - Memory: 15.58 GiB 3536s 2024-11-23 21:15:09,102 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-fmyvgnm3 3536s 2024-11-23 21:15:09,102 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:15:09,104 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44999 3536s 2024-11-23 21:15:09,104 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44999 3536s 2024-11-23 21:15:09,105 - distributed.worker - INFO - Worker name: 1 3536s 2024-11-23 21:15:09,105 - distributed.worker - INFO - dashboard at: 127.0.0.1:46013 3536s 2024-11-23 21:15:09,105 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40361 3536s 2024-11-23 21:15:09,105 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:15:09,105 - distributed.worker - INFO - Threads: 2 3536s 2024-11-23 21:15:09,105 - distributed.worker - INFO - Memory: 15.58 GiB 3536s 2024-11-23 21:15:09,105 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-q4spto64 3536s 2024-11-23 21:15:09,105 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:15:09,106 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37299. Reason: failure-to-start- 3536s 2024-11-23 21:15:09,106 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3536s 2024-11-23 21:15:09,106 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44999. Reason: failure-to-start- 3536s 2024-11-23 21:15:09,107 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3536s 2024-11-23 21:15:09,108 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40361': TLS handshake failed with remote 'tls://127.0.0.1:50152': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3536s 2024-11-23 21:15:09,108 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40361': TLS handshake failed with remote 'tls://127.0.0.1:50154': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3536s 2024-11-23 21:15:09,109 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3536s return await fut 3536s ^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3536s await self._register_with_scheduler() 3536s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3536s comm = await connect(self.scheduler.address, **self.connection_args) 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3536s comm = await wait_for( 3536s ^^^^^^^^^^^^^^^ 3536s ...<2 lines>... 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3536s return await fut 3536s ^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3536s stream = await self.client.connect( 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3536s af, addr, stream = await connector.start(connect_timeout=timeout) 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s asyncio.exceptions.CancelledError 3536s 3536s The above exception was the direct cause of the following exception: 3536s 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3536s await wait_for(self.start_unsafe(), timeout=timeout) 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3536s async with asyncio.timeout(timeout): 3536s ~~~~~~~~~~~~~~~^^^^^^^^^ 3536s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3536s raise TimeoutError from exc_val 3536s TimeoutError 3536s 3536s The above exception was the direct cause of the following exception: 3536s 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3536s s, ws = await start_cluster( 3536s ^^^^^^^^^^^^^^^^^^^^ 3536s ...<9 lines>... 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3536s await asyncio.gather(*workers) 3536s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3536s return await awaitable 3536s ^^^^^^^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3536s raise asyncio.TimeoutError( 3536s f"{type(self).__name__} start timed out after {timeout}s." 3536s ) from exc 3536s TimeoutError: Worker start timed out after 0s. 3536s 2024-11-23 21:15:10,118 - distributed.scheduler - INFO - State start 3536s 2024-11-23 21:15:10,129 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36127 3536s 2024-11-23 21:15:10,130 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45501/status 3536s 2024-11-23 21:15:10,130 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3536s 2024-11-23 21:15:10,154 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43079 3536s 2024-11-23 21:15:10,155 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43079 3536s 2024-11-23 21:15:10,155 - distributed.worker - INFO - Worker name: 0 3536s 2024-11-23 21:15:10,155 - distributed.worker - INFO - dashboard at: 127.0.0.1:46787 3536s 2024-11-23 21:15:10,155 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36127 3536s 2024-11-23 21:15:10,155 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:15:10,155 - distributed.worker - INFO - Threads: 1 3536s 2024-11-23 21:15:10,155 - distributed.worker - INFO - Memory: 15.58 GiB 3536s 2024-11-23 21:15:10,155 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-zpmi78n8 3536s 2024-11-23 21:15:10,155 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:15:10,159 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44561 3536s 2024-11-23 21:15:10,159 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44561 3536s 2024-11-23 21:15:10,159 - distributed.worker - INFO - Worker name: 1 3536s 2024-11-23 21:15:10,159 - distributed.worker - INFO - dashboard at: 127.0.0.1:39037 3536s 2024-11-23 21:15:10,159 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36127 3536s 2024-11-23 21:15:10,159 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:15:10,159 - distributed.worker - INFO - Threads: 2 3536s 2024-11-23 21:15:10,159 - distributed.worker - INFO - Memory: 15.58 GiB 3536s 2024-11-23 21:15:10,159 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-o90j5494 3536s 2024-11-23 21:15:10,159 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:15:10,161 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43079. Reason: failure-to-start- 3536s 2024-11-23 21:15:10,161 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3536s 2024-11-23 21:15:10,162 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44561. Reason: failure-to-start- 3536s 2024-11-23 21:15:10,163 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3536s 2024-11-23 21:15:10,164 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36127': TLS handshake failed with remote 'tls://127.0.0.1:40250': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3536s 2024-11-23 21:15:10,165 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36127': TLS handshake failed with remote 'tls://127.0.0.1:40258': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3536s 2024-11-23 21:15:10,167 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3536s return await fut 3536s ^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3536s await self._register_with_scheduler() 3536s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3536s comm = await connect(self.scheduler.address, **self.connection_args) 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3536s comm = await wait_for( 3536s ^^^^^^^^^^^^^^^ 3536s ...<2 lines>... 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3536s return await fut 3536s ^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3536s stream = await self.client.connect( 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3536s af, addr, stream = await connector.start(connect_timeout=timeout) 3536s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3536s asyncio.exceptions.CancelledError 3536s 3536s The above exception was the direct cause of the following exception: 3536s 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3536s await wait_for(self.start_unsafe(), timeout=timeout) 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3536s async with asyncio.timeout(timeout): 3536s ~~~~~~~~~~~~~~~^^^^^^^^^ 3536s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3536s raise TimeoutError from exc_val 3536s TimeoutError 3536s 3536s The above exception was the direct cause of the following exception: 3536s 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3536s s, ws = await start_cluster( 3536s ^^^^^^^^^^^^^^^^^^^^ 3536s ...<9 lines>... 3536s ) 3536s ^ 3536s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3536s await asyncio.gather(*workers) 3536s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3536s return await awaitable 3536s ^^^^^^^^^^^^^^^ 3536s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3536s raise asyncio.TimeoutError( 3536s f"{type(self).__name__} start timed out after {timeout}s." 3536s ) from exc 3536s TimeoutError: Worker start timed out after 0s. 3536s 2024-11-23 21:15:11,175 - distributed.scheduler - INFO - State start 3536s 2024-11-23 21:15:11,186 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34995 3536s 2024-11-23 21:15:11,186 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45659/status 3536s 2024-11-23 21:15:11,187 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3536s 2024-11-23 21:15:11,212 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35217 3536s 2024-11-23 21:15:11,213 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35217 3536s 2024-11-23 21:15:11,213 - distributed.worker - INFO - Worker name: 0 3536s 2024-11-23 21:15:11,213 - distributed.worker - INFO - dashboard at: 127.0.0.1:38991 3536s 2024-11-23 21:15:11,213 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34995 3536s 2024-11-23 21:15:11,213 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:15:11,213 - distributed.worker - INFO - Threads: 1 3536s 2024-11-23 21:15:11,213 - distributed.worker - INFO - Memory: 15.58 GiB 3536s 2024-11-23 21:15:11,213 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-uarombnn 3536s 2024-11-23 21:15:11,213 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:15:11,217 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36307 3536s 2024-11-23 21:15:11,217 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36307 3536s 2024-11-23 21:15:11,217 - distributed.worker - INFO - Worker name: 1 3536s 2024-11-23 21:15:11,217 - distributed.worker - INFO - dashboard at: 127.0.0.1:45601 3536s 2024-11-23 21:15:11,217 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34995 3536s 2024-11-23 21:15:11,217 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:15:11,217 - distributed.worker - INFO - Threads: 2 3536s 2024-11-23 21:15:11,217 - distributed.worker - INFO - Memory: 15.58 GiB 3536s 2024-11-23 21:15:11,217 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-s1oum2by 3536s 2024-11-23 21:15:11,218 - distributed.worker - INFO - ------------------------------------------------- 3536s 2024-11-23 21:15:11,219 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35217. Reason: failure-to-start- 3536s 2024-11-23 21:15:11,219 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3536s 2024-11-23 21:15:11,220 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36307. Reason: failure-to-start- 3536s 2024-11-23 21:15:11,221 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3536s 2024-11-23 21:15:11,223 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34995': TLS handshake failed with remote 'tls://127.0.0.1:43542': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3536s 2024-11-23 21:15:11,223 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34995': TLS handshake failed with remote 'tls://127.0.0.1:43556': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3536s 2024-11-23 21:15:11,225 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3536s Traceback (most recent call last): 3536s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3536s return await fut 3536s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:15:12,232 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:15:12,243 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46253 3537s 2024-11-23 21:15:12,244 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44633/status 3537s 2024-11-23 21:15:12,244 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:15:12,266 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35611 3537s 2024-11-23 21:15:12,267 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35611 3537s 2024-11-23 21:15:12,267 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:15:12,267 - distributed.worker - INFO - dashboard at: 127.0.0.1:33867 3537s 2024-11-23 21:15:12,267 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46253 3537s 2024-11-23 21:15:12,267 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:15:12,275 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:15:12,276 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:15:12,276 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-5c_rsrqu 3537s 2024-11-23 21:15:12,276 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:15:12,280 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38445 3537s 2024-11-23 21:15:12,280 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38445 3537s 2024-11-23 21:15:12,280 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:15:12,280 - distributed.worker - INFO - dashboard at: 127.0.0.1:36645 3537s 2024-11-23 21:15:12,280 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46253 3537s 2024-11-23 21:15:12,281 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:15:12,281 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:15:12,281 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:15:12,281 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ike2nr64 3537s 2024-11-23 21:15:12,281 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:15:12,283 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35611. Reason: failure-to-start- 3537s 2024-11-23 21:15:12,283 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:15:12,283 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38445. Reason: failure-to-start- 3537s 2024-11-23 21:15:12,284 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:15:12,286 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46253': TLS handshake failed with remote 'tls://127.0.0.1:42586': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:15:12,286 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46253': TLS handshake failed with remote 'tls://127.0.0.1:42598': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:15:12,289 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:15:13,296 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:15:13,307 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37829 3537s 2024-11-23 21:15:13,307 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45415/status 3537s 2024-11-23 21:15:13,308 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:15:13,329 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35679 3537s 2024-11-23 21:15:13,329 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35679 3537s 2024-11-23 21:15:13,329 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:15:13,329 - distributed.worker - INFO - dashboard at: 127.0.0.1:40449 3537s 2024-11-23 21:15:13,329 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37829 3537s 2024-11-23 21:15:13,330 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:15:13,330 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:15:13,330 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:15:13,330 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-u4dm0qs3 3537s 2024-11-23 21:15:13,330 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:15:13,333 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41199 3537s 2024-11-23 21:15:13,333 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41199 3537s 2024-11-23 21:15:13,333 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:15:13,334 - distributed.worker - INFO - dashboard at: 127.0.0.1:35615 3537s 2024-11-23 21:15:13,334 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37829 3537s 2024-11-23 21:15:13,334 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:15:13,334 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:15:13,334 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:15:13,334 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-q03uhuub 3537s 2024-11-23 21:15:13,334 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:15:13,336 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35679. Reason: failure-to-start- 3537s 2024-11-23 21:15:13,336 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:15:13,337 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41199. Reason: failure-to-start- 3537s 2024-11-23 21:15:13,337 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:15:13,339 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37829': TLS handshake failed with remote 'tls://127.0.0.1:48764': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:15:13,339 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37829': TLS handshake failed with remote 'tls://127.0.0.1:48778': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:15:13,342 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:15:14,348 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:15:14,358 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35395 3537s 2024-11-23 21:15:14,359 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45699/status 3537s 2024-11-23 21:15:14,359 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:15:14,376 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36373 3537s 2024-11-23 21:15:14,376 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36373 3537s 2024-11-23 21:15:14,376 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:15:14,376 - distributed.worker - INFO - dashboard at: 127.0.0.1:40107 3537s 2024-11-23 21:15:14,376 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35395 3537s 2024-11-23 21:15:14,376 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:15:14,376 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:15:14,376 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:15:14,376 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-racqxg14 3537s 2024-11-23 21:15:14,376 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:15:14,379 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:32813 3537s 2024-11-23 21:15:14,379 - distributed.worker - INFO - Listening to: tls://127.0.0.1:32813 3537s 2024-11-23 21:15:14,379 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:15:14,379 - distributed.worker - INFO - dashboard at: 127.0.0.1:39419 3537s 2024-11-23 21:15:14,379 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35395 3537s 2024-11-23 21:15:14,379 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:15:14,379 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:15:14,379 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:15:14,379 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-uqvyy_n4 3537s 2024-11-23 21:15:14,380 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:15:14,381 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36373. Reason: failure-to-start- 3537s 2024-11-23 21:15:14,381 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:15:14,382 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:32813. Reason: failure-to-start- 3537s 2024-11-23 21:15:14,382 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:15:14,383 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35395': TLS handshake failed with remote 'tls://127.0.0.1:39802': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:15:14,383 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35395': TLS handshake failed with remote 'tls://127.0.0.1:39810': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:15:14,385 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:15:15,391 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:15:15,398 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35541 3537s 2024-11-23 21:15:15,399 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46585/status 3537s 2024-11-23 21:15:15,399 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:15:15,417 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46067 3537s 2024-11-23 21:15:15,418 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46067 3537s 2024-11-23 21:15:15,418 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:15:15,418 - distributed.worker - INFO - dashboard at: 127.0.0.1:34685 3537s 2024-11-23 21:15:15,418 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35541 3537s 2024-11-23 21:15:15,418 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:15:15,418 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:15:15,418 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:15:15,418 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-7ungfahd 3537s 2024-11-23 21:15:15,418 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:15:15,420 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43979 3537s 2024-11-23 21:15:15,420 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43979 3537s 2024-11-23 21:15:15,421 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:15:15,421 - distributed.worker - INFO - dashboard at: 127.0.0.1:43181 3537s 2024-11-23 21:15:15,421 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35541 3537s 2024-11-23 21:15:15,421 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:15:15,421 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:15:15,421 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:15:15,421 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-59pf5c4m 3537s 2024-11-23 21:15:15,421 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:15:15,422 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46067. Reason: failure-to-start- 3537s 2024-11-23 21:15:15,422 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:15:15,423 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43979. Reason: failure-to-start- 3537s 2024-11-23 21:15:15,423 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:15:15,424 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35541': TLS handshake failed with remote 'tls://127.0.0.1:33922': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:15:15,425 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35541': TLS handshake failed with remote 'tls://127.0.0.1:33924': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:15:15,427 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:15:16,436 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:15:16,445 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44195 3537s 2024-11-23 21:15:16,445 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43633/status 3537s 2024-11-23 21:15:16,445 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:15:16,463 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44357 3537s 2024-11-23 21:15:16,463 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44357 3537s 2024-11-23 21:15:16,463 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:15:16,463 - distributed.worker - INFO - dashboard at: 127.0.0.1:36823 3537s 2024-11-23 21:15:16,463 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44195 3537s 2024-11-23 21:15:16,464 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:15:16,464 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:15:16,464 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:15:16,464 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-6e8edw2f 3537s 2024-11-23 21:15:16,464 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:15:16,467 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37427 3537s 2024-11-23 21:15:16,467 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37427 3537s 2024-11-23 21:15:16,467 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:15:16,468 - distributed.worker - INFO - dashboard at: 127.0.0.1:43383 3537s 2024-11-23 21:15:16,468 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44195 3537s 2024-11-23 21:15:16,468 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:15:16,468 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:15:16,468 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:15:16,468 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-whvhboj3 3537s 2024-11-23 21:15:16,468 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:15:16,469 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44357. Reason: failure-to-start- 3537s 2024-11-23 21:15:16,469 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:15:16,470 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37427. Reason: failure-to-start- 3537s 2024-11-23 21:15:16,470 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:15:16,471 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44195': TLS handshake failed with remote 'tls://127.0.0.1:56478': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:15:16,472 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44195': TLS handshake failed with remote 'tls://127.0.0.1:56484': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:15:16,474 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:15:17,480 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:15:17,489 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36073 3537s 2024-11-23 21:15:17,489 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41069/status 3537s 2024-11-23 21:15:17,490 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:15:17,510 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43225 3537s 2024-11-23 21:15:17,511 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43225 3537s 2024-11-23 21:15:17,511 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:15:17,511 - distributed.worker - INFO - dashboard at: 127.0.0.1:35971 3537s 2024-11-23 21:15:17,511 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36073 3537s 2024-11-23 21:15:17,511 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:15:17,511 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:15:17,511 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:15:17,511 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-h071zpmu 3537s 2024-11-23 21:15:17,511 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:15:17,513 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38609 3537s 2024-11-23 21:15:17,514 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38609 3537s 2024-11-23 21:15:17,514 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:15:17,514 - distributed.worker - INFO - dashboard at: 127.0.0.1:41603 3537s 2024-11-23 21:15:17,514 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36073 3537s 2024-11-23 21:15:17,514 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:15:17,514 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:15:17,514 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:15:17,514 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-e8bm8335 3537s 2024-11-23 21:15:17,514 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:15:17,515 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43225. Reason: failure-to-start- 3537s 2024-11-23 21:15:17,516 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:15:17,516 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38609. Reason: failure-to-start- 3537s 2024-11-23 21:15:17,516 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:15:17,518 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36073': TLS handshake failed with remote 'tls://127.0.0.1:59550': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:15:17,518 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36073': TLS handshake failed with remote 'tls://127.0.0.1:59566': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:15:17,519 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:15:18,530 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:15:18,541 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37521 3537s 2024-11-23 21:15:18,542 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43611/status 3537s 2024-11-23 21:15:18,542 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:15:18,568 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39827 3537s 2024-11-23 21:15:18,568 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39827 3537s 2024-11-23 21:15:18,568 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:15:18,569 - distributed.worker - INFO - dashboard at: 127.0.0.1:38677 3537s 2024-11-23 21:15:18,569 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 3537s 2024-11-23 21:15:18,569 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:15:18,569 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:15:18,569 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:15:18,569 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-n8pym_6r 3537s 2024-11-23 21:15:18,569 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:15:18,572 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39493 3537s 2024-11-23 21:15:18,573 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39493 3537s 2024-11-23 21:15:18,573 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:15:18,573 - distributed.worker - INFO - dashboard at: 127.0.0.1:39885 3537s 2024-11-23 21:15:18,573 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 3537s 2024-11-23 21:15:18,573 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:15:18,573 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:15:18,573 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:15:18,573 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ir5fj4ew 3537s 2024-11-23 21:15:18,573 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:15:18,575 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39827. Reason: failure-to-start- 3537s 2024-11-23 21:15:18,576 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:15:18,576 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39493. Reason: failure-to-start- 3537s 2024-11-23 21:15:18,577 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:15:18,579 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:59850': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:15:18,579 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:59864': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:15:18,581 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:15:19,589 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:15:19,600 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43569 3537s 2024-11-23 21:15:19,601 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40473/status 3537s 2024-11-23 21:15:19,601 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:15:19,630 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37641 3537s 2024-11-23 21:15:19,631 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37641 3537s 2024-11-23 21:15:19,631 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:15:19,631 - distributed.worker - INFO - dashboard at: 127.0.0.1:43925 3537s 2024-11-23 21:15:19,631 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43569 3537s 2024-11-23 21:15:19,631 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:15:19,631 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:15:19,631 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:15:19,631 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-wfju3_m9 3537s 2024-11-23 21:15:19,631 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:15:19,635 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34307 3537s 2024-11-23 21:15:19,635 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34307 3537s 2024-11-23 21:15:19,635 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:15:19,635 - distributed.worker - INFO - dashboard at: 127.0.0.1:34969 3537s 2024-11-23 21:15:19,635 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43569 3537s 2024-11-23 21:15:19,635 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:15:19,635 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:15:19,636 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:15:19,636 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ioy6z6cu 3537s 2024-11-23 21:15:19,636 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:15:19,638 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37641. Reason: failure-to-start- 3537s 2024-11-23 21:15:19,638 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:15:19,639 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34307. Reason: failure-to-start- 3537s 2024-11-23 21:15:19,639 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:15:19,646 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43569': TLS handshake failed with remote 'tls://127.0.0.1:45642': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:15:19,646 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43569': TLS handshake failed with remote 'tls://127.0.0.1:45648': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:15:19,649 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:15:20,656 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:15:20,664 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35235 3537s 2024-11-23 21:15:20,665 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37195/status 3537s 2024-11-23 21:15:20,665 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:15:20,683 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41529 3537s 2024-11-23 21:15:20,683 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41529 3537s 2024-11-23 21:15:20,683 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:15:20,683 - distributed.worker - INFO - dashboard at: 127.0.0.1:39441 3537s 2024-11-23 21:15:20,684 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35235 3537s 2024-11-23 21:15:20,684 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:15:20,684 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:15:20,684 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:15:20,684 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-hels_lr_ 3537s 2024-11-23 21:15:20,684 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:15:20,686 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43537 3537s 2024-11-23 21:15:20,686 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43537 3537s 2024-11-23 21:15:20,686 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:15:20,686 - distributed.worker - INFO - dashboard at: 127.0.0.1:43753 3537s 2024-11-23 21:15:20,687 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35235 3537s 2024-11-23 21:15:20,687 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:15:20,687 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:15:20,687 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:15:20,687 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-o2aupcr7 3537s 2024-11-23 21:15:20,687 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:15:20,688 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41529. Reason: failure-to-start- 3537s 2024-11-23 21:15:20,688 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:15:20,689 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43537. Reason: failure-to-start- 3537s 2024-11-23 21:15:20,689 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:15:20,694 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35235': TLS handshake failed with remote 'tls://127.0.0.1:34362': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:15:20,694 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35235': TLS handshake failed with remote 'tls://127.0.0.1:34370': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:15:20,695 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:15:21,703 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:15:21,715 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38723 3537s 2024-11-23 21:15:21,716 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33117/status 3537s 2024-11-23 21:15:21,716 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:15:21,741 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37931 3537s 2024-11-23 21:15:21,741 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37931 3537s 2024-11-23 21:15:21,742 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:15:21,742 - distributed.worker - INFO - dashboard at: 127.0.0.1:37977 3537s 2024-11-23 21:15:21,742 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38723 3537s 2024-11-23 21:15:21,742 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:15:21,742 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:15:21,742 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:15:21,742 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ap2u0as6 3537s 2024-11-23 21:15:21,742 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:15:21,746 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37141 3537s 2024-11-23 21:15:21,746 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37141 3537s 2024-11-23 21:15:21,746 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:15:21,746 - distributed.worker - INFO - dashboard at: 127.0.0.1:42803 3537s 2024-11-23 21:15:21,746 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38723 3537s 2024-11-23 21:15:21,746 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:15:21,746 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:15:21,746 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:15:21,747 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-tt5gginb 3537s 2024-11-23 21:15:21,747 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:15:21,750 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37931. Reason: failure-to-start- 3537s 2024-11-23 21:15:21,751 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:15:21,751 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37141. Reason: failure-to-start- 3537s 2024-11-23 21:15:21,752 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:15:21,758 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38723': TLS handshake failed with remote 'tls://127.0.0.1:45142': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:15:21,758 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38723': TLS handshake failed with remote 'tls://127.0.0.1:45154': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:15:21,761 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:15:22,769 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:15:22,780 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40605 3537s 2024-11-23 21:15:22,781 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40651/status 3537s 2024-11-23 21:15:22,782 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:15:22,806 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35827 3537s 2024-11-23 21:15:22,807 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35827 3537s 2024-11-23 21:15:22,807 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:15:22,807 - distributed.worker - INFO - dashboard at: 127.0.0.1:38261 3537s 2024-11-23 21:15:22,807 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40605 3537s 2024-11-23 21:15:22,807 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:15:22,807 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:15:22,807 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:15:22,807 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-wwetxwpu 3537s 2024-11-23 21:15:22,807 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:15:22,811 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38199 3537s 2024-11-23 21:15:22,811 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38199 3537s 2024-11-23 21:15:22,811 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:15:22,811 - distributed.worker - INFO - dashboard at: 127.0.0.1:41893 3537s 2024-11-23 21:15:22,812 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40605 3537s 2024-11-23 21:15:22,812 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:15:22,812 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:15:22,812 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:15:22,812 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-744vu6gz 3537s 2024-11-23 21:15:22,812 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:15:22,816 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35827. Reason: failure-to-start- 3537s 2024-11-23 21:15:22,816 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:15:22,817 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38199. Reason: failure-to-start- 3537s 2024-11-23 21:15:22,817 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:15:22,823 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40605': TLS handshake failed with remote 'tls://127.0.0.1:39810': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:15:22,823 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40605': TLS handshake failed with remote 'tls://127.0.0.1:39814': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:15:22,826 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:15:23,834 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:15:23,846 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46203 3537s 2024-11-23 21:15:23,846 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:32809/status 3537s 2024-11-23 21:15:23,847 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:15:23,871 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35213 3537s 2024-11-23 21:15:23,872 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35213 3537s 2024-11-23 21:15:23,872 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:15:23,872 - distributed.worker - INFO - dashboard at: 127.0.0.1:39853 3537s 2024-11-23 21:15:23,872 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46203 3537s 2024-11-23 21:15:23,872 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:15:23,872 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:15:23,872 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:15:23,872 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-m4o4i5hz 3537s 2024-11-23 21:15:23,872 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:15:23,876 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36245 3537s 2024-11-23 21:15:23,876 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36245 3537s 2024-11-23 21:15:23,876 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:15:23,876 - distributed.worker - INFO - dashboard at: 127.0.0.1:38965 3537s 2024-11-23 21:15:23,876 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46203 3537s 2024-11-23 21:15:23,876 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:15:23,876 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:15:23,877 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:15:23,877 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-7y29n2ld 3537s 2024-11-23 21:15:23,877 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:15:23,883 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35213. Reason: failure-to-start- 3537s 2024-11-23 21:15:23,883 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:15:23,884 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36245. Reason: failure-to-start- 3537s 2024-11-23 21:15:23,884 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:15:23,886 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46203': TLS handshake failed with remote 'tls://127.0.0.1:43252': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:15:23,887 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46203': TLS handshake failed with remote 'tls://127.0.0.1:43264': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:15:23,893 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:15:24,901 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:15:24,915 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40265 3537s 2024-11-23 21:15:24,916 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42023/status 3537s 2024-11-23 21:15:24,916 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:15:24,945 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42893 3537s 2024-11-23 21:15:24,946 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42893 3537s 2024-11-23 21:15:24,946 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:15:24,946 - distributed.worker - INFO - dashboard at: 127.0.0.1:46645 3537s 2024-11-23 21:15:24,946 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40265 3537s 2024-11-23 21:15:24,946 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:15:24,946 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:15:24,946 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:15:24,946 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-u_3g6ype 3537s 2024-11-23 21:15:24,946 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:15:24,950 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33715 3537s 2024-11-23 21:15:24,951 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33715 3537s 2024-11-23 21:15:24,951 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:15:24,951 - distributed.worker - INFO - dashboard at: 127.0.0.1:37989 3537s 2024-11-23 21:15:24,951 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40265 3537s 2024-11-23 21:15:24,951 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:15:24,951 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:15:24,951 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:15:24,951 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-z8raenbv 3537s 2024-11-23 21:15:24,951 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:15:24,958 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42893. Reason: failure-to-start- 3537s 2024-11-23 21:15:24,958 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:15:24,959 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33715. Reason: failure-to-start- 3537s 2024-11-23 21:15:24,960 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:15:24,966 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40265': TLS handshake failed with remote 'tls://127.0.0.1:34708': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:15:24,966 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40265': TLS handshake failed with remote 'tls://127.0.0.1:34718': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:15:24,969 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:15:25,977 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:15:25,989 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45243 3537s 2024-11-23 21:15:25,989 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34331/status 3537s 2024-11-23 21:15:25,990 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:15:26,021 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33743 3537s 2024-11-23 21:15:26,021 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33743 3537s 2024-11-23 21:15:26,021 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:15:26,021 - distributed.worker - INFO - dashboard at: 127.0.0.1:41395 3537s 2024-11-23 21:15:26,021 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45243 3537s 2024-11-23 21:15:26,021 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:15:26,021 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:15:26,022 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:15:26,022 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-zy0k0ufv 3537s 2024-11-23 21:15:26,022 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:15:26,025 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44241 3537s 2024-11-23 21:15:26,025 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44241 3537s 2024-11-23 21:15:26,026 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:15:26,026 - distributed.worker - INFO - dashboard at: 127.0.0.1:44757 3537s 2024-11-23 21:15:26,026 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45243 3537s 2024-11-23 21:15:26,026 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:15:26,026 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:15:26,026 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:15:26,026 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-8yfwwrub 3537s 2024-11-23 21:15:26,026 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:15:26,032 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33743. Reason: failure-to-start- 3537s 2024-11-23 21:15:26,032 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:15:26,033 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44241. Reason: failure-to-start- 3537s 2024-11-23 21:15:26,033 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:15:26,036 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45243': TLS handshake failed with remote 'tls://127.0.0.1:50176': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:15:26,036 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45243': TLS handshake failed with remote 'tls://127.0.0.1:50180': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:15:26,039 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:15:27,048 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:15:27,059 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39345 3537s 2024-11-23 21:15:27,060 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:32979/status 3537s 2024-11-23 21:15:27,060 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:15:27,091 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35353 3537s 2024-11-23 21:15:27,092 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35353 3537s 2024-11-23 21:15:27,092 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:15:27,092 - distributed.worker - INFO - dashboard at: 127.0.0.1:44969 3537s 2024-11-23 21:15:27,092 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39345 3537s 2024-11-23 21:15:27,092 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:15:27,092 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:15:27,092 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:15:27,092 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-b088jf2x 3537s 2024-11-23 21:15:27,092 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:15:27,096 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45951 3537s 2024-11-23 21:15:27,096 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45951 3537s 2024-11-23 21:15:27,096 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:15:27,096 - distributed.worker - INFO - dashboard at: 127.0.0.1:41847 3537s 2024-11-23 21:15:27,097 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39345 3537s 2024-11-23 21:15:27,097 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:15:27,097 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:15:27,097 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:15:27,097 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-f86n8fsp 3537s 2024-11-23 21:15:27,097 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:15:27,103 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35353. Reason: failure-to-start- 3537s 2024-11-23 21:15:27,103 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:15:27,104 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45951. Reason: failure-to-start- 3537s 2024-11-23 21:15:27,105 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:15:27,107 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39345': TLS handshake failed with remote 'tls://127.0.0.1:40548': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:15:27,107 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39345': TLS handshake failed with remote 'tls://127.0.0.1:40556': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:15:27,113 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:15:28,121 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:15:28,132 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34787 3537s 2024-11-23 21:15:28,133 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46089/status 3537s 2024-11-23 21:15:28,133 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:15:28,160 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39533 3537s 2024-11-23 21:15:28,161 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39533 3537s 2024-11-23 21:15:28,161 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:15:28,161 - distributed.worker - INFO - dashboard at: 127.0.0.1:33051 3537s 2024-11-23 21:15:28,161 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34787 3537s 2024-11-23 21:15:28,161 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:15:28,161 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:15:28,161 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:15:28,161 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-r7npavmi 3537s 2024-11-23 21:15:28,161 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:15:28,165 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43907 3537s 2024-11-23 21:15:28,165 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43907 3537s 2024-11-23 21:15:28,165 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:15:28,165 - distributed.worker - INFO - dashboard at: 127.0.0.1:36981 3537s 2024-11-23 21:15:28,165 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34787 3537s 2024-11-23 21:15:28,165 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:15:28,165 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:15:28,166 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:15:28,166 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-x4u1_7p_ 3537s 2024-11-23 21:15:28,166 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:15:28,191 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39533. Reason: failure-to-start- 3537s 2024-11-23 21:15:28,192 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:15:28,192 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43907. Reason: failure-to-start- 3537s 2024-11-23 21:15:28,193 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:15:28,199 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34787': TLS handshake failed with remote 'tls://127.0.0.1:39008': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:15:28,200 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34787': TLS handshake failed with remote 'tls://127.0.0.1:39010': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:15:28,206 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:15:29,214 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:15:29,224 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44365 3537s 2024-11-23 21:15:29,225 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46841/status 3537s 2024-11-23 21:15:29,225 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:15:29,253 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44799 3537s 2024-11-23 21:15:29,254 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44799 3537s 2024-11-23 21:15:29,254 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:15:29,254 - distributed.worker - INFO - dashboard at: 127.0.0.1:35703 3537s 2024-11-23 21:15:29,254 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44365 3537s 2024-11-23 21:15:29,254 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:15:29,254 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:15:29,254 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:15:29,254 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-pi9uu0mp 3537s 2024-11-23 21:15:29,254 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:15:29,258 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33855 3537s 2024-11-23 21:15:29,258 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33855 3537s 2024-11-23 21:15:29,258 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:15:29,258 - distributed.worker - INFO - dashboard at: 127.0.0.1:43627 3537s 2024-11-23 21:15:29,258 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44365 3537s 2024-11-23 21:15:29,259 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:15:29,259 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:15:29,259 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:15:29,259 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-t5dy_n0q 3537s 2024-11-23 21:15:29,259 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:15:29,265 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44799. Reason: failure-to-start- 3537s 2024-11-23 21:15:29,265 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:15:29,266 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33855. Reason: failure-to-start- 3537s 2024-11-23 21:15:29,266 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:15:29,269 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44365': TLS handshake failed with remote 'tls://127.0.0.1:49618': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:15:29,269 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44365': TLS handshake failed with remote 'tls://127.0.0.1:49634': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:15:29,271 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:15:30,279 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:15:30,289 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33571 3537s 2024-11-23 21:15:30,290 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44973/status 3537s 2024-11-23 21:15:30,290 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:15:30,309 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37673 3537s 2024-11-23 21:15:30,310 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37673 3537s 2024-11-23 21:15:30,310 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:15:30,310 - distributed.worker - INFO - dashboard at: 127.0.0.1:43739 3537s 2024-11-23 21:15:30,310 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33571 3537s 2024-11-23 21:15:30,310 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:15:30,310 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:15:30,310 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:15:30,310 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-s6gsb6d4 3537s 2024-11-23 21:15:30,310 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:15:30,312 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35087 3537s 2024-11-23 21:15:30,312 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35087 3537s 2024-11-23 21:15:30,312 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:15:30,313 - distributed.worker - INFO - dashboard at: 127.0.0.1:41325 3537s 2024-11-23 21:15:30,313 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33571 3537s 2024-11-23 21:15:30,313 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:15:30,313 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:15:30,313 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:15:30,313 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-9tko84l6 3537s 2024-11-23 21:15:30,313 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:15:30,314 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37673. Reason: failure-to-start- 3537s 2024-11-23 21:15:30,315 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:15:30,315 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35087. Reason: failure-to-start- 3537s 2024-11-23 21:15:30,315 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:15:30,320 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33571': TLS handshake failed with remote 'tls://127.0.0.1:60702': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:15:30,320 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33571': TLS handshake failed with remote 'tls://127.0.0.1:60714': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:15:30,322 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:15:31,328 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:15:31,336 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34971 3537s 2024-11-23 21:15:31,336 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45635/status 3537s 2024-11-23 21:15:31,336 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:15:31,355 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38377 3537s 2024-11-23 21:15:31,356 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38377 3537s 2024-11-23 21:15:31,356 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:15:31,356 - distributed.worker - INFO - dashboard at: 127.0.0.1:45561 3537s 2024-11-23 21:15:31,356 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34971 3537s 2024-11-23 21:15:31,356 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:15:31,356 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:15:31,356 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:15:31,356 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-hjoymvhy 3537s 2024-11-23 21:15:31,356 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:15:31,358 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38071 3537s 2024-11-23 21:15:31,358 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38071 3537s 2024-11-23 21:15:31,359 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:15:31,359 - distributed.worker - INFO - dashboard at: 127.0.0.1:38851 3537s 2024-11-23 21:15:31,359 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34971 3537s 2024-11-23 21:15:31,359 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:15:31,359 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:15:31,359 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:15:31,359 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-hy025t84 3537s 2024-11-23 21:15:31,359 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:15:31,363 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38377. Reason: failure-to-start- 3537s 2024-11-23 21:15:31,363 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:15:31,364 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38071. Reason: failure-to-start- 3537s 2024-11-23 21:15:31,364 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:15:31,368 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34971': TLS handshake failed with remote 'tls://127.0.0.1:35928': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:15:31,369 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34971': TLS handshake failed with remote 'tls://127.0.0.1:35940': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:15:31,371 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:15:32,376 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:15:32,385 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46793 3537s 2024-11-23 21:15:32,385 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34431/status 3537s 2024-11-23 21:15:32,386 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:15:32,404 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40445 3537s 2024-11-23 21:15:32,404 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40445 3537s 2024-11-23 21:15:32,404 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:15:32,404 - distributed.worker - INFO - dashboard at: 127.0.0.1:36079 3537s 2024-11-23 21:15:32,404 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46793 3537s 2024-11-23 21:15:32,404 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:15:32,404 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:15:32,404 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:15:32,404 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-udfuksbe 3537s 2024-11-23 21:15:32,404 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:15:32,406 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40863 3537s 2024-11-23 21:15:32,407 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40863 3537s 2024-11-23 21:15:32,407 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:15:32,407 - distributed.worker - INFO - dashboard at: 127.0.0.1:37255 3537s 2024-11-23 21:15:32,407 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46793 3537s 2024-11-23 21:15:32,407 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:15:32,407 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:15:32,407 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:15:32,407 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-rzxzv3an 3537s 2024-11-23 21:15:32,407 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:15:32,412 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40445. Reason: failure-to-start- 3537s 2024-11-23 21:15:32,413 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:15:32,413 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40863. Reason: failure-to-start- 3537s 2024-11-23 21:15:32,413 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:15:32,415 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46793': TLS handshake failed with remote 'tls://127.0.0.1:42804': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:15:32,415 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46793': TLS handshake failed with remote 'tls://127.0.0.1:42816': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:15:32,417 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:15:33,424 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:15:33,437 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41265 3537s 2024-11-23 21:15:33,437 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38001/status 3537s 2024-11-23 21:15:33,441 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:15:33,468 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39375 3537s 2024-11-23 21:15:33,469 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39375 3537s 2024-11-23 21:15:33,469 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:15:33,469 - distributed.worker - INFO - dashboard at: 127.0.0.1:38983 3537s 2024-11-23 21:15:33,469 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41265 3537s 2024-11-23 21:15:33,469 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:15:33,469 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:15:33,469 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:15:33,469 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-35mivj8v 3537s 2024-11-23 21:15:33,469 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:15:33,473 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45293 3537s 2024-11-23 21:15:33,473 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45293 3537s 2024-11-23 21:15:33,473 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:15:33,473 - distributed.worker - INFO - dashboard at: 127.0.0.1:33943 3537s 2024-11-23 21:15:33,473 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41265 3537s 2024-11-23 21:15:33,474 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:15:33,474 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:15:33,474 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:15:33,474 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ysewg_th 3537s 2024-11-23 21:15:33,474 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:15:33,479 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39375. Reason: failure-to-start- 3537s 2024-11-23 21:15:33,480 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:15:33,481 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45293. Reason: failure-to-start- 3537s 2024-11-23 21:15:33,481 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:15:33,484 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41265': TLS handshake failed with remote 'tls://127.0.0.1:47254': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:15:33,484 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41265': TLS handshake failed with remote 'tls://127.0.0.1:47270': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:15:33,490 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:15:34,500 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:15:34,507 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33665 3537s 2024-11-23 21:15:34,507 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39347/status 3537s 2024-11-23 21:15:34,510 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:15:34,527 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38989 3537s 2024-11-23 21:15:34,528 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38989 3537s 2024-11-23 21:15:34,528 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:15:34,528 - distributed.worker - INFO - dashboard at: 127.0.0.1:35309 3537s 2024-11-23 21:15:34,528 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33665 3537s 2024-11-23 21:15:34,528 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:15:34,528 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:15:34,528 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:15:34,528 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-j8id3oj2 3537s 2024-11-23 21:15:34,528 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:15:34,530 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36773 3537s 2024-11-23 21:15:34,531 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36773 3537s 2024-11-23 21:15:34,531 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:15:34,531 - distributed.worker - INFO - dashboard at: 127.0.0.1:41453 3537s 2024-11-23 21:15:34,531 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33665 3537s 2024-11-23 21:15:34,531 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:15:34,531 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:15:34,531 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:15:34,531 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-cu9ydet4 3537s 2024-11-23 21:15:34,531 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:15:34,532 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38989. Reason: failure-to-start- 3537s 2024-11-23 21:15:34,533 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:15:34,533 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36773. Reason: failure-to-start- 3537s 2024-11-23 21:15:34,533 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:15:34,535 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33665': TLS handshake failed with remote 'tls://127.0.0.1:40592': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:15:34,535 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33665': TLS handshake failed with remote 'tls://127.0.0.1:40604': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:15:34,537 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:15:35,545 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:15:35,552 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37009 3537s 2024-11-23 21:15:35,553 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37871/status 3537s 2024-11-23 21:15:35,553 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:15:35,573 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35737 3537s 2024-11-23 21:15:35,573 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35737 3537s 2024-11-23 21:15:35,573 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:15:35,574 - distributed.worker - INFO - dashboard at: 127.0.0.1:46461 3537s 2024-11-23 21:15:35,574 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37009 3537s 2024-11-23 21:15:35,574 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:15:35,574 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:15:35,574 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:15:35,574 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-7koxi7cg 3537s 2024-11-23 21:15:35,574 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:15:35,576 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42677 3537s 2024-11-23 21:15:35,576 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42677 3537s 2024-11-23 21:15:35,576 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:15:35,576 - distributed.worker - INFO - dashboard at: 127.0.0.1:37525 3537s 2024-11-23 21:15:35,576 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37009 3537s 2024-11-23 21:15:35,577 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:15:35,577 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:15:35,577 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:15:35,577 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-opiya_v3 3537s 2024-11-23 21:15:35,577 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:15:35,581 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35737. Reason: failure-to-start- 3537s 2024-11-23 21:15:35,581 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:15:35,582 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42677. Reason: failure-to-start- 3537s 2024-11-23 21:15:35,582 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:15:35,583 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37009': TLS handshake failed with remote 'tls://127.0.0.1:50232': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:15:35,583 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37009': TLS handshake failed with remote 'tls://127.0.0.1:50234': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:15:35,585 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:15:36,592 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:15:36,599 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41441 3537s 2024-11-23 21:15:36,600 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36439/status 3537s 2024-11-23 21:15:36,600 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:15:36,618 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35605 3537s 2024-11-23 21:15:36,619 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35605 3537s 2024-11-23 21:15:36,619 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:15:36,619 - distributed.worker - INFO - dashboard at: 127.0.0.1:35047 3537s 2024-11-23 21:15:36,619 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41441 3537s 2024-11-23 21:15:36,619 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:15:36,619 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:15:36,619 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:15:36,619 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-vjsn4o0o 3537s 2024-11-23 21:15:36,619 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:15:36,621 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38101 3537s 2024-11-23 21:15:36,622 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38101 3537s 2024-11-23 21:15:36,622 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:15:36,622 - distributed.worker - INFO - dashboard at: 127.0.0.1:36765 3537s 2024-11-23 21:15:36,622 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41441 3537s 2024-11-23 21:15:36,622 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:15:36,622 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:15:36,622 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:15:36,622 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-5yvq53zc 3537s 2024-11-23 21:15:36,622 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:15:36,626 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35605. Reason: failure-to-start- 3537s 2024-11-23 21:15:36,627 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:15:36,627 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38101. Reason: failure-to-start- 3537s 2024-11-23 21:15:36,627 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:15:36,629 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41441': TLS handshake failed with remote 'tls://127.0.0.1:59102': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:15:36,629 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41441': TLS handshake failed with remote 'tls://127.0.0.1:59104': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:15:36,630 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s ______________________________ test_client_submit ______________________________ 3537s 3537s fut = , timeout = 0 3537s 3537s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 3537s async with asyncio.timeout(timeout): 3537s > return await fut 3537s 3537s /usr/lib/python3/dist-packages/distributed/utils.py:1960: 3537s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3537s /usr/lib/python3/dist-packages/distributed/worker.py:1480: in start_unsafe 3537s await self._register_with_scheduler() 3537s /usr/lib/python3/dist-packages/distributed/worker.py:1179: in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s /usr/lib/python3/dist-packages/distributed/comm/core.py:342: in connect 3537s comm = await wait_for( 3537s /usr/lib/python3/dist-packages/distributed/utils.py:1960: in wait_for 3537s return await fut 3537s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:546: in connect 3537s stream = await self.client.connect( 3537s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3537s 3537s self = , host = '127.0.0.1' 3537s port = 35015, af = 3537s ssl_options = 3537s max_buffer_size = 8364507136.0, source_ip = None, source_port = None 3537s timeout = None 3537s 3537s async def connect( 3537s self, 3537s host: str, 3537s port: int, 3537s af: socket.AddressFamily = socket.AF_UNSPEC, 3537s ssl_options: Optional[Union[Dict[str, Any], ssl.SSLContext]] = None, 3537s max_buffer_size: Optional[int] = None, 3537s source_ip: Optional[str] = None, 3537s source_port: Optional[int] = None, 3537s timeout: Optional[Union[float, datetime.timedelta]] = None, 3537s ) -> IOStream: 3537s """Connect to the given host and port. 3537s 3537s Asynchronously returns an `.IOStream` (or `.SSLIOStream` if 3537s ``ssl_options`` is not None). 3537s 3537s Using the ``source_ip`` kwarg, one can specify the source 3537s IP address to use when establishing the connection. 3537s In case the user needs to resolve and 3537s use a specific interface, it has to be handled outside 3537s of Tornado as this depends very much on the platform. 3537s 3537s Raises `TimeoutError` if the input future does not complete before 3537s ``timeout``, which may be specified in any form allowed by 3537s `.IOLoop.add_timeout` (i.e. a `datetime.timedelta` or an absolute time 3537s relative to `.IOLoop.time`) 3537s 3537s Similarly, when the user requires a certain source port, it can 3537s be specified using the ``source_port`` arg. 3537s 3537s .. versionchanged:: 4.5 3537s Added the ``source_ip`` and ``source_port`` arguments. 3537s 3537s .. versionchanged:: 5.0 3537s Added the ``timeout`` argument. 3537s """ 3537s if timeout is not None: 3537s if isinstance(timeout, numbers.Real): 3537s timeout = IOLoop.current().time() + timeout 3537s elif isinstance(timeout, datetime.timedelta): 3537s timeout = IOLoop.current().time() + timeout.total_seconds() 3537s else: 3537s raise TypeError("Unsupported timeout %r" % timeout) 3537s if timeout is not None: 3537s addrinfo = await gen.with_timeout( 3537s timeout, self.resolver.resolve(host, port, af) 3537s ) 3537s else: 3537s addrinfo = await self.resolver.resolve(host, port, af) 3537s connector = _Connector( 3537s addrinfo, 3537s functools.partial( 3537s self._create_stream, 3537s max_buffer_size, 3537s source_ip=source_ip, 3537s source_port=source_port, 3537s ), 3537s ) 3537s > af, addr, stream = await connector.start(connect_timeout=timeout) 3537s E asyncio.exceptions.CancelledError 3537s 3537s /usr/lib/python3/dist-packages/tornado/tcpclient.py:279: CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s self = 3537s 3537s @final 3537s async def start(self): 3537s async with self._startup_lock: 3537s if self.status == Status.failed: 3537s assert self.__startup_exc is not None 3537s raise self.__startup_exc 3537s elif self.status != Status.init: 3537s return self 3537s timeout = getattr(self, "death_timeout", None) 3537s 3537s async def _close_on_failure(exc: Exception) -> None: 3537s await self.close(reason=f"failure-to-start-{str(type(exc))}") 3537s self.status = Status.failed 3537s self.__startup_exc = exc 3537s 3537s try: 3537s > await wait_for(self.start_unsafe(), timeout=timeout) 3537s 3537s /usr/lib/python3/dist-packages/distributed/core.py:664: 3537s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3537s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 3537s async with asyncio.timeout(timeout): 3537s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3537s 3537s self = 3537s exc_type = 3537s exc_val = CancelledError(), exc_tb = 3537s 3537s async def __aexit__( 3537s self, 3537s exc_type: Optional[Type[BaseException]], 3537s exc_val: Optional[BaseException], 3537s exc_tb: Optional[TracebackType], 3537s ) -> Optional[bool]: 3537s assert self._state in (_State.ENTERED, _State.EXPIRING) 3537s 3537s if self._timeout_handler is not None: 3537s self._timeout_handler.cancel() 3537s self._timeout_handler = None 3537s 3537s if self._state is _State.EXPIRING: 3537s self._state = _State.EXPIRED 3537s 3537s if self._task.uncancel() <= self._cancelling and exc_type is not None: 3537s # Since there are no new cancel requests, we're 3537s # handling this. 3537s if issubclass(exc_type, exceptions.CancelledError): 3537s > raise TimeoutError from exc_val 3537s E TimeoutError 3537s 3537s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s @contextlib.asynccontextmanager 3537s async def _cluster_factory(): 3537s workers = [] 3537s s = None 3537s try: 3537s for _ in range(60): 3537s try: 3537s > s, ws = await start_cluster( 3537s nthreads, 3537s scheduler, 3537s security=security, 3537s Worker=Worker, 3537s scheduler_kwargs=scheduler_kwargs, 3537s worker_kwargs=merge( 3537s {"death_timeout": min(15, int(deadline.remaining))}, 3537s worker_kwargs, 3537s ), 3537s ) 3537s 3537s /usr/lib/python3/dist-packages/distributed/utils_test.py:966: 3537s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3537s /usr/lib/python3/dist-packages/distributed/utils_test.py:789: in start_cluster 3537s await asyncio.gather(*workers) 3537s /usr/lib/python3.13/asyncio/tasks.py:737: in _wrap_awaitable 3537s return await awaitable 3537s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3537s 3537s self = 3537s 3537s @final 3537s async def start(self): 3537s async with self._startup_lock: 3537s if self.status == Status.failed: 3537s assert self.__startup_exc is not None 3537s raise self.__startup_exc 3537s elif self.status != Status.init: 3537s return self 3537s timeout = getattr(self, "death_timeout", None) 3537s 3537s async def _close_on_failure(exc: Exception) -> None: 3537s await self.close(reason=f"failure-to-start-{str(type(exc))}") 3537s self.status = Status.failed 3537s self.__startup_exc = exc 3537s 3537s try: 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s except asyncio.TimeoutError as exc: 3537s await _close_on_failure(exc) 3537s > raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s E TimeoutError: Worker start timed out after 0s. 3537s 3537s /usr/lib/python3/dist-packages/distributed/core.py:667: TimeoutError 3537s 3537s During handling of the above exception, another exception occurred: 3537s 3537s fut = ._..test_func..async_fn at 0xe247c938> 3537s timeout = 60 3537s 3537s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 3537s async with asyncio.timeout(timeout): 3537s > return await fut 3537s 3537s /usr/lib/python3/dist-packages/distributed/utils.py:1960: 3537s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3537s /usr/lib/python3/dist-packages/distributed/utils_test.py:999: in async_fn 3537s _cluster_factory() as (s, workers), 3537s /usr/lib/python3.13/contextlib.py:214: in __aenter__ 3537s return await anext(self.gen) 3537s /usr/lib/python3/dist-packages/distributed/utils_test.py:983: in _cluster_factory 3537s await asyncio.sleep(1) 3537s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3537s 3537s delay = 1, result = None 3537s 3537s async def sleep(delay, result=None): 3537s """Coroutine that completes after a given time (in seconds).""" 3537s if delay <= 0: 3537s await __sleep0() 3537s return result 3537s 3537s if math.isnan(delay): 3537s raise ValueError("Invalid delay: NaN (not a number)") 3537s 3537s loop = events.get_running_loop() 3537s future = loop.create_future() 3537s h = loop.call_later(delay, 3537s futures._set_result_unless_cancelled, 3537s future, result) 3537s try: 3537s > return await future 3537s E asyncio.exceptions.CancelledError 3537s 3537s /usr/lib/python3.13/asyncio/tasks.py:718: CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s args = (), kwds = {} 3537s 3537s @wraps(func) 3537s def inner(*args, **kwds): 3537s with self._recreate_cm(): 3537s > return func(*args, **kwds) 3537s 3537s /usr/lib/python3.13/contextlib.py:85: 3537s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3537s /usr/lib/python3.13/contextlib.py:85: in inner 3537s return func(*args, **kwds) 3537s /usr/lib/python3/dist-packages/distributed/utils_test.py:1102: in test_func 3537s return _run_and_close_tornado(async_fn_outer) 3537s /usr/lib/python3/dist-packages/distributed/utils_test.py:378: in _run_and_close_tornado 3537s return asyncio_run(inner_fn(), loop_factory=get_loop_factory()) 3537s /usr/lib/python3.13/asyncio/runners.py:194: in run 3537s return runner.run(main) 3537s /usr/lib/python3.13/asyncio/runners.py:118: in run 3537s return self._loop.run_until_complete(task) 3537s /usr/lib/python3.13/asyncio/base_events.py:720: in run_until_complete 3537s return future.result() 3537s /usr/lib/python3/dist-packages/distributed/utils_test.py:375: in inner_fn 3537s return await async_fn(*args, **kwargs) 3537s /usr/lib/python3/dist-packages/distributed/utils_test.py:1099: in async_fn_outer 3537s return await utils_wait_for(async_fn(), timeout=timeout * 2) 3537s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 3537s async with asyncio.timeout(timeout): 3537s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3537s 3537s self = 3537s exc_type = 3537s exc_val = CancelledError(), exc_tb = 3537s 3537s async def __aexit__( 3537s self, 3537s exc_type: Optional[Type[BaseException]], 3537s exc_val: Optional[BaseException], 3537s exc_tb: Optional[TracebackType], 3537s ) -> Optional[bool]: 3537s assert self._state in (_State.ENTERED, _State.EXPIRING) 3537s 3537s if self._timeout_handler is not None: 3537s self._timeout_handler.cancel() 3537s self._timeout_handler = None 3537s 3537s if self._state is _State.EXPIRING: 3537s self._state = _State.EXPIRED 3537s 3537s if self._task.uncancel() <= self._cancelling and exc_type is not None: 3537s # Since there are no new cancel requests, we're 3537s # handling this. 3537s if issubclass(exc_type, exceptions.CancelledError): 3537s > raise TimeoutError from exc_val 3537s E TimeoutError 3537s 3537s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 3537s ----------------------------- Captured stderr call ----------------------------- 3537s 2024-11-23 21:15:37,461 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:15:37,469 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:37,470 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40281/status 3537s 2024-11-23 21:15:37,470 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:15:37,486 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38359 3537s 2024-11-23 21:15:37,486 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38359 3537s 2024-11-23 21:15:37,486 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:15:37,486 - distributed.worker - INFO - dashboard at: 127.0.0.1:44869 3537s 2024-11-23 21:15:37,486 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:37,486 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:15:37,486 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:15:37,486 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:15:37,486 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-2s121bqh 3537s 2024-11-23 21:15:37,486 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:15:37,488 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34201 3537s 2024-11-23 21:15:37,489 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34201 3537s 2024-11-23 21:15:37,489 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:15:37,489 - distributed.worker - INFO - dashboard at: 127.0.0.1:40561 3537s 2024-11-23 21:15:37,489 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:37,489 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:15:37,489 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:15:37,489 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:15:37,489 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ht829xez 3537s 2024-11-23 21:15:37,489 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:15:37,502 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:37,503 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:37,503 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:40670': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:37,503 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:40684': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:37,616 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:37,616 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:37,616 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:40692': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:37,616 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:40694': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:37,729 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:37,729 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:37,731 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:40698': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:37,731 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:40704': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:37,842 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:37,843 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:37,843 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:40716': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:37,843 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:40722': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:37,956 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:37,956 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:37,957 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:40728': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:37,957 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:40742': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:38,070 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:38,070 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:38,071 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:40744': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:38,071 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:40746': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:38,184 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:38,184 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:38,185 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:40750': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:38,185 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:40762': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:38,297 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:38,297 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:38,298 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:40774': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:38,298 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:40784': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:38,411 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:38,411 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:38,412 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:40790': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:38,412 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:40804': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:38,525 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:38,525 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:38,526 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:40810': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:38,526 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:40814': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:38,638 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:38,638 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:38,639 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:40826': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:38,639 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:40832': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:38,752 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:38,752 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:38,753 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:40840': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:38,753 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:40846': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:38,865 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:38,865 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:38,866 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:40852': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:38,866 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:40854': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:38,979 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:38,979 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:38,983 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:40870': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:38,983 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:40872': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:39,092 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:39,093 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:39,093 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:40878': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:39,093 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:40888': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:39,206 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:39,206 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:39,206 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:40904': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:39,206 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:40912': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:39,321 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:39,321 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:39,321 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:40924': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:39,322 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:40938': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:39,434 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:39,435 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:39,436 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:40948': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:39,437 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:40952': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:39,542 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:39,543 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:40954': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:39,549 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:39,549 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:40964': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:39,651 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:39,651 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:40970': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:39,657 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:39,658 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:40974': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:39,758 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:39,758 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:40976': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:39,765 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:39,765 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:40982': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:39,866 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:39,866 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:40990': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:39,873 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:39,873 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:40998': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:39,973 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:39,977 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:41006': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:39,984 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:39,984 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:41010': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:40,081 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:40,081 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:41022': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:40,091 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:40,091 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:41032': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:40,188 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:40,189 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:41038': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:40,198 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:40,199 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:41040': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:40,296 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:40,297 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:41044': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:40,305 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:40,306 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:41050': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:40,405 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:40,405 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:41058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:40,413 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:40,413 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:41062': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:40,513 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:40,514 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:41074': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:40,520 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:40,521 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:41082': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:40,622 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:40,622 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:41096': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:40,628 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:40,629 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:41110': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:40,729 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:40,730 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:41126': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:40,736 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:40,736 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:41132': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:40,838 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:40,839 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:41138': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:40,846 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:40,846 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:41148': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:40,947 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:40,948 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:41164': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:40,954 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:40,955 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:41168': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:41,055 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:41,057 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:41174': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:41,063 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:41,063 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:41176': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:41,165 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:41,166 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:41190': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:41,172 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:41,173 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:41200': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:41,273 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:41,274 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:41208': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:41,280 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:41,281 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:41210': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:41,381 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:41,381 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:41216': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:41,388 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:41,388 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:41230': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:41,489 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:41,490 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:41238': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:41,496 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:41,497 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:41244': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:41,597 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:41,598 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:59892': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:41,604 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:41,605 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:59908': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:41,705 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:41,706 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:59910': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:41,713 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:41,713 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:59914': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:41,813 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:41,814 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:59930': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:41,821 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:41,821 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:59938': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:41,921 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:41,922 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:59940': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:41,928 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:41,929 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:59954': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:42,029 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:42,029 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:59966': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:42,036 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:42,036 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:59980': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:42,138 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:42,139 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:59982': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:42,145 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:42,146 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:59994': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:42,246 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:42,246 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:60010': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:42,253 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:42,253 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:60016': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:42,353 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:42,354 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:60024': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:42,360 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:42,361 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:60032': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:42,461 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:42,461 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:60044': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:42,468 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:42,468 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:60060': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:42,569 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:42,569 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:60068': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:42,576 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:42,576 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:60078': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:42,677 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:42,677 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:60094': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:42,684 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:42,684 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:60104': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:42,786 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:42,787 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:60110': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:42,795 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:42,795 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:60124': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:42,894 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:42,894 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:60138': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:42,902 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:42,903 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:60146': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:43,002 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:43,002 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:60162': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:43,010 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:43,011 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:60178': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:43,109 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:43,110 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:60182': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:43,118 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:43,118 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:60194': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:43,217 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:43,217 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:60202': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:43,225 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:43,226 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:60214': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:43,324 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:43,325 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:60220': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:43,333 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:43,334 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:60234': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:43,432 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:43,433 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:60250': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:43,441 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:43,441 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:60254': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:43,541 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:43,542 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:60256': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:43,548 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:43,549 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:60266': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:43,651 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:43,652 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:60278': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:43,658 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:43,658 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:60286': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:43,758 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:43,759 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:60302': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:43,765 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:43,766 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:60312': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:43,866 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:43,867 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:60318': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:43,874 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:43,874 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:60334': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:43,975 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:43,979 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:60338': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:43,985 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:43,986 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:60352': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:44,083 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:44,083 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:60368': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:44,093 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:44,093 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:60372': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:44,190 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:44,191 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:60380': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:44,200 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:44,201 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:60396': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:44,298 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:44,299 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:60400': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:44,307 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:44,308 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:60408': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:44,406 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:44,406 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:60414': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:44,415 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:44,416 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:60422': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:44,515 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:44,516 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:60438': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:44,522 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:44,523 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:60450': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:44,624 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:44,624 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:60456': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:44,631 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:44,631 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:60468': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:44,731 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:44,732 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:60478': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:44,738 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:44,739 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:60494': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:44,839 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:44,840 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:60502': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:44,846 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:44,847 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:60518': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:44,948 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:44,948 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:60522': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:44,955 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:44,955 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:60530': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:45,056 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:45,057 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:60536': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:45,063 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:45,064 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:60542': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:45,164 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:45,165 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:60548': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:45,171 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:45,172 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:60550': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:45,272 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:45,273 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:60558': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:45,279 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:45,279 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:60572': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:45,380 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:45,381 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:60584': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:45,387 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:45,388 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:60594': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:45,487 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:45,488 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:60604': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:45,494 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:45,495 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:60610': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:45,597 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:45,598 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:60620': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:45,604 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:45,604 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:60626': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:45,705 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:45,705 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:60638': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:45,712 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:45,712 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:60640': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:45,812 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:45,813 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:60648': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:45,819 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:45,820 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:60652': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:45,920 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:45,920 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:60662': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:45,927 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:45,927 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:60676': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:46,027 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:46,028 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:60686': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:46,034 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:46,035 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:60694': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:46,137 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:46,138 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:60698': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:46,144 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:46,144 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:60702': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:46,245 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:46,245 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:60710': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:46,252 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:46,253 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:60722': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:46,353 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:46,354 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:60738': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:46,360 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:46,361 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:60744': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:46,461 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:46,462 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:60756': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:46,468 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:46,468 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:60770': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:46,569 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:46,569 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:60780': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:46,576 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:46,576 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:60794': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:46,676 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:46,677 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:60802': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:46,683 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:46,684 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:60812': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:46,784 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:46,785 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:60822': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:46,791 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:46,792 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:60838': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:46,892 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:46,893 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:60846': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:46,899 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:46,900 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:60848': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:46,999 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:47,000 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:60854': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:47,006 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:47,007 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:60858': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:47,107 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:47,107 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:60866': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:47,114 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:47,114 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:60874': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:47,215 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:47,216 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:60880': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:47,222 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:47,223 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:60890': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:47,323 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:47,324 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:60896': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:47,330 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:47,331 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:60912': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:47,431 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:47,432 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:60928': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:47,439 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:47,439 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:60940': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:47,541 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:47,542 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:60956': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:47,548 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:47,549 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:60966': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:47,650 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:47,651 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:60968': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:47,657 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:47,658 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:60970': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:47,758 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:47,758 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:60984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:47,766 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:47,767 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:60994': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:47,866 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:47,867 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:60996': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:47,873 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:47,874 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:32780': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:47,975 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:47,979 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:32782': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:47,985 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:47,986 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:32788': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:48,083 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:48,084 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:32802': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:48,092 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:48,093 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:32808': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:48,191 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:48,191 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:32814': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:48,200 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:48,200 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:32824': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:48,298 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:48,299 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:32840': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:48,307 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:48,308 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:32852': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:48,406 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:48,407 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:32856': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:48,415 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:48,415 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:32864': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:48,514 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:48,515 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:32878': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:48,521 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:48,522 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:32886': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:48,623 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:48,624 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:32896': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:48,630 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:48,630 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:32898': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:48,730 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:48,731 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:32902': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:48,737 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:48,738 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:32908': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:48,838 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:48,839 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:32924': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:48,845 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:48,845 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:32932': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:48,946 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:48,947 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:32948': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:48,953 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:48,954 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:32964': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:49,054 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:49,054 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:32978': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:49,061 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:49,061 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:32988': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:49,162 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:49,163 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:32998': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:49,169 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:49,170 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:33012': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:49,270 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:49,270 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:33024': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:49,276 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:49,277 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:33040': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:49,377 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:49,378 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:33048': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:49,384 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:49,384 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:33060': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:49,485 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:49,485 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:33066': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:49,492 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:49,492 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:33076': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:49,593 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:49,593 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:33092': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:49,600 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:49,600 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:33104': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:49,701 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:49,702 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:33110': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:49,708 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:49,709 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:33118': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:49,809 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:49,810 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:33126': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:49,816 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:49,817 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:33128': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:49,917 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:49,917 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:33142': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:49,924 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:49,924 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:33154': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:50,025 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:50,025 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:33162': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:50,032 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:50,032 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:33170': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:50,133 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:50,134 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:33178': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:50,140 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:50,141 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:33186': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:50,240 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:50,241 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:33194': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:50,248 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:50,248 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:33204': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:50,350 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:50,351 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:33216': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:50,357 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:50,358 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:33224': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:50,458 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:50,459 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:33240': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:50,466 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:50,466 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:33248': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:50,567 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:50,567 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:33256': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:50,574 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:50,574 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:33262': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:50,674 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:50,675 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:33264': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:50,682 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:50,682 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:33278': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:50,782 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:50,783 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:33288': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:50,789 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:50,790 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:33296': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:50,890 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:50,891 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:33304': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:50,898 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:50,898 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:33310': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:50,999 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:50,999 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:33316': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:51,005 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:51,006 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:33326': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:51,108 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:51,109 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:33338': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:51,115 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:51,116 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:33346': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:51,216 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:51,217 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:33354': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:51,224 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:51,224 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:33356': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:51,325 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:51,325 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:33364': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:51,332 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:51,332 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:33376': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:51,433 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:51,433 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:33380': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:51,440 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:51,440 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:33388': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:51,540 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:51,541 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:55340': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:51,547 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:51,548 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:55346': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:51,649 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:51,650 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:55358': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:51,656 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:51,657 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:55366': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:51,757 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:51,757 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:55382': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:51,764 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:51,764 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:55390': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:51,866 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:51,867 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:55394': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:51,873 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:51,874 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:55400': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:51,974 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:51,977 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:55406': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:51,984 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:51,984 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:55410': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:52,082 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:52,083 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:55416': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:52,091 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:52,092 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:55424': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:52,190 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:52,190 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:55440': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:52,199 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:52,199 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:55450': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:52,297 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:52,297 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:55452': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:52,306 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:52,306 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:55458': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:52,405 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:52,405 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:55464': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:52,413 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45577 3537s 2024-11-23 21:15:52,413 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45577': TLS handshake failed with remote 'tls://127.0.0.1:55466': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:52,485 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38359. Reason: failure-to-start- 3537s 2024-11-23 21:15:52,485 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:15:52,487 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 15s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 3537s stream = await stream.start_tls( 3537s ^^^^^^^^^^^^^^^^^^^^^^^ 3537s False, ssl_options=ssl_options, server_hostname=host 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 3537s self.socket.do_handshake() 3537s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 3537s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 3537s self._sslobj.do_handshake() 3537s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 3537s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 3537s raise FatalCommClosedError( 3537s ...<2 lines>... 3537s ) from err 3537s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 3537s 3537s During handling of the above exception, another exception occurred: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1218, in _register_with_scheduler 3537s await asyncio.sleep(0.1) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 718, in sleep 3537s return await future 3537s ^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 15s. 3537s 2024-11-23 21:15:52,491 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34201. Reason: failure-to-start- 3537s 2024-11-23 21:15:52,491 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:15:53,494 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:15:53,504 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42205 3537s 2024-11-23 21:15:53,504 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39453/status 3537s 2024-11-23 21:15:53,504 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:15:53,520 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43797 3537s 2024-11-23 21:15:53,521 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43797 3537s 2024-11-23 21:15:53,521 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:15:53,521 - distributed.worker - INFO - dashboard at: 127.0.0.1:32963 3537s 2024-11-23 21:15:53,521 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:15:53,521 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:15:53,521 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:15:53,521 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:15:53,521 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-o_kio34y 3537s 2024-11-23 21:15:53,521 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:15:53,523 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45589 3537s 2024-11-23 21:15:53,524 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45589 3537s 2024-11-23 21:15:53,524 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:15:53,524 - distributed.worker - INFO - dashboard at: 127.0.0.1:35941 3537s 2024-11-23 21:15:53,524 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:15:53,524 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:15:53,524 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:15:53,524 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:15:53,524 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-woho468a 3537s 2024-11-23 21:15:53,524 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:15:53,537 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:15:53,537 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:15:53,538 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:53160': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:53,538 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:53166': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:53,650 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:15:53,650 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:15:53,650 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:53168': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:53,651 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:53184': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:53,763 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:15:53,763 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:15:53,764 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:53188': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:53,764 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:53200': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:53,876 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:15:53,876 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:15:53,877 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:53212': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:53,877 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:53216': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:53,989 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:15:53,990 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:15:53,990 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:53226': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:53,990 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:53232': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:54,103 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:15:54,103 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:15:54,104 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:53236': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:54,104 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:53246': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:54,217 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:15:54,217 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:15:54,218 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:53262': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:54,218 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:53274': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:54,335 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:15:54,335 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:15:54,336 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:53276': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:54,336 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:53286': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:54,451 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:15:54,451 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:15:54,452 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:53292': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:54,452 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:53308': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:54,567 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:15:54,567 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:15:54,568 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:53312': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:54,568 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:53328': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:54,683 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:15:54,684 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:15:54,684 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:53338': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:54,684 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:53348': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:54,800 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:15:54,800 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:15:54,801 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:53354': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:54,801 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:53362': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:54,916 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:15:54,916 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:15:54,917 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:53370': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:54,917 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:53382': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:55,031 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:15:55,032 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:15:55,032 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:53396': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:55,033 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:53402': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:55,147 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:15:55,148 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:15:55,148 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:53414': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:55,148 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:53420': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:55,262 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:15:55,263 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:15:55,264 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:53436': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:55,264 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:53448': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:55,379 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:15:55,380 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:15:55,381 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:53462': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:55,381 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:53478': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:55,495 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:15:55,495 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:15:55,496 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:53494': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:55,496 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:53504': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:55,606 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:15:55,611 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:53512': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:55,613 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:15:55,614 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:53514': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:55,715 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:15:55,717 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:53520': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:55,724 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:15:55,725 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:53522': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:55,825 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:15:55,826 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:53526': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:55,834 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:15:55,835 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:53530': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:55,934 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:15:55,935 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:53534': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:55,943 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:15:55,944 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:53546': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:56,045 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:15:56,045 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:53550': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:56,055 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:15:56,056 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:53558': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:56,153 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:15:56,154 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:53570': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:56,164 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:15:56,165 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:53580': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:56,263 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:15:56,264 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:53592': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:56,273 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:15:56,274 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:53606': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:56,373 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:15:56,374 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:53616': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:56,382 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:15:56,382 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:53630': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:56,483 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:15:56,484 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:53640': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:56,492 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:15:56,493 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:53650': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:56,593 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:15:56,594 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:53656': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:56,602 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:15:56,603 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:53662': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:56,702 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:15:56,703 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:53678': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:56,711 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:15:56,712 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:53690': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:56,817 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:15:56,818 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:53696': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:56,825 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:15:56,825 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:53706': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:56,925 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:15:56,926 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:53714': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:56,932 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:15:56,933 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:53726': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:57,033 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:15:57,034 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:53738': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:57,041 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:15:57,041 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:53750': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:57,143 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:15:57,144 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:53754': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:57,150 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:15:57,151 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:53758': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:57,251 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:15:57,252 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:53766': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:57,259 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:15:57,259 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:53774': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:57,359 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:15:57,360 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:53788': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:57,367 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:15:57,367 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:53802': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:57,467 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:15:57,468 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:53814': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:57,475 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:15:57,478 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:53820': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:57,576 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:15:57,576 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:53834': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:57,583 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:15:57,584 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:53844': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:57,684 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:15:57,684 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:53852': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:57,693 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:15:57,694 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:53854': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:57,792 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:15:57,793 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:53864': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:57,801 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:15:57,801 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:53874': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:57,901 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:15:57,901 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:53882': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:57,908 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:15:57,909 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:53886': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:58,008 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:15:58,011 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:53900': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:58,018 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:15:58,019 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:53906': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:58,116 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:15:58,117 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:53922': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:58,126 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:15:58,126 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:53934': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:58,225 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:15:58,225 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:53940': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:58,233 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:15:58,234 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:53946': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:58,333 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:15:58,333 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:53956': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:58,340 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:15:58,340 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:53960': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:58,440 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:15:58,441 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:53970': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:58,448 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:15:58,448 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:53982': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:58,548 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:15:58,549 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:53998': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:58,556 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:15:58,556 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:54000': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:58,656 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:15:58,657 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:54010': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:58,663 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:15:58,664 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:54012': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:58,764 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:15:58,765 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:54018': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:58,771 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:15:58,772 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:54022': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:58,874 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:15:58,875 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:54034': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:58,881 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:15:58,881 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:54036': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:58,981 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:15:58,982 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:54052': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:58,989 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:15:58,989 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:54058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:59,089 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:15:59,090 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:54066': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:59,097 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:15:59,097 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:54078': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:59,197 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:15:59,197 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:54094': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:59,204 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:15:59,205 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:54108': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:59,305 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:15:59,305 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:54116': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:59,312 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:15:59,313 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:54128': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:59,414 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:15:59,415 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:54138': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:59,421 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:15:59,421 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:54146': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:59,522 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:15:59,522 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:54150': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:59,529 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:15:59,530 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:54162': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:59,629 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:15:59,630 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:54178': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:59,636 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:15:59,637 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:54194': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:59,738 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:15:59,739 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:54198': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:59,745 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:15:59,745 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:54204': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:59,846 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:15:59,846 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:54210': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:59,853 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:15:59,853 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:54212': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:59,953 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:15:59,954 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:54214': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:15:59,960 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:15:59,961 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:54224': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:00,061 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:16:00,061 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:54236': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:00,068 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:16:00,069 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:54238': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:00,169 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:16:00,169 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:54240': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:00,176 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:16:00,176 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:54242': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:00,277 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:16:00,278 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:54256': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:00,284 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:16:00,284 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:54264': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:00,385 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:16:00,386 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:54272': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:00,393 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:16:00,393 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:54278': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:00,493 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:16:00,494 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:54290': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:00,500 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:16:00,501 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:54298': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:00,602 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:16:00,603 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:54304': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:00,610 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:16:00,610 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:54314': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:00,710 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:16:00,710 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:54322': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:00,717 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:16:00,717 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:54332': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:00,818 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:16:00,819 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:54334': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:00,825 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:16:00,825 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:54350': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:00,926 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:16:00,927 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:54360': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:00,933 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:16:00,934 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:54370': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:01,034 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:16:01,034 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:54378': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:01,041 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:16:01,041 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:54388': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:01,142 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:16:01,142 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:54396': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:01,149 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:16:01,149 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:54408': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:01,249 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:16:01,250 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:54416': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:01,257 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:16:01,258 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:54420': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:01,358 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:16:01,358 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:54424': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:01,365 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:16:01,365 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:54436': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:01,466 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:16:01,467 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:54446': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:01,474 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:16:01,478 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:54458': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:01,576 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:16:01,577 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:45302': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:01,583 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:16:01,584 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:45310': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:01,684 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:16:01,684 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:45324': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:01,691 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:16:01,691 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:45326': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:01,792 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:16:01,793 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:45340': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:01,799 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:16:01,800 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:45350': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:01,901 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:16:01,902 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:45356': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:01,909 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:16:01,909 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:45364': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:02,010 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:16:02,013 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:45374': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:02,020 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:16:02,021 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:45382': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:02,118 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:16:02,118 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:45384': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:02,127 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:16:02,127 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:45388': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:02,226 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:16:02,227 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:45396': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:02,234 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:16:02,235 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:45398': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:02,335 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:16:02,335 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:45400': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:02,342 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:16:02,342 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:45416': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:02,443 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:16:02,443 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:45420': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:02,449 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:16:02,450 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:45424': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:02,552 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:16:02,553 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:45438': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:02,559 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:16:02,559 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:45442': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:02,661 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:16:02,662 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:45448': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:02,668 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:16:02,668 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:45458': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:02,768 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:16:02,769 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:45464': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:02,775 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:16:02,776 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:45466': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:02,876 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:16:02,876 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:45472': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:02,883 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:16:02,883 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:45474': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:02,983 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:16:02,984 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:45484': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:02,990 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:16:02,991 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:45500': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:03,092 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:16:03,093 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:45504': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:03,099 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:16:03,099 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:45512': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:03,199 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:16:03,200 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:45514': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:03,206 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:16:03,207 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:45524': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:03,307 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:16:03,308 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:45536': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:03,314 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:16:03,314 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:45540': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:03,415 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:16:03,415 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:45542': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:03,422 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:16:03,422 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:45550': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:03,523 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:16:03,523 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:45552': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:03,530 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:16:03,530 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:45556': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:03,630 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:16:03,630 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:45558': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:03,637 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:16:03,637 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:45562': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:03,738 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:16:03,739 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:45576': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:03,745 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:16:03,745 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:45586': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:03,846 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:16:03,847 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:45590': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:03,853 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:16:03,854 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:45604': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:03,954 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:16:03,954 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:45616': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:03,960 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:16:03,961 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:45622': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:04,062 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:16:04,063 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:45638': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:04,069 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:16:04,069 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:45642': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:04,170 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:16:04,171 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:45654': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:04,177 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:16:04,178 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:45668': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:04,278 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:16:04,278 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:45676': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:04,286 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:16:04,287 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:45678': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:04,385 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:16:04,386 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:45692': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:04,393 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:16:04,394 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:45708': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:04,493 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:16:04,493 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:45716': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:04,501 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:16:04,501 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:45718': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:04,601 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:16:04,601 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:45724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:04,608 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:16:04,608 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:45728': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:04,709 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:16:04,710 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:45730': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:04,716 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:16:04,716 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:45732': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:04,817 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:16:04,818 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:45740': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:04,824 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:16:04,825 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:45750': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:04,925 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:16:04,925 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:45758': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:04,931 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:16:04,932 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:45768': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:05,033 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:16:05,034 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:45782': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:05,040 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:16:05,040 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:45792': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:05,140 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:16:05,141 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:45804': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:05,147 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:16:05,148 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:45808': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:05,248 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:16:05,248 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:45820': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:05,255 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:16:05,255 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:45836': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:05,355 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:16:05,356 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:45838': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:05,363 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:16:05,363 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:45842': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:05,463 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:16:05,464 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:45858': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:05,471 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:16:05,472 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:45860': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:05,572 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:16:05,573 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:45868': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:05,579 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:16:05,579 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:45870': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:05,680 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:16:05,680 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:45878': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:05,687 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:16:05,688 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:45880': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:05,788 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:16:05,789 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:45892': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:05,796 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:16:05,796 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:45906': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:05,898 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:16:05,898 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:45912': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:05,905 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:16:05,907 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:45916': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:06,005 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:16:06,006 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:45930': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:06,015 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:16:06,016 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:45942': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:06,114 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:16:06,114 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:45954': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:06,123 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:16:06,124 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:45970': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:06,221 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:16:06,222 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:45984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:06,231 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:16:06,231 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:45998': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:06,329 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:16:06,329 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:46014': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:06,338 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:16:06,339 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:46030': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:06,437 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:16:06,437 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:46040': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:06,445 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42205 3537s 2024-11-23 21:16:06,446 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42205': TLS handshake failed with remote 'tls://127.0.0.1:46054': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:06,519 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43797. Reason: failure-to-start- 3537s 2024-11-23 21:16:06,519 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:16:06,522 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 13s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 3537s stream = await stream.start_tls( 3537s ^^^^^^^^^^^^^^^^^^^^^^^ 3537s False, ssl_options=ssl_options, server_hostname=host 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 3537s self.socket.do_handshake() 3537s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 3537s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 3537s self._sslobj.do_handshake() 3537s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 3537s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 3537s raise FatalCommClosedError( 3537s ...<2 lines>... 3537s ) from err 3537s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 3537s 3537s During handling of the above exception, another exception occurred: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1218, in _register_with_scheduler 3537s await asyncio.sleep(0.1) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 718, in sleep 3537s return await future 3537s ^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 13s. 3537s 2024-11-23 21:16:06,525 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45589. Reason: failure-to-start- 3537s 2024-11-23 21:16:06,526 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:16:07,529 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:16:07,537 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46747 3537s 2024-11-23 21:16:07,538 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35313/status 3537s 2024-11-23 21:16:07,538 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:16:07,554 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39463 3537s 2024-11-23 21:16:07,555 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39463 3537s 2024-11-23 21:16:07,555 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:16:07,555 - distributed.worker - INFO - dashboard at: 127.0.0.1:44347 3537s 2024-11-23 21:16:07,555 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46747 3537s 2024-11-23 21:16:07,555 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:16:07,555 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:16:07,555 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:16:07,555 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-5ghodh5e 3537s 2024-11-23 21:16:07,555 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:16:07,559 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42511 3537s 2024-11-23 21:16:07,559 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42511 3537s 2024-11-23 21:16:07,559 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:16:07,559 - distributed.worker - INFO - dashboard at: 127.0.0.1:37895 3537s 2024-11-23 21:16:07,559 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46747 3537s 2024-11-23 21:16:07,559 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:16:07,559 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:16:07,559 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:16:07,559 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ncuo7orp 3537s 2024-11-23 21:16:07,560 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:16:07,561 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39463. Reason: failure-to-start- 3537s 2024-11-23 21:16:07,561 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:16:07,561 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42511. Reason: failure-to-start- 3537s 2024-11-23 21:16:07,562 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:16:07,563 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46747': TLS handshake failed with remote 'tls://127.0.0.1:42552': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:16:07,563 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46747': TLS handshake failed with remote 'tls://127.0.0.1:42566': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:16:07,565 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:16:08,572 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:16:08,580 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:32869 3537s 2024-11-23 21:16:08,580 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45237/status 3537s 2024-11-23 21:16:08,580 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:16:08,597 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33717 3537s 2024-11-23 21:16:08,597 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33717 3537s 2024-11-23 21:16:08,597 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:16:08,597 - distributed.worker - INFO - dashboard at: 127.0.0.1:45983 3537s 2024-11-23 21:16:08,597 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:32869 3537s 2024-11-23 21:16:08,597 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:16:08,597 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:16:08,597 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:16:08,597 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-7c8ylhyd 3537s 2024-11-23 21:16:08,598 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:16:08,600 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45457 3537s 2024-11-23 21:16:08,600 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45457 3537s 2024-11-23 21:16:08,600 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:16:08,600 - distributed.worker - INFO - dashboard at: 127.0.0.1:39799 3537s 2024-11-23 21:16:08,600 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:32869 3537s 2024-11-23 21:16:08,600 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:16:08,600 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:16:08,600 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:16:08,600 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-6exk_c99 3537s 2024-11-23 21:16:08,600 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:16:08,602 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33717. Reason: failure-to-start- 3537s 2024-11-23 21:16:08,602 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:16:08,602 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45457. Reason: failure-to-start- 3537s 2024-11-23 21:16:08,602 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:16:08,604 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:32869': TLS handshake failed with remote 'tls://127.0.0.1:39554': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:16:08,604 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:32869': TLS handshake failed with remote 'tls://127.0.0.1:39566': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:16:08,606 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:16:09,612 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:16:09,626 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44367 3537s 2024-11-23 21:16:09,627 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36617/status 3537s 2024-11-23 21:16:09,627 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:16:09,643 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36309 3537s 2024-11-23 21:16:09,644 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36309 3537s 2024-11-23 21:16:09,644 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:16:09,644 - distributed.worker - INFO - dashboard at: 127.0.0.1:46445 3537s 2024-11-23 21:16:09,644 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44367 3537s 2024-11-23 21:16:09,644 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:16:09,644 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:16:09,644 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:16:09,644 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-j2ib7rfo 3537s 2024-11-23 21:16:09,644 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:16:09,646 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38669 3537s 2024-11-23 21:16:09,647 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38669 3537s 2024-11-23 21:16:09,647 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:16:09,647 - distributed.worker - INFO - dashboard at: 127.0.0.1:38441 3537s 2024-11-23 21:16:09,647 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44367 3537s 2024-11-23 21:16:09,647 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:16:09,647 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:16:09,647 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:16:09,647 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-3owrnvg9 3537s 2024-11-23 21:16:09,647 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:16:09,648 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36309. Reason: failure-to-start- 3537s 2024-11-23 21:16:09,649 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:16:09,649 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38669. Reason: failure-to-start- 3537s 2024-11-23 21:16:09,649 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:16:09,651 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44367': TLS handshake failed with remote 'tls://127.0.0.1:45320': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:16:09,651 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44367': TLS handshake failed with remote 'tls://127.0.0.1:45334': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:16:09,652 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:16:10,659 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:16:10,667 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36365 3537s 2024-11-23 21:16:10,667 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44335/status 3537s 2024-11-23 21:16:10,668 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:16:10,685 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35291 3537s 2024-11-23 21:16:10,686 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35291 3537s 2024-11-23 21:16:10,686 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:16:10,686 - distributed.worker - INFO - dashboard at: 127.0.0.1:41289 3537s 2024-11-23 21:16:10,686 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36365 3537s 2024-11-23 21:16:10,686 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:16:10,686 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:16:10,686 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:16:10,686 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-7van7z0x 3537s 2024-11-23 21:16:10,686 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:16:10,688 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35851 3537s 2024-11-23 21:16:10,689 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35851 3537s 2024-11-23 21:16:10,689 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:16:10,689 - distributed.worker - INFO - dashboard at: 127.0.0.1:39827 3537s 2024-11-23 21:16:10,689 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36365 3537s 2024-11-23 21:16:10,689 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:16:10,689 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:16:10,689 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:16:10,689 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-_853blox 3537s 2024-11-23 21:16:10,689 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:16:10,690 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35291. Reason: failure-to-start- 3537s 2024-11-23 21:16:10,690 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:16:10,691 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35851. Reason: failure-to-start- 3537s 2024-11-23 21:16:10,691 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:16:10,692 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36365': TLS handshake failed with remote 'tls://127.0.0.1:32856': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:16:10,693 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36365': TLS handshake failed with remote 'tls://127.0.0.1:32866': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:16:10,694 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:16:11,699 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:16:11,708 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34879 3537s 2024-11-23 21:16:11,708 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43291/status 3537s 2024-11-23 21:16:11,708 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:16:11,724 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42431 3537s 2024-11-23 21:16:11,724 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42431 3537s 2024-11-23 21:16:11,724 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:16:11,724 - distributed.worker - INFO - dashboard at: 127.0.0.1:34557 3537s 2024-11-23 21:16:11,724 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34879 3537s 2024-11-23 21:16:11,724 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:16:11,724 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:16:11,725 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:16:11,725 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-omxok2_4 3537s 2024-11-23 21:16:11,725 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:16:11,727 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41769 3537s 2024-11-23 21:16:11,727 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41769 3537s 2024-11-23 21:16:11,727 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:16:11,727 - distributed.worker - INFO - dashboard at: 127.0.0.1:40693 3537s 2024-11-23 21:16:11,727 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34879 3537s 2024-11-23 21:16:11,727 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:16:11,727 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:16:11,727 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:16:11,727 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ih8rk6up 3537s 2024-11-23 21:16:11,727 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:16:11,730 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42431. Reason: failure-to-start- 3537s 2024-11-23 21:16:11,730 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:16:11,730 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41769. Reason: failure-to-start- 3537s 2024-11-23 21:16:11,731 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:16:11,732 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34879': TLS handshake failed with remote 'tls://127.0.0.1:45576': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:16:11,732 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34879': TLS handshake failed with remote 'tls://127.0.0.1:45578': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:16:11,734 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:16:12,740 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:16:12,747 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35515 3537s 2024-11-23 21:16:12,748 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40899/status 3537s 2024-11-23 21:16:12,748 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:16:12,763 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33463 3537s 2024-11-23 21:16:12,763 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33463 3537s 2024-11-23 21:16:12,763 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:16:12,763 - distributed.worker - INFO - dashboard at: 127.0.0.1:32915 3537s 2024-11-23 21:16:12,763 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35515 3537s 2024-11-23 21:16:12,763 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:16:12,763 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:16:12,764 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:16:12,764 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-los5w0ug 3537s 2024-11-23 21:16:12,764 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:16:12,766 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44397 3537s 2024-11-23 21:16:12,766 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44397 3537s 2024-11-23 21:16:12,766 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:16:12,766 - distributed.worker - INFO - dashboard at: 127.0.0.1:33717 3537s 2024-11-23 21:16:12,766 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35515 3537s 2024-11-23 21:16:12,766 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:16:12,766 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:16:12,766 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:16:12,766 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-gwb_7p1i 3537s 2024-11-23 21:16:12,767 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:16:12,768 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33463. Reason: failure-to-start- 3537s 2024-11-23 21:16:12,768 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:16:12,768 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44397. Reason: failure-to-start- 3537s 2024-11-23 21:16:12,769 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:16:12,770 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35515': TLS handshake failed with remote 'tls://127.0.0.1:56582': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:16:12,770 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35515': TLS handshake failed with remote 'tls://127.0.0.1:56592': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:16:12,772 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:16:13,778 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:16:13,787 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43801 3537s 2024-11-23 21:16:13,787 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45147/status 3537s 2024-11-23 21:16:13,788 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:16:13,803 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37199 3537s 2024-11-23 21:16:13,803 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37199 3537s 2024-11-23 21:16:13,804 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:16:13,804 - distributed.worker - INFO - dashboard at: 127.0.0.1:42489 3537s 2024-11-23 21:16:13,804 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43801 3537s 2024-11-23 21:16:13,804 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:16:13,804 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:16:13,804 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:16:13,804 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-nio9y25j 3537s 2024-11-23 21:16:13,804 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:16:13,806 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37711 3537s 2024-11-23 21:16:13,806 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37711 3537s 2024-11-23 21:16:13,806 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:16:13,806 - distributed.worker - INFO - dashboard at: 127.0.0.1:35947 3537s 2024-11-23 21:16:13,806 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43801 3537s 2024-11-23 21:16:13,807 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:16:13,807 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:16:13,807 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:16:13,807 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ukx2otnm 3537s 2024-11-23 21:16:13,807 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:16:13,808 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37199. Reason: failure-to-start- 3537s 2024-11-23 21:16:13,808 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:16:13,809 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37711. Reason: failure-to-start- 3537s 2024-11-23 21:16:13,809 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:16:13,810 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43801': TLS handshake failed with remote 'tls://127.0.0.1:58166': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:16:13,810 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43801': TLS handshake failed with remote 'tls://127.0.0.1:58172': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:16:13,812 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:16:14,818 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:16:14,825 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37229 3537s 2024-11-23 21:16:14,826 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38417/status 3537s 2024-11-23 21:16:14,826 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:16:14,842 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34199 3537s 2024-11-23 21:16:14,842 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34199 3537s 2024-11-23 21:16:14,842 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:16:14,843 - distributed.worker - INFO - dashboard at: 127.0.0.1:33419 3537s 2024-11-23 21:16:14,843 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37229 3537s 2024-11-23 21:16:14,843 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:16:14,843 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:16:14,843 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:16:14,843 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-p_zak16f 3537s 2024-11-23 21:16:14,843 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:16:14,845 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40467 3537s 2024-11-23 21:16:14,845 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40467 3537s 2024-11-23 21:16:14,845 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:16:14,845 - distributed.worker - INFO - dashboard at: 127.0.0.1:35225 3537s 2024-11-23 21:16:14,845 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37229 3537s 2024-11-23 21:16:14,846 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:16:14,846 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:16:14,846 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:16:14,846 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-a8ct_g37 3537s 2024-11-23 21:16:14,846 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:16:14,847 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34199. Reason: failure-to-start- 3537s 2024-11-23 21:16:14,847 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:16:14,848 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40467. Reason: failure-to-start- 3537s 2024-11-23 21:16:14,848 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:16:14,849 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37229': TLS handshake failed with remote 'tls://127.0.0.1:43470': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:16:14,849 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37229': TLS handshake failed with remote 'tls://127.0.0.1:43486': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:16:14,851 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:16:15,856 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:16:15,864 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45893 3537s 2024-11-23 21:16:15,864 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42293/status 3537s 2024-11-23 21:16:15,865 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:16:15,879 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38361 3537s 2024-11-23 21:16:15,879 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38361 3537s 2024-11-23 21:16:15,879 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:16:15,879 - distributed.worker - INFO - dashboard at: 127.0.0.1:41725 3537s 2024-11-23 21:16:15,879 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45893 3537s 2024-11-23 21:16:15,879 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:16:15,879 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:16:15,879 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:16:15,879 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-76bx_zhy 3537s 2024-11-23 21:16:15,880 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:16:15,882 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42441 3537s 2024-11-23 21:16:15,882 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42441 3537s 2024-11-23 21:16:15,882 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:16:15,882 - distributed.worker - INFO - dashboard at: 127.0.0.1:42335 3537s 2024-11-23 21:16:15,882 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45893 3537s 2024-11-23 21:16:15,882 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:16:15,882 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:16:15,882 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:16:15,882 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-zdrml5lg 3537s 2024-11-23 21:16:15,882 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:16:15,884 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38361. Reason: failure-to-start- 3537s 2024-11-23 21:16:15,885 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:16:15,885 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42441. Reason: failure-to-start- 3537s 2024-11-23 21:16:15,885 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:16:15,887 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45893': TLS handshake failed with remote 'tls://127.0.0.1:50912': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:16:15,887 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45893': TLS handshake failed with remote 'tls://127.0.0.1:50922': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:16:15,888 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:16:16,894 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:16:16,902 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45239 3537s 2024-11-23 21:16:16,903 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36845/status 3537s 2024-11-23 21:16:16,903 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:16:16,919 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34437 3537s 2024-11-23 21:16:16,919 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34437 3537s 2024-11-23 21:16:16,919 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:16:16,919 - distributed.worker - INFO - dashboard at: 127.0.0.1:41997 3537s 2024-11-23 21:16:16,919 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45239 3537s 2024-11-23 21:16:16,919 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:16:16,919 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:16:16,919 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:16:16,919 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-lzyvo4_6 3537s 2024-11-23 21:16:16,919 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:16:16,921 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38101 3537s 2024-11-23 21:16:16,922 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38101 3537s 2024-11-23 21:16:16,922 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:16:16,922 - distributed.worker - INFO - dashboard at: 127.0.0.1:35267 3537s 2024-11-23 21:16:16,922 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45239 3537s 2024-11-23 21:16:16,922 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:16:16,922 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:16:16,922 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:16:16,922 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-fpq7jb77 3537s 2024-11-23 21:16:16,922 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:16:16,924 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34437. Reason: failure-to-start- 3537s 2024-11-23 21:16:16,924 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:16:16,924 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38101. Reason: failure-to-start- 3537s 2024-11-23 21:16:16,925 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:16:16,926 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45239': TLS handshake failed with remote 'tls://127.0.0.1:37184': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:16:16,926 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45239': TLS handshake failed with remote 'tls://127.0.0.1:37192': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:16:16,928 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:16:17,934 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:16:17,943 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44459 3537s 2024-11-23 21:16:17,944 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40025/status 3537s 2024-11-23 21:16:17,944 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:16:17,959 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38033 3537s 2024-11-23 21:16:17,959 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38033 3537s 2024-11-23 21:16:17,959 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:16:17,959 - distributed.worker - INFO - dashboard at: 127.0.0.1:40997 3537s 2024-11-23 21:16:17,959 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44459 3537s 2024-11-23 21:16:17,959 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:16:17,959 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:16:17,959 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:16:17,959 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-2k0r2hhq 3537s 2024-11-23 21:16:17,960 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:16:17,962 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43765 3537s 2024-11-23 21:16:17,962 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43765 3537s 2024-11-23 21:16:17,962 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:16:17,962 - distributed.worker - INFO - dashboard at: 127.0.0.1:36645 3537s 2024-11-23 21:16:17,962 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44459 3537s 2024-11-23 21:16:17,962 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:16:17,962 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:16:17,962 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:16:17,962 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-4x62asf8 3537s 2024-11-23 21:16:17,962 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:16:17,963 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38033. Reason: failure-to-start- 3537s 2024-11-23 21:16:17,964 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:16:17,964 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43765. Reason: failure-to-start- 3537s 2024-11-23 21:16:17,965 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:16:17,966 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44459': TLS handshake failed with remote 'tls://127.0.0.1:56070': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:16:17,966 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44459': TLS handshake failed with remote 'tls://127.0.0.1:56084': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:16:17,968 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:16:18,976 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:16:18,983 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45501 3537s 2024-11-23 21:16:18,983 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46327/status 3537s 2024-11-23 21:16:18,984 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:16:19,001 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34141 3537s 2024-11-23 21:16:19,001 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34141 3537s 2024-11-23 21:16:19,001 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:16:19,001 - distributed.worker - INFO - dashboard at: 127.0.0.1:45467 3537s 2024-11-23 21:16:19,001 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45501 3537s 2024-11-23 21:16:19,001 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:16:19,001 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:16:19,001 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:16:19,001 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-zzj5gzsl 3537s 2024-11-23 21:16:19,001 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:16:19,004 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44455 3537s 2024-11-23 21:16:19,004 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44455 3537s 2024-11-23 21:16:19,004 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:16:19,004 - distributed.worker - INFO - dashboard at: 127.0.0.1:38317 3537s 2024-11-23 21:16:19,004 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45501 3537s 2024-11-23 21:16:19,004 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:16:19,004 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:16:19,004 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:16:19,004 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-pkqkioqj 3537s 2024-11-23 21:16:19,004 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:16:19,006 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34141. Reason: failure-to-start- 3537s 2024-11-23 21:16:19,006 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:16:19,006 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44455. Reason: failure-to-start- 3537s 2024-11-23 21:16:19,007 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:16:19,010 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45501': TLS handshake failed with remote 'tls://127.0.0.1:58100': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:16:19,011 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45501': TLS handshake failed with remote 'tls://127.0.0.1:58102': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:16:19,012 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:16:20,018 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:16:20,025 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38873 3537s 2024-11-23 21:16:20,026 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40627/status 3537s 2024-11-23 21:16:20,026 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:16:20,041 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39971 3537s 2024-11-23 21:16:20,041 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39971 3537s 2024-11-23 21:16:20,041 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:16:20,041 - distributed.worker - INFO - dashboard at: 127.0.0.1:38871 3537s 2024-11-23 21:16:20,041 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38873 3537s 2024-11-23 21:16:20,041 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:16:20,041 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:16:20,042 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:16:20,042 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-zjs6z_p7 3537s 2024-11-23 21:16:20,042 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:16:20,045 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33739 3537s 2024-11-23 21:16:20,045 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33739 3537s 2024-11-23 21:16:20,045 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:16:20,045 - distributed.worker - INFO - dashboard at: 127.0.0.1:46375 3537s 2024-11-23 21:16:20,045 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38873 3537s 2024-11-23 21:16:20,045 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:16:20,045 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:16:20,045 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:16:20,045 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ugbllcqb 3537s 2024-11-23 21:16:20,045 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:16:20,049 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39971. Reason: failure-to-start- 3537s 2024-11-23 21:16:20,049 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:16:20,050 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33739. Reason: failure-to-start- 3537s 2024-11-23 21:16:20,050 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:16:20,051 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38873': TLS handshake failed with remote 'tls://127.0.0.1:44974': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:16:20,052 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38873': TLS handshake failed with remote 'tls://127.0.0.1:44978': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:16:20,053 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:16:21,059 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:16:21,067 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44575 3537s 2024-11-23 21:16:21,068 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39379/status 3537s 2024-11-23 21:16:21,068 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:16:21,085 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35389 3537s 2024-11-23 21:16:21,085 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35389 3537s 2024-11-23 21:16:21,085 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:16:21,085 - distributed.worker - INFO - dashboard at: 127.0.0.1:46105 3537s 2024-11-23 21:16:21,086 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44575 3537s 2024-11-23 21:16:21,086 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:16:21,086 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:16:21,086 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:16:21,086 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-w4z363nt 3537s 2024-11-23 21:16:21,086 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:16:21,088 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36237 3537s 2024-11-23 21:16:21,088 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36237 3537s 2024-11-23 21:16:21,088 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:16:21,088 - distributed.worker - INFO - dashboard at: 127.0.0.1:41501 3537s 2024-11-23 21:16:21,089 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44575 3537s 2024-11-23 21:16:21,089 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:16:21,089 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:16:21,089 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:16:21,089 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-2y9vbmnu 3537s 2024-11-23 21:16:21,089 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:16:21,094 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35389. Reason: failure-to-start- 3537s 2024-11-23 21:16:21,094 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:16:21,095 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36237. Reason: failure-to-start- 3537s 2024-11-23 21:16:21,095 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:16:21,096 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44575': TLS handshake failed with remote 'tls://127.0.0.1:33194': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:16:21,097 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44575': TLS handshake failed with remote 'tls://127.0.0.1:33198': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:16:21,098 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:16:22,105 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:16:22,113 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44487 3537s 2024-11-23 21:16:22,113 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38141/status 3537s 2024-11-23 21:16:22,113 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:16:22,130 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41621 3537s 2024-11-23 21:16:22,131 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41621 3537s 2024-11-23 21:16:22,131 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:16:22,131 - distributed.worker - INFO - dashboard at: 127.0.0.1:33221 3537s 2024-11-23 21:16:22,131 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44487 3537s 2024-11-23 21:16:22,131 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:16:22,131 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:16:22,131 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:16:22,131 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-roamry9r 3537s 2024-11-23 21:16:22,131 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:16:22,134 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37227 3537s 2024-11-23 21:16:22,134 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37227 3537s 2024-11-23 21:16:22,134 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:16:22,134 - distributed.worker - INFO - dashboard at: 127.0.0.1:41533 3537s 2024-11-23 21:16:22,134 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44487 3537s 2024-11-23 21:16:22,134 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:16:22,134 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:16:22,134 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:16:22,134 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-nle_v5f9 3537s 2024-11-23 21:16:22,134 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:16:22,138 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41621. Reason: failure-to-start- 3537s 2024-11-23 21:16:22,139 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:16:22,139 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37227. Reason: failure-to-start- 3537s 2024-11-23 21:16:22,140 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:16:22,141 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44487': TLS handshake failed with remote 'tls://127.0.0.1:45752': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:16:22,141 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44487': TLS handshake failed with remote 'tls://127.0.0.1:45760': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:16:22,143 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:16:23,149 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:16:23,158 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42435 3537s 2024-11-23 21:16:23,159 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42621/status 3537s 2024-11-23 21:16:23,159 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:16:23,176 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45589 3537s 2024-11-23 21:16:23,176 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45589 3537s 2024-11-23 21:16:23,176 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:16:23,176 - distributed.worker - INFO - dashboard at: 127.0.0.1:46229 3537s 2024-11-23 21:16:23,176 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42435 3537s 2024-11-23 21:16:23,176 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:16:23,176 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:16:23,177 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:16:23,177 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-mksty92x 3537s 2024-11-23 21:16:23,177 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:16:23,179 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44491 3537s 2024-11-23 21:16:23,179 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44491 3537s 2024-11-23 21:16:23,179 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:16:23,179 - distributed.worker - INFO - dashboard at: 127.0.0.1:42903 3537s 2024-11-23 21:16:23,179 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42435 3537s 2024-11-23 21:16:23,179 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:16:23,180 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:16:23,180 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:16:23,180 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-t0ujp4el 3537s 2024-11-23 21:16:23,180 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:16:23,183 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45589. Reason: failure-to-start- 3537s 2024-11-23 21:16:23,183 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:16:23,184 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44491. Reason: failure-to-start- 3537s 2024-11-23 21:16:23,184 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:16:23,186 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42435': TLS handshake failed with remote 'tls://127.0.0.1:58290': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:16:23,186 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42435': TLS handshake failed with remote 'tls://127.0.0.1:58292': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:16:23,187 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:16:24,194 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:16:24,202 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34791 3537s 2024-11-23 21:16:24,203 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39311/status 3537s 2024-11-23 21:16:24,203 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:16:24,223 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35675 3537s 2024-11-23 21:16:24,223 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35675 3537s 2024-11-23 21:16:24,223 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:16:24,223 - distributed.worker - INFO - dashboard at: 127.0.0.1:36249 3537s 2024-11-23 21:16:24,223 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34791 3537s 2024-11-23 21:16:24,224 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:16:24,224 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:16:24,224 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:16:24,224 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-4hgr1xop 3537s 2024-11-23 21:16:24,224 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:16:24,226 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40363 3537s 2024-11-23 21:16:24,226 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40363 3537s 2024-11-23 21:16:24,226 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:16:24,227 - distributed.worker - INFO - dashboard at: 127.0.0.1:39563 3537s 2024-11-23 21:16:24,227 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34791 3537s 2024-11-23 21:16:24,227 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:16:24,227 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:16:24,227 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:16:24,227 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-0t1yg3pj 3537s 2024-11-23 21:16:24,227 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:16:24,231 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35675. Reason: failure-to-start- 3537s 2024-11-23 21:16:24,231 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:16:24,232 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40363. Reason: failure-to-start- 3537s 2024-11-23 21:16:24,232 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:16:24,233 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34791': TLS handshake failed with remote 'tls://127.0.0.1:41080': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:16:24,233 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34791': TLS handshake failed with remote 'tls://127.0.0.1:41092': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:16:24,235 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:16:25,242 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:16:25,250 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34143 3537s 2024-11-23 21:16:25,250 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46047/status 3537s 2024-11-23 21:16:25,251 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:16:25,286 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39951 3537s 2024-11-23 21:16:25,286 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39951 3537s 2024-11-23 21:16:25,286 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:16:25,286 - distributed.worker - INFO - dashboard at: 127.0.0.1:43581 3537s 2024-11-23 21:16:25,286 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34143 3537s 2024-11-23 21:16:25,286 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:16:25,286 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:16:25,286 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:16:25,286 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-r_uvb_3p 3537s 2024-11-23 21:16:25,287 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:16:25,289 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33363 3537s 2024-11-23 21:16:25,289 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33363 3537s 2024-11-23 21:16:25,289 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:16:25,289 - distributed.worker - INFO - dashboard at: 127.0.0.1:41771 3537s 2024-11-23 21:16:25,289 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34143 3537s 2024-11-23 21:16:25,289 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:16:25,289 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:16:25,290 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:16:25,290 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-lnhzlhlo 3537s 2024-11-23 21:16:25,290 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:16:25,291 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39951. Reason: failure-to-start- 3537s 2024-11-23 21:16:25,292 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:16:25,292 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33363. Reason: failure-to-start- 3537s 2024-11-23 21:16:25,292 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:16:25,296 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34143': TLS handshake failed with remote 'tls://127.0.0.1:52880': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:16:25,297 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34143': TLS handshake failed with remote 'tls://127.0.0.1:52894': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:16:25,298 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:16:26,305 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:16:26,313 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38877 3537s 2024-11-23 21:16:26,314 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35891/status 3537s 2024-11-23 21:16:26,314 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:16:26,331 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43737 3537s 2024-11-23 21:16:26,331 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43737 3537s 2024-11-23 21:16:26,331 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:16:26,331 - distributed.worker - INFO - dashboard at: 127.0.0.1:46453 3537s 2024-11-23 21:16:26,331 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38877 3537s 2024-11-23 21:16:26,331 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:16:26,331 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:16:26,331 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:16:26,331 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-41o1rp3z 3537s 2024-11-23 21:16:26,331 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:16:26,334 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40439 3537s 2024-11-23 21:16:26,334 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40439 3537s 2024-11-23 21:16:26,334 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:16:26,334 - distributed.worker - INFO - dashboard at: 127.0.0.1:45889 3537s 2024-11-23 21:16:26,334 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38877 3537s 2024-11-23 21:16:26,334 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:16:26,334 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:16:26,334 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:16:26,335 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-z75s1fvz 3537s 2024-11-23 21:16:26,335 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:16:26,339 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43737. Reason: failure-to-start- 3537s 2024-11-23 21:16:26,339 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:16:26,340 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40439. Reason: failure-to-start- 3537s 2024-11-23 21:16:26,340 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:16:26,342 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38877': TLS handshake failed with remote 'tls://127.0.0.1:34846': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:16:26,342 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38877': TLS handshake failed with remote 'tls://127.0.0.1:34860': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:16:26,343 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:16:27,351 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:16:27,359 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36193 3537s 2024-11-23 21:16:27,360 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37837/status 3537s 2024-11-23 21:16:27,360 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:16:27,377 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40597 3537s 2024-11-23 21:16:27,377 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40597 3537s 2024-11-23 21:16:27,377 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:16:27,377 - distributed.worker - INFO - dashboard at: 127.0.0.1:46487 3537s 2024-11-23 21:16:27,377 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36193 3537s 2024-11-23 21:16:27,377 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:16:27,377 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:16:27,377 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:16:27,377 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-lpvkkh_3 3537s 2024-11-23 21:16:27,377 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:16:27,380 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36411 3537s 2024-11-23 21:16:27,380 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36411 3537s 2024-11-23 21:16:27,380 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:16:27,380 - distributed.worker - INFO - dashboard at: 127.0.0.1:38781 3537s 2024-11-23 21:16:27,380 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36193 3537s 2024-11-23 21:16:27,380 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:16:27,380 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:16:27,380 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:16:27,380 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-u8czse84 3537s 2024-11-23 21:16:27,381 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:16:27,385 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40597. Reason: failure-to-start- 3537s 2024-11-23 21:16:27,385 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:16:27,385 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36411. Reason: failure-to-start- 3537s 2024-11-23 21:16:27,385 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:16:27,387 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36193': TLS handshake failed with remote 'tls://127.0.0.1:37852': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:16:27,387 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36193': TLS handshake failed with remote 'tls://127.0.0.1:37856': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:16:27,389 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:16:28,397 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:16:28,406 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44567 3537s 2024-11-23 21:16:28,406 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41559/status 3537s 2024-11-23 21:16:28,406 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:16:28,429 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46779 3537s 2024-11-23 21:16:28,429 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46779 3537s 2024-11-23 21:16:28,429 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:16:28,429 - distributed.worker - INFO - dashboard at: 127.0.0.1:36007 3537s 2024-11-23 21:16:28,429 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44567 3537s 2024-11-23 21:16:28,429 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:16:28,429 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:16:28,429 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:16:28,429 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-yhkuo24o 3537s 2024-11-23 21:16:28,429 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:16:28,432 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39127 3537s 2024-11-23 21:16:28,432 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39127 3537s 2024-11-23 21:16:28,432 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:16:28,432 - distributed.worker - INFO - dashboard at: 127.0.0.1:34181 3537s 2024-11-23 21:16:28,432 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44567 3537s 2024-11-23 21:16:28,432 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:16:28,432 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:16:28,433 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:16:28,433 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-zf2v1jav 3537s 2024-11-23 21:16:28,433 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:16:28,434 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46779. Reason: failure-to-start- 3537s 2024-11-23 21:16:28,434 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:16:28,435 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39127. Reason: failure-to-start- 3537s 2024-11-23 21:16:28,435 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:16:28,437 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44567': TLS handshake failed with remote 'tls://127.0.0.1:50274': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:16:28,437 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44567': TLS handshake failed with remote 'tls://127.0.0.1:50280': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:16:28,439 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:16:29,445 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:16:29,453 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38377 3537s 2024-11-23 21:16:29,454 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36141/status 3537s 2024-11-23 21:16:29,454 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:16:29,472 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38617 3537s 2024-11-23 21:16:29,473 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38617 3537s 2024-11-23 21:16:29,473 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:16:29,473 - distributed.worker - INFO - dashboard at: 127.0.0.1:40393 3537s 2024-11-23 21:16:29,473 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38377 3537s 2024-11-23 21:16:29,473 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:16:29,473 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:16:29,473 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:16:29,473 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-njwqzd7c 3537s 2024-11-23 21:16:29,473 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:16:29,477 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42531 3537s 2024-11-23 21:16:29,477 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42531 3537s 2024-11-23 21:16:29,477 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:16:29,477 - distributed.worker - INFO - dashboard at: 127.0.0.1:41201 3537s 2024-11-23 21:16:29,477 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38377 3537s 2024-11-23 21:16:29,477 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:16:29,478 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:16:29,478 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:16:29,478 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-iakb1cmp 3537s 2024-11-23 21:16:29,478 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:16:29,482 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38617. Reason: failure-to-start- 3537s 2024-11-23 21:16:29,482 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:16:29,482 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42531. Reason: failure-to-start- 3537s 2024-11-23 21:16:29,483 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:16:29,484 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38377': TLS handshake failed with remote 'tls://127.0.0.1:55356': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:16:29,484 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38377': TLS handshake failed with remote 'tls://127.0.0.1:55366': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:16:29,488 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:16:30,495 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:16:30,504 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39055 3537s 2024-11-23 21:16:30,505 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40087/status 3537s 2024-11-23 21:16:30,505 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:16:30,524 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46121 3537s 2024-11-23 21:16:30,524 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46121 3537s 2024-11-23 21:16:30,524 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:16:30,524 - distributed.worker - INFO - dashboard at: 127.0.0.1:46449 3537s 2024-11-23 21:16:30,524 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39055 3537s 2024-11-23 21:16:30,524 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:16:30,524 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:16:30,524 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:16:30,524 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-qw_bes1r 3537s 2024-11-23 21:16:30,525 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:16:30,527 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46485 3537s 2024-11-23 21:16:30,527 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46485 3537s 2024-11-23 21:16:30,527 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:16:30,528 - distributed.worker - INFO - dashboard at: 127.0.0.1:41113 3537s 2024-11-23 21:16:30,528 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39055 3537s 2024-11-23 21:16:30,528 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:16:30,528 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:16:30,528 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:16:30,528 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-izec4u9c 3537s 2024-11-23 21:16:30,528 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:16:30,530 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46121. Reason: failure-to-start- 3537s 2024-11-23 21:16:30,530 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:16:30,530 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46485. Reason: failure-to-start- 3537s 2024-11-23 21:16:30,531 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:16:30,534 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39055': TLS handshake failed with remote 'tls://127.0.0.1:33796': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:16:30,535 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39055': TLS handshake failed with remote 'tls://127.0.0.1:33806': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:16:30,536 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:16:31,544 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:16:31,554 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35299 3537s 2024-11-23 21:16:31,554 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35007/status 3537s 2024-11-23 21:16:31,555 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:16:31,572 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41631 3537s 2024-11-23 21:16:31,572 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41631 3537s 2024-11-23 21:16:31,573 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:16:31,573 - distributed.worker - INFO - dashboard at: 127.0.0.1:36993 3537s 2024-11-23 21:16:31,573 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35299 3537s 2024-11-23 21:16:31,573 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:16:31,573 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:16:31,573 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:16:31,573 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-56_q19df 3537s 2024-11-23 21:16:31,573 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:16:31,575 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45075 3537s 2024-11-23 21:16:31,575 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45075 3537s 2024-11-23 21:16:31,575 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:16:31,576 - distributed.worker - INFO - dashboard at: 127.0.0.1:46541 3537s 2024-11-23 21:16:31,576 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35299 3537s 2024-11-23 21:16:31,576 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:16:31,576 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:16:31,576 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:16:31,576 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-o6_tlg67 3537s 2024-11-23 21:16:31,576 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:16:31,580 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41631. Reason: failure-to-start- 3537s 2024-11-23 21:16:31,580 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:16:31,580 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45075. Reason: failure-to-start- 3537s 2024-11-23 21:16:31,581 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:16:31,582 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35299': TLS handshake failed with remote 'tls://127.0.0.1:38842': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:16:31,583 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35299': TLS handshake failed with remote 'tls://127.0.0.1:38856': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:16:31,587 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:16:32,593 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:16:32,600 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39879 3537s 2024-11-23 21:16:32,601 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41579/status 3537s 2024-11-23 21:16:32,601 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:16:32,618 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41759 3537s 2024-11-23 21:16:32,618 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41759 3537s 2024-11-23 21:16:32,618 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:16:32,618 - distributed.worker - INFO - dashboard at: 127.0.0.1:35357 3537s 2024-11-23 21:16:32,618 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39879 3537s 2024-11-23 21:16:32,618 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:16:32,618 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:16:32,619 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:16:32,619 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-5a9budnh 3537s 2024-11-23 21:16:32,619 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:16:32,621 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39247 3537s 2024-11-23 21:16:32,621 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39247 3537s 2024-11-23 21:16:32,621 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:16:32,621 - distributed.worker - INFO - dashboard at: 127.0.0.1:39577 3537s 2024-11-23 21:16:32,621 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39879 3537s 2024-11-23 21:16:32,621 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:16:32,621 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:16:32,621 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:16:32,621 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-xxchwckj 3537s 2024-11-23 21:16:32,621 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:16:32,625 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41759. Reason: failure-to-start- 3537s 2024-11-23 21:16:32,625 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:16:32,626 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39247. Reason: failure-to-start- 3537s 2024-11-23 21:16:32,626 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:16:32,628 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39879': TLS handshake failed with remote 'tls://127.0.0.1:53658': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:16:32,628 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39879': TLS handshake failed with remote 'tls://127.0.0.1:53662': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:16:32,632 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:16:33,637 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:16:33,645 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36733 3537s 2024-11-23 21:16:33,645 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39155/status 3537s 2024-11-23 21:16:33,646 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:16:33,662 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37723 3537s 2024-11-23 21:16:33,662 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37723 3537s 2024-11-23 21:16:33,662 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:16:33,662 - distributed.worker - INFO - dashboard at: 127.0.0.1:44845 3537s 2024-11-23 21:16:33,663 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36733 3537s 2024-11-23 21:16:33,663 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:16:33,663 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:16:33,663 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:16:33,663 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-d5mljw26 3537s 2024-11-23 21:16:33,663 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:16:33,667 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33145 3537s 2024-11-23 21:16:33,667 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33145 3537s 2024-11-23 21:16:33,667 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:16:33,667 - distributed.worker - INFO - dashboard at: 127.0.0.1:39669 3537s 2024-11-23 21:16:33,667 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36733 3537s 2024-11-23 21:16:33,667 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:16:33,667 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:16:33,667 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:16:33,667 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-k0pzhc32 3537s 2024-11-23 21:16:33,667 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:16:33,672 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37723. Reason: failure-to-start- 3537s 2024-11-23 21:16:33,672 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:16:33,673 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33145. Reason: failure-to-start- 3537s 2024-11-23 21:16:33,673 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:16:33,677 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36733': TLS handshake failed with remote 'tls://127.0.0.1:53598': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:16:33,677 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36733': TLS handshake failed with remote 'tls://127.0.0.1:53608': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:16:33,679 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:16:34,684 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:16:34,707 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34641 3537s 2024-11-23 21:16:34,708 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43313/status 3537s 2024-11-23 21:16:34,708 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:16:34,729 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45727 3537s 2024-11-23 21:16:34,730 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45727 3537s 2024-11-23 21:16:34,730 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:16:34,730 - distributed.worker - INFO - dashboard at: 127.0.0.1:33423 3537s 2024-11-23 21:16:34,730 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34641 3537s 2024-11-23 21:16:34,730 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:16:34,730 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:16:34,730 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:16:34,730 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-bnmko5ij 3537s 2024-11-23 21:16:34,730 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:16:34,733 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35707 3537s 2024-11-23 21:16:34,733 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35707 3537s 2024-11-23 21:16:34,733 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:16:34,733 - distributed.worker - INFO - dashboard at: 127.0.0.1:36605 3537s 2024-11-23 21:16:34,733 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34641 3537s 2024-11-23 21:16:34,733 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:16:34,733 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:16:34,733 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:16:34,733 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-p32309hs 3537s 2024-11-23 21:16:34,733 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:16:34,737 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45727. Reason: failure-to-start- 3537s 2024-11-23 21:16:34,737 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:16:34,737 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35707. Reason: failure-to-start- 3537s 2024-11-23 21:16:34,737 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:16:34,739 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34641': TLS handshake failed with remote 'tls://127.0.0.1:54030': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:16:34,739 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34641': TLS handshake failed with remote 'tls://127.0.0.1:54032': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:16:34,741 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:16:35,747 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:16:35,755 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43055 3537s 2024-11-23 21:16:35,756 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34867/status 3537s 2024-11-23 21:16:35,756 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:16:35,777 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34589 3537s 2024-11-23 21:16:35,777 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34589 3537s 2024-11-23 21:16:35,777 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:16:35,778 - distributed.worker - INFO - dashboard at: 127.0.0.1:45391 3537s 2024-11-23 21:16:35,778 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43055 3537s 2024-11-23 21:16:35,778 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:16:35,778 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:16:35,778 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:16:35,778 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-doz9ginm 3537s 2024-11-23 21:16:35,778 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:16:35,780 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42565 3537s 2024-11-23 21:16:35,780 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42565 3537s 2024-11-23 21:16:35,780 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:16:35,781 - distributed.worker - INFO - dashboard at: 127.0.0.1:39517 3537s 2024-11-23 21:16:35,781 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43055 3537s 2024-11-23 21:16:35,781 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:16:35,781 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:16:35,781 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:16:35,781 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-yj965kjd 3537s 2024-11-23 21:16:35,781 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:16:35,782 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34589. Reason: failure-to-start- 3537s 2024-11-23 21:16:35,783 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:16:35,783 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42565. Reason: failure-to-start- 3537s 2024-11-23 21:16:35,783 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:16:35,785 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43055': TLS handshake failed with remote 'tls://127.0.0.1:58314': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:16:35,785 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43055': TLS handshake failed with remote 'tls://127.0.0.1:58320': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:16:35,787 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:16:36,794 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:16:36,803 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35015 3537s 2024-11-23 21:16:36,804 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46645/status 3537s 2024-11-23 21:16:36,804 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:16:36,820 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33753 3537s 2024-11-23 21:16:36,821 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33753 3537s 2024-11-23 21:16:36,821 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:16:36,821 - distributed.worker - INFO - dashboard at: 127.0.0.1:43391 3537s 2024-11-23 21:16:36,821 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35015 3537s 2024-11-23 21:16:36,821 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:16:36,821 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:16:36,821 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:16:36,821 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-mn5jngfe 3537s 2024-11-23 21:16:36,821 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:16:36,823 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42965 3537s 2024-11-23 21:16:36,824 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42965 3537s 2024-11-23 21:16:36,824 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:16:36,824 - distributed.worker - INFO - dashboard at: 127.0.0.1:44209 3537s 2024-11-23 21:16:36,824 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35015 3537s 2024-11-23 21:16:36,824 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:16:36,824 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:16:36,824 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:16:36,824 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-5r3rfzh1 3537s 2024-11-23 21:16:36,824 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:16:36,829 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33753. Reason: failure-to-start- 3537s 2024-11-23 21:16:36,829 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:16:36,829 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42965. Reason: failure-to-start- 3537s 2024-11-23 21:16:36,830 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:16:36,832 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35015': TLS handshake failed with remote 'tls://127.0.0.1:40186': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:16:36,832 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35015': TLS handshake failed with remote 'tls://127.0.0.1:40192': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:16:36,836 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s _________________________________ test_gather __________________________________ 3537s 3537s fut = , timeout = 0 3537s 3537s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 3537s async with asyncio.timeout(timeout): 3537s > return await fut 3537s 3537s /usr/lib/python3/dist-packages/distributed/utils.py:1960: 3537s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3537s /usr/lib/python3/dist-packages/distributed/worker.py:1480: in start_unsafe 3537s await self._register_with_scheduler() 3537s /usr/lib/python3/dist-packages/distributed/worker.py:1179: in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s /usr/lib/python3/dist-packages/distributed/comm/core.py:342: in connect 3537s comm = await wait_for( 3537s /usr/lib/python3/dist-packages/distributed/utils.py:1960: in wait_for 3537s return await fut 3537s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:546: in connect 3537s stream = await self.client.connect( 3537s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3537s 3537s self = , host = '127.0.0.1' 3537s port = 44759, af = 3537s ssl_options = 3537s max_buffer_size = 8364507136.0, source_ip = None, source_port = None 3537s timeout = None 3537s 3537s async def connect( 3537s self, 3537s host: str, 3537s port: int, 3537s af: socket.AddressFamily = socket.AF_UNSPEC, 3537s ssl_options: Optional[Union[Dict[str, Any], ssl.SSLContext]] = None, 3537s max_buffer_size: Optional[int] = None, 3537s source_ip: Optional[str] = None, 3537s source_port: Optional[int] = None, 3537s timeout: Optional[Union[float, datetime.timedelta]] = None, 3537s ) -> IOStream: 3537s """Connect to the given host and port. 3537s 3537s Asynchronously returns an `.IOStream` (or `.SSLIOStream` if 3537s ``ssl_options`` is not None). 3537s 3537s Using the ``source_ip`` kwarg, one can specify the source 3537s IP address to use when establishing the connection. 3537s In case the user needs to resolve and 3537s use a specific interface, it has to be handled outside 3537s of Tornado as this depends very much on the platform. 3537s 3537s Raises `TimeoutError` if the input future does not complete before 3537s ``timeout``, which may be specified in any form allowed by 3537s `.IOLoop.add_timeout` (i.e. a `datetime.timedelta` or an absolute time 3537s relative to `.IOLoop.time`) 3537s 3537s Similarly, when the user requires a certain source port, it can 3537s be specified using the ``source_port`` arg. 3537s 3537s .. versionchanged:: 4.5 3537s Added the ``source_ip`` and ``source_port`` arguments. 3537s 3537s .. versionchanged:: 5.0 3537s Added the ``timeout`` argument. 3537s """ 3537s if timeout is not None: 3537s if isinstance(timeout, numbers.Real): 3537s timeout = IOLoop.current().time() + timeout 3537s elif isinstance(timeout, datetime.timedelta): 3537s timeout = IOLoop.current().time() + timeout.total_seconds() 3537s else: 3537s raise TypeError("Unsupported timeout %r" % timeout) 3537s if timeout is not None: 3537s addrinfo = await gen.with_timeout( 3537s timeout, self.resolver.resolve(host, port, af) 3537s ) 3537s else: 3537s addrinfo = await self.resolver.resolve(host, port, af) 3537s connector = _Connector( 3537s addrinfo, 3537s functools.partial( 3537s self._create_stream, 3537s max_buffer_size, 3537s source_ip=source_ip, 3537s source_port=source_port, 3537s ), 3537s ) 3537s > af, addr, stream = await connector.start(connect_timeout=timeout) 3537s E asyncio.exceptions.CancelledError 3537s 3537s /usr/lib/python3/dist-packages/tornado/tcpclient.py:279: CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s self = 3537s 3537s @final 3537s async def start(self): 3537s async with self._startup_lock: 3537s if self.status == Status.failed: 3537s assert self.__startup_exc is not None 3537s raise self.__startup_exc 3537s elif self.status != Status.init: 3537s return self 3537s timeout = getattr(self, "death_timeout", None) 3537s 3537s async def _close_on_failure(exc: Exception) -> None: 3537s await self.close(reason=f"failure-to-start-{str(type(exc))}") 3537s self.status = Status.failed 3537s self.__startup_exc = exc 3537s 3537s try: 3537s > await wait_for(self.start_unsafe(), timeout=timeout) 3537s 3537s /usr/lib/python3/dist-packages/distributed/core.py:664: 3537s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3537s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 3537s async with asyncio.timeout(timeout): 3537s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3537s 3537s self = 3537s exc_type = 3537s exc_val = CancelledError(), exc_tb = 3537s 3537s async def __aexit__( 3537s self, 3537s exc_type: Optional[Type[BaseException]], 3537s exc_val: Optional[BaseException], 3537s exc_tb: Optional[TracebackType], 3537s ) -> Optional[bool]: 3537s assert self._state in (_State.ENTERED, _State.EXPIRING) 3537s 3537s if self._timeout_handler is not None: 3537s self._timeout_handler.cancel() 3537s self._timeout_handler = None 3537s 3537s if self._state is _State.EXPIRING: 3537s self._state = _State.EXPIRED 3537s 3537s if self._task.uncancel() <= self._cancelling and exc_type is not None: 3537s # Since there are no new cancel requests, we're 3537s # handling this. 3537s if issubclass(exc_type, exceptions.CancelledError): 3537s > raise TimeoutError from exc_val 3537s E TimeoutError 3537s 3537s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s @contextlib.asynccontextmanager 3537s async def _cluster_factory(): 3537s workers = [] 3537s s = None 3537s try: 3537s for _ in range(60): 3537s try: 3537s > s, ws = await start_cluster( 3537s nthreads, 3537s scheduler, 3537s security=security, 3537s Worker=Worker, 3537s scheduler_kwargs=scheduler_kwargs, 3537s worker_kwargs=merge( 3537s {"death_timeout": min(15, int(deadline.remaining))}, 3537s worker_kwargs, 3537s ), 3537s ) 3537s 3537s /usr/lib/python3/dist-packages/distributed/utils_test.py:966: 3537s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3537s /usr/lib/python3/dist-packages/distributed/utils_test.py:789: in start_cluster 3537s await asyncio.gather(*workers) 3537s /usr/lib/python3.13/asyncio/tasks.py:737: in _wrap_awaitable 3537s return await awaitable 3537s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3537s 3537s self = 3537s 3537s @final 3537s async def start(self): 3537s async with self._startup_lock: 3537s if self.status == Status.failed: 3537s assert self.__startup_exc is not None 3537s raise self.__startup_exc 3537s elif self.status != Status.init: 3537s return self 3537s timeout = getattr(self, "death_timeout", None) 3537s 3537s async def _close_on_failure(exc: Exception) -> None: 3537s await self.close(reason=f"failure-to-start-{str(type(exc))}") 3537s self.status = Status.failed 3537s self.__startup_exc = exc 3537s 3537s try: 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s except asyncio.TimeoutError as exc: 3537s await _close_on_failure(exc) 3537s > raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s E TimeoutError: Worker start timed out after 0s. 3537s 3537s /usr/lib/python3/dist-packages/distributed/core.py:667: TimeoutError 3537s 3537s During handling of the above exception, another exception occurred: 3537s 3537s fut = ._..test_func..async_fn at 0xe247cb08> 3537s timeout = 60 3537s 3537s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 3537s async with asyncio.timeout(timeout): 3537s > return await fut 3537s 3537s /usr/lib/python3/dist-packages/distributed/utils.py:1960: 3537s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3537s /usr/lib/python3/dist-packages/distributed/utils_test.py:999: in async_fn 3537s _cluster_factory() as (s, workers), 3537s /usr/lib/python3.13/contextlib.py:214: in __aenter__ 3537s return await anext(self.gen) 3537s /usr/lib/python3/dist-packages/distributed/utils_test.py:983: in _cluster_factory 3537s await asyncio.sleep(1) 3537s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3537s 3537s delay = 1, result = None 3537s 3537s async def sleep(delay, result=None): 3537s """Coroutine that completes after a given time (in seconds).""" 3537s if delay <= 0: 3537s await __sleep0() 3537s return result 3537s 3537s if math.isnan(delay): 3537s raise ValueError("Invalid delay: NaN (not a number)") 3537s 3537s loop = events.get_running_loop() 3537s future = loop.create_future() 3537s h = loop.call_later(delay, 3537s futures._set_result_unless_cancelled, 3537s future, result) 3537s try: 3537s > return await future 3537s E asyncio.exceptions.CancelledError 3537s 3537s /usr/lib/python3.13/asyncio/tasks.py:718: CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s args = (), kwds = {} 3537s 3537s @wraps(func) 3537s def inner(*args, **kwds): 3537s with self._recreate_cm(): 3537s > return func(*args, **kwds) 3537s 3537s /usr/lib/python3.13/contextlib.py:85: 3537s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3537s /usr/lib/python3.13/contextlib.py:85: in inner 3537s return func(*args, **kwds) 3537s /usr/lib/python3/dist-packages/distributed/utils_test.py:1102: in test_func 3537s return _run_and_close_tornado(async_fn_outer) 3537s /usr/lib/python3/dist-packages/distributed/utils_test.py:378: in _run_and_close_tornado 3537s return asyncio_run(inner_fn(), loop_factory=get_loop_factory()) 3537s /usr/lib/python3.13/asyncio/runners.py:194: in run 3537s return runner.run(main) 3537s /usr/lib/python3.13/asyncio/runners.py:118: in run 3537s return self._loop.run_until_complete(task) 3537s /usr/lib/python3.13/asyncio/base_events.py:720: in run_until_complete 3537s return future.result() 3537s /usr/lib/python3/dist-packages/distributed/utils_test.py:375: in inner_fn 3537s return await async_fn(*args, **kwargs) 3537s /usr/lib/python3/dist-packages/distributed/utils_test.py:1099: in async_fn_outer 3537s return await utils_wait_for(async_fn(), timeout=timeout * 2) 3537s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 3537s async with asyncio.timeout(timeout): 3537s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3537s 3537s self = 3537s exc_type = 3537s exc_val = CancelledError(), exc_tb = 3537s 3537s async def __aexit__( 3537s self, 3537s exc_type: Optional[Type[BaseException]], 3537s exc_val: Optional[BaseException], 3537s exc_tb: Optional[TracebackType], 3537s ) -> Optional[bool]: 3537s assert self._state in (_State.ENTERED, _State.EXPIRING) 3537s 3537s if self._timeout_handler is not None: 3537s self._timeout_handler.cancel() 3537s self._timeout_handler = None 3537s 3537s if self._state is _State.EXPIRING: 3537s self._state = _State.EXPIRED 3537s 3537s if self._task.uncancel() <= self._cancelling and exc_type is not None: 3537s # Since there are no new cancel requests, we're 3537s # handling this. 3537s if issubclass(exc_type, exceptions.CancelledError): 3537s > raise TimeoutError from exc_val 3537s E TimeoutError 3537s 3537s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 3537s ----------------------------- Captured stderr call ----------------------------- 3537s 2024-11-23 21:16:38,060 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:16:38,070 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:38,071 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40025/status 3537s 2024-11-23 21:16:38,071 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:16:38,086 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35625 3537s 2024-11-23 21:16:38,087 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35625 3537s 2024-11-23 21:16:38,087 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:16:38,087 - distributed.worker - INFO - dashboard at: 127.0.0.1:37305 3537s 2024-11-23 21:16:38,087 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:38,087 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:16:38,087 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:16:38,087 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:16:38,087 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-hb61cmsc 3537s 2024-11-23 21:16:38,087 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:16:38,089 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45741 3537s 2024-11-23 21:16:38,090 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45741 3537s 2024-11-23 21:16:38,090 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:16:38,090 - distributed.worker - INFO - dashboard at: 127.0.0.1:32869 3537s 2024-11-23 21:16:38,090 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:38,090 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:16:38,090 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:16:38,090 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:16:38,090 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-0nihdd42 3537s 2024-11-23 21:16:38,090 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:16:38,103 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:38,104 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:38,104 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:35380': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:38,104 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:35392': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:38,216 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:38,216 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:38,217 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:35402': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:38,217 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:35414': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:38,330 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:38,330 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:38,332 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:35428': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:38,332 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:35438': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:38,444 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:38,445 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:38,445 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:35446': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:38,445 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:35452': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:38,558 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:38,558 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:38,559 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:35458': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:38,559 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:35470': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:38,671 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:38,672 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:38,672 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:35482': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:38,672 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:35492': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:38,783 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:38,785 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:38,785 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:35508': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:38,785 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:35514': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:38,892 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:38,897 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:35522': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:38,898 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:38,898 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:35528': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:39,000 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:39,001 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:35536': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:39,007 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:39,007 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:35552': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:39,109 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:39,110 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:35568': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:39,116 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:39,116 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:35576': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:39,217 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:39,217 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:35584': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:39,224 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:39,224 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:35592': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:39,325 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:39,325 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:35594': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:39,332 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:39,332 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:35608': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:39,432 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:39,433 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:35614': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:39,439 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:39,439 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:35616': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:39,540 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:39,541 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:35628': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:39,547 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:39,547 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:35636': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:39,648 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:39,648 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:35642': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:39,655 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:39,655 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:35652': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:39,756 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:39,757 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:35668': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:39,763 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:39,763 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:35684': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:39,865 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:39,866 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:35690': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:39,872 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:39,873 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:35706': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:39,973 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:39,974 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:35720': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:39,982 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:39,982 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:35728': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:40,082 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:40,082 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:35736': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:40,089 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:40,089 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:35752': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:40,189 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:40,190 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:35766': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:40,196 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:40,197 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:35774': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:40,298 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:40,299 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:35776': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:40,305 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:40,305 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:35786': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:40,406 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:40,407 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:35788': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:40,413 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:40,414 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:35794': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:40,514 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:40,515 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:35810': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:40,521 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:40,522 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:35814': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:40,622 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:40,623 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:35830': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:40,629 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:40,630 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:35842': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:40,730 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:40,731 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:35858': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:40,737 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:40,737 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:35864': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:40,839 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:40,840 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:35866': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:40,846 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:40,846 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:35870': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:40,947 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:40,948 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:35886': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:40,954 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:40,954 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:35888': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:41,055 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:41,056 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:35902': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:41,062 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:41,063 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:35910': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:41,163 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:41,163 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:35918': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:41,170 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:41,170 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:35926': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:41,271 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:41,271 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:35934': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:41,277 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:41,278 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:35950': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:41,379 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:41,380 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:35960': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:41,385 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:41,386 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:35974': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:41,486 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:41,487 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:35978': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:41,493 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:41,493 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:35994': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:41,595 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:41,596 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:39952': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:41,602 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:41,603 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:39956': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:41,705 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:41,705 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:39960': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:41,711 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:41,712 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:39970': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:41,812 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:41,813 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:39984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:41,819 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:41,819 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:39994': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:41,920 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:41,921 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:40002': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:41,927 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:41,927 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:40018': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:42,041 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:42,042 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:40022': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:42,049 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:42,049 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:40026': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:42,149 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:42,150 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:40038': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:42,156 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:42,156 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:40048': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:42,257 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:42,257 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:40050': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:42,263 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:42,264 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:40058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:42,365 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:42,366 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:40062': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:42,372 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:42,373 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:40078': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:42,473 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:42,474 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:40080': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:42,480 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:42,480 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:40090': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:42,581 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:42,582 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:40100': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:42,588 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:42,588 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:40112': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:42,689 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:42,690 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:40114': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:42,696 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:42,696 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:40118': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:42,798 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:42,799 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:40126': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:42,804 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:42,805 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:40138': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:42,906 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:42,907 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:40146': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:42,913 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:42,913 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:40152': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:43,013 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:43,014 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:40168': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:43,020 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:43,020 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:40172': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:43,121 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:43,122 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:40184': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:43,128 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:43,129 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:40198': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:43,229 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:43,229 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:40202': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:43,236 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:43,236 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:40214': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:43,338 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:43,339 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:40226': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:43,347 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:43,348 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:40232': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:43,448 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:43,448 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:40236': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:43,455 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:43,455 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:40244': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:43,555 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:43,556 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:40260': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:43,562 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:43,563 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:40272': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:43,676 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:43,678 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:40278': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:43,684 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:43,685 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:40292': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:43,784 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:43,784 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:40294': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:43,792 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:43,793 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:40296': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:43,892 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:43,892 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:40298': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:43,900 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:43,901 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:40306': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:43,999 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:44,000 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:40318': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:44,008 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:44,008 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:40322': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:44,107 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:44,108 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:40330': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:44,116 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:44,116 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:40342': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:44,216 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:44,217 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:40352': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:44,223 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:44,224 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:40358': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:44,325 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:44,326 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:40360': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:44,332 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:44,332 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:40362': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:44,433 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:44,433 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:40364': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:44,440 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:44,440 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:40366': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:44,541 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:44,542 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:40376': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:44,548 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:44,549 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:40386': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:44,648 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:44,649 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:40390': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:44,655 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:44,656 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:40398': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:44,757 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:44,757 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:40410': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:44,764 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:44,764 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:40420': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:44,864 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:44,865 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:40422': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:44,872 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:44,872 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:40426': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:44,973 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:44,973 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:40432': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:44,980 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:44,980 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:40440': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:45,084 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:45,085 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:40456': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:45,092 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:45,092 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:40462': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:45,193 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:45,194 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:40470': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:45,200 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:45,201 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:40478': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:45,301 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:45,302 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:40494': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:45,308 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:45,309 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:40496': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:45,409 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:45,409 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:40498': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:45,416 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:45,416 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:40506': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:45,517 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:45,518 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:40512': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:45,524 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:45,524 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:40522': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:45,625 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:45,626 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:40528': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:45,632 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:45,633 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:40540': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:45,733 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:45,734 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:40542': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:45,741 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:45,741 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:40558': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:45,841 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:45,842 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:40574': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:45,848 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:45,849 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:40578': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:45,949 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:45,950 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:40586': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:45,956 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:45,957 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:40602': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:46,058 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:46,059 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:40606': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:46,065 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:46,065 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:40612': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:46,166 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:46,166 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:40622': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:46,173 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:46,174 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:40638': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:46,274 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:46,275 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:40646': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:46,281 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:46,282 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:40654': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:46,382 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:46,382 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:40668': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:46,389 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:46,389 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:40670': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:46,489 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:46,490 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:40678': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:46,497 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:46,497 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:40686': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:46,597 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:46,598 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:40696': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:46,604 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:46,605 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:40700': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:46,706 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:46,711 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:40702': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:46,718 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:46,718 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:40718': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:46,815 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:46,815 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:40732': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:46,825 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:46,826 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:40744': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:46,923 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:46,924 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:40758': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:46,932 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:46,933 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:40760': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:47,031 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:47,031 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:40772': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:47,040 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:47,041 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:40784': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:47,139 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:47,140 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:40788': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:47,147 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:47,148 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:40800': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:47,247 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:47,247 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:40806': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:47,255 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:47,256 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:40816': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:47,356 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:47,356 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:40826': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:47,363 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:47,363 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:40840': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:47,464 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:47,465 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:40856': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:47,471 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:47,472 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:40860': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:47,573 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:47,576 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:40862': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:47,583 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:47,584 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:40878': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:47,681 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:47,681 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:40882': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:47,691 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:47,691 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:40896': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:47,789 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:47,790 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:40898': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:47,799 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:47,799 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:40912': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:47,899 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:47,899 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:40924': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:47,906 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:47,906 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:40932': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:48,007 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:48,007 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:40934': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:48,014 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:48,015 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:40948': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:48,115 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:48,115 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:40954': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:48,122 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:48,123 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:40958': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:48,223 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:48,223 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:40968': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:48,230 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:48,230 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:40972': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:48,331 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:48,331 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:40988': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:48,338 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:48,338 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:40998': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:48,441 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:48,442 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:41006': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:48,448 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:48,449 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:41008': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:48,561 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:48,562 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:41022': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:48,568 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:48,569 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:41034': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:48,669 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:48,669 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:41038': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:48,676 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:48,677 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:41054': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:48,777 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:48,778 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:41058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:48,784 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:48,784 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:41072': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:48,885 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:48,885 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:41084': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:48,892 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:48,892 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:41086': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:48,993 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:48,994 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:41100': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:49,001 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:49,001 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:41116': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:49,102 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:49,102 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:41128': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:49,109 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:49,109 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:41130': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:49,210 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:49,211 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:41138': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:49,217 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:49,218 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:41152': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:49,318 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:49,319 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:41166': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:49,325 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:49,326 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:41176': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:49,426 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:49,426 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:41190': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:49,433 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:49,433 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:41206': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:49,534 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:49,534 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:41222': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:49,541 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:49,541 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:41236': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:49,642 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:49,643 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:41248': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:49,649 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:49,650 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:41250': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:49,752 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:49,753 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:41266': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:49,759 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:49,760 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:41274': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:49,860 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:49,860 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:41276': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:49,867 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:49,867 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:41282': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:49,968 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:49,969 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:41294': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:49,976 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:49,976 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:41300': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:50,078 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:50,082 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:41304': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:50,088 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:50,089 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:41306': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:50,185 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:50,186 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:41322': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:50,196 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:50,197 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:41330': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:50,294 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:50,295 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:41344': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:50,304 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:50,304 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:41348': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:50,402 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:50,403 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:41362': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:50,411 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:50,412 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:41376': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:50,510 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:50,511 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:41386': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:50,518 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:50,519 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:41392': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:50,618 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:50,619 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:41400': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:50,626 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:50,627 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:41412': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:50,728 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:50,728 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:41414': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:50,735 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:50,735 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:41416': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:50,835 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:50,836 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:41432': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:50,842 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:50,843 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:41442': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:50,944 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:50,945 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:41450': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:50,951 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:50,951 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:41456': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:51,052 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:51,053 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:41470': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:51,060 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:51,060 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:41476': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:51,160 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:51,161 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:41484': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:51,168 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:51,168 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:41490': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:51,269 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:51,270 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:41496': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:51,276 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:51,277 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:41512': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:51,377 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:51,377 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:41514': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:51,384 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:51,384 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:41530': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:51,484 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:51,485 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:41536': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:51,491 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:51,492 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:41548': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:51,592 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:51,592 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:50106': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:51,599 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:51,599 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:50118': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:51,700 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:51,700 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:50122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:51,709 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:51,709 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:50132': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:51,808 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:51,809 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:50146': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:51,816 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:51,817 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:50148': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:51,916 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:51,916 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:50162': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:51,924 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:51,924 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:50172': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:52,024 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:52,024 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:50180': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:52,031 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:52,031 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:50188': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:52,132 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:52,132 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:50202': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:52,139 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:52,139 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:50204': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:52,240 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:52,240 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:50218': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:52,247 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:52,247 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:50232': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:52,348 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:52,349 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:50242': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:52,355 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:52,356 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:50258': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:52,456 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:52,457 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:50272': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:52,464 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:52,464 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:50288': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:52,565 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:52,565 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:50304': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:52,572 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:52,572 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:50312': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:52,673 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:52,673 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:50326': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:52,680 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:52,680 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:50336': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:52,780 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:52,781 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:50352': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:52,787 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:52,788 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:50364': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:52,889 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:52,890 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:50372': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:52,896 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:52,896 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:50378': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:52,996 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:52,997 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:50394': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:53,003 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44707 3537s 2024-11-23 21:16:53,003 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44707': TLS handshake failed with remote 'tls://127.0.0.1:50402': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:53,086 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35625. Reason: failure-to-start- 3537s 2024-11-23 21:16:53,086 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:16:53,088 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45741. Reason: failure-to-start- 3537s 2024-11-23 21:16:53,088 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:16:53,090 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 15s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 3537s stream = await stream.start_tls( 3537s ^^^^^^^^^^^^^^^^^^^^^^^ 3537s False, ssl_options=ssl_options, server_hostname=host 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 3537s self.socket.do_handshake() 3537s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 3537s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 3537s self._sslobj.do_handshake() 3537s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 3537s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 3537s raise FatalCommClosedError( 3537s ...<2 lines>... 3537s ) from err 3537s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 3537s 3537s During handling of the above exception, another exception occurred: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1218, in _register_with_scheduler 3537s await asyncio.sleep(0.1) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 718, in sleep 3537s return await future 3537s ^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 15s. 3537s 2024-11-23 21:16:54,098 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:16:54,111 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33225 3537s 2024-11-23 21:16:54,111 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37431/status 3537s 2024-11-23 21:16:54,111 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:16:54,128 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33073 3537s 2024-11-23 21:16:54,129 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33073 3537s 2024-11-23 21:16:54,129 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:16:54,129 - distributed.worker - INFO - dashboard at: 127.0.0.1:37061 3537s 2024-11-23 21:16:54,129 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:16:54,129 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:16:54,129 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:16:54,129 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:16:54,129 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-k6u63r74 3537s 2024-11-23 21:16:54,129 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:16:54,132 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38829 3537s 2024-11-23 21:16:54,132 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38829 3537s 2024-11-23 21:16:54,132 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:16:54,132 - distributed.worker - INFO - dashboard at: 127.0.0.1:35381 3537s 2024-11-23 21:16:54,132 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:16:54,132 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:16:54,132 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:16:54,132 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:16:54,132 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-gaaoui9l 3537s 2024-11-23 21:16:54,132 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:16:54,146 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:16:54,146 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:16:54,146 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:34398': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:54,147 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:34410': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:54,259 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:16:54,259 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:16:54,260 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:34414': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:54,260 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:34418': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:54,373 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:16:54,373 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:16:54,373 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:34424': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:54,374 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:34426': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:54,486 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:16:54,487 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:16:54,487 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:34438': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:54,487 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:34444': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:54,600 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:16:54,600 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:16:54,601 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:34446': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:54,601 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:34460': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:54,713 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:16:54,714 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:16:54,714 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:34470': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:54,714 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:34472': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:54,827 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:16:54,827 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:16:54,828 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:34488': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:54,828 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:34500': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:54,941 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:16:54,943 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:16:54,944 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:34508': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:54,944 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:34512': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:55,051 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:16:55,056 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:34516': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:55,057 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:16:55,057 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:34532': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:55,159 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:16:55,160 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:34546': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:55,167 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:16:55,167 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:34558': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:55,267 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:16:55,268 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:34562': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:55,275 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:16:55,275 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:34566': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:55,376 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:16:55,376 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:34580': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:55,383 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:16:55,384 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:34594': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:55,483 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:16:55,484 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:34602': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:55,490 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:16:55,491 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:34612': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:55,593 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:16:55,594 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:34618': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:55,600 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:16:55,600 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:34624': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:55,700 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:16:55,701 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:34626': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:55,707 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:16:55,708 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:34630': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:55,808 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:16:55,808 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:34634': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:55,815 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:16:55,816 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:34638': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:55,918 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:16:55,919 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:34644': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:55,925 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:16:55,925 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:34650': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:56,025 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:16:56,026 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:34666': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:56,032 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:16:56,033 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:34676': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:56,133 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:16:56,133 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:34688': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:56,140 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:16:56,140 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:34694': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:56,241 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:16:56,241 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:34702': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:56,248 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:16:56,248 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:34718': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:56,349 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:16:56,349 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:34726': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:56,356 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:16:56,357 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:34734': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:56,457 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:16:56,457 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:34744': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:56,464 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:16:56,464 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:34756': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:56,565 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:16:56,565 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:34758': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:56,574 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:16:56,578 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:34774': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:56,673 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:16:56,674 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:34778': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:56,680 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:16:56,681 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:34792': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:56,781 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:16:56,781 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:34804': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:56,788 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:16:56,788 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:34812': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:56,890 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:16:56,891 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:34828': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:56,897 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:16:56,897 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:34844': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:56,997 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:16:56,998 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:34846': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:57,004 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:16:57,005 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:34860': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:57,105 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:16:57,105 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:34874': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:57,112 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:16:57,112 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:34888': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:57,213 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:16:57,214 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:34890': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:57,220 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:16:57,220 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:34902': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:57,320 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:16:57,321 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:34906': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:57,328 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:16:57,328 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:34922': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:57,429 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:16:57,430 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:34938': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:57,436 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:16:57,437 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:34942': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:57,537 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:16:57,537 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:34950': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:57,544 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:16:57,544 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:34962': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:57,645 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:16:57,646 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:34966': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:57,652 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:16:57,653 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:34976': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:57,753 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:16:57,753 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:34990': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:57,760 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:16:57,760 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:35004': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:57,861 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:16:57,861 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:35018': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:57,868 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:16:57,868 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:35026': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:57,968 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:16:57,969 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:35042': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:57,976 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:16:57,976 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:35050': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:58,076 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:16:58,080 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:35056': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:58,087 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:16:58,087 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:35064': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:58,183 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:16:58,184 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:35072': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:58,194 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:16:58,194 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:35076': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:58,293 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:16:58,294 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:35088': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:58,301 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:16:58,302 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:35102': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:58,401 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:16:58,402 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:35108': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:58,409 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:16:58,409 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:35118': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:58,509 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:16:58,510 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:35132': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:58,516 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:16:58,517 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:35140': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:58,621 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:16:58,622 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:35156': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:58,628 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:16:58,628 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:35164': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:58,730 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:16:58,731 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:35180': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:58,737 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:16:58,737 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:35192': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:58,837 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:16:58,838 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:35204': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:58,844 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:16:58,845 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:35216': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:58,947 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:16:58,948 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:35220': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:58,954 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:16:58,955 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:35236': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:59,054 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:16:59,055 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:35252': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:59,061 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:16:59,062 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:35268': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:59,163 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:16:59,164 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:35274': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:59,170 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:16:59,170 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:35286': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:59,273 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:16:59,274 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:35298': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:59,280 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:16:59,280 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:35312': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:59,382 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:16:59,383 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:35320': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:59,389 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:16:59,389 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:35332': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:59,491 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:16:59,492 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:35344': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:59,498 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:16:59,498 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:35348': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:59,598 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:16:59,599 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:35364': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:59,605 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:16:59,606 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:35374': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:59,706 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:16:59,707 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:35386': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:59,713 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:16:59,714 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:35398': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:59,814 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:16:59,814 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:35404': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:59,821 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:16:59,821 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:35416': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:59,922 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:16:59,922 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:35420': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:16:59,931 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:16:59,931 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:35424': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:00,030 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:17:00,031 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:35436': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:00,038 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:17:00,039 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:35448': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:00,150 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:17:00,151 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:35460': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:00,158 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:17:00,158 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:35476': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:00,258 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:17:00,258 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:35484': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:00,264 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:17:00,265 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:35492': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:00,366 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:17:00,366 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:35500': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:00,373 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:17:00,374 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:35504': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:00,474 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:17:00,474 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:35510': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:00,481 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:17:00,481 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:35512': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:00,584 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:17:00,585 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:35526': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:00,591 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:17:00,592 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:35540': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:00,693 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:17:00,694 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:35546': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:00,700 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:17:00,701 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:35562': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:00,801 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:17:00,801 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:35568': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:00,808 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:17:00,808 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:35570': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:00,909 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:17:00,909 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:35580': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:00,916 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:17:00,917 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:35588': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:01,017 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:17:01,018 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:35598': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:01,025 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:17:01,025 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:35612': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:01,126 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:17:01,126 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:35618': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:01,133 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:17:01,133 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:35634': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:01,233 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:17:01,234 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:35648': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:01,240 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:17:01,241 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:35654': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:01,341 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:17:01,342 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:35670': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:01,349 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:17:01,349 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:35674': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:01,449 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:17:01,450 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:35676': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:01,457 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:17:01,457 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:35692': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:01,558 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:17:01,559 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:44240': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:01,565 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:17:01,566 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:44254': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:01,666 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:17:01,667 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:44262': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:01,673 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:17:01,674 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:44274': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:01,775 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:17:01,776 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:44282': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:01,782 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:17:01,782 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:44296': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:01,882 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:17:01,883 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:44298': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:01,890 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:17:01,890 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:44314': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:01,990 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:17:01,991 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:44324': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:01,998 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:17:01,998 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:44330': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:02,099 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:17:02,099 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:44340': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:02,105 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:17:02,106 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:44346': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:02,206 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:17:02,206 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:44356': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:02,213 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:17:02,213 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:44362': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:02,314 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:17:02,315 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:44372': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:02,321 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:17:02,322 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:44382': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:02,421 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:17:02,422 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:44390': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:02,428 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:17:02,429 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:44394': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:02,529 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:17:02,530 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:44396': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:02,536 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:17:02,536 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:44406': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:02,638 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:17:02,639 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:44418': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:02,645 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:17:02,645 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:44432': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:02,746 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:17:02,747 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:44440': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:02,753 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:17:02,754 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:44454': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:02,855 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:17:02,856 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:44464': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:02,862 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:17:02,862 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:44478': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:02,962 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:17:02,963 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:44484': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:02,969 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:17:02,970 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:44492': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:03,070 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:17:03,071 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:44504': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:03,080 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:17:03,081 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:44518': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:03,180 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:17:03,180 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:44528': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:03,188 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:17:03,189 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:44544': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:03,289 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:17:03,290 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:44560': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:03,296 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:17:03,297 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:44568': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:03,397 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:17:03,398 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:44580': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:03,404 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:17:03,405 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:44596': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:03,504 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:17:03,505 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:44600': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:03,511 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:17:03,512 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:44602': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:03,613 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:17:03,613 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:44606': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:03,622 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:17:03,623 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:44618': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:03,720 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:17:03,720 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:44630': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:03,730 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:17:03,730 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:44638': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:03,827 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:17:03,828 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:44650': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:03,837 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:17:03,838 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:44666': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:03,935 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:17:03,936 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:44682': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:03,944 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:17:03,945 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:44686': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:04,043 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:17:04,043 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:44690': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:04,052 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:17:04,053 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:44704': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:04,151 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:17:04,151 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:44716': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:04,159 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:17:04,159 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:44732': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:04,258 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:17:04,259 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:44746': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:04,265 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:17:04,266 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:44752': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:04,368 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:17:04,369 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:44756': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:04,375 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:17:04,375 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:44772': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:04,476 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:17:04,477 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:44786': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:04,483 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:17:04,484 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:44794': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:04,584 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:17:04,585 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:44808': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:04,591 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:17:04,592 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:44816': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:04,693 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:17:04,694 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:44832': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:04,700 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:17:04,700 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:44846': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:04,801 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:17:04,801 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:44852': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:04,808 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:17:04,808 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:44868': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:04,909 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:17:04,909 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:44870': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:04,918 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:17:04,918 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:44874': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:05,017 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:17:05,017 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:44878': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:05,025 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:17:05,026 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:44888': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:05,124 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:17:05,125 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:44892': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:05,132 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:17:05,133 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:44898': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:05,231 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:17:05,232 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:44906': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:05,240 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:17:05,240 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:44912': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:05,340 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:17:05,341 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:44922': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:05,347 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:17:05,348 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:44924': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:05,448 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:17:05,448 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:44926': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:05,455 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:17:05,455 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:44934': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:05,556 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:17:05,557 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:44936': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:05,563 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:17:05,564 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:44948': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:05,664 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:17:05,665 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:44964': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:05,671 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:17:05,672 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:44980': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:05,773 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:17:05,774 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:44984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:05,780 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:17:05,780 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:44992': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:05,880 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:17:05,880 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:45006': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:05,887 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:17:05,887 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:45008': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:05,987 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:17:05,987 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:45016': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:05,994 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:17:05,994 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:45026': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:06,095 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:17:06,096 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:45028': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:06,102 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:17:06,102 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:45034': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:06,203 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:17:06,204 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:45036': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:06,210 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:17:06,211 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:45050': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:06,312 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:17:06,313 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:45064': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:06,319 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:17:06,319 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:45070': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:06,420 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:17:06,421 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:45086': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:06,427 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:17:06,427 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:45100': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:06,529 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:17:06,530 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:45106': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:06,536 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:17:06,536 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:45116': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:06,637 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:17:06,638 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:45130': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:06,644 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:17:06,645 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:45134': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:06,746 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:17:06,747 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:45146': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:06,753 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:17:06,754 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:45150': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:06,854 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:17:06,855 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:45154': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:06,861 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:17:06,862 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:45170': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:06,961 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:17:06,962 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:45176': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:06,968 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:17:06,969 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:45182': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:07,069 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:17:07,070 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:45188': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:07,076 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 3537s 2024-11-23 21:17:07,080 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:45200': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:07,127 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33073. Reason: failure-to-start- 3537s 2024-11-23 21:17:07,127 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:17:07,130 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 13s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 3537s stream = await stream.start_tls( 3537s ^^^^^^^^^^^^^^^^^^^^^^^ 3537s False, ssl_options=ssl_options, server_hostname=host 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 3537s self.socket.do_handshake() 3537s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 3537s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 3537s self._sslobj.do_handshake() 3537s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 3537s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 3537s raise FatalCommClosedError( 3537s ...<2 lines>... 3537s ) from err 3537s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 3537s 3537s During handling of the above exception, another exception occurred: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1218, in _register_with_scheduler 3537s await asyncio.sleep(0.1) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 718, in sleep 3537s return await future 3537s ^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 13s. 3537s 2024-11-23 21:17:07,134 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38829. Reason: failure-to-start- 3537s 2024-11-23 21:17:07,134 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:17:08,137 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:17:08,145 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44077 3537s 2024-11-23 21:17:08,146 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36427/status 3537s 2024-11-23 21:17:08,146 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:17:08,162 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38385 3537s 2024-11-23 21:17:08,162 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38385 3537s 2024-11-23 21:17:08,162 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:17:08,162 - distributed.worker - INFO - dashboard at: 127.0.0.1:42699 3537s 2024-11-23 21:17:08,162 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44077 3537s 2024-11-23 21:17:08,162 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:17:08,162 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:17:08,162 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:17:08,162 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-a78221x9 3537s 2024-11-23 21:17:08,162 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:17:08,164 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43615 3537s 2024-11-23 21:17:08,165 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43615 3537s 2024-11-23 21:17:08,165 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:17:08,165 - distributed.worker - INFO - dashboard at: 127.0.0.1:32967 3537s 2024-11-23 21:17:08,165 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44077 3537s 2024-11-23 21:17:08,165 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:17:08,165 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:17:08,165 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:17:08,165 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-xtgo9_ub 3537s 2024-11-23 21:17:08,167 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:17:08,168 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38385. Reason: failure-to-start- 3537s 2024-11-23 21:17:08,168 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:17:08,168 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43615. Reason: failure-to-start- 3537s 2024-11-23 21:17:08,169 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:17:08,170 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44077': TLS handshake failed with remote 'tls://127.0.0.1:38718': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:17:08,170 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44077': TLS handshake failed with remote 'tls://127.0.0.1:38726': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:17:08,172 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:17:09,177 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:17:09,185 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38481 3537s 2024-11-23 21:17:09,186 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41015/status 3537s 2024-11-23 21:17:09,186 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:17:09,201 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41431 3537s 2024-11-23 21:17:09,201 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41431 3537s 2024-11-23 21:17:09,201 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:17:09,201 - distributed.worker - INFO - dashboard at: 127.0.0.1:42759 3537s 2024-11-23 21:17:09,201 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38481 3537s 2024-11-23 21:17:09,201 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:17:09,201 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:17:09,201 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:17:09,201 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-70t4_aey 3537s 2024-11-23 21:17:09,201 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:17:09,204 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39465 3537s 2024-11-23 21:17:09,204 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39465 3537s 2024-11-23 21:17:09,204 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:17:09,204 - distributed.worker - INFO - dashboard at: 127.0.0.1:42875 3537s 2024-11-23 21:17:09,204 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38481 3537s 2024-11-23 21:17:09,204 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:17:09,204 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:17:09,204 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:17:09,204 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-7ja2o00j 3537s 2024-11-23 21:17:09,204 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:17:09,205 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41431. Reason: failure-to-start- 3537s 2024-11-23 21:17:09,206 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:17:09,206 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39465. Reason: failure-to-start- 3537s 2024-11-23 21:17:09,206 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:17:09,208 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38481': TLS handshake failed with remote 'tls://127.0.0.1:39816': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:17:09,208 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38481': TLS handshake failed with remote 'tls://127.0.0.1:39822': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:17:09,209 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:17:10,215 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:17:10,224 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36453 3537s 2024-11-23 21:17:10,225 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33639/status 3537s 2024-11-23 21:17:10,225 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:17:10,240 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44237 3537s 2024-11-23 21:17:10,240 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44237 3537s 2024-11-23 21:17:10,240 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:17:10,240 - distributed.worker - INFO - dashboard at: 127.0.0.1:46745 3537s 2024-11-23 21:17:10,240 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36453 3537s 2024-11-23 21:17:10,240 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:17:10,240 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:17:10,240 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:17:10,241 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-u32onm2s 3537s 2024-11-23 21:17:10,241 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:17:10,243 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34349 3537s 2024-11-23 21:17:10,243 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34349 3537s 2024-11-23 21:17:10,243 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:17:10,243 - distributed.worker - INFO - dashboard at: 127.0.0.1:42717 3537s 2024-11-23 21:17:10,243 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36453 3537s 2024-11-23 21:17:10,243 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:17:10,243 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:17:10,243 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:17:10,243 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-hzqtgw0w 3537s 2024-11-23 21:17:10,243 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:17:10,245 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44237. Reason: failure-to-start- 3537s 2024-11-23 21:17:10,245 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:17:10,245 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34349. Reason: failure-to-start- 3537s 2024-11-23 21:17:10,246 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:17:10,247 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36453': TLS handshake failed with remote 'tls://127.0.0.1:51674': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:17:10,247 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36453': TLS handshake failed with remote 'tls://127.0.0.1:51690': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:17:10,249 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:17:11,254 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:17:11,263 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37327 3537s 2024-11-23 21:17:11,263 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42859/status 3537s 2024-11-23 21:17:11,263 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:17:11,280 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36621 3537s 2024-11-23 21:17:11,281 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36621 3537s 2024-11-23 21:17:11,281 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:17:11,281 - distributed.worker - INFO - dashboard at: 127.0.0.1:37235 3537s 2024-11-23 21:17:11,281 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37327 3537s 2024-11-23 21:17:11,281 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:17:11,281 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:17:11,281 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:17:11,281 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-fzp6u5ws 3537s 2024-11-23 21:17:11,281 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:17:11,283 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35931 3537s 2024-11-23 21:17:11,284 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35931 3537s 2024-11-23 21:17:11,284 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:17:11,284 - distributed.worker - INFO - dashboard at: 127.0.0.1:43753 3537s 2024-11-23 21:17:11,284 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37327 3537s 2024-11-23 21:17:11,284 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:17:11,284 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:17:11,284 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:17:11,284 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-j8qzfrfq 3537s 2024-11-23 21:17:11,284 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:17:11,286 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36621. Reason: failure-to-start- 3537s 2024-11-23 21:17:11,286 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:17:11,286 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35931. Reason: failure-to-start- 3537s 2024-11-23 21:17:11,286 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:17:11,288 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37327': TLS handshake failed with remote 'tls://127.0.0.1:50022': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:17:11,288 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37327': TLS handshake failed with remote 'tls://127.0.0.1:50032': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:17:11,289 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:17:12,296 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:17:12,305 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41127 3537s 2024-11-23 21:17:12,305 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46825/status 3537s 2024-11-23 21:17:12,306 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:17:12,322 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46303 3537s 2024-11-23 21:17:12,322 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46303 3537s 2024-11-23 21:17:12,322 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:17:12,322 - distributed.worker - INFO - dashboard at: 127.0.0.1:43795 3537s 2024-11-23 21:17:12,322 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41127 3537s 2024-11-23 21:17:12,322 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:17:12,322 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:17:12,322 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:17:12,322 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-dwh8yfl4 3537s 2024-11-23 21:17:12,323 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:17:12,325 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39527 3537s 2024-11-23 21:17:12,325 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39527 3537s 2024-11-23 21:17:12,325 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:17:12,325 - distributed.worker - INFO - dashboard at: 127.0.0.1:44995 3537s 2024-11-23 21:17:12,325 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41127 3537s 2024-11-23 21:17:12,325 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:17:12,325 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:17:12,325 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:17:12,325 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-hvg_n0lo 3537s 2024-11-23 21:17:12,325 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:17:12,328 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46303. Reason: failure-to-start- 3537s 2024-11-23 21:17:12,328 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:17:12,328 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39527. Reason: failure-to-start- 3537s 2024-11-23 21:17:12,329 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:17:12,330 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41127': TLS handshake failed with remote 'tls://127.0.0.1:46498': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:17:12,330 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41127': TLS handshake failed with remote 'tls://127.0.0.1:46504': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:17:12,332 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:17:13,339 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:17:13,346 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41545 3537s 2024-11-23 21:17:13,347 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:32951/status 3537s 2024-11-23 21:17:13,347 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:17:13,363 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43475 3537s 2024-11-23 21:17:13,363 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43475 3537s 2024-11-23 21:17:13,363 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:17:13,363 - distributed.worker - INFO - dashboard at: 127.0.0.1:46337 3537s 2024-11-23 21:17:13,363 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41545 3537s 2024-11-23 21:17:13,363 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:17:13,363 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:17:13,363 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:17:13,363 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-z8hnsf9l 3537s 2024-11-23 21:17:13,363 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:17:13,365 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41607 3537s 2024-11-23 21:17:13,366 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41607 3537s 2024-11-23 21:17:13,366 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:17:13,366 - distributed.worker - INFO - dashboard at: 127.0.0.1:39613 3537s 2024-11-23 21:17:13,366 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41545 3537s 2024-11-23 21:17:13,366 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:17:13,366 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:17:13,366 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:17:13,366 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-rkhntsbr 3537s 2024-11-23 21:17:13,366 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:17:13,367 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43475. Reason: failure-to-start- 3537s 2024-11-23 21:17:13,368 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:17:13,368 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41607. Reason: failure-to-start- 3537s 2024-11-23 21:17:13,368 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:17:13,370 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41545': TLS handshake failed with remote 'tls://127.0.0.1:34556': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:17:13,370 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41545': TLS handshake failed with remote 'tls://127.0.0.1:34562': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:17:13,371 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:17:14,377 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:17:14,386 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41763 3537s 2024-11-23 21:17:14,386 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38097/status 3537s 2024-11-23 21:17:14,387 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:17:14,401 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33177 3537s 2024-11-23 21:17:14,401 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33177 3537s 2024-11-23 21:17:14,401 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:17:14,401 - distributed.worker - INFO - dashboard at: 127.0.0.1:45507 3537s 2024-11-23 21:17:14,401 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41763 3537s 2024-11-23 21:17:14,401 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:17:14,402 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:17:14,402 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:17:14,402 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-29dc79wl 3537s 2024-11-23 21:17:14,402 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:17:14,404 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39801 3537s 2024-11-23 21:17:14,404 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39801 3537s 2024-11-23 21:17:14,404 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:17:14,404 - distributed.worker - INFO - dashboard at: 127.0.0.1:42541 3537s 2024-11-23 21:17:14,404 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41763 3537s 2024-11-23 21:17:14,404 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:17:14,404 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:17:14,404 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:17:14,404 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-8a753dd5 3537s 2024-11-23 21:17:14,405 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:17:14,406 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33177. Reason: failure-to-start- 3537s 2024-11-23 21:17:14,406 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:17:14,406 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39801. Reason: failure-to-start- 3537s 2024-11-23 21:17:14,407 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:17:14,408 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41763': TLS handshake failed with remote 'tls://127.0.0.1:36892': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:17:14,408 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41763': TLS handshake failed with remote 'tls://127.0.0.1:36904': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:17:14,409 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:17:15,415 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:17:15,423 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33413 3537s 2024-11-23 21:17:15,423 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35549/status 3537s 2024-11-23 21:17:15,424 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:17:15,441 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35217 3537s 2024-11-23 21:17:15,442 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35217 3537s 2024-11-23 21:17:15,442 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:17:15,442 - distributed.worker - INFO - dashboard at: 127.0.0.1:42557 3537s 2024-11-23 21:17:15,442 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33413 3537s 2024-11-23 21:17:15,442 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:17:15,442 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:17:15,442 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:17:15,442 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-tiw7iu_o 3537s 2024-11-23 21:17:15,442 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:17:15,445 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45857 3537s 2024-11-23 21:17:15,445 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45857 3537s 2024-11-23 21:17:15,445 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:17:15,445 - distributed.worker - INFO - dashboard at: 127.0.0.1:33511 3537s 2024-11-23 21:17:15,445 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33413 3537s 2024-11-23 21:17:15,445 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:17:15,445 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:17:15,445 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:17:15,445 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-amu86l8p 3537s 2024-11-23 21:17:15,445 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:17:15,447 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35217. Reason: failure-to-start- 3537s 2024-11-23 21:17:15,447 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:17:15,447 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45857. Reason: failure-to-start- 3537s 2024-11-23 21:17:15,448 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:17:15,449 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33413': TLS handshake failed with remote 'tls://127.0.0.1:50288': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:17:15,449 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33413': TLS handshake failed with remote 'tls://127.0.0.1:50294': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:17:15,450 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:17:16,457 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:17:16,465 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42433 3537s 2024-11-23 21:17:16,465 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42643/status 3537s 2024-11-23 21:17:16,466 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:17:16,482 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35061 3537s 2024-11-23 21:17:16,483 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35061 3537s 2024-11-23 21:17:16,483 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:17:16,483 - distributed.worker - INFO - dashboard at: 127.0.0.1:36927 3537s 2024-11-23 21:17:16,483 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42433 3537s 2024-11-23 21:17:16,483 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:17:16,483 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:17:16,483 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:17:16,483 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-muv9i42g 3537s 2024-11-23 21:17:16,483 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:17:16,485 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33981 3537s 2024-11-23 21:17:16,486 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33981 3537s 2024-11-23 21:17:16,486 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:17:16,486 - distributed.worker - INFO - dashboard at: 127.0.0.1:38467 3537s 2024-11-23 21:17:16,486 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42433 3537s 2024-11-23 21:17:16,486 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:17:16,486 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:17:16,486 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:17:16,486 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-b0nlumi0 3537s 2024-11-23 21:17:16,486 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:17:16,489 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35061. Reason: failure-to-start- 3537s 2024-11-23 21:17:16,489 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:17:16,489 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33981. Reason: failure-to-start- 3537s 2024-11-23 21:17:16,489 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:17:16,491 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42433': TLS handshake failed with remote 'tls://127.0.0.1:46188': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:17:16,491 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42433': TLS handshake failed with remote 'tls://127.0.0.1:46190': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:17:16,492 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:17:17,498 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:17:17,506 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44709 3537s 2024-11-23 21:17:17,507 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38067/status 3537s 2024-11-23 21:17:17,507 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:17:17,523 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34109 3537s 2024-11-23 21:17:17,523 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34109 3537s 2024-11-23 21:17:17,523 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:17:17,524 - distributed.worker - INFO - dashboard at: 127.0.0.1:44081 3537s 2024-11-23 21:17:17,524 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44709 3537s 2024-11-23 21:17:17,524 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:17:17,524 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:17:17,524 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:17:17,524 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-rgwu96q5 3537s 2024-11-23 21:17:17,524 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:17:17,526 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34017 3537s 2024-11-23 21:17:17,527 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34017 3537s 2024-11-23 21:17:17,527 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:17:17,527 - distributed.worker - INFO - dashboard at: 127.0.0.1:45683 3537s 2024-11-23 21:17:17,527 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44709 3537s 2024-11-23 21:17:17,527 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:17:17,527 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:17:17,527 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:17:17,527 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-x76m8tf8 3537s 2024-11-23 21:17:17,527 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:17:17,529 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34109. Reason: failure-to-start- 3537s 2024-11-23 21:17:17,529 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:17:17,529 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34017. Reason: failure-to-start- 3537s 2024-11-23 21:17:17,530 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:17:17,531 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44709': TLS handshake failed with remote 'tls://127.0.0.1:55616': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:17:17,531 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44709': TLS handshake failed with remote 'tls://127.0.0.1:55618': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:17:17,533 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:17:18,539 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:17:18,549 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44471 3537s 2024-11-23 21:17:18,550 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46107/status 3537s 2024-11-23 21:17:18,550 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:17:18,567 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33137 3537s 2024-11-23 21:17:18,567 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33137 3537s 2024-11-23 21:17:18,567 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:17:18,567 - distributed.worker - INFO - dashboard at: 127.0.0.1:42549 3537s 2024-11-23 21:17:18,567 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44471 3537s 2024-11-23 21:17:18,568 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:17:18,568 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:17:18,568 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:17:18,568 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-90fbq539 3537s 2024-11-23 21:17:18,568 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:17:18,570 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36321 3537s 2024-11-23 21:17:18,570 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36321 3537s 2024-11-23 21:17:18,570 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:17:18,570 - distributed.worker - INFO - dashboard at: 127.0.0.1:40523 3537s 2024-11-23 21:17:18,570 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44471 3537s 2024-11-23 21:17:18,571 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:17:18,571 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:17:18,571 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:17:18,571 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-yjpr9opr 3537s 2024-11-23 21:17:18,571 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:17:18,572 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33137. Reason: failure-to-start- 3537s 2024-11-23 21:17:18,572 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:17:18,573 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36321. Reason: failure-to-start- 3537s 2024-11-23 21:17:18,573 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:17:18,577 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44471': TLS handshake failed with remote 'tls://127.0.0.1:60572': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:17:18,577 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44471': TLS handshake failed with remote 'tls://127.0.0.1:60584': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:17:18,579 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:17:19,585 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:17:19,594 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41755 3537s 2024-11-23 21:17:19,594 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36431/status 3537s 2024-11-23 21:17:19,595 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:17:19,614 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:32943 3537s 2024-11-23 21:17:19,614 - distributed.worker - INFO - Listening to: tls://127.0.0.1:32943 3537s 2024-11-23 21:17:19,614 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:17:19,614 - distributed.worker - INFO - dashboard at: 127.0.0.1:34327 3537s 2024-11-23 21:17:19,614 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41755 3537s 2024-11-23 21:17:19,614 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:17:19,614 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:17:19,614 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:17:19,615 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-hn2df6pd 3537s 2024-11-23 21:17:19,615 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:17:19,617 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44751 3537s 2024-11-23 21:17:19,617 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44751 3537s 2024-11-23 21:17:19,617 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:17:19,617 - distributed.worker - INFO - dashboard at: 127.0.0.1:44017 3537s 2024-11-23 21:17:19,618 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41755 3537s 2024-11-23 21:17:19,618 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:17:19,618 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:17:19,618 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:17:19,618 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-9i40yvif 3537s 2024-11-23 21:17:19,618 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:17:19,619 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:32943. Reason: failure-to-start- 3537s 2024-11-23 21:17:19,620 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:17:19,620 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44751. Reason: failure-to-start- 3537s 2024-11-23 21:17:19,620 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:17:19,624 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41755': TLS handshake failed with remote 'tls://127.0.0.1:37132': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:17:19,624 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41755': TLS handshake failed with remote 'tls://127.0.0.1:37142': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:17:19,626 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:17:20,634 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:17:20,645 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38385 3537s 2024-11-23 21:17:20,646 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44557/status 3537s 2024-11-23 21:17:20,646 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:17:20,664 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36411 3537s 2024-11-23 21:17:20,665 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36411 3537s 2024-11-23 21:17:20,665 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:17:20,665 - distributed.worker - INFO - dashboard at: 127.0.0.1:42695 3537s 2024-11-23 21:17:20,665 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38385 3537s 2024-11-23 21:17:20,665 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:17:20,665 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:17:20,665 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:17:20,665 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-uq86mxg2 3537s 2024-11-23 21:17:20,665 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:17:20,668 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38557 3537s 2024-11-23 21:17:20,668 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38557 3537s 2024-11-23 21:17:20,668 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:17:20,668 - distributed.worker - INFO - dashboard at: 127.0.0.1:33867 3537s 2024-11-23 21:17:20,668 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38385 3537s 2024-11-23 21:17:20,668 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:17:20,668 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:17:20,668 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:17:20,669 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-z97sz0ej 3537s 2024-11-23 21:17:20,669 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:17:20,674 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36411. Reason: failure-to-start- 3537s 2024-11-23 21:17:20,674 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:17:20,675 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38557. Reason: failure-to-start- 3537s 2024-11-23 21:17:20,675 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:17:20,676 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38385': TLS handshake failed with remote 'tls://127.0.0.1:58188': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:17:20,677 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38385': TLS handshake failed with remote 'tls://127.0.0.1:58190': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:17:20,678 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:17:21,684 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:17:21,692 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36695 3537s 2024-11-23 21:17:21,693 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37801/status 3537s 2024-11-23 21:17:21,693 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:17:21,711 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46489 3537s 2024-11-23 21:17:21,712 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46489 3537s 2024-11-23 21:17:21,712 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:17:21,712 - distributed.worker - INFO - dashboard at: 127.0.0.1:36867 3537s 2024-11-23 21:17:21,712 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36695 3537s 2024-11-23 21:17:21,712 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:17:21,712 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:17:21,712 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:17:21,712 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-pz65n69x 3537s 2024-11-23 21:17:21,712 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:17:21,715 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42657 3537s 2024-11-23 21:17:21,715 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42657 3537s 2024-11-23 21:17:21,715 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:17:21,715 - distributed.worker - INFO - dashboard at: 127.0.0.1:40789 3537s 2024-11-23 21:17:21,715 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36695 3537s 2024-11-23 21:17:21,715 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:17:21,715 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:17:21,715 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:17:21,715 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-sr79620g 3537s 2024-11-23 21:17:21,716 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:17:21,717 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46489. Reason: failure-to-start- 3537s 2024-11-23 21:17:21,717 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:17:21,718 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42657. Reason: failure-to-start- 3537s 2024-11-23 21:17:21,718 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:17:21,719 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36695': TLS handshake failed with remote 'tls://127.0.0.1:40928': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:17:21,719 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36695': TLS handshake failed with remote 'tls://127.0.0.1:40944': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:17:21,721 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:17:22,727 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:17:22,737 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33173 3537s 2024-11-23 21:17:22,738 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42815/status 3537s 2024-11-23 21:17:22,738 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:17:22,756 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33517 3537s 2024-11-23 21:17:22,756 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33517 3537s 2024-11-23 21:17:22,756 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:17:22,756 - distributed.worker - INFO - dashboard at: 127.0.0.1:34423 3537s 2024-11-23 21:17:22,756 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33173 3537s 2024-11-23 21:17:22,757 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:17:22,757 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:17:22,757 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:17:22,757 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-k0ysw8fp 3537s 2024-11-23 21:17:22,757 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:17:22,759 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46625 3537s 2024-11-23 21:17:22,759 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46625 3537s 2024-11-23 21:17:22,759 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:17:22,759 - distributed.worker - INFO - dashboard at: 127.0.0.1:38867 3537s 2024-11-23 21:17:22,760 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33173 3537s 2024-11-23 21:17:22,760 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:17:22,760 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:17:22,760 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:17:22,760 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-vmt657gs 3537s 2024-11-23 21:17:22,760 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:17:22,761 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33517. Reason: failure-to-start- 3537s 2024-11-23 21:17:22,762 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:17:22,762 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46625. Reason: failure-to-start- 3537s 2024-11-23 21:17:22,762 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:17:22,764 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33173': TLS handshake failed with remote 'tls://127.0.0.1:34572': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:17:22,764 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33173': TLS handshake failed with remote 'tls://127.0.0.1:34588': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:17:22,768 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:17:23,773 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:17:23,782 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46735 3537s 2024-11-23 21:17:23,782 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46653/status 3537s 2024-11-23 21:17:23,782 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:17:23,819 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44697 3537s 2024-11-23 21:17:23,820 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44697 3537s 2024-11-23 21:17:23,820 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:17:23,820 - distributed.worker - INFO - dashboard at: 127.0.0.1:45019 3537s 2024-11-23 21:17:23,820 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46735 3537s 2024-11-23 21:17:23,820 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:17:23,820 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:17:23,820 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:17:23,820 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-61tcrfh8 3537s 2024-11-23 21:17:23,820 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:17:23,822 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42297 3537s 2024-11-23 21:17:23,822 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42297 3537s 2024-11-23 21:17:23,823 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:17:23,823 - distributed.worker - INFO - dashboard at: 127.0.0.1:40153 3537s 2024-11-23 21:17:23,823 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46735 3537s 2024-11-23 21:17:23,823 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:17:23,823 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:17:23,823 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:17:23,823 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-xwhs0y0b 3537s 2024-11-23 21:17:23,823 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:17:23,827 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44697. Reason: failure-to-start- 3537s 2024-11-23 21:17:23,827 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:17:23,827 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42297. Reason: failure-to-start- 3537s 2024-11-23 21:17:23,828 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:17:23,829 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46735': TLS handshake failed with remote 'tls://127.0.0.1:35606': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:17:23,829 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46735': TLS handshake failed with remote 'tls://127.0.0.1:35616': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:17:23,831 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:17:24,843 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:17:24,859 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36671 3537s 2024-11-23 21:17:24,860 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38313/status 3537s 2024-11-23 21:17:24,860 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:17:24,882 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34455 3537s 2024-11-23 21:17:24,883 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34455 3537s 2024-11-23 21:17:24,883 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:17:24,883 - distributed.worker - INFO - dashboard at: 127.0.0.1:43627 3537s 2024-11-23 21:17:24,883 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36671 3537s 2024-11-23 21:17:24,883 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:17:24,883 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:17:24,883 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:17:24,883 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-5f5znbkm 3537s 2024-11-23 21:17:24,883 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:17:24,886 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34835 3537s 2024-11-23 21:17:25,330 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34835 3537s 2024-11-23 21:17:25,330 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:17:25,330 - distributed.worker - INFO - dashboard at: 127.0.0.1:35121 3537s 2024-11-23 21:17:25,330 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36671 3537s 2024-11-23 21:17:25,330 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:17:25,330 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:17:25,330 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:17:25,330 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-w2r4iyc3 3537s 2024-11-23 21:17:25,330 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:17:25,333 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34455. Reason: failure-to-start- 3537s 2024-11-23 21:17:25,333 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:17:25,334 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34835. Reason: failure-to-start- 3537s 2024-11-23 21:17:25,334 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:17:25,369 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36671': TLS handshake failed with remote 'tls://127.0.0.1:50540': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:17:25,369 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36671': TLS handshake failed with remote 'tls://127.0.0.1:50546': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:17:25,375 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:17:26,381 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:17:26,390 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38937 3537s 2024-11-23 21:17:26,390 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36909/status 3537s 2024-11-23 21:17:26,390 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:17:26,410 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44601 3537s 2024-11-23 21:17:26,410 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44601 3537s 2024-11-23 21:17:26,410 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:17:26,410 - distributed.worker - INFO - dashboard at: 127.0.0.1:45093 3537s 2024-11-23 21:17:26,410 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38937 3537s 2024-11-23 21:17:26,410 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:17:26,410 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:17:26,410 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:17:26,410 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-49_cixzj 3537s 2024-11-23 21:17:26,410 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:17:26,413 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38455 3537s 2024-11-23 21:17:26,413 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38455 3537s 2024-11-23 21:17:26,413 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:17:26,413 - distributed.worker - INFO - dashboard at: 127.0.0.1:39663 3537s 2024-11-23 21:17:26,413 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38937 3537s 2024-11-23 21:17:26,413 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:17:26,413 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:17:26,413 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:17:26,413 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-wqp4pz4f 3537s 2024-11-23 21:17:26,413 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:17:26,415 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44601. Reason: failure-to-start- 3537s 2024-11-23 21:17:26,415 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:17:26,416 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38455. Reason: failure-to-start- 3537s 2024-11-23 21:17:26,416 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:17:26,418 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38937': TLS handshake failed with remote 'tls://127.0.0.1:33154': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:17:26,418 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38937': TLS handshake failed with remote 'tls://127.0.0.1:33166': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:17:26,419 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:17:27,426 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:17:27,436 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37145 3537s 2024-11-23 21:17:27,437 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44229/status 3537s 2024-11-23 21:17:27,437 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:17:27,456 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44031 3537s 2024-11-23 21:17:27,456 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44031 3537s 2024-11-23 21:17:27,456 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:17:27,456 - distributed.worker - INFO - dashboard at: 127.0.0.1:33983 3537s 2024-11-23 21:17:27,456 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37145 3537s 2024-11-23 21:17:27,456 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:17:27,456 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:17:27,456 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:17:27,456 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-59d16lu_ 3537s 2024-11-23 21:17:27,457 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:17:27,459 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38217 3537s 2024-11-23 21:17:27,459 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38217 3537s 2024-11-23 21:17:27,459 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:17:27,459 - distributed.worker - INFO - dashboard at: 127.0.0.1:43017 3537s 2024-11-23 21:17:27,459 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37145 3537s 2024-11-23 21:17:27,459 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:17:27,459 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:17:27,459 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:17:27,459 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-imhgnzvb 3537s 2024-11-23 21:17:27,459 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:17:27,461 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44031. Reason: failure-to-start- 3537s 2024-11-23 21:17:27,461 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:17:27,461 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38217. Reason: failure-to-start- 3537s 2024-11-23 21:17:27,462 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:17:27,463 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37145': TLS handshake failed with remote 'tls://127.0.0.1:35262': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:17:27,463 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37145': TLS handshake failed with remote 'tls://127.0.0.1:35264': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:17:27,465 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:17:28,472 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:17:28,481 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33325 3537s 2024-11-23 21:17:28,481 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35731/status 3537s 2024-11-23 21:17:28,482 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:17:28,502 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39207 3537s 2024-11-23 21:17:28,502 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39207 3537s 2024-11-23 21:17:28,502 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:17:28,502 - distributed.worker - INFO - dashboard at: 127.0.0.1:42683 3537s 2024-11-23 21:17:28,502 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33325 3537s 2024-11-23 21:17:28,502 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:17:28,502 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:17:28,503 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:17:28,503 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-codjfp76 3537s 2024-11-23 21:17:28,503 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:17:28,505 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42167 3537s 2024-11-23 21:17:28,505 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42167 3537s 2024-11-23 21:17:28,505 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:17:28,506 - distributed.worker - INFO - dashboard at: 127.0.0.1:36271 3537s 2024-11-23 21:17:28,506 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33325 3537s 2024-11-23 21:17:28,506 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:17:28,506 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:17:28,506 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:17:28,506 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-f04fub09 3537s 2024-11-23 21:17:28,506 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:17:28,508 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39207. Reason: failure-to-start- 3537s 2024-11-23 21:17:28,508 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:17:28,508 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42167. Reason: failure-to-start- 3537s 2024-11-23 21:17:28,508 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:17:28,510 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33325': TLS handshake failed with remote 'tls://127.0.0.1:56022': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:17:28,510 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33325': TLS handshake failed with remote 'tls://127.0.0.1:56032': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:17:28,514 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:17:29,522 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:17:29,531 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37631 3537s 2024-11-23 21:17:29,531 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44149/status 3537s 2024-11-23 21:17:29,531 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:17:29,548 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40887 3537s 2024-11-23 21:17:29,548 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40887 3537s 2024-11-23 21:17:29,548 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:17:29,548 - distributed.worker - INFO - dashboard at: 127.0.0.1:44095 3537s 2024-11-23 21:17:29,548 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37631 3537s 2024-11-23 21:17:29,548 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:17:29,548 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:17:29,548 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:17:29,548 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ul20cnij 3537s 2024-11-23 21:17:29,548 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:17:29,551 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33431 3537s 2024-11-23 21:17:29,551 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33431 3537s 2024-11-23 21:17:29,551 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:17:29,551 - distributed.worker - INFO - dashboard at: 127.0.0.1:40919 3537s 2024-11-23 21:17:29,551 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37631 3537s 2024-11-23 21:17:29,552 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:17:29,552 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:17:29,552 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:17:29,552 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ww05bcb4 3537s 2024-11-23 21:17:29,552 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:17:29,555 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40887. Reason: failure-to-start- 3537s 2024-11-23 21:17:29,556 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:17:29,556 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33431. Reason: failure-to-start- 3537s 2024-11-23 21:17:29,556 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:17:29,561 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37631': TLS handshake failed with remote 'tls://127.0.0.1:53926': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:17:29,561 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37631': TLS handshake failed with remote 'tls://127.0.0.1:53930': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:17:29,563 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:17:30,569 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:17:30,576 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42825 3537s 2024-11-23 21:17:30,577 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34411/status 3537s 2024-11-23 21:17:30,577 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:17:30,595 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42599 3537s 2024-11-23 21:17:30,595 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42599 3537s 2024-11-23 21:17:30,595 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:17:30,595 - distributed.worker - INFO - dashboard at: 127.0.0.1:46055 3537s 2024-11-23 21:17:30,595 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42825 3537s 2024-11-23 21:17:30,595 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:17:30,595 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:17:30,595 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:17:30,595 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-juevan7f 3537s 2024-11-23 21:17:30,595 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:17:30,598 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46357 3537s 2024-11-23 21:17:30,598 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46357 3537s 2024-11-23 21:17:30,598 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:17:30,598 - distributed.worker - INFO - dashboard at: 127.0.0.1:45321 3537s 2024-11-23 21:17:30,598 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42825 3537s 2024-11-23 21:17:30,598 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:17:30,598 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:17:30,598 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:17:30,598 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-_1js3e73 3537s 2024-11-23 21:17:30,598 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:17:30,600 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42599. Reason: failure-to-start- 3537s 2024-11-23 21:17:30,600 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:17:30,601 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46357. Reason: failure-to-start- 3537s 2024-11-23 21:17:30,601 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:17:30,605 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42825': TLS handshake failed with remote 'tls://127.0.0.1:59166': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:17:30,605 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42825': TLS handshake failed with remote 'tls://127.0.0.1:59168': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:17:30,607 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:17:31,612 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:17:31,622 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43255 3537s 2024-11-23 21:17:31,623 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44855/status 3537s 2024-11-23 21:17:31,623 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:17:31,642 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36041 3537s 2024-11-23 21:17:31,642 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36041 3537s 2024-11-23 21:17:31,643 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:17:31,643 - distributed.worker - INFO - dashboard at: 127.0.0.1:34823 3537s 2024-11-23 21:17:31,643 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43255 3537s 2024-11-23 21:17:31,643 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:17:31,643 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:17:31,643 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:17:31,643 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-u1jbd17u 3537s 2024-11-23 21:17:31,643 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:17:31,646 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37613 3537s 2024-11-23 21:17:31,646 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37613 3537s 2024-11-23 21:17:31,646 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:17:31,646 - distributed.worker - INFO - dashboard at: 127.0.0.1:46099 3537s 2024-11-23 21:17:31,646 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43255 3537s 2024-11-23 21:17:31,646 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:17:31,646 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:17:31,646 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:17:31,646 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-d_a4il6t 3537s 2024-11-23 21:17:31,647 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:17:31,648 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36041. Reason: failure-to-start- 3537s 2024-11-23 21:17:31,648 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:17:31,649 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37613. Reason: failure-to-start- 3537s 2024-11-23 21:17:31,649 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:17:31,656 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43255': TLS handshake failed with remote 'tls://127.0.0.1:46344': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:17:31,656 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43255': TLS handshake failed with remote 'tls://127.0.0.1:46354': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:17:31,657 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:17:32,665 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:17:32,674 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36407 3537s 2024-11-23 21:17:32,674 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34669/status 3537s 2024-11-23 21:17:32,675 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:17:32,693 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44819 3537s 2024-11-23 21:17:32,693 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44819 3537s 2024-11-23 21:17:32,693 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:17:32,693 - distributed.worker - INFO - dashboard at: 127.0.0.1:34943 3537s 2024-11-23 21:17:32,693 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36407 3537s 2024-11-23 21:17:32,693 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:17:32,693 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:17:32,693 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:17:32,694 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-37rydd_k 3537s 2024-11-23 21:17:32,694 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:17:32,696 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39845 3537s 2024-11-23 21:17:32,696 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39845 3537s 2024-11-23 21:17:32,696 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:17:32,696 - distributed.worker - INFO - dashboard at: 127.0.0.1:46095 3537s 2024-11-23 21:17:32,696 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36407 3537s 2024-11-23 21:17:32,696 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:17:32,696 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:17:32,696 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:17:32,696 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-lra694iv 3537s 2024-11-23 21:17:32,696 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:17:32,700 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44819. Reason: failure-to-start- 3537s 2024-11-23 21:17:32,700 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:17:32,701 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39845. Reason: failure-to-start- 3537s 2024-11-23 21:17:32,701 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:17:32,705 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36407': TLS handshake failed with remote 'tls://127.0.0.1:42004': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:17:32,705 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36407': TLS handshake failed with remote 'tls://127.0.0.1:42014': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:17:32,707 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:17:33,713 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:17:33,720 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43861 3537s 2024-11-23 21:17:33,720 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40541/status 3537s 2024-11-23 21:17:33,721 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:17:33,738 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35233 3537s 2024-11-23 21:17:33,738 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35233 3537s 2024-11-23 21:17:33,738 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:17:33,738 - distributed.worker - INFO - dashboard at: 127.0.0.1:42897 3537s 2024-11-23 21:17:33,738 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43861 3537s 2024-11-23 21:17:33,738 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:17:33,738 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:17:33,738 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:17:33,738 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-im894udv 3537s 2024-11-23 21:17:33,738 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:17:33,742 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35331 3537s 2024-11-23 21:17:33,742 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35331 3537s 2024-11-23 21:17:33,742 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:17:33,742 - distributed.worker - INFO - dashboard at: 127.0.0.1:46795 3537s 2024-11-23 21:17:33,742 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43861 3537s 2024-11-23 21:17:33,742 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:17:33,742 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:17:33,742 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:17:33,743 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-scs7rcup 3537s 2024-11-23 21:17:33,743 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:17:33,746 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35233. Reason: failure-to-start- 3537s 2024-11-23 21:17:33,747 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:17:33,747 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35331. Reason: failure-to-start- 3537s 2024-11-23 21:17:33,747 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:17:33,751 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43861': TLS handshake failed with remote 'tls://127.0.0.1:47286': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:17:33,751 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43861': TLS handshake failed with remote 'tls://127.0.0.1:47292': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:17:33,753 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:17:34,758 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:17:34,766 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43249 3537s 2024-11-23 21:17:34,767 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43585/status 3537s 2024-11-23 21:17:34,767 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:17:34,787 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42391 3537s 2024-11-23 21:17:34,787 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42391 3537s 2024-11-23 21:17:34,787 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:17:34,787 - distributed.worker - INFO - dashboard at: 127.0.0.1:40699 3537s 2024-11-23 21:17:34,787 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43249 3537s 2024-11-23 21:17:34,787 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:17:34,787 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:17:34,787 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:17:34,787 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-1fgjsuka 3537s 2024-11-23 21:17:34,788 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:17:34,790 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37249 3537s 2024-11-23 21:17:34,790 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37249 3537s 2024-11-23 21:17:34,790 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:17:34,790 - distributed.worker - INFO - dashboard at: 127.0.0.1:34631 3537s 2024-11-23 21:17:34,790 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43249 3537s 2024-11-23 21:17:34,790 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:17:34,790 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:17:34,790 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:17:34,790 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ofrqlg95 3537s 2024-11-23 21:17:34,790 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:17:34,796 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42391. Reason: failure-to-start- 3537s 2024-11-23 21:17:34,796 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:17:34,796 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37249. Reason: failure-to-start- 3537s 2024-11-23 21:17:34,796 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:17:34,798 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43249': TLS handshake failed with remote 'tls://127.0.0.1:37642': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:17:34,798 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43249': TLS handshake failed with remote 'tls://127.0.0.1:37658': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:17:34,800 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:17:35,810 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:17:35,820 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42909 3537s 2024-11-23 21:17:35,821 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44155/status 3537s 2024-11-23 21:17:35,821 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:17:35,841 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44981 3537s 2024-11-23 21:17:35,841 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44981 3537s 2024-11-23 21:17:35,842 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:17:35,842 - distributed.worker - INFO - dashboard at: 127.0.0.1:34239 3537s 2024-11-23 21:17:35,842 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42909 3537s 2024-11-23 21:17:35,842 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:17:35,842 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:17:35,842 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:17:35,842 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-fcfj8l92 3537s 2024-11-23 21:17:35,842 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:17:35,844 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45031 3537s 2024-11-23 21:17:35,845 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45031 3537s 2024-11-23 21:17:35,845 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:17:35,845 - distributed.worker - INFO - dashboard at: 127.0.0.1:33405 3537s 2024-11-23 21:17:35,845 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42909 3537s 2024-11-23 21:17:35,845 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:17:35,845 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:17:35,845 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:17:35,845 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-yazjvbfi 3537s 2024-11-23 21:17:35,845 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:17:35,847 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44981. Reason: failure-to-start- 3537s 2024-11-23 21:17:35,847 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:17:35,848 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45031. Reason: failure-to-start- 3537s 2024-11-23 21:17:35,848 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:17:35,849 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42909': TLS handshake failed with remote 'tls://127.0.0.1:54962': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:17:35,850 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42909': TLS handshake failed with remote 'tls://127.0.0.1:54978': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:17:35,854 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:17:36,863 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:17:36,871 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37367 3537s 2024-11-23 21:17:36,872 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42461/status 3537s 2024-11-23 21:17:36,872 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:17:36,892 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35919 3537s 2024-11-23 21:17:36,892 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35919 3537s 2024-11-23 21:17:36,892 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:17:36,892 - distributed.worker - INFO - dashboard at: 127.0.0.1:39827 3537s 2024-11-23 21:17:36,892 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37367 3537s 2024-11-23 21:17:36,892 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:17:36,892 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:17:36,892 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:17:36,892 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-eiuc93j1 3537s 2024-11-23 21:17:36,892 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:17:36,895 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44053 3537s 2024-11-23 21:17:36,895 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44053 3537s 2024-11-23 21:17:36,895 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:17:36,895 - distributed.worker - INFO - dashboard at: 127.0.0.1:43197 3537s 2024-11-23 21:17:36,895 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37367 3537s 2024-11-23 21:17:36,895 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:17:36,895 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:17:36,895 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:17:36,895 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-knaqpcga 3537s 2024-11-23 21:17:36,895 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:17:36,900 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35919. Reason: failure-to-start- 3537s 2024-11-23 21:17:36,900 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:17:36,900 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44053. Reason: failure-to-start- 3537s 2024-11-23 21:17:36,900 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:17:36,904 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37367': TLS handshake failed with remote 'tls://127.0.0.1:46680': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:17:36,905 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37367': TLS handshake failed with remote 'tls://127.0.0.1:46692': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:17:36,907 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:17:37,912 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:17:37,921 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44759 3537s 2024-11-23 21:17:37,922 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36805/status 3537s 2024-11-23 21:17:37,922 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:17:37,939 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44967 3537s 2024-11-23 21:17:37,940 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44967 3537s 2024-11-23 21:17:37,940 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:17:37,940 - distributed.worker - INFO - dashboard at: 127.0.0.1:46849 3537s 2024-11-23 21:17:37,940 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44759 3537s 2024-11-23 21:17:37,940 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:17:37,940 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:17:37,940 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:17:37,940 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-8vzmrled 3537s 2024-11-23 21:17:37,940 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:17:37,942 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45131 3537s 2024-11-23 21:17:37,942 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45131 3537s 2024-11-23 21:17:37,942 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:17:37,942 - distributed.worker - INFO - dashboard at: 127.0.0.1:46429 3537s 2024-11-23 21:17:37,943 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44759 3537s 2024-11-23 21:17:37,943 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:17:37,943 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:17:37,943 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:17:37,943 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-nam445b8 3537s 2024-11-23 21:17:37,943 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:17:37,947 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44967. Reason: failure-to-start- 3537s 2024-11-23 21:17:37,947 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:17:37,947 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45131. Reason: failure-to-start- 3537s 2024-11-23 21:17:37,948 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:17:37,952 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44759': TLS handshake failed with remote 'tls://127.0.0.1:43458': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:17:37,952 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44759': TLS handshake failed with remote 'tls://127.0.0.1:43462': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:17:37,954 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s _________________________________ test_scatter _________________________________ 3537s 3537s fut = , timeout = 0 3537s 3537s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 3537s async with asyncio.timeout(timeout): 3537s > return await fut 3537s 3537s /usr/lib/python3/dist-packages/distributed/utils.py:1960: 3537s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3537s /usr/lib/python3/dist-packages/distributed/worker.py:1480: in start_unsafe 3537s await self._register_with_scheduler() 3537s /usr/lib/python3/dist-packages/distributed/worker.py:1179: in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s /usr/lib/python3/dist-packages/distributed/comm/core.py:342: in connect 3537s comm = await wait_for( 3537s /usr/lib/python3/dist-packages/distributed/utils.py:1960: in wait_for 3537s return await fut 3537s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:546: in connect 3537s stream = await self.client.connect( 3537s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3537s 3537s self = , host = '127.0.0.1' 3537s port = 39943, af = 3537s ssl_options = 3537s max_buffer_size = 8364507136.0, source_ip = None, source_port = None 3537s timeout = None 3537s 3537s async def connect( 3537s self, 3537s host: str, 3537s port: int, 3537s af: socket.AddressFamily = socket.AF_UNSPEC, 3537s ssl_options: Optional[Union[Dict[str, Any], ssl.SSLContext]] = None, 3537s max_buffer_size: Optional[int] = None, 3537s source_ip: Optional[str] = None, 3537s source_port: Optional[int] = None, 3537s timeout: Optional[Union[float, datetime.timedelta]] = None, 3537s ) -> IOStream: 3537s """Connect to the given host and port. 3537s 3537s Asynchronously returns an `.IOStream` (or `.SSLIOStream` if 3537s ``ssl_options`` is not None). 3537s 3537s Using the ``source_ip`` kwarg, one can specify the source 3537s IP address to use when establishing the connection. 3537s In case the user needs to resolve and 3537s use a specific interface, it has to be handled outside 3537s of Tornado as this depends very much on the platform. 3537s 3537s Raises `TimeoutError` if the input future does not complete before 3537s ``timeout``, which may be specified in any form allowed by 3537s `.IOLoop.add_timeout` (i.e. a `datetime.timedelta` or an absolute time 3537s relative to `.IOLoop.time`) 3537s 3537s Similarly, when the user requires a certain source port, it can 3537s be specified using the ``source_port`` arg. 3537s 3537s .. versionchanged:: 4.5 3537s Added the ``source_ip`` and ``source_port`` arguments. 3537s 3537s .. versionchanged:: 5.0 3537s Added the ``timeout`` argument. 3537s """ 3537s if timeout is not None: 3537s if isinstance(timeout, numbers.Real): 3537s timeout = IOLoop.current().time() + timeout 3537s elif isinstance(timeout, datetime.timedelta): 3537s timeout = IOLoop.current().time() + timeout.total_seconds() 3537s else: 3537s raise TypeError("Unsupported timeout %r" % timeout) 3537s if timeout is not None: 3537s addrinfo = await gen.with_timeout( 3537s timeout, self.resolver.resolve(host, port, af) 3537s ) 3537s else: 3537s addrinfo = await self.resolver.resolve(host, port, af) 3537s connector = _Connector( 3537s addrinfo, 3537s functools.partial( 3537s self._create_stream, 3537s max_buffer_size, 3537s source_ip=source_ip, 3537s source_port=source_port, 3537s ), 3537s ) 3537s > af, addr, stream = await connector.start(connect_timeout=timeout) 3537s E asyncio.exceptions.CancelledError 3537s 3537s /usr/lib/python3/dist-packages/tornado/tcpclient.py:279: CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s self = 3537s 3537s @final 3537s async def start(self): 3537s async with self._startup_lock: 3537s if self.status == Status.failed: 3537s assert self.__startup_exc is not None 3537s raise self.__startup_exc 3537s elif self.status != Status.init: 3537s return self 3537s timeout = getattr(self, "death_timeout", None) 3537s 3537s async def _close_on_failure(exc: Exception) -> None: 3537s await self.close(reason=f"failure-to-start-{str(type(exc))}") 3537s self.status = Status.failed 3537s self.__startup_exc = exc 3537s 3537s try: 3537s > await wait_for(self.start_unsafe(), timeout=timeout) 3537s 3537s /usr/lib/python3/dist-packages/distributed/core.py:664: 3537s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3537s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 3537s async with asyncio.timeout(timeout): 3537s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3537s 3537s self = 3537s exc_type = 3537s exc_val = CancelledError(), exc_tb = 3537s 3537s async def __aexit__( 3537s self, 3537s exc_type: Optional[Type[BaseException]], 3537s exc_val: Optional[BaseException], 3537s exc_tb: Optional[TracebackType], 3537s ) -> Optional[bool]: 3537s assert self._state in (_State.ENTERED, _State.EXPIRING) 3537s 3537s if self._timeout_handler is not None: 3537s self._timeout_handler.cancel() 3537s self._timeout_handler = None 3537s 3537s if self._state is _State.EXPIRING: 3537s self._state = _State.EXPIRED 3537s 3537s if self._task.uncancel() <= self._cancelling and exc_type is not None: 3537s # Since there are no new cancel requests, we're 3537s # handling this. 3537s if issubclass(exc_type, exceptions.CancelledError): 3537s > raise TimeoutError from exc_val 3537s E TimeoutError 3537s 3537s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s @contextlib.asynccontextmanager 3537s async def _cluster_factory(): 3537s workers = [] 3537s s = None 3537s try: 3537s for _ in range(60): 3537s try: 3537s > s, ws = await start_cluster( 3537s nthreads, 3537s scheduler, 3537s security=security, 3537s Worker=Worker, 3537s scheduler_kwargs=scheduler_kwargs, 3537s worker_kwargs=merge( 3537s {"death_timeout": min(15, int(deadline.remaining))}, 3537s worker_kwargs, 3537s ), 3537s ) 3537s 3537s /usr/lib/python3/dist-packages/distributed/utils_test.py:966: 3537s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3537s /usr/lib/python3/dist-packages/distributed/utils_test.py:789: in start_cluster 3537s await asyncio.gather(*workers) 3537s /usr/lib/python3.13/asyncio/tasks.py:737: in _wrap_awaitable 3537s return await awaitable 3537s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3537s 3537s self = 3537s 3537s @final 3537s async def start(self): 3537s async with self._startup_lock: 3537s if self.status == Status.failed: 3537s assert self.__startup_exc is not None 3537s raise self.__startup_exc 3537s elif self.status != Status.init: 3537s return self 3537s timeout = getattr(self, "death_timeout", None) 3537s 3537s async def _close_on_failure(exc: Exception) -> None: 3537s await self.close(reason=f"failure-to-start-{str(type(exc))}") 3537s self.status = Status.failed 3537s self.__startup_exc = exc 3537s 3537s try: 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s except asyncio.TimeoutError as exc: 3537s await _close_on_failure(exc) 3537s > raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s E TimeoutError: Worker start timed out after 0s. 3537s 3537s /usr/lib/python3/dist-packages/distributed/core.py:667: TimeoutError 3537s 3537s During handling of the above exception, another exception occurred: 3537s 3537s fut = ._..test_func..async_fn at 0xe247c028> 3537s timeout = 60 3537s 3537s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 3537s async with asyncio.timeout(timeout): 3537s > return await fut 3537s 3537s /usr/lib/python3/dist-packages/distributed/utils.py:1960: 3537s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3537s /usr/lib/python3/dist-packages/distributed/utils_test.py:999: in async_fn 3537s _cluster_factory() as (s, workers), 3537s /usr/lib/python3.13/contextlib.py:214: in __aenter__ 3537s return await anext(self.gen) 3537s /usr/lib/python3/dist-packages/distributed/utils_test.py:983: in _cluster_factory 3537s await asyncio.sleep(1) 3537s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3537s 3537s delay = 1, result = None 3537s 3537s async def sleep(delay, result=None): 3537s """Coroutine that completes after a given time (in seconds).""" 3537s if delay <= 0: 3537s await __sleep0() 3537s return result 3537s 3537s if math.isnan(delay): 3537s raise ValueError("Invalid delay: NaN (not a number)") 3537s 3537s loop = events.get_running_loop() 3537s future = loop.create_future() 3537s h = loop.call_later(delay, 3537s futures._set_result_unless_cancelled, 3537s future, result) 3537s try: 3537s > return await future 3537s E asyncio.exceptions.CancelledError 3537s 3537s /usr/lib/python3.13/asyncio/tasks.py:718: CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s args = (), kwds = {} 3537s 3537s @wraps(func) 3537s def inner(*args, **kwds): 3537s with self._recreate_cm(): 3537s > return func(*args, **kwds) 3537s 3537s /usr/lib/python3.13/contextlib.py:85: 3537s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3537s /usr/lib/python3.13/contextlib.py:85: in inner 3537s return func(*args, **kwds) 3537s /usr/lib/python3/dist-packages/distributed/utils_test.py:1102: in test_func 3537s return _run_and_close_tornado(async_fn_outer) 3537s /usr/lib/python3/dist-packages/distributed/utils_test.py:378: in _run_and_close_tornado 3537s return asyncio_run(inner_fn(), loop_factory=get_loop_factory()) 3537s /usr/lib/python3.13/asyncio/runners.py:194: in run 3537s return runner.run(main) 3537s /usr/lib/python3.13/asyncio/runners.py:118: in run 3537s return self._loop.run_until_complete(task) 3537s /usr/lib/python3.13/asyncio/base_events.py:720: in run_until_complete 3537s return future.result() 3537s /usr/lib/python3/dist-packages/distributed/utils_test.py:375: in inner_fn 3537s return await async_fn(*args, **kwargs) 3537s /usr/lib/python3/dist-packages/distributed/utils_test.py:1099: in async_fn_outer 3537s return await utils_wait_for(async_fn(), timeout=timeout * 2) 3537s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 3537s async with asyncio.timeout(timeout): 3537s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3537s 3537s self = 3537s exc_type = 3537s exc_val = CancelledError(), exc_tb = 3537s 3537s async def __aexit__( 3537s self, 3537s exc_type: Optional[Type[BaseException]], 3537s exc_val: Optional[BaseException], 3537s exc_tb: Optional[TracebackType], 3537s ) -> Optional[bool]: 3537s assert self._state in (_State.ENTERED, _State.EXPIRING) 3537s 3537s if self._timeout_handler is not None: 3537s self._timeout_handler.cancel() 3537s self._timeout_handler = None 3537s 3537s if self._state is _State.EXPIRING: 3537s self._state = _State.EXPIRED 3537s 3537s if self._task.uncancel() <= self._cancelling and exc_type is not None: 3537s # Since there are no new cancel requests, we're 3537s # handling this. 3537s if issubclass(exc_type, exceptions.CancelledError): 3537s > raise TimeoutError from exc_val 3537s E TimeoutError 3537s 3537s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 3537s ----------------------------- Captured stderr call ----------------------------- 3537s 2024-11-23 21:17:38,653 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:17:38,662 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:38,662 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40229/status 3537s 2024-11-23 21:17:38,662 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:17:38,677 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33779 3537s 2024-11-23 21:17:38,677 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33779 3537s 2024-11-23 21:17:38,677 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:17:38,677 - distributed.worker - INFO - dashboard at: 127.0.0.1:37705 3537s 2024-11-23 21:17:38,677 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:38,677 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:17:38,677 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:17:38,677 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:17:38,677 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-pnjwvcc0 3537s 2024-11-23 21:17:38,677 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:17:38,679 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35965 3537s 2024-11-23 21:17:38,680 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35965 3537s 2024-11-23 21:17:38,680 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:17:38,680 - distributed.worker - INFO - dashboard at: 127.0.0.1:46201 3537s 2024-11-23 21:17:38,680 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:38,680 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:17:38,680 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:17:38,680 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:17:38,680 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-zq8cgj24 3537s 2024-11-23 21:17:38,680 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:17:38,694 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:38,694 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:38,694 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:50432': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:38,694 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:50448': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:38,807 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:38,807 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:38,808 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:50462': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:38,808 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:50466': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:38,922 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:38,922 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:38,923 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:50476': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:38,923 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:50490': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:39,037 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:39,037 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:39,037 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:50494': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:39,037 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:50496': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:39,150 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:39,150 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:39,150 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:50512': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:39,150 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:50522': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:39,263 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:39,263 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:39,263 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:50534': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:39,264 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:50536': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:39,375 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:39,376 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:39,376 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:50548': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:39,377 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:50560': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:39,484 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:39,488 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:50572': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:39,490 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:39,490 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:50586': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:39,592 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:39,593 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:50588': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:39,598 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:39,599 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:50594': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:39,701 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:39,702 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:50598': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:39,708 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:39,708 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:50608': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:39,809 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:39,810 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:50620': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:39,816 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:39,816 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:50630': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:39,917 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:39,918 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:50636': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:39,924 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:39,924 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:50646': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:40,025 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:40,026 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:50656': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:40,032 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:40,032 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:50660': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:40,133 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:40,134 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:50674': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:40,140 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:40,140 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:50686': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:40,242 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:40,243 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:50698': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:40,249 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:40,249 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:50706': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:40,350 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:40,350 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:50722': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:40,357 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:40,357 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:50726': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:40,459 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:40,461 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:50734': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:40,468 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:40,468 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:50736': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:40,567 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:40,567 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:50740': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:40,575 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:40,575 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:50744': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:40,674 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:40,675 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:50748': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:40,682 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:40,682 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:50762': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:40,782 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:40,782 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:50776': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:40,789 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:40,789 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:50780': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:40,890 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:40,890 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:50792': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:40,897 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:40,897 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:50796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:40,997 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:40,998 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:50810': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:41,004 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:41,005 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:50816': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:41,105 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:41,106 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:50828': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:41,112 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:41,112 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:50840': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:41,213 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:41,213 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:50852': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:41,220 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:41,220 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:50854': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:41,321 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:41,321 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:50862': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:41,328 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:41,329 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:50876': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:41,429 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:41,429 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:50884': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:41,436 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:41,437 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:50886': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:41,537 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:41,538 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:57132': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:41,544 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:41,545 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:57138': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:41,645 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:41,645 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:57140': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:41,652 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:41,652 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:57148': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:41,753 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:41,754 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:57152': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:41,760 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:41,761 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:57160': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:41,862 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:41,863 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:57172': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:41,869 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:41,870 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:57184': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:41,970 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:41,970 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:57186': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:41,978 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:41,979 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:57198': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:42,078 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:42,078 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:57206': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:42,086 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:42,087 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:57222': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:42,187 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:42,187 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:57230': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:42,194 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:42,195 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:57246': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:42,294 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:42,295 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:57258': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:42,302 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:42,302 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:57274': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:42,402 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:42,403 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:57278': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:42,409 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:42,410 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:57284': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:42,510 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:42,510 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:57296': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:42,517 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:42,517 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:57308': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:42,618 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:42,619 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:57324': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:42,625 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:42,626 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:57336': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:42,727 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:42,727 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:57346': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:42,734 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:42,734 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:57352': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:42,835 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:42,836 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:57366': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:42,842 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:42,842 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:57370': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:42,943 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:42,944 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:57378': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:42,950 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:42,951 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:57390': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:43,052 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:43,052 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:57396': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:43,059 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:43,059 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:57404': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:43,160 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:43,161 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:57406': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:43,167 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:43,171 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:57416': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:43,268 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:43,269 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:57422': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:43,290 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:43,291 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:57424': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:43,376 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:43,376 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:57432': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:43,398 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:43,398 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:57448': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:43,485 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:43,486 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:57458': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:43,507 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:43,507 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:57474': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:43,597 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:43,597 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:57486': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:43,614 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:43,615 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:57488': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:43,704 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:43,705 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:57500': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:43,722 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:43,722 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:57506': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:43,812 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:43,812 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:57520': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:43,829 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:43,830 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:57536': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:43,920 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:43,921 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:57542': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:43,938 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:43,938 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:57548': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:44,028 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:44,028 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:57552': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:44,045 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:44,046 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:57566': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:44,135 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:44,136 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:57570': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:44,153 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:44,153 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:57578': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:44,243 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:44,244 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:57580': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:44,260 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:44,261 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:57590': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:44,351 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:44,352 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:57594': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:44,369 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:44,369 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:57606': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:44,459 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:44,459 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:57616': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:44,476 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:44,477 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:57630': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:44,566 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:44,567 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:57642': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:44,584 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:44,584 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:57652': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:44,674 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:44,674 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:57658': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:44,691 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:44,692 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:57674': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:44,790 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:44,791 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:57678': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:44,799 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:44,799 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:57680': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:44,898 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:44,898 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:57690': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:44,906 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:44,906 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:57702': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:45,006 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:45,006 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:57712': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:45,012 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:45,013 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:57720': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:45,114 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:45,117 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:57724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:45,123 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:45,124 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:57734': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:45,222 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:45,222 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:57750': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:45,230 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:45,230 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:57760': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:45,330 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:45,331 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:57768': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:45,337 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:45,338 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:57784': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:45,437 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:45,438 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:57792': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:45,445 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:45,445 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:57798': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:45,545 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:45,546 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:57800': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:45,552 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:45,553 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:57802': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:45,654 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:45,655 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:57814': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:45,661 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:45,662 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:57820': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:45,762 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:45,762 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:57830': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:45,769 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:45,769 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:57842': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:45,870 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:45,870 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:57850': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:45,877 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:45,877 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:57862': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:45,978 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:45,979 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:57874': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:45,986 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:45,986 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:57882': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:46,086 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:46,086 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:57892': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:46,093 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:46,093 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:57904': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:46,194 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:46,194 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:57910': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:46,200 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:46,201 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:57918': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:46,301 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:46,302 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:57920': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:46,308 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:46,309 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:57926': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:46,409 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:46,410 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:57940': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:46,416 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:46,417 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:57948': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:46,517 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:46,517 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:57956': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:46,524 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:46,524 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:57966': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:46,625 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:46,625 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:57978': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:46,632 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:46,634 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:57980': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:46,733 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:46,734 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:57996': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:46,740 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:46,741 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:57998': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:46,842 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:46,843 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:58004': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:46,849 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:46,850 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:58012': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:46,950 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:46,951 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:58024': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:46,957 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:46,958 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:58036': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:47,058 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:47,059 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:58048': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:47,065 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:47,066 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:58056': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:47,166 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:47,170 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:58068': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:47,177 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:47,177 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:58070': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:47,274 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:47,274 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:58072': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:47,284 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:47,285 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:58074': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:47,382 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:47,382 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:58080': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:47,391 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:47,391 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:58094': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:47,489 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:47,490 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:58110': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:47,498 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:47,498 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:58118': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:47,598 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:47,598 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:58130': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:47,605 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:47,605 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:58142': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:47,706 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:47,706 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:58150': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:47,713 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:47,713 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:58164': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:47,814 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:47,814 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:58168': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:47,820 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:47,821 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:58172': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:47,921 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:47,922 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:58176': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:47,928 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:47,929 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:58184': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:48,030 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:48,031 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:58194': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:48,037 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:48,037 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:58204': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:48,138 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:48,139 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:58216': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:48,145 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:48,145 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:58230': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:48,247 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:48,248 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:58232': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:48,254 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:48,254 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:58248': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:48,355 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:48,355 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:58258': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:48,362 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:48,362 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:58274': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:48,462 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:48,463 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:58288': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:48,470 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:48,470 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:58294': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:48,571 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:48,571 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:58302': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:48,578 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:48,578 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:58308': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:48,678 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:48,679 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:58314': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:48,685 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:48,685 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:58326': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:48,786 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:48,787 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:58336': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:48,793 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:48,793 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:58340': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:48,894 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:48,895 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:58356': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:48,901 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:48,901 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:58358': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:49,002 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:49,003 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:58374': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:49,009 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:49,010 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:58384': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:49,110 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:49,111 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:58388': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:49,117 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:49,118 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:58394': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:49,219 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:49,220 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:58406': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:49,226 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:49,226 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:58410': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:49,326 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:49,327 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:58420': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:49,333 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:49,334 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:58430': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:49,435 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:49,436 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:58444': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:49,442 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:49,442 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:58452': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:49,543 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:49,543 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:58466': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:49,550 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:49,550 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:58470': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:49,651 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:49,651 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:58472': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:49,658 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:49,658 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:58480': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:49,759 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:49,760 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:58484': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:49,766 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:49,767 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:58488': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:49,867 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:49,868 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:58496': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:49,874 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:49,874 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:58504': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:49,975 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:49,975 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:58508': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:49,982 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:49,982 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:58522': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:50,083 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:50,083 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:58536': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:50,090 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:50,090 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:58548': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:50,191 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:50,191 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:58554': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:50,198 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:50,198 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:58556': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:50,299 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:50,300 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:58570': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:50,306 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:50,307 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:58578': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:50,422 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:50,424 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:58580': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:50,430 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:50,431 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:58586': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:50,531 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:50,531 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:58602': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:50,538 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:50,538 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:58612': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:50,639 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:50,639 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:58618': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:50,646 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:50,646 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:58624': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:50,747 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:50,749 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:58626': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:50,755 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:50,755 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:58628': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:50,857 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:50,858 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:58640': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:50,864 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:50,864 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:58644': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:50,964 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:50,965 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:58656': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:50,971 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:50,972 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:58660': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:51,072 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:51,072 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:58670': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:51,079 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:51,079 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:58676': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:51,179 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:51,179 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:58684': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:51,186 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:51,186 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:58688': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:51,288 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:51,289 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:58694': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:51,295 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:51,296 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:58700': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:51,397 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:51,397 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:58710': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:51,403 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:51,404 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:58718': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:51,505 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:51,505 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:58732': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:51,511 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:51,512 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:58746': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:51,613 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:51,614 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:40840': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:51,620 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:51,620 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:40856': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:51,721 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:51,722 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:40868': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:51,728 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:51,728 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:40870': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:51,830 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:51,831 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:40880': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:51,837 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:51,838 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:40890': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:51,939 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:51,940 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:40904': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:51,946 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:51,947 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:40916': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:52,047 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:52,048 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:40922': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:52,054 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:52,055 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:40934': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:52,155 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:52,156 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:40942': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:52,162 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:52,163 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:40948': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:52,263 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:52,264 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:40964': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:52,270 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:52,270 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:40976': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:52,371 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:52,372 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:40990': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:52,378 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:52,378 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:40992': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:52,480 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:52,481 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:41006': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:52,487 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:52,487 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:41018': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:52,590 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:52,591 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:41032': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:52,597 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:52,597 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:41046': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:52,698 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:52,699 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:41048': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:52,705 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:52,706 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:41054': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:52,809 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:52,810 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:41064': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:52,816 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:52,816 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:41072': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:52,917 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:52,918 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:41074': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:52,924 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:52,925 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:41076': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:53,025 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:53,026 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:41086': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:53,032 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:53,032 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:41102': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:53,134 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:53,135 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:41104': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:53,141 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:53,141 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:41114': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:53,242 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:53,242 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:41116': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:53,249 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:53,249 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:41124': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:53,350 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:53,351 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:41140': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:53,357 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:53,357 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:41142': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:53,457 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:53,458 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:41146': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:53,464 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:53,465 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:41152': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:53,565 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:53,566 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:41156': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:53,572 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:53,573 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:41158': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:53,674 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34633 3537s 2024-11-23 21:17:53,675 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:41170': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:53,675 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33779. Reason: failure-to-start- 3537s 2024-11-23 21:17:53,676 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:17:53,683 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35965. Reason: failure-to-start- 3537s 2024-11-23 21:17:53,683 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:17:53,684 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34633': TLS handshake failed with remote 'tls://127.0.0.1:41180': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:53,684 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 15s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 3537s stream = await stream.start_tls( 3537s ^^^^^^^^^^^^^^^^^^^^^^^ 3537s False, ssl_options=ssl_options, server_hostname=host 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 3537s self.socket.do_handshake() 3537s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 3537s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 3537s self._sslobj.do_handshake() 3537s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 3537s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 3537s raise FatalCommClosedError( 3537s ...<2 lines>... 3537s ) from err 3537s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 3537s 3537s During handling of the above exception, another exception occurred: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1218, in _register_with_scheduler 3537s await asyncio.sleep(0.1) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 718, in sleep 3537s return await future 3537s ^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 15s. 3537s 2024-11-23 21:17:54,693 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:17:54,702 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37569 3537s 2024-11-23 21:17:54,702 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40111/status 3537s 2024-11-23 21:17:54,703 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:17:54,719 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40095 3537s 2024-11-23 21:17:54,719 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40095 3537s 2024-11-23 21:17:54,719 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:17:54,719 - distributed.worker - INFO - dashboard at: 127.0.0.1:42089 3537s 2024-11-23 21:17:54,719 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:17:54,719 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:17:54,719 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:17:54,719 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:17:54,720 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-23zuvsu2 3537s 2024-11-23 21:17:54,720 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:17:54,722 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37139 3537s 2024-11-23 21:17:54,722 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37139 3537s 2024-11-23 21:17:54,722 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:17:54,722 - distributed.worker - INFO - dashboard at: 127.0.0.1:45715 3537s 2024-11-23 21:17:54,722 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:17:54,722 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:17:54,722 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:17:54,722 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:17:54,722 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-a96hoc9l 3537s 2024-11-23 21:17:54,722 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:17:54,735 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:17:54,736 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:17:54,736 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:42112': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:54,736 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:42114': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:54,849 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:17:54,849 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:17:54,850 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:42116': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:54,850 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:42126': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:54,964 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:17:54,964 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:17:54,965 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:42132': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:54,965 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:42146': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:55,078 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:17:55,079 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:17:55,079 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:42150': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:55,079 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:42152': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:55,192 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:17:55,192 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:17:55,193 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:42162': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:55,193 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:42170': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:55,306 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:17:55,306 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:17:55,306 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:42178': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:55,306 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:42182': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:55,419 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:17:55,419 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:17:55,420 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:42190': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:55,420 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:42204': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:55,532 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:17:55,533 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:17:55,533 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:42212': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:55,533 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:42226': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:55,645 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:17:55,645 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:17:55,646 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:42228': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:55,646 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:42240': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:55,760 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:17:55,760 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:17:55,760 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:42254': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:55,761 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:42256': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:55,873 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:17:55,873 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:17:55,874 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:42262': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:55,874 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:42268': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:55,986 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:17:55,986 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:17:55,987 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:42284': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:55,987 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:42294': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:56,100 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:17:56,100 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:17:56,100 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:42298': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:56,100 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:42314': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:56,216 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:17:56,217 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:17:56,217 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:42316': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:56,217 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:42326': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:56,330 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:17:56,330 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:17:56,331 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:42340': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:56,331 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:42356': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:56,443 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:17:56,444 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:17:56,444 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:42362': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:56,444 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:42372': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:56,558 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:17:56,558 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:17:56,558 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:42384': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:56,558 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:42400': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:56,671 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:17:56,671 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:17:56,675 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:42406': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:56,675 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:42410': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:56,784 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:17:56,784 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:17:56,785 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:42424': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:56,785 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:42438': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:56,897 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:17:56,898 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:17:56,898 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:42442': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:56,898 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:42454': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:57,011 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:17:57,011 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:17:57,012 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:42460': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:57,012 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:42474': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:57,124 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:17:57,124 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:17:57,125 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:42488': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:57,125 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:42504': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:57,239 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:17:57,239 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:17:57,239 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:42516': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:57,240 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:42530': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:57,353 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:17:57,355 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:17:57,355 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:42534': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:57,355 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:42544': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:57,468 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:17:57,468 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:17:57,468 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:42552': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:57,469 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:42560': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:57,581 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:17:57,581 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:17:57,582 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:42574': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:57,582 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:42586': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:57,694 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:17:57,694 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:17:57,695 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:42602': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:57,695 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:42614': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:57,807 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:17:57,807 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:17:57,807 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:42618': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:57,808 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:42626': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:57,920 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:17:57,920 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:17:57,921 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:42642': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:57,921 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:42644': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:58,035 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:17:58,035 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:17:58,035 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:42654': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:58,035 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:42668': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:58,165 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:17:58,165 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:17:58,170 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:42684': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:58,171 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:42694': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:58,279 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:17:58,279 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:17:58,280 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:42708': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:58,280 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:42712': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:58,393 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:17:58,393 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:17:58,394 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:42720': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:58,394 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:42722': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:58,507 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:17:58,507 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:17:58,508 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:42738': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:58,508 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:42744': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:58,620 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:17:58,620 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:17:58,621 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:42750': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:58,621 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:42762': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:58,735 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:17:58,736 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:17:58,736 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:42770': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:58,736 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:42778': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:58,849 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:17:58,849 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:17:58,850 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:42788': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:58,850 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:42792': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:58,964 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:17:58,965 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:17:58,965 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:42808': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:58,966 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:42824': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:59,079 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:17:59,079 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:17:59,079 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:42830': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:59,079 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:42834': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:59,194 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:17:59,194 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:17:59,195 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:42842': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:59,195 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:42850': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:59,308 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:17:59,308 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:17:59,309 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:42862': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:59,309 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:42870': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:59,422 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:17:59,422 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:17:59,422 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:42880': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:59,422 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:42886': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:59,535 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:17:59,536 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:17:59,536 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:42890': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:59,536 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:42892': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:59,649 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:17:59,649 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:17:59,650 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:42906': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:59,650 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:42922': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:59,763 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:17:59,763 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:17:59,763 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:42932': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:59,763 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:42938': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:59,877 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:17:59,877 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:17:59,878 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:42952': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:59,878 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:42962': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:59,991 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:17:59,992 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:17:59,992 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:42964': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:17:59,992 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:42976': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:00,105 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:18:00,105 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:18:00,106 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:42978': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:00,106 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:42980': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:00,220 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:18:00,221 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:18:00,221 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:42990': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:00,221 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:43002': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:00,334 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:18:00,334 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:18:00,334 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:43004': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:00,335 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:43016': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:00,448 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:18:00,448 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:18:00,448 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:43022': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:00,449 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:43032': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:00,561 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:18:00,562 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:18:00,562 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:43048': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:00,562 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:43060': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:00,679 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:18:00,679 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:18:00,679 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:43076': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:00,679 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:43088': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:00,793 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:18:00,793 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:18:00,793 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:43102': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:00,794 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:43116': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:00,906 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:18:00,906 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:18:00,907 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:43132': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:00,907 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:43140': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:01,022 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:18:01,022 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:18:01,023 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:43146': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:01,023 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:43152': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:01,135 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:18:01,136 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:18:01,136 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:43162': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:01,136 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:43170': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:01,249 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:18:01,249 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:18:01,250 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:43172': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:01,250 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:43180': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:01,363 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:18:01,363 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:18:01,363 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:43186': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:01,364 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:43198': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:01,477 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:18:01,477 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:18:01,478 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:43202': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:01,478 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:43210': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:01,590 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:18:01,591 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:18:01,591 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:45254': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:01,591 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:45260': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:01,704 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:18:01,704 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:18:01,705 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:45272': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:01,705 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:45274': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:01,817 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:18:01,817 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:18:01,818 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:45276': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:01,818 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:45292': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:01,931 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:18:01,931 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:18:01,932 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:45294': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:01,932 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:45298': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:02,046 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:18:02,046 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:18:02,046 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:45304': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:02,046 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:45310': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:02,159 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:18:02,159 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:18:02,160 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:45322': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:02,160 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:45332': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:02,272 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:18:02,273 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:18:02,273 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:45346': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:02,273 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:45362': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:02,387 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:18:02,388 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:18:02,388 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:45376': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:02,388 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:45378': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:02,501 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:18:02,501 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:18:02,502 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:45380': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:02,502 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:45390': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:02,614 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:18:02,615 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:18:02,615 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:45394': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:02,615 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:45410': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:02,733 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:18:02,734 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:18:02,734 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:45412': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:02,734 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:45422': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:02,847 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:18:02,847 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:18:02,848 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:45424': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:02,848 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:45440': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:02,961 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:18:02,961 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:18:02,962 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:45444': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:02,962 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:45454': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:03,075 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:18:03,075 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:18:03,075 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:45470': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:03,076 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:45472': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:03,188 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:18:03,188 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:18:03,189 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:45486': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:03,189 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:45490': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:03,302 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:18:03,302 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:18:03,303 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:45492': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:03,303 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:45494': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:03,415 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:18:03,415 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:18:03,416 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:45496': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:03,416 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:45504': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:03,528 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:18:03,528 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:18:03,529 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:45520': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:03,529 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:45534': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:03,641 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:18:03,642 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:18:03,642 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:45550': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:03,642 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:45558': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:03,756 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:18:03,756 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:18:03,756 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:45564': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:03,756 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:45578': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:03,870 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:18:03,870 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:18:03,871 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:45590': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:03,871 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:45604': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:03,983 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:18:03,984 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:18:03,984 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:45612': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:03,984 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:45618': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:04,097 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:18:04,097 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:18:04,097 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:45630': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:04,098 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:45638': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:04,210 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:18:04,210 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:18:04,214 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:45646': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:04,214 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:45654': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:04,324 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:18:04,324 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:18:04,325 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:45668': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:04,325 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:45676': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:04,438 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:18:04,438 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:18:04,439 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:45692': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:04,439 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:45700': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:04,554 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:18:04,555 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:18:04,555 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:45716': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:04,555 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:45726': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:04,669 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:18:04,670 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:18:04,674 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:45732': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:04,674 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:45744': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:04,783 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:18:04,783 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:18:04,784 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:45756': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:04,784 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:45770': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:04,897 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:18:04,898 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:18:04,898 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:45780': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:04,898 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:45796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:05,025 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:18:05,025 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:18:05,027 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:45802': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:05,027 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:45808': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:05,140 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:18:05,140 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:18:05,141 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:45822': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:05,141 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:45826': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:05,254 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:18:05,254 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:18:05,255 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:45842': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:05,255 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:45844': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:05,368 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:18:05,369 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:18:05,369 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:45848': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:05,369 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:45860': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:05,482 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:18:05,483 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:18:05,483 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:45862': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:05,483 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:45870': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:05,596 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:18:05,597 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:18:05,597 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:45886': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:05,597 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:45896': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:05,712 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:18:05,712 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:18:05,716 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:45904': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:05,716 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:45912': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:05,825 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:18:05,826 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:18:05,826 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:45922': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:05,826 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:45926': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:05,939 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:18:05,940 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:18:05,940 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:45940': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:05,940 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:45950': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:06,053 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:18:06,054 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:18:06,054 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:45958': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:06,054 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:45960': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:06,167 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:18:06,167 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:18:06,171 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:45964': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:06,171 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:45968': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:06,281 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:18:06,281 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:18:06,282 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:45978': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:06,282 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:45982': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:06,397 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:18:06,397 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:18:06,398 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:45996': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:06,399 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:46012': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:06,511 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:18:06,511 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:18:06,512 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:46016': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:06,512 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:46026': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:06,625 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:18:06,625 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:18:06,625 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:46038': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:06,625 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:46042': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:06,738 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:18:06,739 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:18:06,739 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:46052': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:06,739 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:46058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:06,852 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:18:06,852 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:18:06,853 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:46062': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:06,853 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:46074': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:06,966 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:18:06,966 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:18:06,967 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:46084': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:06,967 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:46092': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:07,080 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:18:07,080 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:18:07,080 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:46108': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:07,081 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:46112': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:07,193 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:18:07,193 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:18:07,193 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:46126': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:07,194 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:46140': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:07,306 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:18:07,306 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:18:07,307 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:46148': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:07,307 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:46162': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:07,420 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:18:07,420 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:18:07,420 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:46176': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:07,421 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:46178': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:07,534 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:18:07,534 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:18:07,535 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:46182': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:07,535 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:46192': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:07,648 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:18:07,648 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37569 3537s 2024-11-23 21:18:07,648 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:46200': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:07,649 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37569': TLS handshake failed with remote 'tls://127.0.0.1:46216': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:07,718 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40095. Reason: failure-to-start- 3537s 2024-11-23 21:18:07,718 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:18:07,720 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 13s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 3537s stream = await stream.start_tls( 3537s ^^^^^^^^^^^^^^^^^^^^^^^ 3537s False, ssl_options=ssl_options, server_hostname=host 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 3537s self.socket.do_handshake() 3537s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 3537s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 3537s self._sslobj.do_handshake() 3537s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 3537s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 3537s raise FatalCommClosedError( 3537s ...<2 lines>... 3537s ) from err 3537s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 3537s 3537s During handling of the above exception, another exception occurred: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1218, in _register_with_scheduler 3537s await asyncio.sleep(0.1) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 718, in sleep 3537s return await future 3537s ^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 13s. 3537s 2024-11-23 21:18:07,725 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37139. Reason: failure-to-start- 3537s 2024-11-23 21:18:07,725 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:18:08,728 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:18:08,736 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37315 3537s 2024-11-23 21:18:08,737 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43519/status 3537s 2024-11-23 21:18:08,737 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:18:08,754 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:32813 3537s 2024-11-23 21:18:08,755 - distributed.worker - INFO - Listening to: tls://127.0.0.1:32813 3537s 2024-11-23 21:18:08,755 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:18:08,755 - distributed.worker - INFO - dashboard at: 127.0.0.1:35931 3537s 2024-11-23 21:18:08,755 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37315 3537s 2024-11-23 21:18:08,755 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:18:08,755 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:18:08,755 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:18:08,755 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-i4esm1s_ 3537s 2024-11-23 21:18:08,755 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:18:08,757 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44757 3537s 2024-11-23 21:18:08,757 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44757 3537s 2024-11-23 21:18:08,757 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:18:08,757 - distributed.worker - INFO - dashboard at: 127.0.0.1:42563 3537s 2024-11-23 21:18:08,757 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37315 3537s 2024-11-23 21:18:08,758 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:18:08,758 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:18:08,758 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:18:08,758 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-l273h7_m 3537s 2024-11-23 21:18:08,758 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:18:08,759 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:32813. Reason: failure-to-start- 3537s 2024-11-23 21:18:08,759 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:18:08,759 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44757. Reason: failure-to-start- 3537s 2024-11-23 21:18:08,759 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:18:08,760 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37315': TLS handshake failed with remote 'tls://127.0.0.1:55732': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:18:08,761 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37315': TLS handshake failed with remote 'tls://127.0.0.1:55742': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:18:08,762 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:18:09,769 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:18:09,776 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37711 3537s 2024-11-23 21:18:09,776 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35163/status 3537s 2024-11-23 21:18:09,776 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:18:09,793 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36089 3537s 2024-11-23 21:18:09,793 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36089 3537s 2024-11-23 21:18:09,793 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:18:09,793 - distributed.worker - INFO - dashboard at: 127.0.0.1:46799 3537s 2024-11-23 21:18:09,793 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37711 3537s 2024-11-23 21:18:09,793 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:18:09,793 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:18:09,793 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:18:09,793 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-q1qsm2jh 3537s 2024-11-23 21:18:09,793 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:18:09,795 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37243 3537s 2024-11-23 21:18:09,796 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37243 3537s 2024-11-23 21:18:09,796 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:18:09,796 - distributed.worker - INFO - dashboard at: 127.0.0.1:40443 3537s 2024-11-23 21:18:09,796 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37711 3537s 2024-11-23 21:18:09,796 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:18:09,796 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:18:09,796 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:18:09,796 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-5dcp06ru 3537s 2024-11-23 21:18:09,796 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:18:09,797 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36089. Reason: failure-to-start- 3537s 2024-11-23 21:18:09,797 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:18:09,798 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37243. Reason: failure-to-start- 3537s 2024-11-23 21:18:09,798 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:18:09,799 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37711': TLS handshake failed with remote 'tls://127.0.0.1:59554': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:18:09,799 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37711': TLS handshake failed with remote 'tls://127.0.0.1:59558': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:18:09,801 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:18:10,807 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:18:10,814 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45473 3537s 2024-11-23 21:18:10,814 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42671/status 3537s 2024-11-23 21:18:10,814 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:18:10,829 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37907 3537s 2024-11-23 21:18:10,829 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37907 3537s 2024-11-23 21:18:10,829 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:18:10,829 - distributed.worker - INFO - dashboard at: 127.0.0.1:43437 3537s 2024-11-23 21:18:10,829 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45473 3537s 2024-11-23 21:18:10,830 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:18:10,830 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:18:10,830 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:18:10,830 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-kqvngnsq 3537s 2024-11-23 21:18:10,830 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:18:10,832 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38797 3537s 2024-11-23 21:18:10,832 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38797 3537s 2024-11-23 21:18:10,832 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:18:10,832 - distributed.worker - INFO - dashboard at: 127.0.0.1:46171 3537s 2024-11-23 21:18:10,832 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45473 3537s 2024-11-23 21:18:10,832 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:18:10,832 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:18:10,832 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:18:10,833 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-w_w2dxni 3537s 2024-11-23 21:18:10,833 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:18:10,834 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37907. Reason: failure-to-start- 3537s 2024-11-23 21:18:10,834 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:18:10,834 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38797. Reason: failure-to-start- 3537s 2024-11-23 21:18:10,834 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:18:10,836 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45473': TLS handshake failed with remote 'tls://127.0.0.1:54532': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:18:10,836 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45473': TLS handshake failed with remote 'tls://127.0.0.1:54538': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:18:10,837 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:18:11,845 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:18:11,853 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38535 3537s 2024-11-23 21:18:11,853 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37161/status 3537s 2024-11-23 21:18:11,853 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:18:11,869 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43275 3537s 2024-11-23 21:18:11,869 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43275 3537s 2024-11-23 21:18:11,869 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:18:11,869 - distributed.worker - INFO - dashboard at: 127.0.0.1:46433 3537s 2024-11-23 21:18:11,869 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38535 3537s 2024-11-23 21:18:11,869 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:18:11,869 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:18:11,869 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:18:11,869 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-mdv927ks 3537s 2024-11-23 21:18:11,869 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:18:11,871 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:32827 3537s 2024-11-23 21:18:11,872 - distributed.worker - INFO - Listening to: tls://127.0.0.1:32827 3537s 2024-11-23 21:18:11,872 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:18:11,872 - distributed.worker - INFO - dashboard at: 127.0.0.1:46313 3537s 2024-11-23 21:18:11,872 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38535 3537s 2024-11-23 21:18:11,872 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:18:11,872 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:18:11,872 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:18:11,872 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-jk0b346a 3537s 2024-11-23 21:18:11,872 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:18:11,873 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43275. Reason: failure-to-start- 3537s 2024-11-23 21:18:11,873 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:18:11,874 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:32827. Reason: failure-to-start- 3537s 2024-11-23 21:18:11,874 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:18:11,875 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38535': TLS handshake failed with remote 'tls://127.0.0.1:45498': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:18:11,875 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38535': TLS handshake failed with remote 'tls://127.0.0.1:45510': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:18:11,877 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:18:12,883 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:18:12,890 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41975 3537s 2024-11-23 21:18:12,891 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39515/status 3537s 2024-11-23 21:18:12,891 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:18:12,908 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38839 3537s 2024-11-23 21:18:12,908 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38839 3537s 2024-11-23 21:18:12,908 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:18:12,908 - distributed.worker - INFO - dashboard at: 127.0.0.1:39271 3537s 2024-11-23 21:18:12,908 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41975 3537s 2024-11-23 21:18:12,908 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:18:12,908 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:18:12,909 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:18:12,909 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-kabhf2rl 3537s 2024-11-23 21:18:12,909 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:18:12,911 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39855 3537s 2024-11-23 21:18:12,911 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39855 3537s 2024-11-23 21:18:12,911 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:18:12,911 - distributed.worker - INFO - dashboard at: 127.0.0.1:44941 3537s 2024-11-23 21:18:12,911 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41975 3537s 2024-11-23 21:18:12,911 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:18:12,911 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:18:12,911 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:18:12,911 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-0nrr2m88 3537s 2024-11-23 21:18:12,912 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:18:12,913 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38839. Reason: failure-to-start- 3537s 2024-11-23 21:18:12,913 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:18:12,913 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39855. Reason: failure-to-start- 3537s 2024-11-23 21:18:12,913 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:18:12,915 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41975': TLS handshake failed with remote 'tls://127.0.0.1:50058': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:18:12,915 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41975': TLS handshake failed with remote 'tls://127.0.0.1:50068': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:18:12,917 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:18:13,923 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:18:13,933 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35005 3537s 2024-11-23 21:18:13,933 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37607/status 3537s 2024-11-23 21:18:13,933 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:18:13,950 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42569 3537s 2024-11-23 21:18:13,950 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42569 3537s 2024-11-23 21:18:13,951 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:18:13,951 - distributed.worker - INFO - dashboard at: 127.0.0.1:39861 3537s 2024-11-23 21:18:13,951 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35005 3537s 2024-11-23 21:18:13,951 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:18:13,951 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:18:13,951 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:18:13,951 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-b18cu9es 3537s 2024-11-23 21:18:13,951 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:18:13,953 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33061 3537s 2024-11-23 21:18:13,953 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33061 3537s 2024-11-23 21:18:13,953 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:18:13,953 - distributed.worker - INFO - dashboard at: 127.0.0.1:43443 3537s 2024-11-23 21:18:13,953 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35005 3537s 2024-11-23 21:18:13,954 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:18:13,954 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:18:13,954 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:18:13,954 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-g1_ad0zw 3537s 2024-11-23 21:18:13,954 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:18:13,956 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42569. Reason: failure-to-start- 3537s 2024-11-23 21:18:13,956 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:18:13,956 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33061. Reason: failure-to-start- 3537s 2024-11-23 21:18:13,956 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:18:13,958 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35005': TLS handshake failed with remote 'tls://127.0.0.1:32916': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:18:13,958 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35005': TLS handshake failed with remote 'tls://127.0.0.1:32932': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:18:13,959 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:18:14,965 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:18:14,973 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38655 3537s 2024-11-23 21:18:14,974 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40861/status 3537s 2024-11-23 21:18:14,974 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:18:14,989 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33757 3537s 2024-11-23 21:18:14,989 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33757 3537s 2024-11-23 21:18:14,989 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:18:14,989 - distributed.worker - INFO - dashboard at: 127.0.0.1:36915 3537s 2024-11-23 21:18:14,989 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38655 3537s 2024-11-23 21:18:14,989 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:18:14,989 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:18:14,989 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:18:14,989 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-mnwx1s5m 3537s 2024-11-23 21:18:14,990 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:18:14,992 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34923 3537s 2024-11-23 21:18:14,992 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34923 3537s 2024-11-23 21:18:14,992 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:18:14,992 - distributed.worker - INFO - dashboard at: 127.0.0.1:44079 3537s 2024-11-23 21:18:14,992 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38655 3537s 2024-11-23 21:18:14,992 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:18:14,992 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:18:14,992 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:18:14,992 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ceiwm5tv 3537s 2024-11-23 21:18:14,992 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:18:14,994 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33757. Reason: failure-to-start- 3537s 2024-11-23 21:18:14,994 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:18:14,994 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34923. Reason: failure-to-start- 3537s 2024-11-23 21:18:14,995 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:18:14,996 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38655': TLS handshake failed with remote 'tls://127.0.0.1:49278': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:18:14,996 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38655': TLS handshake failed with remote 'tls://127.0.0.1:49290': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:18:14,998 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:18:16,006 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:18:16,014 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45787 3537s 2024-11-23 21:18:16,015 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36225/status 3537s 2024-11-23 21:18:16,015 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:18:16,029 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34663 3537s 2024-11-23 21:18:16,030 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34663 3537s 2024-11-23 21:18:16,030 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:18:16,030 - distributed.worker - INFO - dashboard at: 127.0.0.1:36819 3537s 2024-11-23 21:18:16,030 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45787 3537s 2024-11-23 21:18:16,030 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:18:16,030 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:18:16,030 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:18:16,030 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-5zoyk7_f 3537s 2024-11-23 21:18:16,030 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:18:16,032 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35477 3537s 2024-11-23 21:18:16,032 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35477 3537s 2024-11-23 21:18:16,032 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:18:16,032 - distributed.worker - INFO - dashboard at: 127.0.0.1:46217 3537s 2024-11-23 21:18:16,033 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45787 3537s 2024-11-23 21:18:16,033 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:18:16,033 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:18:16,033 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:18:16,033 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-crdb9u7b 3537s 2024-11-23 21:18:16,033 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:18:16,034 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34663. Reason: failure-to-start- 3537s 2024-11-23 21:18:16,035 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:18:16,035 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35477. Reason: failure-to-start- 3537s 2024-11-23 21:18:16,035 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:18:16,037 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45787': TLS handshake failed with remote 'tls://127.0.0.1:48332': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:18:16,037 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45787': TLS handshake failed with remote 'tls://127.0.0.1:48340': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:18:16,038 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:18:17,044 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:18:17,052 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36523 3537s 2024-11-23 21:18:17,053 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33693/status 3537s 2024-11-23 21:18:17,053 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:18:17,070 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41943 3537s 2024-11-23 21:18:17,071 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41943 3537s 2024-11-23 21:18:17,071 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:18:17,071 - distributed.worker - INFO - dashboard at: 127.0.0.1:44579 3537s 2024-11-23 21:18:17,071 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36523 3537s 2024-11-23 21:18:17,071 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:18:17,071 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:18:17,071 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:18:17,071 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-k_3v27ci 3537s 2024-11-23 21:18:17,071 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:18:17,073 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44681 3537s 2024-11-23 21:18:17,073 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44681 3537s 2024-11-23 21:18:17,073 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:18:17,074 - distributed.worker - INFO - dashboard at: 127.0.0.1:42951 3537s 2024-11-23 21:18:17,074 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36523 3537s 2024-11-23 21:18:17,074 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:18:17,074 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:18:17,074 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:18:17,074 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-3g6wzgf3 3537s 2024-11-23 21:18:17,074 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:18:17,075 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41943. Reason: failure-to-start- 3537s 2024-11-23 21:18:17,075 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:18:17,076 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44681. Reason: failure-to-start- 3537s 2024-11-23 21:18:17,076 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:18:17,078 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36523': TLS handshake failed with remote 'tls://127.0.0.1:33996': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:18:17,078 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36523': TLS handshake failed with remote 'tls://127.0.0.1:34006': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:18:17,080 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:18:18,085 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:18:18,093 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43865 3537s 2024-11-23 21:18:18,095 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37445/status 3537s 2024-11-23 21:18:18,095 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:18:18,111 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36021 3537s 2024-11-23 21:18:18,111 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36021 3537s 2024-11-23 21:18:18,111 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:18:18,111 - distributed.worker - INFO - dashboard at: 127.0.0.1:34389 3537s 2024-11-23 21:18:18,112 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43865 3537s 2024-11-23 21:18:18,112 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:18:18,112 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:18:18,112 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:18:18,112 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-70mbmr3g 3537s 2024-11-23 21:18:18,112 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:18:18,114 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38839 3537s 2024-11-23 21:18:18,114 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38839 3537s 2024-11-23 21:18:18,114 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:18:18,114 - distributed.worker - INFO - dashboard at: 127.0.0.1:41211 3537s 2024-11-23 21:18:18,114 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43865 3537s 2024-11-23 21:18:18,115 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:18:18,115 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:18:18,115 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:18:18,115 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-rood49zo 3537s 2024-11-23 21:18:18,115 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:18:18,116 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36021. Reason: failure-to-start- 3537s 2024-11-23 21:18:18,116 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:18:18,117 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38839. Reason: failure-to-start- 3537s 2024-11-23 21:18:18,117 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:18:18,119 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43865': TLS handshake failed with remote 'tls://127.0.0.1:59234': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:18:18,119 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43865': TLS handshake failed with remote 'tls://127.0.0.1:59242': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:18:18,120 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:18:19,126 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:18:19,134 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44957 3537s 2024-11-23 21:18:19,135 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36315/status 3537s 2024-11-23 21:18:19,135 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:18:19,151 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38001 3537s 2024-11-23 21:18:19,151 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38001 3537s 2024-11-23 21:18:19,151 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:18:19,151 - distributed.worker - INFO - dashboard at: 127.0.0.1:35935 3537s 2024-11-23 21:18:19,151 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44957 3537s 2024-11-23 21:18:19,151 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:18:19,152 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:18:19,152 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:18:19,152 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-8why1rbg 3537s 2024-11-23 21:18:19,152 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:18:19,154 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35117 3537s 2024-11-23 21:18:19,154 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35117 3537s 2024-11-23 21:18:19,154 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:18:19,154 - distributed.worker - INFO - dashboard at: 127.0.0.1:42465 3537s 2024-11-23 21:18:19,155 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44957 3537s 2024-11-23 21:18:19,155 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:18:19,155 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:18:19,155 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:18:19,155 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-to5g8q_8 3537s 2024-11-23 21:18:19,155 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:18:19,157 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38001. Reason: failure-to-start- 3537s 2024-11-23 21:18:19,157 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:18:19,158 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35117. Reason: failure-to-start- 3537s 2024-11-23 21:18:19,158 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:18:19,160 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44957': TLS handshake failed with remote 'tls://127.0.0.1:60324': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:18:19,160 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44957': TLS handshake failed with remote 'tls://127.0.0.1:60338': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:18:19,161 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:18:20,170 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:18:20,177 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36065 3537s 2024-11-23 21:18:20,178 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39377/status 3537s 2024-11-23 21:18:20,178 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:18:20,193 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40999 3537s 2024-11-23 21:18:20,193 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40999 3537s 2024-11-23 21:18:20,193 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:18:20,193 - distributed.worker - INFO - dashboard at: 127.0.0.1:46309 3537s 2024-11-23 21:18:20,193 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36065 3537s 2024-11-23 21:18:20,194 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:18:20,194 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:18:20,194 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:18:20,194 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-yit8ogvz 3537s 2024-11-23 21:18:20,194 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:18:20,196 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40213 3537s 2024-11-23 21:18:20,196 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40213 3537s 2024-11-23 21:18:20,196 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:18:20,196 - distributed.worker - INFO - dashboard at: 127.0.0.1:36071 3537s 2024-11-23 21:18:20,196 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36065 3537s 2024-11-23 21:18:20,197 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:18:20,197 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:18:20,197 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:18:20,197 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-p8erdfsl 3537s 2024-11-23 21:18:20,197 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:18:20,198 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40999. Reason: failure-to-start- 3537s 2024-11-23 21:18:20,199 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:18:20,199 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40213. Reason: failure-to-start- 3537s 2024-11-23 21:18:20,199 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:18:20,201 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36065': TLS handshake failed with remote 'tls://127.0.0.1:39580': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:18:20,201 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36065': TLS handshake failed with remote 'tls://127.0.0.1:39584': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:18:20,202 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:18:21,212 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:18:21,239 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41871 3537s 2024-11-23 21:18:21,240 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37813/status 3537s 2024-11-23 21:18:21,240 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:18:21,258 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40475 3537s 2024-11-23 21:18:21,258 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40475 3537s 2024-11-23 21:18:21,258 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:18:21,258 - distributed.worker - INFO - dashboard at: 127.0.0.1:37719 3537s 2024-11-23 21:18:21,258 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41871 3537s 2024-11-23 21:18:21,258 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:18:21,258 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:18:21,259 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:18:21,259 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-uepmb23s 3537s 2024-11-23 21:18:21,259 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:18:21,261 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42423 3537s 2024-11-23 21:18:21,261 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42423 3537s 2024-11-23 21:18:21,261 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:18:21,261 - distributed.worker - INFO - dashboard at: 127.0.0.1:38061 3537s 2024-11-23 21:18:21,261 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41871 3537s 2024-11-23 21:18:21,261 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:18:21,261 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:18:21,261 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:18:21,261 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-dl4jzc87 3537s 2024-11-23 21:18:21,261 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:18:21,263 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40475. Reason: failure-to-start- 3537s 2024-11-23 21:18:21,263 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:18:21,263 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42423. Reason: failure-to-start- 3537s 2024-11-23 21:18:21,263 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:18:21,265 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41871': TLS handshake failed with remote 'tls://127.0.0.1:59770': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:18:21,265 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41871': TLS handshake failed with remote 'tls://127.0.0.1:59782': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:18:21,267 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:18:22,273 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:18:22,281 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41125 3537s 2024-11-23 21:18:22,282 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39941/status 3537s 2024-11-23 21:18:22,282 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:18:22,301 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42425 3537s 2024-11-23 21:18:22,301 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42425 3537s 2024-11-23 21:18:22,301 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:18:22,301 - distributed.worker - INFO - dashboard at: 127.0.0.1:33983 3537s 2024-11-23 21:18:22,302 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41125 3537s 2024-11-23 21:18:22,302 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:18:22,302 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:18:22,302 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:18:22,302 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-xpe1bb6q 3537s 2024-11-23 21:18:22,302 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:18:22,304 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38987 3537s 2024-11-23 21:18:22,304 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38987 3537s 2024-11-23 21:18:22,304 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:18:22,304 - distributed.worker - INFO - dashboard at: 127.0.0.1:33213 3537s 2024-11-23 21:18:22,304 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41125 3537s 2024-11-23 21:18:22,304 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:18:22,304 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:18:22,304 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:18:22,305 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ik4bekgp 3537s 2024-11-23 21:18:22,305 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:18:22,306 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42425. Reason: failure-to-start- 3537s 2024-11-23 21:18:22,306 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:18:22,306 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38987. Reason: failure-to-start- 3537s 2024-11-23 21:18:22,307 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:18:22,308 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41125': TLS handshake failed with remote 'tls://127.0.0.1:46638': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:18:22,308 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41125': TLS handshake failed with remote 'tls://127.0.0.1:46652': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:18:22,310 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:18:23,316 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:18:23,324 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37963 3537s 2024-11-23 21:18:23,324 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39965/status 3537s 2024-11-23 21:18:23,325 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:18:23,342 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41383 3537s 2024-11-23 21:18:23,343 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41383 3537s 2024-11-23 21:18:23,343 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:18:23,343 - distributed.worker - INFO - dashboard at: 127.0.0.1:40871 3537s 2024-11-23 21:18:23,343 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37963 3537s 2024-11-23 21:18:23,343 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:18:23,343 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:18:23,343 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:18:23,343 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-i9dmjtet 3537s 2024-11-23 21:18:23,343 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:18:23,345 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33585 3537s 2024-11-23 21:18:23,345 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33585 3537s 2024-11-23 21:18:23,345 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:18:23,345 - distributed.worker - INFO - dashboard at: 127.0.0.1:39633 3537s 2024-11-23 21:18:23,345 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37963 3537s 2024-11-23 21:18:23,346 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:18:23,346 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:18:23,346 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:18:23,346 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-nryq28at 3537s 2024-11-23 21:18:23,346 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:18:23,348 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41383. Reason: failure-to-start- 3537s 2024-11-23 21:18:23,349 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:18:23,349 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33585. Reason: failure-to-start- 3537s 2024-11-23 21:18:23,349 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:18:23,351 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37963': TLS handshake failed with remote 'tls://127.0.0.1:57380': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:18:23,351 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37963': TLS handshake failed with remote 'tls://127.0.0.1:57394': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:18:23,352 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:18:24,358 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:18:24,366 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41501 3537s 2024-11-23 21:18:24,366 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46469/status 3537s 2024-11-23 21:18:24,367 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:18:24,381 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45393 3537s 2024-11-23 21:18:24,381 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45393 3537s 2024-11-23 21:18:24,381 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:18:24,382 - distributed.worker - INFO - dashboard at: 127.0.0.1:44635 3537s 2024-11-23 21:18:24,382 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41501 3537s 2024-11-23 21:18:24,382 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:18:24,382 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:18:24,382 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:18:24,382 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-4k7m3dar 3537s 2024-11-23 21:18:24,382 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:18:24,384 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44157 3537s 2024-11-23 21:18:24,384 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44157 3537s 2024-11-23 21:18:24,384 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:18:24,384 - distributed.worker - INFO - dashboard at: 127.0.0.1:39169 3537s 2024-11-23 21:18:24,384 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41501 3537s 2024-11-23 21:18:24,384 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:18:24,384 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:18:24,384 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:18:24,385 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-nmzs09w3 3537s 2024-11-23 21:18:24,385 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:18:24,387 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45393. Reason: failure-to-start- 3537s 2024-11-23 21:18:24,387 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:18:24,387 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44157. Reason: failure-to-start- 3537s 2024-11-23 21:18:24,388 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:18:24,389 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41501': TLS handshake failed with remote 'tls://127.0.0.1:44876': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:18:24,389 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41501': TLS handshake failed with remote 'tls://127.0.0.1:44888': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:18:24,391 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:18:25,397 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:18:25,406 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40699 3537s 2024-11-23 21:18:25,407 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37273/status 3537s 2024-11-23 21:18:25,407 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:18:25,422 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42195 3537s 2024-11-23 21:18:25,423 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42195 3537s 2024-11-23 21:18:25,423 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:18:25,423 - distributed.worker - INFO - dashboard at: 127.0.0.1:42313 3537s 2024-11-23 21:18:25,423 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40699 3537s 2024-11-23 21:18:25,423 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:18:25,423 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:18:25,423 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:18:25,423 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-o_qmy9t7 3537s 2024-11-23 21:18:25,423 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:18:25,425 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40219 3537s 2024-11-23 21:18:25,425 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40219 3537s 2024-11-23 21:18:25,426 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:18:25,426 - distributed.worker - INFO - dashboard at: 127.0.0.1:38157 3537s 2024-11-23 21:18:25,426 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40699 3537s 2024-11-23 21:18:25,426 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:18:25,426 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:18:25,426 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:18:25,426 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-j0zs5dy1 3537s 2024-11-23 21:18:25,426 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:18:25,427 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42195. Reason: failure-to-start- 3537s 2024-11-23 21:18:25,428 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:18:25,428 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40219. Reason: failure-to-start- 3537s 2024-11-23 21:18:25,428 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:18:25,430 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40699': TLS handshake failed with remote 'tls://127.0.0.1:36010': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:18:25,430 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40699': TLS handshake failed with remote 'tls://127.0.0.1:36020': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:18:25,432 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:18:26,439 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:18:26,446 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37687 3537s 2024-11-23 21:18:26,447 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39779/status 3537s 2024-11-23 21:18:26,447 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:18:26,464 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34201 3537s 2024-11-23 21:18:26,464 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34201 3537s 2024-11-23 21:18:26,464 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:18:26,464 - distributed.worker - INFO - dashboard at: 127.0.0.1:43791 3537s 2024-11-23 21:18:26,464 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37687 3537s 2024-11-23 21:18:26,464 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:18:26,464 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:18:26,464 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:18:26,464 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-1yx2eh5x 3537s 2024-11-23 21:18:26,464 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:18:26,467 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35467 3537s 2024-11-23 21:18:26,467 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35467 3537s 2024-11-23 21:18:26,467 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:18:26,467 - distributed.worker - INFO - dashboard at: 127.0.0.1:41017 3537s 2024-11-23 21:18:26,467 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37687 3537s 2024-11-23 21:18:26,467 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:18:26,467 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:18:26,467 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:18:26,467 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-0hqarogv 3537s 2024-11-23 21:18:26,467 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:18:26,469 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34201. Reason: failure-to-start- 3537s 2024-11-23 21:18:26,469 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:18:26,469 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35467. Reason: failure-to-start- 3537s 2024-11-23 21:18:26,470 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:18:26,472 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37687': TLS handshake failed with remote 'tls://127.0.0.1:33364': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:18:26,472 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37687': TLS handshake failed with remote 'tls://127.0.0.1:33374': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:18:26,473 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:18:27,479 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:18:27,487 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38437 3537s 2024-11-23 21:18:27,487 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46435/status 3537s 2024-11-23 21:18:27,488 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:18:27,503 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45909 3537s 2024-11-23 21:18:27,503 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45909 3537s 2024-11-23 21:18:27,503 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:18:27,503 - distributed.worker - INFO - dashboard at: 127.0.0.1:42877 3537s 2024-11-23 21:18:27,503 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38437 3537s 2024-11-23 21:18:27,503 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:18:27,503 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:18:27,503 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:18:27,503 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-0bnlepo5 3537s 2024-11-23 21:18:27,503 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:18:27,508 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45419 3537s 2024-11-23 21:18:27,508 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45419 3537s 2024-11-23 21:18:27,508 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:18:27,508 - distributed.worker - INFO - dashboard at: 127.0.0.1:34619 3537s 2024-11-23 21:18:27,508 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38437 3537s 2024-11-23 21:18:27,508 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:18:27,508 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:18:27,508 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:18:27,508 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-mq3_sfe0 3537s 2024-11-23 21:18:27,508 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:18:27,510 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45909. Reason: failure-to-start- 3537s 2024-11-23 21:18:27,510 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:18:27,511 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45419. Reason: failure-to-start- 3537s 2024-11-23 21:18:27,511 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:18:27,512 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38437': TLS handshake failed with remote 'tls://127.0.0.1:60192': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:18:27,512 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38437': TLS handshake failed with remote 'tls://127.0.0.1:60200': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:18:27,514 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:18:28,520 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:18:28,528 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44531 3537s 2024-11-23 21:18:28,528 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39545/status 3537s 2024-11-23 21:18:28,528 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:18:28,544 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38171 3537s 2024-11-23 21:18:28,544 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38171 3537s 2024-11-23 21:18:28,544 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:18:28,544 - distributed.worker - INFO - dashboard at: 127.0.0.1:46559 3537s 2024-11-23 21:18:28,544 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44531 3537s 2024-11-23 21:18:28,545 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:18:28,545 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:18:28,545 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:18:28,545 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-w4zvq8ok 3537s 2024-11-23 21:18:28,545 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:18:28,547 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35125 3537s 2024-11-23 21:18:28,547 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35125 3537s 2024-11-23 21:18:28,547 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:18:28,547 - distributed.worker - INFO - dashboard at: 127.0.0.1:46299 3537s 2024-11-23 21:18:28,547 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44531 3537s 2024-11-23 21:18:28,547 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:18:28,547 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:18:28,548 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:18:28,548 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-6xlrj5z1 3537s 2024-11-23 21:18:28,548 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:18:28,550 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38171. Reason: failure-to-start- 3537s 2024-11-23 21:18:28,550 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:18:28,551 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35125. Reason: failure-to-start- 3537s 2024-11-23 21:18:28,551 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:18:28,552 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44531': TLS handshake failed with remote 'tls://127.0.0.1:35578': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:18:28,553 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44531': TLS handshake failed with remote 'tls://127.0.0.1:35584': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:18:28,554 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:18:29,561 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:18:29,571 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40171 3537s 2024-11-23 21:18:29,572 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41325/status 3537s 2024-11-23 21:18:29,572 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:18:29,588 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41541 3537s 2024-11-23 21:18:29,589 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41541 3537s 2024-11-23 21:18:29,589 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:18:29,589 - distributed.worker - INFO - dashboard at: 127.0.0.1:43477 3537s 2024-11-23 21:18:29,589 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40171 3537s 2024-11-23 21:18:29,589 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:18:29,589 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:18:29,589 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:18:29,589 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-_1cg0vlj 3537s 2024-11-23 21:18:29,589 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:18:29,591 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46425 3537s 2024-11-23 21:18:29,592 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46425 3537s 2024-11-23 21:18:29,592 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:18:29,592 - distributed.worker - INFO - dashboard at: 127.0.0.1:33331 3537s 2024-11-23 21:18:29,592 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40171 3537s 2024-11-23 21:18:29,592 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:18:29,592 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:18:29,592 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:18:29,592 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-yn8bblxz 3537s 2024-11-23 21:18:29,592 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:18:29,594 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41541. Reason: failure-to-start- 3537s 2024-11-23 21:18:29,594 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:18:29,594 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46425. Reason: failure-to-start- 3537s 2024-11-23 21:18:29,594 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:18:29,596 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40171': TLS handshake failed with remote 'tls://127.0.0.1:41848': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:18:29,596 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40171': TLS handshake failed with remote 'tls://127.0.0.1:41856': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:18:29,600 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:18:30,608 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:18:30,615 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44231 3537s 2024-11-23 21:18:30,616 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:32787/status 3537s 2024-11-23 21:18:30,616 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:18:30,631 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35747 3537s 2024-11-23 21:18:30,632 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35747 3537s 2024-11-23 21:18:30,632 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:18:30,632 - distributed.worker - INFO - dashboard at: 127.0.0.1:36271 3537s 2024-11-23 21:18:30,632 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44231 3537s 2024-11-23 21:18:30,632 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:18:30,632 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:18:30,632 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:18:30,632 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-clkj_23v 3537s 2024-11-23 21:18:30,632 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:18:30,634 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45485 3537s 2024-11-23 21:18:30,635 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45485 3537s 2024-11-23 21:18:30,635 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:18:30,635 - distributed.worker - INFO - dashboard at: 127.0.0.1:41123 3537s 2024-11-23 21:18:30,635 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44231 3537s 2024-11-23 21:18:30,635 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:18:30,635 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:18:30,635 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:18:30,635 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-zruim3ss 3537s 2024-11-23 21:18:30,635 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:18:30,637 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35747. Reason: failure-to-start- 3537s 2024-11-23 21:18:30,637 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:18:30,637 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45485. Reason: failure-to-start- 3537s 2024-11-23 21:18:30,638 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:18:30,641 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44231': TLS handshake failed with remote 'tls://127.0.0.1:49030': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:18:30,641 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44231': TLS handshake failed with remote 'tls://127.0.0.1:49044': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:18:30,643 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:18:31,651 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:18:31,660 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42171 3537s 2024-11-23 21:18:31,661 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34135/status 3537s 2024-11-23 21:18:31,661 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:18:31,680 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42631 3537s 2024-11-23 21:18:31,680 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42631 3537s 2024-11-23 21:18:31,680 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:18:31,680 - distributed.worker - INFO - dashboard at: 127.0.0.1:41383 3537s 2024-11-23 21:18:31,680 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42171 3537s 2024-11-23 21:18:31,680 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:18:31,680 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:18:31,680 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:18:31,680 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-t9yqricl 3537s 2024-11-23 21:18:31,681 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:18:31,683 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36517 3537s 2024-11-23 21:18:31,683 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36517 3537s 2024-11-23 21:18:31,683 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:18:31,683 - distributed.worker - INFO - dashboard at: 127.0.0.1:33849 3537s 2024-11-23 21:18:31,683 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42171 3537s 2024-11-23 21:18:31,683 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:18:31,683 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:18:31,683 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:18:31,683 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-hhi8xtq_ 3537s 2024-11-23 21:18:31,683 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:18:31,687 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42631. Reason: failure-to-start- 3537s 2024-11-23 21:18:31,687 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:18:31,688 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36517. Reason: failure-to-start- 3537s 2024-11-23 21:18:31,688 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:18:31,692 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42171': TLS handshake failed with remote 'tls://127.0.0.1:45080': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:18:31,692 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42171': TLS handshake failed with remote 'tls://127.0.0.1:45088': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:18:31,693 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:18:32,699 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:18:32,708 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42033 3537s 2024-11-23 21:18:32,709 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35799/status 3537s 2024-11-23 21:18:32,709 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:18:32,730 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41667 3537s 2024-11-23 21:18:32,730 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41667 3537s 2024-11-23 21:18:32,730 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:18:32,730 - distributed.worker - INFO - dashboard at: 127.0.0.1:44715 3537s 2024-11-23 21:18:32,730 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42033 3537s 2024-11-23 21:18:32,730 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:18:32,730 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:18:32,730 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:18:32,731 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-6nfgs0z1 3537s 2024-11-23 21:18:32,731 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:18:32,733 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42161 3537s 2024-11-23 21:18:32,733 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42161 3537s 2024-11-23 21:18:32,733 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:18:32,733 - distributed.worker - INFO - dashboard at: 127.0.0.1:41835 3537s 2024-11-23 21:18:32,733 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42033 3537s 2024-11-23 21:18:32,733 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:18:32,734 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:18:32,734 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:18:32,734 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-2s2bg29l 3537s 2024-11-23 21:18:32,734 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:18:32,735 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41667. Reason: failure-to-start- 3537s 2024-11-23 21:18:32,736 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:18:32,736 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42161. Reason: failure-to-start- 3537s 2024-11-23 21:18:32,736 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:18:32,738 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42033': TLS handshake failed with remote 'tls://127.0.0.1:34572': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:18:32,738 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42033': TLS handshake failed with remote 'tls://127.0.0.1:34584': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:18:32,742 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:18:33,747 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:18:33,755 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44475 3537s 2024-11-23 21:18:33,755 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37775/status 3537s 2024-11-23 21:18:33,755 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:18:33,771 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40437 3537s 2024-11-23 21:18:33,771 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40437 3537s 2024-11-23 21:18:33,771 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:18:33,771 - distributed.worker - INFO - dashboard at: 127.0.0.1:36735 3537s 2024-11-23 21:18:33,771 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44475 3537s 2024-11-23 21:18:33,771 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:18:33,771 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:18:33,771 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:18:33,771 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-6u5hti0v 3537s 2024-11-23 21:18:33,771 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:18:33,773 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46217 3537s 2024-11-23 21:18:33,774 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46217 3537s 2024-11-23 21:18:33,774 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:18:33,774 - distributed.worker - INFO - dashboard at: 127.0.0.1:33495 3537s 2024-11-23 21:18:33,775 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44475 3537s 2024-11-23 21:18:33,775 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:18:33,775 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:18:33,775 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:18:33,776 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ngbmmfyu 3537s 2024-11-23 21:18:33,776 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:18:33,777 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40437. Reason: failure-to-start- 3537s 2024-11-23 21:18:33,777 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:18:33,778 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46217. Reason: failure-to-start- 3537s 2024-11-23 21:18:33,778 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:18:33,780 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44475': TLS handshake failed with remote 'tls://127.0.0.1:43706': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:18:33,781 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44475': TLS handshake failed with remote 'tls://127.0.0.1:43720': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:18:33,785 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:18:34,790 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:18:34,798 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36993 3537s 2024-11-23 21:18:34,799 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35095/status 3537s 2024-11-23 21:18:34,799 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:18:34,814 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38845 3537s 2024-11-23 21:18:34,815 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38845 3537s 2024-11-23 21:18:34,815 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:18:34,815 - distributed.worker - INFO - dashboard at: 127.0.0.1:43807 3537s 2024-11-23 21:18:34,815 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36993 3537s 2024-11-23 21:18:34,815 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:18:34,815 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:18:34,815 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:18:34,815 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-klar3lgc 3537s 2024-11-23 21:18:34,815 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:18:34,817 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39467 3537s 2024-11-23 21:18:34,818 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39467 3537s 2024-11-23 21:18:34,818 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:18:34,818 - distributed.worker - INFO - dashboard at: 127.0.0.1:35837 3537s 2024-11-23 21:18:34,818 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36993 3537s 2024-11-23 21:18:34,818 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:18:34,818 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:18:34,818 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:18:34,818 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-c0wp4305 3537s 2024-11-23 21:18:34,818 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:18:34,821 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38845. Reason: failure-to-start- 3537s 2024-11-23 21:18:34,821 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:18:34,821 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39467. Reason: failure-to-start- 3537s 2024-11-23 21:18:34,822 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:18:34,825 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36993': TLS handshake failed with remote 'tls://127.0.0.1:35258': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:18:34,826 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36993': TLS handshake failed with remote 'tls://127.0.0.1:35274': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:18:34,827 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:18:35,834 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:18:35,843 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37521 3537s 2024-11-23 21:18:35,843 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44429/status 3537s 2024-11-23 21:18:35,844 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:18:35,860 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35275 3537s 2024-11-23 21:18:35,861 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35275 3537s 2024-11-23 21:18:35,861 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:18:35,861 - distributed.worker - INFO - dashboard at: 127.0.0.1:40923 3537s 2024-11-23 21:18:35,861 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 3537s 2024-11-23 21:18:35,861 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:18:35,861 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:18:35,861 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:18:35,861 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-rmycrpti 3537s 2024-11-23 21:18:35,861 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:18:35,863 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41881 3537s 2024-11-23 21:18:35,863 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41881 3537s 2024-11-23 21:18:35,864 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:18:35,864 - distributed.worker - INFO - dashboard at: 127.0.0.1:41003 3537s 2024-11-23 21:18:35,864 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37521 3537s 2024-11-23 21:18:35,864 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:18:35,864 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:18:35,864 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:18:35,864 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-wm1lknp5 3537s 2024-11-23 21:18:35,864 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:18:35,868 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35275. Reason: failure-to-start- 3537s 2024-11-23 21:18:35,868 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:18:35,869 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41881. Reason: failure-to-start- 3537s 2024-11-23 21:18:35,869 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:18:35,871 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:56922': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:18:35,871 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37521': TLS handshake failed with remote 'tls://127.0.0.1:56924': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:18:35,875 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:18:36,901 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:18:36,910 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34049 3537s 2024-11-23 21:18:36,911 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41993/status 3537s 2024-11-23 21:18:36,911 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:18:36,931 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38259 3537s 2024-11-23 21:18:36,931 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38259 3537s 2024-11-23 21:18:36,931 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:18:36,931 - distributed.worker - INFO - dashboard at: 127.0.0.1:35109 3537s 2024-11-23 21:18:36,931 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34049 3537s 2024-11-23 21:18:36,932 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:18:36,932 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:18:36,932 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:18:36,932 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-nhg5upg6 3537s 2024-11-23 21:18:36,932 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:18:36,934 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35603 3537s 2024-11-23 21:18:36,934 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35603 3537s 2024-11-23 21:18:36,934 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:18:36,934 - distributed.worker - INFO - dashboard at: 127.0.0.1:38195 3537s 2024-11-23 21:18:36,935 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34049 3537s 2024-11-23 21:18:36,935 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:18:36,935 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:18:36,935 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:18:36,935 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-_acwfhzr 3537s 2024-11-23 21:18:36,935 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:18:36,936 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38259. Reason: failure-to-start- 3537s 2024-11-23 21:18:36,937 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:18:36,937 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35603. Reason: failure-to-start- 3537s 2024-11-23 21:18:36,937 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:18:36,941 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34049': TLS handshake failed with remote 'tls://127.0.0.1:56882': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:18:36,942 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34049': TLS handshake failed with remote 'tls://127.0.0.1:56890': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:18:36,943 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:18:37,954 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:18:37,967 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39943 3537s 2024-11-23 21:18:37,968 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39923/status 3537s 2024-11-23 21:18:37,969 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:18:38,000 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39357 3537s 2024-11-23 21:18:38,001 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39357 3537s 2024-11-23 21:18:38,001 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:18:38,001 - distributed.worker - INFO - dashboard at: 127.0.0.1:44139 3537s 2024-11-23 21:18:38,001 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39943 3537s 2024-11-23 21:18:38,001 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:18:38,001 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:18:38,001 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:18:38,001 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-cn1klog5 3537s 2024-11-23 21:18:38,001 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:18:38,004 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35115 3537s 2024-11-23 21:18:38,005 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35115 3537s 2024-11-23 21:18:38,005 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:18:38,005 - distributed.worker - INFO - dashboard at: 127.0.0.1:44595 3537s 2024-11-23 21:18:38,005 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39943 3537s 2024-11-23 21:18:38,005 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:18:38,005 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:18:38,005 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:18:38,005 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-wqhubp8c 3537s 2024-11-23 21:18:38,005 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:18:38,014 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39357. Reason: failure-to-start- 3537s 2024-11-23 21:18:38,014 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:18:38,015 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35115. Reason: failure-to-start- 3537s 2024-11-23 21:18:38,015 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:18:38,018 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39943': TLS handshake failed with remote 'tls://127.0.0.1:48522': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:18:38,018 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39943': TLS handshake failed with remote 'tls://127.0.0.1:48538': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:18:38,024 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s __________________________________ test_nanny __________________________________ 3537s 3537s fut = , timeout = 0 3537s 3537s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 3537s async with asyncio.timeout(timeout): 3537s > return await fut 3537s 3537s /usr/lib/python3/dist-packages/distributed/utils.py:1960: 3537s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3537s /usr/lib/python3/dist-packages/distributed/nanny.py:358: in start_unsafe 3537s comm = await self.rpc.connect(saddr) 3537s /usr/lib/python3/dist-packages/distributed/core.py:1620: in connect 3537s return await self._connect(addr=addr, timeout=timeout) 3537s /usr/lib/python3/dist-packages/distributed/core.py:1564: in _connect 3537s comm = await connect( 3537s /usr/lib/python3/dist-packages/distributed/comm/core.py:342: in connect 3537s comm = await wait_for( 3537s /usr/lib/python3/dist-packages/distributed/utils.py:1960: in wait_for 3537s return await fut 3537s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:546: in connect 3537s stream = await self.client.connect( 3537s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3537s 3537s self = , host = '127.0.0.1' 3537s port = 42355, af = 3537s ssl_options = 3537s max_buffer_size = 8364507136.0, source_ip = None, source_port = None 3537s timeout = None 3537s 3537s async def connect( 3537s self, 3537s host: str, 3537s port: int, 3537s af: socket.AddressFamily = socket.AF_UNSPEC, 3537s ssl_options: Optional[Union[Dict[str, Any], ssl.SSLContext]] = None, 3537s max_buffer_size: Optional[int] = None, 3537s source_ip: Optional[str] = None, 3537s source_port: Optional[int] = None, 3537s timeout: Optional[Union[float, datetime.timedelta]] = None, 3537s ) -> IOStream: 3537s """Connect to the given host and port. 3537s 3537s Asynchronously returns an `.IOStream` (or `.SSLIOStream` if 3537s ``ssl_options`` is not None). 3537s 3537s Using the ``source_ip`` kwarg, one can specify the source 3537s IP address to use when establishing the connection. 3537s In case the user needs to resolve and 3537s use a specific interface, it has to be handled outside 3537s of Tornado as this depends very much on the platform. 3537s 3537s Raises `TimeoutError` if the input future does not complete before 3537s ``timeout``, which may be specified in any form allowed by 3537s `.IOLoop.add_timeout` (i.e. a `datetime.timedelta` or an absolute time 3537s relative to `.IOLoop.time`) 3537s 3537s Similarly, when the user requires a certain source port, it can 3537s be specified using the ``source_port`` arg. 3537s 3537s .. versionchanged:: 4.5 3537s Added the ``source_ip`` and ``source_port`` arguments. 3537s 3537s .. versionchanged:: 5.0 3537s Added the ``timeout`` argument. 3537s """ 3537s if timeout is not None: 3537s if isinstance(timeout, numbers.Real): 3537s timeout = IOLoop.current().time() + timeout 3537s elif isinstance(timeout, datetime.timedelta): 3537s timeout = IOLoop.current().time() + timeout.total_seconds() 3537s else: 3537s raise TypeError("Unsupported timeout %r" % timeout) 3537s if timeout is not None: 3537s addrinfo = await gen.with_timeout( 3537s timeout, self.resolver.resolve(host, port, af) 3537s ) 3537s else: 3537s addrinfo = await self.resolver.resolve(host, port, af) 3537s connector = _Connector( 3537s addrinfo, 3537s functools.partial( 3537s self._create_stream, 3537s max_buffer_size, 3537s source_ip=source_ip, 3537s source_port=source_port, 3537s ), 3537s ) 3537s > af, addr, stream = await connector.start(connect_timeout=timeout) 3537s E asyncio.exceptions.CancelledError 3537s 3537s /usr/lib/python3/dist-packages/tornado/tcpclient.py:279: CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s self = 3537s 3537s @final 3537s async def start(self): 3537s async with self._startup_lock: 3537s if self.status == Status.failed: 3537s assert self.__startup_exc is not None 3537s raise self.__startup_exc 3537s elif self.status != Status.init: 3537s return self 3537s timeout = getattr(self, "death_timeout", None) 3537s 3537s async def _close_on_failure(exc: Exception) -> None: 3537s await self.close(reason=f"failure-to-start-{str(type(exc))}") 3537s self.status = Status.failed 3537s self.__startup_exc = exc 3537s 3537s try: 3537s > await wait_for(self.start_unsafe(), timeout=timeout) 3537s 3537s /usr/lib/python3/dist-packages/distributed/core.py:664: 3537s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3537s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 3537s async with asyncio.timeout(timeout): 3537s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3537s 3537s self = 3537s exc_type = 3537s exc_val = CancelledError(), exc_tb = 3537s 3537s async def __aexit__( 3537s self, 3537s exc_type: Optional[Type[BaseException]], 3537s exc_val: Optional[BaseException], 3537s exc_tb: Optional[TracebackType], 3537s ) -> Optional[bool]: 3537s assert self._state in (_State.ENTERED, _State.EXPIRING) 3537s 3537s if self._timeout_handler is not None: 3537s self._timeout_handler.cancel() 3537s self._timeout_handler = None 3537s 3537s if self._state is _State.EXPIRING: 3537s self._state = _State.EXPIRED 3537s 3537s if self._task.uncancel() <= self._cancelling and exc_type is not None: 3537s # Since there are no new cancel requests, we're 3537s # handling this. 3537s if issubclass(exc_type, exceptions.CancelledError): 3537s > raise TimeoutError from exc_val 3537s E TimeoutError 3537s 3537s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s @contextlib.asynccontextmanager 3537s async def _cluster_factory(): 3537s workers = [] 3537s s = None 3537s try: 3537s for _ in range(60): 3537s try: 3537s > s, ws = await start_cluster( 3537s nthreads, 3537s scheduler, 3537s security=security, 3537s Worker=Worker, 3537s scheduler_kwargs=scheduler_kwargs, 3537s worker_kwargs=merge( 3537s {"death_timeout": min(15, int(deadline.remaining))}, 3537s worker_kwargs, 3537s ), 3537s ) 3537s 3537s /usr/lib/python3/dist-packages/distributed/utils_test.py:966: 3537s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3537s /usr/lib/python3/dist-packages/distributed/utils_test.py:789: in start_cluster 3537s await asyncio.gather(*workers) 3537s /usr/lib/python3.13/asyncio/tasks.py:737: in _wrap_awaitable 3537s return await awaitable 3537s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3537s 3537s self = 3537s 3537s @final 3537s async def start(self): 3537s async with self._startup_lock: 3537s if self.status == Status.failed: 3537s assert self.__startup_exc is not None 3537s raise self.__startup_exc 3537s elif self.status != Status.init: 3537s return self 3537s timeout = getattr(self, "death_timeout", None) 3537s 3537s async def _close_on_failure(exc: Exception) -> None: 3537s await self.close(reason=f"failure-to-start-{str(type(exc))}") 3537s self.status = Status.failed 3537s self.__startup_exc = exc 3537s 3537s try: 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s except asyncio.TimeoutError as exc: 3537s await _close_on_failure(exc) 3537s > raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s E TimeoutError: Nanny start timed out after 0s. 3537s 3537s /usr/lib/python3/dist-packages/distributed/core.py:667: TimeoutError 3537s 3537s During handling of the above exception, another exception occurred: 3537s 3537s fut = ._..test_func..async_fn at 0xe247c4b0> 3537s timeout = 60 3537s 3537s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 3537s async with asyncio.timeout(timeout): 3537s > return await fut 3537s 3537s /usr/lib/python3/dist-packages/distributed/utils.py:1960: 3537s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3537s /usr/lib/python3/dist-packages/distributed/utils_test.py:999: in async_fn 3537s _cluster_factory() as (s, workers), 3537s /usr/lib/python3.13/contextlib.py:214: in __aenter__ 3537s return await anext(self.gen) 3537s /usr/lib/python3/dist-packages/distributed/utils_test.py:983: in _cluster_factory 3537s await asyncio.sleep(1) 3537s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3537s 3537s delay = 1, result = None 3537s 3537s async def sleep(delay, result=None): 3537s """Coroutine that completes after a given time (in seconds).""" 3537s if delay <= 0: 3537s await __sleep0() 3537s return result 3537s 3537s if math.isnan(delay): 3537s raise ValueError("Invalid delay: NaN (not a number)") 3537s 3537s loop = events.get_running_loop() 3537s future = loop.create_future() 3537s h = loop.call_later(delay, 3537s futures._set_result_unless_cancelled, 3537s future, result) 3537s try: 3537s > return await future 3537s E asyncio.exceptions.CancelledError 3537s 3537s /usr/lib/python3.13/asyncio/tasks.py:718: CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s args = (), kwds = {} 3537s 3537s @wraps(func) 3537s def inner(*args, **kwds): 3537s with self._recreate_cm(): 3537s > return func(*args, **kwds) 3537s 3537s /usr/lib/python3.13/contextlib.py:85: 3537s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3537s /usr/lib/python3.13/contextlib.py:85: in inner 3537s return func(*args, **kwds) 3537s /usr/lib/python3/dist-packages/distributed/utils_test.py:1102: in test_func 3537s return _run_and_close_tornado(async_fn_outer) 3537s /usr/lib/python3/dist-packages/distributed/utils_test.py:378: in _run_and_close_tornado 3537s return asyncio_run(inner_fn(), loop_factory=get_loop_factory()) 3537s /usr/lib/python3.13/asyncio/runners.py:194: in run 3537s return runner.run(main) 3537s /usr/lib/python3.13/asyncio/runners.py:118: in run 3537s return self._loop.run_until_complete(task) 3537s /usr/lib/python3.13/asyncio/base_events.py:720: in run_until_complete 3537s return future.result() 3537s /usr/lib/python3/dist-packages/distributed/utils_test.py:375: in inner_fn 3537s return await async_fn(*args, **kwargs) 3537s /usr/lib/python3/dist-packages/distributed/utils_test.py:1099: in async_fn_outer 3537s return await utils_wait_for(async_fn(), timeout=timeout * 2) 3537s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 3537s async with asyncio.timeout(timeout): 3537s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3537s 3537s self = 3537s exc_type = 3537s exc_val = CancelledError(), exc_tb = 3537s 3537s async def __aexit__( 3537s self, 3537s exc_type: Optional[Type[BaseException]], 3537s exc_val: Optional[BaseException], 3537s exc_tb: Optional[TracebackType], 3537s ) -> Optional[bool]: 3537s assert self._state in (_State.ENTERED, _State.EXPIRING) 3537s 3537s if self._timeout_handler is not None: 3537s self._timeout_handler.cancel() 3537s self._timeout_handler = None 3537s 3537s if self._state is _State.EXPIRING: 3537s self._state = _State.EXPIRED 3537s 3537s if self._task.uncancel() <= self._cancelling and exc_type is not None: 3537s # Since there are no new cancel requests, we're 3537s # handling this. 3537s if issubclass(exc_type, exceptions.CancelledError): 3537s > raise TimeoutError from exc_val 3537s E TimeoutError 3537s 3537s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 3537s ----------------------------- Captured stderr call ----------------------------- 3537s 2024-11-23 21:18:39,201 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:18:39,209 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43843 3537s 2024-11-23 21:18:39,210 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41771/status 3537s 2024-11-23 21:18:39,210 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:18:39,236 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:38979'. Reason: failure-to-start- 3537s 2024-11-23 21:18:39,236 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:35947'. Reason: failure-to-start- 3537s 2024-11-23 21:18:39,237 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43843': TLS handshake failed with remote 'tls://127.0.0.1:39972': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:39,237 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43843': TLS handshake failed with remote 'tls://127.0.0.1:39986': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:39,237 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 3537s stream = await stream.start_tls( 3537s ^^^^^^^^^^^^^^^^^^^^^^^ 3537s False, ssl_options=ssl_options, server_hostname=host 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 3537s self.socket.do_handshake() 3537s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 3537s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 3537s self._sslobj.do_handshake() 3537s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 3537s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3537s comm = await self.rpc.connect(saddr) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 3537s return await self._connect(addr=addr, timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 3537s comm = await connect( 3537s ^^^^^^^^^^^^^^ 3537s ...<4 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 3537s raise FatalCommClosedError( 3537s ...<2 lines>... 3537s ) from err 3537s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 3537s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 3537s RuntimeError: Nanny failed to start. 3537s 2024-11-23 21:18:40,243 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:18:40,251 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44401 3537s 2024-11-23 21:18:40,251 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34809/status 3537s 2024-11-23 21:18:40,251 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:18:40,280 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:40415'. Reason: failure-to-start- 3537s 2024-11-23 21:18:40,281 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:39443'. Reason: failure-to-start- 3537s 2024-11-23 21:18:40,281 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44401': TLS handshake failed with remote 'tls://127.0.0.1:47344': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:40,281 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44401': TLS handshake failed with remote 'tls://127.0.0.1:47350': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:40,282 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 3537s stream = await stream.start_tls( 3537s ^^^^^^^^^^^^^^^^^^^^^^^ 3537s False, ssl_options=ssl_options, server_hostname=host 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 3537s self.socket.do_handshake() 3537s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 3537s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 3537s self._sslobj.do_handshake() 3537s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 3537s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3537s comm = await self.rpc.connect(saddr) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 3537s return await self._connect(addr=addr, timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 3537s comm = await connect( 3537s ^^^^^^^^^^^^^^ 3537s ...<4 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 3537s raise FatalCommClosedError( 3537s ...<2 lines>... 3537s ) from err 3537s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 3537s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 3537s RuntimeError: Nanny failed to start. 3537s 2024-11-23 21:18:41,288 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:18:41,295 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44433 3537s 2024-11-23 21:18:41,296 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:32923/status 3537s 2024-11-23 21:18:41,296 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:18:41,331 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:43845'. Reason: failure-to-start- 3537s 2024-11-23 21:18:41,332 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:42629'. Reason: failure-to-start- 3537s 2024-11-23 21:18:41,333 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44433': TLS handshake failed with remote 'tls://127.0.0.1:33290': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:41,333 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44433': TLS handshake failed with remote 'tls://127.0.0.1:33296': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:41,333 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 3537s stream = await stream.start_tls( 3537s ^^^^^^^^^^^^^^^^^^^^^^^ 3537s False, ssl_options=ssl_options, server_hostname=host 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 3537s self.socket.do_handshake() 3537s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 3537s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 3537s self._sslobj.do_handshake() 3537s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 3537s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3537s comm = await self.rpc.connect(saddr) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 3537s return await self._connect(addr=addr, timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 3537s comm = await connect( 3537s ^^^^^^^^^^^^^^ 3537s ...<4 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 3537s raise FatalCommClosedError( 3537s ...<2 lines>... 3537s ) from err 3537s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 3537s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 3537s RuntimeError: Nanny failed to start. 3537s 2024-11-23 21:18:42,339 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:18:42,347 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36431 3537s 2024-11-23 21:18:42,348 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40489/status 3537s 2024-11-23 21:18:42,348 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:18:42,376 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:36307'. Reason: failure-to-start- 3537s 2024-11-23 21:18:42,376 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:45325'. Reason: failure-to-start- 3537s 2024-11-23 21:18:42,377 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36431': TLS handshake failed with remote 'tls://127.0.0.1:51900': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:42,377 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36431': TLS handshake failed with remote 'tls://127.0.0.1:51910': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:42,377 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 3537s stream = await stream.start_tls( 3537s ^^^^^^^^^^^^^^^^^^^^^^^ 3537s False, ssl_options=ssl_options, server_hostname=host 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 3537s self.socket.do_handshake() 3537s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 3537s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 3537s self._sslobj.do_handshake() 3537s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 3537s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3537s comm = await self.rpc.connect(saddr) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 3537s return await self._connect(addr=addr, timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 3537s comm = await connect( 3537s ^^^^^^^^^^^^^^ 3537s ...<4 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 3537s raise FatalCommClosedError( 3537s ...<2 lines>... 3537s ) from err 3537s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 3537s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 3537s RuntimeError: Nanny failed to start. 3537s 2024-11-23 21:18:43,383 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:18:43,391 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45463 3537s 2024-11-23 21:18:43,391 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34451/status 3537s 2024-11-23 21:18:43,392 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:18:43,417 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:41565'. Reason: failure-to-start- 3537s 2024-11-23 21:18:43,417 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:34663'. Reason: failure-to-start- 3537s 2024-11-23 21:18:43,418 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45463': TLS handshake failed with remote 'tls://127.0.0.1:43306': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:43,418 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45463': TLS handshake failed with remote 'tls://127.0.0.1:43316': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:43,418 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 3537s stream = await stream.start_tls( 3537s ^^^^^^^^^^^^^^^^^^^^^^^ 3537s False, ssl_options=ssl_options, server_hostname=host 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 3537s self.socket.do_handshake() 3537s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 3537s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 3537s self._sslobj.do_handshake() 3537s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 3537s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3537s comm = await self.rpc.connect(saddr) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 3537s return await self._connect(addr=addr, timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 3537s comm = await connect( 3537s ^^^^^^^^^^^^^^ 3537s ...<4 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 3537s raise FatalCommClosedError( 3537s ...<2 lines>... 3537s ) from err 3537s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 3537s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 3537s RuntimeError: Nanny failed to start. 3537s 2024-11-23 21:18:44,424 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:18:44,432 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42629 3537s 2024-11-23 21:18:44,433 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33185/status 3537s 2024-11-23 21:18:44,433 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:18:44,459 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:39061'. Reason: failure-to-start- 3537s 2024-11-23 21:18:44,459 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:35649'. Reason: failure-to-start- 3537s 2024-11-23 21:18:44,460 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42629': TLS handshake failed with remote 'tls://127.0.0.1:39112': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:44,460 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42629': TLS handshake failed with remote 'tls://127.0.0.1:39120': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:44,460 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 3537s stream = await stream.start_tls( 3537s ^^^^^^^^^^^^^^^^^^^^^^^ 3537s False, ssl_options=ssl_options, server_hostname=host 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 3537s self.socket.do_handshake() 3537s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 3537s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 3537s self._sslobj.do_handshake() 3537s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 3537s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3537s comm = await self.rpc.connect(saddr) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 3537s return await self._connect(addr=addr, timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 3537s comm = await connect( 3537s ^^^^^^^^^^^^^^ 3537s ...<4 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 3537s raise FatalCommClosedError( 3537s ...<2 lines>... 3537s ) from err 3537s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 3537s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 3537s RuntimeError: Nanny failed to start. 3537s 2024-11-23 21:18:45,466 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:18:45,475 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33365 3537s 2024-11-23 21:18:45,475 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41071/status 3537s 2024-11-23 21:18:45,475 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:18:45,500 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:41295'. Reason: failure-to-start- 3537s 2024-11-23 21:18:45,501 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:35271'. Reason: failure-to-start- 3537s 2024-11-23 21:18:45,502 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33365': TLS handshake failed with remote 'tls://127.0.0.1:34456': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:45,502 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33365': TLS handshake failed with remote 'tls://127.0.0.1:34468': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:45,502 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 3537s stream = await stream.start_tls( 3537s ^^^^^^^^^^^^^^^^^^^^^^^ 3537s False, ssl_options=ssl_options, server_hostname=host 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 3537s self.socket.do_handshake() 3537s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 3537s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 3537s self._sslobj.do_handshake() 3537s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 3537s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3537s comm = await self.rpc.connect(saddr) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 3537s return await self._connect(addr=addr, timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 3537s comm = await connect( 3537s ^^^^^^^^^^^^^^ 3537s ...<4 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 3537s raise FatalCommClosedError( 3537s ...<2 lines>... 3537s ) from err 3537s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 3537s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 3537s RuntimeError: Nanny failed to start. 3537s 2024-11-23 21:18:46,508 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:18:46,517 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39675 3537s 2024-11-23 21:18:46,517 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39933/status 3537s 2024-11-23 21:18:46,518 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:18:46,546 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:37897'. Reason: failure-to-start- 3537s 2024-11-23 21:18:46,546 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:42843'. Reason: failure-to-start- 3537s 2024-11-23 21:18:46,547 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39675': TLS handshake failed with remote 'tls://127.0.0.1:51954': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:46,547 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39675': TLS handshake failed with remote 'tls://127.0.0.1:51968': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:46,547 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 3537s stream = await stream.start_tls( 3537s ^^^^^^^^^^^^^^^^^^^^^^^ 3537s False, ssl_options=ssl_options, server_hostname=host 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 3537s self.socket.do_handshake() 3537s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 3537s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 3537s self._sslobj.do_handshake() 3537s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 3537s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3537s comm = await self.rpc.connect(saddr) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 3537s return await self._connect(addr=addr, timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 3537s comm = await connect( 3537s ^^^^^^^^^^^^^^ 3537s ...<4 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 3537s raise FatalCommClosedError( 3537s ...<2 lines>... 3537s ) from err 3537s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 3537s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 3537s RuntimeError: Nanny failed to start. 3537s 2024-11-23 21:18:47,554 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:18:47,562 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35425 3537s 2024-11-23 21:18:47,563 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46639/status 3537s 2024-11-23 21:18:47,563 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:18:47,589 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:36885'. Reason: failure-to-start- 3537s 2024-11-23 21:18:47,590 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:42409'. Reason: failure-to-start- 3537s 2024-11-23 21:18:47,590 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35425': TLS handshake failed with remote 'tls://127.0.0.1:35618': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:47,590 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35425': TLS handshake failed with remote 'tls://127.0.0.1:35628': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:47,590 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 3537s stream = await stream.start_tls( 3537s ^^^^^^^^^^^^^^^^^^^^^^^ 3537s False, ssl_options=ssl_options, server_hostname=host 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 3537s self.socket.do_handshake() 3537s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 3537s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 3537s self._sslobj.do_handshake() 3537s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 3537s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3537s comm = await self.rpc.connect(saddr) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 3537s return await self._connect(addr=addr, timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 3537s comm = await connect( 3537s ^^^^^^^^^^^^^^ 3537s ...<4 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 3537s raise FatalCommClosedError( 3537s ...<2 lines>... 3537s ) from err 3537s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 3537s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 3537s RuntimeError: Nanny failed to start. 3537s 2024-11-23 21:18:48,597 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:18:48,606 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38485 3537s 2024-11-23 21:18:48,606 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42155/status 3537s 2024-11-23 21:18:48,606 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:18:48,633 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:45367'. Reason: failure-to-start- 3537s 2024-11-23 21:18:48,634 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:43425'. Reason: failure-to-start- 3537s 2024-11-23 21:18:48,634 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38485': TLS handshake failed with remote 'tls://127.0.0.1:47124': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:48,634 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38485': TLS handshake failed with remote 'tls://127.0.0.1:47140': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:48,634 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 3537s stream = await stream.start_tls( 3537s ^^^^^^^^^^^^^^^^^^^^^^^ 3537s False, ssl_options=ssl_options, server_hostname=host 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 3537s self.socket.do_handshake() 3537s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 3537s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 3537s self._sslobj.do_handshake() 3537s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 3537s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3537s comm = await self.rpc.connect(saddr) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 3537s return await self._connect(addr=addr, timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 3537s comm = await connect( 3537s ^^^^^^^^^^^^^^ 3537s ...<4 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 3537s raise FatalCommClosedError( 3537s ...<2 lines>... 3537s ) from err 3537s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 3537s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 3537s RuntimeError: Nanny failed to start. 3537s 2024-11-23 21:18:49,641 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:18:49,650 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33003 3537s 2024-11-23 21:18:49,650 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42531/status 3537s 2024-11-23 21:18:49,650 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:18:49,676 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:34753'. Reason: failure-to-start- 3537s 2024-11-23 21:18:49,676 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:35497'. Reason: failure-to-start- 3537s 2024-11-23 21:18:49,677 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33003': TLS handshake failed with remote 'tls://127.0.0.1:49912': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:49,677 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33003': TLS handshake failed with remote 'tls://127.0.0.1:49926': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:49,677 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 3537s stream = await stream.start_tls( 3537s ^^^^^^^^^^^^^^^^^^^^^^^ 3537s False, ssl_options=ssl_options, server_hostname=host 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 3537s self.socket.do_handshake() 3537s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 3537s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 3537s self._sslobj.do_handshake() 3537s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 3537s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3537s comm = await self.rpc.connect(saddr) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 3537s return await self._connect(addr=addr, timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 3537s comm = await connect( 3537s ^^^^^^^^^^^^^^ 3537s ...<4 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 3537s raise FatalCommClosedError( 3537s ...<2 lines>... 3537s ) from err 3537s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 3537s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 3537s RuntimeError: Nanny failed to start. 3537s 2024-11-23 21:18:50,683 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:18:50,692 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39165 3537s 2024-11-23 21:18:50,693 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36357/status 3537s 2024-11-23 21:18:50,693 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:18:50,720 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:40447'. Reason: failure-to-start- 3537s 2024-11-23 21:18:50,721 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:38551'. Reason: failure-to-start- 3537s 2024-11-23 21:18:50,723 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39165': TLS handshake failed with remote 'tls://127.0.0.1:59610': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:50,724 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39165': TLS handshake failed with remote 'tls://127.0.0.1:59618': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:50,724 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 3537s stream = await stream.start_tls( 3537s ^^^^^^^^^^^^^^^^^^^^^^^ 3537s False, ssl_options=ssl_options, server_hostname=host 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 3537s self.socket.do_handshake() 3537s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 3537s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 3537s self._sslobj.do_handshake() 3537s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 3537s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3537s comm = await self.rpc.connect(saddr) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 3537s return await self._connect(addr=addr, timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 3537s comm = await connect( 3537s ^^^^^^^^^^^^^^ 3537s ...<4 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 3537s raise FatalCommClosedError( 3537s ...<2 lines>... 3537s ) from err 3537s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 3537s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 3537s RuntimeError: Nanny failed to start. 3537s 2024-11-23 21:18:51,730 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:18:51,739 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39909 3537s 2024-11-23 21:18:51,739 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42665/status 3537s 2024-11-23 21:18:51,739 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:18:51,767 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:36051'. Reason: failure-to-start- 3537s 2024-11-23 21:18:51,767 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:36445'. Reason: failure-to-start- 3537s 2024-11-23 21:18:51,768 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39909': TLS handshake failed with remote 'tls://127.0.0.1:53878': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:51,768 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39909': TLS handshake failed with remote 'tls://127.0.0.1:53888': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:51,768 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 3537s stream = await stream.start_tls( 3537s ^^^^^^^^^^^^^^^^^^^^^^^ 3537s False, ssl_options=ssl_options, server_hostname=host 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 3537s self.socket.do_handshake() 3537s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 3537s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 3537s self._sslobj.do_handshake() 3537s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 3537s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3537s comm = await self.rpc.connect(saddr) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 3537s return await self._connect(addr=addr, timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 3537s comm = await connect( 3537s ^^^^^^^^^^^^^^ 3537s ...<4 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 3537s raise FatalCommClosedError( 3537s ...<2 lines>... 3537s ) from err 3537s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 3537s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 3537s RuntimeError: Nanny failed to start. 3537s 2024-11-23 21:18:52,775 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:18:52,784 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44107 3537s 2024-11-23 21:18:52,784 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45493/status 3537s 2024-11-23 21:18:52,785 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:18:52,814 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:37999'. Reason: failure-to-start- 3537s 2024-11-23 21:18:52,814 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:45361'. Reason: failure-to-start- 3537s 2024-11-23 21:18:52,815 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44107': TLS handshake failed with remote 'tls://127.0.0.1:54596': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:52,815 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44107': TLS handshake failed with remote 'tls://127.0.0.1:54608': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:52,815 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 3537s stream = await stream.start_tls( 3537s ^^^^^^^^^^^^^^^^^^^^^^^ 3537s False, ssl_options=ssl_options, server_hostname=host 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 3537s self.socket.do_handshake() 3537s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 3537s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 3537s self._sslobj.do_handshake() 3537s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 3537s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3537s comm = await self.rpc.connect(saddr) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 3537s return await self._connect(addr=addr, timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 3537s comm = await connect( 3537s ^^^^^^^^^^^^^^ 3537s ...<4 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 3537s raise FatalCommClosedError( 3537s ...<2 lines>... 3537s ) from err 3537s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 3537s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 3537s RuntimeError: Nanny failed to start. 3537s 2024-11-23 21:18:53,821 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:18:53,829 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44539 3537s 2024-11-23 21:18:53,830 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41565/status 3537s 2024-11-23 21:18:53,830 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:18:53,856 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:34275'. Reason: failure-to-start- 3537s 2024-11-23 21:18:53,856 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:38423'. Reason: failure-to-start- 3537s 2024-11-23 21:18:53,859 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44539': TLS handshake failed with remote 'tls://127.0.0.1:39742': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:53,860 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44539': TLS handshake failed with remote 'tls://127.0.0.1:39744': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:53,860 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 3537s stream = await stream.start_tls( 3537s ^^^^^^^^^^^^^^^^^^^^^^^ 3537s False, ssl_options=ssl_options, server_hostname=host 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 3537s self.socket.do_handshake() 3537s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 3537s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 3537s self._sslobj.do_handshake() 3537s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 3537s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3537s comm = await self.rpc.connect(saddr) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 3537s return await self._connect(addr=addr, timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 3537s comm = await connect( 3537s ^^^^^^^^^^^^^^ 3537s ...<4 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 3537s raise FatalCommClosedError( 3537s ...<2 lines>... 3537s ) from err 3537s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 3537s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 3537s RuntimeError: Nanny failed to start. 3537s 2024-11-23 21:18:54,866 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:18:54,874 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35795 3537s 2024-11-23 21:18:54,874 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34031/status 3537s 2024-11-23 21:18:54,875 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:18:54,902 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:39753'. Reason: failure-to-start- 3537s 2024-11-23 21:18:54,902 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:38155'. Reason: failure-to-start- 3537s 2024-11-23 21:18:54,905 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35795': TLS handshake failed with remote 'tls://127.0.0.1:33052': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:54,905 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35795': TLS handshake failed with remote 'tls://127.0.0.1:33062': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:54,906 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 3537s stream = await stream.start_tls( 3537s ^^^^^^^^^^^^^^^^^^^^^^^ 3537s False, ssl_options=ssl_options, server_hostname=host 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 3537s self.socket.do_handshake() 3537s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 3537s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 3537s self._sslobj.do_handshake() 3537s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 3537s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3537s comm = await self.rpc.connect(saddr) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 3537s return await self._connect(addr=addr, timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 3537s comm = await connect( 3537s ^^^^^^^^^^^^^^ 3537s ...<4 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 3537s raise FatalCommClosedError( 3537s ...<2 lines>... 3537s ) from err 3537s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 3537s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 3537s RuntimeError: Nanny failed to start. 3537s 2024-11-23 21:18:55,911 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:18:55,919 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35403 3537s 2024-11-23 21:18:55,920 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37253/status 3537s 2024-11-23 21:18:55,920 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:18:55,948 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:38023'. Reason: failure-to-start- 3537s 2024-11-23 21:18:55,948 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:46517'. Reason: failure-to-start- 3537s 2024-11-23 21:18:55,949 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35403': TLS handshake failed with remote 'tls://127.0.0.1:48626': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:55,949 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35403': TLS handshake failed with remote 'tls://127.0.0.1:48640': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:55,949 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 3537s stream = await stream.start_tls( 3537s ^^^^^^^^^^^^^^^^^^^^^^^ 3537s False, ssl_options=ssl_options, server_hostname=host 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 3537s self.socket.do_handshake() 3537s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 3537s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 3537s self._sslobj.do_handshake() 3537s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 3537s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3537s comm = await self.rpc.connect(saddr) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 3537s return await self._connect(addr=addr, timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 3537s comm = await connect( 3537s ^^^^^^^^^^^^^^ 3537s ...<4 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 3537s raise FatalCommClosedError( 3537s ...<2 lines>... 3537s ) from err 3537s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 3537s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 3537s RuntimeError: Nanny failed to start. 3537s 2024-11-23 21:18:56,955 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:18:56,964 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33113 3537s 2024-11-23 21:18:56,964 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36467/status 3537s 2024-11-23 21:18:56,965 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:18:56,995 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:40783'. Reason: failure-to-start- 3537s 2024-11-23 21:18:56,996 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:35255'. Reason: failure-to-start- 3537s 2024-11-23 21:18:56,996 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33113': TLS handshake failed with remote 'tls://127.0.0.1:39678': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:56,996 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33113': TLS handshake failed with remote 'tls://127.0.0.1:39680': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:56,997 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 3537s stream = await stream.start_tls( 3537s ^^^^^^^^^^^^^^^^^^^^^^^ 3537s False, ssl_options=ssl_options, server_hostname=host 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 3537s self.socket.do_handshake() 3537s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 3537s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 3537s self._sslobj.do_handshake() 3537s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 3537s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3537s comm = await self.rpc.connect(saddr) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 3537s return await self._connect(addr=addr, timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 3537s comm = await connect( 3537s ^^^^^^^^^^^^^^ 3537s ...<4 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 3537s raise FatalCommClosedError( 3537s ...<2 lines>... 3537s ) from err 3537s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 3537s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 3537s RuntimeError: Nanny failed to start. 3537s 2024-11-23 21:18:58,002 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:18:58,011 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43379 3537s 2024-11-23 21:18:58,011 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40637/status 3537s 2024-11-23 21:18:58,012 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:18:58,042 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:34589'. Reason: failure-to-start- 3537s 2024-11-23 21:18:58,043 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:33059'. Reason: failure-to-start- 3537s 2024-11-23 21:18:58,044 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43379': TLS handshake failed with remote 'tls://127.0.0.1:43726': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:58,044 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43379': TLS handshake failed with remote 'tls://127.0.0.1:43738': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:58,044 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 3537s stream = await stream.start_tls( 3537s ^^^^^^^^^^^^^^^^^^^^^^^ 3537s False, ssl_options=ssl_options, server_hostname=host 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 3537s self.socket.do_handshake() 3537s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 3537s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 3537s self._sslobj.do_handshake() 3537s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 3537s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3537s comm = await self.rpc.connect(saddr) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 3537s return await self._connect(addr=addr, timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 3537s comm = await connect( 3537s ^^^^^^^^^^^^^^ 3537s ...<4 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 3537s raise FatalCommClosedError( 3537s ...<2 lines>... 3537s ) from err 3537s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 3537s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 3537s RuntimeError: Nanny failed to start. 3537s 2024-11-23 21:18:59,050 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:18:59,059 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42087 3537s 2024-11-23 21:18:59,059 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45771/status 3537s 2024-11-23 21:18:59,059 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:18:59,089 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:37089'. Reason: failure-to-start- 3537s 2024-11-23 21:18:59,090 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:42579'. Reason: failure-to-start- 3537s 2024-11-23 21:18:59,090 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42087': TLS handshake failed with remote 'tls://127.0.0.1:51532': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:59,090 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42087': TLS handshake failed with remote 'tls://127.0.0.1:51542': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:18:59,090 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 3537s stream = await stream.start_tls( 3537s ^^^^^^^^^^^^^^^^^^^^^^^ 3537s False, ssl_options=ssl_options, server_hostname=host 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 3537s self.socket.do_handshake() 3537s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 3537s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 3537s self._sslobj.do_handshake() 3537s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 3537s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3537s comm = await self.rpc.connect(saddr) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 3537s return await self._connect(addr=addr, timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 3537s comm = await connect( 3537s ^^^^^^^^^^^^^^ 3537s ...<4 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 3537s raise FatalCommClosedError( 3537s ...<2 lines>... 3537s ) from err 3537s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 3537s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 3537s RuntimeError: Nanny failed to start. 3537s 2024-11-23 21:19:00,097 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:19:00,108 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36807 3537s 2024-11-23 21:19:00,109 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45627/status 3537s 2024-11-23 21:19:00,109 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:19:00,138 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:46453'. Reason: failure-to-start- 3537s 2024-11-23 21:19:00,139 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:40477'. Reason: failure-to-start- 3537s 2024-11-23 21:19:00,139 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36807': TLS handshake failed with remote 'tls://127.0.0.1:36946': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:00,140 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36807': TLS handshake failed with remote 'tls://127.0.0.1:36954': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:00,140 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 3537s stream = await stream.start_tls( 3537s ^^^^^^^^^^^^^^^^^^^^^^^ 3537s False, ssl_options=ssl_options, server_hostname=host 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 3537s self.socket.do_handshake() 3537s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 3537s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 3537s self._sslobj.do_handshake() 3537s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 3537s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3537s comm = await self.rpc.connect(saddr) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 3537s return await self._connect(addr=addr, timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 3537s comm = await connect( 3537s ^^^^^^^^^^^^^^ 3537s ...<4 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 3537s raise FatalCommClosedError( 3537s ...<2 lines>... 3537s ) from err 3537s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 3537s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 3537s RuntimeError: Nanny failed to start. 3537s 2024-11-23 21:19:01,146 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:19:01,153 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37735 3537s 2024-11-23 21:19:01,154 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33975/status 3537s 2024-11-23 21:19:01,154 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:19:01,183 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:46603'. Reason: failure-to-start- 3537s 2024-11-23 21:19:01,184 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:35837'. Reason: failure-to-start- 3537s 2024-11-23 21:19:01,184 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37735': TLS handshake failed with remote 'tls://127.0.0.1:51052': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:01,185 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37735': TLS handshake failed with remote 'tls://127.0.0.1:51068': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:01,185 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 3537s stream = await stream.start_tls( 3537s ^^^^^^^^^^^^^^^^^^^^^^^ 3537s False, ssl_options=ssl_options, server_hostname=host 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 3537s self.socket.do_handshake() 3537s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 3537s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 3537s self._sslobj.do_handshake() 3537s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 3537s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3537s comm = await self.rpc.connect(saddr) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 3537s return await self._connect(addr=addr, timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 3537s comm = await connect( 3537s ^^^^^^^^^^^^^^ 3537s ...<4 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 3537s raise FatalCommClosedError( 3537s ...<2 lines>... 3537s ) from err 3537s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 3537s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 3537s RuntimeError: Nanny failed to start. 3537s 2024-11-23 21:19:02,191 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:19:02,199 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35781 3537s 2024-11-23 21:19:02,200 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36505/status 3537s 2024-11-23 21:19:02,200 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:19:02,231 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:39837'. Reason: failure-to-start- 3537s 2024-11-23 21:19:02,232 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:41571'. Reason: failure-to-start- 3537s 2024-11-23 21:19:02,232 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35781': TLS handshake failed with remote 'tls://127.0.0.1:38712': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:02,233 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35781': TLS handshake failed with remote 'tls://127.0.0.1:38728': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:02,233 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 3537s stream = await stream.start_tls( 3537s ^^^^^^^^^^^^^^^^^^^^^^^ 3537s False, ssl_options=ssl_options, server_hostname=host 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 3537s self.socket.do_handshake() 3537s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 3537s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 3537s self._sslobj.do_handshake() 3537s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 3537s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3537s comm = await self.rpc.connect(saddr) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 3537s return await self._connect(addr=addr, timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 3537s comm = await connect( 3537s ^^^^^^^^^^^^^^ 3537s ...<4 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 3537s raise FatalCommClosedError( 3537s ...<2 lines>... 3537s ) from err 3537s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 3537s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 3537s RuntimeError: Nanny failed to start. 3537s 2024-11-23 21:19:03,241 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:19:03,250 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34407 3537s 2024-11-23 21:19:03,251 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36091/status 3537s 2024-11-23 21:19:03,251 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:19:03,285 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:45417'. Reason: failure-to-start- 3537s 2024-11-23 21:19:03,285 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:37125'. Reason: failure-to-start- 3537s 2024-11-23 21:19:03,286 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34407': TLS handshake failed with remote 'tls://127.0.0.1:53392': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:03,286 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34407': TLS handshake failed with remote 'tls://127.0.0.1:53406': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:03,286 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 3537s stream = await stream.start_tls( 3537s ^^^^^^^^^^^^^^^^^^^^^^^ 3537s False, ssl_options=ssl_options, server_hostname=host 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 3537s self.socket.do_handshake() 3537s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 3537s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 3537s self._sslobj.do_handshake() 3537s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 3537s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3537s comm = await self.rpc.connect(saddr) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 3537s return await self._connect(addr=addr, timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 3537s comm = await connect( 3537s ^^^^^^^^^^^^^^ 3537s ...<4 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 3537s raise FatalCommClosedError( 3537s ...<2 lines>... 3537s ) from err 3537s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 3537s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 3537s RuntimeError: Nanny failed to start. 3537s 2024-11-23 21:19:04,293 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:19:04,303 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39753 3537s 2024-11-23 21:19:04,304 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39269/status 3537s 2024-11-23 21:19:04,304 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:19:04,334 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:45991'. Reason: failure-to-start- 3537s 2024-11-23 21:19:04,334 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:40977'. Reason: failure-to-start- 3537s 2024-11-23 21:19:04,338 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39753': TLS handshake failed with remote 'tls://127.0.0.1:60420': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:04,338 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39753': TLS handshake failed with remote 'tls://127.0.0.1:60426': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:04,338 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 3537s stream = await stream.start_tls( 3537s ^^^^^^^^^^^^^^^^^^^^^^^ 3537s False, ssl_options=ssl_options, server_hostname=host 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 3537s self.socket.do_handshake() 3537s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 3537s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 3537s self._sslobj.do_handshake() 3537s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 3537s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3537s comm = await self.rpc.connect(saddr) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 3537s return await self._connect(addr=addr, timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 3537s comm = await connect( 3537s ^^^^^^^^^^^^^^ 3537s ...<4 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 3537s raise FatalCommClosedError( 3537s ...<2 lines>... 3537s ) from err 3537s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 3537s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 3537s RuntimeError: Nanny failed to start. 3537s 2024-11-23 21:19:05,344 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:19:05,370 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45973 3537s 2024-11-23 21:19:05,370 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34087/status 3537s 2024-11-23 21:19:05,371 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:19:05,403 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:44397'. Reason: failure-to-start- 3537s 2024-11-23 21:19:05,403 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:41607'. Reason: failure-to-start- 3537s 2024-11-23 21:19:05,406 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45973': TLS handshake failed with remote 'tls://127.0.0.1:49338': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:05,406 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45973': TLS handshake failed with remote 'tls://127.0.0.1:49340': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:05,407 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 3537s stream = await stream.start_tls( 3537s ^^^^^^^^^^^^^^^^^^^^^^^ 3537s False, ssl_options=ssl_options, server_hostname=host 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 3537s self.socket.do_handshake() 3537s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 3537s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 3537s self._sslobj.do_handshake() 3537s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 3537s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3537s comm = await self.rpc.connect(saddr) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 3537s return await self._connect(addr=addr, timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 3537s comm = await connect( 3537s ^^^^^^^^^^^^^^ 3537s ...<4 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 3537s raise FatalCommClosedError( 3537s ...<2 lines>... 3537s ) from err 3537s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 3537s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 3537s RuntimeError: Nanny failed to start. 3537s 2024-11-23 21:19:06,413 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:19:06,421 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38349 3537s 2024-11-23 21:19:06,422 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35311/status 3537s 2024-11-23 21:19:06,422 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:19:06,468 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:45823'. Reason: failure-to-start- 3537s 2024-11-23 21:19:06,469 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:41241'. Reason: failure-to-start- 3537s 2024-11-23 21:19:06,472 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38349': TLS handshake failed with remote 'tls://127.0.0.1:34578': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:06,473 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38349': TLS handshake failed with remote 'tls://127.0.0.1:34594': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:06,473 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 3537s stream = await stream.start_tls( 3537s ^^^^^^^^^^^^^^^^^^^^^^^ 3537s False, ssl_options=ssl_options, server_hostname=host 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 3537s self.socket.do_handshake() 3537s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 3537s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 3537s self._sslobj.do_handshake() 3537s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 3537s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3537s comm = await self.rpc.connect(saddr) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 3537s return await self._connect(addr=addr, timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 3537s comm = await connect( 3537s ^^^^^^^^^^^^^^ 3537s ...<4 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 3537s raise FatalCommClosedError( 3537s ...<2 lines>... 3537s ) from err 3537s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 3537s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 3537s RuntimeError: Nanny failed to start. 3537s 2024-11-23 21:19:07,482 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:19:07,491 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40577 3537s 2024-11-23 21:19:07,491 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34593/status 3537s 2024-11-23 21:19:07,494 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:19:07,521 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:37197'. Reason: failure-to-start- 3537s 2024-11-23 21:19:07,522 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:33315'. Reason: failure-to-start- 3537s 2024-11-23 21:19:07,527 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40577': TLS handshake failed with remote 'tls://127.0.0.1:46658': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:07,527 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40577': TLS handshake failed with remote 'tls://127.0.0.1:46674': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:07,528 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 3537s stream = await stream.start_tls( 3537s ^^^^^^^^^^^^^^^^^^^^^^^ 3537s False, ssl_options=ssl_options, server_hostname=host 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 3537s self.socket.do_handshake() 3537s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 3537s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 3537s self._sslobj.do_handshake() 3537s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 3537s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3537s comm = await self.rpc.connect(saddr) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 3537s return await self._connect(addr=addr, timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 3537s comm = await connect( 3537s ^^^^^^^^^^^^^^ 3537s ...<4 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 3537s raise FatalCommClosedError( 3537s ...<2 lines>... 3537s ) from err 3537s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 3537s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 3537s RuntimeError: Nanny failed to start. 3537s 2024-11-23 21:19:08,534 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:19:08,542 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34167 3537s 2024-11-23 21:19:08,543 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43043/status 3537s 2024-11-23 21:19:08,543 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:19:08,558 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:41073'. Reason: failure-to-start- 3537s 2024-11-23 21:19:08,559 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:44843'. Reason: failure-to-start- 3537s 2024-11-23 21:19:08,559 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34167': TLS handshake failed with remote 'tls://127.0.0.1:34050': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:19:08,560 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34167': TLS handshake failed with remote 'tls://127.0.0.1:34052': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:19:08,560 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3537s comm = await self.rpc.connect(saddr) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 3537s return await self._connect(addr=addr, timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 3537s comm = await connect( 3537s ^^^^^^^^^^^^^^ 3537s ...<4 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Nanny start timed out after 0s. 3537s 2024-11-23 21:19:09,567 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:19:09,575 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36925 3537s 2024-11-23 21:19:09,575 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40423/status 3537s 2024-11-23 21:19:09,578 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:19:09,596 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:41853'. Reason: failure-to-start- 3537s 2024-11-23 21:19:09,596 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:46729'. Reason: failure-to-start- 3537s 2024-11-23 21:19:09,597 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36925': TLS handshake failed with remote 'tls://127.0.0.1:42174': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:19:09,597 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36925': TLS handshake failed with remote 'tls://127.0.0.1:42176': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:19:09,597 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3537s comm = await self.rpc.connect(saddr) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 3537s return await self._connect(addr=addr, timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 3537s comm = await connect( 3537s ^^^^^^^^^^^^^^ 3537s ...<4 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Nanny start timed out after 0s. 3537s 2024-11-23 21:19:10,603 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:19:10,612 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35269 3537s 2024-11-23 21:19:10,612 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38971/status 3537s 2024-11-23 21:19:10,613 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:19:10,631 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:36403'. Reason: failure-to-start- 3537s 2024-11-23 21:19:10,631 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:43045'. Reason: failure-to-start- 3537s 2024-11-23 21:19:10,632 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35269': TLS handshake failed with remote 'tls://127.0.0.1:39144': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:19:10,632 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35269': TLS handshake failed with remote 'tls://127.0.0.1:39152': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:19:10,632 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3537s comm = await self.rpc.connect(saddr) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 3537s return await self._connect(addr=addr, timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 3537s comm = await connect( 3537s ^^^^^^^^^^^^^^ 3537s ...<4 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Nanny start timed out after 0s. 3537s 2024-11-23 21:19:11,637 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:19:11,645 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46015 3537s 2024-11-23 21:19:11,646 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42617/status 3537s 2024-11-23 21:19:11,646 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:19:11,667 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:41869'. Reason: failure-to-start- 3537s 2024-11-23 21:19:11,667 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:37477'. Reason: failure-to-start- 3537s 2024-11-23 21:19:11,668 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46015': TLS handshake failed with remote 'tls://127.0.0.1:36464': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:19:11,669 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46015': TLS handshake failed with remote 'tls://127.0.0.1:36478': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:19:11,669 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3537s comm = await self.rpc.connect(saddr) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 3537s return await self._connect(addr=addr, timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 3537s comm = await connect( 3537s ^^^^^^^^^^^^^^ 3537s ...<4 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Nanny start timed out after 0s. 3537s 2024-11-23 21:19:12,674 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:19:12,682 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36165 3537s 2024-11-23 21:19:12,683 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44013/status 3537s 2024-11-23 21:19:12,683 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:19:12,710 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:37511'. Reason: failure-to-start- 3537s 2024-11-23 21:19:12,710 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:45511'. Reason: failure-to-start- 3537s 2024-11-23 21:19:12,712 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36165': TLS handshake failed with remote 'tls://127.0.0.1:43380': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:19:12,712 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36165': TLS handshake failed with remote 'tls://127.0.0.1:43396': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:19:12,715 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3537s comm = await self.rpc.connect(saddr) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 3537s return await self._connect(addr=addr, timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 3537s comm = await connect( 3537s ^^^^^^^^^^^^^^ 3537s ...<4 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Nanny start timed out after 0s. 3537s 2024-11-23 21:19:13,721 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:19:13,730 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33147 3537s 2024-11-23 21:19:13,730 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35755/status 3537s 2024-11-23 21:19:13,731 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:19:13,752 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:43267'. Reason: failure-to-start- 3537s 2024-11-23 21:19:13,752 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:38089'. Reason: failure-to-start- 3537s 2024-11-23 21:19:13,753 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33147': TLS handshake failed with remote 'tls://127.0.0.1:37582': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:19:13,754 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33147': TLS handshake failed with remote 'tls://127.0.0.1:37592': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:19:13,756 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3537s comm = await self.rpc.connect(saddr) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 3537s return await self._connect(addr=addr, timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 3537s comm = await connect( 3537s ^^^^^^^^^^^^^^ 3537s ...<4 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Nanny start timed out after 0s. 3537s 2024-11-23 21:19:14,761 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:19:14,770 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33555 3537s 2024-11-23 21:19:14,771 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45307/status 3537s 2024-11-23 21:19:14,771 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:19:14,786 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:44273'. Reason: failure-to-start- 3537s 2024-11-23 21:19:14,786 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:35911'. Reason: failure-to-start- 3537s 2024-11-23 21:19:14,789 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33555': TLS handshake failed with remote 'tls://127.0.0.1:38828': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:19:14,789 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33555': TLS handshake failed with remote 'tls://127.0.0.1:38842': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:19:14,790 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3537s comm = await self.rpc.connect(saddr) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 3537s return await self._connect(addr=addr, timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 3537s comm = await connect( 3537s ^^^^^^^^^^^^^^ 3537s ...<4 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Nanny start timed out after 0s. 3537s 2024-11-23 21:19:15,795 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:19:15,804 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33739 3537s 2024-11-23 21:19:15,804 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45703/status 3537s 2024-11-23 21:19:15,805 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:19:15,827 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:35271'. Reason: failure-to-start- 3537s 2024-11-23 21:19:15,827 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:40427'. Reason: failure-to-start- 3537s 2024-11-23 21:19:15,828 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33739': TLS handshake failed with remote 'tls://127.0.0.1:48450': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:19:15,828 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33739': TLS handshake failed with remote 'tls://127.0.0.1:48452': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:19:15,829 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3537s comm = await self.rpc.connect(saddr) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 3537s return await self._connect(addr=addr, timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 3537s comm = await connect( 3537s ^^^^^^^^^^^^^^ 3537s ...<4 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Nanny start timed out after 0s. 3537s 2024-11-23 21:19:16,836 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:19:16,844 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:32993 3537s 2024-11-23 21:19:16,844 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38695/status 3537s 2024-11-23 21:19:16,845 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:19:16,862 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:33889'. Reason: failure-to-start- 3537s 2024-11-23 21:19:16,862 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:46725'. Reason: failure-to-start- 3537s 2024-11-23 21:19:16,863 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:32993': TLS handshake failed with remote 'tls://127.0.0.1:59302': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:19:16,863 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:32993': TLS handshake failed with remote 'tls://127.0.0.1:59306': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:19:16,864 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3537s comm = await self.rpc.connect(saddr) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 3537s return await self._connect(addr=addr, timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 3537s comm = await connect( 3537s ^^^^^^^^^^^^^^ 3537s ...<4 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Nanny start timed out after 0s. 3537s 2024-11-23 21:19:17,869 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:19:17,877 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34689 3537s 2024-11-23 21:19:17,878 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43333/status 3537s 2024-11-23 21:19:17,878 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:19:17,902 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:33649'. Reason: failure-to-start- 3537s 2024-11-23 21:19:17,902 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:44881'. Reason: failure-to-start- 3537s 2024-11-23 21:19:17,903 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34689': TLS handshake failed with remote 'tls://127.0.0.1:41500': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:19:17,903 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34689': TLS handshake failed with remote 'tls://127.0.0.1:41516': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:19:17,903 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3537s comm = await self.rpc.connect(saddr) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 3537s return await self._connect(addr=addr, timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 3537s comm = await connect( 3537s ^^^^^^^^^^^^^^ 3537s ...<4 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Nanny start timed out after 0s. 3537s 2024-11-23 21:19:18,909 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:19:18,920 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33205 3537s 2024-11-23 21:19:18,920 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40491/status 3537s 2024-11-23 21:19:18,921 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:19:18,944 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:34649'. Reason: failure-to-start- 3537s 2024-11-23 21:19:18,945 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:40437'. Reason: failure-to-start- 3537s 2024-11-23 21:19:18,945 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33205': TLS handshake failed with remote 'tls://127.0.0.1:58254': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:19:18,946 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33205': TLS handshake failed with remote 'tls://127.0.0.1:58262': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:19:18,946 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3537s comm = await self.rpc.connect(saddr) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 3537s return await self._connect(addr=addr, timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 3537s comm = await connect( 3537s ^^^^^^^^^^^^^^ 3537s ...<4 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Nanny start timed out after 0s. 3537s 2024-11-23 21:19:19,951 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:19:19,959 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41687 3537s 2024-11-23 21:19:19,960 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41033/status 3537s 2024-11-23 21:19:19,960 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:19:19,981 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:39749'. Reason: failure-to-start- 3537s 2024-11-23 21:19:19,982 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:45393'. Reason: failure-to-start- 3537s 2024-11-23 21:19:19,985 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41687': TLS handshake failed with remote 'tls://127.0.0.1:53228': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:19:19,985 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41687': TLS handshake failed with remote 'tls://127.0.0.1:53236': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:19:19,986 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3537s comm = await self.rpc.connect(saddr) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 3537s return await self._connect(addr=addr, timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 3537s comm = await connect( 3537s ^^^^^^^^^^^^^^ 3537s ...<4 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Nanny start timed out after 0s. 3537s 2024-11-23 21:19:20,991 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:19:21,000 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33927 3537s 2024-11-23 21:19:21,001 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40845/status 3537s 2024-11-23 21:19:21,001 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:19:21,024 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:43317'. Reason: failure-to-start- 3537s 2024-11-23 21:19:21,024 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:37311'. Reason: failure-to-start- 3537s 2024-11-23 21:19:21,028 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33927': TLS handshake failed with remote 'tls://127.0.0.1:34364': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:19:21,028 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33927': TLS handshake failed with remote 'tls://127.0.0.1:34380': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:19:21,029 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3537s comm = await self.rpc.connect(saddr) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 3537s return await self._connect(addr=addr, timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 3537s comm = await connect( 3537s ^^^^^^^^^^^^^^ 3537s ...<4 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Nanny start timed out after 0s. 3537s 2024-11-23 21:19:22,036 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:19:22,046 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45915 3537s 2024-11-23 21:19:22,047 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45569/status 3537s 2024-11-23 21:19:22,047 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:19:22,072 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:34443'. Reason: failure-to-start- 3537s 2024-11-23 21:19:22,073 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:34373'. Reason: failure-to-start- 3537s 2024-11-23 21:19:22,074 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45915': TLS handshake failed with remote 'tls://127.0.0.1:41566': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:19:22,074 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45915': TLS handshake failed with remote 'tls://127.0.0.1:41576': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:19:22,074 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3537s comm = await self.rpc.connect(saddr) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 3537s return await self._connect(addr=addr, timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 3537s comm = await connect( 3537s ^^^^^^^^^^^^^^ 3537s ...<4 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Nanny start timed out after 0s. 3537s 2024-11-23 21:19:23,080 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:19:23,088 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43397 3537s 2024-11-23 21:19:23,089 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45507/status 3537s 2024-11-23 21:19:23,089 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:19:23,133 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:34883'. Reason: failure-to-start- 3537s 2024-11-23 21:19:23,133 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:40715'. Reason: failure-to-start- 3537s 2024-11-23 21:19:23,135 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43397': TLS handshake failed with remote 'tls://127.0.0.1:52014': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:19:23,135 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43397': TLS handshake failed with remote 'tls://127.0.0.1:52018': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:19:23,136 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3537s comm = await self.rpc.connect(saddr) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 3537s return await self._connect(addr=addr, timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 3537s comm = await connect( 3537s ^^^^^^^^^^^^^^ 3537s ...<4 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Nanny start timed out after 0s. 3537s 2024-11-23 21:19:24,142 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:19:24,154 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35153 3537s 2024-11-23 21:19:24,154 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40953/status 3537s 2024-11-23 21:19:24,155 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:19:24,177 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:46607'. Reason: failure-to-start- 3537s 2024-11-23 21:19:24,178 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:35723'. Reason: failure-to-start- 3537s 2024-11-23 21:19:24,179 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35153': TLS handshake failed with remote 'tls://127.0.0.1:39190': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:19:24,179 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35153': TLS handshake failed with remote 'tls://127.0.0.1:39192': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:19:24,179 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3537s comm = await self.rpc.connect(saddr) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 3537s return await self._connect(addr=addr, timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 3537s comm = await connect( 3537s ^^^^^^^^^^^^^^ 3537s ...<4 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Nanny start timed out after 0s. 3537s 2024-11-23 21:19:25,184 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:19:25,193 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34165 3537s 2024-11-23 21:19:25,193 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40791/status 3537s 2024-11-23 21:19:25,194 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:19:25,215 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:43241'. Reason: failure-to-start- 3537s 2024-11-23 21:19:25,215 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:44729'. Reason: failure-to-start- 3537s 2024-11-23 21:19:25,218 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34165': TLS handshake failed with remote 'tls://127.0.0.1:44780': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:19:25,218 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34165': TLS handshake failed with remote 'tls://127.0.0.1:44786': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:19:25,219 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3537s comm = await self.rpc.connect(saddr) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 3537s return await self._connect(addr=addr, timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 3537s comm = await connect( 3537s ^^^^^^^^^^^^^^ 3537s ...<4 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Nanny start timed out after 0s. 3537s 2024-11-23 21:19:26,224 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:19:26,233 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40957 3537s 2024-11-23 21:19:26,233 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43897/status 3537s 2024-11-23 21:19:26,234 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:19:26,258 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:41099'. Reason: failure-to-start- 3537s 2024-11-23 21:19:26,258 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:43783'. Reason: failure-to-start- 3537s 2024-11-23 21:19:26,262 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40957': TLS handshake failed with remote 'tls://127.0.0.1:46378': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:19:26,262 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40957': TLS handshake failed with remote 'tls://127.0.0.1:46394': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:19:26,264 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3537s comm = await self.rpc.connect(saddr) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 3537s return await self._connect(addr=addr, timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 3537s comm = await connect( 3537s ^^^^^^^^^^^^^^ 3537s ...<4 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Nanny start timed out after 0s. 3537s 2024-11-23 21:19:27,271 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:19:27,280 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44657 3537s 2024-11-23 21:19:27,280 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33255/status 3537s 2024-11-23 21:19:27,281 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:19:27,302 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:42101'. Reason: failure-to-start- 3537s 2024-11-23 21:19:27,302 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:46381'. Reason: failure-to-start- 3537s 2024-11-23 21:19:27,305 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44657': TLS handshake failed with remote 'tls://127.0.0.1:39688': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:19:27,305 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44657': TLS handshake failed with remote 'tls://127.0.0.1:39700': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:19:27,306 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3537s comm = await self.rpc.connect(saddr) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 3537s return await self._connect(addr=addr, timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 3537s comm = await connect( 3537s ^^^^^^^^^^^^^^ 3537s ...<4 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Nanny start timed out after 0s. 3537s 2024-11-23 21:19:28,317 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:19:28,328 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37209 3537s 2024-11-23 21:19:28,328 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40011/status 3537s 2024-11-23 21:19:28,329 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:19:28,350 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:38581'. Reason: failure-to-start- 3537s 2024-11-23 21:19:28,350 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:36885'. Reason: failure-to-start- 3537s 2024-11-23 21:19:28,356 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37209': TLS handshake failed with remote 'tls://127.0.0.1:41496': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:19:28,356 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37209': TLS handshake failed with remote 'tls://127.0.0.1:41512': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:19:28,356 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3537s comm = await self.rpc.connect(saddr) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 3537s return await self._connect(addr=addr, timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 3537s comm = await connect( 3537s ^^^^^^^^^^^^^^ 3537s ...<4 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Nanny start timed out after 0s. 3537s 2024-11-23 21:19:29,362 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:19:29,371 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36395 3537s 2024-11-23 21:19:29,372 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45521/status 3537s 2024-11-23 21:19:29,372 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:19:29,392 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:41919'. Reason: failure-to-start- 3537s 2024-11-23 21:19:29,393 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:46831'. Reason: failure-to-start- 3537s 2024-11-23 21:19:29,396 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:52700': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:19:29,396 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:52716': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:19:29,399 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3537s comm = await self.rpc.connect(saddr) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 3537s return await self._connect(addr=addr, timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 3537s comm = await connect( 3537s ^^^^^^^^^^^^^^ 3537s ...<4 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Nanny start timed out after 0s. 3537s 2024-11-23 21:19:30,404 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:19:30,413 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36885 3537s 2024-11-23 21:19:30,414 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45891/status 3537s 2024-11-23 21:19:30,414 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:19:30,456 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:32787'. Reason: failure-to-start- 3537s 2024-11-23 21:19:30,456 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:32771'. Reason: failure-to-start- 3537s 2024-11-23 21:19:30,457 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36885': TLS handshake failed with remote 'tls://127.0.0.1:48322': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:19:30,457 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36885': TLS handshake failed with remote 'tls://127.0.0.1:48328': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:19:30,458 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3537s comm = await self.rpc.connect(saddr) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 3537s return await self._connect(addr=addr, timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 3537s comm = await connect( 3537s ^^^^^^^^^^^^^^ 3537s ...<4 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Nanny start timed out after 0s. 3537s 2024-11-23 21:19:31,464 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:19:31,472 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34169 3537s 2024-11-23 21:19:31,473 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34355/status 3537s 2024-11-23 21:19:31,474 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:19:31,496 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:39645'. Reason: failure-to-start- 3537s 2024-11-23 21:19:31,496 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:33639'. Reason: failure-to-start- 3537s 2024-11-23 21:19:31,497 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34169': TLS handshake failed with remote 'tls://127.0.0.1:53248': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:19:31,497 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34169': TLS handshake failed with remote 'tls://127.0.0.1:53254': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:19:31,500 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3537s comm = await self.rpc.connect(saddr) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 3537s return await self._connect(addr=addr, timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 3537s comm = await connect( 3537s ^^^^^^^^^^^^^^ 3537s ...<4 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Nanny start timed out after 0s. 3537s 2024-11-23 21:19:32,507 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:19:32,516 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37509 3537s 2024-11-23 21:19:32,517 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43431/status 3537s 2024-11-23 21:19:32,517 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:19:32,543 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:34125'. Reason: failure-to-start- 3537s 2024-11-23 21:19:32,544 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:46463'. Reason: failure-to-start- 3537s 2024-11-23 21:19:32,545 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37509': TLS handshake failed with remote 'tls://127.0.0.1:48642': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:19:32,545 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37509': TLS handshake failed with remote 'tls://127.0.0.1:48658': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:19:32,545 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3537s comm = await self.rpc.connect(saddr) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 3537s return await self._connect(addr=addr, timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 3537s comm = await connect( 3537s ^^^^^^^^^^^^^^ 3537s ...<4 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Nanny start timed out after 0s. 3537s 2024-11-23 21:19:33,553 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:19:33,562 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46629 3537s 2024-11-23 21:19:33,563 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36815/status 3537s 2024-11-23 21:19:33,563 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:19:33,587 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:44183'. Reason: failure-to-start- 3537s 2024-11-23 21:19:33,587 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:41819'. Reason: failure-to-start- 3537s 2024-11-23 21:19:33,588 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46629': TLS handshake failed with remote 'tls://127.0.0.1:59386': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:19:33,588 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46629': TLS handshake failed with remote 'tls://127.0.0.1:59400': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:19:33,588 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3537s comm = await self.rpc.connect(saddr) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 3537s return await self._connect(addr=addr, timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 3537s comm = await connect( 3537s ^^^^^^^^^^^^^^ 3537s ...<4 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Nanny start timed out after 0s. 3537s 2024-11-23 21:19:34,594 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:19:34,602 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33095 3537s 2024-11-23 21:19:34,602 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38599/status 3537s 2024-11-23 21:19:34,603 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:19:34,630 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:33203'. Reason: failure-to-start- 3537s 2024-11-23 21:19:34,631 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:45109'. Reason: failure-to-start- 3537s 2024-11-23 21:19:34,632 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33095': TLS handshake failed with remote 'tls://127.0.0.1:57638': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:19:34,632 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33095': TLS handshake failed with remote 'tls://127.0.0.1:57652': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:19:34,632 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3537s comm = await self.rpc.connect(saddr) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 3537s return await self._connect(addr=addr, timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 3537s comm = await connect( 3537s ^^^^^^^^^^^^^^ 3537s ...<4 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Nanny start timed out after 0s. 3537s 2024-11-23 21:19:35,639 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:19:35,648 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33045 3537s 2024-11-23 21:19:35,649 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44947/status 3537s 2024-11-23 21:19:35,649 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:19:35,674 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:33367'. Reason: failure-to-start- 3537s 2024-11-23 21:19:35,675 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:33747'. Reason: failure-to-start- 3537s 2024-11-23 21:19:35,676 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33045': TLS handshake failed with remote 'tls://127.0.0.1:33170': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:19:35,676 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33045': TLS handshake failed with remote 'tls://127.0.0.1:33182': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:19:35,676 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3537s comm = await self.rpc.connect(saddr) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 3537s return await self._connect(addr=addr, timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 3537s comm = await connect( 3537s ^^^^^^^^^^^^^^ 3537s ...<4 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Nanny start timed out after 0s. 3537s 2024-11-23 21:19:36,682 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:19:36,692 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34961 3537s 2024-11-23 21:19:36,693 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35621/status 3537s 2024-11-23 21:19:36,693 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:19:36,726 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:44025'. Reason: failure-to-start- 3537s 2024-11-23 21:19:36,726 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:35191'. Reason: failure-to-start- 3537s 2024-11-23 21:19:36,727 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34961': TLS handshake failed with remote 'tls://127.0.0.1:49608': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:19:36,727 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34961': TLS handshake failed with remote 'tls://127.0.0.1:49610': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:19:36,728 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3537s comm = await self.rpc.connect(saddr) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 3537s return await self._connect(addr=addr, timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 3537s comm = await connect( 3537s ^^^^^^^^^^^^^^ 3537s ...<4 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Nanny start timed out after 0s. 3537s 2024-11-23 21:19:37,735 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:19:37,744 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41785 3537s 2024-11-23 21:19:37,745 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44447/status 3537s 2024-11-23 21:19:37,745 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:19:37,772 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:38123'. Reason: failure-to-start- 3537s 2024-11-23 21:19:37,772 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:44861'. Reason: failure-to-start- 3537s 2024-11-23 21:19:37,773 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41785': TLS handshake failed with remote 'tls://127.0.0.1:55840': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:19:37,773 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41785': TLS handshake failed with remote 'tls://127.0.0.1:55842': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:19:37,774 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3537s comm = await self.rpc.connect(saddr) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 3537s return await self._connect(addr=addr, timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 3537s comm = await connect( 3537s ^^^^^^^^^^^^^^ 3537s ...<4 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Nanny start timed out after 0s. 3537s 2024-11-23 21:19:38,779 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:19:38,788 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42355 3537s 2024-11-23 21:19:38,789 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40093/status 3537s 2024-11-23 21:19:38,789 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:19:38,820 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:32977'. Reason: failure-to-start- 3537s 2024-11-23 21:19:38,821 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:39881'. Reason: failure-to-start- 3537s 2024-11-23 21:19:38,822 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42355': TLS handshake failed with remote 'tls://127.0.0.1:51306': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:19:38,822 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42355': TLS handshake failed with remote 'tls://127.0.0.1:51320': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:19:38,823 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3537s comm = await self.rpc.connect(saddr) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 3537s return await self._connect(addr=addr, timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 3537s comm = await connect( 3537s ^^^^^^^^^^^^^^ 3537s ...<4 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Nanny start timed out after 0s. 3537s ________________________________ test_rebalance ________________________________ 3537s 3537s fut = , timeout = 0 3537s 3537s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 3537s async with asyncio.timeout(timeout): 3537s > return await fut 3537s 3537s /usr/lib/python3/dist-packages/distributed/utils.py:1960: 3537s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3537s /usr/lib/python3/dist-packages/distributed/worker.py:1480: in start_unsafe 3537s await self._register_with_scheduler() 3537s /usr/lib/python3/dist-packages/distributed/worker.py:1179: in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s /usr/lib/python3/dist-packages/distributed/comm/core.py:342: in connect 3537s comm = await wait_for( 3537s /usr/lib/python3/dist-packages/distributed/utils.py:1960: in wait_for 3537s return await fut 3537s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:546: in connect 3537s stream = await self.client.connect( 3537s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3537s 3537s self = , host = '127.0.0.1' 3537s port = 40899, af = 3537s ssl_options = 3537s max_buffer_size = 8364507136.0, source_ip = None, source_port = None 3537s timeout = None 3537s 3537s async def connect( 3537s self, 3537s host: str, 3537s port: int, 3537s af: socket.AddressFamily = socket.AF_UNSPEC, 3537s ssl_options: Optional[Union[Dict[str, Any], ssl.SSLContext]] = None, 3537s max_buffer_size: Optional[int] = None, 3537s source_ip: Optional[str] = None, 3537s source_port: Optional[int] = None, 3537s timeout: Optional[Union[float, datetime.timedelta]] = None, 3537s ) -> IOStream: 3537s """Connect to the given host and port. 3537s 3537s Asynchronously returns an `.IOStream` (or `.SSLIOStream` if 3537s ``ssl_options`` is not None). 3537s 3537s Using the ``source_ip`` kwarg, one can specify the source 3537s IP address to use when establishing the connection. 3537s In case the user needs to resolve and 3537s use a specific interface, it has to be handled outside 3537s of Tornado as this depends very much on the platform. 3537s 3537s Raises `TimeoutError` if the input future does not complete before 3537s ``timeout``, which may be specified in any form allowed by 3537s `.IOLoop.add_timeout` (i.e. a `datetime.timedelta` or an absolute time 3537s relative to `.IOLoop.time`) 3537s 3537s Similarly, when the user requires a certain source port, it can 3537s be specified using the ``source_port`` arg. 3537s 3537s .. versionchanged:: 4.5 3537s Added the ``source_ip`` and ``source_port`` arguments. 3537s 3537s .. versionchanged:: 5.0 3537s Added the ``timeout`` argument. 3537s """ 3537s if timeout is not None: 3537s if isinstance(timeout, numbers.Real): 3537s timeout = IOLoop.current().time() + timeout 3537s elif isinstance(timeout, datetime.timedelta): 3537s timeout = IOLoop.current().time() + timeout.total_seconds() 3537s else: 3537s raise TypeError("Unsupported timeout %r" % timeout) 3537s if timeout is not None: 3537s addrinfo = await gen.with_timeout( 3537s timeout, self.resolver.resolve(host, port, af) 3537s ) 3537s else: 3537s addrinfo = await self.resolver.resolve(host, port, af) 3537s connector = _Connector( 3537s addrinfo, 3537s functools.partial( 3537s self._create_stream, 3537s max_buffer_size, 3537s source_ip=source_ip, 3537s source_port=source_port, 3537s ), 3537s ) 3537s > af, addr, stream = await connector.start(connect_timeout=timeout) 3537s E asyncio.exceptions.CancelledError 3537s 3537s /usr/lib/python3/dist-packages/tornado/tcpclient.py:279: CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s self = 3537s 3537s @final 3537s async def start(self): 3537s async with self._startup_lock: 3537s if self.status == Status.failed: 3537s assert self.__startup_exc is not None 3537s raise self.__startup_exc 3537s elif self.status != Status.init: 3537s return self 3537s timeout = getattr(self, "death_timeout", None) 3537s 3537s async def _close_on_failure(exc: Exception) -> None: 3537s await self.close(reason=f"failure-to-start-{str(type(exc))}") 3537s self.status = Status.failed 3537s self.__startup_exc = exc 3537s 3537s try: 3537s > await wait_for(self.start_unsafe(), timeout=timeout) 3537s 3537s /usr/lib/python3/dist-packages/distributed/core.py:664: 3537s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3537s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 3537s async with asyncio.timeout(timeout): 3537s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3537s 3537s self = 3537s exc_type = 3537s exc_val = CancelledError(), exc_tb = 3537s 3537s async def __aexit__( 3537s self, 3537s exc_type: Optional[Type[BaseException]], 3537s exc_val: Optional[BaseException], 3537s exc_tb: Optional[TracebackType], 3537s ) -> Optional[bool]: 3537s assert self._state in (_State.ENTERED, _State.EXPIRING) 3537s 3537s if self._timeout_handler is not None: 3537s self._timeout_handler.cancel() 3537s self._timeout_handler = None 3537s 3537s if self._state is _State.EXPIRING: 3537s self._state = _State.EXPIRED 3537s 3537s if self._task.uncancel() <= self._cancelling and exc_type is not None: 3537s # Since there are no new cancel requests, we're 3537s # handling this. 3537s if issubclass(exc_type, exceptions.CancelledError): 3537s > raise TimeoutError from exc_val 3537s E TimeoutError 3537s 3537s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s @contextlib.asynccontextmanager 3537s async def _cluster_factory(): 3537s workers = [] 3537s s = None 3537s try: 3537s for _ in range(60): 3537s try: 3537s > s, ws = await start_cluster( 3537s nthreads, 3537s scheduler, 3537s security=security, 3537s Worker=Worker, 3537s scheduler_kwargs=scheduler_kwargs, 3537s worker_kwargs=merge( 3537s {"death_timeout": min(15, int(deadline.remaining))}, 3537s worker_kwargs, 3537s ), 3537s ) 3537s 3537s /usr/lib/python3/dist-packages/distributed/utils_test.py:966: 3537s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3537s /usr/lib/python3/dist-packages/distributed/utils_test.py:789: in start_cluster 3537s await asyncio.gather(*workers) 3537s /usr/lib/python3.13/asyncio/tasks.py:737: in _wrap_awaitable 3537s return await awaitable 3537s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3537s 3537s self = 3537s 3537s @final 3537s async def start(self): 3537s async with self._startup_lock: 3537s if self.status == Status.failed: 3537s assert self.__startup_exc is not None 3537s raise self.__startup_exc 3537s elif self.status != Status.init: 3537s return self 3537s timeout = getattr(self, "death_timeout", None) 3537s 3537s async def _close_on_failure(exc: Exception) -> None: 3537s await self.close(reason=f"failure-to-start-{str(type(exc))}") 3537s self.status = Status.failed 3537s self.__startup_exc = exc 3537s 3537s try: 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s except asyncio.TimeoutError as exc: 3537s await _close_on_failure(exc) 3537s > raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s E TimeoutError: Worker start timed out after 0s. 3537s 3537s /usr/lib/python3/dist-packages/distributed/core.py:667: TimeoutError 3537s 3537s During handling of the above exception, another exception occurred: 3537s 3537s fut = ._..test_func..async_fn at 0xe247ca20> 3537s timeout = 60 3537s 3537s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 3537s async with asyncio.timeout(timeout): 3537s > return await fut 3537s 3537s /usr/lib/python3/dist-packages/distributed/utils.py:1960: 3537s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3537s /usr/lib/python3/dist-packages/distributed/utils_test.py:999: in async_fn 3537s _cluster_factory() as (s, workers), 3537s /usr/lib/python3.13/contextlib.py:214: in __aenter__ 3537s return await anext(self.gen) 3537s /usr/lib/python3/dist-packages/distributed/utils_test.py:983: in _cluster_factory 3537s await asyncio.sleep(1) 3537s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3537s 3537s delay = 1, result = None 3537s 3537s async def sleep(delay, result=None): 3537s """Coroutine that completes after a given time (in seconds).""" 3537s if delay <= 0: 3537s await __sleep0() 3537s return result 3537s 3537s if math.isnan(delay): 3537s raise ValueError("Invalid delay: NaN (not a number)") 3537s 3537s loop = events.get_running_loop() 3537s future = loop.create_future() 3537s h = loop.call_later(delay, 3537s futures._set_result_unless_cancelled, 3537s future, result) 3537s try: 3537s > return await future 3537s E asyncio.exceptions.CancelledError 3537s 3537s /usr/lib/python3.13/asyncio/tasks.py:718: CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s args = (), kwds = {} 3537s 3537s @wraps(func) 3537s def inner(*args, **kwds): 3537s with self._recreate_cm(): 3537s > return func(*args, **kwds) 3537s 3537s /usr/lib/python3.13/contextlib.py:85: 3537s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3537s /usr/lib/python3.13/contextlib.py:85: in inner 3537s return func(*args, **kwds) 3537s /usr/lib/python3/dist-packages/distributed/utils_test.py:1102: in test_func 3537s return _run_and_close_tornado(async_fn_outer) 3537s /usr/lib/python3/dist-packages/distributed/utils_test.py:378: in _run_and_close_tornado 3537s return asyncio_run(inner_fn(), loop_factory=get_loop_factory()) 3537s /usr/lib/python3.13/asyncio/runners.py:194: in run 3537s return runner.run(main) 3537s /usr/lib/python3.13/asyncio/runners.py:118: in run 3537s return self._loop.run_until_complete(task) 3537s /usr/lib/python3.13/asyncio/base_events.py:720: in run_until_complete 3537s return future.result() 3537s /usr/lib/python3/dist-packages/distributed/utils_test.py:375: in inner_fn 3537s return await async_fn(*args, **kwargs) 3537s /usr/lib/python3/dist-packages/distributed/utils_test.py:1099: in async_fn_outer 3537s return await utils_wait_for(async_fn(), timeout=timeout * 2) 3537s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 3537s async with asyncio.timeout(timeout): 3537s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3537s 3537s self = 3537s exc_type = 3537s exc_val = CancelledError(), exc_tb = 3537s 3537s async def __aexit__( 3537s self, 3537s exc_type: Optional[Type[BaseException]], 3537s exc_val: Optional[BaseException], 3537s exc_tb: Optional[TracebackType], 3537s ) -> Optional[bool]: 3537s assert self._state in (_State.ENTERED, _State.EXPIRING) 3537s 3537s if self._timeout_handler is not None: 3537s self._timeout_handler.cancel() 3537s self._timeout_handler = None 3537s 3537s if self._state is _State.EXPIRING: 3537s self._state = _State.EXPIRED 3537s 3537s if self._task.uncancel() <= self._cancelling and exc_type is not None: 3537s # Since there are no new cancel requests, we're 3537s # handling this. 3537s if issubclass(exc_type, exceptions.CancelledError): 3537s > raise TimeoutError from exc_val 3537s E TimeoutError 3537s 3537s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 3537s ----------------------------- Captured stderr call ----------------------------- 3537s 2024-11-23 21:19:39,743 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:19:39,752 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:39,753 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42279/status 3537s 2024-11-23 21:19:39,753 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:19:39,770 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43407 3537s 2024-11-23 21:19:39,771 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43407 3537s 2024-11-23 21:19:39,771 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:19:39,771 - distributed.worker - INFO - dashboard at: 127.0.0.1:45331 3537s 2024-11-23 21:19:39,771 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:39,771 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:19:39,771 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:19:39,771 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:19:39,771 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-kzlhwd3i 3537s 2024-11-23 21:19:39,771 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:19:39,774 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38237 3537s 2024-11-23 21:19:39,774 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38237 3537s 2024-11-23 21:19:39,774 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:19:39,774 - distributed.worker - INFO - dashboard at: 127.0.0.1:33223 3537s 2024-11-23 21:19:39,774 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:39,774 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:19:39,774 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:19:39,774 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:19:39,774 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-xfy5qrnu 3537s 2024-11-23 21:19:39,774 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:19:39,788 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:39,788 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:39,789 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:48914': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:39,789 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:48928': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:39,901 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:39,901 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:39,902 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:48942': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:39,902 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:48946': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:40,015 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:40,016 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:40,016 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:48960': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:40,016 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:48962': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:40,128 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:40,128 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:40,129 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:48970': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:40,129 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:48974': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:40,241 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:40,241 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:40,241 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:48976': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:40,242 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:48982': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:40,354 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:40,355 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:40,355 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:48990': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:40,355 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:49000': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:40,468 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:40,468 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:40,468 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:49014': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:40,468 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:49018': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:40,581 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:40,582 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:40,582 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:49030': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:40,582 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:49036': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:40,694 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:40,695 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:40,695 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:49050': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:40,695 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:49056': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:40,808 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:40,808 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:40,808 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:49068': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:40,808 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:49072': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:40,919 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:40,921 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:40,921 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:49088': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:40,921 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:49098': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:41,029 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:41,033 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:49100': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:41,034 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:41,035 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:49106': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:41,136 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:41,137 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:49122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:41,143 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:41,144 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:49128': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:41,244 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:41,245 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:49130': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:41,251 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:41,252 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:49146': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:41,362 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:41,363 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:49150': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:41,370 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:41,370 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:49152': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:41,470 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:41,471 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:49156': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:41,477 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:41,477 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:49158': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:41,579 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:41,580 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:38784': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:41,586 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:41,586 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:38786': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:41,687 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:41,688 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:38788': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:41,696 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:41,696 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:38798': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:41,796 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:41,796 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:38808': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:41,803 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:41,803 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:38820': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:41,904 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:41,904 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:38822': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:41,911 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:41,911 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:38824': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:42,011 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:42,011 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:38826': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:42,018 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:42,018 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:38836': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:42,119 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:42,120 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:38838': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:42,126 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:42,126 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:38840': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:42,227 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:42,227 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:38850': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:42,234 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:42,234 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:38856': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:42,334 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:42,335 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:38858': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:42,341 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:42,342 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:38864': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:42,442 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:42,443 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:38870': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:42,449 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:42,450 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:38880': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:42,550 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:42,551 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:38896': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:42,557 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:42,558 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:38906': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:42,658 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:42,659 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:38910': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:42,665 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:42,665 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:38916': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:42,766 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:42,767 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:38926': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:42,773 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:42,773 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:38938': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:42,875 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:42,876 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:38942': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:42,882 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:42,882 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:38946': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:42,983 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:42,983 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:38962': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:42,990 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:42,990 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:38972': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:43,090 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:43,091 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:38980': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:43,097 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:43,098 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:38996': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:43,198 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:43,199 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:39002': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:43,205 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:43,206 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:39018': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:43,307 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:43,308 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:39034': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:43,314 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:43,314 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:39044': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:43,417 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:43,418 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:39050': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:43,423 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:43,424 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:39066': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:43,525 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:43,526 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:39074': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:43,532 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:43,532 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:39086': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:43,634 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:43,635 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:39102': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:43,641 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:43,641 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:39112': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:43,742 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:43,742 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:39126': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:43,749 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:43,749 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:39140': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:43,850 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:43,850 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:39156': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:43,857 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:43,858 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:39166': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:43,958 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:43,959 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:39172': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:43,965 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:43,965 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:39188': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:44,066 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:44,066 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:39200': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:44,073 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:44,073 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:39204': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:44,174 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:44,174 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:39218': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:44,180 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:44,181 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:39232': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:44,281 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:44,282 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:39242': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:44,288 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:44,289 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:39244': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:44,389 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:44,390 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:39252': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:44,396 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:44,396 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:39258': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:44,498 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:44,499 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:39272': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:44,505 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:44,505 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:39280': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:44,606 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:44,606 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:39290': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:44,613 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:44,613 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:39302': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:44,715 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:44,716 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:39316': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:44,722 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:44,722 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:39328': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:44,823 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:44,824 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:39334': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:44,829 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:44,830 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:39346': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:44,930 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:44,931 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:39356': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:44,937 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:44,937 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:39364': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:45,039 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:45,041 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:39378': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:45,047 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:45,048 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:39392': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:45,147 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:45,147 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:39398': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:45,155 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:45,155 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:39402': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:45,255 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:45,259 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:39416': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:45,265 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:45,265 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:39432': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:45,362 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:45,362 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:39444': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:45,372 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:45,372 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:39454': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:45,469 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:45,470 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:39464': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:45,479 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:45,480 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:39476': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:45,577 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:45,577 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:39492': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:45,587 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:45,587 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:39500': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:45,685 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:45,685 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:39514': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:45,694 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:45,694 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:39516': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:45,793 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:45,794 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:39524': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:45,801 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:45,802 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:39532': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:45,901 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:45,902 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:39542': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:45,908 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:45,909 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:39558': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:46,009 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:46,010 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:39566': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:46,016 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:46,016 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:39572': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:46,117 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:46,118 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:39584': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:46,124 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:46,124 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:39598': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:46,225 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:46,225 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:39612': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:46,232 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:46,232 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:39618': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:46,333 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:46,333 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:39624': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:46,340 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:46,340 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:39640': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:46,441 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:46,441 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:39650': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:46,448 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:46,448 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:39666': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:46,548 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:46,549 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:39672': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:46,555 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:46,556 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:39676': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:46,656 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:46,656 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:39682': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:46,663 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:46,663 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:39694': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:46,767 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:46,768 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:39702': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:46,774 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:46,774 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:39712': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:46,875 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:46,876 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:39714': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:46,882 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:46,883 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:39722': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:46,983 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:46,984 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:39734': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:46,990 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:46,990 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:39748': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:47,090 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:47,091 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:39754': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:47,097 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:47,098 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:39760': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:47,198 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:47,199 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:39762': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:47,205 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:47,206 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:39764': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:47,306 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:47,307 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:39772': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:47,313 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:47,314 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:39774': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:47,414 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:47,415 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:39784': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:47,421 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:47,421 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:39794': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:47,522 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:47,523 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:39802': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:47,529 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:47,530 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:39812': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:47,630 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:47,631 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:39828': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:47,637 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:47,638 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:39836': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:47,738 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:47,738 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:39844': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:47,745 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:47,745 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:39858': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:47,846 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:47,847 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:39866': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:47,853 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:47,854 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:39874': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:47,954 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:47,954 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:39882': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:47,961 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:47,961 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:39896': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:48,061 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:48,062 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:39904': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:48,068 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:48,068 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:39918': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:48,169 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:48,170 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:39934': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:48,176 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:48,176 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:39948': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:48,278 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:48,279 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:39950': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:48,284 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:48,285 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:39962': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:48,387 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:48,388 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:39964': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:48,394 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:48,394 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:39980': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:48,496 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:48,497 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:39992': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:48,503 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:48,503 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:39998': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:48,603 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:48,604 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:40012': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:48,610 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:48,611 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:40022': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:48,711 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:48,712 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:40028': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:48,718 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:48,719 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:40032': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:48,819 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:48,820 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:40046': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:48,826 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:48,826 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:40052': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:48,927 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:48,927 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:40066': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:48,933 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:48,934 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:40068': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:49,035 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:49,036 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:40072': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:49,042 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:49,042 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:40074': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:49,143 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:49,144 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:40078': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:49,150 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:49,151 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:40082': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:49,251 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:49,252 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:40084': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:49,258 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:49,262 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:40092': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:49,359 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:49,360 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:40102': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:49,366 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:49,366 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:40112': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:49,467 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:49,467 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:40124': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:49,474 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:49,474 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:40132': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:49,575 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:49,576 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:40146': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:49,582 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:49,582 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:40148': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:49,683 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:49,683 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:40162': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:49,690 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:49,690 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:40174': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:49,791 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:49,792 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:40182': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:49,798 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:49,798 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:40194': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:49,899 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:49,900 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:40198': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:49,906 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:49,906 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:40204': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:50,007 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:50,009 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:40214': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:50,015 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:50,016 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:40224': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:50,117 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:50,117 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:40230': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:50,124 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:50,124 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:40238': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:50,225 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:50,226 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:40240': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:50,232 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:50,233 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:40246': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:50,333 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:50,334 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:40258': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:50,340 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:50,341 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:40262': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:50,441 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:50,442 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:40278': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:50,448 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:50,449 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:40280': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:50,549 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:50,550 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:40282': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:50,556 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:50,557 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:40288': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:50,657 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:50,658 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:40300': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:50,664 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:50,664 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:40312': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:50,765 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:50,765 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:40314': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:50,772 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:50,772 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:40316': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:50,873 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:50,874 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:40328': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:50,880 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:50,881 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:40334': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:50,981 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:50,982 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:40338': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:50,988 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:50,989 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:40348': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:51,089 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:51,089 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:40352': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:51,096 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:51,096 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:40362': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:51,198 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:51,199 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:40376': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:51,204 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:51,205 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:40384': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:51,306 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:51,307 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:40390': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:51,313 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:51,313 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:40396': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:51,415 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:51,416 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:40400': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:51,421 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:51,422 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:40410': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:51,523 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:51,524 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:40412': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:51,530 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:51,530 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:49104': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:51,631 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:51,631 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:49116': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:51,639 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:51,640 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:49130': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:51,738 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:51,739 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:49138': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:51,746 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:51,747 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:49150': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:51,846 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:51,846 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:49152': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:51,854 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:51,855 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:49162': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:51,955 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:51,956 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:49168': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:51,962 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:51,963 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:49170': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:52,062 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:52,063 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:49180': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:52,069 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:52,070 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:49192': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:52,171 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:52,172 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:49196': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:52,186 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:52,187 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:49200': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:52,279 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:52,280 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:49206': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:52,293 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:52,294 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:49220': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:52,388 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:52,389 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:49226': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:52,401 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:52,401 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:49228': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:52,496 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:52,497 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:49244': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:52,508 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:52,508 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:49256': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:52,604 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:52,604 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:49268': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:52,615 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:52,615 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:49278': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:52,712 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:52,712 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:49292': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:52,722 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:52,722 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:49308': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:52,819 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:52,820 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:49318': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:52,829 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:52,830 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:49328': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:52,927 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:52,928 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:49344': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:52,936 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:52,937 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:49350': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:53,035 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:53,036 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:49366': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:53,044 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:53,044 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:49376': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:53,143 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:53,143 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:49380': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:53,151 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:53,151 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:49392': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:53,250 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:53,251 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:49406': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:53,259 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:53,263 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:49418': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:53,358 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:53,358 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:49428': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:53,366 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:53,366 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:49444': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:53,466 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:53,466 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:49448': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:53,472 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:53,473 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:49464': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:53,573 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:53,574 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:49474': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:53,580 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:53,581 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:49480': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:53,682 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:53,683 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:49492': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:53,689 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:53,689 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:49508': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:53,790 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:53,790 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:49522': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:53,796 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:53,797 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:49526': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:53,898 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:53,899 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:49542': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:53,905 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:53,906 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:49548': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:54,006 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:54,007 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:49560': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:54,013 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:54,013 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:49576': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:54,114 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:54,114 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:49584': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:54,121 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:54,121 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:49586': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:54,222 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:54,222 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:49592': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:54,228 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:54,229 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:49596': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:54,330 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:54,331 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:49602': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:54,337 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:54,337 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:49616': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:54,438 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:54,439 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:49618': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:54,445 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:54,445 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:49634': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:54,546 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:54,547 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:49648': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:54,553 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:54,553 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:49658': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:54,654 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:54,654 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:49664': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:54,661 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:54,661 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:49680': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:54,764 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:54,765 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:49684': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:54,771 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37241 3537s 2024-11-23 21:19:54,772 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43407. Reason: failure-to-start- 3537s 2024-11-23 21:19:54,772 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:19:54,775 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37241': TLS handshake failed with remote 'tls://127.0.0.1:49686': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:54,775 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38237. Reason: failure-to-start- 3537s 2024-11-23 21:19:54,775 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:19:54,778 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 15s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 3537s stream = await stream.start_tls( 3537s ^^^^^^^^^^^^^^^^^^^^^^^ 3537s False, ssl_options=ssl_options, server_hostname=host 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 3537s self.socket.do_handshake() 3537s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 3537s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 3537s self._sslobj.do_handshake() 3537s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 3537s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 3537s raise FatalCommClosedError( 3537s ...<2 lines>... 3537s ) from err 3537s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 3537s 3537s During handling of the above exception, another exception occurred: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1218, in _register_with_scheduler 3537s await asyncio.sleep(0.1) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 718, in sleep 3537s return await future 3537s ^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 15s. 3537s 2024-11-23 21:19:55,792 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:19:55,802 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45089 3537s 2024-11-23 21:19:55,802 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34155/status 3537s 2024-11-23 21:19:55,803 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:19:55,820 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37701 3537s 2024-11-23 21:19:55,820 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37701 3537s 2024-11-23 21:19:55,820 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:19:55,821 - distributed.worker - INFO - dashboard at: 127.0.0.1:37071 3537s 2024-11-23 21:19:55,821 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:19:55,821 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:19:55,821 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:19:55,821 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:19:55,821 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-b8l6gzt1 3537s 2024-11-23 21:19:55,821 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:19:55,823 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37099 3537s 2024-11-23 21:19:55,823 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37099 3537s 2024-11-23 21:19:55,823 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:19:55,823 - distributed.worker - INFO - dashboard at: 127.0.0.1:38923 3537s 2024-11-23 21:19:55,823 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:19:55,823 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:19:55,824 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:19:55,824 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:19:55,824 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-azq2i441 3537s 2024-11-23 21:19:55,824 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:19:55,837 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:19:55,837 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:19:55,837 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:57678': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:55,837 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:57686': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:55,950 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:19:55,950 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:19:55,951 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:57702': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:55,951 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:57710': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:56,063 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:19:56,064 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:19:56,064 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:57716': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:56,064 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:57722': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:56,177 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:19:56,177 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:19:56,178 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:57724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:56,178 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:57726': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:56,290 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:19:56,291 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:19:56,291 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:57742': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:56,291 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:57752': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:56,404 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:19:56,404 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:19:56,405 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:57760': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:56,405 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:57764': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:56,519 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:19:56,519 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:19:56,519 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:57780': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:56,519 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:57790': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:56,632 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:19:56,632 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:19:56,633 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:57794': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:56,633 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:57796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:56,745 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:19:56,745 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:19:56,746 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:57808': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:56,746 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:57824': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:56,858 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:19:56,858 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:19:56,859 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:57830': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:56,859 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:57836': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:56,971 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:19:56,972 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:19:56,972 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:57846': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:56,972 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:57850': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:57,094 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:19:57,094 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:19:57,095 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:57854': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:57,095 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:57870': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:57,208 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:19:57,208 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:19:57,209 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:57872': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:57,209 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:57876': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:57,322 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:19:57,322 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:19:57,322 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:57884': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:57,323 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:57888': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:57,435 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:19:57,435 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:19:57,436 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:57892': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:57,436 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:57906': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:57,548 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:19:57,548 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:19:57,549 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:57910': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:57,549 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:57912': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:57,662 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:19:57,662 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:19:57,663 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:57914': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:57,663 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:57918': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:57,775 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:19:57,775 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:19:57,776 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:57924': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:57,776 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:57940': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:57,889 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:19:57,889 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:19:57,889 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:57956': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:57,890 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:57958': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:58,002 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:19:58,003 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:19:58,003 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:57972': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:58,003 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:57986': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:58,116 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:19:58,117 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:19:58,117 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:57994': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:58,117 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:58008': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:58,231 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:19:58,233 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:19:58,233 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:58022': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:58,233 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:58028': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:58,339 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:19:58,340 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:58042': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:58,345 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:19:58,346 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:58050': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:58,448 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:19:58,449 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:58054': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:58,454 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:19:58,455 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:58066': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:58,556 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:19:58,557 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:58082': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:58,563 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:19:58,563 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:58088': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:58,664 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:19:58,664 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:58090': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:58,670 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:19:58,671 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:58104': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:58,771 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:19:58,772 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:58114': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:58,778 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:19:58,779 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:58118': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:58,879 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:19:58,879 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:58132': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:58,886 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:19:58,886 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:58148': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:58,988 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:19:58,989 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:58160': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:58,995 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:19:58,995 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:58164': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:59,096 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:19:59,096 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:58174': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:59,102 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:19:59,103 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:58176': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:59,204 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:19:59,205 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:58184': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:59,211 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:19:59,211 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:58200': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:59,313 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:19:59,314 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:58202': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:59,320 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:19:59,320 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:58204': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:59,422 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:19:59,423 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:58220': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:59,429 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:19:59,430 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:58224': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:59,530 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:19:59,530 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:58240': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:59,536 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:19:59,537 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:58256': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:59,637 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:19:59,638 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:58258': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:59,644 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:19:59,645 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:58264': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:59,745 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:19:59,746 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:58266': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:59,752 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:19:59,752 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:58280': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:59,853 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:19:59,854 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:58292': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:59,860 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:19:59,861 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:58308': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:59,963 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:19:59,964 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:58314': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:19:59,970 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:19:59,970 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:58330': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:00,071 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:20:00,072 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:58334': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:00,078 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:20:00,079 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:58338': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:00,181 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:20:00,181 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:58350': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:00,187 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:20:00,188 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:58364': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:00,289 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:20:00,290 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:58378': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:00,296 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:20:00,296 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:58394': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:00,398 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:20:00,399 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:58404': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:00,405 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:20:00,405 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:58416': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:00,506 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:20:00,507 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:58430': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:00,513 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:20:00,514 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:58434': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:00,614 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:20:00,614 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:58440': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:00,621 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:20:00,621 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:58448': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:00,722 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:20:00,722 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:58456': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:00,728 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:20:00,729 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:58466': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:00,829 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:20:00,830 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:58478': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:00,836 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:20:00,836 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:58486': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:00,938 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:20:00,939 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:58494': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:00,945 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:20:00,945 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:58496': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:01,046 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:20:01,046 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:58512': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:01,052 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:20:01,053 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:58528': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:01,154 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:20:01,155 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:58544': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:01,161 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:20:01,161 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:58556': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:01,264 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:20:01,265 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:58562': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:01,271 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:20:01,271 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:58574': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:01,371 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:20:01,372 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:58580': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:01,378 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:20:01,378 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:58584': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:01,480 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:20:01,481 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:58600': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:01,487 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:20:01,487 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:58610': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:01,589 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:20:01,592 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:55250': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:01,598 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:20:01,598 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:55258': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:01,698 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:20:01,698 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:55266': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:01,705 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:20:01,705 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:55270': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:01,806 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:20:01,810 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:55276': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:01,816 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:20:01,816 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:55284': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:01,913 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:20:01,914 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:55286': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:01,923 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:20:01,924 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:55302': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:02,021 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:20:02,021 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:55308': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:02,030 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:20:02,030 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:55322': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:02,130 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:20:02,130 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:55338': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:02,138 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:20:02,138 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:55352': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:02,238 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:20:02,239 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:55366': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:02,245 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:20:02,246 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:55380': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:02,346 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:20:02,346 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:55384': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:02,352 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:20:02,353 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:55386': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:02,454 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:20:02,455 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:55392': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:02,461 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:20:02,461 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:55406': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:02,561 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:20:02,562 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:55410': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:02,568 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:20:02,568 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:55420': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:02,669 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:20:02,670 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:55428': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:02,676 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:20:02,676 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:55442': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:02,777 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:20:02,778 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:55452': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:02,784 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:20:02,784 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:55464': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:02,886 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:20:02,887 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:55478': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:02,893 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:20:02,893 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:55486': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:02,994 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:20:02,995 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:55488': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:03,001 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:20:03,001 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:55494': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:03,101 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:20:03,102 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:55498': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:03,109 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:20:03,109 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:55514': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:03,223 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:20:03,224 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:55520': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:03,230 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:20:03,230 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:55528': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:03,331 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:20:03,331 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:55542': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:03,337 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:20:03,338 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:55556': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:03,438 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:20:03,439 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:55562': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:03,445 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:20:03,446 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:55568': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:03,547 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:20:03,548 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:55582': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:03,553 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:20:03,554 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:55588': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:03,655 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:20:03,656 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:55604': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:03,662 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:20:03,662 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:55620': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:03,764 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:20:03,765 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:55630': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:03,771 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:20:03,771 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:55646': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:03,872 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:20:03,872 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:55658': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:03,879 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:20:03,879 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:55668': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:03,980 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:20:03,981 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:55670': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:03,987 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:20:03,987 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:55672': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:04,089 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:20:04,090 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:55676': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:04,096 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:20:04,096 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:55684': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:04,198 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:20:04,199 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:55694': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:04,205 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:20:04,205 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:55706': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:04,306 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:20:04,309 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:55708': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:04,316 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:20:04,316 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:55724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:04,413 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:20:04,414 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:55740': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:04,424 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:20:04,424 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:55742': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:04,521 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:20:04,522 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:55758': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:04,532 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:20:04,532 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:55768': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:04,631 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:20:04,632 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:55774': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:04,639 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:20:04,640 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:55786': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:04,739 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:20:04,739 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:55798': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:04,747 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:20:04,747 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:55804': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:04,847 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:20:04,847 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:55820': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:04,853 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:20:04,854 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:55834': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:04,956 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:20:04,957 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:55846': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:04,964 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:20:04,964 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:55858': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:05,064 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:20:05,065 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:55862': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:05,071 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:20:05,072 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:55866': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:05,172 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:20:05,172 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:55882': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:05,179 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:20:05,179 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:55890': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:05,279 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:20:05,280 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:55898': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:05,286 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:20:05,287 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:55908': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:05,388 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:20:05,389 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:55912': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:05,395 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:20:05,396 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:55928': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:05,496 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:20:05,496 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:55942': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:05,503 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:20:05,503 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:55958': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:05,604 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:20:05,605 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:55970': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:05,611 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:20:05,612 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:55982': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:05,712 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:20:05,713 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:55984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:05,719 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:20:05,719 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:55990': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:05,820 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:20:05,821 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:56006': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:05,827 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:20:05,828 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:56008': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:05,928 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:20:05,928 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:56014': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:05,934 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:20:05,935 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:56020': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:06,035 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:20:06,036 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:56034': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:06,042 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:20:06,043 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:56038': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:06,143 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:20:06,144 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:56046': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:06,150 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:20:06,150 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:56062': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:06,251 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:20:06,252 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:56064': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:06,258 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:20:06,262 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:56078': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:06,360 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:20:06,361 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:56094': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:06,367 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:20:06,367 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:56104': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:06,467 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:20:06,468 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:56108': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:06,474 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:20:06,474 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:56122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:06,576 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:20:06,578 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:56134': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:06,584 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:20:06,585 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:56138': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:06,683 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:20:06,684 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:56144': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:06,692 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:20:06,692 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:56156': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:06,791 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:20:06,791 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:56164': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:06,799 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:20:06,800 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:56168': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:06,898 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:20:06,899 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:56172': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:06,906 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:20:06,907 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:56178': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:07,006 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:20:07,006 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:56188': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:07,013 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:20:07,014 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:56190': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:07,114 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:20:07,114 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:56196': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:07,121 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:20:07,121 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:56204': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:07,222 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:20:07,223 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:56218': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:07,229 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:20:07,229 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:56222': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:07,330 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:20:07,331 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:56238': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:07,337 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:20:07,338 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:56240': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:07,438 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:20:07,439 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:56244': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:07,445 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:20:07,446 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:56256': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:07,546 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:20:07,546 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:56260': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:07,553 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:20:07,553 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:56276': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:07,654 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:20:07,655 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:56288': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:07,662 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:20:07,662 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:56304': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:07,765 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:20:07,766 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:56320': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:07,772 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:20:07,772 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:56322': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:07,873 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:20:07,873 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:56326': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:07,880 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:20:07,880 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:56328': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:07,981 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:20:07,981 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:56340': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:07,987 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:20:07,988 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:56356': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:08,089 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:20:08,090 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:56366': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:08,096 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:20:08,097 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:56378': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:08,199 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:20:08,199 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:56394': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:08,206 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:20:08,206 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:56406': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:08,307 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:20:08,310 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:56412': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:08,317 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:20:08,317 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:56420': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:08,414 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:20:08,415 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:56428': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:08,424 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:20:08,425 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:56438': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:08,522 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:20:08,522 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:56442': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:08,532 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:20:08,532 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:56454': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:08,630 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:20:08,631 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:56462': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:08,640 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:20:08,640 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:56472': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:08,738 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:20:08,739 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:56474': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:08,747 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45089 3537s 2024-11-23 21:20:08,748 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45089': TLS handshake failed with remote 'tls://127.0.0.1:56486': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:08,819 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37701. Reason: failure-to-start- 3537s 2024-11-23 21:20:08,819 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:20:08,821 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 13s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 3537s stream = await stream.start_tls( 3537s ^^^^^^^^^^^^^^^^^^^^^^^ 3537s False, ssl_options=ssl_options, server_hostname=host 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 3537s self.socket.do_handshake() 3537s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 3537s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 3537s self._sslobj.do_handshake() 3537s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 3537s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 3537s raise FatalCommClosedError( 3537s ...<2 lines>... 3537s ) from err 3537s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 3537s 3537s During handling of the above exception, another exception occurred: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1218, in _register_with_scheduler 3537s await asyncio.sleep(0.1) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 718, in sleep 3537s return await future 3537s ^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 13s. 3537s 2024-11-23 21:20:08,825 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37099. Reason: failure-to-start- 3537s 2024-11-23 21:20:08,825 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:20:09,829 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:20:09,838 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41455 3537s 2024-11-23 21:20:09,839 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41259/status 3537s 2024-11-23 21:20:09,839 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:20:09,855 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41597 3537s 2024-11-23 21:20:09,856 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41597 3537s 2024-11-23 21:20:09,856 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:20:09,856 - distributed.worker - INFO - dashboard at: 127.0.0.1:42687 3537s 2024-11-23 21:20:09,856 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41455 3537s 2024-11-23 21:20:09,856 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:20:09,856 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:20:09,856 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:20:09,856 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-9z4sq0__ 3537s 2024-11-23 21:20:09,856 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:20:09,858 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34487 3537s 2024-11-23 21:20:09,859 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34487 3537s 2024-11-23 21:20:09,859 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:20:09,859 - distributed.worker - INFO - dashboard at: 127.0.0.1:41245 3537s 2024-11-23 21:20:09,859 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41455 3537s 2024-11-23 21:20:09,859 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:20:09,859 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:20:09,859 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:20:09,860 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-_wn9ccvn 3537s 2024-11-23 21:20:09,860 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:20:09,861 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41597. Reason: failure-to-start- 3537s 2024-11-23 21:20:09,862 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:20:09,862 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34487. Reason: failure-to-start- 3537s 2024-11-23 21:20:09,862 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:20:09,863 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41455': TLS handshake failed with remote 'tls://127.0.0.1:33910': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:20:09,864 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41455': TLS handshake failed with remote 'tls://127.0.0.1:33916': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:20:09,866 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:20:10,872 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:20:10,881 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33559 3537s 2024-11-23 21:20:10,881 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41559/status 3537s 2024-11-23 21:20:10,882 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:20:10,899 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46433 3537s 2024-11-23 21:20:10,899 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46433 3537s 2024-11-23 21:20:10,899 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:20:10,899 - distributed.worker - INFO - dashboard at: 127.0.0.1:36021 3537s 2024-11-23 21:20:10,899 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33559 3537s 2024-11-23 21:20:10,899 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:20:10,900 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:20:10,900 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:20:10,900 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-4c_11kit 3537s 2024-11-23 21:20:10,900 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:20:10,902 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42883 3537s 2024-11-23 21:20:10,902 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42883 3537s 2024-11-23 21:20:10,902 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:20:10,902 - distributed.worker - INFO - dashboard at: 127.0.0.1:35275 3537s 2024-11-23 21:20:10,902 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33559 3537s 2024-11-23 21:20:10,902 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:20:10,902 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:20:10,903 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:20:10,903 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ao1iju47 3537s 2024-11-23 21:20:10,903 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:20:10,904 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46433. Reason: failure-to-start- 3537s 2024-11-23 21:20:10,904 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:20:10,904 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42883. Reason: failure-to-start- 3537s 2024-11-23 21:20:10,905 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:20:10,906 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33559': TLS handshake failed with remote 'tls://127.0.0.1:52006': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:20:10,906 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33559': TLS handshake failed with remote 'tls://127.0.0.1:52010': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:20:10,907 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:20:11,913 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:20:11,925 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37195 3537s 2024-11-23 21:20:11,926 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44039/status 3537s 2024-11-23 21:20:11,926 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:20:11,943 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33159 3537s 2024-11-23 21:20:11,943 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33159 3537s 2024-11-23 21:20:11,943 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:20:11,943 - distributed.worker - INFO - dashboard at: 127.0.0.1:41309 3537s 2024-11-23 21:20:11,943 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37195 3537s 2024-11-23 21:20:11,943 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:20:11,943 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:20:11,943 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:20:11,943 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-v6o9iivz 3537s 2024-11-23 21:20:11,943 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:20:11,946 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44461 3537s 2024-11-23 21:20:11,946 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44461 3537s 2024-11-23 21:20:11,946 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:20:11,946 - distributed.worker - INFO - dashboard at: 127.0.0.1:33887 3537s 2024-11-23 21:20:11,946 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37195 3537s 2024-11-23 21:20:11,946 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:20:11,946 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:20:11,946 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:20:11,946 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ag1xdhin 3537s 2024-11-23 21:20:11,946 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:20:11,947 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33159. Reason: failure-to-start- 3537s 2024-11-23 21:20:11,947 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:20:11,948 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44461. Reason: failure-to-start- 3537s 2024-11-23 21:20:11,948 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:20:11,949 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37195': TLS handshake failed with remote 'tls://127.0.0.1:48394': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:20:11,949 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37195': TLS handshake failed with remote 'tls://127.0.0.1:48402': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:20:11,951 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:20:12,958 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:20:12,967 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33201 3537s 2024-11-23 21:20:12,967 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43721/status 3537s 2024-11-23 21:20:12,968 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:20:12,987 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35111 3537s 2024-11-23 21:20:12,987 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35111 3537s 2024-11-23 21:20:12,987 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:20:12,988 - distributed.worker - INFO - dashboard at: 127.0.0.1:41907 3537s 2024-11-23 21:20:12,988 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33201 3537s 2024-11-23 21:20:12,988 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:20:12,988 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:20:12,988 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:20:12,988 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-q12bzi3g 3537s 2024-11-23 21:20:12,988 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:20:12,990 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34725 3537s 2024-11-23 21:20:12,990 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34725 3537s 2024-11-23 21:20:12,990 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:20:12,990 - distributed.worker - INFO - dashboard at: 127.0.0.1:36017 3537s 2024-11-23 21:20:12,991 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33201 3537s 2024-11-23 21:20:12,991 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:20:12,991 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:20:12,991 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:20:12,991 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-m8m_ox37 3537s 2024-11-23 21:20:12,991 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:20:12,992 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35111. Reason: failure-to-start- 3537s 2024-11-23 21:20:12,992 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:20:12,993 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34725. Reason: failure-to-start- 3537s 2024-11-23 21:20:12,993 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:20:12,994 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33201': TLS handshake failed with remote 'tls://127.0.0.1:51280': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:20:12,995 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33201': TLS handshake failed with remote 'tls://127.0.0.1:51290': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:20:12,996 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:20:14,002 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:20:14,010 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42607 3537s 2024-11-23 21:20:14,011 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42325/status 3537s 2024-11-23 21:20:14,011 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:20:14,029 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33827 3537s 2024-11-23 21:20:14,029 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33827 3537s 2024-11-23 21:20:14,029 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:20:14,029 - distributed.worker - INFO - dashboard at: 127.0.0.1:37107 3537s 2024-11-23 21:20:14,029 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42607 3537s 2024-11-23 21:20:14,029 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:20:14,030 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:20:14,030 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:20:14,030 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-3w5ba5m4 3537s 2024-11-23 21:20:14,030 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:20:14,032 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39025 3537s 2024-11-23 21:20:14,032 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39025 3537s 2024-11-23 21:20:14,032 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:20:14,032 - distributed.worker - INFO - dashboard at: 127.0.0.1:42487 3537s 2024-11-23 21:20:14,032 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42607 3537s 2024-11-23 21:20:14,032 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:20:14,033 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:20:14,033 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:20:14,033 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-t_1t9fad 3537s 2024-11-23 21:20:14,033 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:20:14,034 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33827. Reason: failure-to-start- 3537s 2024-11-23 21:20:14,034 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:20:14,034 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39025. Reason: failure-to-start- 3537s 2024-11-23 21:20:14,035 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:20:14,036 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42607': TLS handshake failed with remote 'tls://127.0.0.1:47868': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:20:14,036 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42607': TLS handshake failed with remote 'tls://127.0.0.1:47870': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:20:14,038 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:20:15,050 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:20:15,059 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33155 3537s 2024-11-23 21:20:15,060 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39755/status 3537s 2024-11-23 21:20:15,060 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:20:15,078 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38179 3537s 2024-11-23 21:20:15,079 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38179 3537s 2024-11-23 21:20:15,079 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:20:15,079 - distributed.worker - INFO - dashboard at: 127.0.0.1:34001 3537s 2024-11-23 21:20:15,079 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33155 3537s 2024-11-23 21:20:15,079 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:20:15,079 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:20:15,079 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:20:15,079 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-fzs4yreh 3537s 2024-11-23 21:20:15,079 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:20:15,084 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43211 3537s 2024-11-23 21:20:15,084 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43211 3537s 2024-11-23 21:20:15,084 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:20:15,084 - distributed.worker - INFO - dashboard at: 127.0.0.1:37127 3537s 2024-11-23 21:20:15,085 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33155 3537s 2024-11-23 21:20:15,085 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:20:15,085 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:20:15,085 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:20:15,085 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-83c9whsn 3537s 2024-11-23 21:20:15,085 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:20:15,086 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38179. Reason: failure-to-start- 3537s 2024-11-23 21:20:15,086 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:20:15,087 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43211. Reason: failure-to-start- 3537s 2024-11-23 21:20:15,087 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:20:15,089 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33155': TLS handshake failed with remote 'tls://127.0.0.1:36800': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:20:15,089 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33155': TLS handshake failed with remote 'tls://127.0.0.1:36816': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:20:15,093 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:20:16,098 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:20:16,107 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37803 3537s 2024-11-23 21:20:16,107 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38827/status 3537s 2024-11-23 21:20:16,108 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:20:16,628 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46019 3537s 2024-11-23 21:20:16,632 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46019 3537s 2024-11-23 21:20:16,633 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:20:16,633 - distributed.worker - INFO - dashboard at: 127.0.0.1:40679 3537s 2024-11-23 21:20:16,633 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37803 3537s 2024-11-23 21:20:16,633 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:20:16,633 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:20:16,633 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:20:16,633 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-xksyxxm5 3537s 2024-11-23 21:20:16,633 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:20:16,635 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38225 3537s 2024-11-23 21:20:16,636 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38225 3537s 2024-11-23 21:20:16,636 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:20:16,636 - distributed.worker - INFO - dashboard at: 127.0.0.1:35847 3537s 2024-11-23 21:20:16,636 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37803 3537s 2024-11-23 21:20:16,636 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:20:16,636 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:20:16,636 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:20:16,636 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-uxgdg5q1 3537s 2024-11-23 21:20:16,636 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:20:16,653 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46019. Reason: failure-to-start- 3537s 2024-11-23 21:20:16,653 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:20:16,654 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38225. Reason: failure-to-start- 3537s 2024-11-23 21:20:16,654 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:20:16,656 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37803': TLS handshake failed with remote 'tls://127.0.0.1:41894': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:20:16,656 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37803': TLS handshake failed with remote 'tls://127.0.0.1:41910': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:20:16,658 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:20:17,664 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:20:17,671 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46475 3537s 2024-11-23 21:20:17,671 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40577/status 3537s 2024-11-23 21:20:17,672 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:20:17,687 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33755 3537s 2024-11-23 21:20:17,688 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33755 3537s 2024-11-23 21:20:17,688 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:20:17,688 - distributed.worker - INFO - dashboard at: 127.0.0.1:39345 3537s 2024-11-23 21:20:17,688 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46475 3537s 2024-11-23 21:20:17,688 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:20:17,688 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:20:17,688 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:20:17,688 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-uhmrayoh 3537s 2024-11-23 21:20:17,688 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:20:17,690 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46361 3537s 2024-11-23 21:20:17,691 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46361 3537s 2024-11-23 21:20:17,691 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:20:17,691 - distributed.worker - INFO - dashboard at: 127.0.0.1:39243 3537s 2024-11-23 21:20:17,691 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46475 3537s 2024-11-23 21:20:17,691 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:20:17,691 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:20:17,691 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:20:17,691 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-cywuv6ls 3537s 2024-11-23 21:20:17,691 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:20:17,692 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33755. Reason: failure-to-start- 3537s 2024-11-23 21:20:17,692 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:20:17,693 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46361. Reason: failure-to-start- 3537s 2024-11-23 21:20:17,693 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:20:17,694 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46475': TLS handshake failed with remote 'tls://127.0.0.1:45434': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:20:17,694 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46475': TLS handshake failed with remote 'tls://127.0.0.1:45442': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:20:17,696 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:20:18,701 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:20:18,709 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41941 3537s 2024-11-23 21:20:18,709 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42747/status 3537s 2024-11-23 21:20:18,710 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:20:18,726 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38713 3537s 2024-11-23 21:20:18,726 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38713 3537s 2024-11-23 21:20:18,727 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:20:18,727 - distributed.worker - INFO - dashboard at: 127.0.0.1:38925 3537s 2024-11-23 21:20:18,727 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41941 3537s 2024-11-23 21:20:18,727 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:20:18,727 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:20:18,727 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:20:18,727 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-mted62dn 3537s 2024-11-23 21:20:18,727 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:20:18,729 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33017 3537s 2024-11-23 21:20:18,729 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33017 3537s 2024-11-23 21:20:18,729 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:20:18,730 - distributed.worker - INFO - dashboard at: 127.0.0.1:46771 3537s 2024-11-23 21:20:18,730 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41941 3537s 2024-11-23 21:20:18,730 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:20:18,730 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:20:18,730 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:20:18,730 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-1p66vj2j 3537s 2024-11-23 21:20:18,730 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:20:18,731 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38713. Reason: failure-to-start- 3537s 2024-11-23 21:20:18,731 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:20:18,732 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33017. Reason: failure-to-start- 3537s 2024-11-23 21:20:18,732 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:20:18,733 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41941': TLS handshake failed with remote 'tls://127.0.0.1:33506': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:20:18,733 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41941': TLS handshake failed with remote 'tls://127.0.0.1:33516': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:20:18,735 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:20:19,741 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:20:19,749 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:32905 3537s 2024-11-23 21:20:19,749 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37447/status 3537s 2024-11-23 21:20:19,749 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:20:19,763 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35101 3537s 2024-11-23 21:20:19,764 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35101 3537s 2024-11-23 21:20:19,764 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:20:19,764 - distributed.worker - INFO - dashboard at: 127.0.0.1:42637 3537s 2024-11-23 21:20:19,764 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:32905 3537s 2024-11-23 21:20:19,764 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:20:19,764 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:20:19,764 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:20:19,764 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-7chmnjzr 3537s 2024-11-23 21:20:19,764 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:20:19,766 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45965 3537s 2024-11-23 21:20:19,766 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45965 3537s 2024-11-23 21:20:19,766 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:20:19,766 - distributed.worker - INFO - dashboard at: 127.0.0.1:43787 3537s 2024-11-23 21:20:19,767 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:32905 3537s 2024-11-23 21:20:19,767 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:20:19,767 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:20:19,767 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:20:19,767 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-40z75lrr 3537s 2024-11-23 21:20:19,767 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:20:19,771 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35101. Reason: failure-to-start- 3537s 2024-11-23 21:20:19,771 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:20:19,772 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45965. Reason: failure-to-start- 3537s 2024-11-23 21:20:19,772 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:20:19,773 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:32905': TLS handshake failed with remote 'tls://127.0.0.1:44140': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:20:19,774 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:32905': TLS handshake failed with remote 'tls://127.0.0.1:44150': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:20:19,775 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:20:20,781 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:20:20,788 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43567 3537s 2024-11-23 21:20:20,788 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46393/status 3537s 2024-11-23 21:20:20,788 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:20:20,803 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34683 3537s 2024-11-23 21:20:20,804 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34683 3537s 2024-11-23 21:20:20,804 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:20:20,804 - distributed.worker - INFO - dashboard at: 127.0.0.1:46711 3537s 2024-11-23 21:20:20,804 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43567 3537s 2024-11-23 21:20:20,804 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:20:20,804 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:20:20,804 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:20:20,804 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-rkytupig 3537s 2024-11-23 21:20:20,804 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:20:20,806 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39371 3537s 2024-11-23 21:20:20,806 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39371 3537s 2024-11-23 21:20:20,806 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:20:20,806 - distributed.worker - INFO - dashboard at: 127.0.0.1:45287 3537s 2024-11-23 21:20:20,807 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43567 3537s 2024-11-23 21:20:20,807 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:20:20,807 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:20:20,807 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:20:20,807 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-o03nntk6 3537s 2024-11-23 21:20:20,807 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:20:20,808 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34683. Reason: failure-to-start- 3537s 2024-11-23 21:20:20,808 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:20:20,809 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39371. Reason: failure-to-start- 3537s 2024-11-23 21:20:20,809 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:20:20,812 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43567': TLS handshake failed with remote 'tls://127.0.0.1:55546': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:20:20,812 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43567': TLS handshake failed with remote 'tls://127.0.0.1:55556': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:20:20,814 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:20:21,819 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:20:21,828 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40385 3537s 2024-11-23 21:20:21,829 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33729/status 3537s 2024-11-23 21:20:21,829 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:20:21,844 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36633 3537s 2024-11-23 21:20:21,844 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36633 3537s 2024-11-23 21:20:21,844 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:20:21,844 - distributed.worker - INFO - dashboard at: 127.0.0.1:41395 3537s 2024-11-23 21:20:21,844 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40385 3537s 2024-11-23 21:20:21,844 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:20:21,844 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:20:21,844 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:20:21,844 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-1m9su8_f 3537s 2024-11-23 21:20:21,844 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:20:21,847 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46697 3537s 2024-11-23 21:20:21,847 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46697 3537s 2024-11-23 21:20:21,847 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:20:21,847 - distributed.worker - INFO - dashboard at: 127.0.0.1:40619 3537s 2024-11-23 21:20:21,847 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40385 3537s 2024-11-23 21:20:21,847 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:20:21,847 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:20:21,847 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:20:21,847 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-mfc3otks 3537s 2024-11-23 21:20:21,847 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:20:21,851 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36633. Reason: failure-to-start- 3537s 2024-11-23 21:20:21,851 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:20:21,851 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46697. Reason: failure-to-start- 3537s 2024-11-23 21:20:21,851 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:20:21,853 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40385': TLS handshake failed with remote 'tls://127.0.0.1:42010': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:20:21,853 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40385': TLS handshake failed with remote 'tls://127.0.0.1:42018': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:20:21,855 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:20:22,860 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:20:22,868 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33055 3537s 2024-11-23 21:20:22,868 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41111/status 3537s 2024-11-23 21:20:22,868 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:20:22,893 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40241 3537s 2024-11-23 21:20:22,893 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40241 3537s 2024-11-23 21:20:22,894 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:20:22,894 - distributed.worker - INFO - dashboard at: 127.0.0.1:46823 3537s 2024-11-23 21:20:22,894 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33055 3537s 2024-11-23 21:20:22,894 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:20:22,894 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:20:22,894 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:20:22,894 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-t62mt55f 3537s 2024-11-23 21:20:22,894 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:20:22,896 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36507 3537s 2024-11-23 21:20:22,896 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36507 3537s 2024-11-23 21:20:22,896 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:20:22,896 - distributed.worker - INFO - dashboard at: 127.0.0.1:40935 3537s 2024-11-23 21:20:22,897 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33055 3537s 2024-11-23 21:20:22,897 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:20:22,897 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:20:22,897 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:20:22,897 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-lrgepntm 3537s 2024-11-23 21:20:22,897 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:20:22,900 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40241. Reason: failure-to-start- 3537s 2024-11-23 21:20:22,901 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:20:22,901 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36507. Reason: failure-to-start- 3537s 2024-11-23 21:20:22,901 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:20:22,903 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33055': TLS handshake failed with remote 'tls://127.0.0.1:48382': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:20:22,903 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33055': TLS handshake failed with remote 'tls://127.0.0.1:48396': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:20:22,904 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:20:23,911 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:20:23,918 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40691 3537s 2024-11-23 21:20:23,918 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39845/status 3537s 2024-11-23 21:20:23,919 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:20:23,934 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40265 3537s 2024-11-23 21:20:23,934 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40265 3537s 2024-11-23 21:20:23,934 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:20:23,934 - distributed.worker - INFO - dashboard at: 127.0.0.1:44683 3537s 2024-11-23 21:20:23,934 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40691 3537s 2024-11-23 21:20:23,934 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:20:23,934 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:20:23,934 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:20:23,934 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-m0r8be_6 3537s 2024-11-23 21:20:23,934 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:20:23,938 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46369 3537s 2024-11-23 21:20:23,938 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46369 3537s 2024-11-23 21:20:23,938 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:20:23,938 - distributed.worker - INFO - dashboard at: 127.0.0.1:38551 3537s 2024-11-23 21:20:23,938 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40691 3537s 2024-11-23 21:20:23,938 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:20:23,938 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:20:23,938 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:20:23,938 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-41loxt84 3537s 2024-11-23 21:20:23,938 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:20:23,942 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40265. Reason: failure-to-start- 3537s 2024-11-23 21:20:23,942 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:20:23,943 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46369. Reason: failure-to-start- 3537s 2024-11-23 21:20:23,943 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:20:23,944 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40691': TLS handshake failed with remote 'tls://127.0.0.1:56290': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:20:23,945 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40691': TLS handshake failed with remote 'tls://127.0.0.1:56296': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:20:23,946 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:20:24,952 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:20:24,959 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34085 3537s 2024-11-23 21:20:24,960 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38237/status 3537s 2024-11-23 21:20:24,960 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:20:24,977 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42913 3537s 2024-11-23 21:20:24,977 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42913 3537s 2024-11-23 21:20:24,977 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:20:24,977 - distributed.worker - INFO - dashboard at: 127.0.0.1:38971 3537s 2024-11-23 21:20:24,977 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34085 3537s 2024-11-23 21:20:24,977 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:20:24,977 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:20:24,977 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:20:24,977 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-1pyz4w0t 3537s 2024-11-23 21:20:24,978 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:20:24,980 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37239 3537s 2024-11-23 21:20:24,980 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37239 3537s 2024-11-23 21:20:24,980 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:20:24,980 - distributed.worker - INFO - dashboard at: 127.0.0.1:38277 3537s 2024-11-23 21:20:24,980 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34085 3537s 2024-11-23 21:20:24,980 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:20:24,980 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:20:24,980 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:20:24,981 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-7ebunyn4 3537s 2024-11-23 21:20:24,981 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:20:24,986 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42913. Reason: failure-to-start- 3537s 2024-11-23 21:20:24,986 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:20:24,987 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37239. Reason: failure-to-start- 3537s 2024-11-23 21:20:24,987 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:20:24,988 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34085': TLS handshake failed with remote 'tls://127.0.0.1:53048': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:20:24,988 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34085': TLS handshake failed with remote 'tls://127.0.0.1:53056': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:20:24,990 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:20:25,996 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:20:26,003 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41975 3537s 2024-11-23 21:20:26,003 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39727/status 3537s 2024-11-23 21:20:26,004 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:20:26,019 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38357 3537s 2024-11-23 21:20:26,019 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38357 3537s 2024-11-23 21:20:26,019 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:20:26,019 - distributed.worker - INFO - dashboard at: 127.0.0.1:39921 3537s 2024-11-23 21:20:26,019 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41975 3537s 2024-11-23 21:20:26,019 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:20:26,019 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:20:26,019 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:20:26,019 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-hzf9kx_d 3537s 2024-11-23 21:20:26,020 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:20:26,022 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33433 3537s 2024-11-23 21:20:26,022 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33433 3537s 2024-11-23 21:20:26,022 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:20:26,022 - distributed.worker - INFO - dashboard at: 127.0.0.1:37559 3537s 2024-11-23 21:20:26,022 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41975 3537s 2024-11-23 21:20:26,022 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:20:26,022 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:20:26,022 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:20:26,022 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-4lk8ger0 3537s 2024-11-23 21:20:26,022 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:20:26,027 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38357. Reason: failure-to-start- 3537s 2024-11-23 21:20:26,028 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:20:26,028 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33433. Reason: failure-to-start- 3537s 2024-11-23 21:20:26,028 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:20:26,030 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41975': TLS handshake failed with remote 'tls://127.0.0.1:51370': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:20:26,030 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41975': TLS handshake failed with remote 'tls://127.0.0.1:51386': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:20:26,032 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:20:27,039 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:20:27,047 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33609 3537s 2024-11-23 21:20:27,047 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40493/status 3537s 2024-11-23 21:20:27,048 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:20:27,062 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35139 3537s 2024-11-23 21:20:27,063 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35139 3537s 2024-11-23 21:20:27,063 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:20:27,063 - distributed.worker - INFO - dashboard at: 127.0.0.1:46855 3537s 2024-11-23 21:20:27,063 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33609 3537s 2024-11-23 21:20:27,063 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:20:27,063 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:20:27,063 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:20:27,063 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-kjkt_fda 3537s 2024-11-23 21:20:27,063 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:20:27,065 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35389 3537s 2024-11-23 21:20:27,066 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35389 3537s 2024-11-23 21:20:27,066 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:20:27,066 - distributed.worker - INFO - dashboard at: 127.0.0.1:46395 3537s 2024-11-23 21:20:27,066 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33609 3537s 2024-11-23 21:20:27,066 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:20:27,066 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:20:27,066 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:20:27,066 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-dbmt91b5 3537s 2024-11-23 21:20:27,066 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:20:27,067 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35139. Reason: failure-to-start- 3537s 2024-11-23 21:20:27,068 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:20:27,068 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35389. Reason: failure-to-start- 3537s 2024-11-23 21:20:27,068 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:20:27,072 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33609': TLS handshake failed with remote 'tls://127.0.0.1:42922': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:20:27,072 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33609': TLS handshake failed with remote 'tls://127.0.0.1:42930': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:20:27,074 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:20:28,080 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:20:28,087 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34843 3537s 2024-11-23 21:20:28,087 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41509/status 3537s 2024-11-23 21:20:28,088 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:20:28,103 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39719 3537s 2024-11-23 21:20:28,103 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39719 3537s 2024-11-23 21:20:28,103 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:20:28,103 - distributed.worker - INFO - dashboard at: 127.0.0.1:33985 3537s 2024-11-23 21:20:28,103 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34843 3537s 2024-11-23 21:20:28,104 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:20:28,104 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:20:28,104 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:20:28,104 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-8rujlk3a 3537s 2024-11-23 21:20:28,104 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:20:28,106 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36311 3537s 2024-11-23 21:20:28,106 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36311 3537s 2024-11-23 21:20:28,106 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:20:28,106 - distributed.worker - INFO - dashboard at: 127.0.0.1:38243 3537s 2024-11-23 21:20:28,106 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34843 3537s 2024-11-23 21:20:28,106 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:20:28,106 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:20:28,106 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:20:28,107 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-efl2t54g 3537s 2024-11-23 21:20:28,107 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:20:28,108 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39719. Reason: failure-to-start- 3537s 2024-11-23 21:20:28,108 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:20:28,108 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36311. Reason: failure-to-start- 3537s 2024-11-23 21:20:28,108 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:20:28,110 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34843': TLS handshake failed with remote 'tls://127.0.0.1:38804': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:20:28,110 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34843': TLS handshake failed with remote 'tls://127.0.0.1:38816': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:20:28,114 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:20:29,120 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:20:29,126 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43013 3537s 2024-11-23 21:20:29,127 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:32981/status 3537s 2024-11-23 21:20:29,127 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:20:29,143 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37281 3537s 2024-11-23 21:20:29,143 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37281 3537s 2024-11-23 21:20:29,143 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:20:29,143 - distributed.worker - INFO - dashboard at: 127.0.0.1:38439 3537s 2024-11-23 21:20:29,143 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43013 3537s 2024-11-23 21:20:29,143 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:20:29,143 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:20:29,143 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:20:29,143 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-_c77dk4n 3537s 2024-11-23 21:20:29,144 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:20:29,146 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39455 3537s 2024-11-23 21:20:29,146 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39455 3537s 2024-11-23 21:20:29,146 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:20:29,146 - distributed.worker - INFO - dashboard at: 127.0.0.1:43389 3537s 2024-11-23 21:20:29,146 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43013 3537s 2024-11-23 21:20:29,146 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:20:29,146 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:20:29,146 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:20:29,146 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-y71o8tb2 3537s 2024-11-23 21:20:29,146 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:20:29,148 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37281. Reason: failure-to-start- 3537s 2024-11-23 21:20:29,148 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:20:29,148 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39455. Reason: failure-to-start- 3537s 2024-11-23 21:20:29,148 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:20:29,150 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43013': TLS handshake failed with remote 'tls://127.0.0.1:39364': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:20:29,150 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43013': TLS handshake failed with remote 'tls://127.0.0.1:39372': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:20:29,151 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:20:30,158 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:20:30,165 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42037 3537s 2024-11-23 21:20:30,165 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37947/status 3537s 2024-11-23 21:20:30,166 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:20:30,180 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45071 3537s 2024-11-23 21:20:30,180 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45071 3537s 2024-11-23 21:20:30,181 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:20:30,181 - distributed.worker - INFO - dashboard at: 127.0.0.1:35823 3537s 2024-11-23 21:20:30,181 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42037 3537s 2024-11-23 21:20:30,181 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:20:30,181 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:20:30,181 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:20:30,181 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-8ztu2fmt 3537s 2024-11-23 21:20:30,181 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:20:30,183 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43343 3537s 2024-11-23 21:20:30,183 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43343 3537s 2024-11-23 21:20:30,183 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:20:30,183 - distributed.worker - INFO - dashboard at: 127.0.0.1:44719 3537s 2024-11-23 21:20:30,183 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42037 3537s 2024-11-23 21:20:30,183 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:20:30,183 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:20:30,184 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:20:30,184 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-8wumu63k 3537s 2024-11-23 21:20:30,184 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:20:30,188 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45071. Reason: failure-to-start- 3537s 2024-11-23 21:20:30,189 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:20:30,189 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43343. Reason: failure-to-start- 3537s 2024-11-23 21:20:30,189 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:20:30,191 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42037': TLS handshake failed with remote 'tls://127.0.0.1:39924': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:20:30,191 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42037': TLS handshake failed with remote 'tls://127.0.0.1:39934': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:20:30,193 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:20:31,199 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:20:31,206 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34561 3537s 2024-11-23 21:20:31,206 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41291/status 3537s 2024-11-23 21:20:31,206 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:20:31,221 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42625 3537s 2024-11-23 21:20:31,221 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42625 3537s 2024-11-23 21:20:31,221 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:20:31,221 - distributed.worker - INFO - dashboard at: 127.0.0.1:35361 3537s 2024-11-23 21:20:31,221 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34561 3537s 2024-11-23 21:20:31,221 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:20:31,222 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:20:31,222 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:20:31,222 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-901hx0e9 3537s 2024-11-23 21:20:31,222 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:20:31,224 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39993 3537s 2024-11-23 21:20:31,224 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39993 3537s 2024-11-23 21:20:31,224 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:20:31,224 - distributed.worker - INFO - dashboard at: 127.0.0.1:35111 3537s 2024-11-23 21:20:31,224 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34561 3537s 2024-11-23 21:20:31,224 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:20:31,224 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:20:31,224 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:20:31,224 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-bcb7pzu1 3537s 2024-11-23 21:20:31,224 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:20:31,228 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42625. Reason: failure-to-start- 3537s 2024-11-23 21:20:31,228 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:20:31,229 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39993. Reason: failure-to-start- 3537s 2024-11-23 21:20:31,229 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:20:31,230 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34561': TLS handshake failed with remote 'tls://127.0.0.1:54716': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:20:31,231 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34561': TLS handshake failed with remote 'tls://127.0.0.1:54726': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:20:31,232 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:20:32,256 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:20:32,264 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38125 3537s 2024-11-23 21:20:32,265 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45509/status 3537s 2024-11-23 21:20:32,265 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:20:32,285 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40445 3537s 2024-11-23 21:20:32,285 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40445 3537s 2024-11-23 21:20:32,285 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:20:32,285 - distributed.worker - INFO - dashboard at: 127.0.0.1:43535 3537s 2024-11-23 21:20:32,285 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38125 3537s 2024-11-23 21:20:32,285 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:20:32,285 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:20:32,285 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:20:32,286 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-_63p4aor 3537s 2024-11-23 21:20:32,286 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:20:32,288 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40629 3537s 2024-11-23 21:20:32,288 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40629 3537s 2024-11-23 21:20:32,288 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:20:32,288 - distributed.worker - INFO - dashboard at: 127.0.0.1:44381 3537s 2024-11-23 21:20:32,288 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38125 3537s 2024-11-23 21:20:32,288 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:20:32,288 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:20:32,288 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:20:32,288 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-6dawxcwi 3537s 2024-11-23 21:20:32,288 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:20:32,290 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40445. Reason: failure-to-start- 3537s 2024-11-23 21:20:32,290 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:20:32,290 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40629. Reason: failure-to-start- 3537s 2024-11-23 21:20:32,290 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:20:32,294 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38125': TLS handshake failed with remote 'tls://127.0.0.1:44976': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:20:32,294 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38125': TLS handshake failed with remote 'tls://127.0.0.1:44982': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:20:32,296 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:20:33,301 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:20:33,309 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45037 3537s 2024-11-23 21:20:33,309 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46209/status 3537s 2024-11-23 21:20:33,309 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:20:33,330 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39619 3537s 2024-11-23 21:20:33,330 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39619 3537s 2024-11-23 21:20:33,330 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:20:33,330 - distributed.worker - INFO - dashboard at: 127.0.0.1:43171 3537s 2024-11-23 21:20:33,330 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 3537s 2024-11-23 21:20:33,330 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:20:33,330 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:20:33,330 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:20:33,330 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ynx4aa50 3537s 2024-11-23 21:20:33,330 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:20:33,332 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39365 3537s 2024-11-23 21:20:33,333 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39365 3537s 2024-11-23 21:20:33,333 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:20:33,333 - distributed.worker - INFO - dashboard at: 127.0.0.1:36137 3537s 2024-11-23 21:20:33,333 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 3537s 2024-11-23 21:20:33,333 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:20:33,333 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:20:33,333 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:20:33,333 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-cwcsdxdz 3537s 2024-11-23 21:20:33,333 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:20:33,334 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39619. Reason: failure-to-start- 3537s 2024-11-23 21:20:33,334 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:20:33,335 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39365. Reason: failure-to-start- 3537s 2024-11-23 21:20:33,335 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:20:33,339 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:60184': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:20:33,339 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:60186': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:20:33,343 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:20:34,349 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:20:34,356 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35403 3537s 2024-11-23 21:20:34,356 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38059/status 3537s 2024-11-23 21:20:34,356 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:20:34,371 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39359 3537s 2024-11-23 21:20:34,371 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39359 3537s 2024-11-23 21:20:34,371 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:20:34,371 - distributed.worker - INFO - dashboard at: 127.0.0.1:36211 3537s 2024-11-23 21:20:34,371 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35403 3537s 2024-11-23 21:20:34,371 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:20:34,371 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:20:34,371 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:20:34,372 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-39q0mofx 3537s 2024-11-23 21:20:34,372 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:20:34,375 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33451 3537s 2024-11-23 21:20:34,375 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33451 3537s 2024-11-23 21:20:34,375 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:20:34,375 - distributed.worker - INFO - dashboard at: 127.0.0.1:38645 3537s 2024-11-23 21:20:34,375 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35403 3537s 2024-11-23 21:20:34,375 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:20:34,375 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:20:34,375 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:20:34,375 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ryqaa3k2 3537s 2024-11-23 21:20:34,375 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:20:34,379 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39359. Reason: failure-to-start- 3537s 2024-11-23 21:20:34,379 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:20:34,379 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33451. Reason: failure-to-start- 3537s 2024-11-23 21:20:34,380 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:20:34,381 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35403': TLS handshake failed with remote 'tls://127.0.0.1:43406': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:20:34,381 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35403': TLS handshake failed with remote 'tls://127.0.0.1:43420': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:20:34,383 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:20:35,388 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:20:35,395 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35009 3537s 2024-11-23 21:20:35,395 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44059/status 3537s 2024-11-23 21:20:35,396 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:20:35,411 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42777 3537s 2024-11-23 21:20:35,411 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42777 3537s 2024-11-23 21:20:35,411 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:20:35,411 - distributed.worker - INFO - dashboard at: 127.0.0.1:42791 3537s 2024-11-23 21:20:35,411 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35009 3537s 2024-11-23 21:20:35,411 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:20:35,411 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:20:35,411 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:20:35,411 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-xlpq8uyu 3537s 2024-11-23 21:20:35,411 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:20:35,413 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36685 3537s 2024-11-23 21:20:35,414 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36685 3537s 2024-11-23 21:20:35,414 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:20:35,414 - distributed.worker - INFO - dashboard at: 127.0.0.1:42907 3537s 2024-11-23 21:20:35,414 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35009 3537s 2024-11-23 21:20:35,414 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:20:35,414 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:20:35,414 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:20:35,414 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-wo39ufz8 3537s 2024-11-23 21:20:35,414 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:20:35,415 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42777. Reason: failure-to-start- 3537s 2024-11-23 21:20:35,415 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:20:35,416 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36685. Reason: failure-to-start- 3537s 2024-11-23 21:20:35,416 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:20:35,417 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35009': TLS handshake failed with remote 'tls://127.0.0.1:49042': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:20:35,418 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35009': TLS handshake failed with remote 'tls://127.0.0.1:49048': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:20:35,419 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:20:36,427 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:20:36,435 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37249 3537s 2024-11-23 21:20:36,435 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42289/status 3537s 2024-11-23 21:20:36,436 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:20:36,453 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44805 3537s 2024-11-23 21:20:36,454 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44805 3537s 2024-11-23 21:20:36,454 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:20:36,454 - distributed.worker - INFO - dashboard at: 127.0.0.1:41041 3537s 2024-11-23 21:20:36,454 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37249 3537s 2024-11-23 21:20:36,454 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:20:36,454 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:20:36,454 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:20:36,454 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-biyn8s4u 3537s 2024-11-23 21:20:36,454 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:20:36,456 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40941 3537s 2024-11-23 21:20:36,456 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40941 3537s 2024-11-23 21:20:36,456 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:20:36,457 - distributed.worker - INFO - dashboard at: 127.0.0.1:35125 3537s 2024-11-23 21:20:36,457 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37249 3537s 2024-11-23 21:20:36,457 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:20:36,457 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:20:36,457 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:20:36,457 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-uedom93b 3537s 2024-11-23 21:20:36,457 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:20:36,458 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44805. Reason: failure-to-start- 3537s 2024-11-23 21:20:36,458 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:20:36,459 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40941. Reason: failure-to-start- 3537s 2024-11-23 21:20:36,459 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:20:36,460 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37249': TLS handshake failed with remote 'tls://127.0.0.1:42588': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:20:36,461 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37249': TLS handshake failed with remote 'tls://127.0.0.1:42596': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:20:36,465 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:20:37,471 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:20:37,479 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41777 3537s 2024-11-23 21:20:37,480 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43161/status 3537s 2024-11-23 21:20:37,482 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:20:37,500 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42559 3537s 2024-11-23 21:20:37,501 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42559 3537s 2024-11-23 21:20:37,501 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:20:37,501 - distributed.worker - INFO - dashboard at: 127.0.0.1:35985 3537s 2024-11-23 21:20:37,501 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41777 3537s 2024-11-23 21:20:37,501 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:20:37,501 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:20:37,501 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:20:37,501 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-lf0bqok1 3537s 2024-11-23 21:20:37,501 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:20:37,503 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34937 3537s 2024-11-23 21:20:37,503 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34937 3537s 2024-11-23 21:20:37,503 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:20:37,503 - distributed.worker - INFO - dashboard at: 127.0.0.1:34429 3537s 2024-11-23 21:20:37,503 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41777 3537s 2024-11-23 21:20:37,504 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:20:37,504 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:20:37,504 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:20:37,504 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-wanrxzuu 3537s 2024-11-23 21:20:37,504 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:20:37,505 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42559. Reason: failure-to-start- 3537s 2024-11-23 21:20:37,505 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:20:37,506 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34937. Reason: failure-to-start- 3537s 2024-11-23 21:20:37,506 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:20:37,510 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41777': TLS handshake failed with remote 'tls://127.0.0.1:53034': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:20:37,510 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41777': TLS handshake failed with remote 'tls://127.0.0.1:53042': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:20:37,512 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:20:38,518 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:20:38,525 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38063 3537s 2024-11-23 21:20:38,525 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38311/status 3537s 2024-11-23 21:20:38,525 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:20:38,540 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40943 3537s 2024-11-23 21:20:38,540 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40943 3537s 2024-11-23 21:20:38,540 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:20:38,540 - distributed.worker - INFO - dashboard at: 127.0.0.1:46719 3537s 2024-11-23 21:20:38,541 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38063 3537s 2024-11-23 21:20:38,541 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:20:38,541 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:20:38,541 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:20:38,541 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-n1o659ye 3537s 2024-11-23 21:20:38,541 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:20:38,544 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38319 3537s 2024-11-23 21:20:38,545 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38319 3537s 2024-11-23 21:20:38,545 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:20:38,545 - distributed.worker - INFO - dashboard at: 127.0.0.1:35573 3537s 2024-11-23 21:20:38,545 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38063 3537s 2024-11-23 21:20:38,545 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:20:38,545 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:20:38,545 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:20:38,545 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-0b400mzb 3537s 2024-11-23 21:20:38,545 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:20:38,546 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40943. Reason: failure-to-start- 3537s 2024-11-23 21:20:38,546 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:20:38,547 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38319. Reason: failure-to-start- 3537s 2024-11-23 21:20:38,547 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:20:38,549 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38063': TLS handshake failed with remote 'tls://127.0.0.1:42370': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:20:38,549 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38063': TLS handshake failed with remote 'tls://127.0.0.1:42386': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:20:38,553 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:20:39,559 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:20:39,567 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40899 3537s 2024-11-23 21:20:39,567 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38487/status 3537s 2024-11-23 21:20:39,567 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:20:39,586 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38865 3537s 2024-11-23 21:20:39,586 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38865 3537s 2024-11-23 21:20:39,586 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:20:39,586 - distributed.worker - INFO - dashboard at: 127.0.0.1:34433 3537s 2024-11-23 21:20:39,586 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40899 3537s 2024-11-23 21:20:39,586 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:20:39,586 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:20:39,586 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:20:39,587 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-kedgj1x7 3537s 2024-11-23 21:20:39,587 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:20:39,589 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40409 3537s 2024-11-23 21:20:39,589 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40409 3537s 2024-11-23 21:20:39,589 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:20:39,589 - distributed.worker - INFO - dashboard at: 127.0.0.1:34601 3537s 2024-11-23 21:20:39,589 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40899 3537s 2024-11-23 21:20:39,589 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:20:39,589 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:20:39,589 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:20:39,590 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-gexofi_c 3537s 2024-11-23 21:20:39,590 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:20:39,592 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38865. Reason: failure-to-start- 3537s 2024-11-23 21:20:39,593 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:20:39,593 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40409. Reason: failure-to-start- 3537s 2024-11-23 21:20:39,593 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:20:39,598 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40899': TLS handshake failed with remote 'tls://127.0.0.1:39868': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:20:39,598 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40899': TLS handshake failed with remote 'tls://127.0.0.1:39870': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:20:39,600 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s ______________________________ test_work_stealing ______________________________ 3537s 3537s fut = , timeout = 0 3537s 3537s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 3537s async with asyncio.timeout(timeout): 3537s > return await fut 3537s 3537s /usr/lib/python3/dist-packages/distributed/utils.py:1960: 3537s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3537s /usr/lib/python3/dist-packages/distributed/worker.py:1480: in start_unsafe 3537s await self._register_with_scheduler() 3537s /usr/lib/python3/dist-packages/distributed/worker.py:1179: in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s /usr/lib/python3/dist-packages/distributed/comm/core.py:342: in connect 3537s comm = await wait_for( 3537s /usr/lib/python3/dist-packages/distributed/utils.py:1960: in wait_for 3537s return await fut 3537s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:546: in connect 3537s stream = await self.client.connect( 3537s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3537s 3537s self = , host = '127.0.0.1' 3537s port = 35165, af = 3537s ssl_options = 3537s max_buffer_size = 8364507136.0, source_ip = None, source_port = None 3537s timeout = None 3537s 3537s async def connect( 3537s self, 3537s host: str, 3537s port: int, 3537s af: socket.AddressFamily = socket.AF_UNSPEC, 3537s ssl_options: Optional[Union[Dict[str, Any], ssl.SSLContext]] = None, 3537s max_buffer_size: Optional[int] = None, 3537s source_ip: Optional[str] = None, 3537s source_port: Optional[int] = None, 3537s timeout: Optional[Union[float, datetime.timedelta]] = None, 3537s ) -> IOStream: 3537s """Connect to the given host and port. 3537s 3537s Asynchronously returns an `.IOStream` (or `.SSLIOStream` if 3537s ``ssl_options`` is not None). 3537s 3537s Using the ``source_ip`` kwarg, one can specify the source 3537s IP address to use when establishing the connection. 3537s In case the user needs to resolve and 3537s use a specific interface, it has to be handled outside 3537s of Tornado as this depends very much on the platform. 3537s 3537s Raises `TimeoutError` if the input future does not complete before 3537s ``timeout``, which may be specified in any form allowed by 3537s `.IOLoop.add_timeout` (i.e. a `datetime.timedelta` or an absolute time 3537s relative to `.IOLoop.time`) 3537s 3537s Similarly, when the user requires a certain source port, it can 3537s be specified using the ``source_port`` arg. 3537s 3537s .. versionchanged:: 4.5 3537s Added the ``source_ip`` and ``source_port`` arguments. 3537s 3537s .. versionchanged:: 5.0 3537s Added the ``timeout`` argument. 3537s """ 3537s if timeout is not None: 3537s if isinstance(timeout, numbers.Real): 3537s timeout = IOLoop.current().time() + timeout 3537s elif isinstance(timeout, datetime.timedelta): 3537s timeout = IOLoop.current().time() + timeout.total_seconds() 3537s else: 3537s raise TypeError("Unsupported timeout %r" % timeout) 3537s if timeout is not None: 3537s addrinfo = await gen.with_timeout( 3537s timeout, self.resolver.resolve(host, port, af) 3537s ) 3537s else: 3537s addrinfo = await self.resolver.resolve(host, port, af) 3537s connector = _Connector( 3537s addrinfo, 3537s functools.partial( 3537s self._create_stream, 3537s max_buffer_size, 3537s source_ip=source_ip, 3537s source_port=source_port, 3537s ), 3537s ) 3537s > af, addr, stream = await connector.start(connect_timeout=timeout) 3537s E asyncio.exceptions.CancelledError 3537s 3537s /usr/lib/python3/dist-packages/tornado/tcpclient.py:279: CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s self = 3537s 3537s @final 3537s async def start(self): 3537s async with self._startup_lock: 3537s if self.status == Status.failed: 3537s assert self.__startup_exc is not None 3537s raise self.__startup_exc 3537s elif self.status != Status.init: 3537s return self 3537s timeout = getattr(self, "death_timeout", None) 3537s 3537s async def _close_on_failure(exc: Exception) -> None: 3537s await self.close(reason=f"failure-to-start-{str(type(exc))}") 3537s self.status = Status.failed 3537s self.__startup_exc = exc 3537s 3537s try: 3537s > await wait_for(self.start_unsafe(), timeout=timeout) 3537s 3537s /usr/lib/python3/dist-packages/distributed/core.py:664: 3537s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3537s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 3537s async with asyncio.timeout(timeout): 3537s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3537s 3537s self = 3537s exc_type = 3537s exc_val = CancelledError(), exc_tb = 3537s 3537s async def __aexit__( 3537s self, 3537s exc_type: Optional[Type[BaseException]], 3537s exc_val: Optional[BaseException], 3537s exc_tb: Optional[TracebackType], 3537s ) -> Optional[bool]: 3537s assert self._state in (_State.ENTERED, _State.EXPIRING) 3537s 3537s if self._timeout_handler is not None: 3537s self._timeout_handler.cancel() 3537s self._timeout_handler = None 3537s 3537s if self._state is _State.EXPIRING: 3537s self._state = _State.EXPIRED 3537s 3537s if self._task.uncancel() <= self._cancelling and exc_type is not None: 3537s # Since there are no new cancel requests, we're 3537s # handling this. 3537s if issubclass(exc_type, exceptions.CancelledError): 3537s > raise TimeoutError from exc_val 3537s E TimeoutError 3537s 3537s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s @contextlib.asynccontextmanager 3537s async def _cluster_factory(): 3537s workers = [] 3537s s = None 3537s try: 3537s for _ in range(60): 3537s try: 3537s > s, ws = await start_cluster( 3537s nthreads, 3537s scheduler, 3537s security=security, 3537s Worker=Worker, 3537s scheduler_kwargs=scheduler_kwargs, 3537s worker_kwargs=merge( 3537s {"death_timeout": min(15, int(deadline.remaining))}, 3537s worker_kwargs, 3537s ), 3537s ) 3537s 3537s /usr/lib/python3/dist-packages/distributed/utils_test.py:966: 3537s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3537s /usr/lib/python3/dist-packages/distributed/utils_test.py:789: in start_cluster 3537s await asyncio.gather(*workers) 3537s /usr/lib/python3.13/asyncio/tasks.py:737: in _wrap_awaitable 3537s return await awaitable 3537s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3537s 3537s self = 3537s 3537s @final 3537s async def start(self): 3537s async with self._startup_lock: 3537s if self.status == Status.failed: 3537s assert self.__startup_exc is not None 3537s raise self.__startup_exc 3537s elif self.status != Status.init: 3537s return self 3537s timeout = getattr(self, "death_timeout", None) 3537s 3537s async def _close_on_failure(exc: Exception) -> None: 3537s await self.close(reason=f"failure-to-start-{str(type(exc))}") 3537s self.status = Status.failed 3537s self.__startup_exc = exc 3537s 3537s try: 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s except asyncio.TimeoutError as exc: 3537s await _close_on_failure(exc) 3537s > raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s E TimeoutError: Worker start timed out after 0s. 3537s 3537s /usr/lib/python3/dist-packages/distributed/core.py:667: TimeoutError 3537s 3537s During handling of the above exception, another exception occurred: 3537s 3537s fut = ._..test_func..async_fn at 0xe247cb08> 3537s timeout = 60 3537s 3537s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 3537s async with asyncio.timeout(timeout): 3537s > return await fut 3537s 3537s /usr/lib/python3/dist-packages/distributed/utils.py:1960: 3537s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3537s /usr/lib/python3/dist-packages/distributed/utils_test.py:999: in async_fn 3537s _cluster_factory() as (s, workers), 3537s /usr/lib/python3.13/contextlib.py:214: in __aenter__ 3537s return await anext(self.gen) 3537s /usr/lib/python3/dist-packages/distributed/utils_test.py:983: in _cluster_factory 3537s await asyncio.sleep(1) 3537s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3537s 3537s delay = 1, result = None 3537s 3537s async def sleep(delay, result=None): 3537s """Coroutine that completes after a given time (in seconds).""" 3537s if delay <= 0: 3537s await __sleep0() 3537s return result 3537s 3537s if math.isnan(delay): 3537s raise ValueError("Invalid delay: NaN (not a number)") 3537s 3537s loop = events.get_running_loop() 3537s future = loop.create_future() 3537s h = loop.call_later(delay, 3537s futures._set_result_unless_cancelled, 3537s future, result) 3537s try: 3537s > return await future 3537s E asyncio.exceptions.CancelledError 3537s 3537s /usr/lib/python3.13/asyncio/tasks.py:718: CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s args = (), kwds = {} 3537s 3537s @wraps(func) 3537s def inner(*args, **kwds): 3537s with self._recreate_cm(): 3537s > return func(*args, **kwds) 3537s 3537s /usr/lib/python3.13/contextlib.py:85: 3537s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3537s /usr/lib/python3.13/contextlib.py:85: in inner 3537s return func(*args, **kwds) 3537s /usr/lib/python3/dist-packages/distributed/utils_test.py:1102: in test_func 3537s return _run_and_close_tornado(async_fn_outer) 3537s /usr/lib/python3/dist-packages/distributed/utils_test.py:378: in _run_and_close_tornado 3537s return asyncio_run(inner_fn(), loop_factory=get_loop_factory()) 3537s /usr/lib/python3.13/asyncio/runners.py:194: in run 3537s return runner.run(main) 3537s /usr/lib/python3.13/asyncio/runners.py:118: in run 3537s return self._loop.run_until_complete(task) 3537s /usr/lib/python3.13/asyncio/base_events.py:720: in run_until_complete 3537s return future.result() 3537s /usr/lib/python3/dist-packages/distributed/utils_test.py:375: in inner_fn 3537s return await async_fn(*args, **kwargs) 3537s /usr/lib/python3/dist-packages/distributed/utils_test.py:1099: in async_fn_outer 3537s return await utils_wait_for(async_fn(), timeout=timeout * 2) 3537s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 3537s async with asyncio.timeout(timeout): 3537s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3537s 3537s self = 3537s exc_type = 3537s exc_val = CancelledError(), exc_tb = 3537s 3537s async def __aexit__( 3537s self, 3537s exc_type: Optional[Type[BaseException]], 3537s exc_val: Optional[BaseException], 3537s exc_tb: Optional[TracebackType], 3537s ) -> Optional[bool]: 3537s assert self._state in (_State.ENTERED, _State.EXPIRING) 3537s 3537s if self._timeout_handler is not None: 3537s self._timeout_handler.cancel() 3537s self._timeout_handler = None 3537s 3537s if self._state is _State.EXPIRING: 3537s self._state = _State.EXPIRED 3537s 3537s if self._task.uncancel() <= self._cancelling and exc_type is not None: 3537s # Since there are no new cancel requests, we're 3537s # handling this. 3537s if issubclass(exc_type, exceptions.CancelledError): 3537s > raise TimeoutError from exc_val 3537s E TimeoutError 3537s 3537s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 3537s ----------------------------- Captured stderr call ----------------------------- 3537s 2024-11-23 21:20:40,322 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:20:40,329 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:40,330 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44907/status 3537s 2024-11-23 21:20:40,330 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:20:40,345 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41963 3537s 2024-11-23 21:20:40,345 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41963 3537s 2024-11-23 21:20:40,345 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:20:40,346 - distributed.worker - INFO - dashboard at: 127.0.0.1:45425 3537s 2024-11-23 21:20:40,346 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:40,346 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:20:40,346 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:20:40,346 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:20:40,346 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-sj851rrp 3537s 2024-11-23 21:20:40,346 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:20:40,348 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41585 3537s 2024-11-23 21:20:40,348 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41585 3537s 2024-11-23 21:20:40,348 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:20:40,348 - distributed.worker - INFO - dashboard at: 127.0.0.1:41061 3537s 2024-11-23 21:20:40,348 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:40,348 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:20:40,348 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:20:40,348 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:20:40,348 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-bl8bg9y_ 3537s 2024-11-23 21:20:40,349 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:20:40,362 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:40,362 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:40,362 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:45054': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:40,362 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:45066': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:40,474 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:40,475 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:40,475 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:45074': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:40,475 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:45080': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:40,589 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:40,590 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:40,590 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:45090': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:40,590 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:45100': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:40,704 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:40,704 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:40,705 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:45106': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:40,705 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:45112': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:40,817 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:40,818 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:40,818 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:45122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:40,818 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:45124': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:40,931 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:40,932 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:40,932 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:45126': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:40,932 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:45136': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:41,044 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:41,045 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:41,045 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:45146': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:41,045 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:45158': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:41,158 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:41,158 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:41,158 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:45168': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:41,159 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:45180': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:41,272 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:41,272 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:41,273 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:45196': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:41,273 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:45208': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:41,386 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:41,386 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:41,386 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:45224': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:41,386 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:45234': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:41,499 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:41,499 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:41,499 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:45244': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:41,499 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:45248': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:41,613 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:41,613 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:41,614 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:38944': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:41,614 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:38946': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:41,727 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:41,727 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:41,727 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:38948': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:41,727 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:38958': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:41,844 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:41,844 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:41,844 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:38966': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:41,844 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:38970': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:41,958 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:41,958 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:41,959 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:38974': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:41,959 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:38982': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:42,072 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:42,072 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:42,073 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:38988': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:42,073 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:38992': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:42,187 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:42,188 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:42,188 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:38994': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:42,188 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:39006': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:42,300 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:42,300 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:42,301 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:39018': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:42,301 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:39034': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:42,414 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:42,414 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:42,415 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:39044': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:42,415 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:39056': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:42,528 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:42,528 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:42,529 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:39058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:42,529 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:39074': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:42,641 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:42,641 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:42,642 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:39076': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:42,642 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:39078': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:42,754 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:42,754 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:42,755 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:39088': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:42,755 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:39096': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:42,867 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:42,868 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:42,868 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:39108': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:42,868 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:39124': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:42,981 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:42,982 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:42,982 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:39140': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:42,982 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:39154': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:43,094 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:43,095 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:43,095 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:39156': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:43,095 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:39158': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:43,208 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:43,208 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:43,209 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:39162': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:43,209 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:39168': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:43,322 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:43,322 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:43,323 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:39174': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:43,323 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:39182': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:43,435 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:43,435 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:43,436 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:39186': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:43,436 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:39196': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:43,548 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:43,548 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:43,548 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:39198': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:43,549 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:39204': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:43,661 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:43,661 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:43,662 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:39210': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:43,662 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:39216': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:43,775 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:43,775 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:43,776 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:39226': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:43,776 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:39238': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:43,888 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:43,888 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:43,889 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:39242': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:43,889 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:39244': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:44,003 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:44,003 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:44,004 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:39246': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:44,004 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:39256': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:44,116 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:44,117 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:44,117 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:39264': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:44,117 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:39266': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:44,229 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:44,229 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:44,230 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:39282': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:44,230 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:39296': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:44,346 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:44,346 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:44,346 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:39312': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:44,346 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:39320': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:44,458 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:44,459 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:44,459 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:39326': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:44,459 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:39332': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:44,571 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:44,572 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:44,572 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:39334': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:44,572 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:39344': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:44,685 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:44,685 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:44,686 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:39358': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:44,686 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:39374': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:44,798 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:44,798 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:44,799 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:39384': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:44,799 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:39390': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:44,911 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:44,912 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:44,912 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:39400': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:44,912 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:39412': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:45,025 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:45,026 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:45,026 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:39418': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:45,026 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:39424': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:45,139 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:45,139 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:45,140 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:39430': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:45,140 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:39438': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:45,252 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:45,252 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:45,253 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:39448': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:45,253 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:39458': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:45,366 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:45,367 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:45,367 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:39466': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:45,367 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:39474': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:45,482 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:45,482 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:45,483 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:39478': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:45,483 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:39480': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:45,595 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:45,595 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:45,596 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:39494': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:45,596 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:39504': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:45,709 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:45,709 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:45,710 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:39514': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:45,710 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:39518': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:45,823 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:45,823 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:45,823 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:39522': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:45,824 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:39534': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:45,937 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:45,937 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:45,938 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:39542': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:45,938 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:39558': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:46,050 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:46,050 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:46,051 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:39564': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:46,051 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:39580': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:46,163 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:46,164 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:46,164 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:39588': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:46,164 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:39596': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:46,278 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:46,278 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:46,278 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:39608': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:46,278 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:39620': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:46,391 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:46,391 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:46,392 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:39626': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:46,392 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:39638': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:46,504 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:46,505 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:46,505 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:39654': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:46,505 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:39656': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:46,618 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:46,618 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:46,618 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:39660': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:46,619 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:39676': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:46,731 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:46,732 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:46,732 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:39678': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:46,732 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:39684': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:46,846 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:46,847 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:46,847 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:39694': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:46,847 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:39706': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:46,959 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:46,960 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:46,960 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:39718': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:46,960 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:39720': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:47,072 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:47,073 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:47,073 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:39722': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:47,073 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:39738': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:47,186 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:47,186 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:47,187 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:39748': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:47,187 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:39754': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:47,300 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:47,300 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:47,300 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:39758': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:47,300 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:39772': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:47,414 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:47,415 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:47,415 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:39778': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:47,415 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:39790': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:47,527 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:47,527 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:47,528 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:39796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:47,528 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:39812': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:47,641 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:47,642 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:47,642 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:39818': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:47,642 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:39834': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:47,755 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:47,755 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:47,756 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:39842': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:47,756 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:39856': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:47,869 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:47,869 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:47,869 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:39862': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:47,870 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:39868': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:47,977 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:47,982 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:39882': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:47,983 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:47,983 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:39886': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:48,085 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:48,086 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:39898': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:48,092 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:48,093 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:39900': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:48,193 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:48,194 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:39906': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:48,200 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:48,200 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:39916': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:48,301 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:48,302 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:39920': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:48,308 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:48,309 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:39924': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:48,410 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:48,411 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:39940': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:48,417 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:48,417 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:39952': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:48,518 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:48,518 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:39966': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:48,525 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:48,525 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:39970': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:48,625 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:48,626 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:39984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:48,632 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:48,633 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:39996': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:48,735 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:48,736 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:39998': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:48,742 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:48,742 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:40004': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:48,842 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:48,843 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:40006': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:48,849 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:48,850 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:40022': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:48,950 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:48,951 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:40024': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:48,957 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:48,958 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:40038': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:49,057 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:49,058 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:40044': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:49,064 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:49,065 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:40052': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:49,166 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:49,166 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:40068': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:49,173 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:49,173 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:40084': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:49,273 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:49,274 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:40100': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:49,280 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:49,281 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:40108': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:49,382 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:49,383 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:40116': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:49,389 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:49,390 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:40122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:49,491 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:49,492 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:40138': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:49,498 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:49,499 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:40148': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:49,599 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:49,600 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:40156': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:49,606 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:49,606 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:40168': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:49,707 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:49,708 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:40180': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:49,714 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:49,714 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:40184': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:49,815 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:49,816 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:40186': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:49,822 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:49,822 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:40188': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:49,923 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:49,924 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:40202': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:49,930 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:49,930 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:40216': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:50,030 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:50,031 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:40228': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:50,037 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:50,038 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:40230': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:50,138 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:50,138 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:40232': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:50,145 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:50,145 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:40246': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:50,247 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:50,248 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:40254': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:50,254 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:50,254 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:40270': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:50,355 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:50,356 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:40286': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:50,362 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:50,363 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:40296': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:50,463 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:50,464 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:40304': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:50,470 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:50,471 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:40318': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:50,571 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:50,572 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:40328': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:50,579 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:50,579 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:40344': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:50,679 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:50,680 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:40348': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:50,686 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:50,686 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:40354': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:50,787 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:50,788 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:40362': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:50,794 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:50,794 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:40376': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:50,895 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:50,896 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:40392': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:50,903 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:50,903 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:40396': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:51,003 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:51,004 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:40410': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:51,011 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:51,011 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:40418': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:51,112 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:51,113 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:40424': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:51,119 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:51,120 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:40434': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:51,221 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:51,222 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:40442': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:51,228 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:51,229 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:40448': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:51,328 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:51,329 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:40456': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:51,339 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:51,340 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:40458': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:51,436 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:51,437 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:40474': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:51,446 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:51,447 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:40490': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:51,544 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:51,545 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:44934': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:51,553 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:51,554 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:44946': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:51,652 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:51,653 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:44954': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:51,660 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:51,661 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:44964': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:51,764 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:51,765 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:44974': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:51,771 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:51,772 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:44982': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:51,872 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:51,873 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:44990': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:51,879 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:51,880 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:44996': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:51,980 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:51,981 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:45010': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:51,987 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:51,988 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:45012': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:52,089 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:52,089 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:45028': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:52,096 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:52,096 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:45038': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:52,197 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:52,198 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:45040': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:52,204 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:52,204 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:45050': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:52,305 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:52,306 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:45058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:52,313 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:52,313 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:45072': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:52,415 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:52,416 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:45084': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:52,422 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:52,422 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:45086': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:52,523 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:52,524 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:45098': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:52,530 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:52,531 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:45106': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:52,632 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:52,633 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:45112': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:52,639 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:52,639 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:45124': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:52,740 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:52,740 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:45130': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:52,747 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:52,747 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:45144': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:52,849 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:52,850 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:45148': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:52,856 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:52,857 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:45162': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:52,957 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:52,958 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:45176': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:52,965 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:52,965 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:45178': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:53,066 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:53,067 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:45192': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:53,073 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:53,074 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:45198': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:53,173 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:53,174 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:45200': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:53,181 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:53,181 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:45214': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:53,281 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:53,281 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:45220': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:53,290 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:53,290 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:45222': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:53,389 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:53,389 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:45236': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:53,397 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:53,398 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:45238': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:53,496 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:53,497 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:45252': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:53,505 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:53,505 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:45266': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:53,604 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:53,605 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:45278': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:53,612 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:53,613 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:45282': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:53,713 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:53,713 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:45284': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:53,720 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:53,721 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:45300': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:53,820 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:53,821 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:45314': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:53,827 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:53,828 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:45318': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:53,929 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:53,930 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:45330': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:53,937 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:53,937 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:45332': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:54,038 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:54,038 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:45348': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:54,045 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:54,045 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:45360': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:54,145 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:54,146 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:45370': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:54,153 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:54,153 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:45376': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:54,253 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:54,253 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:45382': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:54,260 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:54,261 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:45394': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:54,361 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:54,361 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:45398': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:54,368 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:54,369 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:45402': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:54,468 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:54,469 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:45416': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:54,476 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:54,476 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:45418': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:54,578 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:54,578 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:45422': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:54,585 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:54,585 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:45428': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:54,685 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:54,686 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:45444': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:54,692 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:54,693 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:45458': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:54,794 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:54,795 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:45474': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:54,802 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:54,803 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:45484': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:54,902 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:54,902 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:45492': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:54,910 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:54,911 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:45496': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:55,010 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:55,011 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:45502': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:55,017 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:55,018 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:45504': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:55,118 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:55,118 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:45508': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:55,125 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:55,125 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:45522': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:55,226 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:55,227 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:45538': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:55,233 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:55,234 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:45542': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:55,334 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:55,338 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:45556': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:55,345 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 3537s 2024-11-23 21:20:55,345 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41963. Reason: failure-to-start- 3537s 2024-11-23 21:20:55,345 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:20:55,347 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:45572': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:55,347 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41585. Reason: failure-to-start- 3537s 2024-11-23 21:20:55,347 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:20:55,349 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 15s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 3537s stream = await stream.start_tls( 3537s ^^^^^^^^^^^^^^^^^^^^^^^ 3537s False, ssl_options=ssl_options, server_hostname=host 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 3537s self.socket.do_handshake() 3537s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 3537s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 3537s self._sslobj.do_handshake() 3537s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 3537s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 3537s raise FatalCommClosedError( 3537s ...<2 lines>... 3537s ) from err 3537s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 3537s 3537s During handling of the above exception, another exception occurred: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1218, in _register_with_scheduler 3537s await asyncio.sleep(0.1) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 718, in sleep 3537s return await future 3537s ^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 15s. 3537s 2024-11-23 21:20:56,356 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:20:56,365 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40451 3537s 2024-11-23 21:20:56,365 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34861/status 3537s 2024-11-23 21:20:56,365 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:20:56,381 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39851 3537s 2024-11-23 21:20:56,381 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39851 3537s 2024-11-23 21:20:56,381 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:20:56,382 - distributed.worker - INFO - dashboard at: 127.0.0.1:38251 3537s 2024-11-23 21:20:56,382 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:20:56,382 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:20:56,382 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:20:56,382 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:20:56,382 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-onteil4h 3537s 2024-11-23 21:20:56,382 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:20:56,385 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46845 3537s 2024-11-23 21:20:56,386 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46845 3537s 2024-11-23 21:20:56,386 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:20:56,386 - distributed.worker - INFO - dashboard at: 127.0.0.1:42991 3537s 2024-11-23 21:20:56,386 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:20:56,386 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:20:56,386 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:20:56,386 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:20:56,386 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-3ifjmtum 3537s 2024-11-23 21:20:56,386 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:20:56,399 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:20:56,400 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:20:56,400 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:51068': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:56,400 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:51070': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:56,513 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:20:56,513 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:20:56,514 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:51084': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:56,514 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:51088': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:56,627 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:20:56,627 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:20:56,628 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:51104': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:56,628 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:51108': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:56,740 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:20:56,741 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:20:56,741 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:51116': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:56,741 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:51126': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:56,854 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:20:56,854 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:20:56,854 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:51130': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:56,854 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:51138': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:56,967 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:20:56,967 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:20:56,968 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:51150': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:56,968 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:51160': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:57,080 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:20:57,080 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:20:57,081 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:51172': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:57,081 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:51186': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:57,194 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:20:57,194 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:20:57,195 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:51200': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:57,195 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:51210': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:57,307 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:20:57,308 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:20:57,308 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:51212': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:57,308 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:51222': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:57,421 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:20:57,421 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:20:57,422 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:51228': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:57,422 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:51238': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:57,535 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:20:57,535 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:20:57,535 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:51252': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:57,536 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:51258': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:57,649 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:20:57,649 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:20:57,649 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:51260': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:57,649 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:51274': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:57,763 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:20:57,763 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:20:57,765 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:51290': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:57,765 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:51298': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:57,879 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:20:57,880 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:20:57,880 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:51306': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:57,880 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:51308': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:57,993 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:20:57,994 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:20:57,994 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:51324': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:57,994 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:51332': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:58,108 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:20:58,108 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:20:58,109 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:51346': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:58,109 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:51360': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:58,223 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:20:58,223 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:20:58,223 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:51370': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:58,224 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:51384': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:58,336 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:20:58,337 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:20:58,340 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:51388': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:58,340 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:51396': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:58,450 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:20:58,450 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:20:58,451 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:51404': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:58,451 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:51414': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:58,563 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:20:58,564 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:20:58,564 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:51428': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:58,564 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:51442': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:58,677 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:20:58,678 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:20:58,678 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:51450': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:58,678 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:51454': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:58,791 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:20:58,791 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:20:58,792 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:51468': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:58,792 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:51484': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:58,905 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:20:58,905 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:20:58,906 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:51492': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:58,906 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:51500': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:59,018 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:20:59,019 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:20:59,019 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:51502': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:59,019 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:51512': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:59,132 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:20:59,133 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:20:59,133 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:51522': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:59,133 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:51524': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:59,246 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:20:59,246 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:20:59,247 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:51528': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:59,247 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:51540': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:59,360 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:20:59,360 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:20:59,361 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:51544': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:59,361 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:51546': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:59,474 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:20:59,474 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:20:59,475 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:51556': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:59,475 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:51562': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:59,589 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:20:59,589 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:20:59,590 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:51564': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:59,590 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:51570': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:59,702 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:20:59,703 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:20:59,703 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:51574': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:59,703 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:51578': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:59,817 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:20:59,817 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:20:59,817 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:51586': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:59,817 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:51598': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:59,931 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:20:59,931 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:20:59,931 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:51610': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:20:59,932 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:51614': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:00,046 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:21:00,046 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:21:00,046 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:51630': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:00,046 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:51636': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:00,159 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:21:00,160 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:21:00,160 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:51646': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:00,160 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:51656': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:00,272 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:21:00,273 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:21:00,273 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:51658': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:00,274 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:51666': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:00,386 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:21:00,387 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:21:00,387 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:51676': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:00,387 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:51690': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:00,500 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:21:00,501 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:21:00,501 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:51704': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:00,501 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:51720': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:00,614 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:21:00,615 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:21:00,615 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:51736': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:00,615 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:51752': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:00,728 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:21:00,728 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:21:00,729 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:51766': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:00,729 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:51778': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:00,844 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:21:00,845 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:21:00,845 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:51790': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:00,845 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:51802': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:00,958 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:21:00,958 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:21:00,959 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:51816': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:00,959 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:51818': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:01,072 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:21:01,072 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:21:01,073 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:51832': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:01,073 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:51834': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:01,187 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:21:01,187 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:21:01,188 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:51838': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:01,188 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:51848': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:01,300 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:21:01,301 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:21:01,301 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:51860': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:01,301 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:51876': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:01,414 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:21:01,415 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:21:01,415 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:51882': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:01,415 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:51892': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:01,528 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:21:01,529 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:21:01,529 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:51904': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:01,529 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:51918': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:01,642 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:21:01,642 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:21:01,643 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:57722': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:01,643 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:57736': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:01,756 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:21:01,756 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:21:01,757 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:57742': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:01,757 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:57756': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:01,870 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:21:01,870 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:21:01,874 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:57760': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:01,874 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:57762': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:01,983 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:21:01,984 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:21:01,984 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:57768': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:01,984 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:57782': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:02,096 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:21:02,097 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:21:02,097 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:57784': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:02,097 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:57790': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:02,210 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:21:02,211 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:21:02,211 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:57800': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:02,211 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:57808': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:02,324 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:21:02,325 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:21:02,325 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:57820': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:02,325 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:57832': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:02,439 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:21:02,439 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:21:02,440 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:57848': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:02,440 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:57852': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:02,552 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:21:02,552 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:21:02,553 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:57858': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:02,553 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:57864': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:02,666 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:21:02,666 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:21:02,667 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:57872': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:02,667 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:57878': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:02,779 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:21:02,780 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:21:02,780 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:57888': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:02,780 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:57896': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:02,893 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:21:02,894 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:21:02,894 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:57910': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:02,894 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:57922': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:03,008 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:21:03,009 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:21:03,009 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:57934': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:03,009 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:57944': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:03,122 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:21:03,122 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:21:03,123 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:57948': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:03,123 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:57954': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:03,236 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:21:03,236 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:21:03,237 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:57960': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:03,237 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:57976': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:03,349 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:21:03,349 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:21:03,350 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:57980': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:03,350 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:57986': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:03,463 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:21:03,464 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:21:03,464 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:57996': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:03,464 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:58004': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:03,577 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:21:03,577 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:21:03,577 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:58020': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:03,577 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:58028': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:03,692 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:21:03,692 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:21:03,692 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:58036': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:03,692 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:58046': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:03,806 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:21:03,807 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:21:03,807 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:58052': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:03,807 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:58056': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:03,919 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:21:03,920 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:21:03,920 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:58068': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:03,920 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:58076': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:04,033 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:21:04,034 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:21:04,034 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:58078': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:04,034 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:58084': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:04,147 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:21:04,147 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:21:04,148 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:58100': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:04,148 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:58114': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:04,261 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:21:04,261 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:21:04,261 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:58122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:04,262 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:58132': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:04,375 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:21:04,375 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:21:04,378 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:58142': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:04,379 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:58158': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:04,489 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:21:04,490 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:21:04,490 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:58170': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:04,490 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:58184': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:04,604 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:21:04,604 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:21:04,605 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:58200': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:04,605 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:58210': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:04,718 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:21:04,718 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:21:04,720 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:58224': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:04,720 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:58236': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:04,832 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:21:04,833 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:21:04,833 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:58242': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:04,833 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:58254': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:04,946 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:21:04,946 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:21:04,946 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:58256': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:04,946 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:58270': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:05,059 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:21:05,060 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:21:05,060 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:58286': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:05,060 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:58292': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:05,173 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:21:05,173 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:21:05,174 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:58300': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:05,174 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:58304': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:05,287 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:21:05,287 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:21:05,287 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:58310': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:05,287 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:58322': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:05,401 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:21:05,402 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:21:05,402 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:58332': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:05,402 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:58336': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:05,517 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:21:05,517 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:21:05,518 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:58340': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:05,518 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:58350': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:05,630 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:21:05,631 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:21:05,631 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:58364': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:05,631 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:58378': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:05,744 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:21:05,744 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:21:05,745 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:58394': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:05,745 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:58398': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:05,857 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:21:05,858 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:21:05,858 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:58404': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:05,858 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:58406': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:05,971 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:21:05,971 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:21:05,972 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:58420': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:05,972 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:58434': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:06,085 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:21:06,085 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:21:06,085 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:58446': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:06,086 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:58456': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:06,198 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:21:06,199 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:21:06,199 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:58472': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:06,199 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:58486': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:06,312 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:21:06,312 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:21:06,313 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:58488': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:06,313 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:58502': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:06,425 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:21:06,426 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:21:06,426 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:58516': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:06,426 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:58520': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:06,541 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:21:06,541 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:21:06,542 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:58532': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:06,542 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:58542': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:06,654 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:21:06,655 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:21:06,655 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:58546': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:06,655 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:58562': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:06,768 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:21:06,768 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:21:06,769 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:58574': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:06,769 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:58578': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:06,882 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:21:06,882 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:21:06,882 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:58584': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:06,882 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:58590': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:06,995 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:21:06,995 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:21:06,996 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:58602': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:06,996 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:58616': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:07,108 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:21:07,109 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:21:07,109 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:58622': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:07,109 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:58638': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:07,222 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:21:07,222 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:21:07,223 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:58652': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:07,223 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:58660': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:07,337 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:21:07,337 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:21:07,341 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:58672': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:07,341 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:58676': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:07,450 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:21:07,451 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:21:07,451 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:58682': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:07,451 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:58696': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:07,564 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:21:07,564 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:21:07,565 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:58702': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:07,565 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:58704': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:07,678 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:21:07,678 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:21:07,678 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:58716': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:07,679 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:58720': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:07,791 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:21:07,791 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:21:07,792 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:58724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:07,792 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:58734': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:07,904 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:21:07,904 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:21:07,905 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:58742': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:07,905 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:58750': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:08,017 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:21:08,017 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:21:08,018 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:58762': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:08,018 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:58774': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:08,130 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:21:08,130 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:21:08,131 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:58782': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:08,131 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:58786': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:08,243 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:21:08,243 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:21:08,244 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:58802': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:08,244 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:58814': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:08,356 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:21:08,356 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:21:08,356 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:58826': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:08,357 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:58832': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:08,470 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:21:08,471 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:21:08,471 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:58834': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:08,471 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:58848': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:08,584 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:21:08,584 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:21:08,585 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:58852': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:08,585 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:58854': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:08,697 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:21:08,698 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:21:08,698 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:58858': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:08,698 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:58860': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:08,811 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:21:08,811 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:21:08,811 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:58872': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:08,812 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:58874': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:08,924 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:21:08,925 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:21:08,925 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:58890': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:08,925 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:58896': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:09,038 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:21:09,039 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:21:09,039 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:58912': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:09,039 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:58922': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:09,154 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:21:09,154 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:21:09,155 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:58926': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:09,155 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:58942': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:09,267 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:21:09,267 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:21:09,268 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:58956': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:09,268 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:58966': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:09,381 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:21:09,381 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 3537s 2024-11-23 21:21:09,381 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:58982': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:09,382 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:58986': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:09,382 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39851. Reason: failure-to-start- 3537s 2024-11-23 21:21:09,382 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:21:09,383 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 13s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 3537s stream = await stream.start_tls( 3537s ^^^^^^^^^^^^^^^^^^^^^^^ 3537s False, ssl_options=ssl_options, server_hostname=host 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 3537s self.socket.do_handshake() 3537s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 3537s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 3537s self._sslobj.do_handshake() 3537s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 3537s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 3537s raise FatalCommClosedError( 3537s ...<2 lines>... 3537s ) from err 3537s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 3537s 3537s During handling of the above exception, another exception occurred: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1218, in _register_with_scheduler 3537s await asyncio.sleep(0.1) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 718, in sleep 3537s return await future 3537s ^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 13s. 3537s 2024-11-23 21:21:09,387 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46845. Reason: failure-to-start- 3537s 2024-11-23 21:21:09,387 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:21:10,391 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:21:10,398 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40423 3537s 2024-11-23 21:21:10,399 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43549/status 3537s 2024-11-23 21:21:10,399 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:21:10,415 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43585 3537s 2024-11-23 21:21:10,415 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43585 3537s 2024-11-23 21:21:10,415 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:21:10,415 - distributed.worker - INFO - dashboard at: 127.0.0.1:34465 3537s 2024-11-23 21:21:10,415 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40423 3537s 2024-11-23 21:21:10,416 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:21:10,416 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:21:10,416 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:21:10,416 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-jc808yku 3537s 2024-11-23 21:21:10,416 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:21:10,418 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37321 3537s 2024-11-23 21:21:10,418 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37321 3537s 2024-11-23 21:21:10,418 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:21:10,418 - distributed.worker - INFO - dashboard at: 127.0.0.1:36833 3537s 2024-11-23 21:21:10,418 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40423 3537s 2024-11-23 21:21:10,418 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:21:10,418 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:21:10,419 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:21:10,419 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-d30eox5v 3537s 2024-11-23 21:21:10,419 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:21:10,420 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43585. Reason: failure-to-start- 3537s 2024-11-23 21:21:10,420 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:21:10,420 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37321. Reason: failure-to-start- 3537s 2024-11-23 21:21:10,420 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:21:10,422 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40423': TLS handshake failed with remote 'tls://127.0.0.1:51840': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:21:10,422 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40423': TLS handshake failed with remote 'tls://127.0.0.1:51852': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:21:10,423 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:21:11,429 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:21:11,437 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38061 3537s 2024-11-23 21:21:11,438 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37069/status 3537s 2024-11-23 21:21:11,438 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:21:11,452 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39001 3537s 2024-11-23 21:21:11,453 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39001 3537s 2024-11-23 21:21:11,453 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:21:11,453 - distributed.worker - INFO - dashboard at: 127.0.0.1:35001 3537s 2024-11-23 21:21:11,453 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38061 3537s 2024-11-23 21:21:11,453 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:21:11,453 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:21:11,453 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:21:11,453 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-krxiu3x2 3537s 2024-11-23 21:21:11,453 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:21:11,460 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42519 3537s 2024-11-23 21:21:11,460 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42519 3537s 2024-11-23 21:21:11,460 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:21:11,460 - distributed.worker - INFO - dashboard at: 127.0.0.1:44267 3537s 2024-11-23 21:21:11,460 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38061 3537s 2024-11-23 21:21:11,460 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:21:11,460 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:21:11,460 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:21:11,460 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-fcslywwq 3537s 2024-11-23 21:21:11,460 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:21:11,462 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39001. Reason: failure-to-start- 3537s 2024-11-23 21:21:11,462 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:21:11,462 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42519. Reason: failure-to-start- 3537s 2024-11-23 21:21:11,462 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:21:11,464 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38061': TLS handshake failed with remote 'tls://127.0.0.1:57760': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:21:11,464 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38061': TLS handshake failed with remote 'tls://127.0.0.1:57774': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:21:11,465 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:21:12,471 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:21:12,479 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38565 3537s 2024-11-23 21:21:12,479 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35825/status 3537s 2024-11-23 21:21:12,479 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:21:12,495 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39613 3537s 2024-11-23 21:21:12,495 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39613 3537s 2024-11-23 21:21:12,495 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:21:12,495 - distributed.worker - INFO - dashboard at: 127.0.0.1:44641 3537s 2024-11-23 21:21:12,495 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38565 3537s 2024-11-23 21:21:12,495 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:21:12,495 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:21:12,495 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:21:12,496 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-0vxsmwzy 3537s 2024-11-23 21:21:12,496 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:21:12,498 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34657 3537s 2024-11-23 21:21:12,498 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34657 3537s 2024-11-23 21:21:12,498 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:21:12,498 - distributed.worker - INFO - dashboard at: 127.0.0.1:44961 3537s 2024-11-23 21:21:12,498 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38565 3537s 2024-11-23 21:21:12,498 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:21:12,498 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:21:12,498 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:21:12,498 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-5nwsnha0 3537s 2024-11-23 21:21:12,499 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:21:12,500 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39613. Reason: failure-to-start- 3537s 2024-11-23 21:21:12,500 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:21:12,500 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34657. Reason: failure-to-start- 3537s 2024-11-23 21:21:12,500 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:21:12,502 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38565': TLS handshake failed with remote 'tls://127.0.0.1:34898': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:21:12,502 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38565': TLS handshake failed with remote 'tls://127.0.0.1:34904': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:21:12,503 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:21:13,510 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:21:13,519 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40335 3537s 2024-11-23 21:21:13,520 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44543/status 3537s 2024-11-23 21:21:13,520 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:21:13,535 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37609 3537s 2024-11-23 21:21:13,535 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37609 3537s 2024-11-23 21:21:13,536 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:21:13,536 - distributed.worker - INFO - dashboard at: 127.0.0.1:36455 3537s 2024-11-23 21:21:13,536 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40335 3537s 2024-11-23 21:21:13,536 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:21:13,536 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:21:13,536 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:21:13,536 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-gq6sxd3q 3537s 2024-11-23 21:21:13,536 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:21:13,538 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34069 3537s 2024-11-23 21:21:13,538 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34069 3537s 2024-11-23 21:21:13,538 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:21:13,538 - distributed.worker - INFO - dashboard at: 127.0.0.1:41163 3537s 2024-11-23 21:21:13,539 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40335 3537s 2024-11-23 21:21:13,539 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:21:13,539 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:21:13,539 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:21:13,539 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-j1_ou96g 3537s 2024-11-23 21:21:13,539 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:21:13,540 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37609. Reason: failure-to-start- 3537s 2024-11-23 21:21:13,540 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:21:13,541 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34069. Reason: failure-to-start- 3537s 2024-11-23 21:21:13,541 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:21:13,542 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40335': TLS handshake failed with remote 'tls://127.0.0.1:50404': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:21:13,542 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40335': TLS handshake failed with remote 'tls://127.0.0.1:50418': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:21:13,544 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:21:14,550 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:21:14,558 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39477 3537s 2024-11-23 21:21:14,558 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37177/status 3537s 2024-11-23 21:21:14,558 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:21:14,576 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35477 3537s 2024-11-23 21:21:14,576 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35477 3537s 2024-11-23 21:21:14,576 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:21:14,576 - distributed.worker - INFO - dashboard at: 127.0.0.1:33581 3537s 2024-11-23 21:21:14,576 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39477 3537s 2024-11-23 21:21:14,576 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:21:14,576 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:21:14,576 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:21:14,576 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-dccdscia 3537s 2024-11-23 21:21:14,576 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:21:14,579 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42585 3537s 2024-11-23 21:21:14,579 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42585 3537s 2024-11-23 21:21:14,579 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:21:14,579 - distributed.worker - INFO - dashboard at: 127.0.0.1:41669 3537s 2024-11-23 21:21:14,579 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39477 3537s 2024-11-23 21:21:14,579 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:21:14,579 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:21:14,579 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:21:14,579 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-1pgrmkwf 3537s 2024-11-23 21:21:14,579 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:21:14,580 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35477. Reason: failure-to-start- 3537s 2024-11-23 21:21:14,580 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:21:14,581 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42585. Reason: failure-to-start- 3537s 2024-11-23 21:21:14,581 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:21:14,582 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39477': TLS handshake failed with remote 'tls://127.0.0.1:48326': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:21:14,583 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39477': TLS handshake failed with remote 'tls://127.0.0.1:48334': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:21:14,584 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:21:15,590 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:21:15,598 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:32789 3537s 2024-11-23 21:21:15,599 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41563/status 3537s 2024-11-23 21:21:15,599 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:21:15,613 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45199 3537s 2024-11-23 21:21:15,614 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45199 3537s 2024-11-23 21:21:15,614 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:21:15,614 - distributed.worker - INFO - dashboard at: 127.0.0.1:34113 3537s 2024-11-23 21:21:15,614 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:32789 3537s 2024-11-23 21:21:15,614 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:21:15,614 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:21:15,614 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:21:15,614 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-nkxwdcz6 3537s 2024-11-23 21:21:15,614 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:21:15,616 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44423 3537s 2024-11-23 21:21:15,616 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44423 3537s 2024-11-23 21:21:15,616 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:21:15,616 - distributed.worker - INFO - dashboard at: 127.0.0.1:37287 3537s 2024-11-23 21:21:15,617 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:32789 3537s 2024-11-23 21:21:15,617 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:21:15,617 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:21:15,617 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:21:15,617 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-9y_y3h60 3537s 2024-11-23 21:21:15,617 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:21:15,619 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45199. Reason: failure-to-start- 3537s 2024-11-23 21:21:15,619 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:21:15,619 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44423. Reason: failure-to-start- 3537s 2024-11-23 21:21:15,620 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:21:15,621 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:32789': TLS handshake failed with remote 'tls://127.0.0.1:38502': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:21:15,621 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:32789': TLS handshake failed with remote 'tls://127.0.0.1:38514': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:21:15,623 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:21:16,629 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:21:16,637 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35111 3537s 2024-11-23 21:21:16,637 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39771/status 3537s 2024-11-23 21:21:16,638 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:21:16,653 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45515 3537s 2024-11-23 21:21:16,653 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45515 3537s 2024-11-23 21:21:16,653 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:21:16,653 - distributed.worker - INFO - dashboard at: 127.0.0.1:43027 3537s 2024-11-23 21:21:16,653 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35111 3537s 2024-11-23 21:21:16,653 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:21:16,653 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:21:16,653 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:21:16,654 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-pqd6xnb3 3537s 2024-11-23 21:21:16,654 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:21:16,656 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44079 3537s 2024-11-23 21:21:16,656 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44079 3537s 2024-11-23 21:21:16,656 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:21:16,656 - distributed.worker - INFO - dashboard at: 127.0.0.1:45227 3537s 2024-11-23 21:21:16,656 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35111 3537s 2024-11-23 21:21:16,656 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:21:16,656 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:21:16,656 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:21:16,656 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-29tk38sv 3537s 2024-11-23 21:21:16,656 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:21:16,658 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45515. Reason: failure-to-start- 3537s 2024-11-23 21:21:16,658 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:21:16,658 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44079. Reason: failure-to-start- 3537s 2024-11-23 21:21:16,658 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:21:16,660 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35111': TLS handshake failed with remote 'tls://127.0.0.1:43784': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:21:16,660 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35111': TLS handshake failed with remote 'tls://127.0.0.1:43796': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:21:16,661 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:21:17,668 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:21:17,677 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43223 3537s 2024-11-23 21:21:17,677 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37949/status 3537s 2024-11-23 21:21:17,678 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:21:17,693 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34321 3537s 2024-11-23 21:21:17,693 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34321 3537s 2024-11-23 21:21:17,693 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:21:17,693 - distributed.worker - INFO - dashboard at: 127.0.0.1:39041 3537s 2024-11-23 21:21:17,693 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43223 3537s 2024-11-23 21:21:17,694 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:21:17,694 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:21:17,694 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:21:17,694 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-c09iumw7 3537s 2024-11-23 21:21:17,694 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:21:17,696 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37281 3537s 2024-11-23 21:21:17,696 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37281 3537s 2024-11-23 21:21:17,696 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:21:17,696 - distributed.worker - INFO - dashboard at: 127.0.0.1:37151 3537s 2024-11-23 21:21:17,696 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43223 3537s 2024-11-23 21:21:17,696 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:21:17,696 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:21:17,697 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:21:17,697 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-lu2ehnyt 3537s 2024-11-23 21:21:17,697 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:21:17,698 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34321. Reason: failure-to-start- 3537s 2024-11-23 21:21:17,698 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:21:17,698 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37281. Reason: failure-to-start- 3537s 2024-11-23 21:21:17,699 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:21:17,700 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43223': TLS handshake failed with remote 'tls://127.0.0.1:53906': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:21:17,700 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43223': TLS handshake failed with remote 'tls://127.0.0.1:53908': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:21:17,702 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:21:18,707 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:21:18,715 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34461 3537s 2024-11-23 21:21:18,716 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34987/status 3537s 2024-11-23 21:21:18,716 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:21:18,733 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42171 3537s 2024-11-23 21:21:18,734 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42171 3537s 2024-11-23 21:21:18,734 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:21:18,734 - distributed.worker - INFO - dashboard at: 127.0.0.1:41403 3537s 2024-11-23 21:21:18,734 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34461 3537s 2024-11-23 21:21:18,734 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:21:18,734 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:21:18,734 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:21:18,734 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-8qt8t7jp 3537s 2024-11-23 21:21:18,734 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:21:18,737 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38949 3537s 2024-11-23 21:21:18,737 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38949 3537s 2024-11-23 21:21:18,737 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:21:18,737 - distributed.worker - INFO - dashboard at: 127.0.0.1:43275 3537s 2024-11-23 21:21:18,737 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34461 3537s 2024-11-23 21:21:18,737 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:21:18,737 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:21:18,737 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:21:18,737 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-f8b6pqdp 3537s 2024-11-23 21:21:18,737 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:21:18,739 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42171. Reason: failure-to-start- 3537s 2024-11-23 21:21:18,739 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:21:18,739 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38949. Reason: failure-to-start- 3537s 2024-11-23 21:21:18,739 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:21:18,741 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34461': TLS handshake failed with remote 'tls://127.0.0.1:43890': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:21:18,741 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34461': TLS handshake failed with remote 'tls://127.0.0.1:43904': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:21:18,743 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:21:19,748 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:21:19,756 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41283 3537s 2024-11-23 21:21:19,756 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38357/status 3537s 2024-11-23 21:21:19,757 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:21:19,771 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37307 3537s 2024-11-23 21:21:19,772 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37307 3537s 2024-11-23 21:21:19,772 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:21:19,772 - distributed.worker - INFO - dashboard at: 127.0.0.1:43063 3537s 2024-11-23 21:21:19,772 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41283 3537s 2024-11-23 21:21:19,772 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:21:19,772 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:21:19,772 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:21:19,772 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-4uk55ldm 3537s 2024-11-23 21:21:19,772 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:21:19,774 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43685 3537s 2024-11-23 21:21:19,774 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43685 3537s 2024-11-23 21:21:19,774 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:21:19,775 - distributed.worker - INFO - dashboard at: 127.0.0.1:37883 3537s 2024-11-23 21:21:19,775 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41283 3537s 2024-11-23 21:21:19,775 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:21:19,775 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:21:19,775 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:21:19,775 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ychj7wo4 3537s 2024-11-23 21:21:19,775 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:21:19,777 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37307. Reason: failure-to-start- 3537s 2024-11-23 21:21:19,777 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:21:19,778 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43685. Reason: failure-to-start- 3537s 2024-11-23 21:21:19,778 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:21:19,779 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41283': TLS handshake failed with remote 'tls://127.0.0.1:44438': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:21:19,779 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41283': TLS handshake failed with remote 'tls://127.0.0.1:44442': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:21:19,781 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:21:20,786 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:21:20,794 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36369 3537s 2024-11-23 21:21:20,795 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35237/status 3537s 2024-11-23 21:21:20,795 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:21:20,810 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43907 3537s 2024-11-23 21:21:20,811 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43907 3537s 2024-11-23 21:21:20,811 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:21:20,811 - distributed.worker - INFO - dashboard at: 127.0.0.1:35119 3537s 2024-11-23 21:21:20,811 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36369 3537s 2024-11-23 21:21:20,811 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:21:20,811 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:21:20,811 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:21:20,811 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ot9_3mkn 3537s 2024-11-23 21:21:20,811 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:21:20,813 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44739 3537s 2024-11-23 21:21:20,814 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44739 3537s 2024-11-23 21:21:20,814 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:21:20,814 - distributed.worker - INFO - dashboard at: 127.0.0.1:39273 3537s 2024-11-23 21:21:20,814 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36369 3537s 2024-11-23 21:21:20,814 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:21:20,814 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:21:20,814 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:21:20,814 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ubjh2mn9 3537s 2024-11-23 21:21:20,814 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:21:20,815 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43907. Reason: failure-to-start- 3537s 2024-11-23 21:21:20,815 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:21:20,816 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44739. Reason: failure-to-start- 3537s 2024-11-23 21:21:20,816 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:21:20,818 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36369': TLS handshake failed with remote 'tls://127.0.0.1:51514': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:21:20,818 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36369': TLS handshake failed with remote 'tls://127.0.0.1:51518': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:21:20,819 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:21:21,825 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:21:21,835 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33217 3537s 2024-11-23 21:21:21,835 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42441/status 3537s 2024-11-23 21:21:21,835 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:21:21,853 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33543 3537s 2024-11-23 21:21:21,853 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33543 3537s 2024-11-23 21:21:21,853 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:21:21,853 - distributed.worker - INFO - dashboard at: 127.0.0.1:38229 3537s 2024-11-23 21:21:21,853 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33217 3537s 2024-11-23 21:21:21,853 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:21:21,853 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:21:21,853 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:21:21,854 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-g_6bn2k0 3537s 2024-11-23 21:21:21,854 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:21:21,856 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36231 3537s 2024-11-23 21:21:21,856 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36231 3537s 2024-11-23 21:21:21,856 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:21:21,856 - distributed.worker - INFO - dashboard at: 127.0.0.1:40509 3537s 2024-11-23 21:21:21,856 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33217 3537s 2024-11-23 21:21:21,856 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:21:21,856 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:21:21,856 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:21:21,856 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-fh3xt95c 3537s 2024-11-23 21:21:21,856 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:21:21,858 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33543. Reason: failure-to-start- 3537s 2024-11-23 21:21:21,858 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:21:21,858 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36231. Reason: failure-to-start- 3537s 2024-11-23 21:21:21,858 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:21:21,860 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33217': TLS handshake failed with remote 'tls://127.0.0.1:36810': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:21:21,860 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33217': TLS handshake failed with remote 'tls://127.0.0.1:36816': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:21:21,861 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:21:22,867 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:21:22,876 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39959 3537s 2024-11-23 21:21:22,876 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46855/status 3537s 2024-11-23 21:21:22,876 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:21:22,897 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46527 3537s 2024-11-23 21:21:22,897 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46527 3537s 2024-11-23 21:21:22,897 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:21:22,897 - distributed.worker - INFO - dashboard at: 127.0.0.1:36117 3537s 2024-11-23 21:21:22,897 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39959 3537s 2024-11-23 21:21:22,897 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:21:22,897 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:21:22,897 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:21:22,897 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-d97jumlb 3537s 2024-11-23 21:21:22,897 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:21:22,900 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35435 3537s 2024-11-23 21:21:22,900 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35435 3537s 2024-11-23 21:21:22,900 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:21:22,900 - distributed.worker - INFO - dashboard at: 127.0.0.1:32877 3537s 2024-11-23 21:21:22,900 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39959 3537s 2024-11-23 21:21:22,900 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:21:22,900 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:21:22,900 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:21:22,900 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-iduovnv5 3537s 2024-11-23 21:21:22,900 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:21:22,902 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46527. Reason: failure-to-start- 3537s 2024-11-23 21:21:22,902 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:21:22,902 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35435. Reason: failure-to-start- 3537s 2024-11-23 21:21:22,903 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:21:22,906 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39959': TLS handshake failed with remote 'tls://127.0.0.1:43304': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:21:22,907 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39959': TLS handshake failed with remote 'tls://127.0.0.1:43318': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:21:22,908 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:21:23,915 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:21:23,923 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45321 3537s 2024-11-23 21:21:23,924 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37747/status 3537s 2024-11-23 21:21:23,924 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:21:23,941 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43663 3537s 2024-11-23 21:21:23,941 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43663 3537s 2024-11-23 21:21:23,941 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:21:23,941 - distributed.worker - INFO - dashboard at: 127.0.0.1:39111 3537s 2024-11-23 21:21:23,941 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45321 3537s 2024-11-23 21:21:23,941 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:21:23,941 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:21:23,942 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:21:23,942 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-hygas5m4 3537s 2024-11-23 21:21:23,942 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:21:23,945 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34065 3537s 2024-11-23 21:21:23,945 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34065 3537s 2024-11-23 21:21:23,945 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:21:23,945 - distributed.worker - INFO - dashboard at: 127.0.0.1:46733 3537s 2024-11-23 21:21:23,945 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45321 3537s 2024-11-23 21:21:23,946 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:21:23,946 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:21:23,946 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:21:23,946 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-quhp96qf 3537s 2024-11-23 21:21:23,946 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:21:23,950 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43663. Reason: failure-to-start- 3537s 2024-11-23 21:21:23,950 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:21:23,950 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34065. Reason: failure-to-start- 3537s 2024-11-23 21:21:23,951 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:21:23,952 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45321': TLS handshake failed with remote 'tls://127.0.0.1:56468': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:21:23,952 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45321': TLS handshake failed with remote 'tls://127.0.0.1:56472': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:21:23,954 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:21:24,960 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:21:24,968 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40703 3537s 2024-11-23 21:21:24,968 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39453/status 3537s 2024-11-23 21:21:24,968 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:21:24,984 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42029 3537s 2024-11-23 21:21:24,985 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42029 3537s 2024-11-23 21:21:24,985 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:21:24,985 - distributed.worker - INFO - dashboard at: 127.0.0.1:43225 3537s 2024-11-23 21:21:24,985 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40703 3537s 2024-11-23 21:21:24,985 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:21:24,985 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:21:24,985 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:21:24,985 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-hu24g5z0 3537s 2024-11-23 21:21:24,985 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:21:24,987 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38607 3537s 2024-11-23 21:21:24,988 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38607 3537s 2024-11-23 21:21:24,988 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:21:24,988 - distributed.worker - INFO - dashboard at: 127.0.0.1:36577 3537s 2024-11-23 21:21:24,988 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40703 3537s 2024-11-23 21:21:24,988 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:21:24,988 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:21:24,988 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:21:24,988 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-suflbcbx 3537s 2024-11-23 21:21:24,988 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:21:24,993 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42029. Reason: failure-to-start- 3537s 2024-11-23 21:21:24,993 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:21:24,993 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38607. Reason: failure-to-start- 3537s 2024-11-23 21:21:24,994 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:21:24,995 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40703': TLS handshake failed with remote 'tls://127.0.0.1:57396': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:21:24,995 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40703': TLS handshake failed with remote 'tls://127.0.0.1:57398': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:21:24,997 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:21:26,002 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:21:26,009 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33279 3537s 2024-11-23 21:21:26,010 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33133/status 3537s 2024-11-23 21:21:26,010 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:21:26,028 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36247 3537s 2024-11-23 21:21:26,028 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36247 3537s 2024-11-23 21:21:26,028 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:21:26,028 - distributed.worker - INFO - dashboard at: 127.0.0.1:36957 3537s 2024-11-23 21:21:26,028 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33279 3537s 2024-11-23 21:21:26,028 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:21:26,028 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:21:26,028 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:21:26,029 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-tyyn9ayo 3537s 2024-11-23 21:21:26,029 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:21:26,031 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35151 3537s 2024-11-23 21:21:26,031 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35151 3537s 2024-11-23 21:21:26,031 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:21:26,031 - distributed.worker - INFO - dashboard at: 127.0.0.1:44425 3537s 2024-11-23 21:21:26,031 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33279 3537s 2024-11-23 21:21:26,031 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:21:26,032 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:21:26,032 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:21:26,032 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-h3og4sjh 3537s 2024-11-23 21:21:26,032 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:21:26,036 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36247. Reason: failure-to-start- 3537s 2024-11-23 21:21:26,036 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:21:26,036 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35151. Reason: failure-to-start- 3537s 2024-11-23 21:21:26,037 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:21:26,038 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33279': TLS handshake failed with remote 'tls://127.0.0.1:49676': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:21:26,038 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33279': TLS handshake failed with remote 'tls://127.0.0.1:49684': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:21:26,040 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:21:27,048 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:21:27,056 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45705 3537s 2024-11-23 21:21:27,056 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38859/status 3537s 2024-11-23 21:21:27,057 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:21:27,073 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37813 3537s 2024-11-23 21:21:27,073 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37813 3537s 2024-11-23 21:21:27,073 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:21:27,073 - distributed.worker - INFO - dashboard at: 127.0.0.1:39309 3537s 2024-11-23 21:21:27,073 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45705 3537s 2024-11-23 21:21:27,073 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:21:27,073 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:21:27,073 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:21:27,073 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-7spf9je7 3537s 2024-11-23 21:21:27,074 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:21:27,076 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43689 3537s 2024-11-23 21:21:27,076 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43689 3537s 2024-11-23 21:21:27,076 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:21:27,076 - distributed.worker - INFO - dashboard at: 127.0.0.1:46395 3537s 2024-11-23 21:21:27,076 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45705 3537s 2024-11-23 21:21:27,076 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:21:27,076 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:21:27,076 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:21:27,076 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-xccg67x9 3537s 2024-11-23 21:21:27,076 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:21:27,080 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37813. Reason: failure-to-start- 3537s 2024-11-23 21:21:27,080 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:21:27,081 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43689. Reason: failure-to-start- 3537s 2024-11-23 21:21:27,081 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:21:27,083 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45705': TLS handshake failed with remote 'tls://127.0.0.1:50746': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:21:27,083 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45705': TLS handshake failed with remote 'tls://127.0.0.1:50748': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:21:27,085 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:21:28,090 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:21:28,099 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37919 3537s 2024-11-23 21:21:28,099 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36357/status 3537s 2024-11-23 21:21:28,100 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:21:28,135 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37611 3537s 2024-11-23 21:21:28,135 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37611 3537s 2024-11-23 21:21:28,135 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:21:28,135 - distributed.worker - INFO - dashboard at: 127.0.0.1:42941 3537s 2024-11-23 21:21:28,136 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37919 3537s 2024-11-23 21:21:28,136 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:21:28,136 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:21:28,136 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:21:28,136 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ukx7bsp0 3537s 2024-11-23 21:21:28,136 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:21:28,138 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39847 3537s 2024-11-23 21:21:28,138 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39847 3537s 2024-11-23 21:21:28,138 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:21:28,138 - distributed.worker - INFO - dashboard at: 127.0.0.1:42933 3537s 2024-11-23 21:21:28,138 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37919 3537s 2024-11-23 21:21:28,138 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:21:28,139 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:21:28,139 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:21:28,139 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-1xr4ps0p 3537s 2024-11-23 21:21:28,139 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:21:28,140 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37611. Reason: failure-to-start- 3537s 2024-11-23 21:21:28,140 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:21:28,141 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39847. Reason: failure-to-start- 3537s 2024-11-23 21:21:28,141 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:21:28,145 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37919': TLS handshake failed with remote 'tls://127.0.0.1:33768': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:21:28,145 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37919': TLS handshake failed with remote 'tls://127.0.0.1:33778': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:21:28,147 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:21:29,153 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:21:29,161 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37817 3537s 2024-11-23 21:21:29,162 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39429/status 3537s 2024-11-23 21:21:29,162 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:21:29,178 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37713 3537s 2024-11-23 21:21:29,178 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37713 3537s 2024-11-23 21:21:29,179 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:21:29,179 - distributed.worker - INFO - dashboard at: 127.0.0.1:43575 3537s 2024-11-23 21:21:29,179 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37817 3537s 2024-11-23 21:21:29,179 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:21:29,179 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:21:29,179 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:21:29,179 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-3xyhp_90 3537s 2024-11-23 21:21:29,179 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:21:29,183 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39927 3537s 2024-11-23 21:21:29,183 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39927 3537s 2024-11-23 21:21:29,183 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:21:29,183 - distributed.worker - INFO - dashboard at: 127.0.0.1:36279 3537s 2024-11-23 21:21:29,183 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37817 3537s 2024-11-23 21:21:29,183 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:21:29,183 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:21:29,183 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:21:29,183 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-xbyvq6zr 3537s 2024-11-23 21:21:29,183 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:21:29,185 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37713. Reason: failure-to-start- 3537s 2024-11-23 21:21:29,185 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:21:29,185 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39927. Reason: failure-to-start- 3537s 2024-11-23 21:21:29,185 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:21:29,190 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37817': TLS handshake failed with remote 'tls://127.0.0.1:35974': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:21:29,190 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37817': TLS handshake failed with remote 'tls://127.0.0.1:35990': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:21:29,191 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:21:30,197 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:21:30,205 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46751 3537s 2024-11-23 21:21:30,206 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41621/status 3537s 2024-11-23 21:21:30,206 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:21:30,223 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40409 3537s 2024-11-23 21:21:30,223 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40409 3537s 2024-11-23 21:21:30,224 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:21:30,224 - distributed.worker - INFO - dashboard at: 127.0.0.1:38557 3537s 2024-11-23 21:21:30,224 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46751 3537s 2024-11-23 21:21:30,224 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:21:30,224 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:21:30,224 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:21:30,224 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-nhrttb75 3537s 2024-11-23 21:21:30,224 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:21:30,226 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41867 3537s 2024-11-23 21:21:30,226 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41867 3537s 2024-11-23 21:21:30,226 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:21:30,227 - distributed.worker - INFO - dashboard at: 127.0.0.1:42339 3537s 2024-11-23 21:21:30,227 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46751 3537s 2024-11-23 21:21:30,227 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:21:30,227 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:21:30,227 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:21:30,227 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-rnkthlty 3537s 2024-11-23 21:21:30,227 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:21:30,230 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40409. Reason: failure-to-start- 3537s 2024-11-23 21:21:30,231 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:21:30,231 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41867. Reason: failure-to-start- 3537s 2024-11-23 21:21:30,231 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:21:30,233 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46751': TLS handshake failed with remote 'tls://127.0.0.1:58648': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:21:30,233 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46751': TLS handshake failed with remote 'tls://127.0.0.1:58656': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:21:30,235 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:21:31,243 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:21:31,251 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37213 3537s 2024-11-23 21:21:31,252 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42141/status 3537s 2024-11-23 21:21:31,252 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:21:31,269 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37925 3537s 2024-11-23 21:21:31,269 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37925 3537s 2024-11-23 21:21:31,269 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:21:31,269 - distributed.worker - INFO - dashboard at: 127.0.0.1:39221 3537s 2024-11-23 21:21:31,269 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37213 3537s 2024-11-23 21:21:31,269 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:21:31,269 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:21:31,270 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:21:31,270 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-1z2y5vm2 3537s 2024-11-23 21:21:31,270 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:21:31,272 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36333 3537s 2024-11-23 21:21:31,272 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36333 3537s 2024-11-23 21:21:31,272 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:21:31,273 - distributed.worker - INFO - dashboard at: 127.0.0.1:41495 3537s 2024-11-23 21:21:31,273 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37213 3537s 2024-11-23 21:21:31,273 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:21:31,273 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:21:31,273 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:21:31,273 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-eanmghoe 3537s 2024-11-23 21:21:31,273 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:21:31,277 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37925. Reason: failure-to-start- 3537s 2024-11-23 21:21:31,277 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:21:31,278 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36333. Reason: failure-to-start- 3537s 2024-11-23 21:21:31,278 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:21:31,280 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37213': TLS handshake failed with remote 'tls://127.0.0.1:43158': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:21:31,280 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37213': TLS handshake failed with remote 'tls://127.0.0.1:43172': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:21:31,282 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:21:32,287 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:21:32,295 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37199 3537s 2024-11-23 21:21:32,296 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34891/status 3537s 2024-11-23 21:21:32,296 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:21:32,316 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35301 3537s 2024-11-23 21:21:32,316 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35301 3537s 2024-11-23 21:21:32,317 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:21:32,317 - distributed.worker - INFO - dashboard at: 127.0.0.1:38255 3537s 2024-11-23 21:21:32,317 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 3537s 2024-11-23 21:21:32,317 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:21:32,317 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:21:32,317 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:21:32,317 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-a76f3fl4 3537s 2024-11-23 21:21:32,317 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:21:32,319 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44649 3537s 2024-11-23 21:21:32,319 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44649 3537s 2024-11-23 21:21:32,319 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:21:32,320 - distributed.worker - INFO - dashboard at: 127.0.0.1:35369 3537s 2024-11-23 21:21:32,320 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 3537s 2024-11-23 21:21:32,320 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:21:32,320 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:21:32,320 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:21:32,320 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-81lry1h6 3537s 2024-11-23 21:21:32,320 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:21:32,321 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35301. Reason: failure-to-start- 3537s 2024-11-23 21:21:32,322 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:21:32,322 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44649. Reason: failure-to-start- 3537s 2024-11-23 21:21:32,322 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:21:32,324 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:52544': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:21:32,324 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:52558': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:21:32,326 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:21:33,331 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:21:33,339 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41413 3537s 2024-11-23 21:21:33,339 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44165/status 3537s 2024-11-23 21:21:33,340 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:21:33,360 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40667 3537s 2024-11-23 21:21:33,361 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40667 3537s 2024-11-23 21:21:33,361 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:21:33,361 - distributed.worker - INFO - dashboard at: 127.0.0.1:40533 3537s 2024-11-23 21:21:33,361 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41413 3537s 2024-11-23 21:21:33,361 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:21:33,361 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:21:33,361 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:21:33,361 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-9n9e_6mb 3537s 2024-11-23 21:21:33,361 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:21:33,363 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38765 3537s 2024-11-23 21:21:33,363 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38765 3537s 2024-11-23 21:21:33,364 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:21:33,364 - distributed.worker - INFO - dashboard at: 127.0.0.1:40167 3537s 2024-11-23 21:21:33,364 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41413 3537s 2024-11-23 21:21:33,364 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:21:33,364 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:21:33,364 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:21:33,364 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-fcny6kec 3537s 2024-11-23 21:21:33,364 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:21:33,365 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40667. Reason: failure-to-start- 3537s 2024-11-23 21:21:33,366 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:21:33,366 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38765. Reason: failure-to-start- 3537s 2024-11-23 21:21:33,366 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:21:33,368 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41413': TLS handshake failed with remote 'tls://127.0.0.1:33076': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:21:33,368 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41413': TLS handshake failed with remote 'tls://127.0.0.1:33078': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:21:33,372 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:21:34,378 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:21:34,386 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:32989 3537s 2024-11-23 21:21:34,386 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39309/status 3537s 2024-11-23 21:21:34,386 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:21:34,404 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33161 3537s 2024-11-23 21:21:34,405 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33161 3537s 2024-11-23 21:21:34,405 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:21:34,405 - distributed.worker - INFO - dashboard at: 127.0.0.1:40493 3537s 2024-11-23 21:21:34,405 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:32989 3537s 2024-11-23 21:21:34,405 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:21:34,405 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:21:34,405 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:21:34,405 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-kgb5mghj 3537s 2024-11-23 21:21:34,405 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:21:34,407 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34079 3537s 2024-11-23 21:21:34,407 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34079 3537s 2024-11-23 21:21:34,407 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:21:34,408 - distributed.worker - INFO - dashboard at: 127.0.0.1:45907 3537s 2024-11-23 21:21:34,408 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:32989 3537s 2024-11-23 21:21:34,408 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:21:34,408 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:21:34,408 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:21:34,408 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-yxsbt4mq 3537s 2024-11-23 21:21:34,408 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:21:34,413 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33161. Reason: failure-to-start- 3537s 2024-11-23 21:21:34,414 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:21:34,414 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34079. Reason: failure-to-start- 3537s 2024-11-23 21:21:34,414 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:21:34,416 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:32989': TLS handshake failed with remote 'tls://127.0.0.1:47288': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:21:34,416 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:32989': TLS handshake failed with remote 'tls://127.0.0.1:47290': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:21:34,418 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:21:35,423 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:21:35,430 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35443 3537s 2024-11-23 21:21:35,431 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40945/status 3537s 2024-11-23 21:21:35,431 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:21:35,449 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46695 3537s 2024-11-23 21:21:35,449 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46695 3537s 2024-11-23 21:21:35,449 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:21:35,449 - distributed.worker - INFO - dashboard at: 127.0.0.1:40709 3537s 2024-11-23 21:21:35,449 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35443 3537s 2024-11-23 21:21:35,449 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:21:35,449 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:21:35,449 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:21:35,449 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-fqihoqp3 3537s 2024-11-23 21:21:35,449 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:21:35,452 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44147 3537s 2024-11-23 21:21:35,452 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44147 3537s 2024-11-23 21:21:35,452 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:21:35,452 - distributed.worker - INFO - dashboard at: 127.0.0.1:39501 3537s 2024-11-23 21:21:35,452 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35443 3537s 2024-11-23 21:21:35,452 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:21:35,452 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:21:35,452 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:21:35,452 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-esa7g8z9 3537s 2024-11-23 21:21:35,452 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:21:35,456 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46695. Reason: failure-to-start- 3537s 2024-11-23 21:21:35,456 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:21:35,457 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44147. Reason: failure-to-start- 3537s 2024-11-23 21:21:35,457 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:21:35,459 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35443': TLS handshake failed with remote 'tls://127.0.0.1:56066': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:21:35,459 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35443': TLS handshake failed with remote 'tls://127.0.0.1:56078': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:21:35,461 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:21:36,468 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:21:36,476 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46045 3537s 2024-11-23 21:21:36,476 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33741/status 3537s 2024-11-23 21:21:36,476 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:21:36,494 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39609 3537s 2024-11-23 21:21:36,494 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39609 3537s 2024-11-23 21:21:36,495 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:21:36,495 - distributed.worker - INFO - dashboard at: 127.0.0.1:37031 3537s 2024-11-23 21:21:36,495 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46045 3537s 2024-11-23 21:21:36,495 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:21:36,495 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:21:36,495 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:21:36,495 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-3aaux6d4 3537s 2024-11-23 21:21:36,495 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:21:36,497 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45707 3537s 2024-11-23 21:21:36,497 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45707 3537s 2024-11-23 21:21:36,498 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:21:36,498 - distributed.worker - INFO - dashboard at: 127.0.0.1:46587 3537s 2024-11-23 21:21:36,498 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46045 3537s 2024-11-23 21:21:36,498 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:21:36,498 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:21:36,498 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:21:36,498 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-94kzyge9 3537s 2024-11-23 21:21:36,498 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:21:36,502 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39609. Reason: failure-to-start- 3537s 2024-11-23 21:21:36,502 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:21:36,502 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45707. Reason: failure-to-start- 3537s 2024-11-23 21:21:36,503 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:21:36,504 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46045': TLS handshake failed with remote 'tls://127.0.0.1:56030': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:21:36,504 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46045': TLS handshake failed with remote 'tls://127.0.0.1:56034': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:21:36,506 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:21:37,512 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:21:37,519 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44563 3537s 2024-11-23 21:21:37,519 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36027/status 3537s 2024-11-23 21:21:37,520 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:21:37,542 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40781 3537s 2024-11-23 21:21:37,542 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40781 3537s 2024-11-23 21:21:37,542 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:21:37,542 - distributed.worker - INFO - dashboard at: 127.0.0.1:41013 3537s 2024-11-23 21:21:37,542 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 3537s 2024-11-23 21:21:37,543 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:21:37,543 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:21:37,543 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:21:37,543 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-8727hndz 3537s 2024-11-23 21:21:37,543 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:21:37,545 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39605 3537s 2024-11-23 21:21:37,545 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39605 3537s 2024-11-23 21:21:37,545 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:21:37,545 - distributed.worker - INFO - dashboard at: 127.0.0.1:33251 3537s 2024-11-23 21:21:37,545 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 3537s 2024-11-23 21:21:37,545 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:21:37,546 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:21:37,546 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:21:37,546 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-r0kottx3 3537s 2024-11-23 21:21:37,546 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:21:37,547 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40781. Reason: failure-to-start- 3537s 2024-11-23 21:21:37,547 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:21:37,548 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39605. Reason: failure-to-start- 3537s 2024-11-23 21:21:37,548 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:21:37,549 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:51528': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:21:37,550 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:51542': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:21:37,551 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:21:38,557 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:21:38,565 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38861 3537s 2024-11-23 21:21:38,565 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46597/status 3537s 2024-11-23 21:21:38,566 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:21:38,588 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37225 3537s 2024-11-23 21:21:38,588 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37225 3537s 2024-11-23 21:21:38,589 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:21:38,589 - distributed.worker - INFO - dashboard at: 127.0.0.1:33881 3537s 2024-11-23 21:21:38,589 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38861 3537s 2024-11-23 21:21:38,589 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:21:38,589 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:21:38,589 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:21:38,589 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ho750pr0 3537s 2024-11-23 21:21:38,589 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:21:38,591 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33203 3537s 2024-11-23 21:21:38,592 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33203 3537s 2024-11-23 21:21:38,592 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:21:38,592 - distributed.worker - INFO - dashboard at: 127.0.0.1:46873 3537s 2024-11-23 21:21:38,592 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38861 3537s 2024-11-23 21:21:38,592 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:21:38,592 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:21:38,592 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:21:38,592 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-iaatsp2r 3537s 2024-11-23 21:21:38,592 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:21:38,594 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37225. Reason: failure-to-start- 3537s 2024-11-23 21:21:38,594 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:21:38,594 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33203. Reason: failure-to-start- 3537s 2024-11-23 21:21:38,594 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:21:38,596 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38861': TLS handshake failed with remote 'tls://127.0.0.1:46826': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:21:38,596 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38861': TLS handshake failed with remote 'tls://127.0.0.1:46838': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:21:38,598 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:21:39,605 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:21:39,612 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35165 3537s 2024-11-23 21:21:39,613 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:32977/status 3537s 2024-11-23 21:21:39,615 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:21:39,633 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42503 3537s 2024-11-23 21:21:39,633 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42503 3537s 2024-11-23 21:21:39,633 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:21:39,633 - distributed.worker - INFO - dashboard at: 127.0.0.1:34917 3537s 2024-11-23 21:21:39,633 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35165 3537s 2024-11-23 21:21:39,633 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:21:39,633 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:21:39,633 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:21:39,634 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-oxuk6_i6 3537s 2024-11-23 21:21:39,634 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:21:39,636 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40931 3537s 2024-11-23 21:21:39,636 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40931 3537s 2024-11-23 21:21:39,636 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:21:39,636 - distributed.worker - INFO - dashboard at: 127.0.0.1:38835 3537s 2024-11-23 21:21:39,636 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35165 3537s 2024-11-23 21:21:39,636 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:21:39,636 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:21:39,637 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:21:39,637 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ntj3x9gj 3537s 2024-11-23 21:21:39,637 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:21:39,640 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42503. Reason: failure-to-start- 3537s 2024-11-23 21:21:39,640 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:21:39,640 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40931. Reason: failure-to-start- 3537s 2024-11-23 21:21:39,641 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:21:39,645 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35165': TLS handshake failed with remote 'tls://127.0.0.1:45074': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:21:39,645 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35165': TLS handshake failed with remote 'tls://127.0.0.1:45078': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:21:39,646 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s ______________________________ test_worker_client ______________________________ 3537s 3537s fut = , timeout = 0 3537s 3537s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 3537s async with asyncio.timeout(timeout): 3537s > return await fut 3537s 3537s /usr/lib/python3/dist-packages/distributed/utils.py:1960: 3537s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3537s /usr/lib/python3/dist-packages/distributed/worker.py:1480: in start_unsafe 3537s await self._register_with_scheduler() 3537s /usr/lib/python3/dist-packages/distributed/worker.py:1179: in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s /usr/lib/python3/dist-packages/distributed/comm/core.py:342: in connect 3537s comm = await wait_for( 3537s /usr/lib/python3/dist-packages/distributed/utils.py:1960: in wait_for 3537s return await fut 3537s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:546: in connect 3537s stream = await self.client.connect( 3537s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3537s 3537s self = , host = '127.0.0.1' 3537s port = 43267, af = 3537s ssl_options = 3537s max_buffer_size = 8364507136.0, source_ip = None, source_port = None 3537s timeout = None 3537s 3537s async def connect( 3537s self, 3537s host: str, 3537s port: int, 3537s af: socket.AddressFamily = socket.AF_UNSPEC, 3537s ssl_options: Optional[Union[Dict[str, Any], ssl.SSLContext]] = None, 3537s max_buffer_size: Optional[int] = None, 3537s source_ip: Optional[str] = None, 3537s source_port: Optional[int] = None, 3537s timeout: Optional[Union[float, datetime.timedelta]] = None, 3537s ) -> IOStream: 3537s """Connect to the given host and port. 3537s 3537s Asynchronously returns an `.IOStream` (or `.SSLIOStream` if 3537s ``ssl_options`` is not None). 3537s 3537s Using the ``source_ip`` kwarg, one can specify the source 3537s IP address to use when establishing the connection. 3537s In case the user needs to resolve and 3537s use a specific interface, it has to be handled outside 3537s of Tornado as this depends very much on the platform. 3537s 3537s Raises `TimeoutError` if the input future does not complete before 3537s ``timeout``, which may be specified in any form allowed by 3537s `.IOLoop.add_timeout` (i.e. a `datetime.timedelta` or an absolute time 3537s relative to `.IOLoop.time`) 3537s 3537s Similarly, when the user requires a certain source port, it can 3537s be specified using the ``source_port`` arg. 3537s 3537s .. versionchanged:: 4.5 3537s Added the ``source_ip`` and ``source_port`` arguments. 3537s 3537s .. versionchanged:: 5.0 3537s Added the ``timeout`` argument. 3537s """ 3537s if timeout is not None: 3537s if isinstance(timeout, numbers.Real): 3537s timeout = IOLoop.current().time() + timeout 3537s elif isinstance(timeout, datetime.timedelta): 3537s timeout = IOLoop.current().time() + timeout.total_seconds() 3537s else: 3537s raise TypeError("Unsupported timeout %r" % timeout) 3537s if timeout is not None: 3537s addrinfo = await gen.with_timeout( 3537s timeout, self.resolver.resolve(host, port, af) 3537s ) 3537s else: 3537s addrinfo = await self.resolver.resolve(host, port, af) 3537s connector = _Connector( 3537s addrinfo, 3537s functools.partial( 3537s self._create_stream, 3537s max_buffer_size, 3537s source_ip=source_ip, 3537s source_port=source_port, 3537s ), 3537s ) 3537s > af, addr, stream = await connector.start(connect_timeout=timeout) 3537s E asyncio.exceptions.CancelledError 3537s 3537s /usr/lib/python3/dist-packages/tornado/tcpclient.py:279: CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s self = 3537s 3537s @final 3537s async def start(self): 3537s async with self._startup_lock: 3537s if self.status == Status.failed: 3537s assert self.__startup_exc is not None 3537s raise self.__startup_exc 3537s elif self.status != Status.init: 3537s return self 3537s timeout = getattr(self, "death_timeout", None) 3537s 3537s async def _close_on_failure(exc: Exception) -> None: 3537s await self.close(reason=f"failure-to-start-{str(type(exc))}") 3537s self.status = Status.failed 3537s self.__startup_exc = exc 3537s 3537s try: 3537s > await wait_for(self.start_unsafe(), timeout=timeout) 3537s 3537s /usr/lib/python3/dist-packages/distributed/core.py:664: 3537s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3537s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 3537s async with asyncio.timeout(timeout): 3537s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3537s 3537s self = 3537s exc_type = 3537s exc_val = CancelledError(), exc_tb = 3537s 3537s async def __aexit__( 3537s self, 3537s exc_type: Optional[Type[BaseException]], 3537s exc_val: Optional[BaseException], 3537s exc_tb: Optional[TracebackType], 3537s ) -> Optional[bool]: 3537s assert self._state in (_State.ENTERED, _State.EXPIRING) 3537s 3537s if self._timeout_handler is not None: 3537s self._timeout_handler.cancel() 3537s self._timeout_handler = None 3537s 3537s if self._state is _State.EXPIRING: 3537s self._state = _State.EXPIRED 3537s 3537s if self._task.uncancel() <= self._cancelling and exc_type is not None: 3537s # Since there are no new cancel requests, we're 3537s # handling this. 3537s if issubclass(exc_type, exceptions.CancelledError): 3537s > raise TimeoutError from exc_val 3537s E TimeoutError 3537s 3537s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s @contextlib.asynccontextmanager 3537s async def _cluster_factory(): 3537s workers = [] 3537s s = None 3537s try: 3537s for _ in range(60): 3537s try: 3537s > s, ws = await start_cluster( 3537s nthreads, 3537s scheduler, 3537s security=security, 3537s Worker=Worker, 3537s scheduler_kwargs=scheduler_kwargs, 3537s worker_kwargs=merge( 3537s {"death_timeout": min(15, int(deadline.remaining))}, 3537s worker_kwargs, 3537s ), 3537s ) 3537s 3537s /usr/lib/python3/dist-packages/distributed/utils_test.py:966: 3537s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3537s /usr/lib/python3/dist-packages/distributed/utils_test.py:789: in start_cluster 3537s await asyncio.gather(*workers) 3537s /usr/lib/python3.13/asyncio/tasks.py:737: in _wrap_awaitable 3537s return await awaitable 3537s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3537s 3537s self = 3537s 3537s @final 3537s async def start(self): 3537s async with self._startup_lock: 3537s if self.status == Status.failed: 3537s assert self.__startup_exc is not None 3537s raise self.__startup_exc 3537s elif self.status != Status.init: 3537s return self 3537s timeout = getattr(self, "death_timeout", None) 3537s 3537s async def _close_on_failure(exc: Exception) -> None: 3537s await self.close(reason=f"failure-to-start-{str(type(exc))}") 3537s self.status = Status.failed 3537s self.__startup_exc = exc 3537s 3537s try: 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s except asyncio.TimeoutError as exc: 3537s await _close_on_failure(exc) 3537s > raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s E TimeoutError: Worker start timed out after 0s. 3537s 3537s /usr/lib/python3/dist-packages/distributed/core.py:667: TimeoutError 3537s 3537s During handling of the above exception, another exception occurred: 3537s 3537s fut = ._..test_func..async_fn at 0xe247c938> 3537s timeout = 60 3537s 3537s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 3537s async with asyncio.timeout(timeout): 3537s > return await fut 3537s 3537s /usr/lib/python3/dist-packages/distributed/utils.py:1960: 3537s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3537s /usr/lib/python3/dist-packages/distributed/utils_test.py:999: in async_fn 3537s _cluster_factory() as (s, workers), 3537s /usr/lib/python3.13/contextlib.py:214: in __aenter__ 3537s return await anext(self.gen) 3537s /usr/lib/python3/dist-packages/distributed/utils_test.py:983: in _cluster_factory 3537s await asyncio.sleep(1) 3537s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3537s 3537s delay = 1, result = None 3537s 3537s async def sleep(delay, result=None): 3537s """Coroutine that completes after a given time (in seconds).""" 3537s if delay <= 0: 3537s await __sleep0() 3537s return result 3537s 3537s if math.isnan(delay): 3537s raise ValueError("Invalid delay: NaN (not a number)") 3537s 3537s loop = events.get_running_loop() 3537s future = loop.create_future() 3537s h = loop.call_later(delay, 3537s futures._set_result_unless_cancelled, 3537s future, result) 3537s try: 3537s > return await future 3537s E asyncio.exceptions.CancelledError 3537s 3537s /usr/lib/python3.13/asyncio/tasks.py:718: CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s args = (), kwds = {} 3537s 3537s @wraps(func) 3537s def inner(*args, **kwds): 3537s with self._recreate_cm(): 3537s > return func(*args, **kwds) 3537s 3537s /usr/lib/python3.13/contextlib.py:85: 3537s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3537s /usr/lib/python3.13/contextlib.py:85: in inner 3537s return func(*args, **kwds) 3537s /usr/lib/python3/dist-packages/distributed/utils_test.py:1102: in test_func 3537s return _run_and_close_tornado(async_fn_outer) 3537s /usr/lib/python3/dist-packages/distributed/utils_test.py:378: in _run_and_close_tornado 3537s return asyncio_run(inner_fn(), loop_factory=get_loop_factory()) 3537s /usr/lib/python3.13/asyncio/runners.py:194: in run 3537s return runner.run(main) 3537s /usr/lib/python3.13/asyncio/runners.py:118: in run 3537s return self._loop.run_until_complete(task) 3537s /usr/lib/python3.13/asyncio/base_events.py:720: in run_until_complete 3537s return future.result() 3537s /usr/lib/python3/dist-packages/distributed/utils_test.py:375: in inner_fn 3537s return await async_fn(*args, **kwargs) 3537s /usr/lib/python3/dist-packages/distributed/utils_test.py:1099: in async_fn_outer 3537s return await utils_wait_for(async_fn(), timeout=timeout * 2) 3537s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 3537s async with asyncio.timeout(timeout): 3537s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3537s 3537s self = 3537s exc_type = 3537s exc_val = CancelledError(), exc_tb = 3537s 3537s async def __aexit__( 3537s self, 3537s exc_type: Optional[Type[BaseException]], 3537s exc_val: Optional[BaseException], 3537s exc_tb: Optional[TracebackType], 3537s ) -> Optional[bool]: 3537s assert self._state in (_State.ENTERED, _State.EXPIRING) 3537s 3537s if self._timeout_handler is not None: 3537s self._timeout_handler.cancel() 3537s self._timeout_handler = None 3537s 3537s if self._state is _State.EXPIRING: 3537s self._state = _State.EXPIRED 3537s 3537s if self._task.uncancel() <= self._cancelling and exc_type is not None: 3537s # Since there are no new cancel requests, we're 3537s # handling this. 3537s if issubclass(exc_type, exceptions.CancelledError): 3537s > raise TimeoutError from exc_val 3537s E TimeoutError 3537s 3537s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 3537s ----------------------------- Captured stderr call ----------------------------- 3537s 2024-11-23 21:21:40,880 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:21:40,887 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:40,888 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:32771/status 3537s 2024-11-23 21:21:40,888 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:21:40,904 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41787 3537s 2024-11-23 21:21:40,904 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41787 3537s 2024-11-23 21:21:40,904 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:21:40,904 - distributed.worker - INFO - dashboard at: 127.0.0.1:39967 3537s 2024-11-23 21:21:40,904 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:40,904 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:21:40,904 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:21:40,905 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:21:40,905 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-euanfirz 3537s 2024-11-23 21:21:40,905 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:21:40,907 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45059 3537s 2024-11-23 21:21:40,907 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45059 3537s 2024-11-23 21:21:40,907 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:21:40,907 - distributed.worker - INFO - dashboard at: 127.0.0.1:33735 3537s 2024-11-23 21:21:40,907 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:40,907 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:21:40,907 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:21:40,907 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:21:40,907 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ohcik8qd 3537s 2024-11-23 21:21:40,908 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:21:40,921 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:40,921 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:40,921 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:58732': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:40,921 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:58742': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:41,034 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:41,034 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:41,034 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:58746': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:41,034 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:58748': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:41,147 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:41,147 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:41,148 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:58752': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:41,148 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:58756': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:41,261 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:41,261 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:41,262 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:58768': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:41,262 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:58776': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:41,374 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:41,375 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:41,375 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:58778': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:41,375 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:58788': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:41,487 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:41,487 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:41,488 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:58802': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:41,488 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:58814': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:41,601 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:41,602 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:41,602 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:36160': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:41,602 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:36172': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:41,716 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:41,716 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:41,716 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:36186': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:41,717 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:36196': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:41,829 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:41,830 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:41,830 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:36210': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:41,830 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:36214': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:41,943 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:41,944 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:41,944 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:36222': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:41,944 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:36238': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:42,056 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:42,057 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:42,057 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:36244': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:42,057 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:36246': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:42,171 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:42,171 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:42,171 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:36260': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:42,172 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:36264': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:42,284 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:42,284 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:42,284 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:36274': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:42,285 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:36278': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:42,398 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:42,398 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:42,401 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:36294': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:42,401 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:36296': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:42,511 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:42,511 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:42,511 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:36310': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:42,511 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:36324': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:42,624 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:42,624 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:42,625 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:36332': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:42,625 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:36334': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:42,738 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:42,738 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:42,738 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:36346': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:42,739 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:36362': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:42,851 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:42,851 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:42,851 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:36366': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:42,851 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:36376': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:42,966 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:42,966 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:42,967 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:36392': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:42,967 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:36396': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:43,079 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:43,079 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:43,079 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:36410': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:43,079 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:36418': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:43,192 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:43,193 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:43,193 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:36434': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:43,193 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:36448': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:43,305 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:43,306 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:43,306 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:36456': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:43,306 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:36460': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:43,420 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:43,420 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:43,420 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:36476': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:43,420 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:36490': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:43,533 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:43,533 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:43,534 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:36494': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:43,534 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:36498': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:43,646 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:43,646 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:43,647 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:36510': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:43,647 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:36518': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:43,759 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:43,759 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:43,759 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:36520': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:43,759 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:36532': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:43,873 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:43,874 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:43,874 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:36540': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:43,874 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:36546': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:43,987 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:43,987 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:43,987 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:36558': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:43,987 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:36574': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:44,100 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:44,101 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:44,101 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:36582': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:44,101 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:36592': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:44,214 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:44,214 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:44,214 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:36598': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:44,215 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:36604': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:44,327 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:44,327 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:44,327 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:36608': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:44,327 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:36622': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:44,441 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:44,442 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:44,442 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:36624': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:44,442 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:36636': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:44,556 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:44,556 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:44,556 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:36640': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:44,557 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:36642': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:44,670 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:44,670 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:44,671 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:36658': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:44,671 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:36666': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:44,785 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:44,785 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:44,785 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:36678': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:44,786 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:36692': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:44,902 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:44,902 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:44,903 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:36700': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:44,903 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:36706': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:45,016 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:45,017 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:45,017 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:36716': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:45,017 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:36728': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:45,130 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:45,131 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:45,131 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:36732': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:45,131 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:36744': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:45,244 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:45,244 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:45,244 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:36756': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:45,245 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:36768': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:45,357 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:45,357 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:45,358 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:36784': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:45,358 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:36798': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:45,471 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:45,471 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:45,472 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:36808': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:45,472 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:36816': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:45,584 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:45,584 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:45,584 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:36818': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:45,585 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:36834': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:45,698 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:45,698 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:45,699 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:36842': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:45,699 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:36846': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:45,812 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:45,812 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:45,813 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:36858': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:45,813 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:36860': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:45,925 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:45,925 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:45,926 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:36868': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:45,926 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:36874': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:46,039 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:46,039 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:46,040 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:36890': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:46,040 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:36906': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:46,151 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:46,153 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:46,153 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:36920': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:46,153 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:36934': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:46,260 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:46,261 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:36942': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:46,266 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:46,266 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:36958': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:46,370 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:46,371 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:36974': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:46,377 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:46,377 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:36984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:46,477 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:46,478 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:36996': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:46,484 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:46,485 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:37002': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:46,585 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:46,587 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:37012': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:46,594 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:46,594 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:37016': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:46,693 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:46,694 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:37026': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:46,702 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:46,702 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:37034': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:46,801 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:46,801 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:37046': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:46,809 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:46,809 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:37054': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:46,909 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:46,910 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:37064': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:46,916 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:46,917 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:37074': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:47,017 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:47,018 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:37082': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:47,024 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:47,025 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:37084': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:47,125 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:47,126 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:37090': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:47,132 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:47,133 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:37098': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:47,233 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:47,233 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:37108': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:47,239 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:47,240 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:37114': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:47,340 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:47,341 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:37124': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:47,347 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:47,348 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:37130': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:47,448 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:47,449 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:37134': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:47,455 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:47,456 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:37140': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:47,556 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:47,557 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:37144': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:47,563 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:47,563 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:37152': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:47,665 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:47,666 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:37160': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:47,672 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:47,673 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:37168': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:47,773 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:47,774 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:37176': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:47,780 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:47,781 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:37186': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:47,881 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:47,882 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:37192': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:47,888 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:47,889 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:37208': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:47,990 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:47,991 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:37212': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:47,997 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:47,997 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:37228': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:48,099 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:48,100 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:37230': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:48,106 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:48,106 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:37242': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:48,206 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:48,207 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:37252': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:48,213 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:48,214 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:37254': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:48,318 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:48,319 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:37264': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:48,325 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:48,326 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:37280': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:48,426 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:48,427 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:37286': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:48,433 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:48,434 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:37294': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:48,534 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:48,534 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:37308': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:48,541 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:48,541 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:37310': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:48,642 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:48,642 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:37314': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:48,649 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:48,649 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:37328': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:48,750 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:48,750 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:37330': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:48,757 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:48,757 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:37344': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:48,858 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:48,859 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:37354': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:48,865 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:48,865 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:37362': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:48,966 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:48,967 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:37374': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:48,973 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:48,974 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:37384': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:49,075 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:49,076 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:37400': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:49,082 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:49,082 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:37406': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:49,183 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:49,184 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:37414': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:49,191 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:49,191 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:37428': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:49,292 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:49,292 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:37438': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:49,299 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:49,299 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:37450': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:49,399 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:49,400 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:37460': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:49,406 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:49,407 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:37470': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:49,507 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:49,508 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:37480': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:49,514 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:49,515 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:37482': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:49,616 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:49,617 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:37492': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:49,623 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:49,623 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:37504': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:49,723 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:49,724 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:37518': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:49,730 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:49,731 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:37524': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:49,832 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:49,833 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:37538': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:49,839 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:49,840 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:37546': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:49,941 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:49,943 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:37548': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:49,949 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:49,950 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:37560': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:50,049 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:50,050 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:37562': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:50,057 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:50,057 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:37572': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:50,157 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:50,158 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:37574': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:50,164 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:50,164 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:37590': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:50,265 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:50,266 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:37592': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:50,272 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:50,273 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:37604': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:50,374 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:50,374 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:37608': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:50,381 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:50,381 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:37620': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:50,482 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:50,482 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:37634': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:50,489 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:50,490 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:37640': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:50,590 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:50,591 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:37642': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:50,597 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:50,598 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:37646': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:50,697 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:50,698 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:37656': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:50,704 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:50,705 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:37670': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:50,806 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:50,807 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:37684': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:50,813 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:50,814 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:37692': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:50,914 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:50,915 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:37704': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:50,921 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:50,922 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:37710': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:51,022 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:51,023 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:37722': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:51,029 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:51,030 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:37734': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:51,131 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:51,132 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:37748': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:51,138 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:51,138 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:37764': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:51,239 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:51,240 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:37770': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:51,246 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:51,246 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:37780': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:51,347 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:51,348 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:37794': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:51,354 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:51,355 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:37806': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:51,456 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:51,457 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:37814': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:51,463 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:51,463 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:37818': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:51,565 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:51,566 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:43770': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:51,572 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:51,572 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:43778': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:51,676 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:51,677 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:43784': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:51,683 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:51,683 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:43796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:51,785 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:51,786 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:43798': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:51,792 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:51,793 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:43814': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:51,893 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:51,897 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:43824': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:51,904 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:51,904 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:43840': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:52,001 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:52,001 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:43854': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:52,011 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:52,012 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:43870': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:52,108 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:52,109 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:43886': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:52,119 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:52,120 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:43902': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:52,216 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:52,217 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:43906': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:52,226 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:52,227 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:43916': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:52,324 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:52,324 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:43920': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:52,334 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:52,335 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:43928': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:52,431 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:52,432 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:43934': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:52,442 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:52,442 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:43946': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:52,540 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:52,541 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:43956': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:52,549 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:52,550 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:43960': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:52,648 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:52,649 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:43964': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:52,656 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:52,657 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:43968': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:52,757 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:52,757 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:43976': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:52,764 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:52,764 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:43986': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:52,865 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:52,865 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:43990': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:52,872 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:52,872 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:44002': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:52,973 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:52,974 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:44014': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:52,980 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:52,981 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:44026': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:53,081 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:53,082 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:44030': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:53,088 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:53,088 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:44032': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:53,189 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:53,190 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:44040': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:53,197 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:53,197 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:44052': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:53,297 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:53,298 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:44062': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:53,306 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:53,307 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:44070': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:53,405 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:53,405 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:44080': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:53,413 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:53,413 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:44092': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:53,514 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:53,514 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:44098': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:53,521 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:53,521 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:44102': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:53,621 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:53,622 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:44108': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:53,628 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:53,629 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:44118': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:53,729 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:53,730 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:44122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:53,736 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:53,736 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:44126': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:53,837 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:53,838 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:44140': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:53,844 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:53,845 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:44152': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:53,945 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:53,946 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:44168': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:53,952 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:53,953 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:44174': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:54,054 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:54,055 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:44188': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:54,061 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:54,062 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:44202': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:54,162 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:54,162 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:44210': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:54,169 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:54,169 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:44220': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:54,270 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:54,271 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:44228': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:54,277 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:54,278 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:44238': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:54,378 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:54,378 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:44248': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:54,385 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:54,385 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:44262': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:54,486 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:54,486 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:44272': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:54,493 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:54,493 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:44286': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:54,594 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:54,595 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:44292': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:54,601 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:54,602 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:44300': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:54,702 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:54,703 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:44304': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:54,709 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:54,710 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:44312': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:54,810 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:54,811 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:44318': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:54,817 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:54,818 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:44324': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:54,919 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:54,920 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:44332': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:54,926 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:54,927 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:44342': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:55,030 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:55,031 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:44348': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:55,037 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:55,037 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:44356': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:55,138 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:55,139 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:44364': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:55,145 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:55,146 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:44376': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:55,246 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:55,246 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:44380': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:55,253 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:55,253 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:44386': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:55,353 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:55,354 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:44394': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:55,360 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:55,361 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:44406': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:55,461 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:55,461 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:44412': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:55,468 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:55,468 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:44420': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:55,570 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:55,571 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:44426': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:55,577 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:55,578 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:44430': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:55,678 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:55,678 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:44438': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:55,685 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:55,685 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:44450': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:55,786 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:55,787 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:44460': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:55,793 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:55,794 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:44464': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:55,898 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:55,899 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:44476': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:55,905 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 3537s 2024-11-23 21:21:55,905 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41787. Reason: failure-to-start- 3537s 2024-11-23 21:21:55,905 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:21:55,907 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:44486': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:55,907 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45059. Reason: failure-to-start- 3537s 2024-11-23 21:21:55,907 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:21:55,909 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 15s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 3537s stream = await stream.start_tls( 3537s ^^^^^^^^^^^^^^^^^^^^^^^ 3537s False, ssl_options=ssl_options, server_hostname=host 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 3537s self.socket.do_handshake() 3537s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 3537s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 3537s self._sslobj.do_handshake() 3537s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 3537s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 3537s raise FatalCommClosedError( 3537s ...<2 lines>... 3537s ) from err 3537s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 3537s 3537s During handling of the above exception, another exception occurred: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1218, in _register_with_scheduler 3537s await asyncio.sleep(0.1) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 718, in sleep 3537s return await future 3537s ^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 15s. 3537s 2024-11-23 21:21:56,916 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:21:56,923 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37285 3537s 2024-11-23 21:21:56,924 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39593/status 3537s 2024-11-23 21:21:56,924 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:21:56,941 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40415 3537s 2024-11-23 21:21:56,941 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40415 3537s 2024-11-23 21:21:56,942 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:21:56,942 - distributed.worker - INFO - dashboard at: 127.0.0.1:34081 3537s 2024-11-23 21:21:56,942 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:21:56,942 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:21:56,942 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:21:56,942 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:21:56,942 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-iuxqkiev 3537s 2024-11-23 21:21:56,942 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:21:56,944 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45925 3537s 2024-11-23 21:21:56,944 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45925 3537s 2024-11-23 21:21:56,944 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:21:56,945 - distributed.worker - INFO - dashboard at: 127.0.0.1:41265 3537s 2024-11-23 21:21:56,945 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:21:56,945 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:21:56,945 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:21:56,945 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:21:56,945 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-o6dehqba 3537s 2024-11-23 21:21:56,945 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:21:56,958 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:21:56,958 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:21:56,958 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:55594': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:56,959 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:55596': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:57,071 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:21:57,071 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:21:57,072 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:55610': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:57,072 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:55620': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:57,185 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:21:57,185 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:21:57,185 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:55626': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:57,185 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:55638': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:57,299 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:21:57,299 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:21:57,300 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:55650': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:57,300 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:55654': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:57,412 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:21:57,412 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:21:57,413 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:55664': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:57,413 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:55668': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:57,525 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:21:57,525 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:21:57,526 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:55674': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:57,526 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:55676': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:57,639 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:21:57,639 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:21:57,639 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:55688': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:57,639 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:55694': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:57,752 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:21:57,752 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:21:57,753 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:55696': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:57,753 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:55706': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:57,865 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:21:57,865 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:21:57,866 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:55720': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:57,866 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:55734': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:57,979 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:21:57,979 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:21:57,979 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:55742': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:57,979 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:55754': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:58,092 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:21:58,092 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:21:58,093 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:55760': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:58,093 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:55768': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:58,207 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:21:58,207 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:21:58,207 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:55778': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:58,208 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:55780': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:58,321 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:21:58,321 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:21:58,322 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:55792': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:58,322 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:55796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:58,437 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:21:58,438 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:21:58,438 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:55800': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:58,438 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:55814': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:58,552 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:21:58,552 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:21:58,552 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:55822': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:58,552 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:55832': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:58,666 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:21:58,666 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:21:58,667 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:55834': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:58,667 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:55846': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:58,780 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:21:58,781 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:21:58,781 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:55860': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:58,781 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:55876': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:58,894 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:21:58,894 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:21:58,898 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:55878': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:58,898 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:55892': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:59,007 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:21:59,007 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:21:59,008 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:55900': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:59,008 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:55912': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:59,121 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:21:59,121 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:21:59,121 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:55914': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:59,121 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:55926': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:59,234 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:21:59,234 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:21:59,235 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:55940': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:59,235 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:55950': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:59,347 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:21:59,347 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:21:59,348 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:55960': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:59,348 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:55962': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:59,461 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:21:59,461 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:21:59,461 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:55966': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:59,461 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:55982': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:59,574 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:21:59,574 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:21:59,575 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:55986': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:59,575 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:55996': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:59,687 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:21:59,687 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:21:59,688 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:55998': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:59,688 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:56004': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:59,800 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:21:59,800 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:21:59,801 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:56008': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:59,801 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:56014': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:59,914 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:21:59,915 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:21:59,915 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:56016': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:21:59,916 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:56032': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:00,023 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:00,028 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:56042': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:00,029 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:00,029 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:56052': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:00,131 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:00,132 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:56062': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:00,138 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:00,138 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:56078': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:00,238 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:00,239 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:56088': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:00,245 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:00,246 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:56102': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:00,347 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:00,347 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:56108': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:00,353 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:00,354 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:56122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:00,454 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:00,454 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:56136': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:00,461 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:00,461 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:56150': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:00,562 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:00,563 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:56154': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:00,569 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:00,570 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:56168': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:00,670 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:00,670 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:56176': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:00,677 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:00,678 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:56184': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:00,778 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:00,778 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:56198': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:00,785 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:00,785 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:56208': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:00,885 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:00,886 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:56214': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:00,893 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:00,896 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:56224': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:00,995 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:00,995 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:56228': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:01,001 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:01,002 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:56238': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:01,102 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:01,102 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:56240': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:01,109 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:01,109 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:56246': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:01,210 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:01,210 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:56250': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:01,217 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:01,217 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:56256': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:01,318 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:01,319 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:56264': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:01,325 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:01,326 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:56278': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:01,428 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:01,432 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:56286': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:01,438 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:01,439 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:56292': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:01,536 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:01,536 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:51114': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:01,546 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:01,546 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:51118': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:01,646 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:01,646 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:51122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:01,653 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:01,653 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:51128': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:01,753 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:01,754 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:51138': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:01,760 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:01,761 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:51140': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:01,862 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:01,862 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:51152': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:01,868 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:01,869 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:51158': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:01,969 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:01,970 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:51166': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:01,977 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:01,977 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:51178': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:02,077 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:02,078 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:51188': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:02,084 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:02,085 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:51202': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:02,185 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:02,185 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:51210': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:02,192 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:02,192 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:51226': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:02,294 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:02,295 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:51228': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:02,301 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:02,302 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:51236': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:02,402 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:02,402 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:51246': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:02,409 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:02,409 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:51258': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:02,511 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:02,512 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:51270': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:02,518 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:02,518 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:51280': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:02,619 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:02,620 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:51296': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:02,626 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:02,627 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:51302': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:02,728 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:02,729 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:51304': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:02,735 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:02,735 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:51314': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:02,836 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:02,836 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:51326': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:02,843 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:02,843 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:51336': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:02,943 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:02,944 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:51342': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:02,950 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:02,951 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:51350': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:03,052 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:03,053 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:51364': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:03,059 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:03,059 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:51380': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:03,161 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:03,162 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:51396': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:03,168 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:03,168 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:51398': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:03,269 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:03,269 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:51412': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:03,277 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:03,278 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:51422': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:03,377 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:03,377 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:51432': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:03,385 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:03,385 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:51448': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:03,485 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:03,486 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:51452': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:03,492 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:03,493 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:51460': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:03,593 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:03,594 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:51468': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:03,600 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:03,601 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:51472': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:03,702 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:03,702 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:51478': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:03,709 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:03,709 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:51486': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:03,810 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:03,811 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:51502': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:03,817 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:03,818 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:51518': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:03,919 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:03,920 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:51522': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:03,926 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:03,930 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:51528': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:04,028 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:04,029 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:51544': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:04,035 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:04,035 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:51558': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:04,135 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:04,136 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:51570': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:04,143 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:04,143 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:51586': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:04,243 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:04,243 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:51598': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:04,249 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:04,250 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:51606': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:04,351 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:04,352 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:51610': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:04,357 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:04,358 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:51622': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:04,459 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:04,460 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:51628': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:04,466 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:04,466 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:51638': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:04,567 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:04,567 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:51654': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:04,573 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:04,574 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:51668': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:04,674 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:04,675 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:51678': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:04,682 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:04,682 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:51692': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:04,782 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:04,782 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:51694': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:04,789 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:04,790 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:51702': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:04,892 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:04,896 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:51712': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:04,902 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:04,903 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:51718': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:05,000 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:05,001 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:51726': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:05,010 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:05,010 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:51736': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:05,108 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:05,109 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:51738': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:05,117 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:05,117 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:51748': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:05,216 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:05,217 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:51752': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:05,224 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:05,225 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:51756': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:05,324 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:05,324 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:51772': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:05,332 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:05,333 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:51776': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:05,435 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:05,436 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:51780': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:05,442 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:05,443 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:51796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:05,542 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:05,543 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:51812': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:05,549 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:05,550 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:51826': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:05,650 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:05,651 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:51838': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:05,657 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:05,658 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:51840': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:05,760 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:05,761 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:51844': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:05,767 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:05,768 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:51846': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:05,869 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:05,870 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:51854': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:05,876 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:05,876 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:51856': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:05,977 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:05,977 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:51872': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:05,984 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:05,984 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:51888': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:06,086 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:06,087 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:51890': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:06,093 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:06,094 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:51892': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:06,194 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:06,194 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:51908': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:06,201 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:06,201 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:51916': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:06,301 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:06,302 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:51930': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:06,308 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:06,309 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:51940': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:06,410 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:06,411 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:51950': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:06,417 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:06,417 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:51960': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:06,518 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:06,518 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:51974': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:06,526 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:06,527 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:51980': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:06,626 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:06,626 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:51992': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:06,634 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:06,634 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:52002': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:06,733 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:06,733 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:52014': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:06,741 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:06,741 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:52020': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:06,840 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:06,841 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:52028': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:06,849 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:06,849 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:52040': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:06,949 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:06,949 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:52056': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:06,955 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:06,956 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:52070': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:07,057 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:07,058 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:52078': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:07,064 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:07,064 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:52090': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:07,166 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:07,166 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:52100': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:07,172 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:07,173 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:52108': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:07,273 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:07,274 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:52120': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:07,280 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:07,281 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:52128': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:07,381 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:07,382 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:52144': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:07,388 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:07,388 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:52160': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:07,489 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:07,490 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:52174': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:07,496 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:07,497 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:52178': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:07,597 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:07,597 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:52192': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:07,604 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:07,604 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:52198': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:07,704 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:07,705 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:52212': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:07,711 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:07,712 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:52218': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:07,812 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:07,813 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:52234': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:07,819 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:07,819 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:52246': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:07,919 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:07,920 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:52254': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:07,926 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:07,930 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:52266': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:08,027 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:08,028 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:52270': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:08,034 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:08,034 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:52276': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:08,135 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:08,135 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:52292': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:08,142 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:08,142 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:52294': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:08,246 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:08,247 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:52304': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:08,253 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:08,253 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:52320': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:08,354 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:08,355 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:52332': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:08,361 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:08,362 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:52338': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:08,462 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:08,463 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:52342': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:08,469 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:08,469 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:52344': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:08,570 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:08,571 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:52348': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:08,577 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:08,577 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:52354': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:08,678 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:08,679 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:52360': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:08,685 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:08,685 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:52374': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:08,786 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:08,787 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:52380': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:08,793 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:08,794 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:52394': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:08,893 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:08,897 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:52404': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:08,903 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:08,904 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:52408': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:09,001 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:09,001 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:52416': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:09,011 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:09,011 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:52430': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:09,108 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:09,108 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:52444': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:09,118 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:09,118 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:52458': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:09,217 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:09,217 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:52460': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:09,225 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:09,226 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:52466': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:09,325 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:09,326 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:52480': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:09,332 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:09,333 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:52496': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:09,434 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:09,435 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:52498': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:09,441 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:09,442 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:52508': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:09,542 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:09,542 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:52514': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:09,548 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:09,549 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:52516': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:09,649 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:09,650 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:52520': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:09,656 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:09,656 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:52528': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:09,756 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:09,757 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:52544': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:09,763 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:09,764 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:52548': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:09,864 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:09,865 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:52564': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:09,873 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:22:09,873 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:52574': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:09,940 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40415. Reason: failure-to-start- 3537s 2024-11-23 21:22:09,940 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:22:09,941 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 13s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 3537s stream = await stream.start_tls( 3537s ^^^^^^^^^^^^^^^^^^^^^^^ 3537s False, ssl_options=ssl_options, server_hostname=host 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 3537s self.socket.do_handshake() 3537s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 3537s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 3537s self._sslobj.do_handshake() 3537s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 3537s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 3537s raise FatalCommClosedError( 3537s ...<2 lines>... 3537s ) from err 3537s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 3537s 3537s During handling of the above exception, another exception occurred: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1218, in _register_with_scheduler 3537s await asyncio.sleep(0.1) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 718, in sleep 3537s return await future 3537s ^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 13s. 3537s 2024-11-23 21:22:09,945 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45925. Reason: failure-to-start- 3537s 2024-11-23 21:22:09,945 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:22:10,948 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:22:10,956 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36489 3537s 2024-11-23 21:22:10,956 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38705/status 3537s 2024-11-23 21:22:10,956 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:22:10,973 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33647 3537s 2024-11-23 21:22:10,973 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33647 3537s 2024-11-23 21:22:10,973 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:22:10,973 - distributed.worker - INFO - dashboard at: 127.0.0.1:44153 3537s 2024-11-23 21:22:10,973 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36489 3537s 2024-11-23 21:22:10,973 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:22:10,973 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:22:10,973 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:22:10,973 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-25b4b_ql 3537s 2024-11-23 21:22:10,974 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:22:10,976 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39801 3537s 2024-11-23 21:22:10,976 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39801 3537s 2024-11-23 21:22:10,976 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:22:10,976 - distributed.worker - INFO - dashboard at: 127.0.0.1:43293 3537s 2024-11-23 21:22:10,976 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36489 3537s 2024-11-23 21:22:10,976 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:22:10,976 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:22:10,976 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:22:10,976 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-zk4cxk1r 3537s 2024-11-23 21:22:10,977 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:22:10,978 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33647. Reason: failure-to-start- 3537s 2024-11-23 21:22:10,978 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:22:10,978 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39801. Reason: failure-to-start- 3537s 2024-11-23 21:22:10,978 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:22:10,980 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36489': TLS handshake failed with remote 'tls://127.0.0.1:36122': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:22:10,980 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36489': TLS handshake failed with remote 'tls://127.0.0.1:36136': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:22:10,982 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:22:11,988 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:22:11,999 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44997 3537s 2024-11-23 21:22:11,999 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34785/status 3537s 2024-11-23 21:22:12,001 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:22:12,018 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33789 3537s 2024-11-23 21:22:12,019 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33789 3537s 2024-11-23 21:22:12,019 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:22:12,019 - distributed.worker - INFO - dashboard at: 127.0.0.1:33027 3537s 2024-11-23 21:22:12,019 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44997 3537s 2024-11-23 21:22:12,019 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:22:12,019 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:22:12,019 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:22:12,019 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ggevxn_e 3537s 2024-11-23 21:22:12,019 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:22:12,021 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44641 3537s 2024-11-23 21:22:12,022 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44641 3537s 2024-11-23 21:22:12,022 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:22:12,022 - distributed.worker - INFO - dashboard at: 127.0.0.1:34711 3537s 2024-11-23 21:22:12,022 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44997 3537s 2024-11-23 21:22:12,022 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:22:12,022 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:22:12,022 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:22:12,022 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-zs2i1fge 3537s 2024-11-23 21:22:12,022 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:22:12,023 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33789. Reason: failure-to-start- 3537s 2024-11-23 21:22:12,024 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:22:12,024 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44641. Reason: failure-to-start- 3537s 2024-11-23 21:22:12,024 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:22:12,026 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44997': TLS handshake failed with remote 'tls://127.0.0.1:33688': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:22:12,026 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44997': TLS handshake failed with remote 'tls://127.0.0.1:33690': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:22:12,027 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:22:13,033 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:22:13,041 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34209 3537s 2024-11-23 21:22:13,042 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37999/status 3537s 2024-11-23 21:22:13,042 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:22:13,060 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42189 3537s 2024-11-23 21:22:13,060 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42189 3537s 2024-11-23 21:22:13,060 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:22:13,060 - distributed.worker - INFO - dashboard at: 127.0.0.1:41845 3537s 2024-11-23 21:22:13,060 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34209 3537s 2024-11-23 21:22:13,061 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:22:13,061 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:22:13,061 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:22:13,061 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-yorsjg9v 3537s 2024-11-23 21:22:13,061 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:22:13,063 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43835 3537s 2024-11-23 21:22:13,064 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43835 3537s 2024-11-23 21:22:13,064 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:22:13,064 - distributed.worker - INFO - dashboard at: 127.0.0.1:39153 3537s 2024-11-23 21:22:13,064 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34209 3537s 2024-11-23 21:22:13,064 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:22:13,064 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:22:13,064 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:22:13,064 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-6o2026no 3537s 2024-11-23 21:22:13,064 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:22:13,065 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42189. Reason: failure-to-start- 3537s 2024-11-23 21:22:13,066 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:22:13,066 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43835. Reason: failure-to-start- 3537s 2024-11-23 21:22:13,066 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:22:13,068 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34209': TLS handshake failed with remote 'tls://127.0.0.1:42296': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:22:13,068 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34209': TLS handshake failed with remote 'tls://127.0.0.1:42306': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:22:13,069 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:22:14,076 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:22:14,084 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46815 3537s 2024-11-23 21:22:14,085 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36433/status 3537s 2024-11-23 21:22:14,085 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:22:14,100 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46597 3537s 2024-11-23 21:22:14,101 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46597 3537s 2024-11-23 21:22:14,101 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:22:14,101 - distributed.worker - INFO - dashboard at: 127.0.0.1:36551 3537s 2024-11-23 21:22:14,101 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46815 3537s 2024-11-23 21:22:14,101 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:22:14,101 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:22:14,101 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:22:14,101 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-0mgxx9us 3537s 2024-11-23 21:22:14,101 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:22:14,103 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39009 3537s 2024-11-23 21:22:14,103 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39009 3537s 2024-11-23 21:22:14,103 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:22:14,103 - distributed.worker - INFO - dashboard at: 127.0.0.1:41761 3537s 2024-11-23 21:22:14,104 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46815 3537s 2024-11-23 21:22:14,104 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:22:14,104 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:22:14,104 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:22:14,104 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-j8js_t94 3537s 2024-11-23 21:22:14,104 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:22:14,105 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46597. Reason: failure-to-start- 3537s 2024-11-23 21:22:14,105 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:22:14,106 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39009. Reason: failure-to-start- 3537s 2024-11-23 21:22:14,106 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:22:14,107 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46815': TLS handshake failed with remote 'tls://127.0.0.1:37784': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:22:14,107 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46815': TLS handshake failed with remote 'tls://127.0.0.1:37796': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:22:14,109 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:22:15,118 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:22:15,126 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35057 3537s 2024-11-23 21:22:15,126 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37773/status 3537s 2024-11-23 21:22:15,127 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:22:15,143 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40983 3537s 2024-11-23 21:22:15,144 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40983 3537s 2024-11-23 21:22:15,144 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:22:15,144 - distributed.worker - INFO - dashboard at: 127.0.0.1:38677 3537s 2024-11-23 21:22:15,144 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35057 3537s 2024-11-23 21:22:15,144 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:22:15,144 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:22:15,144 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:22:15,144 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-n2tqn9c5 3537s 2024-11-23 21:22:15,144 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:22:15,147 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42551 3537s 2024-11-23 21:22:15,147 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42551 3537s 2024-11-23 21:22:15,147 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:22:15,147 - distributed.worker - INFO - dashboard at: 127.0.0.1:42433 3537s 2024-11-23 21:22:15,147 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35057 3537s 2024-11-23 21:22:15,147 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:22:15,147 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:22:15,147 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:22:15,147 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-5nkg7ljh 3537s 2024-11-23 21:22:15,148 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:22:15,149 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40983. Reason: failure-to-start- 3537s 2024-11-23 21:22:15,149 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:22:15,150 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42551. Reason: failure-to-start- 3537s 2024-11-23 21:22:15,150 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:22:15,151 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35057': TLS handshake failed with remote 'tls://127.0.0.1:49108': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:22:15,151 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35057': TLS handshake failed with remote 'tls://127.0.0.1:49124': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:22:15,153 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:22:16,160 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:22:16,168 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43223 3537s 2024-11-23 21:22:16,168 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35875/status 3537s 2024-11-23 21:22:16,169 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:22:16,187 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38173 3537s 2024-11-23 21:22:16,187 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38173 3537s 2024-11-23 21:22:16,187 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:22:16,187 - distributed.worker - INFO - dashboard at: 127.0.0.1:45363 3537s 2024-11-23 21:22:16,187 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43223 3537s 2024-11-23 21:22:16,187 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:22:16,187 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:22:16,187 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:22:16,188 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-kobdbiaw 3537s 2024-11-23 21:22:16,188 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:22:16,190 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39027 3537s 2024-11-23 21:22:16,190 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39027 3537s 2024-11-23 21:22:16,190 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:22:16,190 - distributed.worker - INFO - dashboard at: 127.0.0.1:35217 3537s 2024-11-23 21:22:16,190 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43223 3537s 2024-11-23 21:22:16,190 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:22:16,190 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:22:16,191 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:22:16,191 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-a6lchyrl 3537s 2024-11-23 21:22:16,191 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:22:16,192 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38173. Reason: failure-to-start- 3537s 2024-11-23 21:22:16,192 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:22:16,193 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39027. Reason: failure-to-start- 3537s 2024-11-23 21:22:16,193 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:22:16,195 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43223': TLS handshake failed with remote 'tls://127.0.0.1:55426': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:22:16,195 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43223': TLS handshake failed with remote 'tls://127.0.0.1:55436': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:22:16,196 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:22:17,202 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:22:17,210 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41913 3537s 2024-11-23 21:22:17,211 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:32797/status 3537s 2024-11-23 21:22:17,211 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:22:17,227 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39159 3537s 2024-11-23 21:22:17,227 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39159 3537s 2024-11-23 21:22:17,228 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:22:17,228 - distributed.worker - INFO - dashboard at: 127.0.0.1:45467 3537s 2024-11-23 21:22:17,228 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41913 3537s 2024-11-23 21:22:17,228 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:22:17,228 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:22:17,228 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:22:17,228 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-4uvecj12 3537s 2024-11-23 21:22:17,228 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:22:17,234 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40439 3537s 2024-11-23 21:22:17,234 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40439 3537s 2024-11-23 21:22:17,234 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:22:17,235 - distributed.worker - INFO - dashboard at: 127.0.0.1:33027 3537s 2024-11-23 21:22:17,235 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41913 3537s 2024-11-23 21:22:17,235 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:22:17,235 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:22:17,235 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:22:17,235 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-1jzzvpap 3537s 2024-11-23 21:22:17,235 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:22:17,237 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39159. Reason: failure-to-start- 3537s 2024-11-23 21:22:17,237 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:22:17,238 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40439. Reason: failure-to-start- 3537s 2024-11-23 21:22:17,238 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:22:17,241 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41913': TLS handshake failed with remote 'tls://127.0.0.1:40632': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:22:17,241 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41913': TLS handshake failed with remote 'tls://127.0.0.1:40638': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:22:17,243 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:22:18,251 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:22:18,263 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:32871 3537s 2024-11-23 21:22:18,264 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44283/status 3537s 2024-11-23 21:22:18,264 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:22:18,289 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36223 3537s 2024-11-23 21:22:18,290 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36223 3537s 2024-11-23 21:22:18,290 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:22:18,290 - distributed.worker - INFO - dashboard at: 127.0.0.1:36901 3537s 2024-11-23 21:22:18,290 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:32871 3537s 2024-11-23 21:22:18,290 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:22:18,290 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:22:18,290 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:22:18,290 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-k_qc29sq 3537s 2024-11-23 21:22:18,290 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:22:18,294 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44501 3537s 2024-11-23 21:22:18,294 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44501 3537s 2024-11-23 21:22:18,295 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:22:18,295 - distributed.worker - INFO - dashboard at: 127.0.0.1:45487 3537s 2024-11-23 21:22:18,295 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:32871 3537s 2024-11-23 21:22:18,295 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:22:18,295 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:22:18,295 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:22:18,295 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-l8ufbqaq 3537s 2024-11-23 21:22:18,295 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:22:18,297 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36223. Reason: failure-to-start- 3537s 2024-11-23 21:22:18,298 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:22:18,299 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44501. Reason: failure-to-start- 3537s 2024-11-23 21:22:18,299 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:22:18,302 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:32871': TLS handshake failed with remote 'tls://127.0.0.1:39492': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:22:18,302 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:32871': TLS handshake failed with remote 'tls://127.0.0.1:39496': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:22:18,304 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:22:19,314 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:22:19,326 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44043 3537s 2024-11-23 21:22:19,327 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33963/status 3537s 2024-11-23 21:22:19,328 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:22:19,352 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35017 3537s 2024-11-23 21:22:19,352 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35017 3537s 2024-11-23 21:22:19,352 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:22:19,352 - distributed.worker - INFO - dashboard at: 127.0.0.1:33499 3537s 2024-11-23 21:22:19,353 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44043 3537s 2024-11-23 21:22:19,353 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:22:19,353 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:22:19,353 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:22:19,353 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-sjg611g3 3537s 2024-11-23 21:22:19,353 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:22:19,357 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42747 3537s 2024-11-23 21:22:19,357 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42747 3537s 2024-11-23 21:22:19,357 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:22:19,357 - distributed.worker - INFO - dashboard at: 127.0.0.1:38041 3537s 2024-11-23 21:22:19,357 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44043 3537s 2024-11-23 21:22:19,357 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:22:19,357 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:22:19,357 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:22:19,357 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ir3f6hcl 3537s 2024-11-23 21:22:19,358 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:22:19,360 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35017. Reason: failure-to-start- 3537s 2024-11-23 21:22:19,360 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:22:19,361 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42747. Reason: failure-to-start- 3537s 2024-11-23 21:22:19,361 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:22:19,363 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44043': TLS handshake failed with remote 'tls://127.0.0.1:39978': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:22:19,363 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44043': TLS handshake failed with remote 'tls://127.0.0.1:39980': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:22:19,366 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:22:20,373 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:22:20,386 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43061 3537s 2024-11-23 21:22:20,386 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38247/status 3537s 2024-11-23 21:22:20,387 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:22:20,406 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41519 3537s 2024-11-23 21:22:20,406 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41519 3537s 2024-11-23 21:22:20,406 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:22:20,406 - distributed.worker - INFO - dashboard at: 127.0.0.1:46009 3537s 2024-11-23 21:22:20,406 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43061 3537s 2024-11-23 21:22:20,407 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:22:20,407 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:22:20,407 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:22:20,407 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-g9n9qwrr 3537s 2024-11-23 21:22:20,407 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:22:20,409 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36501 3537s 2024-11-23 21:22:20,410 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36501 3537s 2024-11-23 21:22:20,410 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:22:20,410 - distributed.worker - INFO - dashboard at: 127.0.0.1:46503 3537s 2024-11-23 21:22:20,410 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43061 3537s 2024-11-23 21:22:20,410 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:22:20,410 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:22:20,410 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:22:20,410 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-yv87xr69 3537s 2024-11-23 21:22:20,410 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:22:20,415 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41519. Reason: failure-to-start- 3537s 2024-11-23 21:22:20,415 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:22:20,416 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36501. Reason: failure-to-start- 3537s 2024-11-23 21:22:20,416 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:22:20,417 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43061': TLS handshake failed with remote 'tls://127.0.0.1:60542': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:22:20,417 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43061': TLS handshake failed with remote 'tls://127.0.0.1:60548': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:22:20,419 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:22:21,425 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:22:21,433 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44719 3537s 2024-11-23 21:22:21,434 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:32781/status 3537s 2024-11-23 21:22:21,434 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:22:21,453 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35293 3537s 2024-11-23 21:22:21,454 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35293 3537s 2024-11-23 21:22:21,454 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:22:21,454 - distributed.worker - INFO - dashboard at: 127.0.0.1:46279 3537s 2024-11-23 21:22:21,454 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44719 3537s 2024-11-23 21:22:21,454 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:22:21,454 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:22:21,454 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:22:21,454 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-6cey2m26 3537s 2024-11-23 21:22:21,454 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:22:21,458 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45803 3537s 2024-11-23 21:22:21,458 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45803 3537s 2024-11-23 21:22:21,458 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:22:21,458 - distributed.worker - INFO - dashboard at: 127.0.0.1:39233 3537s 2024-11-23 21:22:21,458 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44719 3537s 2024-11-23 21:22:21,458 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:22:21,458 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:22:21,458 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:22:21,458 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-zwcwqjyq 3537s 2024-11-23 21:22:21,458 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:22:21,460 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35293. Reason: failure-to-start- 3537s 2024-11-23 21:22:21,460 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:22:21,460 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45803. Reason: failure-to-start- 3537s 2024-11-23 21:22:21,461 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:22:21,464 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44719': TLS handshake failed with remote 'tls://127.0.0.1:39322': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:22:21,464 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44719': TLS handshake failed with remote 'tls://127.0.0.1:39336': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:22:21,466 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:22:22,472 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:22:22,480 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38121 3537s 2024-11-23 21:22:22,481 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34511/status 3537s 2024-11-23 21:22:22,481 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:22:22,499 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34887 3537s 2024-11-23 21:22:22,499 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34887 3537s 2024-11-23 21:22:22,499 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:22:22,499 - distributed.worker - INFO - dashboard at: 127.0.0.1:41945 3537s 2024-11-23 21:22:22,499 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38121 3537s 2024-11-23 21:22:22,499 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:22:22,499 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:22:22,500 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:22:22,500 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-m9i8wscg 3537s 2024-11-23 21:22:22,500 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:22:22,502 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41261 3537s 2024-11-23 21:22:22,502 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41261 3537s 2024-11-23 21:22:22,502 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:22:22,502 - distributed.worker - INFO - dashboard at: 127.0.0.1:34089 3537s 2024-11-23 21:22:22,502 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38121 3537s 2024-11-23 21:22:22,502 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:22:22,502 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:22:22,503 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:22:22,503 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-aedainsx 3537s 2024-11-23 21:22:22,503 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:22:22,504 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34887. Reason: failure-to-start- 3537s 2024-11-23 21:22:22,504 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:22:22,505 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41261. Reason: failure-to-start- 3537s 2024-11-23 21:22:22,505 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:22:22,509 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38121': TLS handshake failed with remote 'tls://127.0.0.1:34392': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:22:22,509 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38121': TLS handshake failed with remote 'tls://127.0.0.1:34404': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:22:22,511 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:22:23,516 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:22:23,526 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46087 3537s 2024-11-23 21:22:23,527 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38219/status 3537s 2024-11-23 21:22:23,527 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:22:23,544 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42203 3537s 2024-11-23 21:22:23,544 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42203 3537s 2024-11-23 21:22:23,544 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:22:23,544 - distributed.worker - INFO - dashboard at: 127.0.0.1:43365 3537s 2024-11-23 21:22:23,544 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46087 3537s 2024-11-23 21:22:23,544 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:22:23,544 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:22:23,544 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:22:23,545 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-x_2m1ge0 3537s 2024-11-23 21:22:23,545 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:22:23,547 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45569 3537s 2024-11-23 21:22:23,547 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45569 3537s 2024-11-23 21:22:23,547 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:22:23,547 - distributed.worker - INFO - dashboard at: 127.0.0.1:46825 3537s 2024-11-23 21:22:23,547 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46087 3537s 2024-11-23 21:22:23,547 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:22:23,548 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:22:23,548 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:22:23,548 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-hde2hz5u 3537s 2024-11-23 21:22:23,548 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:22:23,549 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42203. Reason: failure-to-start- 3537s 2024-11-23 21:22:23,549 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:22:23,550 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45569. Reason: failure-to-start- 3537s 2024-11-23 21:22:23,550 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:22:23,554 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46087': TLS handshake failed with remote 'tls://127.0.0.1:53276': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:22:23,554 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46087': TLS handshake failed with remote 'tls://127.0.0.1:53286': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:22:23,556 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:22:24,562 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:22:24,571 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40275 3537s 2024-11-23 21:22:24,571 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45179/status 3537s 2024-11-23 21:22:24,571 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:22:24,590 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45763 3537s 2024-11-23 21:22:24,590 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45763 3537s 2024-11-23 21:22:24,590 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:22:24,590 - distributed.worker - INFO - dashboard at: 127.0.0.1:39257 3537s 2024-11-23 21:22:24,590 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40275 3537s 2024-11-23 21:22:24,590 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:22:24,590 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:22:24,591 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:22:24,591 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-fp46hby_ 3537s 2024-11-23 21:22:24,591 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:22:24,593 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33927 3537s 2024-11-23 21:22:24,593 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33927 3537s 2024-11-23 21:22:24,593 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:22:24,593 - distributed.worker - INFO - dashboard at: 127.0.0.1:41591 3537s 2024-11-23 21:22:24,593 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40275 3537s 2024-11-23 21:22:24,593 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:22:24,594 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:22:24,594 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:22:24,594 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-o5g44jy4 3537s 2024-11-23 21:22:24,594 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:22:24,598 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45763. Reason: failure-to-start- 3537s 2024-11-23 21:22:24,598 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:22:24,598 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33927. Reason: failure-to-start- 3537s 2024-11-23 21:22:24,599 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:22:24,600 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40275': TLS handshake failed with remote 'tls://127.0.0.1:50302': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:22:24,600 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40275': TLS handshake failed with remote 'tls://127.0.0.1:50306': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:22:24,602 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:22:25,607 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:22:25,615 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:32795 3537s 2024-11-23 21:22:25,616 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40285/status 3537s 2024-11-23 21:22:25,616 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:22:25,633 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45831 3537s 2024-11-23 21:22:25,633 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45831 3537s 2024-11-23 21:22:25,633 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:22:25,633 - distributed.worker - INFO - dashboard at: 127.0.0.1:44775 3537s 2024-11-23 21:22:25,633 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:32795 3537s 2024-11-23 21:22:25,633 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:22:25,633 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:22:25,633 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:22:25,633 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-8bjqpeo7 3537s 2024-11-23 21:22:25,634 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:22:25,649 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44807 3537s 2024-11-23 21:22:25,649 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44807 3537s 2024-11-23 21:22:25,649 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:22:25,649 - distributed.worker - INFO - dashboard at: 127.0.0.1:39119 3537s 2024-11-23 21:22:25,649 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:32795 3537s 2024-11-23 21:22:25,649 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:22:25,649 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:22:25,649 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:22:25,649 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-c__1usyh 3537s 2024-11-23 21:22:25,649 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:22:25,653 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45831. Reason: failure-to-start- 3537s 2024-11-23 21:22:25,653 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:22:25,654 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44807. Reason: failure-to-start- 3537s 2024-11-23 21:22:25,654 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:22:25,656 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:32795': TLS handshake failed with remote 'tls://127.0.0.1:42736': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:22:25,656 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:32795': TLS handshake failed with remote 'tls://127.0.0.1:42742': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:22:25,657 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:22:26,663 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:22:26,673 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45015 3537s 2024-11-23 21:22:26,673 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45643/status 3537s 2024-11-23 21:22:26,673 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:22:26,694 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41279 3537s 2024-11-23 21:22:26,694 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41279 3537s 2024-11-23 21:22:26,695 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:22:26,695 - distributed.worker - INFO - dashboard at: 127.0.0.1:41161 3537s 2024-11-23 21:22:26,695 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45015 3537s 2024-11-23 21:22:26,695 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:22:26,695 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:22:26,695 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:22:26,695 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-5nbjrs3n 3537s 2024-11-23 21:22:26,695 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:22:26,697 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45869 3537s 2024-11-23 21:22:26,697 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45869 3537s 2024-11-23 21:22:26,697 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:22:26,698 - distributed.worker - INFO - dashboard at: 127.0.0.1:40653 3537s 2024-11-23 21:22:26,698 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45015 3537s 2024-11-23 21:22:26,698 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:22:26,698 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:22:26,698 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:22:26,698 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-2bvhctyr 3537s 2024-11-23 21:22:26,698 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:22:26,699 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41279. Reason: failure-to-start- 3537s 2024-11-23 21:22:26,700 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:22:26,700 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45869. Reason: failure-to-start- 3537s 2024-11-23 21:22:26,700 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:22:26,702 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45015': TLS handshake failed with remote 'tls://127.0.0.1:59386': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:22:26,702 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45015': TLS handshake failed with remote 'tls://127.0.0.1:59394': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:22:26,703 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:22:27,710 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:22:27,722 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44321 3537s 2024-11-23 21:22:27,722 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42567/status 3537s 2024-11-23 21:22:27,723 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:22:27,744 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33571 3537s 2024-11-23 21:22:27,745 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33571 3537s 2024-11-23 21:22:27,745 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:22:27,745 - distributed.worker - INFO - dashboard at: 127.0.0.1:40097 3537s 2024-11-23 21:22:27,745 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44321 3537s 2024-11-23 21:22:27,745 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:22:27,745 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:22:27,745 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:22:27,745 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ff_1bfqe 3537s 2024-11-23 21:22:27,745 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:22:27,748 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40539 3537s 2024-11-23 21:22:27,748 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40539 3537s 2024-11-23 21:22:27,748 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:22:27,748 - distributed.worker - INFO - dashboard at: 127.0.0.1:44565 3537s 2024-11-23 21:22:27,748 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44321 3537s 2024-11-23 21:22:27,748 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:22:27,748 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:22:27,748 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:22:27,748 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-9syc8197 3537s 2024-11-23 21:22:27,748 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:22:27,750 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33571. Reason: failure-to-start- 3537s 2024-11-23 21:22:27,750 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:22:27,750 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40539. Reason: failure-to-start- 3537s 2024-11-23 21:22:27,751 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:22:27,752 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44321': TLS handshake failed with remote 'tls://127.0.0.1:44020': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:22:27,752 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44321': TLS handshake failed with remote 'tls://127.0.0.1:44034': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:22:27,754 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:22:28,759 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:22:28,769 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39207 3537s 2024-11-23 21:22:28,769 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35823/status 3537s 2024-11-23 21:22:28,770 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:22:28,793 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40695 3537s 2024-11-23 21:22:28,793 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40695 3537s 2024-11-23 21:22:28,793 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:22:28,793 - distributed.worker - INFO - dashboard at: 127.0.0.1:36543 3537s 2024-11-23 21:22:28,793 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39207 3537s 2024-11-23 21:22:28,793 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:22:28,793 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:22:28,793 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:22:28,794 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-5lboodmt 3537s 2024-11-23 21:22:28,794 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:22:28,796 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40587 3537s 2024-11-23 21:22:28,796 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40587 3537s 2024-11-23 21:22:28,796 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:22:28,796 - distributed.worker - INFO - dashboard at: 127.0.0.1:43473 3537s 2024-11-23 21:22:28,796 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39207 3537s 2024-11-23 21:22:28,796 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:22:28,796 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:22:28,797 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:22:28,797 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-mbqs0owi 3537s 2024-11-23 21:22:28,797 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:22:28,798 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40695. Reason: failure-to-start- 3537s 2024-11-23 21:22:28,798 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:22:28,799 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40587. Reason: failure-to-start- 3537s 2024-11-23 21:22:28,799 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:22:28,801 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39207': TLS handshake failed with remote 'tls://127.0.0.1:49562': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:22:28,801 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39207': TLS handshake failed with remote 'tls://127.0.0.1:49566': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:22:28,802 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:22:29,809 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:22:29,818 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41703 3537s 2024-11-23 21:22:29,818 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34319/status 3537s 2024-11-23 21:22:29,819 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:22:29,836 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45331 3537s 2024-11-23 21:22:29,836 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45331 3537s 2024-11-23 21:22:29,836 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:22:29,836 - distributed.worker - INFO - dashboard at: 127.0.0.1:37889 3537s 2024-11-23 21:22:29,836 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41703 3537s 2024-11-23 21:22:29,836 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:22:29,836 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:22:29,836 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:22:29,836 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-dtw6413h 3537s 2024-11-23 21:22:29,836 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:22:29,839 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:32945 3537s 2024-11-23 21:22:29,839 - distributed.worker - INFO - Listening to: tls://127.0.0.1:32945 3537s 2024-11-23 21:22:29,839 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:22:29,839 - distributed.worker - INFO - dashboard at: 127.0.0.1:33623 3537s 2024-11-23 21:22:29,839 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41703 3537s 2024-11-23 21:22:29,839 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:22:29,839 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:22:29,839 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:22:29,839 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-b8o8m4ew 3537s 2024-11-23 21:22:29,839 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:22:29,845 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45331. Reason: failure-to-start- 3537s 2024-11-23 21:22:29,845 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:22:29,845 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:32945. Reason: failure-to-start- 3537s 2024-11-23 21:22:29,846 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:22:29,847 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41703': TLS handshake failed with remote 'tls://127.0.0.1:56948': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:22:29,847 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41703': TLS handshake failed with remote 'tls://127.0.0.1:56950': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:22:29,849 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:22:30,855 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:22:30,864 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42431 3537s 2024-11-23 21:22:30,865 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36705/status 3537s 2024-11-23 21:22:30,865 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:22:30,882 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36441 3537s 2024-11-23 21:22:30,883 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36441 3537s 2024-11-23 21:22:30,883 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:22:30,883 - distributed.worker - INFO - dashboard at: 127.0.0.1:40251 3537s 2024-11-23 21:22:30,883 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42431 3537s 2024-11-23 21:22:30,883 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:22:30,883 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:22:30,883 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:22:30,883 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-b6rt_oe4 3537s 2024-11-23 21:22:30,883 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:22:30,885 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39785 3537s 2024-11-23 21:22:30,886 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39785 3537s 2024-11-23 21:22:30,886 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:22:30,886 - distributed.worker - INFO - dashboard at: 127.0.0.1:41429 3537s 2024-11-23 21:22:30,886 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42431 3537s 2024-11-23 21:22:30,886 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:22:30,886 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:22:30,886 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:22:30,886 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-l8q_5n2a 3537s 2024-11-23 21:22:30,886 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:22:30,888 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36441. Reason: failure-to-start- 3537s 2024-11-23 21:22:30,888 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:22:30,889 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39785. Reason: failure-to-start- 3537s 2024-11-23 21:22:30,889 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:22:30,891 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42431': TLS handshake failed with remote 'tls://127.0.0.1:43792': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:22:30,891 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42431': TLS handshake failed with remote 'tls://127.0.0.1:43800': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:22:30,897 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:22:31,904 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:22:31,918 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39881 3537s 2024-11-23 21:22:31,918 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46017/status 3537s 2024-11-23 21:22:31,919 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:22:31,942 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40613 3537s 2024-11-23 21:22:31,942 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40613 3537s 2024-11-23 21:22:31,942 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:22:31,942 - distributed.worker - INFO - dashboard at: 127.0.0.1:33561 3537s 2024-11-23 21:22:31,943 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39881 3537s 2024-11-23 21:22:31,943 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:22:31,943 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:22:31,943 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:22:31,943 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-9zlqwxlb 3537s 2024-11-23 21:22:31,943 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:22:31,946 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41497 3537s 2024-11-23 21:22:31,946 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41497 3537s 2024-11-23 21:22:31,946 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:22:31,946 - distributed.worker - INFO - dashboard at: 127.0.0.1:37417 3537s 2024-11-23 21:22:31,946 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39881 3537s 2024-11-23 21:22:31,946 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:22:31,946 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:22:31,946 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:22:31,947 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ufx6rzhn 3537s 2024-11-23 21:22:31,947 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:22:31,954 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40613. Reason: failure-to-start- 3537s 2024-11-23 21:22:31,955 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:22:31,955 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41497. Reason: failure-to-start- 3537s 2024-11-23 21:22:31,956 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:22:31,958 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39881': TLS handshake failed with remote 'tls://127.0.0.1:54434': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:22:31,958 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39881': TLS handshake failed with remote 'tls://127.0.0.1:54442': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:22:31,963 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:22:32,969 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:22:32,977 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:32839 3537s 2024-11-23 21:22:32,978 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45007/status 3537s 2024-11-23 21:22:32,978 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:22:32,999 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42817 3537s 2024-11-23 21:22:32,999 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42817 3537s 2024-11-23 21:22:32,999 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:22:32,999 - distributed.worker - INFO - dashboard at: 127.0.0.1:45523 3537s 2024-11-23 21:22:32,999 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:32839 3537s 2024-11-23 21:22:32,999 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:22:32,999 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:22:32,999 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:22:32,999 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-komoxzu2 3537s 2024-11-23 21:22:33,000 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:22:33,002 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44103 3537s 2024-11-23 21:22:33,002 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44103 3537s 2024-11-23 21:22:33,002 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:22:33,002 - distributed.worker - INFO - dashboard at: 127.0.0.1:34361 3537s 2024-11-23 21:22:33,002 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:32839 3537s 2024-11-23 21:22:33,002 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:22:33,002 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:22:33,002 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:22:33,002 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-78_p0149 3537s 2024-11-23 21:22:33,003 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:22:33,009 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42817. Reason: failure-to-start- 3537s 2024-11-23 21:22:33,010 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:22:33,010 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44103. Reason: failure-to-start- 3537s 2024-11-23 21:22:33,010 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:22:33,015 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:32839': TLS handshake failed with remote 'tls://127.0.0.1:36706': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:22:33,015 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:32839': TLS handshake failed with remote 'tls://127.0.0.1:36718': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:22:33,017 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:22:34,022 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:22:34,030 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38147 3537s 2024-11-23 21:22:34,031 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43173/status 3537s 2024-11-23 21:22:34,031 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:22:34,051 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46281 3537s 2024-11-23 21:22:34,051 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46281 3537s 2024-11-23 21:22:34,051 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:22:34,051 - distributed.worker - INFO - dashboard at: 127.0.0.1:45391 3537s 2024-11-23 21:22:34,052 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38147 3537s 2024-11-23 21:22:34,052 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:22:34,052 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:22:34,052 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:22:34,052 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ypjy9q9d 3537s 2024-11-23 21:22:34,052 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:22:34,056 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40051 3537s 2024-11-23 21:22:34,056 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40051 3537s 2024-11-23 21:22:34,056 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:22:34,056 - distributed.worker - INFO - dashboard at: 127.0.0.1:44981 3537s 2024-11-23 21:22:34,056 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38147 3537s 2024-11-23 21:22:34,056 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:22:34,056 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:22:34,056 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:22:34,057 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-7xr6uifc 3537s 2024-11-23 21:22:34,057 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:22:34,060 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46281. Reason: failure-to-start- 3537s 2024-11-23 21:22:34,061 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:22:34,061 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40051. Reason: failure-to-start- 3537s 2024-11-23 21:22:34,061 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:22:34,063 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38147': TLS handshake failed with remote 'tls://127.0.0.1:35604': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:22:34,063 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38147': TLS handshake failed with remote 'tls://127.0.0.1:35606': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:22:34,064 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:22:35,070 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:22:35,078 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42451 3537s 2024-11-23 21:22:35,078 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44985/status 3537s 2024-11-23 21:22:35,079 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:22:35,097 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37935 3537s 2024-11-23 21:22:35,097 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37935 3537s 2024-11-23 21:22:35,097 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:22:35,097 - distributed.worker - INFO - dashboard at: 127.0.0.1:40001 3537s 2024-11-23 21:22:35,097 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42451 3537s 2024-11-23 21:22:35,097 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:22:35,097 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:22:35,098 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:22:35,098 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-d05p4mlw 3537s 2024-11-23 21:22:35,098 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:22:35,100 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41081 3537s 2024-11-23 21:22:35,100 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41081 3537s 2024-11-23 21:22:35,100 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:22:35,100 - distributed.worker - INFO - dashboard at: 127.0.0.1:44297 3537s 2024-11-23 21:22:35,100 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42451 3537s 2024-11-23 21:22:35,101 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:22:35,101 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:22:35,101 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:22:35,101 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-990f6emv 3537s 2024-11-23 21:22:35,101 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:22:35,104 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37935. Reason: failure-to-start- 3537s 2024-11-23 21:22:35,105 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:22:35,105 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41081. Reason: failure-to-start- 3537s 2024-11-23 21:22:35,105 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:22:35,107 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42451': TLS handshake failed with remote 'tls://127.0.0.1:43992': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:22:35,107 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42451': TLS handshake failed with remote 'tls://127.0.0.1:43998': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:22:35,108 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:22:36,117 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:22:36,126 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33965 3537s 2024-11-23 21:22:36,126 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39735/status 3537s 2024-11-23 21:22:36,127 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:22:36,146 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44293 3537s 2024-11-23 21:22:36,146 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44293 3537s 2024-11-23 21:22:36,147 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:22:36,147 - distributed.worker - INFO - dashboard at: 127.0.0.1:34839 3537s 2024-11-23 21:22:36,147 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33965 3537s 2024-11-23 21:22:36,147 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:22:36,147 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:22:36,147 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:22:36,147 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-3ajmic92 3537s 2024-11-23 21:22:36,147 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:22:36,149 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38229 3537s 2024-11-23 21:22:36,150 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38229 3537s 2024-11-23 21:22:36,150 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:22:36,150 - distributed.worker - INFO - dashboard at: 127.0.0.1:42391 3537s 2024-11-23 21:22:36,150 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33965 3537s 2024-11-23 21:22:36,150 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:22:36,150 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:22:36,150 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:22:36,150 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ewlufi3_ 3537s 2024-11-23 21:22:36,150 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:22:36,154 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44293. Reason: failure-to-start- 3537s 2024-11-23 21:22:36,154 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:22:36,155 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38229. Reason: failure-to-start- 3537s 2024-11-23 21:22:36,155 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:22:36,156 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33965': TLS handshake failed with remote 'tls://127.0.0.1:49926': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:22:36,156 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33965': TLS handshake failed with remote 'tls://127.0.0.1:49938': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:22:36,158 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:22:37,164 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:22:37,172 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41579 3537s 2024-11-23 21:22:37,173 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46039/status 3537s 2024-11-23 21:22:37,173 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:22:37,197 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45869 3537s 2024-11-23 21:22:37,197 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45869 3537s 2024-11-23 21:22:37,197 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:22:37,197 - distributed.worker - INFO - dashboard at: 127.0.0.1:35587 3537s 2024-11-23 21:22:37,197 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41579 3537s 2024-11-23 21:22:37,197 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:22:37,197 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:22:37,197 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:22:37,197 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-g8nyz7mz 3537s 2024-11-23 21:22:37,197 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:22:37,199 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34369 3537s 2024-11-23 21:22:37,200 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34369 3537s 2024-11-23 21:22:37,200 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:22:37,200 - distributed.worker - INFO - dashboard at: 127.0.0.1:46105 3537s 2024-11-23 21:22:37,200 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41579 3537s 2024-11-23 21:22:37,200 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:22:37,200 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:22:37,200 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:22:37,200 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ltiq4o3x 3537s 2024-11-23 21:22:37,200 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:22:37,204 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45869. Reason: failure-to-start- 3537s 2024-11-23 21:22:37,204 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:22:37,205 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34369. Reason: failure-to-start- 3537s 2024-11-23 21:22:37,205 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:22:37,206 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41579': TLS handshake failed with remote 'tls://127.0.0.1:60344': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:22:37,206 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41579': TLS handshake failed with remote 'tls://127.0.0.1:60354': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:22:37,208 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:22:38,214 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:22:38,222 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43663 3537s 2024-11-23 21:22:38,222 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35637/status 3537s 2024-11-23 21:22:38,223 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:22:38,241 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42993 3537s 2024-11-23 21:22:38,241 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42993 3537s 2024-11-23 21:22:38,242 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:22:38,242 - distributed.worker - INFO - dashboard at: 127.0.0.1:37231 3537s 2024-11-23 21:22:38,242 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43663 3537s 2024-11-23 21:22:38,242 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:22:38,242 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:22:38,242 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:22:38,242 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-jxjcz569 3537s 2024-11-23 21:22:38,242 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:22:38,246 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38353 3537s 2024-11-23 21:22:38,246 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38353 3537s 2024-11-23 21:22:38,246 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:22:38,246 - distributed.worker - INFO - dashboard at: 127.0.0.1:43373 3537s 2024-11-23 21:22:38,246 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43663 3537s 2024-11-23 21:22:38,246 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:22:38,246 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:22:38,246 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:22:38,247 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-oi2nlnqw 3537s 2024-11-23 21:22:38,247 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:22:38,250 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42993. Reason: failure-to-start- 3537s 2024-11-23 21:22:38,251 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:22:38,251 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38353. Reason: failure-to-start- 3537s 2024-11-23 21:22:38,251 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:22:38,253 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43663': TLS handshake failed with remote 'tls://127.0.0.1:58442': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:22:38,253 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43663': TLS handshake failed with remote 'tls://127.0.0.1:58446': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:22:38,255 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:22:39,260 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:22:39,268 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46589 3537s 2024-11-23 21:22:39,269 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44955/status 3537s 2024-11-23 21:22:39,269 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:22:39,288 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45813 3537s 2024-11-23 21:22:39,288 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45813 3537s 2024-11-23 21:22:39,289 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:22:39,289 - distributed.worker - INFO - dashboard at: 127.0.0.1:34101 3537s 2024-11-23 21:22:39,289 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46589 3537s 2024-11-23 21:22:39,289 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:22:39,289 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:22:39,289 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:22:39,289 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-7eaod2ym 3537s 2024-11-23 21:22:39,289 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:22:39,291 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34539 3537s 2024-11-23 21:22:39,292 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34539 3537s 2024-11-23 21:22:39,292 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:22:39,292 - distributed.worker - INFO - dashboard at: 127.0.0.1:40941 3537s 2024-11-23 21:22:39,292 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46589 3537s 2024-11-23 21:22:39,292 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:22:39,292 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:22:39,292 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:22:39,292 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-l7mq_ne1 3537s 2024-11-23 21:22:39,292 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:22:39,298 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45813. Reason: failure-to-start- 3537s 2024-11-23 21:22:39,298 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:22:39,299 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34539. Reason: failure-to-start- 3537s 2024-11-23 21:22:39,299 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:22:39,301 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46589': TLS handshake failed with remote 'tls://127.0.0.1:33116': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:22:39,301 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46589': TLS handshake failed with remote 'tls://127.0.0.1:33118': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:22:39,302 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:22:40,308 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:22:40,317 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43267 3537s 2024-11-23 21:22:40,317 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41199/status 3537s 2024-11-23 21:22:40,318 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:22:40,334 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44505 3537s 2024-11-23 21:22:40,335 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44505 3537s 2024-11-23 21:22:40,335 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:22:40,335 - distributed.worker - INFO - dashboard at: 127.0.0.1:39353 3537s 2024-11-23 21:22:40,335 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43267 3537s 2024-11-23 21:22:40,335 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:22:40,335 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:22:40,335 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:22:40,335 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-9ennvrxx 3537s 2024-11-23 21:22:40,335 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:22:40,337 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42913 3537s 2024-11-23 21:22:40,338 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42913 3537s 2024-11-23 21:22:40,338 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:22:40,338 - distributed.worker - INFO - dashboard at: 127.0.0.1:35665 3537s 2024-11-23 21:22:40,338 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43267 3537s 2024-11-23 21:22:40,338 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:22:40,338 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:22:40,338 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:22:40,338 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-jvzyto9h 3537s 2024-11-23 21:22:40,338 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:22:40,346 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44505. Reason: failure-to-start- 3537s 2024-11-23 21:22:40,346 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:22:40,347 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42913. Reason: failure-to-start- 3537s 2024-11-23 21:22:40,347 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:22:40,348 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43267': TLS handshake failed with remote 'tls://127.0.0.1:48708': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:22:40,348 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43267': TLS handshake failed with remote 'tls://127.0.0.1:48716': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:22:40,350 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s __________________________ test_worker_client_gather ___________________________ 3537s 3537s fut = , timeout = 0 3537s 3537s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 3537s async with asyncio.timeout(timeout): 3537s > return await fut 3537s 3537s /usr/lib/python3/dist-packages/distributed/utils.py:1960: 3537s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3537s /usr/lib/python3/dist-packages/distributed/worker.py:1480: in start_unsafe 3537s await self._register_with_scheduler() 3537s /usr/lib/python3/dist-packages/distributed/worker.py:1179: in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s /usr/lib/python3/dist-packages/distributed/comm/core.py:342: in connect 3537s comm = await wait_for( 3537s /usr/lib/python3/dist-packages/distributed/utils.py:1960: in wait_for 3537s return await fut 3537s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:546: in connect 3537s stream = await self.client.connect( 3537s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3537s 3537s self = , host = '127.0.0.1' 3537s port = 46681, af = 3537s ssl_options = 3537s max_buffer_size = 8364507136.0, source_ip = None, source_port = None 3537s timeout = None 3537s 3537s async def connect( 3537s self, 3537s host: str, 3537s port: int, 3537s af: socket.AddressFamily = socket.AF_UNSPEC, 3537s ssl_options: Optional[Union[Dict[str, Any], ssl.SSLContext]] = None, 3537s max_buffer_size: Optional[int] = None, 3537s source_ip: Optional[str] = None, 3537s source_port: Optional[int] = None, 3537s timeout: Optional[Union[float, datetime.timedelta]] = None, 3537s ) -> IOStream: 3537s """Connect to the given host and port. 3537s 3537s Asynchronously returns an `.IOStream` (or `.SSLIOStream` if 3537s ``ssl_options`` is not None). 3537s 3537s Using the ``source_ip`` kwarg, one can specify the source 3537s IP address to use when establishing the connection. 3537s In case the user needs to resolve and 3537s use a specific interface, it has to be handled outside 3537s of Tornado as this depends very much on the platform. 3537s 3537s Raises `TimeoutError` if the input future does not complete before 3537s ``timeout``, which may be specified in any form allowed by 3537s `.IOLoop.add_timeout` (i.e. a `datetime.timedelta` or an absolute time 3537s relative to `.IOLoop.time`) 3537s 3537s Similarly, when the user requires a certain source port, it can 3537s be specified using the ``source_port`` arg. 3537s 3537s .. versionchanged:: 4.5 3537s Added the ``source_ip`` and ``source_port`` arguments. 3537s 3537s .. versionchanged:: 5.0 3537s Added the ``timeout`` argument. 3537s """ 3537s if timeout is not None: 3537s if isinstance(timeout, numbers.Real): 3537s timeout = IOLoop.current().time() + timeout 3537s elif isinstance(timeout, datetime.timedelta): 3537s timeout = IOLoop.current().time() + timeout.total_seconds() 3537s else: 3537s raise TypeError("Unsupported timeout %r" % timeout) 3537s if timeout is not None: 3537s addrinfo = await gen.with_timeout( 3537s timeout, self.resolver.resolve(host, port, af) 3537s ) 3537s else: 3537s addrinfo = await self.resolver.resolve(host, port, af) 3537s connector = _Connector( 3537s addrinfo, 3537s functools.partial( 3537s self._create_stream, 3537s max_buffer_size, 3537s source_ip=source_ip, 3537s source_port=source_port, 3537s ), 3537s ) 3537s > af, addr, stream = await connector.start(connect_timeout=timeout) 3537s E asyncio.exceptions.CancelledError 3537s 3537s /usr/lib/python3/dist-packages/tornado/tcpclient.py:279: CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s self = 3537s 3537s @final 3537s async def start(self): 3537s async with self._startup_lock: 3537s if self.status == Status.failed: 3537s assert self.__startup_exc is not None 3537s raise self.__startup_exc 3537s elif self.status != Status.init: 3537s return self 3537s timeout = getattr(self, "death_timeout", None) 3537s 3537s async def _close_on_failure(exc: Exception) -> None: 3537s await self.close(reason=f"failure-to-start-{str(type(exc))}") 3537s self.status = Status.failed 3537s self.__startup_exc = exc 3537s 3537s try: 3537s > await wait_for(self.start_unsafe(), timeout=timeout) 3537s 3537s /usr/lib/python3/dist-packages/distributed/core.py:664: 3537s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3537s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 3537s async with asyncio.timeout(timeout): 3537s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3537s 3537s self = 3537s exc_type = 3537s exc_val = CancelledError(), exc_tb = 3537s 3537s async def __aexit__( 3537s self, 3537s exc_type: Optional[Type[BaseException]], 3537s exc_val: Optional[BaseException], 3537s exc_tb: Optional[TracebackType], 3537s ) -> Optional[bool]: 3537s assert self._state in (_State.ENTERED, _State.EXPIRING) 3537s 3537s if self._timeout_handler is not None: 3537s self._timeout_handler.cancel() 3537s self._timeout_handler = None 3537s 3537s if self._state is _State.EXPIRING: 3537s self._state = _State.EXPIRED 3537s 3537s if self._task.uncancel() <= self._cancelling and exc_type is not None: 3537s # Since there are no new cancel requests, we're 3537s # handling this. 3537s if issubclass(exc_type, exceptions.CancelledError): 3537s > raise TimeoutError from exc_val 3537s E TimeoutError 3537s 3537s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s @contextlib.asynccontextmanager 3537s async def _cluster_factory(): 3537s workers = [] 3537s s = None 3537s try: 3537s for _ in range(60): 3537s try: 3537s > s, ws = await start_cluster( 3537s nthreads, 3537s scheduler, 3537s security=security, 3537s Worker=Worker, 3537s scheduler_kwargs=scheduler_kwargs, 3537s worker_kwargs=merge( 3537s {"death_timeout": min(15, int(deadline.remaining))}, 3537s worker_kwargs, 3537s ), 3537s ) 3537s 3537s /usr/lib/python3/dist-packages/distributed/utils_test.py:966: 3537s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3537s /usr/lib/python3/dist-packages/distributed/utils_test.py:789: in start_cluster 3537s await asyncio.gather(*workers) 3537s /usr/lib/python3.13/asyncio/tasks.py:737: in _wrap_awaitable 3537s return await awaitable 3537s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3537s 3537s self = 3537s 3537s @final 3537s async def start(self): 3537s async with self._startup_lock: 3537s if self.status == Status.failed: 3537s assert self.__startup_exc is not None 3537s raise self.__startup_exc 3537s elif self.status != Status.init: 3537s return self 3537s timeout = getattr(self, "death_timeout", None) 3537s 3537s async def _close_on_failure(exc: Exception) -> None: 3537s await self.close(reason=f"failure-to-start-{str(type(exc))}") 3537s self.status = Status.failed 3537s self.__startup_exc = exc 3537s 3537s try: 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s except asyncio.TimeoutError as exc: 3537s await _close_on_failure(exc) 3537s > raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s E TimeoutError: Worker start timed out after 0s. 3537s 3537s /usr/lib/python3/dist-packages/distributed/core.py:667: TimeoutError 3537s 3537s During handling of the above exception, another exception occurred: 3537s 3537s fut = ._..test_func..async_fn at 0xe247c850> 3537s timeout = 60 3537s 3537s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 3537s async with asyncio.timeout(timeout): 3537s > return await fut 3537s 3537s /usr/lib/python3/dist-packages/distributed/utils.py:1960: 3537s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3537s /usr/lib/python3/dist-packages/distributed/utils_test.py:999: in async_fn 3537s _cluster_factory() as (s, workers), 3537s /usr/lib/python3.13/contextlib.py:214: in __aenter__ 3537s return await anext(self.gen) 3537s /usr/lib/python3/dist-packages/distributed/utils_test.py:983: in _cluster_factory 3537s await asyncio.sleep(1) 3537s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3537s 3537s delay = 1, result = None 3537s 3537s async def sleep(delay, result=None): 3537s """Coroutine that completes after a given time (in seconds).""" 3537s if delay <= 0: 3537s await __sleep0() 3537s return result 3537s 3537s if math.isnan(delay): 3537s raise ValueError("Invalid delay: NaN (not a number)") 3537s 3537s loop = events.get_running_loop() 3537s future = loop.create_future() 3537s h = loop.call_later(delay, 3537s futures._set_result_unless_cancelled, 3537s future, result) 3537s try: 3537s > return await future 3537s E asyncio.exceptions.CancelledError 3537s 3537s /usr/lib/python3.13/asyncio/tasks.py:718: CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s args = (), kwds = {} 3537s 3537s @wraps(func) 3537s def inner(*args, **kwds): 3537s with self._recreate_cm(): 3537s > return func(*args, **kwds) 3537s 3537s /usr/lib/python3.13/contextlib.py:85: 3537s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3537s /usr/lib/python3.13/contextlib.py:85: in inner 3537s return func(*args, **kwds) 3537s /usr/lib/python3/dist-packages/distributed/utils_test.py:1102: in test_func 3537s return _run_and_close_tornado(async_fn_outer) 3537s /usr/lib/python3/dist-packages/distributed/utils_test.py:378: in _run_and_close_tornado 3537s return asyncio_run(inner_fn(), loop_factory=get_loop_factory()) 3537s /usr/lib/python3.13/asyncio/runners.py:194: in run 3537s return runner.run(main) 3537s /usr/lib/python3.13/asyncio/runners.py:118: in run 3537s return self._loop.run_until_complete(task) 3537s /usr/lib/python3.13/asyncio/base_events.py:720: in run_until_complete 3537s return future.result() 3537s /usr/lib/python3/dist-packages/distributed/utils_test.py:375: in inner_fn 3537s return await async_fn(*args, **kwargs) 3537s /usr/lib/python3/dist-packages/distributed/utils_test.py:1099: in async_fn_outer 3537s return await utils_wait_for(async_fn(), timeout=timeout * 2) 3537s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 3537s async with asyncio.timeout(timeout): 3537s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3537s 3537s self = 3537s exc_type = 3537s exc_val = CancelledError(), exc_tb = 3537s 3537s async def __aexit__( 3537s self, 3537s exc_type: Optional[Type[BaseException]], 3537s exc_val: Optional[BaseException], 3537s exc_tb: Optional[TracebackType], 3537s ) -> Optional[bool]: 3537s assert self._state in (_State.ENTERED, _State.EXPIRING) 3537s 3537s if self._timeout_handler is not None: 3537s self._timeout_handler.cancel() 3537s self._timeout_handler = None 3537s 3537s if self._state is _State.EXPIRING: 3537s self._state = _State.EXPIRED 3537s 3537s if self._task.uncancel() <= self._cancelling and exc_type is not None: 3537s # Since there are no new cancel requests, we're 3537s # handling this. 3537s if issubclass(exc_type, exceptions.CancelledError): 3537s > raise TimeoutError from exc_val 3537s E TimeoutError 3537s 3537s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 3537s ----------------------------- Captured stderr call ----------------------------- 3537s 2024-11-23 21:22:41,403 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:22:41,412 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:41,412 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33151/status 3537s 2024-11-23 21:22:41,412 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:22:41,428 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34187 3537s 2024-11-23 21:22:41,428 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34187 3537s 2024-11-23 21:22:41,428 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:22:41,428 - distributed.worker - INFO - dashboard at: 127.0.0.1:36983 3537s 2024-11-23 21:22:41,429 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:41,429 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:22:41,429 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:22:41,429 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:22:41,429 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ezbo4wk1 3537s 2024-11-23 21:22:41,429 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:22:41,431 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35269 3537s 2024-11-23 21:22:41,431 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35269 3537s 2024-11-23 21:22:41,431 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:22:41,431 - distributed.worker - INFO - dashboard at: 127.0.0.1:34707 3537s 2024-11-23 21:22:41,431 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:41,431 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:22:41,432 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:22:41,432 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:22:41,432 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-txr6cqka 3537s 2024-11-23 21:22:41,432 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:22:41,445 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:41,445 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:41,445 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:35372': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:41,446 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:35382': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:41,558 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:41,558 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:41,558 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:58254': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:41,559 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:58260': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:41,670 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:41,671 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:41,672 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:58262': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:41,673 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:58268': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:41,783 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:41,784 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:41,784 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:58274': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:41,784 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:58282': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:41,896 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:41,896 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:41,897 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:58286': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:41,897 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:58296': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:42,009 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:42,010 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:42,010 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:58304': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:42,010 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:58306': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:42,123 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:42,123 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:42,123 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:58320': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:42,124 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:58336': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:42,236 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:42,236 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:42,237 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:58342': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:42,237 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:58344': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:42,349 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:42,349 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:42,349 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:58350': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:42,350 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:58352': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:42,462 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:42,462 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:42,462 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:58364': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:42,463 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:58374': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:42,574 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:42,575 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:42,575 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:58378': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:42,575 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:58394': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:42,687 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:42,687 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:42,688 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:58396': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:42,688 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:58410': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:42,801 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:42,801 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:42,801 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:58414': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:42,801 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:58416': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:42,914 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:42,914 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:42,915 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:58418': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:42,915 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:58422': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:43,027 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:43,027 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:43,027 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:58438': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:43,027 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:58454': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:43,140 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:43,140 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:43,141 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:58462': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:43,141 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:58468': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:43,254 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:43,255 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:43,255 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:58484': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:43,255 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:58488': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:43,368 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:43,368 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:43,370 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:58504': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:43,370 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:58510': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:43,482 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:43,482 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:43,483 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:58516': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:43,483 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:58528': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:43,595 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:43,595 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:43,595 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:58544': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:43,596 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:58556': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:43,708 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:43,708 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:43,709 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:58572': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:43,709 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:58582': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:43,821 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:43,821 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:43,822 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:58592': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:43,822 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:58596': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:43,934 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:43,934 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:43,935 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:58598': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:43,935 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:58612': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:44,047 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:44,047 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:44,047 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:58614': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:44,048 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:58624': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:44,160 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:44,161 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:44,161 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:58636': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:44,161 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:58652': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:44,273 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:44,274 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:44,274 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:58662': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:44,274 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:58668': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:44,386 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:44,387 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:44,387 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:58680': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:44,387 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:58686': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:44,499 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:44,500 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:44,500 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:58700': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:44,500 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:58714': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:44,612 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:44,612 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:44,613 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:58724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:44,613 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:58726': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:44,725 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:44,725 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:44,726 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:58742': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:44,726 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:58754': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:44,838 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:44,838 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:44,838 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:58756': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:44,839 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:58762': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:44,951 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:44,951 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:44,952 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:58778': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:44,952 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:58788': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:45,064 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:45,065 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:45,065 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:58792': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:45,065 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:58804': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:45,181 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:45,181 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:45,181 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:58814': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:45,181 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:58826': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:45,294 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:45,295 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:45,295 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:58828': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:45,295 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:58844': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:45,408 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:45,408 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:45,409 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:58852': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:45,409 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:58866': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:45,521 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:45,521 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:45,522 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:58872': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:45,522 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:58882': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:45,634 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:45,634 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:45,634 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:58886': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:45,634 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:58890': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:45,747 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:45,747 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:45,747 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:58896': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:45,747 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:58908': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:45,860 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:45,861 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:45,861 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:58922': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:45,861 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:58924': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:45,973 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:45,974 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:45,974 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:58932': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:45,974 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:58934': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:46,087 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:46,087 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:46,088 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:58942': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:46,088 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:58956': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:46,200 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:46,200 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:46,201 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:58960': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:46,201 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:58964': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:46,314 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:46,314 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:46,314 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:58970': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:46,314 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:58984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:46,428 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:46,428 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:46,429 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:58986': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:46,429 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:59002': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:46,541 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:46,541 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:46,541 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:59012': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:46,542 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:59028': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:46,654 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:46,654 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:46,654 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:59042': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:46,654 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:59056': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:46,767 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:46,767 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:46,767 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:59066': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:46,767 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:59078': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:46,880 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:46,881 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:46,881 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:59088': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:46,881 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:59098': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:47,447 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:47,447 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:47,448 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:59108': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:47,448 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:59112': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:47,560 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:47,561 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:47,561 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:59128': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:47,561 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:59136': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:47,674 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:47,674 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:47,674 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:59146': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:47,674 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:59152': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:47,788 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:47,788 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:47,788 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:59156': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:47,788 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:59168': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:47,902 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:47,902 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:47,902 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:59180': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:47,902 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:59196': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:48,015 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:48,015 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:48,016 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:59208': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:48,016 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:59214': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:48,128 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:48,129 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:48,129 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:59226': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:48,129 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:59238': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:48,242 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:48,242 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:48,243 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:59240': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:48,243 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:59252': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:48,356 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:48,356 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:48,357 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:59258': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:48,357 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:59268': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:48,469 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:48,470 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:48,470 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:59282': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:48,470 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:59290': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:48,583 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:48,583 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:48,583 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:59300': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:48,583 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:59312': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:48,696 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:48,696 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:48,697 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:59318': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:48,697 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:59332': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:48,810 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:48,811 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:48,811 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:59338': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:48,811 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:59344': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:48,927 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:48,927 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:48,928 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:59360': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:48,928 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:59374': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:49,041 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:49,041 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:49,041 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:59384': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:49,042 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:59386': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:49,155 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:49,155 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:49,156 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:59390': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:49,156 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:59396': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:49,269 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:49,269 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:49,269 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:59404': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:49,269 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:59412': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:49,382 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:49,382 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:49,383 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:59414': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:49,383 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:59420': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:49,495 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:49,495 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:49,496 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:59436': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:49,496 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:59448': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:49,610 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:49,610 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:49,610 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:59464': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:49,610 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:59478': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:49,723 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:49,723 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:49,724 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:59486': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:49,724 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:59490': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:49,836 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:49,837 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:49,837 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:59502': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:49,837 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:59518': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:49,950 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:49,950 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:49,950 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:59530': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:49,950 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:59534': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:50,064 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:50,064 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:50,065 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:59536': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:50,065 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:59538': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:50,177 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:50,178 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:50,178 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:59544': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:50,178 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:59558': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:50,291 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:50,291 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:50,291 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:59572': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:50,292 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:59588': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:50,405 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:50,406 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:50,406 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:59598': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:50,406 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:59610': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:50,518 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:50,519 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:50,519 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:59620': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:50,519 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:59632': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:50,632 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:50,632 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:50,632 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:59638': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:50,632 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:59640': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:50,745 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:50,746 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:50,746 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:59654': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:50,746 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:59668': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:50,859 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:50,859 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:50,860 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:59676': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:50,860 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:59678': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:50,973 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:50,974 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:50,974 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:59686': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:50,974 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:59696': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:51,086 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:51,087 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:51,087 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:59708': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:51,087 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:59720': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:51,200 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:51,200 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:51,201 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:59722': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:51,201 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:59728': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:51,314 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:51,314 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:51,315 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:59736': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:51,315 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:59750': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:51,429 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:51,430 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:51,430 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:59752': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:51,430 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:59768': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:51,542 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:51,543 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:51,543 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:38270': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:51,543 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:38284': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:51,656 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:51,656 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:51,656 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:38288': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:51,656 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:38304': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:51,769 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:51,769 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:51,770 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:38312': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:51,770 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:38314': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:51,882 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:51,883 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:51,883 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:38330': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:51,883 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:38340': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:51,999 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:51,999 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:52,000 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:38356': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:52,000 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:38368': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:52,112 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:52,112 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:52,113 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:38370': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:52,113 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:38382': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:52,225 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:52,226 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:52,226 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:38392': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:52,226 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:38396': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:52,339 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:52,339 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:52,340 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:38412': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:52,340 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:38428': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:52,452 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:52,453 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:52,453 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:38436': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:52,453 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:38444': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:52,566 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:52,566 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:52,566 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:38446': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:52,567 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:38456': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:52,679 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:52,679 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:52,680 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:38458': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:52,680 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:38466': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:52,793 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:52,793 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:52,794 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:38474': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:52,794 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:38478': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:52,907 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:52,907 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:52,907 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:38494': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:52,907 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:38506': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:53,020 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:53,021 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:53,021 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:38518': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:53,021 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:38532': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:53,134 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:53,134 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:53,135 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:38534': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:53,135 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:38536': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:53,247 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:53,248 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:53,248 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:38542': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:53,248 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:38554': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:53,361 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:53,361 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:53,362 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:38568': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:53,362 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:38576': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:53,475 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:53,475 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:53,475 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:38584': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:53,476 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:38592': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:53,588 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:53,588 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:53,589 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:38608': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:53,590 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:38624': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:53,703 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:53,703 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:53,704 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:38626': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:53,704 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:38638': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:53,817 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:53,817 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:53,818 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:38644': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:53,818 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:38656': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:53,930 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:53,931 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:53,931 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:38664': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:53,931 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:38670': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:54,043 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:54,044 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:54,044 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:38686': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:54,044 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:38700': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:54,156 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:54,157 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:54,157 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:38716': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:54,157 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:38728': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:54,270 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:54,270 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:54,271 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:38740': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:54,271 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:38754': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:54,383 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:54,384 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:54,384 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:38762': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:54,384 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:38774': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:54,498 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:54,498 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:54,499 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:38790': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:54,499 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:38792': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:54,612 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:54,612 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:54,613 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:38806': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:54,613 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:38816': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:54,725 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:54,726 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:54,726 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:38828': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:54,726 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:38832': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:54,838 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:54,839 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:54,839 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:38848': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:54,839 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:38856': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:54,952 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:54,953 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:54,953 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:38866': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:54,953 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:38870': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:55,065 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:55,066 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:55,066 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:38876': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:55,066 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:38888': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:55,179 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:55,179 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:55,180 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:38892': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:55,180 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:38906': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:55,294 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:55,294 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:55,294 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:38912': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:55,294 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:38924': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:55,408 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:55,408 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:55,408 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:38930': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:55,409 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:38932': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:55,521 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:55,521 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:55,522 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:38946': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:55,522 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:38952': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:55,635 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:55,635 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:55,635 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:38958': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:55,635 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:38962': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:55,748 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:55,748 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:55,749 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:38974': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:55,749 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:38980': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:55,861 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:55,861 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:55,862 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:38988': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:55,862 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:38998': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:55,975 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:55,975 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:55,976 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:39006': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:55,976 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:39014': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:56,088 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:56,088 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:56,089 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:39018': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:56,089 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:39032': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:56,202 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:56,202 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:56,203 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:39044': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:56,203 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:39058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:56,315 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:56,315 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:56,316 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:39072': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:56,316 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:39086': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:56,430 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34187. Reason: failure-to-start- 3537s 2024-11-23 21:22:56,431 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:22:56,432 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 3537s 2024-11-23 21:22:56,433 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:39100': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:56,433 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:39104': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:56,433 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35269. Reason: failure-to-start- 3537s 2024-11-23 21:22:56,433 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:22:56,435 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 15s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 3537s stream = await stream.start_tls( 3537s ^^^^^^^^^^^^^^^^^^^^^^^ 3537s False, ssl_options=ssl_options, server_hostname=host 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 15s. 3537s 2024-11-23 21:22:57,441 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:22:57,449 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40345 3537s 2024-11-23 21:22:57,449 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38123/status 3537s 2024-11-23 21:22:57,450 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:22:57,467 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42561 3537s 2024-11-23 21:22:57,467 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42561 3537s 2024-11-23 21:22:57,467 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:22:57,467 - distributed.worker - INFO - dashboard at: 127.0.0.1:43095 3537s 2024-11-23 21:22:57,467 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:22:57,467 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:22:57,467 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:22:57,468 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:22:57,468 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-rgf6vpfw 3537s 2024-11-23 21:22:57,468 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:22:57,470 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38849 3537s 2024-11-23 21:22:57,470 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38849 3537s 2024-11-23 21:22:57,470 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:22:57,470 - distributed.worker - INFO - dashboard at: 127.0.0.1:36729 3537s 2024-11-23 21:22:57,470 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:22:57,470 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:22:57,470 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:22:57,470 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:22:57,470 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-g6upm064 3537s 2024-11-23 21:22:57,470 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:22:57,483 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:22:57,484 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:22:57,484 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:39906': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:57,484 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:39922': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:57,597 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:22:57,597 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:22:57,598 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:39934': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:57,598 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:39950': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:57,711 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:22:57,711 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:22:57,712 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:39962': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:57,712 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:39976': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:57,825 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:22:57,825 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:22:57,826 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:39984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:57,826 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:39994': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:57,939 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:22:57,939 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:22:57,940 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:40008': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:57,940 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:40022': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:58,053 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:22:58,053 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:22:58,054 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:40024': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:58,054 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:40030': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:58,167 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:22:58,167 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:22:58,168 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:40034': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:58,168 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:40038': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:58,282 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:22:58,282 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:22:58,283 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:40052': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:58,283 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:40062': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:58,396 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:22:58,396 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:22:58,397 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:40074': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:58,397 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:40082': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:58,509 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:22:58,509 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:22:58,510 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:40092': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:58,510 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:40098': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:58,623 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:22:58,623 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:22:58,623 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:40110': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:58,624 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:40114': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:58,736 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:22:58,737 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:22:58,737 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:40116': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:58,737 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:40128': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:58,850 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:22:58,850 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:22:58,851 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:40144': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:58,851 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:40146': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:58,966 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:22:58,966 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:22:58,967 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:40162': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:58,967 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:40164': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:59,080 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:22:59,080 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:22:59,080 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:40180': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:59,080 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:40196': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:59,193 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:22:59,194 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:22:59,194 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:40212': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:59,194 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:40228': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:59,308 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:22:59,308 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:22:59,309 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:40244': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:59,309 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:40258': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:59,422 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:22:59,422 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:22:59,425 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:40264': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:59,426 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:40270': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:59,536 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:22:59,536 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:22:59,537 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:40282': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:59,537 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:40296': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:59,650 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:22:59,650 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:22:59,650 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:40298': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:59,651 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:40304': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:59,764 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:22:59,764 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:22:59,764 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:40308': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:59,764 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:40314': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:59,878 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:22:59,878 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:22:59,879 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:40322': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:59,879 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:40330': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:59,992 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:22:59,992 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:22:59,993 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:40334': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:22:59,993 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:40350': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:00,105 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:00,105 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:00,106 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:40354': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:00,106 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:40368': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:00,218 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:00,219 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:00,219 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:40370': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:00,219 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:40372': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:00,332 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:00,332 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:00,333 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:40386': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:00,333 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:40398': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:00,446 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:00,446 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:00,447 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:40404': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:00,447 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:40414': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:00,559 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:00,559 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:00,560 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:40418': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:00,560 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:40430': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:00,673 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:00,673 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:00,674 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:40432': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:00,674 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:40434': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:00,787 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:00,787 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:00,787 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:40438': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:00,788 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:40444': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:00,900 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:00,900 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:00,900 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:40458': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:00,900 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:40468': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:01,013 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:01,013 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:01,014 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:40480': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:01,014 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:40494': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:01,127 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:01,127 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:01,127 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:40508': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:01,128 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:40510': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:01,240 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:01,240 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:01,241 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:40520': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:01,241 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:40532': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:01,353 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:01,353 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:01,354 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:40544': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:01,354 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:40554': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:01,467 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:01,467 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:01,467 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:40566': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:01,467 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:40570': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:01,580 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:01,580 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:01,580 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:37204': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:01,581 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:37218': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:01,693 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:01,694 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:01,694 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:37220': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:01,694 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:37232': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:01,807 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:01,807 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:01,808 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:37244': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:01,808 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:37254': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:01,920 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:01,920 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:01,924 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:37268': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:01,924 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:37280': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:02,033 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:02,033 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:02,034 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:37296': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:02,034 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:37298': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:02,146 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:02,147 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:02,147 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:37308': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:02,147 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:37320': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:02,260 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:02,260 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:02,261 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:37324': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:02,261 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:37326': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:02,373 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:02,373 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:02,374 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:37340': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:02,374 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:37342': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:02,487 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:02,487 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:02,487 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:37348': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:02,488 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:37356': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:02,600 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:02,601 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:02,601 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:37372': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:02,601 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:37380': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:02,714 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:02,714 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:02,715 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:37382': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:02,715 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:37392': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:02,828 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:02,828 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:02,828 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:37402': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:02,829 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:37414': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:02,942 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:02,942 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:02,943 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:37422': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:02,943 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:37430': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:03,055 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:03,055 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:03,056 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:37438': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:03,056 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:37448': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:03,169 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:03,169 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:03,170 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:37464': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:03,170 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:37470': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:03,284 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:03,284 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:03,285 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:37472': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:03,285 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:37476': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:03,397 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:03,398 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:03,398 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:37488': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:03,398 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:37498': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:03,511 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:03,511 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:03,512 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:37504': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:03,512 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:37506': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:03,625 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:03,626 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:03,626 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:37510': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:03,626 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:37516': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:03,740 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:03,740 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:03,741 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:37530': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:03,741 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:37542': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:03,853 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:03,854 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:03,854 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:37558': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:03,854 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:37564': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:03,967 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:03,968 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:03,968 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:37566': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:03,968 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:37578': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:04,081 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:04,082 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:04,082 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:37592': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:04,082 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:37600': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:04,196 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:04,196 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:04,196 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:37610': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:04,197 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:37614': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:04,310 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:04,310 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:04,310 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:37630': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:04,310 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:37634': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:04,427 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:04,428 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:04,428 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:37646': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:04,428 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:37648': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:04,541 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:04,541 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:04,541 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:37664': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:04,541 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:37672': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:04,656 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:04,656 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:04,656 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:37680': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:04,656 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:37690': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:04,770 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:04,770 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:04,770 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:37704': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:04,770 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:37716': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:04,884 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:04,884 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:04,885 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:37726': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:04,885 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:37734': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:04,998 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:04,998 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:04,999 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:37740': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:04,999 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:37756': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:05,112 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:05,112 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:05,113 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:37768': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:05,113 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:37776': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:05,225 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:05,225 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:05,226 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:37778': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:05,226 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:37786': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:05,339 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:05,340 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:05,340 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:37788': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:05,340 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:37798': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:05,453 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:05,453 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:05,454 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:37814': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:05,454 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:37824': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:05,567 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:05,567 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:05,567 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:37826': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:05,567 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:37830': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:05,680 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:05,680 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:05,681 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:37832': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:05,681 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:37846': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:05,793 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:05,793 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:05,794 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:37852': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:05,794 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:37860': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:05,907 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:05,907 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:05,907 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:37870': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:05,908 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:37880': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:06,021 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:06,021 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:06,022 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:37884': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:06,022 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:37892': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:06,136 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:06,136 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:06,136 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:37900': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:06,137 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:37906': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:06,253 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:06,253 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:06,253 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:37922': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:06,254 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:37930': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:06,367 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:06,367 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:06,367 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:37936': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:06,367 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:37948': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:06,480 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:06,480 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:06,481 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:37964': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:06,481 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:37978': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:06,595 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:06,595 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:06,596 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:37986': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:06,596 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:38002': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:06,708 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:06,709 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:06,709 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:38018': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:06,709 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:38026': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:06,822 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:06,822 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:06,823 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:38042': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:06,823 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:38058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:06,935 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:06,935 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:06,936 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:38062': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:06,936 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:38072': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:07,049 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:07,049 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:07,050 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:38078': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:07,050 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:38092': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:07,163 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:07,163 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:07,164 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:38100': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:07,164 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:38102': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:07,277 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:07,277 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:07,278 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:38104': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:07,278 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:38112': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:07,390 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:07,390 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:07,391 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:38128': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:07,391 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:38132': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:07,505 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:07,505 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:07,506 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:38144': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:07,506 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:38152': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:07,618 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:07,618 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:07,619 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:38168': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:07,619 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:38174': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:07,731 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:07,731 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:07,732 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:38176': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:07,732 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:38188': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:07,845 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:07,845 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:07,846 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:38200': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:07,846 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:38208': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:07,958 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:07,959 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:07,962 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:38214': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:07,962 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:38228': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:08,072 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:08,072 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:08,072 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:38234': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:08,072 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:38240': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:08,184 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:08,185 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:08,185 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:38246': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:08,185 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:38250': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:08,298 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:08,298 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:08,299 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:38256': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:08,299 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:38270': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:08,412 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:08,412 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:08,413 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:38274': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:08,413 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:38288': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:08,526 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:08,526 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:08,527 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:38302': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:08,527 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:38304': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:08,640 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:08,641 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:08,641 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:38314': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:08,641 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:38326': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:08,753 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:08,754 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:08,754 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:38332': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:08,754 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:38336': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:08,867 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:08,867 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:08,868 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:38346': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:08,868 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:38352': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:08,981 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:08,981 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:08,981 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:38356': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:08,982 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:38368': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:09,095 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:09,095 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:09,096 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:38384': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:09,096 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:38392': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:09,208 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:09,209 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:09,209 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:38404': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:09,209 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:38406': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:09,322 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:09,322 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:09,323 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:38410': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:09,323 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:38426': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:09,435 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:09,436 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:09,436 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:38434': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:09,436 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:38436': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:09,549 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:09,549 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:09,550 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:38440': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:09,550 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:38442': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:09,666 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:09,666 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:09,667 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:38454': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:09,667 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:38456': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:09,780 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:09,780 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:09,781 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:38464': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:09,781 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:38470': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:09,894 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:09,895 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:09,895 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:38482': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:09,895 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:38498': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:10,008 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:10,008 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:10,009 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:38514': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:10,009 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:38530': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:10,122 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:10,122 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:10,123 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:38538': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:10,123 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:38540': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:10,238 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:10,239 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:10,239 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:38556': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:10,239 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:38562': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:10,353 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:10,354 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:10,354 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:38570': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:10,354 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:38584': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:10,468 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42561. Reason: failure-to-start- 3537s 2024-11-23 21:23:10,468 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:23:10,468 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40345 3537s 2024-11-23 21:23:10,469 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:38588': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:10,469 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40345': TLS handshake failed with remote 'tls://127.0.0.1:38594': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:10,470 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38849. Reason: failure-to-start- 3537s 2024-11-23 21:23:10,470 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:23:10,471 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 13s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 3537s stream = await stream.start_tls( 3537s ^^^^^^^^^^^^^^^^^^^^^^^ 3537s False, ssl_options=ssl_options, server_hostname=host 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 13s. 3537s 2024-11-23 21:23:11,478 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:23:11,485 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39861 3537s 2024-11-23 21:23:11,486 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33261/status 3537s 2024-11-23 21:23:11,486 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:23:11,502 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36529 3537s 2024-11-23 21:23:11,502 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36529 3537s 2024-11-23 21:23:11,502 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:23:11,502 - distributed.worker - INFO - dashboard at: 127.0.0.1:42469 3537s 2024-11-23 21:23:11,502 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39861 3537s 2024-11-23 21:23:11,502 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:23:11,502 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:23:11,502 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:23:11,502 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-avohiu9v 3537s 2024-11-23 21:23:11,502 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:23:11,504 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44403 3537s 2024-11-23 21:23:11,505 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44403 3537s 2024-11-23 21:23:11,505 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:23:11,505 - distributed.worker - INFO - dashboard at: 127.0.0.1:46329 3537s 2024-11-23 21:23:11,505 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39861 3537s 2024-11-23 21:23:11,505 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:23:11,505 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:23:11,505 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:23:11,505 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-f47ir_oq 3537s 2024-11-23 21:23:11,505 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:23:11,506 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36529. Reason: failure-to-start- 3537s 2024-11-23 21:23:11,506 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:23:11,507 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44403. Reason: failure-to-start- 3537s 2024-11-23 21:23:11,507 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:23:11,508 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39861': TLS handshake failed with remote 'tls://127.0.0.1:33918': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:23:11,508 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39861': TLS handshake failed with remote 'tls://127.0.0.1:33932': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:23:11,510 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:23:12,516 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:23:12,524 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43287 3537s 2024-11-23 21:23:12,525 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39461/status 3537s 2024-11-23 21:23:12,525 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:23:12,540 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33841 3537s 2024-11-23 21:23:12,541 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33841 3537s 2024-11-23 21:23:12,541 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:23:12,541 - distributed.worker - INFO - dashboard at: 127.0.0.1:33857 3537s 2024-11-23 21:23:12,541 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43287 3537s 2024-11-23 21:23:12,541 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:23:12,541 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:23:12,541 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:23:12,541 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-gzkhp7nu 3537s 2024-11-23 21:23:12,541 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:23:12,543 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33971 3537s 2024-11-23 21:23:12,543 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33971 3537s 2024-11-23 21:23:12,544 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:23:12,544 - distributed.worker - INFO - dashboard at: 127.0.0.1:36501 3537s 2024-11-23 21:23:12,544 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43287 3537s 2024-11-23 21:23:12,544 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:23:12,544 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:23:12,544 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:23:12,544 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-lumviycb 3537s 2024-11-23 21:23:12,544 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:23:12,545 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33841. Reason: failure-to-start- 3537s 2024-11-23 21:23:12,545 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:23:12,546 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33971. Reason: failure-to-start- 3537s 2024-11-23 21:23:12,546 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:23:12,547 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43287': TLS handshake failed with remote 'tls://127.0.0.1:48994': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:23:12,547 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43287': TLS handshake failed with remote 'tls://127.0.0.1:49004': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:23:12,549 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:23:13,556 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:23:13,564 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44201 3537s 2024-11-23 21:23:13,565 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44329/status 3537s 2024-11-23 21:23:13,565 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:23:13,580 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33323 3537s 2024-11-23 21:23:13,580 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33323 3537s 2024-11-23 21:23:13,580 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:23:13,580 - distributed.worker - INFO - dashboard at: 127.0.0.1:42855 3537s 2024-11-23 21:23:13,581 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44201 3537s 2024-11-23 21:23:13,581 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:23:13,581 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:23:13,581 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:23:13,581 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-04wtt0ap 3537s 2024-11-23 21:23:13,581 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:23:13,583 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33307 3537s 2024-11-23 21:23:13,583 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33307 3537s 2024-11-23 21:23:13,583 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:23:13,583 - distributed.worker - INFO - dashboard at: 127.0.0.1:44545 3537s 2024-11-23 21:23:13,583 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44201 3537s 2024-11-23 21:23:13,583 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:23:13,583 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:23:13,584 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:23:13,584 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-5oczpvd3 3537s 2024-11-23 21:23:13,584 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:23:13,585 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33323. Reason: failure-to-start- 3537s 2024-11-23 21:23:13,585 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:23:13,585 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33307. Reason: failure-to-start- 3537s 2024-11-23 21:23:13,585 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:23:13,587 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44201': TLS handshake failed with remote 'tls://127.0.0.1:55982': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:23:13,587 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44201': TLS handshake failed with remote 'tls://127.0.0.1:55996': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:23:13,589 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:23:14,594 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:23:14,602 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37755 3537s 2024-11-23 21:23:14,602 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36203/status 3537s 2024-11-23 21:23:14,602 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:23:14,618 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41107 3537s 2024-11-23 21:23:14,619 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41107 3537s 2024-11-23 21:23:14,619 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:23:14,619 - distributed.worker - INFO - dashboard at: 127.0.0.1:38381 3537s 2024-11-23 21:23:14,619 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37755 3537s 2024-11-23 21:23:14,619 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:23:14,619 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:23:14,619 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:23:14,619 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-k34hzyvm 3537s 2024-11-23 21:23:14,619 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:23:14,621 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45887 3537s 2024-11-23 21:23:14,621 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45887 3537s 2024-11-23 21:23:14,621 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:23:14,622 - distributed.worker - INFO - dashboard at: 127.0.0.1:36645 3537s 2024-11-23 21:23:14,622 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37755 3537s 2024-11-23 21:23:14,622 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:23:14,622 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:23:14,622 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:23:14,622 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ge06kpa2 3537s 2024-11-23 21:23:14,622 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:23:14,623 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41107. Reason: failure-to-start- 3537s 2024-11-23 21:23:14,623 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:23:14,624 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45887. Reason: failure-to-start- 3537s 2024-11-23 21:23:14,624 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:23:14,625 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37755': TLS handshake failed with remote 'tls://127.0.0.1:53956': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:23:14,625 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37755': TLS handshake failed with remote 'tls://127.0.0.1:53960': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:23:14,627 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:23:15,633 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:23:15,640 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35283 3537s 2024-11-23 21:23:15,640 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42579/status 3537s 2024-11-23 21:23:15,641 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:23:15,654 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36781 3537s 2024-11-23 21:23:15,654 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36781 3537s 2024-11-23 21:23:15,654 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:23:15,654 - distributed.worker - INFO - dashboard at: 127.0.0.1:45523 3537s 2024-11-23 21:23:15,655 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35283 3537s 2024-11-23 21:23:15,655 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:23:15,655 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:23:15,655 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:23:15,655 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-l6nts7b5 3537s 2024-11-23 21:23:15,655 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:23:15,658 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42381 3537s 2024-11-23 21:23:15,658 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42381 3537s 2024-11-23 21:23:15,658 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:23:15,658 - distributed.worker - INFO - dashboard at: 127.0.0.1:46523 3537s 2024-11-23 21:23:15,658 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35283 3537s 2024-11-23 21:23:15,658 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:23:15,658 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:23:15,658 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:23:15,658 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-815wshs5 3537s 2024-11-23 21:23:15,658 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:23:15,659 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36781. Reason: failure-to-start- 3537s 2024-11-23 21:23:15,660 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:23:15,660 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42381. Reason: failure-to-start- 3537s 2024-11-23 21:23:15,660 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:23:15,661 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35283': TLS handshake failed with remote 'tls://127.0.0.1:39666': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:23:15,661 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35283': TLS handshake failed with remote 'tls://127.0.0.1:39676': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:23:15,663 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:23:16,669 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:23:16,676 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39389 3537s 2024-11-23 21:23:16,677 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44733/status 3537s 2024-11-23 21:23:16,677 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:23:16,691 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41185 3537s 2024-11-23 21:23:16,692 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41185 3537s 2024-11-23 21:23:16,692 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:23:16,692 - distributed.worker - INFO - dashboard at: 127.0.0.1:38193 3537s 2024-11-23 21:23:16,692 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39389 3537s 2024-11-23 21:23:16,692 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:23:16,692 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:23:16,692 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:23:16,692 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-hbgnc9vm 3537s 2024-11-23 21:23:16,692 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:23:16,694 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41355 3537s 2024-11-23 21:23:16,695 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41355 3537s 2024-11-23 21:23:16,695 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:23:16,695 - distributed.worker - INFO - dashboard at: 127.0.0.1:33447 3537s 2024-11-23 21:23:16,695 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39389 3537s 2024-11-23 21:23:16,695 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:23:16,695 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:23:16,695 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:23:16,695 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-d_ua8w99 3537s 2024-11-23 21:23:16,695 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:23:16,696 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41185. Reason: failure-to-start- 3537s 2024-11-23 21:23:16,697 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:23:16,697 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41355. Reason: failure-to-start- 3537s 2024-11-23 21:23:16,697 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:23:16,699 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39389': TLS handshake failed with remote 'tls://127.0.0.1:47976': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:23:16,699 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39389': TLS handshake failed with remote 'tls://127.0.0.1:47980': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:23:16,700 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:23:17,708 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:23:17,715 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34709 3537s 2024-11-23 21:23:17,716 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46851/status 3537s 2024-11-23 21:23:17,716 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:23:17,731 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38419 3537s 2024-11-23 21:23:17,732 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38419 3537s 2024-11-23 21:23:17,732 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:23:17,732 - distributed.worker - INFO - dashboard at: 127.0.0.1:40521 3537s 2024-11-23 21:23:17,732 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34709 3537s 2024-11-23 21:23:17,732 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:23:17,732 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:23:17,732 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:23:17,732 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-1740ehqd 3537s 2024-11-23 21:23:17,732 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:23:17,734 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33921 3537s 2024-11-23 21:23:17,735 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33921 3537s 2024-11-23 21:23:17,735 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:23:17,735 - distributed.worker - INFO - dashboard at: 127.0.0.1:34965 3537s 2024-11-23 21:23:17,735 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34709 3537s 2024-11-23 21:23:17,735 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:23:17,735 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:23:17,735 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:23:17,735 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-6o7ejaiu 3537s 2024-11-23 21:23:17,735 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:23:17,736 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38419. Reason: failure-to-start- 3537s 2024-11-23 21:23:17,736 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:23:17,737 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33921. Reason: failure-to-start- 3537s 2024-11-23 21:23:17,737 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:23:17,738 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34709': TLS handshake failed with remote 'tls://127.0.0.1:55676': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:23:17,739 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34709': TLS handshake failed with remote 'tls://127.0.0.1:55692': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:23:17,740 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:23:18,746 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:23:18,754 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44933 3537s 2024-11-23 21:23:18,754 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45603/status 3537s 2024-11-23 21:23:18,754 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:23:18,771 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46483 3537s 2024-11-23 21:23:18,771 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46483 3537s 2024-11-23 21:23:18,772 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:23:18,772 - distributed.worker - INFO - dashboard at: 127.0.0.1:36893 3537s 2024-11-23 21:23:18,772 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44933 3537s 2024-11-23 21:23:18,772 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:23:18,772 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:23:18,772 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:23:18,772 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-b_6l6gb4 3537s 2024-11-23 21:23:18,772 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:23:18,774 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37965 3537s 2024-11-23 21:23:18,775 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37965 3537s 2024-11-23 21:23:18,775 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:23:18,775 - distributed.worker - INFO - dashboard at: 127.0.0.1:43087 3537s 2024-11-23 21:23:18,775 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44933 3537s 2024-11-23 21:23:18,775 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:23:18,775 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:23:18,775 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:23:18,775 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-cwe5hlsm 3537s 2024-11-23 21:23:18,775 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:23:18,776 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46483. Reason: failure-to-start- 3537s 2024-11-23 21:23:18,776 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:23:18,777 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37965. Reason: failure-to-start- 3537s 2024-11-23 21:23:18,777 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:23:18,779 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44933': TLS handshake failed with remote 'tls://127.0.0.1:41282': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:23:18,779 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44933': TLS handshake failed with remote 'tls://127.0.0.1:41288': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:23:18,781 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:23:19,787 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:23:19,794 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43929 3537s 2024-11-23 21:23:19,794 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41121/status 3537s 2024-11-23 21:23:19,795 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:23:19,809 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44341 3537s 2024-11-23 21:23:19,810 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44341 3537s 2024-11-23 21:23:19,810 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:23:19,810 - distributed.worker - INFO - dashboard at: 127.0.0.1:45253 3537s 2024-11-23 21:23:19,810 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43929 3537s 2024-11-23 21:23:19,810 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:23:19,810 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:23:19,810 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:23:19,810 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-nhptyqnd 3537s 2024-11-23 21:23:19,810 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:23:19,812 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38963 3537s 2024-11-23 21:23:19,812 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38963 3537s 2024-11-23 21:23:19,812 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:23:19,812 - distributed.worker - INFO - dashboard at: 127.0.0.1:44125 3537s 2024-11-23 21:23:19,812 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43929 3537s 2024-11-23 21:23:19,812 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:23:19,812 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:23:19,812 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:23:19,813 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-e3u9zqgr 3537s 2024-11-23 21:23:19,813 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:23:19,814 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44341. Reason: failure-to-start- 3537s 2024-11-23 21:23:19,814 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:23:19,814 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38963. Reason: failure-to-start- 3537s 2024-11-23 21:23:19,814 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:23:19,816 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43929': TLS handshake failed with remote 'tls://127.0.0.1:48550': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:23:19,816 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43929': TLS handshake failed with remote 'tls://127.0.0.1:48562': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:23:19,818 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:23:20,824 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:23:20,831 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42973 3537s 2024-11-23 21:23:20,831 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39717/status 3537s 2024-11-23 21:23:20,832 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:23:20,846 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34241 3537s 2024-11-23 21:23:20,846 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34241 3537s 2024-11-23 21:23:20,846 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:23:20,846 - distributed.worker - INFO - dashboard at: 127.0.0.1:38247 3537s 2024-11-23 21:23:20,846 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42973 3537s 2024-11-23 21:23:20,846 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:23:20,846 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:23:20,846 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:23:20,846 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-p0t921pd 3537s 2024-11-23 21:23:20,847 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:23:20,848 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41233 3537s 2024-11-23 21:23:20,849 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41233 3537s 2024-11-23 21:23:20,849 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:23:20,849 - distributed.worker - INFO - dashboard at: 127.0.0.1:38317 3537s 2024-11-23 21:23:20,849 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42973 3537s 2024-11-23 21:23:20,849 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:23:20,849 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:23:20,849 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:23:20,849 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-aib5td31 3537s 2024-11-23 21:23:20,849 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:23:20,851 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34241. Reason: failure-to-start- 3537s 2024-11-23 21:23:20,851 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:23:20,852 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41233. Reason: failure-to-start- 3537s 2024-11-23 21:23:20,852 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:23:20,853 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42973': TLS handshake failed with remote 'tls://127.0.0.1:53858': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:23:20,853 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42973': TLS handshake failed with remote 'tls://127.0.0.1:53868': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:23:20,855 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:23:21,861 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:23:21,868 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38671 3537s 2024-11-23 21:23:21,869 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45315/status 3537s 2024-11-23 21:23:21,869 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:23:21,884 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43691 3537s 2024-11-23 21:23:21,885 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43691 3537s 2024-11-23 21:23:21,885 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:23:21,885 - distributed.worker - INFO - dashboard at: 127.0.0.1:43911 3537s 2024-11-23 21:23:21,885 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38671 3537s 2024-11-23 21:23:21,885 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:23:21,885 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:23:21,885 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:23:21,885 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-6_awzomw 3537s 2024-11-23 21:23:21,885 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:23:21,887 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35719 3537s 2024-11-23 21:23:21,887 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35719 3537s 2024-11-23 21:23:21,887 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:23:21,888 - distributed.worker - INFO - dashboard at: 127.0.0.1:45549 3537s 2024-11-23 21:23:21,888 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38671 3537s 2024-11-23 21:23:21,888 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:23:21,888 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:23:21,888 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:23:21,888 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-a48m1_lw 3537s 2024-11-23 21:23:21,888 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:23:21,889 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43691. Reason: failure-to-start- 3537s 2024-11-23 21:23:21,889 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:23:21,890 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35719. Reason: failure-to-start- 3537s 2024-11-23 21:23:21,890 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:23:21,892 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38671': TLS handshake failed with remote 'tls://127.0.0.1:48878': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:23:21,892 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38671': TLS handshake failed with remote 'tls://127.0.0.1:48880': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:23:21,893 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:23:22,901 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:23:22,908 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41311 3537s 2024-11-23 21:23:22,908 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38613/status 3537s 2024-11-23 21:23:22,908 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:23:22,923 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37333 3537s 2024-11-23 21:23:22,923 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37333 3537s 2024-11-23 21:23:22,923 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:23:22,923 - distributed.worker - INFO - dashboard at: 127.0.0.1:33863 3537s 2024-11-23 21:23:22,923 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41311 3537s 2024-11-23 21:23:22,923 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:23:22,924 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:23:22,924 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:23:22,924 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-gvhmrw91 3537s 2024-11-23 21:23:22,924 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:23:22,926 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38437 3537s 2024-11-23 21:23:22,926 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38437 3537s 2024-11-23 21:23:22,926 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:23:22,926 - distributed.worker - INFO - dashboard at: 127.0.0.1:44807 3537s 2024-11-23 21:23:22,926 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41311 3537s 2024-11-23 21:23:22,926 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:23:22,926 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:23:22,926 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:23:22,927 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-0n1fdi6m 3537s 2024-11-23 21:23:22,927 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:23:22,930 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37333. Reason: failure-to-start- 3537s 2024-11-23 21:23:22,930 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:23:22,931 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38437. Reason: failure-to-start- 3537s 2024-11-23 21:23:22,931 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:23:22,932 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41311': TLS handshake failed with remote 'tls://127.0.0.1:56282': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:23:22,933 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41311': TLS handshake failed with remote 'tls://127.0.0.1:56286': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:23:22,934 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:23:23,940 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:23:23,947 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36229 3537s 2024-11-23 21:23:23,948 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42017/status 3537s 2024-11-23 21:23:23,948 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:23:23,977 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40947 3537s 2024-11-23 21:23:23,978 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40947 3537s 2024-11-23 21:23:23,978 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:23:23,978 - distributed.worker - INFO - dashboard at: 127.0.0.1:43281 3537s 2024-11-23 21:23:23,978 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36229 3537s 2024-11-23 21:23:23,978 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:23:23,978 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:23:23,978 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:23:23,978 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-0qjbcp7p 3537s 2024-11-23 21:23:23,978 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:23:23,980 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41907 3537s 2024-11-23 21:23:23,980 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41907 3537s 2024-11-23 21:23:23,980 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:23:23,981 - distributed.worker - INFO - dashboard at: 127.0.0.1:40039 3537s 2024-11-23 21:23:23,981 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36229 3537s 2024-11-23 21:23:23,981 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:23:23,981 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:23:23,981 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:23:23,981 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-blysrjk4 3537s 2024-11-23 21:23:23,981 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:23:23,984 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40947. Reason: failure-to-start- 3537s 2024-11-23 21:23:23,984 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:23:23,985 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41907. Reason: failure-to-start- 3537s 2024-11-23 21:23:23,985 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:23:23,987 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36229': TLS handshake failed with remote 'tls://127.0.0.1:34472': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:23:23,987 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36229': TLS handshake failed with remote 'tls://127.0.0.1:34480': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:23:23,991 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:23:24,998 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:23:25,005 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37785 3537s 2024-11-23 21:23:25,005 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46327/status 3537s 2024-11-23 21:23:25,006 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:23:25,022 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44475 3537s 2024-11-23 21:23:25,022 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44475 3537s 2024-11-23 21:23:25,022 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:23:25,022 - distributed.worker - INFO - dashboard at: 127.0.0.1:32873 3537s 2024-11-23 21:23:25,022 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37785 3537s 2024-11-23 21:23:25,022 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:23:25,022 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:23:25,022 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:23:25,022 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-c8jt1pgk 3537s 2024-11-23 21:23:25,022 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:23:25,026 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46543 3537s 2024-11-23 21:23:25,026 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46543 3537s 2024-11-23 21:23:25,026 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:23:25,026 - distributed.worker - INFO - dashboard at: 127.0.0.1:32817 3537s 2024-11-23 21:23:25,026 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37785 3537s 2024-11-23 21:23:25,026 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:23:25,026 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:23:25,026 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:23:25,026 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-fw74myx3 3537s 2024-11-23 21:23:25,026 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:23:25,028 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44475. Reason: failure-to-start- 3537s 2024-11-23 21:23:25,028 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:23:25,028 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46543. Reason: failure-to-start- 3537s 2024-11-23 21:23:25,028 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:23:25,032 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37785': TLS handshake failed with remote 'tls://127.0.0.1:55814': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:23:25,032 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37785': TLS handshake failed with remote 'tls://127.0.0.1:55818': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:23:25,034 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:23:26,040 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:23:26,047 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36031 3537s 2024-11-23 21:23:26,048 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42573/status 3537s 2024-11-23 21:23:26,049 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:23:26,064 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37331 3537s 2024-11-23 21:23:26,065 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37331 3537s 2024-11-23 21:23:26,065 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:23:26,065 - distributed.worker - INFO - dashboard at: 127.0.0.1:39535 3537s 2024-11-23 21:23:26,065 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36031 3537s 2024-11-23 21:23:26,065 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:23:26,065 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:23:26,065 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:23:26,065 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-dnf206ch 3537s 2024-11-23 21:23:26,065 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:23:26,067 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33469 3537s 2024-11-23 21:23:26,069 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33469 3537s 2024-11-23 21:23:26,069 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:23:26,070 - distributed.worker - INFO - dashboard at: 127.0.0.1:43975 3537s 2024-11-23 21:23:26,070 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36031 3537s 2024-11-23 21:23:26,070 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:23:26,070 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:23:26,070 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:23:26,070 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-wglhz37x 3537s 2024-11-23 21:23:26,070 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:23:26,072 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37331. Reason: failure-to-start- 3537s 2024-11-23 21:23:26,072 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:23:26,072 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33469. Reason: failure-to-start- 3537s 2024-11-23 21:23:26,073 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:23:26,077 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36031': TLS handshake failed with remote 'tls://127.0.0.1:40644': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:23:26,077 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36031': TLS handshake failed with remote 'tls://127.0.0.1:40658': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:23:26,079 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:23:27,086 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:23:27,094 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42095 3537s 2024-11-23 21:23:27,094 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39309/status 3537s 2024-11-23 21:23:27,095 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:23:27,110 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38807 3537s 2024-11-23 21:23:27,110 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38807 3537s 2024-11-23 21:23:27,110 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:23:27,111 - distributed.worker - INFO - dashboard at: 127.0.0.1:41021 3537s 2024-11-23 21:23:27,111 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42095 3537s 2024-11-23 21:23:27,111 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:23:27,111 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:23:27,111 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:23:27,111 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-0pepuecp 3537s 2024-11-23 21:23:27,111 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:23:27,113 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34105 3537s 2024-11-23 21:23:27,113 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34105 3537s 2024-11-23 21:23:27,113 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:23:27,113 - distributed.worker - INFO - dashboard at: 127.0.0.1:44049 3537s 2024-11-23 21:23:27,113 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42095 3537s 2024-11-23 21:23:27,113 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:23:27,114 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:23:27,114 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:23:27,114 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-hc4lwaok 3537s 2024-11-23 21:23:27,114 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:23:27,117 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38807. Reason: failure-to-start- 3537s 2024-11-23 21:23:27,117 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:23:27,118 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34105. Reason: failure-to-start- 3537s 2024-11-23 21:23:27,118 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:23:27,120 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42095': TLS handshake failed with remote 'tls://127.0.0.1:38394': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:23:27,120 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42095': TLS handshake failed with remote 'tls://127.0.0.1:38408': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:23:27,122 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:23:28,128 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:23:28,135 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46725 3537s 2024-11-23 21:23:28,136 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36145/status 3537s 2024-11-23 21:23:28,136 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:23:28,153 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46467 3537s 2024-11-23 21:23:28,153 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46467 3537s 2024-11-23 21:23:28,153 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:23:28,153 - distributed.worker - INFO - dashboard at: 127.0.0.1:40271 3537s 2024-11-23 21:23:28,153 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46725 3537s 2024-11-23 21:23:28,154 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:23:28,154 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:23:28,154 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:23:28,154 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-qblp3nwu 3537s 2024-11-23 21:23:28,154 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:23:28,156 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39083 3537s 2024-11-23 21:23:28,156 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39083 3537s 2024-11-23 21:23:28,156 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:23:28,156 - distributed.worker - INFO - dashboard at: 127.0.0.1:44555 3537s 2024-11-23 21:23:28,156 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46725 3537s 2024-11-23 21:23:28,156 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:23:28,156 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:23:28,156 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:23:28,156 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-lwvjq4sc 3537s 2024-11-23 21:23:28,157 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:23:28,160 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46467. Reason: failure-to-start- 3537s 2024-11-23 21:23:28,160 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:23:28,161 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39083. Reason: failure-to-start- 3537s 2024-11-23 21:23:28,161 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:23:28,162 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46725': TLS handshake failed with remote 'tls://127.0.0.1:45470': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:23:28,162 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46725': TLS handshake failed with remote 'tls://127.0.0.1:45484': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:23:28,164 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:23:29,170 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:23:29,178 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36185 3537s 2024-11-23 21:23:29,178 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42229/status 3537s 2024-11-23 21:23:29,178 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:23:29,197 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44881 3537s 2024-11-23 21:23:29,197 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44881 3537s 2024-11-23 21:23:29,197 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:23:29,197 - distributed.worker - INFO - dashboard at: 127.0.0.1:41811 3537s 2024-11-23 21:23:29,197 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36185 3537s 2024-11-23 21:23:29,198 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:23:29,198 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:23:29,198 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:23:29,198 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ierrccoc 3537s 2024-11-23 21:23:29,198 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:23:29,200 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36891 3537s 2024-11-23 21:23:29,200 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36891 3537s 2024-11-23 21:23:29,200 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:23:29,200 - distributed.worker - INFO - dashboard at: 127.0.0.1:45067 3537s 2024-11-23 21:23:29,200 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36185 3537s 2024-11-23 21:23:29,200 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:23:29,200 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:23:29,200 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:23:29,200 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-va36_tg7 3537s 2024-11-23 21:23:29,201 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:23:29,202 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44881. Reason: failure-to-start- 3537s 2024-11-23 21:23:29,202 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:23:29,202 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36891. Reason: failure-to-start- 3537s 2024-11-23 21:23:29,203 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:23:29,204 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36185': TLS handshake failed with remote 'tls://127.0.0.1:40954': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:23:29,204 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36185': TLS handshake failed with remote 'tls://127.0.0.1:40958': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:23:29,206 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:23:30,212 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:23:30,219 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34987 3537s 2024-11-23 21:23:30,220 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41597/status 3537s 2024-11-23 21:23:30,220 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:23:30,238 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33987 3537s 2024-11-23 21:23:30,238 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33987 3537s 2024-11-23 21:23:30,238 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:23:30,238 - distributed.worker - INFO - dashboard at: 127.0.0.1:45797 3537s 2024-11-23 21:23:30,238 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34987 3537s 2024-11-23 21:23:30,238 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:23:30,238 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:23:30,238 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:23:30,238 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-zp3dmgnn 3537s 2024-11-23 21:23:30,238 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:23:30,240 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43013 3537s 2024-11-23 21:23:30,241 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43013 3537s 2024-11-23 21:23:30,241 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:23:30,241 - distributed.worker - INFO - dashboard at: 127.0.0.1:42777 3537s 2024-11-23 21:23:30,241 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34987 3537s 2024-11-23 21:23:30,241 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:23:30,241 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:23:30,241 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:23:30,241 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-oswodt_j 3537s 2024-11-23 21:23:30,241 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:23:30,244 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33987. Reason: failure-to-start- 3537s 2024-11-23 21:23:30,244 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:23:30,244 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43013. Reason: failure-to-start- 3537s 2024-11-23 21:23:30,244 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:23:30,246 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34987': TLS handshake failed with remote 'tls://127.0.0.1:37416': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:23:30,246 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34987': TLS handshake failed with remote 'tls://127.0.0.1:37420': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:23:30,248 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:23:31,253 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:23:31,261 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38047 3537s 2024-11-23 21:23:31,261 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37557/status 3537s 2024-11-23 21:23:31,262 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:23:31,279 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43493 3537s 2024-11-23 21:23:31,279 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43493 3537s 2024-11-23 21:23:31,279 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:23:31,279 - distributed.worker - INFO - dashboard at: 127.0.0.1:44619 3537s 2024-11-23 21:23:31,279 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38047 3537s 2024-11-23 21:23:31,280 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:23:31,280 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:23:31,280 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:23:31,280 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-sb25tsbw 3537s 2024-11-23 21:23:31,280 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:23:31,282 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46195 3537s 2024-11-23 21:23:31,282 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46195 3537s 2024-11-23 21:23:31,282 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:23:31,282 - distributed.worker - INFO - dashboard at: 127.0.0.1:41943 3537s 2024-11-23 21:23:31,282 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38047 3537s 2024-11-23 21:23:31,282 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:23:31,282 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:23:31,282 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:23:31,282 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-n45rei5d 3537s 2024-11-23 21:23:31,283 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:23:31,284 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43493. Reason: failure-to-start- 3537s 2024-11-23 21:23:31,284 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:23:31,284 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46195. Reason: failure-to-start- 3537s 2024-11-23 21:23:31,285 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:23:31,286 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38047': TLS handshake failed with remote 'tls://127.0.0.1:58116': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:23:31,286 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38047': TLS handshake failed with remote 'tls://127.0.0.1:58120': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:23:31,288 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:23:32,295 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:23:32,303 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44515 3537s 2024-11-23 21:23:32,303 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41991/status 3537s 2024-11-23 21:23:32,304 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:23:32,322 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35311 3537s 2024-11-23 21:23:32,322 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35311 3537s 2024-11-23 21:23:32,322 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:23:32,323 - distributed.worker - INFO - dashboard at: 127.0.0.1:40907 3537s 2024-11-23 21:23:32,323 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44515 3537s 2024-11-23 21:23:32,323 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:23:32,323 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:23:32,323 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:23:32,323 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-mzz1ns8q 3537s 2024-11-23 21:23:32,323 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:23:32,325 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45465 3537s 2024-11-23 21:23:32,325 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45465 3537s 2024-11-23 21:23:32,326 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:23:32,326 - distributed.worker - INFO - dashboard at: 127.0.0.1:41987 3537s 2024-11-23 21:23:32,326 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44515 3537s 2024-11-23 21:23:32,326 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:23:32,326 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:23:32,326 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:23:32,326 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-5ypzz7rs 3537s 2024-11-23 21:23:32,326 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:23:32,327 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35311. Reason: failure-to-start- 3537s 2024-11-23 21:23:32,328 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:23:32,328 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45465. Reason: failure-to-start- 3537s 2024-11-23 21:23:32,328 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:23:32,330 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44515': TLS handshake failed with remote 'tls://127.0.0.1:47028': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:23:32,330 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44515': TLS handshake failed with remote 'tls://127.0.0.1:47042': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:23:32,331 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:23:33,337 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:23:33,344 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45581 3537s 2024-11-23 21:23:33,345 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:32965/status 3537s 2024-11-23 21:23:33,345 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:23:33,363 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43311 3537s 2024-11-23 21:23:33,364 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43311 3537s 2024-11-23 21:23:33,364 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:23:33,364 - distributed.worker - INFO - dashboard at: 127.0.0.1:43529 3537s 2024-11-23 21:23:33,364 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45581 3537s 2024-11-23 21:23:33,364 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:23:33,364 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:23:33,364 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:23:33,364 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-_jduubzs 3537s 2024-11-23 21:23:33,364 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:23:33,366 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42179 3537s 2024-11-23 21:23:33,367 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42179 3537s 2024-11-23 21:23:33,367 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:23:33,367 - distributed.worker - INFO - dashboard at: 127.0.0.1:42891 3537s 2024-11-23 21:23:33,367 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45581 3537s 2024-11-23 21:23:33,367 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:23:33,367 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:23:33,367 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:23:33,367 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-s9cy8p45 3537s 2024-11-23 21:23:33,367 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:23:33,369 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43311. Reason: failure-to-start- 3537s 2024-11-23 21:23:33,369 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:23:33,369 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42179. Reason: failure-to-start- 3537s 2024-11-23 21:23:33,370 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:23:33,371 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45581': TLS handshake failed with remote 'tls://127.0.0.1:34782': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:23:33,371 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45581': TLS handshake failed with remote 'tls://127.0.0.1:34792': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:23:33,375 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:23:34,381 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:23:34,389 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42191 3537s 2024-11-23 21:23:34,389 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35029/status 3537s 2024-11-23 21:23:34,389 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:23:34,406 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45277 3537s 2024-11-23 21:23:34,407 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45277 3537s 2024-11-23 21:23:34,407 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:23:34,407 - distributed.worker - INFO - dashboard at: 127.0.0.1:36355 3537s 2024-11-23 21:23:34,407 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42191 3537s 2024-11-23 21:23:34,407 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:23:34,407 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:23:34,407 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:23:34,407 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ppq55hma 3537s 2024-11-23 21:23:34,407 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:23:34,409 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37909 3537s 2024-11-23 21:23:34,410 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37909 3537s 2024-11-23 21:23:34,410 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:23:34,410 - distributed.worker - INFO - dashboard at: 127.0.0.1:45777 3537s 2024-11-23 21:23:34,410 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42191 3537s 2024-11-23 21:23:34,410 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:23:34,410 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:23:34,410 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:23:34,410 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-6o1wo5w9 3537s 2024-11-23 21:23:34,410 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:23:34,412 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45277. Reason: failure-to-start- 3537s 2024-11-23 21:23:34,412 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:23:34,412 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37909. Reason: failure-to-start- 3537s 2024-11-23 21:23:34,412 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:23:34,416 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42191': TLS handshake failed with remote 'tls://127.0.0.1:48072': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:23:34,416 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42191': TLS handshake failed with remote 'tls://127.0.0.1:48078': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:23:34,420 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:23:35,425 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:23:35,433 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41251 3537s 2024-11-23 21:23:35,433 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39863/status 3537s 2024-11-23 21:23:35,434 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:23:35,450 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35505 3537s 2024-11-23 21:23:35,451 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35505 3537s 2024-11-23 21:23:35,451 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:23:35,451 - distributed.worker - INFO - dashboard at: 127.0.0.1:40579 3537s 2024-11-23 21:23:35,451 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41251 3537s 2024-11-23 21:23:35,451 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:23:35,451 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:23:35,451 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:23:35,451 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-dpflpz24 3537s 2024-11-23 21:23:35,451 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:23:35,453 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41509 3537s 2024-11-23 21:23:35,454 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41509 3537s 2024-11-23 21:23:35,454 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:23:35,454 - distributed.worker - INFO - dashboard at: 127.0.0.1:33205 3537s 2024-11-23 21:23:35,454 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41251 3537s 2024-11-23 21:23:35,454 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:23:35,455 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:23:35,455 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:23:35,455 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ekd5n0l5 3537s 2024-11-23 21:23:35,455 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:23:35,459 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35505. Reason: failure-to-start- 3537s 2024-11-23 21:23:35,460 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:23:35,460 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41509. Reason: failure-to-start- 3537s 2024-11-23 21:23:35,460 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:23:35,464 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41251': TLS handshake failed with remote 'tls://127.0.0.1:37386': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:23:35,464 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41251': TLS handshake failed with remote 'tls://127.0.0.1:37396': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:23:35,465 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:23:36,471 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:23:36,481 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38889 3537s 2024-11-23 21:23:36,481 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43371/status 3537s 2024-11-23 21:23:36,481 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:23:36,500 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38335 3537s 2024-11-23 21:23:36,500 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38335 3537s 2024-11-23 21:23:36,500 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:23:36,500 - distributed.worker - INFO - dashboard at: 127.0.0.1:34141 3537s 2024-11-23 21:23:36,500 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38889 3537s 2024-11-23 21:23:36,500 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:23:36,500 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:23:36,500 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:23:36,500 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ap5u09su 3537s 2024-11-23 21:23:36,500 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:23:36,503 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34781 3537s 2024-11-23 21:23:36,503 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34781 3537s 2024-11-23 21:23:36,503 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:23:36,503 - distributed.worker - INFO - dashboard at: 127.0.0.1:40611 3537s 2024-11-23 21:23:36,503 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38889 3537s 2024-11-23 21:23:36,503 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:23:36,503 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:23:36,503 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:23:36,503 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-8i6st2df 3537s 2024-11-23 21:23:36,503 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:23:36,509 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38335. Reason: failure-to-start- 3537s 2024-11-23 21:23:36,509 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:23:36,509 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34781. Reason: failure-to-start- 3537s 2024-11-23 21:23:36,509 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:23:36,511 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38889': TLS handshake failed with remote 'tls://127.0.0.1:53850': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:23:36,511 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38889': TLS handshake failed with remote 'tls://127.0.0.1:53854': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:23:36,516 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:23:37,521 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:23:37,529 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35431 3537s 2024-11-23 21:23:37,530 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43427/status 3537s 2024-11-23 21:23:37,530 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:23:37,549 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39423 3537s 2024-11-23 21:23:37,549 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39423 3537s 2024-11-23 21:23:37,549 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:23:37,549 - distributed.worker - INFO - dashboard at: 127.0.0.1:41771 3537s 2024-11-23 21:23:37,549 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35431 3537s 2024-11-23 21:23:37,550 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:23:37,550 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:23:37,550 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:23:37,550 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-k9arfoe6 3537s 2024-11-23 21:23:37,550 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:23:37,552 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42795 3537s 2024-11-23 21:23:37,552 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42795 3537s 2024-11-23 21:23:37,552 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:23:37,552 - distributed.worker - INFO - dashboard at: 127.0.0.1:38601 3537s 2024-11-23 21:23:37,553 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35431 3537s 2024-11-23 21:23:37,553 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:23:37,553 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:23:37,553 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:23:37,553 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-wsjik1f5 3537s 2024-11-23 21:23:37,553 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:23:37,555 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39423. Reason: failure-to-start- 3537s 2024-11-23 21:23:37,555 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:23:37,555 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42795. Reason: failure-to-start- 3537s 2024-11-23 21:23:37,555 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:23:37,560 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35431': TLS handshake failed with remote 'tls://127.0.0.1:47184': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:23:37,560 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35431': TLS handshake failed with remote 'tls://127.0.0.1:47186': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:23:37,561 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:23:38,569 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:23:38,577 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36897 3537s 2024-11-23 21:23:38,577 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35683/status 3537s 2024-11-23 21:23:38,580 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:23:38,596 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36391 3537s 2024-11-23 21:23:38,596 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36391 3537s 2024-11-23 21:23:38,596 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:23:38,597 - distributed.worker - INFO - dashboard at: 127.0.0.1:33453 3537s 2024-11-23 21:23:38,597 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36897 3537s 2024-11-23 21:23:38,597 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:23:38,597 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:23:38,597 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:23:38,597 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-_8tf5k9e 3537s 2024-11-23 21:23:38,597 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:23:38,599 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39553 3537s 2024-11-23 21:23:38,599 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39553 3537s 2024-11-23 21:23:38,599 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:23:38,599 - distributed.worker - INFO - dashboard at: 127.0.0.1:33649 3537s 2024-11-23 21:23:38,599 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36897 3537s 2024-11-23 21:23:38,600 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:23:38,600 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:23:38,600 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:23:38,600 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-8sgm7fpk 3537s 2024-11-23 21:23:38,600 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:23:38,601 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36391. Reason: failure-to-start- 3537s 2024-11-23 21:23:38,601 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:23:38,602 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39553. Reason: failure-to-start- 3537s 2024-11-23 21:23:38,602 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:23:38,606 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36897': TLS handshake failed with remote 'tls://127.0.0.1:42318': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:23:38,606 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36897': TLS handshake failed with remote 'tls://127.0.0.1:42324': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:23:38,610 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:23:39,616 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:23:39,624 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38609 3537s 2024-11-23 21:23:39,624 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39715/status 3537s 2024-11-23 21:23:39,624 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:23:39,660 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44835 3537s 2024-11-23 21:23:39,661 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44835 3537s 2024-11-23 21:23:39,661 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:23:39,661 - distributed.worker - INFO - dashboard at: 127.0.0.1:39011 3537s 2024-11-23 21:23:39,661 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38609 3537s 2024-11-23 21:23:39,661 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:23:39,661 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:23:39,661 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:23:39,661 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-fb339ua7 3537s 2024-11-23 21:23:39,661 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:23:39,663 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44423 3537s 2024-11-23 21:23:39,664 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44423 3537s 2024-11-23 21:23:39,664 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:23:39,664 - distributed.worker - INFO - dashboard at: 127.0.0.1:44265 3537s 2024-11-23 21:23:39,664 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38609 3537s 2024-11-23 21:23:39,664 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:23:39,664 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:23:39,664 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:23:39,664 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-0j9t6ssd 3537s 2024-11-23 21:23:39,664 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:23:39,670 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44835. Reason: failure-to-start- 3537s 2024-11-23 21:23:39,670 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:23:39,671 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44423. Reason: failure-to-start- 3537s 2024-11-23 21:23:39,671 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:23:39,673 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38609': TLS handshake failed with remote 'tls://127.0.0.1:54118': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:23:39,673 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38609': TLS handshake failed with remote 'tls://127.0.0.1:54132': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:23:39,675 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:23:40,683 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:23:40,691 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46681 3537s 2024-11-23 21:23:40,691 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34333/status 3537s 2024-11-23 21:23:40,692 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:23:40,713 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43457 3537s 2024-11-23 21:23:40,713 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43457 3537s 2024-11-23 21:23:40,714 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:23:40,714 - distributed.worker - INFO - dashboard at: 127.0.0.1:41861 3537s 2024-11-23 21:23:40,714 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46681 3537s 2024-11-23 21:23:40,714 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:23:40,714 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:23:40,714 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:23:40,714 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-cg5kq0xf 3537s 2024-11-23 21:23:40,714 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:23:40,716 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43091 3537s 2024-11-23 21:23:40,716 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43091 3537s 2024-11-23 21:23:40,716 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:23:40,717 - distributed.worker - INFO - dashboard at: 127.0.0.1:38945 3537s 2024-11-23 21:23:40,717 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46681 3537s 2024-11-23 21:23:40,717 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:23:40,717 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:23:40,717 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:23:40,717 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-vcr7_d7v 3537s 2024-11-23 21:23:40,717 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:23:40,719 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43457. Reason: failure-to-start- 3537s 2024-11-23 21:23:40,719 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:23:40,719 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43091. Reason: failure-to-start- 3537s 2024-11-23 21:23:40,719 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:23:40,723 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46681': TLS handshake failed with remote 'tls://127.0.0.1:56724': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:23:40,723 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46681': TLS handshake failed with remote 'tls://127.0.0.1:56726': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:23:40,727 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s _________________________ test_worker_client_executor __________________________ 3537s 3537s fut = , timeout = 0 3537s 3537s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 3537s async with asyncio.timeout(timeout): 3537s > return await fut 3537s 3537s /usr/lib/python3/dist-packages/distributed/utils.py:1960: 3537s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3537s /usr/lib/python3/dist-packages/distributed/worker.py:1480: in start_unsafe 3537s await self._register_with_scheduler() 3537s /usr/lib/python3/dist-packages/distributed/worker.py:1179: in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s /usr/lib/python3/dist-packages/distributed/comm/core.py:342: in connect 3537s comm = await wait_for( 3537s /usr/lib/python3/dist-packages/distributed/utils.py:1960: in wait_for 3537s return await fut 3537s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:546: in connect 3537s stream = await self.client.connect( 3537s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3537s 3537s self = , host = '127.0.0.1' 3537s port = 32841, af = 3537s ssl_options = 3537s max_buffer_size = 8364507136.0, source_ip = None, source_port = None 3537s timeout = None 3537s 3537s async def connect( 3537s self, 3537s host: str, 3537s port: int, 3537s af: socket.AddressFamily = socket.AF_UNSPEC, 3537s ssl_options: Optional[Union[Dict[str, Any], ssl.SSLContext]] = None, 3537s max_buffer_size: Optional[int] = None, 3537s source_ip: Optional[str] = None, 3537s source_port: Optional[int] = None, 3537s timeout: Optional[Union[float, datetime.timedelta]] = None, 3537s ) -> IOStream: 3537s """Connect to the given host and port. 3537s 3537s Asynchronously returns an `.IOStream` (or `.SSLIOStream` if 3537s ``ssl_options`` is not None). 3537s 3537s Using the ``source_ip`` kwarg, one can specify the source 3537s IP address to use when establishing the connection. 3537s In case the user needs to resolve and 3537s use a specific interface, it has to be handled outside 3537s of Tornado as this depends very much on the platform. 3537s 3537s Raises `TimeoutError` if the input future does not complete before 3537s ``timeout``, which may be specified in any form allowed by 3537s `.IOLoop.add_timeout` (i.e. a `datetime.timedelta` or an absolute time 3537s relative to `.IOLoop.time`) 3537s 3537s Similarly, when the user requires a certain source port, it can 3537s be specified using the ``source_port`` arg. 3537s 3537s .. versionchanged:: 4.5 3537s Added the ``source_ip`` and ``source_port`` arguments. 3537s 3537s .. versionchanged:: 5.0 3537s Added the ``timeout`` argument. 3537s """ 3537s if timeout is not None: 3537s if isinstance(timeout, numbers.Real): 3537s timeout = IOLoop.current().time() + timeout 3537s elif isinstance(timeout, datetime.timedelta): 3537s timeout = IOLoop.current().time() + timeout.total_seconds() 3537s else: 3537s raise TypeError("Unsupported timeout %r" % timeout) 3537s if timeout is not None: 3537s addrinfo = await gen.with_timeout( 3537s timeout, self.resolver.resolve(host, port, af) 3537s ) 3537s else: 3537s addrinfo = await self.resolver.resolve(host, port, af) 3537s connector = _Connector( 3537s addrinfo, 3537s functools.partial( 3537s self._create_stream, 3537s max_buffer_size, 3537s source_ip=source_ip, 3537s source_port=source_port, 3537s ), 3537s ) 3537s > af, addr, stream = await connector.start(connect_timeout=timeout) 3537s E asyncio.exceptions.CancelledError 3537s 3537s /usr/lib/python3/dist-packages/tornado/tcpclient.py:279: CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s self = 3537s 3537s @final 3537s async def start(self): 3537s async with self._startup_lock: 3537s if self.status == Status.failed: 3537s assert self.__startup_exc is not None 3537s raise self.__startup_exc 3537s elif self.status != Status.init: 3537s return self 3537s timeout = getattr(self, "death_timeout", None) 3537s 3537s async def _close_on_failure(exc: Exception) -> None: 3537s await self.close(reason=f"failure-to-start-{str(type(exc))}") 3537s self.status = Status.failed 3537s self.__startup_exc = exc 3537s 3537s try: 3537s > await wait_for(self.start_unsafe(), timeout=timeout) 3537s 3537s /usr/lib/python3/dist-packages/distributed/core.py:664: 3537s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3537s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 3537s async with asyncio.timeout(timeout): 3537s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3537s 3537s self = 3537s exc_type = 3537s exc_val = CancelledError(), exc_tb = 3537s 3537s async def __aexit__( 3537s self, 3537s exc_type: Optional[Type[BaseException]], 3537s exc_val: Optional[BaseException], 3537s exc_tb: Optional[TracebackType], 3537s ) -> Optional[bool]: 3537s assert self._state in (_State.ENTERED, _State.EXPIRING) 3537s 3537s if self._timeout_handler is not None: 3537s self._timeout_handler.cancel() 3537s self._timeout_handler = None 3537s 3537s if self._state is _State.EXPIRING: 3537s self._state = _State.EXPIRED 3537s 3537s if self._task.uncancel() <= self._cancelling and exc_type is not None: 3537s # Since there are no new cancel requests, we're 3537s # handling this. 3537s if issubclass(exc_type, exceptions.CancelledError): 3537s > raise TimeoutError from exc_val 3537s E TimeoutError 3537s 3537s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s @contextlib.asynccontextmanager 3537s async def _cluster_factory(): 3537s workers = [] 3537s s = None 3537s try: 3537s for _ in range(60): 3537s try: 3537s > s, ws = await start_cluster( 3537s nthreads, 3537s scheduler, 3537s security=security, 3537s Worker=Worker, 3537s scheduler_kwargs=scheduler_kwargs, 3537s worker_kwargs=merge( 3537s {"death_timeout": min(15, int(deadline.remaining))}, 3537s worker_kwargs, 3537s ), 3537s ) 3537s 3537s /usr/lib/python3/dist-packages/distributed/utils_test.py:966: 3537s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3537s /usr/lib/python3/dist-packages/distributed/utils_test.py:789: in start_cluster 3537s await asyncio.gather(*workers) 3537s /usr/lib/python3.13/asyncio/tasks.py:737: in _wrap_awaitable 3537s return await awaitable 3537s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3537s 3537s self = 3537s 3537s @final 3537s async def start(self): 3537s async with self._startup_lock: 3537s if self.status == Status.failed: 3537s assert self.__startup_exc is not None 3537s raise self.__startup_exc 3537s elif self.status != Status.init: 3537s return self 3537s timeout = getattr(self, "death_timeout", None) 3537s 3537s async def _close_on_failure(exc: Exception) -> None: 3537s await self.close(reason=f"failure-to-start-{str(type(exc))}") 3537s self.status = Status.failed 3537s self.__startup_exc = exc 3537s 3537s try: 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s except asyncio.TimeoutError as exc: 3537s await _close_on_failure(exc) 3537s > raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s E TimeoutError: Worker start timed out after 0s. 3537s 3537s /usr/lib/python3/dist-packages/distributed/core.py:667: TimeoutError 3537s 3537s During handling of the above exception, another exception occurred: 3537s 3537s fut = ._..test_func..async_fn at 0xe247ca20> 3537s timeout = 60 3537s 3537s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 3537s async with asyncio.timeout(timeout): 3537s > return await fut 3537s 3537s /usr/lib/python3/dist-packages/distributed/utils.py:1960: 3537s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3537s /usr/lib/python3/dist-packages/distributed/utils_test.py:999: in async_fn 3537s _cluster_factory() as (s, workers), 3537s /usr/lib/python3.13/contextlib.py:214: in __aenter__ 3537s return await anext(self.gen) 3537s /usr/lib/python3/dist-packages/distributed/utils_test.py:983: in _cluster_factory 3537s await asyncio.sleep(1) 3537s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3537s 3537s delay = 1, result = None 3537s 3537s async def sleep(delay, result=None): 3537s """Coroutine that completes after a given time (in seconds).""" 3537s if delay <= 0: 3537s await __sleep0() 3537s return result 3537s 3537s if math.isnan(delay): 3537s raise ValueError("Invalid delay: NaN (not a number)") 3537s 3537s loop = events.get_running_loop() 3537s future = loop.create_future() 3537s h = loop.call_later(delay, 3537s futures._set_result_unless_cancelled, 3537s future, result) 3537s try: 3537s > return await future 3537s E asyncio.exceptions.CancelledError 3537s 3537s /usr/lib/python3.13/asyncio/tasks.py:718: CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s args = (), kwds = {} 3537s 3537s @wraps(func) 3537s def inner(*args, **kwds): 3537s with self._recreate_cm(): 3537s > return func(*args, **kwds) 3537s 3537s /usr/lib/python3.13/contextlib.py:85: 3537s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3537s /usr/lib/python3.13/contextlib.py:85: in inner 3537s return func(*args, **kwds) 3537s /usr/lib/python3/dist-packages/distributed/utils_test.py:1102: in test_func 3537s return _run_and_close_tornado(async_fn_outer) 3537s /usr/lib/python3/dist-packages/distributed/utils_test.py:378: in _run_and_close_tornado 3537s return asyncio_run(inner_fn(), loop_factory=get_loop_factory()) 3537s /usr/lib/python3.13/asyncio/runners.py:194: in run 3537s return runner.run(main) 3537s /usr/lib/python3.13/asyncio/runners.py:118: in run 3537s return self._loop.run_until_complete(task) 3537s /usr/lib/python3.13/asyncio/base_events.py:720: in run_until_complete 3537s return future.result() 3537s /usr/lib/python3/dist-packages/distributed/utils_test.py:375: in inner_fn 3537s return await async_fn(*args, **kwargs) 3537s /usr/lib/python3/dist-packages/distributed/utils_test.py:1099: in async_fn_outer 3537s return await utils_wait_for(async_fn(), timeout=timeout * 2) 3537s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 3537s async with asyncio.timeout(timeout): 3537s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3537s 3537s self = 3537s exc_type = 3537s exc_val = CancelledError(), exc_tb = 3537s 3537s async def __aexit__( 3537s self, 3537s exc_type: Optional[Type[BaseException]], 3537s exc_val: Optional[BaseException], 3537s exc_tb: Optional[TracebackType], 3537s ) -> Optional[bool]: 3537s assert self._state in (_State.ENTERED, _State.EXPIRING) 3537s 3537s if self._timeout_handler is not None: 3537s self._timeout_handler.cancel() 3537s self._timeout_handler = None 3537s 3537s if self._state is _State.EXPIRING: 3537s self._state = _State.EXPIRED 3537s 3537s if self._task.uncancel() <= self._cancelling and exc_type is not None: 3537s # Since there are no new cancel requests, we're 3537s # handling this. 3537s if issubclass(exc_type, exceptions.CancelledError): 3537s > raise TimeoutError from exc_val 3537s E TimeoutError 3537s 3537s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 3537s ----------------------------- Captured stderr call ----------------------------- 3537s 2024-11-23 21:23:41,929 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:23:41,938 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:41,938 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39387/status 3537s 2024-11-23 21:23:41,939 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:23:41,954 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40023 3537s 2024-11-23 21:23:41,955 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40023 3537s 2024-11-23 21:23:41,955 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:23:41,955 - distributed.worker - INFO - dashboard at: 127.0.0.1:42005 3537s 2024-11-23 21:23:41,955 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:41,955 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:23:41,955 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:23:41,955 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:23:41,955 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-anshd59d 3537s 2024-11-23 21:23:41,955 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:23:41,957 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33733 3537s 2024-11-23 21:23:41,958 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33733 3537s 2024-11-23 21:23:41,958 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:23:41,958 - distributed.worker - INFO - dashboard at: 127.0.0.1:34565 3537s 2024-11-23 21:23:41,958 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:41,958 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:23:41,958 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:23:41,958 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:23:41,958 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-nzrdc7nt 3537s 2024-11-23 21:23:41,958 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:23:41,971 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:41,972 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:41,972 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:46368': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:41,972 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:46380': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:42,084 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:42,084 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:42,085 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:46386': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:42,085 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:46398': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:42,198 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:42,198 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:42,199 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:46400': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:42,199 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:46402': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:42,315 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:42,316 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:42,316 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:46410': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:42,316 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:46418': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:42,429 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:42,430 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:42,430 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:46426': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:42,430 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:46430': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:42,542 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:42,543 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:42,543 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:46434': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:42,543 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:46446': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:42,655 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:42,656 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:42,656 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:46456': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:42,656 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:46458': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:42,768 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:42,769 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:42,769 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:46474': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:42,769 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:46476': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:42,881 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:42,882 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:42,882 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:46488': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:42,882 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:46492': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:42,994 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:42,994 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:42,995 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:46504': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:42,995 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:46516': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:43,107 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:43,107 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:43,108 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:46530': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:43,108 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:46542': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:43,221 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:43,221 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:43,222 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:46558': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:43,222 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:46572': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:43,335 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:43,335 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:43,336 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:46574': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:43,336 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:46584': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:43,453 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:43,453 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:43,454 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:46590': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:43,454 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:46600': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:43,567 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:43,567 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:43,567 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:46606': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:43,567 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:46610': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:43,680 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:43,681 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:43,681 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:46622': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:43,681 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:46636': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:43,794 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:43,794 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:43,795 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:46650': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:43,795 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:46666': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:43,908 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:43,908 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:43,909 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:46676': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:43,909 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:46690': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:44,023 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:44,023 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:44,023 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:46698': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:44,024 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:46710': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:44,136 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:44,136 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:44,136 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:46712': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:44,137 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:46714': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:44,249 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:44,250 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:44,250 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:46726': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:44,250 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:46732': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:44,362 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:44,362 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:44,363 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:46734': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:44,363 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:46738': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:44,475 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:44,476 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:44,476 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:46752': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:44,476 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:46758': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:44,589 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:44,590 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:44,590 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:46772': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:44,590 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:46780': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:44,702 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:44,703 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:44,703 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:46792': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:44,703 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:46794': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:44,815 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:44,815 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:44,816 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:46802': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:44,816 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:46814': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:44,929 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:44,929 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:44,930 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:46826': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:44,930 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:46838': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:45,043 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:45,044 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:45,044 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:46844': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:45,044 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:46846': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:45,155 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:45,156 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:45,156 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:46852': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:45,156 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:46856': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:45,269 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:45,269 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:45,269 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:46864': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:45,269 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:46876': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:45,381 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:45,382 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:45,382 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:46884': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:45,382 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:46896': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:45,494 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:45,495 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:45,495 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:46910': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:45,495 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:46922': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:45,607 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:45,608 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:45,609 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:46930': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:45,609 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:46944': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:45,721 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:45,721 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:45,722 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:46954': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:45,722 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:46968': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:45,836 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:45,836 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:45,836 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:46970': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:45,836 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:46986': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:45,953 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:45,953 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:45,953 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:46988': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:45,954 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:47002': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:46,067 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:46,067 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:46,067 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:47010': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:46,068 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:47022': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:46,181 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:46,181 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:46,181 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:47030': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:46,181 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:47042': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:46,294 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:46,295 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:46,295 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:47050': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:46,295 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:47056': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:46,407 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:46,407 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:46,408 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:47068': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:46,408 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:47074': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:46,521 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:46,521 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:46,521 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:47090': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:46,521 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:47096': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:46,634 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:46,634 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:46,634 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:47098': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:46,635 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:47104': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:46,747 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:46,748 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:46,748 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:47108': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:46,748 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:47112': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:46,860 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:46,860 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:46,861 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:47124': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:46,861 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:47132': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:46,974 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:46,974 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:46,975 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:47148': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:46,975 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:47158': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:47,087 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:47,088 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:47,088 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:47170': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:47,088 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:47172': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:47,200 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:47,201 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:47,201 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:47186': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:47,201 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:47202': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:47,313 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:47,314 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:47,314 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:47204': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:47,314 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:47216': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:47,427 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:47,428 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:47,428 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:47222': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:47,428 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:47238': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:47,541 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:47,541 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:47,541 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:47240': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:47,542 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:47252': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:47,656 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:47,656 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:47,657 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:47260': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:47,657 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:47262': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:47,770 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:47,770 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:47,771 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:47276': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:47,771 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:47290': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:47,883 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:47,884 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:47,884 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:47302': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:47,884 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:47314': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:47,997 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:47,997 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:47,997 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:47316': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:47,997 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:47318': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:48,110 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:48,110 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:48,110 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:47332': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:48,111 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:47346': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:48,223 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:48,223 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:48,224 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:47362': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:48,224 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:47370': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:48,336 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:48,336 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:48,336 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:47374': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:48,336 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:47390': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:48,453 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:48,454 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:48,454 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:47398': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:48,454 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:47414': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:48,566 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:48,567 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:48,567 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:47422': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:48,567 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:47436': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:48,681 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:48,681 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:48,681 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:47450': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:48,682 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:47456': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:48,794 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:48,794 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:48,795 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:47466': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:48,795 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:47470': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:48,907 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:48,907 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:48,908 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:47474': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:48,908 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:47476': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:49,021 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:49,021 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:49,022 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:47490': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:49,022 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:47502': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:49,134 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:49,134 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:49,134 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:47510': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:49,135 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:47518': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:49,248 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:49,248 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:49,249 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:47528': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:49,249 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:47542': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:49,362 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:49,362 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:49,364 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:47550': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:49,364 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:47554': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:49,476 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:49,476 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:49,476 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:47560': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:49,477 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:47566': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:49,590 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:49,590 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:49,590 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:47574': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:49,591 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:47582': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:49,703 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:49,703 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:49,704 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:47594': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:49,704 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:47596': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:49,816 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:49,816 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:49,817 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:47600': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:49,817 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:47610': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:49,929 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:49,929 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:49,930 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:47616': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:49,930 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:47620': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:50,043 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:50,044 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:50,044 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:47626': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:50,044 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:47640': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:50,156 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:50,157 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:50,157 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:47654': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:50,157 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:47662': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:50,271 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:50,271 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:50,272 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:47674': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:50,272 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:47688': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:50,384 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:50,384 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:50,385 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:47698': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:50,385 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:47710': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:50,497 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:50,497 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:50,498 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:47712': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:50,498 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:47728': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:50,610 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:50,611 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:50,611 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:47730': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:50,611 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:47734': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:50,724 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:50,724 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:50,725 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:47744': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:50,725 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:47746': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:50,837 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:50,837 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:50,838 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:47758': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:50,838 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:47772': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:50,953 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:50,953 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:50,954 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:47774': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:50,954 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:47786': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:51,067 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:51,067 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:51,067 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:47796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:51,068 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:47806': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:51,183 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:51,183 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:51,183 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:47810': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:51,184 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:47818': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:51,296 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:51,297 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:51,297 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:47820': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:51,297 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:47836': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:51,409 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:51,410 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:51,410 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:47848': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:51,410 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:47854': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:51,524 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:51,525 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:51,525 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:47866': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:51,525 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:47880': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:51,637 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:51,638 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:51,638 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:51754': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:51,638 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:51770': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:51,751 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:51,751 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:51,752 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:51776': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:51,752 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:51790': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:51,865 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:51,865 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:51,865 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:51794': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:51,866 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:51796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:51,978 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:51,978 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:51,979 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:51812': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:51,979 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:51820': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:52,092 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:52,092 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:52,093 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:51832': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:52,093 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:51836': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:52,205 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:52,205 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:52,206 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:51844': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:52,206 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:51860': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:52,318 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:52,319 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:52,319 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:51872': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:52,319 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:51886': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:52,431 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:52,432 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:52,432 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:51892': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:52,432 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:51898': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:52,546 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:52,546 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:52,546 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:51910': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:52,546 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:51916': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:52,659 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:52,659 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:52,659 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:51924': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:52,660 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:51930': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:52,772 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:52,772 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:52,773 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:51936': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:52,773 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:51950': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:52,886 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:52,886 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:52,886 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:51956': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:52,887 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:51958': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:53,000 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:53,000 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:53,000 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:51972': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:53,000 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:51988': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:53,113 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:53,113 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:53,114 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:51992': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:53,114 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:51994': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:53,226 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:53,227 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:53,227 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:51996': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:53,227 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:52004': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:53,341 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:53,341 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:53,341 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:52008': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:53,341 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:52016': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:53,455 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:53,456 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:53,456 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:52024': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:53,456 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:52034': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:53,568 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:53,569 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:53,569 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:52040': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:53,569 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:52042': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:53,681 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:53,681 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:53,682 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:52058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:53,682 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:52068': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:53,795 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:53,795 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:53,796 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:52070': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:53,796 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:52074': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:53,908 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:53,909 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:53,909 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:52082': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:53,909 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:52098': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:54,022 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:54,022 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:54,023 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:52104': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:54,023 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:52114': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:54,135 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:54,135 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:54,136 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:52122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:54,136 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:52134': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:54,249 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:54,250 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:54,250 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:52140': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:54,250 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:52156': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:54,362 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:54,363 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:54,363 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:52168': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:54,363 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:52184': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:54,476 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:54,476 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:54,477 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:52192': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:54,477 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:52204': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:54,590 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:54,590 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:54,591 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:52218': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:54,591 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:52222': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:54,706 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:54,707 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:54,707 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:52228': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:54,707 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:52242': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:54,820 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:54,821 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:54,821 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:52254': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:54,821 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:52268': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:54,933 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:54,934 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:54,934 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:52284': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:54,934 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:52288': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:55,047 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:55,047 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:55,048 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:52298': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:55,048 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:52306': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:55,160 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:55,161 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:55,161 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:52320': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:55,161 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:52322': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:55,275 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:55,275 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:55,275 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:52330': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:55,275 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:52346': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:55,388 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:55,388 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:55,389 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:52350': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:55,389 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:52356': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:55,502 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:55,502 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:55,503 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:52372': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:55,503 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:52382': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:55,615 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:55,616 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:55,616 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:52398': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:55,616 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:52414': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:55,730 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:55,730 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:55,731 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:52418': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:55,731 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:52426': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:55,844 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:55,844 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:55,845 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:52430': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:55,845 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:52446': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:55,957 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:55,957 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:55,958 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:52450': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:55,958 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:52458': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:56,071 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:56,072 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:56,072 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:52460': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:56,072 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:52468': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:56,184 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:56,185 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:56,185 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:52484': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:56,185 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:52490': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:56,297 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:56,298 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:56,298 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:52500': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:56,298 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:52516': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:56,411 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:56,411 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:56,412 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:52524': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:56,412 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:52540': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:56,526 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:56,526 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:56,527 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:52542': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:56,527 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:52550': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:56,640 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:56,640 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:56,641 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:52552': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:56,641 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:52564': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:56,754 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:56,754 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:56,755 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:52580': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:56,755 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:52582': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:56,867 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:56,867 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40805 3537s 2024-11-23 21:23:56,868 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:52592': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:56,868 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40805': TLS handshake failed with remote 'tls://127.0.0.1:52596': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:56,955 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40023. Reason: failure-to-start- 3537s 2024-11-23 21:23:56,955 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:23:56,956 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33733. Reason: failure-to-start- 3537s 2024-11-23 21:23:56,957 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:23:56,958 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 15s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 3537s stream = await stream.start_tls( 3537s ^^^^^^^^^^^^^^^^^^^^^^^ 3537s False, ssl_options=ssl_options, server_hostname=host 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 3537s self.socket.do_handshake() 3537s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 3537s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 3537s self._sslobj.do_handshake() 3537s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 3537s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 3537s raise FatalCommClosedError( 3537s ...<2 lines>... 3537s ) from err 3537s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 3537s 3537s During handling of the above exception, another exception occurred: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1218, in _register_with_scheduler 3537s await asyncio.sleep(0.1) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 718, in sleep 3537s return await future 3537s ^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 15s. 3537s 2024-11-23 21:23:57,966 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:23:57,974 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38855 3537s 2024-11-23 21:23:57,975 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41569/status 3537s 2024-11-23 21:23:57,975 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:23:57,992 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41055 3537s 2024-11-23 21:23:57,993 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41055 3537s 2024-11-23 21:23:57,993 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:23:57,993 - distributed.worker - INFO - dashboard at: 127.0.0.1:40885 3537s 2024-11-23 21:23:57,993 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:23:57,993 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:23:57,993 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:23:57,993 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:23:57,993 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-atm47tmf 3537s 2024-11-23 21:23:57,993 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:23:57,996 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37085 3537s 2024-11-23 21:23:57,996 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37085 3537s 2024-11-23 21:23:57,996 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:23:57,996 - distributed.worker - INFO - dashboard at: 127.0.0.1:35687 3537s 2024-11-23 21:23:57,996 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:23:57,996 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:23:57,996 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:23:57,996 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:23:57,996 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-7acsz_rd 3537s 2024-11-23 21:23:57,996 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:23:58,012 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:23:58,012 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:23:58,013 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:49618': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:58,013 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:49620': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:58,127 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:23:58,127 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:23:58,128 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:49628': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:58,128 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:49642': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:58,236 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:23:58,241 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:49648': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:58,242 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:23:58,243 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:49662': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:58,345 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:23:58,346 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:49678': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:58,352 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:23:58,353 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:49694': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:58,469 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:23:58,470 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:23:58,470 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:49700': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:58,470 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:49712': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:58,583 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:23:58,583 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:23:58,584 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:49722': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:58,584 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:49730': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:58,697 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:23:58,698 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:23:58,698 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:49744': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:58,698 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:49756': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:58,811 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:23:58,812 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:23:58,812 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:49764': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:58,812 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:49774': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:58,924 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:23:58,925 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:23:58,925 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:49790': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:58,925 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:49806': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:59,037 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:23:59,038 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:23:59,038 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:49818': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:59,038 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:49822': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:59,151 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:23:59,151 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:23:59,151 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:49824': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:59,152 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:49836': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:59,264 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:23:59,264 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:23:59,265 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:49840': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:59,265 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:49854': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:59,377 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:23:59,378 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:23:59,378 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:49868': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:59,378 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:49884': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:59,491 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:23:59,491 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:23:59,491 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:49890': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:59,492 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:49904': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:59,604 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:23:59,604 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:23:59,604 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:49916': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:59,605 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:49926': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:59,718 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:23:59,718 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:23:59,719 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:49936': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:59,719 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:49940': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:59,832 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:23:59,833 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:23:59,833 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:49942': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:59,833 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:49946': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:59,946 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:23:59,946 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:23:59,950 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:49962': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:23:59,950 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:49978': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:00,059 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:00,060 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:00,060 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:49990': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:00,060 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:50002': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:00,173 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:00,173 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:00,174 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:50004': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:00,174 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:50006': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:00,286 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:00,286 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:00,287 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:50010': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:00,287 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:50022': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:00,400 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:00,400 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:00,400 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:50034': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:00,400 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:50046': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:00,513 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:00,513 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:00,514 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:50052': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:00,514 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:50058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:00,626 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:00,627 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:00,627 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:50060': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:00,627 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:50072': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:00,740 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:00,740 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:00,741 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:50080': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:00,741 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:50094': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:00,853 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:00,853 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:00,854 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:50106': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:00,854 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:50120': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:00,966 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:00,966 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:00,967 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:50132': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:00,967 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:50148': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:01,080 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:01,080 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:01,081 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:50152': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:01,081 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:50168': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:01,193 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:01,193 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:01,194 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:50180': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:01,194 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:50196': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:01,308 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:01,309 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:01,309 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:50208': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:01,309 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:50224': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:01,422 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:01,422 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:01,422 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:50230': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:01,423 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:50242': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:01,535 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:01,535 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:01,536 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:50248': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:01,536 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:50250': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:01,649 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:01,649 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:01,650 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:46034': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:01,650 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:46048': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:01,763 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:01,764 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:01,764 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:46050': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:01,764 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:46058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:01,877 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:01,877 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:01,878 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:46068': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:01,878 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:46074': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:01,992 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:01,992 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:01,992 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:46084': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:01,993 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:46098': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:02,105 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:02,106 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:02,106 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:46104': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:02,106 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:46106': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:02,219 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:02,219 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:02,219 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:46112': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:02,219 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:46126': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:02,332 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:02,332 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:02,333 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:46140': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:02,333 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:46142': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:02,446 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:02,446 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:02,449 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:46158': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:02,450 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:46164': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:02,559 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:02,560 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:02,560 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:46168': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:02,560 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:46174': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:02,673 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:02,673 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:02,674 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:46184': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:02,674 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:46198': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:02,787 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:02,787 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:02,788 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:46202': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:02,788 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:46208': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:02,900 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:02,901 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:02,901 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:46216': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:02,901 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:46226': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:03,015 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:03,015 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:03,016 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:46240': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:03,016 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:46256': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:03,128 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:03,128 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:03,129 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:46268': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:03,129 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:46282': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:03,245 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:03,245 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:03,246 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:46296': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:03,246 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:46308': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:03,358 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:03,358 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:03,359 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:46322': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:03,359 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:46338': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:03,473 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:03,473 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:03,473 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:46340': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:03,473 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:46356': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:03,586 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:03,586 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:03,587 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:46366': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:03,587 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:46374': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:03,700 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:03,700 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:03,701 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:46382': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:03,701 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:46386': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:03,814 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:03,814 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:03,814 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:46396': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:03,814 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:46410': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:03,927 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:03,927 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:03,928 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:46424': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:03,928 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:46438': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:04,040 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:04,041 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:04,041 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:46450': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:04,041 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:46452': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:04,154 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:04,154 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:04,154 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:46460': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:04,154 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:46466': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:04,267 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:04,267 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:04,267 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:46478': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:04,268 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:46480': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:04,380 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:04,380 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:04,381 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:46482': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:04,381 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:46492': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:04,493 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:04,493 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:04,494 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:46508': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:04,494 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:46520': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:04,606 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:04,606 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:04,607 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:46534': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:04,607 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:46542': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:04,721 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:04,721 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:04,721 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:46550': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:04,721 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:46552': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:04,834 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:04,834 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:04,835 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:46554': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:04,835 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:46568': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:04,948 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:04,949 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:04,953 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:46570': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:04,953 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:46572': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:05,062 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:05,062 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:05,063 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:46582': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:05,063 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:46596': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:05,175 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:05,175 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:05,176 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:46600': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:05,176 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:46612': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:05,290 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:05,290 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:05,291 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:46616': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:05,291 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:46630': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:05,403 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:05,403 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:05,404 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:46638': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:05,404 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:46648': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:05,516 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:05,516 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:05,517 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:46658': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:05,517 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:46672': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:05,629 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:05,629 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:05,630 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:46684': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:05,630 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:46694': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:05,743 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:05,743 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:05,743 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:46710': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:05,744 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:46714': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:05,856 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:05,856 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:05,857 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:46724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:05,857 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:46738': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:05,969 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:05,969 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:05,970 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:46740': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:05,970 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:46744': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:06,082 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:06,082 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:06,083 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:46760': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:06,083 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:46768': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:06,195 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:06,195 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:06,196 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:46770': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:06,196 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:46782': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:06,309 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:06,309 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:06,310 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:46792': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:06,310 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:46798': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:06,422 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:06,422 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:06,423 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:46814': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:06,423 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:46818': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:06,536 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:06,536 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:06,537 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:46820': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:06,537 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:46836': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:06,650 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:06,650 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:06,651 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:46848': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:06,651 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:46862': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:06,765 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:06,765 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:06,765 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:46872': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:06,765 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:46888': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:06,879 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:06,879 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:06,880 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:46904': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:06,880 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:46910': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:06,991 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:06,992 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:06,992 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:46914': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:06,992 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:46928': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:07,106 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:07,106 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:07,107 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:46934': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:07,107 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:46944': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:07,219 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:07,220 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:07,220 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:46954': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:07,220 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:46970': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:07,333 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:07,333 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:07,334 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:46986': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:07,334 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:46988': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:07,447 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:07,447 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:07,451 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:47004': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:07,451 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:47006': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:07,561 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:07,561 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:07,561 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:47012': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:07,562 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:47022': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:07,674 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:07,674 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:07,675 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:47032': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:07,675 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:47048': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:07,787 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:07,788 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:07,788 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:47056': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:07,788 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:47072': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:07,901 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:07,901 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:07,902 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:47074': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:07,902 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:47082': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:08,014 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:08,014 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:08,015 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:47084': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:08,015 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:47100': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:08,127 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:08,128 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:08,128 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:47112': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:08,128 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:47124': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:08,240 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:08,241 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:08,241 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:47140': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:08,241 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:47156': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:08,354 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:08,354 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:08,354 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:47164': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:08,354 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:47168': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:08,466 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:08,467 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:08,467 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:47176': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:08,467 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:47182': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:08,580 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:08,580 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:08,581 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:47196': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:08,581 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:47198': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:08,693 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:08,694 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:08,694 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:47214': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:08,694 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:47230': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:08,810 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:08,811 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:08,811 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:47234': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:08,811 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:47246': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:08,925 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:08,925 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:08,926 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:47262': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:08,926 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:47270': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:09,038 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:09,039 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:09,039 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:47286': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:09,039 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:47292': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:09,152 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:09,152 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:09,153 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:47308': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:09,153 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:47318': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:09,266 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:09,267 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:09,267 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:47334': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:09,267 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:47346': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:09,380 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:09,380 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:09,380 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:47358': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:09,381 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:47372': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:09,488 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:09,492 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:47388': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:09,494 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:09,494 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:47394': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:09,596 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:09,597 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:47410': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:09,603 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:09,603 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:47424': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:09,703 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:09,704 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:47438': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:09,710 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:09,710 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:47446': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:09,811 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:09,811 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:47456': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:09,817 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:09,818 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:47466': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:09,919 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:09,919 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:47470': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:09,925 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:09,926 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:47482': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:10,027 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:10,027 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:47484': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:10,034 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:10,035 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:47500': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:10,134 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:10,135 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:47510': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:10,141 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:10,142 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:47516': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:10,245 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:10,246 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:47532': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:10,253 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:10,253 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:47534': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:10,352 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:10,353 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:47546': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:10,359 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:10,360 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:47556': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:10,460 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:10,460 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:47566': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:10,467 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:10,467 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:47574': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:10,568 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:10,568 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:47578': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:10,575 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:10,575 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:47592': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:10,676 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:10,677 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:47608': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:10,683 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:10,683 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:47610': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:10,784 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:10,784 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:47624': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:10,791 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:10,791 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:47628': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:10,892 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:10,892 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:47630': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:10,899 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38855 3537s 2024-11-23 21:24:10,899 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38855': TLS handshake failed with remote 'tls://127.0.0.1:47642': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:10,992 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41055. Reason: failure-to-start- 3537s 2024-11-23 21:24:10,992 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:24:10,995 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 13s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 3537s stream = await stream.start_tls( 3537s ^^^^^^^^^^^^^^^^^^^^^^^ 3537s False, ssl_options=ssl_options, server_hostname=host 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 3537s self.socket.do_handshake() 3537s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 3537s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 3537s self._sslobj.do_handshake() 3537s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 3537s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 3537s raise FatalCommClosedError( 3537s ...<2 lines>... 3537s ) from err 3537s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 3537s 3537s During handling of the above exception, another exception occurred: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1218, in _register_with_scheduler 3537s await asyncio.sleep(0.1) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 718, in sleep 3537s return await future 3537s ^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 13s. 3537s 2024-11-23 21:24:10,999 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37085. Reason: failure-to-start- 3537s 2024-11-23 21:24:10,999 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:24:12,002 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:24:12,010 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35607 3537s 2024-11-23 21:24:12,011 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43995/status 3537s 2024-11-23 21:24:12,011 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:24:12,028 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37647 3537s 2024-11-23 21:24:12,028 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37647 3537s 2024-11-23 21:24:12,028 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:24:12,028 - distributed.worker - INFO - dashboard at: 127.0.0.1:45393 3537s 2024-11-23 21:24:12,028 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 3537s 2024-11-23 21:24:12,028 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:24:12,028 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:24:12,028 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:24:12,028 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ow3_amb7 3537s 2024-11-23 21:24:12,028 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:24:12,030 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36805 3537s 2024-11-23 21:24:12,031 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36805 3537s 2024-11-23 21:24:12,031 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:24:12,031 - distributed.worker - INFO - dashboard at: 127.0.0.1:42909 3537s 2024-11-23 21:24:12,031 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 3537s 2024-11-23 21:24:12,031 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:24:12,031 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:24:12,031 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:24:12,031 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-fsxuza2w 3537s 2024-11-23 21:24:12,031 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:24:12,032 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37647. Reason: failure-to-start- 3537s 2024-11-23 21:24:12,033 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:24:12,033 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36805. Reason: failure-to-start- 3537s 2024-11-23 21:24:12,033 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:24:12,034 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:48602': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:24:12,035 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:48604': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:24:12,036 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:24:13,044 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:24:13,054 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45249 3537s 2024-11-23 21:24:13,054 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35357/status 3537s 2024-11-23 21:24:13,054 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:24:13,070 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38111 3537s 2024-11-23 21:24:13,071 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38111 3537s 2024-11-23 21:24:13,071 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:24:13,071 - distributed.worker - INFO - dashboard at: 127.0.0.1:34295 3537s 2024-11-23 21:24:13,071 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45249 3537s 2024-11-23 21:24:13,071 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:24:13,071 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:24:13,071 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:24:13,071 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-pt9jys_9 3537s 2024-11-23 21:24:13,071 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:24:13,073 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38673 3537s 2024-11-23 21:24:13,073 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38673 3537s 2024-11-23 21:24:13,074 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:24:13,074 - distributed.worker - INFO - dashboard at: 127.0.0.1:33669 3537s 2024-11-23 21:24:13,074 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45249 3537s 2024-11-23 21:24:13,074 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:24:13,074 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:24:13,074 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:24:13,074 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-vk64ss7z 3537s 2024-11-23 21:24:13,074 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:24:13,075 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38111. Reason: failure-to-start- 3537s 2024-11-23 21:24:13,075 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:24:13,076 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38673. Reason: failure-to-start- 3537s 2024-11-23 21:24:13,076 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:24:13,077 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45249': TLS handshake failed with remote 'tls://127.0.0.1:41796': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:24:13,078 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45249': TLS handshake failed with remote 'tls://127.0.0.1:41808': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:24:13,080 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:24:14,087 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:24:14,095 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37887 3537s 2024-11-23 21:24:14,095 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38967/status 3537s 2024-11-23 21:24:14,096 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:24:14,111 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33423 3537s 2024-11-23 21:24:14,111 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33423 3537s 2024-11-23 21:24:14,111 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:24:14,111 - distributed.worker - INFO - dashboard at: 127.0.0.1:45573 3537s 2024-11-23 21:24:14,111 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37887 3537s 2024-11-23 21:24:14,111 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:24:14,111 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:24:14,111 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:24:14,111 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-hmnexhxj 3537s 2024-11-23 21:24:14,112 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:24:14,114 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39015 3537s 2024-11-23 21:24:14,114 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39015 3537s 2024-11-23 21:24:14,114 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:24:14,114 - distributed.worker - INFO - dashboard at: 127.0.0.1:41779 3537s 2024-11-23 21:24:14,114 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37887 3537s 2024-11-23 21:24:14,114 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:24:14,114 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:24:14,114 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:24:14,114 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-xlhh8amj 3537s 2024-11-23 21:24:14,114 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:24:14,115 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33423. Reason: failure-to-start- 3537s 2024-11-23 21:24:14,116 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:24:14,116 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39015. Reason: failure-to-start- 3537s 2024-11-23 21:24:14,116 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:24:14,118 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37887': TLS handshake failed with remote 'tls://127.0.0.1:40276': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:24:14,118 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37887': TLS handshake failed with remote 'tls://127.0.0.1:40280': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:24:14,119 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:24:15,125 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:24:15,135 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43029 3537s 2024-11-23 21:24:15,136 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37313/status 3537s 2024-11-23 21:24:15,136 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:24:15,154 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36941 3537s 2024-11-23 21:24:15,154 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36941 3537s 2024-11-23 21:24:15,154 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:24:15,154 - distributed.worker - INFO - dashboard at: 127.0.0.1:36921 3537s 2024-11-23 21:24:15,154 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43029 3537s 2024-11-23 21:24:15,154 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:24:15,154 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:24:15,154 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:24:15,154 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-v38d50nf 3537s 2024-11-23 21:24:15,154 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:24:15,156 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33309 3537s 2024-11-23 21:24:15,157 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33309 3537s 2024-11-23 21:24:15,157 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:24:15,157 - distributed.worker - INFO - dashboard at: 127.0.0.1:33159 3537s 2024-11-23 21:24:15,157 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43029 3537s 2024-11-23 21:24:15,157 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:24:15,157 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:24:15,157 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:24:15,157 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-u22ia93b 3537s 2024-11-23 21:24:15,157 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:24:15,158 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36941. Reason: failure-to-start- 3537s 2024-11-23 21:24:15,159 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:24:15,159 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33309. Reason: failure-to-start- 3537s 2024-11-23 21:24:15,159 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:24:15,161 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43029': TLS handshake failed with remote 'tls://127.0.0.1:57920': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:24:15,161 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43029': TLS handshake failed with remote 'tls://127.0.0.1:57930': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:24:15,162 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:24:16,168 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:24:16,176 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42943 3537s 2024-11-23 21:24:16,176 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44899/status 3537s 2024-11-23 21:24:16,177 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:24:16,192 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38961 3537s 2024-11-23 21:24:16,192 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38961 3537s 2024-11-23 21:24:16,192 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:24:16,192 - distributed.worker - INFO - dashboard at: 127.0.0.1:38519 3537s 2024-11-23 21:24:16,192 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42943 3537s 2024-11-23 21:24:16,192 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:24:16,192 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:24:16,192 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:24:16,192 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-_qn5ku94 3537s 2024-11-23 21:24:16,192 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:24:16,195 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35987 3537s 2024-11-23 21:24:16,196 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35987 3537s 2024-11-23 21:24:16,196 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:24:16,196 - distributed.worker - INFO - dashboard at: 127.0.0.1:40927 3537s 2024-11-23 21:24:16,196 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42943 3537s 2024-11-23 21:24:16,196 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:24:16,196 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:24:16,196 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:24:16,196 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-4ftzuf07 3537s 2024-11-23 21:24:16,196 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:24:16,197 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38961. Reason: failure-to-start- 3537s 2024-11-23 21:24:16,198 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:24:16,198 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35987. Reason: failure-to-start- 3537s 2024-11-23 21:24:16,198 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:24:16,200 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42943': TLS handshake failed with remote 'tls://127.0.0.1:40086': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:24:16,200 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42943': TLS handshake failed with remote 'tls://127.0.0.1:40092': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:24:16,201 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:24:17,207 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:24:17,215 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43525 3537s 2024-11-23 21:24:17,215 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39173/status 3537s 2024-11-23 21:24:17,216 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:24:17,232 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37865 3537s 2024-11-23 21:24:17,232 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37865 3537s 2024-11-23 21:24:17,232 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:24:17,232 - distributed.worker - INFO - dashboard at: 127.0.0.1:36799 3537s 2024-11-23 21:24:17,232 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43525 3537s 2024-11-23 21:24:17,232 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:24:17,232 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:24:17,232 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:24:17,232 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-_ufoxf7e 3537s 2024-11-23 21:24:17,232 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:24:17,235 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39215 3537s 2024-11-23 21:24:17,235 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39215 3537s 2024-11-23 21:24:17,235 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:24:17,235 - distributed.worker - INFO - dashboard at: 127.0.0.1:33825 3537s 2024-11-23 21:24:17,235 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43525 3537s 2024-11-23 21:24:17,235 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:24:17,235 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:24:17,235 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:24:17,235 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-51_hg_8l 3537s 2024-11-23 21:24:17,235 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:24:17,237 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37865. Reason: failure-to-start- 3537s 2024-11-23 21:24:17,237 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:24:17,237 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39215. Reason: failure-to-start- 3537s 2024-11-23 21:24:17,238 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:24:17,239 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43525': TLS handshake failed with remote 'tls://127.0.0.1:50350': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:24:17,239 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43525': TLS handshake failed with remote 'tls://127.0.0.1:50356': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:24:17,241 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:24:18,249 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:24:18,257 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42899 3537s 2024-11-23 21:24:18,257 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35041/status 3537s 2024-11-23 21:24:18,258 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:24:18,273 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35869 3537s 2024-11-23 21:24:18,274 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35869 3537s 2024-11-23 21:24:18,274 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:24:18,274 - distributed.worker - INFO - dashboard at: 127.0.0.1:43641 3537s 2024-11-23 21:24:18,274 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42899 3537s 2024-11-23 21:24:18,274 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:24:18,274 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:24:18,274 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:24:18,274 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-b155r3pa 3537s 2024-11-23 21:24:18,274 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:24:18,276 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40043 3537s 2024-11-23 21:24:18,276 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40043 3537s 2024-11-23 21:24:18,276 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:24:18,276 - distributed.worker - INFO - dashboard at: 127.0.0.1:34653 3537s 2024-11-23 21:24:18,276 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42899 3537s 2024-11-23 21:24:18,276 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:24:18,277 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:24:18,277 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:24:18,277 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ckqupif3 3537s 2024-11-23 21:24:18,277 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:24:18,278 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35869. Reason: failure-to-start- 3537s 2024-11-23 21:24:18,278 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:24:18,278 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40043. Reason: failure-to-start- 3537s 2024-11-23 21:24:18,279 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:24:18,280 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42899': TLS handshake failed with remote 'tls://127.0.0.1:53242': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:24:18,280 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42899': TLS handshake failed with remote 'tls://127.0.0.1:53256': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:24:18,282 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:24:19,288 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:24:19,296 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34629 3537s 2024-11-23 21:24:19,296 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38259/status 3537s 2024-11-23 21:24:19,296 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:24:19,313 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41353 3537s 2024-11-23 21:24:19,313 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41353 3537s 2024-11-23 21:24:19,313 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:24:19,313 - distributed.worker - INFO - dashboard at: 127.0.0.1:38571 3537s 2024-11-23 21:24:19,313 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34629 3537s 2024-11-23 21:24:19,313 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:24:19,313 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:24:19,314 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:24:19,314 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-v502yrpl 3537s 2024-11-23 21:24:19,314 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:24:19,316 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45425 3537s 2024-11-23 21:24:19,316 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45425 3537s 2024-11-23 21:24:19,316 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:24:19,316 - distributed.worker - INFO - dashboard at: 127.0.0.1:36015 3537s 2024-11-23 21:24:19,316 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34629 3537s 2024-11-23 21:24:19,316 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:24:19,316 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:24:19,316 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:24:19,316 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-5zdtfyxf 3537s 2024-11-23 21:24:19,317 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:24:19,318 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41353. Reason: failure-to-start- 3537s 2024-11-23 21:24:19,318 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:24:19,318 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45425. Reason: failure-to-start- 3537s 2024-11-23 21:24:19,319 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:24:19,320 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34629': TLS handshake failed with remote 'tls://127.0.0.1:55212': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:24:19,320 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34629': TLS handshake failed with remote 'tls://127.0.0.1:55222': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:24:19,322 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:24:20,327 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:24:20,335 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45915 3537s 2024-11-23 21:24:20,335 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39031/status 3537s 2024-11-23 21:24:20,336 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:24:20,351 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38267 3537s 2024-11-23 21:24:20,351 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38267 3537s 2024-11-23 21:24:20,351 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:24:20,351 - distributed.worker - INFO - dashboard at: 127.0.0.1:40595 3537s 2024-11-23 21:24:20,351 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45915 3537s 2024-11-23 21:24:20,351 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:24:20,351 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:24:20,351 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:24:20,351 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-tqaab15j 3537s 2024-11-23 21:24:20,352 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:24:20,355 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43537 3537s 2024-11-23 21:24:20,355 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43537 3537s 2024-11-23 21:24:20,355 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:24:20,355 - distributed.worker - INFO - dashboard at: 127.0.0.1:35651 3537s 2024-11-23 21:24:20,355 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45915 3537s 2024-11-23 21:24:20,355 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:24:20,355 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:24:20,355 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:24:20,355 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-l9ovomw1 3537s 2024-11-23 21:24:20,355 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:24:20,357 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38267. Reason: failure-to-start- 3537s 2024-11-23 21:24:20,357 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:24:20,358 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43537. Reason: failure-to-start- 3537s 2024-11-23 21:24:20,358 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:24:20,359 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45915': TLS handshake failed with remote 'tls://127.0.0.1:34790': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:24:20,359 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45915': TLS handshake failed with remote 'tls://127.0.0.1:34802': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:24:20,361 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:24:21,367 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:24:21,375 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45411 3537s 2024-11-23 21:24:21,375 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37183/status 3537s 2024-11-23 21:24:21,375 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:24:21,391 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46431 3537s 2024-11-23 21:24:21,391 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46431 3537s 2024-11-23 21:24:21,391 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:24:21,391 - distributed.worker - INFO - dashboard at: 127.0.0.1:33809 3537s 2024-11-23 21:24:21,391 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45411 3537s 2024-11-23 21:24:21,391 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:24:21,391 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:24:21,391 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:24:21,391 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-htlx3abr 3537s 2024-11-23 21:24:21,392 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:24:21,394 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34159 3537s 2024-11-23 21:24:21,394 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34159 3537s 2024-11-23 21:24:21,394 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:24:21,394 - distributed.worker - INFO - dashboard at: 127.0.0.1:36521 3537s 2024-11-23 21:24:21,394 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45411 3537s 2024-11-23 21:24:21,394 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:24:21,394 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:24:21,394 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:24:21,394 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-tg8ra2tc 3537s 2024-11-23 21:24:21,394 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:24:21,396 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46431. Reason: failure-to-start- 3537s 2024-11-23 21:24:21,396 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:24:21,397 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34159. Reason: failure-to-start- 3537s 2024-11-23 21:24:21,397 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:24:21,398 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45411': TLS handshake failed with remote 'tls://127.0.0.1:40564': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:24:21,398 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45411': TLS handshake failed with remote 'tls://127.0.0.1:40574': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:24:21,400 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:24:22,416 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:24:22,425 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36427 3537s 2024-11-23 21:24:22,425 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41769/status 3537s 2024-11-23 21:24:22,426 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:24:22,444 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44439 3537s 2024-11-23 21:24:22,444 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44439 3537s 2024-11-23 21:24:22,444 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:24:22,444 - distributed.worker - INFO - dashboard at: 127.0.0.1:35347 3537s 2024-11-23 21:24:22,444 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36427 3537s 2024-11-23 21:24:22,444 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:24:22,444 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:24:22,444 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:24:22,444 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-q2esjq9c 3537s 2024-11-23 21:24:22,444 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:24:22,446 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34207 3537s 2024-11-23 21:24:22,447 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34207 3537s 2024-11-23 21:24:22,447 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:24:22,447 - distributed.worker - INFO - dashboard at: 127.0.0.1:37853 3537s 2024-11-23 21:24:22,447 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36427 3537s 2024-11-23 21:24:22,447 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:24:22,447 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:24:22,447 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:24:22,447 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-1ub5vkpc 3537s 2024-11-23 21:24:22,447 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:24:22,451 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44439. Reason: failure-to-start- 3537s 2024-11-23 21:24:22,451 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:24:22,452 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34207. Reason: failure-to-start- 3537s 2024-11-23 21:24:22,452 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:24:22,453 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36427': TLS handshake failed with remote 'tls://127.0.0.1:39828': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:24:22,454 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36427': TLS handshake failed with remote 'tls://127.0.0.1:39844': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:24:22,455 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:24:23,462 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:24:23,470 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46393 3537s 2024-11-23 21:24:23,471 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44121/status 3537s 2024-11-23 21:24:23,471 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:24:23,489 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44995 3537s 2024-11-23 21:24:23,490 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44995 3537s 2024-11-23 21:24:23,490 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:24:23,490 - distributed.worker - INFO - dashboard at: 127.0.0.1:35369 3537s 2024-11-23 21:24:23,490 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46393 3537s 2024-11-23 21:24:23,490 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:24:23,490 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:24:23,490 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:24:23,490 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ltj4o5k4 3537s 2024-11-23 21:24:23,490 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:24:23,492 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37021 3537s 2024-11-23 21:24:23,492 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37021 3537s 2024-11-23 21:24:23,492 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:24:23,493 - distributed.worker - INFO - dashboard at: 127.0.0.1:37631 3537s 2024-11-23 21:24:23,493 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46393 3537s 2024-11-23 21:24:23,493 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:24:23,493 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:24:23,493 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:24:23,493 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ngn_afps 3537s 2024-11-23 21:24:23,493 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:24:23,496 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44995. Reason: failure-to-start- 3537s 2024-11-23 21:24:23,497 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:24:23,497 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37021. Reason: failure-to-start- 3537s 2024-11-23 21:24:23,497 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:24:23,499 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46393': TLS handshake failed with remote 'tls://127.0.0.1:49886': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:24:23,499 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46393': TLS handshake failed with remote 'tls://127.0.0.1:49900': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:24:23,500 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:24:24,506 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:24:24,514 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37493 3537s 2024-11-23 21:24:24,515 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45505/status 3537s 2024-11-23 21:24:24,515 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:24:24,533 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42217 3537s 2024-11-23 21:24:24,533 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42217 3537s 2024-11-23 21:24:24,533 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:24:24,533 - distributed.worker - INFO - dashboard at: 127.0.0.1:44437 3537s 2024-11-23 21:24:24,533 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37493 3537s 2024-11-23 21:24:24,534 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:24:24,534 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:24:24,534 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:24:24,534 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-abptghxh 3537s 2024-11-23 21:24:24,534 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:24:24,537 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33931 3537s 2024-11-23 21:24:24,538 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33931 3537s 2024-11-23 21:24:24,538 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:24:24,538 - distributed.worker - INFO - dashboard at: 127.0.0.1:37155 3537s 2024-11-23 21:24:24,538 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37493 3537s 2024-11-23 21:24:24,538 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:24:24,538 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:24:24,538 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:24:24,538 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-vz0pp6_k 3537s 2024-11-23 21:24:24,538 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:24:24,539 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42217. Reason: failure-to-start- 3537s 2024-11-23 21:24:24,540 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:24:24,540 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33931. Reason: failure-to-start- 3537s 2024-11-23 21:24:24,540 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:24:24,542 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37493': TLS handshake failed with remote 'tls://127.0.0.1:37246': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:24:24,542 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37493': TLS handshake failed with remote 'tls://127.0.0.1:37254': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:24:24,544 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:24:25,549 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:24:25,556 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35043 3537s 2024-11-23 21:24:25,557 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40989/status 3537s 2024-11-23 21:24:25,557 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:24:25,575 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41533 3537s 2024-11-23 21:24:25,575 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41533 3537s 2024-11-23 21:24:25,575 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:24:25,576 - distributed.worker - INFO - dashboard at: 127.0.0.1:42921 3537s 2024-11-23 21:24:25,576 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35043 3537s 2024-11-23 21:24:25,576 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:24:25,576 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:24:25,576 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:24:25,576 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-mt8nolwp 3537s 2024-11-23 21:24:25,576 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:24:25,578 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46565 3537s 2024-11-23 21:24:25,578 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46565 3537s 2024-11-23 21:24:25,578 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:24:25,579 - distributed.worker - INFO - dashboard at: 127.0.0.1:37271 3537s 2024-11-23 21:24:25,579 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35043 3537s 2024-11-23 21:24:25,579 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:24:25,579 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:24:25,579 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:24:25,579 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-rmro63b9 3537s 2024-11-23 21:24:25,579 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:24:25,580 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41533. Reason: failure-to-start- 3537s 2024-11-23 21:24:25,580 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:24:25,581 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46565. Reason: failure-to-start- 3537s 2024-11-23 21:24:25,581 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:24:25,582 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35043': TLS handshake failed with remote 'tls://127.0.0.1:43614': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:24:25,583 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35043': TLS handshake failed with remote 'tls://127.0.0.1:43624': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:24:25,584 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:24:26,592 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:24:26,599 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44077 3537s 2024-11-23 21:24:26,599 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41635/status 3537s 2024-11-23 21:24:26,600 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:24:26,618 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33887 3537s 2024-11-23 21:24:26,618 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33887 3537s 2024-11-23 21:24:26,618 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:24:26,618 - distributed.worker - INFO - dashboard at: 127.0.0.1:33017 3537s 2024-11-23 21:24:26,618 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44077 3537s 2024-11-23 21:24:26,618 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:24:26,619 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:24:26,619 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:24:26,619 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-e6o5bgtj 3537s 2024-11-23 21:24:26,619 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:24:26,621 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43193 3537s 2024-11-23 21:24:26,621 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43193 3537s 2024-11-23 21:24:26,621 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:24:26,621 - distributed.worker - INFO - dashboard at: 127.0.0.1:36149 3537s 2024-11-23 21:24:26,621 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44077 3537s 2024-11-23 21:24:26,621 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:24:26,622 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:24:26,622 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:24:26,622 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-pa0jw0jd 3537s 2024-11-23 21:24:26,622 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:24:26,623 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33887. Reason: failure-to-start- 3537s 2024-11-23 21:24:26,623 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:24:26,624 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43193. Reason: failure-to-start- 3537s 2024-11-23 21:24:26,624 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:24:26,625 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44077': TLS handshake failed with remote 'tls://127.0.0.1:54596': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:24:26,625 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44077': TLS handshake failed with remote 'tls://127.0.0.1:54602': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:24:26,627 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:24:27,633 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:24:27,641 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37043 3537s 2024-11-23 21:24:27,642 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34853/status 3537s 2024-11-23 21:24:27,642 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:24:27,662 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36149 3537s 2024-11-23 21:24:27,662 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36149 3537s 2024-11-23 21:24:27,662 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:24:27,662 - distributed.worker - INFO - dashboard at: 127.0.0.1:45663 3537s 2024-11-23 21:24:27,662 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37043 3537s 2024-11-23 21:24:27,662 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:24:27,662 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:24:27,662 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:24:27,662 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-2epysv0n 3537s 2024-11-23 21:24:27,663 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:24:27,665 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38337 3537s 2024-11-23 21:24:27,665 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38337 3537s 2024-11-23 21:24:27,665 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:24:27,665 - distributed.worker - INFO - dashboard at: 127.0.0.1:34941 3537s 2024-11-23 21:24:27,665 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37043 3537s 2024-11-23 21:24:27,665 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:24:27,665 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:24:27,665 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:24:27,665 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-4nevq1sx 3537s 2024-11-23 21:24:27,665 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:24:27,666 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36149. Reason: failure-to-start- 3537s 2024-11-23 21:24:27,667 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:24:27,667 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38337. Reason: failure-to-start- 3537s 2024-11-23 21:24:27,667 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:24:27,669 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37043': TLS handshake failed with remote 'tls://127.0.0.1:44114': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:24:27,669 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37043': TLS handshake failed with remote 'tls://127.0.0.1:44122': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:24:27,670 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:24:28,676 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:24:28,684 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43085 3537s 2024-11-23 21:24:28,684 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42095/status 3537s 2024-11-23 21:24:28,685 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:24:28,704 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41011 3537s 2024-11-23 21:24:28,705 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41011 3537s 2024-11-23 21:24:28,705 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:24:28,705 - distributed.worker - INFO - dashboard at: 127.0.0.1:42547 3537s 2024-11-23 21:24:28,705 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43085 3537s 2024-11-23 21:24:28,705 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:24:28,705 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:24:28,705 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:24:28,705 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-i3__b3dc 3537s 2024-11-23 21:24:28,705 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:24:28,708 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41945 3537s 2024-11-23 21:24:28,708 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41945 3537s 2024-11-23 21:24:28,708 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:24:28,708 - distributed.worker - INFO - dashboard at: 127.0.0.1:37389 3537s 2024-11-23 21:24:28,708 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43085 3537s 2024-11-23 21:24:28,708 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:24:28,708 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:24:28,708 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:24:28,708 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-bq_tv903 3537s 2024-11-23 21:24:28,708 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:24:28,710 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41011. Reason: failure-to-start- 3537s 2024-11-23 21:24:28,710 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:24:28,710 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41945. Reason: failure-to-start- 3537s 2024-11-23 21:24:28,711 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:24:28,712 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43085': TLS handshake failed with remote 'tls://127.0.0.1:37948': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:24:28,712 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43085': TLS handshake failed with remote 'tls://127.0.0.1:37960': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:24:28,714 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:24:29,722 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:24:29,730 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43539 3537s 2024-11-23 21:24:29,730 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:32777/status 3537s 2024-11-23 21:24:29,730 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:24:29,746 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38879 3537s 2024-11-23 21:24:29,747 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38879 3537s 2024-11-23 21:24:29,747 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:24:29,747 - distributed.worker - INFO - dashboard at: 127.0.0.1:37437 3537s 2024-11-23 21:24:29,747 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43539 3537s 2024-11-23 21:24:29,747 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:24:29,747 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:24:29,747 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:24:29,747 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-07r51d45 3537s 2024-11-23 21:24:29,747 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:24:29,749 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44589 3537s 2024-11-23 21:24:29,749 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44589 3537s 2024-11-23 21:24:29,750 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:24:29,750 - distributed.worker - INFO - dashboard at: 127.0.0.1:39305 3537s 2024-11-23 21:24:29,750 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43539 3537s 2024-11-23 21:24:29,750 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:24:29,750 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:24:29,750 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:24:29,750 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-e1hyn332 3537s 2024-11-23 21:24:29,750 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:24:29,753 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38879. Reason: failure-to-start- 3537s 2024-11-23 21:24:29,753 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:24:29,753 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44589. Reason: failure-to-start- 3537s 2024-11-23 21:24:29,753 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:24:29,755 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43539': TLS handshake failed with remote 'tls://127.0.0.1:60142': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:24:29,755 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43539': TLS handshake failed with remote 'tls://127.0.0.1:60144': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:24:29,757 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:24:30,763 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:24:30,771 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39703 3537s 2024-11-23 21:24:30,771 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:32967/status 3537s 2024-11-23 21:24:30,771 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:24:30,786 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40467 3537s 2024-11-23 21:24:30,787 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40467 3537s 2024-11-23 21:24:30,787 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:24:30,787 - distributed.worker - INFO - dashboard at: 127.0.0.1:39261 3537s 2024-11-23 21:24:30,787 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39703 3537s 2024-11-23 21:24:30,787 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:24:30,787 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:24:30,787 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:24:30,787 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-n9t1dunw 3537s 2024-11-23 21:24:30,787 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:24:30,789 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44159 3537s 2024-11-23 21:24:30,789 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44159 3537s 2024-11-23 21:24:30,790 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:24:30,790 - distributed.worker - INFO - dashboard at: 127.0.0.1:45883 3537s 2024-11-23 21:24:30,790 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39703 3537s 2024-11-23 21:24:30,790 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:24:30,790 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:24:30,790 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:24:30,790 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-tu7vk478 3537s 2024-11-23 21:24:30,790 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:24:30,791 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40467. Reason: failure-to-start- 3537s 2024-11-23 21:24:30,791 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:24:30,792 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44159. Reason: failure-to-start- 3537s 2024-11-23 21:24:30,792 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:24:30,793 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39703': TLS handshake failed with remote 'tls://127.0.0.1:38564': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:24:30,793 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39703': TLS handshake failed with remote 'tls://127.0.0.1:38570': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:24:30,795 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:24:31,804 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:24:31,812 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38883 3537s 2024-11-23 21:24:31,812 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44737/status 3537s 2024-11-23 21:24:31,812 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:24:31,828 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38363 3537s 2024-11-23 21:24:31,828 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38363 3537s 2024-11-23 21:24:31,828 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:24:31,828 - distributed.worker - INFO - dashboard at: 127.0.0.1:33861 3537s 2024-11-23 21:24:31,828 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38883 3537s 2024-11-23 21:24:31,828 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:24:31,828 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:24:31,828 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:24:31,828 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-hmmuqc_2 3537s 2024-11-23 21:24:31,828 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:24:31,830 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39437 3537s 2024-11-23 21:24:31,831 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39437 3537s 2024-11-23 21:24:31,831 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:24:31,831 - distributed.worker - INFO - dashboard at: 127.0.0.1:46257 3537s 2024-11-23 21:24:31,831 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38883 3537s 2024-11-23 21:24:31,831 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:24:31,831 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:24:31,831 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:24:31,831 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-t0_7onzu 3537s 2024-11-23 21:24:31,831 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:24:31,832 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38363. Reason: failure-to-start- 3537s 2024-11-23 21:24:31,832 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:24:31,833 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39437. Reason: failure-to-start- 3537s 2024-11-23 21:24:31,833 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:24:31,834 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38883': TLS handshake failed with remote 'tls://127.0.0.1:57344': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:24:31,835 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38883': TLS handshake failed with remote 'tls://127.0.0.1:57354': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:24:31,836 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:24:32,841 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:24:32,848 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40145 3537s 2024-11-23 21:24:32,849 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38003/status 3537s 2024-11-23 21:24:32,849 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:24:32,865 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38707 3537s 2024-11-23 21:24:32,866 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38707 3537s 2024-11-23 21:24:32,866 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:24:32,866 - distributed.worker - INFO - dashboard at: 127.0.0.1:46053 3537s 2024-11-23 21:24:32,866 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40145 3537s 2024-11-23 21:24:32,866 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:24:32,866 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:24:32,866 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:24:32,866 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-aru34wc1 3537s 2024-11-23 21:24:32,866 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:24:32,868 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43453 3537s 2024-11-23 21:24:32,868 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43453 3537s 2024-11-23 21:24:32,868 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:24:32,868 - distributed.worker - INFO - dashboard at: 127.0.0.1:39481 3537s 2024-11-23 21:24:32,868 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40145 3537s 2024-11-23 21:24:32,869 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:24:32,869 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:24:32,869 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:24:32,869 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-v_ga9v5a 3537s 2024-11-23 21:24:32,869 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:24:32,870 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38707. Reason: failure-to-start- 3537s 2024-11-23 21:24:32,870 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:24:32,871 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43453. Reason: failure-to-start- 3537s 2024-11-23 21:24:32,871 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:24:32,872 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40145': TLS handshake failed with remote 'tls://127.0.0.1:34968': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:24:32,872 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40145': TLS handshake failed with remote 'tls://127.0.0.1:34970': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:24:32,874 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:24:33,881 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:24:33,889 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45251 3537s 2024-11-23 21:24:33,889 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33293/status 3537s 2024-11-23 21:24:33,889 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:24:33,905 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36955 3537s 2024-11-23 21:24:33,905 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36955 3537s 2024-11-23 21:24:33,905 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:24:33,905 - distributed.worker - INFO - dashboard at: 127.0.0.1:41069 3537s 2024-11-23 21:24:33,905 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45251 3537s 2024-11-23 21:24:33,905 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:24:33,905 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:24:33,905 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:24:33,906 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-b7f_3kgm 3537s 2024-11-23 21:24:33,906 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:24:33,909 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40909 3537s 2024-11-23 21:24:33,909 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40909 3537s 2024-11-23 21:24:33,909 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:24:33,909 - distributed.worker - INFO - dashboard at: 127.0.0.1:39353 3537s 2024-11-23 21:24:33,909 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45251 3537s 2024-11-23 21:24:33,909 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:24:33,909 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:24:33,909 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:24:33,910 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-2299hylm 3537s 2024-11-23 21:24:33,910 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:24:33,911 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36955. Reason: failure-to-start- 3537s 2024-11-23 21:24:33,911 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:24:33,911 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40909. Reason: failure-to-start- 3537s 2024-11-23 21:24:33,912 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:24:33,913 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45251': TLS handshake failed with remote 'tls://127.0.0.1:60550': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:24:33,913 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45251': TLS handshake failed with remote 'tls://127.0.0.1:60566': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:24:33,914 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:24:34,919 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:24:34,927 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46637 3537s 2024-11-23 21:24:34,927 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45065/status 3537s 2024-11-23 21:24:34,928 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:24:34,945 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38123 3537s 2024-11-23 21:24:34,945 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38123 3537s 2024-11-23 21:24:34,945 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:24:34,945 - distributed.worker - INFO - dashboard at: 127.0.0.1:41389 3537s 2024-11-23 21:24:34,946 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46637 3537s 2024-11-23 21:24:34,946 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:24:34,946 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:24:34,946 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:24:34,946 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-lr5c4v9u 3537s 2024-11-23 21:24:34,946 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:24:34,948 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35375 3537s 2024-11-23 21:24:34,948 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35375 3537s 2024-11-23 21:24:34,948 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:24:34,948 - distributed.worker - INFO - dashboard at: 127.0.0.1:34833 3537s 2024-11-23 21:24:34,948 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46637 3537s 2024-11-23 21:24:34,948 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:24:34,948 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:24:34,949 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:24:34,949 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-z2wf1jgf 3537s 2024-11-23 21:24:34,949 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:24:34,953 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38123. Reason: failure-to-start- 3537s 2024-11-23 21:24:34,954 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:24:34,954 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35375. Reason: failure-to-start- 3537s 2024-11-23 21:24:34,954 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:24:34,956 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46637': TLS handshake failed with remote 'tls://127.0.0.1:34858': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:24:34,956 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46637': TLS handshake failed with remote 'tls://127.0.0.1:34868': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:24:34,957 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:24:35,963 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:24:35,971 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36253 3537s 2024-11-23 21:24:35,971 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39169/status 3537s 2024-11-23 21:24:35,972 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:24:35,990 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44301 3537s 2024-11-23 21:24:35,991 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44301 3537s 2024-11-23 21:24:35,991 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:24:35,991 - distributed.worker - INFO - dashboard at: 127.0.0.1:39189 3537s 2024-11-23 21:24:35,991 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 3537s 2024-11-23 21:24:35,991 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:24:35,991 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:24:35,991 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:24:35,991 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-zyts5bii 3537s 2024-11-23 21:24:35,991 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:24:35,993 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37267 3537s 2024-11-23 21:24:35,994 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37267 3537s 2024-11-23 21:24:35,994 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:24:35,994 - distributed.worker - INFO - dashboard at: 127.0.0.1:45105 3537s 2024-11-23 21:24:35,994 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36253 3537s 2024-11-23 21:24:35,994 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:24:35,994 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:24:35,994 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:24:35,994 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-lplei0i0 3537s 2024-11-23 21:24:35,994 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:24:35,998 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44301. Reason: failure-to-start- 3537s 2024-11-23 21:24:35,999 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:24:35,999 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37267. Reason: failure-to-start- 3537s 2024-11-23 21:24:35,999 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:24:36,001 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:52778': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:24:36,001 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36253': TLS handshake failed with remote 'tls://127.0.0.1:52790': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:24:36,003 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:24:37,008 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:24:37,018 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44883 3537s 2024-11-23 21:24:37,019 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46833/status 3537s 2024-11-23 21:24:37,019 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:24:37,041 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34729 3537s 2024-11-23 21:24:37,041 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34729 3537s 2024-11-23 21:24:37,041 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:24:37,041 - distributed.worker - INFO - dashboard at: 127.0.0.1:46141 3537s 2024-11-23 21:24:37,041 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44883 3537s 2024-11-23 21:24:37,041 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:24:37,041 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:24:37,041 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:24:37,041 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-jwpovirn 3537s 2024-11-23 21:24:37,041 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:24:37,044 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39135 3537s 2024-11-23 21:24:37,044 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39135 3537s 2024-11-23 21:24:37,044 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:24:37,044 - distributed.worker - INFO - dashboard at: 127.0.0.1:44615 3537s 2024-11-23 21:24:37,044 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44883 3537s 2024-11-23 21:24:37,044 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:24:37,044 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:24:37,044 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:24:37,045 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-mg32mdw7 3537s 2024-11-23 21:24:37,045 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:24:37,046 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34729. Reason: failure-to-start- 3537s 2024-11-23 21:24:37,046 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:24:37,047 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39135. Reason: failure-to-start- 3537s 2024-11-23 21:24:37,047 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:24:37,048 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44883': TLS handshake failed with remote 'tls://127.0.0.1:45326': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:24:37,049 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44883': TLS handshake failed with remote 'tls://127.0.0.1:45340': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:24:37,050 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:24:38,056 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:24:38,064 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33987 3537s 2024-11-23 21:24:38,064 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33833/status 3537s 2024-11-23 21:24:38,065 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:24:38,101 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42253 3537s 2024-11-23 21:24:38,101 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42253 3537s 2024-11-23 21:24:38,101 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:24:38,101 - distributed.worker - INFO - dashboard at: 127.0.0.1:34603 3537s 2024-11-23 21:24:38,101 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33987 3537s 2024-11-23 21:24:38,101 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:24:38,101 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:24:38,102 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:24:38,102 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-c9vwlnol 3537s 2024-11-23 21:24:38,102 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:24:38,104 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42911 3537s 2024-11-23 21:24:38,104 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42911 3537s 2024-11-23 21:24:38,104 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:24:38,104 - distributed.worker - INFO - dashboard at: 127.0.0.1:39325 3537s 2024-11-23 21:24:38,104 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33987 3537s 2024-11-23 21:24:38,105 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:24:38,105 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:24:38,105 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:24:38,105 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-6y0hpfrd 3537s 2024-11-23 21:24:38,105 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:24:38,109 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42253. Reason: failure-to-start- 3537s 2024-11-23 21:24:38,109 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:24:38,109 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42911. Reason: failure-to-start- 3537s 2024-11-23 21:24:38,110 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:24:38,114 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33987': TLS handshake failed with remote 'tls://127.0.0.1:59426': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:24:38,114 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33987': TLS handshake failed with remote 'tls://127.0.0.1:59438': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:24:38,115 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:24:39,121 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:24:39,130 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46693 3537s 2024-11-23 21:24:39,131 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42033/status 3537s 2024-11-23 21:24:39,131 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:24:39,149 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40981 3537s 2024-11-23 21:24:39,150 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40981 3537s 2024-11-23 21:24:39,150 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:24:39,150 - distributed.worker - INFO - dashboard at: 127.0.0.1:40659 3537s 2024-11-23 21:24:39,150 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46693 3537s 2024-11-23 21:24:39,150 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:24:39,150 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:24:39,150 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:24:39,150 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-u227thy6 3537s 2024-11-23 21:24:39,150 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:24:39,152 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34093 3537s 2024-11-23 21:24:39,153 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34093 3537s 2024-11-23 21:24:39,153 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:24:39,153 - distributed.worker - INFO - dashboard at: 127.0.0.1:43587 3537s 2024-11-23 21:24:39,153 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46693 3537s 2024-11-23 21:24:39,153 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:24:39,153 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:24:39,153 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:24:39,153 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-hpfr3abc 3537s 2024-11-23 21:24:39,155 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:24:39,162 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40981. Reason: failure-to-start- 3537s 2024-11-23 21:24:39,162 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:24:39,163 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34093. Reason: failure-to-start- 3537s 2024-11-23 21:24:39,163 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:24:39,165 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46693': TLS handshake failed with remote 'tls://127.0.0.1:43892': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:24:39,165 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46693': TLS handshake failed with remote 'tls://127.0.0.1:43906': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:24:39,167 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:24:40,172 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:24:40,181 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44479 3537s 2024-11-23 21:24:40,182 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43789/status 3537s 2024-11-23 21:24:40,182 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:24:40,203 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44885 3537s 2024-11-23 21:24:40,203 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44885 3537s 2024-11-23 21:24:40,203 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:24:40,203 - distributed.worker - INFO - dashboard at: 127.0.0.1:42697 3537s 2024-11-23 21:24:40,203 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44479 3537s 2024-11-23 21:24:40,203 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:24:40,203 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:24:40,203 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:24:40,204 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-o2wz54xk 3537s 2024-11-23 21:24:40,204 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:24:40,206 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34251 3537s 2024-11-23 21:24:40,206 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34251 3537s 2024-11-23 21:24:40,206 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:24:40,206 - distributed.worker - INFO - dashboard at: 127.0.0.1:43673 3537s 2024-11-23 21:24:40,207 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44479 3537s 2024-11-23 21:24:40,207 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:24:40,207 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:24:40,207 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:24:40,207 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-cgpisruo 3537s 2024-11-23 21:24:40,207 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:24:40,211 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44885. Reason: failure-to-start- 3537s 2024-11-23 21:24:40,212 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:24:40,212 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34251. Reason: failure-to-start- 3537s 2024-11-23 21:24:40,212 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:24:40,214 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44479': TLS handshake failed with remote 'tls://127.0.0.1:39264': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:24:40,214 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44479': TLS handshake failed with remote 'tls://127.0.0.1:39276': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:24:40,216 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:24:41,224 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:24:41,236 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:32841 3537s 2024-11-23 21:24:41,236 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37107/status 3537s 2024-11-23 21:24:41,237 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:24:41,257 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39901 3537s 2024-11-23 21:24:41,257 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39901 3537s 2024-11-23 21:24:41,257 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:24:41,257 - distributed.worker - INFO - dashboard at: 127.0.0.1:44533 3537s 2024-11-23 21:24:41,257 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:32841 3537s 2024-11-23 21:24:41,257 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:24:41,257 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:24:41,258 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:24:41,258 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-w1r8n643 3537s 2024-11-23 21:24:41,258 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:24:41,260 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45227 3537s 2024-11-23 21:24:41,260 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45227 3537s 2024-11-23 21:24:41,260 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:24:41,260 - distributed.worker - INFO - dashboard at: 127.0.0.1:44417 3537s 2024-11-23 21:24:41,260 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:32841 3537s 2024-11-23 21:24:41,261 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:24:41,261 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:24:41,261 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:24:41,261 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-hevnt0md 3537s 2024-11-23 21:24:41,261 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:24:41,262 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39901. Reason: failure-to-start- 3537s 2024-11-23 21:24:41,263 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:24:41,263 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45227. Reason: failure-to-start- 3537s 2024-11-23 21:24:41,263 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:24:41,268 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:32841': TLS handshake failed with remote 'tls://127.0.0.1:48562': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:24:41,268 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:32841': TLS handshake failed with remote 'tls://127.0.0.1:48576': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:24:41,270 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s _____________________________ test_retire_workers ______________________________ 3537s 3537s fut = , timeout = 0 3537s 3537s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 3537s async with asyncio.timeout(timeout): 3537s > return await fut 3537s 3537s /usr/lib/python3/dist-packages/distributed/utils.py:1960: 3537s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3537s /usr/lib/python3/dist-packages/distributed/nanny.py:358: in start_unsafe 3537s comm = await self.rpc.connect(saddr) 3537s /usr/lib/python3/dist-packages/distributed/core.py:1620: in connect 3537s return await self._connect(addr=addr, timeout=timeout) 3537s /usr/lib/python3/dist-packages/distributed/core.py:1564: in _connect 3537s comm = await connect( 3537s /usr/lib/python3/dist-packages/distributed/comm/core.py:342: in connect 3537s comm = await wait_for( 3537s /usr/lib/python3/dist-packages/distributed/utils.py:1960: in wait_for 3537s return await fut 3537s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:546: in connect 3537s stream = await self.client.connect( 3537s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3537s 3537s self = , host = '127.0.0.1' 3537s port = 37681, af = 3537s ssl_options = 3537s max_buffer_size = 8364507136.0, source_ip = None, source_port = None 3537s timeout = None 3537s 3537s async def connect( 3537s self, 3537s host: str, 3537s port: int, 3537s af: socket.AddressFamily = socket.AF_UNSPEC, 3537s ssl_options: Optional[Union[Dict[str, Any], ssl.SSLContext]] = None, 3537s max_buffer_size: Optional[int] = None, 3537s source_ip: Optional[str] = None, 3537s source_port: Optional[int] = None, 3537s timeout: Optional[Union[float, datetime.timedelta]] = None, 3537s ) -> IOStream: 3537s """Connect to the given host and port. 3537s 3537s Asynchronously returns an `.IOStream` (or `.SSLIOStream` if 3537s ``ssl_options`` is not None). 3537s 3537s Using the ``source_ip`` kwarg, one can specify the source 3537s IP address to use when establishing the connection. 3537s In case the user needs to resolve and 3537s use a specific interface, it has to be handled outside 3537s of Tornado as this depends very much on the platform. 3537s 3537s Raises `TimeoutError` if the input future does not complete before 3537s ``timeout``, which may be specified in any form allowed by 3537s `.IOLoop.add_timeout` (i.e. a `datetime.timedelta` or an absolute time 3537s relative to `.IOLoop.time`) 3537s 3537s Similarly, when the user requires a certain source port, it can 3537s be specified using the ``source_port`` arg. 3537s 3537s .. versionchanged:: 4.5 3537s Added the ``source_ip`` and ``source_port`` arguments. 3537s 3537s .. versionchanged:: 5.0 3537s Added the ``timeout`` argument. 3537s """ 3537s if timeout is not None: 3537s if isinstance(timeout, numbers.Real): 3537s timeout = IOLoop.current().time() + timeout 3537s elif isinstance(timeout, datetime.timedelta): 3537s timeout = IOLoop.current().time() + timeout.total_seconds() 3537s else: 3537s raise TypeError("Unsupported timeout %r" % timeout) 3537s if timeout is not None: 3537s addrinfo = await gen.with_timeout( 3537s timeout, self.resolver.resolve(host, port, af) 3537s ) 3537s else: 3537s addrinfo = await self.resolver.resolve(host, port, af) 3537s connector = _Connector( 3537s addrinfo, 3537s functools.partial( 3537s self._create_stream, 3537s max_buffer_size, 3537s source_ip=source_ip, 3537s source_port=source_port, 3537s ), 3537s ) 3537s > af, addr, stream = await connector.start(connect_timeout=timeout) 3537s E asyncio.exceptions.CancelledError 3537s 3537s /usr/lib/python3/dist-packages/tornado/tcpclient.py:279: CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s self = 3537s 3537s @final 3537s async def start(self): 3537s async with self._startup_lock: 3537s if self.status == Status.failed: 3537s assert self.__startup_exc is not None 3537s raise self.__startup_exc 3537s elif self.status != Status.init: 3537s return self 3537s timeout = getattr(self, "death_timeout", None) 3537s 3537s async def _close_on_failure(exc: Exception) -> None: 3537s await self.close(reason=f"failure-to-start-{str(type(exc))}") 3537s self.status = Status.failed 3537s self.__startup_exc = exc 3537s 3537s try: 3537s > await wait_for(self.start_unsafe(), timeout=timeout) 3537s 3537s /usr/lib/python3/dist-packages/distributed/core.py:664: 3537s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3537s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 3537s async with asyncio.timeout(timeout): 3537s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3537s 3537s self = 3537s exc_type = 3537s exc_val = CancelledError(), exc_tb = 3537s 3537s async def __aexit__( 3537s self, 3537s exc_type: Optional[Type[BaseException]], 3537s exc_val: Optional[BaseException], 3537s exc_tb: Optional[TracebackType], 3537s ) -> Optional[bool]: 3537s assert self._state in (_State.ENTERED, _State.EXPIRING) 3537s 3537s if self._timeout_handler is not None: 3537s self._timeout_handler.cancel() 3537s self._timeout_handler = None 3537s 3537s if self._state is _State.EXPIRING: 3537s self._state = _State.EXPIRED 3537s 3537s if self._task.uncancel() <= self._cancelling and exc_type is not None: 3537s # Since there are no new cancel requests, we're 3537s # handling this. 3537s if issubclass(exc_type, exceptions.CancelledError): 3537s > raise TimeoutError from exc_val 3537s E TimeoutError 3537s 3537s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s @contextlib.asynccontextmanager 3537s async def _cluster_factory(): 3537s workers = [] 3537s s = None 3537s try: 3537s for _ in range(60): 3537s try: 3537s > s, ws = await start_cluster( 3537s nthreads, 3537s scheduler, 3537s security=security, 3537s Worker=Worker, 3537s scheduler_kwargs=scheduler_kwargs, 3537s worker_kwargs=merge( 3537s {"death_timeout": min(15, int(deadline.remaining))}, 3537s worker_kwargs, 3537s ), 3537s ) 3537s 3537s /usr/lib/python3/dist-packages/distributed/utils_test.py:966: 3537s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3537s /usr/lib/python3/dist-packages/distributed/utils_test.py:789: in start_cluster 3537s await asyncio.gather(*workers) 3537s /usr/lib/python3.13/asyncio/tasks.py:737: in _wrap_awaitable 3537s return await awaitable 3537s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3537s 3537s self = 3537s 3537s @final 3537s async def start(self): 3537s async with self._startup_lock: 3537s if self.status == Status.failed: 3537s assert self.__startup_exc is not None 3537s raise self.__startup_exc 3537s elif self.status != Status.init: 3537s return self 3537s timeout = getattr(self, "death_timeout", None) 3537s 3537s async def _close_on_failure(exc: Exception) -> None: 3537s await self.close(reason=f"failure-to-start-{str(type(exc))}") 3537s self.status = Status.failed 3537s self.__startup_exc = exc 3537s 3537s try: 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s except asyncio.TimeoutError as exc: 3537s await _close_on_failure(exc) 3537s > raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s E TimeoutError: Nanny start timed out after 0s. 3537s 3537s /usr/lib/python3/dist-packages/distributed/core.py:667: TimeoutError 3537s 3537s During handling of the above exception, another exception occurred: 3537s 3537s fut = ._..test_func..async_fn at 0xe247c4b0> 3537s timeout = 60 3537s 3537s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 3537s async with asyncio.timeout(timeout): 3537s > return await fut 3537s 3537s /usr/lib/python3/dist-packages/distributed/utils.py:1960: 3537s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3537s /usr/lib/python3/dist-packages/distributed/utils_test.py:999: in async_fn 3537s _cluster_factory() as (s, workers), 3537s /usr/lib/python3.13/contextlib.py:214: in __aenter__ 3537s return await anext(self.gen) 3537s /usr/lib/python3/dist-packages/distributed/utils_test.py:983: in _cluster_factory 3537s await asyncio.sleep(1) 3537s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3537s 3537s delay = 1, result = None 3537s 3537s async def sleep(delay, result=None): 3537s """Coroutine that completes after a given time (in seconds).""" 3537s if delay <= 0: 3537s await __sleep0() 3537s return result 3537s 3537s if math.isnan(delay): 3537s raise ValueError("Invalid delay: NaN (not a number)") 3537s 3537s loop = events.get_running_loop() 3537s future = loop.create_future() 3537s h = loop.call_later(delay, 3537s futures._set_result_unless_cancelled, 3537s future, result) 3537s try: 3537s > return await future 3537s E asyncio.exceptions.CancelledError 3537s 3537s /usr/lib/python3.13/asyncio/tasks.py:718: CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s args = (), kwds = {} 3537s 3537s @wraps(func) 3537s def inner(*args, **kwds): 3537s with self._recreate_cm(): 3537s > return func(*args, **kwds) 3537s 3537s /usr/lib/python3.13/contextlib.py:85: 3537s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3537s /usr/lib/python3.13/contextlib.py:85: in inner 3537s return func(*args, **kwds) 3537s /usr/lib/python3/dist-packages/distributed/utils_test.py:1102: in test_func 3537s return _run_and_close_tornado(async_fn_outer) 3537s /usr/lib/python3/dist-packages/distributed/utils_test.py:378: in _run_and_close_tornado 3537s return asyncio_run(inner_fn(), loop_factory=get_loop_factory()) 3537s /usr/lib/python3.13/asyncio/runners.py:194: in run 3537s return runner.run(main) 3537s /usr/lib/python3.13/asyncio/runners.py:118: in run 3537s return self._loop.run_until_complete(task) 3537s /usr/lib/python3.13/asyncio/base_events.py:720: in run_until_complete 3537s return future.result() 3537s /usr/lib/python3/dist-packages/distributed/utils_test.py:375: in inner_fn 3537s return await async_fn(*args, **kwargs) 3537s /usr/lib/python3/dist-packages/distributed/utils_test.py:1099: in async_fn_outer 3537s return await utils_wait_for(async_fn(), timeout=timeout * 2) 3537s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 3537s async with asyncio.timeout(timeout): 3537s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3537s 3537s self = 3537s exc_type = 3537s exc_val = CancelledError(), exc_tb = 3537s 3537s async def __aexit__( 3537s self, 3537s exc_type: Optional[Type[BaseException]], 3537s exc_val: Optional[BaseException], 3537s exc_tb: Optional[TracebackType], 3537s ) -> Optional[bool]: 3537s assert self._state in (_State.ENTERED, _State.EXPIRING) 3537s 3537s if self._timeout_handler is not None: 3537s self._timeout_handler.cancel() 3537s self._timeout_handler = None 3537s 3537s if self._state is _State.EXPIRING: 3537s self._state = _State.EXPIRED 3537s 3537s if self._task.uncancel() <= self._cancelling and exc_type is not None: 3537s # Since there are no new cancel requests, we're 3537s # handling this. 3537s if issubclass(exc_type, exceptions.CancelledError): 3537s > raise TimeoutError from exc_val 3537s E TimeoutError 3537s 3537s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 3537s ----------------------------- Captured stderr call ----------------------------- 3537s 2024-11-23 21:24:42,506 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:24:42,514 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46249 3537s 2024-11-23 21:24:42,515 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40015/status 3537s 2024-11-23 21:24:42,515 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:24:42,541 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:34087'. Reason: failure-to-start- 3537s 2024-11-23 21:24:42,542 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:35317'. Reason: failure-to-start- 3537s 2024-11-23 21:24:42,542 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46249': TLS handshake failed with remote 'tls://127.0.0.1:50754': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:42,542 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46249': TLS handshake failed with remote 'tls://127.0.0.1:50756': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:42,543 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 3537s stream = await stream.start_tls( 3537s ^^^^^^^^^^^^^^^^^^^^^^^ 3537s False, ssl_options=ssl_options, server_hostname=host 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 3537s self.socket.do_handshake() 3537s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 3537s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 3537s self._sslobj.do_handshake() 3537s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 3537s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3537s comm = await self.rpc.connect(saddr) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 3537s return await self._connect(addr=addr, timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 3537s comm = await connect( 3537s ^^^^^^^^^^^^^^ 3537s ...<4 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 3537s raise FatalCommClosedError( 3537s ...<2 lines>... 3537s ) from err 3537s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 3537s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 3537s RuntimeError: Nanny failed to start. 3537s 2024-11-23 21:24:43,549 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:24:43,558 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37383 3537s 2024-11-23 21:24:43,558 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45915/status 3537s 2024-11-23 21:24:43,559 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:24:43,586 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:46589'. Reason: failure-to-start- 3537s 2024-11-23 21:24:43,586 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:36901'. Reason: failure-to-start- 3537s 2024-11-23 21:24:43,586 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37383': TLS handshake failed with remote 'tls://127.0.0.1:43804': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:43,587 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37383': TLS handshake failed with remote 'tls://127.0.0.1:43808': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:43,587 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 3537s stream = await stream.start_tls( 3537s ^^^^^^^^^^^^^^^^^^^^^^^ 3537s False, ssl_options=ssl_options, server_hostname=host 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 3537s self.socket.do_handshake() 3537s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 3537s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 3537s self._sslobj.do_handshake() 3537s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 3537s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3537s comm = await self.rpc.connect(saddr) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 3537s return await self._connect(addr=addr, timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 3537s comm = await connect( 3537s ^^^^^^^^^^^^^^ 3537s ...<4 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 3537s raise FatalCommClosedError( 3537s ...<2 lines>... 3537s ) from err 3537s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 3537s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 3537s RuntimeError: Nanny failed to start. 3537s 2024-11-23 21:24:44,592 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:24:44,601 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35661 3537s 2024-11-23 21:24:44,601 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36939/status 3537s 2024-11-23 21:24:44,601 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:24:44,627 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:38473'. Reason: failure-to-start- 3537s 2024-11-23 21:24:44,628 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:42441'. Reason: failure-to-start- 3537s 2024-11-23 21:24:44,628 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35661': TLS handshake failed with remote 'tls://127.0.0.1:47188': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:44,628 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35661': TLS handshake failed with remote 'tls://127.0.0.1:47202': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:44,628 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 3537s stream = await stream.start_tls( 3537s ^^^^^^^^^^^^^^^^^^^^^^^ 3537s False, ssl_options=ssl_options, server_hostname=host 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 3537s self.socket.do_handshake() 3537s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 3537s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 3537s self._sslobj.do_handshake() 3537s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 3537s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3537s comm = await self.rpc.connect(saddr) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 3537s return await self._connect(addr=addr, timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 3537s comm = await connect( 3537s ^^^^^^^^^^^^^^ 3537s ...<4 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 3537s raise FatalCommClosedError( 3537s ...<2 lines>... 3537s ) from err 3537s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 3537s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 3537s RuntimeError: Nanny failed to start. 3537s 2024-11-23 21:24:45,634 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:24:45,642 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35285 3537s 2024-11-23 21:24:45,643 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37451/status 3537s 2024-11-23 21:24:45,643 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:24:45,670 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:35297'. Reason: failure-to-start- 3537s 2024-11-23 21:24:45,671 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:37721'. Reason: failure-to-start- 3537s 2024-11-23 21:24:45,671 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35285': TLS handshake failed with remote 'tls://127.0.0.1:35356': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:45,671 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35285': TLS handshake failed with remote 'tls://127.0.0.1:35368': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:45,671 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 3537s stream = await stream.start_tls( 3537s ^^^^^^^^^^^^^^^^^^^^^^^ 3537s False, ssl_options=ssl_options, server_hostname=host 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 3537s self.socket.do_handshake() 3537s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 3537s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 3537s self._sslobj.do_handshake() 3537s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 3537s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3537s comm = await self.rpc.connect(saddr) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 3537s return await self._connect(addr=addr, timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 3537s comm = await connect( 3537s ^^^^^^^^^^^^^^ 3537s ...<4 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 3537s raise FatalCommClosedError( 3537s ...<2 lines>... 3537s ) from err 3537s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 3537s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 3537s RuntimeError: Nanny failed to start. 3537s 2024-11-23 21:24:46,678 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:24:46,686 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37181 3537s 2024-11-23 21:24:46,687 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40471/status 3537s 2024-11-23 21:24:46,687 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:24:46,712 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:45559'. Reason: failure-to-start- 3537s 2024-11-23 21:24:46,713 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:35663'. Reason: failure-to-start- 3537s 2024-11-23 21:24:46,713 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37181': TLS handshake failed with remote 'tls://127.0.0.1:49328': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:46,713 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37181': TLS handshake failed with remote 'tls://127.0.0.1:49340': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:46,713 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 3537s stream = await stream.start_tls( 3537s ^^^^^^^^^^^^^^^^^^^^^^^ 3537s False, ssl_options=ssl_options, server_hostname=host 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 3537s self.socket.do_handshake() 3537s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 3537s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 3537s self._sslobj.do_handshake() 3537s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 3537s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3537s comm = await self.rpc.connect(saddr) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 3537s return await self._connect(addr=addr, timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 3537s comm = await connect( 3537s ^^^^^^^^^^^^^^ 3537s ...<4 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 3537s raise FatalCommClosedError( 3537s ...<2 lines>... 3537s ) from err 3537s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 3537s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 3537s RuntimeError: Nanny failed to start. 3537s 2024-11-23 21:24:47,719 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:24:47,728 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33033 3537s 2024-11-23 21:24:47,729 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44287/status 3537s 2024-11-23 21:24:47,729 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:24:47,756 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:46413'. Reason: failure-to-start- 3537s 2024-11-23 21:24:47,757 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:40861'. Reason: failure-to-start- 3537s 2024-11-23 21:24:47,757 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33033': TLS handshake failed with remote 'tls://127.0.0.1:58272': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:47,757 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33033': TLS handshake failed with remote 'tls://127.0.0.1:58278': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:47,757 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 3537s stream = await stream.start_tls( 3537s ^^^^^^^^^^^^^^^^^^^^^^^ 3537s False, ssl_options=ssl_options, server_hostname=host 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 3537s self.socket.do_handshake() 3537s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 3537s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 3537s self._sslobj.do_handshake() 3537s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 3537s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3537s comm = await self.rpc.connect(saddr) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 3537s return await self._connect(addr=addr, timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 3537s comm = await connect( 3537s ^^^^^^^^^^^^^^ 3537s ...<4 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 3537s raise FatalCommClosedError( 3537s ...<2 lines>... 3537s ) from err 3537s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 3537s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 3537s RuntimeError: Nanny failed to start. 3537s 2024-11-23 21:24:48,764 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:24:48,776 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45149 3537s 2024-11-23 21:24:48,777 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35935/status 3537s 2024-11-23 21:24:48,777 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:24:48,804 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:41829'. Reason: failure-to-start- 3537s 2024-11-23 21:24:48,805 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:38321'. Reason: failure-to-start- 3537s 2024-11-23 21:24:48,805 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45149': TLS handshake failed with remote 'tls://127.0.0.1:60636': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:48,805 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45149': TLS handshake failed with remote 'tls://127.0.0.1:60638': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:48,805 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 3537s stream = await stream.start_tls( 3537s ^^^^^^^^^^^^^^^^^^^^^^^ 3537s False, ssl_options=ssl_options, server_hostname=host 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 3537s self.socket.do_handshake() 3537s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 3537s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 3537s self._sslobj.do_handshake() 3537s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 3537s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3537s comm = await self.rpc.connect(saddr) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 3537s return await self._connect(addr=addr, timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 3537s comm = await connect( 3537s ^^^^^^^^^^^^^^ 3537s ...<4 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 3537s raise FatalCommClosedError( 3537s ...<2 lines>... 3537s ) from err 3537s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 3537s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 3537s RuntimeError: Nanny failed to start. 3537s 2024-11-23 21:24:49,811 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:24:49,819 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34939 3537s 2024-11-23 21:24:49,819 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38729/status 3537s 2024-11-23 21:24:49,820 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:24:49,845 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:44797'. Reason: failure-to-start- 3537s 2024-11-23 21:24:49,846 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:38379'. Reason: failure-to-start- 3537s 2024-11-23 21:24:49,847 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34939': TLS handshake failed with remote 'tls://127.0.0.1:47628': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:49,847 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34939': TLS handshake failed with remote 'tls://127.0.0.1:47630': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:49,847 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 3537s stream = await stream.start_tls( 3537s ^^^^^^^^^^^^^^^^^^^^^^^ 3537s False, ssl_options=ssl_options, server_hostname=host 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 3537s self.socket.do_handshake() 3537s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 3537s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 3537s self._sslobj.do_handshake() 3537s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 3537s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3537s comm = await self.rpc.connect(saddr) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 3537s return await self._connect(addr=addr, timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 3537s comm = await connect( 3537s ^^^^^^^^^^^^^^ 3537s ...<4 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 3537s raise FatalCommClosedError( 3537s ...<2 lines>... 3537s ) from err 3537s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 3537s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 3537s RuntimeError: Nanny failed to start. 3537s 2024-11-23 21:24:50,852 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:24:50,861 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35073 3537s 2024-11-23 21:24:50,862 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38055/status 3537s 2024-11-23 21:24:50,862 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:24:50,888 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:33859'. Reason: failure-to-start- 3537s 2024-11-23 21:24:50,888 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:45545'. Reason: failure-to-start- 3537s 2024-11-23 21:24:50,889 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35073': TLS handshake failed with remote 'tls://127.0.0.1:33280': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:50,889 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35073': TLS handshake failed with remote 'tls://127.0.0.1:33294': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:50,889 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 3537s stream = await stream.start_tls( 3537s ^^^^^^^^^^^^^^^^^^^^^^^ 3537s False, ssl_options=ssl_options, server_hostname=host 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 3537s self.socket.do_handshake() 3537s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 3537s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 3537s self._sslobj.do_handshake() 3537s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 3537s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3537s comm = await self.rpc.connect(saddr) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 3537s return await self._connect(addr=addr, timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 3537s comm = await connect( 3537s ^^^^^^^^^^^^^^ 3537s ...<4 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 3537s raise FatalCommClosedError( 3537s ...<2 lines>... 3537s ) from err 3537s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 3537s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 3537s RuntimeError: Nanny failed to start. 3537s 2024-11-23 21:24:51,895 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:24:51,904 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35805 3537s 2024-11-23 21:24:51,904 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40361/status 3537s 2024-11-23 21:24:51,904 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:24:51,932 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:39605'. Reason: failure-to-start- 3537s 2024-11-23 21:24:51,933 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:43507'. Reason: failure-to-start- 3537s 2024-11-23 21:24:51,933 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35805': TLS handshake failed with remote 'tls://127.0.0.1:56370': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:51,934 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35805': TLS handshake failed with remote 'tls://127.0.0.1:56374': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:51,934 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 3537s stream = await stream.start_tls( 3537s ^^^^^^^^^^^^^^^^^^^^^^^ 3537s False, ssl_options=ssl_options, server_hostname=host 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 3537s self.socket.do_handshake() 3537s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 3537s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 3537s self._sslobj.do_handshake() 3537s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 3537s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3537s comm = await self.rpc.connect(saddr) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 3537s return await self._connect(addr=addr, timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 3537s comm = await connect( 3537s ^^^^^^^^^^^^^^ 3537s ...<4 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 3537s raise FatalCommClosedError( 3537s ...<2 lines>... 3537s ) from err 3537s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 3537s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 3537s RuntimeError: Nanny failed to start. 3537s 2024-11-23 21:24:52,939 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:24:52,947 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40161 3537s 2024-11-23 21:24:52,948 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46085/status 3537s 2024-11-23 21:24:52,948 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:24:52,974 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:45163'. Reason: failure-to-start- 3537s 2024-11-23 21:24:52,974 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:36265'. Reason: failure-to-start- 3537s 2024-11-23 21:24:52,975 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40161': TLS handshake failed with remote 'tls://127.0.0.1:60606': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:52,975 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40161': TLS handshake failed with remote 'tls://127.0.0.1:60616': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:52,975 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 3537s stream = await stream.start_tls( 3537s ^^^^^^^^^^^^^^^^^^^^^^^ 3537s False, ssl_options=ssl_options, server_hostname=host 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 3537s self.socket.do_handshake() 3537s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 3537s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 3537s self._sslobj.do_handshake() 3537s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 3537s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3537s comm = await self.rpc.connect(saddr) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 3537s return await self._connect(addr=addr, timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 3537s comm = await connect( 3537s ^^^^^^^^^^^^^^ 3537s ...<4 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 3537s raise FatalCommClosedError( 3537s ...<2 lines>... 3537s ) from err 3537s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 3537s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 3537s RuntimeError: Nanny failed to start. 3537s 2024-11-23 21:24:53,981 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:24:53,989 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46111 3537s 2024-11-23 21:24:53,989 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36995/status 3537s 2024-11-23 21:24:53,990 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:24:54,016 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:45083'. Reason: failure-to-start- 3537s 2024-11-23 21:24:54,017 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:37989'. Reason: failure-to-start- 3537s 2024-11-23 21:24:54,017 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46111': TLS handshake failed with remote 'tls://127.0.0.1:57556': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:54,018 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46111': TLS handshake failed with remote 'tls://127.0.0.1:57558': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:54,020 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 3537s stream = await stream.start_tls( 3537s ^^^^^^^^^^^^^^^^^^^^^^^ 3537s False, ssl_options=ssl_options, server_hostname=host 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 3537s self.socket.do_handshake() 3537s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 3537s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 3537s self._sslobj.do_handshake() 3537s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 3537s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3537s comm = await self.rpc.connect(saddr) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 3537s return await self._connect(addr=addr, timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 3537s comm = await connect( 3537s ^^^^^^^^^^^^^^ 3537s ...<4 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 3537s raise FatalCommClosedError( 3537s ...<2 lines>... 3537s ) from err 3537s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 3537s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 3537s RuntimeError: Nanny failed to start. 3537s 2024-11-23 21:24:55,026 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:24:55,034 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36809 3537s 2024-11-23 21:24:55,034 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39875/status 3537s 2024-11-23 21:24:55,035 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:24:55,061 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:35639'. Reason: failure-to-start- 3537s 2024-11-23 21:24:55,061 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:42391'. Reason: failure-to-start- 3537s 2024-11-23 21:24:55,064 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36809': TLS handshake failed with remote 'tls://127.0.0.1:40118': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:55,064 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36809': TLS handshake failed with remote 'tls://127.0.0.1:40132': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:55,064 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 3537s stream = await stream.start_tls( 3537s ^^^^^^^^^^^^^^^^^^^^^^^ 3537s False, ssl_options=ssl_options, server_hostname=host 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 3537s self.socket.do_handshake() 3537s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 3537s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 3537s self._sslobj.do_handshake() 3537s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 3537s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3537s comm = await self.rpc.connect(saddr) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 3537s return await self._connect(addr=addr, timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 3537s comm = await connect( 3537s ^^^^^^^^^^^^^^ 3537s ...<4 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 3537s raise FatalCommClosedError( 3537s ...<2 lines>... 3537s ) from err 3537s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 3537s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 3537s RuntimeError: Nanny failed to start. 3537s 2024-11-23 21:24:56,071 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:24:56,079 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38301 3537s 2024-11-23 21:24:56,079 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44235/status 3537s 2024-11-23 21:24:56,080 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:24:56,108 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:44057'. Reason: failure-to-start- 3537s 2024-11-23 21:24:56,108 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:36233'. Reason: failure-to-start- 3537s 2024-11-23 21:24:56,111 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38301': TLS handshake failed with remote 'tls://127.0.0.1:58990': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:56,112 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38301': TLS handshake failed with remote 'tls://127.0.0.1:58992': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:56,112 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 3537s stream = await stream.start_tls( 3537s ^^^^^^^^^^^^^^^^^^^^^^^ 3537s False, ssl_options=ssl_options, server_hostname=host 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 3537s self.socket.do_handshake() 3537s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 3537s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 3537s self._sslobj.do_handshake() 3537s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 3537s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3537s comm = await self.rpc.connect(saddr) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 3537s return await self._connect(addr=addr, timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 3537s comm = await connect( 3537s ^^^^^^^^^^^^^^ 3537s ...<4 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 3537s raise FatalCommClosedError( 3537s ...<2 lines>... 3537s ) from err 3537s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 3537s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 3537s RuntimeError: Nanny failed to start. 3537s 2024-11-23 21:24:57,118 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:24:57,126 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46651 3537s 2024-11-23 21:24:57,127 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36773/status 3537s 2024-11-23 21:24:57,127 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:24:57,153 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:40059'. Reason: failure-to-start- 3537s 2024-11-23 21:24:57,153 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:32991'. Reason: failure-to-start- 3537s 2024-11-23 21:24:57,156 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46651': TLS handshake failed with remote 'tls://127.0.0.1:43336': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:57,157 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46651': TLS handshake failed with remote 'tls://127.0.0.1:43348': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:57,157 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 3537s stream = await stream.start_tls( 3537s ^^^^^^^^^^^^^^^^^^^^^^^ 3537s False, ssl_options=ssl_options, server_hostname=host 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 3537s self.socket.do_handshake() 3537s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 3537s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 3537s self._sslobj.do_handshake() 3537s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 3537s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3537s comm = await self.rpc.connect(saddr) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 3537s return await self._connect(addr=addr, timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 3537s comm = await connect( 3537s ^^^^^^^^^^^^^^ 3537s ...<4 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 3537s raise FatalCommClosedError( 3537s ...<2 lines>... 3537s ) from err 3537s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 3537s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 3537s RuntimeError: Nanny failed to start. 3537s 2024-11-23 21:24:58,163 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:24:58,171 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45523 3537s 2024-11-23 21:24:58,171 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38037/status 3537s 2024-11-23 21:24:58,172 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:24:58,197 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:37283'. Reason: failure-to-start- 3537s 2024-11-23 21:24:58,198 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:37803'. Reason: failure-to-start- 3537s 2024-11-23 21:24:58,201 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45523': TLS handshake failed with remote 'tls://127.0.0.1:55728': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:58,201 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45523': TLS handshake failed with remote 'tls://127.0.0.1:55744': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:58,201 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 3537s stream = await stream.start_tls( 3537s ^^^^^^^^^^^^^^^^^^^^^^^ 3537s False, ssl_options=ssl_options, server_hostname=host 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 3537s self.socket.do_handshake() 3537s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 3537s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 3537s self._sslobj.do_handshake() 3537s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 3537s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3537s comm = await self.rpc.connect(saddr) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 3537s return await self._connect(addr=addr, timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 3537s comm = await connect( 3537s ^^^^^^^^^^^^^^ 3537s ...<4 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 3537s raise FatalCommClosedError( 3537s ...<2 lines>... 3537s ) from err 3537s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 3537s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 3537s RuntimeError: Nanny failed to start. 3537s 2024-11-23 21:24:59,207 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:24:59,216 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46637 3537s 2024-11-23 21:24:59,217 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45727/status 3537s 2024-11-23 21:24:59,217 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:24:59,245 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:38731'. Reason: failure-to-start- 3537s 2024-11-23 21:24:59,246 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:34191'. Reason: failure-to-start- 3537s 2024-11-23 21:24:59,247 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46637': TLS handshake failed with remote 'tls://127.0.0.1:46738': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:59,247 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46637': TLS handshake failed with remote 'tls://127.0.0.1:46754': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:24:59,247 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 3537s stream = await stream.start_tls( 3537s ^^^^^^^^^^^^^^^^^^^^^^^ 3537s False, ssl_options=ssl_options, server_hostname=host 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 3537s self.socket.do_handshake() 3537s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 3537s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 3537s self._sslobj.do_handshake() 3537s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 3537s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3537s comm = await self.rpc.connect(saddr) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 3537s return await self._connect(addr=addr, timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 3537s comm = await connect( 3537s ^^^^^^^^^^^^^^ 3537s ...<4 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 3537s raise FatalCommClosedError( 3537s ...<2 lines>... 3537s ) from err 3537s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 3537s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 3537s RuntimeError: Nanny failed to start. 3537s 2024-11-23 21:25:00,252 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:25:00,260 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43111 3537s 2024-11-23 21:25:00,261 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39035/status 3537s 2024-11-23 21:25:00,261 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:25:00,288 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:39545'. Reason: failure-to-start- 3537s 2024-11-23 21:25:00,288 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:40839'. Reason: failure-to-start- 3537s 2024-11-23 21:25:00,291 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43111': TLS handshake failed with remote 'tls://127.0.0.1:35764': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:00,291 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43111': TLS handshake failed with remote 'tls://127.0.0.1:35774': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:00,291 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 3537s stream = await stream.start_tls( 3537s ^^^^^^^^^^^^^^^^^^^^^^^ 3537s False, ssl_options=ssl_options, server_hostname=host 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 3537s self.socket.do_handshake() 3537s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 3537s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 3537s self._sslobj.do_handshake() 3537s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 3537s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3537s comm = await self.rpc.connect(saddr) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 3537s return await self._connect(addr=addr, timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 3537s comm = await connect( 3537s ^^^^^^^^^^^^^^ 3537s ...<4 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 3537s raise FatalCommClosedError( 3537s ...<2 lines>... 3537s ) from err 3537s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 3537s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 3537s RuntimeError: Nanny failed to start. 3537s 2024-11-23 21:25:01,297 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:25:01,305 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34137 3537s 2024-11-23 21:25:01,305 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44469/status 3537s 2024-11-23 21:25:01,306 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:25:01,334 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:33203'. Reason: failure-to-start- 3537s 2024-11-23 21:25:01,334 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:44773'. Reason: failure-to-start- 3537s 2024-11-23 21:25:01,335 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34137': TLS handshake failed with remote 'tls://127.0.0.1:59240': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:01,335 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34137': TLS handshake failed with remote 'tls://127.0.0.1:59242': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:01,335 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 3537s stream = await stream.start_tls( 3537s ^^^^^^^^^^^^^^^^^^^^^^^ 3537s False, ssl_options=ssl_options, server_hostname=host 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 3537s self.socket.do_handshake() 3537s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 3537s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 3537s self._sslobj.do_handshake() 3537s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 3537s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3537s comm = await self.rpc.connect(saddr) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 3537s return await self._connect(addr=addr, timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 3537s comm = await connect( 3537s ^^^^^^^^^^^^^^ 3537s ...<4 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 3537s raise FatalCommClosedError( 3537s ...<2 lines>... 3537s ) from err 3537s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 3537s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 3537s RuntimeError: Nanny failed to start. 3537s 2024-11-23 21:25:02,342 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:25:02,350 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35499 3537s 2024-11-23 21:25:02,351 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34059/status 3537s 2024-11-23 21:25:02,351 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:25:02,381 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:39317'. Reason: failure-to-start- 3537s 2024-11-23 21:25:02,382 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:36735'. Reason: failure-to-start- 3537s 2024-11-23 21:25:02,383 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35499': TLS handshake failed with remote 'tls://127.0.0.1:42124': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:02,383 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35499': TLS handshake failed with remote 'tls://127.0.0.1:42132': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:02,383 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 3537s stream = await stream.start_tls( 3537s ^^^^^^^^^^^^^^^^^^^^^^^ 3537s False, ssl_options=ssl_options, server_hostname=host 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 3537s self.socket.do_handshake() 3537s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 3537s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 3537s self._sslobj.do_handshake() 3537s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 3537s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3537s comm = await self.rpc.connect(saddr) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 3537s return await self._connect(addr=addr, timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 3537s comm = await connect( 3537s ^^^^^^^^^^^^^^ 3537s ...<4 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 3537s raise FatalCommClosedError( 3537s ...<2 lines>... 3537s ) from err 3537s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 3537s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 3537s RuntimeError: Nanny failed to start. 3537s 2024-11-23 21:25:03,388 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:25:03,396 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34437 3537s 2024-11-23 21:25:03,397 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34505/status 3537s 2024-11-23 21:25:03,397 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:25:03,424 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:45139'. Reason: failure-to-start- 3537s 2024-11-23 21:25:03,424 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:34993'. Reason: failure-to-start- 3537s 2024-11-23 21:25:03,425 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34437': TLS handshake failed with remote 'tls://127.0.0.1:34464': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:03,425 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34437': TLS handshake failed with remote 'tls://127.0.0.1:34476': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:03,425 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 3537s stream = await stream.start_tls( 3537s ^^^^^^^^^^^^^^^^^^^^^^^ 3537s False, ssl_options=ssl_options, server_hostname=host 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 3537s self.socket.do_handshake() 3537s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 3537s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 3537s self._sslobj.do_handshake() 3537s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 3537s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3537s comm = await self.rpc.connect(saddr) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 3537s return await self._connect(addr=addr, timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 3537s comm = await connect( 3537s ^^^^^^^^^^^^^^ 3537s ...<4 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 3537s raise FatalCommClosedError( 3537s ...<2 lines>... 3537s ) from err 3537s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 3537s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 3537s RuntimeError: Nanny failed to start. 3537s 2024-11-23 21:25:04,431 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:25:04,441 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45243 3537s 2024-11-23 21:25:04,441 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41283/status 3537s 2024-11-23 21:25:04,441 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:25:04,469 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:40479'. Reason: failure-to-start- 3537s 2024-11-23 21:25:04,469 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:40571'. Reason: failure-to-start- 3537s 2024-11-23 21:25:04,470 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45243': TLS handshake failed with remote 'tls://127.0.0.1:54562': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:04,470 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45243': TLS handshake failed with remote 'tls://127.0.0.1:54564': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:04,470 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 3537s stream = await stream.start_tls( 3537s ^^^^^^^^^^^^^^^^^^^^^^^ 3537s False, ssl_options=ssl_options, server_hostname=host 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 3537s self.socket.do_handshake() 3537s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 3537s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 3537s self._sslobj.do_handshake() 3537s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 3537s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3537s comm = await self.rpc.connect(saddr) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 3537s return await self._connect(addr=addr, timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 3537s comm = await connect( 3537s ^^^^^^^^^^^^^^ 3537s ...<4 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 3537s raise FatalCommClosedError( 3537s ...<2 lines>... 3537s ) from err 3537s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 3537s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 3537s RuntimeError: Nanny failed to start. 3537s 2024-11-23 21:25:05,477 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:25:05,485 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43535 3537s 2024-11-23 21:25:05,486 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42529/status 3537s 2024-11-23 21:25:05,486 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:25:05,514 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:46335'. Reason: failure-to-start- 3537s 2024-11-23 21:25:05,515 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:39889'. Reason: failure-to-start- 3537s 2024-11-23 21:25:05,515 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43535': TLS handshake failed with remote 'tls://127.0.0.1:55504': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:05,515 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43535': TLS handshake failed with remote 'tls://127.0.0.1:55520': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:05,515 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 3537s stream = await stream.start_tls( 3537s ^^^^^^^^^^^^^^^^^^^^^^^ 3537s False, ssl_options=ssl_options, server_hostname=host 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 3537s self.socket.do_handshake() 3537s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 3537s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 3537s self._sslobj.do_handshake() 3537s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 3537s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3537s comm = await self.rpc.connect(saddr) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 3537s return await self._connect(addr=addr, timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 3537s comm = await connect( 3537s ^^^^^^^^^^^^^^ 3537s ...<4 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 3537s raise FatalCommClosedError( 3537s ...<2 lines>... 3537s ) from err 3537s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 3537s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 3537s RuntimeError: Nanny failed to start. 3537s 2024-11-23 21:25:06,522 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:25:06,546 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36473 3537s 2024-11-23 21:25:06,547 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41439/status 3537s 2024-11-23 21:25:06,547 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:25:06,580 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:37617'. Reason: failure-to-start- 3537s 2024-11-23 21:25:06,580 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:46879'. Reason: failure-to-start- 3537s 2024-11-23 21:25:06,581 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36473': TLS handshake failed with remote 'tls://127.0.0.1:58054': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:06,581 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36473': TLS handshake failed with remote 'tls://127.0.0.1:58060': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:06,582 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 3537s stream = await stream.start_tls( 3537s ^^^^^^^^^^^^^^^^^^^^^^^ 3537s False, ssl_options=ssl_options, server_hostname=host 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 3537s self.socket.do_handshake() 3537s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 3537s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 3537s self._sslobj.do_handshake() 3537s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 3537s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3537s comm = await self.rpc.connect(saddr) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 3537s return await self._connect(addr=addr, timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 3537s comm = await connect( 3537s ^^^^^^^^^^^^^^ 3537s ...<4 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 3537s raise FatalCommClosedError( 3537s ...<2 lines>... 3537s ) from err 3537s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 3537s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 3537s RuntimeError: Nanny failed to start. 3537s 2024-11-23 21:25:07,588 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:25:07,596 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39033 3537s 2024-11-23 21:25:07,597 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40145/status 3537s 2024-11-23 21:25:07,597 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:25:07,627 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:34221'. Reason: failure-to-start- 3537s 2024-11-23 21:25:07,628 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:45311'. Reason: failure-to-start- 3537s 2024-11-23 21:25:07,628 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39033': TLS handshake failed with remote 'tls://127.0.0.1:55298': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:07,628 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39033': TLS handshake failed with remote 'tls://127.0.0.1:55310': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:07,629 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 3537s stream = await stream.start_tls( 3537s ^^^^^^^^^^^^^^^^^^^^^^^ 3537s False, ssl_options=ssl_options, server_hostname=host 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 3537s self.socket.do_handshake() 3537s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 3537s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 3537s self._sslobj.do_handshake() 3537s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 3537s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3537s comm = await self.rpc.connect(saddr) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 3537s return await self._connect(addr=addr, timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 3537s comm = await connect( 3537s ^^^^^^^^^^^^^^ 3537s ...<4 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 3537s raise FatalCommClosedError( 3537s ...<2 lines>... 3537s ) from err 3537s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 3537s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 3537s RuntimeError: Nanny failed to start. 3537s 2024-11-23 21:25:08,634 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:25:08,645 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42297 3537s 2024-11-23 21:25:08,645 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42067/status 3537s 2024-11-23 21:25:08,646 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:25:08,676 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:46517'. Reason: failure-to-start- 3537s 2024-11-23 21:25:08,676 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:34171'. Reason: failure-to-start- 3537s 2024-11-23 21:25:08,680 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42297': TLS handshake failed with remote 'tls://127.0.0.1:34420': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:08,680 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42297': TLS handshake failed with remote 'tls://127.0.0.1:34432': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:08,680 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 3537s stream = await stream.start_tls( 3537s ^^^^^^^^^^^^^^^^^^^^^^^ 3537s False, ssl_options=ssl_options, server_hostname=host 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 3537s self.socket.do_handshake() 3537s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 3537s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 3537s self._sslobj.do_handshake() 3537s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 3537s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3537s comm = await self.rpc.connect(saddr) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 3537s return await self._connect(addr=addr, timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 3537s comm = await connect( 3537s ^^^^^^^^^^^^^^ 3537s ...<4 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 3537s raise FatalCommClosedError( 3537s ...<2 lines>... 3537s ) from err 3537s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 3537s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 3537s RuntimeError: Nanny failed to start. 3537s 2024-11-23 21:25:09,686 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:25:09,695 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38423 3537s 2024-11-23 21:25:09,695 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46433/status 3537s 2024-11-23 21:25:09,696 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:25:09,726 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:34141'. Reason: failure-to-start- 3537s 2024-11-23 21:25:09,726 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:43363'. Reason: failure-to-start- 3537s 2024-11-23 21:25:09,729 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38423': TLS handshake failed with remote 'tls://127.0.0.1:54884': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:09,729 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38423': TLS handshake failed with remote 'tls://127.0.0.1:54886': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:09,730 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 3537s stream = await stream.start_tls( 3537s ^^^^^^^^^^^^^^^^^^^^^^^ 3537s False, ssl_options=ssl_options, server_hostname=host 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 3537s self.socket.do_handshake() 3537s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 3537s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 3537s self._sslobj.do_handshake() 3537s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 3537s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3537s comm = await self.rpc.connect(saddr) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 3537s return await self._connect(addr=addr, timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 3537s comm = await connect( 3537s ^^^^^^^^^^^^^^ 3537s ...<4 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 3537s raise FatalCommClosedError( 3537s ...<2 lines>... 3537s ) from err 3537s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 3537s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 3537s RuntimeError: Nanny failed to start. 3537s 2024-11-23 21:25:10,736 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:25:10,749 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41149 3537s 2024-11-23 21:25:10,749 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38941/status 3537s 2024-11-23 21:25:10,750 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:25:10,782 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:38125'. Reason: failure-to-start- 3537s 2024-11-23 21:25:10,782 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:43273'. Reason: failure-to-start- 3537s 2024-11-23 21:25:10,786 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41149': TLS handshake failed with remote 'tls://127.0.0.1:58316': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:10,786 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41149': TLS handshake failed with remote 'tls://127.0.0.1:58326': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:10,786 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 3537s stream = await stream.start_tls( 3537s ^^^^^^^^^^^^^^^^^^^^^^^ 3537s False, ssl_options=ssl_options, server_hostname=host 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 3537s self.socket.do_handshake() 3537s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 3537s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 3537s self._sslobj.do_handshake() 3537s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 3537s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3537s comm = await self.rpc.connect(saddr) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 3537s return await self._connect(addr=addr, timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 3537s comm = await connect( 3537s ^^^^^^^^^^^^^^ 3537s ...<4 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 3537s raise FatalCommClosedError( 3537s ...<2 lines>... 3537s ) from err 3537s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 3537s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 3537s RuntimeError: Nanny failed to start. 3537s 2024-11-23 21:25:11,793 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:25:11,801 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42293 3537s 2024-11-23 21:25:11,802 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42253/status 3537s 2024-11-23 21:25:11,802 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:25:11,820 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:44215'. Reason: failure-to-start- 3537s 2024-11-23 21:25:11,820 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:43833'. Reason: failure-to-start- 3537s 2024-11-23 21:25:11,821 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42293': TLS handshake failed with remote 'tls://127.0.0.1:33146': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:25:11,821 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42293': TLS handshake failed with remote 'tls://127.0.0.1:33152': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:25:11,821 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3537s comm = await self.rpc.connect(saddr) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 3537s return await self._connect(addr=addr, timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 3537s comm = await connect( 3537s ^^^^^^^^^^^^^^ 3537s ...<4 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Nanny start timed out after 0s. 3537s 2024-11-23 21:25:12,828 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:25:12,838 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41923 3537s 2024-11-23 21:25:12,839 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36721/status 3537s 2024-11-23 21:25:12,839 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:25:12,862 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:40343'. Reason: failure-to-start- 3537s 2024-11-23 21:25:12,862 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:41681'. Reason: failure-to-start- 3537s 2024-11-23 21:25:12,863 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41923': TLS handshake failed with remote 'tls://127.0.0.1:33316': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:25:12,864 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41923': TLS handshake failed with remote 'tls://127.0.0.1:33330': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:25:12,864 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3537s comm = await self.rpc.connect(saddr) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 3537s return await self._connect(addr=addr, timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 3537s comm = await connect( 3537s ^^^^^^^^^^^^^^ 3537s ...<4 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Nanny start timed out after 0s. 3537s 2024-11-23 21:25:13,870 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:25:13,879 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41179 3537s 2024-11-23 21:25:13,880 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44039/status 3537s 2024-11-23 21:25:13,880 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:25:13,896 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:39385'. Reason: failure-to-start- 3537s 2024-11-23 21:25:13,896 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:34565'. Reason: failure-to-start- 3537s 2024-11-23 21:25:13,897 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:57894': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:25:13,897 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:57910': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:25:13,898 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3537s comm = await self.rpc.connect(saddr) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 3537s return await self._connect(addr=addr, timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 3537s comm = await connect( 3537s ^^^^^^^^^^^^^^ 3537s ...<4 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Nanny start timed out after 0s. 3537s 2024-11-23 21:25:14,904 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:25:14,914 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38023 3537s 2024-11-23 21:25:14,915 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44173/status 3537s 2024-11-23 21:25:14,915 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:25:14,937 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:37547'. Reason: failure-to-start- 3537s 2024-11-23 21:25:14,937 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:35277'. Reason: failure-to-start- 3537s 2024-11-23 21:25:14,938 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38023': TLS handshake failed with remote 'tls://127.0.0.1:52444': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:25:14,939 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38023': TLS handshake failed with remote 'tls://127.0.0.1:52458': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:25:14,939 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3537s comm = await self.rpc.connect(saddr) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 3537s return await self._connect(addr=addr, timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 3537s comm = await connect( 3537s ^^^^^^^^^^^^^^ 3537s ...<4 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Nanny start timed out after 0s. 3537s 2024-11-23 21:25:15,945 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:25:15,953 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44137 3537s 2024-11-23 21:25:15,954 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33343/status 3537s 2024-11-23 21:25:15,954 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:25:15,974 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:35169'. Reason: failure-to-start- 3537s 2024-11-23 21:25:15,974 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:33369'. Reason: failure-to-start- 3537s 2024-11-23 21:25:15,975 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44137': TLS handshake failed with remote 'tls://127.0.0.1:46742': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:25:15,975 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44137': TLS handshake failed with remote 'tls://127.0.0.1:46752': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:25:15,975 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3537s comm = await self.rpc.connect(saddr) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 3537s return await self._connect(addr=addr, timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 3537s comm = await connect( 3537s ^^^^^^^^^^^^^^ 3537s ...<4 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Nanny start timed out after 0s. 3537s 2024-11-23 21:25:16,981 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:25:16,990 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39393 3537s 2024-11-23 21:25:16,990 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34245/status 3537s 2024-11-23 21:25:16,991 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:25:17,013 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:38699'. Reason: failure-to-start- 3537s 2024-11-23 21:25:17,013 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:42147'. Reason: failure-to-start- 3537s 2024-11-23 21:25:17,014 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39393': TLS handshake failed with remote 'tls://127.0.0.1:50424': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:25:17,014 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39393': TLS handshake failed with remote 'tls://127.0.0.1:50436': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:25:17,014 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3537s comm = await self.rpc.connect(saddr) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 3537s return await self._connect(addr=addr, timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 3537s comm = await connect( 3537s ^^^^^^^^^^^^^^ 3537s ...<4 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Nanny start timed out after 0s. 3537s 2024-11-23 21:25:18,021 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:25:18,029 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46031 3537s 2024-11-23 21:25:18,030 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36825/status 3537s 2024-11-23 21:25:18,030 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:25:18,048 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:40891'. Reason: failure-to-start- 3537s 2024-11-23 21:25:18,048 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:33975'. Reason: failure-to-start- 3537s 2024-11-23 21:25:18,049 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46031': TLS handshake failed with remote 'tls://127.0.0.1:57134': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:25:18,050 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46031': TLS handshake failed with remote 'tls://127.0.0.1:57136': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:25:18,050 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3537s comm = await self.rpc.connect(saddr) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 3537s return await self._connect(addr=addr, timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 3537s comm = await connect( 3537s ^^^^^^^^^^^^^^ 3537s ...<4 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Nanny start timed out after 0s. 3537s 2024-11-23 21:25:19,056 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:25:19,064 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40755 3537s 2024-11-23 21:25:19,064 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37911/status 3537s 2024-11-23 21:25:19,065 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:25:19,084 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:42561'. Reason: failure-to-start- 3537s 2024-11-23 21:25:19,084 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:39745'. Reason: failure-to-start- 3537s 2024-11-23 21:25:19,087 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40755': TLS handshake failed with remote 'tls://127.0.0.1:34500': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:25:19,087 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40755': TLS handshake failed with remote 'tls://127.0.0.1:34510': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:25:19,087 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3537s comm = await self.rpc.connect(saddr) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 3537s return await self._connect(addr=addr, timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 3537s comm = await connect( 3537s ^^^^^^^^^^^^^^ 3537s ...<4 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Nanny start timed out after 0s. 3537s 2024-11-23 21:25:20,094 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:25:20,103 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38947 3537s 2024-11-23 21:25:20,104 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40201/status 3537s 2024-11-23 21:25:20,104 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:25:20,123 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:42765'. Reason: failure-to-start- 3537s 2024-11-23 21:25:20,124 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:46067'. Reason: failure-to-start- 3537s 2024-11-23 21:25:20,124 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38947': TLS handshake failed with remote 'tls://127.0.0.1:37724': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:25:20,124 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38947': TLS handshake failed with remote 'tls://127.0.0.1:37726': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:25:20,125 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3537s comm = await self.rpc.connect(saddr) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 3537s return await self._connect(addr=addr, timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 3537s comm = await connect( 3537s ^^^^^^^^^^^^^^ 3537s ...<4 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Nanny start timed out after 0s. 3537s 2024-11-23 21:25:21,130 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:25:21,138 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42173 3537s 2024-11-23 21:25:21,138 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43157/status 3537s 2024-11-23 21:25:21,139 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:25:21,161 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:39387'. Reason: failure-to-start- 3537s 2024-11-23 21:25:21,162 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:37737'. Reason: failure-to-start- 3537s 2024-11-23 21:25:21,163 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42173': TLS handshake failed with remote 'tls://127.0.0.1:52832': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:25:21,163 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42173': TLS handshake failed with remote 'tls://127.0.0.1:52846': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:25:21,163 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3537s comm = await self.rpc.connect(saddr) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 3537s return await self._connect(addr=addr, timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 3537s comm = await connect( 3537s ^^^^^^^^^^^^^^ 3537s ...<4 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Nanny start timed out after 0s. 3537s 2024-11-23 21:25:22,168 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:25:22,177 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43053 3537s 2024-11-23 21:25:22,178 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36975/status 3537s 2024-11-23 21:25:22,178 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:25:22,197 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:32859'. Reason: failure-to-start- 3537s 2024-11-23 21:25:22,198 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:39859'. Reason: failure-to-start- 3537s 2024-11-23 21:25:22,199 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43053': TLS handshake failed with remote 'tls://127.0.0.1:44846': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:25:22,199 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43053': TLS handshake failed with remote 'tls://127.0.0.1:44862': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:25:22,199 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3537s comm = await self.rpc.connect(saddr) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 3537s return await self._connect(addr=addr, timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 3537s comm = await connect( 3537s ^^^^^^^^^^^^^^ 3537s ...<4 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Nanny start timed out after 0s. 3537s 2024-11-23 21:25:23,205 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:25:23,214 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35281 3537s 2024-11-23 21:25:23,215 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35939/status 3537s 2024-11-23 21:25:23,215 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:25:23,233 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:35375'. Reason: failure-to-start- 3537s 2024-11-23 21:25:23,234 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:33951'. Reason: failure-to-start- 3537s 2024-11-23 21:25:23,237 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35281': TLS handshake failed with remote 'tls://127.0.0.1:33418': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:25:23,237 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35281': TLS handshake failed with remote 'tls://127.0.0.1:33430': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:25:23,237 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3537s comm = await self.rpc.connect(saddr) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 3537s return await self._connect(addr=addr, timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 3537s comm = await connect( 3537s ^^^^^^^^^^^^^^ 3537s ...<4 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Nanny start timed out after 0s. 3537s 2024-11-23 21:25:24,242 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:25:24,251 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42433 3537s 2024-11-23 21:25:24,252 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45377/status 3537s 2024-11-23 21:25:24,252 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:25:24,272 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:37255'. Reason: failure-to-start- 3537s 2024-11-23 21:25:24,272 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:34429'. Reason: failure-to-start- 3537s 2024-11-23 21:25:24,273 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42433': TLS handshake failed with remote 'tls://127.0.0.1:52068': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:25:24,273 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42433': TLS handshake failed with remote 'tls://127.0.0.1:52070': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:25:24,274 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3537s comm = await self.rpc.connect(saddr) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 3537s return await self._connect(addr=addr, timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 3537s comm = await connect( 3537s ^^^^^^^^^^^^^^ 3537s ...<4 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Nanny start timed out after 0s. 3537s 2024-11-23 21:25:25,279 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:25:25,288 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35791 3537s 2024-11-23 21:25:25,288 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45319/status 3537s 2024-11-23 21:25:25,289 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:25:25,327 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:40401'. Reason: failure-to-start- 3537s 2024-11-23 21:25:25,327 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:38145'. Reason: failure-to-start- 3537s 2024-11-23 21:25:25,331 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35791': TLS handshake failed with remote 'tls://127.0.0.1:35938': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:25:25,331 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35791': TLS handshake failed with remote 'tls://127.0.0.1:35950': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:25:25,331 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3537s comm = await self.rpc.connect(saddr) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 3537s return await self._connect(addr=addr, timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 3537s comm = await connect( 3537s ^^^^^^^^^^^^^^ 3537s ...<4 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Nanny start timed out after 0s. 3537s 2024-11-23 21:25:26,337 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:25:26,347 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37825 3537s 2024-11-23 21:25:26,348 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38703/status 3537s 2024-11-23 21:25:26,348 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:25:26,368 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:40691'. Reason: failure-to-start- 3537s 2024-11-23 21:25:26,369 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:42425'. Reason: failure-to-start- 3537s 2024-11-23 21:25:26,372 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37825': TLS handshake failed with remote 'tls://127.0.0.1:41436': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:25:26,372 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37825': TLS handshake failed with remote 'tls://127.0.0.1:41440': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:25:26,372 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3537s comm = await self.rpc.connect(saddr) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 3537s return await self._connect(addr=addr, timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 3537s comm = await connect( 3537s ^^^^^^^^^^^^^^ 3537s ...<4 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Nanny start timed out after 0s. 3537s 2024-11-23 21:25:27,378 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:25:27,386 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46461 3537s 2024-11-23 21:25:27,387 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35787/status 3537s 2024-11-23 21:25:27,387 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:25:27,410 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:44043'. Reason: failure-to-start- 3537s 2024-11-23 21:25:27,410 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:43143'. Reason: failure-to-start- 3537s 2024-11-23 21:25:27,413 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46461': TLS handshake failed with remote 'tls://127.0.0.1:53896': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:25:27,413 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46461': TLS handshake failed with remote 'tls://127.0.0.1:53912': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:25:27,413 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3537s comm = await self.rpc.connect(saddr) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 3537s return await self._connect(addr=addr, timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 3537s comm = await connect( 3537s ^^^^^^^^^^^^^^ 3537s ...<4 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Nanny start timed out after 0s. 3537s 2024-11-23 21:25:28,419 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:25:28,427 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39613 3537s 2024-11-23 21:25:28,428 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37107/status 3537s 2024-11-23 21:25:28,428 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:25:28,446 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:45769'. Reason: failure-to-start- 3537s 2024-11-23 21:25:28,446 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:37731'. Reason: failure-to-start- 3537s 2024-11-23 21:25:28,450 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:40082': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:25:28,450 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:40096': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:25:28,450 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3537s comm = await self.rpc.connect(saddr) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 3537s return await self._connect(addr=addr, timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 3537s comm = await connect( 3537s ^^^^^^^^^^^^^^ 3537s ...<4 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Nanny start timed out after 0s. 3537s 2024-11-23 21:25:29,456 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:25:29,465 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41215 3537s 2024-11-23 21:25:29,465 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41365/status 3537s 2024-11-23 21:25:29,466 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:25:29,486 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:39041'. Reason: failure-to-start- 3537s 2024-11-23 21:25:29,486 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:36331'. Reason: failure-to-start- 3537s 2024-11-23 21:25:29,487 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41215': TLS handshake failed with remote 'tls://127.0.0.1:60566': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:25:29,487 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41215': TLS handshake failed with remote 'tls://127.0.0.1:60574': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:25:29,488 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3537s comm = await self.rpc.connect(saddr) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 3537s return await self._connect(addr=addr, timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 3537s comm = await connect( 3537s ^^^^^^^^^^^^^^ 3537s ...<4 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Nanny start timed out after 0s. 3537s 2024-11-23 21:25:30,495 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:25:30,504 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42135 3537s 2024-11-23 21:25:30,504 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46191/status 3537s 2024-11-23 21:25:30,505 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:25:30,527 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:40013'. Reason: failure-to-start- 3537s 2024-11-23 21:25:30,528 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:44709'. Reason: failure-to-start- 3537s 2024-11-23 21:25:30,529 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42135': TLS handshake failed with remote 'tls://127.0.0.1:54844': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:25:30,529 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42135': TLS handshake failed with remote 'tls://127.0.0.1:54852': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:25:30,529 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3537s comm = await self.rpc.connect(saddr) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 3537s return await self._connect(addr=addr, timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 3537s comm = await connect( 3537s ^^^^^^^^^^^^^^ 3537s ...<4 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Nanny start timed out after 0s. 3537s 2024-11-23 21:25:31,537 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:25:31,546 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37437 3537s 2024-11-23 21:25:31,546 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44697/status 3537s 2024-11-23 21:25:31,547 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:25:31,587 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:41089'. Reason: failure-to-start- 3537s 2024-11-23 21:25:31,587 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:45301'. Reason: failure-to-start- 3537s 2024-11-23 21:25:31,590 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37437': TLS handshake failed with remote 'tls://127.0.0.1:58898': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:25:31,591 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37437': TLS handshake failed with remote 'tls://127.0.0.1:58908': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:25:31,591 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3537s comm = await self.rpc.connect(saddr) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 3537s return await self._connect(addr=addr, timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 3537s comm = await connect( 3537s ^^^^^^^^^^^^^^ 3537s ...<4 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Nanny start timed out after 0s. 3537s 2024-11-23 21:25:32,597 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:25:32,606 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45847 3537s 2024-11-23 21:25:32,607 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33089/status 3537s 2024-11-23 21:25:32,607 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:25:32,631 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:37559'. Reason: failure-to-start- 3537s 2024-11-23 21:25:32,632 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:45995'. Reason: failure-to-start- 3537s 2024-11-23 21:25:32,635 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45847': TLS handshake failed with remote 'tls://127.0.0.1:49516': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:25:32,635 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45847': TLS handshake failed with remote 'tls://127.0.0.1:49528': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:25:32,635 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3537s comm = await self.rpc.connect(saddr) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 3537s return await self._connect(addr=addr, timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 3537s comm = await connect( 3537s ^^^^^^^^^^^^^^ 3537s ...<4 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Nanny start timed out after 0s. 3537s 2024-11-23 21:25:33,642 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:25:33,652 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44437 3537s 2024-11-23 21:25:33,653 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37849/status 3537s 2024-11-23 21:25:33,653 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:25:33,683 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:36683'. Reason: failure-to-start- 3537s 2024-11-23 21:25:33,684 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:43621'. Reason: failure-to-start- 3537s 2024-11-23 21:25:33,685 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44437': TLS handshake failed with remote 'tls://127.0.0.1:57636': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:25:33,685 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44437': TLS handshake failed with remote 'tls://127.0.0.1:57640': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:25:33,687 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3537s comm = await self.rpc.connect(saddr) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 3537s return await self._connect(addr=addr, timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 3537s comm = await connect( 3537s ^^^^^^^^^^^^^^ 3537s ...<4 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Nanny start timed out after 0s. 3537s 2024-11-23 21:25:34,694 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:25:34,704 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37449 3537s 2024-11-23 21:25:34,704 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45125/status 3537s 2024-11-23 21:25:34,705 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:25:34,729 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:36335'. Reason: failure-to-start- 3537s 2024-11-23 21:25:34,729 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:42763'. Reason: failure-to-start- 3537s 2024-11-23 21:25:34,730 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37449': TLS handshake failed with remote 'tls://127.0.0.1:52856': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:25:34,730 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37449': TLS handshake failed with remote 'tls://127.0.0.1:52860': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:25:34,731 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3537s comm = await self.rpc.connect(saddr) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 3537s return await self._connect(addr=addr, timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 3537s comm = await connect( 3537s ^^^^^^^^^^^^^^ 3537s ...<4 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Nanny start timed out after 0s. 3537s 2024-11-23 21:25:35,736 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:25:35,745 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35989 3537s 2024-11-23 21:25:35,746 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39563/status 3537s 2024-11-23 21:25:35,746 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:25:35,770 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:40099'. Reason: failure-to-start- 3537s 2024-11-23 21:25:35,770 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:37443'. Reason: failure-to-start- 3537s 2024-11-23 21:25:35,774 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35989': TLS handshake failed with remote 'tls://127.0.0.1:33972': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:25:35,774 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35989': TLS handshake failed with remote 'tls://127.0.0.1:33982': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:25:35,774 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3537s comm = await self.rpc.connect(saddr) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 3537s return await self._connect(addr=addr, timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 3537s comm = await connect( 3537s ^^^^^^^^^^^^^^ 3537s ...<4 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Nanny start timed out after 0s. 3537s 2024-11-23 21:25:36,780 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:25:36,789 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39163 3537s 2024-11-23 21:25:36,790 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38075/status 3537s 2024-11-23 21:25:36,793 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:25:36,820 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:33103'. Reason: failure-to-start- 3537s 2024-11-23 21:25:36,821 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:36401'. Reason: failure-to-start- 3537s 2024-11-23 21:25:36,822 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39163': TLS handshake failed with remote 'tls://127.0.0.1:56412': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:25:36,822 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39163': TLS handshake failed with remote 'tls://127.0.0.1:56418': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:25:36,825 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3537s comm = await self.rpc.connect(saddr) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 3537s return await self._connect(addr=addr, timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 3537s comm = await connect( 3537s ^^^^^^^^^^^^^^ 3537s ...<4 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Nanny start timed out after 0s. 3537s 2024-11-23 21:25:37,831 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:25:37,840 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36705 3537s 2024-11-23 21:25:37,841 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37349/status 3537s 2024-11-23 21:25:37,841 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:25:37,868 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:35355'. Reason: failure-to-start- 3537s 2024-11-23 21:25:37,869 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:43337'. Reason: failure-to-start- 3537s 2024-11-23 21:25:37,870 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36705': TLS handshake failed with remote 'tls://127.0.0.1:57904': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:25:37,870 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36705': TLS handshake failed with remote 'tls://127.0.0.1:57918': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:25:37,873 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3537s comm = await self.rpc.connect(saddr) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 3537s return await self._connect(addr=addr, timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 3537s comm = await connect( 3537s ^^^^^^^^^^^^^^ 3537s ...<4 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Nanny start timed out after 0s. 3537s 2024-11-23 21:25:38,879 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:25:38,888 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33221 3537s 2024-11-23 21:25:38,889 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34549/status 3537s 2024-11-23 21:25:38,889 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:25:38,919 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:45247'. Reason: failure-to-start- 3537s 2024-11-23 21:25:38,919 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:40497'. Reason: failure-to-start- 3537s 2024-11-23 21:25:38,921 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33221': TLS handshake failed with remote 'tls://127.0.0.1:42792': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:25:38,921 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33221': TLS handshake failed with remote 'tls://127.0.0.1:42798': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:25:38,924 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3537s comm = await self.rpc.connect(saddr) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 3537s return await self._connect(addr=addr, timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 3537s comm = await connect( 3537s ^^^^^^^^^^^^^^ 3537s ...<4 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Nanny start timed out after 0s. 3537s 2024-11-23 21:25:39,929 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:25:39,939 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36095 3537s 2024-11-23 21:25:39,940 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44875/status 3537s 2024-11-23 21:25:39,940 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:25:39,973 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:37493'. Reason: failure-to-start- 3537s 2024-11-23 21:25:39,973 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:44131'. Reason: failure-to-start- 3537s 2024-11-23 21:25:39,974 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36095': TLS handshake failed with remote 'tls://127.0.0.1:32966': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:25:39,974 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36095': TLS handshake failed with remote 'tls://127.0.0.1:32972': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:25:39,977 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3537s comm = await self.rpc.connect(saddr) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 3537s return await self._connect(addr=addr, timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 3537s comm = await connect( 3537s ^^^^^^^^^^^^^^ 3537s ...<4 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Nanny start timed out after 0s. 3537s 2024-11-23 21:25:40,984 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:25:40,994 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46843 3537s 2024-11-23 21:25:40,995 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43659/status 3537s 2024-11-23 21:25:40,995 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:25:41,027 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:45525'. Reason: failure-to-start- 3537s 2024-11-23 21:25:41,028 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:35921'. Reason: failure-to-start- 3537s 2024-11-23 21:25:41,029 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46843': TLS handshake failed with remote 'tls://127.0.0.1:39212': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:25:41,029 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46843': TLS handshake failed with remote 'tls://127.0.0.1:39224': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:25:41,030 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3537s comm = await self.rpc.connect(saddr) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 3537s return await self._connect(addr=addr, timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 3537s comm = await connect( 3537s ^^^^^^^^^^^^^^ 3537s ...<4 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Nanny start timed out after 0s. 3537s 2024-11-23 21:25:42,037 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:25:42,046 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37681 3537s 2024-11-23 21:25:42,047 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39495/status 3537s 2024-11-23 21:25:42,047 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:25:42,077 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:46883'. Reason: failure-to-start- 3537s 2024-11-23 21:25:42,077 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:36875'. Reason: failure-to-start- 3537s 2024-11-23 21:25:42,081 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37681': TLS handshake failed with remote 'tls://127.0.0.1:38954': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:25:42,081 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37681': TLS handshake failed with remote 'tls://127.0.0.1:38960': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:25:42,082 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3537s comm = await self.rpc.connect(saddr) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 3537s return await self._connect(addr=addr, timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 3537s comm = await connect( 3537s ^^^^^^^^^^^^^^ 3537s ...<4 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Nanny start timed out after 0s. 3537s ___________________________ test_security_dict_input ___________________________ 3537s 3537s self = 3537s address = '127.0.0.1:43623', deserialize = True 3537s connection_args = {'extra_conn_args': {}, 'require_encryption': True, 'ssl_context': } 3537s ip = '127.0.0.1', port = 43623 3537s kwargs = {'ssl_options': } 3537s 3537s async def connect(self, address, deserialize=True, **connection_args): 3537s self._check_encryption(address, connection_args) 3537s ip, port = parse_host_port(address) 3537s kwargs = self._get_connect_args(**connection_args) 3537s 3537s try: 3537s # server_hostname option (for SNI) only works with tornado.iostream.IOStream 3537s if "server_hostname" in kwargs: 3537s stream = await self.client.connect( 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE 3537s ) 3537s stream = await stream.start_tls(False, **kwargs) 3537s else: 3537s > stream = await self.client.connect( 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ) 3537s 3537s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:546: 3537s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3537s /usr/lib/python3/dist-packages/tornado/tcpclient.py:292: in connect 3537s stream = await stream.start_tls( 3537s /usr/lib/python3/dist-packages/tornado/iostream.py:1367: in _do_ssl_handshake 3537s self.socket.do_handshake() 3537s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3537s 3537s self = , block = False 3537s 3537s @_sslcopydoc 3537s def do_handshake(self, block=False): 3537s self._check_connected() 3537s timeout = self.gettimeout() 3537s try: 3537s if timeout == 0.0 and block: 3537s self.settimeout(None) 3537s > self._sslobj.do_handshake() 3537s E ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 3537s 3537s /usr/lib/python3.13/ssl.py:1372: SSLCertVerificationError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s self = 3537s 3537s async def _register_with_scheduler(self) -> None: 3537s self.periodic_callbacks["keep-alive"].stop() 3537s self.periodic_callbacks["heartbeat"].stop() 3537s start = time() 3537s if self.contact_address is None: 3537s self.contact_address = self.address 3537s logger.info("-" * 49) 3537s 3537s # Worker reconnection is not supported 3537s assert not self.data 3537s assert not self.state.tasks 3537s 3537s while True: 3537s try: 3537s _start = time() 3537s > comm = await connect(self.scheduler.address, **self.connection_args) 3537s 3537s /usr/lib/python3/dist-packages/distributed/worker.py:1179: 3537s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3537s /usr/lib/python3/dist-packages/distributed/comm/core.py:342: in connect 3537s comm = await wait_for( 3537s /usr/lib/python3/dist-packages/distributed/utils.py:1960: in wait_for 3537s return await fut 3537s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3537s 3537s self = 3537s address = '127.0.0.1:43623', deserialize = True 3537s connection_args = {'extra_conn_args': {}, 'require_encryption': True, 'ssl_context': } 3537s ip = '127.0.0.1', port = 43623 3537s kwargs = {'ssl_options': } 3537s 3537s async def connect(self, address, deserialize=True, **connection_args): 3537s self._check_encryption(address, connection_args) 3537s ip, port = parse_host_port(address) 3537s kwargs = self._get_connect_args(**connection_args) 3537s 3537s try: 3537s # server_hostname option (for SNI) only works with tornado.iostream.IOStream 3537s if "server_hostname" in kwargs: 3537s stream = await self.client.connect( 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE 3537s ) 3537s stream = await stream.start_tls(False, **kwargs) 3537s else: 3537s stream = await self.client.connect( 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ) 3537s 3537s # Under certain circumstances tornado will have a closed connection with an 3537s # error and not raise a StreamClosedError. 3537s # 3537s # This occurs with tornado 5.x and openssl 1.1+ 3537s if stream.closed() and stream.error: 3537s raise StreamClosedError(stream.error) 3537s 3537s except StreamClosedError as e: 3537s # The socket connect() call failed 3537s convert_stream_closed_error(self, e) 3537s except SSLCertVerificationError as err: 3537s > raise FatalCommClosedError( 3537s "TLS certificate does not match. Check your security settings. " 3537s "More info at https://distributed.dask.org/en/latest/tls.html" 3537s ) from err 3537s E distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 3537s 3537s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:561: FatalCommClosedError 3537s 3537s During handling of the above exception, another exception occurred: 3537s 3537s @gen_test() 3537s async def test_security_dict_input(): 3537s conf = tls_config() 3537s ca_file = conf["distributed"]["comm"]["tls"]["ca-file"] 3537s client = conf["distributed"]["comm"]["tls"]["client"]["cert"] 3537s worker = conf["distributed"]["comm"]["tls"]["worker"]["cert"] 3537s scheduler = conf["distributed"]["comm"]["tls"]["scheduler"]["cert"] 3537s 3537s async with Scheduler( 3537s host="localhost", 3537s dashboard_address=":0", 3537s security={"tls_ca_file": ca_file, "tls_scheduler_cert": scheduler}, 3537s ) as s: 3537s assert s.address.startswith("tls://") 3537s > async with Worker( 3537s s.address, security={"tls_ca_file": ca_file, "tls_worker_cert": worker} 3537s ) as w: 3537s 3537s /usr/lib/python3/dist-packages/distributed/tests/test_tls_functional.py:225: 3537s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3537s /usr/lib/python3/dist-packages/distributed/core.py:678: in __aenter__ 3537s await self 3537s /usr/lib/python3/dist-packages/distributed/core.py:664: in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s /usr/lib/python3/dist-packages/distributed/utils.py:1960: in wait_for 3537s return await fut 3537s /usr/lib/python3/dist-packages/distributed/worker.py:1480: in start_unsafe 3537s await self._register_with_scheduler() 3537s /usr/lib/python3/dist-packages/distributed/worker.py:1218: in _register_with_scheduler 3537s await asyncio.sleep(0.1) 3537s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3537s 3537s delay = 0.1, result = None 3537s 3537s async def sleep(delay, result=None): 3537s """Coroutine that completes after a given time (in seconds).""" 3537s if delay <= 0: 3537s await __sleep0() 3537s return result 3537s 3537s if math.isnan(delay): 3537s raise ValueError("Invalid delay: NaN (not a number)") 3537s 3537s loop = events.get_running_loop() 3537s future = loop.create_future() 3537s h = loop.call_later(delay, 3537s futures._set_result_unless_cancelled, 3537s future, result) 3537s try: 3537s > return await future 3537s E asyncio.exceptions.CancelledError 3537s 3537s /usr/lib/python3.13/asyncio/tasks.py:718: CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s args = (), kwds = {} 3537s 3537s @wraps(func) 3537s def inner(*args, **kwds): 3537s with self._recreate_cm(): 3537s > return func(*args, **kwds) 3537s 3537s /usr/lib/python3.13/contextlib.py:85: 3537s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3537s /usr/lib/python3.13/contextlib.py:85: in inner 3537s return func(*args, **kwds) 3537s /usr/lib/python3/dist-packages/distributed/utils_test.py:746: in test_func 3537s return _run_and_close_tornado(async_fn_outer, func, *args, **kwargs) 3537s /usr/lib/python3/dist-packages/distributed/utils_test.py:378: in _run_and_close_tornado 3537s return asyncio_run(inner_fn(), loop_factory=get_loop_factory()) 3537s /usr/lib/python3.13/asyncio/runners.py:194: in run 3537s return runner.run(main) 3537s /usr/lib/python3.13/asyncio/runners.py:118: in run 3537s return self._loop.run_until_complete(task) 3537s /usr/lib/python3.13/asyncio/base_events.py:720: in run_until_complete 3537s return future.result() 3537s /usr/lib/python3/dist-packages/distributed/utils_test.py:375: in inner_fn 3537s return await async_fn(*args, **kwargs) 3537s /usr/lib/python3/dist-packages/distributed/utils_test.py:736: in async_fn_outer 3537s return await utils_wait_for(async_fn(*args, **kwargs), timeout) 3537s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 3537s async with asyncio.timeout(timeout): 3537s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3537s 3537s self = 3537s exc_type = 3537s exc_val = CancelledError(), exc_tb = 3537s 3537s async def __aexit__( 3537s self, 3537s exc_type: Optional[Type[BaseException]], 3537s exc_val: Optional[BaseException], 3537s exc_tb: Optional[TracebackType], 3537s ) -> Optional[bool]: 3537s assert self._state in (_State.ENTERED, _State.EXPIRING) 3537s 3537s if self._timeout_handler is not None: 3537s self._timeout_handler.cancel() 3537s self._timeout_handler = None 3537s 3537s if self._state is _State.EXPIRING: 3537s self._state = _State.EXPIRED 3537s 3537s if self._task.uncancel() <= self._cancelling and exc_type is not None: 3537s # Since there are no new cancel requests, we're 3537s # handling this. 3537s if issubclass(exc_type, exceptions.CancelledError): 3537s > raise TimeoutError from exc_val 3537s E TimeoutError 3537s 3537s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 3537s ----------------------------- Captured stderr call ----------------------------- 3537s 2024-11-23 21:25:43,623 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:25:43,632 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43623 3537s 2024-11-23 21:25:43,633 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44595/status 3537s 2024-11-23 21:25:43,633 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:25:43,642 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35227 3537s 2024-11-23 21:25:43,642 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35227 3537s 2024-11-23 21:25:43,642 - distributed.worker - INFO - dashboard at: 127.0.0.1:43543 3537s 2024-11-23 21:25:43,642 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:25:43,642 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:25:43,642 - distributed.worker - INFO - Threads: 8 3537s 2024-11-23 21:25:43,642 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:25:43,642 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-oqnhjvua 3537s 2024-11-23 21:25:43,642 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:25:43,650 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:25:43,650 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:56296': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:43,757 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:25:43,758 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:56302': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:43,865 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:25:43,866 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:56314': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:43,973 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:25:43,974 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:56326': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:44,081 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:25:44,081 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:56330': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:44,189 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:25:44,189 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:56344': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:44,298 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:25:44,298 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:56346': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:44,406 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:25:44,406 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:56352': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:44,514 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:25:44,514 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:56354': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:44,622 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:25:44,622 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:56370': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:44,730 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:25:44,730 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:56376': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:44,838 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:25:44,838 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:56386': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:44,945 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:25:44,945 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:56402': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:45,053 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:25:45,053 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:56416': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:45,160 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:25:45,161 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:56420': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:45,268 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:25:45,268 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:56436': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:45,376 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:25:45,376 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:56448': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:45,483 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:25:45,484 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:56460': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:45,591 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:25:45,592 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:56472': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:45,698 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:25:45,699 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:56480': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:45,806 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:25:45,807 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:56486': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:45,914 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:25:45,915 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:56490': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:46,022 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:25:46,023 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:56500': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:46,130 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:25:46,130 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:56502': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:46,237 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:25:46,238 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:56510': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:46,345 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:25:46,346 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:56512': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:46,454 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:25:46,455 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:56518': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:46,562 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:25:46,563 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:56524': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:46,670 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:25:46,670 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:56530': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:46,777 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:25:46,778 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:56546': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:46,887 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:25:46,887 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:56550': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:46,995 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:25:46,995 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:56562': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:47,104 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:25:47,104 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:56566': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:47,212 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:25:47,212 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:56570': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:47,320 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:25:47,320 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:56586': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:47,428 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:25:47,429 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:56592': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:47,537 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:25:47,538 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:56606': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:47,645 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:25:47,645 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:56610': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:47,753 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:25:47,753 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:56612': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:47,861 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:25:47,861 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:56622': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:47,968 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:25:47,969 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:56624': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:48,077 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:25:48,078 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:56638': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:48,186 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:25:48,186 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:56640': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:48,294 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:25:48,294 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:56646': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:48,402 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:25:48,402 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:56652': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:48,510 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:25:48,510 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:56656': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:48,618 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:25:48,618 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:56666': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:48,725 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:25:48,726 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:56668': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:48,833 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:25:48,834 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:56670': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:48,940 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:25:48,941 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:56672': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:49,048 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:25:49,048 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:56682': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:49,156 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:25:49,156 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:56686': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:49,264 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:25:49,265 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:56696': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:49,372 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:25:49,373 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:56706': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:49,480 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:25:49,480 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:56722': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:49,587 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:25:49,588 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:56724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:49,695 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:25:49,696 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:56738': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:49,804 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:25:49,805 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:56742': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:49,912 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:25:49,913 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:56752': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:50,020 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:25:50,021 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:56766': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:50,128 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:25:50,128 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:56780': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:50,236 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:25:50,237 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:56784': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:50,344 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:25:50,345 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:56786': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:50,453 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:25:50,453 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:56796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:50,562 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:25:50,562 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:56800': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:50,670 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:25:50,670 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:56806': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:50,778 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:25:50,779 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:56812': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:50,887 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:25:50,888 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:56822': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:50,996 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:25:50,996 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:56830': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:51,103 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:25:51,104 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:56846': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:51,212 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:25:51,212 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:56852': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:51,320 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:25:51,321 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:56862': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:51,428 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:25:51,429 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:56864': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:51,537 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:25:51,537 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:52610': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:51,644 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:25:51,645 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:52618': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:51,752 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:25:51,752 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:52622': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:51,860 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:25:51,861 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:52632': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:51,968 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:25:51,968 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:52640': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:52,076 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:25:52,077 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:52656': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:52,184 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:25:52,185 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:52658': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:52,312 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:25:52,313 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:52670': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:52,421 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:25:52,422 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:52682': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:52,529 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:25:52,530 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:52692': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:52,638 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:25:52,644 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:52696': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:52,745 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:25:52,746 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:52708': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:52,855 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:25:52,856 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:52718': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:52,964 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:25:52,964 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:52730': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:53,072 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:25:53,072 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:52740': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:53,180 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:25:53,180 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:52744': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:53,288 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:25:53,288 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:52748': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:53,396 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:25:53,396 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:52754': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:53,504 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:25:53,504 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:52766': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:53,613 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:25:53,614 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:52780': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:53,721 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:25:53,722 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:52796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:53,829 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:25:53,830 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:52798': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:53,937 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:25:53,937 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:52806': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:54,045 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:25:54,045 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:52814': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:54,152 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:25:54,153 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:52824': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:54,260 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:25:54,261 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:52830': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:54,368 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:25:54,369 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:52846': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:54,478 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:25:54,478 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:52854': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:54,586 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:25:54,586 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:52862': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:54,694 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:25:54,695 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:52872': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:54,803 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:25:54,803 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:52886': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:54,910 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:25:54,911 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:52890': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:55,019 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:25:55,019 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:52900': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:55,127 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:25:55,128 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:52906': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:55,236 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:25:55,237 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:52918': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:55,344 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:25:55,345 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:52924': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:55,452 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:25:55,453 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:52928': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:55,561 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:25:55,561 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:52936': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:55,669 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:25:55,669 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:52948': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:55,779 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:25:55,779 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:52958': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:55,888 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:25:55,889 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:52964': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:55,997 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:25:55,997 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:52972': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:56,105 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:25:56,106 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:52974': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:56,213 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:25:56,214 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:52980': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:56,321 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:25:56,322 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:52992': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:56,429 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:25:56,430 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:53000': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:56,538 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:25:56,538 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:53004': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:56,646 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:25:56,646 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:53006': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:56,754 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:25:56,754 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:53022': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:56,862 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:25:56,863 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:53034': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:56,971 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:25:56,971 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:53050': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:57,079 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:25:57,080 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:53062': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:57,187 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:25:57,188 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:53072': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:57,305 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:25:57,306 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:53086': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:57,413 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:25:57,414 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:53090': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:57,523 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:25:57,523 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:53104': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:57,631 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:25:57,632 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:53120': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:57,739 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:25:57,739 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:53124': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:57,847 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:25:57,848 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:53134': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:57,955 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:25:57,956 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:53146': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:58,063 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:25:58,063 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:53152': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:58,171 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:25:58,172 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:53164': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:58,279 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:25:58,280 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:53176': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:58,387 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:25:58,388 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:53184': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:58,495 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:25:58,496 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:53194': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:58,604 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:25:58,604 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:53202': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:58,713 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:25:58,713 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:53208': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:58,821 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:25:58,821 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:53216': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:58,930 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:25:58,931 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:53230': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:59,039 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:25:59,039 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:53246': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:59,146 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:25:59,147 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:53254': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:59,255 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:25:59,255 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:53266': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:59,363 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:25:59,363 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:53272': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:59,471 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:25:59,471 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:53280': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:59,579 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:25:59,579 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:53292': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:59,686 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:25:59,687 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:53298': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:59,794 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:25:59,795 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:53306': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:25:59,903 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:25:59,903 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:53316': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:00,011 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:26:00,011 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:53328': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:00,119 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:26:00,120 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:53340': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:00,228 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:26:00,228 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:53342': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:00,336 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:26:00,337 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:53354': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:00,444 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:26:00,444 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:53368': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:00,552 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:26:00,553 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:53376': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:00,660 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:26:00,661 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:53386': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:00,769 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:26:00,769 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:53394': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:00,878 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:26:00,878 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:53400': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:00,986 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:26:00,987 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:53406': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:01,095 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:26:01,095 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:53416': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:01,203 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:26:01,204 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:53418': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:01,312 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:26:01,312 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:53434': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:01,420 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:26:01,420 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:53440': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:01,528 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:26:01,529 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:53448': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:01,637 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:26:01,641 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:48576': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:01,746 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:26:01,746 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:48580': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:01,854 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:26:01,854 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:48590': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:01,962 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:26:01,962 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:48598': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:02,071 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:26:02,071 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:48602': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:02,179 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:26:02,180 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:48616': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:02,288 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:26:02,288 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:48620': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:02,395 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:26:02,396 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:48636': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:02,504 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:26:02,504 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:48650': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:02,613 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:26:02,614 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:48658': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:02,721 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:26:02,722 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:48670': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:02,830 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:26:02,831 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:48674': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:02,939 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:26:02,939 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:48680': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:03,047 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:26:03,048 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:48688': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:03,155 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:26:03,156 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:48704': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:03,264 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:26:03,264 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:48710': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:03,372 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:26:03,373 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:48726': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:03,480 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:26:03,480 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:48740': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:03,589 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:26:03,589 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:48750': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:03,696 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:26:03,697 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:48764': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:03,805 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:26:03,805 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:48776': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:03,912 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:26:03,913 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:48792': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:04,021 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:26:04,021 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:48804': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:04,129 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:26:04,130 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:48806': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:04,237 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:26:04,238 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:48816': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:04,345 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:26:04,345 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:48822': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:04,453 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:26:04,454 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:48834': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:04,561 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:26:04,562 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:48848': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:04,670 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:26:04,670 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:48856': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:04,778 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:26:04,779 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:48866': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:04,887 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:26:04,887 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:48870': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:04,995 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:26:04,995 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:48874': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:05,105 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:26:05,106 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:48886': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:05,213 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:26:05,213 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:48892': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:05,321 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:26:05,322 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:48908': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:05,429 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:26:05,429 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:48914': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:05,537 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:26:05,538 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:48918': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:05,645 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:26:05,646 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:48928': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:05,753 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:26:05,754 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:48936': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:05,861 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:26:05,862 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:48952': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:05,969 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:26:05,969 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:48956': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:06,076 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:26:06,077 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:48958': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:06,185 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:26:06,185 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:48966': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:06,294 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:26:06,295 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:48972': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:06,402 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:26:06,402 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:48982': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:06,510 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:26:06,511 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:48994': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:06,619 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:26:06,619 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:48996': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:06,727 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:26:06,728 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:49006': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:06,835 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:26:06,836 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:49008': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:06,943 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:26:06,944 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:49010': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:07,052 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:26:07,052 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:49020': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:07,160 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:26:07,161 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:49028': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:07,269 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:26:07,269 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:49036': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:07,378 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:26:07,379 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:49038': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:07,486 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:26:07,486 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:49052': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:07,595 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:26:07,595 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:49058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:07,703 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:26:07,704 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:49060': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:07,811 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:26:07,812 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:49076': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:07,920 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:26:07,920 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:49082': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:08,028 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:26:08,029 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:49098': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:08,138 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:26:08,142 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:49110': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:08,246 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:26:08,247 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:49124': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:08,355 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:26:08,355 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:49126': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:08,462 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:26:08,462 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:49140': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:08,570 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:26:08,571 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:49146': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:08,679 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:26:08,679 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:49156': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:08,787 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:26:08,787 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:49172': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:08,895 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:26:08,896 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:49174': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:09,004 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:26:09,004 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:49176': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:09,113 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:26:09,114 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:49186': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:09,221 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:26:09,222 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:49190': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:09,329 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:26:09,330 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:49194': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:09,437 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:26:09,438 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:49208': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:09,545 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:26:09,546 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:49218': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:09,654 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:26:09,655 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:49228': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:09,762 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:26:09,763 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:49244': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:09,870 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:26:09,871 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:49250': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:09,978 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:26:09,979 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:49262': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:10,086 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:26:10,087 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:49276': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:10,194 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:26:10,194 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:49284': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:10,301 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:26:10,302 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:49288': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:10,410 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:26:10,411 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:49292': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:10,519 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:26:10,519 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:49302': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:10,627 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:26:10,628 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:49318': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:10,735 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:26:10,736 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:49330': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:10,843 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:26:10,844 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:49342': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:10,952 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:26:10,952 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:49354': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:11,060 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:26:11,060 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:49366': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:11,168 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:26:11,169 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:49372': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:11,276 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:26:11,276 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:49382': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:11,385 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:26:11,386 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:49386': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:11,495 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:26:11,495 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:49402': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:11,602 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:26:11,603 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:51396': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:11,711 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:26:11,711 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:51400': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:11,819 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:26:11,820 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:51408': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:11,928 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:26:11,928 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:51416': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:12,036 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:26:12,037 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:51428': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:12,145 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:26:12,146 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:51432': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:12,254 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:26:12,254 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:51446': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:12,361 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:26:12,362 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:51462': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:12,469 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:26:12,470 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:51470': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:12,578 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:26:12,579 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:51474': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:12,686 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:26:12,687 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:51482': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:12,794 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:26:12,795 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:51486': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:12,902 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:26:12,903 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:51498': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:13,011 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:26:13,011 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:51506': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:13,119 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:26:13,120 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:51518': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:13,228 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:26:13,228 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:51524': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:13,336 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:26:13,336 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:51532': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:13,444 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:26:13,444 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:51544': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:13,552 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43623 3537s 2024-11-23 21:26:13,553 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:51558': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:13,590 - distributed.scheduler - INFO - Scheduler closing due to unknown reason... 3537s 2024-11-23 21:26:13,591 - distributed.scheduler - INFO - Scheduler closing all comms 3537s _____________________________ test_gen_cluster_tls _____________________________ 3537s 3537s fut = , timeout = 0 3537s 3537s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 3537s async with asyncio.timeout(timeout): 3537s > return await fut 3537s 3537s /usr/lib/python3/dist-packages/distributed/utils.py:1960: 3537s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3537s /usr/lib/python3/dist-packages/distributed/worker.py:1480: in start_unsafe 3537s await self._register_with_scheduler() 3537s /usr/lib/python3/dist-packages/distributed/worker.py:1179: in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s /usr/lib/python3/dist-packages/distributed/comm/core.py:342: in connect 3537s comm = await wait_for( 3537s /usr/lib/python3/dist-packages/distributed/utils.py:1960: in wait_for 3537s return await fut 3537s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:546: in connect 3537s stream = await self.client.connect( 3537s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3537s 3537s self = , host = '127.0.0.1' 3537s port = 33941, af = 3537s ssl_options = 3537s max_buffer_size = 8364507136.0, source_ip = None, source_port = None 3537s timeout = None 3537s 3537s async def connect( 3537s self, 3537s host: str, 3537s port: int, 3537s af: socket.AddressFamily = socket.AF_UNSPEC, 3537s ssl_options: Optional[Union[Dict[str, Any], ssl.SSLContext]] = None, 3537s max_buffer_size: Optional[int] = None, 3537s source_ip: Optional[str] = None, 3537s source_port: Optional[int] = None, 3537s timeout: Optional[Union[float, datetime.timedelta]] = None, 3537s ) -> IOStream: 3537s """Connect to the given host and port. 3537s 3537s Asynchronously returns an `.IOStream` (or `.SSLIOStream` if 3537s ``ssl_options`` is not None). 3537s 3537s Using the ``source_ip`` kwarg, one can specify the source 3537s IP address to use when establishing the connection. 3537s In case the user needs to resolve and 3537s use a specific interface, it has to be handled outside 3537s of Tornado as this depends very much on the platform. 3537s 3537s Raises `TimeoutError` if the input future does not complete before 3537s ``timeout``, which may be specified in any form allowed by 3537s `.IOLoop.add_timeout` (i.e. a `datetime.timedelta` or an absolute time 3537s relative to `.IOLoop.time`) 3537s 3537s Similarly, when the user requires a certain source port, it can 3537s be specified using the ``source_port`` arg. 3537s 3537s .. versionchanged:: 4.5 3537s Added the ``source_ip`` and ``source_port`` arguments. 3537s 3537s .. versionchanged:: 5.0 3537s Added the ``timeout`` argument. 3537s """ 3537s if timeout is not None: 3537s if isinstance(timeout, numbers.Real): 3537s timeout = IOLoop.current().time() + timeout 3537s elif isinstance(timeout, datetime.timedelta): 3537s timeout = IOLoop.current().time() + timeout.total_seconds() 3537s else: 3537s raise TypeError("Unsupported timeout %r" % timeout) 3537s if timeout is not None: 3537s addrinfo = await gen.with_timeout( 3537s timeout, self.resolver.resolve(host, port, af) 3537s ) 3537s else: 3537s addrinfo = await self.resolver.resolve(host, port, af) 3537s connector = _Connector( 3537s addrinfo, 3537s functools.partial( 3537s self._create_stream, 3537s max_buffer_size, 3537s source_ip=source_ip, 3537s source_port=source_port, 3537s ), 3537s ) 3537s > af, addr, stream = await connector.start(connect_timeout=timeout) 3537s E asyncio.exceptions.CancelledError 3537s 3537s /usr/lib/python3/dist-packages/tornado/tcpclient.py:279: CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s self = 3537s 3537s @final 3537s async def start(self): 3537s async with self._startup_lock: 3537s if self.status == Status.failed: 3537s assert self.__startup_exc is not None 3537s raise self.__startup_exc 3537s elif self.status != Status.init: 3537s return self 3537s timeout = getattr(self, "death_timeout", None) 3537s 3537s async def _close_on_failure(exc: Exception) -> None: 3537s await self.close(reason=f"failure-to-start-{str(type(exc))}") 3537s self.status = Status.failed 3537s self.__startup_exc = exc 3537s 3537s try: 3537s > await wait_for(self.start_unsafe(), timeout=timeout) 3537s 3537s /usr/lib/python3/dist-packages/distributed/core.py:664: 3537s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3537s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 3537s async with asyncio.timeout(timeout): 3537s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3537s 3537s self = 3537s exc_type = 3537s exc_val = CancelledError(), exc_tb = 3537s 3537s async def __aexit__( 3537s self, 3537s exc_type: Optional[Type[BaseException]], 3537s exc_val: Optional[BaseException], 3537s exc_tb: Optional[TracebackType], 3537s ) -> Optional[bool]: 3537s assert self._state in (_State.ENTERED, _State.EXPIRING) 3537s 3537s if self._timeout_handler is not None: 3537s self._timeout_handler.cancel() 3537s self._timeout_handler = None 3537s 3537s if self._state is _State.EXPIRING: 3537s self._state = _State.EXPIRED 3537s 3537s if self._task.uncancel() <= self._cancelling and exc_type is not None: 3537s # Since there are no new cancel requests, we're 3537s # handling this. 3537s if issubclass(exc_type, exceptions.CancelledError): 3537s > raise TimeoutError from exc_val 3537s E TimeoutError 3537s 3537s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s @contextlib.asynccontextmanager 3537s async def _cluster_factory(): 3537s workers = [] 3537s s = None 3537s try: 3537s for _ in range(60): 3537s try: 3537s > s, ws = await start_cluster( 3537s nthreads, 3537s scheduler, 3537s security=security, 3537s Worker=Worker, 3537s scheduler_kwargs=scheduler_kwargs, 3537s worker_kwargs=merge( 3537s {"death_timeout": min(15, int(deadline.remaining))}, 3537s worker_kwargs, 3537s ), 3537s ) 3537s 3537s /usr/lib/python3/dist-packages/distributed/utils_test.py:966: 3537s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3537s /usr/lib/python3/dist-packages/distributed/utils_test.py:789: in start_cluster 3537s await asyncio.gather(*workers) 3537s /usr/lib/python3.13/asyncio/tasks.py:737: in _wrap_awaitable 3537s return await awaitable 3537s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3537s 3537s self = 3537s 3537s @final 3537s async def start(self): 3537s async with self._startup_lock: 3537s if self.status == Status.failed: 3537s assert self.__startup_exc is not None 3537s raise self.__startup_exc 3537s elif self.status != Status.init: 3537s return self 3537s timeout = getattr(self, "death_timeout", None) 3537s 3537s async def _close_on_failure(exc: Exception) -> None: 3537s await self.close(reason=f"failure-to-start-{str(type(exc))}") 3537s self.status = Status.failed 3537s self.__startup_exc = exc 3537s 3537s try: 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s except asyncio.TimeoutError as exc: 3537s await _close_on_failure(exc) 3537s > raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s E TimeoutError: Worker start timed out after 0s. 3537s 3537s /usr/lib/python3/dist-packages/distributed/core.py:667: TimeoutError 3537s 3537s During handling of the above exception, another exception occurred: 3537s 3537s fut = ._..test_func..async_fn at 0xe247cb08> 3537s timeout = 60 3537s 3537s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 3537s async with asyncio.timeout(timeout): 3537s > return await fut 3537s 3537s /usr/lib/python3/dist-packages/distributed/utils.py:1960: 3537s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3537s /usr/lib/python3/dist-packages/distributed/utils_test.py:999: in async_fn 3537s _cluster_factory() as (s, workers), 3537s /usr/lib/python3.13/contextlib.py:214: in __aenter__ 3537s return await anext(self.gen) 3537s /usr/lib/python3/dist-packages/distributed/utils_test.py:983: in _cluster_factory 3537s await asyncio.sleep(1) 3537s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3537s 3537s delay = 1, result = None 3537s 3537s async def sleep(delay, result=None): 3537s """Coroutine that completes after a given time (in seconds).""" 3537s if delay <= 0: 3537s await __sleep0() 3537s return result 3537s 3537s if math.isnan(delay): 3537s raise ValueError("Invalid delay: NaN (not a number)") 3537s 3537s loop = events.get_running_loop() 3537s future = loop.create_future() 3537s h = loop.call_later(delay, 3537s futures._set_result_unless_cancelled, 3537s future, result) 3537s try: 3537s > return await future 3537s E asyncio.exceptions.CancelledError 3537s 3537s /usr/lib/python3.13/asyncio/tasks.py:718: CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s args = (), kwds = {} 3537s 3537s @wraps(func) 3537s def inner(*args, **kwds): 3537s with self._recreate_cm(): 3537s > return func(*args, **kwds) 3537s 3537s /usr/lib/python3.13/contextlib.py:85: 3537s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3537s /usr/lib/python3.13/contextlib.py:85: in inner 3537s return func(*args, **kwds) 3537s /usr/lib/python3/dist-packages/distributed/utils_test.py:1102: in test_func 3537s return _run_and_close_tornado(async_fn_outer) 3537s /usr/lib/python3/dist-packages/distributed/utils_test.py:378: in _run_and_close_tornado 3537s return asyncio_run(inner_fn(), loop_factory=get_loop_factory()) 3537s /usr/lib/python3.13/asyncio/runners.py:194: in run 3537s return runner.run(main) 3537s /usr/lib/python3.13/asyncio/runners.py:118: in run 3537s return self._loop.run_until_complete(task) 3537s /usr/lib/python3.13/asyncio/base_events.py:720: in run_until_complete 3537s return future.result() 3537s /usr/lib/python3/dist-packages/distributed/utils_test.py:375: in inner_fn 3537s return await async_fn(*args, **kwargs) 3537s /usr/lib/python3/dist-packages/distributed/utils_test.py:1099: in async_fn_outer 3537s return await utils_wait_for(async_fn(), timeout=timeout * 2) 3537s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 3537s async with asyncio.timeout(timeout): 3537s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3537s 3537s self = 3537s exc_type = 3537s exc_val = CancelledError(), exc_tb = 3537s 3537s async def __aexit__( 3537s self, 3537s exc_type: Optional[Type[BaseException]], 3537s exc_val: Optional[BaseException], 3537s exc_tb: Optional[TracebackType], 3537s ) -> Optional[bool]: 3537s assert self._state in (_State.ENTERED, _State.EXPIRING) 3537s 3537s if self._timeout_handler is not None: 3537s self._timeout_handler.cancel() 3537s self._timeout_handler = None 3537s 3537s if self._state is _State.EXPIRING: 3537s self._state = _State.EXPIRED 3537s 3537s if self._task.uncancel() <= self._cancelling and exc_type is not None: 3537s # Since there are no new cancel requests, we're 3537s # handling this. 3537s if issubclass(exc_type, exceptions.CancelledError): 3537s > raise TimeoutError from exc_val 3537s E TimeoutError 3537s 3537s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 3537s ----------------------------- Captured stderr call ----------------------------- 3537s 2024-11-23 21:26:26,941 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:26:26,949 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:26,949 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43869/status 3537s 2024-11-23 21:26:26,949 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:26:26,966 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34533 3537s 2024-11-23 21:26:26,967 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34533 3537s 2024-11-23 21:26:26,967 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:26:26,967 - distributed.worker - INFO - dashboard at: 127.0.0.1:39545 3537s 2024-11-23 21:26:26,967 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:26,967 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:26:26,967 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:26:26,967 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:26:26,967 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-rb1h3dgn 3537s 2024-11-23 21:26:26,967 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:26:26,970 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39709 3537s 2024-11-23 21:26:26,970 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39709 3537s 2024-11-23 21:26:26,970 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:26:26,970 - distributed.worker - INFO - dashboard at: 127.0.0.1:35423 3537s 2024-11-23 21:26:26,972 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:26,972 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:26:26,972 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:26:26,972 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:26:26,972 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-3eid0alz 3537s 2024-11-23 21:26:26,972 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:26:26,986 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:26,987 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:26,987 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:34314': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:26,987 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:34324': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:27,101 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:27,102 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:27,102 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:34328': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:27,102 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:34338': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:27,215 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:27,216 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:27,216 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:34340': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:27,216 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:34352': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:27,330 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:27,330 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:27,330 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:34360': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:27,331 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:34370': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:27,443 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:27,444 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:27,444 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:34372': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:27,444 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:34382': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:27,558 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:27,559 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:27,559 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:34394': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:27,559 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:34402': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:27,672 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:27,673 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:27,673 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:34418': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:27,673 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:34432': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:27,786 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:27,787 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:27,787 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:34434': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:27,787 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:34440': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:27,901 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:27,902 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:27,902 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:34454': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:27,903 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:34458': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:28,015 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:28,016 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:28,016 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:34460': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:28,016 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:34468': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:28,129 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:28,129 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:28,130 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:34474': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:28,130 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:34476': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:28,243 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:28,243 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:28,244 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:34478': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:28,244 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:34492': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:28,372 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:28,372 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:28,374 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:34506': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:28,374 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:34520': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:28,486 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:28,486 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:28,487 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:34524': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:28,487 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:34540': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:28,602 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:28,602 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:28,603 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:34544': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:28,603 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:34558': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:28,716 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:28,716 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:28,716 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:34570': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:28,717 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:34580': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:28,831 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:28,831 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:28,831 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:34592': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:28,831 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:34594': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:28,944 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:28,945 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:28,945 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:34598': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:28,945 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:34610': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:29,059 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:29,059 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:29,060 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:34614': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:29,060 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:34630': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:29,174 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:29,174 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:29,175 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:34636': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:29,175 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:34650': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:29,288 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:29,288 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:29,289 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:34666': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:29,289 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:34668': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:29,402 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:29,402 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:29,403 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:34670': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:29,403 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:34672': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:29,516 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:29,517 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:29,517 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:34674': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:29,517 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:34682': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:29,631 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:29,631 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:29,632 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:34686': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:29,632 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:34698': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:29,745 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:29,745 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:29,745 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:34708': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:29,746 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:34722': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:29,858 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:29,859 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:29,859 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:34728': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:29,859 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:34738': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:29,972 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:29,973 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:29,973 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:34746': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:29,973 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:34762': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:30,087 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:30,088 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:30,088 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:34774': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:30,088 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:34780': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:30,201 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:30,201 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:30,202 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:34788': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:30,202 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:34798': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:30,315 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:30,315 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:30,315 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:34812': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:30,315 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:34820': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:30,428 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:30,429 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:30,429 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:34830': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:30,429 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:34844': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:30,543 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:30,544 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:30,544 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:34850': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:30,544 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:34852': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:30,657 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:30,658 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:30,659 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:34866': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:30,659 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:34878': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:30,772 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:30,772 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:30,772 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:34892': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:30,773 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:34902': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:30,885 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:30,885 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:30,886 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:34914': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:30,886 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:34924': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:30,999 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:30,999 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:31,000 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:34938': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:31,000 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:34942': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:31,112 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:31,113 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:31,113 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:34952': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:31,113 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:34960': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:31,227 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:31,227 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:31,228 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:34962': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:31,228 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:34974': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:31,341 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:31,342 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:31,342 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:34976': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:31,342 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:34986': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:31,455 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:31,455 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:31,459 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:34998': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:31,459 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:35000': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:31,569 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:31,569 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:31,570 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:45490': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:31,570 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:45494': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:31,701 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:31,701 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:31,701 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:45506': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:31,702 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:45520': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:31,815 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:31,815 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:31,815 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:45522': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:31,815 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:45536': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:31,928 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:31,928 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:31,929 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:45542': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:31,929 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:45548': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:32,041 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:32,042 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:32,042 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:45558': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:32,042 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:45568': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:32,156 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:32,156 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:32,157 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:45580': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:32,157 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:45582': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:32,270 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:32,271 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:32,271 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:45588': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:32,271 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:45594': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:32,384 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:32,384 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:32,384 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:45600': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:32,385 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:45610': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:32,499 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:32,499 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:32,499 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:45622': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:32,499 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:45632': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:32,613 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:32,613 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:32,614 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:45638': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:32,614 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:45654': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:32,728 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:32,728 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:32,729 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:45664': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:32,729 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:45680': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:32,842 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:32,842 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:32,842 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:45686': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:32,842 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:45696': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:32,955 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:32,956 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:32,959 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:45698': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:32,960 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:45712': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:33,070 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:33,071 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:33,071 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:45718': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:33,071 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:45722': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:33,184 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:33,184 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:33,184 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:45724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:33,184 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:45728': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:33,297 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:33,297 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:33,298 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:45742': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:33,298 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:45752': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:33,412 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:33,412 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:33,412 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:45754': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:33,413 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:45768': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:33,526 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:33,526 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:33,527 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:45784': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:33,527 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:45786': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:33,639 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:33,639 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:33,640 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:45790': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:33,640 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:45798': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:33,753 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:33,753 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:33,754 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:45802': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:33,754 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:45818': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:33,866 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:33,866 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:33,867 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:45826': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:33,867 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:45828': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:33,974 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:33,979 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:45838': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:33,980 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:33,980 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:45850': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:34,082 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:34,083 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:45862': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:34,089 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:34,089 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:45864': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:34,190 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:34,190 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:45866': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:34,197 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:34,197 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:45876': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:34,299 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:34,300 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:45880': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:34,306 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:34,306 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:45882': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:34,407 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:34,407 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:45888': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:34,414 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:34,414 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:45898': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:34,515 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:34,516 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:45902': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:34,522 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:34,523 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:45918': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:34,622 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:34,623 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:45934': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:34,630 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:34,630 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:45948': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:34,730 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:34,730 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:45962': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:34,737 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:34,737 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:45974': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:34,838 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:34,838 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:45990': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:34,845 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:34,845 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:46006': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:34,946 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:34,946 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:46010': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:34,955 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:34,959 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:46024': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:35,054 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:35,055 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:46028': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:35,062 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:35,062 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:46042': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:35,162 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:35,162 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:46054': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:35,169 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:35,169 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:46064': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:35,269 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:35,270 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:46066': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:35,276 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:35,277 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:46074': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:35,377 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:35,377 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:46080': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:35,384 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:35,385 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:46090': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:35,485 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:35,486 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:46096': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:35,493 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:35,493 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:46102': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:35,595 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:35,596 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:46114': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:35,615 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:35,616 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:46128': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:35,703 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:35,704 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:46132': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:35,723 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:35,724 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:46146': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:35,811 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:35,812 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:46154': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:35,831 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:35,832 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:46158': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:35,919 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:35,920 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:46168': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:35,939 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:35,940 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:46176': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:36,028 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:36,029 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:46192': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:36,047 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:36,048 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:46206': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:36,136 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:36,137 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:46218': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:36,155 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:36,156 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:46224': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:36,245 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:36,245 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:46236': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:36,263 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:36,264 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:46248': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:36,353 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:36,354 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:46264': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:36,371 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:36,371 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:46266': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:36,461 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:36,462 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:46268': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:36,479 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:36,479 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:46274': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:36,571 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:36,571 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:46282': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:36,587 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:36,587 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:46286': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:36,679 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:36,680 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:46300': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:36,695 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:36,695 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:46304': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:36,788 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:36,788 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:46312': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:36,802 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:36,803 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:46318': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:36,895 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:36,896 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:46322': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:36,910 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:36,911 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:46332': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:37,004 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:37,004 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:46340': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:37,018 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:37,019 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:46352': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:37,111 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:37,112 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:46356': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:37,126 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:37,126 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:46372': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:37,220 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:37,220 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:46378': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:37,233 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:37,234 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:46394': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:37,328 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:37,328 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:46406': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:37,341 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:37,342 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:46414': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:37,435 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:37,436 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:46418': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:37,449 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:37,450 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:46428': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:37,543 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:37,544 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:46440': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:37,557 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:37,558 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:46450': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:37,651 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:37,652 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:46462': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:37,665 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:37,665 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:46476': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:37,759 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:37,760 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:46488': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:37,774 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:37,775 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:46498': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:37,868 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:37,869 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:46504': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:37,882 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:37,882 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:46512': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:37,977 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:37,977 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:46526': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:37,989 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:37,990 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:46540': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:38,085 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:38,087 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:46548': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:38,097 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:38,097 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:46556': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:38,195 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:38,196 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:46558': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:38,205 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:38,205 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:46566': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:38,303 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:38,304 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:46574': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:38,312 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:38,313 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:46576': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:38,411 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:38,412 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:46592': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:38,420 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:38,420 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:46608': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:38,519 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:38,520 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:46610': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:38,527 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:38,528 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:46616': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:38,627 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:38,627 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:46630': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:38,635 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:38,635 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:46634': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:38,734 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:38,735 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:46646': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:38,742 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:38,743 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:46648': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:38,842 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:38,843 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:46654': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:38,849 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:38,850 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:46668': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:38,950 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:38,951 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:46682': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:38,961 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:38,961 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:46694': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:39,057 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:39,058 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:46702': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:39,067 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:39,068 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:46704': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:39,165 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:39,166 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:46706': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:39,175 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:39,175 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:46712': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:39,273 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:39,273 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:46718': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:39,282 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:39,282 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:46722': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:39,381 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:39,382 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:46738': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:39,390 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:39,390 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:46742': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:39,489 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:39,490 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:46744': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:39,496 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:39,497 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:46750': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:39,598 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:39,600 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:46758': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:39,606 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:39,607 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:46764': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:39,706 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:39,706 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:46776': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:39,714 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:39,714 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:46792': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:39,813 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:39,814 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:46798': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:39,821 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:39,822 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:46808': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:39,921 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:39,922 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:46824': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:39,928 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:39,929 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:46838': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:40,030 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:40,031 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:46840': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:40,037 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:40,037 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:46842': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:40,137 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:40,138 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:46858': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:40,144 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:40,145 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:46864': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:40,244 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:40,245 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:46868': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:40,251 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:40,252 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:46882': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:40,352 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:40,353 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:46896': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:40,359 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:40,360 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:46910': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:40,460 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:40,461 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:46916': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:40,467 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:40,467 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:46926': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:40,569 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:40,570 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:46936': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:40,576 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:40,577 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:46948': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:40,677 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:40,678 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:46962': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:40,684 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:40,685 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:46972': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:40,785 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:40,786 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:46974': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:40,793 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:40,793 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:46976': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:40,893 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:40,894 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:46982': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:40,900 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:40,901 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:46988': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:41,001 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:41,001 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:46990': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:41,008 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:41,009 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:47002': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:41,108 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:41,109 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:47016': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:41,115 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:41,116 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:47022': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:41,217 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:41,218 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:47028': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:41,224 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:41,224 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:47034': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:41,325 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:41,326 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:47050': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:41,332 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:41,333 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:47066': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:41,434 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:41,435 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:47078': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:41,441 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:41,441 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:47086': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:41,541 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:41,542 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:34570': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:41,548 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:41,549 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:34580': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:41,649 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:41,650 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:34586': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:41,656 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:41,657 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:34588': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:41,757 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:41,758 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:34598': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:41,765 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:41,765 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:34612': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:41,865 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:41,865 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:34622': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:41,872 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33065 3537s 2024-11-23 21:26:41,872 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33065': TLS handshake failed with remote 'tls://127.0.0.1:34632': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:41,965 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34533. Reason: failure-to-start- 3537s 2024-11-23 21:26:41,965 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:26:41,967 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 15s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 3537s stream = await stream.start_tls( 3537s ^^^^^^^^^^^^^^^^^^^^^^^ 3537s False, ssl_options=ssl_options, server_hostname=host 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 3537s self.socket.do_handshake() 3537s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 3537s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 3537s self._sslobj.do_handshake() 3537s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 3537s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 3537s raise FatalCommClosedError( 3537s ...<2 lines>... 3537s ) from err 3537s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 3537s 3537s During handling of the above exception, another exception occurred: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1218, in _register_with_scheduler 3537s await asyncio.sleep(0.1) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 718, in sleep 3537s return await future 3537s ^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 15s. 3537s 2024-11-23 21:26:41,971 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39709. Reason: failure-to-start- 3537s 2024-11-23 21:26:41,972 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:26:42,976 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:26:42,985 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:42,985 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37803/status 3537s 2024-11-23 21:26:42,986 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:26:43,014 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38991 3537s 2024-11-23 21:26:43,015 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38991 3537s 2024-11-23 21:26:43,015 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:26:43,015 - distributed.worker - INFO - dashboard at: 127.0.0.1:33783 3537s 2024-11-23 21:26:43,015 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:43,015 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:26:43,015 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:26:43,015 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:26:43,015 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-b1egctmp 3537s 2024-11-23 21:26:43,015 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:26:43,017 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38957 3537s 2024-11-23 21:26:43,017 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38957 3537s 2024-11-23 21:26:43,017 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:26:43,018 - distributed.worker - INFO - dashboard at: 127.0.0.1:44847 3537s 2024-11-23 21:26:43,018 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:43,018 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:26:43,018 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:26:43,018 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:26:43,018 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-dj6hv6iq 3537s 2024-11-23 21:26:43,018 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:26:43,031 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:43,031 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:43,031 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:33830': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:43,032 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:33842': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:43,144 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:43,145 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:43,145 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:33856': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:43,145 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:33860': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:43,258 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:43,259 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:43,259 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:33874': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:43,259 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:33880': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:43,372 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:43,372 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:43,372 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:33882': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:43,372 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:33890': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:43,485 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:43,485 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:43,486 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:33902': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:43,486 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:33908': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:43,600 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:43,601 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:43,601 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:33922': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:43,601 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:33932': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:43,712 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:43,714 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:43,714 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:33942': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:43,714 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:33948': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:43,822 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:43,826 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:33960': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:43,827 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:43,828 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:33968': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:43,930 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:43,931 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:33970': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:43,937 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:43,937 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:33978': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:44,037 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:44,038 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:33980': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:44,044 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:44,044 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:33996': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:44,146 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:44,147 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:34010': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:44,153 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:44,155 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:34024': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:44,255 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:44,255 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:34034': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:44,262 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:44,262 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:34040': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:44,362 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:44,363 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:34046': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:44,370 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:44,370 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:34048': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:44,471 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:44,472 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:34056': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:44,478 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:44,479 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:34058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:44,579 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:44,580 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:34064': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:44,586 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:44,587 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:34072': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:44,687 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:44,687 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:34084': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:44,694 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:44,694 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:34090': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:44,796 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:44,797 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:34098': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:44,803 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:44,803 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:34106': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:44,903 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:44,904 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:34116': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:44,910 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:44,911 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:34120': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:45,011 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:45,012 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:34128': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:45,019 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:45,019 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:34132': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:45,119 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:45,120 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:34138': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:45,126 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:45,127 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:34150': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:45,226 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:45,227 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:34158': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:45,233 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:45,234 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:34160': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:45,334 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:45,335 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:34170': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:45,341 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:45,342 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:34182': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:45,443 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:45,444 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:34186': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:45,450 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:45,450 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:34192': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:45,550 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:45,551 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:34202': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:45,558 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:45,558 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:34206': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:45,658 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:45,658 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:34214': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:45,666 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:45,667 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:34220': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:45,766 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:45,766 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:34230': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:45,774 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:45,774 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:34242': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:45,874 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:45,874 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:34254': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:45,881 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:45,881 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:34260': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:45,981 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:45,982 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:34262': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:45,989 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:45,993 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:34268': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:46,089 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:46,090 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:34270': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:46,097 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:46,097 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:34284': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:46,197 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:46,198 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:34294': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:46,204 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:46,205 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:34300': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:46,305 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:46,306 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:34316': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:46,313 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:46,313 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:34328': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:46,414 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:46,415 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:34342': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:46,421 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:46,422 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:34356': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:46,524 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:46,525 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:34366': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:46,531 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:46,531 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:34370': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:46,631 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:46,632 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:34382': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:46,638 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:46,639 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:34386': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:46,739 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:46,740 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:34394': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:46,746 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:46,747 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:34402': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:46,848 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:46,849 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:34408': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:46,855 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:46,856 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:34414': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:46,959 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:46,960 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:34420': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:46,966 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:46,967 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:34426': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:47,067 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:47,068 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:34428': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:47,074 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:47,074 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:34436': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:47,177 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:47,177 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:34440': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:47,184 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:47,184 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:34450': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:47,284 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:47,285 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:34458': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:47,292 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:47,292 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:34468': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:47,394 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:47,395 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:34476': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:47,401 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:47,402 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:34490': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:47,502 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:47,502 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:34502': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:47,509 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:47,509 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:34518': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:47,610 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:47,611 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:34520': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:47,617 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:47,618 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:34536': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:47,719 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:47,720 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:34552': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:47,727 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:47,727 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:34558': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:47,828 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:47,828 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:34564': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:47,835 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:47,835 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:34568': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:47,935 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:47,936 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:34580': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:47,942 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:47,943 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:34596': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:48,043 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:48,044 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:34612': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:48,050 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:48,051 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:34628': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:48,151 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:48,153 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:34632': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:48,159 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:48,159 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:34638': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:48,260 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:48,260 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:34642': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:48,266 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:48,267 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:34646': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:48,367 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:48,368 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:34658': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:48,374 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:48,374 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:34662': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:48,475 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:48,476 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:34670': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:48,483 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:48,483 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:34682': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:48,585 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:48,586 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:34692': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:48,592 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:48,592 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:34694': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:48,692 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:48,693 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:34710': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:48,700 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:48,700 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:34712': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:48,812 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:48,813 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:34724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:48,818 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:48,819 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:34728': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:48,920 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:48,921 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:34736': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:48,927 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:48,927 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:34752': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:49,028 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:49,029 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:34754': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:49,036 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:49,037 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:34764': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:49,136 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:49,137 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:34768': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:49,143 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:49,144 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:34772': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:49,244 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:49,245 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:34788': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:49,252 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:49,252 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:34796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:49,354 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:49,355 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:34802': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:49,361 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:49,361 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:34804': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:49,461 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:49,462 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:34820': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:49,468 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:49,469 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:34834': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:49,569 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:49,569 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:34836': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:49,576 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:49,576 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:34850': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:49,677 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:49,677 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:34862': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:49,684 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:49,684 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:34872': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:49,785 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:49,785 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:34874': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:49,792 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:49,792 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:34888': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:49,893 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:49,893 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:34902': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:49,900 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:49,900 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:34918': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:50,001 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:50,003 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:34930': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:50,009 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:50,010 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:34946': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:50,110 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:50,111 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:34958': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:50,117 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:50,118 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:34966': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:50,219 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:50,221 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:34978': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:50,227 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:50,228 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:34982': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:50,327 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:50,328 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:34988': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:50,334 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:50,335 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:34994': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:50,435 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:50,435 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:35008': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:50,442 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:50,442 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:35018': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:50,543 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:50,544 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:35028': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:50,550 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:50,551 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:35040': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:50,655 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:50,656 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:35050': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:50,662 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:50,663 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:35058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:50,763 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:50,764 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:35062': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:50,770 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:50,771 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:35072': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:50,872 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:50,872 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:35082': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:50,879 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:50,879 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:35094': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:50,980 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:50,980 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:35100': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:50,987 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:50,991 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:35112': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:51,088 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:51,088 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:35124': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:51,095 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:51,095 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:35138': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:51,195 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:51,195 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:35150': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:51,202 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:51,203 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:35154': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:51,304 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:51,305 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:35162': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:51,311 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:51,312 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:35168': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:51,412 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:51,412 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:35180': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:51,419 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:51,419 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:35184': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:51,519 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:51,520 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:35194': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:51,526 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:51,526 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:35200': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:51,626 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:51,627 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:46360': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:51,633 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:51,634 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:46362': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:51,735 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:51,736 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:46378': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:51,742 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:51,742 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:46390': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:51,842 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:51,842 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:46400': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:51,849 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:51,849 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:46410': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:51,950 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:51,951 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:46418': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:51,961 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:51,962 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:46432': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:52,058 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:52,059 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:46444': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:52,069 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:52,069 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:46460': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:52,167 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:52,168 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:46472': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:52,176 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:52,177 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:46488': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:52,275 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:52,276 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:46504': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:52,285 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:52,285 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:46518': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:52,384 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:52,385 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:46534': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:52,393 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:52,393 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:46548': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:52,496 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:52,497 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:46556': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:52,503 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:52,503 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:46558': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:52,603 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:52,604 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:46564': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:52,610 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:52,611 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:46572': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:52,711 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:52,711 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:46586': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:52,718 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:52,718 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:46596': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:52,818 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:52,819 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:46602': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:52,825 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:52,826 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:46614': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:52,926 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:52,926 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:46624': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:52,933 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:52,933 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:46628': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:53,034 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:53,034 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:46644': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:53,041 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:53,041 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:46656': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:53,141 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:53,142 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:46658': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:53,148 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:53,149 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:46662': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:53,249 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:53,250 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:46668': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:53,256 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:53,257 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:46680': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:53,358 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:53,358 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:46694': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:53,365 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:53,365 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:46708': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:53,466 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:53,467 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:46712': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:53,473 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:53,474 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:46726': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:53,575 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:53,576 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:46738': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:53,582 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:53,582 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:46746': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:53,683 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:53,683 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:46756': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:53,690 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:53,690 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:46772': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:53,791 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:53,792 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:46778': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:53,798 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:53,799 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:46792': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:53,899 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:53,899 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:46800': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:53,906 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:53,906 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:46814': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:54,007 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:54,007 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:46830': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:54,014 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:54,014 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:46846': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:54,115 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:54,115 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:46854': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:54,122 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:54,122 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:46862': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:54,222 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:54,223 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:46866': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:54,229 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:54,229 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:46868': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:54,331 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:54,332 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:46878': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:54,338 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:54,339 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:46892': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:54,439 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:54,439 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:46902': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:54,446 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:54,446 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:46910': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:54,547 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:54,547 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:46914': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:54,554 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:54,555 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:46930': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:54,654 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:54,655 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:46934': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:54,662 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:54,662 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:46938': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:54,763 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:54,763 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:46948': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:54,781 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:54,782 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:46964': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:54,871 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:54,872 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:46976': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:54,889 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:54,890 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:46978': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:54,980 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:54,981 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:46990': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:54,997 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:54,998 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:46992': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:55,088 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:55,089 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:47002': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:55,106 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:55,106 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:47014': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:55,197 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:55,198 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:47020': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:55,213 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:55,213 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:47022': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:55,305 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:55,305 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:47026': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:55,322 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:55,323 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:47040': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:55,414 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:55,414 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:47044': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:55,431 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:55,432 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:47050': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:55,522 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:55,523 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:47066': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:55,540 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:55,540 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:47080': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:55,632 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:55,633 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:47086': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:55,648 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:55,648 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:47102': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:55,740 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:55,741 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:47116': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:55,755 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:55,755 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:47128': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:55,848 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:55,849 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:47134': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:55,863 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:55,863 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:47142': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:55,960 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:55,960 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:47154': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:55,970 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41463 3537s 2024-11-23 21:26:55,971 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41463': TLS handshake failed with remote 'tls://127.0.0.1:47160': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 3537s 2024-11-23 21:26:56,013 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38991. Reason: failure-to-start- 3537s 2024-11-23 21:26:56,013 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:26:56,015 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 13s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 3537s stream = await stream.start_tls( 3537s ^^^^^^^^^^^^^^^^^^^^^^^ 3537s False, ssl_options=ssl_options, server_hostname=host 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 3537s self.socket.do_handshake() 3537s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 3537s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 3537s self._sslobj.do_handshake() 3537s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 3537s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 3537s raise FatalCommClosedError( 3537s ...<2 lines>... 3537s ) from err 3537s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 3537s 3537s During handling of the above exception, another exception occurred: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1218, in _register_with_scheduler 3537s await asyncio.sleep(0.1) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 718, in sleep 3537s return await future 3537s ^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 13s. 3537s 2024-11-23 21:26:56,019 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38957. Reason: failure-to-start- 3537s 2024-11-23 21:26:56,020 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:26:57,023 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:26:57,032 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35655 3537s 2024-11-23 21:26:57,032 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39373/status 3537s 2024-11-23 21:26:57,033 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:26:57,049 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34303 3537s 2024-11-23 21:26:57,049 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34303 3537s 2024-11-23 21:26:57,049 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:26:57,049 - distributed.worker - INFO - dashboard at: 127.0.0.1:37633 3537s 2024-11-23 21:26:57,049 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35655 3537s 2024-11-23 21:26:57,049 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:26:57,049 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:26:57,049 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:26:57,049 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-34vjn9bg 3537s 2024-11-23 21:26:57,049 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:26:57,051 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42361 3537s 2024-11-23 21:26:57,051 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42361 3537s 2024-11-23 21:26:57,052 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:26:57,052 - distributed.worker - INFO - dashboard at: 127.0.0.1:41375 3537s 2024-11-23 21:26:57,052 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35655 3537s 2024-11-23 21:26:57,052 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:26:57,052 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:26:57,052 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:26:57,052 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-zlctpwr4 3537s 2024-11-23 21:26:57,052 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:26:57,053 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34303. Reason: failure-to-start- 3537s 2024-11-23 21:26:57,053 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:26:57,054 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42361. Reason: failure-to-start- 3537s 2024-11-23 21:26:57,054 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:26:57,055 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35655': TLS handshake failed with remote 'tls://127.0.0.1:34880': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:26:57,055 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35655': TLS handshake failed with remote 'tls://127.0.0.1:34892': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:26:57,057 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:26:58,064 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:26:58,072 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40559 3537s 2024-11-23 21:26:58,073 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39383/status 3537s 2024-11-23 21:26:58,073 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:26:58,089 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36353 3537s 2024-11-23 21:26:58,089 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36353 3537s 2024-11-23 21:26:58,089 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:26:58,089 - distributed.worker - INFO - dashboard at: 127.0.0.1:38531 3537s 2024-11-23 21:26:58,089 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40559 3537s 2024-11-23 21:26:58,089 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:26:58,089 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:26:58,089 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:26:58,089 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ck60d2af 3537s 2024-11-23 21:26:58,089 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:26:58,091 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41139 3537s 2024-11-23 21:26:58,092 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41139 3537s 2024-11-23 21:26:58,092 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:26:58,092 - distributed.worker - INFO - dashboard at: 127.0.0.1:39101 3537s 2024-11-23 21:26:58,092 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40559 3537s 2024-11-23 21:26:58,092 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:26:58,092 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:26:58,092 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:26:58,092 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-aj0deckp 3537s 2024-11-23 21:26:58,092 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:26:58,093 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36353. Reason: failure-to-start- 3537s 2024-11-23 21:26:58,093 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:26:58,094 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41139. Reason: failure-to-start- 3537s 2024-11-23 21:26:58,094 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:26:58,095 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40559': TLS handshake failed with remote 'tls://127.0.0.1:40354': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:26:58,096 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40559': TLS handshake failed with remote 'tls://127.0.0.1:40356': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:26:58,097 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:26:59,104 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:26:59,114 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33071 3537s 2024-11-23 21:26:59,114 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46413/status 3537s 2024-11-23 21:26:59,114 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:26:59,130 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44307 3537s 2024-11-23 21:26:59,130 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44307 3537s 2024-11-23 21:26:59,130 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:26:59,130 - distributed.worker - INFO - dashboard at: 127.0.0.1:34317 3537s 2024-11-23 21:26:59,130 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33071 3537s 2024-11-23 21:26:59,131 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:26:59,131 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:26:59,131 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:26:59,131 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-2x1setf8 3537s 2024-11-23 21:26:59,131 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:26:59,133 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42911 3537s 2024-11-23 21:26:59,133 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42911 3537s 2024-11-23 21:26:59,133 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:26:59,133 - distributed.worker - INFO - dashboard at: 127.0.0.1:46081 3537s 2024-11-23 21:26:59,133 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33071 3537s 2024-11-23 21:26:59,133 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:26:59,134 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:26:59,134 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:26:59,134 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-34ln4o01 3537s 2024-11-23 21:26:59,134 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:26:59,135 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44307. Reason: failure-to-start- 3537s 2024-11-23 21:26:59,135 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:26:59,136 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42911. Reason: failure-to-start- 3537s 2024-11-23 21:26:59,136 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:26:59,137 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33071': TLS handshake failed with remote 'tls://127.0.0.1:33896': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:26:59,137 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33071': TLS handshake failed with remote 'tls://127.0.0.1:33902': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:26:59,139 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:27:00,144 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:27:00,153 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39251 3537s 2024-11-23 21:27:00,153 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46293/status 3537s 2024-11-23 21:27:00,153 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:27:00,171 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40949 3537s 2024-11-23 21:27:00,172 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40949 3537s 2024-11-23 21:27:00,172 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:27:00,172 - distributed.worker - INFO - dashboard at: 127.0.0.1:45377 3537s 2024-11-23 21:27:00,172 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39251 3537s 2024-11-23 21:27:00,172 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:27:00,172 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:27:00,172 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:27:00,172 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-e0w20_fd 3537s 2024-11-23 21:27:00,172 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:27:00,174 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35883 3537s 2024-11-23 21:27:00,175 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35883 3537s 2024-11-23 21:27:00,175 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:27:00,175 - distributed.worker - INFO - dashboard at: 127.0.0.1:37795 3537s 2024-11-23 21:27:00,175 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39251 3537s 2024-11-23 21:27:00,175 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:27:00,175 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:27:00,175 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:27:00,175 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ws948tpe 3537s 2024-11-23 21:27:00,175 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:27:00,176 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40949. Reason: failure-to-start- 3537s 2024-11-23 21:27:00,176 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:27:00,177 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35883. Reason: failure-to-start- 3537s 2024-11-23 21:27:00,177 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:27:00,178 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39251': TLS handshake failed with remote 'tls://127.0.0.1:33696': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:27:00,178 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39251': TLS handshake failed with remote 'tls://127.0.0.1:33702': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:27:00,180 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:27:01,187 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:27:01,196 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43831 3537s 2024-11-23 21:27:01,196 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44885/status 3537s 2024-11-23 21:27:01,197 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:27:01,214 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44447 3537s 2024-11-23 21:27:01,214 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44447 3537s 2024-11-23 21:27:01,214 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:27:01,214 - distributed.worker - INFO - dashboard at: 127.0.0.1:46001 3537s 2024-11-23 21:27:01,214 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43831 3537s 2024-11-23 21:27:01,214 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:27:01,214 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:27:01,214 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:27:01,214 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-soct708y 3537s 2024-11-23 21:27:01,214 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:27:01,217 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33057 3537s 2024-11-23 21:27:01,217 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33057 3537s 2024-11-23 21:27:01,217 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:27:01,217 - distributed.worker - INFO - dashboard at: 127.0.0.1:39889 3537s 2024-11-23 21:27:01,217 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43831 3537s 2024-11-23 21:27:01,217 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:27:01,217 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:27:01,217 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:27:01,217 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-qbw4su06 3537s 2024-11-23 21:27:01,218 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:27:01,221 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44447. Reason: failure-to-start- 3537s 2024-11-23 21:27:01,221 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:27:01,221 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33057. Reason: failure-to-start- 3537s 2024-11-23 21:27:01,222 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:27:01,223 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43831': TLS handshake failed with remote 'tls://127.0.0.1:51298': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:27:01,223 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43831': TLS handshake failed with remote 'tls://127.0.0.1:51314': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:27:01,225 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:27:02,231 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:27:02,240 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44037 3537s 2024-11-23 21:27:02,240 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37415/status 3537s 2024-11-23 21:27:02,240 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:27:02,255 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45095 3537s 2024-11-23 21:27:02,255 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45095 3537s 2024-11-23 21:27:02,255 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:27:02,255 - distributed.worker - INFO - dashboard at: 127.0.0.1:37711 3537s 2024-11-23 21:27:02,256 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44037 3537s 2024-11-23 21:27:02,256 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:27:02,256 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:27:02,256 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:27:02,256 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-tv1kpmdi 3537s 2024-11-23 21:27:02,256 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:27:02,258 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36633 3537s 2024-11-23 21:27:02,258 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36633 3537s 2024-11-23 21:27:02,258 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:27:02,258 - distributed.worker - INFO - dashboard at: 127.0.0.1:38369 3537s 2024-11-23 21:27:02,258 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44037 3537s 2024-11-23 21:27:02,258 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:27:02,258 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:27:02,258 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:27:02,258 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-lilv0dl_ 3537s 2024-11-23 21:27:02,259 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:27:02,260 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45095. Reason: failure-to-start- 3537s 2024-11-23 21:27:02,260 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:27:02,260 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36633. Reason: failure-to-start- 3537s 2024-11-23 21:27:02,260 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:27:02,262 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44037': TLS handshake failed with remote 'tls://127.0.0.1:42838': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:27:02,262 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44037': TLS handshake failed with remote 'tls://127.0.0.1:42850': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:27:02,264 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:27:03,270 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:27:03,279 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33481 3537s 2024-11-23 21:27:03,280 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33631/status 3537s 2024-11-23 21:27:03,280 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:27:03,296 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42681 3537s 2024-11-23 21:27:03,296 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42681 3537s 2024-11-23 21:27:03,296 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:27:03,296 - distributed.worker - INFO - dashboard at: 127.0.0.1:37797 3537s 2024-11-23 21:27:03,296 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33481 3537s 2024-11-23 21:27:03,296 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:27:03,296 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:27:03,296 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:27:03,296 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-xdwe5r23 3537s 2024-11-23 21:27:03,296 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:27:03,299 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35313 3537s 2024-11-23 21:27:03,299 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35313 3537s 2024-11-23 21:27:03,299 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:27:03,299 - distributed.worker - INFO - dashboard at: 127.0.0.1:41153 3537s 2024-11-23 21:27:03,299 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33481 3537s 2024-11-23 21:27:03,299 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:27:03,299 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:27:03,300 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:27:03,300 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-aq_1ddmh 3537s 2024-11-23 21:27:03,300 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:27:03,301 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42681. Reason: failure-to-start- 3537s 2024-11-23 21:27:03,301 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:27:03,302 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35313. Reason: failure-to-start- 3537s 2024-11-23 21:27:03,302 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:27:03,303 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33481': TLS handshake failed with remote 'tls://127.0.0.1:34172': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:27:03,303 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33481': TLS handshake failed with remote 'tls://127.0.0.1:34174': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:27:03,305 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:27:04,311 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:27:04,319 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37285 3537s 2024-11-23 21:27:04,319 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45843/status 3537s 2024-11-23 21:27:04,319 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:27:04,337 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46047 3537s 2024-11-23 21:27:04,337 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46047 3537s 2024-11-23 21:27:04,337 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:27:04,338 - distributed.worker - INFO - dashboard at: 127.0.0.1:44221 3537s 2024-11-23 21:27:04,338 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:27:04,338 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:27:04,338 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:27:04,338 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:27:04,338 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-w_41c9ao 3537s 2024-11-23 21:27:04,338 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:27:04,340 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43813 3537s 2024-11-23 21:27:04,340 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43813 3537s 2024-11-23 21:27:04,340 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:27:04,340 - distributed.worker - INFO - dashboard at: 127.0.0.1:40967 3537s 2024-11-23 21:27:04,340 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37285 3537s 2024-11-23 21:27:04,340 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:27:04,340 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:27:04,340 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:27:04,340 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-3bhd0l48 3537s 2024-11-23 21:27:04,341 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:27:04,342 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46047. Reason: failure-to-start- 3537s 2024-11-23 21:27:04,342 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:27:04,342 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43813. Reason: failure-to-start- 3537s 2024-11-23 21:27:04,343 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:27:04,344 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:49776': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:27:04,344 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37285': TLS handshake failed with remote 'tls://127.0.0.1:49792': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:27:04,346 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:27:05,353 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:27:05,362 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46327 3537s 2024-11-23 21:27:05,362 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42951/status 3537s 2024-11-23 21:27:05,362 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:27:05,379 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35415 3537s 2024-11-23 21:27:05,380 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35415 3537s 2024-11-23 21:27:05,380 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:27:05,380 - distributed.worker - INFO - dashboard at: 127.0.0.1:42033 3537s 2024-11-23 21:27:05,380 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46327 3537s 2024-11-23 21:27:05,380 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:27:05,380 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:27:05,380 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:27:05,380 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-vfgu9ww5 3537s 2024-11-23 21:27:05,380 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:27:05,383 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45549 3537s 2024-11-23 21:27:05,383 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45549 3537s 2024-11-23 21:27:05,383 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:27:05,384 - distributed.worker - INFO - dashboard at: 127.0.0.1:40335 3537s 2024-11-23 21:27:05,384 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46327 3537s 2024-11-23 21:27:05,384 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:27:05,384 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:27:05,384 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:27:05,384 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-7o7e9aac 3537s 2024-11-23 21:27:05,384 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:27:05,386 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35415. Reason: failure-to-start- 3537s 2024-11-23 21:27:05,386 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:27:05,386 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45549. Reason: failure-to-start- 3537s 2024-11-23 21:27:05,387 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:27:05,388 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46327': TLS handshake failed with remote 'tls://127.0.0.1:46404': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:27:05,388 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46327': TLS handshake failed with remote 'tls://127.0.0.1:46414': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:27:05,390 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:27:06,396 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:27:06,407 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40109 3537s 2024-11-23 21:27:06,407 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40687/status 3537s 2024-11-23 21:27:06,407 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:27:06,426 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40951 3537s 2024-11-23 21:27:06,426 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40951 3537s 2024-11-23 21:27:06,426 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:27:06,426 - distributed.worker - INFO - dashboard at: 127.0.0.1:44995 3537s 2024-11-23 21:27:06,426 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40109 3537s 2024-11-23 21:27:06,426 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:27:06,426 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:27:06,426 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:27:06,426 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-xnqp8so4 3537s 2024-11-23 21:27:06,426 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:27:06,429 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33549 3537s 2024-11-23 21:27:06,429 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33549 3537s 2024-11-23 21:27:06,429 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:27:06,429 - distributed.worker - INFO - dashboard at: 127.0.0.1:44655 3537s 2024-11-23 21:27:06,429 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40109 3537s 2024-11-23 21:27:06,429 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:27:06,429 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:27:06,429 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:27:06,429 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-poygnn_1 3537s 2024-11-23 21:27:06,429 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:27:06,431 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40951. Reason: failure-to-start- 3537s 2024-11-23 21:27:06,431 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:27:06,431 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33549. Reason: failure-to-start- 3537s 2024-11-23 21:27:06,432 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:27:06,433 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40109': TLS handshake failed with remote 'tls://127.0.0.1:42462': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:27:06,433 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40109': TLS handshake failed with remote 'tls://127.0.0.1:42478': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:27:06,435 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:27:07,443 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:27:07,451 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46027 3537s 2024-11-23 21:27:07,452 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43617/status 3537s 2024-11-23 21:27:07,452 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:27:07,470 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34715 3537s 2024-11-23 21:27:07,470 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34715 3537s 2024-11-23 21:27:07,470 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:27:07,470 - distributed.worker - INFO - dashboard at: 127.0.0.1:43699 3537s 2024-11-23 21:27:07,470 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46027 3537s 2024-11-23 21:27:07,470 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:27:07,470 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:27:07,471 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:27:07,471 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ql9wuqvf 3537s 2024-11-23 21:27:07,471 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:27:07,473 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41553 3537s 2024-11-23 21:27:07,473 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41553 3537s 2024-11-23 21:27:07,473 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:27:07,473 - distributed.worker - INFO - dashboard at: 127.0.0.1:36467 3537s 2024-11-23 21:27:07,474 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46027 3537s 2024-11-23 21:27:07,474 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:27:07,474 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:27:07,474 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:27:07,474 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-e81vccq2 3537s 2024-11-23 21:27:07,474 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:27:07,475 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34715. Reason: failure-to-start- 3537s 2024-11-23 21:27:07,475 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:27:07,476 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41553. Reason: failure-to-start- 3537s 2024-11-23 21:27:07,476 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:27:07,477 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46027': TLS handshake failed with remote 'tls://127.0.0.1:53366': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:27:07,477 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46027': TLS handshake failed with remote 'tls://127.0.0.1:53376': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:27:07,479 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:27:08,485 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:27:08,492 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45143 3537s 2024-11-23 21:27:08,493 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37337/status 3537s 2024-11-23 21:27:08,493 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:27:08,523 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40563 3537s 2024-11-23 21:27:08,523 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40563 3537s 2024-11-23 21:27:08,524 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:27:08,524 - distributed.worker - INFO - dashboard at: 127.0.0.1:34227 3537s 2024-11-23 21:27:08,524 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45143 3537s 2024-11-23 21:27:08,524 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:27:08,524 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:27:08,524 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:27:08,524 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-_th2b5ii 3537s 2024-11-23 21:27:08,524 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:27:08,526 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44065 3537s 2024-11-23 21:27:08,526 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44065 3537s 2024-11-23 21:27:08,526 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:27:08,526 - distributed.worker - INFO - dashboard at: 127.0.0.1:39757 3537s 2024-11-23 21:27:08,526 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45143 3537s 2024-11-23 21:27:08,526 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:27:08,526 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:27:08,526 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:27:08,527 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-vpeqqoa6 3537s 2024-11-23 21:27:08,527 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:27:08,528 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40563. Reason: failure-to-start- 3537s 2024-11-23 21:27:08,528 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:27:08,528 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44065. Reason: failure-to-start- 3537s 2024-11-23 21:27:08,529 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:27:08,530 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45143': TLS handshake failed with remote 'tls://127.0.0.1:33012': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:27:08,530 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45143': TLS handshake failed with remote 'tls://127.0.0.1:33024': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:27:08,532 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:27:09,539 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:27:09,547 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33683 3537s 2024-11-23 21:27:09,548 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38393/status 3537s 2024-11-23 21:27:09,548 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:27:09,564 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45195 3537s 2024-11-23 21:27:09,565 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45195 3537s 2024-11-23 21:27:09,565 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:27:09,565 - distributed.worker - INFO - dashboard at: 127.0.0.1:38413 3537s 2024-11-23 21:27:09,565 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33683 3537s 2024-11-23 21:27:09,565 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:27:09,565 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:27:09,565 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:27:09,565 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-qpjx9uuv 3537s 2024-11-23 21:27:09,565 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:27:09,569 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46705 3537s 2024-11-23 21:27:09,569 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46705 3537s 2024-11-23 21:27:09,569 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:27:09,569 - distributed.worker - INFO - dashboard at: 127.0.0.1:46651 3537s 2024-11-23 21:27:09,569 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33683 3537s 2024-11-23 21:27:09,569 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:27:09,569 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:27:09,569 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:27:09,569 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-hf34v8mb 3537s 2024-11-23 21:27:09,569 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:27:09,571 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45195. Reason: failure-to-start- 3537s 2024-11-23 21:27:09,571 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:27:09,571 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46705. Reason: failure-to-start- 3537s 2024-11-23 21:27:09,571 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:27:09,573 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33683': TLS handshake failed with remote 'tls://127.0.0.1:53232': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:27:09,573 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33683': TLS handshake failed with remote 'tls://127.0.0.1:53236': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:27:09,578 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:27:10,583 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:27:10,590 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38867 3537s 2024-11-23 21:27:10,591 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35061/status 3537s 2024-11-23 21:27:10,591 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:27:10,606 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36913 3537s 2024-11-23 21:27:10,606 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36913 3537s 2024-11-23 21:27:10,606 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:27:10,606 - distributed.worker - INFO - dashboard at: 127.0.0.1:36495 3537s 2024-11-23 21:27:10,606 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38867 3537s 2024-11-23 21:27:10,606 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:27:10,606 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:27:10,606 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:27:10,606 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ju97dscj 3537s 2024-11-23 21:27:10,607 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:27:10,609 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38819 3537s 2024-11-23 21:27:10,609 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38819 3537s 2024-11-23 21:27:10,609 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:27:10,609 - distributed.worker - INFO - dashboard at: 127.0.0.1:34231 3537s 2024-11-23 21:27:10,609 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38867 3537s 2024-11-23 21:27:10,609 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:27:10,609 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:27:10,609 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:27:10,609 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-r7z8jicm 3537s 2024-11-23 21:27:10,609 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:27:10,611 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36913. Reason: failure-to-start- 3537s 2024-11-23 21:27:10,611 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:27:10,611 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38819. Reason: failure-to-start- 3537s 2024-11-23 21:27:10,611 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:27:10,613 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38867': TLS handshake failed with remote 'tls://127.0.0.1:40650': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:27:10,613 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38867': TLS handshake failed with remote 'tls://127.0.0.1:40656': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:27:10,615 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:27:11,623 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:27:11,632 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41495 3537s 2024-11-23 21:27:11,632 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37347/status 3537s 2024-11-23 21:27:11,633 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:27:11,649 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36815 3537s 2024-11-23 21:27:11,650 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36815 3537s 2024-11-23 21:27:11,650 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:27:11,650 - distributed.worker - INFO - dashboard at: 127.0.0.1:38555 3537s 2024-11-23 21:27:11,650 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41495 3537s 2024-11-23 21:27:11,650 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:27:11,650 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:27:11,650 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:27:11,650 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-tvqsaed1 3537s 2024-11-23 21:27:11,650 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:27:11,653 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42083 3537s 2024-11-23 21:27:11,653 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42083 3537s 2024-11-23 21:27:11,653 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:27:11,653 - distributed.worker - INFO - dashboard at: 127.0.0.1:38447 3537s 2024-11-23 21:27:11,653 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41495 3537s 2024-11-23 21:27:11,653 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:27:11,653 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:27:11,653 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:27:11,653 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-uvboho9d 3537s 2024-11-23 21:27:11,653 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:27:11,655 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36815. Reason: failure-to-start- 3537s 2024-11-23 21:27:11,655 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:27:11,655 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42083. Reason: failure-to-start- 3537s 2024-11-23 21:27:11,655 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:27:11,660 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41495': TLS handshake failed with remote 'tls://127.0.0.1:47070': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:27:11,660 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41495': TLS handshake failed with remote 'tls://127.0.0.1:47086': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:27:11,662 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:27:12,667 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:27:12,675 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45333 3537s 2024-11-23 21:27:12,676 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34367/status 3537s 2024-11-23 21:27:12,676 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:27:12,693 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39759 3537s 2024-11-23 21:27:12,694 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39759 3537s 2024-11-23 21:27:12,694 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:27:12,694 - distributed.worker - INFO - dashboard at: 127.0.0.1:35309 3537s 2024-11-23 21:27:12,694 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45333 3537s 2024-11-23 21:27:12,694 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:27:12,694 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:27:12,694 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:27:12,694 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-o61oovv6 3537s 2024-11-23 21:27:12,694 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:27:12,697 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37839 3537s 2024-11-23 21:27:12,697 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37839 3537s 2024-11-23 21:27:12,697 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:27:12,697 - distributed.worker - INFO - dashboard at: 127.0.0.1:34337 3537s 2024-11-23 21:27:12,697 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45333 3537s 2024-11-23 21:27:12,697 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:27:12,697 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:27:12,697 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:27:12,697 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-xlq41i3b 3537s 2024-11-23 21:27:12,697 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:27:12,699 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39759. Reason: failure-to-start- 3537s 2024-11-23 21:27:12,699 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:27:12,700 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37839. Reason: failure-to-start- 3537s 2024-11-23 21:27:12,700 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:27:12,704 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45333': TLS handshake failed with remote 'tls://127.0.0.1:53456': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:27:12,704 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45333': TLS handshake failed with remote 'tls://127.0.0.1:53472': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:27:12,706 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:27:13,712 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:27:13,721 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38763 3537s 2024-11-23 21:27:13,721 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45681/status 3537s 2024-11-23 21:27:13,721 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:27:13,738 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35515 3537s 2024-11-23 21:27:13,739 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35515 3537s 2024-11-23 21:27:13,739 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:27:13,739 - distributed.worker - INFO - dashboard at: 127.0.0.1:44493 3537s 2024-11-23 21:27:13,739 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38763 3537s 2024-11-23 21:27:13,739 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:27:13,739 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:27:13,739 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:27:13,739 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-6fo_3n3m 3537s 2024-11-23 21:27:13,739 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:27:13,741 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43473 3537s 2024-11-23 21:27:13,742 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43473 3537s 2024-11-23 21:27:13,742 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:27:13,742 - distributed.worker - INFO - dashboard at: 127.0.0.1:43197 3537s 2024-11-23 21:27:13,742 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38763 3537s 2024-11-23 21:27:13,742 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:27:13,742 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:27:13,742 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:27:13,742 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-e5yeaaky 3537s 2024-11-23 21:27:13,742 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:27:13,744 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35515. Reason: failure-to-start- 3537s 2024-11-23 21:27:13,744 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:27:13,744 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43473. Reason: failure-to-start- 3537s 2024-11-23 21:27:13,744 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:27:13,748 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38763': TLS handshake failed with remote 'tls://127.0.0.1:38352': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:27:13,748 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38763': TLS handshake failed with remote 'tls://127.0.0.1:38358': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:27:13,750 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:27:14,757 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:27:14,765 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39255 3537s 2024-11-23 21:27:14,765 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46399/status 3537s 2024-11-23 21:27:14,765 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:27:14,780 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33303 3537s 2024-11-23 21:27:14,781 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33303 3537s 2024-11-23 21:27:14,781 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:27:14,781 - distributed.worker - INFO - dashboard at: 127.0.0.1:33801 3537s 2024-11-23 21:27:14,781 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39255 3537s 2024-11-23 21:27:14,781 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:27:14,781 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:27:14,781 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:27:14,781 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-52j1gp_u 3537s 2024-11-23 21:27:14,781 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:27:14,783 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39363 3537s 2024-11-23 21:27:14,783 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39363 3537s 2024-11-23 21:27:14,784 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:27:14,784 - distributed.worker - INFO - dashboard at: 127.0.0.1:43387 3537s 2024-11-23 21:27:14,784 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39255 3537s 2024-11-23 21:27:14,784 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:27:14,784 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:27:14,784 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:27:14,784 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-44bjxlt0 3537s 2024-11-23 21:27:14,784 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:27:14,787 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33303. Reason: failure-to-start- 3537s 2024-11-23 21:27:14,787 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:27:14,787 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39363. Reason: failure-to-start- 3537s 2024-11-23 21:27:14,788 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:27:14,791 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39255': TLS handshake failed with remote 'tls://127.0.0.1:57940': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:27:14,791 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39255': TLS handshake failed with remote 'tls://127.0.0.1:57950': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:27:14,793 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:27:15,799 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:27:15,807 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38529 3537s 2024-11-23 21:27:15,808 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41559/status 3537s 2024-11-23 21:27:15,808 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:27:15,824 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42451 3537s 2024-11-23 21:27:15,824 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42451 3537s 2024-11-23 21:27:15,824 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:27:15,824 - distributed.worker - INFO - dashboard at: 127.0.0.1:46251 3537s 2024-11-23 21:27:15,824 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38529 3537s 2024-11-23 21:27:15,824 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:27:15,825 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:27:15,825 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:27:15,825 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-_tem4d0u 3537s 2024-11-23 21:27:15,825 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:27:15,827 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33945 3537s 2024-11-23 21:27:15,827 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33945 3537s 2024-11-23 21:27:15,827 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:27:15,827 - distributed.worker - INFO - dashboard at: 127.0.0.1:35699 3537s 2024-11-23 21:27:15,827 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38529 3537s 2024-11-23 21:27:15,828 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:27:15,828 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:27:15,828 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:27:15,828 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-bd_843j2 3537s 2024-11-23 21:27:15,828 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:27:15,832 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42451. Reason: failure-to-start- 3537s 2024-11-23 21:27:15,832 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:27:15,832 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33945. Reason: failure-to-start- 3537s 2024-11-23 21:27:15,832 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:27:15,834 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38529': TLS handshake failed with remote 'tls://127.0.0.1:43374': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:27:15,834 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38529': TLS handshake failed with remote 'tls://127.0.0.1:43380': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:27:15,836 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:27:16,842 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:27:16,853 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34665 3537s 2024-11-23 21:27:16,853 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33793/status 3537s 2024-11-23 21:27:16,854 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:27:16,870 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33837 3537s 2024-11-23 21:27:16,870 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33837 3537s 2024-11-23 21:27:16,870 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:27:16,870 - distributed.worker - INFO - dashboard at: 127.0.0.1:44133 3537s 2024-11-23 21:27:16,870 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34665 3537s 2024-11-23 21:27:16,871 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:27:16,871 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:27:16,871 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:27:16,871 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-22p6in_m 3537s 2024-11-23 21:27:16,871 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:27:16,873 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37807 3537s 2024-11-23 21:27:16,873 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37807 3537s 2024-11-23 21:27:16,873 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:27:16,873 - distributed.worker - INFO - dashboard at: 127.0.0.1:46875 3537s 2024-11-23 21:27:16,873 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34665 3537s 2024-11-23 21:27:16,873 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:27:16,873 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:27:16,873 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:27:16,874 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-uwtftw4n 3537s 2024-11-23 21:27:16,874 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:27:16,877 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33837. Reason: failure-to-start- 3537s 2024-11-23 21:27:16,877 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:27:16,878 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37807. Reason: failure-to-start- 3537s 2024-11-23 21:27:16,878 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:27:16,880 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34665': TLS handshake failed with remote 'tls://127.0.0.1:38224': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:27:16,880 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34665': TLS handshake failed with remote 'tls://127.0.0.1:38226': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:27:16,881 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:27:17,887 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:27:17,895 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33517 3537s 2024-11-23 21:27:17,895 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39073/status 3537s 2024-11-23 21:27:17,896 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:27:17,913 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34347 3537s 2024-11-23 21:27:17,913 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34347 3537s 2024-11-23 21:27:17,913 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:27:17,913 - distributed.worker - INFO - dashboard at: 127.0.0.1:39039 3537s 2024-11-23 21:27:17,913 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33517 3537s 2024-11-23 21:27:17,914 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:27:17,914 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:27:17,914 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:27:17,914 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-u_4cz8f9 3537s 2024-11-23 21:27:17,914 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:27:17,916 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44951 3537s 2024-11-23 21:27:17,916 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44951 3537s 2024-11-23 21:27:17,916 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:27:17,916 - distributed.worker - INFO - dashboard at: 127.0.0.1:33019 3537s 2024-11-23 21:27:17,916 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33517 3537s 2024-11-23 21:27:17,916 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:27:17,916 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:27:17,916 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:27:17,917 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-c1lmp7cz 3537s 2024-11-23 21:27:17,917 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:27:17,920 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34347. Reason: failure-to-start- 3537s 2024-11-23 21:27:17,920 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:27:17,921 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44951. Reason: failure-to-start- 3537s 2024-11-23 21:27:17,921 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:27:17,923 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33517': TLS handshake failed with remote 'tls://127.0.0.1:35294': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:27:17,923 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33517': TLS handshake failed with remote 'tls://127.0.0.1:35308': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:27:17,924 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:27:18,930 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:27:18,939 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37953 3537s 2024-11-23 21:27:18,939 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35009/status 3537s 2024-11-23 21:27:18,939 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:27:18,956 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43691 3537s 2024-11-23 21:27:18,958 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43691 3537s 2024-11-23 21:27:18,958 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:27:18,958 - distributed.worker - INFO - dashboard at: 127.0.0.1:43335 3537s 2024-11-23 21:27:18,958 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37953 3537s 2024-11-23 21:27:18,958 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:27:18,958 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:27:18,958 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:27:18,958 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-fcw3vmpz 3537s 2024-11-23 21:27:18,958 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:27:18,961 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40257 3537s 2024-11-23 21:27:18,961 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40257 3537s 2024-11-23 21:27:18,961 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:27:18,961 - distributed.worker - INFO - dashboard at: 127.0.0.1:38433 3537s 2024-11-23 21:27:18,961 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37953 3537s 2024-11-23 21:27:18,961 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:27:18,962 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:27:18,962 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:27:18,962 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-u8fmyt0q 3537s 2024-11-23 21:27:18,962 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:27:18,966 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43691. Reason: failure-to-start- 3537s 2024-11-23 21:27:18,967 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:27:18,967 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40257. Reason: failure-to-start- 3537s 2024-11-23 21:27:18,967 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:27:18,972 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37953': TLS handshake failed with remote 'tls://127.0.0.1:42580': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:27:18,972 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37953': TLS handshake failed with remote 'tls://127.0.0.1:42596': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:27:18,974 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:27:19,980 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:27:19,988 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38589 3537s 2024-11-23 21:27:19,988 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44563/status 3537s 2024-11-23 21:27:19,989 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:27:20,008 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41179 3537s 2024-11-23 21:27:20,008 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41179 3537s 2024-11-23 21:27:20,008 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:27:20,008 - distributed.worker - INFO - dashboard at: 127.0.0.1:40227 3537s 2024-11-23 21:27:20,008 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38589 3537s 2024-11-23 21:27:20,008 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:27:20,008 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:27:20,008 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:27:20,008 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-vguzy5hb 3537s 2024-11-23 21:27:20,008 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:27:20,011 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41347 3537s 2024-11-23 21:27:20,011 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41347 3537s 2024-11-23 21:27:20,011 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:27:20,012 - distributed.worker - INFO - dashboard at: 127.0.0.1:43751 3537s 2024-11-23 21:27:20,012 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38589 3537s 2024-11-23 21:27:20,012 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:27:20,012 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:27:20,012 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:27:20,012 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-6186osof 3537s 2024-11-23 21:27:20,012 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:27:20,017 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41179. Reason: failure-to-start- 3537s 2024-11-23 21:27:20,017 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:27:20,018 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41347. Reason: failure-to-start- 3537s 2024-11-23 21:27:20,018 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:27:20,020 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38589': TLS handshake failed with remote 'tls://127.0.0.1:53792': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:27:20,020 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38589': TLS handshake failed with remote 'tls://127.0.0.1:53798': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:27:20,022 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:27:21,029 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:27:21,038 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38121 3537s 2024-11-23 21:27:21,038 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34275/status 3537s 2024-11-23 21:27:21,038 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:27:21,059 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34491 3537s 2024-11-23 21:27:21,059 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34491 3537s 2024-11-23 21:27:21,059 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:27:21,059 - distributed.worker - INFO - dashboard at: 127.0.0.1:36951 3537s 2024-11-23 21:27:21,059 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38121 3537s 2024-11-23 21:27:21,059 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:27:21,059 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:27:21,060 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:27:21,060 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-isje47am 3537s 2024-11-23 21:27:21,060 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:27:21,062 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44317 3537s 2024-11-23 21:27:21,062 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44317 3537s 2024-11-23 21:27:21,062 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:27:21,062 - distributed.worker - INFO - dashboard at: 127.0.0.1:43775 3537s 2024-11-23 21:27:21,063 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38121 3537s 2024-11-23 21:27:21,063 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:27:21,063 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:27:21,063 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:27:21,063 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-iaa_njvr 3537s 2024-11-23 21:27:21,063 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:27:21,067 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34491. Reason: failure-to-start- 3537s 2024-11-23 21:27:21,067 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:27:21,068 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44317. Reason: failure-to-start- 3537s 2024-11-23 21:27:21,068 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:27:21,070 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38121': TLS handshake failed with remote 'tls://127.0.0.1:45022': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:27:21,070 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38121': TLS handshake failed with remote 'tls://127.0.0.1:45032': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:27:21,072 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:27:22,081 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:27:22,089 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34717 3537s 2024-11-23 21:27:22,089 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37861/status 3537s 2024-11-23 21:27:22,090 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:27:22,107 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40455 3537s 2024-11-23 21:27:22,107 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40455 3537s 2024-11-23 21:27:22,107 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:27:22,107 - distributed.worker - INFO - dashboard at: 127.0.0.1:44159 3537s 2024-11-23 21:27:22,107 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34717 3537s 2024-11-23 21:27:22,107 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:27:22,107 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:27:22,107 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:27:22,107 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-6dgum8a_ 3537s 2024-11-23 21:27:22,108 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:27:22,110 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42871 3537s 2024-11-23 21:27:22,110 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42871 3537s 2024-11-23 21:27:22,110 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:27:22,110 - distributed.worker - INFO - dashboard at: 127.0.0.1:38815 3537s 2024-11-23 21:27:22,110 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34717 3537s 2024-11-23 21:27:22,110 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:27:22,110 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:27:22,110 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:27:22,110 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ld7if12i 3537s 2024-11-23 21:27:22,111 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:27:22,115 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40455. Reason: failure-to-start- 3537s 2024-11-23 21:27:22,115 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:27:22,116 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42871. Reason: failure-to-start- 3537s 2024-11-23 21:27:22,116 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:27:22,118 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34717': TLS handshake failed with remote 'tls://127.0.0.1:40684': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:27:22,118 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34717': TLS handshake failed with remote 'tls://127.0.0.1:40692': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:27:22,122 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:27:23,128 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:27:23,137 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41607 3537s 2024-11-23 21:27:23,137 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44799/status 3537s 2024-11-23 21:27:23,137 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:27:23,159 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45397 3537s 2024-11-23 21:27:23,159 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45397 3537s 2024-11-23 21:27:23,159 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:27:23,159 - distributed.worker - INFO - dashboard at: 127.0.0.1:45495 3537s 2024-11-23 21:27:23,159 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41607 3537s 2024-11-23 21:27:23,159 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:27:23,159 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:27:23,159 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:27:23,159 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-sfrr0l2b 3537s 2024-11-23 21:27:23,159 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:27:23,162 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39243 3537s 2024-11-23 21:27:23,162 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39243 3537s 2024-11-23 21:27:23,162 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:27:23,162 - distributed.worker - INFO - dashboard at: 127.0.0.1:38597 3537s 2024-11-23 21:27:23,162 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41607 3537s 2024-11-23 21:27:23,162 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:27:23,162 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:27:23,162 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:27:23,162 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-rajyfdv0 3537s 2024-11-23 21:27:23,162 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:27:23,167 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45397. Reason: failure-to-start- 3537s 2024-11-23 21:27:23,167 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:27:23,167 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39243. Reason: failure-to-start- 3537s 2024-11-23 21:27:23,167 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:27:23,169 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41607': TLS handshake failed with remote 'tls://127.0.0.1:60972': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:27:23,170 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41607': TLS handshake failed with remote 'tls://127.0.0.1:60978': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:27:23,171 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:27:24,177 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:27:24,186 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35007 3537s 2024-11-23 21:27:24,186 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44121/status 3537s 2024-11-23 21:27:24,187 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:27:24,226 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39287 3537s 2024-11-23 21:27:24,226 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39287 3537s 2024-11-23 21:27:24,226 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:27:24,226 - distributed.worker - INFO - dashboard at: 127.0.0.1:36157 3537s 2024-11-23 21:27:24,226 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35007 3537s 2024-11-23 21:27:24,226 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:27:24,226 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:27:24,226 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:27:24,226 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-rq1hdzsd 3537s 2024-11-23 21:27:24,226 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:27:24,229 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42859 3537s 2024-11-23 21:27:24,229 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42859 3537s 2024-11-23 21:27:24,229 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:27:24,229 - distributed.worker - INFO - dashboard at: 127.0.0.1:33165 3537s 2024-11-23 21:27:24,229 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35007 3537s 2024-11-23 21:27:24,229 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:27:24,229 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:27:24,229 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:27:24,229 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ymx2zgde 3537s 2024-11-23 21:27:24,229 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:27:24,236 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39287. Reason: failure-to-start- 3537s 2024-11-23 21:27:24,236 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:27:24,236 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42859. Reason: failure-to-start- 3537s 2024-11-23 21:27:24,236 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:27:24,238 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35007': TLS handshake failed with remote 'tls://127.0.0.1:49150': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:27:24,238 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35007': TLS handshake failed with remote 'tls://127.0.0.1:49164': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:27:24,241 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:27:25,248 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:27:25,258 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46753 3537s 2024-11-23 21:27:25,258 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44551/status 3537s 2024-11-23 21:27:25,259 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:27:25,276 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42661 3537s 2024-11-23 21:27:25,276 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42661 3537s 2024-11-23 21:27:25,277 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:27:25,277 - distributed.worker - INFO - dashboard at: 127.0.0.1:46283 3537s 2024-11-23 21:27:25,277 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46753 3537s 2024-11-23 21:27:25,277 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:27:25,277 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:27:25,277 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:27:25,277 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-33yya4d0 3537s 2024-11-23 21:27:25,277 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:27:25,280 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45199 3537s 2024-11-23 21:27:25,280 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45199 3537s 2024-11-23 21:27:25,280 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:27:25,280 - distributed.worker - INFO - dashboard at: 127.0.0.1:35923 3537s 2024-11-23 21:27:25,280 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46753 3537s 2024-11-23 21:27:25,280 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:27:25,280 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:27:25,280 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:27:25,280 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-oi1aiuuo 3537s 2024-11-23 21:27:25,280 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:27:25,286 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42661. Reason: failure-to-start- 3537s 2024-11-23 21:27:25,287 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:27:25,287 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45199. Reason: failure-to-start- 3537s 2024-11-23 21:27:25,287 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:27:25,292 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46753': TLS handshake failed with remote 'tls://127.0.0.1:35922': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:27:25,292 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46753': TLS handshake failed with remote 'tls://127.0.0.1:35928': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:27:25,294 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s 2024-11-23 21:27:26,301 - distributed.scheduler - INFO - State start 3537s 2024-11-23 21:27:26,309 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33941 3537s 2024-11-23 21:27:26,310 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39027/status 3537s 2024-11-23 21:27:26,310 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3537s 2024-11-23 21:27:26,330 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34015 3537s 2024-11-23 21:27:26,330 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34015 3537s 2024-11-23 21:27:26,330 - distributed.worker - INFO - Worker name: 0 3537s 2024-11-23 21:27:26,331 - distributed.worker - INFO - dashboard at: 127.0.0.1:38079 3537s 2024-11-23 21:27:26,331 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33941 3537s 2024-11-23 21:27:26,331 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:27:26,331 - distributed.worker - INFO - Threads: 1 3537s 2024-11-23 21:27:26,331 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:27:26,331 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-egt2yze0 3537s 2024-11-23 21:27:26,331 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:27:26,333 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41879 3537s 2024-11-23 21:27:26,333 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41879 3537s 2024-11-23 21:27:26,334 - distributed.worker - INFO - Worker name: 1 3537s 2024-11-23 21:27:26,334 - distributed.worker - INFO - dashboard at: 127.0.0.1:42073 3537s 2024-11-23 21:27:26,334 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33941 3537s 2024-11-23 21:27:26,334 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:27:26,334 - distributed.worker - INFO - Threads: 2 3537s 2024-11-23 21:27:26,334 - distributed.worker - INFO - Memory: 15.58 GiB 3537s 2024-11-23 21:27:26,334 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-hn4is3vb 3537s 2024-11-23 21:27:26,334 - distributed.worker - INFO - ------------------------------------------------- 3537s 2024-11-23 21:27:26,339 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34015. Reason: failure-to-start- 3537s 2024-11-23 21:27:26,339 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:27:26,340 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41879. Reason: failure-to-start- 3537s 2024-11-23 21:27:26,340 - distributed.worker - INFO - Closed worker has not yet started: Status.init 3537s 2024-11-23 21:27:26,342 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33941': TLS handshake failed with remote 'tls://127.0.0.1:34644': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:27:26,342 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33941': TLS handshake failed with remote 'tls://127.0.0.1:34658': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 3537s 2024-11-23 21:27:26,344 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 3537s await self._register_with_scheduler() 3537s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 3537s comm = await connect(self.scheduler.address, **self.connection_args) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3537s comm = await wait_for( 3537s ^^^^^^^^^^^^^^^ 3537s ...<2 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 3537s return await fut 3537s ^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3537s stream = await self.client.connect( 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3537s af, addr, stream = await connector.start(connect_timeout=timeout) 3537s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3537s asyncio.exceptions.CancelledError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 3537s await wait_for(self.start_unsafe(), timeout=timeout) 3537s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 3537s async with asyncio.timeout(timeout): 3537s ~~~~~~~~~~~~~~~^^^^^^^^^ 3537s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3537s raise TimeoutError from exc_val 3537s TimeoutError 3537s 3537s The above exception was the direct cause of the following exception: 3537s 3537s Traceback (most recent call last): 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 3537s s, ws = await start_cluster( 3537s ^^^^^^^^^^^^^^^^^^^^ 3537s ...<9 lines>... 3537s ) 3537s ^ 3537s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 3537s await asyncio.gather(*workers) 3537s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3537s return await awaitable 3537s ^^^^^^^^^^^^^^^ 3537s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 3537s raise asyncio.TimeoutError( 3537s f"{type(self).__name__} start timed out after {timeout}s." 3537s ) from exc 3537s TimeoutError: Worker start timed out after 0s. 3537s ============================= slowest 20 durations ============================= 3537s 300.02s setup tests/test_utils_test.py::test_tls_cluster 3537s 60.01s call tests/test_utils_test.py::test_gen_cluster_tls 3537s 60.01s call tests/test_tls_functional.py::test_worker_client_executor 3537s 60.01s call tests/test_tls_functional.py::test_nanny 3537s 60.01s call tests/test_tls_functional.py::test_scatter 3537s 60.01s call tests/test_scheduler.py::test_broadcast_tls 3537s 60.01s call tests/test_tls_functional.py::test_gather 3537s 60.01s call tests/test_tls_functional.py::test_client_submit 3537s 60.01s call tests/test_tls_functional.py::test_retire_workers 3537s 60.01s call tests/test_tls_functional.py::test_basic 3537s 60.01s call tests/test_tls_functional.py::test_work_stealing 3537s 60.01s call tests/test_tls_functional.py::test_worker_client_gather 3537s 60.01s call tests/test_tls_functional.py::test_Queue 3537s 60.01s call tests/test_tls_functional.py::test_rebalance 3537s 60.01s call tests/test_tls_functional.py::test_worker_client 3537s 30.01s call tests/test_tls_functional.py::test_security_dict_input 3537s 16.29s call shuffle/tests/test_rechunk.py::test_rechunk_method 3537s 10.03s call tests/test_utils_test.py::test_popen_timeout 3537s 9.32s call tests/test_nanny.py::test_num_fds 3537s 8.68s call tests/test_stress.py::test_cancel_stress_sync 3537s =========================== short test summary info ============================ 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_ssh.py:9: could not import 'paramiko': No module named 'paramiko' 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_ucx.py:15: could not import 'ucp': No module named 'ucp' 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_ucx_config.py:22: could not import 'ucp': No module named 'ucp' 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/dashboard/tests/test_components.py:5: could not import 'bokeh': No module named 'bokeh' 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/dashboard/tests/test_scheduler_bokeh.py:11: could not import 'bokeh': No module named 'bokeh' 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/dashboard/tests/test_worker_bokeh.py:10: could not import 'bokeh': No module named 'bokeh' 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_old_ssh.py:7: could not import 'paramiko': No module named 'paramiko' 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_ssh.py:5: could not import 'asyncssh': No module named 'asyncssh' 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_cudf_diagnostics.py:20: could not import 'cudf': No module named 'cudf' 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_memray.py:5: could not import 'memray': No module named 'memray' 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_nvml.py:10: could not import 'pynvml': No module named 'pynvml' 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_progress_stream.py:5: could not import 'bokeh': No module named 'bokeh' 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_progress_widgets.py:14: could not import 'ipywidgets': No module named 'ipywidgets' 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_rmm_diagnostics.py:14: could not import 'dask_cuda': No module named 'dask_cuda' 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_arrow.py:5: could not import 'pyarrow': No module named 'pyarrow' 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_cupy.py:11: could not import 'cupy': No module named 'cupy' 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_h5py.py:8: could not import 'h5py': No module named 'h5py' 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_keras.py:5: could not import 'keras': No module named 'keras' 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_netcdf4.py:5: could not import 'netCDF4': No module named 'netCDF4' 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numba.py:11: could not import 'numba.cuda': No module named 'numba' 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_rmm.py:10: could not import 'numba.cuda': No module named 'numba' 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_scipy.py:8: could not import 'scipy': No module named 'scipy' 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_sparse.py:6: could not import 'sparse': No module named 'sparse' 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_torch.py:8: could not import 'torch': No module named 'torch' 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_graph.py:9: could not import 'pyarrow': No module named 'pyarrow' 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_merge.py:71: could not import 'pyarrow': No module named 'pyarrow' 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_merge_column_and_index.py:110: could not import 'pyarrow': No module named 'pyarrow' 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_metrics.py:71: could not import 'pyarrow': No module named 'pyarrow' 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_shuffle.py:195: could not import 'pyarrow': No module named 'pyarrow' 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_parse_stdout.py:14: could not import 'parse_stdout': No module named 'parse_stdout' 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py:75: could not import 'bokeh': No module named 'bokeh' 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py:107: could not import 'bokeh': No module named 'bokeh' 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py:154: could not import 'bokeh': No module named 'bokeh' 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py:291: could not import 'bokeh': No module named 'bokeh' 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py:497: need --runslow option to run 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py:509: need --runslow option to run 3537s SKIPPED [2] ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py:569: need --runslow option to run 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py:169: need --runslow option to run 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py:194: need --runslow option to run 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py:264: need --runslow option to run 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py:290: need --runslow option to run 3537s SKIPPED [2] ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py:309: need --runslow option to run 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py:345: need --runslow option to run 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py:368: need --runslow option to run 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py:375: need --runslow option to run 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py:383: need --runslow option to run 3537s SKIPPED [4] ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py:397: need --runslow option to run 3537s SKIPPED [4] ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py:431: need --runslow option to run 3537s SKIPPED [4] ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py:468: need --runslow option to run 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py:487: need --runslow option to run 3537s SKIPPED [2] ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py:525: need --runslow option to run 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py:536: need --runslow option to run 3537s SKIPPED [2] ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py:546: need --runslow option to run 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py:589: need --runslow option to run 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py:606: need --runslow option to run 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py:625: need --runslow option to run 3537s SKIPPED [2] ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py:639: need --runslow option to run 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py:726: need --runslow option to run 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_subprocess.py:77: need --runslow option to run 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_subprocess.py:91: Windows-specific error testing (distributed#7434) 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_eventstream.py:16: could not import 'bokeh': No module named 'bokeh' 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_install_plugin.py:143: need --runslow option to run 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_memory_sampler.py:49: need --runslow option to run 3537s SKIPPED [2] ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_memory_sampler.py:79: could not import 'matplotlib': No module named 'matplotlib' 3537s SKIPPED [2] ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_memory_sampler.py:108: need --runslow option to run 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_task_stream.py:140: could not import 'bokeh.models': No module named 'bokeh' 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_task_stream.py:151: could not import 'bokeh.models': No module named 'bokeh' 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_missing_bokeh.py:35: could not import 'bokeh': No module named 'bokeh' 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_missing_bokeh.py:59: could not import 'bokeh': No module named 'bokeh' 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py:86: could not import 'bokeh': No module named 'bokeh' 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py:324: could not import 'aiohttp': No module named 'aiohttp' 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py:437: could not import 'bokeh': No module named 'bokeh' 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py:478: could not import 'aiohttp': No module named 'aiohttp' 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py:498: could not import 'aiohttp': No module named 'aiohttp' 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py:521: could not import 'aiohttp': No module named 'aiohttp' 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py:543: could not import 'aiohttp': No module named 'aiohttp' 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py:564: could not import 'aiohttp': No module named 'aiohttp' 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/http/worker/tests/test_worker_http.py:149: could not import 'aiohttp': No module named 'aiohttp' 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/http/worker/tests/test_worker_http.py:162: could not import 'aiohttp': No module named 'aiohttp' 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/http/worker/tests/test_worker_http.py:233: Fails on 32-bit, seems to be large memory request 3537s SKIPPED [4] ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_collection_cuda.py:12: could not import 'cupy': No module named 'cupy' 3537s SKIPPED [4] ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_collection_cuda.py:44: could not import 'cudf': No module named 'cudf' 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py:125: could not import 'lz4': No module named 'lz4' 3537s SKIPPED [2] ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py:132: could not import 'lz4': No module named 'lz4' 3537s SKIPPED [2] ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py:132: could not import 'snappy': No module named 'snappy' 3537s SKIPPED [2] ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py:132: could not import 'zstandard': No module named 'zstandard' 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py:143: could not import 'lz4': No module named 'lz4' 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py:143: could not import 'snappy': No module named 'snappy' 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py:143: could not import 'zstandard': No module named 'zstandard' 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py:151: could not import 'lz4': No module named 'lz4' 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py:151: could not import 'snappy': No module named 'snappy' 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py:151: could not import 'zstandard': No module named 'zstandard' 3537s SKIPPED [10] ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py:168: need --runslow option to run 3537s SKIPPED [5] ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py:188: need --runslow option to run 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py:150: could not import 'numpy.core.test_rational': No module named 'numpy.core.test_rational' 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py:180: need --runslow option to run 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pickle.py:283: need --runslow option to run 3537s SKIPPED [3] ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol.py:213: need --runslow option to run 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py:1252: need --runslow option to run 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py:1296: need --runslow option to run 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py:1309: need --runslow option to run 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py:1331: need --runslow option to run 3537s SKIPPED [2] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py:1352: need --runslow option to run 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_batched.py:158: need --runslow option to run 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_batched.py:228: need --runslow option to run 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:853: need --runslow option to run 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:1726: need --runslow option to run 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:1860: unconditional skip 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:2078: unconditional skip 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:2653: unconditional skip 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:2672: Use fast random selection now 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:3303: unconditional skip 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:3586: need --runslow option to run 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:3651: need --runslow option to run 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:3763: need --runslow option to run 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:4586: need --runslow option to run 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:4689: Now prefer first-in-first-out 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:4719: need --runslow option to run 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:4855: could not import 'scipy': No module named 'scipy' 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:4998: need --runslow option to run 3537s SKIPPED [2] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:5041: need --runslow option to run 3537s SKIPPED [2] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:5061: need --runslow option to run 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:5088: need --runslow option to run 3537s SKIPPED [2] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:5101: need --runslow option to run 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:5289: need --runslow option to run 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:5308: need --runslow option to run 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:5603: need --runslow option to run 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:5845: need --runslow option to run 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:6046: need --runslow option to run 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:6163: unconditional skip 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:6377: could not import 'bokeh.plotting': No module named 'bokeh' 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:6726: known intermittent failure 3537s SKIPPED [2] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:6807: need --runslow option to run 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:6870: On Py3.10+ semaphore._loop is not bound until .acquire() blocks 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:6890: On Py3.10+ semaphore._loop is not bound until .acquire() blocks 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:6899: need --runslow option to run 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:7305: could not import 'bokeh': No module named 'bokeh' 3537s SKIPPED [2] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:7406: need --runslow option to run 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:7501: numpy >=1.25 can capture ufunc code 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:7645: need --runslow option to run 3537s SKIPPED [2] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:8396: need --runslow option to run 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client_executor.py:146: need --runslow option to run 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_config.py:356: could not import 'uvloop': No module named 'uvloop' 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py:602: need --runslow option to run 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py:1026: could not import 'crick': No module named 'crick' 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py:1035: could not import 'crick': No module named 'crick' 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py:1487: need --runslow option to run 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_counter.py:13: no crick library 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_dask_collections.py:221: could not import 'sparse': No module named 'sparse' 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_diskutils.py:224: need --runslow option to run 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py:41: need --runslow option to run 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py:117: need --runslow option to run 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py:128: need --runslow option to run 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py:286: need --runslow option to run 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py:357: need --runslow option to run 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py:441: need --runslow option to run 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py:453: need --runslow option to run 3537s SKIPPED [2] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py:474: need --runslow option to run 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py:520: need --runslow option to run 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_jupyter.py:47: need --runslow option to run 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_metrics.py:31: WindowsTime doesn't work with high accuracy base timer 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py:93: need --runslow option to run 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py:107: need --runslow option to run 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py:141: need --runslow option to run 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py:269: need --runslow option to run 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py:468: need --runslow option to run 3537s SKIPPED [2] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py:545: could not import 'ucp': No module named 'ucp' 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py:632: need --runslow option to run 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py:640: need --runslow option to run 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py:681: need --runslow option to run 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py:724: need --runslow option to run 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py:75: could not import 'stacktrace': No module named 'stacktrace' 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_queues.py:113: need --runslow option to run 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py:363: Skipped 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py:420: Should protect resource keys from optimization 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py:441: atop fusion seemed to break this 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py:305: Not relevant with queuing on; see https://github.com/dask/distributed/issues/7204 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py:440: need --runslow option to run 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py:1087: need --runslow option to run 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py:1115: need --runslow option to run 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py:1136: need --runslow option to run 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py:1228: need --runslow option to run 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py:1246: need --runslow option to run 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py:1638: need --runslow option to run 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py:1691: need --runslow option to run 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py:1708: need --runslow option to run 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py:1871: need --runslow option to run 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py:1911: need --runslow option to run 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py:2102: need --runslow option to run 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py:2361: need --runslow option to run 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py:2450: need --runslow option to run 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py:2471: need --runslow option to run 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py:2506: need --runslow option to run 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py:2549: need --runslow option to run 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py:2604: could not import 'bokeh': No module named 'bokeh' 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py:2980: need --runslow option to run 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py:3394: need --runslow option to run 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py:3573: need --runslow option to run 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py:3605: need --runslow option to run 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py:3748: need --runslow option to run 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py:3805: need --runslow option to run 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py:3825: need --runslow option to run 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py:4064: need --runslow option to run 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py:106: need --runslow option to run 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py:285: Skipped 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py:1287: executing heartbeats not considered yet 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py:1353: need --runslow option to run 3537s SKIPPED [2] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_stress.py:51: need --runslow option to run 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_stress.py:96: need --runslow option to run 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_stress.py:202: unconditional skip 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_stress.py:233: need --runslow option to run 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_stress.py:260: need --runslow option to run 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_stress.py:301: need --runslow option to run 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_system_monitor.py:111: could not import 'gilknocker': No module named 'gilknocker' 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py:167: could not import 'IPython': No module named 'IPython' 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py:357: could not import 'pyarrow': No module named 'pyarrow' 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_perf.py:86: need --runslow option to run 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py:149: This hangs on travis 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py:442: need --runslow option to run 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py:603: need --runslow option to run 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py:816: need --runslow option to run 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_variable.py:194: need --runslow option to run 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py:219: don't yet support uploading pyc files 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py:309: could not import 'crick': No module named 'crick' 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py:345: need --runslow option to run 3537s SKIPPED [8] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py:420: need --runslow option to run 3537s SKIPPED [5] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py:561: need --runslow option to run 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py:1207: need --runslow option to run 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py:1287: need --runslow option to run 3537s SKIPPED [2] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py:1476: could not import 'ucp': No module named 'ucp' 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py:1540: need --runslow option to run 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py:1572: need --runslow option to run 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py:1603: need --runslow option to run 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py:1630: need --runslow option to run 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py:1658: need --runslow option to run 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py:1725: need --runslow option to run 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py:1830: need --runslow option to run 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py:2729: need --runslow option to run 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py:3421: need --runslow option to run 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py:3451: need --runslow option to run 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py:871: need --runslow option to run 3537s SKIPPED [2] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py:883: need --runslow option to run 3537s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py:997: need --runslow option to run 3537s FAILED cli/tests/test_dask_scheduler.py::test_preload_file - distributed.comm.core.CommClosedError: in : Stream is closed 3537s FAILED cli/tests/test_dask_scheduler.py::test_preload_module - distributed.comm.core.CommClosedError: in : Stream is closed 3537s FAILED cli/tests/test_dask_scheduler.py::test_preload_remote_module - distributed.comm.core.CommClosedError: in : Stream is closed 3537s FAILED cli/tests/test_dask_scheduler.py::test_preload_config - SystemError: no locals found when setting up annotations 3537s FAILED cli/tests/test_dask_scheduler.py::test_preload_command - distributed.comm.core.CommClosedError: in : Stream is closed 3537s FAILED cli/tests/test_dask_scheduler.py::test_preload_command_default - distributed.comm.core.CommClosedError: in : Stream is closed 3537s FAILED cli/tests/test_dask_scheduler.py::test_multiple_workers_2 - SystemError: no locals found when setting up annotations 3537s FAILED cli/tests/test_tls_cli.py::test_basic - distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 3537s FAILED cli/tests/test_tls_cli.py::test_sni - distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 3537s FAILED cli/tests/test_tls_cli.py::test_nanny - distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 3537s FAILED cli/tests/test_tls_cli.py::test_separate_key_cert - distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 3537s FAILED cli/tests/test_tls_cli.py::test_use_config_file - distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 3537s FAILED deploy/tests/test_subprocess.py::test_basic - SystemError: no locals found when setting up annotations 3537s FAILED deploy/tests/test_subprocess.py::test_n_workers - SystemError: no locals found when setting up annotations 3537s FAILED tests/test_client.py::test_upload_file_zip - KeyError: '/tmp/dask-scratch-space/scheduler-uym9plud/myfile.zip' 3537s FAILED tests/test_profile.py::test_info_frame_f_lineno[22-4] - TypeError: '<=' not supported between instances of 'int' and 'NoneType' 3537s FAILED tests/test_profile.py::test_info_frame_f_lineno[23-4] - TypeError: '<=' not supported between instances of 'int' and 'NoneType' 3537s FAILED tests/test_profile.py::test_call_stack_f_lineno[22-4] - TypeError: '<=' not supported between instances of 'int' and 'NoneType' 3537s FAILED tests/test_profile.py::test_call_stack_f_lineno[23-4] - TypeError: '<=' not supported between instances of 'int' and 'NoneType' 3537s FAILED tests/test_scheduler.py::test_broadcast_tls - TimeoutError 3537s FAILED tests/test_security.py::test_repr_temp_keys - ImportError: Using `Security.temporary` requires `cryptography`, please install it using either pip or conda 3537s FAILED tests/test_security.py::test_temporary_credentials - ImportError: Using `Security.temporary` requires `cryptography`, please install it using either pip or conda 3537s FAILED tests/test_security.py::test_extra_conn_args_in_temporary_credentials - ImportError: Using `Security.temporary` requires `cryptography`, please install it using either pip or conda 3537s FAILED tests/test_tls_functional.py::test_basic - TimeoutError 3537s FAILED tests/test_tls_functional.py::test_Queue - TimeoutError 3537s FAILED tests/test_tls_functional.py::test_client_submit - TimeoutError 3537s FAILED tests/test_tls_functional.py::test_gather - TimeoutError 3537s FAILED tests/test_tls_functional.py::test_scatter - TimeoutError 3537s FAILED tests/test_tls_functional.py::test_nanny - TimeoutError 3537s FAILED tests/test_tls_functional.py::test_rebalance - TimeoutError 3537s FAILED tests/test_tls_functional.py::test_work_stealing - TimeoutError 3537s FAILED tests/test_tls_functional.py::test_worker_client - TimeoutError 3537s FAILED tests/test_tls_functional.py::test_worker_client_gather - TimeoutError 3537s FAILED tests/test_tls_functional.py::test_worker_client_executor - TimeoutError 3537s FAILED tests/test_tls_functional.py::test_retire_workers - TimeoutError 3537s FAILED tests/test_tls_functional.py::test_security_dict_input - TimeoutError 3537s FAILED tests/test_utils_test.py::test_gen_cluster_tls - TimeoutError 3537s ERROR tests/test_utils_test.py::test_tls_cluster - Failed: Timeout >300.0s 3537s = 37 failed, 2846 passed, 306 skipped, 166 deselected, 15 xfailed, 8 xpassed, 1 error in 2661.32s (0:44:21) = 3539s *** END OF RUN 1: NOT ALL TESTS HAVE YET PASSED/XFAILED *** 3539s *** STARTING RUN 2: python3.13 -m pytest --pyargs distributed --verbose --color=no --timeout-method=signal --timeout=300 -m not avoid_ci -rfE --last-failed --last-failed-no-failures none --ignore=../../../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_comms.py --ignore=../../../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_ws.py --ignore=../../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_adaptive.py --ignore=../../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py --ignore=../../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_slow_adaptive.py --ignore=../../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_spec_cluster.py --deselect=cli/tests/test_dask_scheduler.py::test_no_dashboard --deselect=deploy/tests/test_local.py::test_localcluster_get_client --deselect=deploy/tests/test_old_ssh.py::test_cluster --deselect=deploy/tests/test_old_ssh.py::test_old_ssh_nprocs_renamed_to_n_workers --deselect=deploy/tests/test_old_ssh.py::test_nprocs_attribute_is_deprecated --deselect=deploy/tests/test_ssh.py::test_nprocs_attribute_is_deprecated --deselect=http/tests/test_core.py::test_prometheus_api_doc --deselect=tests/test_init.py::test_git_revision --deselect=tests/test_jupyter.py::test_jupyter_idle_timeout --deselect=tests/test_jupyter.py::test_jupyter_idle_timeout_returned --deselect=tests/test_jupyter.py::test_jupyter_server --deselect=tests/test_jupyter.py::test_shutsdown_cleanly --deselect=tests/test_profile.py::test_stack_overflow --deselect=tests/test_pubsub.py::test_client_worker --deselect=tests/test_queues.py::test_queue_in_task --deselect=tests/test_spill.py::test_spillbuffer_oserror --deselect=tests/test_steal.py::test_steal_twice --deselect=tests/test_utils_test.py::test_cluster --deselect=tests/test_variable.py::test_variable_in_task --deselect=tests/test_worker.py::test_process_executor_kills_process --deselect=tests/test_worker_memory.py::test_fail_to_pickle_execute_1 --deselect=tests/test_worker_state_machine.py::test_task_state_instance_are_garbage_collected --deselect=protocol/tests/test_protocol.py::test_deeply_nested_structures --deselect=protocol/tests/test_serialize.py::test_deeply_nested_structures --deselect=deploy/tests/test_local.py::test_local_cluster_redundant_kwarg --deselect=deploy/tests/test_slow_adaptive.py::test_adaptive --deselect=tests/test_client.py::test_futures_in_subgraphs --deselect=tests/test_dask_collections.py::test_dataframe_groupby_tasks --deselect=tests/test_dask_collections.py::test_dataframes --deselect=tests/test_dask_collections.py::test_rolling_sync --deselect=tests/test_scheduler.py::test_balance_many_workers_2 --deselect=tests/test_scheduler.py::test_default_task_duration_splits --deselect=tests/test_steal.py::test_blocklist_shuffle_split --deselect=cli/tests/test_dask_scheduler.py::test_defaults --deselect=cli/tests/test_dask_scheduler.py::test_hostport --deselect=cli/tests/test_dask_spec.py::test_errors --deselect=cli/tests/test_dask_worker.py::test_scheduler_file --deselect=cli/tests/test_dask_worker.py::test_scheduler_file --deselect=cli/tests/test_dask_worker.py::test_scheduler_file --deselect=dashboard/tests/test_scheduler_bokeh.py::test_counters --deselect=dashboard/tests/test_worker_bokeh.py::test_counters --deselect=deploy/tests/test_local.py::test_adapt_then_manual --deselect=deploy/tests/test_local.py::test_async_with --deselect=deploy/tests/test_local.py::test_close_twice --deselect=deploy/tests/test_local.py::test_cluster_info_sync --deselect=deploy/tests/test_local.py::test_local_tls --deselect=deploy/tests/test_local.py::test_no_dangling_asyncio_tasks --deselect=deploy/tests/test_local.py::test_only_local_access --deselect=deploy/tests/test_local.py::test_remote_access --deselect=diagnostics/tests/test_progress_widgets.py::test_serializers --deselect=diagnostics/tests/test_scheduler_plugin.py::test_lifecycle --deselect=http/scheduler/tests/test_missing_bokeh.py::test_missing_bokeh --deselect=http/scheduler/tests/test_scheduler_http.py::test_metrics_when_prometheus_client_not_installed --deselect=protocol/tests/test_serialize.py::test_errors --deselect=tests/test_batched.py::test_BatchedSend --deselect=tests/test_batched.py::test_close_closed --deselect=tests/test_batched.py::test_close_twice --deselect=tests/test_batched.py::test_send_after_stream_start --deselect=tests/test_batched.py::test_send_before_close --deselect=tests/test_batched.py::test_send_before_start --deselect=tests/test_batched.py::test_sending_traffic_jam --deselect=tests/test_batched.py::test_serializers --deselect=tests/test_client.py::TestClientSecurityLoader::test_security_loader --deselect=tests/test_client.py::TestClientSecurityLoader::test_security_loader_ignored_if_explicit_security_provided --deselect=tests/test_client.py::TestClientSecurityLoader::test_security_loader_ignored_if_returns_none --deselect=tests/test_client.py::test_async_with --deselect=tests/test_client.py::test_client_is_quiet_cluster_close --deselect=tests/test_client.py::test_dashboard_link_cluster --deselect=tests/test_client.py::test_dashboard_link_inproc --deselect=tests/test_client.py::test_file_descriptors_dont_leak --deselect=tests/test_client.py::test_mixing_clients_different_scheduler --deselect=tests/test_client.py::test_quiet_client_close --deselect=tests/test_client.py::test_rebalance_sync --deselect=tests/test_client.py::test_repr_localcluster --deselect=tests/test_client.py::test_security_loader --deselect=tests/test_client.py::test_security_loader_ignored_if_explicit_security_provided --deselect=tests/test_client.py::test_security_loader_ignored_if_returns_none --deselect=tests/test_client.py::test_shutdown --deselect=tests/test_client.py::test_shutdown_is_quiet_with_cluster --deselect=tests/test_client.py::test_shutdown_localcluster --deselect=tests/test_client.py::test_shutdown_stops_callbacks --deselect=tests/test_client_loop.py::test_close_loop_sync_start_new_loop --deselect=tests/test_client_loop.py::test_close_loop_sync_use_running_loop --deselect=tests/test_core.py::test_close_fast_without_active_handlers --deselect=tests/test_core.py::test_close_grace_period_for_handlers --deselect=tests/test_core.py::test_close_properly --deselect=tests/test_core.py::test_compression --deselect=tests/test_core.py::test_connection_pool --deselect=tests/test_core.py::test_connection_pool_close_while_connecting --deselect=tests/test_core.py::test_connection_pool_detects_remote_close --deselect=tests/test_core.py::test_connection_pool_outside_cancellation --deselect=tests/test_core.py::test_connection_pool_remove --deselect=tests/test_core.py::test_connection_pool_respects_limit --deselect=tests/test_core.py::test_connection_pool_tls --deselect=tests/test_core.py::test_counters --deselect=tests/test_core.py::test_deserialize_error --deselect=tests/test_core.py::test_errors --deselect=tests/test_core.py::test_identity_inproc --deselect=tests/test_core.py::test_identity_tcp --deselect=tests/test_core.py::test_large_packets_inproc --deselect=tests/test_core.py::test_messages_are_ordered_bsend --deselect=tests/test_core.py::test_messages_are_ordered_raw --deselect=tests/test_core.py::test_ports --deselect=tests/test_core.py::test_rpc_default --deselect=tests/test_core.py::test_rpc_inproc --deselect=tests/test_core.py::test_rpc_message_lifetime_default --deselect=tests/test_core.py::test_rpc_message_lifetime_inproc --deselect=tests/test_core.py::test_rpc_message_lifetime_tcp --deselect=tests/test_core.py::test_rpc_serialization --deselect=tests/test_core.py::test_rpc_tcp --deselect=tests/test_core.py::test_rpc_tls --deselect=tests/test_core.py::test_rpc_with_many_connections_inproc --deselect=tests/test_core.py::test_rpc_with_many_connections_tcp --deselect=tests/test_core.py::test_send_recv_args --deselect=tests/test_core.py::test_send_recv_cancelled --deselect=tests/test_core.py::test_server --deselect=tests/test_core.py::test_server_comms_mark_active_handlers --deselect=tests/test_core.py::test_server_raises_on_blocked_handlers --deselect=tests/test_jupyter.py::test_jupyter_idle_timeout --deselect=tests/test_jupyter.py::test_jupyter_server --deselect=tests/test_locks.py::test_errors --deselect=tests/test_nanny.py::test_scheduler_file --deselect=tests/test_nanny.py::test_scheduler_file --deselect=tests/test_nanny.py::test_scheduler_file --deselect=tests/test_nanny.py::test_worker_uses_same_host_as_nanny --deselect=tests/test_preload.py::test_failure_doesnt_crash_scheduler --deselect=tests/test_preload.py::test_preload_import_time --deselect=tests/test_preload.py::test_preload_manager_sequence --deselect=tests/test_preload.py::test_worker_preload_text --deselect=tests/test_scheduler.py::test_allowed_failures_config --deselect=tests/test_scheduler.py::test_async_context_manager --deselect=tests/test_scheduler.py::test_dashboard_host --deselect=tests/test_scheduler.py::test_file_descriptors_dont_leak --deselect=tests/test_scheduler.py::test_finished --deselect=tests/test_scheduler.py::test_multiple_listeners --deselect=tests/test_scheduler.py::test_no_dangling_asyncio_tasks --deselect=tests/test_scheduler.py::test_scheduler_file --deselect=tests/test_scheduler.py::test_scheduler_file --deselect=tests/test_scheduler.py::test_scheduler_file --deselect=tests/test_security.py::test_require_encryption --deselect=tests/test_security.py::test_tls_listen_connect --deselect=tests/test_security.py::test_tls_temporary_credentials_functional --deselect=tests/test_semaphore.py::test_threadpoolworkers_pick_correct_ioloop --deselect=tests/test_tls_functional.py::test_security_dict_input_no_security --deselect=tests/test_utils_test.py::test_ensure_no_new_clients --deselect=tests/test_utils_test.py::test_freeze_batched_send --deselect=tests/test_utils_test.py::test_locked_comm_drop_in_replacement --deselect=tests/test_utils_test.py::test_locked_comm_intercept_read --deselect=tests/test_utils_test.py::test_locked_comm_intercept_write --deselect=tests/test_worker.py::test_host_uses_scheduler_protocol --deselect=tests/test_worker.py::test_plugin_exception --deselect=tests/test_worker.py::test_plugin_internal_exception --deselect=tests/test_worker.py::test_plugin_multiple_exceptions --deselect=tests/test_worker.py::test_scheduler_file --deselect=tests/test_worker.py::test_scheduler_file --deselect=tests/test_worker.py::test_scheduler_file --deselect=tests/test_worker_client.py::test_dont_override_default_get 3540s ============================= test session starts ============================== 3540s platform linux -- Python 3.13.0, pytest-8.3.3, pluggy-1.5.0 -- /usr/bin/python3.13 3540s cachedir: .pytest_cache 3540s rootdir: /tmp/autopkgtest.1vd31g/autopkgtest_tmp/build 3540s configfile: pyproject.toml 3540s plugins: typeguard-4.4.1, anyio-4.6.2, rerunfailures-14.0, timeout-2.3.1 3540s timeout: 300.0s 3540s timeout method: signal 3540s timeout func_only: False 3550s collecting ... collected 3349 items / 3311 deselected / 30 skipped / 38 selected 3550s run-last-failure: rerun previous 38 failures 3550s 3552s cli/tests/test_dask_scheduler.py::test_preload_file <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py FAILED [ 2%] 3554s cli/tests/test_dask_scheduler.py::test_preload_module <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py FAILED [ 5%] 3556s cli/tests/test_dask_scheduler.py::test_preload_remote_module <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py FAILED [ 7%] 3557s cli/tests/test_dask_scheduler.py::test_preload_config <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py FAILED [ 10%] 3559s cli/tests/test_dask_scheduler.py::test_preload_command <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py FAILED [ 13%] 3561s cli/tests/test_dask_scheduler.py::test_preload_command_default <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py FAILED [ 15%] 3564s cli/tests/test_dask_scheduler.py::test_multiple_workers_2 <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py FAILED [ 18%] 3568s cli/tests/test_tls_cli.py::test_basic <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_tls_cli.py FAILED [ 21%] 3571s cli/tests/test_tls_cli.py::test_sni <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_tls_cli.py FAILED [ 23%] 3575s cli/tests/test_tls_cli.py::test_nanny <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_tls_cli.py FAILED [ 26%] 3578s cli/tests/test_tls_cli.py::test_separate_key_cert <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_tls_cli.py FAILED [ 28%] 3582s cli/tests/test_tls_cli.py::test_use_config_file <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_tls_cli.py FAILED [ 31%] 3584s deploy/tests/test_subprocess.py::test_basic <- ../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_subprocess.py FAILED [ 34%] 3587s deploy/tests/test_subprocess.py::test_n_workers <- ../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_subprocess.py FAILED [ 36%] 3588s tests/test_client.py::test_upload_file_zip <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py FAILED [ 39%] 3588s tests/test_profile.py::test_info_frame_f_lineno[22-4] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py FAILED [ 42%] 3588s tests/test_profile.py::test_info_frame_f_lineno[23-4] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py FAILED [ 44%] 3588s tests/test_profile.py::test_call_stack_f_lineno[22-4] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py FAILED [ 47%] 3588s tests/test_profile.py::test_call_stack_f_lineno[23-4] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py FAILED [ 50%] 3649s tests/test_scheduler.py::test_broadcast_tls <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py FAILED [ 52%] 3649s tests/test_security.py::test_repr_temp_keys <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py FAILED [ 55%] 3649s tests/test_security.py::test_temporary_credentials <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py FAILED [ 57%] 3649s tests/test_security.py::test_extra_conn_args_in_temporary_credentials <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py FAILED [ 60%] 3710s tests/test_tls_functional.py::test_basic <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_tls_functional.py FAILED [ 63%] 3770s tests/test_tls_functional.py::test_Queue <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_tls_functional.py FAILED [ 65%] 3831s tests/test_tls_functional.py::test_client_submit <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_tls_functional.py FAILED [ 68%] 3892s tests/test_tls_functional.py::test_gather <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_tls_functional.py FAILED [ 71%] 3952s tests/test_tls_functional.py::test_scatter <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_tls_functional.py FAILED [ 73%] 4013s tests/test_tls_functional.py::test_nanny <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_tls_functional.py FAILED [ 76%] 4073s tests/test_tls_functional.py::test_rebalance <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_tls_functional.py FAILED [ 78%] 4134s tests/test_tls_functional.py::test_work_stealing <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_tls_functional.py FAILED [ 81%] 4194s tests/test_tls_functional.py::test_worker_client <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_tls_functional.py FAILED [ 84%] 4255s tests/test_tls_functional.py::test_worker_client_gather <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_tls_functional.py FAILED [ 86%] 4315s tests/test_tls_functional.py::test_worker_client_executor <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_tls_functional.py FAILED [ 89%] 4376s tests/test_tls_functional.py::test_retire_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_tls_functional.py FAILED [ 92%] 4406s tests/test_tls_functional.py::test_security_dict_input <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_tls_functional.py FAILED [ 94%] 4467s tests/test_utils_test.py::test_gen_cluster_tls <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py FAILED [ 97%] 4767s tests/test_utils_test.py::test_tls_cluster <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py +++++++++++++++++++++++++++++++++++ Timeout ++++++++++++++++++++++++++++++++++++ 4767s ~~~~~~~~~~~~~~~~~~~~~ Stack of test IOLoop_0 (3880776704) ~~~~~~~~~~~~~~~~~~~~~~ 4767s File "/usr/lib/python3.13/threading.py", line 1012, in _bootstrap 4767s self._bootstrap_inner() 4767s File "/usr/lib/python3.13/threading.py", line 1041, in _bootstrap_inner 4767s self.run() 4767s File "/usr/lib/python3.13/threading.py", line 992, in run 4767s self._target(*self._args, **self._kwargs) 4767s File "/usr/lib/python3.13/concurrent/futures/thread.py", line 92, in _worker 4767s work_item.run() 4767s File "/usr/lib/python3.13/concurrent/futures/thread.py", line 58, in run 4767s result = self.fn(*self.args, **self.kwargs) 4767s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 378, in _run_and_close_tornado 4767s return asyncio_run(inner_fn(), loop_factory=get_loop_factory()) 4767s File "/usr/lib/python3.13/asyncio/runners.py", line 194, in run 4767s return runner.run(main) 4767s File "/usr/lib/python3.13/asyncio/runners.py", line 118, in run 4767s return self._loop.run_until_complete(task) 4767s File "/usr/lib/python3.13/asyncio/base_events.py", line 707, in run_until_complete 4767s self.run_forever() 4767s File "/usr/lib/python3.13/asyncio/base_events.py", line 678, in run_forever 4767s self._run_once() 4767s File "/usr/lib/python3.13/asyncio/base_events.py", line 1995, in _run_once 4767s event_list = self._selector.select(timeout) 4767s File "/usr/lib/python3.13/selectors.py", line 452, in select 4767s fd_event_list = self._selector.poll(timeout, max_ev) 4767s ~~~~~~~~~~~~~~~~~~~~~ Stack of Dask-Offload_0 (4053050368) ~~~~~~~~~~~~~~~~~~~~~ 4767s File "/usr/lib/python3.13/threading.py", line 1012, in _bootstrap 4767s self._bootstrap_inner() 4767s File "/usr/lib/python3.13/threading.py", line 1041, in _bootstrap_inner 4767s self.run() 4767s File "/usr/lib/python3.13/threading.py", line 992, in run 4767s self._target(*self._args, **self._kwargs) 4767s File "/usr/lib/python3.13/concurrent/futures/thread.py", line 89, in _worker 4767s work_item = work_queue.get(block=True) 4767s +++++++++++++++++++++++++++++++++++ Timeout ++++++++++++++++++++++++++++++++++++ 4767s ERROR [100%] 4767s 4767s ==================================== ERRORS ==================================== 4767s ______________________ ERROR at setup of test_tls_cluster ______________________ 4767s 4767s loop = 4767s security = Security(require_encryption=True, tls_ca_file=Local (/usr/lib/python3/dist-packages/distributed/tests/tls-ca-cert.pem)...ted/tests/tls-key-cert.pem), tls_worker_cert=Local (/usr/lib/python3/dist-packages/distributed/tests/tls-key-cert.pem)) 4767s 4767s @pytest.fixture 4767s def tls_cluster(loop, security): 4767s > with tls_cluster_context(security=security) as (scheduler, workers): 4767s 4767s /usr/lib/python3/dist-packages/distributed/utils_test.py:573: 4767s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4767s /usr/lib/python3.13/contextlib.py:141: in __enter__ 4767s return next(self.gen) 4767s /usr/lib/python3/dist-packages/distributed/utils_test.py:565: in tls_cluster_context 4767s with cluster( 4767s /usr/lib/python3.13/contextlib.py:141: in __enter__ 4767s return next(self.gen) 4767s /usr/lib/python3/dist-packages/distributed/utils_test.py:672: in cluster 4767s pid, addr_or_exception = q.get() 4767s /usr/lib/python3.13/multiprocessing/queues.py:101: in get 4767s res = self._recv_bytes() 4767s /usr/lib/python3.13/multiprocessing/connection.py:216: in recv_bytes 4767s buf = self._recv_bytes(maxlength) 4767s /usr/lib/python3.13/multiprocessing/connection.py:430: in _recv_bytes 4767s buf = self._recv(4) 4767s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4767s 4767s self = , size = 4 4767s read = 4767s 4767s def _recv(self, size, read=_read): 4767s buf = io.BytesIO() 4767s handle = self._handle 4767s remaining = size 4767s while remaining > 0: 4767s > chunk = read(handle, remaining) 4767s E Failed: Timeout >300.0s 4767s 4767s /usr/lib/python3.13/multiprocessing/connection.py:395: Failed 4767s ---------------------------- Captured stderr setup ----------------------------- 4767s 2024-11-23 21:50:57,372 - distributed.http.proxy - INFO - To route to workers diagnostics web server please install jupyter-server-proxy: python -m pip install jupyter-server-proxy 4767s 2024-11-23 21:50:57,374 - distributed.scheduler - INFO - State start 4767s 2024-11-23 21:50:57,386 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45041 4767s 2024-11-23 21:50:57,387 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:8787/status 4767s 2024-11-23 21:50:57,387 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4767s 2024-11-23 21:50:57,417 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41065 4767s 2024-11-23 21:50:57,417 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41065 4767s 2024-11-23 21:50:57,418 - distributed.worker - INFO - dashboard at: 127.0.0.1:40753 4767s 2024-11-23 21:50:57,418 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:50:57,418 - distributed.worker - INFO - ------------------------------------------------- 4767s 2024-11-23 21:50:57,418 - distributed.worker - INFO - Threads: 1 4767s 2024-11-23 21:50:57,418 - distributed.worker - INFO - Memory: 15.58 GiB 4767s 2024-11-23 21:50:57,418 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-xc6umy1h 4767s 2024-11-23 21:50:57,418 - distributed.worker - INFO - ------------------------------------------------- 4767s 2024-11-23 21:50:57,421 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42071 4767s 2024-11-23 21:50:57,421 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42071 4767s 2024-11-23 21:50:57,421 - distributed.worker - INFO - dashboard at: 127.0.0.1:45683 4767s 2024-11-23 21:50:57,421 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:50:57,421 - distributed.worker - INFO - ------------------------------------------------- 4767s 2024-11-23 21:50:57,421 - distributed.worker - INFO - Threads: 1 4767s 2024-11-23 21:50:57,421 - distributed.worker - INFO - Memory: 15.58 GiB 4767s 2024-11-23 21:50:57,421 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-xzpbtwav 4767s 2024-11-23 21:50:57,422 - distributed.worker - INFO - ------------------------------------------------- 4767s 2024-11-23 21:50:57,425 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:50:57,428 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42844': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:50:57,429 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42852': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:50:57,429 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:50:57,531 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:50:57,535 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42862': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:50:57,535 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42870': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:50:57,535 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:50:57,638 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:50:57,642 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42872': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:50:57,642 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42874': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:50:57,642 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:50:57,744 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:50:57,748 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42888': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:50:57,748 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42892': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:50:57,748 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:50:57,851 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:50:57,854 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42902': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:50:57,855 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42904': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:50:57,855 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:50:57,957 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:50:57,960 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42908': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:50:57,961 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42918': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:50:57,961 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:50:58,063 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:50:58,067 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42934': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:50:58,068 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42948': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:50:58,068 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:50:58,170 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:50:58,173 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42960': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:50:58,174 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42968': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:50:58,174 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:50:58,276 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:50:58,279 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:50:58,280 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42990': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:50:58,280 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:50:58,382 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:50:58,386 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43004': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:50:58,386 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43010': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:50:58,386 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:50:58,488 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:50:58,492 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43014': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:50:58,493 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43026': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:50:58,493 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:50:58,595 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:50:58,598 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43042': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:50:58,599 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43054': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:50:58,599 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:50:58,701 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:50:58,705 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43064': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:50:58,705 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43072': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:50:58,705 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:50:58,807 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:50:58,810 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43088': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:50:58,811 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43094': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:50:58,811 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:50:58,913 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:50:58,917 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43104': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:50:58,917 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43114': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:50:58,917 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:50:59,019 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:50:59,023 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43124': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:50:59,023 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43138': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:50:59,024 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:50:59,126 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:50:59,130 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43148': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:50:59,130 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43160': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:50:59,130 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:50:59,232 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:50:59,236 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43162': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:50:59,236 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43178': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:50:59,236 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:50:59,339 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:50:59,342 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43188': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:50:59,343 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43204': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:50:59,343 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:50:59,445 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:50:59,448 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43208': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:50:59,449 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43214': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:50:59,449 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:50:59,551 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:50:59,554 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43230': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:50:59,555 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43240': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:50:59,555 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:50:59,657 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:50:59,660 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43256': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:50:59,661 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43268': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:50:59,661 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:50:59,763 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:50:59,766 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43274': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:50:59,767 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43282': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:50:59,767 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:50:59,869 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:50:59,872 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43292': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:50:59,873 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43308': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:50:59,873 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:50:59,975 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:50:59,978 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43322': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:50:59,979 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43334': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:50:59,979 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:00,081 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:00,084 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43338': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:00,085 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43344': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:00,085 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:00,187 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:00,190 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43354': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:00,191 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43366': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:00,191 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:00,293 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:00,297 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43382': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:00,297 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43390': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:00,297 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:00,399 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:00,403 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43404': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:00,403 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43408': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:00,403 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:00,505 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:00,509 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43416': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:00,509 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43418': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:00,509 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:00,611 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:00,615 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43430': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:00,615 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43444': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:00,615 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:00,717 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:00,720 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43456': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:00,721 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:00,721 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43458': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:00,824 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:00,827 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43466': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:00,828 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43468': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:00,828 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:00,930 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:00,933 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43470': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:00,934 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:00,934 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43476': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:01,036 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:01,040 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43492': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:01,040 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43500': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:01,040 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:01,142 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:01,145 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43516': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:01,146 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43518': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:01,146 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:01,248 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:01,252 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43528': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:01,252 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:01,252 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43542': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:01,354 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:01,358 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43552': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:01,358 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43566': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:01,358 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:01,461 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:01,464 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43582': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:01,465 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43586': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:01,465 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:01,567 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:01,571 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43466': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:01,571 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43472': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:01,571 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:01,673 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:01,677 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43488': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:01,677 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43502': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:01,677 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:01,779 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:01,783 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43516': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:01,783 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43528': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:01,783 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:01,885 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:01,889 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43542': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:01,890 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:01,893 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43546': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:01,992 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:01,995 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43550': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:01,996 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43560': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:01,996 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:02,098 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:02,101 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43562': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:02,102 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43576': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:02,102 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:02,204 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:02,207 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43586': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:02,208 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:02,208 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43602': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:02,310 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:02,314 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43616': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:02,314 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43626': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:02,314 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:02,417 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:02,420 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43636': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:02,421 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43648': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:02,421 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:02,524 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:02,527 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43664': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:02,528 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43672': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:02,528 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:02,630 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:02,634 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43682': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:02,634 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43686': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:02,634 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:02,737 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:02,740 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43690': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:02,741 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43692': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:02,741 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:02,843 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:02,847 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43700': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:02,847 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43714': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:02,847 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:02,949 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:02,953 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43728': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:02,954 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43744': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:02,954 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:03,055 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:03,060 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43760': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:03,060 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:03,060 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43774': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:03,162 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:03,165 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43790': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:03,166 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43792': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:03,166 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:03,268 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:03,271 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43804': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:03,272 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43808': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:03,272 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:03,374 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:03,377 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43812': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:03,378 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43820': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:03,378 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:03,481 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:03,484 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43836': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:03,485 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43846': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:03,485 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:03,587 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:03,591 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43858': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:03,591 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43862': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:03,591 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:03,693 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:03,697 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43866': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:03,697 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43874': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:03,698 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:03,800 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:03,803 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43886': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:03,804 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43888': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:03,804 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:03,906 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:03,910 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43904': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:03,910 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43908': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:03,910 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:04,012 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:04,016 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43914': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:04,017 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43924': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:04,017 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:04,119 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:04,122 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43936': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:04,123 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43946': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:04,123 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:04,226 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:04,230 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43956': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:04,230 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43960': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:04,230 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:04,332 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:04,336 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43974': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:04,336 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43976': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:04,337 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:04,440 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:04,443 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43992': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:04,444 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43996': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:04,444 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:04,546 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:04,549 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44006': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:04,550 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44010': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:04,550 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:04,653 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:04,656 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44020': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:04,657 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44028': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:04,657 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:04,759 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:04,763 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44036': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:04,763 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44038': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:04,763 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:04,865 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:04,869 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44044': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:04,870 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:04,870 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:04,972 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:04,975 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44066': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:04,976 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44080': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:04,976 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:05,078 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:05,081 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44090': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:05,082 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44094': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:05,082 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:05,184 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:05,188 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44108': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:05,188 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:05,188 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:05,291 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:05,294 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44134': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:05,295 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44146': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:05,295 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:05,397 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:05,401 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44150': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:05,401 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44158': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:05,401 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:05,504 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:05,508 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44168': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:05,509 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:05,509 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44184': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:05,610 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:05,614 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44188': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:05,614 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44202': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:05,614 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:05,717 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:05,720 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44204': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:05,721 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44212': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:05,721 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:05,823 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:05,826 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44226': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:05,827 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44242': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:05,827 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:05,930 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:05,934 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44250': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:05,934 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44252': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:05,934 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:06,036 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:06,040 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44256': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:06,040 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44260': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:06,041 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:06,143 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:06,146 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44266': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:06,147 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44274': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:06,147 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:06,249 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:06,253 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44276': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:06,253 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44290': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:06,253 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:06,355 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:06,359 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44304': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:06,360 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44314': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:06,360 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:06,462 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:06,465 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44324': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:06,466 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44340': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:06,466 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:06,568 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:06,571 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44356': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:06,572 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44358': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:06,572 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:06,674 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:06,678 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44362': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:06,678 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44364': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:06,679 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:06,781 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:06,784 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44370': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:06,785 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44380': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:06,785 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:06,887 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:06,890 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44382': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:06,891 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:06,894 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44388': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:06,993 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:06,997 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44404': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:06,997 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44412': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:06,997 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:07,099 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:07,103 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44418': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:07,103 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44426': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:07,103 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:07,206 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:07,209 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44428': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:07,210 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44436': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:07,210 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:07,312 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:07,315 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44450': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:07,316 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44452': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:07,316 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:07,418 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:07,422 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44454': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:07,422 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44466': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:07,422 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:07,524 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:07,528 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44468': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:07,528 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44480': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:07,528 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:07,632 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:07,636 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44494': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:07,636 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44504': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:07,636 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:07,738 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:07,742 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44506': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:07,742 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44510': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:07,743 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:07,845 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:07,848 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44524': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:07,849 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44526': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:07,849 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:07,951 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:07,955 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44534': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:07,955 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44546': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:07,955 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:08,057 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:08,061 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44562': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:08,061 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44576': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:08,061 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:08,164 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:08,167 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44578': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:08,168 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44588': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:08,168 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:08,270 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:08,274 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44600': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:08,274 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44610': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:08,274 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:08,376 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:08,380 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44616': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:08,380 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44618': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:08,380 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:08,482 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:08,486 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44620': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:08,487 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44636': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:08,487 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:08,589 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:08,592 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44646': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:08,593 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44658': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:08,593 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:08,695 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:08,698 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44670': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:08,699 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44680': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:08,699 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:08,802 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:08,805 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44690': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:08,806 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44696': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:08,806 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:08,908 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:08,912 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44710': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:08,912 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44716': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:08,912 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:09,014 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:09,018 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44728': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:09,018 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44732': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:09,018 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:09,120 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:09,124 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44734': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:09,124 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44748': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:09,124 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:09,227 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:09,230 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44760': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:09,231 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44762': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:09,231 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:09,334 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:09,337 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44772': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:09,338 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44784': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:09,338 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:09,440 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:09,443 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44790': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:09,444 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44794': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:09,444 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:09,546 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:09,549 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44802': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:09,550 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44818': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:09,550 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:09,652 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:09,655 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44820': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:09,656 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44828': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:09,656 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:09,758 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:09,761 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44832': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:09,762 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44836': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:09,762 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:09,864 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:09,867 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44840': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:09,868 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44856': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:09,868 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:09,970 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:09,974 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44866': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:09,974 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44876': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:09,974 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:10,076 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:10,080 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44886': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:10,080 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44900': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:10,080 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:10,182 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:10,186 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44916': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:10,186 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44932': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:10,186 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:10,288 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:10,292 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44942': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:10,292 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44944': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:10,292 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:10,396 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:10,400 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44946': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:10,400 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44958': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:10,400 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:10,502 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:10,506 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44974': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:10,506 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44988': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:10,506 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:10,608 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:10,612 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44998': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:10,613 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:45000': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:10,613 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:10,714 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:45002': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:10,714 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:10,719 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:45008': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:10,719 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:10,821 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:10,825 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:45010': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:10,825 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:45012': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:10,825 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:10,927 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:10,931 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:45028': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:10,931 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:45040': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:10,931 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:11,034 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:11,038 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:45046': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:11,038 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:45058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:11,038 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:11,140 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:11,144 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:45066': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:11,144 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:45082': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:11,144 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:11,246 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:11,250 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:45094': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:11,251 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:45108': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:11,251 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:11,353 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:11,356 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:45120': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:11,357 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:45136': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:11,357 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:11,459 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:11,462 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:45150': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:11,463 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:45162': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:11,463 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:11,565 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:11,569 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60590': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:11,569 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60602': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:11,569 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:11,671 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:11,675 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60612': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:11,675 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60626': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:11,675 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:11,777 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:11,781 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60632': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:11,781 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60642': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:11,781 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:11,884 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:11,887 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60656': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:11,888 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:11,891 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60662': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:11,990 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:11,994 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60664': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:11,994 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60668': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:11,994 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:12,096 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:12,100 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60674': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:12,100 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:12,100 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60678': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:12,202 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:12,206 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60684': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:12,206 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60696': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:12,206 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:12,309 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:12,312 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60700': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:12,313 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:12,313 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60708': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:12,415 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:12,419 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60720': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:12,419 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60730': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:12,419 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:12,521 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:12,525 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60744': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:12,525 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60750': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:12,525 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:12,627 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:12,631 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60762': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:12,632 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60766': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:12,632 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:12,734 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:12,738 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60776': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:12,738 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60782': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:12,738 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:12,841 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:12,844 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60794': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:12,845 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60798': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:12,845 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:12,947 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:12,951 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60806': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:12,951 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60818': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:12,951 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:13,053 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:13,057 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60826': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:13,058 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60838': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:13,058 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:13,160 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:13,163 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60852': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:13,164 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60866': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:13,164 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:13,266 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:13,269 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60882': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:13,270 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60894': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:13,270 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:13,372 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:13,376 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60898': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:13,376 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60912': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:13,376 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:13,479 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:13,482 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60926': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:13,483 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60928': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:13,483 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:13,585 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:13,588 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60936': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:13,589 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60942': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:13,589 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:13,691 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:13,694 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60952': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:13,695 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60960': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:13,695 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:13,797 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:13,800 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60976': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:13,801 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60986': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:13,801 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:13,903 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:13,906 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60992': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:13,907 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:32768': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:13,907 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:14,009 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:14,013 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:32778': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:14,013 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:32792': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:14,013 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:14,115 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:14,119 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:32800': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:14,119 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:32810': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:14,119 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:14,221 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:14,225 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:32818': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:14,226 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:32826': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:14,226 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:14,328 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:14,331 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:32830': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:14,332 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:32838': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:14,332 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:14,435 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:14,439 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:32844': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:14,439 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:32850': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:14,439 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:14,541 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:14,545 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:32858': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:14,545 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:32868': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:14,545 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:14,648 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:14,651 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:32870': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:14,652 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:32874': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:14,652 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:14,754 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:14,758 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:32880': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:14,758 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:32894': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:14,758 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:14,860 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:14,864 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:32906': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:14,864 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:32916': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:14,864 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:14,967 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:14,970 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:32930': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:14,971 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:32940': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:14,971 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:15,073 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:15,076 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:32956': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:15,077 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:32960': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:15,077 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:15,179 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:15,183 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:32964': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:15,183 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:32968': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:15,183 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:15,286 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:15,289 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:32974': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:15,290 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:15,290 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:32984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:15,392 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:15,399 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:32988': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:15,400 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33000': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:15,400 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:15,498 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33004': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:15,498 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:15,506 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:15,506 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33016': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:15,605 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33032': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:15,605 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:15,612 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33040': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:15,612 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:15,711 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33052': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:15,711 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:15,718 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33056': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:15,718 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:15,817 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33070': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:15,817 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:15,825 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33072': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:15,825 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:15,924 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:15,924 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33078': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:15,931 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:15,931 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33088': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:16,030 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33094': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:16,030 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:16,037 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33102': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:16,037 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:16,137 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33114': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:16,137 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:16,143 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33130': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:16,143 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:16,244 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33142': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:16,244 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:16,249 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:16,249 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33152': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:16,350 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:16,350 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33158': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:16,355 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33160': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:16,355 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:16,456 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:16,456 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33170': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:16,461 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33176': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:16,461 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:16,562 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33188': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:16,562 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:16,567 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33202': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:16,567 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:16,668 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:16,673 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33216': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:16,674 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33220': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:16,674 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:16,775 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:16,775 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33234': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:16,780 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:16,780 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33244': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:16,881 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:16,881 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33248': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:16,886 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:16,886 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33260': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:16,987 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33266': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:16,987 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:16,992 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33276': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:16,992 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:17,094 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:17,098 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33288': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:17,098 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33296': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:17,098 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:17,200 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:17,204 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33298': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:17,204 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33306': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:17,204 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:17,306 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:17,310 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33314': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:17,310 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33326': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:17,310 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:17,413 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:17,416 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33338': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:17,417 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33354': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:17,417 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:17,519 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:17,523 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33370': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:17,523 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33376': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:17,523 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:17,626 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:17,630 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33384': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:17,630 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33392': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:17,630 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:17,733 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:17,736 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33408': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:17,736 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33424': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:17,737 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:17,840 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:17,843 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33426': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:17,844 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33432': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:17,844 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:17,946 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:17,950 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33446': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:17,951 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33454': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:17,951 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:18,053 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:18,056 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33456': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:18,057 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33464': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:18,057 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:18,159 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:18,162 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33468': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:18,163 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:18,164 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33474': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:18,265 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:18,269 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33484': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:18,269 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33492': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:18,269 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:18,372 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:18,375 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33500': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:18,376 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33512': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:18,376 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:18,478 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:18,482 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33526': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:18,482 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33534': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:18,482 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:18,584 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:18,588 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33548': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:18,588 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33550': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:18,588 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:18,691 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:18,695 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33558': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:18,695 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33574': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:18,695 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:18,798 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33588': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:18,798 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:18,803 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33602': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:18,804 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:18,904 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:18,904 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33608': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:18,912 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33610': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:18,912 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:19,011 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33624': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:19,011 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:19,021 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33632': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:19,021 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:19,117 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33636': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:19,117 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:19,129 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33642': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:19,129 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:19,224 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33644': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:19,224 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:19,238 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33650': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:19,238 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:19,330 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:19,331 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33652': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:19,347 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33662': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:19,347 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:19,437 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33672': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:19,437 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:19,456 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33682': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:19,456 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:19,544 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33696': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:19,544 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:19,564 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33712': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:19,565 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:19,651 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:19,651 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33722': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:19,673 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33726': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:19,674 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:19,758 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33734': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:19,758 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:19,782 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33748': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:19,782 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:19,865 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33752': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:19,865 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:19,891 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:19,893 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33762': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:19,971 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33778': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:19,971 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:20,000 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33786': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:20,000 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:20,078 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33800': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:20,078 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:20,109 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33816': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:20,109 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:20,185 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33818': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:20,185 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:20,218 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33820': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:20,218 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:20,291 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33830': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:20,291 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:20,326 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33832': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:20,327 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:20,398 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33834': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:20,398 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:20,435 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33840': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:20,436 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:20,504 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33850': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:20,504 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:20,544 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33866': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:20,544 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:20,611 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33870': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:20,611 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:20,653 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33872': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:20,653 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:20,718 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33886': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:20,718 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:20,762 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33894': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:20,762 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:20,824 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33900': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:20,824 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:20,871 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33914': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:20,871 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:20,931 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33922': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:20,931 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:20,979 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33926': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:20,980 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:21,038 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33932': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:21,038 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:21,088 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33946': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:21,089 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:21,144 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33962': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:21,144 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:21,197 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33970': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:21,198 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:21,252 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33980': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:21,252 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:21,306 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33982': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:21,307 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:21,359 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33990': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:21,359 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:21,415 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33992': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:21,416 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:21,465 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34002': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:21,465 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:21,524 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34018': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:21,524 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:21,572 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44208': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:21,572 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:21,633 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44224': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:21,633 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:21,679 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44236': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:21,679 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:21,742 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44250': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:21,742 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:21,785 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44258': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:21,785 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:21,851 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44260': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:21,852 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:21,892 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:21,894 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44266': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:21,960 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44270': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:21,961 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:21,999 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44278': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:21,999 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:22,071 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44292': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:22,072 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:22,106 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44308': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:22,106 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:22,180 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44312': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:22,180 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:22,212 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44322': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:22,212 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:22,289 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44332': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:22,289 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:22,319 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44340': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:22,319 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:22,398 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44342': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:22,398 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:22,426 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44344': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:22,426 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:22,506 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44360': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:22,507 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:22,532 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44374': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:22,532 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:22,615 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44384': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:22,616 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:22,639 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44392': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:22,639 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:22,724 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44408': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:22,725 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:22,746 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44412': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:22,746 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:22,833 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44424': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:22,833 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:22,854 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:22,854 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44436': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:22,942 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44438': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:22,942 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:22,961 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44440': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:22,961 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:23,051 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44450': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:23,051 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:23,068 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44454': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:23,068 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:23,160 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44470': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:23,160 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:23,174 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44476': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:23,174 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:23,269 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44486': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:23,269 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:23,280 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44498': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:23,280 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:23,378 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44514': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:23,378 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:23,387 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:23,392 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44520': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:23,487 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44530': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:23,487 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:23,495 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:23,495 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44544': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:23,595 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44552': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:23,596 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:23,602 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:23,602 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44556': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:23,704 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:23,708 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44570': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:23,709 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:23,709 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44584': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:23,812 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:23,816 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44586': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:23,817 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44592': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:23,817 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:23,922 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:23,926 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44602': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:23,926 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:23,927 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44606': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:24,031 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:24,035 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44612': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:24,036 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:24,036 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44620': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:24,141 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:24,145 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44626': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:24,145 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:24,146 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44642': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:24,250 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:24,254 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44648': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:24,255 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:24,255 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44650': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:24,360 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:24,364 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44662': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:24,364 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:24,365 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44668': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:24,469 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:24,474 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44684': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:24,474 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:24,475 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44688': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:24,579 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:24,583 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44698': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:24,583 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:24,584 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44710': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:24,688 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:24,694 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:24,694 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44726': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:24,694 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44738': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:24,798 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:24,802 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44750': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:24,802 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:24,802 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44752': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:24,907 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:24,911 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44754': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:24,911 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:24,912 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44770': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:25,017 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:25,021 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44776': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:25,021 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:25,022 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44784': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:25,126 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:25,131 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:25,131 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:25,131 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44798': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:25,236 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:25,240 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44814': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:25,240 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:25,240 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44828': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:25,345 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:25,350 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44838': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:25,350 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:25,350 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44850': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:25,455 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:25,459 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44864': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:25,459 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:25,460 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44876': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:25,564 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:25,569 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44888': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:25,569 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:25,569 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44896': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:25,674 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:25,678 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44910': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:25,678 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:25,679 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44924': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:25,784 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:25,788 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:25,788 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44938': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:25,789 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44948': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:25,893 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:25,904 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44956': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:25,905 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:25,905 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44966': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:26,002 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44974': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:26,002 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:26,014 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44982': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:26,014 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:26,112 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44988': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:26,112 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:26,124 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:44996': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:26,124 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:26,222 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:45010': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:26,222 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:26,233 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:26,233 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:45020': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:26,331 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:45026': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:26,332 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:26,343 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:45038': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:26,343 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:26,441 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:45046': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:26,441 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:26,454 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:26,454 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:45050': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:26,553 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:45058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:26,553 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:26,564 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:45068': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:26,564 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:26,662 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:26,663 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:45076': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:26,673 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:45086': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:26,673 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:26,772 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:45090': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:26,772 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:26,782 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:26,782 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:45100': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:26,881 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:26,881 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:45108': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:26,891 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:26,894 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:45120': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:26,991 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:45126': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:26,991 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:27,000 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:45138': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:27,000 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:27,100 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:27,100 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:45144': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:27,108 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:27,108 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:45154': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:27,210 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:27,210 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:45166': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:27,217 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:27,217 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:45178': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:27,319 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:27,325 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:45180': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:27,326 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:45192': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:27,326 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:27,429 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:27,429 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:45202': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:27,436 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:27,436 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:45212': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:27,538 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:45228': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:27,539 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:27,545 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:45240': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:27,545 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:27,648 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:27,648 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:45248': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:27,655 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:27,655 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:45258': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:27,757 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:27,763 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:45272': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:27,764 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:45274': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:27,764 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:27,867 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:45286': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:27,867 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:27,873 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:27,873 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:45288': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:27,976 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:27,981 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:45302': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:27,982 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:45316': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:27,982 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:28,086 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:28,090 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:45322': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:28,091 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:28,091 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:45334': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:28,195 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:28,200 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:45348': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:28,201 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:45364': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:28,201 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:28,304 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:45378': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:28,305 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:28,311 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:45386': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:28,311 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:28,414 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:45400': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:28,414 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:28,421 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:45416': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:28,421 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:28,524 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:28,524 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:45424': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:28,531 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:45430': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:28,531 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:28,633 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:45438': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:28,633 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:28,641 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:45448': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:28,641 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:28,743 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:45452': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:28,743 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:28,750 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:45458': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:28,750 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:28,853 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:45462': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:28,853 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:28,860 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:45470': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:28,860 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:28,962 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:28,963 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:45484': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:28,970 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:45494': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:28,970 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:29,072 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:45498': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:29,072 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:29,079 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:45502': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:29,079 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:29,181 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:45510': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:29,181 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:29,189 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:45520': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:29,189 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:29,291 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:45526': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:29,291 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:29,299 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:45532': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:29,299 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:29,400 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:45536': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:29,400 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:29,408 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:45544': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:29,408 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:29,510 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:45550': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:29,510 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:29,518 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:45554': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:29,518 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:29,619 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:45564': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:29,619 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:29,627 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:45566': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:29,627 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:29,729 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:45572': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:29,729 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:29,737 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:45578': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:29,737 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:29,839 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:45588': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:29,839 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:29,846 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:45602': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:29,846 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:29,948 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:45610': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:29,948 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:29,956 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:45618': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:29,957 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:30,058 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:45626': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:30,058 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:30,066 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:45628': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:30,066 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:30,168 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:45640': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:30,168 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:30,176 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:45656': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:30,176 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:30,278 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:30,278 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:45664': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:30,286 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:30,286 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:45678': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:30,388 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:30,388 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:45690': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:30,408 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:45706': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:30,408 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:30,497 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:45710': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:30,497 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:30,518 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:45720': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:30,518 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:30,607 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:45730': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:30,607 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:30,628 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:45732': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:30,628 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:30,717 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:45734': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:30,717 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:30,738 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:45742': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:30,738 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:30,827 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:45744': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:30,827 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:30,848 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:45752': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:30,848 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:30,936 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:45762': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:30,936 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:30,962 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:45764': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:30,962 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:31,050 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:31,050 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:45766': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:31,072 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:45770': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:31,072 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:31,159 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:45778': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:31,159 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:31,182 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:45782': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:31,182 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:31,269 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:31,269 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:45798': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:31,292 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:45804': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:31,292 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:31,378 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:45816': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:31,378 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:31,401 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:31,401 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:45826': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:31,488 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:31,488 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:45836': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:31,511 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:45842': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:31,511 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:31,598 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59070': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:31,598 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:31,620 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:31,620 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59084': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:31,708 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59100': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:31,708 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:31,730 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59110': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:31,730 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:31,818 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59116': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:31,818 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:31,840 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:31,840 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59130': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:31,928 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59134': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:31,928 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:31,950 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59142': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:31,950 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:32,038 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59158': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:32,038 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:32,060 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59160': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:32,060 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:32,147 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:32,147 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59168': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:32,170 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59174': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:32,170 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:32,257 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59184': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:32,257 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:32,279 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59188': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:32,279 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:32,367 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59204': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:32,367 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:32,389 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:32,393 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59218': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:32,476 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59232': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:32,477 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:32,499 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59242': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:32,499 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:32,586 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59258': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:32,586 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:32,609 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59274': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:32,609 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:32,696 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59278': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:32,696 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:32,718 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59280': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:32,718 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:32,806 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59284': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:32,806 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:32,828 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59292': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:32,828 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:32,915 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59298': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:32,915 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:32,938 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59302': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:32,938 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:33,025 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59312': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:33,025 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:33,048 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59328': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:33,048 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:33,135 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59340': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:33,135 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:33,158 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59348': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:33,158 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:33,245 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59364': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:33,245 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:33,267 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59380': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:33,267 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:33,355 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59382': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:33,355 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:33,377 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59386': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:33,377 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:33,464 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59396': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:33,465 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:33,488 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59398': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:33,488 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:33,575 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59400': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:33,575 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:33,598 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59402': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:33,598 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:33,685 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59410': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:33,685 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:33,708 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59426': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:33,708 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:33,795 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:33,795 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59442': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:33,818 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59454': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:33,818 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:33,904 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59464': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:33,904 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:33,928 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59476': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:33,928 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:34,014 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:34,014 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59484': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:34,038 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59496': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:34,038 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:34,123 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:34,123 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59510': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:34,148 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59526': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:34,148 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:34,233 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:34,233 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59528': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:34,258 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59540': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:34,258 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:34,342 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59544': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:34,342 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:34,368 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59550': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:34,367 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:34,452 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59558': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:34,452 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:34,477 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59562': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:34,477 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:34,561 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59578': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:34,561 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:34,587 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59584': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:34,587 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:34,669 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59590': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:34,669 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:34,697 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59594': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:34,697 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:34,778 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59596': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:34,778 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:34,807 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59606': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:34,808 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:34,887 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59618': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:34,887 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:34,918 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59624': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:34,918 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:34,995 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59638': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:34,995 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:35,027 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59646': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:35,028 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:35,103 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59648': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:35,103 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:35,138 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59652': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:35,138 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:35,211 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59654': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:35,211 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:35,249 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59664': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:35,249 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:35,320 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59678': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:35,320 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:35,359 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59692': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:35,359 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:35,429 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59694': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:35,430 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:35,469 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59704': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:35,469 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:35,539 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59714': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:35,539 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:35,580 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:35,581 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:35,651 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59730': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:35,651 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:35,690 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59732': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:35,691 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:35,761 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59738': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:35,761 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:35,801 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59740': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:35,801 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:35,870 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:35,870 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59750': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:35,911 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59762': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:35,911 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:35,978 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:35,978 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59778': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:36,021 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59788': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:36,021 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:36,085 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:36,085 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59790': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:36,131 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59792': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:36,131 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:36,193 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:36,193 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59808': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:36,241 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59822': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:36,241 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:36,300 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:36,300 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59828': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:36,351 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59844': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:36,351 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:36,407 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:36,407 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59858': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:36,461 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59860': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:36,461 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:36,514 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:36,515 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59868': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:36,571 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59870': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:36,571 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:36,622 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:36,622 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59886': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:36,681 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59894': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:36,681 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:36,729 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:36,730 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59904': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:36,791 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59920': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:36,791 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:36,837 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:36,837 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59934': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:36,901 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59940': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:36,901 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:36,944 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:36,945 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59948': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:37,012 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59962': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:37,012 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:37,052 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:37,052 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59970': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:37,122 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59972': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:37,123 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:37,160 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:37,160 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59982': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:37,232 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59992': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:37,232 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:37,267 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:37,268 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60004': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:37,343 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60014': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:37,343 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:37,375 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:37,375 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60020': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:37,453 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60028': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:37,453 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:37,483 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:37,483 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60034': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:37,563 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60042': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:37,563 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:37,590 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:37,591 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60054': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:37,672 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60064': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:37,672 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:37,698 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:37,698 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60070': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:37,780 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60076': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:37,780 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:37,805 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:37,805 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60088': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:37,889 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:37,895 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60102': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:37,912 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:37,912 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60108': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:37,998 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60124': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:37,998 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:38,020 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:38,020 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60136': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:38,107 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60152': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:38,107 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:38,127 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:38,127 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60166': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:38,217 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60180': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:38,217 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:38,235 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:38,235 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60182': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:38,327 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60186': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:38,327 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:38,342 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:38,342 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60190': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:38,437 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60200': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:38,437 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:38,450 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:38,450 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60208': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:38,547 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60212': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:38,547 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:38,557 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:38,557 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60218': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:38,656 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:38,656 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60220': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:38,664 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:38,664 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60224': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:38,767 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:38,771 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60226': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:38,771 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:38,772 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60238': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:38,876 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:38,881 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60242': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:38,881 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:38,882 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60256': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:38,986 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:38,990 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60272': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:38,991 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:38,991 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60288': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:39,095 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:39,100 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60304': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:39,100 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:39,100 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60308': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:39,205 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:39,209 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60316': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:39,209 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:39,210 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60320': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:39,314 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:39,318 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60328': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:39,319 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:39,319 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60330': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:39,424 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:39,428 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60342': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:39,428 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:39,429 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60354': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:39,533 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:39,537 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60366': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:39,538 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:39,538 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60376': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:39,643 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:39,647 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60388': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:39,648 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:39,648 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60400': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:39,753 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:39,757 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60412': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:39,757 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:39,757 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60424': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:39,863 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:39,867 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60430': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:39,868 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:39,868 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60436': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:39,972 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:39,977 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60442': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:39,977 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:39,977 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60444': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:40,084 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:40,088 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60452': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:40,088 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:40,089 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60460': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:40,193 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:40,198 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60468': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:40,198 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:40,198 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60476': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:40,302 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:40,307 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60478': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:40,307 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:40,307 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60488': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:40,411 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:40,416 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60492': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:40,416 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:40,416 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60500': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:40,521 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:40,526 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60502': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:40,526 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:40,526 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60504': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:40,630 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:40,635 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60508': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:40,635 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:40,635 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60518': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:40,740 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:40,744 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60520': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:40,744 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:40,745 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60528': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:40,849 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:40,853 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60530': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:40,854 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:40,854 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60540': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:40,958 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:40,963 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60550': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:40,963 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:40,963 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60558': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:41,068 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:41,072 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60570': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:41,072 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:41,073 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60586': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:41,177 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:41,181 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60590': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:41,182 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:41,182 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60596': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:41,287 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:41,291 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:41,291 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60604': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:41,292 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60616': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:41,399 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:41,402 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60622': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:41,403 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:41,403 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60638': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:41,508 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:41,512 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60648': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:41,512 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:41,513 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60656': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:41,617 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:41,621 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36038': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:41,622 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:41,622 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36042': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:41,726 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:41,730 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36052': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:41,730 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:41,730 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36064': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:41,835 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:41,839 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36070': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:41,839 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:41,839 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36078': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:41,943 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:41,947 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36080': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:41,948 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:41,948 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36088': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:42,052 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:42,056 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36098': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:42,057 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:42,057 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36108': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:42,161 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:42,165 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36124': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:42,166 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36138': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:42,166 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:42,270 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:42,274 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36144': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:42,275 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:42,275 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36152': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:42,379 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:42,382 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36162': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:42,382 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36174': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:42,382 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:42,488 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:42,490 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36184': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:42,491 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36188': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:42,491 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:42,596 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:42,599 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36192': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:42,600 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36196': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:42,600 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:42,705 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:42,708 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36206': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:42,708 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36212': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:42,708 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:42,814 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:42,817 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36222': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:42,817 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36226': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:42,817 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:42,922 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:42,925 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36230': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:42,926 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36234': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:42,926 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:43,031 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:43,034 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36246': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:43,035 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36258': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:43,035 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:43,140 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:43,144 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36274': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:43,144 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36290': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:43,144 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:43,249 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:43,252 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36304': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:43,252 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36316': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:43,252 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:43,358 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:43,360 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36320': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:43,361 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36330': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:43,361 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:43,467 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:43,469 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36332': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:43,470 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36338': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:43,470 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:43,576 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:43,578 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36340': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:43,579 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36350': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:43,579 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:43,685 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:43,688 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36364': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:43,688 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36370': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:43,688 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:43,793 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:43,796 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36376': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:43,797 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36382': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:43,797 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:43,902 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:43,905 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36386': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:43,905 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36388': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:43,905 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:44,011 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:44,014 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36396': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:44,014 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36398': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:44,014 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:44,120 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:44,122 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36404': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:44,123 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36418': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:44,123 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:44,228 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:44,231 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36434': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:44,232 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36444': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:44,232 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:44,337 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:44,340 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36448': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:44,341 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36450': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:44,341 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:44,446 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:44,449 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36462': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:44,450 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36478': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:44,450 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:44,555 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:44,558 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36490': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:44,558 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36500': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:44,558 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:44,664 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:44,667 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36516': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:44,667 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36522': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:44,667 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:44,772 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:44,775 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36538': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:44,776 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36550': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:44,776 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:44,881 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:44,884 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36554': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:44,885 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36564': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:44,885 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:44,990 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:44,993 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36572': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:44,993 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36588': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:44,993 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:45,099 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:45,102 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36596': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:45,102 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36604': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:45,102 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:45,208 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:45,210 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36608': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:45,211 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36610': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:45,211 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:45,317 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:45,319 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36624': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:45,320 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36632': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:45,320 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:45,425 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:45,428 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36644': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:45,429 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36658': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:45,429 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:45,534 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:45,537 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36672': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:45,537 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36684': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:45,537 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:45,643 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:45,646 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36686': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:45,646 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36694': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:45,646 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:45,752 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:45,755 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36696': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:45,756 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36704': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:45,756 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:45,861 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:45,864 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36714': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:45,865 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:45,865 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:45,970 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:45,973 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36732': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:45,973 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36738': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:45,973 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:46,079 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:46,082 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36744': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:46,082 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36758': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:46,082 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:46,188 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:46,191 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36764': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:46,191 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36780': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:46,191 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:46,297 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:46,299 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36794': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:46,300 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:46,300 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:46,405 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:46,408 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36810': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:46,409 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36824': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:46,409 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:46,514 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:46,517 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36828': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:46,517 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36840': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:46,517 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:46,623 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:46,625 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36846': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:46,626 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36850': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:46,626 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:46,732 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:46,735 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36866': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:46,735 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36874': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:46,735 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:46,841 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:46,843 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36888': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:46,844 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36900': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:46,844 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:46,950 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:46,952 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36916': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:46,953 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36932': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:46,953 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:47,058 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:47,061 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36946': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:47,062 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36950': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:47,062 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:47,167 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:47,170 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36964': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:47,171 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36974': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:47,171 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:47,276 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:47,279 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36986': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:47,279 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36990': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:47,279 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:47,385 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:47,388 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36998': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:47,388 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:47,391 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37004': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:47,494 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:47,497 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37014': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:47,498 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37024': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:47,498 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:47,603 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:47,606 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37028': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:47,606 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37032': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:47,606 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:47,711 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:47,714 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37048': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:47,715 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37056': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:47,715 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:47,820 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:47,823 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:47,824 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:47,824 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37060': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:47,929 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:47,932 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37064': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:47,932 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37076': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:47,932 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:48,038 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:48,041 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37080': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:48,041 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37082': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:48,041 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:48,147 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:48,150 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37096': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:48,150 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37102': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:48,150 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:48,255 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:48,258 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37118': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:48,259 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37132': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:48,259 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:48,364 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:48,366 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37142': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:48,367 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37150': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:48,367 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:48,473 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:48,475 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37156': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:48,476 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37160': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:48,476 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:48,581 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:48,584 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37162': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:48,585 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37176': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:48,585 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:48,691 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:48,693 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37186': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:48,694 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37200': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:48,694 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:48,799 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:48,802 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37206': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:48,803 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37212': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:48,803 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:48,908 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:48,911 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37220': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:48,911 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:48,911 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37224': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:49,017 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:49,020 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37236': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:49,020 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37240': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:49,020 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:49,127 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:49,130 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37254': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:49,131 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37268': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:49,131 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:49,237 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:49,240 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37278': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:49,241 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37292': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:49,241 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:49,346 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:49,349 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37298': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:49,349 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37306': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:49,349 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:49,455 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:49,458 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37314': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:49,458 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37326': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:49,458 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:49,564 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:49,566 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37340': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:49,567 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37354': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:49,567 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:49,673 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:49,675 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37360': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:49,676 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:49,676 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37372': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:49,781 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:49,784 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37378': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:49,784 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37384': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:49,785 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:49,890 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:49,897 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37392': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:49,897 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37398': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:49,897 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:49,998 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37404': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:49,999 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:50,004 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37406': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:50,004 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:50,107 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:50,110 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37414': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:50,111 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37424': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:50,111 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:50,216 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:50,219 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37438': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:50,220 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37442': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:50,220 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:50,325 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:50,328 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37458': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:50,328 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37468': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:50,328 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:50,434 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:50,437 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37484': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:50,437 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37492': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:50,437 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:50,543 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:50,545 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37504': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:50,546 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37510': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:50,546 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:50,652 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:50,654 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37518': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:50,655 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37526': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:50,655 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:50,761 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:50,764 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37534': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:50,764 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37536': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:50,764 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:50,870 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:50,872 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37548': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:50,873 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37550': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:50,873 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:50,979 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:50,982 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37564': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:50,983 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:50,983 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37568': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:51,089 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:51,092 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37572': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:51,092 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37582': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:51,092 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:51,197 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:51,200 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37586': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:51,201 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37592': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:51,201 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:51,306 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:51,309 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37608': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:51,310 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37614': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:51,310 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:51,415 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:51,418 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37620': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:51,419 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37636': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:51,419 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:51,524 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:51,527 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37642': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:51,527 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37644': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:51,527 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:51,633 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:51,636 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37658': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:51,636 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37662': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:51,636 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:51,742 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:51,745 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37670': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:51,745 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:51,745 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37684': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:51,851 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:51,855 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37692': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:51,855 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37706': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:51,855 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:51,959 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:51,962 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37710': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:51,963 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37722': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:51,963 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:52,069 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:52,072 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37728': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:52,072 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37742': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:52,072 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:52,178 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:52,181 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37754': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:52,181 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37768': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:52,181 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:52,287 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:52,290 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37782': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:52,290 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37790': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:52,290 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:52,397 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:52,400 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37792': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:52,400 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37802': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:52,401 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:52,506 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:52,509 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37804': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:52,510 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37806': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:52,510 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:52,615 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:52,618 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37816': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:52,618 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37826': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:52,618 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:52,725 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:52,728 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37834': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:52,728 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37836': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:52,728 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:52,834 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:52,837 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37838': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:52,837 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37850': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:52,837 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:52,943 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:52,945 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37860': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:52,946 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37862': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:52,946 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:53,052 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:53,055 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37866': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:53,055 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37874': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:53,055 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:53,161 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:53,163 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37876': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:53,164 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37886': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:53,164 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:53,270 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:53,273 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37894': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:53,273 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37910': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:53,273 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:53,379 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:53,381 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37926': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:53,382 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37928': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:53,382 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:53,487 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:53,490 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37934': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:53,491 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37944': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:53,491 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:53,596 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:53,599 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37948': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:53,600 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:53,600 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37954': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:53,704 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:53,707 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37968': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:53,707 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:53,708 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:53,810 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:53,814 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37996': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:53,814 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38000': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:53,814 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:53,916 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:53,920 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38016': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:53,920 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38022': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:53,920 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:54,023 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:54,026 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38036': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:54,027 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38042': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:54,027 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:54,129 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:54,132 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38052': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:54,133 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38060': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:54,133 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:54,235 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:54,239 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38066': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:54,240 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38082': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:54,240 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:54,342 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:54,345 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38088': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:54,345 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38098': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:54,345 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:54,449 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:54,452 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38100': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:54,453 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38104': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:54,453 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:54,555 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:54,558 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38112': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:54,559 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38114': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:54,559 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:54,661 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:54,664 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38124': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:54,665 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38132': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:54,665 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:54,767 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:54,770 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38136': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:54,771 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38142': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:54,771 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:54,873 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:54,877 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38158': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:54,877 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38162': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:54,877 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:54,979 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:54,983 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38178': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:54,984 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38180': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:54,984 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:55,086 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:55,089 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38194': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:55,090 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38210': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:55,090 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:55,192 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:55,195 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38212': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:55,196 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38216': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:55,196 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:55,298 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:55,301 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38220': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:55,302 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38236': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:55,302 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:55,404 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:55,407 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38242': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:55,408 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38250': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:55,408 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:55,510 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:55,514 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38266': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:55,514 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38270': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:55,514 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:55,617 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:55,620 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38272': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:55,621 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38286': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:55,621 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:55,723 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:55,726 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38290': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:55,727 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38294': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:55,727 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:55,829 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:55,833 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38298': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:55,833 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38306': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:55,833 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:55,936 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:55,939 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38322': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:55,940 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38332': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:55,940 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:56,042 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:56,046 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38340': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:56,046 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38354': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:56,046 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:56,149 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:56,153 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38356': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:56,153 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38358': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:56,153 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:56,256 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:56,260 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38362': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:56,260 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38368': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:56,260 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:56,362 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:56,366 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38376': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:56,366 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38382': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:56,367 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:56,469 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:56,472 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38398': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:56,473 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38414': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:56,473 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:56,575 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:56,579 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38420': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:56,579 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38430': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:56,579 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:56,682 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:56,685 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38432': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:56,686 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38436': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:56,686 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:56,788 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:56,792 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38448': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:56,793 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38452': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:56,793 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:56,897 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:56,901 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38466': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:56,901 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38468': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:56,901 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:57,003 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:57,007 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38474': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:57,007 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38476': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:57,007 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:57,110 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:57,113 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38490': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:57,114 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38496': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:57,114 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:57,216 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:57,220 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38508': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:57,220 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38512': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:57,220 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:57,323 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:57,326 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38520': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:57,327 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38522': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:57,327 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:57,429 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:57,432 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38538': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:57,433 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38548': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:57,433 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:57,535 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:57,539 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38550': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:57,539 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38564': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:57,539 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:57,641 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:57,645 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38576': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:57,646 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38582': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:57,646 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:57,748 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:57,751 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38588': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:57,752 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38602': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:57,752 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:57,855 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:57,859 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38618': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:57,859 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38628': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:57,859 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:57,961 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:57,965 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38630': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:57,965 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38632': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:57,965 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:58,068 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:58,071 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38640': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:58,072 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38642': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:58,072 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:58,174 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:58,178 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38648': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:58,178 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38654': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:58,178 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:58,280 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:58,284 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38670': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:58,284 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38682': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:58,284 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:58,387 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:58,390 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38696': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:58,391 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:58,394 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38698': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:58,494 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:58,497 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38712': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:58,498 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38718': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:58,498 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:58,600 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:58,603 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38732': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:58,604 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38748': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:58,604 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:58,706 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:58,710 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38764': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:58,710 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:58,710 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38780': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:58,812 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:58,816 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38782': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:58,817 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38784': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:58,817 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:58,919 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:58,922 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38790': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:58,923 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38792': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:58,923 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:59,025 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:59,028 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:59,029 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38804': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:59,029 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:59,131 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:59,135 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38818': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:59,135 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38820': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:59,135 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:59,237 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:59,241 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38836': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:59,241 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38852': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:59,241 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:59,343 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:59,347 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38858': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:59,348 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38862': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:59,348 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:59,450 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:59,453 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38866': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:59,454 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38876': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:59,454 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:59,557 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:59,560 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38886': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:59,561 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38888': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:59,561 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:59,663 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:59,667 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38902': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:59,667 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38908': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:59,668 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:59,770 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:59,773 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38912': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:59,774 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38918': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:59,774 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:59,876 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:59,879 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38932': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:59,880 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38942': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:59,880 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:59,982 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:51:59,986 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38954': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:59,986 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38966': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:51:59,986 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:00,088 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:00,092 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38976': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:00,093 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38988': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:00,093 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:00,195 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:00,198 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39002': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:00,199 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39004': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:00,199 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:00,301 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:00,304 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39008': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:00,305 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39014': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:00,305 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:00,407 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:00,411 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39030': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:00,411 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39034': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:00,411 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:00,513 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:00,517 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39040': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:00,517 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39042': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:00,517 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:00,619 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:00,623 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:00,623 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39064': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:00,623 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:00,725 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:00,729 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39080': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:00,729 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39082': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:00,729 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:00,831 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:00,835 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39090': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:00,835 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39098': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:00,835 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:00,937 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:00,941 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39108': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:00,941 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39114': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:00,941 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:01,043 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:01,047 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39126': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:01,047 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39142': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:01,047 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:01,150 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:01,153 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39156': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:01,154 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39166': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:01,154 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:01,256 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:01,260 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39176': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:01,260 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39186': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:01,261 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:01,363 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:01,366 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39202': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:01,367 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39208': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:01,367 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:01,469 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:01,472 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39224': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:01,473 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39232': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:01,473 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:01,575 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:01,579 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60934': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:01,579 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60940': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:01,579 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:01,681 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:01,684 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60944': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:01,685 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60956': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:01,685 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:01,787 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:01,790 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60962': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:01,791 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60972': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:01,791 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:01,896 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:01,899 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60982': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:01,900 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:01,900 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:02,002 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:02,005 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60986': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:02,006 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60992': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:02,006 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:02,108 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:02,112 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60996': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:02,112 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:32772': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:02,112 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:02,214 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:02,218 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:32786': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:02,218 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:32802': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:02,218 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:02,320 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:02,324 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:32810': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:02,324 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:32822': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:02,324 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:02,426 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:02,430 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:32838': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:02,430 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:32854': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:02,430 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:02,533 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:02,536 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:32858': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:02,537 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:32870': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:02,537 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:02,639 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:02,642 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:32882': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:02,643 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:32890': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:02,643 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:02,745 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:02,748 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:32902': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:02,749 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:32916': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:02,749 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:02,851 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:02,855 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:32932': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:02,855 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:32938': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:02,855 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:02,958 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:02,962 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:32944': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:02,963 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:32956': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:02,963 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:03,065 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:03,068 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:32966': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:03,069 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:32976': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:03,069 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:03,171 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:03,174 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:32988': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:03,175 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:32990': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:03,175 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:03,278 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:03,282 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33000': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:03,282 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33012': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:03,282 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:03,384 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:03,388 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33024': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:03,389 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:03,393 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33040': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:03,491 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:03,495 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33046': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:03,495 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33052': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:03,495 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:03,597 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:03,601 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33068': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:03,601 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33080': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:03,601 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:03,703 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:03,707 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33082': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:03,707 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33088': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:03,707 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:03,809 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:03,814 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33092': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:03,814 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33094': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:03,814 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:03,915 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:03,915 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33098': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:03,920 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33106': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:03,920 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:04,022 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:04,026 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33114': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:04,026 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33128': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:04,026 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:04,129 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:04,132 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33132': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:04,133 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33138': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:04,133 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:04,235 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:04,239 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33152': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:04,239 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33168': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:04,239 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:04,342 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:04,345 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33180': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:04,346 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33192': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:04,346 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:04,448 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:04,452 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33196': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:04,452 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33202': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:04,452 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:04,554 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:04,558 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33210': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:04,559 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33212': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:04,559 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:04,661 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:04,665 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33228': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:04,666 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33230': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:04,666 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:04,768 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:04,772 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33236': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:04,772 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33246': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:04,772 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:04,874 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:04,877 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33248': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:04,878 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33258': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:04,878 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:04,980 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:04,983 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33266': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:04,984 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33282': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:04,984 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:05,086 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:05,090 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33290': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:05,090 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33296': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:05,090 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:05,192 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:05,196 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33310': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:05,197 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33312': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:05,197 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:05,299 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:05,302 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33316': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:05,303 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33332': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:05,303 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:05,405 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:05,408 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33334': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:05,409 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33350': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:05,409 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:05,511 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:05,514 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33366': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:05,515 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33372': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:05,515 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:05,617 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:05,621 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33388': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:05,621 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33390': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:05,622 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:05,724 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:05,727 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33398': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:05,728 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33406': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:05,728 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:05,830 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:05,834 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33420': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:05,834 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33422': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:05,834 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:05,937 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:05,940 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33428': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:05,941 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33438': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:05,941 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:06,043 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:06,047 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33440': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:06,047 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33456': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:06,047 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:06,149 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:06,153 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33460': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:06,153 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33476': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:06,153 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:06,255 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:06,259 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33490': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:06,260 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33500': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:06,260 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:06,362 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:06,366 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33514': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:06,367 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33530': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:06,367 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:06,469 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:06,472 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33538': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:06,473 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33540': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:06,473 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:06,575 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:06,578 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33554': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:06,579 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33560': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:06,579 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:06,681 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:06,684 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33572': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:06,685 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33582': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:06,685 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:06,787 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:06,791 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33590': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:06,791 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33602': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:06,791 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:06,896 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:06,899 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33610': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:06,900 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33626': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:06,900 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:07,002 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:07,005 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33632': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:07,006 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33640': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:07,006 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:07,108 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:07,112 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33644': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:07,112 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33660': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:07,112 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:07,215 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:07,218 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33672': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:07,219 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33688': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:07,219 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:07,321 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:07,325 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33698': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:07,325 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33706': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:07,325 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:07,427 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:07,431 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33722': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:07,431 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33736': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:07,431 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:07,534 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:07,537 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33738': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:07,538 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33754': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:07,538 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:07,640 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:07,643 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33766': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:07,644 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33782': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:07,644 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:07,746 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:07,750 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:07,750 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33800': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:07,750 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:07,853 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:07,856 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33808': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:07,857 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33812': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:07,857 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:07,959 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:07,963 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33824': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:07,963 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33826': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:07,963 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:08,067 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:08,070 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33830': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:08,071 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33836': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:08,071 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:08,173 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:08,177 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33852': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:08,177 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33856': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:08,177 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:08,280 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:08,283 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33868': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:08,284 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33880': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:08,284 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:08,386 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:08,390 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33894': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:08,390 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:08,392 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33896': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:08,492 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:08,496 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33904': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:08,496 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33914': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:08,496 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:08,598 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:08,602 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33928': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:08,602 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33942': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:08,603 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:08,705 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:08,708 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33950': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:08,709 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33952': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:08,709 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:08,811 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:08,815 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33954': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:08,816 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33964': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:08,816 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:08,918 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:08,921 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33980': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:08,922 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33996': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:08,922 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:09,024 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:09,028 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34002': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:09,028 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34014': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:09,028 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:09,130 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:09,134 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34022': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:09,135 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34030': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:09,135 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:09,237 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:09,240 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34044': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:09,241 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34056': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:09,241 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:09,343 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:09,347 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34068': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:09,347 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34070': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:09,347 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:09,449 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:09,453 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34082': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:09,453 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34084': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:09,453 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:09,555 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:09,559 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34086': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:09,560 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34102': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:09,560 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:09,662 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:09,665 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34118': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:09,666 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:09,666 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:09,769 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:09,772 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34128': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:09,773 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34144': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:09,773 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:09,875 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:09,878 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34154': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:09,879 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34168': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:09,879 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:09,981 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:09,984 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34176': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:09,985 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34192': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:09,985 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:10,087 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:10,091 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34196': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:10,091 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34208': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:10,091 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:10,193 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:10,197 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34222': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:10,197 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34228': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:10,197 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:10,299 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:10,303 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34238': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:10,303 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34246': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:10,303 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:10,405 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:10,409 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34256': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:10,409 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34260': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:10,409 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:10,512 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:10,515 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34262': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:10,516 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34274': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:10,516 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:10,618 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:10,621 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34290': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:10,622 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34302': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:10,622 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:10,724 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:10,728 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34308': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:10,728 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34322': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:10,728 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:10,830 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:10,834 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34324': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:10,834 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34338': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:10,834 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:10,936 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:10,940 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34346': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:10,941 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34360': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:10,941 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:11,043 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:11,047 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34366': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:11,048 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34382': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:11,048 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:11,150 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:11,153 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34388': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:11,154 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34402': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:11,154 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:11,256 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:11,260 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34416': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:11,260 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34430': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:11,260 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:11,362 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:11,366 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34446': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:11,367 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34452': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:11,367 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:11,469 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:11,473 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34458': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:11,474 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34464': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:11,474 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:11,576 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:11,579 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33950': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:11,580 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33964': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:11,580 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:11,682 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:11,685 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33976': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:11,686 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33980': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:11,686 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:11,788 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:11,792 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33996': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:11,792 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34002': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:11,792 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:11,895 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:11,899 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34016': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:11,899 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34020': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:11,899 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:12,001 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:12,005 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34026': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:12,005 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34030': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:12,005 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:12,107 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:12,111 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34044': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:12,112 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34060': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:12,112 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:12,214 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:12,217 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34068': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:12,218 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34084': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:12,218 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:12,320 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:12,323 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34096': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:12,324 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34104': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:12,324 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:12,426 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:12,429 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34116': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:12,430 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34126': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:12,430 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:12,532 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:12,536 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34134': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:12,536 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34138': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:12,536 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:12,639 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:12,642 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34154': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:12,643 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34156': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:12,643 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:12,746 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:12,749 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34166': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:12,750 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34168': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:12,750 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:12,852 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:12,855 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34180': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:12,856 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34188': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:12,856 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:12,958 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:12,961 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34190': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:12,962 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:12,962 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34198': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:13,064 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:13,067 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34212': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:13,068 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34228': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:13,068 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:13,171 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:13,174 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34232': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:13,175 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34240': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:13,175 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:13,277 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:13,280 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34242': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:13,281 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34244': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:13,281 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:13,383 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:13,386 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34250': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:13,387 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:13,387 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34254': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:13,489 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:13,492 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34266': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:13,493 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:13,493 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34276': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:13,595 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:13,598 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34284': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:13,599 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34292': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:13,599 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:13,701 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:13,704 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34294': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:13,705 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34298': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:13,705 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:13,807 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:13,811 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34312': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:13,812 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34326': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:13,812 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:13,914 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:13,917 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34340': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:13,918 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34354': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:13,918 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:14,021 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:14,024 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34358': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:14,025 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34366': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:14,025 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:14,127 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:14,130 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34378': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:14,131 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34388': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:14,131 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:14,233 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:14,237 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34398': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:14,237 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34404': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:14,237 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:14,340 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:14,343 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34416': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:14,344 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34428': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:14,344 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:14,446 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:14,449 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34434': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:14,450 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34444': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:14,450 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:14,552 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:14,556 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34450': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:14,556 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34458': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:14,556 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:14,659 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:14,662 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34464': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:14,663 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34476': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:14,663 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:14,765 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:14,768 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34484': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:14,769 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34498': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:14,769 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:14,872 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:14,875 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34502': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:14,876 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34516': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:14,876 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:14,978 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:14,982 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34532': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:14,982 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34544': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:14,982 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:15,085 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:15,088 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34558': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:15,089 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34568': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:15,089 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:15,191 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:15,194 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34574': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:15,195 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34582': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:15,195 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:15,297 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:15,300 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34586': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:15,301 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34600': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:15,301 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:15,403 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:15,407 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34606': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:15,407 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34612': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:15,407 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:15,509 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:15,512 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34626': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:15,513 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34628': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:15,513 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:15,615 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:15,618 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34642': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:15,619 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34650': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:15,619 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:15,721 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:15,725 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34664': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:15,725 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34676': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:15,725 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:15,827 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:15,831 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34692': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:15,832 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34708': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:15,832 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:15,933 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:15,937 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34720': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:15,938 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34726': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:15,938 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:16,040 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:16,044 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34734': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:16,044 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34736': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:16,044 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:16,146 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:16,150 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34748': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:16,150 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34756': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:16,150 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:16,252 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:16,256 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34766': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:16,257 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34770': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:16,257 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:16,359 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:16,362 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34786': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:16,363 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:16,363 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:16,465 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:16,468 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34800': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:16,469 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34806': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:16,469 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:16,572 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:16,575 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34810': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:16,576 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34820': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:16,576 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:16,678 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:16,681 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34830': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:16,682 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34838': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:16,682 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:16,784 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:16,788 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34850': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:16,788 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34866': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:16,788 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:16,890 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:16,897 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34876': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:16,897 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34892': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:16,897 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:16,997 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34906': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:16,997 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:17,003 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34908': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:17,003 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:17,103 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34918': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:17,103 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:17,109 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34922': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:17,109 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:17,209 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34924': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:17,210 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:17,215 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34936': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:17,215 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:17,316 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34942': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:17,316 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:17,321 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34956': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:17,321 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:17,422 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:17,422 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34958': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:17,427 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34968': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:17,427 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:17,529 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:17,529 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34976': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:17,534 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:17,534 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34980': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:17,635 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:17,636 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34996': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:17,640 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35010': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:17,640 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:17,742 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35026': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:17,742 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:17,746 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35032': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:17,746 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:17,848 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35048': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:17,848 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:17,853 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35062': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:17,853 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:17,954 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:17,958 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35070': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:17,959 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35082': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:17,959 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:18,060 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:18,064 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35084': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:18,065 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35094': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:18,065 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:18,166 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:18,170 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35098': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:18,170 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35102': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:18,170 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:18,273 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:18,277 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35116': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:18,277 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35124': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:18,277 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:18,380 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:18,383 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35140': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:18,384 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35142': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:18,384 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:18,486 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:18,490 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35146': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:18,490 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35152': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:18,490 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:18,593 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:18,596 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35168': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:18,597 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35170': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:18,597 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:18,699 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:18,703 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:18,703 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35182': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:18,704 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35190': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:18,805 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:18,809 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35194': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:18,809 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35196': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:18,809 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:18,912 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:18,915 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35202': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:18,916 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35204': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:18,916 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:19,018 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:19,022 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35212': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:19,022 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35224': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:19,022 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:19,125 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:19,128 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35236': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:19,129 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35242': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:19,129 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:19,231 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:19,234 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35252': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:19,235 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35266': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:19,235 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:19,337 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:19,341 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35280': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:19,341 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35290': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:19,341 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:19,444 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:19,447 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35300': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:19,448 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35308': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:19,448 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:19,550 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:19,553 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35316': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:19,554 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35328': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:19,554 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:19,656 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:19,659 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35334': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:19,660 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35336': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:19,660 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:19,762 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:19,766 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35348': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:19,766 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35352': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:19,766 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:19,869 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:19,872 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35362': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:19,873 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35374': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:19,873 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:19,976 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:19,979 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35380': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:19,980 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35394': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:19,980 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:20,082 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:20,085 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35408': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:20,086 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35414': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:20,086 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:20,188 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:20,192 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35422': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:20,192 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35438': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:20,192 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:20,295 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:20,298 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35450': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:20,299 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35454': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:20,299 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:20,401 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:20,404 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35468': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:20,405 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35478': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:20,405 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:20,507 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:20,511 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35484': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:20,511 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35494': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:20,511 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:20,614 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:20,617 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35504': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:20,618 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35512': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:20,618 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:20,720 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:20,724 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35524': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:20,724 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35526': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:20,724 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:20,827 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:20,830 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35532': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:20,831 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35534': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:20,831 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:20,933 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:20,937 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35544': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:20,937 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35548': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:20,937 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:21,040 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:21,043 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35558': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:21,044 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35570': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:21,044 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:21,146 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:21,149 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35584': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:21,150 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35598': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:21,150 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:21,252 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:21,256 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35612': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:21,256 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35622': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:21,256 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:21,358 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:21,362 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35636': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:21,362 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35650': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:21,362 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:21,464 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:21,468 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35662': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:21,469 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35666': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:21,469 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:21,571 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:21,574 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:51874': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:21,575 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:51880': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:21,575 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:21,678 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:21,681 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:51890': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:21,682 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:51898': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:21,682 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:21,784 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:21,787 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:51904': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:21,788 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:51910': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:21,788 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:21,890 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:21,897 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:51922': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:21,897 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:51934': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:21,897 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:21,998 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:51946': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:21,998 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:22,003 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:51948': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:22,003 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:22,104 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:51964': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:22,104 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:22,110 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:51974': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:22,110 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:22,211 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:22,211 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:51988': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:22,216 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:51992': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:22,216 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:22,318 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:52004': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:22,318 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:22,323 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:52008': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:22,323 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:22,424 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:22,428 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:52020': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:22,429 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:52036': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:22,429 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:22,531 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:22,534 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:52038': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:22,535 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:52048': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:22,535 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:22,637 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:22,641 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:52054': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:22,641 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:52060': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:22,641 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:22,743 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:22,747 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:52072': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:22,747 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:52086': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:22,747 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:22,850 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:22,853 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:52102': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:22,854 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:52110': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:22,854 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:22,956 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:22,960 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:52118': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:22,960 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:52134': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:22,960 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:23,062 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:23,066 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:52142': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:23,066 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:52156': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:23,066 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:23,169 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:23,172 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:52158': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:23,173 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:52174': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:23,173 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:23,275 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:23,278 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:52184': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:23,279 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:52190': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:23,279 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:23,382 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:23,385 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:52192': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:23,386 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:52202': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:23,386 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:23,488 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:23,492 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:52218': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:23,492 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:52220': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:23,492 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:23,594 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:23,598 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:52224': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:23,598 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:52238': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:23,599 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:23,701 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:23,705 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:52252': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:23,706 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:52256': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:23,706 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:23,807 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:52272': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:23,807 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:23,812 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:52282': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:23,812 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:23,913 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:23,913 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:52284': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:23,918 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:52286': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:23,918 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:24,019 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:24,023 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:52296': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:24,024 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:52308': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:24,024 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:24,126 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:24,129 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:52316': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:24,130 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:52324': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:24,130 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:24,232 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:24,235 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:52330': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:24,236 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:52334': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:24,236 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:24,339 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:24,344 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:52348': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:24,345 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:24,345 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:52364': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:24,446 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:24,451 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:52370': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:24,452 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:24,452 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:52380': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:24,554 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:24,559 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:52384': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:24,559 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:24,559 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:52390': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:24,661 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:24,666 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:52404': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:24,666 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:24,666 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:52414': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:24,768 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:24,773 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:52426': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:24,773 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:24,774 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:52440': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:24,875 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:24,880 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:52448': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:24,880 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:24,881 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:52452': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:24,982 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:24,987 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:52458': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:24,987 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:24,988 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:52470': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:25,090 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:25,095 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:52476': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:25,096 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:25,096 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:52482': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:25,197 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:25,202 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:52486': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:25,203 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:25,203 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:52492': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:25,304 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:25,309 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:52504': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:25,310 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:25,310 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:52514': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:25,411 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:25,416 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:52516': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:25,416 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:25,417 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:52522': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:25,518 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:25,523 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:52526': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:25,524 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:25,524 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:52536': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:25,625 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:25,630 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:52552': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:25,631 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:25,631 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:52554': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:25,733 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:25,737 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:52556': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:25,737 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:25,738 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:52568': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:25,840 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:25,844 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:52584': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:25,845 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:25,845 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:52592': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:25,947 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:25,951 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:52602': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:25,952 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:25,952 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:52612': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:26,054 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:26,059 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:52616': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:26,059 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:26,059 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:52622': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:26,161 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:26,165 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:52636': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:26,166 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:26,166 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:52646': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:26,267 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:26,272 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:52662': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:26,273 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:26,273 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:52676': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:26,374 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:26,379 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:52680': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:26,379 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:26,380 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:52688': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:26,481 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:26,486 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:52690': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:26,487 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:26,487 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:52692': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:26,589 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:26,594 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:52700': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:26,594 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:26,594 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:52708': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:26,696 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:26,701 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:52722': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:26,701 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:26,701 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:52732': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:26,804 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:26,808 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:52746': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:26,809 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:26,809 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:52748': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:26,911 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:26,916 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:52752': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:26,916 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:26,916 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:52762': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:27,018 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:27,023 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:52776': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:27,023 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:27,023 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:52782': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:27,126 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:27,131 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:52794': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:27,132 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:27,132 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:52806': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:27,233 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:27,238 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:52816': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:27,239 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:27,239 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:52820': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:27,340 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:27,345 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:52828': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:27,346 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:27,346 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:52836': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:27,447 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:27,452 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:52852': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:27,453 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:27,453 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:52864': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:27,554 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:27,559 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:52872': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:27,559 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:27,560 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:52882': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:27,661 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:27,666 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:52884': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:27,666 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:27,667 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:52900': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:27,768 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:27,773 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:52916': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:27,773 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:27,774 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:52932': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:27,875 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:27,880 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:52938': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:27,880 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:27,881 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:52948': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:27,982 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:27,987 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:52964': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:27,987 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:27,988 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:52980': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:28,090 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:28,095 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:52984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:28,095 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:28,095 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:52988': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:28,197 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:28,201 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:52998': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:28,202 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:28,202 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:53010': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:28,304 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:28,308 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:53018': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:28,309 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:28,309 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:53024': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:28,411 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:28,415 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:53028': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:28,416 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:28,416 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:53032': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:28,518 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:28,523 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:53044': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:28,524 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:28,524 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:53054': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:28,626 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:28,631 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:53062': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:28,631 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:28,631 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:53072': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:28,733 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:28,739 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:53078': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:28,740 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:28,740 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:53084': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:28,840 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:28,840 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:53090': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:28,847 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:28,847 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:53102': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:28,947 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:28,947 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:53104': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:28,954 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:28,954 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:53118': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:29,054 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:29,054 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:53128': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:29,061 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:29,061 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:53134': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:29,161 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:29,161 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:53140': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:29,168 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:29,168 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:53150': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:29,268 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:29,268 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:53156': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:29,274 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:29,275 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:53172': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:29,375 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:29,375 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:53188': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:29,382 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:29,382 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:53196': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:29,482 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:29,483 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:53202': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:29,489 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:29,489 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:53204': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:29,590 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:29,590 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:53218': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:29,596 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:29,596 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:53232': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:29,697 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:29,697 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:53234': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:29,703 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:29,703 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:53236': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:29,804 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:29,804 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:53242': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:29,811 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:29,811 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:53258': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:29,911 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:29,911 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:53260': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:29,917 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:29,918 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:53270': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:30,018 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:30,019 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:53282': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:30,025 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:30,025 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:53292': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:30,125 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:30,125 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:53308': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:30,132 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:30,132 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:53320': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:30,233 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:30,238 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:53326': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:30,239 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:30,239 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:53336': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:30,340 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:30,345 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:53348': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:30,345 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:30,346 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:53350': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:30,448 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:30,453 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:53352': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:30,453 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:30,453 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:53368': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:30,555 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:30,559 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:53376': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:30,560 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:30,560 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:53378': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:30,662 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:30,667 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:53384': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:30,667 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:30,667 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:53400': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:30,769 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:30,774 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:53416': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:30,774 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:30,774 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:53420': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:30,876 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:30,881 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:53432': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:30,881 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:30,882 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:53442': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:30,983 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:30,988 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:53458': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:30,989 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:30,989 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:53466': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:31,090 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:31,096 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:53482': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:31,096 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:31,097 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:53484': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:31,198 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:31,203 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:53496': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:31,203 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:31,204 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:53508': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:31,305 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:31,310 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:53524': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:31,310 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:31,311 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:53536': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:31,411 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:31,412 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:53542': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:31,418 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:31,418 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:53552': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:31,519 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:31,519 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:53556': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:31,525 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:31,525 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:53566': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:31,626 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:31,627 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40736': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:31,632 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:31,632 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40748': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:31,733 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:31,733 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40750': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:31,739 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:31,740 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40766': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:31,840 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:31,840 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40768': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:31,847 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:31,847 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40780': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:31,949 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:31,954 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40790': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:31,954 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:31,954 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40806': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:32,056 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:32,061 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40820': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:32,061 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:32,061 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40830': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:32,163 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:32,168 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40834': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:32,168 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:32,168 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40848': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:32,270 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:32,275 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40858': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:32,276 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:32,276 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40862': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:32,377 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:32,377 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40872': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:32,383 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:32,383 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40888': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:32,484 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:32,484 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40896': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:32,490 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:32,491 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40906': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:32,591 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:32,591 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40910': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:32,598 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:32,598 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40912': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:32,698 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:32,698 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40926': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:32,705 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:32,705 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40934': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:32,806 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:32,806 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40946': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:32,812 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:32,813 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40950': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:32,913 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:32,913 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40962': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:32,919 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:32,920 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40968': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:33,020 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:33,020 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40976': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:33,027 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:33,027 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40978': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:33,127 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:33,128 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40988': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:33,134 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:33,134 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41000': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:33,235 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:33,235 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41002': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:33,241 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:33,242 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41018': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:33,342 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:33,342 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41022': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:33,349 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:33,349 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41026': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:33,450 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:33,450 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41038': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:33,456 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:33,456 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41050': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:33,557 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:33,557 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41054': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:33,564 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:33,564 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41068': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:33,665 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:33,670 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41084': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:33,671 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:33,671 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41086': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:33,773 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:33,775 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41102': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:33,781 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:33,781 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41106': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:33,880 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:33,880 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41118': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:33,887 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:33,888 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41128': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:33,987 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:33,988 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41138': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:33,995 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:33,995 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41140': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:34,095 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:34,095 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41152': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:34,101 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:34,102 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41168': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:34,202 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:34,202 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41172': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:34,209 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:34,209 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41184': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:34,309 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:34,309 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41196': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:34,316 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:34,316 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41208': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:34,416 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:34,417 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41212': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:34,423 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:34,423 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41222': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:34,524 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:34,524 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41224': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:34,530 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:34,531 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41230': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:34,631 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:34,631 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41234': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:34,637 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:34,638 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41250': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:34,738 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:34,739 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41254': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:34,745 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:34,745 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41270': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:34,846 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:34,846 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41276': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:34,852 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:34,853 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41282': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:34,953 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:34,953 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41294': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:34,960 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:34,960 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41306': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:35,060 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:35,061 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41316': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:35,067 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:35,067 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41330': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:35,168 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:35,168 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41342': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:35,174 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:35,174 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41344': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:35,275 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:35,275 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41352': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:35,282 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:35,282 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41358': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:35,383 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:35,388 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41360': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:35,389 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:35,394 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41364': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:35,491 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:35,496 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41374': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:35,496 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:35,496 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41386': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:35,598 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:35,603 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41392': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:35,604 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:35,604 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41402': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:35,705 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:35,710 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41418': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:35,711 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:35,711 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41422': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:35,812 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:35,817 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41430': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:35,817 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:35,818 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41434': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:35,919 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:35,924 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41436': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:35,924 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:35,925 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41438': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:36,026 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:36,031 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41448': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:36,031 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:36,032 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41464': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:36,133 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:36,138 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41480': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:36,138 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:36,139 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41496': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:36,241 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:36,246 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41508': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:36,246 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:36,246 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41522': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:36,348 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:36,353 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41536': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:36,353 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:36,354 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41550': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:36,455 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:36,460 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41552': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:36,460 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:36,460 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41554': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:36,562 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:36,567 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41556': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:36,567 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:36,568 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41566': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:36,669 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:36,674 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41574': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:36,675 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:36,675 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41576': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:36,777 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:36,782 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41590': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:36,782 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:36,783 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41602': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:36,884 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:36,889 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41606': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:36,890 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:36,894 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41618': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:36,991 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:36,996 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41620': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:36,997 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:36,997 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41630': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:37,099 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:37,104 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41642': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:37,104 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:37,104 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41648': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:37,206 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:37,211 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41650': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:37,211 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:37,211 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41666': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:37,313 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:37,318 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41676': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:37,319 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:37,319 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41680': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:37,420 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:37,425 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41690': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:37,426 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:37,426 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41706': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:37,528 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:37,532 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41720': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:37,533 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:37,533 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41726': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:37,635 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:37,640 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41728': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:37,641 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:37,641 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41734': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:37,742 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:37,747 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41736': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:37,747 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:37,748 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41746': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:37,849 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:37,854 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41750': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:37,855 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:37,855 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41756': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:37,956 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:37,961 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41762': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:37,962 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:37,962 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41766': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:38,064 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:38,068 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41782': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:38,069 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:38,069 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41790': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:38,171 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:38,176 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41798': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:38,176 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:38,176 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41802': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:38,278 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:38,283 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41812': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:38,283 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:38,283 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41822': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:38,385 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:38,390 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41838': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:38,391 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:38,396 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41852': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:38,493 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:38,498 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41860': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:38,498 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:38,498 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41862': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:38,600 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:38,604 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41870': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:38,605 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:38,605 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41886': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:38,707 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:38,711 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41894': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:38,712 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:38,712 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41896': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:38,816 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:38,821 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41904': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:38,821 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:38,822 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41920': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:38,923 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:38,928 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41930': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:38,928 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:38,928 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41946': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:39,030 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:39,035 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41948': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:39,035 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:39,036 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41960': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:39,137 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:39,142 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41974': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:39,143 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:39,143 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41978': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:39,244 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:39,249 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:39,250 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:39,250 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41998': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:39,352 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:39,356 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42008': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:39,357 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:39,357 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42018': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:39,459 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:39,464 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42026': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:39,464 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:39,464 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42042': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:39,566 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:39,571 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42056': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:39,571 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:39,572 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42060': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:39,673 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:39,678 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42076': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:39,678 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:39,678 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42086': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:39,780 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:39,785 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42096': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:39,785 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:39,786 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42112': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:39,887 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:39,892 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42114': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:39,893 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:39,898 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42116': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:39,994 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:39,999 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42132': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:40,000 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:40,000 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42140': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:40,101 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:40,106 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42144': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:40,107 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:40,107 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42158': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:40,208 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:40,213 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42162': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:40,214 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:40,214 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42168': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:40,315 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:40,320 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42172': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:40,321 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:40,321 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42182': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:40,423 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:40,428 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42186': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:40,428 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:40,428 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42196': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:40,531 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:40,535 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42198': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:40,536 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:40,536 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42208': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:40,638 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:40,643 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42222': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:40,644 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:40,644 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42228': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:40,745 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:40,750 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42234': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:40,751 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:40,751 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42238': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:40,852 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:40,857 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42248': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:40,858 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:40,858 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42258': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:40,959 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:40,964 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42260': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:40,965 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:40,965 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42268': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:41,066 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:41,071 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42278': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:41,071 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:41,071 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42284': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:41,176 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:41,180 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42298': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:41,180 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:41,180 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42300': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:41,285 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:41,289 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42310': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:41,290 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:41,290 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42324': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:41,399 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:41,403 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42330': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:41,403 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:41,403 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42344': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:41,508 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:41,513 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42360': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:41,513 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:41,513 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42376': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:41,620 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:41,624 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:49526': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:41,624 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:41,625 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:49538': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:41,729 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:41,734 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:49544': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:41,734 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:41,735 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:49554': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:41,839 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:41,844 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:49556': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:41,844 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:41,844 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:49568': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:41,949 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:41,953 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:49578': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:41,953 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:41,954 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:49592': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:42,059 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:42,063 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:49608': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:42,063 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:42,063 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:49614': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:42,168 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:42,173 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:49628': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:42,173 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:42,173 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:49644': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:42,279 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:42,283 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:49658': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:42,283 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:42,284 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:49662': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:42,389 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:42,398 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:49664': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:42,398 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:42,398 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:49672': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:42,499 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:49680': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:42,499 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:42,506 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:42,506 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:49686': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:42,609 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:42,613 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:49692': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:42,613 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:42,614 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:49708': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:42,719 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:42,723 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:49724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:42,723 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:42,723 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:49730': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:42,829 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:42,832 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:49738': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:42,832 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:49748': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:42,832 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:42,938 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:42,941 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:49758': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:42,941 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:49766': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:42,941 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:43,047 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:43,050 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:49780': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:43,050 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:49796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:43,050 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:43,156 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:43,159 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:49812': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:43,160 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:49824': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:43,160 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:43,265 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:43,268 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:49832': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:43,269 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:49844': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:43,269 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:43,374 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:43,377 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:49846': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:43,378 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:49862': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:43,378 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:43,483 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:43,486 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:49876': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:43,487 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:49888': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:43,487 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:43,592 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:43,595 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:49896': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:43,596 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:49908': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:43,596 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:43,701 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:43,704 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:49910': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:43,705 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:49920': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:43,705 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:43,810 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:43,813 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:49922': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:43,814 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:49926': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:43,814 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:43,920 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:43,922 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:49928': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:43,923 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:43,923 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:49942': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:44,030 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:44,032 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:49952': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:44,033 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:49956': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:44,033 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:44,139 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:44,142 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:49966': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:44,142 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:44,142 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:49980': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:44,248 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:44,251 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:49988': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:44,251 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:49992': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:44,251 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:44,357 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:44,360 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:50002': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:44,360 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:50006': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:44,360 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:44,466 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:44,469 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:50022': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:44,469 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:44,469 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:50028': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:44,573 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:44,577 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:50034': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:44,577 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:50048': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:44,578 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:44,680 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:44,683 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:50052': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:44,684 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:50054': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:44,684 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:44,786 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:44,790 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:50056': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:44,790 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:50068': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:44,791 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:44,896 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:44,899 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:50082': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:44,900 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:50094': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:44,900 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:45,002 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:45,006 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:50102': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:45,006 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:50116': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:45,006 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:45,108 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:45,112 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:50128': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:45,112 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:50142': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:45,112 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:45,215 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:45,218 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:50156': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:45,219 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:50160': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:45,219 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:45,321 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:45,325 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:50166': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:45,325 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:50170': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:45,325 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:45,427 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:45,431 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:50172': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:45,431 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:45,431 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:50176': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:45,533 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:45,537 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:50188': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:45,538 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:50200': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:45,538 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:45,640 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:45,643 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:50212': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:45,644 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:50228': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:45,644 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:45,747 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:45,750 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:50234': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:45,751 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:50240': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:45,751 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:45,853 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:45,857 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:50250': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:45,857 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:45,857 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:50258': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:45,960 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:45,963 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:50262': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:45,964 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:50268': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:45,964 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:46,066 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:46,070 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:50276': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:46,070 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:50286': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:46,070 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:46,172 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:46,176 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:50302': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:46,177 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:50304': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:46,177 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:46,279 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:46,282 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:50310': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:46,283 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:50326': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:46,283 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:46,385 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:46,389 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:50330': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:46,389 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:46,393 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:50334': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:46,492 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:46,496 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:50336': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:46,497 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:50344': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:46,497 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:46,598 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:46,602 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:50354': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:46,603 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:50366': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:46,603 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:46,705 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:46,709 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:50370': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:46,709 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:50378': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:46,709 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:46,811 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:46,815 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:50394': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:46,815 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:50410': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:46,816 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:46,918 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:46,921 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:50422': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:46,922 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:50426': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:46,922 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:47,024 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:47,027 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:50436': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:47,028 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:50446': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:47,028 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:47,130 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:47,134 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:50454': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:47,134 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:50470': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:47,134 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:47,236 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:47,240 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:50476': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:47,241 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:50488': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:47,241 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:47,343 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:47,346 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:50492': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:47,347 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:50504': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:47,347 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:47,450 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:47,453 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:50516': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:47,454 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:50528': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:47,454 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:47,556 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:47,560 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:50538': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:47,560 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:50550': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:47,560 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:47,662 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:47,666 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:50562': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:47,667 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:50568': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:47,667 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:47,769 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:47,772 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:50572': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:47,773 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:50574': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:47,773 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:47,875 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:47,879 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:50590': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:47,880 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:50602': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:47,880 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:47,982 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:47,985 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:50616': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:47,986 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:50626': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:47,986 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:48,088 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:48,092 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:50642': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:48,092 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:50656': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:48,092 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:48,194 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:48,198 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:50672': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:48,198 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:50678': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:48,199 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:48,301 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:48,304 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:50690': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:48,305 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:50704': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:48,305 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:48,407 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:48,410 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:50706': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:48,411 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:50708': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:48,411 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:48,513 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:48,517 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:50716': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:48,517 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:50722': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:48,517 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:48,620 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:48,623 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:50726': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:48,624 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:50736': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:48,624 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:48,726 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:48,730 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:50742': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:48,730 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:50756': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:48,730 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:48,832 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:48,837 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:50770': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:48,837 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:50772': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:48,837 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:48,939 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:50788': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:48,939 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:48,944 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:50790': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:48,944 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:49,046 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:50794': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:49,046 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:49,050 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:50800': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:49,051 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:49,153 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:49,156 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:50804': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:49,157 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:50820': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:49,157 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:49,259 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:49,263 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:50822': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:49,263 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:50830': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:49,263 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:49,365 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:49,369 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:50842': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:49,370 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:50856': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:49,370 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:49,472 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:49,475 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:50870': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:49,476 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:50874': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:49,476 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:49,578 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:49,582 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:50886': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:49,582 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:50902': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:49,582 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:49,685 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:49,688 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:50912': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:49,689 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:50924': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:49,689 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:49,791 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:49,795 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:50936': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:49,795 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:50938': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:49,795 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:49,897 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:49,901 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:50942': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:49,901 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:50952': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:49,901 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:50,003 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:50,007 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:50954': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:50,008 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:50968': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:50,008 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:50,110 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:50,113 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:50974': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:50,114 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:50980': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:50,114 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:50,216 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:50,219 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:50990': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:50,220 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:50992': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:50,220 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:50,322 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:50,325 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:51006': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:50,326 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:51008': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:50,326 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:50,428 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:50,432 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:51012': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:50,433 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:51014': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:50,433 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:50,535 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:50,538 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:51024': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:50,539 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:51036': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:50,539 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:50,641 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:50,645 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:51038': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:50,645 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:51048': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:50,645 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:50,747 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:50,751 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:51064': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:50,751 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:51070': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:50,751 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:50,854 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:50,858 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:51074': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:50,859 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:51086': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:50,859 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:50,961 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:50,964 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:51096': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:50,965 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:51104': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:50,965 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:51,067 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:51,070 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:51118': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:51,071 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:51126': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:51,071 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:51,173 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:51,177 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:51136': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:51,177 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:51148': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:51,177 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:51,280 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:51,284 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:51156': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:51,284 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:51162': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:51,284 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:51,387 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:51,390 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:51176': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:51,391 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:51,394 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:51190': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:51,493 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:51,497 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:51204': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:51,497 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:51210': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:51,497 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:51,599 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:51,603 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34790': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:51,604 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34794': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:51,604 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:51,706 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:51,709 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:51,710 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34812': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:51,710 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:51,812 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:51,816 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34826': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:51,816 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34842': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:51,816 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:51,919 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34844': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:51,919 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:51,924 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34860': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:51,925 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:52,025 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34862': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:52,025 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:52,033 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34876': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:52,034 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:52,132 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34892': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:52,132 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:52,142 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34908': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:52,142 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:52,238 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34910': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:52,238 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:52,251 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34924': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:52,251 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:52,345 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34930': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:52,345 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:52,359 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34946': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:52,360 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:52,451 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34952': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:52,451 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:52,468 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34962': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:52,468 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:52,558 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:52,558 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34976': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:52,577 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:52,577 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:52,665 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35000': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:52,665 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:52,686 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35014': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:52,686 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:52,771 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35022': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:52,771 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:52,794 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35036': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:52,794 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:52,877 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35038': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:52,877 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:52,902 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35042': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:52,902 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:52,984 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35052': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:52,984 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:53,009 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:53,009 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:53,090 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35062': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:53,090 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:53,115 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35064': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:53,115 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:53,196 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35080': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:53,197 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:53,221 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35096': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:53,221 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:53,303 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35100': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:53,303 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:53,327 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35106': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:53,327 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:53,409 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35118': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:53,409 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:53,434 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:53,434 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:53,516 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35124': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:53,516 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:53,540 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:53,540 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35136': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:53,622 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35146': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:53,622 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:53,646 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35156': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:53,646 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:53,728 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35162': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:53,728 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:53,752 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35172': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:53,752 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:53,835 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35174': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:53,835 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:53,859 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:53,859 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35176': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:53,941 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35182': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:53,941 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:53,966 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35190': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:53,966 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:54,048 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35194': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:54,048 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:54,072 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35198': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:54,072 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:54,154 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35210': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:54,154 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:54,178 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35212': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:54,178 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:54,261 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35228': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:54,261 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:54,284 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35240': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:54,284 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:54,368 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35248': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:54,368 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:54,391 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:54,394 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35252': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:54,474 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35264': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:54,474 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:54,497 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:54,497 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35280': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:54,580 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35282': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:54,580 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:54,603 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35294': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:54,603 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:54,687 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:54,687 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35302': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:54,709 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:54,709 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35314': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:54,793 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:54,793 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35324': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:54,816 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35328': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:54,816 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:54,899 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35344': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:54,899 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:54,922 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:54,922 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35346': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:55,006 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35354': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:55,006 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:55,028 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35364': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:55,028 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:55,113 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35372': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:55,113 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:55,135 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35374': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:55,135 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:55,219 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:55,219 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35390': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:55,241 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35394': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:55,241 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:55,325 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35410': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:55,325 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:55,347 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:55,347 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35426': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:55,432 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35436': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:55,432 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:55,453 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35444': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:55,453 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:55,538 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35452': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:55,538 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:55,559 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:55,559 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35464': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:55,645 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35468': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:55,645 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:55,665 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35474': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:55,665 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:55,751 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35490': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:55,751 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:55,771 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35498': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:55,771 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:55,857 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35508': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:55,858 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:55,877 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35522': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:55,877 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:55,965 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:55,965 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35536': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:55,984 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35546': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:55,984 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:56,072 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35556': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:56,072 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:56,090 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35562': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:56,090 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:56,178 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:56,178 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35570': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:56,196 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35572': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:56,196 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:56,284 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35586': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:56,284 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:56,303 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35596': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:56,303 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:56,390 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:56,393 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35610': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:56,409 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35616': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:56,409 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:56,496 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35618': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:56,496 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:56,515 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35630': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:56,515 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:56,603 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35636': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:56,603 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:56,621 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35648': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:56,621 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:56,709 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35664': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:56,709 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:56,727 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35680': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:56,727 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:56,816 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35690': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:56,816 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:56,833 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35698': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:56,833 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:56,922 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35712': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:56,922 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:56,939 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35728': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:56,939 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:57,028 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35740': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:57,028 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:57,046 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35752': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:57,046 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:57,135 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35766': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:57,135 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:57,152 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35780': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:57,152 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:57,241 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35792': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:57,241 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:57,258 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:57,258 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:57,348 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35808': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:57,348 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:57,365 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35816': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:57,365 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:57,456 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35824': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:57,456 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:57,471 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35832': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:57,471 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:57,562 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35838': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:57,563 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:57,577 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35842': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:57,577 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:57,670 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35858': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:57,670 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:57,684 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:57,684 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35864': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:57,776 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35872': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:57,776 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:57,790 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35876': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:57,790 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:57,883 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35882': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:57,883 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:57,896 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35898': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:57,896 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:57,989 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35904': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:57,989 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:58,002 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35910': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:58,002 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:58,096 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35914': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:58,096 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:58,109 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35922': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:58,109 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:58,202 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35932': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:58,202 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:58,215 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35948': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:58,215 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:58,309 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35960': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:58,309 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:58,321 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35962': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:58,321 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:58,415 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35978': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:58,415 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:58,427 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35982': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:58,427 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:58,522 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35996': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:58,522 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:58,533 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36002': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:58,533 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:58,628 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36008': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:58,628 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:58,639 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36010': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:58,640 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:58,735 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:58,735 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36018': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:58,746 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36034': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:58,746 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:58,841 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36038': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:58,841 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:58,852 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36040': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:58,852 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:58,948 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36044': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:58,948 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:58,958 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36060': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:58,958 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:59,054 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36072': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:59,055 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:59,064 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36084': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:59,064 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:59,161 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36094': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:59,161 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:59,170 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36100': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:59,170 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:59,267 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36106': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:59,267 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:59,276 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36114': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:59,276 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:59,374 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36130': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:59,374 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:59,382 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36142': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:59,382 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:59,480 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36154': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:59,480 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:59,488 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36170': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:59,488 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:59,586 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36186': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:59,586 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:59,594 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36202': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:59,594 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:59,692 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36218': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:59,692 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:59,700 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36228': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:59,700 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:59,799 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36242': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:59,799 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:59,806 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36250': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:59,806 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:59,905 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36254': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:59,905 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:52:59,912 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36270': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:52:59,912 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:00,011 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36278': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:00,011 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:00,018 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36290': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:00,018 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:00,117 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36296': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:00,118 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:00,124 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36310': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:00,124 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:00,224 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36320': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:00,224 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:00,230 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36328': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:00,230 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:00,331 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36330': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:00,331 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:00,336 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36342': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:00,336 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:00,437 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36346': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:00,437 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:00,442 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36360': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:00,442 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:00,543 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36372': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:00,543 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:00,548 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36374': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:00,548 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:00,649 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:00,649 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36386': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:00,654 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36402': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:00,654 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:00,755 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36416': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:00,755 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:00,760 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36432': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:00,760 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:00,863 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:00,867 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36444': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:00,867 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36450': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:00,867 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:00,969 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:00,972 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36462': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:00,973 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36468': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:00,973 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:01,076 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:01,079 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36476': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:01,080 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36484': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:01,080 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:01,182 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:01,186 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36500': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:01,186 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36506': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:01,186 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:01,288 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:01,292 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36512': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:01,292 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36524': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:01,292 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:01,395 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:01,399 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36530': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:01,399 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36542': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:01,399 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:01,502 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:01,505 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36558': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:01,506 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36560': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:01,506 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:01,608 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:01,611 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39524': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:01,612 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39526': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:01,612 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:01,714 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:01,718 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39542': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:01,718 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39546': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:01,718 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:01,820 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:01,824 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39554': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:01,824 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39558': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:01,824 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:01,927 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:01,930 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39566': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:01,931 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39582': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:01,931 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:02,033 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:02,036 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39594': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:02,037 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39602': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:02,037 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:02,139 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:02,143 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39610': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:02,143 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39624': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:02,143 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:02,245 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:02,249 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39628': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:02,250 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39636': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:02,250 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:02,352 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:02,355 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39650': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:02,356 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39658': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:02,356 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:02,458 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:02,462 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39660': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:02,462 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39670': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:02,462 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:02,564 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:02,568 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39678': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:02,568 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39688': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:02,568 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:02,670 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:02,674 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39690': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:02,675 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39698': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:02,675 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:02,778 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:02,781 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39704': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:02,782 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39716': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:02,782 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:02,884 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:02,887 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:02,888 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:02,890 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39728': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:02,990 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:02,994 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39742': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:02,994 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39746': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:02,994 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:03,097 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:03,100 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39752': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:03,101 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39762': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:03,101 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:03,203 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:03,206 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39768': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:03,207 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39776': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:03,207 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:03,309 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:03,313 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39788': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:03,313 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39804': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:03,313 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:03,415 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:03,419 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39816': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:03,420 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39832': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:03,420 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:03,522 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:03,525 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39838': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:03,526 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39848': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:03,526 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:03,628 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:03,631 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39856': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:03,632 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39868': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:03,632 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:03,734 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:03,738 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:03,738 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39870': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:03,739 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39876': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:03,841 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:03,844 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39882': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:03,845 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39894': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:03,845 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:03,947 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:03,950 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39898': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:03,951 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39900': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:03,951 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:04,054 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:04,059 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39914': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:04,059 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:04,060 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39918': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:04,161 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:04,166 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39928': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:04,166 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:04,166 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39930': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:04,268 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:04,273 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39940': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:04,273 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:04,273 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39950': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:04,375 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:04,380 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39966': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:04,380 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:04,381 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39974': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:04,483 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:04,488 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39976': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:04,488 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:04,489 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39990': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:04,590 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:04,595 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39996': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:04,596 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:04,596 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40008': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:04,697 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:04,702 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40014': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:04,703 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:04,703 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40024': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:04,804 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:04,809 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40030': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:04,810 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:04,810 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40034': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:04,911 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:04,916 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40042': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:04,917 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:04,917 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:05,018 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:05,023 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40072': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:05,024 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:05,024 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40078': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:05,125 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:05,130 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40084': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:05,131 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:05,131 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40086': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:05,232 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:05,237 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40100': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:05,238 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:05,238 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40116': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:05,339 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:05,344 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40120': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:05,345 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:05,345 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40132': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:05,447 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:05,452 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40148': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:05,452 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:05,452 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40162': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:05,554 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:05,559 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40170': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:05,560 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:05,560 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40184': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:05,662 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:05,667 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40200': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:05,667 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:05,667 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40204': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:05,769 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:05,774 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40210': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:05,774 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:05,774 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40226': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:05,876 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:05,881 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40234': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:05,881 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:05,882 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40248': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:05,983 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:05,988 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40260': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:05,989 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:05,989 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40264': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:06,090 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:06,095 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40276': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:06,096 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:06,096 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40280': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:06,198 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:06,203 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40294': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:06,204 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:06,204 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40298': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:06,305 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:06,310 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40312': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:06,311 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:06,311 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40326': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:06,412 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40340': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:06,412 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:06,417 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40348': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:06,417 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:06,518 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:06,518 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40350': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:06,523 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40352': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:06,523 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:06,624 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40362': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:06,624 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:06,629 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40370': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:06,629 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:06,730 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40386': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:06,730 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:06,735 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40396': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:06,735 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:06,837 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:06,840 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40410': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:06,841 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40422': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:06,841 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:06,943 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:06,946 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40432': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:06,947 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40436': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:06,947 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:07,049 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:07,053 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40448': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:07,053 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40454': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:07,053 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:07,156 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:07,159 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40470': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:07,160 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40480': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:07,160 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:07,262 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:07,265 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40494': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:07,266 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40500': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:07,266 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:07,368 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:07,371 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40516': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:07,372 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40528': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:07,372 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:07,474 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:07,478 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40538': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:07,478 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40550': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:07,478 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:07,580 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:07,584 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40556': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:07,585 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40562': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:07,585 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:07,687 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:07,690 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40574': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:07,691 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40586': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:07,691 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:07,793 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:07,796 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40602': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:07,797 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40618': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:07,797 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:07,900 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:07,903 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40624': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:07,904 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40636': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:07,904 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:08,006 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:08,009 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40646': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:08,010 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40658': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:08,010 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:08,112 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:08,116 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40670': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:08,116 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40672': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:08,116 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:08,218 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:08,222 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40680': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:08,222 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40696': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:08,222 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:08,324 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:08,328 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40710': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:08,328 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40726': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:08,328 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:08,430 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:08,434 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40728': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:08,435 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40738': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:08,435 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:08,537 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:08,540 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40752': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:08,541 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40756': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:08,541 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:08,643 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:08,646 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40772': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:08,647 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40788': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:08,647 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:08,749 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:08,753 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40798': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:08,754 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40808': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:08,754 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:08,855 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40824': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:08,855 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:08,862 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40828': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:08,863 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:08,961 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40830': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:08,961 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:08,971 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40842': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:08,972 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:09,068 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40854': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:09,068 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:09,080 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40860': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:09,080 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:09,175 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40866': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:09,175 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:09,189 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40868': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:09,189 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:09,281 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40876': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:09,281 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:09,297 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40886': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:09,298 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:09,388 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40898': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:09,388 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:09,406 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40902': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:09,407 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:09,494 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40908': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:09,494 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:09,515 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40910': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:09,516 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:09,601 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40920': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:09,601 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:09,624 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40924': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:09,625 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:09,708 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40930': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:09,708 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:09,733 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40932': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:09,733 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:09,814 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40938': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:09,814 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:09,842 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40948': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:09,842 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:09,921 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40950': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:09,921 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:09,950 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40960': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:09,951 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:10,028 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40970': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:10,028 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:10,059 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40986': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:10,059 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:10,134 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40998': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:10,134 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:10,168 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41010': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:10,168 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:10,241 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41012': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:10,241 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:10,277 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41016': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:10,277 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:10,347 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41028': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:10,347 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:10,386 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41042': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:10,386 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:10,455 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41056': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:10,455 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:10,497 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:10,497 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:10,561 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41072': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:10,561 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:10,606 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41074': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:10,606 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:10,668 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41090': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:10,668 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:10,715 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41098': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:10,715 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:10,774 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41104': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:10,774 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:10,823 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41108': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:10,824 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:10,881 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41120': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:10,881 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:10,933 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41124': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:10,933 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:10,987 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:10,987 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41132': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:11,042 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41138': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:11,042 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:11,094 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:11,094 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41140': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:11,151 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41146': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:11,151 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:11,200 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41150': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:11,200 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:11,260 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41152': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:11,260 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:11,307 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41164': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:11,307 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:11,369 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41168': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:11,369 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:11,414 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41176': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:11,414 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:11,478 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41182': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:11,478 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:11,520 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41190': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:11,520 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:11,586 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39336': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:11,587 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:11,627 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39350': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:11,627 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:11,695 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39354': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:11,695 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:11,733 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39364': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:11,733 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:11,804 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39366': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:11,804 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:11,840 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39378': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:11,840 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:11,912 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39394': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:11,913 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:11,947 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39402': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:11,947 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:12,021 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39408': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:12,021 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:12,053 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39418': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:12,053 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:12,129 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39428': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:12,129 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:12,160 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:12,160 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39430': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:12,238 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39432': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:12,238 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:12,266 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39438': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:12,266 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:12,346 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39442': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:12,346 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:12,373 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39446': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:12,373 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:12,455 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39450': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:12,455 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:12,479 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39454': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:12,479 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:12,563 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39470': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:12,564 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:12,586 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39486': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:12,586 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:12,672 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39502': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:12,672 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:12,692 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39514': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:12,692 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:12,781 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39520': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:12,781 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:12,799 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39526': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:12,799 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:12,890 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:12,893 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39542': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:12,905 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39544': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:12,905 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:12,999 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39556': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:12,999 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:13,013 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39562': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:13,013 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:13,108 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39566': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:13,108 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:13,119 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39582': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:13,119 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:13,216 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39594': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:13,217 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:13,226 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39602': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:13,225 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:13,325 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39616': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:13,326 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:13,332 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39630': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:13,332 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:13,434 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:13,437 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39644': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:13,438 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39660': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:13,438 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:13,543 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:13,546 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39668': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:13,547 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39680': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:13,547 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:13,652 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:13,655 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39688': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:13,656 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39704': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:13,656 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:13,762 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:13,765 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:13,765 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39718': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:13,766 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39716': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:13,871 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:13,873 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39730': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:13,874 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39734': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:13,874 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:13,980 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:13,983 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39738': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:13,983 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39752': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:13,983 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:14,089 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:14,092 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39764': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:14,092 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39774': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:14,092 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:14,198 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:14,200 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39790': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:14,201 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39804': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:14,201 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:14,307 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:14,309 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39806': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:14,310 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39812': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:14,310 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:14,415 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:14,418 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39816': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:14,419 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39832': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:14,419 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:14,524 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:14,527 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39836': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:14,528 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39844': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:14,528 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:14,633 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:14,636 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39858': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:14,636 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:14,636 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39868': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:14,742 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:14,746 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39870': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:14,746 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39874': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:14,746 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:14,851 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:14,854 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39884': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:14,854 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39894': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:14,854 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:14,960 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:14,962 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39910': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:14,963 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39918': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:14,963 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:15,069 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:15,071 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39924': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:15,072 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39936': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:15,072 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:15,178 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:15,181 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39950': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:15,181 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39962': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:15,181 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:15,287 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:15,290 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39966': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:15,290 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39982': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:15,290 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:15,396 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:15,400 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39992': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:15,401 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:15,401 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:15,503 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:15,503 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39994': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:15,508 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40008': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:15,508 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:15,609 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:15,609 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40022': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:15,614 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40028': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:15,614 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:15,715 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40032': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:15,715 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:15,720 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40048': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:15,720 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:15,821 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40056': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:15,821 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:15,826 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40068': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:15,826 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:15,927 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:15,927 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40082': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:15,932 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40084': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:15,932 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:16,034 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:16,034 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40092': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:16,039 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40104': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:16,039 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:16,140 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:16,140 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40112': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:16,145 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40116': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:16,145 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:16,246 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:16,246 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40132': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:16,251 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40142': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:16,251 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:16,352 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:16,352 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40152': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:16,357 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40156': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:16,357 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:16,458 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:16,458 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40158': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:16,464 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40174': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:16,464 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:16,565 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40182': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:16,565 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:16,571 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40194': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:16,571 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:16,671 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40206': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:16,671 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:16,677 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40220': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:16,677 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:16,777 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40228': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:16,777 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:16,783 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40236': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:16,783 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:16,883 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40244': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:16,883 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:16,889 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:16,891 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40260': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:16,990 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40270': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:16,990 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:16,995 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40280': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:16,995 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:17,096 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:17,096 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40284': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:17,101 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40294': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:17,101 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:17,202 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:17,202 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40302': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:17,207 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40310': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:17,207 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:17,308 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40320': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:17,308 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:17,313 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40324': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:17,313 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:17,415 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:17,418 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40336': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:17,419 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40344': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:17,419 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:17,521 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:17,524 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40350': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:17,525 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40352': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:17,525 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:17,627 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:17,630 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40358': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:17,631 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40372': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:17,631 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:17,733 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:17,737 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40376': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:17,737 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40382': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:17,737 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:17,839 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:17,843 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40398': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:17,844 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40402': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:17,844 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:17,946 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:17,949 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40412': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:17,950 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40426': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:17,950 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:18,052 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:18,056 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40438': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:18,056 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40452': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:18,056 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:18,158 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:18,163 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40464': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:18,163 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40470': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:18,163 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:18,265 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40482': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:18,265 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:18,270 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40488': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:18,270 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:18,371 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40492': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:18,371 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:18,376 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40498': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:18,376 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:18,477 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:18,477 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40510': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:18,482 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40526': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:18,482 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:18,583 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40528': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:18,583 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:18,588 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40540': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:18,588 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:18,689 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40542': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:18,689 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:18,694 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40558': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:18,694 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:18,796 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:18,800 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40572': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:18,801 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40574': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:18,801 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:18,902 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:18,902 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40576': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:18,907 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40586': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:18,907 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:19,008 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40594': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:19,008 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:19,013 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:19,013 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40596': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:19,114 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40604': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:19,114 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:19,119 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40610': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:19,119 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:19,220 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:19,224 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40614': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:19,225 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40626': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:19,225 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:19,327 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:19,330 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40642': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:19,331 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40648': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:19,331 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:19,433 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:19,436 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40660': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:19,437 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40668': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:19,437 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:19,539 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:19,543 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40678': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:19,543 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40688': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:19,543 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:19,645 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:19,649 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40704': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:19,649 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40718': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:19,649 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:19,752 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:19,755 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40732': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:19,756 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40744': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:19,756 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:19,858 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:19,862 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40746': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:19,863 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40752': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:19,863 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:19,964 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40762': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:19,964 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:19,969 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40768': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:19,969 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:20,071 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:20,075 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40770': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:20,075 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40780': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:20,075 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:20,177 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40786': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:20,177 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:20,182 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40790': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:20,182 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:20,283 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:20,287 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40802': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:20,288 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40810': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:20,288 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:20,390 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:20,397 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40824': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:20,397 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40830': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:20,397 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:20,496 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40834': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:20,496 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:20,503 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40844': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:20,503 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:20,603 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40856': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:20,603 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:20,609 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40868': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:20,609 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:20,709 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40884': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:20,709 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:20,715 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40890': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:20,715 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:20,815 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40896': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:20,815 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:20,821 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40906': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:20,821 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:20,922 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40912': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:20,922 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:20,927 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40920': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:20,927 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:21,028 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40926': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:21,028 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:21,033 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40928': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:21,033 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:21,135 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40940': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:21,135 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:21,140 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40942': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:21,140 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:21,241 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40958': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:21,241 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:21,246 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40962': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:21,246 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:21,348 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:21,351 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40978': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:21,352 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40992': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:21,352 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:21,454 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:21,458 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41002': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:21,458 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41018': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:21,458 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:21,561 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:21,565 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42090': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:21,565 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42100': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:21,566 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:21,667 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:21,671 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42108': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:21,671 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42110': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:21,671 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:21,773 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:21,777 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:21,777 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42128': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:21,777 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:21,880 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:21,883 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42130': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:21,884 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42142': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:21,884 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:21,986 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:21,989 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42156': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:21,990 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:21,990 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42166': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:22,092 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:22,096 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42174': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:22,096 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42176': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:22,096 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:22,199 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:22,202 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42178': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:22,203 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42180': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:22,204 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:22,305 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42184': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:22,305 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:22,310 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42194': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:22,310 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:22,411 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:22,412 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42210': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:22,417 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42216': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:22,417 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:22,518 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:22,518 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42220': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:22,523 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42228': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:22,523 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:22,624 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42232': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:22,624 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:22,629 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42242': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:22,629 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:22,730 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42248': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:22,730 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:22,735 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42262': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:22,735 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:22,838 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:22,841 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42268': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:22,842 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42284': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:22,842 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:22,944 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:22,947 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42296': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:22,948 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42306': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:22,948 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:23,050 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:23,054 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42316': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:23,054 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42322': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:23,054 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:23,156 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:23,160 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42326': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:23,161 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42328': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:23,161 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:23,262 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:23,267 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42332': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:23,268 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42340': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:23,268 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:23,369 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:23,370 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42348': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:23,376 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:23,376 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42364': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:23,476 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:23,476 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42370': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:23,483 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:23,483 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42376': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:23,584 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:23,584 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42388': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:23,590 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:23,591 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42392': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:23,691 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:23,691 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42398': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:23,698 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:23,698 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42404': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:23,798 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:23,798 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42420': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:23,806 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:23,807 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42424': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:23,905 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:23,905 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42426': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:23,913 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:23,913 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42432': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:24,012 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:24,013 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42442': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:24,020 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:24,020 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42452': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:24,120 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:24,120 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42466': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:24,126 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:24,127 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42482': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:24,227 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:24,227 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42496': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:24,233 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:24,234 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42510': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:24,334 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:24,334 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42526': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:24,341 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:24,341 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42538': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:24,442 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:24,442 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42540': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:24,448 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:24,448 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42542': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:24,549 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:24,549 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42546': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:24,556 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:24,556 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42560': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:24,656 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:24,657 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42570': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:24,663 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:24,663 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42582': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:24,764 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:24,765 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42598': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:24,770 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:24,771 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42612': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:24,872 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:24,877 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42618': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:24,878 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:24,878 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42620': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:24,980 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:24,980 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42624': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:24,987 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:24,988 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42632': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:25,087 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:25,087 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42644': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:25,094 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:25,094 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42650': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:25,194 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:25,194 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42654': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:25,201 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:25,201 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42670': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:25,301 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:25,302 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42678': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:25,308 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:25,308 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42688': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:25,409 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:25,409 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42692': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:25,415 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:25,415 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42702': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:25,516 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:25,516 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42712': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:25,522 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:25,523 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42722': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:25,623 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:25,623 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42734': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:25,630 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:25,630 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42746': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:25,731 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:25,731 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42756': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:25,737 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:25,737 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42766': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:25,838 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:25,839 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42776': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:25,844 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:25,845 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42788': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:25,945 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:25,945 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42792': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:25,952 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:25,952 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:26,053 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:26,054 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42806': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:26,059 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:26,060 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42822': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:26,160 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:26,160 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42830': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:26,167 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:26,167 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42836': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:26,267 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:26,268 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42848': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:26,274 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:26,274 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42850': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:26,375 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:26,375 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42860': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:26,381 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:26,382 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42862': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:26,482 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:26,482 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42864': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:26,489 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:26,489 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42872': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:26,589 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:26,589 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42874': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:26,595 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:26,595 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42890': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:26,696 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:26,696 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42896': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:26,702 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:26,702 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42908': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:26,802 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42920': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:26,802 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:26,808 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42932': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:26,808 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:26,909 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42946': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:26,909 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:26,914 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42948': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:26,914 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:27,015 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:27,015 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42952': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:27,021 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:27,021 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42968': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:27,121 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42978': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:27,121 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:27,127 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42980': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:27,127 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:27,228 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:27,228 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:27,233 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42992': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:27,233 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:27,334 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:27,334 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42994': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:27,339 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43010': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:27,339 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:27,441 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43026': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:27,441 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:27,445 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43032': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:27,445 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:27,547 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43038': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:27,547 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:27,552 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43040': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:27,552 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:27,653 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43048': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:27,653 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:27,658 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43050': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:27,658 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:27,759 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43056': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:27,759 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:27,764 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43068': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:27,764 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:27,866 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:27,870 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43074': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:27,870 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43090': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:27,870 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:27,972 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:27,976 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43102': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:27,976 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43110': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:27,976 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:28,078 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:28,082 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43120': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:28,082 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43130': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:28,082 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:28,185 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:28,188 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43142': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:28,189 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43146': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:28,189 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:28,291 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:28,294 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43156': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:28,295 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43168': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:28,295 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:28,397 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:28,401 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43174': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:28,402 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43186': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:28,402 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:28,503 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43200': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:28,503 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:28,508 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43202': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:28,508 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:28,610 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:28,613 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43210': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:28,614 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43216': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:28,614 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:28,716 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:28,719 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43224': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:28,720 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:28,721 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43234': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:28,822 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:28,826 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43246': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:28,826 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43250': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:28,826 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:28,928 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:28,932 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43262': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:28,932 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43270': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:28,932 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:29,035 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:29,038 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43274': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:29,039 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43280': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:29,039 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:29,141 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:29,145 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43282': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:29,145 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43298': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:29,145 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:29,247 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:29,251 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43308': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:29,251 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43316': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:29,251 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:29,353 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:29,357 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43322': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:29,358 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43334': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:29,358 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:29,460 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:29,463 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43348': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:29,464 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43364': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:29,464 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:29,566 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:29,570 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43368': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:29,570 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:29,570 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43376': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:29,673 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:29,677 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43384': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:29,678 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43392': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:29,678 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:29,780 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43406': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:29,780 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:29,785 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:29,785 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43414': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:29,886 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43426': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:29,886 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:29,891 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:29,893 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43440': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:29,992 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43442': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:29,992 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:29,997 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43458': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:29,997 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:30,098 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:30,098 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43470': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:30,104 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43478': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:30,104 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:30,205 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43480': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:30,205 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:30,210 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43484': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:30,210 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:30,311 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43498': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:30,311 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:30,316 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43510': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:30,316 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:30,418 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:30,422 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43516': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:30,422 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43520': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:30,422 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:30,524 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43526': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:30,524 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:30,529 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43528': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:30,529 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:30,630 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:30,634 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43540': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:30,635 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43552': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:30,635 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:30,737 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:30,740 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43556': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:30,741 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43568': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:30,741 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:30,843 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:30,847 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43570': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:30,847 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43582': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:30,847 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:30,949 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:30,953 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43596': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:30,953 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43604': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:30,953 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:31,055 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:31,059 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43620': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:31,060 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43630': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:31,060 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:31,162 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:31,165 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43644': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:31,166 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43652': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:31,166 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:31,268 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:31,271 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43662': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:31,272 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43672': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:31,272 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:31,374 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:31,378 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43674': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:31,378 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43682': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:31,378 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:31,480 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:31,484 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43690': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:31,485 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:43700': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:31,485 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:31,587 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:31,590 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55326': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:31,591 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55334': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:31,591 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:31,693 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:31,696 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55348': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:31,697 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55362': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:31,697 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:31,799 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:31,804 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55370': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:31,804 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55380': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:31,804 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:31,906 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55382': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:31,906 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:31,910 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55392': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:31,910 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:32,012 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55408': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:32,012 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:32,017 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55412': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:32,017 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:32,118 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55422': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:32,118 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:32,123 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55434': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:32,123 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:32,224 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55450': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:32,224 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:32,229 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55458': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:32,229 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:32,330 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55460': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:32,331 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:32,335 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55462': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:32,335 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:32,437 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:32,441 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55468': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:32,441 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55484': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:32,441 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:32,543 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:32,547 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55488': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:32,547 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55502': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:32,547 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:32,649 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:32,653 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55506': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:32,654 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55520': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:32,654 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:32,756 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:32,759 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55528': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:32,760 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55534': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:32,760 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:32,862 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:32,866 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55546': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:32,866 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55562': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:32,866 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:32,968 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:32,972 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55564': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:32,973 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55568': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:32,973 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:33,074 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:33,078 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55584': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:33,079 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55592': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:33,079 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:33,181 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:33,184 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55600': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:33,185 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55604': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:33,185 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:33,287 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:33,291 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55608': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:33,291 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55610': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:33,291 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:33,395 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:33,399 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55622': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:33,399 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55638': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:33,399 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:33,501 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:33,506 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55652': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:33,506 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55662': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:33,506 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:33,608 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55664': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:33,608 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:33,613 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55680': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:33,613 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:33,714 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:33,719 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55684': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:33,719 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55688': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:33,719 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:33,820 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:33,820 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55692': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:33,825 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55706': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:33,825 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:33,927 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:33,931 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55712': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:33,931 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55716': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:33,931 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:34,033 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:34,037 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55726': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:34,037 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55736': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:34,037 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:34,139 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:34,143 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55744': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:34,143 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55746': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:34,143 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:34,245 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:34,249 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55762': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:34,250 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55770': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:34,250 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:34,352 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:34,355 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55776': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:34,356 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55782': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:34,356 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:34,459 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:34,462 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55792': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:34,463 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:34,463 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:34,565 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55810': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:34,565 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:34,570 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:34,570 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55822': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:34,671 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:34,675 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55826': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:34,676 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55840': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:34,676 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:34,777 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:34,781 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55856': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:34,782 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55866': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:34,782 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:34,884 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:34,887 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55870': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:34,888 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:34,890 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55872': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:34,990 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:34,994 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55880': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:34,994 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55894': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:34,994 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:35,096 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:35,100 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55910': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:35,100 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55926': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:35,100 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:35,203 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:35,207 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55934': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:35,208 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55948': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:35,208 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:35,309 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:35,313 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55954': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:35,314 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55968': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:35,314 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:35,416 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:35,419 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55970': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:35,420 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:35,420 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:35,522 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:35,525 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55988': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:35,526 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55990': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:35,526 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:35,628 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:35,632 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55994': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:35,632 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56004': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:35,632 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:35,734 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:35,738 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56006': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:35,738 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56010': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:35,738 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:35,841 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:35,844 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56026': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:35,845 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56030': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:35,845 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:35,947 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:35,951 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56036': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:35,951 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56044': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:35,951 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:36,053 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:36,057 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56056': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:36,058 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56064': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:36,058 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:36,159 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:36,163 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56076': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:36,164 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56086': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:36,164 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:36,266 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:36,269 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56092': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:36,270 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56108': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:36,270 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:36,372 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:36,376 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56120': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:36,376 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:36,376 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:36,478 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:36,482 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56138': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:36,483 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56148': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:36,483 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:36,585 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:36,588 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56152': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:36,589 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56154': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:36,589 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:36,691 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:36,695 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56162': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:36,695 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56170': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:36,695 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:36,797 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:36,801 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56186': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:36,802 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56190': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:36,802 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:36,904 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:36,908 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56196': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:36,909 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56208': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:36,909 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:37,010 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56210': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:37,010 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:37,015 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56214': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:37,015 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:37,116 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56230': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:37,116 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:37,121 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56232': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:37,121 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:37,223 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:37,227 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56244': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:37,227 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56254': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:37,227 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:37,329 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:37,333 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56266': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:37,333 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56276': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:37,333 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:37,435 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:37,439 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56278': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:37,440 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56292': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:37,440 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:37,542 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:37,545 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56302': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:37,546 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56310': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:37,546 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:37,648 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:37,651 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56322': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:37,652 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56326': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:37,652 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:37,754 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:37,758 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56338': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:37,758 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56350': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:37,758 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:37,861 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:37,864 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56358': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:37,865 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56362': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:37,865 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:37,967 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:37,971 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56364': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:37,971 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56374': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:37,972 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:38,074 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:38,077 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56376': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:38,078 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56392': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:38,078 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:38,180 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:38,184 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56396': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:38,184 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56406': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:38,184 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:38,287 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:38,290 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56420': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:38,291 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56422': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:38,291 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:38,395 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:38,399 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56424': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:38,399 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56434': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:38,399 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:38,502 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:38,505 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56438': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:38,506 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56444': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:38,506 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:38,608 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:38,612 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56456': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:38,613 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56470': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:38,613 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:38,714 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:38,719 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56478': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:38,720 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56492': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:38,720 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:38,821 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56500': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:38,821 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:38,828 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56512': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:38,829 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:38,927 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56526': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:38,927 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:38,937 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56534': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:38,938 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:39,034 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56550': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:39,034 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:39,046 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56556': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:39,047 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:39,141 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56560': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:39,141 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:39,155 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56564': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:39,156 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:39,248 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56568': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:39,248 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:39,264 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56570': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:39,264 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:39,355 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56572': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:39,355 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:39,374 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56576': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:39,374 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:39,462 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56592': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:39,462 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:39,483 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56598': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:39,483 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:39,568 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56602': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:39,568 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:39,591 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56606': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:39,592 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:39,674 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56618': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:39,674 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:39,700 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56632': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:39,700 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:39,781 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56644': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:39,781 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:39,809 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56654': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:39,809 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:39,887 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:39,887 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56658': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:39,917 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56672': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:39,917 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:39,994 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56680': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:39,994 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:40,026 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56688': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:40,026 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:40,100 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56700': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:40,100 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:40,134 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56710': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:40,135 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:40,207 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:40,207 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:40,243 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56730': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:40,243 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:40,313 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56744': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:40,313 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:40,352 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56746': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:40,353 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:40,420 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56756': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:40,420 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:40,461 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56758': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:40,461 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:40,526 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56766': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:40,526 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:40,570 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56782': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:40,570 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:40,633 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56784': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:40,633 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:40,678 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56792': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:40,679 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:40,739 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56800': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:40,739 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:40,787 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56814': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:40,787 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:40,846 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:40,846 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56828': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:40,896 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56838': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:40,896 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:40,953 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56848': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:40,953 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:41,005 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56864': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:41,005 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:41,059 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56866': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:41,059 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:41,114 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56870': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:41,115 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:41,165 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56874': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:41,165 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:41,224 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56878': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:41,225 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:41,271 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56882': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:41,271 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:41,334 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56886': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:41,334 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:41,378 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56890': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:41,378 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:41,443 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56898': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:41,443 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:41,485 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56914': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:41,485 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:41,552 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34320': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:41,552 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:41,591 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34324': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:41,591 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:41,660 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34326': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:41,661 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:41,697 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34338': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:41,697 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:41,769 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34350': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:41,770 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:41,804 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34358': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:41,804 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:41,878 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34370': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:41,879 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:41,910 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:41,910 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34376': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:41,987 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34380': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:41,987 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:42,016 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34392': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:42,016 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:42,096 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34404': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:42,097 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:42,123 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34410': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:42,123 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:42,205 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34418': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:42,205 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:42,229 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34428': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:42,229 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:42,314 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34444': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:42,314 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:42,336 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34452': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:42,336 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:42,422 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34454': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:42,423 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:42,442 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34464': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:42,442 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:42,532 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34478': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:42,532 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:42,549 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34490': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:42,549 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:42,641 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34494': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:42,641 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:42,655 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34508': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:42,655 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:42,749 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34510': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:42,750 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:42,762 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34512': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:42,762 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:42,858 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34516': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:42,859 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:42,868 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34532': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:42,868 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:42,968 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34536': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:42,968 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:42,974 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34538': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:42,974 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:43,077 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:43,080 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34546': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:43,081 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34558': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:43,081 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:43,186 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:43,189 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34568': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:43,189 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34574': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:43,189 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:43,295 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:43,298 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34582': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:43,299 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34598': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:43,299 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:43,404 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:43,407 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34614': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:43,407 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34626': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:43,407 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:43,513 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:43,516 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34636': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:43,516 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34640': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:43,516 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:43,622 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:43,625 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34654': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:43,626 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34660': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:43,626 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:43,731 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:43,734 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:43,735 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34664': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:43,735 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34676': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:43,841 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:43,844 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34692': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:43,844 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34702': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:43,844 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:43,950 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:43,952 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34704': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:43,953 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34716': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:43,953 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:44,059 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:44,062 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34728': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:44,062 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34742': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:44,062 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:44,168 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:44,171 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34746': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:44,171 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34750': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:44,171 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:44,278 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:44,281 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34752': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:44,281 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34764': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:44,281 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:44,387 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:44,390 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34778': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:44,391 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:44,393 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34784': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:44,496 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:44,499 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:44,500 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34810': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:44,500 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:44,606 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:44,609 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34826': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:44,610 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34834': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:44,610 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:44,714 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:44,718 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34842': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:44,719 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34856': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:44,719 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:44,821 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:44,821 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34866': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:44,828 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34878': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:44,828 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:44,928 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34880': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:44,928 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:44,937 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34892': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:44,937 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:45,034 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34906': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:45,034 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:45,046 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34916': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:45,046 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:45,141 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34918': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:45,141 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:45,155 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34932': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:45,155 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:45,247 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34948': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:45,247 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:45,264 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34962': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:45,264 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:45,354 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34966': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:45,354 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:45,373 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34982': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:45,373 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:45,461 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:45,461 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:45,482 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34990': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:45,483 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:45,568 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34994': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:45,568 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:45,591 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35002': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:45,592 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:45,674 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35016': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:45,674 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:45,700 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35032': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:45,701 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:45,780 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35040': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:45,780 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:45,810 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35044': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:45,810 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:45,886 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:45,886 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:45,919 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35072': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:45,919 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:45,993 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35082': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:45,993 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:46,028 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35086': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:46,028 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:46,099 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35102': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:46,099 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:46,137 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35112': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:46,137 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:46,205 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35128': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:46,205 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:46,246 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35144': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:46,246 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:46,311 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35158': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:46,312 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:46,355 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35172': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:46,355 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:46,418 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35176': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:46,418 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:46,464 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35184': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:46,464 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:46,524 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35200': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:46,524 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:46,573 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35206': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:46,573 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:46,630 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35220': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:46,630 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:46,681 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35232': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:46,682 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:46,737 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35234': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:46,737 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:46,790 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35244': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:46,790 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:46,844 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35252': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:46,844 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:46,899 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35260': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:46,899 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:46,950 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35266': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:46,950 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:47,007 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35280': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:47,008 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:47,057 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35294': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:47,057 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:47,116 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35302': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:47,116 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:47,164 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35312': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:47,164 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:47,224 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35316': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:47,225 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:47,271 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35322': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:47,271 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:47,333 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35324': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:47,333 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:47,377 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35330': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:47,377 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:47,441 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35344': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:47,442 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:47,484 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35356': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:47,484 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:47,550 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35368': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:47,551 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:47,590 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35374': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:47,590 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:47,659 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35386': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:47,659 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:47,696 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35392': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:47,696 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:47,768 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35406': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:47,768 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:47,803 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35420': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:47,803 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:47,876 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35424': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:47,877 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:47,909 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35426': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:47,909 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:47,985 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35442': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:47,985 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:48,016 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35444': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:48,016 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:48,093 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35456': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:48,094 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:48,123 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35468': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:48,123 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:48,202 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35476': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:48,202 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:48,229 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35482': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:48,229 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:48,310 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35496': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:48,310 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:48,336 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35500': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:48,336 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:48,418 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35512': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:48,419 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:48,442 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35528': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:48,442 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:48,527 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35530': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:48,527 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:48,548 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35540': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:48,548 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:48,635 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35554': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:48,636 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:48,655 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35556': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:48,655 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:48,744 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35558': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:48,744 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:48,761 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35574': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:48,761 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:48,853 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35582': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:48,853 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:48,867 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35588': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:48,867 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:48,963 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35600': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:48,964 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:48,974 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35606': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:48,974 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:49,072 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35608': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:49,072 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:49,082 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35620': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:49,082 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:49,181 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35634': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:49,181 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:49,188 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35640': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:49,188 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:49,289 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35654': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:49,290 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:49,294 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35664': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:49,294 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:49,398 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:49,401 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35672': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:49,402 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35678': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:49,402 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:49,507 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:49,510 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35686': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:49,511 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35698': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:49,511 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:49,616 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:49,619 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35702': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:49,619 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35716': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:49,619 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:49,725 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:49,727 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35718': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:49,728 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:49,728 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:49,833 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:49,836 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35732': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:49,837 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35746': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:49,837 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:49,942 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:49,945 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35748': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:49,945 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35750': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:49,945 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:50,051 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:50,053 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35752': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:50,054 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35760': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:50,054 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:50,159 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:50,162 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35762': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:50,163 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35774': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:50,163 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:50,268 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:50,271 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35776': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:50,271 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35784': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:50,271 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:50,377 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:50,380 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35798': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:50,380 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35804': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:50,380 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:50,485 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:50,488 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35808': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:50,489 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35814': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:50,489 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:50,594 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:50,597 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35818': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:50,598 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35824': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:50,598 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:50,703 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:50,707 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35832': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:50,707 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35834': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:50,707 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:50,812 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:50,814 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35848': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:50,815 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35862': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:50,815 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:50,921 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:50,923 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35866': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:50,924 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:50,924 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35882': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:51,029 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:51,032 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35892': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:51,033 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35906': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:51,033 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:51,138 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:51,141 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35922': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:51,141 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35928': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:51,141 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:51,247 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:51,250 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35930': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:51,250 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35936': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:51,250 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:51,355 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:51,358 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35940': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:51,359 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35942': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:51,359 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:51,464 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:51,467 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35946': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:51,467 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35950': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:51,467 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:51,573 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:51,576 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55214': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:51,576 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55222': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:51,576 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:51,681 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:51,684 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55232': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:51,685 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55238': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:51,685 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:51,790 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:51,793 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55248': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:51,794 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55260': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:51,794 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:51,899 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:51,901 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55276': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:51,902 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55278': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:51,902 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:52,007 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:52,010 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55280': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:52,011 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55290': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:52,011 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:52,116 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:52,119 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55296': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:52,120 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55302': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:52,120 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:52,225 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:52,228 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55306': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:52,229 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55308': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:52,230 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:52,335 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:52,337 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55316': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:52,338 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55320': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:52,339 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:52,444 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:52,447 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55334': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:52,448 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55340': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:52,449 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:52,553 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:52,556 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55354': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:52,557 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55356': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:52,558 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:52,662 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:52,665 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55362': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:52,666 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55376': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:52,666 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:52,771 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:52,774 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55392': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:52,775 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55406': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:52,775 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:52,880 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:52,883 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55418': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:52,884 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55428': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:52,884 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:52,989 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:52,992 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55430': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:52,993 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55434': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:52,993 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:53,098 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:53,101 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55444': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:53,102 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55450': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:53,102 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:53,206 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:53,209 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55462': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:53,211 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55474': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:53,211 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:53,315 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:53,318 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55476': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:53,319 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55490': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:53,319 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:53,424 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:53,427 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55492': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:53,428 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55500': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:53,428 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:53,533 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:53,536 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55508': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:53,536 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55516': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:53,537 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:53,640 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:53,644 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55528': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:53,645 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55544': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:53,645 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:53,747 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55546': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:53,747 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:53,754 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55552': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:53,754 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:53,854 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55560': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:53,854 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:53,862 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55570': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:53,863 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:53,961 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55582': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:53,961 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:53,973 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55596': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:53,973 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:54,067 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55598': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:54,067 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:54,082 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55612': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:54,082 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:54,173 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55626': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:54,173 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:54,192 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55642': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:54,192 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:54,280 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55650': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:54,280 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:54,301 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55658': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:54,301 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:54,387 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55666': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:54,387 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:54,409 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55680': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:54,410 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:54,493 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55692': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:54,493 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:54,518 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55698': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:54,519 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:54,599 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55702': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:54,599 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:54,627 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55704': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:54,627 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:54,706 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55710': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:54,706 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:54,736 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55726': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:54,736 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:54,813 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55728': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:54,813 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:54,844 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55740': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:54,845 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:54,919 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55752': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:54,919 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:54,953 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55754': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:54,954 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:55,025 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55770': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:55,025 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:55,062 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55778': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:55,063 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:55,132 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55794': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:55,132 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:55,171 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55798': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:55,172 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:55,238 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55804': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:55,238 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:55,280 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55808': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:55,280 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:55,344 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55818': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:55,345 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:55,389 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:55,391 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55826': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:55,451 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55830': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:55,451 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:55,498 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55838': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:55,498 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:55,557 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55842': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:55,557 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:55,606 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55844': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:55,607 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:55,664 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55854': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:55,664 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:55,715 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55858': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:55,715 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:55,770 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55864': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:55,770 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:55,824 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55876': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:55,824 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:55,877 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55882': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:55,877 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:55,933 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55890': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:55,934 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:55,983 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55898': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:55,983 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:56,042 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55904': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:56,043 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:56,089 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55914': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:56,089 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:56,151 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55928': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:56,152 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:56,196 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55942': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:56,196 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:56,260 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55946': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:56,260 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:56,302 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55962': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:56,302 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:56,369 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55968': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:56,369 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:56,409 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55980': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:56,409 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:56,478 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55986': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:56,478 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:56,515 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55988': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:56,515 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:56,587 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56004': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:56,588 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:56,622 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56020': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:56,622 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:56,696 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56022': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:56,697 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:56,730 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56024': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:56,730 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:56,805 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56030': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:56,806 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:56,839 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56032': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:56,839 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:56,914 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56040': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:56,914 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:56,948 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56054': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:56,948 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:57,023 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56068': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:57,023 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:57,056 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56070': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:57,057 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:57,132 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56072': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:57,132 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:57,165 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56080': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:57,166 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:57,241 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56084': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:57,241 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:57,274 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56094': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:57,274 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:57,350 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56098': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:57,350 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:57,383 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56106': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:57,383 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:57,459 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56116': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:57,459 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:57,492 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56120': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:57,492 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:57,568 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:57,568 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:57,602 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56124': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:57,602 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:57,677 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56126': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:57,677 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:57,712 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56138': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:57,712 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:57,786 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56148': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:57,786 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:57,822 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56150': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:57,822 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:57,898 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56162': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:57,899 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:57,932 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56166': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:57,932 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:58,007 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56180': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:58,007 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:58,042 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56186': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:58,042 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:58,116 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56190': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:58,116 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:58,151 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56192': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:58,151 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:58,225 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56208': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:58,226 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:58,261 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56222': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:58,261 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:58,335 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56224': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:58,335 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:58,372 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56226': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:58,372 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:58,445 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56232': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:58,445 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:58,482 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56248': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:58,482 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:58,555 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56256': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:58,555 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:58,592 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56258': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:58,592 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:58,665 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56268': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:58,665 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:58,704 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56276': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:58,704 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:58,775 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56282': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:58,775 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:58,814 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56288': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:58,814 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:58,887 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56302': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:58,887 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:58,923 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56310': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:58,923 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:58,997 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56322': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:58,997 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:59,031 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56334': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:59,032 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:59,107 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56342': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:59,107 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:59,140 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56354': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:59,140 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:59,217 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56362': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:59,217 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:59,249 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56370': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:59,249 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:59,327 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56374': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:59,327 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:59,358 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56386': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:59,358 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:59,437 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:59,437 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56392': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:59,467 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:59,468 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56398': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:59,546 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:59,546 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56414': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:59,576 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:59,577 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56424': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:59,655 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56434': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:59,655 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:59,686 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:59,686 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56436': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:59,765 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56442': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:59,765 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:59,795 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:59,795 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56452': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:59,874 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56466': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:59,874 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:59,904 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56480': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:59,904 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:53:59,984 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56488': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:53:59,984 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:00,013 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:00,013 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56504': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:00,093 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56510': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:00,094 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:00,122 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56514': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:00,123 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:00,203 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:00,203 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56524': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:00,232 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:00,232 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56538': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:00,312 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:00,312 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56542': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:00,341 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:00,341 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56550': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:00,422 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:00,422 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56562': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:00,450 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:00,450 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56572': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:00,531 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56582': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:00,531 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:00,559 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:00,559 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56584': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:00,641 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56596': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:00,641 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:00,668 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:00,669 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56598': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:00,751 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56608': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:00,751 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:00,778 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56610': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:00,778 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:00,860 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56616': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:00,860 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:00,887 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:00,887 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56628': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:00,971 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:00,971 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56640': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:00,996 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56646': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:00,996 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:01,080 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:01,080 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56662': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:01,105 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56666': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:01,105 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:01,190 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:01,190 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56674': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:01,215 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:01,215 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56676': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:01,299 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:01,299 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56680': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:01,324 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:01,325 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56682': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:01,409 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56698': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:01,409 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:01,433 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:01,433 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56706': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:01,519 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:01,519 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56716': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:01,543 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:46568': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:01,543 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:01,628 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:46574': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:01,628 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:01,653 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:01,653 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:46588': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:01,738 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:46602': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:01,738 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:01,762 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:01,762 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:46610': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:01,847 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:46612': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:01,847 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:01,871 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:01,871 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:46622': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:01,957 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:46636': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:01,957 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:01,980 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:01,980 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:46648': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:02,067 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:46656': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:02,066 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:02,089 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:46660': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:02,089 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:02,176 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:46674': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:02,176 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:02,199 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:02,199 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:46686': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:02,286 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:46688': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:02,286 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:02,308 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:46702': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:02,309 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:02,399 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:46712': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:02,399 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:02,419 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:46726': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:02,419 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:02,509 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:46728': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:02,509 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:02,529 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:46742': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:02,529 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:02,619 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:02,619 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:46748': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:02,639 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:46764': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:02,639 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:02,729 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:46778': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:02,729 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:02,748 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:46794': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:02,748 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:02,839 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:46808': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:02,839 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:02,858 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:46810': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:02,858 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:02,950 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:46812': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:02,950 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:02,968 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:46826': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:02,968 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:03,060 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:46836': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:03,060 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:03,077 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:46848': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:03,077 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:03,169 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:46862': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:03,170 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:03,187 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:46864': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:03,187 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:03,279 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:46880': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:03,279 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:03,297 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:46896': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:03,297 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:03,390 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:03,393 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:46900': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:03,407 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:46916': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:03,407 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:03,499 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:46932': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:03,499 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:03,517 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:46946': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:03,517 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:03,609 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:46950': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:03,609 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:03,629 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:46964': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:03,629 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:03,719 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:46970': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:03,719 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:03,739 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:46986': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:03,739 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:03,831 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:03,831 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:46990': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:03,849 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47006': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:03,849 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:03,941 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47020': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:03,941 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:03,958 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47028': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:03,958 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:04,051 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47044': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:04,051 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:04,068 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47052': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:04,068 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:04,161 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47068': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:04,161 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:04,178 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47078': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:04,178 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:04,271 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47086': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:04,271 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:04,288 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:04,288 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47092': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:04,380 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47108': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:04,381 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:04,398 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47110': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:04,398 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:04,490 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47116': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:04,490 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:04,508 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47128': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:04,508 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:04,600 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:04,600 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47142': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:04,617 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:04,617 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47152': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:04,711 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:04,711 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47158': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:04,727 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47164': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:04,727 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:04,821 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47170': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:04,821 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:04,837 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47178': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:04,837 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:04,930 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47190': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:04,930 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:04,947 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47196': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:04,947 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:05,040 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47212': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:05,040 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:05,057 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:05,057 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47228': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:05,150 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47230': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:05,150 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:05,166 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47238': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:05,166 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:05,260 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47248': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:05,260 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:05,276 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47252': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:05,276 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:05,369 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47264': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:05,369 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:05,386 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47266': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:05,387 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:05,480 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47280': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:05,480 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:05,497 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47284': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:05,497 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:05,590 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47288': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:05,590 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:05,607 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47298': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:05,607 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:05,700 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47302': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:05,700 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:05,717 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47308': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:05,717 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:05,810 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47318': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:05,810 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:05,827 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47332': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:05,827 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:05,920 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47344': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:05,920 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:05,936 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47352': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:05,937 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:06,030 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47368': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:06,030 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:06,046 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47372': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:06,046 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:06,140 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47386': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:06,140 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:06,156 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47396': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:06,156 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:06,250 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47412': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:06,250 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:06,266 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47414': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:06,266 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:06,360 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47426': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:06,360 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:06,376 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47434': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:06,376 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:06,471 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47436': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:06,471 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:06,486 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:06,486 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47438': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:06,581 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47442': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:06,581 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:06,596 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:06,596 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47444': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:06,691 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47454': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:06,691 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:06,705 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47458': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:06,706 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:06,800 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47474': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:06,801 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:06,815 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47490': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:06,815 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:06,910 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47494': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:06,910 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:06,924 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47498': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:06,924 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:07,018 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47506': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:07,019 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:07,033 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47512': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:07,034 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:07,128 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47516': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:07,128 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:07,142 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47532': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:07,143 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:07,236 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47540': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:07,237 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:07,251 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47548': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:07,251 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:07,346 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47558': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:07,346 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:07,360 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47564': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:07,361 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:07,455 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47576': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:07,455 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:07,469 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47588': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:07,470 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:07,564 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47600': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:07,564 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:07,578 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47606': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:07,578 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:07,673 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47618': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:07,673 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:07,686 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:07,686 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47632': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:07,784 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47640': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:07,784 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:07,793 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:07,793 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47652': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:07,893 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:07,897 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47666': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:07,903 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:07,903 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47682': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:08,003 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47692': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:08,003 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:08,010 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:08,010 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47702': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:08,113 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:08,117 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47706': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:08,117 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:08,118 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47712': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:08,223 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:08,227 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47722': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:08,228 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:08,228 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:08,333 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:08,337 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47740': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:08,337 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:08,338 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47742': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:08,442 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:08,447 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47754': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:08,447 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:08,447 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47766': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:08,552 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:08,556 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47772': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:08,556 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:08,557 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47786': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:08,662 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:08,666 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:08,666 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:08,666 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47812': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:08,773 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:08,778 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47820': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:08,778 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:08,778 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47834': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:08,883 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:08,887 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47850': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:08,888 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:08,890 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47866': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:08,993 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:08,997 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47868': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:08,998 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:08,998 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47884': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:09,103 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:09,107 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47900': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:09,107 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:09,107 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47914': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:09,213 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:09,217 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47918': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:09,217 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:09,217 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47934': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:09,323 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:09,327 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47942': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:09,327 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:09,328 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47954': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:09,433 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:09,437 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47964': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:09,437 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:09,437 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47972': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:09,542 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:09,547 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47988': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:09,547 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:09,547 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47990': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:09,652 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:09,657 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47996': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:09,657 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:09,657 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:48004': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:09,762 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:09,766 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:48020': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:09,767 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:09,767 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:48036': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:09,872 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:09,876 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:48044': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:09,877 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:09,877 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:48060': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:09,982 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:09,987 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:48062': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:09,987 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:09,987 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:48076': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:10,092 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:10,096 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:48092': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:10,097 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:10,097 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:48102': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:10,202 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:10,206 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:48106': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:10,206 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:10,207 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:48118': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:10,312 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:10,316 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:48124': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:10,316 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:10,316 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:48136': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:10,422 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:10,426 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:48152': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:10,426 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:10,427 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:48164': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:10,532 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:10,536 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:48178': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:10,536 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:10,536 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:48190': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:10,641 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:10,646 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:48198': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:10,646 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:10,647 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:48202': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:10,751 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:10,755 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:48210': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:10,755 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:10,756 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:48216': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:10,861 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:10,865 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:48230': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:10,865 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:10,865 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:48244': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:10,971 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:10,975 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:48256': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:10,975 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:10,976 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:48270': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:11,081 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:11,085 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:48282': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:11,085 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:11,085 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:48286': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:11,191 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:11,195 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:48300': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:11,195 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:11,196 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:48304': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:11,301 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:11,305 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:48316': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:11,305 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:11,305 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:48328': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:11,410 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:11,415 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:48330': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:11,415 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:11,415 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:48344': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:11,520 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:11,525 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:48360': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:11,525 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:11,525 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:48364': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:11,630 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:11,634 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59628': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:11,635 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:11,635 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59630': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:11,741 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:11,745 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59638': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:11,746 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:11,746 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59650': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:11,850 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:11,854 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59652': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:11,854 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:11,855 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59662': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:11,959 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:11,964 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59672': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:11,964 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:11,964 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59678': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:12,069 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:12,073 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59682': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:12,074 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:12,074 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59684': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:12,179 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:12,183 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59700': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:12,183 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:12,184 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59716': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:12,288 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:12,293 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:12,293 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59718': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:12,293 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59730': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:12,400 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:12,404 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59734': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:12,404 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:12,405 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59750': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:12,509 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:12,514 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59752': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:12,514 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:12,514 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59764': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:12,619 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:12,623 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59766': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:12,624 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:12,624 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59772': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:12,729 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:12,733 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59780': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:12,733 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:12,733 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59794': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:12,838 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:12,842 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59808': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:12,842 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:12,843 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59810': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:12,948 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:12,952 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59814': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:12,952 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:12,952 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59822': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:13,057 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:13,061 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59828': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:13,062 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:13,062 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59838': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:13,167 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:13,171 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59846': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:13,172 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:13,172 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59854': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:13,277 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:13,281 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59856': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:13,281 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:13,282 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59872': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:13,387 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:13,392 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59888': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:13,392 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:13,396 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59894': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:13,497 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:13,502 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59906': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:13,502 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:13,502 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59918': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:13,604 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:13,609 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59934': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:13,610 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:13,610 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59946': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:13,712 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:13,717 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59958': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:13,718 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:13,718 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59962': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:13,820 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:13,824 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59978': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:13,825 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:13,825 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59992': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:13,927 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:13,932 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60008': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:13,932 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:13,932 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60014': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:14,034 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:14,041 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60024': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:14,041 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:14,041 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60026': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:14,141 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:14,141 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60042': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:14,148 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:14,148 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:14,248 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:14,249 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60062': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:14,255 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:14,255 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60070': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:14,356 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:14,356 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60074': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:14,362 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:14,362 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60078': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:14,463 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:14,463 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60094': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:14,470 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:14,470 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60110': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:14,570 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:14,570 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60124': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:14,577 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:14,577 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60128': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:14,677 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:14,677 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60136': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:14,684 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:14,684 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60152': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:14,784 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:14,785 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60168': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:14,791 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:14,791 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60178': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:14,892 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:14,896 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60182': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:14,902 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:14,902 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60198': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:14,999 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:14,999 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60204': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:15,009 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:15,010 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60208': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:15,106 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:15,107 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60218': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:15,116 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:15,117 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60220': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:15,214 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:15,215 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60236': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:15,223 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:15,224 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60246': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:15,322 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:15,322 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60250': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:15,330 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:15,331 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60254': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:15,429 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:15,429 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60268': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:15,437 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:15,438 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60270': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:15,536 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:15,536 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60280': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:15,544 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:15,545 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60296': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:15,644 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:15,644 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60302': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:15,651 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:15,651 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60304': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:15,751 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:15,751 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60320': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:15,758 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:15,758 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60332': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:15,858 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:15,858 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60340': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:15,865 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:15,865 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60342': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:15,966 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:15,966 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60352': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:15,972 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:15,973 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60368': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:16,073 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:16,073 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60376': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:16,079 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:16,079 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60378': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:16,180 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:16,181 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60386': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:16,187 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:16,187 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60388': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:16,288 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:16,288 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60390': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:16,294 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:16,294 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60396': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:16,398 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:16,403 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60410': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:16,404 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:16,404 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60418': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:16,505 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:16,510 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60424': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:16,511 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:16,511 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60430': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:16,613 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:16,617 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60438': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:16,618 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:16,618 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60446': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:16,720 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:16,725 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60458': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:16,725 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:16,725 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60464': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:16,827 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:16,832 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60476': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:16,832 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:16,832 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60482': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:16,935 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:16,940 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60490': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:16,940 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:16,941 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60506': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:17,042 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:17,047 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60518': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:17,047 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:17,048 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60534': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:17,149 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:17,154 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60548': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:17,154 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:17,155 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60552': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:17,256 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:17,261 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60564': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:17,262 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:17,262 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60578': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:17,364 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:17,369 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60594': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:17,369 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:17,369 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60604': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:17,471 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:17,476 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60614': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:17,477 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:17,477 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60616': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:17,578 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:17,583 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60618': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:17,584 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:17,584 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60620': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:17,686 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:17,691 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60622': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:17,691 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:17,691 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60628': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:17,795 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:17,799 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60644': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:17,800 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60660': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:17,800 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:17,904 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:17,908 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60676': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:17,909 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:17,909 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60682': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:18,012 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:18,016 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60686': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:18,017 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:18,017 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60690': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:18,121 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:18,125 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60696': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:18,126 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60710': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:18,126 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:18,230 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:18,234 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60716': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:18,234 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:18,234 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60732': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:18,338 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:18,343 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:18,343 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60734': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:18,344 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60750': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:18,448 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:18,452 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60760': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:18,452 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:18,453 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60776': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:18,559 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:18,563 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60784': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:18,563 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:18,564 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60794': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:18,669 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:18,673 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60810': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:18,673 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:18,673 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60820': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:18,778 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:18,781 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60832': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:18,782 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60840': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:18,782 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:18,886 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:18,890 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60846': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:18,891 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:18,896 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60848': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:18,995 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:18,999 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60858': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:18,999 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:18,999 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60864': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:19,103 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:19,107 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60870': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:19,108 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60882': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:19,108 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:19,212 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:19,216 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60890': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:19,216 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60900': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:19,216 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:19,320 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:19,324 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60902': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:19,325 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:19,325 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60918': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:19,429 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:19,433 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60926': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:19,434 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:19,434 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60936': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:19,538 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:19,542 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60948': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:19,542 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:19,543 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60954': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:19,646 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:19,651 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60958': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:19,651 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:19,651 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60974': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:19,755 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:19,759 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60978': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:19,759 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:19,759 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60980': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:19,863 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:19,867 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60996': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:19,868 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:32774': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:19,868 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:19,972 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:19,976 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:32788': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:19,977 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:19,977 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:32800': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:20,082 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:20,086 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:32802': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:20,087 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:20,087 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:32818': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:20,192 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:20,196 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:32820': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:20,196 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:20,197 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:32834': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:20,301 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:20,305 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:32842': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:20,306 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:20,306 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:32858': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:20,412 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:20,416 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:32874': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:20,416 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:20,417 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:32890': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:20,522 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:20,526 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:32898': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:20,526 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:20,527 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:32906': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:20,631 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:20,635 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:32920': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:20,636 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:20,636 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:32936': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:20,741 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:20,745 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:32952': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:20,745 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:20,746 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:32966': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:20,850 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:20,855 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:32970': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:20,855 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:20,855 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:32986': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:20,960 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:20,964 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:32996': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:20,964 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:20,965 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33002': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:21,069 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:21,074 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33014': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:21,074 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:21,074 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33020': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:21,179 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:21,183 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33030': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:21,183 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:21,184 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33044': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:21,289 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:21,293 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:21,293 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:21,294 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33068': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:21,399 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:21,403 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33072': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:21,403 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:21,403 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33088': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:21,508 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:21,513 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33104': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:21,513 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:21,513 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33112': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:21,618 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:21,622 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:57348': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:21,622 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:21,622 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:57354': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:21,727 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:21,731 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:57368': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:21,732 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:21,732 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:57382': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:21,837 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:21,841 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:57396': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:21,841 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:21,841 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:57400': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:21,946 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:21,951 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:57410': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:21,951 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:21,951 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:57418': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:22,056 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:22,060 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:57422': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:22,060 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:22,061 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:57428': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:22,166 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:22,171 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:57432': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:22,171 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:22,171 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:57436': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:22,276 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:22,280 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:57438': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:22,280 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:22,281 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:57440': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:22,385 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:22,390 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:57448': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:22,390 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:22,395 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:57462': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:22,495 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:22,499 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:57470': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:22,499 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:22,500 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:57472': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:22,605 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:22,609 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:57480': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:22,609 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:22,609 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:57490': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:22,714 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:22,718 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:57506': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:22,719 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:22,719 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:57522': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:22,824 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:22,828 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:57524': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:22,828 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:22,829 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:57534': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:22,933 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:22,937 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:57536': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:22,938 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:22,938 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:57542': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:23,042 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:23,047 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:57558': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:23,047 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:23,047 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:57568': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:23,151 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:23,155 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:57576': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:23,156 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:23,156 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:57580': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:23,261 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:23,265 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:57596': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:23,265 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:23,266 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:57608': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:23,370 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:23,375 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:57622': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:23,375 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:23,375 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:57632': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:23,483 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:23,486 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:57644': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4767s 2024-11-23 21:54:23,486 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4767s 2024-11-23 21:54:23,487 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:57646': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:23,593 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:23,597 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:57658': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:23,597 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:23,598 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:57668': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:23,703 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:23,707 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:57680': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:23,707 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:23,707 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:57690': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:23,812 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:23,816 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:57704': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:23,817 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:23,817 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:57716': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:23,923 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:23,927 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:57724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:23,927 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:23,928 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:57726': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:24,033 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:24,038 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:57732': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:24,039 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:24,039 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:57744': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:24,143 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:24,147 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:57760': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:24,147 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:24,148 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:57770': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:24,252 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:24,256 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:57782': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:24,257 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:24,257 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:57786': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:24,362 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:24,366 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:57798': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:24,366 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:24,367 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:57808': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:24,472 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:24,476 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:57820': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:24,476 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:24,477 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:57822': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:24,582 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:24,586 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:57836': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:24,586 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:24,587 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:57842': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:24,692 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:24,696 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:57850': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:24,696 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:24,697 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:57860': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:24,801 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:24,806 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:57872': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:24,806 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:24,807 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:57878': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:24,911 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:24,915 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:57892': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:24,916 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:24,916 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:57904': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:25,020 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:25,025 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:57920': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:25,025 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:25,026 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:57926': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:25,130 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:25,135 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:57938': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:25,135 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:25,135 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:57944': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:25,240 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:25,244 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:57954': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:25,245 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:25,245 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:57960': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:25,350 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:25,354 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:57970': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:25,354 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:25,355 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:57974': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:25,459 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:25,464 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:57976': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:25,464 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:25,465 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:57978': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:25,569 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:25,573 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:57982': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:25,573 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:25,574 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:57998': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:25,679 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:25,684 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:58014': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:25,684 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:25,685 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:58018': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:25,789 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:25,794 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:58020': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:25,794 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:25,794 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:58034': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:25,900 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:25,904 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:58046': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:25,905 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:25,905 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:58062': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:26,009 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:26,014 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:58076': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:26,014 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:26,015 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:58078': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:26,119 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:26,124 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:58082': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:26,124 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:26,124 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:58098': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:26,229 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:26,233 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:58108': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:26,234 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:26,234 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:58114': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:26,339 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:26,343 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:58120': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:26,344 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:26,344 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:58122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:26,449 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:26,453 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:58132': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:26,453 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:26,453 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:58140': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:26,558 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:26,562 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:58144': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:26,563 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:26,563 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:58148': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:26,668 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:26,672 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:58154': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:26,672 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:26,672 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:58162': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:26,777 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:26,781 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:58166': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:26,782 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:26,782 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:58178': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:26,886 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:26,891 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:26,891 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:58182': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:26,897 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:58192': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:26,996 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:27,000 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:58200': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:27,001 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:27,001 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:58214': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:27,105 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:27,110 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:58218': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:27,110 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:27,111 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:58224': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:27,214 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:27,219 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:58234': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:27,219 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:27,220 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:58242': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:27,324 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:27,328 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:58246': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:27,329 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:27,329 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:58262': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:27,434 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:27,439 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:58268': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:27,439 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:27,440 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:58274': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:27,544 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:27,548 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:58278': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:27,549 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:27,549 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:58280': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:27,654 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:27,658 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:58288': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:27,658 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:27,659 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:58294': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:27,763 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:27,767 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:58298': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:27,768 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:27,768 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:58304': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:27,872 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:27,877 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:58314': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:27,877 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:27,877 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:58328': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:27,982 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:27,986 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:58334': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:27,986 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:27,987 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:58348': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:28,092 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:28,096 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:58354': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:28,096 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:28,097 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:58360': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:28,201 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:28,205 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:58376': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:28,206 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:28,206 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:58384': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:28,311 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:28,315 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:58386': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:28,315 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:28,316 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:58396': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:28,422 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:28,426 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:58412': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:28,426 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:28,427 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:58416': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:28,531 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:28,535 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:58432': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:28,536 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:28,536 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:58436': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:28,640 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:28,645 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:58444': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:28,645 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:28,646 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:58458': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:28,750 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:28,754 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:58466': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:28,754 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:28,755 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:58476': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:28,860 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:28,864 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:58478': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:28,864 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:28,865 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:58486': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:28,969 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:28,974 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:58490': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:28,974 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:28,975 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:58506': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:29,079 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:29,083 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:58508': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:29,083 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:29,084 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:58514': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:29,189 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:29,196 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:58526': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:29,196 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:29,197 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:58532': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:29,298 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:29,303 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:58546': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:29,304 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:29,304 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:58558': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:29,408 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:29,412 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:58562': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:29,412 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:29,413 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:58564': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:29,517 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:29,522 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:58574': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:29,522 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:29,522 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:58590': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:29,627 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:29,631 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:58600': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:29,631 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:29,632 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:58610': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:29,737 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:29,740 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:58616': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:29,741 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:29,741 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:58632': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:29,846 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:29,850 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:58640': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:29,851 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:29,851 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:58650': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:29,956 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:29,960 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:58664': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:29,960 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:29,960 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:58676': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:30,066 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:30,070 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:58680': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:30,070 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:30,071 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:58690': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:30,177 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:30,181 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:58694': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:30,182 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:30,182 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:58696': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:30,287 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:30,291 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:58702': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:30,291 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:30,292 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:58708': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:30,399 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:30,402 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:58710': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:30,402 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:30,403 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:58712': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:30,508 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:30,513 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:58714': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:30,513 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:30,513 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:58722': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:30,618 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:30,622 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:58738': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:30,622 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:30,623 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:58744': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:30,727 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:30,732 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:58752': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:30,732 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:30,732 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:58766': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:30,836 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:30,841 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:58780': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:30,841 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:30,841 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:58794': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:30,947 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:30,951 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:58806': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:30,951 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:30,952 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:58810': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:31,056 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:31,061 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:58822': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:31,061 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:31,061 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:58828': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:31,166 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:31,170 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:58830': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:31,171 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:31,171 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:58834': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:31,275 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:31,280 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:58844': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:31,280 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:31,280 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:58858': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:31,385 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:31,389 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:31,389 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:58872': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:31,394 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:58882': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:31,494 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:31,498 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:58886': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:31,499 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:31,499 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:58902': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:31,603 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:31,608 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36854': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:31,608 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:31,608 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36860': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:31,713 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:31,717 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36862': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:31,717 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:31,718 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36872': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:31,822 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:31,827 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36886': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:31,827 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:31,827 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36892': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:31,931 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:31,936 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36902': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:31,936 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:31,936 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36904': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:32,041 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:32,045 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36914': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:32,045 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:32,046 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36928': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:32,150 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:32,154 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36938': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:32,154 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:32,155 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36946': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:32,260 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:32,264 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36958': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:32,264 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:32,265 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36968': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:32,369 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:32,374 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36970': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:32,374 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:32,374 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36972': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:32,479 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:32,483 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36986': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:32,483 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:32,484 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37002': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:32,588 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:32,593 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37014': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:32,593 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:32,594 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37020': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:32,699 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:32,703 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37022': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:32,704 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:32,704 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37038': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:32,809 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:32,813 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37054': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:32,813 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:32,814 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:32,918 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:32,922 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37064': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:32,923 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:32,923 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37074': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:33,027 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:33,032 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37076': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:33,032 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:33,033 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37084': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:33,137 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:33,142 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37094': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:33,142 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:33,143 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37098': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:33,247 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:33,251 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37108': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:33,252 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:33,252 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37118': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:33,359 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:33,363 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37132': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:33,364 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:33,364 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37138': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:33,469 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:33,473 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37154': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:33,473 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:33,474 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37160': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:33,579 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:33,583 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37164': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:33,583 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:33,583 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37168': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:33,688 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:33,693 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37174': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:33,693 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:33,694 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37184': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:33,798 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:33,802 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37188': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:33,803 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:33,803 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37200': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:33,908 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:33,912 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37202': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:33,913 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:33,913 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37206': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:34,018 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:34,022 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37208': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:34,023 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:34,023 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37218': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:34,128 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:34,132 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37220': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:34,132 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:34,133 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37230': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:34,238 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:34,242 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37238': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:34,242 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:34,243 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37248': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:34,348 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:34,353 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37262': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:34,354 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:34,354 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37270': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:34,458 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:34,462 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37284': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:34,463 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:34,463 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37292': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:34,568 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:34,572 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37304': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:34,573 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:34,573 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37314': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:34,678 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:34,682 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37326': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:34,683 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:34,683 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37342': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:34,788 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:34,792 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:34,792 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37354': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:34,793 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37358': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:34,899 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:34,903 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37370': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:34,904 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:34,904 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37374': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:35,009 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:35,013 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37376': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:35,013 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:35,014 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37386': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:35,119 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:35,123 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37396': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:35,123 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:35,124 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37410': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:35,229 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:35,233 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37418': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:35,233 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:35,234 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37426': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:35,338 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:35,343 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37434': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:35,343 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:35,343 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37444': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:35,448 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:35,453 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37446': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:35,453 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:35,453 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37460': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:35,558 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:35,562 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37466': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:35,563 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:35,563 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37480': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:35,668 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:35,672 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37490': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:35,673 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:35,673 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37504': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:35,778 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:35,782 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37518': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:35,782 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:35,783 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37526': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:35,888 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:35,892 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:35,892 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37528': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:35,897 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37534': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:35,997 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:36,002 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37546': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:36,002 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:36,002 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37554': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:36,107 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:36,111 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37556': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:36,111 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:36,112 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37558': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:36,217 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:36,222 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37572': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:36,222 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:36,223 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37578': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:36,327 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:36,331 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37582': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:36,332 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:36,332 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37588': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:36,437 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:36,441 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37594': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:36,441 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:36,442 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37600': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:36,547 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:36,551 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37610': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:36,551 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:36,551 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37616': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:36,656 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:36,661 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37618': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:36,661 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:36,661 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37622': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:36,767 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:36,771 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37632': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:36,771 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:36,771 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37636': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:36,876 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:36,881 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37650': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:36,881 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:36,881 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37662': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:36,986 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:36,991 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:36,991 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37668': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:36,991 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37670': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:37,096 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:37,100 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37686': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:37,101 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:37,101 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37692': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:37,206 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:37,210 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37704': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:37,210 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:37,211 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37714': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:37,316 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:37,320 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37720': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:37,320 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:37,321 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37732': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:37,425 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:37,430 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37738': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:37,430 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:37,430 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37740': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:37,535 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:37,540 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37752': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:37,540 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:37,541 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37758': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:37,645 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:37,649 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37770': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:37,650 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:37,650 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37784': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:37,755 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:37,759 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37800': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:37,759 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:37,760 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37814': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:37,865 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:37,869 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37826': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:37,869 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:37,870 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37836': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:37,976 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:37,980 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37842': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:37,980 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:37,981 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37854': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:38,086 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:38,090 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37868': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:38,090 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:38,091 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37876': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:38,196 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:38,200 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37878': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:38,200 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:38,201 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37880': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:38,307 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:38,311 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37894': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:38,311 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:38,312 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37908': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:38,416 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:38,421 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37914': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:38,421 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:38,421 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37922': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:38,526 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:38,530 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37936': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:38,530 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:38,531 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37950': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:38,635 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:38,640 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37966': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:38,640 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:38,641 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37978': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:38,745 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:38,749 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:38,749 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:38,750 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38000': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:38,855 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:38,859 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38008': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:38,859 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:38,860 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38012': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:38,964 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:38,968 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38014': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:38,969 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:38,969 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38016': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:39,074 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:39,078 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38026': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:39,078 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:39,078 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38042': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:39,183 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:39,187 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:39,187 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38044': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:39,188 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38054': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:39,292 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:39,297 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38056': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:39,297 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:39,298 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38062': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:39,402 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:39,406 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38064': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:39,406 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:39,407 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38068': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:39,511 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:39,516 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:39,517 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38094': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:39,518 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38084': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:39,621 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:39,625 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38106': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:39,625 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:39,626 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38112': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:39,731 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:39,735 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:39,736 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:39,736 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38124': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:39,840 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:39,845 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38138': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:39,845 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:39,845 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38144': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:39,950 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:39,954 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38158': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:39,954 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:39,955 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38160': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:40,059 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:40,064 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38162': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:40,064 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:40,064 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38174': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:40,169 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:40,173 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38186': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:40,174 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:40,174 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38198': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:40,279 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:40,283 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38212': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:40,283 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:40,284 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38218': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:40,389 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:40,397 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38222': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:40,397 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:40,398 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38238': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:40,499 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38250': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:40,499 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:40,505 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:40,506 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38262': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:40,609 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:40,613 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38276': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:40,613 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:40,614 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38284': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:40,718 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:40,723 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38298': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:40,723 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:40,723 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38308': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:40,828 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:40,832 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38318': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:40,832 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:40,833 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38330': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:40,937 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:40,942 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38332': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:40,942 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:40,942 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38346': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:41,047 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:41,051 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38358': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:41,052 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:41,052 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38372': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:41,157 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:41,161 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38388': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:41,161 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:41,162 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38396': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:41,266 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:41,271 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38410': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:41,271 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:41,271 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38418': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:41,376 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:41,380 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38424': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:41,380 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:41,381 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38432': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:41,486 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:41,491 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38444': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:41,491 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:41,492 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38458': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:41,596 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:41,600 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33566': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:41,600 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:41,601 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33578': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:41,706 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:41,710 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33586': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:41,710 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:41,711 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33596': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:41,815 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:41,819 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33602': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:41,820 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:41,820 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33610': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:41,925 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:41,929 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33618': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:41,929 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:41,930 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33630': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:42,034 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:42,039 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33646': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:42,039 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:42,039 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33652': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:42,144 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:42,148 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33666': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:42,149 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:42,149 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33672': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:42,254 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:42,258 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33680': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:42,258 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:42,258 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33686': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:42,363 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:42,367 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33694': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:42,368 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:42,368 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33698': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:42,473 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:42,477 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33704': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:42,477 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:42,478 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33710': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:42,582 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:42,586 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33716': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:42,587 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:42,587 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33718': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:42,692 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:42,696 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33722': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:42,696 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:42,697 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33728': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:42,801 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:42,806 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33732': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:42,806 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:42,806 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33746': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:42,911 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:42,915 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33758': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:42,915 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:42,915 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33768': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:43,021 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:43,025 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33780': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:43,025 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:43,025 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33788': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:43,130 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:43,135 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33790': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:43,135 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:43,135 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33804': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:43,243 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:43,247 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33820': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:43,247 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:43,247 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33830': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:43,353 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:43,357 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33846': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:43,358 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:43,358 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33862': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:43,463 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:43,467 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33874': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:43,467 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:43,468 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33890': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:43,573 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:43,577 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33896': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:43,577 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:43,578 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33910': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:43,683 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:43,687 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33916': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:43,687 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:43,688 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33920': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:43,792 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:43,797 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33926': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:43,797 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:43,798 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33928': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:43,902 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:43,906 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33940': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:43,906 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:43,907 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33948': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:44,011 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:44,016 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33956': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:44,016 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:44,016 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33968': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:44,121 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:44,125 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33982': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:44,126 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:44,126 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:33988': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:44,231 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:44,235 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34002': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:44,235 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:44,236 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34012': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:44,341 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:44,345 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34020': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:44,345 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:44,346 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34034': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:44,451 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:44,455 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34046': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:44,455 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:44,456 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34048': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:44,561 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:44,565 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:44,565 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:44,566 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34072': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:44,671 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:44,675 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:44,676 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34096': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:44,677 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34088': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:44,781 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:44,785 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34102': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:44,785 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:44,785 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34104': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:44,891 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:44,899 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34112': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:44,899 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:44,900 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34126': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:45,001 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:45,006 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34128': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:45,007 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:45,007 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34142': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:45,111 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:45,115 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34148': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:45,116 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:45,116 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34152': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:45,221 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:45,224 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34154': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:45,225 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34158': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:45,225 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:45,330 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:45,333 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34172': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:45,334 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34186': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:45,334 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:45,439 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:45,442 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34196': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:45,443 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34208': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:45,443 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:45,548 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:45,551 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34218': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:45,551 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34234': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:45,551 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:45,657 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:45,660 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34238': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:45,660 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34240': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:45,660 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:45,766 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:45,769 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34250': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:45,769 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34262': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:45,769 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:45,874 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:45,877 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34278': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:45,878 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34280': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:45,878 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:45,983 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:45,986 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34294': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:45,987 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:45,987 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34310': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:46,092 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:46,095 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34316': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:46,096 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34326': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:46,096 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:46,201 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:46,204 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34336': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:46,205 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34338': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:46,205 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:46,310 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:46,313 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34340': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:46,314 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34342': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:46,314 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:46,419 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:46,422 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34346': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:46,423 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34358': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:46,423 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:46,528 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:46,531 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34364': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:46,532 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34378': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:46,532 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:46,637 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:46,640 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34394': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:46,641 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34406': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:46,641 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:46,749 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:46,750 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34408': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:46,750 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34424': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:46,750 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:46,857 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:46,860 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34436': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:46,861 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34426': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:46,862 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:46,963 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:46,963 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34448': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:46,970 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34462': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:46,970 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:47,069 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34474': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:47,069 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:47,079 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34490': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:47,079 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:47,175 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34500': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:47,175 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:47,188 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34514': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:47,188 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:47,282 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34524': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:47,282 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:47,296 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34530': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:47,297 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:47,388 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:47,390 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34536': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:47,405 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34538': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:47,405 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:47,495 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34542': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:47,495 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:47,514 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34550': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:47,514 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:47,601 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34556': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:47,601 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:47,623 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34570': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:47,623 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:47,708 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34572': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:47,708 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:47,732 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34582': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:47,732 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:47,814 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34584': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:47,814 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:47,841 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34586': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:47,841 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:47,921 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:47,921 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34596': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:47,949 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34608': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:47,950 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:48,027 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34616': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:48,027 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:48,058 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34628': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:48,059 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:48,134 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34640': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:48,134 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:48,169 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34644': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:48,169 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:48,240 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34648': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:48,240 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:48,278 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34654': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:48,278 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:48,346 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34662': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:48,346 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:48,387 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34674': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:48,387 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:48,453 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34686': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:48,453 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:48,495 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34698': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:48,496 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:48,560 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34700': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:48,560 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:48,604 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34710': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:48,604 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:48,666 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34716': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:48,666 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:48,713 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34726': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:48,713 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:48,773 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34740': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:48,773 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:48,821 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34742': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:48,822 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:48,879 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34744': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:48,879 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:48,930 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34746': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:48,931 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:48,986 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34762': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:48,986 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:49,039 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34778': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:49,039 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:49,092 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34792': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:49,092 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:49,148 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:49,148 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:49,199 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34812': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:49,199 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:49,257 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34816': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:49,257 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:49,305 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34824': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:49,305 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:49,365 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34832': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:49,366 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:49,412 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34836': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:49,412 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:49,474 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34844': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:49,474 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:49,518 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34850': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:49,518 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:49,583 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34858': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:49,583 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:49,625 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34874': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:49,625 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:49,692 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34878': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:49,692 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:49,732 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34886': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:49,732 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:49,800 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34902': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:49,801 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:49,838 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34918': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:49,838 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:49,909 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34920': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:49,910 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:49,945 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34928': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:49,945 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:50,018 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34934': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:50,018 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:50,052 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34940': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:50,052 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:50,127 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34950': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:50,127 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:50,160 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34958': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:50,160 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:50,236 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34968': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:50,236 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:50,266 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34970': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:50,266 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:50,345 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34980': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:50,345 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:50,373 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:50,373 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34982': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:50,454 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:50,454 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:50,479 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:34996': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:50,479 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:50,562 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35002': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:50,563 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:50,586 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35018': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:50,586 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:50,672 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35022': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:50,672 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:50,693 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35028': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:50,693 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:50,781 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35044': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:50,781 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:50,800 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35046': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:50,800 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:50,891 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:50,892 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35050': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:50,907 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35060': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:50,907 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:50,999 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35066': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:51,000 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:51,013 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35080': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:51,013 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:51,108 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:51,108 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35088': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:51,119 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35094': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:51,119 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:51,215 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35100': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:51,215 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:51,226 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:51,226 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35102': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:51,321 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:51,321 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35114': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:51,332 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35124': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:51,332 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:51,427 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35128': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:51,427 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:51,438 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:35132': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:51,438 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:51,533 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56048': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:51,533 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:51,545 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56054': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:51,545 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:51,640 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56062': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:51,640 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:51,651 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:51,651 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56068': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:51,746 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56072': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:51,746 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:51,757 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:51,757 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56086': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:51,852 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56090': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:51,852 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:51,864 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56092': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:51,864 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:51,959 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56106': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:51,959 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:51,970 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56110': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:51,970 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:52,065 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56126': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:52,065 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:52,076 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56130': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:52,076 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:52,171 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56144': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:52,171 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:52,182 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56146': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:52,182 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:52,278 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56162': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:52,278 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:52,289 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56168': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:52,289 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:52,384 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56180': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:52,384 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:52,395 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:52,395 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56182': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:52,490 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56196': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:52,490 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:52,501 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56210': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:52,501 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:52,597 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56224': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:52,597 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:52,607 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56240': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:52,607 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:52,703 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56242': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:52,703 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:52,714 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56254': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:52,714 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:52,810 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56266': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:52,810 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:52,821 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56278': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:52,821 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:52,917 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56294': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:52,917 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:52,927 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:52,927 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56296': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:53,025 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56300': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:53,025 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:53,033 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56306': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:53,033 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:53,131 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56308': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:53,131 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:53,140 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56314': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:53,140 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:53,238 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56320': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:53,238 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:53,246 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56336': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:53,246 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:53,344 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56346': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:53,344 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:53,352 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56362': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:53,352 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:53,450 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56366': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:53,450 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:53,459 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56368': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:53,459 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:53,556 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56374': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:53,556 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:53,566 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56378': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:53,566 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:53,662 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56386': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:53,662 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:53,672 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56398': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:53,672 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:53,769 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56408': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:53,769 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:53,778 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56422': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:53,778 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:53,875 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56434': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:53,875 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:53,884 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56440': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:53,884 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:53,982 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56452': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:53,982 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:53,990 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56456': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:53,990 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:54,088 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56466': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:54,088 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:54,096 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56478': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:54,096 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:54,194 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56480': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:54,194 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:54,202 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56494': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:54,202 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:54,301 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56508': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:54,301 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:54,307 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56522': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:54,307 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:54,407 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56526': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:54,407 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:54,413 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56538': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:54,413 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:54,516 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:54,519 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56550': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:54,521 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56560': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:54,522 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:54,622 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56574': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:54,622 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:54,628 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56578': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:54,628 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:54,729 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56586': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:54,729 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:54,735 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56596': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:54,735 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:54,835 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56600': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:54,835 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:54,840 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56606': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:54,840 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:54,942 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:54,946 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56618': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:54,946 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56626': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:54,946 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:55,048 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:55,052 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56642': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:55,052 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56656': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:55,052 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:55,154 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:55,158 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56664': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:55,158 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56672': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:55,158 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:55,261 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:55,265 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56686': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:55,266 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56700': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:55,266 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:55,367 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56702': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:55,367 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:55,372 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56708': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:55,372 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:55,473 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56714': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:55,473 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:55,478 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56730': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:55,478 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:55,579 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:55,583 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56738': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:55,584 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56752': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:55,584 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:55,686 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:55,690 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56766': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:55,690 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56782': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:55,690 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:55,792 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:55,796 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56784': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:55,796 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:55,796 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:55,898 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:55,902 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56808': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:55,902 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56820': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:55,902 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:56,005 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:56,008 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56836': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:56,009 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56842': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:56,009 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:56,111 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:56,115 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56854': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:56,115 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56870': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:56,115 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:56,217 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:56,221 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56886': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:56,221 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56902': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:56,221 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:56,323 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:56,327 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56908': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:56,328 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56918': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:56,328 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:56,430 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:56,433 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56920': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:56,434 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56932': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:56,434 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:56,536 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:56,540 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56942': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:56,540 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56952': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:56,540 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:56,642 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:56,646 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56956': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:56,647 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56962': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:56,647 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:56,749 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:56,752 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56974': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:56,753 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56986': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:56,753 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:56,855 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:56,858 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56988': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:56,859 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:56992': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:56,859 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:56,961 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:56,966 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:57008': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:56,966 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:57018': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:56,966 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:57,068 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:57,068 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:57030': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:57,073 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:57046': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:57,073 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:57,174 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:57062': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:57,174 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:57,179 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:57064': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:57,179 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:57,281 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:57,284 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:57076': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:57,285 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:57078': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:57,285 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:57,386 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:57088': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:57,387 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:57,391 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:57,393 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:57100': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:57,493 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:57106': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:57,493 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:57,498 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:57112': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:57,499 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:57,599 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:57124': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:57,599 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:57,605 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:57132': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:57,605 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:57,705 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:57146': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:57,705 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:57,711 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:57162': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:57,711 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:57,812 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:57,816 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:57176': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:57,817 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:57180': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:57,817 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:57,919 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:57,922 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:57192': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:57,923 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:57202': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:57,923 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:58,026 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:58,029 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:57212': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:58,030 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:57218': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:58,030 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:58,132 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:58,135 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:57224': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:58,136 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:57234': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:58,136 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:58,239 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:58,242 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:57246': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:58,243 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:57258': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:58,243 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:58,345 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:58,348 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:57268': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:58,349 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:57274': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:58,349 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:58,451 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:58,455 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:57286': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:58,456 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:58,456 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:57298': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:58,558 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:58,561 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:57300': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:58,562 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:57308': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:58,562 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:58,665 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:58,669 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:57316': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:58,670 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:57332': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:58,670 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:58,771 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:57348': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:58,771 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:58,776 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:57358': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:58,776 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:58,878 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:57366': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:58,878 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:58,882 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:57378': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:58,882 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:58,984 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:58,988 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:57380': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:58,988 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:57388': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:58,988 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:59,090 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:59,094 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:57396': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:59,095 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:57412': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:59,095 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:59,197 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:59,201 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:57414': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:59,201 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:57420': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:59,201 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:59,304 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:59,307 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:57424': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:59,308 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:57432': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:59,308 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:59,410 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:59,414 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:57434': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:59,414 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:59,414 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:57442': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:59,517 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:59,520 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:57446': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:59,521 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:57456': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:59,521 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:59,623 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:59,627 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:57462': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:59,627 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:59,628 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:57472': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:59,730 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:59,733 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:57484': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:59,734 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:57486': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:59,734 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:59,837 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:59,840 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:57492': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:59,841 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:57508': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:59,841 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:59,943 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:54:59,947 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:57514': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:59,947 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:57524': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:54:59,947 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:00,050 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:00,053 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:57530': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:00,054 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:57542': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:00,054 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:00,156 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:00,159 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:57558': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:00,160 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:57566': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:00,160 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:00,262 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:00,266 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:57576': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:00,266 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:57580': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:00,266 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:00,368 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:00,373 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:57592': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:00,373 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:57600': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:00,373 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:00,475 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:57614': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:00,475 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:00,480 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:57620': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:00,480 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:00,581 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:57622': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:00,581 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:00,586 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:57630': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:00,586 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:00,687 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:00,687 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:57634': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:00,692 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:57640': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:00,692 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:00,794 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:57646': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:00,794 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:00,798 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:57652': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:00,798 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:00,900 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:57662': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:00,900 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:00,905 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:00,905 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:57670': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:01,006 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:57678': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:01,006 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:01,011 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:57680': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:01,011 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:01,112 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:01,116 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:57690': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:01,117 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:57706': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:01,117 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:01,219 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:01,222 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:57722': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:01,223 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:57730': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:01,223 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:01,325 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:01,329 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:57738': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:01,329 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:01,330 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:57752': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:01,432 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:01,435 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:57758': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:01,436 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:57764': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:01,436 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:01,538 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:01,542 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36560': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:01,542 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36576': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:01,542 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:01,644 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:01,648 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36578': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:01,648 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36580': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:01,648 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:01,751 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:01,754 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36592': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:01,755 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36604': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:01,755 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:01,857 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:01,861 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36610': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:01,861 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36612': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:01,861 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:01,963 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:01,967 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36614': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:01,967 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36622': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:01,967 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:02,070 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:02,074 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36628': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:02,075 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36634': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:02,075 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:02,176 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36646': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:02,176 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:02,181 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:02,181 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36654': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:02,283 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:02,283 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36656': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:02,288 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36662': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:02,288 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:02,389 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:02,395 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36666': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:02,396 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36682': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:02,396 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:02,495 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36684': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:02,496 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:02,501 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36686': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:02,501 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:02,603 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:02,603 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36698': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:02,607 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36706': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:02,607 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:02,709 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:02,713 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36718': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:02,713 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:02,713 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:02,815 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:02,819 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36726': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:02,819 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36736': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:02,819 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:02,922 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:02,925 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36746': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:02,926 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36760': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:02,926 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:03,028 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:03,031 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36774': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:03,032 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36784': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:03,032 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:03,134 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:03,138 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36786': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:03,138 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36800': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:03,138 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:03,241 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:03,244 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36816': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:03,245 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36820': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:03,245 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:03,347 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:03,350 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36828': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:03,351 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36842': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:03,351 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:03,453 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:03,457 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36844': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:03,457 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36854': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:03,457 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:03,559 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:03,563 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36870': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:03,564 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36876': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:03,564 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:03,666 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:03,669 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36882': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:03,670 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:03,670 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36886': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:03,772 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:03,777 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36896': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:03,777 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36908': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:03,777 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:03,878 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36922': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:03,878 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:03,883 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36936': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:03,883 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:03,985 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:03,989 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36938': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:03,989 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36946': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:03,989 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:04,091 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:04,095 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36952': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:04,095 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36966': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:04,095 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:04,197 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:04,201 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36974': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:04,201 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36978': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:04,201 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:04,303 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:04,307 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36988': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:04,307 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:36998': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:04,307 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:04,409 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:04,413 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37014': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:04,414 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37024': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:04,414 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:04,516 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:04,519 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37032': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:04,520 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37046': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:04,520 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:04,622 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:04,625 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37050': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:04,626 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37060': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:04,626 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:04,728 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:04,732 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37062': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:04,732 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37072': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:04,732 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:04,834 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:04,838 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37084': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:04,839 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37086': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:04,839 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:04,941 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:04,945 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37098': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:04,945 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:04,945 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37102': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:05,047 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:05,051 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37104': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:05,051 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37114': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:05,051 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:05,154 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:05,157 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37124': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:05,158 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37138': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:05,158 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:05,260 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:05,263 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37152': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:05,264 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37164': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:05,264 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:05,366 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:05,369 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37180': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:05,370 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37192': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:05,370 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:05,472 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:05,476 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37196': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:05,477 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37200': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:05,477 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:05,578 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:05,582 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37210': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:05,583 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37226': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:05,583 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:05,684 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37232': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:05,685 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:05,689 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37248': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:05,689 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:05,791 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:05,795 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37254': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:05,795 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37268': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:05,795 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:05,897 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:05,901 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:05,901 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37270': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:05,902 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37284': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:06,003 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:06,007 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37290': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:06,008 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37298': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:06,008 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:06,110 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:06,113 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37310': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:06,114 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37324': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:06,114 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:06,216 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:06,220 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37340': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:06,220 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37346': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:06,220 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:06,322 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:06,326 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37358': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:06,326 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37368': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:06,326 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:06,428 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:06,432 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37384': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:06,432 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37390': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:06,432 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:06,535 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:06,538 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37398': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:06,539 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37414': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:06,539 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:06,641 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:06,645 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37428': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:06,645 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37432': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:06,645 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:06,747 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:06,751 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37434': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:06,751 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37440': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:06,751 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:06,853 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:06,857 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37456': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:06,858 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37466': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:06,858 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:06,960 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:06,963 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37474': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:06,964 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37482': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:06,964 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:07,066 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37498': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:07,066 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:07,071 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37502': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:07,071 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:07,173 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37518': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:07,173 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:07,178 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:07,178 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37520': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:07,279 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37530': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:07,279 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:07,285 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37546': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:07,285 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:07,386 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:07,390 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37548': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:07,391 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:07,393 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37554': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:07,493 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:07,496 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37556': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:07,497 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37570': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:07,497 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:07,599 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:07,603 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37574': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:07,603 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37590': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:07,603 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:07,706 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:07,709 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37594': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:07,710 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37598': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:07,710 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:07,812 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:07,815 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37612': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:07,816 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37616': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:07,816 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:07,918 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:07,922 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37628': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:07,923 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37636': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:07,923 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:08,025 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:08,028 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37650': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:08,029 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37666': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:08,029 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:08,131 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:08,135 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37682': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:08,135 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37686': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:08,135 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:08,238 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:08,241 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37692': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:08,242 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37700': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:08,242 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:08,344 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:08,347 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37716': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:08,348 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37732': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:08,348 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:08,450 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:08,454 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37748': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:08,454 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37754': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:08,454 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:08,557 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:08,560 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37770': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:08,561 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37786': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:08,561 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:08,663 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:08,667 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37790': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:08,667 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37800': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:08,667 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:08,770 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:08,773 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37810': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:08,774 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37820': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:08,774 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:08,876 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:08,880 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37834': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:08,881 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37848': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:08,881 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:08,982 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:08,986 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37864': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:08,987 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37870': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:08,987 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:09,089 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:09,092 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37880': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:09,093 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37896': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:09,093 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:09,195 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:09,199 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37908': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:09,199 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37916': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:09,199 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:09,302 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:09,305 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37928': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:09,306 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37940': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:09,306 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:09,408 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:09,411 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37946': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:09,412 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37950': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:09,412 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:09,514 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:09,518 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37964': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:09,518 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37980': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:09,518 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:09,620 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:09,624 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:37988': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:09,625 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38002': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:09,625 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:09,727 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:09,730 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38016': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:09,731 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38026': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:09,731 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:09,834 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:09,837 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38036': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:09,838 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38052': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:09,838 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:09,940 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:09,944 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38056': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:09,944 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38068': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:09,944 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:10,047 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:10,050 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38070': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:10,051 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38074': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:10,051 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:10,153 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:10,156 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38086': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:10,157 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38094': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:10,157 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:10,259 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:10,263 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38108': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:10,263 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38118': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:10,263 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:10,365 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:10,369 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38130': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:10,369 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38146': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:10,370 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:10,472 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:10,475 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38148': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:10,476 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38160': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:10,476 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:10,578 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:10,582 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38176': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:10,583 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38188': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:10,583 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:10,684 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38204': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:10,684 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:10,689 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38210': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:10,689 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:10,790 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38220': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:10,790 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:10,795 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38226': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:10,795 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:10,896 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38236': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:10,896 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:10,901 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38240': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:10,901 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:11,003 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:11,007 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38242': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:11,007 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38250': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:11,007 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:11,109 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:11,113 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38258': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:11,113 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38270': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:11,113 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:11,215 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:11,219 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38284': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:11,219 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38292': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:11,219 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:11,321 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:11,325 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38308': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:11,326 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38312': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:11,326 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:11,428 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:11,431 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38320': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:11,432 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38322': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:11,432 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:11,534 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:11,537 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40972': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:11,538 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40980': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:11,538 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:11,640 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:11,644 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40994': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:11,644 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41010': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:11,644 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:11,746 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:11,749 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41022': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:11,750 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41026': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:11,750 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:11,852 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:11,856 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41036': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:11,857 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41052': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:11,857 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:11,958 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:11,962 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:11,963 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41064': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:11,963 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:12,065 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:12,068 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41080': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:12,069 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41096': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:12,069 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:12,171 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:12,175 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41106': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:12,176 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41118': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:12,176 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:12,278 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:12,282 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41120': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:12,283 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41134': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:12,283 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:12,384 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41144': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:12,384 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:12,389 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:12,390 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41160': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:12,490 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41164': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:12,490 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:12,495 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:12,495 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41178': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:12,596 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41194': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:12,596 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:12,601 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:12,601 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41198': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:12,703 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41212': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:12,703 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:12,707 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41218': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:12,707 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:12,809 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41226': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:12,809 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:12,813 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41230': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:12,813 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:12,915 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41242': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:12,915 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:12,919 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41246': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:12,919 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:13,021 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:13,025 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41262': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:13,025 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41266': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:13,025 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:13,127 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41282': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:13,127 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:13,132 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41294': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:13,132 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:13,233 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41306': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:13,233 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:13,238 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41322': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:13,238 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:13,339 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41336': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:13,339 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:13,344 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41340': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:13,344 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:13,445 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:13,449 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41348': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:13,450 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41352': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:13,450 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:13,551 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:13,555 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41354': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:13,555 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41368': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:13,555 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:13,658 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:13,661 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41376': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:13,662 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41378': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:13,662 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:13,764 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:13,767 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41380': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:13,768 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41390': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:13,768 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:13,870 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:13,874 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41404': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:13,874 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41406': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:13,874 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:13,976 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:13,980 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41422': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:13,981 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41426': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:13,981 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:14,082 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:14,082 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41434': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:14,087 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:14,087 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41446': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:14,188 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:14,192 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41456': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:14,193 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:14,193 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41462': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:14,294 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:14,300 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41468': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:14,300 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41478': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:14,300 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:14,400 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41480': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:14,400 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:14,406 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41486': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:14,406 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:14,507 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41492': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:14,507 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:14,512 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41504': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:14,512 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:14,613 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:14,613 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41508': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:14,618 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41514': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:14,618 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:14,719 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:14,719 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41526': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:14,724 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41532': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:14,724 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:14,826 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:14,829 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41536': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:14,830 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41552': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:14,830 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:14,933 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:14,936 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41556': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:14,937 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41564': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:14,937 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:15,039 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:15,042 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41576': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:15,043 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41578': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:15,043 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:15,145 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:15,149 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41582': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:15,149 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41592': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:15,149 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:15,251 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:15,255 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41594': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:15,255 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41602': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:15,255 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:15,358 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:15,361 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41606': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:15,362 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41614': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:15,362 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:15,464 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:15,467 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41630': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:15,468 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41636': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:15,468 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:15,570 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:15,574 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41650': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:15,574 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41658': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:15,574 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:15,677 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:15,681 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41670': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:15,682 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41684': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:15,682 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:15,783 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41686': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:15,783 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:15,788 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41690': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:15,788 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:15,890 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:15,895 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41700': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:15,896 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41708': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:15,896 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:15,996 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41720': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:15,996 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:16,002 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41726': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:16,002 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:16,103 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41730': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:16,103 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:16,109 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41732': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:16,109 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:16,209 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41748': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:16,209 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:16,215 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41750': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:16,215 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:16,315 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41758': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:16,315 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:16,321 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41764': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:16,321 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:16,422 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41780': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:16,422 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:16,427 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41792': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:16,427 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:16,528 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41806': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:16,528 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:16,533 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41818': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:16,533 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:16,635 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41830': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:16,635 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:16,640 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41842': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:16,640 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:16,741 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41856': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:16,741 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:16,746 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41858': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:16,746 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:16,848 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:16,848 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41872': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:16,853 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41886': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:16,853 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:16,955 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:16,958 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41888': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:16,959 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41902': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:16,959 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:17,061 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:17,065 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41910': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:17,065 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41918': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:17,065 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:17,167 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:17,171 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41928': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:17,172 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41932': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:17,172 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:17,274 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:17,277 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41938': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:17,278 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41950': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:17,278 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:17,380 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:17,384 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41956': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:17,385 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41966': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:17,385 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:17,486 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41968': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:17,487 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:17,491 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41974': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:17,491 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:17,593 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41976': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:17,593 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:17,597 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41980': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:17,597 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:17,699 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41988': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:17,699 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:17,704 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:41994': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:17,704 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:17,805 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42002': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:17,805 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:17,810 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42014': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:17,810 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:17,911 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:17,915 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42024': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:17,916 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42030': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:17,916 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:18,018 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:18,021 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42038': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:18,022 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42052': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:18,022 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:18,124 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:18,127 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:18,128 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42074': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:18,128 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:18,230 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:18,233 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42088': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:18,234 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42094': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:18,234 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:18,336 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:18,340 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42096': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:18,340 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42104': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:18,340 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:18,443 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:18,446 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42110': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:18,447 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42114': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:18,447 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:18,549 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:18,552 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:18,553 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42132': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:18,553 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:18,655 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:18,658 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42144': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:18,659 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42150': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:18,659 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:18,761 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:18,765 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42164': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:18,765 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42168': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:18,765 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:18,867 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:18,871 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42176': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:18,871 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42184': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:18,871 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:18,973 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:18,977 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42194': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:18,978 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42200': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:18,978 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:19,080 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:19,084 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42216': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:19,084 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42232': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:19,085 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:19,185 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:19,186 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42248': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:19,191 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42258': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:19,191 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:19,292 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:19,292 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42260': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:19,297 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42268': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:19,297 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:19,398 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42284': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:19,398 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:19,403 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42298': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:19,403 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:19,504 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42304': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:19,504 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:19,509 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42308': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:19,509 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:19,610 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42314': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:19,610 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:19,615 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:19,615 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42318': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:19,716 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42332': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:19,716 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:19,721 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42334': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:19,721 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:19,822 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42338': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:19,822 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:19,827 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42352': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:19,827 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:19,929 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42364': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:19,929 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:19,933 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42366': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:19,934 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:20,035 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:20,035 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42378': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:20,040 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42392': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:20,040 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:20,141 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:20,141 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42400': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:20,146 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42416': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:20,146 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:20,247 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:20,247 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42418': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:20,252 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42434': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:20,252 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:20,353 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42442': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:20,353 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:20,358 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42454': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:20,358 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:20,459 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42468': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:20,459 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:20,464 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42480': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:20,464 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:20,565 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42496': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:20,565 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:20,571 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42508': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:20,571 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:20,671 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42510': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:20,671 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:20,677 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42524': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:20,677 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:20,777 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42532': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:20,777 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:20,784 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42544': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:20,784 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:20,884 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42550': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:20,884 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:20,890 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:20,892 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42558': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:20,990 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42574': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:20,990 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:20,996 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42586': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:20,996 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:21,096 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:21,096 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42598': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:21,102 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42610': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:21,102 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:21,202 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42622': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:21,202 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:21,208 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42624': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:21,208 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:21,308 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42638': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:21,308 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:21,314 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42642': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:21,314 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:21,414 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42654': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:21,414 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:21,422 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42660': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:21,422 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:21,521 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42662': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:21,521 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:21,528 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:42672': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:21,528 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:21,627 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:58776': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:21,627 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:21,634 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:58784': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:21,634 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:21,734 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:58796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:21,734 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:21,740 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:58812': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:21,740 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:21,840 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:21,840 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:58818': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:21,846 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:58820': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:21,846 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:21,947 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:58824': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:21,947 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:21,952 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:58828': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:21,952 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:22,053 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:22,053 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:58840': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:22,058 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:58844': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:22,058 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:22,159 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:22,159 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:58846': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:22,164 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:58856': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:22,164 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:22,265 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:58862': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:22,265 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:22,270 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:58870': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:22,270 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:22,372 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:22,375 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:58886': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:22,376 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:58900': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:22,376 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:22,478 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:22,482 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:58910': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:22,483 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:58916': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:22,483 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:22,584 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:58920': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:22,584 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:22,589 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:58934': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:22,589 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:22,690 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:58944': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:22,690 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:22,695 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:22,695 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:58950': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:22,796 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:22,800 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:58964': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:22,801 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:58978': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:22,801 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:22,903 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:22,906 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:58994': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:22,907 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59006': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:22,907 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:23,009 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:23,012 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59012': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:23,013 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59014': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:23,013 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:23,115 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:23,118 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59018': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:23,119 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59020': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:23,119 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:23,221 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:23,225 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59034': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:23,226 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59048': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:23,226 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:23,328 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:23,331 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59050': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:23,332 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59052': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:23,332 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:23,434 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:23,438 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59064': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:23,438 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59080': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:23,438 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:23,541 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:23,544 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59094': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:23,545 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59104': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:23,545 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:23,647 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:23,650 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59112': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:23,651 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59128': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:23,651 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:23,753 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:23,757 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59140': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:23,757 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59150': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:23,757 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:23,859 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:23,863 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59158': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:23,864 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59170': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:23,864 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:23,966 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:23,969 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59178': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:23,970 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59184': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:23,970 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:24,074 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:24,077 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59198': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:24,078 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59202': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:24,078 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:24,180 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:24,184 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59216': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:24,185 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59226': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:24,185 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:24,287 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:24,291 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59230': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:24,291 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59242': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:24,291 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:24,396 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:24,400 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59256': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:24,400 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59270': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:24,400 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:24,503 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:24,506 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59278': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:24,507 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59280': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:24,507 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:24,609 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:24,613 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59292': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:24,613 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59306': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:24,613 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:24,716 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:24,719 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59314': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:24,720 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59328': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:24,720 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:24,822 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:24,826 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59342': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:24,827 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59346': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:24,827 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:24,929 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:24,932 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59350': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:24,933 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59360': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:24,933 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:25,035 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:25,039 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59372': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:25,039 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59382': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:25,039 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:25,141 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:25,145 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59386': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:25,146 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59400': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:25,146 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:25,248 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:25,251 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59410': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:25,252 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59418': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:25,252 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:25,354 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:25,358 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59428': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:25,358 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59432': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:25,358 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:25,460 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:25,464 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59446': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:25,464 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59448': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:25,464 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:25,566 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:25,570 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59452': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:25,571 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59462': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:25,571 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:25,673 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:25,676 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59472': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:25,677 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59482': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:25,677 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:25,779 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:25,782 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59496': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:25,783 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59510': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:25,783 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:25,885 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:25,889 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59514': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:25,890 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:25,892 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59522': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:25,991 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:25,995 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59526': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:25,996 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59540': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:25,996 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:26,098 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:26,101 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59546': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:26,102 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59562': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:26,102 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:26,204 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59564': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:26,204 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:26,251 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59578': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:26,251 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:26,310 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59584': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:26,310 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:26,357 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59592': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:26,357 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:26,416 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59600': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:26,416 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:26,463 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59604': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:26,463 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:26,563 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59616': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:26,563 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:26,570 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59620': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:26,570 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:26,669 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59624': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:26,669 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:26,676 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59638': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:26,676 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:26,775 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59644': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:26,775 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:26,781 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59656': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:26,781 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:26,881 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59666': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:26,882 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:26,887 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:26,887 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59680': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:26,988 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59686': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:26,988 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:26,993 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59698': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:26,993 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:27,094 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59702': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:27,094 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:27,099 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59708': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:27,099 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:27,200 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59710': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:27,200 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:27,205 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59714': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:27,205 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:27,306 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:27,306 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:27,312 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59734': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:27,312 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:27,412 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59750': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:27,412 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:27,418 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59756': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:27,418 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:27,518 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59760': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:27,518 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:27,524 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59766': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:27,524 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:27,624 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59778': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:27,624 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:27,631 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59788': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:27,631 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:27,731 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59802': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:27,731 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:27,737 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59812': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:27,737 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:27,837 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59822': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:27,837 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:27,843 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59824': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:27,843 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:27,942 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59834': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:27,942 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:27,949 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59838': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:27,949 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:28,049 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59850': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:28,049 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:28,055 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59862': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:28,055 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:28,155 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59866': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:28,155 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:28,161 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59882': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:28,161 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:28,261 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59884': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:28,261 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:28,267 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59898': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:28,267 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:28,367 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59908': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:28,367 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:28,373 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59922': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:28,373 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:28,473 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59924': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:28,473 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:28,480 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59930': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:28,480 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:28,579 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59942': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:28,579 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:28,586 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59946': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:28,586 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:28,685 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59952': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:28,685 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:28,692 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59964': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:28,692 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:28,791 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59966': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:28,791 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:28,798 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59978': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:28,798 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:28,897 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59982': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:28,897 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:28,904 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:59986': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:28,904 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:29,003 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60000': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:29,003 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:29,010 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60012': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:29,010 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:29,129 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:29,129 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60014': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:29,134 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60024': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:29,134 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:29,235 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60026': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:29,236 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:29,240 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60042': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:29,240 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:29,342 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:29,347 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60056': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:29,347 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60066': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:29,347 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:29,448 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60068': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:29,448 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:29,453 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60070': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:29,453 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:29,555 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:29,559 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60084': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:29,559 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60094': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:29,559 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:29,661 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:29,665 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60098': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:29,665 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60114': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:29,666 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:29,768 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60118': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:29,768 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:29,774 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60124': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:29,774 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:29,874 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60140': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:29,874 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:29,880 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60146': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:29,880 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:29,980 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60154': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:29,981 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:29,986 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60156': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:29,986 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:30,088 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:30,091 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60168': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:30,092 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60176': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:30,092 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:30,194 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:30,198 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60182': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:30,198 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60198': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:30,198 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:30,300 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:30,304 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60200': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:30,304 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60204': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:30,304 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:30,407 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:30,410 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60216': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:30,411 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60228': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:30,411 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:30,513 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:30,516 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60230': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:30,517 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60236': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:30,517 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:30,619 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:30,623 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60238': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:30,624 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60250': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:30,624 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:30,726 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:30,729 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60258': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:30,730 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60266': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:30,730 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:30,832 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:30,836 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60278': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:30,836 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60292': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:30,836 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:30,939 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:30,942 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60300': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:30,943 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60316': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:30,943 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:31,045 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:31,050 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60322': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:31,050 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60338': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:31,050 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:31,151 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60354': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:31,151 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:31,156 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60358': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:31,156 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:31,258 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:31,261 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60368': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:31,262 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60382': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:31,262 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:31,364 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:31,368 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60394': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:31,368 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60408': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:31,368 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:31,470 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:31,474 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60416': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:31,474 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:60420': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:31,475 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:31,577 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:31,580 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:46512': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:31,581 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:46522': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:31,581 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:31,683 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:31,687 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:46534': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:31,687 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:46544': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:31,687 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:31,789 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:31,793 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:46558': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:31,793 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:46560': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:31,793 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:31,895 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:31,899 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:46570': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:31,900 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:46574': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:31,900 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:32,001 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:32,005 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:46582': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:32,006 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:46588': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:32,006 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:32,108 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:32,111 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:46604': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:32,112 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:46614': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:32,112 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:32,214 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:32,218 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:46630': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:32,218 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:46642': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:32,218 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:32,321 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:32,324 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:46656': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:32,325 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:46672': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:32,325 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:32,427 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:32,431 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:46678': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:32,431 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:46694': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:32,431 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:32,534 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:32,537 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:46708': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:32,538 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:46712': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:32,538 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:32,640 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:32,644 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:46726': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:32,645 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:46738': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:32,645 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:32,747 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:32,751 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:46740': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:32,752 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:46754': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:32,752 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:32,853 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:46758': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:32,853 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:32,858 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:46770': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:32,858 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:32,960 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:32,963 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:46772': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:32,964 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:46778': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:32,964 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:33,066 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:33,070 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:46782': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:33,070 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:46798': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:33,070 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:33,172 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:33,176 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:46814': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:33,177 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:46828': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:33,177 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:33,279 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:33,282 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:46834': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:33,283 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:46850': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:33,283 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:33,385 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:33,389 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:46862': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:33,389 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:33,391 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:46878': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:33,491 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:33,495 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:46894': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:33,496 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:46898': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:33,496 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:33,598 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:33,601 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:46912': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:33,602 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:46926': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:33,602 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:33,704 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:33,708 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:46942': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:33,708 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:46950': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:33,708 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:33,810 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:33,814 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:46964': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:33,814 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:46972': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:33,814 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:33,917 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:33,920 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:46980': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:33,921 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:46990': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:33,922 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:34,023 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:34,027 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47004': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:34,028 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47014': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:34,028 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:34,130 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47024': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:34,149 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:34,156 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47028': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:34,156 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:34,256 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47030': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:34,257 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:34,262 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47046': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:34,262 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:34,363 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:34,367 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47062': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:34,367 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47070': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:34,368 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:34,470 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:34,474 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47072': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:34,475 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47082': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:34,475 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:34,576 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47088': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:34,576 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:34,581 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47104': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:34,581 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:34,682 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:34,686 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47116': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:34,687 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47132': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:34,687 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:34,789 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:34,830 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47136': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:34,830 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47152': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:34,830 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:34,895 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47168': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:34,895 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:34,936 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47180': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:34,936 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:35,001 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47194': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:35,001 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:35,043 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47202': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:35,043 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:35,108 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47208': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:35,108 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:35,149 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47222': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:35,149 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:35,214 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47228': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:35,214 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:35,255 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47238': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:35,255 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:35,321 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47254': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:35,321 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:35,362 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47264': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:35,362 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:35,427 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47276': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:35,427 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:35,468 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47288': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:35,468 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:35,533 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47290': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:35,533 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:35,574 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47294': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:35,574 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:35,640 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47304': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:35,640 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:35,680 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47314': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:35,680 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:35,746 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47322': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:35,746 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:35,786 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47332': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:35,786 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:35,853 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47336': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:35,853 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:35,894 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47350': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:35,894 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:35,959 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47352': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:35,959 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:36,000 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47356': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:36,000 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:36,065 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47368': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:36,065 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:36,106 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47374': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:36,106 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:36,172 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47388': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:36,173 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:36,214 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47392': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:36,214 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:36,281 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47400': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:36,282 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:36,320 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47414': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:36,320 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:36,391 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:36,392 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47416': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:36,427 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47432': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:36,427 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:36,500 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47444': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:36,500 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:36,533 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47458': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:36,533 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:36,609 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47470': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:36,609 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:36,643 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47476': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:36,643 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:36,716 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47488': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:36,716 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:36,749 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47498': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:36,749 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:36,822 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47510': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:36,822 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:36,856 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47524': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:36,856 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:36,929 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47538': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:36,929 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:36,962 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47542': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:36,962 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:37,035 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47558': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:37,035 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:37,068 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47572': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:37,068 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:37,141 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47588': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:37,141 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:37,174 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47592': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:37,174 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:37,248 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47598': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:37,248 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:37,281 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47612': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:37,281 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:37,354 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47618': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:37,354 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:37,387 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:37,387 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47634': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:37,461 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47640': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:37,461 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:37,493 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47654': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:37,493 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:37,567 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47656': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:37,567 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:37,599 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47664': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:37,599 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:37,673 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47670': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:37,673 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:37,706 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47684': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:37,706 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:37,780 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47690': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:37,780 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:37,812 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47704': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:37,812 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:37,886 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47714': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:37,886 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:37,920 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47718': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:37,920 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:37,993 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47732': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:37,993 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:38,026 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47748': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:38,026 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:38,099 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47754': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:38,099 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:38,132 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47768': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:38,132 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:38,206 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47782': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:38,206 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:38,238 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47788': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:38,238 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:38,312 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:38,312 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:38,345 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47812': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:38,346 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:38,419 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47820': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:38,419 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:38,452 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47830': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:38,452 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:38,525 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47834': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:38,525 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:38,558 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47836': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:38,558 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:38,632 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47848': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:38,632 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:38,664 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47850': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:38,664 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:38,739 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47860': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:38,739 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:38,770 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47876': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:38,770 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:38,845 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47878': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:38,845 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:38,876 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:38,876 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47894': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:38,952 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47898': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:38,952 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:38,982 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47906': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:38,982 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:39,059 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:39,059 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47908': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:39,088 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:39,089 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47918': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:39,165 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47922': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:39,165 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:39,195 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47924': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:39,195 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:39,271 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47938': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:39,271 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:39,301 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47954': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:39,301 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:39,378 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47956': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:39,378 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:39,407 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:39,407 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47964': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:39,484 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47974': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:39,484 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:39,513 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47982': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:39,513 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:39,590 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:47996': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:39,590 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:39,621 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:39,621 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:48006': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:39,697 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:39,697 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:48018': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:39,727 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:48032': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:39,727 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:39,803 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:48048': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:39,803 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:39,833 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:48056': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:39,833 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:39,909 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:48064': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:39,909 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:39,940 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:48080': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:39,940 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:40,016 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:48086': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:40,016 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:40,046 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:48100': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:40,046 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:40,122 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:48104': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:40,122 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:40,152 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:48120': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:40,152 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:40,229 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:40,229 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:48122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:40,259 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:48130': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:40,259 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:40,335 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:40,335 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:48142': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:40,365 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:48152': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:40,365 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:40,441 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:48162': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:40,441 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:40,472 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:48166': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:40,472 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:40,548 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:48168': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:40,548 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:40,578 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:48184': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:40,578 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:40,654 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:48196': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:40,654 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:40,684 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:40,684 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:48200': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:40,760 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:40,760 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:48212': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:40,791 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:48216': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:40,791 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:40,867 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:48224': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:40,867 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:40,897 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:48226': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:40,897 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:40,974 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:48238': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:40,974 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:41,004 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:48246': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:41,004 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:41,080 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:48262': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:41,080 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:41,110 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:48268': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:41,110 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:41,187 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:48272': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:41,187 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:41,216 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:48278': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:41,216 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:41,293 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:48280': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:41,293 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:41,323 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:48282': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:41,323 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:41,399 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:48292': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:41,399 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:41,430 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:41,430 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:48296': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:41,506 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:48298': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:41,506 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:41,536 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38662': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:41,536 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:41,613 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38668': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:41,613 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:41,642 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38680': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:41,642 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:41,719 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38694': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:41,719 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:41,748 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38696': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:41,748 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:41,825 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38698': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:41,825 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:41,854 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38704': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:41,854 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:41,932 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38716': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:41,932 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:41,961 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38718': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:41,961 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:42,038 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38726': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:42,038 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:42,067 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:42,067 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38742': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:42,145 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38746': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:42,145 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:42,173 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38760': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:42,173 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:42,251 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38764': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:42,251 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:42,279 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38770': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:42,279 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:42,358 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38778': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:42,358 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:42,385 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38794': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:42,385 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:42,464 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38808': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:42,464 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:42,491 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38816': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:42,491 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:42,570 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38830': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:42,570 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:42,598 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38836': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:42,598 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:42,676 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38842': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:42,676 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:42,704 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38844': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:42,704 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:42,783 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38854': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:42,783 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:42,811 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38868': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:42,811 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:42,889 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:42,891 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38876': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:42,917 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38882': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:42,917 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:42,996 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38886': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:42,996 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:43,024 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38888': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:43,024 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:43,103 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38900': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:43,103 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:43,131 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38904': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:43,131 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:43,209 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38908': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:43,209 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:43,237 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38916': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:43,237 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:43,315 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38920': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:43,315 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:43,343 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38932': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:43,343 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:43,422 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38938': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:43,422 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:43,449 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38952': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:43,449 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:43,528 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38954': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:43,528 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:43,556 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38970': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:43,556 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:43,634 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38980': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:43,634 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:43,662 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:38994': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:43,662 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:43,740 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39006': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:43,740 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:43,768 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39016': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:43,768 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:43,847 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39024': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:43,847 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:43,874 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39040': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:43,874 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:43,953 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39052': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:43,953 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:43,980 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:43,980 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:44,059 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39068': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:44,059 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:44,086 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39082': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:44,086 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:44,166 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39098': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:44,166 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:44,193 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39110': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:44,193 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:44,272 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39120': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:44,272 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:44,299 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:44,299 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39130': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:44,378 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39132': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:44,378 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:44,405 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:44,405 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39140': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:44,485 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39142': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:44,485 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:44,511 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39152': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:44,511 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:44,591 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:44,591 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39162': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:44,617 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39166': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:44,617 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:44,697 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:44,697 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39182': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:44,724 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39188': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:44,724 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:44,803 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:44,803 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39194': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:44,831 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39204': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:44,831 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:44,909 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39214': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:44,909 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:44,937 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39224': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:44,937 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:45,016 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39236': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:45,016 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:45,043 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39242': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:45,043 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:45,122 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:45,122 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39256': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:45,149 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39264': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:45,149 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:45,229 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39274': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:45,229 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:45,255 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39280': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:45,255 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:45,335 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39284': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:45,335 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:45,361 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39298': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:45,361 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:45,441 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39304': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:45,441 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:45,467 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39306': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:45,467 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:45,547 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39314': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:45,547 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:45,573 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39316': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:45,573 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:45,654 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39320': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:45,654 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:45,680 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39326': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:45,680 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:45,760 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39330': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:45,760 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:45,786 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39334': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:45,786 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:45,866 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39346': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:45,866 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:45,892 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:45,894 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39354': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:45,973 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39368': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:45,973 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:45,998 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39370': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:45,998 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:46,079 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39372': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:46,079 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:46,104 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:46,104 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39388': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:46,185 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39396': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:46,185 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:46,210 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:46,210 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39402': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:46,291 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39414': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:46,291 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:46,316 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39424': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:46,316 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:46,397 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39426': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:46,397 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:46,423 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:46,423 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39434': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:46,504 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39444': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:46,504 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:46,529 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39454': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:46,529 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:46,610 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39458': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:46,610 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:46,635 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39468': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:46,635 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:46,716 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:46,716 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39480': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:46,741 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39490': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:46,741 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:46,822 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39498': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:46,822 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:46,847 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39500': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:46,847 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:46,928 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39502': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:46,928 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:46,954 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39518': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:46,954 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:47,035 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39520': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:47,035 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:47,060 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:47,060 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39536': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:47,141 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39552': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:47,141 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:47,167 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:47,167 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39568': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:47,247 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39570': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:47,247 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:47,273 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39572': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:47,273 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:47,354 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:47,354 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39588': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:47,382 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:47,382 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39594': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:47,461 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39604': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:47,461 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:47,488 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39620': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:47,488 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:47,568 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39626': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:47,568 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:47,594 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39628': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:47,594 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:47,675 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39638': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:47,675 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:47,700 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39644': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:47,700 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:47,781 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:47,781 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39654': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:47,806 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39656': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:47,806 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:47,887 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:47,887 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39664': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:47,912 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39668': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:47,912 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:47,993 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39676': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:47,993 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:48,019 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39688': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:48,019 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:48,100 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39702': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:48,100 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:48,125 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39716': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:48,125 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:48,206 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39720': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:48,206 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:48,232 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39734': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:48,232 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:48,313 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39748': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:48,313 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:48,338 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39752': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:48,338 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:48,419 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39762': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:48,419 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:48,444 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39764': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:48,444 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:48,526 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39770': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:48,526 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:48,551 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39776': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:48,551 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:48,632 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39778': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:48,632 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:48,657 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39782': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:48,657 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:48,738 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39786': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:48,738 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:48,763 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:48,763 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39794': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:48,845 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39800': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:48,845 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:48,869 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:48,869 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39810': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:48,951 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39814': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:48,951 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:48,975 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39830': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:48,975 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:49,057 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39840': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:49,057 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:49,081 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39844': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:49,081 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:49,164 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39854': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:49,164 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:49,187 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:49,187 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39868': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:49,270 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39884': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:49,270 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:49,293 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39896': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:49,293 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:49,376 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39902': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:49,376 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:49,399 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39910': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:49,399 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:49,482 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39918': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:49,483 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:49,505 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39924': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:49,505 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:49,589 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39936': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:49,589 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:49,611 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39940': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:49,611 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:49,695 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39954': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:49,695 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:49,717 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39968': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:49,717 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:49,801 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39982': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:49,801 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:49,824 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:39996': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:49,824 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:49,908 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40002': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:49,908 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:49,930 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40004': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:49,930 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:50,014 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40018': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:50,014 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:50,037 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40032': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:50,037 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:50,121 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40048': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:50,121 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:50,143 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40060': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:50,143 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:50,227 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40072': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:50,227 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:50,249 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40086': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:50,249 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:50,334 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40098': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:50,334 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:50,355 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40112': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:50,355 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:50,440 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40116': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:50,440 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:50,461 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40128': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:50,461 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:50,547 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40138': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:50,547 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:50,568 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40154': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:50,568 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:50,653 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40166': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:50,653 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:50,674 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40168': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:50,674 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:50,760 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40184': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:50,760 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:50,780 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40196': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:50,780 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:50,866 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40200': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:50,866 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:50,886 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40210': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:50,886 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:50,972 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40226': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:50,972 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:50,993 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40236': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:50,993 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:51,079 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40244': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:51,079 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:51,099 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40248': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:51,099 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:51,185 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40264': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:51,185 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:51,205 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40266': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:51,205 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:51,292 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40276': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:51,292 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:51,312 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40292': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:51,312 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:51,398 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40300': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:51,398 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:51,418 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:51,418 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40316': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:51,504 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40332': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:51,504 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:51,526 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40342': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:51,526 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:51,611 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:54832': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:51,611 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:51,632 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:54844': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:51,632 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:51,717 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:54846': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:51,717 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:51,738 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:54854': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:51,738 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:51,824 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:54860': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:51,824 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:51,845 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:54862': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:51,845 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:51,930 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:51,931 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:54864': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:51,951 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:54876': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:51,951 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:52,037 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:54884': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:52,037 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:52,057 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:54886': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:52,057 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:52,144 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:54890': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:52,144 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:52,163 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:54906': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:52,163 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:52,250 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:54912': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:52,250 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:52,270 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:54918': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:52,270 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:52,357 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:52,357 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:54922': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:52,376 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:54936': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:52,376 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:52,463 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:54942': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:52,463 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:52,482 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:54944': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:52,482 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:52,570 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:54950': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:52,570 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:52,588 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:54956': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:52,589 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:52,676 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:54958': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:52,676 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:52,695 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:54964': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:52,695 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:52,782 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:52,782 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:54970': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:52,801 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:54972': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:52,801 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:52,888 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:52,890 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:54984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:52,907 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:54988': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:52,907 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:52,994 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:54990': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:52,994 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:53,014 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:53,014 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:54998': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:53,101 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55004': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:53,101 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:53,120 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55020': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:53,120 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:53,207 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55032': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:53,207 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:53,227 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55036': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:53,227 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:53,313 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55042': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:53,313 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:53,334 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55044': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:53,334 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:53,420 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55048': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:53,420 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:53,440 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55060': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:53,440 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:53,526 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55064': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:53,526 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:53,546 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55066': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:53,546 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:53,632 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55082': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:53,632 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:53,653 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55088': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:53,653 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:53,739 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55098': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:53,739 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:53,759 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55112': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:53,759 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:53,845 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55116': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:53,845 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:53,865 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55128': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:53,865 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:53,952 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55134': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:53,952 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:53,972 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55150': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:53,972 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:54,058 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55162': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:54,058 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:54,078 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55170': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:54,078 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:54,165 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55174': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:54,165 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:54,184 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55180': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:54,184 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:54,271 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55186': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:54,271 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:54,291 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55190': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:54,291 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:54,378 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55194': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:54,378 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:54,397 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55200': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:54,397 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:54,484 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55202': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:54,484 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:54,503 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55204': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:54,503 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:54,590 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55210': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:54,590 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:54,609 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55226': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:54,609 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:54,696 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55232': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:54,696 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:54,715 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55238': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:54,716 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:54,803 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55244': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:54,803 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:54,822 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55252': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:54,822 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:54,909 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55264': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:54,909 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:54,929 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55274': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:54,929 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:55,016 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55290': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:55,016 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:55,035 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55292': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:55,035 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:55,122 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55306': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:55,122 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:55,141 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55310': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:55,141 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:55,228 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55318': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:55,228 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:55,248 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55330': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:55,248 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:55,335 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:55,335 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55342': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:55,354 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55348': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:55,354 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:55,441 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:55,441 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55360': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:55,460 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55368': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:55,460 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:55,547 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:55,547 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55380': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:55,566 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55386': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:55,566 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:55,663 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55392': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:55,663 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:55,673 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55396': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:55,673 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:55,769 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:55,769 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55408': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:55,780 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55410': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:55,780 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:55,876 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55424': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:55,876 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:55,886 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55440': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:55,886 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:55,982 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55456': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:55,982 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:55,992 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55468': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:55,992 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:56,089 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55476': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:56,089 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:56,098 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:56,098 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55492': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:56,195 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55502': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:56,195 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:56,204 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55516': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:56,204 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:56,301 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55532': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:56,301 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s 2024-11-23 21:55:56,310 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:55548': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:55:56,310 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 4768s =================================== FAILURES =================================== 4768s ______________________________ test_preload_file _______________________________ 4768s 4768s self = 4768s deserializers = None 4768s 4768s async def read(self, deserializers=None): 4768s stream = self.stream 4768s if stream is None: 4768s raise CommClosedError() 4768s 4768s fmt = "Q" 4768s fmt_size = struct.calcsize(fmt) 4768s 4768s try: 4768s # Don't store multiple numpy or parquet buffers into the same buffer, or 4768s # none will be released until all are released. 4768s > frames_nosplit_nbytes_bin = await stream.read_bytes(fmt_size) 4768s E tornado.iostream.StreamClosedError: Stream is closed 4768s 4768s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:225: StreamClosedError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s loop = 4768s tmp_path = PosixPath('/tmp/pytest-of-ubuntu/pytest-1/test_preload_file0') 4768s 4768s def test_preload_file(loop, tmp_path): 4768s def check_scheduler(): 4768s import scheduler_info 4768s 4768s return scheduler_info.get_scheduler_address() 4768s 4768s path = tmp_path / "scheduler_info.py" 4768s with open(path, "w") as f: 4768s f.write(PRELOAD_TEXT) 4768s with tmpfile() as fn: 4768s with popen( 4768s [ 4768s "dask", 4768s "scheduler", 4768s "--scheduler-file", 4768s fn, 4768s "--preload", 4768s path, 4768s f"--port={open_port()}", 4768s ] 4768s ): 4768s with Client(scheduler_file=fn, loop=loop) as c: 4768s > assert c.run_on_scheduler(check_scheduler) == c.scheduler.address 4768s 4768s /usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py:342: 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s /usr/lib/python3/dist-packages/distributed/client.py:2858: in run_on_scheduler 4768s return self.sync(self._run_on_scheduler, function, *args, **kwargs) 4768s /usr/lib/python3/dist-packages/distributed/utils.py:362: in sync 4768s return sync( 4768s /usr/lib/python3/dist-packages/distributed/utils.py:438: in sync 4768s raise error 4768s /usr/lib/python3/dist-packages/distributed/utils.py:412: in f 4768s result = yield future 4768s /usr/lib/python3/dist-packages/tornado/gen.py:766: in run 4768s value = future.result() 4768s /usr/lib/python3/dist-packages/distributed/client.py:2809: in _run_on_scheduler 4768s response = await self.scheduler.run_function( 4768s /usr/lib/python3/dist-packages/distributed/core.py:1395: in send_recv_from_rpc 4768s return await send_recv(comm=comm, op=key, **kwargs) 4768s /usr/lib/python3/dist-packages/distributed/core.py:1154: in send_recv 4768s response = await comm.read(deserializers=deserializers) 4768s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:236: in read 4768s convert_stream_closed_error(self, e) 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s 4768s obj = 4768s exc = StreamClosedError('Stream is closed') 4768s 4768s def convert_stream_closed_error(obj, exc): 4768s """ 4768s Re-raise StreamClosedError as CommClosedError. 4768s """ 4768s if exc.real_error is not None: 4768s # The stream was closed because of an underlying OS error 4768s exc = exc.real_error 4768s if isinstance(exc, ssl.SSLError): 4768s if exc.reason and "UNKNOWN_CA" in exc.reason: 4768s raise FatalCommClosedError(f"in {obj}: {exc.__class__.__name__}: {exc}") 4768s raise CommClosedError(f"in {obj}: {exc.__class__.__name__}: {exc}") from exc 4768s else: 4768s > raise CommClosedError(f"in {obj}: {exc}") from exc 4768s E distributed.comm.core.CommClosedError: in : Stream is closed 4768s 4768s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:142: CommClosedError 4768s ----------------------------- Captured stderr call ----------------------------- 4768s 2024-11-23 21:35:40,343 - distributed.utils - INFO - Reload module scheduler_info from .py file 4768s 2024-11-23 21:35:40,345 - distributed.preloading - INFO - Import preload module: /tmp/pytest-of-ubuntu/pytest-1/test_preload_file0/scheduler_info.py 4768s 2024-11-23 21:35:40,346 - distributed.scheduler - INFO - ----------------------------------------------- 4768s 2024-11-23 21:35:40,348 - distributed.preloading - INFO - Creating preload: /tmp/pytest-of-ubuntu/pytest-1/test_preload_file0/scheduler_info.py 4768s 2024-11-23 21:35:40,349 - distributed.utils - INFO - Reload module scheduler_info from .py file 4768s 2024-11-23 21:35:40,350 - distributed.preloading - INFO - Import preload module: /tmp/pytest-of-ubuntu/pytest-1/test_preload_file0/scheduler_info.py 4768s 2024-11-23 21:35:40,375 - distributed.http.proxy - INFO - To route to workers diagnostics web server please install jupyter-server-proxy: python -m pip install jupyter-server-proxy 4768s 2024-11-23 21:35:40,379 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:35:40,390 - distributed.scheduler - INFO - ----------------------------------------------- 4768s 2024-11-23 21:35:40,392 - distributed.scheduler - INFO - Scheduler at: tcp://10.0.4.73:33651 4768s 2024-11-23 21:35:40,392 - distributed.scheduler - INFO - dashboard at: http://10.0.4.73:8787/status 4768s 2024-11-23 21:35:40,393 - distributed.preloading - INFO - Run preload setup: /tmp/pytest-of-ubuntu/pytest-1/test_preload_file0/scheduler_info.py 4768s 2024-11-23 21:35:40,393 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:35:40,409 - distributed.scheduler - INFO - Receive client connection: Client-e25274da-a9e2-11ef-bb5a-00163e4db70f 4768s 2024-11-23 21:35:40,756 - distributed.core - INFO - Starting established connection to tcp://10.0.4.73:60534 4768s 2024-11-23 21:35:40,761 - distributed.worker - INFO - Run out-of-band function 'check_scheduler' 4768s 2024-11-23 21:35:41,206 - distributed.client - ERROR - 4768s ConnectionRefusedError: [Errno 111] Connection refused 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 559, in connect 4768s convert_stream_closed_error(self, e) 4768s ~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 140, in convert_stream_closed_error 4768s raise CommClosedError(f"in {obj}: {exc.__class__.__name__}: {exc}") from exc 4768s distributed.comm.core.CommClosedError: in : ConnectionRefusedError: [Errno 111] Connection refused 4768s 4768s During handling of the above exception, another exception occurred: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 836, in wrapper 4768s return await func(*args, **kwargs) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/client.py", line 1331, in _reconnect 4768s await self._ensure_connected(timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/client.py", line 1361, in _ensure_connected 4768s comm = await connect( 4768s ^^^^^^^^^^^^^^ 4768s self.scheduler.address, timeout=timeout, **self.connection_args 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 366, in connect 4768s await asyncio.sleep(backoff) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 718, in sleep 4768s return await future 4768s ^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s _____________________________ test_preload_module ______________________________ 4768s 4768s self = 4768s deserializers = None 4768s 4768s async def read(self, deserializers=None): 4768s stream = self.stream 4768s if stream is None: 4768s raise CommClosedError() 4768s 4768s fmt = "Q" 4768s fmt_size = struct.calcsize(fmt) 4768s 4768s try: 4768s # Don't store multiple numpy or parquet buffers into the same buffer, or 4768s # none will be released until all are released. 4768s > frames_nosplit_nbytes_bin = await stream.read_bytes(fmt_size) 4768s E tornado.iostream.StreamClosedError: Stream is closed 4768s 4768s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:225: StreamClosedError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s loop = 4768s tmp_path = PosixPath('/tmp/pytest-of-ubuntu/pytest-1/test_preload_module0') 4768s 4768s def test_preload_module(loop, tmp_path): 4768s def check_scheduler(): 4768s import scheduler_info 4768s 4768s return scheduler_info.get_scheduler_address() 4768s 4768s path = tmp_path / "scheduler_info.py" 4768s with open(path, "w") as f: 4768s f.write(PRELOAD_TEXT) 4768s env = os.environ.copy() 4768s if "PYTHONPATH" in env: 4768s env["PYTHONPATH"] = str(tmp_path) + ":" + env["PYTHONPATH"] 4768s else: 4768s env["PYTHONPATH"] = str(tmp_path) 4768s with tmpfile() as fn: 4768s with popen( 4768s [ 4768s "dask", 4768s "scheduler", 4768s "--scheduler-file", 4768s fn, 4768s "--preload", 4768s "scheduler_info", 4768s f"--port={open_port()}", 4768s ], 4768s env=env, 4768s ): 4768s with Client(scheduler_file=fn, loop=loop) as c: 4768s > assert c.run_on_scheduler(check_scheduler) == c.scheduler.address 4768s 4768s /usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py:373: 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s /usr/lib/python3/dist-packages/distributed/client.py:2858: in run_on_scheduler 4768s return self.sync(self._run_on_scheduler, function, *args, **kwargs) 4768s /usr/lib/python3/dist-packages/distributed/utils.py:362: in sync 4768s return sync( 4768s /usr/lib/python3/dist-packages/distributed/utils.py:438: in sync 4768s raise error 4768s /usr/lib/python3/dist-packages/distributed/utils.py:412: in f 4768s result = yield future 4768s /usr/lib/python3/dist-packages/tornado/gen.py:766: in run 4768s value = future.result() 4768s /usr/lib/python3/dist-packages/distributed/client.py:2809: in _run_on_scheduler 4768s response = await self.scheduler.run_function( 4768s /usr/lib/python3/dist-packages/distributed/core.py:1395: in send_recv_from_rpc 4768s return await send_recv(comm=comm, op=key, **kwargs) 4768s /usr/lib/python3/dist-packages/distributed/core.py:1154: in send_recv 4768s response = await comm.read(deserializers=deserializers) 4768s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:236: in read 4768s convert_stream_closed_error(self, e) 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s 4768s obj = 4768s exc = StreamClosedError('Stream is closed') 4768s 4768s def convert_stream_closed_error(obj, exc): 4768s """ 4768s Re-raise StreamClosedError as CommClosedError. 4768s """ 4768s if exc.real_error is not None: 4768s # The stream was closed because of an underlying OS error 4768s exc = exc.real_error 4768s if isinstance(exc, ssl.SSLError): 4768s if exc.reason and "UNKNOWN_CA" in exc.reason: 4768s raise FatalCommClosedError(f"in {obj}: {exc.__class__.__name__}: {exc}") 4768s raise CommClosedError(f"in {obj}: {exc.__class__.__name__}: {exc}") from exc 4768s else: 4768s > raise CommClosedError(f"in {obj}: {exc}") from exc 4768s E distributed.comm.core.CommClosedError: in : Stream is closed 4768s 4768s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:142: CommClosedError 4768s ----------------------------- Captured stderr call ----------------------------- 4768s 2024-11-23 21:35:42,218 - distributed.preloading - INFO - Import preload module: scheduler_info 4768s 2024-11-23 21:35:42,219 - distributed.scheduler - INFO - ----------------------------------------------- 4768s 2024-11-23 21:35:42,221 - distributed.preloading - INFO - Creating preload: scheduler_info 4768s 2024-11-23 21:35:42,221 - distributed.preloading - INFO - Import preload module: scheduler_info 4768s 2024-11-23 21:35:42,243 - distributed.http.proxy - INFO - To route to workers diagnostics web server please install jupyter-server-proxy: python -m pip install jupyter-server-proxy 4768s 2024-11-23 21:35:42,247 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:35:42,249 - distributed.diskutils - INFO - Found stale lock file and directory '/tmp/dask-scratch-space/scheduler-zarervxj', purging 4768s 2024-11-23 21:35:42,256 - distributed.scheduler - INFO - ----------------------------------------------- 4768s 2024-11-23 21:35:42,257 - distributed.scheduler - INFO - Scheduler at: tcp://10.0.4.73:34629 4768s 2024-11-23 21:35:42,257 - distributed.scheduler - INFO - dashboard at: http://10.0.4.73:8787/status 4768s 2024-11-23 21:35:42,257 - distributed.preloading - INFO - Run preload setup: scheduler_info 4768s 2024-11-23 21:35:42,258 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:35:42,270 - distributed.scheduler - INFO - Receive client connection: Client-e3754a42-a9e2-11ef-bb5a-00163e4db70f 4768s 2024-11-23 21:35:42,597 - distributed.core - INFO - Starting established connection to tcp://10.0.4.73:36868 4768s 2024-11-23 21:35:42,601 - distributed.worker - INFO - Run out-of-band function 'check_scheduler' 4768s 2024-11-23 21:35:43,044 - distributed.client - ERROR - 4768s ConnectionRefusedError: [Errno 111] Connection refused 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 559, in connect 4768s convert_stream_closed_error(self, e) 4768s ~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 140, in convert_stream_closed_error 4768s raise CommClosedError(f"in {obj}: {exc.__class__.__name__}: {exc}") from exc 4768s distributed.comm.core.CommClosedError: in : ConnectionRefusedError: [Errno 111] Connection refused 4768s 4768s During handling of the above exception, another exception occurred: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 836, in wrapper 4768s return await func(*args, **kwargs) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/client.py", line 1331, in _reconnect 4768s await self._ensure_connected(timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/client.py", line 1361, in _ensure_connected 4768s comm = await connect( 4768s ^^^^^^^^^^^^^^ 4768s self.scheduler.address, timeout=timeout, **self.connection_args 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 366, in connect 4768s await asyncio.sleep(backoff) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 718, in sleep 4768s return await future 4768s ^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s __________________________ test_preload_remote_module __________________________ 4768s 4768s self = 4768s deserializers = None 4768s 4768s async def read(self, deserializers=None): 4768s stream = self.stream 4768s if stream is None: 4768s raise CommClosedError() 4768s 4768s fmt = "Q" 4768s fmt_size = struct.calcsize(fmt) 4768s 4768s try: 4768s # Don't store multiple numpy or parquet buffers into the same buffer, or 4768s # none will be released until all are released. 4768s > frames_nosplit_nbytes_bin = await stream.read_bytes(fmt_size) 4768s E tornado.iostream.StreamClosedError: Stream is closed 4768s 4768s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:225: StreamClosedError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s loop = 4768s tmp_path = PosixPath('/tmp/pytest-of-ubuntu/pytest-1/test_preload_remote_module0') 4768s 4768s def test_preload_remote_module(loop, tmp_path): 4768s with open(tmp_path / "scheduler_info.py", "w") as f: 4768s f.write(PRELOAD_TEXT) 4768s http_server_port = open_port() 4768s with popen( 4768s [sys.executable, "-m", "http.server", str(http_server_port)], cwd=tmp_path 4768s ): 4768s with popen( 4768s [ 4768s "dask", 4768s "scheduler", 4768s "--scheduler-file", 4768s str(tmp_path / "scheduler-file.json"), 4768s "--preload", 4768s f"http://localhost:{http_server_port}/scheduler_info.py", 4768s f"--port={open_port()}", 4768s ] 4768s ) as proc: 4768s with Client( 4768s scheduler_file=tmp_path / "scheduler-file.json", loop=loop 4768s ) as c: 4768s > assert ( 4768s c.run_on_scheduler( 4768s lambda dask_scheduler: getattr(dask_scheduler, "foo", None) 4768s ) 4768s == "bar" 4768s ) 4768s 4768s /usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py:397: 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s /usr/lib/python3/dist-packages/distributed/client.py:2858: in run_on_scheduler 4768s return self.sync(self._run_on_scheduler, function, *args, **kwargs) 4768s /usr/lib/python3/dist-packages/distributed/utils.py:362: in sync 4768s return sync( 4768s /usr/lib/python3/dist-packages/distributed/utils.py:438: in sync 4768s raise error 4768s /usr/lib/python3/dist-packages/distributed/utils.py:412: in f 4768s result = yield future 4768s /usr/lib/python3/dist-packages/tornado/gen.py:766: in run 4768s value = future.result() 4768s /usr/lib/python3/dist-packages/distributed/client.py:2809: in _run_on_scheduler 4768s response = await self.scheduler.run_function( 4768s /usr/lib/python3/dist-packages/distributed/core.py:1395: in send_recv_from_rpc 4768s return await send_recv(comm=comm, op=key, **kwargs) 4768s /usr/lib/python3/dist-packages/distributed/core.py:1154: in send_recv 4768s response = await comm.read(deserializers=deserializers) 4768s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:236: in read 4768s convert_stream_closed_error(self, e) 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s 4768s obj = 4768s exc = StreamClosedError('Stream is closed') 4768s 4768s def convert_stream_closed_error(obj, exc): 4768s """ 4768s Re-raise StreamClosedError as CommClosedError. 4768s """ 4768s if exc.real_error is not None: 4768s # The stream was closed because of an underlying OS error 4768s exc = exc.real_error 4768s if isinstance(exc, ssl.SSLError): 4768s if exc.reason and "UNKNOWN_CA" in exc.reason: 4768s raise FatalCommClosedError(f"in {obj}: {exc.__class__.__name__}: {exc}") 4768s raise CommClosedError(f"in {obj}: {exc.__class__.__name__}: {exc}") from exc 4768s else: 4768s > raise CommClosedError(f"in {obj}: {exc}") from exc 4768s E distributed.comm.core.CommClosedError: in : Stream is closed 4768s 4768s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:142: CommClosedError 4768s ----------------------------- Captured stdout call ----------------------------- 4768s Serving HTTP on 0.0.0.0 port 58501 (http://0.0.0.0:58501/) ... 4768s 4768s Keyboard interrupt received, exiting. 4768s ----------------------------- Captured stderr call ----------------------------- 4768s 2024-11-23 21:35:43,986 - distributed.scheduler - INFO - ----------------------------------------------- 4768s 2024-11-23 21:35:43,988 - distributed.preloading - INFO - Creating preload: http://localhost:58501/scheduler_info.py 4768s 2024-11-23 21:35:43,989 - distributed.preloading - INFO - Downloading preload at http://localhost:58501/scheduler_info.py 4768s 127.0.0.1 - - [23/Nov/2024 21:35:44] "GET /scheduler_info.py HTTP/1.1" 200 - 4768s 2024-11-23 21:35:44,044 - distributed.http.proxy - INFO - To route to workers diagnostics web server please install jupyter-server-proxy: python -m pip install jupyter-server-proxy 4768s 2024-11-23 21:35:44,047 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:35:44,049 - distributed.diskutils - INFO - Found stale lock file and directory '/tmp/dask-scratch-space/scheduler-pv50n5cs', purging 4768s 2024-11-23 21:35:44,057 - distributed.scheduler - INFO - ----------------------------------------------- 4768s 2024-11-23 21:35:44,059 - distributed.scheduler - INFO - Scheduler at: tcp://10.0.4.73:33187 4768s 2024-11-23 21:35:44,059 - distributed.scheduler - INFO - dashboard at: http://10.0.4.73:8787/status 4768s 2024-11-23 21:35:44,059 - distributed.preloading - INFO - Run preload setup: http://localhost:58501/scheduler_info.py 4768s 2024-11-23 21:35:44,060 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:35:44,069 - distributed.scheduler - INFO - Receive client connection: Client-e481b3d4-a9e2-11ef-bb5a-00163e4db70f 4768s 2024-11-23 21:35:44,415 - distributed.core - INFO - Starting established connection to tcp://10.0.4.73:44144 4768s 2024-11-23 21:35:44,420 - distributed.worker - INFO - Run out-of-band function 'lambda' 4768s 2024-11-23 21:35:44,868 - distributed.client - ERROR - 4768s ConnectionRefusedError: [Errno 111] Connection refused 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 559, in connect 4768s convert_stream_closed_error(self, e) 4768s ~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 140, in convert_stream_closed_error 4768s raise CommClosedError(f"in {obj}: {exc.__class__.__name__}: {exc}") from exc 4768s distributed.comm.core.CommClosedError: in : ConnectionRefusedError: [Errno 111] Connection refused 4768s 4768s During handling of the above exception, another exception occurred: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 836, in wrapper 4768s return await func(*args, **kwargs) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/client.py", line 1331, in _reconnect 4768s await self._ensure_connected(timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/client.py", line 1361, in _ensure_connected 4768s comm = await connect( 4768s ^^^^^^^^^^^^^^ 4768s self.scheduler.address, timeout=timeout, **self.connection_args 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 366, in connect 4768s await asyncio.sleep(backoff) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 718, in sleep 4768s return await future 4768s ^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s _____________________________ test_preload_config ______________________________ 4768s 4768s loop = 4768s 4768s def test_preload_config(loop): 4768s # Ensure dask scheduler pulls the preload from the Dask config if 4768s # not specified via a command line option 4768s with tmpfile() as fn: 4768s env = os.environ.copy() 4768s env["DASK_DISTRIBUTED__SCHEDULER__PRELOAD"] = PRELOAD_TEXT 4768s with popen(["dask", "scheduler", "--scheduler-file", fn], env=env): 4768s with Client(scheduler_file=fn, loop=loop) as c: 4768s > assert ( 4768s c.run_on_scheduler(lambda dask_scheduler: dask_scheduler.foo) 4768s == "bar" 4768s ) 4768s 4768s /usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py:413: 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s /usr/lib/python3/dist-packages/distributed/client.py:2858: in run_on_scheduler 4768s return self.sync(self._run_on_scheduler, function, *args, **kwargs) 4768s /usr/lib/python3/dist-packages/distributed/utils.py:362: in sync 4768s return sync( 4768s /usr/lib/python3/dist-packages/distributed/utils.py:438: in sync 4768s raise error 4768s /usr/lib/python3/dist-packages/distributed/utils.py:412: in f 4768s result = yield future 4768s /usr/lib/python3/dist-packages/tornado/gen.py:766: in run 4768s value = future.result() 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s 4768s self = 4768s function = . at 0xeb24e078> 4768s wait = True, args = (), kwargs = {} 4768s response = {'exception': b'\x80\x05\x953\x02\x00\x00\x00\x00\x00\x00\x8c\x16tblib.pickling_support\x94\x8c\x12unpickle_exception\...ext': "SystemError('no locals found when setting up annotations')", 'status': 'error', 'traceback': b'\x80\x05N.', ...} 4768s typ = 4768s exc = SystemError('no locals found when setting up annotations'), tb = None 4768s 4768s async def _run_on_scheduler(self, function, *args, wait=True, **kwargs): 4768s response = await self.scheduler.run_function( 4768s function=dumps(function), 4768s args=dumps(args), 4768s kwargs=dumps(kwargs), 4768s wait=wait, 4768s ) 4768s if response["status"] == "error": 4768s typ, exc, tb = clean_exception(**response) 4768s > raise exc.with_traceback(tb) 4768s E SystemError: no locals found when setting up annotations 4768s 4768s /usr/lib/python3/dist-packages/distributed/client.py:2817: SystemError 4768s ----------------------------- Captured stderr call ----------------------------- 4768s 2024-11-23 21:35:45,852 - distributed.scheduler - INFO - ----------------------------------------------- 4768s 2024-11-23 21:35:45,854 - distributed.preloading - INFO - Creating preload: 4768s _scheduler_info = {} 4768s 4768s def dask_setup(scheduler): 4768s _scheduler_info['address'] = scheduler.address 4768s scheduler.foo = "bar" 4768s 4768s def get_scheduler_address(): 4768s return _scheduler_info['address'] 4768s 4768s 2024-11-23 21:35:45,855 - distributed.utils - INFO - Reload module tmpcnlx1p5y from .py file 4768s 2024-11-23 21:35:45,856 - distributed.preloading - INFO - Import preload module: /tmp/tmpcnlx1p5y.py 4768s 2024-11-23 21:35:45,880 - distributed.http.proxy - INFO - To route to workers diagnostics web server please install jupyter-server-proxy: python -m pip install jupyter-server-proxy 4768s 2024-11-23 21:35:45,883 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:35:45,885 - distributed.diskutils - INFO - Found stale lock file and directory '/tmp/dask-scratch-space/scheduler-28t79m10', purging 4768s 2024-11-23 21:35:45,891 - distributed.scheduler - INFO - ----------------------------------------------- 4768s 2024-11-23 21:35:45,893 - distributed.scheduler - INFO - Scheduler at: tcp://10.0.4.73:8786 4768s 2024-11-23 21:35:45,893 - distributed.scheduler - INFO - dashboard at: http://10.0.4.73:8787/status 4768s 2024-11-23 21:35:45,893 - distributed.preloading - INFO - Run preload setup: 4768s _scheduler_info = {} 4768s 4768s def dask_setup(scheduler): 4768s _scheduler_info['address'] = scheduler.address 4768s scheduler.foo = "bar" 4768s 4768s def get_scheduler_address(): 4768s return _scheduler_info['address'] 4768s 4768s 2024-11-23 21:35:45,893 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:35:45,902 - distributed.scheduler - INFO - Receive client connection: Client-e5a0bd37-a9e2-11ef-bb5a-00163e4db70f 4768s 2024-11-23 21:35:46,237 - distributed.core - INFO - Starting established connection to tcp://10.0.4.73:54260 4768s 2024-11-23 21:35:46,241 - distributed.worker - INFO - Run out-of-band function 'lambda' 4768s 2024-11-23 21:35:46,241 - distributed.worker - WARNING - Run Failed 4768s Function: lambda 4768s args: () 4768s kwargs: {'dask_scheduler': } 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 3182, in run 4768s result = function(*args, **kwargs) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s SystemError: no locals found when setting up annotations 4768s 2024-11-23 21:35:46,251 - distributed.scheduler - INFO - Remove client Client-e5a0bd37-a9e2-11ef-bb5a-00163e4db70f 4768s 2024-11-23 21:35:46,251 - distributed.core - INFO - Received 'close-stream' from tcp://10.0.4.73:54260; closing. 4768s 2024-11-23 21:35:46,252 - distributed.scheduler - INFO - Remove client Client-e5a0bd37-a9e2-11ef-bb5a-00163e4db70f 4768s 2024-11-23 21:35:46,252 - distributed.scheduler - INFO - Close client connection: Client-e5a0bd37-a9e2-11ef-bb5a-00163e4db70f 4768s 2024-11-23 21:35:46,253 - distributed._signals - INFO - Received signal SIGINT (2) 4768s 2024-11-23 21:35:46,253 - distributed.scheduler - INFO - Scheduler closing due to signal-2... 4768s 2024-11-23 21:35:46,253 - distributed.scheduler - INFO - Scheduler closing all comms 4768s 2024-11-23 21:35:46,254 - distributed.scheduler - INFO - Stopped scheduler at 'tcp://10.0.4.73:8786' 4768s 2024-11-23 21:35:46,255 - distributed.scheduler - INFO - End scheduler 4768s _____________________________ test_preload_command _____________________________ 4768s 4768s self = 4768s deserializers = None 4768s 4768s async def read(self, deserializers=None): 4768s stream = self.stream 4768s if stream is None: 4768s raise CommClosedError() 4768s 4768s fmt = "Q" 4768s fmt_size = struct.calcsize(fmt) 4768s 4768s try: 4768s # Don't store multiple numpy or parquet buffers into the same buffer, or 4768s # none will be released until all are released. 4768s > frames_nosplit_nbytes_bin = await stream.read_bytes(fmt_size) 4768s E tornado.iostream.StreamClosedError: Stream is closed 4768s 4768s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:225: StreamClosedError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s loop = 4768s 4768s def test_preload_command(loop): 4768s def check_passthrough(): 4768s import passthrough_info 4768s 4768s return passthrough_info.get_passthrough() 4768s 4768s tmpdir = tempfile.mkdtemp() 4768s try: 4768s path = os.path.join(tmpdir, "passthrough_info.py") 4768s with open(path, "w") as f: 4768s f.write(PRELOAD_COMMAND_TEXT) 4768s 4768s with tmpfile() as fn: 4768s print(fn) 4768s with popen( 4768s [ 4768s "dask", 4768s "scheduler", 4768s "--scheduler-file", 4768s fn, 4768s "--preload", 4768s path, 4768s "--passthrough", 4768s "foobar", 4768s ] 4768s ): 4768s with Client(scheduler_file=fn, loop=loop) as c: 4768s > assert c.run_on_scheduler(check_passthrough) == "foobar" 4768s 4768s /usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py:460: 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s /usr/lib/python3/dist-packages/distributed/client.py:2858: in run_on_scheduler 4768s return self.sync(self._run_on_scheduler, function, *args, **kwargs) 4768s /usr/lib/python3/dist-packages/distributed/utils.py:362: in sync 4768s return sync( 4768s /usr/lib/python3/dist-packages/distributed/utils.py:438: in sync 4768s raise error 4768s /usr/lib/python3/dist-packages/distributed/utils.py:412: in f 4768s result = yield future 4768s /usr/lib/python3/dist-packages/tornado/gen.py:766: in run 4768s value = future.result() 4768s /usr/lib/python3/dist-packages/distributed/client.py:2809: in _run_on_scheduler 4768s response = await self.scheduler.run_function( 4768s /usr/lib/python3/dist-packages/distributed/core.py:1395: in send_recv_from_rpc 4768s return await send_recv(comm=comm, op=key, **kwargs) 4768s /usr/lib/python3/dist-packages/distributed/core.py:1154: in send_recv 4768s response = await comm.read(deserializers=deserializers) 4768s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:236: in read 4768s convert_stream_closed_error(self, e) 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s 4768s obj = 4768s exc = StreamClosedError('Stream is closed') 4768s 4768s def convert_stream_closed_error(obj, exc): 4768s """ 4768s Re-raise StreamClosedError as CommClosedError. 4768s """ 4768s if exc.real_error is not None: 4768s # The stream was closed because of an underlying OS error 4768s exc = exc.real_error 4768s if isinstance(exc, ssl.SSLError): 4768s if exc.reason and "UNKNOWN_CA" in exc.reason: 4768s raise FatalCommClosedError(f"in {obj}: {exc.__class__.__name__}: {exc}") 4768s raise CommClosedError(f"in {obj}: {exc.__class__.__name__}: {exc}") from exc 4768s else: 4768s > raise CommClosedError(f"in {obj}: {exc}") from exc 4768s E distributed.comm.core.CommClosedError: in : Stream is closed 4768s 4768s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:142: CommClosedError 4768s ----------------------------- Captured stdout call ----------------------------- 4768s /tmp/tmp9np8y7l5 4768s ----------------------------- Captured stderr call ----------------------------- 4768s 2024-11-23 21:35:47,431 - distributed.utils - INFO - Reload module passthrough_info from .py file 4768s 2024-11-23 21:35:47,433 - distributed.preloading - INFO - Import preload module: /tmp/tmpyqio5mhn/passthrough_info.py 4768s 2024-11-23 21:35:47,434 - distributed.scheduler - INFO - ----------------------------------------------- 4768s 2024-11-23 21:35:47,436 - distributed.preloading - INFO - Creating preload: /tmp/tmpyqio5mhn/passthrough_info.py 4768s 2024-11-23 21:35:47,436 - distributed.utils - INFO - Reload module passthrough_info from .py file 4768s 2024-11-23 21:35:47,437 - distributed.preloading - INFO - Import preload module: /tmp/tmpyqio5mhn/passthrough_info.py 4768s 2024-11-23 21:35:47,462 - distributed.http.proxy - INFO - To route to workers diagnostics web server please install jupyter-server-proxy: python -m pip install jupyter-server-proxy 4768s 2024-11-23 21:35:47,466 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:35:47,475 - distributed.scheduler - INFO - ----------------------------------------------- 4768s 2024-11-23 21:35:47,476 - distributed.scheduler - INFO - Scheduler at: tcp://10.0.4.73:8786 4768s 2024-11-23 21:35:47,476 - distributed.scheduler - INFO - dashboard at: http://10.0.4.73:8787/status 4768s 2024-11-23 21:35:47,477 - distributed.preloading - INFO - Run preload setup: /tmp/tmpyqio5mhn/passthrough_info.py 4768s 2024-11-23 21:35:47,477 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:35:47,491 - distributed.scheduler - INFO - Receive client connection: Client-e690306b-a9e2-11ef-bb5a-00163e4db70f 4768s 2024-11-23 21:35:47,831 - distributed.core - INFO - Starting established connection to tcp://10.0.4.73:54274 4768s 2024-11-23 21:35:47,836 - distributed.worker - INFO - Run out-of-band function 'check_passthrough' 4768s 2024-11-23 21:35:48,291 - distributed.client - ERROR - 4768s ConnectionRefusedError: [Errno 111] Connection refused 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 559, in connect 4768s convert_stream_closed_error(self, e) 4768s ~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 140, in convert_stream_closed_error 4768s raise CommClosedError(f"in {obj}: {exc.__class__.__name__}: {exc}") from exc 4768s distributed.comm.core.CommClosedError: in : ConnectionRefusedError: [Errno 111] Connection refused 4768s 4768s During handling of the above exception, another exception occurred: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 836, in wrapper 4768s return await func(*args, **kwargs) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/client.py", line 1331, in _reconnect 4768s await self._ensure_connected(timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/client.py", line 1361, in _ensure_connected 4768s comm = await connect( 4768s ^^^^^^^^^^^^^^ 4768s self.scheduler.address, timeout=timeout, **self.connection_args 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 366, in connect 4768s await asyncio.sleep(backoff) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 718, in sleep 4768s return await future 4768s ^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s _________________________ test_preload_command_default _________________________ 4768s 4768s self = 4768s deserializers = None 4768s 4768s async def read(self, deserializers=None): 4768s stream = self.stream 4768s if stream is None: 4768s raise CommClosedError() 4768s 4768s fmt = "Q" 4768s fmt_size = struct.calcsize(fmt) 4768s 4768s try: 4768s # Don't store multiple numpy or parquet buffers into the same buffer, or 4768s # none will be released until all are released. 4768s > frames_nosplit_nbytes_bin = await stream.read_bytes(fmt_size) 4768s E tornado.iostream.StreamClosedError: Stream is closed 4768s 4768s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:225: StreamClosedError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s loop = 4768s 4768s def test_preload_command_default(loop): 4768s def check_passthrough(): 4768s import passthrough_info 4768s 4768s return passthrough_info.get_passthrough() 4768s 4768s tmpdir = tempfile.mkdtemp() 4768s try: 4768s path = os.path.join(tmpdir, "passthrough_info.py") 4768s with open(path, "w") as f: 4768s f.write(PRELOAD_COMMAND_TEXT) 4768s 4768s with tmpfile() as fn2: 4768s print(fn2) 4768s with popen( 4768s ["dask", "scheduler", "--scheduler-file", fn2, "--preload", path], 4768s stdout=sys.stdout, 4768s stderr=sys.stderr, 4768s ): 4768s with Client(scheduler_file=fn2, loop=loop) as c: 4768s > assert c.run_on_scheduler(check_passthrough) == "default" 4768s 4768s /usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py:485: 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s /usr/lib/python3/dist-packages/distributed/client.py:2858: in run_on_scheduler 4768s return self.sync(self._run_on_scheduler, function, *args, **kwargs) 4768s /usr/lib/python3/dist-packages/distributed/utils.py:362: in sync 4768s return sync( 4768s /usr/lib/python3/dist-packages/distributed/utils.py:438: in sync 4768s raise error 4768s /usr/lib/python3/dist-packages/distributed/utils.py:412: in f 4768s result = yield future 4768s /usr/lib/python3/dist-packages/tornado/gen.py:766: in run 4768s value = future.result() 4768s /usr/lib/python3/dist-packages/distributed/client.py:2809: in _run_on_scheduler 4768s response = await self.scheduler.run_function( 4768s /usr/lib/python3/dist-packages/distributed/core.py:1395: in send_recv_from_rpc 4768s return await send_recv(comm=comm, op=key, **kwargs) 4768s /usr/lib/python3/dist-packages/distributed/core.py:1154: in send_recv 4768s response = await comm.read(deserializers=deserializers) 4768s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:236: in read 4768s convert_stream_closed_error(self, e) 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s 4768s obj = 4768s exc = StreamClosedError('Stream is closed') 4768s 4768s def convert_stream_closed_error(obj, exc): 4768s """ 4768s Re-raise StreamClosedError as CommClosedError. 4768s """ 4768s if exc.real_error is not None: 4768s # The stream was closed because of an underlying OS error 4768s exc = exc.real_error 4768s if isinstance(exc, ssl.SSLError): 4768s if exc.reason and "UNKNOWN_CA" in exc.reason: 4768s raise FatalCommClosedError(f"in {obj}: {exc.__class__.__name__}: {exc}") 4768s raise CommClosedError(f"in {obj}: {exc.__class__.__name__}: {exc}") from exc 4768s else: 4768s > raise CommClosedError(f"in {obj}: {exc}") from exc 4768s E distributed.comm.core.CommClosedError: in : Stream is closed 4768s 4768s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:142: CommClosedError 4768s ----------------------------- Captured stdout call ----------------------------- 4768s /tmp/tmp59b9p2th 4768s ----------------------------- Captured stderr call ----------------------------- 4768s 2024-11-23 21:35:49,501 - distributed.utils - INFO - Reload module passthrough_info from .py file 4768s 2024-11-23 21:35:49,503 - distributed.preloading - INFO - Import preload module: /tmp/tmpf1palu4l/passthrough_info.py 4768s 2024-11-23 21:35:49,504 - distributed.scheduler - INFO - ----------------------------------------------- 4768s 2024-11-23 21:35:49,506 - distributed.preloading - INFO - Creating preload: /tmp/tmpf1palu4l/passthrough_info.py 4768s 2024-11-23 21:35:49,507 - distributed.utils - INFO - Reload module passthrough_info from .py file 4768s 2024-11-23 21:35:49,508 - distributed.preloading - INFO - Import preload module: /tmp/tmpf1palu4l/passthrough_info.py 4768s 2024-11-23 21:35:49,534 - distributed.http.proxy - INFO - To route to workers diagnostics web server please install jupyter-server-proxy: python -m pip install jupyter-server-proxy 4768s 2024-11-23 21:35:49,537 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:35:49,539 - distributed.diskutils - INFO - Found stale lock file and directory '/tmp/dask-scratch-space/scheduler-0i9xf1xo', purging 4768s 2024-11-23 21:35:49,547 - distributed.scheduler - INFO - ----------------------------------------------- 4768s 2024-11-23 21:35:49,549 - distributed.scheduler - INFO - Scheduler at: tcp://10.0.4.73:8786 4768s 2024-11-23 21:35:49,549 - distributed.scheduler - INFO - dashboard at: http://10.0.4.73:8787/status 4768s 2024-11-23 21:35:49,549 - distributed.preloading - INFO - Run preload setup: /tmp/tmpf1palu4l/passthrough_info.py 4768s 2024-11-23 21:35:49,550 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:35:49,562 - distributed.scheduler - INFO - Receive client connection: Client-e7cca1f4-a9e2-11ef-bb5a-00163e4db70f 4768s 2024-11-23 21:35:49,906 - distributed.core - INFO - Starting established connection to tcp://10.0.4.73:54346 4768s 2024-11-23 21:35:49,910 - distributed.worker - INFO - Run out-of-band function 'check_passthrough' 4768s 2024-11-23 21:35:50,357 - distributed.client - ERROR - 4768s ConnectionRefusedError: [Errno 111] Connection refused 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 559, in connect 4768s convert_stream_closed_error(self, e) 4768s ~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 140, in convert_stream_closed_error 4768s raise CommClosedError(f"in {obj}: {exc.__class__.__name__}: {exc}") from exc 4768s distributed.comm.core.CommClosedError: in : ConnectionRefusedError: [Errno 111] Connection refused 4768s 4768s During handling of the above exception, another exception occurred: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 836, in wrapper 4768s return await func(*args, **kwargs) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/client.py", line 1331, in _reconnect 4768s await self._ensure_connected(timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/client.py", line 1361, in _ensure_connected 4768s comm = await connect( 4768s ^^^^^^^^^^^^^^ 4768s self.scheduler.address, timeout=timeout, **self.connection_args 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 366, in connect 4768s await asyncio.sleep(backoff) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 718, in sleep 4768s return await future 4768s ^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s ___________________________ test_multiple_workers_2 ____________________________ 4768s 4768s loop = 4768s 4768s def test_multiple_workers_2(loop): 4768s text = """ 4768s def dask_setup(worker): 4768s worker.foo = 'setup' 4768s """ 4768s port = open_port() 4768s with popen( 4768s ["dask", "scheduler", "--no-dashboard", "--host", f"127.0.0.1:{port}"] 4768s ) as s: 4768s with popen( 4768s [ 4768s "dask", 4768s "worker", 4768s f"localhost:{port}", 4768s "--no-dashboard", 4768s "--preload", 4768s text, 4768s "--preload-nanny", 4768s text, 4768s ] 4768s ) as a: 4768s with Client(f"127.0.0.1:{port}", loop=loop) as c: 4768s c.wait_for_workers(1) 4768s > [foo] = c.run(lambda dask_worker: dask_worker.foo).values() 4768s 4768s /usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py:549: 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s /usr/lib/python3/dist-packages/distributed/client.py:2993: in run 4768s return self.sync( 4768s /usr/lib/python3/dist-packages/distributed/utils.py:362: in sync 4768s return sync( 4768s /usr/lib/python3/dist-packages/distributed/utils.py:438: in sync 4768s raise error 4768s /usr/lib/python3/dist-packages/distributed/utils.py:412: in f 4768s result = yield future 4768s /usr/lib/python3/dist-packages/tornado/gen.py:766: in run 4768s value = future.result() 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s 4768s self = 4768s function = . at 0xe981aac8> 4768s nanny = False, workers = None, wait = True, on_error = 'raise', args = () 4768s kwargs = {} 4768s responses = {'tcp://127.0.0.1:41163': {'exception': b'\x80\x05\x953\x02\x00\x00\x00\x00\x00\x00\x8c\x16tblib.pickling_support\x94\...xt': "SystemError('no locals found when setting up annotations')", 'status': 'error', 'traceback': b'\x80\x05N.', ...}} 4768s results = {}, key = 'tcp://127.0.0.1:41163' 4768s resp = {'exception': b'\x80\x05\x953\x02\x00\x00\x00\x00\x00\x00\x8c\x16tblib.pickling_support\x94\x8c\x12unpickle_exception\...ext': "SystemError('no locals found when setting up annotations')", 'status': 'error', 'traceback': b'\x80\x05N.', ...} 4768s exc = SystemError('no locals found when setting up annotations') 4768s _ = 4768s 4768s async def _run( 4768s self, 4768s function, 4768s *args, 4768s nanny: bool = False, 4768s workers: list[str] | None = None, 4768s wait: bool = True, 4768s on_error: Literal["raise", "return", "ignore"] = "raise", 4768s **kwargs, 4768s ): 4768s responses = await self.scheduler.broadcast( 4768s msg=dict( 4768s op="run", 4768s function=dumps(function), 4768s args=dumps(args), 4768s wait=wait, 4768s kwargs=dumps(kwargs), 4768s ), 4768s workers=workers, 4768s nanny=nanny, 4768s on_error="return_pickle", 4768s ) 4768s results = {} 4768s for key, resp in responses.items(): 4768s if isinstance(resp, bytes): 4768s # Pickled RPC exception 4768s exc = loads(resp) 4768s assert isinstance(exc, Exception) 4768s elif resp["status"] == "error": 4768s # Exception raised by the remote function 4768s _, exc, tb = clean_exception(**resp) 4768s exc = exc.with_traceback(tb) 4768s else: 4768s assert resp["status"] == "OK" 4768s results[key] = resp["result"] 4768s continue 4768s 4768s if on_error == "raise": 4768s > raise exc 4768s E SystemError: no locals found when setting up annotations 4768s 4768s /usr/lib/python3/dist-packages/distributed/client.py:2898: SystemError 4768s ----------------------------- Captured stderr call ----------------------------- 4768s 2024-11-23 21:35:51,303 - distributed.scheduler - INFO - ----------------------------------------------- 4768s 2024-11-23 21:35:51,318 - distributed.utils - INFO - Reload module tmpbs7vcf9j from .py file 4768s 2024-11-23 21:35:51,319 - distributed.preloading - INFO - Import preload module: /tmp/tmpbs7vcf9j.py 4768s 2024-11-23 21:35:51,328 - distributed.http.proxy - INFO - To route to workers diagnostics web server please install jupyter-server-proxy: python -m pip install jupyter-server-proxy 4768s 2024-11-23 21:35:51,331 - distributed.preloading - INFO - Creating preload: 4768s def dask_setup(worker): 4768s worker.foo = 'setup' 4768s 4768s 2024-11-23 21:35:51,332 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:35:51,332 - distributed.utils - INFO - Reload module tmp_g5si3yh from .py file 4768s 2024-11-23 21:35:51,334 - distributed.preloading - INFO - Import preload module: /tmp/tmp_g5si3yh.py 4768s 2024-11-23 21:35:51,334 - distributed.diskutils - INFO - Found stale lock file and directory '/tmp/dask-scratch-space/scheduler-jfo_yg8a', purging 4768s 2024-11-23 21:35:51,336 - distributed.preloading - INFO - Run preload setup: 4768s def dask_setup(worker): 4768s worker.foo = 'setup' 4768s 4768s 2024-11-23 21:35:51,342 - distributed.scheduler - INFO - ----------------------------------------------- 4768s 2024-11-23 21:35:51,343 - distributed.scheduler - INFO - Scheduler at: tcp://127.0.0.1:38205 4768s 2024-11-23 21:35:51,343 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:8787/status 4768s 2024-11-23 21:35:51,344 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:35:51,353 - distributed.nanny - INFO - Start Nanny at: 'tcp://127.0.0.1:35225' 4768s 2024-11-23 21:35:51,828 - distributed.scheduler - INFO - Receive client connection: Client-e8ddd9a9-a9e2-11ef-bb5a-00163e4db70f 4768s 2024-11-23 21:35:52,039 - distributed.preloading - INFO - Creating preload: 4768s def dask_setup(worker): 4768s worker.foo = 'setup' 4768s 4768s 2024-11-23 21:35:52,040 - distributed.utils - INFO - Reload module tmptt5qe0pz from .py file 4768s 2024-11-23 21:35:52,041 - distributed.preloading - INFO - Import preload module: /tmp/tmptt5qe0pz.py 4768s 2024-11-23 21:35:52,072 - distributed.preloading - INFO - Run preload setup: 4768s def dask_setup(worker): 4768s worker.foo = 'setup' 4768s 4768s 2024-11-23 21:35:52,072 - distributed.worker - INFO - Start worker at: tcp://127.0.0.1:41163 4768s 2024-11-23 21:35:52,072 - distributed.worker - INFO - Listening to: tcp://127.0.0.1:41163 4768s 2024-11-23 21:35:52,072 - distributed.worker - INFO - dashboard at: 127.0.0.1:46315 4768s 2024-11-23 21:35:52,072 - distributed.worker - INFO - Waiting to connect to: tcp://localhost:38205 4768s 2024-11-23 21:35:52,072 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:35:52,072 - distributed.worker - INFO - Threads: 8 4768s 2024-11-23 21:35:52,072 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:35:52,072 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-wf2rnonj 4768s 2024-11-23 21:35:52,072 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:35:52,167 - distributed.core - INFO - Starting established connection to tcp://127.0.0.1:45376 4768s 2024-11-23 21:35:52,523 - distributed.scheduler - INFO - Register worker 4768s 2024-11-23 21:35:52,524 - distributed.scheduler - INFO - Starting worker compute stream, tcp://127.0.0.1:41163 4768s 2024-11-23 21:35:52,524 - distributed.core - INFO - Starting established connection to tcp://127.0.0.1:45402 4768s 2024-11-23 21:35:52,525 - distributed.worker - INFO - Starting Worker plugin shuffle 4768s 2024-11-23 21:35:52,525 - distributed.worker - INFO - Registered to: tcp://localhost:38205 4768s 2024-11-23 21:35:52,526 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:35:52,527 - distributed.core - INFO - Starting established connection to tcp://localhost:38205 4768s 2024-11-23 21:35:52,587 - distributed.worker - INFO - Run out-of-band function 'lambda' 4768s 2024-11-23 21:35:52,587 - distributed.worker - WARNING - Run Failed 4768s Function: lambda 4768s args: () 4768s kwargs: {'dask_worker': } 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 3182, in run 4768s result = function(*args, **kwargs) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s SystemError: no locals found when setting up annotations 4768s 2024-11-23 21:35:52,594 - distributed.scheduler - INFO - Remove client Client-e8ddd9a9-a9e2-11ef-bb5a-00163e4db70f 4768s 2024-11-23 21:35:52,594 - distributed.core - INFO - Received 'close-stream' from tcp://127.0.0.1:45376; closing. 4768s 2024-11-23 21:35:52,595 - distributed.scheduler - INFO - Remove client Client-e8ddd9a9-a9e2-11ef-bb5a-00163e4db70f 4768s 2024-11-23 21:35:52,595 - distributed.scheduler - INFO - Close client connection: Client-e8ddd9a9-a9e2-11ef-bb5a-00163e4db70f 4768s 2024-11-23 21:35:52,596 - distributed._signals - INFO - Received signal SIGINT (2) 4768s 2024-11-23 21:35:52,596 - distributed.nanny - INFO - Closing Nanny at 'tcp://127.0.0.1:35225'. Reason: signal-2 4768s 2024-11-23 21:35:52,596 - distributed.nanny - INFO - Nanny asking worker to close. Reason: signal-2 4768s 2024-11-23 21:35:52,598 - distributed.worker - INFO - Stopping worker at tcp://127.0.0.1:41163. Reason: signal-2 4768s 2024-11-23 21:35:52,600 - distributed.core - INFO - Received 'close-stream' from tcp://127.0.0.1:45402; closing. 4768s 2024-11-23 21:35:52,600 - distributed.core - INFO - Connection to tcp://localhost:38205 has been closed. 4768s 2024-11-23 21:35:52,600 - distributed.scheduler - INFO - Remove worker (stimulus_id='handle-worker-cleanup-1732397752.6007705') 4768s 2024-11-23 21:35:52,601 - distributed.scheduler - INFO - Lost all workers 4768s 2024-11-23 21:35:52,602 - distributed.nanny - INFO - Worker closed 4768s 2024-11-23 21:35:52,909 - distributed.dask_worker - INFO - End worker 4768s 2024-11-23 21:35:53,163 - distributed._signals - INFO - Received signal SIGINT (2) 4768s 2024-11-23 21:35:53,163 - distributed.scheduler - INFO - Scheduler closing due to signal-2... 4768s 2024-11-23 21:35:53,164 - distributed.scheduler - INFO - Scheduler closing all comms 4768s 2024-11-23 21:35:53,164 - distributed.scheduler - INFO - Stopped scheduler at 'tcp://127.0.0.1:38205' 4768s 2024-11-23 21:35:53,165 - distributed.scheduler - INFO - End scheduler 4768s __________________________________ test_basic __________________________________ 4768s 4768s self = 4768s address = '127.0.0.1:8786', deserialize = True 4768s connection_args = {'extra_conn_args': {}, 'require_encryption': False, 'ssl_context': } 4768s ip = '127.0.0.1', port = 8786 4768s kwargs = {'ssl_options': } 4768s 4768s async def connect(self, address, deserialize=True, **connection_args): 4768s self._check_encryption(address, connection_args) 4768s ip, port = parse_host_port(address) 4768s kwargs = self._get_connect_args(**connection_args) 4768s 4768s try: 4768s # server_hostname option (for SNI) only works with tornado.iostream.IOStream 4768s if "server_hostname" in kwargs: 4768s stream = await self.client.connect( 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE 4768s ) 4768s stream = await stream.start_tls(False, **kwargs) 4768s else: 4768s > stream = await self.client.connect( 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ) 4768s 4768s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:546: 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s /usr/lib/python3/dist-packages/tornado/tcpclient.py:292: in connect 4768s stream = await stream.start_tls( 4768s /usr/lib/python3/dist-packages/tornado/iostream.py:1367: in _do_ssl_handshake 4768s self.socket.do_handshake() 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s 4768s self = , block = False 4768s 4768s @_sslcopydoc 4768s def do_handshake(self, block=False): 4768s self._check_connected() 4768s timeout = self.gettimeout() 4768s try: 4768s if timeout == 0.0 and block: 4768s self.settimeout(None) 4768s > self._sslobj.do_handshake() 4768s E ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 4768s 4768s /usr/lib/python3.13/ssl.py:1372: SSLCertVerificationError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s loop = 4768s requires_default_ports = None 4768s 4768s def test_basic(loop, requires_default_ports): 4768s with ( 4768s popen(["dask", "scheduler", "--no-dashboard"] + tls_args), 4768s popen(["dask", "worker", "--no-dashboard", "tls://127.0.0.1:8786"] + tls_args), 4768s > Client("tls://127.0.0.1:8786", loop=loop, security=tls_security()) as c, 4768s ): 4768s 4768s /usr/lib/python3/dist-packages/distributed/cli/tests/test_tls_cli.py:37: 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s /usr/lib/python3/dist-packages/distributed/client.py:1018: in __init__ 4768s self.start(timeout=timeout) 4768s /usr/lib/python3/dist-packages/distributed/client.py:1220: in start 4768s sync(self.loop, self._start, **kwargs) 4768s /usr/lib/python3/dist-packages/distributed/utils.py:438: in sync 4768s raise error 4768s /usr/lib/python3/dist-packages/distributed/utils.py:412: in f 4768s result = yield future 4768s /usr/lib/python3/dist-packages/tornado/gen.py:766: in run 4768s value = future.result() 4768s /usr/lib/python3/dist-packages/distributed/client.py:1299: in _start 4768s await self._ensure_connected(timeout=timeout) 4768s /usr/lib/python3/dist-packages/distributed/client.py:1361: in _ensure_connected 4768s comm = await connect( 4768s /usr/lib/python3/dist-packages/distributed/comm/core.py:342: in connect 4768s comm = await wait_for( 4768s /usr/lib/python3/dist-packages/distributed/utils.py:1960: in wait_for 4768s return await fut 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s 4768s self = 4768s address = '127.0.0.1:8786', deserialize = True 4768s connection_args = {'extra_conn_args': {}, 'require_encryption': False, 'ssl_context': } 4768s ip = '127.0.0.1', port = 8786 4768s kwargs = {'ssl_options': } 4768s 4768s async def connect(self, address, deserialize=True, **connection_args): 4768s self._check_encryption(address, connection_args) 4768s ip, port = parse_host_port(address) 4768s kwargs = self._get_connect_args(**connection_args) 4768s 4768s try: 4768s # server_hostname option (for SNI) only works with tornado.iostream.IOStream 4768s if "server_hostname" in kwargs: 4768s stream = await self.client.connect( 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE 4768s ) 4768s stream = await stream.start_tls(False, **kwargs) 4768s else: 4768s stream = await self.client.connect( 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ) 4768s 4768s # Under certain circumstances tornado will have a closed connection with an 4768s # error and not raise a StreamClosedError. 4768s # 4768s # This occurs with tornado 5.x and openssl 1.1+ 4768s if stream.closed() and stream.error: 4768s raise StreamClosedError(stream.error) 4768s 4768s except StreamClosedError as e: 4768s # The socket connect() call failed 4768s convert_stream_closed_error(self, e) 4768s except SSLCertVerificationError as err: 4768s > raise FatalCommClosedError( 4768s "TLS certificate does not match. Check your security settings. " 4768s "More info at https://distributed.dask.org/en/latest/tls.html" 4768s ) from err 4768s E distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 4768s 4768s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:561: FatalCommClosedError 4768s ----------------------------- Captured stderr call ----------------------------- 4768s 2024-11-23 21:35:54,371 - distributed.scheduler - INFO - ----------------------------------------------- 4768s 2024-11-23 21:35:54,398 - distributed.http.proxy - INFO - To route to workers diagnostics web server please install jupyter-server-proxy: python -m pip install jupyter-server-proxy 4768s 2024-11-23 21:35:54,402 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:35:54,410 - distributed.scheduler - INFO - ----------------------------------------------- 4768s 2024-11-23 21:35:54,413 - distributed.scheduler - INFO - Scheduler at: tls://10.0.4.73:8786 4768s 2024-11-23 21:35:54,413 - distributed.scheduler - INFO - dashboard at: http://10.0.4.73:8787/status 4768s 2024-11-23 21:35:54,414 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:35:54,432 - distributed.nanny - INFO - Start Nanny at: 'tls://127.0.0.1:41415' 4768s 2024-11-23 21:35:54,473 - distributed.comm.tcp - WARNING - Listener on 'tls://0.0.0.0:8786': TLS handshake failed with remote 'tls://127.0.0.1:51252': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1000) 4768s 2024-11-23 21:35:54,473 - distributed._signals - INFO - Received signal SIGINT (2) 4768s 2024-11-23 21:35:54,474 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:41415'. Reason: signal-2 4768s 2024-11-23 21:35:55,179 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38595 4768s 2024-11-23 21:35:55,180 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38595 4768s 2024-11-23 21:35:55,180 - distributed.worker - INFO - dashboard at: 127.0.0.1:34865 4768s 2024-11-23 21:35:55,180 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:8786 4768s 2024-11-23 21:35:55,180 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:35:55,180 - distributed.worker - INFO - Threads: 8 4768s 2024-11-23 21:35:55,180 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:35:55,180 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-0cc29h4u 4768s 2024-11-23 21:35:55,180 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:35:55,550 - distributed.scheduler - INFO - Register worker 4768s 2024-11-23 21:35:55,895 - distributed.scheduler - INFO - Starting worker compute stream, tls://127.0.0.1:38595 4768s 2024-11-23 21:35:55,895 - distributed.core - INFO - Starting established connection to tls://127.0.0.1:51268 4768s 2024-11-23 21:35:55,896 - distributed.worker - INFO - Starting Worker plugin shuffle 4768s 2024-11-23 21:35:55,897 - distributed.worker - INFO - Registered to: tls://127.0.0.1:8786 4768s 2024-11-23 21:35:55,897 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:35:55,899 - distributed.core - INFO - Starting established connection to tls://127.0.0.1:8786 4768s 2024-11-23 21:35:55,902 - distributed.nanny - INFO - Nanny asking worker to close. Reason: signal-2 4768s 2024-11-23 21:35:55,904 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38595. Reason: signal-2 4768s 2024-11-23 21:35:55,906 - distributed.core - INFO - Received 'close-stream' from tls://127.0.0.1:51268; closing. 4768s 2024-11-23 21:35:55,906 - distributed.core - INFO - Connection to tls://127.0.0.1:8786 has been closed. 4768s 2024-11-23 21:35:55,907 - distributed.scheduler - INFO - Remove worker (stimulus_id='handle-worker-cleanup-1732397755.9069395') 4768s 2024-11-23 21:35:55,907 - distributed.scheduler - INFO - Lost all workers 4768s 2024-11-23 21:35:55,910 - distributed.nanny - INFO - Worker closed 4768s 2024-11-23 21:35:56,238 - distributed.dask_worker - INFO - End worker 4768s 2024-11-23 21:35:56,493 - distributed._signals - INFO - Received signal SIGINT (2) 4768s 2024-11-23 21:35:56,493 - distributed.scheduler - INFO - Scheduler closing due to signal-2... 4768s 2024-11-23 21:35:56,494 - distributed.scheduler - INFO - Scheduler closing all comms 4768s 2024-11-23 21:35:56,495 - distributed.scheduler - INFO - Stopped scheduler at 'tls://10.0.4.73:8786' 4768s 2024-11-23 21:35:56,495 - distributed.scheduler - INFO - End scheduler 4768s ___________________________________ test_sni ___________________________________ 4768s 4768s self = 4768s address = '127.0.0.1:46485', deserialize = True 4768s connection_args = {'extra_conn_args': {}, 'require_encryption': False, 'ssl_context': } 4768s ip = '127.0.0.1', port = 46485 4768s kwargs = {'ssl_options': } 4768s 4768s async def connect(self, address, deserialize=True, **connection_args): 4768s self._check_encryption(address, connection_args) 4768s ip, port = parse_host_port(address) 4768s kwargs = self._get_connect_args(**connection_args) 4768s 4768s try: 4768s # server_hostname option (for SNI) only works with tornado.iostream.IOStream 4768s if "server_hostname" in kwargs: 4768s stream = await self.client.connect( 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE 4768s ) 4768s stream = await stream.start_tls(False, **kwargs) 4768s else: 4768s > stream = await self.client.connect( 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ) 4768s 4768s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:546: 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s /usr/lib/python3/dist-packages/tornado/tcpclient.py:292: in connect 4768s stream = await stream.start_tls( 4768s /usr/lib/python3/dist-packages/tornado/iostream.py:1367: in _do_ssl_handshake 4768s self.socket.do_handshake() 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s 4768s self = , block = False 4768s 4768s @_sslcopydoc 4768s def do_handshake(self, block=False): 4768s self._check_connected() 4768s timeout = self.gettimeout() 4768s try: 4768s if timeout == 0.0 and block: 4768s self.settimeout(None) 4768s > self._sslobj.do_handshake() 4768s E ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 4768s 4768s /usr/lib/python3.13/ssl.py:1372: SSLCertVerificationError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s loop = 4768s 4768s def test_sni(loop): 4768s port = open_port() 4768s with popen( 4768s ["dask", "scheduler", "--no-dashboard", f"--port={port}"] + tls_args 4768s ) as s: 4768s with popen( 4768s [ 4768s "dask", 4768s "worker", 4768s "--no-dashboard", 4768s "--scheduler-sni", 4768s "localhost", 4768s f"tls://127.0.0.1:{port}", 4768s ] 4768s + tls_args 4768s ) as w: 4768s > with Client( 4768s f"tls://127.0.0.1:{port}", loop=loop, security=tls_security() 4768s ) as c: 4768s 4768s /usr/lib/python3/dist-packages/distributed/cli/tests/test_tls_cli.py:58: 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s /usr/lib/python3/dist-packages/distributed/client.py:1018: in __init__ 4768s self.start(timeout=timeout) 4768s /usr/lib/python3/dist-packages/distributed/client.py:1220: in start 4768s sync(self.loop, self._start, **kwargs) 4768s /usr/lib/python3/dist-packages/distributed/utils.py:438: in sync 4768s raise error 4768s /usr/lib/python3/dist-packages/distributed/utils.py:412: in f 4768s result = yield future 4768s /usr/lib/python3/dist-packages/tornado/gen.py:766: in run 4768s value = future.result() 4768s /usr/lib/python3/dist-packages/distributed/client.py:1299: in _start 4768s await self._ensure_connected(timeout=timeout) 4768s /usr/lib/python3/dist-packages/distributed/client.py:1361: in _ensure_connected 4768s comm = await connect( 4768s /usr/lib/python3/dist-packages/distributed/comm/core.py:342: in connect 4768s comm = await wait_for( 4768s /usr/lib/python3/dist-packages/distributed/utils.py:1960: in wait_for 4768s return await fut 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s 4768s self = 4768s address = '127.0.0.1:46485', deserialize = True 4768s connection_args = {'extra_conn_args': {}, 'require_encryption': False, 'ssl_context': } 4768s ip = '127.0.0.1', port = 46485 4768s kwargs = {'ssl_options': } 4768s 4768s async def connect(self, address, deserialize=True, **connection_args): 4768s self._check_encryption(address, connection_args) 4768s ip, port = parse_host_port(address) 4768s kwargs = self._get_connect_args(**connection_args) 4768s 4768s try: 4768s # server_hostname option (for SNI) only works with tornado.iostream.IOStream 4768s if "server_hostname" in kwargs: 4768s stream = await self.client.connect( 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE 4768s ) 4768s stream = await stream.start_tls(False, **kwargs) 4768s else: 4768s stream = await self.client.connect( 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ) 4768s 4768s # Under certain circumstances tornado will have a closed connection with an 4768s # error and not raise a StreamClosedError. 4768s # 4768s # This occurs with tornado 5.x and openssl 1.1+ 4768s if stream.closed() and stream.error: 4768s raise StreamClosedError(stream.error) 4768s 4768s except StreamClosedError as e: 4768s # The socket connect() call failed 4768s convert_stream_closed_error(self, e) 4768s except SSLCertVerificationError as err: 4768s > raise FatalCommClosedError( 4768s "TLS certificate does not match. Check your security settings. " 4768s "More info at https://distributed.dask.org/en/latest/tls.html" 4768s ) from err 4768s E distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 4768s 4768s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:561: FatalCommClosedError 4768s ----------------------------- Captured stderr call ----------------------------- 4768s 2024-11-23 21:35:57,855 - distributed.scheduler - INFO - ----------------------------------------------- 4768s 2024-11-23 21:35:57,882 - distributed.http.proxy - INFO - To route to workers diagnostics web server please install jupyter-server-proxy: python -m pip install jupyter-server-proxy 4768s 2024-11-23 21:35:57,886 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:35:57,894 - distributed.scheduler - INFO - ----------------------------------------------- 4768s 2024-11-23 21:35:57,897 - distributed.scheduler - INFO - Scheduler at: tls://10.0.4.73:46485 4768s 2024-11-23 21:35:57,897 - distributed.scheduler - INFO - dashboard at: http://10.0.4.73:8787/status 4768s 2024-11-23 21:35:57,898 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:35:57,929 - distributed.nanny - INFO - Start Nanny at: 'tls://127.0.0.1:36863' 4768s 2024-11-23 21:35:58,044 - distributed.comm.tcp - WARNING - Listener on 'tls://0.0.0.0:46485': TLS handshake failed with remote 'tls://127.0.0.1:39378': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1000) 4768s 2024-11-23 21:35:58,044 - distributed._signals - INFO - Received signal SIGINT (2) 4768s 2024-11-23 21:35:58,045 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:36863'. Reason: signal-2 4768s 2024-11-23 21:35:58,676 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36539 4768s 2024-11-23 21:35:58,677 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36539 4768s 2024-11-23 21:35:58,677 - distributed.worker - INFO - dashboard at: 127.0.0.1:41089 4768s 2024-11-23 21:35:58,677 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46485 4768s 2024-11-23 21:35:58,677 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:35:58,677 - distributed.worker - INFO - Threads: 8 4768s 2024-11-23 21:35:58,677 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:35:58,677 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-gvqnt3m2 4768s 2024-11-23 21:35:58,677 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:35:59,043 - distributed.scheduler - INFO - Register worker 4768s 2024-11-23 21:35:59,386 - distributed.scheduler - INFO - Starting worker compute stream, tls://127.0.0.1:36539 4768s 2024-11-23 21:35:59,386 - distributed.core - INFO - Starting established connection to tls://127.0.0.1:39390 4768s 2024-11-23 21:35:59,387 - distributed.worker - INFO - Starting Worker plugin shuffle 4768s 2024-11-23 21:35:59,388 - distributed.worker - INFO - Registered to: tls://127.0.0.1:46485 4768s 2024-11-23 21:35:59,388 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:35:59,390 - distributed.core - INFO - Starting established connection to tls://127.0.0.1:46485 4768s 2024-11-23 21:35:59,399 - distributed.nanny - INFO - Nanny asking worker to close. Reason: signal-2 4768s 2024-11-23 21:35:59,400 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36539. Reason: signal-2 4768s 2024-11-23 21:35:59,403 - distributed.core - INFO - Connection to tls://127.0.0.1:46485 has been closed. 4768s 2024-11-23 21:35:59,404 - distributed.core - INFO - Received 'close-stream' from tls://127.0.0.1:39390; closing. 4768s 2024-11-23 21:35:59,405 - distributed.scheduler - INFO - Remove worker (stimulus_id='handle-worker-cleanup-1732397759.4050674') 4768s 2024-11-23 21:35:59,405 - distributed.scheduler - INFO - Lost all workers 4768s 2024-11-23 21:35:59,407 - distributed.nanny - INFO - Worker closed 4768s 2024-11-23 21:35:59,730 - distributed.dask_worker - INFO - End worker 4768s 2024-11-23 21:35:59,964 - distributed._signals - INFO - Received signal SIGINT (2) 4768s 2024-11-23 21:35:59,965 - distributed.scheduler - INFO - Scheduler closing due to signal-2... 4768s 2024-11-23 21:35:59,965 - distributed.scheduler - INFO - Scheduler closing all comms 4768s 2024-11-23 21:35:59,966 - distributed.scheduler - INFO - Stopped scheduler at 'tls://10.0.4.73:46485' 4768s 2024-11-23 21:35:59,967 - distributed.scheduler - INFO - End scheduler 4768s __________________________________ test_nanny __________________________________ 4768s 4768s self = 4768s address = '127.0.0.1:46661', deserialize = True 4768s connection_args = {'extra_conn_args': {}, 'require_encryption': False, 'ssl_context': } 4768s ip = '127.0.0.1', port = 46661 4768s kwargs = {'ssl_options': } 4768s 4768s async def connect(self, address, deserialize=True, **connection_args): 4768s self._check_encryption(address, connection_args) 4768s ip, port = parse_host_port(address) 4768s kwargs = self._get_connect_args(**connection_args) 4768s 4768s try: 4768s # server_hostname option (for SNI) only works with tornado.iostream.IOStream 4768s if "server_hostname" in kwargs: 4768s stream = await self.client.connect( 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE 4768s ) 4768s stream = await stream.start_tls(False, **kwargs) 4768s else: 4768s > stream = await self.client.connect( 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ) 4768s 4768s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:546: 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s /usr/lib/python3/dist-packages/tornado/tcpclient.py:292: in connect 4768s stream = await stream.start_tls( 4768s /usr/lib/python3/dist-packages/tornado/iostream.py:1367: in _do_ssl_handshake 4768s self.socket.do_handshake() 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s 4768s self = , block = False 4768s 4768s @_sslcopydoc 4768s def do_handshake(self, block=False): 4768s self._check_connected() 4768s timeout = self.gettimeout() 4768s try: 4768s if timeout == 0.0 and block: 4768s self.settimeout(None) 4768s > self._sslobj.do_handshake() 4768s E ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 4768s 4768s /usr/lib/python3.13/ssl.py:1372: SSLCertVerificationError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s loop = 4768s 4768s def test_nanny(loop): 4768s port = open_port() 4768s with popen( 4768s [ 4768s "dask", 4768s "scheduler", 4768s "--no-dashboard", 4768s f"--port={port}", 4768s ] 4768s + tls_args 4768s ) as s: 4768s with popen( 4768s ["dask", "worker", "--no-dashboard", "--nanny", f"tls://127.0.0.1:{port}"] 4768s + tls_args 4768s ) as w: 4768s > with Client( 4768s f"tls://127.0.0.1:{port}", loop=loop, security=tls_security() 4768s ) as c: 4768s 4768s /usr/lib/python3/dist-packages/distributed/cli/tests/test_tls_cli.py:79: 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s /usr/lib/python3/dist-packages/distributed/client.py:1018: in __init__ 4768s self.start(timeout=timeout) 4768s /usr/lib/python3/dist-packages/distributed/client.py:1220: in start 4768s sync(self.loop, self._start, **kwargs) 4768s /usr/lib/python3/dist-packages/distributed/utils.py:438: in sync 4768s raise error 4768s /usr/lib/python3/dist-packages/distributed/utils.py:412: in f 4768s result = yield future 4768s /usr/lib/python3/dist-packages/tornado/gen.py:766: in run 4768s value = future.result() 4768s /usr/lib/python3/dist-packages/distributed/client.py:1299: in _start 4768s await self._ensure_connected(timeout=timeout) 4768s /usr/lib/python3/dist-packages/distributed/client.py:1361: in _ensure_connected 4768s comm = await connect( 4768s /usr/lib/python3/dist-packages/distributed/comm/core.py:342: in connect 4768s comm = await wait_for( 4768s /usr/lib/python3/dist-packages/distributed/utils.py:1960: in wait_for 4768s return await fut 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s 4768s self = 4768s address = '127.0.0.1:46661', deserialize = True 4768s connection_args = {'extra_conn_args': {}, 'require_encryption': False, 'ssl_context': } 4768s ip = '127.0.0.1', port = 46661 4768s kwargs = {'ssl_options': } 4768s 4768s async def connect(self, address, deserialize=True, **connection_args): 4768s self._check_encryption(address, connection_args) 4768s ip, port = parse_host_port(address) 4768s kwargs = self._get_connect_args(**connection_args) 4768s 4768s try: 4768s # server_hostname option (for SNI) only works with tornado.iostream.IOStream 4768s if "server_hostname" in kwargs: 4768s stream = await self.client.connect( 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE 4768s ) 4768s stream = await stream.start_tls(False, **kwargs) 4768s else: 4768s stream = await self.client.connect( 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ) 4768s 4768s # Under certain circumstances tornado will have a closed connection with an 4768s # error and not raise a StreamClosedError. 4768s # 4768s # This occurs with tornado 5.x and openssl 1.1+ 4768s if stream.closed() and stream.error: 4768s raise StreamClosedError(stream.error) 4768s 4768s except StreamClosedError as e: 4768s # The socket connect() call failed 4768s convert_stream_closed_error(self, e) 4768s except SSLCertVerificationError as err: 4768s > raise FatalCommClosedError( 4768s "TLS certificate does not match. Check your security settings. " 4768s "More info at https://distributed.dask.org/en/latest/tls.html" 4768s ) from err 4768s E distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 4768s 4768s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:561: FatalCommClosedError 4768s ----------------------------- Captured stderr call ----------------------------- 4768s 2024-11-23 21:36:01,334 - distributed.scheduler - INFO - ----------------------------------------------- 4768s 2024-11-23 21:36:01,361 - distributed.http.proxy - INFO - To route to workers diagnostics web server please install jupyter-server-proxy: python -m pip install jupyter-server-proxy 4768s 2024-11-23 21:36:01,364 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:36:01,374 - distributed.scheduler - INFO - ----------------------------------------------- 4768s 2024-11-23 21:36:01,377 - distributed.scheduler - INFO - Scheduler at: tls://10.0.4.73:46661 4768s 2024-11-23 21:36:01,378 - distributed.scheduler - INFO - dashboard at: http://10.0.4.73:8787/status 4768s 2024-11-23 21:36:01,378 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:36:01,517 - distributed.nanny - INFO - Start Nanny at: 'tls://127.0.0.1:45503' 4768s 2024-11-23 21:36:02,099 - distributed.comm.tcp - WARNING - Listener on 'tls://0.0.0.0:46661': TLS handshake failed with remote 'tls://127.0.0.1:44566': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1000) 4768s 2024-11-23 21:36:02,100 - distributed._signals - INFO - Received signal SIGINT (2) 4768s 2024-11-23 21:36:02,101 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:45503'. Reason: signal-2 4768s 2024-11-23 21:36:02,222 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44143 4768s 2024-11-23 21:36:02,222 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44143 4768s 2024-11-23 21:36:02,223 - distributed.worker - INFO - dashboard at: 127.0.0.1:35917 4768s 2024-11-23 21:36:02,223 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46661 4768s 2024-11-23 21:36:02,223 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:36:02,223 - distributed.worker - INFO - Threads: 8 4768s 2024-11-23 21:36:02,223 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:36:02,223 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-2xi4fa4r 4768s 2024-11-23 21:36:02,223 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:36:02,572 - distributed.scheduler - INFO - Register worker 4768s 2024-11-23 21:36:02,903 - distributed.scheduler - INFO - Starting worker compute stream, tls://127.0.0.1:44143 4768s 2024-11-23 21:36:02,904 - distributed.core - INFO - Starting established connection to tls://127.0.0.1:44574 4768s 2024-11-23 21:36:02,904 - distributed.worker - INFO - Starting Worker plugin shuffle 4768s 2024-11-23 21:36:02,905 - distributed.worker - INFO - Registered to: tls://127.0.0.1:46661 4768s 2024-11-23 21:36:02,906 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:36:02,907 - distributed.core - INFO - Starting established connection to tls://127.0.0.1:46661 4768s 2024-11-23 21:36:02,936 - distributed.nanny - INFO - Nanny asking worker to close. Reason: signal-2 4768s 2024-11-23 21:36:02,937 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44143. Reason: signal-2 4768s 2024-11-23 21:36:02,940 - distributed.core - INFO - Received 'close-stream' from tls://127.0.0.1:44574; closing. 4768s 2024-11-23 21:36:02,940 - distributed.core - INFO - Connection to tls://127.0.0.1:46661 has been closed. 4768s 2024-11-23 21:36:02,941 - distributed.scheduler - INFO - Remove worker (stimulus_id='handle-worker-cleanup-1732397762.9410586') 4768s 2024-11-23 21:36:02,941 - distributed.scheduler - INFO - Lost all workers 4768s 2024-11-23 21:36:02,943 - distributed.nanny - INFO - Worker closed 4768s 2024-11-23 21:36:03,252 - distributed.dask_worker - INFO - End worker 4768s 2024-11-23 21:36:03,471 - distributed._signals - INFO - Received signal SIGINT (2) 4768s 2024-11-23 21:36:03,471 - distributed.scheduler - INFO - Scheduler closing due to signal-2... 4768s 2024-11-23 21:36:03,472 - distributed.scheduler - INFO - Scheduler closing all comms 4768s 2024-11-23 21:36:03,473 - distributed.scheduler - INFO - Stopped scheduler at 'tls://10.0.4.73:46661' 4768s 2024-11-23 21:36:03,473 - distributed.scheduler - INFO - End scheduler 4768s ____________________________ test_separate_key_cert ____________________________ 4768s 4768s self = 4768s address = '127.0.0.1:44723', deserialize = True 4768s connection_args = {'extra_conn_args': {}, 'require_encryption': False, 'ssl_context': } 4768s ip = '127.0.0.1', port = 44723 4768s kwargs = {'ssl_options': } 4768s 4768s async def connect(self, address, deserialize=True, **connection_args): 4768s self._check_encryption(address, connection_args) 4768s ip, port = parse_host_port(address) 4768s kwargs = self._get_connect_args(**connection_args) 4768s 4768s try: 4768s # server_hostname option (for SNI) only works with tornado.iostream.IOStream 4768s if "server_hostname" in kwargs: 4768s stream = await self.client.connect( 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE 4768s ) 4768s stream = await stream.start_tls(False, **kwargs) 4768s else: 4768s > stream = await self.client.connect( 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ) 4768s 4768s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:546: 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s /usr/lib/python3/dist-packages/tornado/tcpclient.py:292: in connect 4768s stream = await stream.start_tls( 4768s /usr/lib/python3/dist-packages/tornado/iostream.py:1367: in _do_ssl_handshake 4768s self.socket.do_handshake() 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s 4768s self = , block = False 4768s 4768s @_sslcopydoc 4768s def do_handshake(self, block=False): 4768s self._check_connected() 4768s timeout = self.gettimeout() 4768s try: 4768s if timeout == 0.0 and block: 4768s self.settimeout(None) 4768s > self._sslobj.do_handshake() 4768s E ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 4768s 4768s /usr/lib/python3.13/ssl.py:1372: SSLCertVerificationError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s loop = 4768s 4768s def test_separate_key_cert(loop): 4768s port = open_port() 4768s with popen( 4768s [ 4768s "dask", 4768s "scheduler", 4768s "--no-dashboard", 4768s f"--port={port}", 4768s ] 4768s + tls_args_2 4768s ) as s: 4768s with popen( 4768s ["dask", "worker", "--no-dashboard", f"tls://127.0.0.1:{port}"] + tls_args_2 4768s ) as w: 4768s > with Client( 4768s f"tls://127.0.0.1:{port}", loop=loop, security=tls_security() 4768s ) as c: 4768s 4768s /usr/lib/python3/dist-packages/distributed/cli/tests/test_tls_cli.py:99: 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s /usr/lib/python3/dist-packages/distributed/client.py:1018: in __init__ 4768s self.start(timeout=timeout) 4768s /usr/lib/python3/dist-packages/distributed/client.py:1220: in start 4768s sync(self.loop, self._start, **kwargs) 4768s /usr/lib/python3/dist-packages/distributed/utils.py:438: in sync 4768s raise error 4768s /usr/lib/python3/dist-packages/distributed/utils.py:412: in f 4768s result = yield future 4768s /usr/lib/python3/dist-packages/tornado/gen.py:766: in run 4768s value = future.result() 4768s /usr/lib/python3/dist-packages/distributed/client.py:1299: in _start 4768s await self._ensure_connected(timeout=timeout) 4768s /usr/lib/python3/dist-packages/distributed/client.py:1361: in _ensure_connected 4768s comm = await connect( 4768s /usr/lib/python3/dist-packages/distributed/comm/core.py:342: in connect 4768s comm = await wait_for( 4768s /usr/lib/python3/dist-packages/distributed/utils.py:1960: in wait_for 4768s return await fut 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s 4768s self = 4768s address = '127.0.0.1:44723', deserialize = True 4768s connection_args = {'extra_conn_args': {}, 'require_encryption': False, 'ssl_context': } 4768s ip = '127.0.0.1', port = 44723 4768s kwargs = {'ssl_options': } 4768s 4768s async def connect(self, address, deserialize=True, **connection_args): 4768s self._check_encryption(address, connection_args) 4768s ip, port = parse_host_port(address) 4768s kwargs = self._get_connect_args(**connection_args) 4768s 4768s try: 4768s # server_hostname option (for SNI) only works with tornado.iostream.IOStream 4768s if "server_hostname" in kwargs: 4768s stream = await self.client.connect( 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE 4768s ) 4768s stream = await stream.start_tls(False, **kwargs) 4768s else: 4768s stream = await self.client.connect( 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ) 4768s 4768s # Under certain circumstances tornado will have a closed connection with an 4768s # error and not raise a StreamClosedError. 4768s # 4768s # This occurs with tornado 5.x and openssl 1.1+ 4768s if stream.closed() and stream.error: 4768s raise StreamClosedError(stream.error) 4768s 4768s except StreamClosedError as e: 4768s # The socket connect() call failed 4768s convert_stream_closed_error(self, e) 4768s except SSLCertVerificationError as err: 4768s > raise FatalCommClosedError( 4768s "TLS certificate does not match. Check your security settings. " 4768s "More info at https://distributed.dask.org/en/latest/tls.html" 4768s ) from err 4768s E distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 4768s 4768s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:561: FatalCommClosedError 4768s ----------------------------- Captured stderr call ----------------------------- 4768s 2024-11-23 21:36:04,777 - distributed.scheduler - INFO - ----------------------------------------------- 4768s 2024-11-23 21:36:04,802 - distributed.http.proxy - INFO - To route to workers diagnostics web server please install jupyter-server-proxy: python -m pip install jupyter-server-proxy 4768s 2024-11-23 21:36:04,805 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:36:04,814 - distributed.scheduler - INFO - ----------------------------------------------- 4768s 2024-11-23 21:36:04,816 - distributed.scheduler - INFO - Scheduler at: tls://10.0.4.73:44723 4768s 2024-11-23 21:36:04,817 - distributed.scheduler - INFO - dashboard at: http://10.0.4.73:8787/status 4768s 2024-11-23 21:36:04,817 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:36:04,835 - distributed.nanny - INFO - Start Nanny at: 'tls://127.0.0.1:38859' 4768s 2024-11-23 21:36:05,016 - distributed.comm.tcp - WARNING - Listener on 'tls://0.0.0.0:44723': TLS handshake failed with remote 'tls://127.0.0.1:36690': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1000) 4768s 2024-11-23 21:36:05,017 - distributed._signals - INFO - Received signal SIGINT (2) 4768s 2024-11-23 21:36:05,017 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:38859'. Reason: signal-2 4768s 2024-11-23 21:36:05,549 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44201 4768s 2024-11-23 21:36:05,550 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44201 4768s 2024-11-23 21:36:05,550 - distributed.worker - INFO - dashboard at: 127.0.0.1:39609 4768s 2024-11-23 21:36:05,550 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44723 4768s 2024-11-23 21:36:05,550 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:36:05,550 - distributed.worker - INFO - Threads: 8 4768s 2024-11-23 21:36:05,550 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:36:05,550 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-nwjc70xz 4768s 2024-11-23 21:36:05,550 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:36:05,902 - distributed.scheduler - INFO - Register worker 4768s 2024-11-23 21:36:06,241 - distributed.scheduler - INFO - Starting worker compute stream, tls://127.0.0.1:44201 4768s 2024-11-23 21:36:06,242 - distributed.core - INFO - Starting established connection to tls://127.0.0.1:36696 4768s 2024-11-23 21:36:06,242 - distributed.worker - INFO - Starting Worker plugin shuffle 4768s 2024-11-23 21:36:06,243 - distributed.worker - INFO - Registered to: tls://127.0.0.1:44723 4768s 2024-11-23 21:36:06,244 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:36:06,245 - distributed.core - INFO - Starting established connection to tls://127.0.0.1:44723 4768s 2024-11-23 21:36:06,255 - distributed.nanny - INFO - Nanny asking worker to close. Reason: signal-2 4768s 2024-11-23 21:36:06,257 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44201. Reason: signal-2 4768s 2024-11-23 21:36:06,259 - distributed.core - INFO - Received 'close-stream' from tls://127.0.0.1:36696; closing. 4768s 2024-11-23 21:36:06,259 - distributed.core - INFO - Connection to tls://127.0.0.1:44723 has been closed. 4768s 2024-11-23 21:36:06,260 - distributed.scheduler - INFO - Remove worker (stimulus_id='handle-worker-cleanup-1732397766.2604535') 4768s 2024-11-23 21:36:06,261 - distributed.scheduler - INFO - Lost all workers 4768s 2024-11-23 21:36:06,262 - distributed.nanny - INFO - Worker closed 4768s 2024-11-23 21:36:06,558 - distributed.dask_worker - INFO - End worker 4768s 2024-11-23 21:36:06,786 - distributed._signals - INFO - Received signal SIGINT (2) 4768s 2024-11-23 21:36:06,787 - distributed.scheduler - INFO - Scheduler closing due to signal-2... 4768s 2024-11-23 21:36:06,787 - distributed.scheduler - INFO - Scheduler closing all comms 4768s 2024-11-23 21:36:06,788 - distributed.scheduler - INFO - Stopped scheduler at 'tls://10.0.4.73:44723' 4768s 2024-11-23 21:36:06,789 - distributed.scheduler - INFO - End scheduler 4768s _____________________________ test_use_config_file _____________________________ 4768s 4768s self = 4768s address = '127.0.0.1:41875', deserialize = True 4768s connection_args = {'extra_conn_args': {}, 'require_encryption': False, 'ssl_context': } 4768s ip = '127.0.0.1', port = 41875 4768s kwargs = {'ssl_options': } 4768s 4768s async def connect(self, address, deserialize=True, **connection_args): 4768s self._check_encryption(address, connection_args) 4768s ip, port = parse_host_port(address) 4768s kwargs = self._get_connect_args(**connection_args) 4768s 4768s try: 4768s # server_hostname option (for SNI) only works with tornado.iostream.IOStream 4768s if "server_hostname" in kwargs: 4768s stream = await self.client.connect( 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE 4768s ) 4768s stream = await stream.start_tls(False, **kwargs) 4768s else: 4768s > stream = await self.client.connect( 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ) 4768s 4768s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:546: 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s /usr/lib/python3/dist-packages/tornado/tcpclient.py:292: in connect 4768s stream = await stream.start_tls( 4768s /usr/lib/python3/dist-packages/tornado/iostream.py:1367: in _do_ssl_handshake 4768s self.socket.do_handshake() 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s 4768s self = , block = False 4768s 4768s @_sslcopydoc 4768s def do_handshake(self, block=False): 4768s self._check_connected() 4768s timeout = self.gettimeout() 4768s try: 4768s if timeout == 0.0 and block: 4768s self.settimeout(None) 4768s > self._sslobj.do_handshake() 4768s E ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 4768s 4768s /usr/lib/python3.13/ssl.py:1372: SSLCertVerificationError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s loop = 4768s 4768s def test_use_config_file(loop): 4768s port = open_port() 4768s with new_config_file(tls_only_config()): 4768s with popen( 4768s [ 4768s "dask", 4768s "scheduler", 4768s "--no-dashboard", 4768s "--host", 4768s "tls://", 4768s "--port", 4768s str(port), 4768s ] 4768s ) as s: 4768s with popen( 4768s ["dask", "worker", "--no-dashboard", f"tls://127.0.0.1:{port}"] 4768s ) as w: 4768s > with Client( 4768s f"tls://127.0.0.1:{port}", loop=loop, security=tls_security() 4768s ) as c: 4768s 4768s /usr/lib/python3/dist-packages/distributed/cli/tests/test_tls_cli.py:122: 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s /usr/lib/python3/dist-packages/distributed/client.py:1018: in __init__ 4768s self.start(timeout=timeout) 4768s /usr/lib/python3/dist-packages/distributed/client.py:1220: in start 4768s sync(self.loop, self._start, **kwargs) 4768s /usr/lib/python3/dist-packages/distributed/utils.py:438: in sync 4768s raise error 4768s /usr/lib/python3/dist-packages/distributed/utils.py:412: in f 4768s result = yield future 4768s /usr/lib/python3/dist-packages/tornado/gen.py:766: in run 4768s value = future.result() 4768s /usr/lib/python3/dist-packages/distributed/client.py:1299: in _start 4768s await self._ensure_connected(timeout=timeout) 4768s /usr/lib/python3/dist-packages/distributed/client.py:1361: in _ensure_connected 4768s comm = await connect( 4768s /usr/lib/python3/dist-packages/distributed/comm/core.py:342: in connect 4768s comm = await wait_for( 4768s /usr/lib/python3/dist-packages/distributed/utils.py:1960: in wait_for 4768s return await fut 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s 4768s self = 4768s address = '127.0.0.1:41875', deserialize = True 4768s connection_args = {'extra_conn_args': {}, 'require_encryption': False, 'ssl_context': } 4768s ip = '127.0.0.1', port = 41875 4768s kwargs = {'ssl_options': } 4768s 4768s async def connect(self, address, deserialize=True, **connection_args): 4768s self._check_encryption(address, connection_args) 4768s ip, port = parse_host_port(address) 4768s kwargs = self._get_connect_args(**connection_args) 4768s 4768s try: 4768s # server_hostname option (for SNI) only works with tornado.iostream.IOStream 4768s if "server_hostname" in kwargs: 4768s stream = await self.client.connect( 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE 4768s ) 4768s stream = await stream.start_tls(False, **kwargs) 4768s else: 4768s stream = await self.client.connect( 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ) 4768s 4768s # Under certain circumstances tornado will have a closed connection with an 4768s # error and not raise a StreamClosedError. 4768s # 4768s # This occurs with tornado 5.x and openssl 1.1+ 4768s if stream.closed() and stream.error: 4768s raise StreamClosedError(stream.error) 4768s 4768s except StreamClosedError as e: 4768s # The socket connect() call failed 4768s convert_stream_closed_error(self, e) 4768s except SSLCertVerificationError as err: 4768s > raise FatalCommClosedError( 4768s "TLS certificate does not match. Check your security settings. " 4768s "More info at https://distributed.dask.org/en/latest/tls.html" 4768s ) from err 4768s E distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 4768s 4768s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:561: FatalCommClosedError 4768s ----------------------------- Captured stderr call ----------------------------- 4768s 2024-11-23 21:36:08,146 - distributed.scheduler - INFO - ----------------------------------------------- 4768s 2024-11-23 21:36:08,172 - distributed.http.proxy - INFO - To route to workers diagnostics web server please install jupyter-server-proxy: python -m pip install jupyter-server-proxy 4768s 2024-11-23 21:36:08,176 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:36:08,185 - distributed.scheduler - INFO - ----------------------------------------------- 4768s 2024-11-23 21:36:08,187 - distributed.scheduler - INFO - Scheduler at: tls://10.0.4.73:41875 4768s 2024-11-23 21:36:08,188 - distributed.scheduler - INFO - dashboard at: http://10.0.4.73:8787/status 4768s 2024-11-23 21:36:08,188 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:36:08,228 - distributed.nanny - INFO - Start Nanny at: 'tls://127.0.0.1:40575' 4768s 2024-11-23 21:36:08,994 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45629 4768s 2024-11-23 21:36:08,994 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45629 4768s 2024-11-23 21:36:08,994 - distributed.worker - INFO - dashboard at: 127.0.0.1:40709 4768s 2024-11-23 21:36:08,994 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41875 4768s 2024-11-23 21:36:08,994 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:36:08,994 - distributed.worker - INFO - Threads: 8 4768s 2024-11-23 21:36:08,994 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:36:08,994 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-sp8yhw8r 4768s 2024-11-23 21:36:08,995 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:36:09,368 - distributed.scheduler - INFO - Register worker 4768s 2024-11-23 21:36:09,719 - distributed.scheduler - INFO - Starting worker compute stream, tls://127.0.0.1:45629 4768s 2024-11-23 21:36:09,719 - distributed.core - INFO - Starting established connection to tls://127.0.0.1:37254 4768s 2024-11-23 21:36:09,720 - distributed.worker - INFO - Starting Worker plugin shuffle 4768s 2024-11-23 21:36:09,721 - distributed.worker - INFO - Registered to: tls://127.0.0.1:41875 4768s 2024-11-23 21:36:09,722 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:36:09,723 - distributed.core - INFO - Starting established connection to tls://127.0.0.1:41875 4768s 2024-11-23 21:36:09,730 - distributed.comm.tcp - WARNING - Listener on 'tls://0.0.0.0:41875': TLS handshake failed with remote 'tls://127.0.0.1:37260': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1000) 4768s 2024-11-23 21:36:09,731 - distributed._signals - INFO - Received signal SIGINT (2) 4768s 2024-11-23 21:36:09,731 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:40575'. Reason: signal-2 4768s 2024-11-23 21:36:09,747 - distributed.nanny - INFO - Nanny asking worker to close. Reason: signal-2 4768s 2024-11-23 21:36:09,748 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45629. Reason: signal-2 4768s 2024-11-23 21:36:09,751 - distributed.core - INFO - Received 'close-stream' from tls://127.0.0.1:37254; closing. 4768s 2024-11-23 21:36:09,751 - distributed.core - INFO - Connection to tls://127.0.0.1:41875 has been closed. 4768s 2024-11-23 21:36:09,751 - distributed.scheduler - INFO - Remove worker (stimulus_id='handle-worker-cleanup-1732397769.751662') 4768s 2024-11-23 21:36:09,752 - distributed.scheduler - INFO - Lost all workers 4768s 2024-11-23 21:36:09,754 - distributed.nanny - INFO - Worker closed 4768s 2024-11-23 21:36:10,094 - distributed.dask_worker - INFO - End worker 4768s 2024-11-23 21:36:10,348 - distributed._signals - INFO - Received signal SIGINT (2) 4768s 2024-11-23 21:36:10,348 - distributed.scheduler - INFO - Scheduler closing due to signal-2... 4768s 2024-11-23 21:36:10,349 - distributed.scheduler - INFO - Scheduler closing all comms 4768s 2024-11-23 21:36:10,350 - distributed.scheduler - INFO - Stopped scheduler at 'tls://10.0.4.73:41875' 4768s 2024-11-23 21:36:10,350 - distributed.scheduler - INFO - End scheduler 4768s __________________________________ test_basic __________________________________ 4768s 4768s @pytest.mark.skipif(WINDOWS, reason="distributed#7434") 4768s @gen_test() 4768s async def test_basic(): 4768s async with SubprocessCluster( 4768s asynchronous=True, 4768s dashboard_address=":0", 4768s scheduler_kwargs={"idle_timeout": "5s"}, 4768s worker_kwargs={"death_timeout": "5s"}, 4768s ) as cluster: 4768s async with Client(cluster, asynchronous=True) as client: 4768s > result = await client.submit(lambda x: x + 1, 10) 4768s 4768s /usr/lib/python3/dist-packages/distributed/deploy/tests/test_subprocess.py:27: 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s 4768s self = 4768s raiseit = True 4768s 4768s async def _result(self, raiseit=True): 4768s await self._state.wait() 4768s if self.status == "error": 4768s exc = clean_exception(self._state.exception, self._state.traceback) 4768s if raiseit: 4768s typ, exc, tb = exc 4768s > raise exc.with_traceback(tb) 4768s E SystemError: no locals found when setting up annotations 4768s 4768s /usr/lib/python3/dist-packages/distributed/client.py:337: SystemError 4768s ----------------------------- Captured stderr call ----------------------------- 4768s 2024-11-23 21:36:13,652 - distributed.worker - WARNING - Compute Failed 4768s Key: lambda-f3b41d234e8d3805a39c193d3564145c 4768s Function: lambda 4768s args: (10) 4768s kwargs: {} 4768s Exception: "SystemError('no locals found when setting up annotations')" 4768s 4768s ________________________________ test_n_workers ________________________________ 4768s 4768s @pytest.mark.skipif(WINDOWS, reason="distributed#7434") 4768s @gen_test() 4768s async def test_n_workers(): 4768s async with SubprocessCluster( 4768s asynchronous=True, dashboard_address=":0", n_workers=2 4768s ) as cluster: 4768s async with Client(cluster, asynchronous=True) as client: 4768s assert len(cluster.workers) == 2 4768s > result = await client.submit(lambda x: x + 1, 10) 4768s 4768s /usr/lib/python3/dist-packages/distributed/deploy/tests/test_subprocess.py:41: 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s 4768s self = 4768s raiseit = True 4768s 4768s async def _result(self, raiseit=True): 4768s await self._state.wait() 4768s if self.status == "error": 4768s exc = clean_exception(self._state.exception, self._state.traceback) 4768s if raiseit: 4768s typ, exc, tb = exc 4768s > raise exc.with_traceback(tb) 4768s E SystemError: no locals found when setting up annotations 4768s 4768s /usr/lib/python3/dist-packages/distributed/client.py:337: SystemError 4768s ----------------------------- Captured stderr call ----------------------------- 4768s 2024-11-23 21:36:16,391 - distributed.worker - WARNING - Compute Failed 4768s Key: lambda-181b28c0c705f6e48fbf22b0c3a995c6 4768s Function: lambda 4768s args: (10) 4768s kwargs: {} 4768s Exception: "SystemError('no locals found when setting up annotations')" 4768s 4768s _____________________________ test_upload_file_zip _____________________________ 4768s 4768s c = 4768s s = 4768s a = 4768s b = 4768s 4768s @gen_cluster(client=True) 4768s async def test_upload_file_zip(c, s, a, b): 4768s def g(): 4768s import myfile 4768s 4768s return myfile.f() 4768s 4768s with save_sys_modules(): 4768s try: 4768s for value in [123, 456]: 4768s with tmp_text( 4768s "myfile.py", f"def f():\n return {value}" 4768s ) as fn_my_file: 4768s with zipfile.ZipFile("myfile.zip", "w") as z: 4768s z.write(fn_my_file, arcname=os.path.basename(fn_my_file)) 4768s > await c.upload_file("myfile.zip") 4768s 4768s /usr/lib/python3/dist-packages/distributed/tests/test_client.py:1716: 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s /usr/lib/python3/dist-packages/distributed/client.py:3824: in _ 4768s results = await asyncio.gather( 4768s /usr/lib/python3/dist-packages/distributed/client.py:4939: in _register_scheduler_plugin 4768s return await self.scheduler.register_scheduler_plugin( 4768s /usr/lib/python3/dist-packages/distributed/core.py:1395: in send_recv_from_rpc 4768s return await send_recv(comm=comm, op=key, **kwargs) 4768s /usr/lib/python3/dist-packages/distributed/core.py:1179: in send_recv 4768s raise exc.with_traceback(tb) 4768s /usr/lib/python3/dist-packages/distributed/core.py:970: in _handle_comm 4768s result = await result 4768s /usr/lib/python3/dist-packages/distributed/scheduler.py:6035: in register_scheduler_plugin 4768s await result 4768s /usr/lib/python3/dist-packages/distributed/diagnostics/plugin.py:396: in start 4768s await scheduler.upload_file(self.filename, self.data, load=self.load) 4768s /usr/lib/python3/dist-packages/distributed/core.py:563: in upload_file 4768s raise e 4768s /usr/lib/python3/dist-packages/distributed/core.py:560: in upload_file 4768s import_file(out_filename) 4768s /usr/lib/python3/dist-packages/distributed/utils.py:1162: in import_file 4768s names_to_import.extend(names) 4768s /usr/lib/python3/dist-packages/distributed/utils.py:1161: in 4768s names = (mod_info.name for mod_info in pkgutil.iter_modules([path])) 4768s /usr/lib/python3.13/pkgutil.py:116: in iter_modules 4768s for name, ispkg in iter_importer_modules(i, prefix): 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s 4768s """Utilities to support packages.""" 4768s 4768s from collections import namedtuple 4768s from functools import singledispatch as simplegeneric 4768s import importlib 4768s import importlib.util 4768s import importlib.machinery 4768s import os 4768s import os.path 4768s import sys 4768s from types import ModuleType 4768s import warnings 4768s 4768s __all__ = [ 4768s 'get_importer', 'iter_importers', 'get_loader', 'find_loader', 4768s 'walk_packages', 'iter_modules', 'get_data', 4768s 'read_code', 'extend_path', 4768s 'ModuleInfo', 4768s ] 4768s 4768s 4768s ModuleInfo = namedtuple('ModuleInfo', 'module_finder name ispkg') 4768s ModuleInfo.__doc__ = 'A namedtuple with minimal info about a module.' 4768s 4768s 4768s def read_code(stream): 4768s # This helper is needed in order for the PEP 302 emulation to 4768s # correctly handle compiled files 4768s import marshal 4768s 4768s magic = stream.read(4) 4768s if magic != importlib.util.MAGIC_NUMBER: 4768s return None 4768s 4768s stream.read(12) # Skip rest of the header 4768s return marshal.load(stream) 4768s 4768s 4768s def walk_packages(path=None, prefix='', onerror=None): 4768s """Yields ModuleInfo for all modules recursively 4768s on path, or, if path is None, all accessible modules. 4768s 4768s 'path' should be either None or a list of paths to look for 4768s modules in. 4768s 4768s 'prefix' is a string to output on the front of every module name 4768s on output. 4768s 4768s Note that this function must import all *packages* (NOT all 4768s modules!) on the given path, in order to access the __path__ 4768s attribute to find submodules. 4768s 4768s 'onerror' is a function which gets called with one argument (the 4768s name of the package which was being imported) if any exception 4768s occurs while trying to import a package. If no onerror function is 4768s supplied, ImportErrors are caught and ignored, while all other 4768s exceptions are propagated, terminating the search. 4768s 4768s Examples: 4768s 4768s # list all modules python can access 4768s walk_packages() 4768s 4768s # list all submodules of ctypes 4768s walk_packages(ctypes.__path__, ctypes.__name__+'.') 4768s """ 4768s 4768s def seen(p, m={}): 4768s if p in m: 4768s return True 4768s m[p] = True 4768s 4768s for info in iter_modules(path, prefix): 4768s yield info 4768s 4768s if info.ispkg: 4768s try: 4768s __import__(info.name) 4768s except ImportError: 4768s if onerror is not None: 4768s onerror(info.name) 4768s except Exception: 4768s if onerror is not None: 4768s onerror(info.name) 4768s else: 4768s raise 4768s else: 4768s path = getattr(sys.modules[info.name], '__path__', None) or [] 4768s 4768s # don't traverse path items we've seen before 4768s path = [p for p in path if not seen(p)] 4768s 4768s yield from walk_packages(path, info.name+'.', onerror) 4768s 4768s 4768s def iter_modules(path=None, prefix=''): 4768s """Yields ModuleInfo for all submodules on path, 4768s or, if path is None, all top-level modules on sys.path. 4768s 4768s 'path' should be either None or a list of paths to look for 4768s modules in. 4768s 4768s 'prefix' is a string to output on the front of every module name 4768s on output. 4768s """ 4768s if path is None: 4768s importers = iter_importers() 4768s elif isinstance(path, str): 4768s raise ValueError("path must be None or list of paths to look for " 4768s "modules in") 4768s else: 4768s importers = map(get_importer, path) 4768s 4768s yielded = {} 4768s for i in importers: 4768s for name, ispkg in iter_importer_modules(i, prefix): 4768s if name not in yielded: 4768s yielded[name] = 1 4768s yield ModuleInfo(i, name, ispkg) 4768s 4768s 4768s @simplegeneric 4768s def iter_importer_modules(importer, prefix=''): 4768s if not hasattr(importer, 'iter_modules'): 4768s return [] 4768s return importer.iter_modules(prefix) 4768s 4768s 4768s # Implement a file walker for the normal importlib path hook 4768s def _iter_file_finder_modules(importer, prefix=''): 4768s if importer.path is None or not os.path.isdir(importer.path): 4768s return 4768s 4768s yielded = {} 4768s import inspect 4768s try: 4768s filenames = os.listdir(importer.path) 4768s except OSError: 4768s # ignore unreadable directories like import does 4768s filenames = [] 4768s filenames.sort() # handle packages before same-named modules 4768s 4768s for fn in filenames: 4768s modname = inspect.getmodulename(fn) 4768s if modname=='__init__' or modname in yielded: 4768s continue 4768s 4768s path = os.path.join(importer.path, fn) 4768s ispkg = False 4768s 4768s if not modname and os.path.isdir(path) and '.' not in fn: 4768s modname = fn 4768s try: 4768s dircontents = os.listdir(path) 4768s except OSError: 4768s # ignore unreadable directories like import does 4768s dircontents = [] 4768s for fn in dircontents: 4768s subname = inspect.getmodulename(fn) 4768s if subname=='__init__': 4768s ispkg = True 4768s break 4768s else: 4768s continue # not a package 4768s 4768s if modname and '.' not in modname: 4768s yielded[modname] = 1 4768s yield prefix + modname, ispkg 4768s 4768s iter_importer_modules.register( 4768s importlib.machinery.FileFinder, _iter_file_finder_modules) 4768s 4768s 4768s try: 4768s import zipimport 4768s from zipimport import zipimporter 4768s 4768s def iter_zipimport_modules(importer, prefix=''): 4768s > dirlist = sorted(zipimport._zip_directory_cache[importer.archive]) 4768s E KeyError: '/tmp/dask-scratch-space/scheduler-i9w7e1_c/myfile.zip' 4768s 4768s /usr/lib/python3.13/pkgutil.py:179: KeyError 4768s ----------------------------- Captured stdout call ----------------------------- 4768s Dumped cluster state to test_cluster_dump/test_upload_file_zip.yaml 4768s ----------------------------- Captured stderr call ----------------------------- 4768s 2024-11-23 21:36:16,556 - distributed.http.proxy - INFO - To route to workers diagnostics web server please install jupyter-server-proxy: python -m pip install jupyter-server-proxy 4768s 2024-11-23 21:36:16,559 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:36:16,560 - distributed.diskutils - INFO - Found stale lock file and directory '/tmp/dask-scratch-space/worker-ty7rd_r2', purging 4768s 2024-11-23 21:36:16,561 - distributed.diskutils - INFO - Found stale lock file and directory '/tmp/dask-scratch-space/worker-m7mj4tgy', purging 4768s 2024-11-23 21:36:16,567 - distributed.scheduler - INFO - Scheduler at: tcp://127.0.0.1:42029 4768s 2024-11-23 21:36:16,567 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40201/status 4768s 2024-11-23 21:36:16,568 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:36:16,584 - distributed.worker - INFO - Start worker at: tcp://127.0.0.1:44271 4768s 2024-11-23 21:36:16,584 - distributed.worker - INFO - Listening to: tcp://127.0.0.1:44271 4768s 2024-11-23 21:36:16,584 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:36:16,585 - distributed.worker - INFO - dashboard at: 127.0.0.1:34157 4768s 2024-11-23 21:36:16,585 - distributed.worker - INFO - Waiting to connect to: tcp://127.0.0.1:42029 4768s 2024-11-23 21:36:16,585 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:36:16,585 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:36:16,585 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:36:16,585 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-cbo8xsvq 4768s 2024-11-23 21:36:16,585 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:36:16,587 - distributed.worker - INFO - Start worker at: tcp://127.0.0.1:34065 4768s 2024-11-23 21:36:16,587 - distributed.worker - INFO - Listening to: tcp://127.0.0.1:34065 4768s 2024-11-23 21:36:16,587 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:36:16,587 - distributed.worker - INFO - dashboard at: 127.0.0.1:38145 4768s 2024-11-23 21:36:16,587 - distributed.worker - INFO - Waiting to connect to: tcp://127.0.0.1:42029 4768s 2024-11-23 21:36:16,587 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:36:16,587 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:36:16,587 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:36:16,587 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-n44ooqwi 4768s 2024-11-23 21:36:16,587 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:36:16,593 - distributed.scheduler - INFO - Register worker 4768s 2024-11-23 21:36:16,594 - distributed.scheduler - INFO - Starting worker compute stream, tcp://127.0.0.1:44271 4768s 2024-11-23 21:36:16,594 - distributed.core - INFO - Starting established connection to tcp://127.0.0.1:54146 4768s 2024-11-23 21:36:16,595 - distributed.scheduler - INFO - Register worker 4768s 2024-11-23 21:36:16,596 - distributed.scheduler - INFO - Starting worker compute stream, tcp://127.0.0.1:34065 4768s 2024-11-23 21:36:16,596 - distributed.core - INFO - Starting established connection to tcp://127.0.0.1:54148 4768s 2024-11-23 21:36:16,597 - distributed.worker - INFO - Starting Worker plugin shuffle 4768s 2024-11-23 21:36:16,597 - distributed.worker - INFO - Starting Worker plugin shuffle 4768s 2024-11-23 21:36:16,598 - distributed.worker - INFO - Registered to: tcp://127.0.0.1:42029 4768s 2024-11-23 21:36:16,598 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:36:16,598 - distributed.worker - INFO - Registered to: tcp://127.0.0.1:42029 4768s 2024-11-23 21:36:16,598 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:36:16,599 - distributed.core - INFO - Starting established connection to tcp://127.0.0.1:42029 4768s 2024-11-23 21:36:16,600 - distributed.core - INFO - Starting established connection to tcp://127.0.0.1:42029 4768s 2024-11-23 21:36:16,606 - distributed.scheduler - INFO - Receive client connection: Client-f85820f7-a9e2-11ef-bb5a-00163e4db70f 4768s 2024-11-23 21:36:16,607 - distributed.core - INFO - Starting established connection to tcp://127.0.0.1:54160 4768s 2024-11-23 21:36:16,614 - distributed.utils - INFO - Reload module myfile from .zip file 4768s 2024-11-23 21:36:16,617 - distributed.scheduler - INFO - Registering Worker plugin myfile.zipb111453a-e7fa-4fd6-a791-56f8e1a7176c 4768s 2024-11-23 21:36:16,621 - distributed.worker - INFO - Starting Worker plugin myfile.zipb111453a-e7fa-4fd6-a791-56f8e1a7176c 4768s 2024-11-23 21:36:16,623 - distributed.utils - INFO - Reload module myfile from .zip file 4768s 2024-11-23 21:36:16,625 - distributed.worker - INFO - Starting Worker plugin myfile.zipb111453a-e7fa-4fd6-a791-56f8e1a7176c 4768s 2024-11-23 21:36:16,627 - distributed.utils - INFO - Reload module myfile from .zip file 4768s 2024-11-23 21:36:16,646 - distributed.core - ERROR - '/tmp/dask-scratch-space/scheduler-i9w7e1_c/myfile.zip' 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 560, in upload_file 4768s import_file(out_filename) 4768s ~~~~~~~~~~~^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1162, in import_file 4768s names_to_import.extend(names) 4768s ~~~~~~~~~~~~~~~~~~~~~~^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1161, in 4768s names = (mod_info.name for mod_info in pkgutil.iter_modules([path])) 4768s ~~~~~~~~~~~~~~~~~~~~^^^^^^^^ 4768s File "/usr/lib/python3.13/pkgutil.py", line 116, in iter_modules 4768s for name, ispkg in iter_importer_modules(i, prefix): 4768s ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^ 4768s File "/usr/lib/python3.13/pkgutil.py", line 179, in iter_zipimport_modules 4768s dirlist = sorted(zipimport._zip_directory_cache[importer.archive]) 4768s ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^ 4768s KeyError: '/tmp/dask-scratch-space/scheduler-i9w7e1_c/myfile.zip' 4768s 2024-11-23 21:36:16,648 - distributed.core - ERROR - Exception while handling op register_scheduler_plugin 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 970, in _handle_comm 4768s result = await result 4768s ^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/scheduler.py", line 6035, in register_scheduler_plugin 4768s await result 4768s File "/usr/lib/python3/dist-packages/distributed/diagnostics/plugin.py", line 396, in start 4768s await scheduler.upload_file(self.filename, self.data, load=self.load) 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 563, in upload_file 4768s raise e 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 560, in upload_file 4768s import_file(out_filename) 4768s ~~~~~~~~~~~^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1162, in import_file 4768s names_to_import.extend(names) 4768s ~~~~~~~~~~~~~~~~~~~~~~^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1161, in 4768s names = (mod_info.name for mod_info in pkgutil.iter_modules([path])) 4768s ~~~~~~~~~~~~~~~~~~~~^^^^^^^^ 4768s File "/usr/lib/python3.13/pkgutil.py", line 116, in iter_modules 4768s for name, ispkg in iter_importer_modules(i, prefix): 4768s ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^ 4768s File "/usr/lib/python3.13/pkgutil.py", line 179, in iter_zipimport_modules 4768s dirlist = sorted(zipimport._zip_directory_cache[importer.archive]) 4768s ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^ 4768s KeyError: '/tmp/dask-scratch-space/scheduler-i9w7e1_c/myfile.zip' 4768s 2024-11-23 21:36:16,656 - distributed.scheduler - INFO - Registering Worker plugin myfile.zipde21670f-d51a-45ff-8b04-35a477b5b0e1 4768s 2024-11-23 21:36:16,660 - distributed.worker - INFO - Starting Worker plugin myfile.zipde21670f-d51a-45ff-8b04-35a477b5b0e1 4768s 2024-11-23 21:36:16,661 - distributed.core - ERROR - '/tmp/dask-scratch-space/worker-n44ooqwi/myfile.zip' 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 560, in upload_file 4768s import_file(out_filename) 4768s ~~~~~~~~~~~^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1162, in import_file 4768s names_to_import.extend(names) 4768s ~~~~~~~~~~~~~~~~~~~~~~^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1161, in 4768s names = (mod_info.name for mod_info in pkgutil.iter_modules([path])) 4768s ~~~~~~~~~~~~~~~~~~~~^^^^^^^^ 4768s File "/usr/lib/python3.13/pkgutil.py", line 116, in iter_modules 4768s for name, ispkg in iter_importer_modules(i, prefix): 4768s ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^ 4768s File "/usr/lib/python3.13/pkgutil.py", line 179, in iter_zipimport_modules 4768s dirlist = sorted(zipimport._zip_directory_cache[importer.archive]) 4768s ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^ 4768s KeyError: '/tmp/dask-scratch-space/worker-n44ooqwi/myfile.zip' 4768s 2024-11-23 21:36:16,735 - distributed.worker - INFO - Starting Worker plugin myfile.zipde21670f-d51a-45ff-8b04-35a477b5b0e1 4768s 2024-11-23 21:36:16,738 - distributed.utils - INFO - Reload module myfile from .zip file 4768s 2024-11-23 21:36:16,741 - distributed.scheduler - INFO - Remove client Client-f85820f7-a9e2-11ef-bb5a-00163e4db70f 4768s 2024-11-23 21:36:16,742 - distributed.core - INFO - Received 'close-stream' from tcp://127.0.0.1:54160; closing. 4768s 2024-11-23 21:36:16,742 - distributed.scheduler - INFO - Remove client Client-f85820f7-a9e2-11ef-bb5a-00163e4db70f 4768s 2024-11-23 21:36:16,744 - distributed.scheduler - INFO - Close client connection: Client-f85820f7-a9e2-11ef-bb5a-00163e4db70f 4768s 2024-11-23 21:36:16,746 - distributed.worker - INFO - Stopping worker at tcp://127.0.0.1:44271. Reason: worker-close 4768s 2024-11-23 21:36:16,746 - distributed.worker - INFO - Stopping worker at tcp://127.0.0.1:34065. Reason: worker-close 4768s 2024-11-23 21:36:16,749 - distributed.core - INFO - Received 'close-stream' from tcp://127.0.0.1:54148; closing. 4768s 2024-11-23 21:36:16,750 - distributed.scheduler - INFO - Remove worker (stimulus_id='handle-worker-cleanup-1732397776.7505355') 4768s 2024-11-23 21:36:16,751 - distributed.core - INFO - Connection to tcp://127.0.0.1:42029 has been closed. 4768s 2024-11-23 21:36:16,754 - distributed.core - INFO - Connection to tcp://127.0.0.1:42029 has been closed. 4768s 2024-11-23 21:36:16,755 - distributed.core - INFO - Received 'close-stream' from tcp://127.0.0.1:54146; closing. 4768s 2024-11-23 21:36:16,755 - distributed.scheduler - INFO - Remove worker (stimulus_id='handle-worker-cleanup-1732397776.7558768') 4768s 2024-11-23 21:36:16,756 - distributed.scheduler - INFO - Lost all workers 4768s 2024-11-23 21:36:16,759 - distributed.scheduler - INFO - Scheduler closing due to unknown reason... 4768s 2024-11-23 21:36:16,759 - distributed.scheduler - INFO - Scheduler closing all comms 4768s ________________________ test_info_frame_f_lineno[22-4] ________________________ 4768s 4768s f_lasti = 22, f_lineno = 4 4768s 4768s @pytest.mark.parametrize( 4768s "f_lasti,f_lineno", 4768s [ 4768s (-1, 1), 4768s (0, 2), 4768s (1, 2), 4768s (11, 2), 4768s (12, 3), 4768s (21, 4), 4768s (22, 4), 4768s (23, 4), 4768s (24, 2), 4768s (25, 2), 4768s (26, 2), 4768s (27, 2), 4768s (100, 2), 4768s ], 4768s ) 4768s def test_info_frame_f_lineno(f_lasti: int, f_lineno: int) -> None: 4768s > assert info_frame(FakeFrame(f_lasti=f_lasti, f_code=FAKE_CODE)) == { # type: ignore 4768s "filename": "", 4768s "name": "example", 4768s "line_number": f_lineno, 4768s "line": "", 4768s } 4768s 4768s /usr/lib/python3/dist-packages/distributed/tests/test_profile.py:327: 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s /usr/lib/python3/dist-packages/distributed/profile.py:115: in info_frame 4768s line = linecache.getline(co.co_filename, f_lineno, frame.f_globals).lstrip() 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s 4768s filename = '', lineno = None, module_globals = {} 4768s 4768s def getline(filename, lineno, module_globals=None): 4768s """Get a line for a Python source file from the cache. 4768s Update the cache if it doesn't contain an entry for this file already.""" 4768s 4768s lines = getlines(filename, module_globals) 4768s > if 1 <= lineno <= len(lines): 4768s E TypeError: '<=' not supported between instances of 'int' and 'NoneType' 4768s 4768s /usr/lib/python3.13/linecache.py:26: TypeError 4768s ________________________ test_info_frame_f_lineno[23-4] ________________________ 4768s 4768s f_lasti = 23, f_lineno = 4 4768s 4768s @pytest.mark.parametrize( 4768s "f_lasti,f_lineno", 4768s [ 4768s (-1, 1), 4768s (0, 2), 4768s (1, 2), 4768s (11, 2), 4768s (12, 3), 4768s (21, 4), 4768s (22, 4), 4768s (23, 4), 4768s (24, 2), 4768s (25, 2), 4768s (26, 2), 4768s (27, 2), 4768s (100, 2), 4768s ], 4768s ) 4768s def test_info_frame_f_lineno(f_lasti: int, f_lineno: int) -> None: 4768s > assert info_frame(FakeFrame(f_lasti=f_lasti, f_code=FAKE_CODE)) == { # type: ignore 4768s "filename": "", 4768s "name": "example", 4768s "line_number": f_lineno, 4768s "line": "", 4768s } 4768s 4768s /usr/lib/python3/dist-packages/distributed/tests/test_profile.py:327: 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s /usr/lib/python3/dist-packages/distributed/profile.py:115: in info_frame 4768s line = linecache.getline(co.co_filename, f_lineno, frame.f_globals).lstrip() 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s 4768s filename = '', lineno = None, module_globals = {} 4768s 4768s def getline(filename, lineno, module_globals=None): 4768s """Get a line for a Python source file from the cache. 4768s Update the cache if it doesn't contain an entry for this file already.""" 4768s 4768s lines = getlines(filename, module_globals) 4768s > if 1 <= lineno <= len(lines): 4768s E TypeError: '<=' not supported between instances of 'int' and 'NoneType' 4768s 4768s /usr/lib/python3.13/linecache.py:26: TypeError 4768s ________________________ test_call_stack_f_lineno[22-4] ________________________ 4768s 4768s f_lasti = 22, f_lineno = 4 4768s 4768s @pytest.mark.parametrize( 4768s "f_lasti,f_lineno", 4768s [ 4768s (-1, 1), 4768s (0, 2), 4768s (1, 2), 4768s (11, 2), 4768s (12, 3), 4768s (21, 4), 4768s (22, 4), 4768s (23, 4), 4768s (24, 2), 4768s (25, 2), 4768s (26, 2), 4768s (27, 2), 4768s (100, 2), 4768s ], 4768s ) 4768s def test_call_stack_f_lineno(f_lasti: int, f_lineno: int) -> None: 4768s > assert call_stack(FakeFrame(f_lasti=f_lasti, f_code=FAKE_CODE)) == [ # type: ignore 4768s f' File "", line {f_lineno}, in example\n\t' 4768s ] 4768s 4768s /usr/lib/python3/dist-packages/distributed/tests/test_profile.py:354: 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s /usr/lib/python3/dist-packages/distributed/profile.py:263: in call_stack 4768s L.append(repr_frame(cur_frame)) 4768s /usr/lib/python3/dist-packages/distributed/profile.py:105: in repr_frame 4768s line = linecache.getline(co.co_filename, f_lineno, frame.f_globals).lstrip() 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s 4768s filename = '', lineno = None, module_globals = {} 4768s 4768s def getline(filename, lineno, module_globals=None): 4768s """Get a line for a Python source file from the cache. 4768s Update the cache if it doesn't contain an entry for this file already.""" 4768s 4768s lines = getlines(filename, module_globals) 4768s > if 1 <= lineno <= len(lines): 4768s E TypeError: '<=' not supported between instances of 'int' and 'NoneType' 4768s 4768s /usr/lib/python3.13/linecache.py:26: TypeError 4768s ________________________ test_call_stack_f_lineno[23-4] ________________________ 4768s 4768s f_lasti = 23, f_lineno = 4 4768s 4768s @pytest.mark.parametrize( 4768s "f_lasti,f_lineno", 4768s [ 4768s (-1, 1), 4768s (0, 2), 4768s (1, 2), 4768s (11, 2), 4768s (12, 3), 4768s (21, 4), 4768s (22, 4), 4768s (23, 4), 4768s (24, 2), 4768s (25, 2), 4768s (26, 2), 4768s (27, 2), 4768s (100, 2), 4768s ], 4768s ) 4768s def test_call_stack_f_lineno(f_lasti: int, f_lineno: int) -> None: 4768s > assert call_stack(FakeFrame(f_lasti=f_lasti, f_code=FAKE_CODE)) == [ # type: ignore 4768s f' File "", line {f_lineno}, in example\n\t' 4768s ] 4768s 4768s /usr/lib/python3/dist-packages/distributed/tests/test_profile.py:354: 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s /usr/lib/python3/dist-packages/distributed/profile.py:263: in call_stack 4768s L.append(repr_frame(cur_frame)) 4768s /usr/lib/python3/dist-packages/distributed/profile.py:105: in repr_frame 4768s line = linecache.getline(co.co_filename, f_lineno, frame.f_globals).lstrip() 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s 4768s filename = '', lineno = None, module_globals = {} 4768s 4768s def getline(filename, lineno, module_globals=None): 4768s """Get a line for a Python source file from the cache. 4768s Update the cache if it doesn't contain an entry for this file already.""" 4768s 4768s lines = getlines(filename, module_globals) 4768s > if 1 <= lineno <= len(lines): 4768s E TypeError: '<=' not supported between instances of 'int' and 'NoneType' 4768s 4768s /usr/lib/python3.13/linecache.py:26: TypeError 4768s ______________________________ test_broadcast_tls ______________________________ 4768s 4768s fut = , timeout = 0 4768s 4768s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 4768s async with asyncio.timeout(timeout): 4768s > return await fut 4768s 4768s /usr/lib/python3/dist-packages/distributed/utils.py:1960: 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s /usr/lib/python3/dist-packages/distributed/worker.py:1480: in start_unsafe 4768s await self._register_with_scheduler() 4768s /usr/lib/python3/dist-packages/distributed/worker.py:1179: in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s /usr/lib/python3/dist-packages/distributed/comm/core.py:342: in connect 4768s comm = await wait_for( 4768s /usr/lib/python3/dist-packages/distributed/utils.py:1960: in wait_for 4768s return await fut 4768s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:546: in connect 4768s stream = await self.client.connect( 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s 4768s self = , host = '127.0.0.1' 4768s port = 46385, af = 4768s ssl_options = 4768s max_buffer_size = 8364507136.0, source_ip = None, source_port = None 4768s timeout = None 4768s 4768s async def connect( 4768s self, 4768s host: str, 4768s port: int, 4768s af: socket.AddressFamily = socket.AF_UNSPEC, 4768s ssl_options: Optional[Union[Dict[str, Any], ssl.SSLContext]] = None, 4768s max_buffer_size: Optional[int] = None, 4768s source_ip: Optional[str] = None, 4768s source_port: Optional[int] = None, 4768s timeout: Optional[Union[float, datetime.timedelta]] = None, 4768s ) -> IOStream: 4768s """Connect to the given host and port. 4768s 4768s Asynchronously returns an `.IOStream` (or `.SSLIOStream` if 4768s ``ssl_options`` is not None). 4768s 4768s Using the ``source_ip`` kwarg, one can specify the source 4768s IP address to use when establishing the connection. 4768s In case the user needs to resolve and 4768s use a specific interface, it has to be handled outside 4768s of Tornado as this depends very much on the platform. 4768s 4768s Raises `TimeoutError` if the input future does not complete before 4768s ``timeout``, which may be specified in any form allowed by 4768s `.IOLoop.add_timeout` (i.e. a `datetime.timedelta` or an absolute time 4768s relative to `.IOLoop.time`) 4768s 4768s Similarly, when the user requires a certain source port, it can 4768s be specified using the ``source_port`` arg. 4768s 4768s .. versionchanged:: 4.5 4768s Added the ``source_ip`` and ``source_port`` arguments. 4768s 4768s .. versionchanged:: 5.0 4768s Added the ``timeout`` argument. 4768s """ 4768s if timeout is not None: 4768s if isinstance(timeout, numbers.Real): 4768s timeout = IOLoop.current().time() + timeout 4768s elif isinstance(timeout, datetime.timedelta): 4768s timeout = IOLoop.current().time() + timeout.total_seconds() 4768s else: 4768s raise TypeError("Unsupported timeout %r" % timeout) 4768s if timeout is not None: 4768s addrinfo = await gen.with_timeout( 4768s timeout, self.resolver.resolve(host, port, af) 4768s ) 4768s else: 4768s addrinfo = await self.resolver.resolve(host, port, af) 4768s connector = _Connector( 4768s addrinfo, 4768s functools.partial( 4768s self._create_stream, 4768s max_buffer_size, 4768s source_ip=source_ip, 4768s source_port=source_port, 4768s ), 4768s ) 4768s > af, addr, stream = await connector.start(connect_timeout=timeout) 4768s E asyncio.exceptions.CancelledError 4768s 4768s /usr/lib/python3/dist-packages/tornado/tcpclient.py:279: CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s self = 4768s 4768s @final 4768s async def start(self): 4768s async with self._startup_lock: 4768s if self.status == Status.failed: 4768s assert self.__startup_exc is not None 4768s raise self.__startup_exc 4768s elif self.status != Status.init: 4768s return self 4768s timeout = getattr(self, "death_timeout", None) 4768s 4768s async def _close_on_failure(exc: Exception) -> None: 4768s await self.close(reason=f"failure-to-start-{str(type(exc))}") 4768s self.status = Status.failed 4768s self.__startup_exc = exc 4768s 4768s try: 4768s > await wait_for(self.start_unsafe(), timeout=timeout) 4768s 4768s /usr/lib/python3/dist-packages/distributed/core.py:664: 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 4768s async with asyncio.timeout(timeout): 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s 4768s self = 4768s exc_type = 4768s exc_val = CancelledError(), exc_tb = 4768s 4768s async def __aexit__( 4768s self, 4768s exc_type: Optional[Type[BaseException]], 4768s exc_val: Optional[BaseException], 4768s exc_tb: Optional[TracebackType], 4768s ) -> Optional[bool]: 4768s assert self._state in (_State.ENTERED, _State.EXPIRING) 4768s 4768s if self._timeout_handler is not None: 4768s self._timeout_handler.cancel() 4768s self._timeout_handler = None 4768s 4768s if self._state is _State.EXPIRING: 4768s self._state = _State.EXPIRED 4768s 4768s if self._task.uncancel() <= self._cancelling and exc_type is not None: 4768s # Since there are no new cancel requests, we're 4768s # handling this. 4768s if issubclass(exc_type, exceptions.CancelledError): 4768s > raise TimeoutError from exc_val 4768s E TimeoutError 4768s 4768s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s @contextlib.asynccontextmanager 4768s async def _cluster_factory(): 4768s workers = [] 4768s s = None 4768s try: 4768s for _ in range(60): 4768s try: 4768s > s, ws = await start_cluster( 4768s nthreads, 4768s scheduler, 4768s security=security, 4768s Worker=Worker, 4768s scheduler_kwargs=scheduler_kwargs, 4768s worker_kwargs=merge( 4768s {"death_timeout": min(15, int(deadline.remaining))}, 4768s worker_kwargs, 4768s ), 4768s ) 4768s 4768s /usr/lib/python3/dist-packages/distributed/utils_test.py:966: 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s /usr/lib/python3/dist-packages/distributed/utils_test.py:789: in start_cluster 4768s await asyncio.gather(*workers) 4768s /usr/lib/python3.13/asyncio/tasks.py:737: in _wrap_awaitable 4768s return await awaitable 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s 4768s self = 4768s 4768s @final 4768s async def start(self): 4768s async with self._startup_lock: 4768s if self.status == Status.failed: 4768s assert self.__startup_exc is not None 4768s raise self.__startup_exc 4768s elif self.status != Status.init: 4768s return self 4768s timeout = getattr(self, "death_timeout", None) 4768s 4768s async def _close_on_failure(exc: Exception) -> None: 4768s await self.close(reason=f"failure-to-start-{str(type(exc))}") 4768s self.status = Status.failed 4768s self.__startup_exc = exc 4768s 4768s try: 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s except asyncio.TimeoutError as exc: 4768s await _close_on_failure(exc) 4768s > raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s E TimeoutError: Worker start timed out after 0s. 4768s 4768s /usr/lib/python3/dist-packages/distributed/core.py:667: TimeoutError 4768s 4768s During handling of the above exception, another exception occurred: 4768s 4768s fut = ._..test_func..async_fn at 0xe99ada20> 4768s timeout = 60 4768s 4768s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 4768s async with asyncio.timeout(timeout): 4768s > return await fut 4768s 4768s /usr/lib/python3/dist-packages/distributed/utils.py:1960: 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s /usr/lib/python3/dist-packages/distributed/utils_test.py:999: in async_fn 4768s _cluster_factory() as (s, workers), 4768s /usr/lib/python3.13/contextlib.py:214: in __aenter__ 4768s return await anext(self.gen) 4768s /usr/lib/python3/dist-packages/distributed/utils_test.py:983: in _cluster_factory 4768s await asyncio.sleep(1) 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s 4768s delay = 1, result = None 4768s 4768s async def sleep(delay, result=None): 4768s """Coroutine that completes after a given time (in seconds).""" 4768s if delay <= 0: 4768s await __sleep0() 4768s return result 4768s 4768s if math.isnan(delay): 4768s raise ValueError("Invalid delay: NaN (not a number)") 4768s 4768s loop = events.get_running_loop() 4768s future = loop.create_future() 4768s h = loop.call_later(delay, 4768s futures._set_result_unless_cancelled, 4768s future, result) 4768s try: 4768s > return await future 4768s E asyncio.exceptions.CancelledError 4768s 4768s /usr/lib/python3.13/asyncio/tasks.py:718: CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s args = (), kwds = {} 4768s 4768s @wraps(func) 4768s def inner(*args, **kwds): 4768s with self._recreate_cm(): 4768s > return func(*args, **kwds) 4768s 4768s /usr/lib/python3.13/contextlib.py:85: 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s /usr/lib/python3.13/contextlib.py:85: in inner 4768s return func(*args, **kwds) 4768s /usr/lib/python3/dist-packages/distributed/utils_test.py:1102: in test_func 4768s return _run_and_close_tornado(async_fn_outer) 4768s /usr/lib/python3/dist-packages/distributed/utils_test.py:378: in _run_and_close_tornado 4768s return asyncio_run(inner_fn(), loop_factory=get_loop_factory()) 4768s /usr/lib/python3.13/asyncio/runners.py:194: in run 4768s return runner.run(main) 4768s /usr/lib/python3.13/asyncio/runners.py:118: in run 4768s return self._loop.run_until_complete(task) 4768s /usr/lib/python3.13/asyncio/base_events.py:720: in run_until_complete 4768s return future.result() 4768s /usr/lib/python3/dist-packages/distributed/utils_test.py:375: in inner_fn 4768s return await async_fn(*args, **kwargs) 4768s /usr/lib/python3/dist-packages/distributed/utils_test.py:1099: in async_fn_outer 4768s return await utils_wait_for(async_fn(), timeout=timeout * 2) 4768s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 4768s async with asyncio.timeout(timeout): 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s 4768s self = 4768s exc_type = 4768s exc_val = CancelledError(), exc_tb = 4768s 4768s async def __aexit__( 4768s self, 4768s exc_type: Optional[Type[BaseException]], 4768s exc_val: Optional[BaseException], 4768s exc_tb: Optional[TracebackType], 4768s ) -> Optional[bool]: 4768s assert self._state in (_State.ENTERED, _State.EXPIRING) 4768s 4768s if self._timeout_handler is not None: 4768s self._timeout_handler.cancel() 4768s self._timeout_handler = None 4768s 4768s if self._state is _State.EXPIRING: 4768s self._state = _State.EXPIRED 4768s 4768s if self._task.uncancel() <= self._cancelling and exc_type is not None: 4768s # Since there are no new cancel requests, we're 4768s # handling this. 4768s if issubclass(exc_type, exceptions.CancelledError): 4768s > raise TimeoutError from exc_val 4768s E TimeoutError 4768s 4768s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 4768s ----------------------------- Captured stderr call ----------------------------- 4768s 2024-11-23 21:36:17,717 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:36:17,726 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:17,726 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34495/status 4768s 2024-11-23 21:36:17,726 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:36:17,743 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41025 4768s 2024-11-23 21:36:17,743 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41025 4768s 2024-11-23 21:36:17,743 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:36:17,743 - distributed.worker - INFO - dashboard at: 127.0.0.1:34551 4768s 2024-11-23 21:36:17,743 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:17,743 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:36:17,743 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:36:17,743 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:36:17,743 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-cbg4h5p0 4768s 2024-11-23 21:36:17,744 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:36:17,746 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45267 4768s 2024-11-23 21:36:17,746 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45267 4768s 2024-11-23 21:36:17,746 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:36:17,746 - distributed.worker - INFO - dashboard at: 127.0.0.1:42207 4768s 2024-11-23 21:36:17,746 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:17,746 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:36:17,746 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:36:17,747 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:36:17,747 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-x6ydkjuo 4768s 2024-11-23 21:36:17,747 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:36:17,760 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:17,761 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:17,761 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:54172': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:17,761 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:54178': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:17,874 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:17,874 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:17,875 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:54184': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:17,875 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:54186': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:17,990 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:17,990 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:17,990 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:54194': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:17,990 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:54206': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:18,103 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:18,104 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:18,104 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:54212': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:18,104 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:54224': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:18,217 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:18,217 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:18,218 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:54226': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:18,218 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:54230': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:18,332 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:18,332 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:18,333 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:54238': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:18,333 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:54248': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:18,446 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:18,446 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:18,446 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:54250': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:18,446 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:54266': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:18,560 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:18,560 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:18,560 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:54272': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:18,561 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:54280': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:18,674 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:18,674 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:18,674 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:54286': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:18,675 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:54288': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:18,788 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:18,789 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:18,789 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:54294': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:18,789 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:54306': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:18,902 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:18,902 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:18,903 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:54316': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:18,903 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:54318': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:19,016 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:19,016 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:19,016 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:54326': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:19,017 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:54328': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:19,130 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:19,130 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:19,130 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:54330': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:19,130 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:54344': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:19,244 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:19,244 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:19,244 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:54346': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:19,245 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:54362': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:19,357 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:19,358 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:19,358 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:54368': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:19,358 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:54382': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:19,471 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:19,471 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:19,472 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:54390': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:19,472 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:54406': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:19,587 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:19,587 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:19,588 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:54412': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:19,588 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:54420': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:19,701 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:19,701 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:19,702 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:54426': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:19,702 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:54442': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:19,816 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:19,816 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:19,816 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:54454': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:19,816 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:54462': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:19,929 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:19,929 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:19,930 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:54476': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:19,930 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:54484': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:20,043 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:20,044 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:20,044 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:54490': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:20,044 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:54496': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:20,157 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:20,157 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:20,158 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:54504': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:20,158 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:54518': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:20,272 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:20,272 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:20,273 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:54532': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:20,273 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:54534': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:20,386 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:20,386 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:20,386 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:54546': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:20,386 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:54556': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:20,500 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:20,501 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:20,501 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:54558': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:20,501 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:54562': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:20,615 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:20,615 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:20,615 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:54578': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:20,615 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:54580': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:20,728 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:20,729 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:20,729 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:54594': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:20,729 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:54610': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:20,842 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:20,842 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:20,843 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:54624': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:20,843 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:54632': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:20,956 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:20,956 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:20,956 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:54634': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:20,956 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:54646': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:21,069 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:21,069 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:21,070 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:54662': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:21,070 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:54668': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:21,184 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:21,185 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:21,185 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:54682': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:21,185 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:54686': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:21,299 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:21,299 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:21,299 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:54694': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:21,300 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:54708': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:21,414 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:21,414 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:21,415 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:54718': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:21,415 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:54722': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:21,528 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:21,529 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:21,529 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:54730': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:21,529 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:54736': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:21,642 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:21,643 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:21,643 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:50990': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:21,643 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:50996': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:21,756 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:21,757 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:21,757 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:50998': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:21,757 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:51000': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:21,871 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:21,871 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:21,871 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:51002': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:21,871 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:51016': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:21,984 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:21,985 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:21,985 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:51018': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:21,985 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:51026': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:22,098 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:22,099 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:22,099 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:51038': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:22,099 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:51050': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:22,213 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:22,213 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:22,214 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:51064': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:22,214 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:51070': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:22,328 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:22,328 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:22,328 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:51084': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:22,328 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:51100': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:22,441 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:22,442 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:22,442 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:51110': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:22,442 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:51118': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:22,555 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:22,555 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:22,556 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:51128': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:22,556 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:51136': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:22,668 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:22,669 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:22,669 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:51152': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:22,669 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:51162': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:22,782 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:22,783 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:22,783 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:51174': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:22,783 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:51188': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:22,897 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:22,897 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:22,898 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:51192': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:22,898 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:51194': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:23,011 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:23,011 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:23,012 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:51210': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:23,012 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:51212': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:23,124 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:23,125 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:23,125 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:51216': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:23,125 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:51222': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:23,244 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:23,244 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:23,245 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:51226': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:23,245 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:51238': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:23,358 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:23,358 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:23,358 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:51240': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:23,358 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:51252': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:23,471 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:23,472 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:23,472 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:51258': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:23,472 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:51260': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:23,585 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:23,586 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:23,586 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:51276': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:23,586 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:51278': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:23,699 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:23,699 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:23,700 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:51290': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:23,700 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:51306': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:23,813 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:23,813 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:23,813 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:51322': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:23,814 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:51336': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:23,926 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:23,926 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:23,927 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:51348': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:23,927 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:51360': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:24,040 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:24,041 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:24,041 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:51374': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:24,041 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:51390': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:24,154 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:24,155 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:24,155 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:51398': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:24,155 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:51412': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:24,268 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:24,269 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:24,269 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:51426': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:24,269 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:51432': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:24,382 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:24,382 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:24,382 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:51434': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:24,382 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:51446': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:24,497 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:24,497 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:24,497 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:51448': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:24,498 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:51456': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:24,610 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:24,611 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:24,611 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:51458': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:24,611 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:51462': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:24,724 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:24,724 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:24,725 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:51472': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:24,725 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:51486': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:24,837 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:24,838 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:24,838 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:51492': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:24,838 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:51506': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:24,951 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:24,951 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:24,951 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:51510': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:24,951 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:51526': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:25,065 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:25,065 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:25,066 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:51540': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:25,066 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:51542': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:25,178 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:25,178 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:25,179 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:51544': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:25,179 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:51552': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:25,292 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:25,293 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:25,293 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:51554': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:25,293 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:51570': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:25,406 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:25,406 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:25,407 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:51574': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:25,407 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:51580': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:25,520 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:25,520 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:25,520 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:51584': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:25,521 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:51596': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:25,633 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:25,633 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:25,634 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:51612': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:25,634 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:51616': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:25,746 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:25,746 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:25,747 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:51628': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:25,747 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:51644': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:25,860 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:25,860 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:25,860 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:51652': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:25,861 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:51662': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:25,973 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:25,974 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:25,974 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:51674': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:25,974 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:51690': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:26,087 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:26,087 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:26,088 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:51706': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:26,088 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:51710': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:26,202 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:26,202 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:26,202 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:51724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:26,203 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:51740': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:26,317 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:26,317 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:26,318 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:51748': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:26,318 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:51750': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:26,431 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:26,431 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:26,431 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:51762': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:26,432 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:51770': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:26,545 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:26,545 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:26,545 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:51782': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:26,546 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:51794': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:26,659 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:26,660 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:26,660 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:51796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:26,660 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:51806': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:26,774 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:26,774 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:26,775 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:51814': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:26,775 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:51830': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:26,888 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:26,888 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:26,889 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:51846': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:26,889 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:51862': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:27,002 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:27,002 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:27,002 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:51876': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:27,003 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:51878': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:27,115 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:27,115 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:27,116 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:51888': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:27,116 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:51898': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:27,229 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:27,229 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:27,233 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:51910': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:27,233 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:51920': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:27,342 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:27,343 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:27,343 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:51936': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:27,343 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:51950': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:27,456 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:27,456 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:27,457 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:51954': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:27,457 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:51956': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:27,570 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:27,570 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:27,570 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:51958': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:27,570 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:51966': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:27,683 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:27,684 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:27,684 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:51982': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:27,684 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:51994': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:27,799 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:27,799 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:27,800 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:52002': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:27,800 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:52006': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:27,913 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:27,914 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:27,914 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:52020': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:27,914 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:52026': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:28,027 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:28,028 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:28,028 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:52042': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:28,028 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:52046': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:28,141 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:28,141 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:28,141 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:52052': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:28,141 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:52056': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:28,254 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:28,254 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:28,255 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:52058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:28,255 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:52064': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:28,368 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:28,369 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:28,369 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:52080': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:28,369 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:52092': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:28,482 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:28,482 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:28,483 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:52098': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:28,483 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:52108': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:28,595 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:28,596 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:28,596 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:52118': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:28,596 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:52120': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:28,710 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:28,710 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:28,711 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:52124': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:28,711 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:52128': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:28,823 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:28,824 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:28,824 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:52142': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:28,824 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:52154': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:28,937 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:28,937 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:28,938 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:52158': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:28,938 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:52168': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:29,051 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:29,051 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:29,052 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:52176': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:29,052 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:52184': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:29,164 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:29,164 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:29,165 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:52190': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:29,165 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:52192': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:29,277 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:29,278 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:29,278 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:52198': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:29,278 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:52212': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:29,391 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:29,391 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:29,392 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:52224': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:29,392 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:52232': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:29,506 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:29,506 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:29,507 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:52242': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:29,507 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:52244': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:29,619 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:29,620 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:29,620 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:52256': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:29,620 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:52258': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:29,733 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:29,733 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:29,738 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:52264': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:29,738 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:52270': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:29,846 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:29,847 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:29,847 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:52272': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:29,847 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:52280': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:29,960 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:29,960 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:29,961 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:52290': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:29,961 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:52302': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:30,073 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:30,074 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:30,074 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:52304': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:30,074 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:52320': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:30,186 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:30,187 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:30,187 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:52322': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:30,187 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:52334': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:30,300 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:30,301 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:30,301 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:52340': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:30,301 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:52348': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:30,415 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:30,415 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:30,416 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:52350': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:30,416 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:52360': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:30,530 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:30,530 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:30,531 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:52364': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:30,531 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:52368': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:30,643 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:30,644 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:30,644 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:52380': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:30,644 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:52396': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:30,758 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:30,759 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:30,759 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:52398': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:30,759 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:52410': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:30,872 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:30,872 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:30,873 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:52414': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:30,873 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:52424': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:30,985 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:30,986 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:30,986 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:52432': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:30,986 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:52438': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:31,101 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:31,101 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:31,102 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:52448': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:31,102 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:52456': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:31,215 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:31,215 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:31,216 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:52460': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:31,216 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:52464': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:31,329 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:31,329 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:31,330 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:52476': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:31,330 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:52486': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:31,442 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:31,443 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:31,443 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:52494': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:31,443 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:52498': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:31,556 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:31,557 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:31,557 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:41920': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:31,557 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:41932': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:31,670 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:31,670 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:31,671 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:41934': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:31,671 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:41936': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:31,784 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:31,784 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:31,784 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:41944': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:31,784 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:41954': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:31,897 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:31,897 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:31,898 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:41956': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:31,898 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:41964': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:32,011 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:32,011 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:32,012 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:41968': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:32,012 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:41970': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:32,125 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:32,125 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:32,126 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:41972': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:32,126 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:41980': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:32,242 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:32,243 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:32,243 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:41996': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:32,243 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:42010': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:32,357 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:32,357 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:32,357 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:42020': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:32,357 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:42034': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:32,470 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:32,471 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:32,471 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:42050': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:32,471 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:42066': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:32,584 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:32,584 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:32,585 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:42082': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:32,585 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:42088': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:32,697 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:32,698 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46291 4768s 2024-11-23 21:36:32,698 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:42100': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:32,698 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:42104': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:32,741 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41025. Reason: failure-to-start- 4768s 2024-11-23 21:36:32,741 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:36:32,744 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 15s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 4768s stream = await stream.start_tls( 4768s ^^^^^^^^^^^^^^^^^^^^^^^ 4768s False, ssl_options=ssl_options, server_hostname=host 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 4768s self.socket.do_handshake() 4768s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 4768s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 4768s self._sslobj.do_handshake() 4768s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 4768s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 4768s raise FatalCommClosedError( 4768s ...<2 lines>... 4768s ) from err 4768s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 4768s 4768s During handling of the above exception, another exception occurred: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1218, in _register_with_scheduler 4768s await asyncio.sleep(0.1) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 718, in sleep 4768s return await future 4768s ^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 15s. 4768s 2024-11-23 21:36:32,750 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45267. Reason: failure-to-start- 4768s 2024-11-23 21:36:32,750 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:36:33,753 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:36:33,760 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:33,760 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45709/status 4768s 2024-11-23 21:36:33,760 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:36:33,776 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46241 4768s 2024-11-23 21:36:33,776 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46241 4768s 2024-11-23 21:36:33,776 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:36:33,776 - distributed.worker - INFO - dashboard at: 127.0.0.1:37401 4768s 2024-11-23 21:36:33,776 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:33,776 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:36:33,776 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:36:33,776 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:36:33,777 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-fiydysii 4768s 2024-11-23 21:36:33,777 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:36:33,779 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35253 4768s 2024-11-23 21:36:33,779 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35253 4768s 2024-11-23 21:36:33,779 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:36:33,779 - distributed.worker - INFO - dashboard at: 127.0.0.1:33299 4768s 2024-11-23 21:36:33,779 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:33,779 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:36:33,779 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:36:33,779 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:36:33,779 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-w_emq22o 4768s 2024-11-23 21:36:33,779 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:36:33,793 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:33,793 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:33,793 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:44780': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:33,793 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:44794': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:33,906 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:33,907 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:33,907 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:44800': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:33,907 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:44802': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:34,021 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:34,021 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:34,022 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:44818': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:34,022 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:44828': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:34,139 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:34,140 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:34,140 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:44832': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:34,140 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:44838': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:34,254 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:34,254 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:34,254 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:44842': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:34,254 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:44856': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:34,368 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:34,368 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:34,369 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:44864': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:34,369 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:44880': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:34,482 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:34,482 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:34,483 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:44884': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:34,483 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:44896': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:34,596 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:34,596 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:34,597 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:44898': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:34,597 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:44908': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:34,711 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:34,712 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:34,712 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:44924': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:34,712 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:44932': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:34,825 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:34,826 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:34,826 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:44946': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:34,826 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:44952': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:34,939 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:34,940 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:34,940 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:44960': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:34,940 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:44974': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:35,054 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:35,054 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:35,055 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:44982': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:35,055 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:44988': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:35,168 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:35,168 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:35,169 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:45002': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:35,169 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:45014': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:35,281 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:35,281 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:35,282 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:45016': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:35,282 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:45032': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:35,396 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:35,396 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:35,396 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:45038': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:35,396 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:45054': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:35,510 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:35,510 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:35,511 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:45060': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:35,511 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:45074': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:35,624 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:35,625 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:35,625 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:45078': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:35,625 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:45086': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:35,743 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:35,744 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:35,744 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:45092': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:35,744 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:45098': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:35,857 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:35,858 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:35,858 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:45108': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:35,858 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:45116': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:35,971 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:35,971 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:35,971 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:45118': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:35,971 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:45126': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:36,084 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:36,084 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:36,084 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:45140': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:36,085 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:45146': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:36,197 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:36,197 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:36,198 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:45148': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:36,198 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:45152': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:36,311 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:36,311 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:36,312 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:45168': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:36,312 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:45170': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:36,425 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:36,425 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:36,425 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:45172': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:36,425 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:45184': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:36,539 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:36,539 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:36,539 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:45194': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:36,540 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:45210': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:36,652 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:36,653 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:36,653 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:45222': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:36,653 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:45228': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:36,766 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:36,766 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:36,770 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:45230': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:36,770 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:45234': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:36,880 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:36,880 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:36,880 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:45244': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:36,881 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:45258': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:36,993 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:36,994 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:36,994 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:45274': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:36,994 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:45282': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:37,107 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:37,107 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:37,108 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:45284': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:37,108 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:45290': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:37,220 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:37,220 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:37,221 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:45306': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:37,221 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:45318': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:37,334 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:37,335 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:37,335 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:45326': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:37,335 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:45338': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:37,450 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:37,450 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:37,451 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:45354': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:37,451 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:45370': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:37,566 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:37,566 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:37,567 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:45374': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:37,567 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:45382': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:37,680 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:37,680 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:37,681 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:45392': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:37,681 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:45400': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:37,794 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:37,794 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:37,794 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:45408': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:37,794 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:45412': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:37,908 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:37,908 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:37,908 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:45424': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:37,908 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:45430': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:38,022 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:38,022 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:38,023 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:45434': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:38,023 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:45450': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:38,136 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:38,136 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:38,137 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:45466': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:38,137 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:45476': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:38,250 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:38,250 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:38,251 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:45482': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:38,251 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:45486': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:38,364 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:38,364 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:38,364 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:45490': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:38,364 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:45498': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:38,477 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:38,477 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:38,478 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:45502': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:38,478 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:45508': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:38,591 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:38,591 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:38,592 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:45518': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:38,592 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:45520': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:38,704 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:38,705 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:38,705 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:45532': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:38,705 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:45536': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:38,818 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:38,819 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:38,819 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:45544': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:38,819 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:45556': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:38,932 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:38,932 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:38,933 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:45572': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:38,933 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:45588': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:39,046 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:39,046 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:39,047 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:45590': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:39,047 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:45600': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:39,161 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:39,161 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:39,162 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:45616': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:39,162 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:45632': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:39,278 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:39,278 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:39,278 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:45636': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:39,279 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:45648': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:39,391 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:39,392 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:39,392 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:45658': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:39,392 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:45666': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:39,505 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:39,505 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:39,506 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:45680': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:39,506 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:45692': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:39,619 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:39,619 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:39,619 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:45708': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:39,620 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:45720': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:39,732 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:39,733 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:39,736 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:45724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:39,736 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:45736': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:39,846 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:39,846 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:39,847 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:45750': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:39,847 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:45760': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:39,960 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:39,960 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:39,961 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:45766': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:39,961 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:45782': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:40,074 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:40,074 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:40,075 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:45794': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:40,075 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:45804': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:40,188 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:40,189 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:40,189 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:45816': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:40,189 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:45822': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:40,302 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:40,302 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:40,302 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:45828': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:40,303 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:45834': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:40,415 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:40,416 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:40,416 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:45848': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:40,416 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:45864': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:40,529 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:40,529 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:40,530 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:45870': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:40,530 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:45884': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:40,642 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:40,643 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:40,643 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:45892': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:40,643 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:45906': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:40,756 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:40,756 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:40,757 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:45908': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:40,757 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:45922': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:40,870 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:40,871 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:40,871 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:45926': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:40,871 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:45930': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:40,986 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:40,986 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:40,987 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:45946': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:40,987 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:45950': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:41,102 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:41,102 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:41,103 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:45954': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:41,103 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:45970': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:41,216 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:41,216 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:41,217 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:45980': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:41,217 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:45984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:41,331 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:41,332 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:41,332 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:45996': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:41,332 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:46008': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:41,446 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:41,446 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:41,446 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:46016': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:41,446 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:46018': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:41,559 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:41,560 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:41,560 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:41506': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:41,560 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:41514': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:41,674 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:41,674 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:41,674 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:41516': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:41,674 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:41522': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:41,788 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:41,788 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:41,789 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:41534': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:41,789 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:41550': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:41,902 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:41,902 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:41,902 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:41560': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:41,902 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:41572': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:42,016 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:42,016 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:42,017 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:41578': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:42,017 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:41584': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:42,130 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:42,130 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:42,130 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:41598': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:42,131 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:41602': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:42,244 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:42,244 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:42,244 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:41610': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:42,245 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:41626': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:42,358 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:42,358 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:42,359 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:41628': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:42,359 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:41644': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:42,472 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:42,472 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:42,472 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:41654': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:42,473 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:41664': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:42,586 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:42,586 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:42,587 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:41676': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:42,587 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:41692': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:42,700 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:42,700 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:42,701 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:41700': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:42,701 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:41712': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:42,815 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:42,815 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:42,816 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:41722': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:42,816 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:41732': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:42,930 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:42,931 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:42,931 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:41738': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:42,931 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:41750': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:43,044 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:43,044 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:43,045 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:41754': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:43,045 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:41762': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:43,159 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:43,159 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:43,160 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:41764': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:43,160 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:41770': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:43,277 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:43,277 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:43,277 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:41774': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:43,277 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:41790': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:43,390 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:43,391 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:43,391 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:41800': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:43,391 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:41802': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:43,505 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:43,505 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:43,505 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:41810': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:43,506 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:41826': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:43,619 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:43,619 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:43,619 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:41830': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:43,619 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:41832': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:43,733 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:43,733 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:43,737 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:41844': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:43,738 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:41854': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:43,847 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:43,847 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:43,848 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:41858': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:43,848 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:41862': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:43,961 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:43,962 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:43,962 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:41864': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:43,962 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:41872': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:44,075 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:44,075 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:44,076 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:41886': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:44,076 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:41902': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:44,189 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:44,189 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:44,190 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:41904': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:44,190 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:41914': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:44,303 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:44,303 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:44,304 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:41916': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:44,304 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:41920': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:44,416 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:44,417 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:44,417 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:41936': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:44,417 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:41946': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:44,532 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:44,532 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:44,533 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:41950': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:44,533 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:41960': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:44,646 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:44,646 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:44,647 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:41970': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:44,647 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:41978': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:44,760 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:44,761 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:44,761 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:41982': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:44,761 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:41994': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:44,875 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:44,875 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:44,875 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:42006': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:44,875 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:42010': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:44,989 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:44,989 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:44,990 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:42012': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:44,990 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:42024': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:45,103 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:45,104 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:45,104 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:42034': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:45,104 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:42050': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:45,217 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:45,218 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:45,218 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:42066': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:45,218 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:42072': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:45,332 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:45,332 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:45,332 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:42078': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:45,332 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:42094': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:45,445 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:45,446 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:45,446 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:42098': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:45,446 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:42108': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:45,559 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:45,559 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:45,560 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:42118': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:45,560 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:42122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:45,673 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:45,673 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:45,673 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:42138': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:45,673 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:42144': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:45,787 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:45,787 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:45,787 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:42158': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:45,788 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:42164': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:45,902 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:45,903 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:45,903 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:42166': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:45,903 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:42178': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:46,018 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:46,018 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:46,019 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:42182': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:46,019 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:42188': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:46,132 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:46,133 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:46,133 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:42194': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:46,133 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:42204': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:46,246 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:46,247 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:46,247 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:42208': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:46,247 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:42216': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:46,360 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:46,361 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:46,361 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:42220': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:46,361 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:42226': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:46,474 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:46,475 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:46,475 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:42242': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:46,475 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:42254': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:46,589 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:46,590 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:46,590 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:42260': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:46,590 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:42270': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:46,703 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:46,704 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41097 4768s 2024-11-23 21:36:46,704 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:42280': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:46,704 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:42294': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:36:46,775 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46241. Reason: failure-to-start- 4768s 2024-11-23 21:36:46,776 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:36:46,778 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 13s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 4768s stream = await stream.start_tls( 4768s ^^^^^^^^^^^^^^^^^^^^^^^ 4768s False, ssl_options=ssl_options, server_hostname=host 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 4768s self.socket.do_handshake() 4768s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 4768s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 4768s self._sslobj.do_handshake() 4768s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 4768s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 4768s raise FatalCommClosedError( 4768s ...<2 lines>... 4768s ) from err 4768s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 4768s 4768s During handling of the above exception, another exception occurred: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1218, in _register_with_scheduler 4768s await asyncio.sleep(0.1) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 718, in sleep 4768s return await future 4768s ^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 13s. 4768s 2024-11-23 21:36:46,781 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35253. Reason: failure-to-start- 4768s 2024-11-23 21:36:46,782 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:36:47,785 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:36:47,792 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38915 4768s 2024-11-23 21:36:47,792 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40771/status 4768s 2024-11-23 21:36:47,793 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:36:47,808 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43999 4768s 2024-11-23 21:36:47,808 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43999 4768s 2024-11-23 21:36:47,808 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:36:47,808 - distributed.worker - INFO - dashboard at: 127.0.0.1:36231 4768s 2024-11-23 21:36:47,808 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38915 4768s 2024-11-23 21:36:47,808 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:36:47,808 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:36:47,808 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:36:47,808 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-7m232i4i 4768s 2024-11-23 21:36:47,808 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:36:47,811 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35255 4768s 2024-11-23 21:36:47,811 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35255 4768s 2024-11-23 21:36:47,811 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:36:47,811 - distributed.worker - INFO - dashboard at: 127.0.0.1:45631 4768s 2024-11-23 21:36:47,811 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38915 4768s 2024-11-23 21:36:47,811 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:36:47,811 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:36:47,811 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:36:47,811 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-a_9gtgok 4768s 2024-11-23 21:36:47,811 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:36:47,812 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43999. Reason: failure-to-start- 4768s 2024-11-23 21:36:47,812 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:36:47,814 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35255. Reason: failure-to-start- 4768s 2024-11-23 21:36:47,815 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:36:47,816 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38915': TLS handshake failed with remote 'tls://127.0.0.1:43178': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:36:47,816 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38915': TLS handshake failed with remote 'tls://127.0.0.1:43184': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:36:47,818 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:36:48,824 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:36:48,832 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35631 4768s 2024-11-23 21:36:48,833 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43519/status 4768s 2024-11-23 21:36:48,833 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:36:48,848 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35487 4768s 2024-11-23 21:36:48,848 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35487 4768s 2024-11-23 21:36:48,848 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:36:48,849 - distributed.worker - INFO - dashboard at: 127.0.0.1:33617 4768s 2024-11-23 21:36:48,849 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35631 4768s 2024-11-23 21:36:48,849 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:36:48,849 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:36:48,849 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:36:48,849 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-tx_hetkb 4768s 2024-11-23 21:36:48,849 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:36:48,851 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40303 4768s 2024-11-23 21:36:48,852 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40303 4768s 2024-11-23 21:36:48,852 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:36:48,852 - distributed.worker - INFO - dashboard at: 127.0.0.1:40203 4768s 2024-11-23 21:36:48,852 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35631 4768s 2024-11-23 21:36:48,852 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:36:48,852 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:36:48,852 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:36:48,852 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-gvbtv1ga 4768s 2024-11-23 21:36:48,852 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:36:48,853 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35487. Reason: failure-to-start- 4768s 2024-11-23 21:36:48,853 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:36:48,854 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40303. Reason: failure-to-start- 4768s 2024-11-23 21:36:48,854 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:36:48,856 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35631': TLS handshake failed with remote 'tls://127.0.0.1:39104': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:36:48,856 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35631': TLS handshake failed with remote 'tls://127.0.0.1:39120': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:36:48,857 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:36:49,864 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:36:49,873 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39445 4768s 2024-11-23 21:36:49,874 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43985/status 4768s 2024-11-23 21:36:49,874 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:36:49,890 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42789 4768s 2024-11-23 21:36:49,890 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42789 4768s 2024-11-23 21:36:49,890 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:36:49,890 - distributed.worker - INFO - dashboard at: 127.0.0.1:37091 4768s 2024-11-23 21:36:49,890 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39445 4768s 2024-11-23 21:36:49,890 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:36:49,890 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:36:49,890 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:36:49,890 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ohi_ec7i 4768s 2024-11-23 21:36:49,890 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:36:49,893 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:32931 4768s 2024-11-23 21:36:49,893 - distributed.worker - INFO - Listening to: tls://127.0.0.1:32931 4768s 2024-11-23 21:36:49,893 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:36:49,893 - distributed.worker - INFO - dashboard at: 127.0.0.1:34949 4768s 2024-11-23 21:36:49,893 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39445 4768s 2024-11-23 21:36:49,893 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:36:49,893 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:36:49,893 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:36:49,893 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-j0zmg72b 4768s 2024-11-23 21:36:49,893 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:36:49,895 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42789. Reason: failure-to-start- 4768s 2024-11-23 21:36:49,895 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:36:49,895 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:32931. Reason: failure-to-start- 4768s 2024-11-23 21:36:49,896 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:36:49,897 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39445': TLS handshake failed with remote 'tls://127.0.0.1:57326': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:36:49,897 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39445': TLS handshake failed with remote 'tls://127.0.0.1:57340': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:36:49,899 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:36:50,904 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:36:50,913 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40921 4768s 2024-11-23 21:36:50,913 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40243/status 4768s 2024-11-23 21:36:50,913 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:36:50,930 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46515 4768s 2024-11-23 21:36:50,930 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46515 4768s 2024-11-23 21:36:50,931 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:36:50,931 - distributed.worker - INFO - dashboard at: 127.0.0.1:43803 4768s 2024-11-23 21:36:50,931 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40921 4768s 2024-11-23 21:36:50,931 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:36:50,931 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:36:50,931 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:36:50,931 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-jog_a_m3 4768s 2024-11-23 21:36:50,931 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:36:50,933 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41221 4768s 2024-11-23 21:36:50,934 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41221 4768s 2024-11-23 21:36:50,934 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:36:50,934 - distributed.worker - INFO - dashboard at: 127.0.0.1:40067 4768s 2024-11-23 21:36:50,934 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40921 4768s 2024-11-23 21:36:50,934 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:36:50,934 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:36:50,934 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:36:50,934 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-3brgyvwx 4768s 2024-11-23 21:36:50,934 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:36:50,935 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46515. Reason: failure-to-start- 4768s 2024-11-23 21:36:50,936 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:36:50,936 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41221. Reason: failure-to-start- 4768s 2024-11-23 21:36:50,936 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:36:50,938 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40921': TLS handshake failed with remote 'tls://127.0.0.1:35538': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:36:50,938 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40921': TLS handshake failed with remote 'tls://127.0.0.1:35542': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:36:50,940 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:36:51,947 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:36:51,955 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43633 4768s 2024-11-23 21:36:51,955 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45921/status 4768s 2024-11-23 21:36:51,955 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:36:51,970 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37203 4768s 2024-11-23 21:36:51,971 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37203 4768s 2024-11-23 21:36:51,971 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:36:51,971 - distributed.worker - INFO - dashboard at: 127.0.0.1:36043 4768s 2024-11-23 21:36:51,971 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43633 4768s 2024-11-23 21:36:51,971 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:36:51,971 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:36:51,971 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:36:51,971 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-f_86a_7f 4768s 2024-11-23 21:36:51,971 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:36:51,973 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41087 4768s 2024-11-23 21:36:51,974 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41087 4768s 2024-11-23 21:36:51,974 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:36:51,974 - distributed.worker - INFO - dashboard at: 127.0.0.1:35647 4768s 2024-11-23 21:36:51,974 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43633 4768s 2024-11-23 21:36:51,974 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:36:51,974 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:36:51,974 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:36:51,974 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-d5r_b85e 4768s 2024-11-23 21:36:51,974 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:36:51,976 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37203. Reason: failure-to-start- 4768s 2024-11-23 21:36:51,977 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:36:51,977 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41087. Reason: failure-to-start- 4768s 2024-11-23 21:36:51,977 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:36:51,979 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43633': TLS handshake failed with remote 'tls://127.0.0.1:43122': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:36:51,979 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43633': TLS handshake failed with remote 'tls://127.0.0.1:43136': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:36:51,980 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:36:52,986 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:36:52,994 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37433 4768s 2024-11-23 21:36:52,995 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37177/status 4768s 2024-11-23 21:36:52,995 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:36:53,010 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43561 4768s 2024-11-23 21:36:53,010 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43561 4768s 2024-11-23 21:36:53,010 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:36:53,010 - distributed.worker - INFO - dashboard at: 127.0.0.1:33443 4768s 2024-11-23 21:36:53,010 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37433 4768s 2024-11-23 21:36:53,010 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:36:53,010 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:36:53,010 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:36:53,010 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-r2lqpzpw 4768s 2024-11-23 21:36:53,010 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:36:53,013 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45853 4768s 2024-11-23 21:36:53,013 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45853 4768s 2024-11-23 21:36:53,013 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:36:53,013 - distributed.worker - INFO - dashboard at: 127.0.0.1:42155 4768s 2024-11-23 21:36:53,013 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37433 4768s 2024-11-23 21:36:53,013 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:36:53,013 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:36:53,013 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:36:53,013 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-6083svby 4768s 2024-11-23 21:36:53,013 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:36:53,014 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43561. Reason: failure-to-start- 4768s 2024-11-23 21:36:53,015 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:36:53,015 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45853. Reason: failure-to-start- 4768s 2024-11-23 21:36:53,015 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:36:53,017 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37433': TLS handshake failed with remote 'tls://127.0.0.1:60500': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:36:53,017 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37433': TLS handshake failed with remote 'tls://127.0.0.1:60512': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:36:53,019 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:36:54,025 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:36:54,039 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37049 4768s 2024-11-23 21:36:54,039 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46221/status 4768s 2024-11-23 21:36:54,039 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:36:54,055 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39339 4768s 2024-11-23 21:36:54,055 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39339 4768s 2024-11-23 21:36:54,055 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:36:54,055 - distributed.worker - INFO - dashboard at: 127.0.0.1:41579 4768s 2024-11-23 21:36:54,055 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37049 4768s 2024-11-23 21:36:54,055 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:36:54,055 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:36:54,055 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:36:54,055 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-sstckk8x 4768s 2024-11-23 21:36:54,055 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:36:54,058 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35699 4768s 2024-11-23 21:36:54,058 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35699 4768s 2024-11-23 21:36:54,058 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:36:54,058 - distributed.worker - INFO - dashboard at: 127.0.0.1:34991 4768s 2024-11-23 21:36:54,058 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37049 4768s 2024-11-23 21:36:54,058 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:36:54,058 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:36:54,058 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:36:54,058 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ukchlu67 4768s 2024-11-23 21:36:54,058 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:36:54,060 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39339. Reason: failure-to-start- 4768s 2024-11-23 21:36:54,060 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:36:54,060 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35699. Reason: failure-to-start- 4768s 2024-11-23 21:36:54,061 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:36:54,062 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37049': TLS handshake failed with remote 'tls://127.0.0.1:33498': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:36:54,062 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37049': TLS handshake failed with remote 'tls://127.0.0.1:33512': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:36:54,064 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:36:55,070 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:36:55,078 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38349 4768s 2024-11-23 21:36:55,078 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34595/status 4768s 2024-11-23 21:36:55,079 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:36:55,095 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46681 4768s 2024-11-23 21:36:55,096 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46681 4768s 2024-11-23 21:36:55,096 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:36:55,096 - distributed.worker - INFO - dashboard at: 127.0.0.1:42887 4768s 2024-11-23 21:36:55,096 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38349 4768s 2024-11-23 21:36:55,096 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:36:55,096 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:36:55,096 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:36:55,096 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-rv950yb_ 4768s 2024-11-23 21:36:55,096 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:36:55,098 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35349 4768s 2024-11-23 21:36:55,099 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35349 4768s 2024-11-23 21:36:55,099 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:36:55,099 - distributed.worker - INFO - dashboard at: 127.0.0.1:43065 4768s 2024-11-23 21:36:55,099 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38349 4768s 2024-11-23 21:36:55,099 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:36:55,099 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:36:55,099 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:36:55,099 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-qzny1l_u 4768s 2024-11-23 21:36:55,099 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:36:55,100 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46681. Reason: failure-to-start- 4768s 2024-11-23 21:36:55,101 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:36:55,101 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35349. Reason: failure-to-start- 4768s 2024-11-23 21:36:55,101 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:36:55,103 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38349': TLS handshake failed with remote 'tls://127.0.0.1:56346': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:36:55,103 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38349': TLS handshake failed with remote 'tls://127.0.0.1:56358': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:36:55,104 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:36:56,112 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:36:56,121 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40081 4768s 2024-11-23 21:36:56,121 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41735/status 4768s 2024-11-23 21:36:56,121 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:36:56,137 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45669 4768s 2024-11-23 21:36:56,137 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45669 4768s 2024-11-23 21:36:56,137 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:36:56,137 - distributed.worker - INFO - dashboard at: 127.0.0.1:38981 4768s 2024-11-23 21:36:56,137 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40081 4768s 2024-11-23 21:36:56,137 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:36:56,137 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:36:56,137 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:36:56,137 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-2q0w01yg 4768s 2024-11-23 21:36:56,137 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:36:56,140 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43323 4768s 2024-11-23 21:36:56,140 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43323 4768s 2024-11-23 21:36:56,140 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:36:56,140 - distributed.worker - INFO - dashboard at: 127.0.0.1:38079 4768s 2024-11-23 21:36:56,140 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40081 4768s 2024-11-23 21:36:56,140 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:36:56,140 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:36:56,140 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:36:56,140 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-cesjcch4 4768s 2024-11-23 21:36:56,140 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:36:56,143 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45669. Reason: failure-to-start- 4768s 2024-11-23 21:36:56,143 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:36:56,143 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43323. Reason: failure-to-start- 4768s 2024-11-23 21:36:56,144 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:36:56,145 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40081': TLS handshake failed with remote 'tls://127.0.0.1:46000': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:36:56,145 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40081': TLS handshake failed with remote 'tls://127.0.0.1:46002': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:36:56,146 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:36:57,153 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:36:57,161 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37435 4768s 2024-11-23 21:36:57,161 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35415/status 4768s 2024-11-23 21:36:57,161 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:36:57,176 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33505 4768s 2024-11-23 21:36:57,176 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33505 4768s 2024-11-23 21:36:57,176 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:36:57,176 - distributed.worker - INFO - dashboard at: 127.0.0.1:36077 4768s 2024-11-23 21:36:57,176 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37435 4768s 2024-11-23 21:36:57,176 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:36:57,177 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:36:57,177 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:36:57,177 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-cuz_z3wv 4768s 2024-11-23 21:36:57,177 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:36:57,179 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38667 4768s 2024-11-23 21:36:57,179 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38667 4768s 2024-11-23 21:36:57,179 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:36:57,179 - distributed.worker - INFO - dashboard at: 127.0.0.1:33345 4768s 2024-11-23 21:36:57,179 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37435 4768s 2024-11-23 21:36:57,179 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:36:57,179 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:36:57,179 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:36:57,179 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-oqs8ohtd 4768s 2024-11-23 21:36:57,179 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:36:57,181 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33505. Reason: failure-to-start- 4768s 2024-11-23 21:36:57,181 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:36:57,181 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38667. Reason: failure-to-start- 4768s 2024-11-23 21:36:57,182 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:36:57,183 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37435': TLS handshake failed with remote 'tls://127.0.0.1:38964': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:36:57,183 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37435': TLS handshake failed with remote 'tls://127.0.0.1:38974': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:36:57,184 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:36:58,192 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:36:58,201 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39819 4768s 2024-11-23 21:36:58,201 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46799/status 4768s 2024-11-23 21:36:58,202 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:36:58,216 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46811 4768s 2024-11-23 21:36:58,217 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46811 4768s 2024-11-23 21:36:58,217 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:36:58,217 - distributed.worker - INFO - dashboard at: 127.0.0.1:42323 4768s 2024-11-23 21:36:58,217 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39819 4768s 2024-11-23 21:36:58,217 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:36:58,217 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:36:58,217 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:36:58,217 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-dw3x5786 4768s 2024-11-23 21:36:58,217 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:36:58,219 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34465 4768s 2024-11-23 21:36:58,219 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34465 4768s 2024-11-23 21:36:58,219 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:36:58,219 - distributed.worker - INFO - dashboard at: 127.0.0.1:40499 4768s 2024-11-23 21:36:58,219 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39819 4768s 2024-11-23 21:36:58,220 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:36:58,220 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:36:58,220 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:36:58,220 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-3jh3bsls 4768s 2024-11-23 21:36:58,220 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:36:58,221 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46811. Reason: failure-to-start- 4768s 2024-11-23 21:36:58,221 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:36:58,222 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34465. Reason: failure-to-start- 4768s 2024-11-23 21:36:58,222 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:36:58,223 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39819': TLS handshake failed with remote 'tls://127.0.0.1:60430': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:36:58,223 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39819': TLS handshake failed with remote 'tls://127.0.0.1:60446': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:36:58,225 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:36:59,233 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:36:59,240 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36967 4768s 2024-11-23 21:36:59,240 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38355/status 4768s 2024-11-23 21:36:59,240 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:36:59,257 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34033 4768s 2024-11-23 21:36:59,257 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34033 4768s 2024-11-23 21:36:59,257 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:36:59,258 - distributed.worker - INFO - dashboard at: 127.0.0.1:35389 4768s 2024-11-23 21:36:59,258 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36967 4768s 2024-11-23 21:36:59,258 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:36:59,258 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:36:59,258 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:36:59,258 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-5mbzmmy_ 4768s 2024-11-23 21:36:59,258 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:36:59,260 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40987 4768s 2024-11-23 21:36:59,260 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40987 4768s 2024-11-23 21:36:59,260 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:36:59,260 - distributed.worker - INFO - dashboard at: 127.0.0.1:39039 4768s 2024-11-23 21:36:59,261 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36967 4768s 2024-11-23 21:36:59,261 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:36:59,261 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:36:59,261 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:36:59,261 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-18q1i3f5 4768s 2024-11-23 21:36:59,261 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:36:59,262 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34033. Reason: failure-to-start- 4768s 2024-11-23 21:36:59,262 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:36:59,263 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40987. Reason: failure-to-start- 4768s 2024-11-23 21:36:59,263 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:36:59,267 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36967': TLS handshake failed with remote 'tls://127.0.0.1:53798': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:36:59,267 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36967': TLS handshake failed with remote 'tls://127.0.0.1:53804': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:36:59,269 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:37:00,274 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:37:00,282 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44289 4768s 2024-11-23 21:37:00,282 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35183/status 4768s 2024-11-23 21:37:00,283 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:37:00,299 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46171 4768s 2024-11-23 21:37:00,299 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46171 4768s 2024-11-23 21:37:00,299 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:37:00,299 - distributed.worker - INFO - dashboard at: 127.0.0.1:40889 4768s 2024-11-23 21:37:00,299 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44289 4768s 2024-11-23 21:37:00,299 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:37:00,299 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:37:00,299 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:37:00,299 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-8q2gsfvn 4768s 2024-11-23 21:37:00,299 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:37:00,303 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43499 4768s 2024-11-23 21:37:00,303 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43499 4768s 2024-11-23 21:37:00,303 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:37:00,303 - distributed.worker - INFO - dashboard at: 127.0.0.1:46407 4768s 2024-11-23 21:37:00,303 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44289 4768s 2024-11-23 21:37:00,303 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:37:00,303 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:37:00,304 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:37:00,304 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-blcjxfgz 4768s 2024-11-23 21:37:00,304 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:37:00,308 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46171. Reason: failure-to-start- 4768s 2024-11-23 21:37:00,308 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:37:00,309 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43499. Reason: failure-to-start- 4768s 2024-11-23 21:37:00,309 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:37:00,310 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44289': TLS handshake failed with remote 'tls://127.0.0.1:50326': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:37:00,310 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44289': TLS handshake failed with remote 'tls://127.0.0.1:50336': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:37:00,312 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:37:01,317 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:37:01,325 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33717 4768s 2024-11-23 21:37:01,325 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39207/status 4768s 2024-11-23 21:37:01,326 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:37:01,341 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37541 4768s 2024-11-23 21:37:01,342 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37541 4768s 2024-11-23 21:37:01,342 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:37:01,342 - distributed.worker - INFO - dashboard at: 127.0.0.1:36851 4768s 2024-11-23 21:37:01,342 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33717 4768s 2024-11-23 21:37:01,342 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:37:01,342 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:37:01,342 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:37:01,342 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ssynkv2j 4768s 2024-11-23 21:37:01,342 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:37:01,344 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33809 4768s 2024-11-23 21:37:01,345 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33809 4768s 2024-11-23 21:37:01,345 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:37:01,345 - distributed.worker - INFO - dashboard at: 127.0.0.1:33975 4768s 2024-11-23 21:37:01,345 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33717 4768s 2024-11-23 21:37:01,345 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:37:01,345 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:37:01,345 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:37:01,345 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-in0sidbc 4768s 2024-11-23 21:37:01,345 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:37:01,350 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37541. Reason: failure-to-start- 4768s 2024-11-23 21:37:01,350 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:37:01,351 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33809. Reason: failure-to-start- 4768s 2024-11-23 21:37:01,351 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:37:01,352 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33717': TLS handshake failed with remote 'tls://127.0.0.1:52174': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:37:01,353 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33717': TLS handshake failed with remote 'tls://127.0.0.1:52176': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:37:01,354 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:37:02,360 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:37:02,368 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44269 4768s 2024-11-23 21:37:02,368 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45305/status 4768s 2024-11-23 21:37:02,368 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:37:02,385 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34489 4768s 2024-11-23 21:37:02,385 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34489 4768s 2024-11-23 21:37:02,385 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:37:02,385 - distributed.worker - INFO - dashboard at: 127.0.0.1:33339 4768s 2024-11-23 21:37:02,385 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44269 4768s 2024-11-23 21:37:02,385 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:37:02,385 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:37:02,385 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:37:02,386 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ce4_4t07 4768s 2024-11-23 21:37:02,386 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:37:02,388 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44889 4768s 2024-11-23 21:37:02,388 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44889 4768s 2024-11-23 21:37:02,388 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:37:02,388 - distributed.worker - INFO - dashboard at: 127.0.0.1:46317 4768s 2024-11-23 21:37:02,388 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44269 4768s 2024-11-23 21:37:02,388 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:37:02,388 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:37:02,389 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:37:02,389 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-g7xt0wtz 4768s 2024-11-23 21:37:02,389 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:37:02,393 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34489. Reason: failure-to-start- 4768s 2024-11-23 21:37:02,393 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:37:02,393 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44889. Reason: failure-to-start- 4768s 2024-11-23 21:37:02,393 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:37:02,395 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44269': TLS handshake failed with remote 'tls://127.0.0.1:35398': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:37:02,395 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44269': TLS handshake failed with remote 'tls://127.0.0.1:35406': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:37:02,397 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:37:03,402 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:37:03,411 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46455 4768s 2024-11-23 21:37:03,412 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37649/status 4768s 2024-11-23 21:37:03,412 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:37:03,427 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35371 4768s 2024-11-23 21:37:03,427 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35371 4768s 2024-11-23 21:37:03,427 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:37:03,427 - distributed.worker - INFO - dashboard at: 127.0.0.1:33863 4768s 2024-11-23 21:37:03,427 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46455 4768s 2024-11-23 21:37:03,427 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:37:03,427 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:37:03,427 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:37:03,427 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-7eikt8bq 4768s 2024-11-23 21:37:03,427 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:37:03,430 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41861 4768s 2024-11-23 21:37:03,430 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41861 4768s 2024-11-23 21:37:03,430 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:37:03,430 - distributed.worker - INFO - dashboard at: 127.0.0.1:41435 4768s 2024-11-23 21:37:03,430 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46455 4768s 2024-11-23 21:37:03,430 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:37:03,430 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:37:03,430 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:37:03,430 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ekz4oenj 4768s 2024-11-23 21:37:03,431 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:37:03,434 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35371. Reason: failure-to-start- 4768s 2024-11-23 21:37:03,435 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:37:03,435 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41861. Reason: failure-to-start- 4768s 2024-11-23 21:37:03,435 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:37:03,437 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46455': TLS handshake failed with remote 'tls://127.0.0.1:39464': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:37:03,437 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46455': TLS handshake failed with remote 'tls://127.0.0.1:39472': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:37:03,438 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:37:04,444 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:37:04,452 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33477 4768s 2024-11-23 21:37:04,452 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44499/status 4768s 2024-11-23 21:37:04,453 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:37:04,470 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44523 4768s 2024-11-23 21:37:04,470 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44523 4768s 2024-11-23 21:37:04,470 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:37:04,470 - distributed.worker - INFO - dashboard at: 127.0.0.1:44323 4768s 2024-11-23 21:37:04,470 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33477 4768s 2024-11-23 21:37:04,470 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:37:04,470 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:37:04,470 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:37:04,470 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-byxznqci 4768s 2024-11-23 21:37:04,470 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:37:04,473 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45051 4768s 2024-11-23 21:37:04,473 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45051 4768s 2024-11-23 21:37:04,473 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:37:04,473 - distributed.worker - INFO - dashboard at: 127.0.0.1:36415 4768s 2024-11-23 21:37:04,473 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33477 4768s 2024-11-23 21:37:04,473 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:37:04,473 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:37:04,473 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:37:04,473 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-kcs8tjvb 4768s 2024-11-23 21:37:04,473 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:37:04,477 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44523. Reason: failure-to-start- 4768s 2024-11-23 21:37:04,477 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:37:04,478 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45051. Reason: failure-to-start- 4768s 2024-11-23 21:37:04,478 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:37:04,480 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33477': TLS handshake failed with remote 'tls://127.0.0.1:52368': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:37:04,480 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33477': TLS handshake failed with remote 'tls://127.0.0.1:52370': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:37:04,481 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:37:05,488 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:37:05,495 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40645 4768s 2024-11-23 21:37:05,496 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41467/status 4768s 2024-11-23 21:37:05,496 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:37:05,514 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39753 4768s 2024-11-23 21:37:05,514 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39753 4768s 2024-11-23 21:37:05,514 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:37:05,514 - distributed.worker - INFO - dashboard at: 127.0.0.1:44117 4768s 2024-11-23 21:37:05,515 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40645 4768s 2024-11-23 21:37:05,515 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:37:05,515 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:37:05,515 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:37:05,515 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-h4uktr1d 4768s 2024-11-23 21:37:05,515 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:37:05,518 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37347 4768s 2024-11-23 21:37:05,518 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37347 4768s 2024-11-23 21:37:05,519 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:37:05,519 - distributed.worker - INFO - dashboard at: 127.0.0.1:33597 4768s 2024-11-23 21:37:05,519 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40645 4768s 2024-11-23 21:37:05,519 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:37:05,519 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:37:05,519 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:37:05,519 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-c24tfgkt 4768s 2024-11-23 21:37:05,519 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:37:05,520 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39753. Reason: failure-to-start- 4768s 2024-11-23 21:37:05,520 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:37:05,521 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37347. Reason: failure-to-start- 4768s 2024-11-23 21:37:05,521 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:37:05,523 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40645': TLS handshake failed with remote 'tls://127.0.0.1:36512': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:37:05,523 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40645': TLS handshake failed with remote 'tls://127.0.0.1:36522': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:37:05,524 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:37:06,531 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:37:06,538 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38079 4768s 2024-11-23 21:37:06,539 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44597/status 4768s 2024-11-23 21:37:06,539 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:37:06,554 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45133 4768s 2024-11-23 21:37:06,555 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45133 4768s 2024-11-23 21:37:06,555 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:37:06,555 - distributed.worker - INFO - dashboard at: 127.0.0.1:40199 4768s 2024-11-23 21:37:06,555 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38079 4768s 2024-11-23 21:37:06,555 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:37:06,555 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:37:06,555 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:37:06,555 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-8ycvo9zw 4768s 2024-11-23 21:37:06,555 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:37:06,557 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41629 4768s 2024-11-23 21:37:06,558 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41629 4768s 2024-11-23 21:37:06,558 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:37:06,558 - distributed.worker - INFO - dashboard at: 127.0.0.1:43467 4768s 2024-11-23 21:37:06,558 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38079 4768s 2024-11-23 21:37:06,558 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:37:06,558 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:37:06,558 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:37:06,558 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ff1uypwu 4768s 2024-11-23 21:37:06,558 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:37:06,563 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45133. Reason: failure-to-start- 4768s 2024-11-23 21:37:06,564 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:37:06,564 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41629. Reason: failure-to-start- 4768s 2024-11-23 21:37:06,564 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:37:06,566 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38079': TLS handshake failed with remote 'tls://127.0.0.1:48074': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:37:06,566 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38079': TLS handshake failed with remote 'tls://127.0.0.1:48078': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:37:06,568 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:37:07,574 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:37:07,581 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34387 4768s 2024-11-23 21:37:07,581 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37205/status 4768s 2024-11-23 21:37:07,582 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:37:07,601 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37011 4768s 2024-11-23 21:37:07,601 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37011 4768s 2024-11-23 21:37:07,601 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:37:07,601 - distributed.worker - INFO - dashboard at: 127.0.0.1:35935 4768s 2024-11-23 21:37:07,601 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34387 4768s 2024-11-23 21:37:07,601 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:37:07,602 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:37:07,602 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:37:07,602 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-13mtpixg 4768s 2024-11-23 21:37:07,602 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:37:07,604 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33793 4768s 2024-11-23 21:37:07,604 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33793 4768s 2024-11-23 21:37:07,604 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:37:07,604 - distributed.worker - INFO - dashboard at: 127.0.0.1:38799 4768s 2024-11-23 21:37:07,604 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34387 4768s 2024-11-23 21:37:07,604 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:37:07,604 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:37:07,604 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:37:07,605 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ij4jfxo5 4768s 2024-11-23 21:37:07,605 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:37:07,606 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37011. Reason: failure-to-start- 4768s 2024-11-23 21:37:07,606 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:37:07,607 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33793. Reason: failure-to-start- 4768s 2024-11-23 21:37:07,607 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:37:07,608 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34387': TLS handshake failed with remote 'tls://127.0.0.1:46870': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:37:07,608 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34387': TLS handshake failed with remote 'tls://127.0.0.1:46880': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:37:07,610 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:37:08,615 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:37:08,625 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39213 4768s 2024-11-23 21:37:08,625 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35571/status 4768s 2024-11-23 21:37:08,625 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:37:08,644 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34149 4768s 2024-11-23 21:37:08,644 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34149 4768s 2024-11-23 21:37:08,644 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:37:08,644 - distributed.worker - INFO - dashboard at: 127.0.0.1:33811 4768s 2024-11-23 21:37:08,644 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39213 4768s 2024-11-23 21:37:08,645 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:37:08,645 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:37:08,645 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:37:08,645 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-exl09mk9 4768s 2024-11-23 21:37:08,645 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:37:08,647 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43053 4768s 2024-11-23 21:37:08,647 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43053 4768s 2024-11-23 21:37:08,647 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:37:08,648 - distributed.worker - INFO - dashboard at: 127.0.0.1:45215 4768s 2024-11-23 21:37:08,648 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39213 4768s 2024-11-23 21:37:08,648 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:37:08,648 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:37:08,648 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:37:08,648 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-_5hjo7zv 4768s 2024-11-23 21:37:08,648 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:37:08,649 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34149. Reason: failure-to-start- 4768s 2024-11-23 21:37:08,649 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:37:08,650 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43053. Reason: failure-to-start- 4768s 2024-11-23 21:37:08,650 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:37:08,652 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39213': TLS handshake failed with remote 'tls://127.0.0.1:54364': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:37:08,652 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39213': TLS handshake failed with remote 'tls://127.0.0.1:54370': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:37:08,653 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:37:09,659 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:37:09,666 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42269 4768s 2024-11-23 21:37:09,667 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34079/status 4768s 2024-11-23 21:37:09,667 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:37:09,702 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:32849 4768s 2024-11-23 21:37:09,702 - distributed.worker - INFO - Listening to: tls://127.0.0.1:32849 4768s 2024-11-23 21:37:09,702 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:37:09,702 - distributed.worker - INFO - dashboard at: 127.0.0.1:44679 4768s 2024-11-23 21:37:09,702 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42269 4768s 2024-11-23 21:37:09,702 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:37:09,702 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:37:09,702 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:37:09,702 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-_94un1wi 4768s 2024-11-23 21:37:09,702 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:37:09,705 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36601 4768s 2024-11-23 21:37:09,705 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36601 4768s 2024-11-23 21:37:09,705 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:37:09,705 - distributed.worker - INFO - dashboard at: 127.0.0.1:45931 4768s 2024-11-23 21:37:09,705 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42269 4768s 2024-11-23 21:37:09,705 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:37:09,705 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:37:09,705 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:37:09,705 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-yhrauluh 4768s 2024-11-23 21:37:09,705 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:37:09,707 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:32849. Reason: failure-to-start- 4768s 2024-11-23 21:37:09,707 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:37:09,707 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36601. Reason: failure-to-start- 4768s 2024-11-23 21:37:09,707 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:37:09,712 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42269': TLS handshake failed with remote 'tls://127.0.0.1:57000': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:37:09,712 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42269': TLS handshake failed with remote 'tls://127.0.0.1:57006': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:37:09,714 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:37:10,720 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:37:10,728 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40793 4768s 2024-11-23 21:37:10,728 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35347/status 4768s 2024-11-23 21:37:10,729 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:37:10,746 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43329 4768s 2024-11-23 21:37:10,747 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43329 4768s 2024-11-23 21:37:10,747 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:37:10,747 - distributed.worker - INFO - dashboard at: 127.0.0.1:39887 4768s 2024-11-23 21:37:10,747 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40793 4768s 2024-11-23 21:37:10,747 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:37:10,747 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:37:10,747 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:37:10,747 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ow9v0xhz 4768s 2024-11-23 21:37:10,747 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:37:10,751 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:32867 4768s 2024-11-23 21:37:10,751 - distributed.worker - INFO - Listening to: tls://127.0.0.1:32867 4768s 2024-11-23 21:37:10,751 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:37:10,751 - distributed.worker - INFO - dashboard at: 127.0.0.1:42235 4768s 2024-11-23 21:37:10,751 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40793 4768s 2024-11-23 21:37:10,751 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:37:10,751 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:37:10,751 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:37:10,751 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-xwl0kw7c 4768s 2024-11-23 21:37:10,751 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:37:10,756 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43329. Reason: failure-to-start- 4768s 2024-11-23 21:37:10,756 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:37:10,756 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:32867. Reason: failure-to-start- 4768s 2024-11-23 21:37:10,757 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:37:10,758 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40793': TLS handshake failed with remote 'tls://127.0.0.1:54992': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:37:10,758 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40793': TLS handshake failed with remote 'tls://127.0.0.1:55008': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:37:10,760 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:37:11,767 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:37:11,773 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45823 4768s 2024-11-23 21:37:11,773 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43319/status 4768s 2024-11-23 21:37:11,774 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:37:11,788 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36003 4768s 2024-11-23 21:37:11,788 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36003 4768s 2024-11-23 21:37:11,788 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:37:11,788 - distributed.worker - INFO - dashboard at: 127.0.0.1:46337 4768s 2024-11-23 21:37:11,788 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45823 4768s 2024-11-23 21:37:11,788 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:37:11,788 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:37:11,788 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:37:11,789 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-fsu3xv5b 4768s 2024-11-23 21:37:11,789 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:37:11,791 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41953 4768s 2024-11-23 21:37:11,791 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41953 4768s 2024-11-23 21:37:11,791 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:37:11,791 - distributed.worker - INFO - dashboard at: 127.0.0.1:37591 4768s 2024-11-23 21:37:11,791 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45823 4768s 2024-11-23 21:37:11,791 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:37:11,791 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:37:11,791 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:37:11,791 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-_woiflzx 4768s 2024-11-23 21:37:11,791 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:37:11,795 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36003. Reason: failure-to-start- 4768s 2024-11-23 21:37:11,795 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:37:11,796 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41953. Reason: failure-to-start- 4768s 2024-11-23 21:37:11,797 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:37:11,799 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45823': TLS handshake failed with remote 'tls://127.0.0.1:50360': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:37:11,799 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45823': TLS handshake failed with remote 'tls://127.0.0.1:50368': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:37:11,804 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:37:12,810 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:37:12,818 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33105 4768s 2024-11-23 21:37:12,818 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38081/status 4768s 2024-11-23 21:37:12,819 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:37:12,835 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45611 4768s 2024-11-23 21:37:12,835 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45611 4768s 2024-11-23 21:37:12,835 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:37:12,835 - distributed.worker - INFO - dashboard at: 127.0.0.1:46233 4768s 2024-11-23 21:37:12,835 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33105 4768s 2024-11-23 21:37:12,835 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:37:12,835 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:37:12,835 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:37:12,835 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-dp_wgtrv 4768s 2024-11-23 21:37:12,835 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:37:12,838 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33933 4768s 2024-11-23 21:37:12,838 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33933 4768s 2024-11-23 21:37:12,838 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:37:12,838 - distributed.worker - INFO - dashboard at: 127.0.0.1:43539 4768s 2024-11-23 21:37:12,838 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33105 4768s 2024-11-23 21:37:12,838 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:37:12,838 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:37:12,838 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:37:12,838 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-c5k54l9k 4768s 2024-11-23 21:37:12,838 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:37:12,843 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45611. Reason: failure-to-start- 4768s 2024-11-23 21:37:12,843 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:37:12,843 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33933. Reason: failure-to-start- 4768s 2024-11-23 21:37:12,844 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:37:12,848 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33105': TLS handshake failed with remote 'tls://127.0.0.1:57274': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:37:12,848 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33105': TLS handshake failed with remote 'tls://127.0.0.1:57282': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:37:12,850 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:37:13,856 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:37:13,866 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40937 4768s 2024-11-23 21:37:13,866 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41041/status 4768s 2024-11-23 21:37:13,866 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:37:13,883 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43357 4768s 2024-11-23 21:37:13,884 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43357 4768s 2024-11-23 21:37:13,884 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:37:13,884 - distributed.worker - INFO - dashboard at: 127.0.0.1:40989 4768s 2024-11-23 21:37:13,884 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40937 4768s 2024-11-23 21:37:13,884 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:37:13,884 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:37:13,884 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:37:13,884 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-hrsh2mry 4768s 2024-11-23 21:37:13,884 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:37:13,886 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42209 4768s 2024-11-23 21:37:13,886 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42209 4768s 2024-11-23 21:37:13,887 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:37:13,887 - distributed.worker - INFO - dashboard at: 127.0.0.1:41177 4768s 2024-11-23 21:37:13,887 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40937 4768s 2024-11-23 21:37:13,887 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:37:13,887 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:37:13,887 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:37:13,887 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-62d1cy2h 4768s 2024-11-23 21:37:13,887 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:37:13,893 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43357. Reason: failure-to-start- 4768s 2024-11-23 21:37:13,894 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:37:13,894 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42209. Reason: failure-to-start- 4768s 2024-11-23 21:37:13,895 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:37:13,896 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40937': TLS handshake failed with remote 'tls://127.0.0.1:37746': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:37:13,896 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40937': TLS handshake failed with remote 'tls://127.0.0.1:37754': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:37:13,898 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:37:14,904 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:37:14,912 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41667 4768s 2024-11-23 21:37:14,912 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41991/status 4768s 2024-11-23 21:37:14,912 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:37:14,934 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39663 4768s 2024-11-23 21:37:14,935 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39663 4768s 2024-11-23 21:37:14,935 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:37:14,935 - distributed.worker - INFO - dashboard at: 127.0.0.1:34125 4768s 2024-11-23 21:37:14,935 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41667 4768s 2024-11-23 21:37:14,935 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:37:14,935 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:37:14,935 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:37:14,935 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-xx_h7bdd 4768s 2024-11-23 21:37:14,935 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:37:14,937 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44907 4768s 2024-11-23 21:37:14,938 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44907 4768s 2024-11-23 21:37:14,938 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:37:14,938 - distributed.worker - INFO - dashboard at: 127.0.0.1:38577 4768s 2024-11-23 21:37:14,938 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41667 4768s 2024-11-23 21:37:14,938 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:37:14,938 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:37:14,938 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:37:14,938 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-t0626mmo 4768s 2024-11-23 21:37:14,938 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:37:14,942 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39663. Reason: failure-to-start- 4768s 2024-11-23 21:37:14,942 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:37:14,943 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44907. Reason: failure-to-start- 4768s 2024-11-23 21:37:14,943 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:37:14,945 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41667': TLS handshake failed with remote 'tls://127.0.0.1:42640': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:37:14,945 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41667': TLS handshake failed with remote 'tls://127.0.0.1:42650': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:37:14,947 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:37:15,954 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:37:15,962 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43247 4768s 2024-11-23 21:37:15,962 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46007/status 4768s 2024-11-23 21:37:15,963 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:37:15,985 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44539 4768s 2024-11-23 21:37:15,985 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44539 4768s 2024-11-23 21:37:15,985 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:37:15,985 - distributed.worker - INFO - dashboard at: 127.0.0.1:45087 4768s 2024-11-23 21:37:15,986 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43247 4768s 2024-11-23 21:37:15,986 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:37:15,986 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:37:15,986 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:37:15,986 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-hcrr9o9b 4768s 2024-11-23 21:37:15,986 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:37:15,988 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33933 4768s 2024-11-23 21:37:15,988 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33933 4768s 2024-11-23 21:37:15,988 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:37:15,988 - distributed.worker - INFO - dashboard at: 127.0.0.1:41715 4768s 2024-11-23 21:37:15,988 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43247 4768s 2024-11-23 21:37:15,988 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:37:15,989 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:37:15,989 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:37:15,989 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-1sfyme0b 4768s 2024-11-23 21:37:15,989 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:37:15,990 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44539. Reason: failure-to-start- 4768s 2024-11-23 21:37:15,990 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:37:15,991 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33933. Reason: failure-to-start- 4768s 2024-11-23 21:37:15,991 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:37:15,992 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43247': TLS handshake failed with remote 'tls://127.0.0.1:40088': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:37:15,993 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43247': TLS handshake failed with remote 'tls://127.0.0.1:40092': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:37:15,994 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:37:17,001 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:37:17,009 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46385 4768s 2024-11-23 21:37:17,010 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35597/status 4768s 2024-11-23 21:37:17,012 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:37:17,029 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42747 4768s 2024-11-23 21:37:17,029 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42747 4768s 2024-11-23 21:37:17,029 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:37:17,029 - distributed.worker - INFO - dashboard at: 127.0.0.1:36435 4768s 2024-11-23 21:37:17,029 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46385 4768s 2024-11-23 21:37:17,029 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:37:17,029 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:37:17,030 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:37:17,030 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-jgd6j4g9 4768s 2024-11-23 21:37:17,030 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:37:17,032 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35891 4768s 2024-11-23 21:37:17,032 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35891 4768s 2024-11-23 21:37:17,032 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:37:17,033 - distributed.worker - INFO - dashboard at: 127.0.0.1:46073 4768s 2024-11-23 21:37:17,033 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46385 4768s 2024-11-23 21:37:17,033 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:37:17,033 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:37:17,033 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:37:17,033 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-dhnhqivb 4768s 2024-11-23 21:37:17,033 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:37:17,036 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42747. Reason: failure-to-start- 4768s 2024-11-23 21:37:17,036 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:37:17,037 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35891. Reason: failure-to-start- 4768s 2024-11-23 21:37:17,037 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:37:17,039 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46385': TLS handshake failed with remote 'tls://127.0.0.1:35458': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:37:17,039 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46385': TLS handshake failed with remote 'tls://127.0.0.1:35470': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:37:17,047 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s _____________________________ test_repr_temp_keys ______________________________ 4768s 4768s cls = , kwargs = {} 4768s 4768s @classmethod 4768s def temporary(cls, **kwargs): 4768s """Create a new temporary Security object. 4768s 4768s This creates a new self-signed key/cert pair suitable for securing 4768s communication for all roles in a Dask cluster. These keys/certs exist 4768s only in memory, and are stored in this object. 4768s 4768s This method requires the library ``cryptography`` be installed. 4768s """ 4768s try: 4768s > from cryptography import x509 4768s 4768s /usr/lib/python3/dist-packages/distributed/security.py:165: 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s /usr/lib/python3/dist-packages/cryptography/x509/__init__.py:7: in 4768s from cryptography.x509 import certificate_transparency, verification 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s 4768s # This file is dual licensed under the terms of the Apache License, Version 4768s # 2.0, and the BSD License. See the LICENSE file in the root of this repository 4768s # for complete details. 4768s 4768s from __future__ import annotations 4768s 4768s import abc 4768s import datetime 4768s 4768s from cryptography import utils 4768s > from cryptography.hazmat.bindings._rust import x509 as rust_x509 4768s E ImportError: cannot import name 'x509' from 'cryptography.hazmat.bindings._rust' (unknown location) 4768s 4768s /usr/lib/python3/dist-packages/cryptography/x509/certificate_transparency.py:11: ImportError 4768s 4768s During handling of the above exception, another exception occurred: 4768s 4768s def test_repr_temp_keys(): 4768s > xfail_ssl_issue5601() 4768s 4768s /usr/lib/python3/dist-packages/distributed/tests/test_security.py:155: 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s /usr/lib/python3/dist-packages/distributed/utils_test.py:1945: in xfail_ssl_issue5601 4768s Security.temporary() 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s 4768s cls = , kwargs = {} 4768s 4768s @classmethod 4768s def temporary(cls, **kwargs): 4768s """Create a new temporary Security object. 4768s 4768s This creates a new self-signed key/cert pair suitable for securing 4768s communication for all roles in a Dask cluster. These keys/certs exist 4768s only in memory, and are stored in this object. 4768s 4768s This method requires the library ``cryptography`` be installed. 4768s """ 4768s try: 4768s from cryptography import x509 4768s from cryptography.hazmat.backends import default_backend 4768s from cryptography.hazmat.primitives import hashes, serialization 4768s from cryptography.hazmat.primitives.asymmetric import rsa 4768s from cryptography.x509.oid import NameOID 4768s except ImportError: 4768s > raise ImportError( 4768s "Using `Security.temporary` requires `cryptography`, please " 4768s "install it using either pip or conda" 4768s ) 4768s E ImportError: Using `Security.temporary` requires `cryptography`, please install it using either pip or conda 4768s 4768s /usr/lib/python3/dist-packages/distributed/security.py:171: ImportError 4768s __________________________ test_temporary_credentials __________________________ 4768s 4768s cls = , kwargs = {} 4768s 4768s @classmethod 4768s def temporary(cls, **kwargs): 4768s """Create a new temporary Security object. 4768s 4768s This creates a new self-signed key/cert pair suitable for securing 4768s communication for all roles in a Dask cluster. These keys/certs exist 4768s only in memory, and are stored in this object. 4768s 4768s This method requires the library ``cryptography`` be installed. 4768s """ 4768s try: 4768s > from cryptography import x509 4768s 4768s /usr/lib/python3/dist-packages/distributed/security.py:165: 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s /usr/lib/python3/dist-packages/cryptography/x509/__init__.py:7: in 4768s from cryptography.x509 import certificate_transparency, verification 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s 4768s # This file is dual licensed under the terms of the Apache License, Version 4768s # 2.0, and the BSD License. See the LICENSE file in the root of this repository 4768s # for complete details. 4768s 4768s from __future__ import annotations 4768s 4768s import abc 4768s import datetime 4768s 4768s from cryptography import utils 4768s > from cryptography.hazmat.bindings._rust import x509 as rust_x509 4768s E ImportError: cannot import name 'x509' from 'cryptography.hazmat.bindings._rust' (unknown location) 4768s 4768s /usr/lib/python3/dist-packages/cryptography/x509/certificate_transparency.py:11: ImportError 4768s 4768s During handling of the above exception, another exception occurred: 4768s 4768s def test_temporary_credentials(): 4768s > xfail_ssl_issue5601() 4768s 4768s /usr/lib/python3/dist-packages/distributed/tests/test_security.py:448: 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s /usr/lib/python3/dist-packages/distributed/utils_test.py:1945: in xfail_ssl_issue5601 4768s Security.temporary() 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s 4768s cls = , kwargs = {} 4768s 4768s @classmethod 4768s def temporary(cls, **kwargs): 4768s """Create a new temporary Security object. 4768s 4768s This creates a new self-signed key/cert pair suitable for securing 4768s communication for all roles in a Dask cluster. These keys/certs exist 4768s only in memory, and are stored in this object. 4768s 4768s This method requires the library ``cryptography`` be installed. 4768s """ 4768s try: 4768s from cryptography import x509 4768s from cryptography.hazmat.backends import default_backend 4768s from cryptography.hazmat.primitives import hashes, serialization 4768s from cryptography.hazmat.primitives.asymmetric import rsa 4768s from cryptography.x509.oid import NameOID 4768s except ImportError: 4768s > raise ImportError( 4768s "Using `Security.temporary` requires `cryptography`, please " 4768s "install it using either pip or conda" 4768s ) 4768s E ImportError: Using `Security.temporary` requires `cryptography`, please install it using either pip or conda 4768s 4768s /usr/lib/python3/dist-packages/distributed/security.py:171: ImportError 4768s ________________ test_extra_conn_args_in_temporary_credentials _________________ 4768s 4768s cls = , kwargs = {} 4768s 4768s @classmethod 4768s def temporary(cls, **kwargs): 4768s """Create a new temporary Security object. 4768s 4768s This creates a new self-signed key/cert pair suitable for securing 4768s communication for all roles in a Dask cluster. These keys/certs exist 4768s only in memory, and are stored in this object. 4768s 4768s This method requires the library ``cryptography`` be installed. 4768s """ 4768s try: 4768s > from cryptography import x509 4768s 4768s /usr/lib/python3/dist-packages/distributed/security.py:165: 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s /usr/lib/python3/dist-packages/cryptography/x509/__init__.py:7: in 4768s from cryptography.x509 import certificate_transparency, verification 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s 4768s # This file is dual licensed under the terms of the Apache License, Version 4768s # 2.0, and the BSD License. See the LICENSE file in the root of this repository 4768s # for complete details. 4768s 4768s from __future__ import annotations 4768s 4768s import abc 4768s import datetime 4768s 4768s from cryptography import utils 4768s > from cryptography.hazmat.bindings._rust import x509 as rust_x509 4768s E ImportError: cannot import name 'x509' from 'cryptography.hazmat.bindings._rust' (unknown location) 4768s 4768s /usr/lib/python3/dist-packages/cryptography/x509/certificate_transparency.py:11: ImportError 4768s 4768s During handling of the above exception, another exception occurred: 4768s 4768s def test_extra_conn_args_in_temporary_credentials(): 4768s > xfail_ssl_issue5601() 4768s 4768s /usr/lib/python3/dist-packages/distributed/tests/test_security.py:466: 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s /usr/lib/python3/dist-packages/distributed/utils_test.py:1945: in xfail_ssl_issue5601 4768s Security.temporary() 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s 4768s cls = , kwargs = {} 4768s 4768s @classmethod 4768s def temporary(cls, **kwargs): 4768s """Create a new temporary Security object. 4768s 4768s This creates a new self-signed key/cert pair suitable for securing 4768s communication for all roles in a Dask cluster. These keys/certs exist 4768s only in memory, and are stored in this object. 4768s 4768s This method requires the library ``cryptography`` be installed. 4768s """ 4768s try: 4768s from cryptography import x509 4768s from cryptography.hazmat.backends import default_backend 4768s from cryptography.hazmat.primitives import hashes, serialization 4768s from cryptography.hazmat.primitives.asymmetric import rsa 4768s from cryptography.x509.oid import NameOID 4768s except ImportError: 4768s > raise ImportError( 4768s "Using `Security.temporary` requires `cryptography`, please " 4768s "install it using either pip or conda" 4768s ) 4768s E ImportError: Using `Security.temporary` requires `cryptography`, please install it using either pip or conda 4768s 4768s /usr/lib/python3/dist-packages/distributed/security.py:171: ImportError 4768s __________________________________ test_basic __________________________________ 4768s 4768s fut = , timeout = 0 4768s 4768s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 4768s async with asyncio.timeout(timeout): 4768s > return await fut 4768s 4768s /usr/lib/python3/dist-packages/distributed/utils.py:1960: 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s /usr/lib/python3/dist-packages/distributed/worker.py:1480: in start_unsafe 4768s await self._register_with_scheduler() 4768s /usr/lib/python3/dist-packages/distributed/worker.py:1179: in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s /usr/lib/python3/dist-packages/distributed/comm/core.py:342: in connect 4768s comm = await wait_for( 4768s /usr/lib/python3/dist-packages/distributed/utils.py:1960: in wait_for 4768s return await fut 4768s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:546: in connect 4768s stream = await self.client.connect( 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s 4768s self = , host = '127.0.0.1' 4768s port = 41641, af = 4768s ssl_options = 4768s max_buffer_size = 8364507136.0, source_ip = None, source_port = None 4768s timeout = None 4768s 4768s async def connect( 4768s self, 4768s host: str, 4768s port: int, 4768s af: socket.AddressFamily = socket.AF_UNSPEC, 4768s ssl_options: Optional[Union[Dict[str, Any], ssl.SSLContext]] = None, 4768s max_buffer_size: Optional[int] = None, 4768s source_ip: Optional[str] = None, 4768s source_port: Optional[int] = None, 4768s timeout: Optional[Union[float, datetime.timedelta]] = None, 4768s ) -> IOStream: 4768s """Connect to the given host and port. 4768s 4768s Asynchronously returns an `.IOStream` (or `.SSLIOStream` if 4768s ``ssl_options`` is not None). 4768s 4768s Using the ``source_ip`` kwarg, one can specify the source 4768s IP address to use when establishing the connection. 4768s In case the user needs to resolve and 4768s use a specific interface, it has to be handled outside 4768s of Tornado as this depends very much on the platform. 4768s 4768s Raises `TimeoutError` if the input future does not complete before 4768s ``timeout``, which may be specified in any form allowed by 4768s `.IOLoop.add_timeout` (i.e. a `datetime.timedelta` or an absolute time 4768s relative to `.IOLoop.time`) 4768s 4768s Similarly, when the user requires a certain source port, it can 4768s be specified using the ``source_port`` arg. 4768s 4768s .. versionchanged:: 4.5 4768s Added the ``source_ip`` and ``source_port`` arguments. 4768s 4768s .. versionchanged:: 5.0 4768s Added the ``timeout`` argument. 4768s """ 4768s if timeout is not None: 4768s if isinstance(timeout, numbers.Real): 4768s timeout = IOLoop.current().time() + timeout 4768s elif isinstance(timeout, datetime.timedelta): 4768s timeout = IOLoop.current().time() + timeout.total_seconds() 4768s else: 4768s raise TypeError("Unsupported timeout %r" % timeout) 4768s if timeout is not None: 4768s addrinfo = await gen.with_timeout( 4768s timeout, self.resolver.resolve(host, port, af) 4768s ) 4768s else: 4768s addrinfo = await self.resolver.resolve(host, port, af) 4768s connector = _Connector( 4768s addrinfo, 4768s functools.partial( 4768s self._create_stream, 4768s max_buffer_size, 4768s source_ip=source_ip, 4768s source_port=source_port, 4768s ), 4768s ) 4768s > af, addr, stream = await connector.start(connect_timeout=timeout) 4768s E asyncio.exceptions.CancelledError 4768s 4768s /usr/lib/python3/dist-packages/tornado/tcpclient.py:279: CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s self = 4768s 4768s @final 4768s async def start(self): 4768s async with self._startup_lock: 4768s if self.status == Status.failed: 4768s assert self.__startup_exc is not None 4768s raise self.__startup_exc 4768s elif self.status != Status.init: 4768s return self 4768s timeout = getattr(self, "death_timeout", None) 4768s 4768s async def _close_on_failure(exc: Exception) -> None: 4768s await self.close(reason=f"failure-to-start-{str(type(exc))}") 4768s self.status = Status.failed 4768s self.__startup_exc = exc 4768s 4768s try: 4768s > await wait_for(self.start_unsafe(), timeout=timeout) 4768s 4768s /usr/lib/python3/dist-packages/distributed/core.py:664: 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 4768s async with asyncio.timeout(timeout): 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s 4768s self = 4768s exc_type = 4768s exc_val = CancelledError(), exc_tb = 4768s 4768s async def __aexit__( 4768s self, 4768s exc_type: Optional[Type[BaseException]], 4768s exc_val: Optional[BaseException], 4768s exc_tb: Optional[TracebackType], 4768s ) -> Optional[bool]: 4768s assert self._state in (_State.ENTERED, _State.EXPIRING) 4768s 4768s if self._timeout_handler is not None: 4768s self._timeout_handler.cancel() 4768s self._timeout_handler = None 4768s 4768s if self._state is _State.EXPIRING: 4768s self._state = _State.EXPIRED 4768s 4768s if self._task.uncancel() <= self._cancelling and exc_type is not None: 4768s # Since there are no new cancel requests, we're 4768s # handling this. 4768s if issubclass(exc_type, exceptions.CancelledError): 4768s > raise TimeoutError from exc_val 4768s E TimeoutError 4768s 4768s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s @contextlib.asynccontextmanager 4768s async def _cluster_factory(): 4768s workers = [] 4768s s = None 4768s try: 4768s for _ in range(60): 4768s try: 4768s > s, ws = await start_cluster( 4768s nthreads, 4768s scheduler, 4768s security=security, 4768s Worker=Worker, 4768s scheduler_kwargs=scheduler_kwargs, 4768s worker_kwargs=merge( 4768s {"death_timeout": min(15, int(deadline.remaining))}, 4768s worker_kwargs, 4768s ), 4768s ) 4768s 4768s /usr/lib/python3/dist-packages/distributed/utils_test.py:966: 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s /usr/lib/python3/dist-packages/distributed/utils_test.py:789: in start_cluster 4768s await asyncio.gather(*workers) 4768s /usr/lib/python3.13/asyncio/tasks.py:737: in _wrap_awaitable 4768s return await awaitable 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s 4768s self = 4768s 4768s @final 4768s async def start(self): 4768s async with self._startup_lock: 4768s if self.status == Status.failed: 4768s assert self.__startup_exc is not None 4768s raise self.__startup_exc 4768s elif self.status != Status.init: 4768s return self 4768s timeout = getattr(self, "death_timeout", None) 4768s 4768s async def _close_on_failure(exc: Exception) -> None: 4768s await self.close(reason=f"failure-to-start-{str(type(exc))}") 4768s self.status = Status.failed 4768s self.__startup_exc = exc 4768s 4768s try: 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s except asyncio.TimeoutError as exc: 4768s await _close_on_failure(exc) 4768s > raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s E TimeoutError: Worker start timed out after 0s. 4768s 4768s /usr/lib/python3/dist-packages/distributed/core.py:667: TimeoutError 4768s 4768s During handling of the above exception, another exception occurred: 4768s 4768s fut = ._..test_func..async_fn at 0xea3f82e0> 4768s timeout = 60 4768s 4768s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 4768s async with asyncio.timeout(timeout): 4768s > return await fut 4768s 4768s /usr/lib/python3/dist-packages/distributed/utils.py:1960: 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s /usr/lib/python3/dist-packages/distributed/utils_test.py:999: in async_fn 4768s _cluster_factory() as (s, workers), 4768s /usr/lib/python3.13/contextlib.py:214: in __aenter__ 4768s return await anext(self.gen) 4768s /usr/lib/python3/dist-packages/distributed/utils_test.py:983: in _cluster_factory 4768s await asyncio.sleep(1) 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s 4768s delay = 1, result = None 4768s 4768s async def sleep(delay, result=None): 4768s """Coroutine that completes after a given time (in seconds).""" 4768s if delay <= 0: 4768s await __sleep0() 4768s return result 4768s 4768s if math.isnan(delay): 4768s raise ValueError("Invalid delay: NaN (not a number)") 4768s 4768s loop = events.get_running_loop() 4768s future = loop.create_future() 4768s h = loop.call_later(delay, 4768s futures._set_result_unless_cancelled, 4768s future, result) 4768s try: 4768s > return await future 4768s E asyncio.exceptions.CancelledError 4768s 4768s /usr/lib/python3.13/asyncio/tasks.py:718: CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s args = (), kwds = {} 4768s 4768s @wraps(func) 4768s def inner(*args, **kwds): 4768s with self._recreate_cm(): 4768s > return func(*args, **kwds) 4768s 4768s /usr/lib/python3.13/contextlib.py:85: 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s /usr/lib/python3.13/contextlib.py:85: in inner 4768s return func(*args, **kwds) 4768s /usr/lib/python3/dist-packages/distributed/utils_test.py:1102: in test_func 4768s return _run_and_close_tornado(async_fn_outer) 4768s /usr/lib/python3/dist-packages/distributed/utils_test.py:378: in _run_and_close_tornado 4768s return asyncio_run(inner_fn(), loop_factory=get_loop_factory()) 4768s /usr/lib/python3.13/asyncio/runners.py:194: in run 4768s return runner.run(main) 4768s /usr/lib/python3.13/asyncio/runners.py:118: in run 4768s return self._loop.run_until_complete(task) 4768s /usr/lib/python3.13/asyncio/base_events.py:720: in run_until_complete 4768s return future.result() 4768s /usr/lib/python3/dist-packages/distributed/utils_test.py:375: in inner_fn 4768s return await async_fn(*args, **kwargs) 4768s /usr/lib/python3/dist-packages/distributed/utils_test.py:1099: in async_fn_outer 4768s return await utils_wait_for(async_fn(), timeout=timeout * 2) 4768s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 4768s async with asyncio.timeout(timeout): 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s 4768s self = 4768s exc_type = 4768s exc_val = CancelledError(), exc_tb = 4768s 4768s async def __aexit__( 4768s self, 4768s exc_type: Optional[Type[BaseException]], 4768s exc_val: Optional[BaseException], 4768s exc_tb: Optional[TracebackType], 4768s ) -> Optional[bool]: 4768s assert self._state in (_State.ENTERED, _State.EXPIRING) 4768s 4768s if self._timeout_handler is not None: 4768s self._timeout_handler.cancel() 4768s self._timeout_handler = None 4768s 4768s if self._state is _State.EXPIRING: 4768s self._state = _State.EXPIRED 4768s 4768s if self._task.uncancel() <= self._cancelling and exc_type is not None: 4768s # Since there are no new cancel requests, we're 4768s # handling this. 4768s if issubclass(exc_type, exceptions.CancelledError): 4768s > raise TimeoutError from exc_val 4768s E TimeoutError 4768s 4768s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 4768s ----------------------------- Captured stderr call ----------------------------- 4768s 2024-11-23 21:37:18,854 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:37:18,863 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:18,863 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36411/status 4768s 2024-11-23 21:37:18,864 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:37:18,879 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39399 4768s 2024-11-23 21:37:18,880 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39399 4768s 2024-11-23 21:37:18,880 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:37:18,880 - distributed.worker - INFO - dashboard at: 127.0.0.1:33369 4768s 2024-11-23 21:37:18,880 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:18,880 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:37:18,880 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:37:18,880 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:37:18,880 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-mks9lv7s 4768s 2024-11-23 21:37:18,880 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:37:18,882 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44061 4768s 2024-11-23 21:37:18,883 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44061 4768s 2024-11-23 21:37:18,883 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:37:18,883 - distributed.worker - INFO - dashboard at: 127.0.0.1:39739 4768s 2024-11-23 21:37:18,883 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:18,883 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:37:18,883 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:37:18,883 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:37:18,883 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-a34bfgd1 4768s 2024-11-23 21:37:18,883 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:37:18,896 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:18,898 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:18,898 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:53158': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:18,898 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:53164': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:19,006 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:19,011 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:53174': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:19,012 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:19,012 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:53182': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:19,114 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:19,115 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:53190': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:19,122 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:19,123 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:53192': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:19,223 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:19,223 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:53200': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:19,230 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:19,231 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:53202': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:19,331 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:19,331 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:53204': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:19,338 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:19,338 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:53214': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:19,439 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:19,439 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:53222': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:19,446 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:19,446 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:53230': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:19,547 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:19,547 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:53234': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:19,554 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:19,554 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:53250': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:19,655 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:19,655 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:53266': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:19,663 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:19,663 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:53278': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:19,763 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:19,764 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:53288': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:19,771 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:19,771 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:53300': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:19,876 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:19,877 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:53302': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:19,883 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:19,883 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:53318': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:19,984 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:19,984 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:53328': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:19,991 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:19,992 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:53338': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:20,092 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:20,092 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:53344': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:20,099 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:20,099 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:53348': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:20,201 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:20,202 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:53360': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:20,208 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:20,209 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:53370': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:20,309 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:20,310 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:53376': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:20,317 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:20,317 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:53382': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:20,418 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:20,419 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:53398': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:20,426 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:20,426 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:53414': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:20,527 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:20,527 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:53420': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:20,534 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:20,534 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:53434': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:20,637 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:20,638 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:53450': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:20,644 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:20,645 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:53464': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:20,745 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:20,745 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:53476': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:20,752 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:20,752 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:53480': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:20,854 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:20,855 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:53490': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:20,861 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:20,862 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:53504': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:20,962 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:20,962 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:53506': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:20,969 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:20,970 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:53522': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:21,070 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:21,070 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:53528': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:21,077 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:21,078 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:53534': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:21,178 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:21,179 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:53536': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:21,186 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:21,186 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:53540': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:21,287 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:21,287 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:53548': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:21,294 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:21,295 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:53550': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:21,395 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:21,395 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:53554': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:21,402 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:21,403 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:53568': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:21,503 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:21,503 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:53570': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:21,510 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:21,511 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:53584': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:21,611 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:21,611 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:40654': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:21,620 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:21,620 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:40656': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:21,719 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:21,720 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:40660': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:21,727 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:21,727 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:40674': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:21,827 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:21,828 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:40678': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:21,834 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:21,835 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:40682': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:21,936 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:21,937 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:40698': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:21,943 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:21,943 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:40704': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:22,045 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:22,045 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:40712': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:22,052 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:22,052 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:40720': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:22,153 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:22,153 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:40722': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:22,160 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:22,160 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:40734': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:22,261 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:22,262 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:40744': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:22,269 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:22,269 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:40752': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:22,375 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:22,376 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:40760': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:22,382 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:22,383 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:40766': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:22,483 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:22,483 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:40770': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:22,490 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:22,491 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:40780': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:22,591 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:22,591 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:40786': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:22,598 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:22,598 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:40802': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:22,699 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:22,699 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:40812': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:22,706 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:22,706 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:40828': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:22,807 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:22,808 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:40840': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:22,815 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:22,815 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:40844': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:22,916 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:22,916 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:40846': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:22,923 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:22,924 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:40852': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:23,025 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:23,026 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:40858': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:23,032 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:23,033 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:40860': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:23,133 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:23,134 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:40862': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:23,142 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:23,143 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:40864': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:23,241 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:23,242 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:40880': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:23,250 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:23,250 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:40888': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:23,350 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:23,350 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:40892': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:23,357 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:23,358 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:40896': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:23,458 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:23,459 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:40908': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:23,465 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:23,466 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:40922': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:23,567 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:23,568 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:40932': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:23,575 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:23,575 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:40946': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:23,676 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:23,676 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:40956': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:23,683 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:23,683 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:40960': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:23,783 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:23,784 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:40966': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:23,791 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:23,791 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:40968': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:23,891 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:23,892 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:40978': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:23,898 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:23,899 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:40992': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:23,999 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:23,999 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:41002': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:24,006 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:24,006 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:41010': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:24,108 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:24,109 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:41020': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:24,115 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:24,116 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:41022': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:24,216 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:24,216 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:41036': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:24,223 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:24,223 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:41052': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:24,324 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:24,324 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:41064': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:24,331 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:24,332 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:41080': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:24,432 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:24,432 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:41096': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:24,439 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:24,439 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:41098': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:24,541 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:24,542 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:41102': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:24,548 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:24,549 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:41116': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:24,649 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:24,650 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:41128': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:24,658 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:24,659 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:41140': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:24,758 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:24,758 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:41152': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:24,765 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:24,766 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:41154': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:24,867 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:24,871 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:41160': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:24,878 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:24,878 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:41170': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:24,975 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:24,975 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:41172': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:24,985 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:24,986 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:41174': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:25,083 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:25,083 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:41188': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:25,094 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:25,094 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:41196': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:25,191 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:25,191 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:41208': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:25,201 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:25,202 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:41218': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:25,299 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:25,299 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:41230': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:25,309 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:25,310 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:41232': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:25,408 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:25,408 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:41236': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:25,417 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:25,418 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:41244': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:25,516 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:25,516 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:41258': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:25,525 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:25,526 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:41270': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:25,624 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:25,624 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:41286': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:25,633 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:25,634 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:41292': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:25,732 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:25,732 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:41302': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:25,741 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:25,742 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:41316': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:25,841 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:25,841 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:41332': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:25,849 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:25,850 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:41344': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:25,949 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:25,950 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:41352': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:25,956 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:25,957 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:41358': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:26,057 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:26,057 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:41368': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:26,065 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:26,065 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:41372': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:26,165 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:26,166 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:41376': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:26,174 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:26,175 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:41390': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:26,274 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:26,274 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:41404': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:26,281 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:26,282 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:41420': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:26,382 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:26,382 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:41428': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:26,389 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:26,390 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:41440': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:26,490 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:26,490 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:41450': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:26,497 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:26,497 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:41456': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:26,598 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:26,598 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:41470': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:26,605 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:26,605 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:41486': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:26,706 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:26,706 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:41490': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:26,713 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:26,713 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:41506': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:26,813 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:26,814 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:41518': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:26,821 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:26,821 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:41534': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:26,921 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:26,922 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:41538': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:26,929 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:26,929 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:41552': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:27,030 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:27,030 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:41556': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:27,037 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:27,037 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:41564': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:27,138 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:27,138 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:41578': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:27,145 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:27,146 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:41582': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:27,246 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:27,247 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:41584': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:27,254 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:27,254 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:41586': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:27,355 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:27,355 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:41596': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:27,362 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:27,363 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:41612': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:27,463 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:27,464 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:41628': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:27,471 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:27,471 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:41636': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:27,573 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:27,574 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:41638': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:27,580 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:27,581 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:41654': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:27,682 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:27,683 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:41660': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:27,691 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:27,691 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:41676': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:27,789 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:27,790 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:41678': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:27,799 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:27,799 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:41694': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:27,897 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:27,898 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:41696': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:27,907 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:27,907 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:41706': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:28,005 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:28,006 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:41714': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:28,015 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:28,015 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:41722': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:28,113 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:28,114 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:41732': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:28,122 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:28,123 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:41744': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:28,222 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:28,222 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:41750': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:28,230 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:28,230 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:41758': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:28,329 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:28,330 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:41768': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:28,338 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:28,338 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:41778': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:28,438 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:28,438 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:41782': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:28,445 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:28,445 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:41798': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:28,546 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:28,546 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:41804': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:28,553 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:28,554 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:41818': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:28,654 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:28,654 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:41824': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:28,661 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:28,662 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:41836': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:28,762 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:28,762 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:41840': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:28,769 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:28,770 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:41844': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:28,874 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:28,875 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:41846': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:28,881 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:28,882 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:41852': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:28,982 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:28,982 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:41868': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:28,989 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:28,990 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:41878': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:29,089 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:29,090 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:41884': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:29,097 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:29,097 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:41886': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:29,198 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:29,199 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:41902': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:29,207 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:29,208 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:41918': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:29,307 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:29,308 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:41924': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:29,315 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:29,315 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:41936': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:29,415 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:29,416 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:41942': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:29,423 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:29,423 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:41948': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:29,523 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:29,524 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:41960': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:29,531 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:29,531 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:41972': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:29,632 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:29,632 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:41984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:29,639 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:29,640 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:41992': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:29,740 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:29,740 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:41996': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:29,747 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:29,747 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:42006': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:29,847 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:29,848 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:42014': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:29,855 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:29,855 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:42026': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:29,956 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:29,957 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:42042': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:29,964 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:29,964 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:42056': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:30,065 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:30,066 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:42060': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:30,072 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:30,073 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:42064': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:30,173 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:30,173 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:42080': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:30,180 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:30,181 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:42094': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:30,281 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:30,281 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:42102': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:30,288 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:30,288 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:42106': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:30,390 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:30,390 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:42118': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:30,397 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:30,397 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:42122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:30,498 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:30,498 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:42132': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:30,505 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:30,505 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:42138': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:30,606 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:30,606 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:42146': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:30,613 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:30,613 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:42156': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:30,713 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:30,714 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:42160': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:30,721 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:30,722 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:42164': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:30,821 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:30,821 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:42168': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:30,829 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:30,830 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:42170': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:30,929 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:30,929 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:42184': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:30,936 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:30,936 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:42190': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:31,038 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:31,039 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:42200': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:31,045 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:31,045 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:42214': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:31,145 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:31,146 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:42228': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:31,152 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:31,153 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:42230': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:31,253 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:31,254 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:42246': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:31,261 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:31,261 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:42252': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:31,362 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:31,363 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:42254': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:31,374 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:31,374 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:42264': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:31,471 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:31,471 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:42280': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:31,481 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:31,482 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:42286': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:31,578 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:31,579 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:58492': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:31,589 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:31,589 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:58508': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:31,686 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:31,687 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:58524': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:31,697 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:31,697 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:58540': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:31,794 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:31,795 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:58554': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:31,805 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:31,805 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:58560': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:31,903 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:31,903 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:58568': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:31,912 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:31,913 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:58576': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:32,010 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:32,011 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:58586': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:32,020 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:32,020 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:58594': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:32,118 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:32,119 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:58602': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:32,128 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:32,128 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:58616': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:32,226 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:32,227 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:58630': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:32,236 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:32,237 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:58640': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:32,335 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:32,335 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:58656': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:32,344 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:32,345 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:58662': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:32,443 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:32,443 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:58678': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:32,451 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:32,452 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:58690': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:32,551 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:32,552 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:58700': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:32,559 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:32,559 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:58716': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:32,659 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:32,660 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:58720': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:32,666 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:32,667 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:58722': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:32,768 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:32,769 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:58724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:32,776 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:32,776 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:58738': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:32,876 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:32,876 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:58748': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:32,883 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:32,883 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:58762': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:32,983 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:32,984 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:58770': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:32,990 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:32,991 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:58782': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:33,092 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:33,093 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:58786': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:33,100 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:33,100 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:58794': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:33,200 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:33,200 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:58804': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:33,207 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:33,208 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:58810': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:33,309 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:33,310 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:58820': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:33,317 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:33,317 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:58828': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:33,417 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:33,417 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:58842': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:33,424 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:33,424 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:58844': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:33,525 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:33,526 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:58846': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:33,533 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:33,533 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:58858': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:33,634 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:33,634 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:58868': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:33,641 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:33,641 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:58872': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:33,742 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:33,742 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:58880': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:33,750 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:33,751 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:58882': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:33,850 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:33,850 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:58890': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:33,857 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 4768s 2024-11-23 21:37:33,858 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:58898': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:33,879 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39399. Reason: failure-to-start- 4768s 2024-11-23 21:37:33,879 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:37:33,881 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44061. Reason: failure-to-start- 4768s 2024-11-23 21:37:33,882 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:37:33,882 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 15s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 4768s stream = await stream.start_tls( 4768s ^^^^^^^^^^^^^^^^^^^^^^^ 4768s False, ssl_options=ssl_options, server_hostname=host 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 4768s self.socket.do_handshake() 4768s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 4768s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 4768s self._sslobj.do_handshake() 4768s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 4768s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 4768s raise FatalCommClosedError( 4768s ...<2 lines>... 4768s ) from err 4768s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 4768s 4768s During handling of the above exception, another exception occurred: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1218, in _register_with_scheduler 4768s await asyncio.sleep(0.1) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 718, in sleep 4768s return await future 4768s ^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 15s. 4768s 2024-11-23 21:37:34,890 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:37:34,898 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:34,899 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39773/status 4768s 2024-11-23 21:37:34,899 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:37:34,915 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39071 4768s 2024-11-23 21:37:34,915 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39071 4768s 2024-11-23 21:37:34,915 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:37:34,915 - distributed.worker - INFO - dashboard at: 127.0.0.1:34157 4768s 2024-11-23 21:37:34,915 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:34,915 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:37:34,915 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:37:34,915 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:37:34,915 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-mc3at6sg 4768s 2024-11-23 21:37:34,915 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:37:34,917 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39639 4768s 2024-11-23 21:37:34,918 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39639 4768s 2024-11-23 21:37:34,918 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:37:34,918 - distributed.worker - INFO - dashboard at: 127.0.0.1:38311 4768s 2024-11-23 21:37:34,918 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:34,918 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:37:34,918 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:37:34,918 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:37:34,918 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-soi6www_ 4768s 2024-11-23 21:37:34,918 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:37:34,931 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:34,932 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:34,932 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:55238': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:34,932 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:55240': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:35,045 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:35,045 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:35,046 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:55244': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:35,046 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:55252': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:35,158 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:35,159 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:35,159 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:55256': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:35,159 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:55268': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:35,278 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:35,278 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:35,279 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:55276': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:35,279 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:55280': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:35,391 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:35,392 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:35,392 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:55296': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:35,392 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:55310': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:35,505 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:35,506 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:35,506 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:55318': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:35,506 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:55334': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:35,620 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:35,620 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:35,621 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:55344': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:35,621 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:55360': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:35,733 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:35,733 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:35,734 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:55362': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:35,734 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:55366': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:35,847 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:35,848 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:35,848 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:55382': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:35,848 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:55392': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:35,961 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:35,961 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:35,962 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:55408': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:35,962 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:55412': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:36,075 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:36,075 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:36,075 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:55426': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:36,075 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:55440': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:36,188 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:36,188 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:36,189 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:55444': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:36,189 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:55458': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:36,302 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:36,302 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:36,303 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:55468': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:36,303 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:55472': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:36,415 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:36,416 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:36,416 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:55480': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:36,416 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:55482': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:36,529 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:36,530 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:36,530 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:55486': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:36,530 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:55494': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:36,643 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:36,643 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:36,644 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:55508': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:36,644 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:55512': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:36,757 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:36,757 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:36,758 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:55528': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:36,758 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:55536': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:36,872 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:36,873 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:36,877 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:55544': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:36,877 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:55560': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:36,986 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:36,986 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:36,986 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:55574': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:36,986 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:55590': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:37,100 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:37,100 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:37,101 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:55594': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:37,101 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:55604': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:37,214 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:37,215 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:37,215 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:55610': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:37,215 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:55626': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:37,328 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:37,328 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:37,328 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:55632': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:37,329 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:55640': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:37,443 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:37,443 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:37,443 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:55646': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:37,443 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:55648': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:37,556 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:37,557 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:37,557 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:55662': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:37,557 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:55664': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:37,671 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:37,672 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:37,672 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:55670': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:37,672 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:55672': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:37,785 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:37,786 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:37,786 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:55680': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:37,786 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:55690': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:37,900 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:37,901 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:37,901 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:55706': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:37,901 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:55716': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:38,014 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:38,014 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:38,015 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:55726': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:38,015 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:55730': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:38,128 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:38,128 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:38,129 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:55746': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:38,129 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:55756': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:38,242 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:38,242 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:38,243 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:55768': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:38,243 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:55772': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:38,356 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:38,356 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:38,357 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:55774': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:38,357 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:55782': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:38,470 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:38,471 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:38,471 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:55786': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:38,471 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:55792': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:38,587 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:38,587 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:38,588 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:55800': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:38,588 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:55814': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:38,700 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:38,701 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:38,701 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:55830': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:38,701 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:55834': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:38,814 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:38,815 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:38,815 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:55850': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:38,815 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:55858': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:38,929 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:38,930 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:38,930 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:55862': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:38,930 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:55876': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:39,043 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:39,043 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:39,044 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:55886': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:39,044 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:55900': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:39,157 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:39,158 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:39,158 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:55906': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:39,159 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:55914': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:39,272 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:39,272 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:39,272 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:55920': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:39,272 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:55926': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:39,385 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:39,385 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:39,386 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:55940': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:39,386 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:55950': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:39,498 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:39,499 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:39,499 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:55962': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:39,499 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:55968': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:39,612 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:39,613 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:39,613 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:55970': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:39,613 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:55978': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:39,726 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:39,727 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:39,727 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:55984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:39,727 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:55998': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:39,840 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:39,841 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:39,841 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:56012': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:39,841 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:56018': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:39,954 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:39,955 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:39,955 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:56026': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:39,955 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:56040': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:40,068 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:40,069 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:40,069 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:56052': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:40,069 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:56068': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:40,183 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:40,183 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:40,183 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:56080': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:40,183 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:56094': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:40,297 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:40,297 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:40,297 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:56106': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:40,297 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:56118': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:40,417 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:40,417 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:40,418 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:56126': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:40,418 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:56136': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:40,532 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:40,532 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:40,533 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:56146': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:40,533 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:56148': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:40,647 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:40,647 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:40,647 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:56156': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:40,648 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:56166': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:40,761 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:40,761 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:40,762 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:56176': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:40,762 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:56188': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:40,879 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:40,879 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:40,880 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:56196': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:40,880 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:56208': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:40,993 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:40,993 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:40,994 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:56218': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:40,994 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:56224': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:41,107 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:41,107 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:41,108 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:56236': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:41,108 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:56246': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:41,221 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:41,222 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:41,222 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:56254': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:41,222 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:56256': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:41,335 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:41,336 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:41,336 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:56270': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:41,336 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:56286': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:41,450 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:41,450 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:41,451 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:56296': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:41,451 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:56312': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:41,564 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:41,564 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:41,564 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:49044': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:41,564 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:49050': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:41,677 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:41,677 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:41,678 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:49062': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:41,678 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:49076': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:41,792 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:41,792 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:41,792 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:49078': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:41,793 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:49080': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:41,906 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:41,906 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:41,910 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:49086': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:41,910 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:49100': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:42,019 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:42,020 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:42,020 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:49110': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:42,020 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:49124': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:42,133 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:42,134 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:42,134 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:49126': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:42,134 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:49140': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:42,250 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:42,250 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:42,251 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:49152': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:42,251 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:49154': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:42,364 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:42,364 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:42,365 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:49162': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:42,365 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:49164': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:42,472 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:42,477 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:49178': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:42,478 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:42,479 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:49188': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:42,580 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:42,581 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:49204': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:42,588 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:42,588 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:49214': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:42,688 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:42,688 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:49226': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:42,695 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:42,695 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:49238': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:42,795 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:42,796 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:49252': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:42,803 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:42,803 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:49268': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:42,904 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:42,908 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:49274': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:42,915 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:42,915 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:49286': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:43,012 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:43,013 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:49296': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:43,022 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:43,023 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:49300': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:43,121 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:43,122 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:49302': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:43,130 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:43,130 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:49304': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:43,230 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:43,230 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:49310': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:43,237 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:43,237 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:49318': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:43,338 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:43,338 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:49334': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:43,345 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:43,345 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:49348': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:43,446 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:43,446 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:49364': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:43,453 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:43,453 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:49374': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:43,554 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:43,554 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:49376': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:43,561 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:43,561 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:49388': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:43,662 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:43,662 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:49390': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:43,669 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:43,670 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:49392': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:43,770 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:43,770 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:49408': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:43,777 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:43,778 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:49418': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:43,878 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:43,878 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:49432': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:43,885 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:43,885 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:49444': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:43,988 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:43,989 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:49452': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:43,995 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:43,996 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:49466': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:44,096 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:44,096 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:49474': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:44,103 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:44,104 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:49476': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:44,204 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:44,205 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:49480': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:44,212 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:44,212 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:49488': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:44,312 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:44,313 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:49504': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:44,319 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:44,320 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:49518': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:44,421 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:44,422 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:49534': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:44,428 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:44,429 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:49544': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:44,529 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:44,530 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:49552': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:44,536 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:44,537 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:49568': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:44,637 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:44,637 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:49578': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:44,644 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:44,644 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:49584': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:44,745 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:44,745 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:49586': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:44,752 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:44,752 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:49602': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:44,853 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:44,854 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:49612': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:44,860 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:44,860 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:49626': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:44,961 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:44,961 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:49630': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:44,968 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:44,968 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:49636': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:45,068 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:45,069 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:49640': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:45,076 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:45,076 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:49646': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:45,177 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:45,177 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:49648': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:45,184 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:45,184 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:49664': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:45,286 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:45,287 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:49672': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:45,293 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:45,293 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:49678': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:45,395 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:45,396 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:49682': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:45,403 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:45,406 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:49696': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:45,504 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:45,504 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:49706': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:45,511 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:45,511 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:49712': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:45,614 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:45,614 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:49716': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:45,621 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:45,622 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:49730': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:45,723 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:45,724 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:49734': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:45,730 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:45,731 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:49746': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:45,831 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:45,832 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:49748': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:45,838 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:45,839 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:49764': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:45,939 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:45,939 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:49780': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:45,946 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:45,947 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:49796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:46,047 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:46,047 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:49802': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:46,054 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:46,055 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:49816': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:46,155 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:46,156 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:49830': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:46,162 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:46,163 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:49840': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:46,263 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:46,263 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:49856': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:46,270 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:46,271 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:49872': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:46,375 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:46,376 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:49874': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:46,382 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:46,382 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:49884': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:46,482 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:46,482 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:49888': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:46,489 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:46,489 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:49894': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:46,591 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:46,592 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:49902': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:46,598 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:46,599 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:49906': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:46,698 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:46,699 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:49922': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:46,706 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:46,706 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:49926': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:46,806 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:46,807 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:49936': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:46,814 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:46,814 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:49946': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:46,914 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:46,914 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:49962': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:46,921 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:46,921 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:49978': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:47,022 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:47,022 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:49992': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:47,029 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:47,029 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:50004': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:47,130 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:47,130 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:50010': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:47,137 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:47,137 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:50020': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:47,238 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:47,239 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:50036': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:47,245 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:47,246 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:50046': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:47,346 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:47,346 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:50058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:47,353 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:47,354 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:50066': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:47,454 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:47,455 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:50082': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:47,462 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:47,462 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:50092': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:47,562 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:47,563 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:50102': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:47,569 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:47,570 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:50106': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:47,671 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:47,672 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:50122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:47,678 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:47,679 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:50134': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:47,779 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:47,780 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:50148': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:47,786 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:47,787 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:50160': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:47,887 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:47,887 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:50162': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:47,894 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35191 4768s 2024-11-23 21:37:47,894 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35191': TLS handshake failed with remote 'tls://127.0.0.1:50174': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:37:47,913 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39071. Reason: failure-to-start- 4768s 2024-11-23 21:37:47,914 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:37:47,915 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 13s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 4768s stream = await stream.start_tls( 4768s ^^^^^^^^^^^^^^^^^^^^^^^ 4768s False, ssl_options=ssl_options, server_hostname=host 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 4768s self.socket.do_handshake() 4768s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 4768s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 4768s self._sslobj.do_handshake() 4768s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 4768s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 4768s raise FatalCommClosedError( 4768s ...<2 lines>... 4768s ) from err 4768s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 4768s 4768s During handling of the above exception, another exception occurred: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1218, in _register_with_scheduler 4768s await asyncio.sleep(0.1) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 718, in sleep 4768s return await future 4768s ^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 13s. 4768s 2024-11-23 21:37:47,919 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39639. Reason: failure-to-start- 4768s 2024-11-23 21:37:47,919 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:37:48,923 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:37:48,931 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35089 4768s 2024-11-23 21:37:48,931 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45255/status 4768s 2024-11-23 21:37:48,931 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:37:48,947 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41525 4768s 2024-11-23 21:37:48,947 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41525 4768s 2024-11-23 21:37:48,947 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:37:48,947 - distributed.worker - INFO - dashboard at: 127.0.0.1:35251 4768s 2024-11-23 21:37:48,947 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35089 4768s 2024-11-23 21:37:48,947 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:37:48,947 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:37:48,947 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:37:48,947 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-kbklgosi 4768s 2024-11-23 21:37:48,947 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:37:48,951 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43143 4768s 2024-11-23 21:37:48,951 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43143 4768s 2024-11-23 21:37:48,951 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:37:48,951 - distributed.worker - INFO - dashboard at: 127.0.0.1:39209 4768s 2024-11-23 21:37:48,951 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35089 4768s 2024-11-23 21:37:48,951 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:37:48,951 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:37:48,951 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:37:48,951 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-xoeww4sc 4768s 2024-11-23 21:37:48,952 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:37:48,953 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41525. Reason: failure-to-start- 4768s 2024-11-23 21:37:48,953 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:37:48,953 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43143. Reason: failure-to-start- 4768s 2024-11-23 21:37:48,954 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:37:48,955 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35089': TLS handshake failed with remote 'tls://127.0.0.1:36990': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:37:48,955 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35089': TLS handshake failed with remote 'tls://127.0.0.1:37002': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:37:48,957 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:37:49,963 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:37:49,972 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39491 4768s 2024-11-23 21:37:49,972 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44137/status 4768s 2024-11-23 21:37:49,972 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:37:49,988 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36691 4768s 2024-11-23 21:37:49,988 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36691 4768s 2024-11-23 21:37:49,988 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:37:49,988 - distributed.worker - INFO - dashboard at: 127.0.0.1:33597 4768s 2024-11-23 21:37:49,988 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39491 4768s 2024-11-23 21:37:49,988 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:37:49,988 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:37:49,988 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:37:49,988 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-0bgmytsn 4768s 2024-11-23 21:37:49,988 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:37:49,991 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39541 4768s 2024-11-23 21:37:49,991 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39541 4768s 2024-11-23 21:37:49,991 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:37:49,991 - distributed.worker - INFO - dashboard at: 127.0.0.1:42789 4768s 2024-11-23 21:37:49,991 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39491 4768s 2024-11-23 21:37:49,991 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:37:49,991 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:37:49,991 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:37:49,991 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-uefxeti4 4768s 2024-11-23 21:37:49,991 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:37:49,992 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36691. Reason: failure-to-start- 4768s 2024-11-23 21:37:49,992 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:37:49,993 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39541. Reason: failure-to-start- 4768s 2024-11-23 21:37:49,993 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:37:49,994 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39491': TLS handshake failed with remote 'tls://127.0.0.1:60854': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:37:49,994 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39491': TLS handshake failed with remote 'tls://127.0.0.1:60856': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:37:49,996 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:37:51,002 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:37:51,013 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46353 4768s 2024-11-23 21:37:51,013 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41617/status 4768s 2024-11-23 21:37:51,013 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:37:51,030 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45605 4768s 2024-11-23 21:37:51,030 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45605 4768s 2024-11-23 21:37:51,030 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:37:51,030 - distributed.worker - INFO - dashboard at: 127.0.0.1:35933 4768s 2024-11-23 21:37:51,030 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46353 4768s 2024-11-23 21:37:51,030 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:37:51,030 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:37:51,031 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:37:51,031 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-602uerrh 4768s 2024-11-23 21:37:51,031 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:37:51,033 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40989 4768s 2024-11-23 21:37:51,034 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40989 4768s 2024-11-23 21:37:51,034 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:37:51,034 - distributed.worker - INFO - dashboard at: 127.0.0.1:46227 4768s 2024-11-23 21:37:51,034 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46353 4768s 2024-11-23 21:37:51,034 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:37:51,034 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:37:51,034 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:37:51,034 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-kh72fl0e 4768s 2024-11-23 21:37:51,034 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:37:51,035 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45605. Reason: failure-to-start- 4768s 2024-11-23 21:37:51,035 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:37:51,036 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40989. Reason: failure-to-start- 4768s 2024-11-23 21:37:51,036 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:37:51,038 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46353': TLS handshake failed with remote 'tls://127.0.0.1:39594': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:37:51,038 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46353': TLS handshake failed with remote 'tls://127.0.0.1:39602': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:37:51,039 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:37:52,045 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:37:52,053 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41593 4768s 2024-11-23 21:37:52,054 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46729/status 4768s 2024-11-23 21:37:52,054 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:37:52,071 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36845 4768s 2024-11-23 21:37:52,071 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36845 4768s 2024-11-23 21:37:52,071 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:37:52,071 - distributed.worker - INFO - dashboard at: 127.0.0.1:39991 4768s 2024-11-23 21:37:52,071 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41593 4768s 2024-11-23 21:37:52,071 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:37:52,071 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:37:52,071 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:37:52,071 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-4tany4xm 4768s 2024-11-23 21:37:52,071 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:37:52,074 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37739 4768s 2024-11-23 21:37:52,074 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37739 4768s 2024-11-23 21:37:52,074 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:37:52,074 - distributed.worker - INFO - dashboard at: 127.0.0.1:41701 4768s 2024-11-23 21:37:52,074 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41593 4768s 2024-11-23 21:37:52,074 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:37:52,074 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:37:52,074 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:37:52,074 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-m4_g7mmt 4768s 2024-11-23 21:37:52,074 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:37:52,076 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36845. Reason: failure-to-start- 4768s 2024-11-23 21:37:52,076 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:37:52,076 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37739. Reason: failure-to-start- 4768s 2024-11-23 21:37:52,076 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:37:52,078 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41593': TLS handshake failed with remote 'tls://127.0.0.1:49008': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:37:52,078 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41593': TLS handshake failed with remote 'tls://127.0.0.1:49020': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:37:52,080 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:37:53,086 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:37:53,095 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38037 4768s 2024-11-23 21:37:53,095 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40653/status 4768s 2024-11-23 21:37:53,095 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:37:53,110 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42517 4768s 2024-11-23 21:37:53,111 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42517 4768s 2024-11-23 21:37:53,111 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:37:53,111 - distributed.worker - INFO - dashboard at: 127.0.0.1:33109 4768s 2024-11-23 21:37:53,111 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38037 4768s 2024-11-23 21:37:53,111 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:37:53,111 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:37:53,111 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:37:53,111 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-qlskhnve 4768s 2024-11-23 21:37:53,111 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:37:53,113 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44689 4768s 2024-11-23 21:37:53,114 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44689 4768s 2024-11-23 21:37:53,114 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:37:53,114 - distributed.worker - INFO - dashboard at: 127.0.0.1:33629 4768s 2024-11-23 21:37:53,114 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38037 4768s 2024-11-23 21:37:53,114 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:37:53,114 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:37:53,115 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:37:53,115 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-w9ejzcra 4768s 2024-11-23 21:37:53,115 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:37:53,116 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42517. Reason: failure-to-start- 4768s 2024-11-23 21:37:53,116 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:37:53,117 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44689. Reason: failure-to-start- 4768s 2024-11-23 21:37:53,117 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:37:53,119 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38037': TLS handshake failed with remote 'tls://127.0.0.1:55380': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:37:53,119 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38037': TLS handshake failed with remote 'tls://127.0.0.1:55396': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:37:53,120 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:37:54,127 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:37:54,135 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41165 4768s 2024-11-23 21:37:54,135 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33291/status 4768s 2024-11-23 21:37:54,135 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:37:54,151 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38719 4768s 2024-11-23 21:37:54,151 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38719 4768s 2024-11-23 21:37:54,151 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:37:54,151 - distributed.worker - INFO - dashboard at: 127.0.0.1:42381 4768s 2024-11-23 21:37:54,151 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41165 4768s 2024-11-23 21:37:54,151 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:37:54,151 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:37:54,151 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:37:54,151 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-o62p3fps 4768s 2024-11-23 21:37:54,151 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:37:54,153 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45167 4768s 2024-11-23 21:37:54,153 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45167 4768s 2024-11-23 21:37:54,153 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:37:54,154 - distributed.worker - INFO - dashboard at: 127.0.0.1:35271 4768s 2024-11-23 21:37:54,154 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41165 4768s 2024-11-23 21:37:54,154 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:37:54,154 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:37:54,154 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:37:54,154 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-g_1011th 4768s 2024-11-23 21:37:54,154 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:37:54,155 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38719. Reason: failure-to-start- 4768s 2024-11-23 21:37:54,155 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:37:54,156 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45167. Reason: failure-to-start- 4768s 2024-11-23 21:37:54,156 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:37:54,157 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41165': TLS handshake failed with remote 'tls://127.0.0.1:57560': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:37:54,158 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41165': TLS handshake failed with remote 'tls://127.0.0.1:57564': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:37:54,159 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:37:55,165 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:37:55,181 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45591 4768s 2024-11-23 21:37:55,181 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44885/status 4768s 2024-11-23 21:37:55,182 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:37:55,198 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46251 4768s 2024-11-23 21:37:55,198 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46251 4768s 2024-11-23 21:37:55,198 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:37:55,198 - distributed.worker - INFO - dashboard at: 127.0.0.1:33155 4768s 2024-11-23 21:37:55,198 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45591 4768s 2024-11-23 21:37:55,198 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:37:55,198 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:37:55,198 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:37:55,199 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-2j9nqv15 4768s 2024-11-23 21:37:55,199 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:37:55,201 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42433 4768s 2024-11-23 21:37:55,201 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42433 4768s 2024-11-23 21:37:55,201 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:37:55,201 - distributed.worker - INFO - dashboard at: 127.0.0.1:33007 4768s 2024-11-23 21:37:55,201 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45591 4768s 2024-11-23 21:37:55,201 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:37:55,201 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:37:55,201 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:37:55,201 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-g0obgy4z 4768s 2024-11-23 21:37:55,201 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:37:55,203 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46251. Reason: failure-to-start- 4768s 2024-11-23 21:37:55,203 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:37:55,203 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42433. Reason: failure-to-start- 4768s 2024-11-23 21:37:55,203 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:37:55,205 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45591': TLS handshake failed with remote 'tls://127.0.0.1:44404': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:37:55,205 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45591': TLS handshake failed with remote 'tls://127.0.0.1:44416': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:37:55,207 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:37:56,213 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:37:56,221 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38227 4768s 2024-11-23 21:37:56,221 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39107/status 4768s 2024-11-23 21:37:56,222 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:37:56,239 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42211 4768s 2024-11-23 21:37:56,239 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42211 4768s 2024-11-23 21:37:56,239 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:37:56,240 - distributed.worker - INFO - dashboard at: 127.0.0.1:38095 4768s 2024-11-23 21:37:56,240 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38227 4768s 2024-11-23 21:37:56,240 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:37:56,240 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:37:56,240 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:37:56,240 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-e5gytanw 4768s 2024-11-23 21:37:56,240 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:37:56,242 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33389 4768s 2024-11-23 21:37:56,242 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33389 4768s 2024-11-23 21:37:56,242 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:37:56,242 - distributed.worker - INFO - dashboard at: 127.0.0.1:34507 4768s 2024-11-23 21:37:56,242 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38227 4768s 2024-11-23 21:37:56,242 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:37:56,242 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:37:56,242 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:37:56,242 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-t1uvb1o8 4768s 2024-11-23 21:37:56,243 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:37:56,244 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42211. Reason: failure-to-start- 4768s 2024-11-23 21:37:56,244 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:37:56,245 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33389. Reason: failure-to-start- 4768s 2024-11-23 21:37:56,245 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:37:56,246 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38227': TLS handshake failed with remote 'tls://127.0.0.1:47258': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:37:56,246 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38227': TLS handshake failed with remote 'tls://127.0.0.1:47264': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:37:56,248 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:37:57,254 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:37:57,262 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34583 4768s 2024-11-23 21:37:57,262 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36017/status 4768s 2024-11-23 21:37:57,263 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:37:57,279 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41811 4768s 2024-11-23 21:37:57,279 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41811 4768s 2024-11-23 21:37:57,279 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:37:57,279 - distributed.worker - INFO - dashboard at: 127.0.0.1:45807 4768s 2024-11-23 21:37:57,280 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34583 4768s 2024-11-23 21:37:57,280 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:37:57,280 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:37:57,280 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:37:57,280 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-6xqq7f0g 4768s 2024-11-23 21:37:57,280 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:37:57,283 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35457 4768s 2024-11-23 21:37:57,283 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35457 4768s 2024-11-23 21:37:57,283 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:37:57,284 - distributed.worker - INFO - dashboard at: 127.0.0.1:37627 4768s 2024-11-23 21:37:57,284 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34583 4768s 2024-11-23 21:37:57,284 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:37:57,284 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:37:57,284 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:37:57,284 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-6g9vbb8w 4768s 2024-11-23 21:37:57,284 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:37:57,285 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41811. Reason: failure-to-start- 4768s 2024-11-23 21:37:57,285 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:37:57,286 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35457. Reason: failure-to-start- 4768s 2024-11-23 21:37:57,286 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:37:57,288 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34583': TLS handshake failed with remote 'tls://127.0.0.1:60562': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:37:57,288 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34583': TLS handshake failed with remote 'tls://127.0.0.1:60568': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:37:57,289 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:37:58,297 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:37:58,305 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35673 4768s 2024-11-23 21:37:58,305 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36307/status 4768s 2024-11-23 21:37:58,305 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:37:58,321 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41359 4768s 2024-11-23 21:37:58,321 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41359 4768s 2024-11-23 21:37:58,321 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:37:58,321 - distributed.worker - INFO - dashboard at: 127.0.0.1:39557 4768s 2024-11-23 21:37:58,321 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35673 4768s 2024-11-23 21:37:58,322 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:37:58,322 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:37:58,322 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:37:58,322 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-rkl655en 4768s 2024-11-23 21:37:58,322 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:37:58,324 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44971 4768s 2024-11-23 21:37:58,324 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44971 4768s 2024-11-23 21:37:58,324 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:37:58,324 - distributed.worker - INFO - dashboard at: 127.0.0.1:34949 4768s 2024-11-23 21:37:58,324 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35673 4768s 2024-11-23 21:37:58,324 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:37:58,324 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:37:58,324 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:37:58,325 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-sskj3727 4768s 2024-11-23 21:37:58,325 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:37:58,326 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41359. Reason: failure-to-start- 4768s 2024-11-23 21:37:58,326 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:37:58,327 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44971. Reason: failure-to-start- 4768s 2024-11-23 21:37:58,327 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:37:58,328 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35673': TLS handshake failed with remote 'tls://127.0.0.1:40258': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:37:58,328 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35673': TLS handshake failed with remote 'tls://127.0.0.1:40270': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:37:58,330 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:37:59,337 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:37:59,346 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40259 4768s 2024-11-23 21:37:59,346 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39133/status 4768s 2024-11-23 21:37:59,346 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:37:59,362 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45509 4768s 2024-11-23 21:37:59,362 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45509 4768s 2024-11-23 21:37:59,362 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:37:59,362 - distributed.worker - INFO - dashboard at: 127.0.0.1:41483 4768s 2024-11-23 21:37:59,362 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40259 4768s 2024-11-23 21:37:59,362 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:37:59,362 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:37:59,362 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:37:59,362 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-83sl7w8z 4768s 2024-11-23 21:37:59,363 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:37:59,365 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37015 4768s 2024-11-23 21:37:59,365 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37015 4768s 2024-11-23 21:37:59,365 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:37:59,365 - distributed.worker - INFO - dashboard at: 127.0.0.1:41681 4768s 2024-11-23 21:37:59,365 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40259 4768s 2024-11-23 21:37:59,365 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:37:59,365 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:37:59,365 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:37:59,365 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-4n9depsc 4768s 2024-11-23 21:37:59,365 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:37:59,367 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45509. Reason: failure-to-start- 4768s 2024-11-23 21:37:59,367 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:37:59,367 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37015. Reason: failure-to-start- 4768s 2024-11-23 21:37:59,367 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:37:59,372 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40259': TLS handshake failed with remote 'tls://127.0.0.1:53972': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:37:59,372 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40259': TLS handshake failed with remote 'tls://127.0.0.1:53988': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:37:59,373 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:38:00,380 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:38:00,387 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44597 4768s 2024-11-23 21:38:00,387 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46077/status 4768s 2024-11-23 21:38:00,388 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:38:00,405 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46503 4768s 2024-11-23 21:38:00,405 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46503 4768s 2024-11-23 21:38:00,405 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:38:00,405 - distributed.worker - INFO - dashboard at: 127.0.0.1:41247 4768s 2024-11-23 21:38:00,405 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44597 4768s 2024-11-23 21:38:00,405 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:38:00,405 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:38:00,406 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:38:00,406 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-h5arjpn7 4768s 2024-11-23 21:38:00,406 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:38:00,408 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46549 4768s 2024-11-23 21:38:00,408 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46549 4768s 2024-11-23 21:38:00,408 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:38:00,408 - distributed.worker - INFO - dashboard at: 127.0.0.1:45025 4768s 2024-11-23 21:38:00,408 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44597 4768s 2024-11-23 21:38:00,408 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:38:00,408 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:38:00,408 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:38:00,408 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ae6k4pmd 4768s 2024-11-23 21:38:00,408 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:38:00,412 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46503. Reason: failure-to-start- 4768s 2024-11-23 21:38:00,413 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:38:00,413 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46549. Reason: failure-to-start- 4768s 2024-11-23 21:38:00,413 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:38:00,415 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44597': TLS handshake failed with remote 'tls://127.0.0.1:35380': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:38:00,415 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44597': TLS handshake failed with remote 'tls://127.0.0.1:35382': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:38:00,417 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:38:01,422 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:38:01,429 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43335 4768s 2024-11-23 21:38:01,430 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41297/status 4768s 2024-11-23 21:38:01,430 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:38:01,446 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39581 4768s 2024-11-23 21:38:01,447 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39581 4768s 2024-11-23 21:38:01,447 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:38:01,447 - distributed.worker - INFO - dashboard at: 127.0.0.1:45121 4768s 2024-11-23 21:38:01,447 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43335 4768s 2024-11-23 21:38:01,447 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:38:01,447 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:38:01,447 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:38:01,447 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-eo4co9j2 4768s 2024-11-23 21:38:01,447 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:38:01,449 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39333 4768s 2024-11-23 21:38:01,450 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39333 4768s 2024-11-23 21:38:01,450 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:38:01,450 - distributed.worker - INFO - dashboard at: 127.0.0.1:43597 4768s 2024-11-23 21:38:01,450 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43335 4768s 2024-11-23 21:38:01,450 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:38:01,450 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:38:01,450 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:38:01,450 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-a7acct_h 4768s 2024-11-23 21:38:01,450 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:38:01,454 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39581. Reason: failure-to-start- 4768s 2024-11-23 21:38:01,454 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:38:01,455 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39333. Reason: failure-to-start- 4768s 2024-11-23 21:38:01,455 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:38:01,456 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43335': TLS handshake failed with remote 'tls://127.0.0.1:49020': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:38:01,457 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43335': TLS handshake failed with remote 'tls://127.0.0.1:49030': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:38:01,458 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:38:02,464 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:38:02,472 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35897 4768s 2024-11-23 21:38:02,472 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41633/status 4768s 2024-11-23 21:38:02,472 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:38:02,489 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39003 4768s 2024-11-23 21:38:02,489 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39003 4768s 2024-11-23 21:38:02,489 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:38:02,489 - distributed.worker - INFO - dashboard at: 127.0.0.1:38689 4768s 2024-11-23 21:38:02,489 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35897 4768s 2024-11-23 21:38:02,489 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:38:02,489 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:38:02,489 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:38:02,489 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-2l5e_e_g 4768s 2024-11-23 21:38:02,489 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:38:02,491 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45537 4768s 2024-11-23 21:38:02,492 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45537 4768s 2024-11-23 21:38:02,492 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:38:02,492 - distributed.worker - INFO - dashboard at: 127.0.0.1:43915 4768s 2024-11-23 21:38:02,492 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35897 4768s 2024-11-23 21:38:02,492 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:38:02,492 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:38:02,492 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:38:02,492 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-kzyqx3k3 4768s 2024-11-23 21:38:02,492 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:38:02,497 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39003. Reason: failure-to-start- 4768s 2024-11-23 21:38:02,497 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:38:02,497 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45537. Reason: failure-to-start- 4768s 2024-11-23 21:38:02,498 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:38:02,499 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35897': TLS handshake failed with remote 'tls://127.0.0.1:51214': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:38:02,499 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35897': TLS handshake failed with remote 'tls://127.0.0.1:51226': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:38:02,501 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:38:03,506 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:38:03,514 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33285 4768s 2024-11-23 21:38:03,514 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44375/status 4768s 2024-11-23 21:38:03,515 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:38:03,533 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37635 4768s 2024-11-23 21:38:03,533 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37635 4768s 2024-11-23 21:38:03,533 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:38:03,533 - distributed.worker - INFO - dashboard at: 127.0.0.1:46207 4768s 2024-11-23 21:38:03,533 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33285 4768s 2024-11-23 21:38:03,533 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:38:03,533 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:38:03,533 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:38:03,533 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-b1ko0i9m 4768s 2024-11-23 21:38:03,533 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:38:03,536 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42715 4768s 2024-11-23 21:38:03,536 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42715 4768s 2024-11-23 21:38:03,536 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:38:03,536 - distributed.worker - INFO - dashboard at: 127.0.0.1:45297 4768s 2024-11-23 21:38:03,536 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33285 4768s 2024-11-23 21:38:03,536 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:38:03,536 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:38:03,536 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:38:03,536 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-38fz677_ 4768s 2024-11-23 21:38:03,536 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:38:03,537 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37635. Reason: failure-to-start- 4768s 2024-11-23 21:38:03,538 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:38:03,538 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42715. Reason: failure-to-start- 4768s 2024-11-23 21:38:03,538 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:38:03,540 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33285': TLS handshake failed with remote 'tls://127.0.0.1:58532': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:38:03,540 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33285': TLS handshake failed with remote 'tls://127.0.0.1:58538': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:38:03,541 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:38:04,549 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:38:04,556 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43519 4768s 2024-11-23 21:38:04,556 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44387/status 4768s 2024-11-23 21:38:04,557 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:38:04,574 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44279 4768s 2024-11-23 21:38:04,574 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44279 4768s 2024-11-23 21:38:04,574 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:38:04,574 - distributed.worker - INFO - dashboard at: 127.0.0.1:33147 4768s 2024-11-23 21:38:04,575 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 4768s 2024-11-23 21:38:04,575 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:38:04,575 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:38:04,575 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:38:04,575 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-yl7tfkt1 4768s 2024-11-23 21:38:04,575 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:38:04,577 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34063 4768s 2024-11-23 21:38:04,577 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34063 4768s 2024-11-23 21:38:04,577 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:38:04,577 - distributed.worker - INFO - dashboard at: 127.0.0.1:42613 4768s 2024-11-23 21:38:04,577 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43519 4768s 2024-11-23 21:38:04,577 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:38:04,578 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:38:04,578 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:38:04,578 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-794pfyar 4768s 2024-11-23 21:38:04,578 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:38:04,579 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44279. Reason: failure-to-start- 4768s 2024-11-23 21:38:04,579 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:38:04,580 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34063. Reason: failure-to-start- 4768s 2024-11-23 21:38:04,580 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:38:04,582 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35516': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:38:04,582 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43519': TLS handshake failed with remote 'tls://127.0.0.1:35520': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:38:04,583 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:38:05,590 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:38:05,598 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37681 4768s 2024-11-23 21:38:05,598 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33257/status 4768s 2024-11-23 21:38:05,598 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:38:05,620 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39735 4768s 2024-11-23 21:38:05,620 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39735 4768s 2024-11-23 21:38:05,620 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:38:05,620 - distributed.worker - INFO - dashboard at: 127.0.0.1:43121 4768s 2024-11-23 21:38:05,620 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37681 4768s 2024-11-23 21:38:05,620 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:38:05,620 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:38:05,620 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:38:05,620 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-nkizf_0u 4768s 2024-11-23 21:38:05,620 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:38:05,623 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38925 4768s 2024-11-23 21:38:05,623 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38925 4768s 2024-11-23 21:38:05,623 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:38:05,623 - distributed.worker - INFO - dashboard at: 127.0.0.1:46705 4768s 2024-11-23 21:38:05,623 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37681 4768s 2024-11-23 21:38:05,624 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:38:05,624 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:38:05,624 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:38:05,624 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-zg6x24wy 4768s 2024-11-23 21:38:05,624 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:38:05,625 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39735. Reason: failure-to-start- 4768s 2024-11-23 21:38:05,626 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:38:05,626 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38925. Reason: failure-to-start- 4768s 2024-11-23 21:38:05,626 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:38:05,628 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37681': TLS handshake failed with remote 'tls://127.0.0.1:38174': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:38:05,628 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37681': TLS handshake failed with remote 'tls://127.0.0.1:38190': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:38:05,630 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:38:06,636 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:38:06,644 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38261 4768s 2024-11-23 21:38:06,644 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40577/status 4768s 2024-11-23 21:38:06,645 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:38:06,665 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39003 4768s 2024-11-23 21:38:06,665 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39003 4768s 2024-11-23 21:38:06,665 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:38:06,665 - distributed.worker - INFO - dashboard at: 127.0.0.1:38875 4768s 2024-11-23 21:38:06,666 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 4768s 2024-11-23 21:38:06,666 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:38:06,666 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:38:06,666 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:38:06,666 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-8vwz3yl1 4768s 2024-11-23 21:38:06,666 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:38:06,668 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39197 4768s 2024-11-23 21:38:06,668 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39197 4768s 2024-11-23 21:38:06,668 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:38:06,669 - distributed.worker - INFO - dashboard at: 127.0.0.1:44007 4768s 2024-11-23 21:38:06,669 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 4768s 2024-11-23 21:38:06,669 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:38:06,669 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:38:06,669 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:38:06,669 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-vehonm6p 4768s 2024-11-23 21:38:06,669 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:38:06,670 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39003. Reason: failure-to-start- 4768s 2024-11-23 21:38:06,671 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:38:06,671 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39197. Reason: failure-to-start- 4768s 2024-11-23 21:38:06,671 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:38:06,673 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:39630': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:38:06,673 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:39632': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:38:06,675 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:38:07,681 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:38:07,689 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38027 4768s 2024-11-23 21:38:07,689 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41373/status 4768s 2024-11-23 21:38:07,690 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:38:07,708 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36309 4768s 2024-11-23 21:38:07,708 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36309 4768s 2024-11-23 21:38:07,708 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:38:07,709 - distributed.worker - INFO - dashboard at: 127.0.0.1:38499 4768s 2024-11-23 21:38:07,709 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38027 4768s 2024-11-23 21:38:07,709 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:38:07,709 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:38:07,709 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:38:07,709 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-6i4xe5_w 4768s 2024-11-23 21:38:07,709 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:38:07,711 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44805 4768s 2024-11-23 21:38:07,712 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44805 4768s 2024-11-23 21:38:07,712 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:38:07,712 - distributed.worker - INFO - dashboard at: 127.0.0.1:38471 4768s 2024-11-23 21:38:07,712 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38027 4768s 2024-11-23 21:38:07,712 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:38:07,712 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:38:07,712 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:38:07,712 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-5ddnpcw5 4768s 2024-11-23 21:38:07,712 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:38:07,715 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36309. Reason: failure-to-start- 4768s 2024-11-23 21:38:07,715 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:38:07,715 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44805. Reason: failure-to-start- 4768s 2024-11-23 21:38:07,715 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:38:07,717 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38027': TLS handshake failed with remote 'tls://127.0.0.1:59778': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:38:07,717 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38027': TLS handshake failed with remote 'tls://127.0.0.1:59784': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:38:07,719 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:38:08,725 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:38:08,734 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38503 4768s 2024-11-23 21:38:08,734 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36941/status 4768s 2024-11-23 21:38:08,737 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:38:08,753 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45019 4768s 2024-11-23 21:38:08,753 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45019 4768s 2024-11-23 21:38:08,753 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:38:08,753 - distributed.worker - INFO - dashboard at: 127.0.0.1:45815 4768s 2024-11-23 21:38:08,754 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38503 4768s 2024-11-23 21:38:08,754 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:38:08,754 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:38:08,754 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:38:08,754 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-rq18fzy1 4768s 2024-11-23 21:38:08,754 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:38:08,756 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40595 4768s 2024-11-23 21:38:08,756 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40595 4768s 2024-11-23 21:38:08,756 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:38:08,756 - distributed.worker - INFO - dashboard at: 127.0.0.1:45429 4768s 2024-11-23 21:38:08,757 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38503 4768s 2024-11-23 21:38:08,757 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:38:08,757 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:38:08,757 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:38:08,757 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-mdv8jm00 4768s 2024-11-23 21:38:08,757 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:38:08,758 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45019. Reason: failure-to-start- 4768s 2024-11-23 21:38:08,758 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:38:08,759 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40595. Reason: failure-to-start- 4768s 2024-11-23 21:38:08,759 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:38:08,760 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38503': TLS handshake failed with remote 'tls://127.0.0.1:49580': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:38:08,761 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38503': TLS handshake failed with remote 'tls://127.0.0.1:49594': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:38:08,762 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:38:09,771 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:38:09,779 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33019 4768s 2024-11-23 21:38:09,779 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44461/status 4768s 2024-11-23 21:38:09,779 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:38:09,795 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36973 4768s 2024-11-23 21:38:09,795 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36973 4768s 2024-11-23 21:38:09,795 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:38:09,796 - distributed.worker - INFO - dashboard at: 127.0.0.1:43771 4768s 2024-11-23 21:38:09,796 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33019 4768s 2024-11-23 21:38:09,796 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:38:09,796 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:38:09,796 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:38:09,796 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-q3l2cmh_ 4768s 2024-11-23 21:38:09,796 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:38:09,798 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46105 4768s 2024-11-23 21:38:09,798 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46105 4768s 2024-11-23 21:38:09,798 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:38:09,798 - distributed.worker - INFO - dashboard at: 127.0.0.1:46809 4768s 2024-11-23 21:38:09,798 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33019 4768s 2024-11-23 21:38:09,799 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:38:09,799 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:38:09,799 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:38:09,799 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ht10ydoq 4768s 2024-11-23 21:38:09,799 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:38:09,800 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36973. Reason: failure-to-start- 4768s 2024-11-23 21:38:09,800 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:38:09,801 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46105. Reason: failure-to-start- 4768s 2024-11-23 21:38:09,801 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:38:09,803 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33019': TLS handshake failed with remote 'tls://127.0.0.1:57582': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:38:09,803 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33019': TLS handshake failed with remote 'tls://127.0.0.1:57592': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:38:09,804 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:38:10,811 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:38:10,819 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38101 4768s 2024-11-23 21:38:10,820 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44301/status 4768s 2024-11-23 21:38:10,820 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:38:10,852 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38625 4768s 2024-11-23 21:38:10,852 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38625 4768s 2024-11-23 21:38:10,852 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:38:10,852 - distributed.worker - INFO - dashboard at: 127.0.0.1:42313 4768s 2024-11-23 21:38:10,852 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38101 4768s 2024-11-23 21:38:10,852 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:38:10,852 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:38:10,852 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:38:10,852 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ylecjbch 4768s 2024-11-23 21:38:10,853 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:38:10,855 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41679 4768s 2024-11-23 21:38:10,855 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41679 4768s 2024-11-23 21:38:10,855 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:38:10,855 - distributed.worker - INFO - dashboard at: 127.0.0.1:40525 4768s 2024-11-23 21:38:10,855 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38101 4768s 2024-11-23 21:38:10,855 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:38:10,855 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:38:10,855 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:38:10,855 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ik_xrmex 4768s 2024-11-23 21:38:10,855 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:38:10,859 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38625. Reason: failure-to-start- 4768s 2024-11-23 21:38:10,860 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:38:10,860 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41679. Reason: failure-to-start- 4768s 2024-11-23 21:38:10,860 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:38:10,862 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38101': TLS handshake failed with remote 'tls://127.0.0.1:50172': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:38:10,862 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38101': TLS handshake failed with remote 'tls://127.0.0.1:50184': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:38:10,864 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:38:11,870 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:38:11,878 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36097 4768s 2024-11-23 21:38:11,878 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37773/status 4768s 2024-11-23 21:38:11,878 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:38:11,896 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43239 4768s 2024-11-23 21:38:11,896 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43239 4768s 2024-11-23 21:38:11,896 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:38:11,896 - distributed.worker - INFO - dashboard at: 127.0.0.1:41997 4768s 2024-11-23 21:38:11,896 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36097 4768s 2024-11-23 21:38:11,896 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:38:11,897 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:38:11,897 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:38:11,897 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-4s3p9yhy 4768s 2024-11-23 21:38:11,897 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:38:11,899 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33543 4768s 2024-11-23 21:38:11,899 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33543 4768s 2024-11-23 21:38:11,899 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:38:11,899 - distributed.worker - INFO - dashboard at: 127.0.0.1:42765 4768s 2024-11-23 21:38:11,900 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36097 4768s 2024-11-23 21:38:11,900 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:38:11,900 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:38:11,900 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:38:11,900 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-2eq19b5s 4768s 2024-11-23 21:38:11,900 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:38:11,904 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43239. Reason: failure-to-start- 4768s 2024-11-23 21:38:11,904 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:38:11,905 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33543. Reason: failure-to-start- 4768s 2024-11-23 21:38:11,905 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:38:11,910 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36097': TLS handshake failed with remote 'tls://127.0.0.1:33362': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:38:11,911 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36097': TLS handshake failed with remote 'tls://127.0.0.1:33364': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:38:11,913 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:38:12,919 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:38:12,927 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36525 4768s 2024-11-23 21:38:12,927 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42017/status 4768s 2024-11-23 21:38:12,928 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:38:12,945 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42015 4768s 2024-11-23 21:38:12,945 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42015 4768s 2024-11-23 21:38:12,945 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:38:12,945 - distributed.worker - INFO - dashboard at: 127.0.0.1:46175 4768s 2024-11-23 21:38:12,945 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36525 4768s 2024-11-23 21:38:12,945 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:38:12,945 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:38:12,945 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:38:12,945 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-thqfsur5 4768s 2024-11-23 21:38:12,945 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:38:12,948 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45159 4768s 2024-11-23 21:38:12,948 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45159 4768s 2024-11-23 21:38:12,948 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:38:12,948 - distributed.worker - INFO - dashboard at: 127.0.0.1:37527 4768s 2024-11-23 21:38:12,948 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36525 4768s 2024-11-23 21:38:12,948 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:38:12,948 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:38:12,948 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:38:12,948 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-8prplrpz 4768s 2024-11-23 21:38:12,948 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:38:12,956 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42015. Reason: failure-to-start- 4768s 2024-11-23 21:38:12,956 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:38:12,957 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45159. Reason: failure-to-start- 4768s 2024-11-23 21:38:12,957 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:38:12,959 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36525': TLS handshake failed with remote 'tls://127.0.0.1:52374': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:38:12,959 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36525': TLS handshake failed with remote 'tls://127.0.0.1:52390': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:38:12,961 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:38:13,967 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:38:13,975 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42435 4768s 2024-11-23 21:38:13,976 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46765/status 4768s 2024-11-23 21:38:13,976 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:38:13,999 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36375 4768s 2024-11-23 21:38:13,999 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36375 4768s 2024-11-23 21:38:13,999 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:38:13,999 - distributed.worker - INFO - dashboard at: 127.0.0.1:46495 4768s 2024-11-23 21:38:13,999 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42435 4768s 2024-11-23 21:38:13,999 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:38:13,999 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:38:13,999 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:38:13,999 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-rg66wnlv 4768s 2024-11-23 21:38:13,999 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:38:14,001 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34187 4768s 2024-11-23 21:38:14,002 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34187 4768s 2024-11-23 21:38:14,002 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:38:14,002 - distributed.worker - INFO - dashboard at: 127.0.0.1:45407 4768s 2024-11-23 21:38:14,002 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42435 4768s 2024-11-23 21:38:14,002 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:38:14,002 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:38:14,002 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:38:14,002 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-8n5wwhe4 4768s 2024-11-23 21:38:14,002 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:38:14,004 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36375. Reason: failure-to-start- 4768s 2024-11-23 21:38:14,004 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:38:14,004 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34187. Reason: failure-to-start- 4768s 2024-11-23 21:38:14,005 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:38:14,006 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42435': TLS handshake failed with remote 'tls://127.0.0.1:47088': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:38:14,006 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42435': TLS handshake failed with remote 'tls://127.0.0.1:47102': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:38:14,008 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:38:15,013 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:38:15,024 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35377 4768s 2024-11-23 21:38:15,024 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33049/status 4768s 2024-11-23 21:38:15,024 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:38:15,045 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33599 4768s 2024-11-23 21:38:15,045 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33599 4768s 2024-11-23 21:38:15,045 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:38:15,045 - distributed.worker - INFO - dashboard at: 127.0.0.1:35785 4768s 2024-11-23 21:38:15,045 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35377 4768s 2024-11-23 21:38:15,045 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:38:15,045 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:38:15,045 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:38:15,045 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-t53brlvk 4768s 2024-11-23 21:38:15,045 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:38:15,048 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46467 4768s 2024-11-23 21:38:15,048 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46467 4768s 2024-11-23 21:38:15,048 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:38:15,048 - distributed.worker - INFO - dashboard at: 127.0.0.1:34345 4768s 2024-11-23 21:38:15,048 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35377 4768s 2024-11-23 21:38:15,048 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:38:15,048 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:38:15,048 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:38:15,048 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-uop9un5c 4768s 2024-11-23 21:38:15,048 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:38:15,050 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33599. Reason: failure-to-start- 4768s 2024-11-23 21:38:15,050 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:38:15,050 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46467. Reason: failure-to-start- 4768s 2024-11-23 21:38:15,051 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:38:15,052 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35377': TLS handshake failed with remote 'tls://127.0.0.1:42120': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:38:15,052 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35377': TLS handshake failed with remote 'tls://127.0.0.1:42132': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:38:15,054 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:38:16,060 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:38:16,068 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34325 4768s 2024-11-23 21:38:16,068 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38031/status 4768s 2024-11-23 21:38:16,069 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:38:16,089 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38809 4768s 2024-11-23 21:38:16,089 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38809 4768s 2024-11-23 21:38:16,089 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:38:16,089 - distributed.worker - INFO - dashboard at: 127.0.0.1:33447 4768s 2024-11-23 21:38:16,090 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34325 4768s 2024-11-23 21:38:16,090 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:38:16,090 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:38:16,090 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:38:16,090 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-yy5uvil5 4768s 2024-11-23 21:38:16,090 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:38:16,092 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42357 4768s 2024-11-23 21:38:16,092 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42357 4768s 2024-11-23 21:38:16,093 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:38:16,093 - distributed.worker - INFO - dashboard at: 127.0.0.1:44119 4768s 2024-11-23 21:38:16,093 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34325 4768s 2024-11-23 21:38:16,093 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:38:16,093 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:38:16,093 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:38:16,093 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-rgl7z3o4 4768s 2024-11-23 21:38:16,093 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:38:16,095 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38809. Reason: failure-to-start- 4768s 2024-11-23 21:38:16,095 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:38:16,095 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42357. Reason: failure-to-start- 4768s 2024-11-23 21:38:16,095 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:38:16,097 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34325': TLS handshake failed with remote 'tls://127.0.0.1:40770': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:38:16,097 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34325': TLS handshake failed with remote 'tls://127.0.0.1:40786': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:38:16,102 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:38:17,108 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:38:17,116 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35307 4768s 2024-11-23 21:38:17,116 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46601/status 4768s 2024-11-23 21:38:17,116 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:38:17,133 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33589 4768s 2024-11-23 21:38:17,133 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33589 4768s 2024-11-23 21:38:17,133 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:38:17,133 - distributed.worker - INFO - dashboard at: 127.0.0.1:45517 4768s 2024-11-23 21:38:17,133 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35307 4768s 2024-11-23 21:38:17,133 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:38:17,133 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:38:17,133 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:38:17,133 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-m3n3yals 4768s 2024-11-23 21:38:17,133 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:38:17,137 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38969 4768s 2024-11-23 21:38:17,137 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38969 4768s 2024-11-23 21:38:17,137 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:38:17,137 - distributed.worker - INFO - dashboard at: 127.0.0.1:36373 4768s 2024-11-23 21:38:17,137 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35307 4768s 2024-11-23 21:38:17,138 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:38:17,138 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:38:17,138 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:38:17,138 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-78pdmx6o 4768s 2024-11-23 21:38:17,138 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:38:17,139 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33589. Reason: failure-to-start- 4768s 2024-11-23 21:38:17,139 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:38:17,140 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38969. Reason: failure-to-start- 4768s 2024-11-23 21:38:17,140 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:38:17,145 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35307': TLS handshake failed with remote 'tls://127.0.0.1:56688': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:38:17,146 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35307': TLS handshake failed with remote 'tls://127.0.0.1:56694': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:38:17,148 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:38:18,154 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:38:18,162 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41641 4768s 2024-11-23 21:38:18,162 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37849/status 4768s 2024-11-23 21:38:18,162 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:38:18,178 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39039 4768s 2024-11-23 21:38:18,178 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39039 4768s 2024-11-23 21:38:18,178 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:38:18,178 - distributed.worker - INFO - dashboard at: 127.0.0.1:46573 4768s 2024-11-23 21:38:18,178 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41641 4768s 2024-11-23 21:38:18,178 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:38:18,178 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:38:18,178 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:38:18,178 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-7e8fkjp2 4768s 2024-11-23 21:38:18,178 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:38:18,180 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34527 4768s 2024-11-23 21:38:18,181 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34527 4768s 2024-11-23 21:38:18,181 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:38:18,181 - distributed.worker - INFO - dashboard at: 127.0.0.1:33683 4768s 2024-11-23 21:38:18,181 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41641 4768s 2024-11-23 21:38:18,181 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:38:18,181 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:38:18,181 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:38:18,181 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-3ibz58p8 4768s 2024-11-23 21:38:18,181 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:38:18,184 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39039. Reason: failure-to-start- 4768s 2024-11-23 21:38:18,184 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:38:18,184 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34527. Reason: failure-to-start- 4768s 2024-11-23 21:38:18,185 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:38:18,186 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41641': TLS handshake failed with remote 'tls://127.0.0.1:43198': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:38:18,187 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41641': TLS handshake failed with remote 'tls://127.0.0.1:43210': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:38:18,191 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s __________________________________ test_Queue __________________________________ 4768s 4768s fut = , timeout = 0 4768s 4768s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 4768s async with asyncio.timeout(timeout): 4768s > return await fut 4768s 4768s /usr/lib/python3/dist-packages/distributed/utils.py:1960: 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s /usr/lib/python3/dist-packages/distributed/worker.py:1480: in start_unsafe 4768s await self._register_with_scheduler() 4768s /usr/lib/python3/dist-packages/distributed/worker.py:1179: in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s /usr/lib/python3/dist-packages/distributed/comm/core.py:342: in connect 4768s comm = await wait_for( 4768s /usr/lib/python3/dist-packages/distributed/utils.py:1960: in wait_for 4768s return await fut 4768s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:546: in connect 4768s stream = await self.client.connect( 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s 4768s self = , host = '127.0.0.1' 4768s port = 37041, af = 4768s ssl_options = 4768s max_buffer_size = 8364507136.0, source_ip = None, source_port = None 4768s timeout = None 4768s 4768s async def connect( 4768s self, 4768s host: str, 4768s port: int, 4768s af: socket.AddressFamily = socket.AF_UNSPEC, 4768s ssl_options: Optional[Union[Dict[str, Any], ssl.SSLContext]] = None, 4768s max_buffer_size: Optional[int] = None, 4768s source_ip: Optional[str] = None, 4768s source_port: Optional[int] = None, 4768s timeout: Optional[Union[float, datetime.timedelta]] = None, 4768s ) -> IOStream: 4768s """Connect to the given host and port. 4768s 4768s Asynchronously returns an `.IOStream` (or `.SSLIOStream` if 4768s ``ssl_options`` is not None). 4768s 4768s Using the ``source_ip`` kwarg, one can specify the source 4768s IP address to use when establishing the connection. 4768s In case the user needs to resolve and 4768s use a specific interface, it has to be handled outside 4768s of Tornado as this depends very much on the platform. 4768s 4768s Raises `TimeoutError` if the input future does not complete before 4768s ``timeout``, which may be specified in any form allowed by 4768s `.IOLoop.add_timeout` (i.e. a `datetime.timedelta` or an absolute time 4768s relative to `.IOLoop.time`) 4768s 4768s Similarly, when the user requires a certain source port, it can 4768s be specified using the ``source_port`` arg. 4768s 4768s .. versionchanged:: 4.5 4768s Added the ``source_ip`` and ``source_port`` arguments. 4768s 4768s .. versionchanged:: 5.0 4768s Added the ``timeout`` argument. 4768s """ 4768s if timeout is not None: 4768s if isinstance(timeout, numbers.Real): 4768s timeout = IOLoop.current().time() + timeout 4768s elif isinstance(timeout, datetime.timedelta): 4768s timeout = IOLoop.current().time() + timeout.total_seconds() 4768s else: 4768s raise TypeError("Unsupported timeout %r" % timeout) 4768s if timeout is not None: 4768s addrinfo = await gen.with_timeout( 4768s timeout, self.resolver.resolve(host, port, af) 4768s ) 4768s else: 4768s addrinfo = await self.resolver.resolve(host, port, af) 4768s connector = _Connector( 4768s addrinfo, 4768s functools.partial( 4768s self._create_stream, 4768s max_buffer_size, 4768s source_ip=source_ip, 4768s source_port=source_port, 4768s ), 4768s ) 4768s > af, addr, stream = await connector.start(connect_timeout=timeout) 4768s E asyncio.exceptions.CancelledError 4768s 4768s /usr/lib/python3/dist-packages/tornado/tcpclient.py:279: CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s self = 4768s 4768s @final 4768s async def start(self): 4768s async with self._startup_lock: 4768s if self.status == Status.failed: 4768s assert self.__startup_exc is not None 4768s raise self.__startup_exc 4768s elif self.status != Status.init: 4768s return self 4768s timeout = getattr(self, "death_timeout", None) 4768s 4768s async def _close_on_failure(exc: Exception) -> None: 4768s await self.close(reason=f"failure-to-start-{str(type(exc))}") 4768s self.status = Status.failed 4768s self.__startup_exc = exc 4768s 4768s try: 4768s > await wait_for(self.start_unsafe(), timeout=timeout) 4768s 4768s /usr/lib/python3/dist-packages/distributed/core.py:664: 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 4768s async with asyncio.timeout(timeout): 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s 4768s self = 4768s exc_type = 4768s exc_val = CancelledError(), exc_tb = 4768s 4768s async def __aexit__( 4768s self, 4768s exc_type: Optional[Type[BaseException]], 4768s exc_val: Optional[BaseException], 4768s exc_tb: Optional[TracebackType], 4768s ) -> Optional[bool]: 4768s assert self._state in (_State.ENTERED, _State.EXPIRING) 4768s 4768s if self._timeout_handler is not None: 4768s self._timeout_handler.cancel() 4768s self._timeout_handler = None 4768s 4768s if self._state is _State.EXPIRING: 4768s self._state = _State.EXPIRED 4768s 4768s if self._task.uncancel() <= self._cancelling and exc_type is not None: 4768s # Since there are no new cancel requests, we're 4768s # handling this. 4768s if issubclass(exc_type, exceptions.CancelledError): 4768s > raise TimeoutError from exc_val 4768s E TimeoutError 4768s 4768s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s @contextlib.asynccontextmanager 4768s async def _cluster_factory(): 4768s workers = [] 4768s s = None 4768s try: 4768s for _ in range(60): 4768s try: 4768s > s, ws = await start_cluster( 4768s nthreads, 4768s scheduler, 4768s security=security, 4768s Worker=Worker, 4768s scheduler_kwargs=scheduler_kwargs, 4768s worker_kwargs=merge( 4768s {"death_timeout": min(15, int(deadline.remaining))}, 4768s worker_kwargs, 4768s ), 4768s ) 4768s 4768s /usr/lib/python3/dist-packages/distributed/utils_test.py:966: 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s /usr/lib/python3/dist-packages/distributed/utils_test.py:789: in start_cluster 4768s await asyncio.gather(*workers) 4768s /usr/lib/python3.13/asyncio/tasks.py:737: in _wrap_awaitable 4768s return await awaitable 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s 4768s self = 4768s 4768s @final 4768s async def start(self): 4768s async with self._startup_lock: 4768s if self.status == Status.failed: 4768s assert self.__startup_exc is not None 4768s raise self.__startup_exc 4768s elif self.status != Status.init: 4768s return self 4768s timeout = getattr(self, "death_timeout", None) 4768s 4768s async def _close_on_failure(exc: Exception) -> None: 4768s await self.close(reason=f"failure-to-start-{str(type(exc))}") 4768s self.status = Status.failed 4768s self.__startup_exc = exc 4768s 4768s try: 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s except asyncio.TimeoutError as exc: 4768s await _close_on_failure(exc) 4768s > raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s E TimeoutError: Worker start timed out after 0s. 4768s 4768s /usr/lib/python3/dist-packages/distributed/core.py:667: TimeoutError 4768s 4768s During handling of the above exception, another exception occurred: 4768s 4768s fut = ._..test_func..async_fn at 0xe99addc0> 4768s timeout = 60 4768s 4768s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 4768s async with asyncio.timeout(timeout): 4768s > return await fut 4768s 4768s /usr/lib/python3/dist-packages/distributed/utils.py:1960: 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s /usr/lib/python3/dist-packages/distributed/utils_test.py:999: in async_fn 4768s _cluster_factory() as (s, workers), 4768s /usr/lib/python3.13/contextlib.py:214: in __aenter__ 4768s return await anext(self.gen) 4768s /usr/lib/python3/dist-packages/distributed/utils_test.py:983: in _cluster_factory 4768s await asyncio.sleep(1) 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s 4768s delay = 1, result = None 4768s 4768s async def sleep(delay, result=None): 4768s """Coroutine that completes after a given time (in seconds).""" 4768s if delay <= 0: 4768s await __sleep0() 4768s return result 4768s 4768s if math.isnan(delay): 4768s raise ValueError("Invalid delay: NaN (not a number)") 4768s 4768s loop = events.get_running_loop() 4768s future = loop.create_future() 4768s h = loop.call_later(delay, 4768s futures._set_result_unless_cancelled, 4768s future, result) 4768s try: 4768s > return await future 4768s E asyncio.exceptions.CancelledError 4768s 4768s /usr/lib/python3.13/asyncio/tasks.py:718: CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s args = (), kwds = {} 4768s 4768s @wraps(func) 4768s def inner(*args, **kwds): 4768s with self._recreate_cm(): 4768s > return func(*args, **kwds) 4768s 4768s /usr/lib/python3.13/contextlib.py:85: 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s /usr/lib/python3.13/contextlib.py:85: in inner 4768s return func(*args, **kwds) 4768s /usr/lib/python3/dist-packages/distributed/utils_test.py:1102: in test_func 4768s return _run_and_close_tornado(async_fn_outer) 4768s /usr/lib/python3/dist-packages/distributed/utils_test.py:378: in _run_and_close_tornado 4768s return asyncio_run(inner_fn(), loop_factory=get_loop_factory()) 4768s /usr/lib/python3.13/asyncio/runners.py:194: in run 4768s return runner.run(main) 4768s /usr/lib/python3.13/asyncio/runners.py:118: in run 4768s return self._loop.run_until_complete(task) 4768s /usr/lib/python3.13/asyncio/base_events.py:720: in run_until_complete 4768s return future.result() 4768s /usr/lib/python3/dist-packages/distributed/utils_test.py:375: in inner_fn 4768s return await async_fn(*args, **kwargs) 4768s /usr/lib/python3/dist-packages/distributed/utils_test.py:1099: in async_fn_outer 4768s return await utils_wait_for(async_fn(), timeout=timeout * 2) 4768s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 4768s async with asyncio.timeout(timeout): 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s 4768s self = 4768s exc_type = 4768s exc_val = CancelledError(), exc_tb = 4768s 4768s async def __aexit__( 4768s self, 4768s exc_type: Optional[Type[BaseException]], 4768s exc_val: Optional[BaseException], 4768s exc_tb: Optional[TracebackType], 4768s ) -> Optional[bool]: 4768s assert self._state in (_State.ENTERED, _State.EXPIRING) 4768s 4768s if self._timeout_handler is not None: 4768s self._timeout_handler.cancel() 4768s self._timeout_handler = None 4768s 4768s if self._state is _State.EXPIRING: 4768s self._state = _State.EXPIRED 4768s 4768s if self._task.uncancel() <= self._cancelling and exc_type is not None: 4768s # Since there are no new cancel requests, we're 4768s # handling this. 4768s if issubclass(exc_type, exceptions.CancelledError): 4768s > raise TimeoutError from exc_val 4768s E TimeoutError 4768s 4768s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 4768s ----------------------------- Captured stderr call ----------------------------- 4768s 2024-11-23 21:38:19,416 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:38:19,425 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:19,426 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44567/status 4768s 2024-11-23 21:38:19,426 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:38:19,442 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44107 4768s 2024-11-23 21:38:19,442 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44107 4768s 2024-11-23 21:38:19,442 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:38:19,442 - distributed.worker - INFO - dashboard at: 127.0.0.1:46239 4768s 2024-11-23 21:38:19,442 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:19,442 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:38:19,442 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:38:19,442 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:38:19,442 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-e93qrjfz 4768s 2024-11-23 21:38:19,442 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:38:19,445 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44433 4768s 2024-11-23 21:38:19,445 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44433 4768s 2024-11-23 21:38:19,445 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:38:19,445 - distributed.worker - INFO - dashboard at: 127.0.0.1:46519 4768s 2024-11-23 21:38:19,445 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:19,445 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:38:19,445 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:38:19,445 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:38:19,445 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-xytwex23 4768s 2024-11-23 21:38:19,445 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:38:19,458 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:19,459 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:19,459 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:38374': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:19,459 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:38382': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:19,572 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:19,572 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:19,573 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:38388': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:19,573 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:38396': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:19,686 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:19,686 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:19,688 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:38404': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:19,688 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:38420': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:19,800 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:19,800 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:19,801 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:38434': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:19,801 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:38440': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:19,914 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:19,915 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:19,915 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:38450': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:19,915 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:38462': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:20,028 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:20,029 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:20,029 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:38478': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:20,029 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:38492': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:20,142 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:20,142 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:20,142 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:38496': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:20,143 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:38508': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:20,255 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:20,255 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:20,256 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:38520': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:20,256 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:38536': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:20,368 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:20,368 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:20,369 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:38544': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:20,369 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:38550': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:20,482 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:20,482 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:20,483 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:38556': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:20,483 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:38562': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:20,595 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:20,595 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:20,595 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:38578': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:20,595 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:38586': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:20,709 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:20,710 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:20,710 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:38588': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:20,710 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:38598': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:20,823 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:20,823 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:20,823 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:38612': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:20,824 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:38624': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:20,941 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:20,941 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:20,942 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:38626': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:20,942 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:38636': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:21,054 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:21,054 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:21,055 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:38652': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:21,055 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:38660': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:21,167 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:21,168 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:21,168 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:38672': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:21,168 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:38680': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:21,282 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:21,282 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:21,283 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:38692': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:21,283 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:38696': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:21,395 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:21,396 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:21,397 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:38700': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:21,397 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:38702': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:21,504 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:21,505 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:38704': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:21,510 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:21,511 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:38708': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:21,612 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:21,613 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:51890': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:21,619 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:21,620 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:51904': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:21,720 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:21,720 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:51912': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:21,727 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:21,727 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:51914': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:21,828 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:21,828 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:51918': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:21,835 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:21,835 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:51926': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:21,938 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:21,939 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:51932': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:21,945 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:21,946 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:51940': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:22,045 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:22,046 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:51946': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:22,053 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:22,053 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:51948': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:22,154 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:22,154 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:51956': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:22,160 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:22,161 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:51968': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:22,261 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:22,261 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:51982': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:22,268 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:22,268 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:51992': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:22,369 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:22,369 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:51996': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:22,375 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:22,376 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:52002': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:22,477 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:22,478 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:52018': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:22,484 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:22,484 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:52032': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:22,585 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:22,586 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:52040': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:22,592 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:22,592 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:52042': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:22,694 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:22,695 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:52046': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:22,701 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:22,701 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:52052': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:22,802 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:22,802 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:52056': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:22,809 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:22,809 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:52060': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:22,910 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:22,910 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:52064': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:22,917 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:22,917 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:52066': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:23,018 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:23,019 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:52074': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:23,025 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:23,026 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:52090': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:23,128 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:23,128 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:52092': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:23,135 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:23,135 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:52106': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:23,235 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:23,236 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:52114': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:23,243 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:23,243 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:52126': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:23,344 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:23,344 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:52132': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:23,350 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:23,351 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:52146': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:23,452 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:23,453 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:52150': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:23,459 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:23,459 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:52166': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:23,559 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:23,560 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:52182': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:23,566 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:23,566 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:52184': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:23,667 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:23,668 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:52188': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:23,675 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:23,675 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:52204': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:23,775 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:23,776 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:52212': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:23,782 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:23,783 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:52220': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:23,883 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:23,884 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:52236': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:23,890 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:23,891 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:52238': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:23,992 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:23,993 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:52240': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:23,999 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:23,999 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:52252': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:24,100 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:24,101 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:52266': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:24,107 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:24,108 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:52280': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:24,208 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:24,208 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:52292': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:24,215 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:24,215 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:52308': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:24,316 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:24,316 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:52310': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:24,323 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:24,323 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:52326': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:24,424 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:24,424 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:52342': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:24,431 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:24,436 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:52344': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:24,532 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:24,533 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:52348': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:24,539 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:24,540 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:52354': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:24,640 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:24,641 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:52356': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:24,647 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:24,648 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:52366': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:24,749 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:24,750 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:52370': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:24,756 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:24,757 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:52374': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:24,859 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:24,860 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:52388': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:24,866 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:24,866 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:52392': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:24,966 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:24,967 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:52406': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:24,973 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:24,974 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:52416': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:25,075 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:25,075 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:52420': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:25,082 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:25,082 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:52428': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:25,183 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:25,184 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:52434': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:25,191 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:25,191 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:52446': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:25,291 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:25,292 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:52450': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:25,299 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:25,299 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:52458': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:25,399 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:25,400 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:52474': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:25,406 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:25,407 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:52486': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:25,506 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:25,507 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:52490': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:25,514 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:25,514 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:52496': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:25,615 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:25,615 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:52502': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:25,622 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:25,622 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:52514': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:25,722 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:25,723 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:52524': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:25,729 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:25,730 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:52536': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:25,831 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:25,831 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:52538': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:25,838 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:25,838 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:52546': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:25,938 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:25,939 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:52554': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:25,945 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:25,945 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:52560': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:26,046 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:26,046 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:52576': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:26,053 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:26,053 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:52590': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:26,154 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:26,154 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:52606': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:26,160 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:26,161 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:52610': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:26,262 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:26,263 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:52622': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:26,269 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:26,269 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:52630': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:26,371 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:26,372 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:52634': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:26,378 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:26,378 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:52638': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:26,479 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:26,482 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:52640': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:26,488 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:26,489 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:52650': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:26,588 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:26,588 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:52660': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:26,596 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:26,597 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:52668': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:26,696 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:26,697 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:52672': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:26,703 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:26,703 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:52684': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:26,805 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:26,805 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:52690': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:26,812 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:26,812 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:52696': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:26,912 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:26,912 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:52710': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:26,919 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:26,919 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:52720': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:27,021 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:27,022 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:52724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:27,028 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:27,028 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:52738': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:27,129 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:27,130 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:52746': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:27,136 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:27,137 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:52758': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:27,237 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:27,237 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:52762': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:27,244 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:27,244 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:52766': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:27,345 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:27,345 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:52772': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:27,352 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:27,352 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:52774': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:27,453 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:27,454 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:52788': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:27,460 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:27,461 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:52792': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:27,561 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:27,561 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:52808': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:27,568 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:27,568 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:52822': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:27,669 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:27,670 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:52824': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:27,676 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:27,676 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:52836': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:27,777 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:27,778 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:52852': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:27,784 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:27,785 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:52868': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:27,885 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:27,886 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:52870': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:27,892 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:27,893 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:52882': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:27,993 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:27,994 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:52892': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:28,000 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:28,001 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:52904': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:28,102 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:28,103 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:52918': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:28,110 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:28,111 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:52932': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:28,210 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:28,211 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:52944': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:28,217 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:28,217 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:52946': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:28,318 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:28,319 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:52956': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:28,325 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:28,326 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:52972': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:28,426 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:28,427 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:52986': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:28,437 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:28,437 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:52988': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:28,534 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:28,534 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:53004': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:28,544 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:28,544 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:53020': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:28,641 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:28,642 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:53034': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:28,652 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:28,652 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:53050': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:28,749 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:28,750 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:53066': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:28,759 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:28,760 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:53082': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:28,857 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:28,858 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:53096': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:28,867 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:28,867 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:53098': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:28,965 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:28,966 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:53112': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:28,975 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:28,975 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:53128': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:29,074 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:29,074 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:53136': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:29,082 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:29,082 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:53142': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:29,181 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:29,182 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:53154': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:29,190 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:29,190 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:53168': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:29,289 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:29,289 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:53172': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:29,297 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:29,298 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:53174': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:29,397 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:29,398 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:53176': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:29,405 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:29,405 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:53192': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:29,506 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:29,507 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:53202': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:29,513 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:29,514 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:53218': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:29,614 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:29,615 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:53222': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:29,621 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:29,622 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:53232': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:29,722 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:29,722 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:53238': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:29,729 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:29,729 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:53250': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:29,831 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:29,832 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:53262': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:29,839 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:29,839 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:53274': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:29,939 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:29,940 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:53288': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:29,946 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:29,947 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:53302': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:30,048 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:30,049 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:53316': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:30,056 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:30,056 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:53322': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:30,157 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:30,157 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:53332': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:30,164 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:30,164 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:53334': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:30,265 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:30,265 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:53350': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:30,272 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:30,272 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:53354': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:30,373 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:30,373 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:53364': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:30,380 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:30,380 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:53372': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:30,481 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:30,482 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:53386': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:30,488 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:30,489 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:53402': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:30,590 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:30,591 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:53410': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:30,597 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:30,597 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:53412': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:30,699 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:30,700 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:53414': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:30,706 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:30,707 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:53424': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:30,808 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:30,809 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:53434': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:30,815 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:30,815 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:53442': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:30,915 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:30,916 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:53454': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:30,923 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:30,923 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:53458': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:31,024 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:31,024 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:53468': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:31,031 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:31,031 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:53480': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:31,132 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:31,133 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:53496': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:31,140 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:31,140 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:53512': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:31,240 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:31,241 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:53514': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:31,248 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:31,248 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:53526': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:31,348 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:31,349 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:53528': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:31,355 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:31,356 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:53538': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:31,457 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:31,458 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:53546': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:31,464 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:31,464 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:53548': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:31,565 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:31,565 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:37828': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:31,572 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:31,572 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:37834': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:31,674 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:31,675 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:37850': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:31,682 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:31,682 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:37858': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:31,782 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:31,783 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:37872': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:31,789 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:31,790 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:37888': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:31,891 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:31,892 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:37890': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:31,898 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:31,898 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:37894': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:31,999 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:32,000 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:37896': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:32,006 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:32,007 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:37904': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:32,107 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:32,108 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:37908': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:32,114 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:32,115 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:37910': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:32,215 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:32,216 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:37922': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:32,222 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:32,223 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:37936': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:32,324 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:32,324 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:37942': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:32,331 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:32,331 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:37956': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:32,436 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:32,437 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:37966': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:32,443 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:32,444 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:37974': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:32,544 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:32,545 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:37980': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:32,551 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:32,552 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:37990': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:32,654 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:32,655 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:38002': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:32,661 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:32,661 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:38008': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:32,761 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:32,762 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:38010': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:32,768 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:32,769 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:38018': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:32,869 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:32,870 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:38028': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:32,877 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:32,877 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:38034': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:32,978 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:32,979 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:38036': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:32,985 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:32,986 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:38048': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:33,089 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:33,090 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:38056': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:33,096 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:33,097 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:38064': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:33,198 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:33,199 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:38072': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:33,205 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:33,206 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:38084': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:33,307 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:33,308 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:38096': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:33,314 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:33,314 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:38106': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:33,416 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:33,417 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:38110': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:33,423 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:33,423 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:38112': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:33,524 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:33,525 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:38116': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:33,531 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:33,532 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:38130': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:33,632 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:33,633 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:38144': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:33,639 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:33,640 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:38146': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:33,740 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:33,741 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:38162': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:33,747 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:33,748 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:38172': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:33,848 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:33,848 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:38184': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:33,855 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:33,856 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:38186': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:33,956 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:33,956 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:38190': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:33,963 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:33,963 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:38194': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:34,063 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:34,064 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:38202': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:34,070 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:34,070 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:38208': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:34,171 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:34,172 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:38210': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:34,178 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:34,179 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:38222': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:34,279 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:34,281 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:38238': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:34,287 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:34,287 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:38246': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:34,387 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:34,388 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:38254': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:34,394 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 4768s 2024-11-23 21:38:34,394 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:38256': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:34,441 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44107. Reason: failure-to-start- 4768s 2024-11-23 21:38:34,442 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:38:34,443 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44433. Reason: failure-to-start- 4768s 2024-11-23 21:38:34,443 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:38:34,445 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 15s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 4768s stream = await stream.start_tls( 4768s ^^^^^^^^^^^^^^^^^^^^^^^ 4768s False, ssl_options=ssl_options, server_hostname=host 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 4768s self.socket.do_handshake() 4768s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 4768s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 4768s self._sslobj.do_handshake() 4768s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 4768s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 4768s raise FatalCommClosedError( 4768s ...<2 lines>... 4768s ) from err 4768s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 4768s 4768s During handling of the above exception, another exception occurred: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1218, in _register_with_scheduler 4768s await asyncio.sleep(0.1) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 718, in sleep 4768s return await future 4768s ^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 15s. 4768s 2024-11-23 21:38:35,452 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:38:35,463 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:35,463 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41681/status 4768s 2024-11-23 21:38:35,463 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:38:35,479 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44517 4768s 2024-11-23 21:38:35,480 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44517 4768s 2024-11-23 21:38:35,480 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:38:35,480 - distributed.worker - INFO - dashboard at: 127.0.0.1:42209 4768s 2024-11-23 21:38:35,480 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:35,480 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:38:35,480 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:38:35,480 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:38:35,480 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-iofzu_li 4768s 2024-11-23 21:38:35,480 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:38:35,482 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34377 4768s 2024-11-23 21:38:35,483 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34377 4768s 2024-11-23 21:38:35,483 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:38:35,483 - distributed.worker - INFO - dashboard at: 127.0.0.1:44929 4768s 2024-11-23 21:38:35,483 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:35,483 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:38:35,483 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:38:35,483 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:38:35,483 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-e14tgqcn 4768s 2024-11-23 21:38:35,483 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:38:35,496 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:35,497 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:35,497 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:41370': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:35,497 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:41386': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:35,610 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:35,611 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:35,611 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:41388': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:35,611 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:41394': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:35,724 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:35,724 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:35,724 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:41402': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:35,725 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:41404': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:35,838 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:35,839 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:35,839 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:41416': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:35,839 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:41430': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:35,952 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:35,953 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:35,953 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:41440': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:35,953 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:41452': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:36,067 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:36,067 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:36,067 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:41458': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:36,067 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:41470': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:36,180 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:36,181 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:36,181 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:41478': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:36,181 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:41488': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:36,295 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:36,295 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:36,296 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:41492': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:36,296 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:41500': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:36,409 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:36,410 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:36,410 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:41502': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:36,410 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:41510': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:36,522 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:36,523 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:36,523 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:41522': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:36,523 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:41534': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:36,636 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:36,637 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:36,637 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:41544': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:36,637 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:41556': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:36,750 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:36,750 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:36,751 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:41564': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:36,751 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:41574': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:36,864 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:36,864 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:36,865 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:41576': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:36,865 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:41592': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:36,980 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:36,981 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:36,981 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:41604': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:36,982 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:41616': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:37,089 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:37,094 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:41624': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:37,095 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:37,096 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:41636': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:37,198 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:37,199 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:41642': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:37,206 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:37,206 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:41646': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:37,307 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:37,308 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:41654': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:37,314 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:37,315 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:41668': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:37,416 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:37,416 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:41672': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:37,423 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:37,423 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:41674': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:37,524 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:37,525 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:41690': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:37,531 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:37,532 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:41696': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:37,632 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:37,632 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:41700': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:37,639 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:37,639 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:41706': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:37,740 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:37,740 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:41714': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:37,747 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:37,747 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:41724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:37,849 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:37,850 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:41726': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:37,856 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:37,857 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:41738': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:37,958 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:37,959 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:41752': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:37,966 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:37,970 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:41758': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:38,067 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:38,067 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:41762': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:38,074 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:38,074 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:41764': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:38,174 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:38,175 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:41778': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:38,182 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:38,182 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:41788': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:38,282 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:38,282 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:41792': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:38,289 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:38,289 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:41800': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:38,390 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:38,391 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:41816': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:38,397 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:38,398 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:41826': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:38,498 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:38,498 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:41836': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:38,505 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:38,505 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:41838': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:38,606 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:38,606 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:41848': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:38,613 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:38,613 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:41860': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:38,714 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:38,715 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:41866': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:38,721 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:38,722 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:41870': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:38,822 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:38,823 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:41874': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:38,829 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:38,830 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:41890': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:38,936 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:38,936 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:41898': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:38,943 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:38,943 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:41914': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:39,044 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:39,045 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:41926': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:39,051 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:39,052 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:41940': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:39,153 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:39,154 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:41948': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:39,160 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:39,161 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:41956': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:39,261 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:39,261 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:41966': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:39,268 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:39,269 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:41980': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:39,368 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:39,369 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:41990': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:39,375 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:39,376 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:41996': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:39,476 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:39,476 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:42012': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:39,483 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:39,483 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:42020': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:39,583 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:39,584 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:42026': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:39,592 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:39,592 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:42028': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:39,691 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:39,692 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:42042': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:39,700 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:39,700 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:42054': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:39,799 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:39,800 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:42062': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:39,807 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:39,808 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:42064': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:39,907 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:39,907 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:42072': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:39,914 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:39,914 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:42080': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:40,015 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:40,015 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:42084': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:40,022 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:40,022 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:42088': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:40,123 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:40,124 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:42090': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:40,130 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:40,131 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:42106': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:40,232 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:40,233 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:42122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:40,239 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:40,240 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:42138': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:40,340 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:40,340 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:42150': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:40,347 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:40,347 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:42164': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:40,448 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:40,448 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:42178': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:40,455 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:40,455 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:42190': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:40,556 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:40,556 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:42196': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:40,563 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:40,563 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:42210': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:40,664 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:40,664 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:42218': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:40,671 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:40,671 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:42228': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:40,773 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:40,774 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:42242': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:40,780 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:40,780 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:42246': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:40,882 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:40,883 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:42252': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:40,889 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:40,890 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:42260': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:40,990 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:40,991 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:42268': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:40,997 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:40,998 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:42282': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:41,099 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:41,100 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:42290': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:41,107 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:41,107 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:42300': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:41,208 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:41,208 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:42314': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:41,215 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:41,217 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:42330': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:41,317 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:41,318 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:42336': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:41,324 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:41,324 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:42342': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:41,425 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:41,425 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:42344': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:41,435 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:41,436 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:42346': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:41,533 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:41,533 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:56610': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:41,544 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:41,544 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:56616': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:41,640 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:41,641 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:56630': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:41,651 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:41,651 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:56638': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:41,748 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:41,749 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:56652': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:41,759 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:41,759 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:56666': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:41,856 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:41,857 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:56670': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:41,867 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:41,867 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:56678': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:41,964 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:41,965 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:56680': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:41,974 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:41,975 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:56684': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:42,072 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:42,072 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:56692': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:42,082 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:42,083 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:56700': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:42,180 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:42,181 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:56706': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:42,190 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:42,190 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:56708': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:42,288 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:42,289 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:56712': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:42,298 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:42,298 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:56718': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:42,396 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:42,397 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:56724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:42,406 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:42,406 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:56728': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:42,504 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:42,505 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:56744': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:42,513 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:42,513 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:56746': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:42,613 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:42,613 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:56760': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:42,620 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:42,621 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:56772': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:42,722 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:42,723 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:56784': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:42,729 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:42,730 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:56788': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:42,830 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:42,830 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:56790': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:42,837 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:42,837 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:56804': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:42,939 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:42,940 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:56814': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:42,946 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:42,947 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:56830': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:43,048 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:43,049 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:56836': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:43,055 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:43,056 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:56844': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:43,157 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:43,158 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:56852': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:43,164 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:43,165 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:56856': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:43,264 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:43,265 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:56864': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:43,272 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:43,272 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:56874': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:43,372 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:43,373 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:56878': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:43,379 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:43,380 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:56886': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:43,480 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:43,481 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:56900': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:43,487 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:43,488 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:56908': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:43,588 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:43,588 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:56910': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:43,595 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:43,596 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:56924': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:43,695 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:43,696 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:56938': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:43,703 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:43,703 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:56946': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:43,804 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:43,804 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:56962': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:43,811 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:43,812 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:56964': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:43,912 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:43,912 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:56980': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:43,919 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:43,919 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:56982': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:44,020 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:44,021 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:56990': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:44,028 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:44,028 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:56998': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:44,128 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:44,129 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:57012': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:44,135 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:44,136 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:57020': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:44,237 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:44,238 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:57024': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:44,244 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:44,244 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:57038': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:44,345 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:44,345 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:57040': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:44,352 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:44,352 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:57046': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:44,453 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:44,453 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:57054': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:44,460 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:44,460 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:57056': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:44,561 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:44,561 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:57062': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:44,568 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:44,569 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:57068': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:44,669 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:44,669 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:57076': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:44,676 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:44,676 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:57086': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:44,777 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:44,778 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:57102': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:44,784 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:44,785 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:57112': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:44,886 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:44,887 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:57116': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:44,893 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:44,894 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:57130': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:44,994 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:44,994 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:57136': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:45,001 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:45,001 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:57138': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:45,102 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:45,102 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:57146': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:45,109 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:45,109 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:57160': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:45,209 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:45,210 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:57166': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:45,216 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:45,217 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:57174': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:45,317 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:45,317 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:57182': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:45,324 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:45,324 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:57192': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:45,424 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:45,425 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:57202': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:45,435 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:45,436 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:57204': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:45,532 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:45,533 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:57220': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:45,542 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:45,543 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:57226': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:45,640 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:45,640 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:57230': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:45,650 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:45,650 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:57242': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:45,748 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:45,749 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:57250': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:45,757 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:45,758 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:57264': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:45,856 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:45,856 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:57268': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:45,865 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:45,866 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:57270': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:45,964 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:45,965 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:57282': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:45,975 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:45,975 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:57288': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:46,072 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:46,073 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:57296': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:46,083 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:46,083 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:57300': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:46,183 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:46,184 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:57308': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:46,190 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:46,191 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:57314': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:46,291 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:46,292 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:57330': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:46,298 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:46,299 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:57342': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:46,399 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:46,400 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:57348': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:46,406 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:46,407 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:57360': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:46,508 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:46,508 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:57364': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:46,515 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:46,515 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:57368': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:46,616 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:46,616 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:57382': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:46,623 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:46,623 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:57384': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:46,723 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:46,724 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:57392': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:46,730 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:46,731 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:57398': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:46,831 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:46,832 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:57408': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:46,838 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:46,839 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:57424': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:46,939 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:46,940 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:57434': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:46,946 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:46,947 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:57442': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:47,047 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:47,047 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:57454': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:47,054 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:47,054 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:57466': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:47,154 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:47,155 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:57480': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:47,161 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:47,162 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:57490': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:47,262 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:47,263 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:57494': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:47,270 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:47,270 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:57506': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:47,372 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:47,373 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:57512': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:47,379 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:47,379 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:57524': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:47,480 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:47,480 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:57532': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:47,487 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:47,488 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:57538': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:47,588 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:47,588 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:57554': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:47,595 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:47,595 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:57568': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:47,697 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:47,698 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:57576': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:47,704 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:47,705 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:57592': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:47,805 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:47,806 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:57596': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:47,814 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:47,814 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:57598': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:47,913 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:47,914 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:57606': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:47,922 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:47,922 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:57612': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:48,022 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:48,022 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:57614': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:48,029 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:48,030 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:57630': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:48,130 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:48,130 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:57634': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:48,137 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:48,138 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:57646': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:48,238 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:48,239 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:57648': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:48,246 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:48,246 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:57650': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:48,346 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:48,346 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:57652': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:48,353 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:48,354 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:57658': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:48,454 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:48,455 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:57666': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:48,461 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 4768s 2024-11-23 21:38:48,462 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:57676': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:38:48,479 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44517. Reason: failure-to-start- 4768s 2024-11-23 21:38:48,479 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:38:48,481 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 13s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 4768s stream = await stream.start_tls( 4768s ^^^^^^^^^^^^^^^^^^^^^^^ 4768s False, ssl_options=ssl_options, server_hostname=host 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 4768s self.socket.do_handshake() 4768s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 4768s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 4768s self._sslobj.do_handshake() 4768s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 4768s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 4768s raise FatalCommClosedError( 4768s ...<2 lines>... 4768s ) from err 4768s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 4768s 4768s During handling of the above exception, another exception occurred: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1218, in _register_with_scheduler 4768s await asyncio.sleep(0.1) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 718, in sleep 4768s return await future 4768s ^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 13s. 4768s 2024-11-23 21:38:48,485 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34377. Reason: failure-to-start- 4768s 2024-11-23 21:38:48,485 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:38:49,489 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:38:49,498 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37915 4768s 2024-11-23 21:38:49,498 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45371/status 4768s 2024-11-23 21:38:49,498 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:38:49,517 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40349 4768s 2024-11-23 21:38:49,517 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40349 4768s 2024-11-23 21:38:49,517 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:38:49,517 - distributed.worker - INFO - dashboard at: 127.0.0.1:43775 4768s 2024-11-23 21:38:49,517 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37915 4768s 2024-11-23 21:38:49,517 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:38:49,517 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:38:49,517 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:38:49,517 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-sz_0d0ts 4768s 2024-11-23 21:38:49,517 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:38:49,520 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46547 4768s 2024-11-23 21:38:49,520 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46547 4768s 2024-11-23 21:38:49,520 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:38:49,520 - distributed.worker - INFO - dashboard at: 127.0.0.1:45761 4768s 2024-11-23 21:38:49,520 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37915 4768s 2024-11-23 21:38:49,520 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:38:49,520 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:38:49,520 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:38:49,520 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-6he3p25l 4768s 2024-11-23 21:38:49,520 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:38:49,521 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40349. Reason: failure-to-start- 4768s 2024-11-23 21:38:49,522 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:38:49,522 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46547. Reason: failure-to-start- 4768s 2024-11-23 21:38:49,522 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:38:49,524 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37915': TLS handshake failed with remote 'tls://127.0.0.1:60572': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:38:49,524 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37915': TLS handshake failed with remote 'tls://127.0.0.1:60574': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:38:49,526 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:38:50,532 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:38:50,540 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36485 4768s 2024-11-23 21:38:50,541 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36589/status 4768s 2024-11-23 21:38:50,541 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:38:50,557 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35205 4768s 2024-11-23 21:38:50,557 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35205 4768s 2024-11-23 21:38:50,557 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:38:50,557 - distributed.worker - INFO - dashboard at: 127.0.0.1:42273 4768s 2024-11-23 21:38:50,558 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36485 4768s 2024-11-23 21:38:50,558 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:38:50,558 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:38:50,558 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:38:50,558 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-8j2ca986 4768s 2024-11-23 21:38:50,558 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:38:50,560 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45921 4768s 2024-11-23 21:38:50,560 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45921 4768s 2024-11-23 21:38:50,560 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:38:50,560 - distributed.worker - INFO - dashboard at: 127.0.0.1:41995 4768s 2024-11-23 21:38:50,560 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36485 4768s 2024-11-23 21:38:50,560 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:38:50,561 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:38:50,561 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:38:50,561 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ccxn7zej 4768s 2024-11-23 21:38:50,561 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:38:50,562 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35205. Reason: failure-to-start- 4768s 2024-11-23 21:38:50,562 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:38:50,563 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45921. Reason: failure-to-start- 4768s 2024-11-23 21:38:50,563 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:38:50,564 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36485': TLS handshake failed with remote 'tls://127.0.0.1:47538': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:38:50,564 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36485': TLS handshake failed with remote 'tls://127.0.0.1:47552': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:38:50,566 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:38:51,572 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:38:51,586 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33831 4768s 2024-11-23 21:38:51,587 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37119/status 4768s 2024-11-23 21:38:51,587 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:38:51,603 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45311 4768s 2024-11-23 21:38:51,603 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45311 4768s 2024-11-23 21:38:51,603 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:38:51,603 - distributed.worker - INFO - dashboard at: 127.0.0.1:44019 4768s 2024-11-23 21:38:51,603 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33831 4768s 2024-11-23 21:38:51,603 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:38:51,603 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:38:51,603 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:38:51,603 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-dakoqj1s 4768s 2024-11-23 21:38:51,604 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:38:51,606 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36549 4768s 2024-11-23 21:38:51,606 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36549 4768s 2024-11-23 21:38:51,606 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:38:51,606 - distributed.worker - INFO - dashboard at: 127.0.0.1:44615 4768s 2024-11-23 21:38:51,606 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33831 4768s 2024-11-23 21:38:51,606 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:38:51,606 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:38:51,606 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:38:51,606 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-pypi66dd 4768s 2024-11-23 21:38:51,606 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:38:51,608 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45311. Reason: failure-to-start- 4768s 2024-11-23 21:38:51,608 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:38:51,608 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36549. Reason: failure-to-start- 4768s 2024-11-23 21:38:51,608 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:38:51,610 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33831': TLS handshake failed with remote 'tls://127.0.0.1:46702': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:38:51,610 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33831': TLS handshake failed with remote 'tls://127.0.0.1:46712': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:38:51,612 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:38:52,618 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:38:52,626 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38123 4768s 2024-11-23 21:38:52,626 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37873/status 4768s 2024-11-23 21:38:52,627 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:38:52,645 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35497 4768s 2024-11-23 21:38:52,645 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35497 4768s 2024-11-23 21:38:52,645 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:38:52,645 - distributed.worker - INFO - dashboard at: 127.0.0.1:39909 4768s 2024-11-23 21:38:52,645 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38123 4768s 2024-11-23 21:38:52,645 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:38:52,645 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:38:52,645 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:38:52,645 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-2j03ggas 4768s 2024-11-23 21:38:52,645 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:38:52,648 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43875 4768s 2024-11-23 21:38:52,648 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43875 4768s 2024-11-23 21:38:52,648 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:38:52,648 - distributed.worker - INFO - dashboard at: 127.0.0.1:38903 4768s 2024-11-23 21:38:52,648 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38123 4768s 2024-11-23 21:38:52,648 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:38:52,648 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:38:52,648 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:38:52,648 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-zevf0b6a 4768s 2024-11-23 21:38:52,648 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:38:52,650 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35497. Reason: failure-to-start- 4768s 2024-11-23 21:38:52,650 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:38:52,650 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43875. Reason: failure-to-start- 4768s 2024-11-23 21:38:52,650 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:38:52,652 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38123': TLS handshake failed with remote 'tls://127.0.0.1:43938': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:38:52,652 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38123': TLS handshake failed with remote 'tls://127.0.0.1:43952': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:38:52,654 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:38:53,660 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:38:53,668 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38867 4768s 2024-11-23 21:38:53,669 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46225/status 4768s 2024-11-23 21:38:53,669 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:38:53,685 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33839 4768s 2024-11-23 21:38:53,686 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33839 4768s 2024-11-23 21:38:53,686 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:38:53,686 - distributed.worker - INFO - dashboard at: 127.0.0.1:33195 4768s 2024-11-23 21:38:53,686 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38867 4768s 2024-11-23 21:38:53,686 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:38:53,686 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:38:53,686 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:38:53,686 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-t4t_k2ka 4768s 2024-11-23 21:38:53,686 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:38:53,688 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39063 4768s 2024-11-23 21:38:53,689 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39063 4768s 2024-11-23 21:38:53,689 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:38:53,689 - distributed.worker - INFO - dashboard at: 127.0.0.1:45517 4768s 2024-11-23 21:38:53,689 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38867 4768s 2024-11-23 21:38:53,689 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:38:53,690 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:38:53,690 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:38:53,690 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-g88j4vea 4768s 2024-11-23 21:38:53,690 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:38:53,692 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33839. Reason: failure-to-start- 4768s 2024-11-23 21:38:53,692 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:38:53,692 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39063. Reason: failure-to-start- 4768s 2024-11-23 21:38:53,693 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:38:53,694 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38867': TLS handshake failed with remote 'tls://127.0.0.1:52660': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:38:53,694 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38867': TLS handshake failed with remote 'tls://127.0.0.1:52668': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:38:53,696 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:38:54,702 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:38:54,710 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33391 4768s 2024-11-23 21:38:54,710 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34469/status 4768s 2024-11-23 21:38:54,710 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:38:54,726 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41883 4768s 2024-11-23 21:38:54,726 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41883 4768s 2024-11-23 21:38:54,726 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:38:54,726 - distributed.worker - INFO - dashboard at: 127.0.0.1:36381 4768s 2024-11-23 21:38:54,726 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33391 4768s 2024-11-23 21:38:54,726 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:38:54,726 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:38:54,726 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:38:54,726 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-02pglklt 4768s 2024-11-23 21:38:54,726 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:38:54,728 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40623 4768s 2024-11-23 21:38:54,729 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40623 4768s 2024-11-23 21:38:54,729 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:38:54,729 - distributed.worker - INFO - dashboard at: 127.0.0.1:40307 4768s 2024-11-23 21:38:54,729 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33391 4768s 2024-11-23 21:38:54,729 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:38:54,729 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:38:54,729 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:38:54,729 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-85ol8kui 4768s 2024-11-23 21:38:54,729 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:38:54,730 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41883. Reason: failure-to-start- 4768s 2024-11-23 21:38:54,730 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:38:54,731 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40623. Reason: failure-to-start- 4768s 2024-11-23 21:38:54,731 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:38:54,732 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33391': TLS handshake failed with remote 'tls://127.0.0.1:45180': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:38:54,733 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33391': TLS handshake failed with remote 'tls://127.0.0.1:45190': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:38:54,734 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:38:55,741 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:38:55,751 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36849 4768s 2024-11-23 21:38:55,752 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46487/status 4768s 2024-11-23 21:38:55,752 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:38:55,769 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38453 4768s 2024-11-23 21:38:55,769 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38453 4768s 2024-11-23 21:38:55,769 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:38:55,769 - distributed.worker - INFO - dashboard at: 127.0.0.1:42981 4768s 2024-11-23 21:38:55,770 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36849 4768s 2024-11-23 21:38:55,770 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:38:55,770 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:38:55,770 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:38:55,770 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-u82aqnmn 4768s 2024-11-23 21:38:55,770 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:38:55,772 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38717 4768s 2024-11-23 21:38:55,773 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38717 4768s 2024-11-23 21:38:55,773 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:38:55,773 - distributed.worker - INFO - dashboard at: 127.0.0.1:33367 4768s 2024-11-23 21:38:55,773 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36849 4768s 2024-11-23 21:38:55,773 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:38:55,773 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:38:55,773 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:38:55,773 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-6lp9dqm2 4768s 2024-11-23 21:38:55,773 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:38:55,774 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38453. Reason: failure-to-start- 4768s 2024-11-23 21:38:55,774 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:38:55,775 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38717. Reason: failure-to-start- 4768s 2024-11-23 21:38:55,775 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:38:55,777 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36849': TLS handshake failed with remote 'tls://127.0.0.1:55442': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:38:55,777 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36849': TLS handshake failed with remote 'tls://127.0.0.1:55450': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:38:55,778 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:38:56,785 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:38:56,793 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33141 4768s 2024-11-23 21:38:56,793 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33895/status 4768s 2024-11-23 21:38:56,794 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:38:56,813 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37285 4768s 2024-11-23 21:38:56,813 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37285 4768s 2024-11-23 21:38:56,813 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:38:56,813 - distributed.worker - INFO - dashboard at: 127.0.0.1:43645 4768s 2024-11-23 21:38:56,813 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33141 4768s 2024-11-23 21:38:56,813 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:38:56,813 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:38:56,813 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:38:56,813 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-pa4fl0tg 4768s 2024-11-23 21:38:56,813 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:38:56,816 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38963 4768s 2024-11-23 21:38:56,816 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38963 4768s 2024-11-23 21:38:56,816 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:38:56,816 - distributed.worker - INFO - dashboard at: 127.0.0.1:41989 4768s 2024-11-23 21:38:56,816 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33141 4768s 2024-11-23 21:38:56,816 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:38:56,816 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:38:56,816 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:38:56,816 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-yffjz1f9 4768s 2024-11-23 21:38:56,817 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:38:56,818 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37285. Reason: failure-to-start- 4768s 2024-11-23 21:38:56,818 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:38:56,819 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38963. Reason: failure-to-start- 4768s 2024-11-23 21:38:56,819 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:38:56,820 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33141': TLS handshake failed with remote 'tls://127.0.0.1:42714': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:38:56,820 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33141': TLS handshake failed with remote 'tls://127.0.0.1:42722': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:38:56,822 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:38:57,828 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:38:57,836 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40605 4768s 2024-11-23 21:38:57,836 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44591/status 4768s 2024-11-23 21:38:57,837 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:38:57,853 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42569 4768s 2024-11-23 21:38:57,853 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42569 4768s 2024-11-23 21:38:57,853 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:38:57,853 - distributed.worker - INFO - dashboard at: 127.0.0.1:40349 4768s 2024-11-23 21:38:57,853 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40605 4768s 2024-11-23 21:38:57,853 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:38:57,853 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:38:57,853 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:38:57,853 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-wai9n0y3 4768s 2024-11-23 21:38:57,853 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:38:57,857 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46337 4768s 2024-11-23 21:38:57,857 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46337 4768s 2024-11-23 21:38:57,857 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:38:57,857 - distributed.worker - INFO - dashboard at: 127.0.0.1:41631 4768s 2024-11-23 21:38:57,857 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40605 4768s 2024-11-23 21:38:57,857 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:38:57,857 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:38:57,857 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:38:57,857 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-zthq5s_e 4768s 2024-11-23 21:38:57,857 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:38:57,858 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42569. Reason: failure-to-start- 4768s 2024-11-23 21:38:57,859 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:38:57,859 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46337. Reason: failure-to-start- 4768s 2024-11-23 21:38:57,859 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:38:57,861 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40605': TLS handshake failed with remote 'tls://127.0.0.1:45454': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:38:57,861 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40605': TLS handshake failed with remote 'tls://127.0.0.1:45460': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:38:57,863 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:38:58,868 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:38:58,876 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44705 4768s 2024-11-23 21:38:58,877 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44473/status 4768s 2024-11-23 21:38:58,877 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:38:58,892 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46159 4768s 2024-11-23 21:38:58,893 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46159 4768s 2024-11-23 21:38:58,893 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:38:58,893 - distributed.worker - INFO - dashboard at: 127.0.0.1:41439 4768s 2024-11-23 21:38:58,893 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44705 4768s 2024-11-23 21:38:58,893 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:38:58,893 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:38:58,893 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:38:58,893 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-zusk_102 4768s 2024-11-23 21:38:58,893 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:38:58,895 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36921 4768s 2024-11-23 21:38:58,896 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36921 4768s 2024-11-23 21:38:58,896 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:38:58,896 - distributed.worker - INFO - dashboard at: 127.0.0.1:35749 4768s 2024-11-23 21:38:58,896 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44705 4768s 2024-11-23 21:38:58,896 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:38:58,896 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:38:58,896 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:38:58,896 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-7iu8myeu 4768s 2024-11-23 21:38:58,896 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:38:58,897 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46159. Reason: failure-to-start- 4768s 2024-11-23 21:38:58,897 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:38:58,898 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36921. Reason: failure-to-start- 4768s 2024-11-23 21:38:58,898 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:38:58,900 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44705': TLS handshake failed with remote 'tls://127.0.0.1:36446': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:38:58,900 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44705': TLS handshake failed with remote 'tls://127.0.0.1:36454': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:38:58,901 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:38:59,907 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:38:59,916 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37437 4768s 2024-11-23 21:38:59,917 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35975/status 4768s 2024-11-23 21:38:59,917 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:38:59,933 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36979 4768s 2024-11-23 21:38:59,934 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36979 4768s 2024-11-23 21:38:59,934 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:38:59,934 - distributed.worker - INFO - dashboard at: 127.0.0.1:44147 4768s 2024-11-23 21:38:59,934 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37437 4768s 2024-11-23 21:38:59,934 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:38:59,934 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:38:59,934 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:38:59,934 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-d7nfbtzj 4768s 2024-11-23 21:38:59,934 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:38:59,936 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33707 4768s 2024-11-23 21:38:59,936 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33707 4768s 2024-11-23 21:38:59,937 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:38:59,937 - distributed.worker - INFO - dashboard at: 127.0.0.1:43585 4768s 2024-11-23 21:38:59,937 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37437 4768s 2024-11-23 21:38:59,937 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:38:59,937 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:38:59,937 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:38:59,937 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-1a3sf2nc 4768s 2024-11-23 21:38:59,937 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:38:59,941 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36979. Reason: failure-to-start- 4768s 2024-11-23 21:38:59,941 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:38:59,941 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33707. Reason: failure-to-start- 4768s 2024-11-23 21:38:59,941 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:38:59,943 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37437': TLS handshake failed with remote 'tls://127.0.0.1:37142': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:38:59,943 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37437': TLS handshake failed with remote 'tls://127.0.0.1:37148': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:38:59,944 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:39:00,951 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:39:00,959 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37173 4768s 2024-11-23 21:39:00,959 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43435/status 4768s 2024-11-23 21:39:00,959 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:39:00,977 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44809 4768s 2024-11-23 21:39:00,977 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44809 4768s 2024-11-23 21:39:00,977 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:39:00,977 - distributed.worker - INFO - dashboard at: 127.0.0.1:38213 4768s 2024-11-23 21:39:00,977 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37173 4768s 2024-11-23 21:39:00,977 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:39:00,977 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:39:00,977 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:39:00,977 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-t3ashrkw 4768s 2024-11-23 21:39:00,977 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:39:00,980 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35285 4768s 2024-11-23 21:39:00,980 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35285 4768s 2024-11-23 21:39:00,980 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:39:00,980 - distributed.worker - INFO - dashboard at: 127.0.0.1:38589 4768s 2024-11-23 21:39:00,980 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37173 4768s 2024-11-23 21:39:00,980 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:39:00,980 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:39:00,980 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:39:00,980 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-_n8wxntn 4768s 2024-11-23 21:39:00,980 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:39:00,984 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44809. Reason: failure-to-start- 4768s 2024-11-23 21:39:00,985 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:39:00,985 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35285. Reason: failure-to-start- 4768s 2024-11-23 21:39:00,985 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:39:00,987 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37173': TLS handshake failed with remote 'tls://127.0.0.1:57534': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:39:00,987 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37173': TLS handshake failed with remote 'tls://127.0.0.1:57548': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:39:00,989 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:39:01,995 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:39:02,003 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38711 4768s 2024-11-23 21:39:02,003 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34729/status 4768s 2024-11-23 21:39:02,004 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:39:02,022 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43127 4768s 2024-11-23 21:39:02,022 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43127 4768s 2024-11-23 21:39:02,022 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:39:02,022 - distributed.worker - INFO - dashboard at: 127.0.0.1:41311 4768s 2024-11-23 21:39:02,022 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38711 4768s 2024-11-23 21:39:02,022 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:39:02,022 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:39:02,022 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:39:02,022 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-mpuvarid 4768s 2024-11-23 21:39:02,022 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:39:02,026 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:32963 4768s 2024-11-23 21:39:02,026 - distributed.worker - INFO - Listening to: tls://127.0.0.1:32963 4768s 2024-11-23 21:39:02,026 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:39:02,026 - distributed.worker - INFO - dashboard at: 127.0.0.1:38209 4768s 2024-11-23 21:39:02,026 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38711 4768s 2024-11-23 21:39:02,026 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:39:02,026 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:39:02,026 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:39:02,027 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-o5fn1nqq 4768s 2024-11-23 21:39:02,027 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:39:02,028 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43127. Reason: failure-to-start- 4768s 2024-11-23 21:39:02,028 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:39:02,029 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:32963. Reason: failure-to-start- 4768s 2024-11-23 21:39:02,029 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:39:02,030 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38711': TLS handshake failed with remote 'tls://127.0.0.1:60736': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:39:02,031 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38711': TLS handshake failed with remote 'tls://127.0.0.1:60750': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:39:02,032 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:39:03,038 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:39:03,046 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45039 4768s 2024-11-23 21:39:03,046 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39859/status 4768s 2024-11-23 21:39:03,046 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:39:03,064 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39855 4768s 2024-11-23 21:39:03,065 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39855 4768s 2024-11-23 21:39:03,065 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:39:03,065 - distributed.worker - INFO - dashboard at: 127.0.0.1:37685 4768s 2024-11-23 21:39:03,065 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45039 4768s 2024-11-23 21:39:03,065 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:39:03,065 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:39:03,065 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:39:03,065 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-v6rcyyd3 4768s 2024-11-23 21:39:03,065 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:39:03,067 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37061 4768s 2024-11-23 21:39:03,067 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37061 4768s 2024-11-23 21:39:03,067 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:39:03,067 - distributed.worker - INFO - dashboard at: 127.0.0.1:34263 4768s 2024-11-23 21:39:03,068 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45039 4768s 2024-11-23 21:39:03,068 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:39:03,068 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:39:03,068 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:39:03,068 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-40lgwkn7 4768s 2024-11-23 21:39:03,068 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:39:03,069 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39855. Reason: failure-to-start- 4768s 2024-11-23 21:39:03,069 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:39:03,070 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37061. Reason: failure-to-start- 4768s 2024-11-23 21:39:03,070 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:39:03,071 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45039': TLS handshake failed with remote 'tls://127.0.0.1:57626': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:39:03,071 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45039': TLS handshake failed with remote 'tls://127.0.0.1:57628': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:39:03,073 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:39:04,079 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:39:04,087 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43921 4768s 2024-11-23 21:39:04,087 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40551/status 4768s 2024-11-23 21:39:04,088 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:39:04,104 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46241 4768s 2024-11-23 21:39:04,105 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46241 4768s 2024-11-23 21:39:04,105 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:39:04,105 - distributed.worker - INFO - dashboard at: 127.0.0.1:38277 4768s 2024-11-23 21:39:04,105 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43921 4768s 2024-11-23 21:39:04,105 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:39:04,105 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:39:04,105 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:39:04,105 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-svnhf5v_ 4768s 2024-11-23 21:39:04,105 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:39:04,107 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42443 4768s 2024-11-23 21:39:04,107 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42443 4768s 2024-11-23 21:39:04,107 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:39:04,107 - distributed.worker - INFO - dashboard at: 127.0.0.1:44937 4768s 2024-11-23 21:39:04,108 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43921 4768s 2024-11-23 21:39:04,108 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:39:04,108 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:39:04,108 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:39:04,108 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-abp4mm9m 4768s 2024-11-23 21:39:04,108 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:39:04,109 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46241. Reason: failure-to-start- 4768s 2024-11-23 21:39:04,109 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:39:04,110 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42443. Reason: failure-to-start- 4768s 2024-11-23 21:39:04,110 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:39:04,111 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43921': TLS handshake failed with remote 'tls://127.0.0.1:34098': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:39:04,111 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43921': TLS handshake failed with remote 'tls://127.0.0.1:34104': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:39:04,113 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:39:05,119 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:39:05,129 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36945 4768s 2024-11-23 21:39:05,130 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43567/status 4768s 2024-11-23 21:39:05,130 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:39:05,149 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41007 4768s 2024-11-23 21:39:05,150 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41007 4768s 2024-11-23 21:39:05,150 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:39:05,150 - distributed.worker - INFO - dashboard at: 127.0.0.1:34613 4768s 2024-11-23 21:39:05,150 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36945 4768s 2024-11-23 21:39:05,150 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:39:05,150 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:39:05,150 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:39:05,150 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-o1fu3yem 4768s 2024-11-23 21:39:05,150 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:39:05,152 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35737 4768s 2024-11-23 21:39:05,153 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35737 4768s 2024-11-23 21:39:05,153 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:39:05,153 - distributed.worker - INFO - dashboard at: 127.0.0.1:42513 4768s 2024-11-23 21:39:05,153 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36945 4768s 2024-11-23 21:39:05,153 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:39:05,153 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:39:05,153 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:39:05,153 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-eppnn6_l 4768s 2024-11-23 21:39:05,153 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:39:05,155 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41007. Reason: failure-to-start- 4768s 2024-11-23 21:39:05,155 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:39:05,155 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35737. Reason: failure-to-start- 4768s 2024-11-23 21:39:05,155 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:39:05,157 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36945': TLS handshake failed with remote 'tls://127.0.0.1:52284': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:39:05,157 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36945': TLS handshake failed with remote 'tls://127.0.0.1:52298': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:39:05,158 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:39:06,165 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:39:06,172 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39593 4768s 2024-11-23 21:39:06,173 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44419/status 4768s 2024-11-23 21:39:06,173 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:39:06,193 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44303 4768s 2024-11-23 21:39:06,193 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44303 4768s 2024-11-23 21:39:06,193 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:39:06,193 - distributed.worker - INFO - dashboard at: 127.0.0.1:36923 4768s 2024-11-23 21:39:06,193 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39593 4768s 2024-11-23 21:39:06,193 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:39:06,193 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:39:06,193 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:39:06,193 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-i27be449 4768s 2024-11-23 21:39:06,193 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:39:06,195 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36691 4768s 2024-11-23 21:39:06,196 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36691 4768s 2024-11-23 21:39:06,196 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:39:06,196 - distributed.worker - INFO - dashboard at: 127.0.0.1:34491 4768s 2024-11-23 21:39:06,196 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39593 4768s 2024-11-23 21:39:06,196 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:39:06,196 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:39:06,196 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:39:06,196 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-nwyb_yxs 4768s 2024-11-23 21:39:06,196 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:39:06,198 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44303. Reason: failure-to-start- 4768s 2024-11-23 21:39:06,198 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:39:06,198 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36691. Reason: failure-to-start- 4768s 2024-11-23 21:39:06,198 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:39:06,200 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39593': TLS handshake failed with remote 'tls://127.0.0.1:60242': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:39:06,200 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39593': TLS handshake failed with remote 'tls://127.0.0.1:60250': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:39:06,201 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:39:07,207 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:39:07,214 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37879 4768s 2024-11-23 21:39:07,214 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38851/status 4768s 2024-11-23 21:39:07,215 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:39:07,245 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46065 4768s 2024-11-23 21:39:07,245 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46065 4768s 2024-11-23 21:39:07,245 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:39:07,245 - distributed.worker - INFO - dashboard at: 127.0.0.1:45909 4768s 2024-11-23 21:39:07,245 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37879 4768s 2024-11-23 21:39:07,246 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:39:07,246 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:39:07,246 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:39:07,246 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-bb26r3hd 4768s 2024-11-23 21:39:07,246 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:39:07,248 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40029 4768s 2024-11-23 21:39:07,248 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40029 4768s 2024-11-23 21:39:07,248 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:39:07,248 - distributed.worker - INFO - dashboard at: 127.0.0.1:39733 4768s 2024-11-23 21:39:07,248 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37879 4768s 2024-11-23 21:39:07,248 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:39:07,248 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:39:07,248 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:39:07,248 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-fws_i_ys 4768s 2024-11-23 21:39:07,248 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:39:07,250 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46065. Reason: failure-to-start- 4768s 2024-11-23 21:39:07,250 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:39:07,250 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40029. Reason: failure-to-start- 4768s 2024-11-23 21:39:07,250 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:39:07,252 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37879': TLS handshake failed with remote 'tls://127.0.0.1:38548': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:39:07,252 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37879': TLS handshake failed with remote 'tls://127.0.0.1:38564': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:39:07,256 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:39:08,262 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:39:08,269 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46239 4768s 2024-11-23 21:39:08,269 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38339/status 4768s 2024-11-23 21:39:08,270 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:39:08,286 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43953 4768s 2024-11-23 21:39:08,286 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43953 4768s 2024-11-23 21:39:08,286 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:39:08,286 - distributed.worker - INFO - dashboard at: 127.0.0.1:36827 4768s 2024-11-23 21:39:08,286 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46239 4768s 2024-11-23 21:39:08,286 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:39:08,286 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:39:08,287 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:39:08,287 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-09ef0phx 4768s 2024-11-23 21:39:08,287 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:39:08,289 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45447 4768s 2024-11-23 21:39:08,289 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45447 4768s 2024-11-23 21:39:08,289 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:39:08,289 - distributed.worker - INFO - dashboard at: 127.0.0.1:35595 4768s 2024-11-23 21:39:08,289 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46239 4768s 2024-11-23 21:39:08,289 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:39:08,289 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:39:08,289 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:39:08,289 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-fw0rbrjg 4768s 2024-11-23 21:39:08,289 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:39:08,291 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43953. Reason: failure-to-start- 4768s 2024-11-23 21:39:08,291 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:39:08,291 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45447. Reason: failure-to-start- 4768s 2024-11-23 21:39:08,292 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:39:08,293 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46239': TLS handshake failed with remote 'tls://127.0.0.1:53212': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:39:08,293 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46239': TLS handshake failed with remote 'tls://127.0.0.1:53224': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:39:08,298 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:39:09,305 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:39:09,313 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39291 4768s 2024-11-23 21:39:09,313 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42013/status 4768s 2024-11-23 21:39:09,314 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:39:09,334 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39985 4768s 2024-11-23 21:39:09,334 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39985 4768s 2024-11-23 21:39:09,334 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:39:09,334 - distributed.worker - INFO - dashboard at: 127.0.0.1:36269 4768s 2024-11-23 21:39:09,334 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:39:09,334 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:39:09,334 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:39:09,334 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:39:09,334 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-buzjccsk 4768s 2024-11-23 21:39:09,334 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:39:09,336 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34651 4768s 2024-11-23 21:39:09,337 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34651 4768s 2024-11-23 21:39:09,337 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:39:09,337 - distributed.worker - INFO - dashboard at: 127.0.0.1:36283 4768s 2024-11-23 21:39:09,337 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:39:09,337 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:39:09,337 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:39:09,337 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:39:09,337 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-eqghr0bp 4768s 2024-11-23 21:39:09,337 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:39:09,339 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39985. Reason: failure-to-start- 4768s 2024-11-23 21:39:09,339 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:39:09,339 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34651. Reason: failure-to-start- 4768s 2024-11-23 21:39:09,340 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:39:09,344 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:45606': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:39:09,344 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:45614': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:39:09,346 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:39:10,352 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:39:10,360 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38433 4768s 2024-11-23 21:39:10,361 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42861/status 4768s 2024-11-23 21:39:10,361 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:39:10,380 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38321 4768s 2024-11-23 21:39:10,380 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38321 4768s 2024-11-23 21:39:10,380 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:39:10,380 - distributed.worker - INFO - dashboard at: 127.0.0.1:44989 4768s 2024-11-23 21:39:10,380 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38433 4768s 2024-11-23 21:39:10,380 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:39:10,380 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:39:10,380 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:39:10,380 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-euj2s589 4768s 2024-11-23 21:39:10,380 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:39:10,383 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37379 4768s 2024-11-23 21:39:10,383 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37379 4768s 2024-11-23 21:39:10,383 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:39:10,383 - distributed.worker - INFO - dashboard at: 127.0.0.1:42657 4768s 2024-11-23 21:39:10,383 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38433 4768s 2024-11-23 21:39:10,383 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:39:10,383 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:39:10,383 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:39:10,383 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-igl9vw8x 4768s 2024-11-23 21:39:10,383 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:39:10,387 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38321. Reason: failure-to-start- 4768s 2024-11-23 21:39:10,388 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:39:10,388 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37379. Reason: failure-to-start- 4768s 2024-11-23 21:39:10,388 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:39:10,390 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38433': TLS handshake failed with remote 'tls://127.0.0.1:55392': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:39:10,390 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38433': TLS handshake failed with remote 'tls://127.0.0.1:55406': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:39:10,392 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:39:11,398 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:39:11,405 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45395 4768s 2024-11-23 21:39:11,406 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43081/status 4768s 2024-11-23 21:39:11,406 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:39:11,421 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41367 4768s 2024-11-23 21:39:11,422 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41367 4768s 2024-11-23 21:39:11,422 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:39:11,422 - distributed.worker - INFO - dashboard at: 127.0.0.1:34095 4768s 2024-11-23 21:39:11,422 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 4768s 2024-11-23 21:39:11,422 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:39:11,422 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:39:11,422 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:39:11,422 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-c71866nr 4768s 2024-11-23 21:39:11,422 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:39:11,426 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34111 4768s 2024-11-23 21:39:11,426 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34111 4768s 2024-11-23 21:39:11,426 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:39:11,426 - distributed.worker - INFO - dashboard at: 127.0.0.1:36839 4768s 2024-11-23 21:39:11,426 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 4768s 2024-11-23 21:39:11,426 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:39:11,426 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:39:11,426 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:39:11,426 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-x9qfq4rw 4768s 2024-11-23 21:39:11,426 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:39:11,431 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41367. Reason: failure-to-start- 4768s 2024-11-23 21:39:11,431 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:39:11,431 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34111. Reason: failure-to-start- 4768s 2024-11-23 21:39:11,432 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:39:11,436 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:50726': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:39:11,436 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:50736': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:39:11,438 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:39:12,444 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:39:12,451 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34197 4768s 2024-11-23 21:39:12,451 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42011/status 4768s 2024-11-23 21:39:12,451 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:39:12,466 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41637 4768s 2024-11-23 21:39:12,466 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41637 4768s 2024-11-23 21:39:12,466 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:39:12,466 - distributed.worker - INFO - dashboard at: 127.0.0.1:37511 4768s 2024-11-23 21:39:12,466 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34197 4768s 2024-11-23 21:39:12,466 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:39:12,466 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:39:12,467 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:39:12,467 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ydstf2va 4768s 2024-11-23 21:39:12,467 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:39:12,469 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33721 4768s 2024-11-23 21:39:12,469 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33721 4768s 2024-11-23 21:39:12,469 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:39:12,469 - distributed.worker - INFO - dashboard at: 127.0.0.1:41727 4768s 2024-11-23 21:39:12,469 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34197 4768s 2024-11-23 21:39:12,469 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:39:12,469 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:39:12,469 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:39:12,469 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-g7iof596 4768s 2024-11-23 21:39:12,469 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:39:12,476 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41637. Reason: failure-to-start- 4768s 2024-11-23 21:39:12,476 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:39:12,477 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33721. Reason: failure-to-start- 4768s 2024-11-23 21:39:12,477 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:39:12,479 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34197': TLS handshake failed with remote 'tls://127.0.0.1:40612': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:39:12,479 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34197': TLS handshake failed with remote 'tls://127.0.0.1:40614': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:39:12,481 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:39:13,486 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:39:13,494 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45181 4768s 2024-11-23 21:39:13,494 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40375/status 4768s 2024-11-23 21:39:13,494 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:39:13,509 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46739 4768s 2024-11-23 21:39:13,510 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46739 4768s 2024-11-23 21:39:13,510 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:39:13,510 - distributed.worker - INFO - dashboard at: 127.0.0.1:45203 4768s 2024-11-23 21:39:13,510 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45181 4768s 2024-11-23 21:39:13,510 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:39:13,510 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:39:13,510 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:39:13,510 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-u_xgo92s 4768s 2024-11-23 21:39:13,510 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:39:13,512 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44359 4768s 2024-11-23 21:39:13,512 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44359 4768s 2024-11-23 21:39:13,512 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:39:13,512 - distributed.worker - INFO - dashboard at: 127.0.0.1:38655 4768s 2024-11-23 21:39:13,512 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45181 4768s 2024-11-23 21:39:13,513 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:39:13,513 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:39:13,513 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:39:13,513 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-viaumzwg 4768s 2024-11-23 21:39:13,513 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:39:13,519 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46739. Reason: failure-to-start- 4768s 2024-11-23 21:39:13,519 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:39:13,520 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44359. Reason: failure-to-start- 4768s 2024-11-23 21:39:13,520 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:39:13,522 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45181': TLS handshake failed with remote 'tls://127.0.0.1:41342': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:39:13,522 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45181': TLS handshake failed with remote 'tls://127.0.0.1:41350': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:39:13,524 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:39:14,530 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:39:14,539 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:32951 4768s 2024-11-23 21:39:14,539 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43981/status 4768s 2024-11-23 21:39:14,539 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:39:14,555 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43903 4768s 2024-11-23 21:39:14,555 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43903 4768s 2024-11-23 21:39:14,555 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:39:14,555 - distributed.worker - INFO - dashboard at: 127.0.0.1:36867 4768s 2024-11-23 21:39:14,555 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:32951 4768s 2024-11-23 21:39:14,555 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:39:14,555 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:39:14,555 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:39:14,555 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-6ebbh3cf 4768s 2024-11-23 21:39:14,555 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:39:14,557 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37621 4768s 2024-11-23 21:39:14,558 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37621 4768s 2024-11-23 21:39:14,558 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:39:14,558 - distributed.worker - INFO - dashboard at: 127.0.0.1:39831 4768s 2024-11-23 21:39:14,558 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:32951 4768s 2024-11-23 21:39:14,558 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:39:14,558 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:39:14,558 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:39:14,558 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-6mz3qx2k 4768s 2024-11-23 21:39:14,558 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:39:14,564 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43903. Reason: failure-to-start- 4768s 2024-11-23 21:39:14,564 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:39:14,565 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37621. Reason: failure-to-start- 4768s 2024-11-23 21:39:14,565 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:39:14,566 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:32951': TLS handshake failed with remote 'tls://127.0.0.1:47256': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:39:14,566 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:32951': TLS handshake failed with remote 'tls://127.0.0.1:47258': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:39:14,568 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:39:15,574 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:39:15,582 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42501 4768s 2024-11-23 21:39:15,582 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41565/status 4768s 2024-11-23 21:39:15,582 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:39:15,600 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41417 4768s 2024-11-23 21:39:15,600 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41417 4768s 2024-11-23 21:39:15,600 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:39:15,600 - distributed.worker - INFO - dashboard at: 127.0.0.1:43431 4768s 2024-11-23 21:39:15,600 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42501 4768s 2024-11-23 21:39:15,600 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:39:15,600 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:39:15,600 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:39:15,600 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-zava30gi 4768s 2024-11-23 21:39:15,600 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:39:15,602 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34943 4768s 2024-11-23 21:39:15,603 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34943 4768s 2024-11-23 21:39:15,603 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:39:15,603 - distributed.worker - INFO - dashboard at: 127.0.0.1:42173 4768s 2024-11-23 21:39:15,603 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42501 4768s 2024-11-23 21:39:15,603 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:39:15,603 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:39:15,603 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:39:15,603 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-2q01lq67 4768s 2024-11-23 21:39:15,603 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:39:15,610 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41417. Reason: failure-to-start- 4768s 2024-11-23 21:39:15,610 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:39:15,610 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34943. Reason: failure-to-start- 4768s 2024-11-23 21:39:15,610 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:39:15,612 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42501': TLS handshake failed with remote 'tls://127.0.0.1:36760': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:39:15,612 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42501': TLS handshake failed with remote 'tls://127.0.0.1:36774': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:39:15,614 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:39:16,619 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:39:16,628 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:32905 4768s 2024-11-23 21:39:16,628 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42927/status 4768s 2024-11-23 21:39:16,628 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:39:16,648 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40249 4768s 2024-11-23 21:39:16,648 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40249 4768s 2024-11-23 21:39:16,648 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:39:16,649 - distributed.worker - INFO - dashboard at: 127.0.0.1:33067 4768s 2024-11-23 21:39:16,649 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:32905 4768s 2024-11-23 21:39:16,649 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:39:16,649 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:39:16,649 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:39:16,649 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-xckln_l5 4768s 2024-11-23 21:39:16,649 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:39:16,653 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42453 4768s 2024-11-23 21:39:16,653 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42453 4768s 2024-11-23 21:39:16,653 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:39:16,653 - distributed.worker - INFO - dashboard at: 127.0.0.1:40961 4768s 2024-11-23 21:39:16,653 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:32905 4768s 2024-11-23 21:39:16,653 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:39:16,653 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:39:16,653 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:39:16,653 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-l85nq5i9 4768s 2024-11-23 21:39:16,653 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:39:16,658 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40249. Reason: failure-to-start- 4768s 2024-11-23 21:39:16,658 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:39:16,659 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42453. Reason: failure-to-start- 4768s 2024-11-23 21:39:16,659 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:39:16,660 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:32905': TLS handshake failed with remote 'tls://127.0.0.1:57266': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:39:16,661 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:32905': TLS handshake failed with remote 'tls://127.0.0.1:57272': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:39:16,663 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:39:17,669 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:39:17,677 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37923 4768s 2024-11-23 21:39:17,677 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42207/status 4768s 2024-11-23 21:39:17,678 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:39:17,698 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37057 4768s 2024-11-23 21:39:17,698 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37057 4768s 2024-11-23 21:39:17,698 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:39:17,698 - distributed.worker - INFO - dashboard at: 127.0.0.1:39359 4768s 2024-11-23 21:39:17,698 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37923 4768s 2024-11-23 21:39:17,698 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:39:17,698 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:39:17,698 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:39:17,698 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-c0nxcocc 4768s 2024-11-23 21:39:17,698 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:39:17,701 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38167 4768s 2024-11-23 21:39:17,701 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38167 4768s 2024-11-23 21:39:17,701 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:39:17,701 - distributed.worker - INFO - dashboard at: 127.0.0.1:41191 4768s 2024-11-23 21:39:17,701 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37923 4768s 2024-11-23 21:39:17,701 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:39:17,701 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:39:17,701 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:39:17,701 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-5t8eadsj 4768s 2024-11-23 21:39:17,701 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:39:17,703 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37057. Reason: failure-to-start- 4768s 2024-11-23 21:39:17,703 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:39:17,703 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38167. Reason: failure-to-start- 4768s 2024-11-23 21:39:17,703 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:39:17,705 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37923': TLS handshake failed with remote 'tls://127.0.0.1:59602': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:39:17,705 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37923': TLS handshake failed with remote 'tls://127.0.0.1:59606': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:39:17,707 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:39:18,715 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:39:18,723 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37041 4768s 2024-11-23 21:39:18,723 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33009/status 4768s 2024-11-23 21:39:18,724 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:39:18,746 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42881 4768s 2024-11-23 21:39:18,746 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42881 4768s 2024-11-23 21:39:18,746 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:39:18,746 - distributed.worker - INFO - dashboard at: 127.0.0.1:32979 4768s 2024-11-23 21:39:18,746 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37041 4768s 2024-11-23 21:39:18,746 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:39:18,746 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:39:18,746 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:39:18,746 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-t6ky7d_w 4768s 2024-11-23 21:39:18,746 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:39:18,749 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40801 4768s 2024-11-23 21:39:18,749 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40801 4768s 2024-11-23 21:39:18,749 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:39:18,749 - distributed.worker - INFO - dashboard at: 127.0.0.1:46661 4768s 2024-11-23 21:39:18,749 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37041 4768s 2024-11-23 21:39:18,749 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:39:18,749 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:39:18,749 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:39:18,749 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-aby7m595 4768s 2024-11-23 21:39:18,749 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:39:18,751 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42881. Reason: failure-to-start- 4768s 2024-11-23 21:39:18,751 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:39:18,752 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40801. Reason: failure-to-start- 4768s 2024-11-23 21:39:18,752 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:39:18,754 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37041': TLS handshake failed with remote 'tls://127.0.0.1:58180': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:39:18,754 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37041': TLS handshake failed with remote 'tls://127.0.0.1:58192': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:39:18,759 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s ______________________________ test_client_submit ______________________________ 4768s 4768s fut = , timeout = 0 4768s 4768s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 4768s async with asyncio.timeout(timeout): 4768s > return await fut 4768s 4768s /usr/lib/python3/dist-packages/distributed/utils.py:1960: 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s /usr/lib/python3/dist-packages/distributed/worker.py:1480: in start_unsafe 4768s await self._register_with_scheduler() 4768s /usr/lib/python3/dist-packages/distributed/worker.py:1179: in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s /usr/lib/python3/dist-packages/distributed/comm/core.py:342: in connect 4768s comm = await wait_for( 4768s /usr/lib/python3/dist-packages/distributed/utils.py:1960: in wait_for 4768s return await fut 4768s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:546: in connect 4768s stream = await self.client.connect( 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s 4768s self = , host = '127.0.0.1' 4768s port = 42289, af = 4768s ssl_options = 4768s max_buffer_size = 8364507136.0, source_ip = None, source_port = None 4768s timeout = None 4768s 4768s async def connect( 4768s self, 4768s host: str, 4768s port: int, 4768s af: socket.AddressFamily = socket.AF_UNSPEC, 4768s ssl_options: Optional[Union[Dict[str, Any], ssl.SSLContext]] = None, 4768s max_buffer_size: Optional[int] = None, 4768s source_ip: Optional[str] = None, 4768s source_port: Optional[int] = None, 4768s timeout: Optional[Union[float, datetime.timedelta]] = None, 4768s ) -> IOStream: 4768s """Connect to the given host and port. 4768s 4768s Asynchronously returns an `.IOStream` (or `.SSLIOStream` if 4768s ``ssl_options`` is not None). 4768s 4768s Using the ``source_ip`` kwarg, one can specify the source 4768s IP address to use when establishing the connection. 4768s In case the user needs to resolve and 4768s use a specific interface, it has to be handled outside 4768s of Tornado as this depends very much on the platform. 4768s 4768s Raises `TimeoutError` if the input future does not complete before 4768s ``timeout``, which may be specified in any form allowed by 4768s `.IOLoop.add_timeout` (i.e. a `datetime.timedelta` or an absolute time 4768s relative to `.IOLoop.time`) 4768s 4768s Similarly, when the user requires a certain source port, it can 4768s be specified using the ``source_port`` arg. 4768s 4768s .. versionchanged:: 4.5 4768s Added the ``source_ip`` and ``source_port`` arguments. 4768s 4768s .. versionchanged:: 5.0 4768s Added the ``timeout`` argument. 4768s """ 4768s if timeout is not None: 4768s if isinstance(timeout, numbers.Real): 4768s timeout = IOLoop.current().time() + timeout 4768s elif isinstance(timeout, datetime.timedelta): 4768s timeout = IOLoop.current().time() + timeout.total_seconds() 4768s else: 4768s raise TypeError("Unsupported timeout %r" % timeout) 4768s if timeout is not None: 4768s addrinfo = await gen.with_timeout( 4768s timeout, self.resolver.resolve(host, port, af) 4768s ) 4768s else: 4768s addrinfo = await self.resolver.resolve(host, port, af) 4768s connector = _Connector( 4768s addrinfo, 4768s functools.partial( 4768s self._create_stream, 4768s max_buffer_size, 4768s source_ip=source_ip, 4768s source_port=source_port, 4768s ), 4768s ) 4768s > af, addr, stream = await connector.start(connect_timeout=timeout) 4768s E asyncio.exceptions.CancelledError 4768s 4768s /usr/lib/python3/dist-packages/tornado/tcpclient.py:279: CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s self = 4768s 4768s @final 4768s async def start(self): 4768s async with self._startup_lock: 4768s if self.status == Status.failed: 4768s assert self.__startup_exc is not None 4768s raise self.__startup_exc 4768s elif self.status != Status.init: 4768s return self 4768s timeout = getattr(self, "death_timeout", None) 4768s 4768s async def _close_on_failure(exc: Exception) -> None: 4768s await self.close(reason=f"failure-to-start-{str(type(exc))}") 4768s self.status = Status.failed 4768s self.__startup_exc = exc 4768s 4768s try: 4768s > await wait_for(self.start_unsafe(), timeout=timeout) 4768s 4768s /usr/lib/python3/dist-packages/distributed/core.py:664: 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 4768s async with asyncio.timeout(timeout): 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s 4768s self = 4768s exc_type = 4768s exc_val = CancelledError(), exc_tb = 4768s 4768s async def __aexit__( 4768s self, 4768s exc_type: Optional[Type[BaseException]], 4768s exc_val: Optional[BaseException], 4768s exc_tb: Optional[TracebackType], 4768s ) -> Optional[bool]: 4768s assert self._state in (_State.ENTERED, _State.EXPIRING) 4768s 4768s if self._timeout_handler is not None: 4768s self._timeout_handler.cancel() 4768s self._timeout_handler = None 4768s 4768s if self._state is _State.EXPIRING: 4768s self._state = _State.EXPIRED 4768s 4768s if self._task.uncancel() <= self._cancelling and exc_type is not None: 4768s # Since there are no new cancel requests, we're 4768s # handling this. 4768s if issubclass(exc_type, exceptions.CancelledError): 4768s > raise TimeoutError from exc_val 4768s E TimeoutError 4768s 4768s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s @contextlib.asynccontextmanager 4768s async def _cluster_factory(): 4768s workers = [] 4768s s = None 4768s try: 4768s for _ in range(60): 4768s try: 4768s > s, ws = await start_cluster( 4768s nthreads, 4768s scheduler, 4768s security=security, 4768s Worker=Worker, 4768s scheduler_kwargs=scheduler_kwargs, 4768s worker_kwargs=merge( 4768s {"death_timeout": min(15, int(deadline.remaining))}, 4768s worker_kwargs, 4768s ), 4768s ) 4768s 4768s /usr/lib/python3/dist-packages/distributed/utils_test.py:966: 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s /usr/lib/python3/dist-packages/distributed/utils_test.py:789: in start_cluster 4768s await asyncio.gather(*workers) 4768s /usr/lib/python3.13/asyncio/tasks.py:737: in _wrap_awaitable 4768s return await awaitable 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s 4768s self = 4768s 4768s @final 4768s async def start(self): 4768s async with self._startup_lock: 4768s if self.status == Status.failed: 4768s assert self.__startup_exc is not None 4768s raise self.__startup_exc 4768s elif self.status != Status.init: 4768s return self 4768s timeout = getattr(self, "death_timeout", None) 4768s 4768s async def _close_on_failure(exc: Exception) -> None: 4768s await self.close(reason=f"failure-to-start-{str(type(exc))}") 4768s self.status = Status.failed 4768s self.__startup_exc = exc 4768s 4768s try: 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s except asyncio.TimeoutError as exc: 4768s await _close_on_failure(exc) 4768s > raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s E TimeoutError: Worker start timed out after 0s. 4768s 4768s /usr/lib/python3/dist-packages/distributed/core.py:667: TimeoutError 4768s 4768s During handling of the above exception, another exception occurred: 4768s 4768s fut = ._..test_func..async_fn at 0xe99ada20> 4768s timeout = 60 4768s 4768s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 4768s async with asyncio.timeout(timeout): 4768s > return await fut 4768s 4768s /usr/lib/python3/dist-packages/distributed/utils.py:1960: 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s /usr/lib/python3/dist-packages/distributed/utils_test.py:999: in async_fn 4768s _cluster_factory() as (s, workers), 4768s /usr/lib/python3.13/contextlib.py:214: in __aenter__ 4768s return await anext(self.gen) 4768s /usr/lib/python3/dist-packages/distributed/utils_test.py:983: in _cluster_factory 4768s await asyncio.sleep(1) 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s 4768s delay = 1, result = None 4768s 4768s async def sleep(delay, result=None): 4768s """Coroutine that completes after a given time (in seconds).""" 4768s if delay <= 0: 4768s await __sleep0() 4768s return result 4768s 4768s if math.isnan(delay): 4768s raise ValueError("Invalid delay: NaN (not a number)") 4768s 4768s loop = events.get_running_loop() 4768s future = loop.create_future() 4768s h = loop.call_later(delay, 4768s futures._set_result_unless_cancelled, 4768s future, result) 4768s try: 4768s > return await future 4768s E asyncio.exceptions.CancelledError 4768s 4768s /usr/lib/python3.13/asyncio/tasks.py:718: CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s args = (), kwds = {} 4768s 4768s @wraps(func) 4768s def inner(*args, **kwds): 4768s with self._recreate_cm(): 4768s > return func(*args, **kwds) 4768s 4768s /usr/lib/python3.13/contextlib.py:85: 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s /usr/lib/python3.13/contextlib.py:85: in inner 4768s return func(*args, **kwds) 4768s /usr/lib/python3/dist-packages/distributed/utils_test.py:1102: in test_func 4768s return _run_and_close_tornado(async_fn_outer) 4768s /usr/lib/python3/dist-packages/distributed/utils_test.py:378: in _run_and_close_tornado 4768s return asyncio_run(inner_fn(), loop_factory=get_loop_factory()) 4768s /usr/lib/python3.13/asyncio/runners.py:194: in run 4768s return runner.run(main) 4768s /usr/lib/python3.13/asyncio/runners.py:118: in run 4768s return self._loop.run_until_complete(task) 4768s /usr/lib/python3.13/asyncio/base_events.py:720: in run_until_complete 4768s return future.result() 4768s /usr/lib/python3/dist-packages/distributed/utils_test.py:375: in inner_fn 4768s return await async_fn(*args, **kwargs) 4768s /usr/lib/python3/dist-packages/distributed/utils_test.py:1099: in async_fn_outer 4768s return await utils_wait_for(async_fn(), timeout=timeout * 2) 4768s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 4768s async with asyncio.timeout(timeout): 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s 4768s self = 4768s exc_type = 4768s exc_val = CancelledError(), exc_tb = 4768s 4768s async def __aexit__( 4768s self, 4768s exc_type: Optional[Type[BaseException]], 4768s exc_val: Optional[BaseException], 4768s exc_tb: Optional[TracebackType], 4768s ) -> Optional[bool]: 4768s assert self._state in (_State.ENTERED, _State.EXPIRING) 4768s 4768s if self._timeout_handler is not None: 4768s self._timeout_handler.cancel() 4768s self._timeout_handler = None 4768s 4768s if self._state is _State.EXPIRING: 4768s self._state = _State.EXPIRED 4768s 4768s if self._task.uncancel() <= self._cancelling and exc_type is not None: 4768s # Since there are no new cancel requests, we're 4768s # handling this. 4768s if issubclass(exc_type, exceptions.CancelledError): 4768s > raise TimeoutError from exc_val 4768s E TimeoutError 4768s 4768s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 4768s ----------------------------- Captured stderr call ----------------------------- 4768s 2024-11-23 21:39:19,965 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:39:19,974 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:19,975 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:32921/status 4768s 2024-11-23 21:39:19,975 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:39:19,992 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41277 4768s 2024-11-23 21:39:19,992 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41277 4768s 2024-11-23 21:39:19,992 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:39:19,992 - distributed.worker - INFO - dashboard at: 127.0.0.1:40815 4768s 2024-11-23 21:39:19,992 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:19,992 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:39:19,992 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:39:19,992 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:39:19,992 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-n47okd85 4768s 2024-11-23 21:39:19,992 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:39:19,995 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44181 4768s 2024-11-23 21:39:19,995 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44181 4768s 2024-11-23 21:39:19,995 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:39:19,995 - distributed.worker - INFO - dashboard at: 127.0.0.1:46555 4768s 2024-11-23 21:39:19,995 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:19,995 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:39:19,995 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:39:19,995 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:39:19,995 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-sjigh4te 4768s 2024-11-23 21:39:19,995 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:39:20,009 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:20,009 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:20,009 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:41346': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:20,010 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:41360': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:20,122 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:20,122 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:20,123 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:41372': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:20,123 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:41388': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:20,235 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:20,236 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:20,237 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:41398': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:20,238 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:41402': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:20,349 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:20,349 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:20,350 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:41406': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:20,350 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:41416': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:20,463 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:20,464 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:20,464 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:41432': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:20,464 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:41434': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:20,578 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:20,578 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:20,578 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:41450': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:20,579 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:41466': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:20,691 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:20,691 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:20,692 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:41480': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:20,692 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:41496': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:20,805 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:20,805 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:20,806 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:41502': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:20,806 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:41506': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:20,918 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:20,919 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:20,919 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:41522': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:20,919 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:41530': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:21,033 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:21,033 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:21,033 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:41534': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:21,033 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:41540': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:21,146 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:21,147 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:21,147 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:41554': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:21,147 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:41560': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:21,260 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:21,260 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:21,261 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:41570': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:21,261 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:41580': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:21,373 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:21,374 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:21,374 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:41594': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:21,374 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:41610': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:21,490 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:21,491 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:21,491 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:41626': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:21,491 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:41632': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:21,603 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:21,603 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:21,604 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:41744': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:21,604 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:41750': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:21,717 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:21,718 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:21,718 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:41754': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:21,718 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:41768': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:21,831 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:21,832 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:21,832 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:41784': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:21,832 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:41800': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:21,944 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:21,944 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:21,946 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:41804': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:21,946 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:41806': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:22,057 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:22,058 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:22,058 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:41816': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:22,058 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:41822': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:22,170 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:22,171 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:22,171 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:41832': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:22,171 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:41848': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:22,284 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:22,285 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:22,285 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:41854': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:22,285 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:41866': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:22,399 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:22,399 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:22,399 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:41882': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:22,399 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:41886': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:22,512 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:22,512 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:22,513 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:41898': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:22,513 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:41906': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:22,626 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:22,626 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:22,627 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:41910': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:22,627 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:41918': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:22,739 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:22,739 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:22,740 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:41932': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:22,740 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:41940': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:22,853 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:22,853 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:22,854 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:41950': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:22,854 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:41962': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:22,966 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:22,966 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:22,966 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:41966': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:22,967 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:41974': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:23,079 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:23,080 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:23,080 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:41980': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:23,080 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:41994': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:23,192 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:23,193 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:23,193 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:42008': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:23,193 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:42012': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:23,306 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:23,306 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:23,307 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:42014': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:23,307 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:42016': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:23,419 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:23,420 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:23,420 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:42030': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:23,420 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:42044': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:23,533 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:23,534 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:23,534 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:42046': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:23,534 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:42052': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:23,647 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:23,648 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:23,648 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:42054': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:23,648 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:42060': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:23,763 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:23,763 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:23,764 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:42064': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:23,764 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:42066': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:23,877 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:23,877 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:23,878 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:42072': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:23,878 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:42078': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:23,993 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:23,993 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:23,993 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:42092': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:23,994 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:42100': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:24,106 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:24,106 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:24,107 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:42112': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:24,107 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:42116': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:24,219 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:24,220 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:24,220 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:42124': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:24,220 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:42132': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:24,333 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:24,333 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:24,333 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:42134': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:24,333 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:42138': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:24,446 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:24,446 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:24,447 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:42142': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:24,447 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:42156': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:24,560 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:24,561 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:24,561 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:42158': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:24,561 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:42172': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:24,674 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:24,674 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:24,675 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:42182': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:24,675 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:42190': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:24,788 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:24,788 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:24,789 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:42198': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:24,789 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:42214': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:24,901 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:24,901 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:24,902 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:42222': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:24,902 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:42238': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:25,014 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:25,015 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:25,015 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:42250': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:25,015 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:42256': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:25,127 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:25,128 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:25,128 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:42270': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:25,128 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:42286': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:25,241 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:25,241 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:25,242 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:42290': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:25,242 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:42296': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:25,354 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:25,355 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:25,355 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:42312': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:25,355 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:42318': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:25,469 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:25,469 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:25,469 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:42324': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:25,470 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:42338': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:25,584 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:25,585 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:25,585 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:42350': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:25,585 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:42356': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:25,699 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:25,699 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:25,699 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:42366': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:25,699 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:42372': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:25,812 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:25,812 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:25,813 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:42386': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:25,813 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:42400': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:25,926 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:25,927 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:25,927 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:42402': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:25,927 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:42414': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:26,039 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:26,040 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:26,040 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:42430': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:26,040 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:42440': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:26,152 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:26,153 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:26,153 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:42446': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:26,153 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:42458': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:26,266 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:26,266 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:26,266 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:42468': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:26,267 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:42480': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:26,379 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:26,379 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:26,380 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:42492': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:26,380 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:42506': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:26,492 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:26,492 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:26,493 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:42522': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:26,493 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:42528': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:26,605 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:26,606 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:26,606 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:42530': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:26,606 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:42536': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:26,718 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:26,719 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:26,719 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:42548': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:26,719 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:42564': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:26,832 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:26,832 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:26,833 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:42566': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:26,833 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:42570': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:26,945 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:26,945 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:26,946 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:42576': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:26,946 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:42590': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:27,059 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:27,060 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:27,060 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:42592': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:27,060 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:42608': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:27,172 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:27,173 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:27,173 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:42610': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:27,173 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:42616': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:27,287 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:27,287 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:27,287 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:42628': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:27,288 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:42638': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:27,402 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:27,402 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:27,403 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:42642': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:27,403 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:42652': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:27,515 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:27,515 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:27,516 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:42662': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:27,516 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:42678': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:27,628 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:27,628 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:27,628 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:42686': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:27,628 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:42694': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:27,741 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:27,741 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:27,742 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:42702': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:27,742 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:42718': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:27,854 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:27,855 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:27,855 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:42734': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:27,855 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:42748': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:27,968 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:27,968 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:27,969 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:42752': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:27,969 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:42764': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:28,082 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:28,082 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:28,083 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:42768': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:28,083 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:42782': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:28,196 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:28,196 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:28,196 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:42784': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:28,197 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:42798': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:28,309 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:28,310 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:28,310 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:42806': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:28,310 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:42810': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:28,423 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:28,423 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:28,424 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:42826': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:28,424 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:42838': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:28,536 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:28,537 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:28,537 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:42842': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:28,537 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:42846': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:28,650 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:28,650 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:28,651 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:42856': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:28,651 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:42864': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:28,764 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:28,764 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:28,764 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:42868': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:28,765 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:42882': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:28,877 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:28,877 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:28,878 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:42894': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:28,878 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:42896': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:28,992 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:28,993 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:28,993 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:42898': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:28,993 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:42906': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:29,106 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:29,106 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:29,107 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:42912': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:29,107 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:42916': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:29,223 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:29,223 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:29,224 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:42918': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:29,224 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:42934': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:29,337 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:29,337 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:29,338 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:42938': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:29,338 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:42946': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:29,451 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:29,451 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:29,452 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:42958': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:29,452 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:42972': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:29,565 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:29,566 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:29,566 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:42988': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:29,566 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:43000': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:29,679 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:29,679 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:29,680 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:43010': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:29,680 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:43026': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:29,792 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:29,793 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:29,793 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:43028': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:29,793 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:43032': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:29,906 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:29,907 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:29,907 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:43044': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:29,907 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:43058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:30,020 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:30,021 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:30,021 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:43068': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:30,021 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:43070': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:30,134 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:30,134 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:30,135 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:43080': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:30,135 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:43084': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:30,249 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:30,249 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:30,250 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:43100': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:30,250 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:43112': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:30,364 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:30,364 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:30,364 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:43116': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:30,365 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:43126': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:30,478 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:30,478 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:30,482 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:43132': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:30,482 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:43138': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:30,592 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:30,592 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:30,592 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:43142': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:30,593 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:43144': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:30,705 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:30,706 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:30,706 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:43146': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:30,706 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:43152': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:30,819 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:30,819 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:30,820 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:43162': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:30,820 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:43168': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:30,933 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:30,933 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:30,934 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:43184': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:30,934 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:43194': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:31,048 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:31,048 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:31,048 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:43210': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:31,049 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:43218': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:31,162 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:31,163 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:31,163 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:43222': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:31,163 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:43238': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:31,277 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:31,277 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:31,277 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:43248': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:31,278 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:43264': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:31,390 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:31,390 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:31,391 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:43268': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:31,391 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:43280': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:31,504 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:31,504 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:31,505 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:43284': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:31,505 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:43286': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:31,617 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:31,617 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:31,618 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:54106': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:31,618 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:54114': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:31,730 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:31,731 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:31,731 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:54116': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:31,731 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:54126': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:31,844 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:31,844 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:31,845 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:54136': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:31,845 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:54142': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:31,957 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:31,958 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:31,958 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:54148': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:31,958 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:54162': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:32,072 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:32,072 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:32,073 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:54170': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:32,073 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:54172': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:32,185 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:32,185 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:32,186 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:54186': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:32,186 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:54190': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:32,299 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:32,299 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:32,299 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:54198': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:32,299 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:54214': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:32,412 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:32,413 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:32,413 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:54222': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:32,413 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:54228': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:32,526 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:32,526 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:32,527 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:54242': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:32,527 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:54252': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:32,639 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:32,640 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:32,640 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:54264': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:32,640 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:54266': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:32,756 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:32,757 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:32,757 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:54274': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:32,757 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:54288': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:32,870 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:32,870 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:32,871 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:54302': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:32,871 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:54308': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:32,984 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:32,984 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:32,989 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:54310': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:32,989 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:54316': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:33,098 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:33,098 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:33,098 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:54332': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:33,099 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:54336': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:33,211 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:33,212 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:33,212 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:54338': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:33,212 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:54342': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:33,326 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:33,327 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:33,327 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:54346': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:33,327 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:54354': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:33,440 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:33,440 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:33,440 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:54360': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:33,441 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:54368': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:33,554 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:33,554 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:33,555 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:54374': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:33,555 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:54376': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:33,668 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:33,668 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:33,668 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:54380': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:33,669 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:54392': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:33,782 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:33,782 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:33,782 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:54400': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:33,783 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:54406': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:33,895 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:33,895 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:33,896 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:54414': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:33,896 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:54420': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:34,009 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:34,009 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:34,009 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:54424': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:34,009 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:54434': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:34,123 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:34,123 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:34,123 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:54444': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:34,124 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:54458': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:34,237 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:34,237 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:34,238 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:54460': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:34,238 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:54476': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:34,350 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:34,350 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:34,351 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:54488': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:34,351 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:54500': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:34,464 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:34,464 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:34,464 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:54508': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:34,465 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:54510': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:34,579 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:34,579 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:34,579 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:54522': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:34,580 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:54532': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:34,692 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:34,693 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:34,693 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:54546': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:34,693 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:54562': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:34,806 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:34,807 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:34,807 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:54572': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:34,807 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:54580': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:34,920 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:34,920 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35607 4768s 2024-11-23 21:39:34,921 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:54586': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:34,921 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35607': TLS handshake failed with remote 'tls://127.0.0.1:54596': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:34,990 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41277. Reason: failure-to-start- 4768s 2024-11-23 21:39:34,991 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:39:34,993 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 15s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 4768s stream = await stream.start_tls( 4768s ^^^^^^^^^^^^^^^^^^^^^^^ 4768s False, ssl_options=ssl_options, server_hostname=host 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 4768s self.socket.do_handshake() 4768s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 4768s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 4768s self._sslobj.do_handshake() 4768s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 4768s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 4768s raise FatalCommClosedError( 4768s ...<2 lines>... 4768s ) from err 4768s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 4768s 4768s During handling of the above exception, another exception occurred: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1218, in _register_with_scheduler 4768s await asyncio.sleep(0.1) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 718, in sleep 4768s return await future 4768s ^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 15s. 4768s 2024-11-23 21:39:34,997 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44181. Reason: failure-to-start- 4768s 2024-11-23 21:39:34,997 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:39:36,001 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:39:36,010 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:36,011 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42339/status 4768s 2024-11-23 21:39:36,011 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:39:36,028 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41373 4768s 2024-11-23 21:39:36,028 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41373 4768s 2024-11-23 21:39:36,028 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:39:36,028 - distributed.worker - INFO - dashboard at: 127.0.0.1:36075 4768s 2024-11-23 21:39:36,028 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:36,028 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:39:36,028 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:39:36,028 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:39:36,028 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-6lowoap9 4768s 2024-11-23 21:39:36,029 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:39:36,031 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36215 4768s 2024-11-23 21:39:36,031 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36215 4768s 2024-11-23 21:39:36,031 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:39:36,031 - distributed.worker - INFO - dashboard at: 127.0.0.1:42751 4768s 2024-11-23 21:39:36,031 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:36,031 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:39:36,031 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:39:36,032 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:39:36,032 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-v1d9gwb7 4768s 2024-11-23 21:39:36,032 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:39:36,047 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:36,047 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:36,047 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:54120': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:36,047 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:54136': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:36,161 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:36,162 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:36,162 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:54152': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:36,162 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:54166': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:36,273 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:36,275 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:36,275 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:54174': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:36,275 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:54188': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:36,382 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:36,383 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:54196': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:36,388 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:36,388 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:54204': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:36,490 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:36,491 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:54216': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:36,497 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:36,498 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:54230': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:36,597 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:36,598 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:54240': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:36,605 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:36,605 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:54256': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:36,706 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:36,706 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:54266': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:36,713 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:36,714 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:54282': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:36,813 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:36,814 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:54288': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:36,820 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:36,820 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:54296': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:36,920 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:36,921 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:54298': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:36,927 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:36,928 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:54300': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:37,028 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:37,029 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:54308': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:37,036 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:37,036 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:54310': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:37,137 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:37,137 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:54324': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:37,144 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:37,144 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:54328': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:37,244 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:37,244 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:54342': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:37,251 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:37,251 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:54346': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:37,352 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:37,353 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:54354': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:37,359 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:37,359 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:54364': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:37,460 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:37,460 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:54376': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:37,467 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:37,467 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:54386': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:37,568 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:37,569 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:54388': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:37,576 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:37,576 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:54390': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:37,678 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:37,679 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:54402': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:37,685 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:37,686 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:54404': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:37,787 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:37,788 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:54410': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:37,794 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:37,794 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:54416': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:37,895 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:37,895 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:54430': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:37,902 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:37,902 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:54442': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:38,003 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:38,003 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:54444': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:38,010 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:38,010 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:54446': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:38,110 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:38,111 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:54450': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:38,117 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:38,118 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:54462': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:38,218 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:38,218 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:54472': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:38,225 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:38,225 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:54488': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:38,325 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:38,326 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:54494': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:38,333 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:38,333 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:54508': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:38,433 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:38,434 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:54516': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:38,441 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:38,441 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:54530': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:38,542 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:38,542 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:54532': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:38,549 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:38,549 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:54536': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:38,650 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:38,651 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:54550': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:38,657 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:38,658 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:54558': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:38,758 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:38,758 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:54572': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:38,765 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:38,766 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:54582': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:38,866 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:38,866 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:54590': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:38,873 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:38,873 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:54604': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:38,974 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:38,975 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:54610': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:38,985 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:38,985 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:54612': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:39,083 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:39,084 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:54626': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:39,093 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:39,093 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:54630': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:39,191 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:39,192 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:54636': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:39,200 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:39,201 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:54652': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:39,300 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:39,300 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:54660': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:39,309 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:39,310 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:54662': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:39,408 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:39,408 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:54674': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:39,417 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:39,418 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:54680': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:39,516 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:39,520 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:54690': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:39,527 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:39,527 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:54698': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:39,625 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:39,625 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:54710': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:39,634 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:39,634 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:54726': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:39,732 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:39,733 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:54728': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:39,741 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:39,742 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:54732': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:39,840 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:39,841 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:54742': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:39,848 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:39,849 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:54748': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:39,948 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:39,948 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:54762': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:39,956 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:39,956 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:54768': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:40,056 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:40,056 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:54770': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:40,063 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:40,063 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:54780': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:40,164 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:40,164 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:54782': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:40,171 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:40,171 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:54798': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:40,271 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:40,272 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:54814': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:40,278 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:40,279 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:54822': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:40,379 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:40,380 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:54830': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:40,387 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:40,387 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:54846': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:40,487 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:40,487 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:54854': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:40,494 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:40,494 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:54868': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:40,594 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:40,595 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:54878': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:40,601 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:40,601 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:54884': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:40,702 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:40,703 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:54890': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:40,709 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:40,709 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:54906': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:40,810 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:40,812 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:54916': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:40,818 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:40,818 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:54932': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:40,918 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:40,919 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:54934': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:40,925 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:40,926 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:54948': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:41,026 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:41,026 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:54952': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:41,033 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:41,033 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:54954': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:41,134 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:41,135 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:54968': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:41,141 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:41,142 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:54978': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:41,244 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:41,245 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:54984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:41,251 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:41,251 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:54992': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:41,352 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:41,352 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:55000': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:41,359 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:41,359 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:55016': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:41,460 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:41,461 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:55022': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:41,467 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:41,468 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:55038': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:41,568 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:41,568 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:48016': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:41,575 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:41,575 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:48028': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:41,676 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:41,676 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:48034': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:41,683 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:41,683 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:48046': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:41,784 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:41,784 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:48060': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:41,791 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:41,791 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:48070': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:41,892 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:41,892 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:48074': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:41,899 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:41,899 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:48076': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:42,001 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:42,002 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:48080': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:42,008 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:42,008 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:48090': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:42,109 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:42,109 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:48098': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:42,116 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:42,117 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:48104': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:42,217 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:42,217 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:48112': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:42,224 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:42,224 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:48122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:42,324 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:42,325 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:48136': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:42,332 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:42,332 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:48142': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:42,433 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:42,434 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:48150': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:42,440 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:42,441 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:48154': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:42,541 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:42,542 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:48156': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:42,548 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:42,549 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:48166': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:42,650 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:42,651 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:48178': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:42,657 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:42,657 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:48184': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:42,758 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:42,759 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:48192': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:42,765 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:42,766 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:48204': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:42,866 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:42,867 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:48206': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:42,873 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:42,874 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:48220': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:42,975 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:42,976 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:48236': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:42,986 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:42,987 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:48246': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:43,083 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:43,083 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:48250': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:43,093 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:43,094 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:48254': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:43,191 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:43,191 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:48266': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:43,201 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:43,201 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:48282': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:43,298 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:43,299 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:48288': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:43,309 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:43,309 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:48296': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:43,406 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:43,407 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:48302': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:43,417 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:43,417 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:48314': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:43,514 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:43,518 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:48328': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:43,525 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:43,525 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:48340': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:43,623 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:43,623 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:48346': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:43,632 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:43,632 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:48352': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:43,730 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:43,731 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:48368': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:43,739 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:43,739 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:48378': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:43,838 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:43,838 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:48386': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:43,846 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:43,847 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:48396': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:43,946 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:43,946 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:48400': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:43,954 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:43,954 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:48408': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:44,054 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:44,054 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:48420': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:44,061 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:44,061 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:48436': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:44,161 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:44,162 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:48452': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:44,168 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:44,169 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:48466': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:44,270 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:44,272 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:48468': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:44,279 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:44,279 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:48476': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:44,379 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:44,380 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:48478': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:44,386 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:44,387 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:48480': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:44,487 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:44,487 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:48492': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:44,494 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:44,494 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:48508': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:44,595 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:44,595 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:48518': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:44,602 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:44,602 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:48530': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:44,704 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:44,705 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:48542': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:44,711 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:44,711 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:48548': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:44,812 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:44,812 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:48564': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:44,819 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:44,819 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:48574': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:44,920 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:44,921 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:48586': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:44,928 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:44,928 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:48594': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:45,029 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:45,029 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:48596': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:45,036 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:45,037 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:48598': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:45,138 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:45,139 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:48614': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:45,145 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:45,146 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:48620': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:45,247 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:45,248 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:48636': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:45,254 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:45,255 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:48646': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:45,356 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:45,357 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:48662': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:45,363 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:45,364 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:48668': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:45,465 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:45,466 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:48670': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:45,472 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:45,472 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:48676': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:45,573 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:45,573 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:48684': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:45,580 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:45,580 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:48686': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:45,680 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:45,681 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:48690': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:45,688 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:45,688 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:48706': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:45,788 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:45,788 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:48720': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:45,795 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:45,795 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:48722': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:45,896 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:45,897 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:48732': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:45,903 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:45,903 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:48738': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:46,004 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:46,005 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:48748': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:46,012 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:46,012 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:48762': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:46,113 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:46,114 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:48774': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:46,120 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:46,120 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:48786': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:46,221 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:46,221 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:48796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:46,228 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:46,228 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:48812': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:46,329 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:46,329 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:48828': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:46,336 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:46,336 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:48840': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:46,437 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:46,438 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:48844': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:46,444 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:46,445 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:48850': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:46,545 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:46,546 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:48860': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:46,553 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:46,553 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:48872': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:46,653 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:46,654 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:48876': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:46,661 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:46,661 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:48886': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:46,762 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:46,762 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:48900': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:46,769 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:46,769 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:48904': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:46,869 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:46,870 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:48914': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:46,877 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:46,878 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:48922': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:46,978 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:46,982 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:48936': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:46,989 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:46,990 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:48940': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:47,086 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:47,086 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:48954': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:47,098 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:47,098 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:48962': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:47,194 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:47,195 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:48970': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:47,205 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:47,205 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:48984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:47,302 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:47,302 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:48998': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:47,313 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:47,313 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:49004': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:47,410 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:47,411 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:49016': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:47,420 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:47,420 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:49020': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:47,522 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:47,523 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:49026': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:47,529 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:47,530 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:49030': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:47,632 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:47,633 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:49034': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:47,640 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:47,640 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:49048': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:47,741 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:47,741 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:49050': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:47,748 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:47,748 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:49052': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:47,849 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:47,849 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:49066': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:47,856 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:47,857 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:49078': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:47,958 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:47,959 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:49086': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:47,965 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:47,965 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:49100': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:48,066 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:48,067 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:49108': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:48,073 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:48,074 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:49122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:48,175 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:48,176 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:49134': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:48,182 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:48,183 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:49148': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:48,283 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:48,284 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:49154': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:48,290 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:48,291 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:49162': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:48,391 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:48,391 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:49170': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:48,398 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:48,398 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:49172': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:48,499 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:48,499 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:49174': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:48,506 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:48,506 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:49178': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:48,607 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:48,608 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:49190': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:48,614 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:48,615 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:49204': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:48,715 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:48,716 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:49218': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:48,722 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:48,723 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:49234': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:48,823 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:48,823 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:49240': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:48,830 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:48,830 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:49244': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:48,930 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:48,931 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:49248': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:48,937 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41509 4768s 2024-11-23 21:39:48,938 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41509': TLS handshake failed with remote 'tls://127.0.0.1:49252': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:39:49,027 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41373. Reason: failure-to-start- 4768s 2024-11-23 21:39:49,027 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:39:49,029 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 13s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 4768s stream = await stream.start_tls( 4768s ^^^^^^^^^^^^^^^^^^^^^^^ 4768s False, ssl_options=ssl_options, server_hostname=host 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 4768s self.socket.do_handshake() 4768s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 4768s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 4768s self._sslobj.do_handshake() 4768s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 4768s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 4768s raise FatalCommClosedError( 4768s ...<2 lines>... 4768s ) from err 4768s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 4768s 4768s During handling of the above exception, another exception occurred: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1218, in _register_with_scheduler 4768s await asyncio.sleep(0.1) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 718, in sleep 4768s return await future 4768s ^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 13s. 4768s 2024-11-23 21:39:49,033 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36215. Reason: failure-to-start- 4768s 2024-11-23 21:39:49,033 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:39:50,037 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:39:50,050 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42861 4768s 2024-11-23 21:39:50,050 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35209/status 4768s 2024-11-23 21:39:50,051 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:39:50,067 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34747 4768s 2024-11-23 21:39:50,068 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34747 4768s 2024-11-23 21:39:50,068 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:39:50,068 - distributed.worker - INFO - dashboard at: 127.0.0.1:36745 4768s 2024-11-23 21:39:50,068 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42861 4768s 2024-11-23 21:39:50,068 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:39:50,068 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:39:50,068 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:39:50,068 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-4govbbkb 4768s 2024-11-23 21:39:50,068 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:39:50,071 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44331 4768s 2024-11-23 21:39:50,071 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44331 4768s 2024-11-23 21:39:50,071 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:39:50,071 - distributed.worker - INFO - dashboard at: 127.0.0.1:40109 4768s 2024-11-23 21:39:50,071 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42861 4768s 2024-11-23 21:39:50,071 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:39:50,071 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:39:50,071 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:39:50,071 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-wpgf1f0y 4768s 2024-11-23 21:39:50,071 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:39:50,072 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34747. Reason: failure-to-start- 4768s 2024-11-23 21:39:50,073 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:39:50,073 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44331. Reason: failure-to-start- 4768s 2024-11-23 21:39:50,073 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:39:50,075 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42861': TLS handshake failed with remote 'tls://127.0.0.1:50834': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:39:50,075 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42861': TLS handshake failed with remote 'tls://127.0.0.1:50836': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:39:50,077 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:39:51,083 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:39:51,092 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40351 4768s 2024-11-23 21:39:51,092 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42147/status 4768s 2024-11-23 21:39:51,093 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:39:51,112 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40797 4768s 2024-11-23 21:39:51,112 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40797 4768s 2024-11-23 21:39:51,112 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:39:51,112 - distributed.worker - INFO - dashboard at: 127.0.0.1:33259 4768s 2024-11-23 21:39:51,112 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40351 4768s 2024-11-23 21:39:51,112 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:39:51,112 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:39:51,112 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:39:51,112 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-n2sjos2e 4768s 2024-11-23 21:39:51,112 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:39:51,115 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33351 4768s 2024-11-23 21:39:51,115 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33351 4768s 2024-11-23 21:39:51,115 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:39:51,115 - distributed.worker - INFO - dashboard at: 127.0.0.1:43101 4768s 2024-11-23 21:39:51,115 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40351 4768s 2024-11-23 21:39:51,115 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:39:51,115 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:39:51,115 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:39:51,116 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-6ovxjxnz 4768s 2024-11-23 21:39:51,116 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:39:51,117 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40797. Reason: failure-to-start- 4768s 2024-11-23 21:39:51,117 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:39:51,118 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33351. Reason: failure-to-start- 4768s 2024-11-23 21:39:51,118 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:39:51,119 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40351': TLS handshake failed with remote 'tls://127.0.0.1:44588': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:39:51,119 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40351': TLS handshake failed with remote 'tls://127.0.0.1:44596': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:39:51,121 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:39:52,127 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:39:52,136 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45407 4768s 2024-11-23 21:39:52,136 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33789/status 4768s 2024-11-23 21:39:52,137 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:39:52,153 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35489 4768s 2024-11-23 21:39:52,153 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35489 4768s 2024-11-23 21:39:52,154 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:39:52,154 - distributed.worker - INFO - dashboard at: 127.0.0.1:43495 4768s 2024-11-23 21:39:52,154 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45407 4768s 2024-11-23 21:39:52,154 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:39:52,154 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:39:52,154 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:39:52,154 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-3075bnvg 4768s 2024-11-23 21:39:52,154 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:39:52,156 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41859 4768s 2024-11-23 21:39:52,157 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41859 4768s 2024-11-23 21:39:52,157 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:39:52,157 - distributed.worker - INFO - dashboard at: 127.0.0.1:40485 4768s 2024-11-23 21:39:52,157 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45407 4768s 2024-11-23 21:39:52,157 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:39:52,157 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:39:52,157 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:39:52,157 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-7ghjrs8h 4768s 2024-11-23 21:39:52,157 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:39:52,159 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35489. Reason: failure-to-start- 4768s 2024-11-23 21:39:52,160 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:39:52,160 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41859. Reason: failure-to-start- 4768s 2024-11-23 21:39:52,160 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:39:52,162 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45407': TLS handshake failed with remote 'tls://127.0.0.1:40396': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:39:52,162 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45407': TLS handshake failed with remote 'tls://127.0.0.1:40412': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:39:52,164 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:39:53,170 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:39:53,179 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34227 4768s 2024-11-23 21:39:53,179 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35339/status 4768s 2024-11-23 21:39:53,180 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:39:53,196 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35403 4768s 2024-11-23 21:39:53,197 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35403 4768s 2024-11-23 21:39:53,197 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:39:53,197 - distributed.worker - INFO - dashboard at: 127.0.0.1:46017 4768s 2024-11-23 21:39:53,197 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34227 4768s 2024-11-23 21:39:53,197 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:39:53,197 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:39:53,197 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:39:53,197 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-fa_am8tl 4768s 2024-11-23 21:39:53,197 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:39:53,199 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35341 4768s 2024-11-23 21:39:53,200 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35341 4768s 2024-11-23 21:39:53,200 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:39:53,200 - distributed.worker - INFO - dashboard at: 127.0.0.1:37741 4768s 2024-11-23 21:39:53,200 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34227 4768s 2024-11-23 21:39:53,200 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:39:53,200 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:39:53,200 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:39:53,200 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-vj6mtf_v 4768s 2024-11-23 21:39:53,200 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:39:53,201 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35403. Reason: failure-to-start- 4768s 2024-11-23 21:39:53,202 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:39:53,202 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35341. Reason: failure-to-start- 4768s 2024-11-23 21:39:53,202 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:39:53,204 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34227': TLS handshake failed with remote 'tls://127.0.0.1:44384': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:39:53,204 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34227': TLS handshake failed with remote 'tls://127.0.0.1:44394': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:39:53,206 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:39:54,212 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:39:54,222 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38757 4768s 2024-11-23 21:39:54,223 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36473/status 4768s 2024-11-23 21:39:54,223 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:39:54,239 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38209 4768s 2024-11-23 21:39:54,239 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38209 4768s 2024-11-23 21:39:54,240 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:39:54,240 - distributed.worker - INFO - dashboard at: 127.0.0.1:36921 4768s 2024-11-23 21:39:54,240 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38757 4768s 2024-11-23 21:39:54,240 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:39:54,240 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:39:54,240 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:39:54,240 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-sdlp0edn 4768s 2024-11-23 21:39:54,240 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:39:54,242 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46235 4768s 2024-11-23 21:39:54,242 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46235 4768s 2024-11-23 21:39:54,242 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:39:54,242 - distributed.worker - INFO - dashboard at: 127.0.0.1:34703 4768s 2024-11-23 21:39:54,242 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38757 4768s 2024-11-23 21:39:54,243 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:39:54,243 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:39:54,243 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:39:54,243 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-fyelc44r 4768s 2024-11-23 21:39:54,243 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:39:54,244 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38209. Reason: failure-to-start- 4768s 2024-11-23 21:39:54,244 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:39:54,245 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46235. Reason: failure-to-start- 4768s 2024-11-23 21:39:54,245 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:39:54,246 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38757': TLS handshake failed with remote 'tls://127.0.0.1:33506': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:39:54,246 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38757': TLS handshake failed with remote 'tls://127.0.0.1:33516': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:39:54,248 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:39:55,254 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:39:55,263 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40973 4768s 2024-11-23 21:39:55,263 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40801/status 4768s 2024-11-23 21:39:55,263 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:39:55,281 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45199 4768s 2024-11-23 21:39:55,282 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45199 4768s 2024-11-23 21:39:55,282 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:39:55,282 - distributed.worker - INFO - dashboard at: 127.0.0.1:43867 4768s 2024-11-23 21:39:55,282 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40973 4768s 2024-11-23 21:39:55,282 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:39:55,282 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:39:55,282 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:39:55,282 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-_poi4r9w 4768s 2024-11-23 21:39:55,282 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:39:55,284 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42493 4768s 2024-11-23 21:39:55,285 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42493 4768s 2024-11-23 21:39:55,285 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:39:55,285 - distributed.worker - INFO - dashboard at: 127.0.0.1:35059 4768s 2024-11-23 21:39:55,285 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40973 4768s 2024-11-23 21:39:55,285 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:39:55,285 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:39:55,285 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:39:55,285 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-qznusc3c 4768s 2024-11-23 21:39:55,285 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:39:55,286 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45199. Reason: failure-to-start- 4768s 2024-11-23 21:39:55,287 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:39:55,287 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42493. Reason: failure-to-start- 4768s 2024-11-23 21:39:55,287 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:39:55,289 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40973': TLS handshake failed with remote 'tls://127.0.0.1:47416': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:39:55,289 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40973': TLS handshake failed with remote 'tls://127.0.0.1:47424': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:39:55,291 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:39:56,296 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:39:56,305 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42257 4768s 2024-11-23 21:39:56,305 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40291/status 4768s 2024-11-23 21:39:56,306 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:39:56,323 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39165 4768s 2024-11-23 21:39:56,323 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39165 4768s 2024-11-23 21:39:56,323 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:39:56,323 - distributed.worker - INFO - dashboard at: 127.0.0.1:38357 4768s 2024-11-23 21:39:56,323 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42257 4768s 2024-11-23 21:39:56,323 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:39:56,323 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:39:56,323 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:39:56,323 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-gus4tk7_ 4768s 2024-11-23 21:39:56,323 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:39:56,326 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33167 4768s 2024-11-23 21:39:56,326 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33167 4768s 2024-11-23 21:39:56,326 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:39:56,326 - distributed.worker - INFO - dashboard at: 127.0.0.1:36797 4768s 2024-11-23 21:39:56,326 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42257 4768s 2024-11-23 21:39:56,326 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:39:56,326 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:39:56,326 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:39:56,326 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-z58x1jra 4768s 2024-11-23 21:39:56,326 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:39:56,329 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39165. Reason: failure-to-start- 4768s 2024-11-23 21:39:56,329 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:39:56,329 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33167. Reason: failure-to-start- 4768s 2024-11-23 21:39:56,329 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:39:56,331 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42257': TLS handshake failed with remote 'tls://127.0.0.1:51690': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:39:56,331 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42257': TLS handshake failed with remote 'tls://127.0.0.1:51706': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:39:56,333 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:39:57,338 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:39:57,347 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39673 4768s 2024-11-23 21:39:57,348 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38491/status 4768s 2024-11-23 21:39:57,348 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:39:57,364 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35869 4768s 2024-11-23 21:39:57,364 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35869 4768s 2024-11-23 21:39:57,364 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:39:57,365 - distributed.worker - INFO - dashboard at: 127.0.0.1:40227 4768s 2024-11-23 21:39:57,365 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39673 4768s 2024-11-23 21:39:57,365 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:39:57,365 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:39:57,365 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:39:57,365 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-uzh_0yzt 4768s 2024-11-23 21:39:57,365 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:39:57,367 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46129 4768s 2024-11-23 21:39:57,367 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46129 4768s 2024-11-23 21:39:57,368 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:39:57,368 - distributed.worker - INFO - dashboard at: 127.0.0.1:43605 4768s 2024-11-23 21:39:57,368 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39673 4768s 2024-11-23 21:39:57,368 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:39:57,368 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:39:57,368 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:39:57,368 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ys6pzrwq 4768s 2024-11-23 21:39:57,368 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:39:57,369 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35869. Reason: failure-to-start- 4768s 2024-11-23 21:39:57,369 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:39:57,370 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46129. Reason: failure-to-start- 4768s 2024-11-23 21:39:57,370 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:39:57,372 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39673': TLS handshake failed with remote 'tls://127.0.0.1:46654': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:39:57,372 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39673': TLS handshake failed with remote 'tls://127.0.0.1:46656': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:39:57,373 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:39:58,379 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:39:58,390 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42047 4768s 2024-11-23 21:39:58,390 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42781/status 4768s 2024-11-23 21:39:58,390 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:39:58,407 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42791 4768s 2024-11-23 21:39:58,408 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42791 4768s 2024-11-23 21:39:58,408 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:39:58,408 - distributed.worker - INFO - dashboard at: 127.0.0.1:38193 4768s 2024-11-23 21:39:58,408 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42047 4768s 2024-11-23 21:39:58,408 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:39:58,408 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:39:58,408 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:39:58,408 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-wphbqhv0 4768s 2024-11-23 21:39:58,408 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:39:58,411 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37789 4768s 2024-11-23 21:39:58,411 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37789 4768s 2024-11-23 21:39:58,411 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:39:58,411 - distributed.worker - INFO - dashboard at: 127.0.0.1:33343 4768s 2024-11-23 21:39:58,411 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42047 4768s 2024-11-23 21:39:58,411 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:39:58,411 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:39:58,411 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:39:58,411 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-7wy8ne2n 4768s 2024-11-23 21:39:58,411 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:39:58,413 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42791. Reason: failure-to-start- 4768s 2024-11-23 21:39:58,413 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:39:58,413 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37789. Reason: failure-to-start- 4768s 2024-11-23 21:39:58,413 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:39:58,415 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42047': TLS handshake failed with remote 'tls://127.0.0.1:56914': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:39:58,415 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42047': TLS handshake failed with remote 'tls://127.0.0.1:56928': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:39:58,417 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:39:59,424 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:39:59,433 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35503 4768s 2024-11-23 21:39:59,433 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34819/status 4768s 2024-11-23 21:39:59,434 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:39:59,452 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35769 4768s 2024-11-23 21:39:59,452 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35769 4768s 2024-11-23 21:39:59,452 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:39:59,452 - distributed.worker - INFO - dashboard at: 127.0.0.1:45191 4768s 2024-11-23 21:39:59,452 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35503 4768s 2024-11-23 21:39:59,453 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:39:59,453 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:39:59,453 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:39:59,453 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-skr5zbl4 4768s 2024-11-23 21:39:59,453 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:39:59,455 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39975 4768s 2024-11-23 21:39:59,456 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39975 4768s 2024-11-23 21:39:59,456 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:39:59,456 - distributed.worker - INFO - dashboard at: 127.0.0.1:40741 4768s 2024-11-23 21:39:59,456 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35503 4768s 2024-11-23 21:39:59,456 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:39:59,456 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:39:59,456 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:39:59,456 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-hp8b2y_p 4768s 2024-11-23 21:39:59,456 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:39:59,457 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35769. Reason: failure-to-start- 4768s 2024-11-23 21:39:59,458 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:39:59,458 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39975. Reason: failure-to-start- 4768s 2024-11-23 21:39:59,458 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:39:59,460 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35503': TLS handshake failed with remote 'tls://127.0.0.1:35134': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:39:59,460 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35503': TLS handshake failed with remote 'tls://127.0.0.1:35146': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:39:59,462 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:40:00,468 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:40:00,477 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35819 4768s 2024-11-23 21:40:00,478 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34025/status 4768s 2024-11-23 21:40:00,478 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:40:00,497 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38083 4768s 2024-11-23 21:40:00,498 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38083 4768s 2024-11-23 21:40:00,498 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:40:00,498 - distributed.worker - INFO - dashboard at: 127.0.0.1:38201 4768s 2024-11-23 21:40:00,498 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35819 4768s 2024-11-23 21:40:00,498 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:40:00,498 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:40:00,498 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:40:00,498 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-lgt669qw 4768s 2024-11-23 21:40:00,498 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:40:00,501 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:32833 4768s 2024-11-23 21:40:00,501 - distributed.worker - INFO - Listening to: tls://127.0.0.1:32833 4768s 2024-11-23 21:40:00,501 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:40:00,501 - distributed.worker - INFO - dashboard at: 127.0.0.1:39159 4768s 2024-11-23 21:40:00,501 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35819 4768s 2024-11-23 21:40:00,501 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:40:00,501 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:40:00,501 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:40:00,501 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-szzij042 4768s 2024-11-23 21:40:00,501 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:40:00,504 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38083. Reason: failure-to-start- 4768s 2024-11-23 21:40:00,504 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:40:00,504 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:32833. Reason: failure-to-start- 4768s 2024-11-23 21:40:00,505 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:40:00,506 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35819': TLS handshake failed with remote 'tls://127.0.0.1:42934': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:40:00,506 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35819': TLS handshake failed with remote 'tls://127.0.0.1:42946': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:40:00,508 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:40:01,514 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:40:01,522 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42251 4768s 2024-11-23 21:40:01,522 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45007/status 4768s 2024-11-23 21:40:01,523 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:40:01,541 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41725 4768s 2024-11-23 21:40:01,541 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41725 4768s 2024-11-23 21:40:01,542 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:40:01,542 - distributed.worker - INFO - dashboard at: 127.0.0.1:43577 4768s 2024-11-23 21:40:01,542 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42251 4768s 2024-11-23 21:40:01,542 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:40:01,542 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:40:01,542 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:40:01,542 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ab1s1qkn 4768s 2024-11-23 21:40:01,542 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:40:01,544 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33681 4768s 2024-11-23 21:40:01,545 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33681 4768s 2024-11-23 21:40:01,545 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:40:01,545 - distributed.worker - INFO - dashboard at: 127.0.0.1:39275 4768s 2024-11-23 21:40:01,545 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42251 4768s 2024-11-23 21:40:01,545 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:40:01,545 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:40:01,545 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:40:01,545 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-pu66i7nu 4768s 2024-11-23 21:40:01,545 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:40:01,546 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41725. Reason: failure-to-start- 4768s 2024-11-23 21:40:01,547 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:40:01,547 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33681. Reason: failure-to-start- 4768s 2024-11-23 21:40:01,547 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:40:01,549 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42251': TLS handshake failed with remote 'tls://127.0.0.1:45388': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:40:01,549 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42251': TLS handshake failed with remote 'tls://127.0.0.1:45398': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:40:01,551 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:40:02,557 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:40:02,567 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41461 4768s 2024-11-23 21:40:02,568 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43481/status 4768s 2024-11-23 21:40:02,568 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:40:02,585 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42559 4768s 2024-11-23 21:40:02,585 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42559 4768s 2024-11-23 21:40:02,585 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:40:02,585 - distributed.worker - INFO - dashboard at: 127.0.0.1:33221 4768s 2024-11-23 21:40:02,586 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41461 4768s 2024-11-23 21:40:02,586 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:40:02,586 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:40:02,586 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:40:02,586 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-2yx0m7eu 4768s 2024-11-23 21:40:02,586 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:40:02,588 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33569 4768s 2024-11-23 21:40:02,588 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33569 4768s 2024-11-23 21:40:02,589 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:40:02,589 - distributed.worker - INFO - dashboard at: 127.0.0.1:43165 4768s 2024-11-23 21:40:02,589 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41461 4768s 2024-11-23 21:40:02,589 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:40:02,589 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:40:02,589 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:40:02,589 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-i_14zciz 4768s 2024-11-23 21:40:02,589 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:40:02,590 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42559. Reason: failure-to-start- 4768s 2024-11-23 21:40:02,591 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:40:02,591 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33569. Reason: failure-to-start- 4768s 2024-11-23 21:40:02,591 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:40:02,593 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41461': TLS handshake failed with remote 'tls://127.0.0.1:49540': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:40:02,593 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41461': TLS handshake failed with remote 'tls://127.0.0.1:49550': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:40:02,597 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:40:03,603 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:40:03,611 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34357 4768s 2024-11-23 21:40:03,612 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35057/status 4768s 2024-11-23 21:40:03,612 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:40:03,631 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34161 4768s 2024-11-23 21:40:03,632 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34161 4768s 2024-11-23 21:40:03,632 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:40:03,632 - distributed.worker - INFO - dashboard at: 127.0.0.1:45411 4768s 2024-11-23 21:40:03,632 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34357 4768s 2024-11-23 21:40:03,632 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:40:03,632 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:40:03,632 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:40:03,632 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-mhynd5ug 4768s 2024-11-23 21:40:03,632 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:40:03,635 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44509 4768s 2024-11-23 21:40:03,635 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44509 4768s 2024-11-23 21:40:03,635 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:40:03,635 - distributed.worker - INFO - dashboard at: 127.0.0.1:39631 4768s 2024-11-23 21:40:03,635 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34357 4768s 2024-11-23 21:40:03,635 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:40:03,635 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:40:03,635 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:40:03,635 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-jkv5whwp 4768s 2024-11-23 21:40:03,635 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:40:03,637 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34161. Reason: failure-to-start- 4768s 2024-11-23 21:40:03,637 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:40:03,638 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44509. Reason: failure-to-start- 4768s 2024-11-23 21:40:03,638 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:40:03,639 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34357': TLS handshake failed with remote 'tls://127.0.0.1:37210': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:40:03,639 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34357': TLS handshake failed with remote 'tls://127.0.0.1:37212': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:40:03,644 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:40:04,650 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:40:04,659 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46353 4768s 2024-11-23 21:40:04,659 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38649/status 4768s 2024-11-23 21:40:04,660 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:40:04,677 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35537 4768s 2024-11-23 21:40:04,677 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35537 4768s 2024-11-23 21:40:04,677 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:40:04,677 - distributed.worker - INFO - dashboard at: 127.0.0.1:45855 4768s 2024-11-23 21:40:04,677 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46353 4768s 2024-11-23 21:40:04,677 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:40:04,677 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:40:04,677 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:40:04,677 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-dzw24oqg 4768s 2024-11-23 21:40:04,677 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:40:04,680 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40673 4768s 2024-11-23 21:40:04,680 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40673 4768s 2024-11-23 21:40:04,680 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:40:04,680 - distributed.worker - INFO - dashboard at: 127.0.0.1:36119 4768s 2024-11-23 21:40:04,680 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46353 4768s 2024-11-23 21:40:04,680 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:40:04,680 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:40:04,681 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:40:04,681 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-n3s660ac 4768s 2024-11-23 21:40:04,681 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:40:04,683 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35537. Reason: failure-to-start- 4768s 2024-11-23 21:40:04,683 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:40:04,684 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40673. Reason: failure-to-start- 4768s 2024-11-23 21:40:04,684 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:40:04,689 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46353': TLS handshake failed with remote 'tls://127.0.0.1:54810': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:40:04,689 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46353': TLS handshake failed with remote 'tls://127.0.0.1:54816': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:40:04,691 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:40:05,697 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:40:05,705 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45557 4768s 2024-11-23 21:40:05,706 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35759/status 4768s 2024-11-23 21:40:05,706 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:40:05,723 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42501 4768s 2024-11-23 21:40:05,723 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42501 4768s 2024-11-23 21:40:05,724 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:40:05,724 - distributed.worker - INFO - dashboard at: 127.0.0.1:40157 4768s 2024-11-23 21:40:05,724 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45557 4768s 2024-11-23 21:40:05,724 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:40:05,724 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:40:05,724 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:40:05,724 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-zf9565p4 4768s 2024-11-23 21:40:05,724 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:40:05,726 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39119 4768s 2024-11-23 21:40:05,727 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39119 4768s 2024-11-23 21:40:05,727 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:40:05,727 - distributed.worker - INFO - dashboard at: 127.0.0.1:38463 4768s 2024-11-23 21:40:05,727 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45557 4768s 2024-11-23 21:40:05,727 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:40:05,727 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:40:05,727 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:40:05,727 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-96_o1_57 4768s 2024-11-23 21:40:05,727 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:40:05,728 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42501. Reason: failure-to-start- 4768s 2024-11-23 21:40:05,729 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:40:05,729 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39119. Reason: failure-to-start- 4768s 2024-11-23 21:40:05,729 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:40:05,734 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45557': TLS handshake failed with remote 'tls://127.0.0.1:50746': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:40:05,734 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45557': TLS handshake failed with remote 'tls://127.0.0.1:50750': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:40:05,736 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:40:06,757 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:40:06,767 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44847 4768s 2024-11-23 21:40:06,767 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37527/status 4768s 2024-11-23 21:40:06,767 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:40:06,787 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43011 4768s 2024-11-23 21:40:06,787 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43011 4768s 2024-11-23 21:40:06,787 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:40:06,788 - distributed.worker - INFO - dashboard at: 127.0.0.1:39629 4768s 2024-11-23 21:40:06,788 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44847 4768s 2024-11-23 21:40:06,788 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:40:06,788 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:40:06,788 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:40:06,788 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-qwj64jdb 4768s 2024-11-23 21:40:06,788 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:40:06,790 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35407 4768s 2024-11-23 21:40:06,790 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35407 4768s 2024-11-23 21:40:06,790 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:40:06,791 - distributed.worker - INFO - dashboard at: 127.0.0.1:46033 4768s 2024-11-23 21:40:06,791 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44847 4768s 2024-11-23 21:40:06,791 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:40:06,791 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:40:06,791 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:40:06,791 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-n2l046wq 4768s 2024-11-23 21:40:06,791 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:40:06,792 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43011. Reason: failure-to-start- 4768s 2024-11-23 21:40:06,793 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:40:06,793 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35407. Reason: failure-to-start- 4768s 2024-11-23 21:40:06,793 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:40:06,795 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44847': TLS handshake failed with remote 'tls://127.0.0.1:58136': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:40:06,795 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44847': TLS handshake failed with remote 'tls://127.0.0.1:58152': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:40:06,797 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:40:07,803 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:40:07,812 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46861 4768s 2024-11-23 21:40:07,813 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38383/status 4768s 2024-11-23 21:40:07,813 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:40:08,129 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40983 4768s 2024-11-23 21:40:08,129 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40983 4768s 2024-11-23 21:40:08,129 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:40:08,129 - distributed.worker - INFO - dashboard at: 127.0.0.1:42057 4768s 2024-11-23 21:40:08,129 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46861 4768s 2024-11-23 21:40:08,129 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:40:08,129 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:40:08,129 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:40:08,129 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-d68x3q6y 4768s 2024-11-23 21:40:08,129 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:40:08,132 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37243 4768s 2024-11-23 21:40:08,132 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37243 4768s 2024-11-23 21:40:08,132 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:40:08,132 - distributed.worker - INFO - dashboard at: 127.0.0.1:37549 4768s 2024-11-23 21:40:08,132 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46861 4768s 2024-11-23 21:40:08,132 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:40:08,132 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:40:08,132 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:40:08,132 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-erd8loq_ 4768s 2024-11-23 21:40:08,132 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:40:08,159 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40983. Reason: failure-to-start- 4768s 2024-11-23 21:40:08,160 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:40:08,160 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37243. Reason: failure-to-start- 4768s 2024-11-23 21:40:08,160 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:40:08,162 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46861': TLS handshake failed with remote 'tls://127.0.0.1:50248': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:40:08,162 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46861': TLS handshake failed with remote 'tls://127.0.0.1:50250': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:40:08,170 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:40:09,176 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:40:09,184 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41147 4768s 2024-11-23 21:40:09,184 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36421/status 4768s 2024-11-23 21:40:09,184 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:40:09,203 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40105 4768s 2024-11-23 21:40:09,203 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40105 4768s 2024-11-23 21:40:09,203 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:40:09,203 - distributed.worker - INFO - dashboard at: 127.0.0.1:35327 4768s 2024-11-23 21:40:09,203 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41147 4768s 2024-11-23 21:40:09,203 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:40:09,203 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:40:09,203 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:40:09,203 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-2yv77qbh 4768s 2024-11-23 21:40:09,203 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:40:09,205 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34115 4768s 2024-11-23 21:40:09,206 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34115 4768s 2024-11-23 21:40:09,206 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:40:09,206 - distributed.worker - INFO - dashboard at: 127.0.0.1:33865 4768s 2024-11-23 21:40:09,206 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41147 4768s 2024-11-23 21:40:09,206 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:40:09,206 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:40:09,206 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:40:09,206 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-8l8t77fa 4768s 2024-11-23 21:40:09,206 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:40:09,207 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40105. Reason: failure-to-start- 4768s 2024-11-23 21:40:09,207 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:40:09,208 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34115. Reason: failure-to-start- 4768s 2024-11-23 21:40:09,208 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:40:09,209 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41147': TLS handshake failed with remote 'tls://127.0.0.1:51768': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:40:09,210 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41147': TLS handshake failed with remote 'tls://127.0.0.1:51772': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:40:09,214 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:40:10,220 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:40:10,233 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40471 4768s 2024-11-23 21:40:10,234 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43479/status 4768s 2024-11-23 21:40:10,234 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:40:10,263 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36221 4768s 2024-11-23 21:40:10,263 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36221 4768s 2024-11-23 21:40:10,263 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:40:10,263 - distributed.worker - INFO - dashboard at: 127.0.0.1:35215 4768s 2024-11-23 21:40:10,263 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40471 4768s 2024-11-23 21:40:10,263 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:40:10,263 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:40:10,263 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:40:10,263 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-uha452xk 4768s 2024-11-23 21:40:10,263 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:40:10,267 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45581 4768s 2024-11-23 21:40:10,267 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45581 4768s 2024-11-23 21:40:10,267 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:40:10,267 - distributed.worker - INFO - dashboard at: 127.0.0.1:37443 4768s 2024-11-23 21:40:10,267 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40471 4768s 2024-11-23 21:40:10,267 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:40:10,267 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:40:10,267 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:40:10,267 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-4ssfj8ae 4768s 2024-11-23 21:40:10,267 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:40:10,270 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36221. Reason: failure-to-start- 4768s 2024-11-23 21:40:10,270 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:40:10,270 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45581. Reason: failure-to-start- 4768s 2024-11-23 21:40:10,271 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:40:10,277 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40471': TLS handshake failed with remote 'tls://127.0.0.1:60040': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:40:10,277 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40471': TLS handshake failed with remote 'tls://127.0.0.1:60056': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:40:10,283 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:40:11,290 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:40:11,301 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36985 4768s 2024-11-23 21:40:11,301 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35007/status 4768s 2024-11-23 21:40:11,302 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:40:11,326 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38463 4768s 2024-11-23 21:40:11,326 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38463 4768s 2024-11-23 21:40:11,326 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:40:11,326 - distributed.worker - INFO - dashboard at: 127.0.0.1:40323 4768s 2024-11-23 21:40:11,326 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36985 4768s 2024-11-23 21:40:11,326 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:40:11,326 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:40:11,326 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:40:11,326 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-_i9rh9zj 4768s 2024-11-23 21:40:11,327 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:40:11,330 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46187 4768s 2024-11-23 21:40:11,330 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46187 4768s 2024-11-23 21:40:11,330 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:40:11,330 - distributed.worker - INFO - dashboard at: 127.0.0.1:33811 4768s 2024-11-23 21:40:11,330 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36985 4768s 2024-11-23 21:40:11,330 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:40:11,330 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:40:11,330 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:40:11,330 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-e272rta8 4768s 2024-11-23 21:40:11,330 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:40:11,339 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38463. Reason: failure-to-start- 4768s 2024-11-23 21:40:11,339 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:40:11,340 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46187. Reason: failure-to-start- 4768s 2024-11-23 21:40:11,341 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:40:11,343 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36985': TLS handshake failed with remote 'tls://127.0.0.1:55878': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:40:11,343 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36985': TLS handshake failed with remote 'tls://127.0.0.1:55890': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:40:11,346 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:40:12,356 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:40:12,366 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41649 4768s 2024-11-23 21:40:12,366 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45415/status 4768s 2024-11-23 21:40:12,367 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:40:12,388 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36367 4768s 2024-11-23 21:40:12,388 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36367 4768s 2024-11-23 21:40:12,388 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:40:12,388 - distributed.worker - INFO - dashboard at: 127.0.0.1:33899 4768s 2024-11-23 21:40:12,388 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41649 4768s 2024-11-23 21:40:12,388 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:40:12,388 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:40:12,388 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:40:12,388 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ute3ma1z 4768s 2024-11-23 21:40:12,388 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:40:12,392 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33159 4768s 2024-11-23 21:40:12,392 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33159 4768s 2024-11-23 21:40:12,392 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:40:12,392 - distributed.worker - INFO - dashboard at: 127.0.0.1:34385 4768s 2024-11-23 21:40:12,392 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41649 4768s 2024-11-23 21:40:12,392 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:40:12,392 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:40:12,392 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:40:12,392 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-qrkv91xw 4768s 2024-11-23 21:40:12,392 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:40:12,396 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36367. Reason: failure-to-start- 4768s 2024-11-23 21:40:12,397 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:40:12,397 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33159. Reason: failure-to-start- 4768s 2024-11-23 21:40:12,398 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:40:12,404 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41649': TLS handshake failed with remote 'tls://127.0.0.1:52160': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:40:12,404 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41649': TLS handshake failed with remote 'tls://127.0.0.1:52164': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:40:12,407 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:40:13,414 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:40:13,424 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41467 4768s 2024-11-23 21:40:13,425 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33181/status 4768s 2024-11-23 21:40:13,425 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:40:13,447 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35069 4768s 2024-11-23 21:40:13,447 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35069 4768s 2024-11-23 21:40:13,447 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:40:13,447 - distributed.worker - INFO - dashboard at: 127.0.0.1:40735 4768s 2024-11-23 21:40:13,448 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41467 4768s 2024-11-23 21:40:13,448 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:40:13,448 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:40:13,448 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:40:13,448 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-_rtso2ht 4768s 2024-11-23 21:40:13,448 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:40:13,451 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46645 4768s 2024-11-23 21:40:13,452 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46645 4768s 2024-11-23 21:40:13,452 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:40:13,452 - distributed.worker - INFO - dashboard at: 127.0.0.1:44893 4768s 2024-11-23 21:40:13,452 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41467 4768s 2024-11-23 21:40:13,452 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:40:13,452 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:40:13,452 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:40:13,452 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ko3q01js 4768s 2024-11-23 21:40:13,452 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:40:13,458 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35069. Reason: failure-to-start- 4768s 2024-11-23 21:40:13,458 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:40:13,459 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46645. Reason: failure-to-start- 4768s 2024-11-23 21:40:13,459 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:40:13,462 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41467': TLS handshake failed with remote 'tls://127.0.0.1:39466': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:40:13,462 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41467': TLS handshake failed with remote 'tls://127.0.0.1:39470': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:40:13,464 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:40:14,472 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:40:14,485 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45431 4768s 2024-11-23 21:40:14,486 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34255/status 4768s 2024-11-23 21:40:14,486 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:40:14,516 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35989 4768s 2024-11-23 21:40:14,516 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35989 4768s 2024-11-23 21:40:14,516 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:40:14,516 - distributed.worker - INFO - dashboard at: 127.0.0.1:38013 4768s 2024-11-23 21:40:14,516 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45431 4768s 2024-11-23 21:40:14,516 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:40:14,516 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:40:14,516 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:40:14,517 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-l8dv77z1 4768s 2024-11-23 21:40:14,517 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:40:14,520 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37357 4768s 2024-11-23 21:40:14,520 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37357 4768s 2024-11-23 21:40:14,520 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:40:14,520 - distributed.worker - INFO - dashboard at: 127.0.0.1:35667 4768s 2024-11-23 21:40:14,520 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45431 4768s 2024-11-23 21:40:14,520 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:40:14,520 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:40:14,520 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:40:14,520 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-uyzx4q07 4768s 2024-11-23 21:40:14,521 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:40:14,526 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35989. Reason: failure-to-start- 4768s 2024-11-23 21:40:14,527 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:40:14,527 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37357. Reason: failure-to-start- 4768s 2024-11-23 21:40:14,528 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:40:14,530 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45431': TLS handshake failed with remote 'tls://127.0.0.1:33456': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:40:14,530 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45431': TLS handshake failed with remote 'tls://127.0.0.1:33468': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:40:14,536 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:40:15,543 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:40:15,553 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42383 4768s 2024-11-23 21:40:15,554 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40023/status 4768s 2024-11-23 21:40:15,554 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:40:15,582 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37217 4768s 2024-11-23 21:40:15,583 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37217 4768s 2024-11-23 21:40:15,583 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:40:15,583 - distributed.worker - INFO - dashboard at: 127.0.0.1:43561 4768s 2024-11-23 21:40:15,583 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42383 4768s 2024-11-23 21:40:15,583 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:40:15,583 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:40:15,583 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:40:15,583 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-e3qpgzi5 4768s 2024-11-23 21:40:15,583 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:40:15,587 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42559 4768s 2024-11-23 21:40:15,587 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42559 4768s 2024-11-23 21:40:15,587 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:40:15,587 - distributed.worker - INFO - dashboard at: 127.0.0.1:37163 4768s 2024-11-23 21:40:15,587 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42383 4768s 2024-11-23 21:40:15,587 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:40:15,587 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:40:15,587 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:40:15,587 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-331iyk66 4768s 2024-11-23 21:40:15,587 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:40:15,594 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37217. Reason: failure-to-start- 4768s 2024-11-23 21:40:15,594 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:40:15,594 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42559. Reason: failure-to-start- 4768s 2024-11-23 21:40:15,595 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:40:15,597 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42383': TLS handshake failed with remote 'tls://127.0.0.1:51206': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:40:15,597 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42383': TLS handshake failed with remote 'tls://127.0.0.1:51208': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:40:15,604 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:40:16,611 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:40:16,621 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35595 4768s 2024-11-23 21:40:16,622 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41883/status 4768s 2024-11-23 21:40:16,622 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:40:16,649 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43655 4768s 2024-11-23 21:40:16,649 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43655 4768s 2024-11-23 21:40:16,650 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:40:16,650 - distributed.worker - INFO - dashboard at: 127.0.0.1:45217 4768s 2024-11-23 21:40:16,650 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35595 4768s 2024-11-23 21:40:16,650 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:40:16,650 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:40:16,650 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:40:16,650 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-pfx_c404 4768s 2024-11-23 21:40:16,650 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:40:16,653 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39725 4768s 2024-11-23 21:40:16,654 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39725 4768s 2024-11-23 21:40:16,654 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:40:16,654 - distributed.worker - INFO - dashboard at: 127.0.0.1:43295 4768s 2024-11-23 21:40:16,654 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35595 4768s 2024-11-23 21:40:16,654 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:40:16,654 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:40:16,654 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:40:16,654 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-cj9b317d 4768s 2024-11-23 21:40:16,654 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:40:16,660 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43655. Reason: failure-to-start- 4768s 2024-11-23 21:40:16,660 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:40:16,661 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39725. Reason: failure-to-start- 4768s 2024-11-23 21:40:16,661 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:40:16,664 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35595': TLS handshake failed with remote 'tls://127.0.0.1:52472': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:40:16,664 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35595': TLS handshake failed with remote 'tls://127.0.0.1:52474': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:40:16,669 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:40:17,676 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:40:17,686 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39401 4768s 2024-11-23 21:40:17,687 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39611/status 4768s 2024-11-23 21:40:17,687 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:40:17,714 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42441 4768s 2024-11-23 21:40:17,714 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42441 4768s 2024-11-23 21:40:17,714 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:40:17,714 - distributed.worker - INFO - dashboard at: 127.0.0.1:38815 4768s 2024-11-23 21:40:17,714 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39401 4768s 2024-11-23 21:40:17,714 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:40:17,715 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:40:17,715 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:40:17,715 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-jmo7p4xs 4768s 2024-11-23 21:40:17,715 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:40:17,720 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41799 4768s 2024-11-23 21:40:17,720 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41799 4768s 2024-11-23 21:40:17,720 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:40:17,720 - distributed.worker - INFO - dashboard at: 127.0.0.1:33591 4768s 2024-11-23 21:40:17,720 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39401 4768s 2024-11-23 21:40:17,720 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:40:17,720 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:40:17,720 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:40:17,720 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ywgutv22 4768s 2024-11-23 21:40:17,720 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:40:17,726 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42441. Reason: failure-to-start- 4768s 2024-11-23 21:40:17,726 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:40:17,727 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41799. Reason: failure-to-start- 4768s 2024-11-23 21:40:17,727 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:40:17,729 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39401': TLS handshake failed with remote 'tls://127.0.0.1:49876': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:40:17,730 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39401': TLS handshake failed with remote 'tls://127.0.0.1:49892': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:40:17,735 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:40:18,746 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:40:18,756 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37433 4768s 2024-11-23 21:40:18,756 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43817/status 4768s 2024-11-23 21:40:18,757 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:40:18,779 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40217 4768s 2024-11-23 21:40:18,779 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40217 4768s 2024-11-23 21:40:18,779 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:40:18,779 - distributed.worker - INFO - dashboard at: 127.0.0.1:42679 4768s 2024-11-23 21:40:18,779 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37433 4768s 2024-11-23 21:40:18,779 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:40:18,779 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:40:18,780 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:40:18,780 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-2itozyf2 4768s 2024-11-23 21:40:18,780 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:40:18,783 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36177 4768s 2024-11-23 21:40:18,783 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36177 4768s 2024-11-23 21:40:18,784 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:40:18,784 - distributed.worker - INFO - dashboard at: 127.0.0.1:41711 4768s 2024-11-23 21:40:18,784 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37433 4768s 2024-11-23 21:40:18,784 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:40:18,784 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:40:18,784 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:40:18,784 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-rurqmxpq 4768s 2024-11-23 21:40:18,784 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:40:18,795 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40217. Reason: failure-to-start- 4768s 2024-11-23 21:40:18,795 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:40:18,796 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36177. Reason: failure-to-start- 4768s 2024-11-23 21:40:18,796 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:40:18,799 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37433': TLS handshake failed with remote 'tls://127.0.0.1:36110': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:40:18,799 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37433': TLS handshake failed with remote 'tls://127.0.0.1:36118': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:40:18,801 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:40:19,810 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:40:19,820 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42289 4768s 2024-11-23 21:40:19,821 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42201/status 4768s 2024-11-23 21:40:19,824 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:40:19,847 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40027 4768s 2024-11-23 21:40:19,847 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40027 4768s 2024-11-23 21:40:19,848 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:40:19,848 - distributed.worker - INFO - dashboard at: 127.0.0.1:41903 4768s 2024-11-23 21:40:19,848 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42289 4768s 2024-11-23 21:40:19,848 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:40:19,848 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:40:19,848 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:40:19,848 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-u1q_inr1 4768s 2024-11-23 21:40:19,848 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:40:19,850 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37497 4768s 2024-11-23 21:40:19,850 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37497 4768s 2024-11-23 21:40:19,850 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:40:19,850 - distributed.worker - INFO - dashboard at: 127.0.0.1:42031 4768s 2024-11-23 21:40:19,850 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42289 4768s 2024-11-23 21:40:19,850 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:40:19,851 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:40:19,851 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:40:19,851 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-d68dzg5t 4768s 2024-11-23 21:40:19,851 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:40:19,852 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40027. Reason: failure-to-start- 4768s 2024-11-23 21:40:19,852 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:40:19,853 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37497. Reason: failure-to-start- 4768s 2024-11-23 21:40:19,853 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:40:19,858 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42289': TLS handshake failed with remote 'tls://127.0.0.1:35034': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:40:19,858 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42289': TLS handshake failed with remote 'tls://127.0.0.1:35042': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:40:19,860 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s _________________________________ test_gather __________________________________ 4768s 4768s fut = , timeout = 0 4768s 4768s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 4768s async with asyncio.timeout(timeout): 4768s > return await fut 4768s 4768s /usr/lib/python3/dist-packages/distributed/utils.py:1960: 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s /usr/lib/python3/dist-packages/distributed/worker.py:1480: in start_unsafe 4768s await self._register_with_scheduler() 4768s /usr/lib/python3/dist-packages/distributed/worker.py:1179: in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s /usr/lib/python3/dist-packages/distributed/comm/core.py:342: in connect 4768s comm = await wait_for( 4768s /usr/lib/python3/dist-packages/distributed/utils.py:1960: in wait_for 4768s return await fut 4768s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:546: in connect 4768s stream = await self.client.connect( 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s 4768s self = , host = '127.0.0.1' 4768s port = 45485, af = 4768s ssl_options = 4768s max_buffer_size = 8364507136.0, source_ip = None, source_port = None 4768s timeout = None 4768s 4768s async def connect( 4768s self, 4768s host: str, 4768s port: int, 4768s af: socket.AddressFamily = socket.AF_UNSPEC, 4768s ssl_options: Optional[Union[Dict[str, Any], ssl.SSLContext]] = None, 4768s max_buffer_size: Optional[int] = None, 4768s source_ip: Optional[str] = None, 4768s source_port: Optional[int] = None, 4768s timeout: Optional[Union[float, datetime.timedelta]] = None, 4768s ) -> IOStream: 4768s """Connect to the given host and port. 4768s 4768s Asynchronously returns an `.IOStream` (or `.SSLIOStream` if 4768s ``ssl_options`` is not None). 4768s 4768s Using the ``source_ip`` kwarg, one can specify the source 4768s IP address to use when establishing the connection. 4768s In case the user needs to resolve and 4768s use a specific interface, it has to be handled outside 4768s of Tornado as this depends very much on the platform. 4768s 4768s Raises `TimeoutError` if the input future does not complete before 4768s ``timeout``, which may be specified in any form allowed by 4768s `.IOLoop.add_timeout` (i.e. a `datetime.timedelta` or an absolute time 4768s relative to `.IOLoop.time`) 4768s 4768s Similarly, when the user requires a certain source port, it can 4768s be specified using the ``source_port`` arg. 4768s 4768s .. versionchanged:: 4.5 4768s Added the ``source_ip`` and ``source_port`` arguments. 4768s 4768s .. versionchanged:: 5.0 4768s Added the ``timeout`` argument. 4768s """ 4768s if timeout is not None: 4768s if isinstance(timeout, numbers.Real): 4768s timeout = IOLoop.current().time() + timeout 4768s elif isinstance(timeout, datetime.timedelta): 4768s timeout = IOLoop.current().time() + timeout.total_seconds() 4768s else: 4768s raise TypeError("Unsupported timeout %r" % timeout) 4768s if timeout is not None: 4768s addrinfo = await gen.with_timeout( 4768s timeout, self.resolver.resolve(host, port, af) 4768s ) 4768s else: 4768s addrinfo = await self.resolver.resolve(host, port, af) 4768s connector = _Connector( 4768s addrinfo, 4768s functools.partial( 4768s self._create_stream, 4768s max_buffer_size, 4768s source_ip=source_ip, 4768s source_port=source_port, 4768s ), 4768s ) 4768s > af, addr, stream = await connector.start(connect_timeout=timeout) 4768s E asyncio.exceptions.CancelledError 4768s 4768s /usr/lib/python3/dist-packages/tornado/tcpclient.py:279: CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s self = 4768s 4768s @final 4768s async def start(self): 4768s async with self._startup_lock: 4768s if self.status == Status.failed: 4768s assert self.__startup_exc is not None 4768s raise self.__startup_exc 4768s elif self.status != Status.init: 4768s return self 4768s timeout = getattr(self, "death_timeout", None) 4768s 4768s async def _close_on_failure(exc: Exception) -> None: 4768s await self.close(reason=f"failure-to-start-{str(type(exc))}") 4768s self.status = Status.failed 4768s self.__startup_exc = exc 4768s 4768s try: 4768s > await wait_for(self.start_unsafe(), timeout=timeout) 4768s 4768s /usr/lib/python3/dist-packages/distributed/core.py:664: 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 4768s async with asyncio.timeout(timeout): 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s 4768s self = 4768s exc_type = 4768s exc_val = CancelledError(), exc_tb = 4768s 4768s async def __aexit__( 4768s self, 4768s exc_type: Optional[Type[BaseException]], 4768s exc_val: Optional[BaseException], 4768s exc_tb: Optional[TracebackType], 4768s ) -> Optional[bool]: 4768s assert self._state in (_State.ENTERED, _State.EXPIRING) 4768s 4768s if self._timeout_handler is not None: 4768s self._timeout_handler.cancel() 4768s self._timeout_handler = None 4768s 4768s if self._state is _State.EXPIRING: 4768s self._state = _State.EXPIRED 4768s 4768s if self._task.uncancel() <= self._cancelling and exc_type is not None: 4768s # Since there are no new cancel requests, we're 4768s # handling this. 4768s if issubclass(exc_type, exceptions.CancelledError): 4768s > raise TimeoutError from exc_val 4768s E TimeoutError 4768s 4768s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s @contextlib.asynccontextmanager 4768s async def _cluster_factory(): 4768s workers = [] 4768s s = None 4768s try: 4768s for _ in range(60): 4768s try: 4768s > s, ws = await start_cluster( 4768s nthreads, 4768s scheduler, 4768s security=security, 4768s Worker=Worker, 4768s scheduler_kwargs=scheduler_kwargs, 4768s worker_kwargs=merge( 4768s {"death_timeout": min(15, int(deadline.remaining))}, 4768s worker_kwargs, 4768s ), 4768s ) 4768s 4768s /usr/lib/python3/dist-packages/distributed/utils_test.py:966: 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s /usr/lib/python3/dist-packages/distributed/utils_test.py:789: in start_cluster 4768s await asyncio.gather(*workers) 4768s /usr/lib/python3.13/asyncio/tasks.py:737: in _wrap_awaitable 4768s return await awaitable 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s 4768s self = 4768s 4768s @final 4768s async def start(self): 4768s async with self._startup_lock: 4768s if self.status == Status.failed: 4768s assert self.__startup_exc is not None 4768s raise self.__startup_exc 4768s elif self.status != Status.init: 4768s return self 4768s timeout = getattr(self, "death_timeout", None) 4768s 4768s async def _close_on_failure(exc: Exception) -> None: 4768s await self.close(reason=f"failure-to-start-{str(type(exc))}") 4768s self.status = Status.failed 4768s self.__startup_exc = exc 4768s 4768s try: 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s except asyncio.TimeoutError as exc: 4768s await _close_on_failure(exc) 4768s > raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s E TimeoutError: Worker start timed out after 0s. 4768s 4768s /usr/lib/python3/dist-packages/distributed/core.py:667: TimeoutError 4768s 4768s During handling of the above exception, another exception occurred: 4768s 4768s fut = ._..test_func..async_fn at 0xe99adb08> 4768s timeout = 60 4768s 4768s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 4768s async with asyncio.timeout(timeout): 4768s > return await fut 4768s 4768s /usr/lib/python3/dist-packages/distributed/utils.py:1960: 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s /usr/lib/python3/dist-packages/distributed/utils_test.py:999: in async_fn 4768s _cluster_factory() as (s, workers), 4768s /usr/lib/python3.13/contextlib.py:214: in __aenter__ 4768s return await anext(self.gen) 4768s /usr/lib/python3/dist-packages/distributed/utils_test.py:983: in _cluster_factory 4768s await asyncio.sleep(1) 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s 4768s delay = 1, result = None 4768s 4768s async def sleep(delay, result=None): 4768s """Coroutine that completes after a given time (in seconds).""" 4768s if delay <= 0: 4768s await __sleep0() 4768s return result 4768s 4768s if math.isnan(delay): 4768s raise ValueError("Invalid delay: NaN (not a number)") 4768s 4768s loop = events.get_running_loop() 4768s future = loop.create_future() 4768s h = loop.call_later(delay, 4768s futures._set_result_unless_cancelled, 4768s future, result) 4768s try: 4768s > return await future 4768s E asyncio.exceptions.CancelledError 4768s 4768s /usr/lib/python3.13/asyncio/tasks.py:718: CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s args = (), kwds = {} 4768s 4768s @wraps(func) 4768s def inner(*args, **kwds): 4768s with self._recreate_cm(): 4768s > return func(*args, **kwds) 4768s 4768s /usr/lib/python3.13/contextlib.py:85: 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s /usr/lib/python3.13/contextlib.py:85: in inner 4768s return func(*args, **kwds) 4768s /usr/lib/python3/dist-packages/distributed/utils_test.py:1102: in test_func 4768s return _run_and_close_tornado(async_fn_outer) 4768s /usr/lib/python3/dist-packages/distributed/utils_test.py:378: in _run_and_close_tornado 4768s return asyncio_run(inner_fn(), loop_factory=get_loop_factory()) 4768s /usr/lib/python3.13/asyncio/runners.py:194: in run 4768s return runner.run(main) 4768s /usr/lib/python3.13/asyncio/runners.py:118: in run 4768s return self._loop.run_until_complete(task) 4768s /usr/lib/python3.13/asyncio/base_events.py:720: in run_until_complete 4768s return future.result() 4768s /usr/lib/python3/dist-packages/distributed/utils_test.py:375: in inner_fn 4768s return await async_fn(*args, **kwargs) 4768s /usr/lib/python3/dist-packages/distributed/utils_test.py:1099: in async_fn_outer 4768s return await utils_wait_for(async_fn(), timeout=timeout * 2) 4768s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 4768s async with asyncio.timeout(timeout): 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s 4768s self = 4768s exc_type = 4768s exc_val = CancelledError(), exc_tb = 4768s 4768s async def __aexit__( 4768s self, 4768s exc_type: Optional[Type[BaseException]], 4768s exc_val: Optional[BaseException], 4768s exc_tb: Optional[TracebackType], 4768s ) -> Optional[bool]: 4768s assert self._state in (_State.ENTERED, _State.EXPIRING) 4768s 4768s if self._timeout_handler is not None: 4768s self._timeout_handler.cancel() 4768s self._timeout_handler = None 4768s 4768s if self._state is _State.EXPIRING: 4768s self._state = _State.EXPIRED 4768s 4768s if self._task.uncancel() <= self._cancelling and exc_type is not None: 4768s # Since there are no new cancel requests, we're 4768s # handling this. 4768s if issubclass(exc_type, exceptions.CancelledError): 4768s > raise TimeoutError from exc_val 4768s E TimeoutError 4768s 4768s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 4768s ----------------------------- Captured stderr call ----------------------------- 4768s 2024-11-23 21:40:20,521 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:40:20,529 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:20,530 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36139/status 4768s 2024-11-23 21:40:20,530 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:40:20,545 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39339 4768s 2024-11-23 21:40:20,545 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39339 4768s 2024-11-23 21:40:20,546 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:40:20,546 - distributed.worker - INFO - dashboard at: 127.0.0.1:43537 4768s 2024-11-23 21:40:20,546 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:20,546 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:40:20,546 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:40:20,546 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:40:20,546 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-s1nm44a7 4768s 2024-11-23 21:40:20,546 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:40:20,548 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36571 4768s 2024-11-23 21:40:20,548 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36571 4768s 2024-11-23 21:40:20,548 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:40:20,548 - distributed.worker - INFO - dashboard at: 127.0.0.1:39709 4768s 2024-11-23 21:40:20,548 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:20,548 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:40:20,548 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:40:20,549 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:40:20,549 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-fxobc90a 4768s 2024-11-23 21:40:20,549 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:40:20,562 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:20,562 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:20,563 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:42046': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:20,563 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:42048': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:20,675 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:20,676 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:20,676 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:42062': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:20,676 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:42078': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:20,790 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:20,790 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:20,791 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:42080': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:20,791 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:42092': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:20,904 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:20,905 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:20,905 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:42104': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:20,905 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:42108': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:21,019 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:21,019 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:21,019 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:42112': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:21,020 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:42126': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:21,132 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:21,132 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:21,133 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:42142': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:21,133 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:42154': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:21,246 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:21,246 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:21,246 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:42158': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:21,246 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:42168': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:21,359 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:21,359 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:21,360 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:42172': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:21,360 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:42176': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:21,472 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:21,473 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:21,473 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:42180': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:21,473 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:42188': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:21,586 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:21,586 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:21,587 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:50216': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:21,587 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:50218': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:21,700 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:21,701 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:21,701 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:50224': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:21,701 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:50234': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:21,814 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:21,814 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:21,815 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:50240': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:21,815 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:50254': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:21,928 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:21,928 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:21,929 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:50270': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:21,929 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:50278': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:22,045 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:22,046 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:22,046 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:50290': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:22,046 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:50296': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:22,159 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:22,159 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:22,159 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:50304': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:22,159 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:50314': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:22,272 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:22,272 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:22,273 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:50326': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:22,273 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:50328': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:22,388 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:22,388 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:22,389 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:50332': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:22,389 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:50346': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:22,501 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:22,502 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:22,502 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:50352': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:22,502 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:50356': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:22,617 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:22,617 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:22,617 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:50364': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:22,617 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:50376': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:22,730 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:22,730 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:22,730 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:50386': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:22,730 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:50398': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:22,843 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:22,844 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:22,844 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:50408': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:22,844 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:50416': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:22,956 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:22,957 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:22,957 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:50424': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:22,957 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:50428': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:23,070 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:23,070 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:23,071 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:50434': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:23,071 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:50444': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:23,183 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:23,183 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:23,184 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:50448': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:23,184 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:50460': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:23,297 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:23,297 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:23,298 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:50470': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:23,298 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:50484': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:23,410 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:23,410 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:23,411 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:50494': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:23,411 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:50498': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:23,524 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:23,525 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:23,525 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:50506': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:23,525 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:50518': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:23,639 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:23,639 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:23,640 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:50520': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:23,640 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:50534': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:23,753 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:23,753 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:23,754 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:50542': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:23,754 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:50548': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:23,867 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:23,867 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:23,868 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:50554': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:23,868 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:50558': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:23,981 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:23,982 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:23,982 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:50568': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:23,982 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:50582': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:24,095 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:24,095 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:24,096 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:50588': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:24,096 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:50604': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:24,210 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:24,210 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:24,211 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:50610': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:24,211 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:50620': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:24,324 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:24,324 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:24,324 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:50630': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:24,324 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:50632': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:24,438 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:24,438 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:24,439 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:50638': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:24,439 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:50652': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:24,552 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:24,552 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:24,552 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:50668': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:24,553 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:50682': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:24,665 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:24,666 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:24,666 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:50698': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:24,666 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:50714': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:24,779 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:24,779 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:24,780 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:50730': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:24,780 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:50746': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:24,893 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:24,893 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:24,893 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:50760': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:24,893 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:50766': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:25,006 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:25,007 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:25,007 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:50768': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:25,007 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:50774': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:25,122 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:25,122 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:25,123 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:50776': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:25,123 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:50790': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:25,236 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:25,236 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:25,237 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:50796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:25,237 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:50808': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:25,349 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:25,350 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:25,350 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:50812': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:25,350 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:50828': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:25,463 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:25,463 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:25,464 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:50842': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:25,464 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:50854': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:25,577 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:25,577 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:25,578 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:50866': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:25,578 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:50870': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:25,693 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:25,693 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:25,694 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:50872': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:25,694 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:50882': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:25,808 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:25,808 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:25,809 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:50894': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:25,809 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:50896': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:25,922 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:25,922 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:25,922 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:50900': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:25,922 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:50912': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:26,037 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:26,037 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:26,041 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:50928': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:26,042 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:50932': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:26,151 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:26,151 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:26,151 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:50948': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:26,151 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:50958': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:26,264 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:26,264 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:26,265 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:50970': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:26,265 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:50984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:26,378 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:26,378 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:26,379 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:50986': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:26,379 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:50994': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:26,492 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:26,492 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:26,492 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:50998': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:26,493 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:51002': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:26,606 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:26,606 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:26,607 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:51012': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:26,607 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:51024': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:26,720 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:26,721 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:26,721 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:51036': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:26,721 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:51052': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:26,835 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:26,835 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:26,836 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:51058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:26,836 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:51068': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:26,949 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:26,949 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:26,949 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:51072': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:26,949 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:51074': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:27,062 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:27,063 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:27,063 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:51078': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:27,063 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:51082': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:27,176 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:27,176 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:27,177 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:51098': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:27,177 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:51104': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:27,290 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:27,290 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:27,294 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:51112': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:27,294 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:51114': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:27,405 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:27,405 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:27,405 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:51130': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:27,405 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:51144': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:27,518 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:27,519 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:27,519 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:51160': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:27,519 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:51168': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:27,633 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:27,633 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:27,634 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:51172': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:27,634 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:51186': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:27,746 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:27,747 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:27,747 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:51198': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:27,747 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:51202': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:27,861 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:27,862 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:27,862 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:51216': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:27,862 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:51222': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:27,975 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:27,975 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:27,976 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:51226': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:27,976 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:51236': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:28,089 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:28,089 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:28,090 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:51248': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:28,090 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:51250': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:28,202 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:28,203 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:28,203 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:51266': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:28,203 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:51276': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:28,316 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:28,316 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:28,317 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:51278': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:28,317 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:51286': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:28,429 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:28,430 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:28,430 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:51300': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:28,430 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:51306': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:28,547 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:28,548 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:28,548 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:51320': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:28,548 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:51330': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:28,661 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:28,661 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:28,661 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:51336': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:28,661 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:51342': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:28,774 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:28,774 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:28,775 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:51346': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:28,775 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:51348': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:28,889 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:28,889 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:28,889 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:51354': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:28,889 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:51366': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:29,004 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:29,004 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:29,005 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:51372': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:29,005 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:51384': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:29,118 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:29,118 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:29,119 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:51400': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:29,119 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:51408': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:29,232 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:29,233 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:29,233 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:51422': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:29,233 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:51434': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:29,346 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:29,346 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:29,346 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:51444': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:29,347 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:51446': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:29,459 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:29,460 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:29,460 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:51450': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:29,460 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:51452': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:29,574 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:29,574 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:29,574 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:51460': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:29,574 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:51476': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:29,688 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:29,688 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:29,689 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:51484': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:29,689 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:51492': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:29,802 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:29,802 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:29,803 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:51506': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:29,803 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:51522': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:29,917 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:29,917 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:29,917 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:51534': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:29,918 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:51540': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:30,030 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:30,031 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:30,031 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:51546': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:30,031 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:51560': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:30,144 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:30,144 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:30,144 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:51572': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:30,145 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:51578': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:30,258 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:30,258 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:30,259 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:51586': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:30,259 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:51602': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:30,372 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:30,372 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:30,373 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:51606': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:30,373 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:51622': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:30,485 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:30,485 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:30,486 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:51628': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:30,486 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:51638': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:30,599 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:30,599 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:30,600 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:51642': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:30,600 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:51654': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:30,714 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:30,714 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:30,715 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:51660': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:30,715 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:51674': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:30,828 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:30,828 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:30,829 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:51676': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:30,829 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:51678': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:30,943 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:30,943 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:30,943 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:51680': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:30,944 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:51694': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:31,057 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:31,057 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:31,057 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:51704': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:31,057 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:51714': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:31,171 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:31,171 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:31,172 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:51728': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:31,172 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:51742': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:31,285 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:31,285 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:31,285 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:51756': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:31,286 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:51762': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:31,399 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:31,399 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:31,399 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:51764': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:31,399 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:51766': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:31,513 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:31,513 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:31,514 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:51774': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:31,514 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:51790': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:31,627 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:31,627 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:31,628 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:39864': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:31,628 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:39866': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:31,742 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:31,742 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:31,742 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:39874': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:31,743 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:39884': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:31,856 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:31,856 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:31,856 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:39892': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:31,856 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:39906': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:31,969 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:31,969 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:31,970 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:39922': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:31,970 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:39924': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:32,083 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:32,083 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:32,083 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:39938': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:32,084 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:39948': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:32,197 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:32,198 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:32,198 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:39956': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:32,198 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:39964': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:32,313 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:32,313 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:32,314 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:39968': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:32,314 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:39980': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:32,427 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:32,427 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:32,428 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:39986': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:32,428 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:40000': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:32,546 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:32,546 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:32,546 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:40006': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:32,546 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:40016': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:32,660 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:32,660 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:32,660 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:40026': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:32,660 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:40030': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:32,774 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:32,774 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:32,774 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:40044': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:32,774 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:40060': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:32,887 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:32,888 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:32,888 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:40064': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:32,888 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:40078': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:33,001 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:33,001 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:33,002 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:40082': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:33,002 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:40096': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:33,115 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:33,115 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:33,115 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:40112': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:33,115 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:40124': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:33,228 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:33,229 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:33,229 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:40140': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:33,229 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:40156': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:33,343 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:33,344 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:33,344 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:40164': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:33,344 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:40166': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:33,457 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:33,457 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:33,458 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:40180': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:33,458 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:40184': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:33,571 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:33,571 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:33,572 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:40190': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:33,572 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:40206': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:33,684 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:33,685 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:33,685 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:40220': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:33,685 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:40234': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:33,798 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:33,799 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:33,799 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:40250': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:33,799 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:40252': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:33,912 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:33,912 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:33,912 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:40266': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:33,912 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:40280': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:34,026 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:34,027 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:34,027 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:40284': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:34,027 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:40290': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:34,141 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:34,141 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:34,141 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:40298': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:34,141 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:40304': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:34,254 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:34,255 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:34,255 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:40306': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:34,255 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:40322': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:34,369 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:34,369 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:34,369 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:40324': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:34,369 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:40330': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:34,482 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:34,483 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:34,483 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:40342': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:34,483 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:40352': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:34,596 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:34,596 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:34,597 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:40360': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:34,597 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:40366': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:34,709 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:34,710 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:34,710 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:40378': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:34,710 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:40394': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:34,823 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:34,824 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:34,824 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:40400': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:34,824 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:40402': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:34,937 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:34,937 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:34,938 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:40414': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:34,938 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:40428': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:35,050 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:35,050 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:35,051 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:40430': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:35,051 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:40444': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:35,164 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:35,165 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:35,165 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:40448': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:35,165 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:40462': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:35,277 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:35,278 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:35,278 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:40478': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:35,278 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:40482': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:35,391 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:35,391 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:35,392 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:40488': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:35,392 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:40500': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:35,505 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:35,505 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37205 4768s 2024-11-23 21:40:35,506 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:40514': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:35,506 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37205': TLS handshake failed with remote 'tls://127.0.0.1:40522': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:35,546 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39339. Reason: failure-to-start- 4768s 2024-11-23 21:40:35,546 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:40:35,547 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36571. Reason: failure-to-start- 4768s 2024-11-23 21:40:35,548 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:40:35,549 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 15s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 4768s stream = await stream.start_tls( 4768s ^^^^^^^^^^^^^^^^^^^^^^^ 4768s False, ssl_options=ssl_options, server_hostname=host 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 4768s self.socket.do_handshake() 4768s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 4768s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 4768s self._sslobj.do_handshake() 4768s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 4768s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 4768s raise FatalCommClosedError( 4768s ...<2 lines>... 4768s ) from err 4768s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 4768s 4768s During handling of the above exception, another exception occurred: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1218, in _register_with_scheduler 4768s await asyncio.sleep(0.1) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 718, in sleep 4768s return await future 4768s ^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 15s. 4768s 2024-11-23 21:40:36,558 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:40:36,567 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:36,568 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38521/status 4768s 2024-11-23 21:40:36,568 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:40:36,584 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39261 4768s 2024-11-23 21:40:36,584 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39261 4768s 2024-11-23 21:40:36,584 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:40:36,584 - distributed.worker - INFO - dashboard at: 127.0.0.1:39499 4768s 2024-11-23 21:40:36,584 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:36,584 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:40:36,584 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:40:36,584 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:40:36,585 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-jlk4v79j 4768s 2024-11-23 21:40:36,585 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:40:36,587 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45607 4768s 2024-11-23 21:40:36,587 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45607 4768s 2024-11-23 21:40:36,587 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:40:36,587 - distributed.worker - INFO - dashboard at: 127.0.0.1:43515 4768s 2024-11-23 21:40:36,587 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:36,587 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:40:36,587 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:40:36,587 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:40:36,587 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-na6xayvp 4768s 2024-11-23 21:40:36,587 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:40:36,600 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:36,601 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:36,601 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:55622': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:36,601 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:55638': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:36,714 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:36,714 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:36,715 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:55644': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:36,715 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:55654': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:36,828 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:36,828 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:36,829 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:55658': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:36,829 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:55664': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:36,942 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:36,943 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:36,943 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:55678': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:36,943 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:55694': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:37,055 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:37,056 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:37,056 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:55710': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:37,056 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:55724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:37,171 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:37,171 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:37,172 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:55726': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:37,172 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:55742': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:37,285 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:37,285 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:37,286 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:55754': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:37,286 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:55766': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:37,399 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:37,399 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:37,399 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:55778': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:37,400 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:55788': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:37,513 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:37,513 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:37,513 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:55792': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:37,513 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:55798': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:37,627 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:37,627 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:37,627 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:55814': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:37,627 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:55818': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:37,744 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:37,744 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:37,745 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:55820': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:37,745 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:55834': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:37,859 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:37,859 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:37,859 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:55838': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:37,859 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:55846': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:37,976 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:37,977 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:37,977 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:55850': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:37,977 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:55864': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:38,090 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:38,090 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:38,090 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:55868': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:38,091 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:55884': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:38,203 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:38,203 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:38,204 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:55892': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:38,204 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:55896': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:38,317 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:38,318 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:38,318 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:55900': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:38,318 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:55912': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:38,432 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:38,433 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:38,433 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:55916': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:38,433 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:55918': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:38,549 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:38,549 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:38,549 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:55922': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:38,549 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:55938': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:38,663 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:38,663 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:38,664 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:55942': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:38,664 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:55958': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:38,776 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:38,776 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:38,777 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:55964': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:38,777 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:55978': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:38,890 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:38,890 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:38,890 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:55990': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:38,891 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:56004': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:39,004 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:39,004 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:39,004 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:56018': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:39,005 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:56030': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:39,117 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:39,117 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:39,118 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:56040': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:39,118 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:56044': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:39,230 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:39,231 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:39,231 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:56058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:39,231 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:56064': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:39,343 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:39,344 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:39,344 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:56076': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:39,345 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:56084': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:39,451 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:39,452 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:56086': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:39,458 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:39,458 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:56098': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:39,559 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:39,560 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:56112': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:39,567 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:39,567 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:56118': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:39,667 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:39,667 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:56120': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:39,674 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:39,675 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:56128': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:39,776 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:39,777 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:56138': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:39,783 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:39,783 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:56142': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:39,884 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:39,884 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:56156': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:39,891 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:39,891 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:56168': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:39,992 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:39,992 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:56176': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:39,998 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:39,999 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:56178': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:40,100 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:40,101 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:56188': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:40,107 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:40,108 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:56196': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:40,209 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:40,210 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:56204': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:40,216 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:40,217 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:56218': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:40,317 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:40,317 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:56224': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:40,324 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:40,325 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:56226': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:40,424 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:40,425 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:56232': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:40,431 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:40,432 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:56234': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:40,533 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:40,538 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:56250': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:40,544 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:40,545 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:56256': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:40,642 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:40,642 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:56266': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:40,652 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:40,653 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:56282': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:40,750 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:40,750 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:56294': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:40,760 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:40,761 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:56306': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:40,857 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:40,858 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:56310': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:40,868 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:40,869 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:56320': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:40,966 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:40,966 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:56328': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:40,976 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:40,976 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:56334': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:41,078 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:41,078 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:56336': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:41,085 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:41,085 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:56352': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:41,187 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:41,188 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:56356': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:41,194 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:41,194 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:56370': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:41,295 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:41,295 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:56378': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:41,302 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:41,302 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:56382': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:41,404 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:41,405 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:56386': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:41,411 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:41,412 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:56394': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:41,512 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:41,512 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:56396': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:41,519 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:41,519 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:56408': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:41,620 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:41,620 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:60530': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:41,627 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:41,627 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:60542': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:41,730 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:41,731 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:60544': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:41,737 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:41,737 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:60560': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:41,839 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:41,841 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:60568': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:41,847 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:41,847 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:60570': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:41,949 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:41,950 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:60578': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:41,956 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:41,957 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:60588': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:42,057 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:42,057 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:60600': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:42,064 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:42,064 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:60614': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:42,165 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:42,165 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:60620': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:42,172 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:42,173 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:60624': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:42,273 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:42,273 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:60638': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:42,280 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:42,280 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:60654': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:42,380 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:42,381 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:60668': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:42,387 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:42,388 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:60678': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:42,488 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:42,488 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:60694': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:42,495 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:42,495 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:60710': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:42,596 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:42,597 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:60724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:42,603 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:42,604 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:60732': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:42,704 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:42,704 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:60746': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:42,711 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:42,711 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:60758': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:42,812 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:42,813 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:60768': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:42,819 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:42,820 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:60770': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:42,920 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:42,921 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:60782': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:42,927 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:42,928 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:60796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:43,029 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:43,030 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:60804': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:43,039 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:43,040 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:60810': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:43,137 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:43,138 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:60818': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:43,147 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:43,147 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:60824': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:43,246 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:43,246 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:60828': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:43,254 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:43,254 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:60840': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:43,354 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:43,355 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:60846': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:43,361 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:43,362 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:60852': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:43,462 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:43,462 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:60862': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:43,470 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:43,471 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:60874': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:43,570 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:43,574 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:60890': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:43,580 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:43,581 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:60898': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:43,679 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:43,679 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:60914': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:43,688 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:43,689 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:60920': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:43,787 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:43,787 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:60928': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:43,796 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:43,797 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:60930': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:43,895 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:43,896 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:60936': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:43,904 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:43,904 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:60944': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:44,004 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:44,004 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:60960': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:44,011 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:44,011 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:60968': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:44,111 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:44,112 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:60972': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:44,118 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:44,119 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:60976': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:44,219 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:44,220 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:60988': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:44,226 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:44,227 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:60998': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:44,327 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:44,327 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:32780': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:44,334 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:44,335 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:32786': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:44,435 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:44,436 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:32788': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:44,442 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:44,443 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:32798': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:44,543 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:44,544 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:32812': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:44,550 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:44,551 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:32824': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:44,653 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:44,654 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:32826': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:44,660 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:44,660 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:32832': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:44,761 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:44,761 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:32840': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:44,768 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:44,768 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:32846': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:44,868 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:44,869 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:32860': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:44,875 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:44,876 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:32872': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:44,977 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:44,978 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:32874': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:44,984 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:44,985 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:32886': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:45,085 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:45,085 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:32900': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:45,093 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:45,094 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:32910': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:45,193 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:45,193 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:32912': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:45,201 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:45,202 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:32920': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:45,301 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:45,302 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:32924': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:45,308 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:45,309 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:32930': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:45,410 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:45,411 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:32932': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:45,417 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:45,418 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:32936': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:45,518 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:45,518 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:32946': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:45,525 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:45,525 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:32954': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:45,626 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:45,626 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:32962': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:45,633 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:45,634 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:32974': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:45,733 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:45,734 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:32990': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:45,741 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:45,741 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:33006': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:45,841 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:45,842 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:33012': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:45,848 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:45,849 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:33020': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:45,949 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:45,950 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:33032': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:45,956 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:45,957 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:33040': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:46,057 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:46,057 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:33048': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:46,064 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:46,064 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:33050': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:46,165 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:46,165 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:33054': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:46,172 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:46,173 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:33056': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:46,273 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:46,273 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:33060': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:46,280 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:46,280 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:33070': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:46,380 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:46,381 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:33084': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:46,388 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:46,388 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:33092': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:46,488 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:46,489 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:33104': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:46,495 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:46,496 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:33116': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:46,596 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:46,597 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:33122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:46,604 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:46,604 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:33130': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:46,704 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:46,705 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:33146': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:46,711 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:46,712 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:33158': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:46,812 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:46,813 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:33174': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:46,820 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:46,820 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:33180': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:46,921 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:46,921 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:33194': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:46,928 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:46,928 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:33204': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:47,029 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:47,030 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:33218': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:47,041 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:47,042 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:33228': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:47,138 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:47,138 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:33242': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:47,148 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:47,149 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:33244': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:47,246 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:47,246 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:33256': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:47,256 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:47,257 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:33272': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:47,354 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:47,355 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:33276': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:47,363 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:47,364 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:33290': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:47,462 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:47,463 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:33304': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:47,471 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:47,471 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:33314': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:47,571 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:47,575 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:33330': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:47,581 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:47,582 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:33342': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:47,679 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:47,679 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:33344': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:47,689 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:47,690 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:33358': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:47,787 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:47,787 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:33364': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:47,796 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:47,797 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:33366': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:47,896 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:47,896 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:33372': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:47,904 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:47,905 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:33384': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:48,004 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:48,004 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:33400': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:48,011 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:48,011 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:33414': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:48,112 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:48,112 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:33428': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:48,119 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:48,120 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:33440': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:48,220 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:48,221 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:33456': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:48,227 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:48,228 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:33464': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:48,328 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:48,328 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:33478': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:48,336 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:48,336 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:33480': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:48,439 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:48,440 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:33482': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:48,446 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:48,447 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:33486': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:48,547 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:48,547 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:33498': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:48,554 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:48,554 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:33512': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:48,655 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:48,655 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:33520': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:48,662 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:48,662 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:33534': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:48,763 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:48,763 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:33536': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:48,770 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:48,770 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:33544': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:48,871 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:48,872 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:33546': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:48,879 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:48,879 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:33560': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:48,979 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:48,980 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:33568': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:48,987 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:48,987 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:33572': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:49,088 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:49,088 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:33580': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:49,095 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:49,095 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:33594': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:49,196 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:49,197 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:33602': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:49,203 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:49,204 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:33614': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:49,304 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:49,305 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:33620': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:49,311 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:49,312 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:33624': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:49,413 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:49,414 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:33626': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:49,420 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:49,420 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:33628': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:49,521 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:49,522 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:33634': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:49,528 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35525 4768s 2024-11-23 21:40:49,529 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35525': TLS handshake failed with remote 'tls://127.0.0.1:33640': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:40:49,583 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39261. Reason: failure-to-start- 4768s 2024-11-23 21:40:49,584 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:40:49,585 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 13s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 4768s stream = await stream.start_tls( 4768s ^^^^^^^^^^^^^^^^^^^^^^^ 4768s False, ssl_options=ssl_options, server_hostname=host 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 4768s self.socket.do_handshake() 4768s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 4768s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 4768s self._sslobj.do_handshake() 4768s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 4768s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 4768s raise FatalCommClosedError( 4768s ...<2 lines>... 4768s ) from err 4768s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 4768s 4768s During handling of the above exception, another exception occurred: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1218, in _register_with_scheduler 4768s await asyncio.sleep(0.1) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 718, in sleep 4768s return await future 4768s ^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 13s. 4768s 2024-11-23 21:40:49,589 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45607. Reason: failure-to-start- 4768s 2024-11-23 21:40:49,589 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:40:50,593 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:40:50,600 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43501 4768s 2024-11-23 21:40:50,601 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41981/status 4768s 2024-11-23 21:40:50,601 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:40:50,617 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38241 4768s 2024-11-23 21:40:50,617 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38241 4768s 2024-11-23 21:40:50,617 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:40:50,617 - distributed.worker - INFO - dashboard at: 127.0.0.1:44229 4768s 2024-11-23 21:40:50,617 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43501 4768s 2024-11-23 21:40:50,617 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:40:50,617 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:40:50,617 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:40:50,617 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-boh9y2oc 4768s 2024-11-23 21:40:50,617 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:40:50,620 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33613 4768s 2024-11-23 21:40:50,620 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33613 4768s 2024-11-23 21:40:50,620 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:40:50,620 - distributed.worker - INFO - dashboard at: 127.0.0.1:42751 4768s 2024-11-23 21:40:50,620 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43501 4768s 2024-11-23 21:40:50,620 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:40:50,620 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:40:50,620 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:40:50,620 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-4su83g3g 4768s 2024-11-23 21:40:50,620 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:40:50,621 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38241. Reason: failure-to-start- 4768s 2024-11-23 21:40:50,621 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:40:50,622 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33613. Reason: failure-to-start- 4768s 2024-11-23 21:40:50,622 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:40:50,623 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43501': TLS handshake failed with remote 'tls://127.0.0.1:46302': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:40:50,623 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43501': TLS handshake failed with remote 'tls://127.0.0.1:46316': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:40:50,625 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:40:51,631 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:40:51,640 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40329 4768s 2024-11-23 21:40:51,640 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44559/status 4768s 2024-11-23 21:40:51,640 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:40:51,658 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42081 4768s 2024-11-23 21:40:51,658 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42081 4768s 2024-11-23 21:40:51,658 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:40:51,658 - distributed.worker - INFO - dashboard at: 127.0.0.1:45673 4768s 2024-11-23 21:40:51,658 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40329 4768s 2024-11-23 21:40:51,658 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:40:51,658 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:40:51,658 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:40:51,658 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-r2uo_4km 4768s 2024-11-23 21:40:51,658 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:40:51,661 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38551 4768s 2024-11-23 21:40:51,661 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38551 4768s 2024-11-23 21:40:51,661 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:40:51,661 - distributed.worker - INFO - dashboard at: 127.0.0.1:41595 4768s 2024-11-23 21:40:51,662 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40329 4768s 2024-11-23 21:40:51,662 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:40:51,662 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:40:51,662 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:40:51,662 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-fz_u_kc7 4768s 2024-11-23 21:40:51,662 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:40:51,663 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42081. Reason: failure-to-start- 4768s 2024-11-23 21:40:51,663 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:40:51,664 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38551. Reason: failure-to-start- 4768s 2024-11-23 21:40:51,664 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:40:51,665 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40329': TLS handshake failed with remote 'tls://127.0.0.1:36926': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:40:51,666 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40329': TLS handshake failed with remote 'tls://127.0.0.1:36934': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:40:51,668 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:40:52,674 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:40:52,682 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41013 4768s 2024-11-23 21:40:52,683 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40187/status 4768s 2024-11-23 21:40:52,683 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:40:52,698 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39679 4768s 2024-11-23 21:40:52,698 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39679 4768s 2024-11-23 21:40:52,698 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:40:52,698 - distributed.worker - INFO - dashboard at: 127.0.0.1:38175 4768s 2024-11-23 21:40:52,699 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41013 4768s 2024-11-23 21:40:52,699 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:40:52,699 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:40:52,699 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:40:52,699 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-na8x1h1b 4768s 2024-11-23 21:40:52,699 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:40:52,701 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45785 4768s 2024-11-23 21:40:52,701 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45785 4768s 2024-11-23 21:40:52,701 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:40:52,701 - distributed.worker - INFO - dashboard at: 127.0.0.1:33501 4768s 2024-11-23 21:40:52,701 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41013 4768s 2024-11-23 21:40:52,701 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:40:52,702 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:40:52,702 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:40:52,702 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-b7m6q2mc 4768s 2024-11-23 21:40:52,702 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:40:52,703 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39679. Reason: failure-to-start- 4768s 2024-11-23 21:40:52,703 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:40:52,703 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45785. Reason: failure-to-start- 4768s 2024-11-23 21:40:52,704 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:40:52,705 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41013': TLS handshake failed with remote 'tls://127.0.0.1:59844': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:40:52,705 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41013': TLS handshake failed with remote 'tls://127.0.0.1:59852': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:40:52,707 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:40:53,714 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:40:53,722 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44695 4768s 2024-11-23 21:40:53,722 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44727/status 4768s 2024-11-23 21:40:53,723 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:40:53,737 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:32941 4768s 2024-11-23 21:40:53,737 - distributed.worker - INFO - Listening to: tls://127.0.0.1:32941 4768s 2024-11-23 21:40:53,737 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:40:53,737 - distributed.worker - INFO - dashboard at: 127.0.0.1:42021 4768s 2024-11-23 21:40:53,737 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44695 4768s 2024-11-23 21:40:53,737 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:40:53,737 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:40:53,737 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:40:53,737 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-1pqv0000 4768s 2024-11-23 21:40:53,737 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:40:53,739 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45299 4768s 2024-11-23 21:40:53,739 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45299 4768s 2024-11-23 21:40:53,740 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:40:53,740 - distributed.worker - INFO - dashboard at: 127.0.0.1:35713 4768s 2024-11-23 21:40:53,740 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44695 4768s 2024-11-23 21:40:53,740 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:40:53,740 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:40:53,740 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:40:53,740 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-6yaijje9 4768s 2024-11-23 21:40:53,740 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:40:53,741 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:32941. Reason: failure-to-start- 4768s 2024-11-23 21:40:53,741 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:40:53,742 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45299. Reason: failure-to-start- 4768s 2024-11-23 21:40:53,742 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:40:53,743 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44695': TLS handshake failed with remote 'tls://127.0.0.1:48532': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:40:53,743 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44695': TLS handshake failed with remote 'tls://127.0.0.1:48542': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:40:53,745 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:40:54,751 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:40:54,760 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42863 4768s 2024-11-23 21:40:54,760 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35253/status 4768s 2024-11-23 21:40:54,760 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:40:54,777 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37145 4768s 2024-11-23 21:40:54,777 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37145 4768s 2024-11-23 21:40:54,777 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:40:54,777 - distributed.worker - INFO - dashboard at: 127.0.0.1:40793 4768s 2024-11-23 21:40:54,777 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42863 4768s 2024-11-23 21:40:54,777 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:40:54,777 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:40:54,777 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:40:54,777 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-3xll1olq 4768s 2024-11-23 21:40:54,777 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:40:54,780 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43519 4768s 2024-11-23 21:40:54,780 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43519 4768s 2024-11-23 21:40:54,780 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:40:54,780 - distributed.worker - INFO - dashboard at: 127.0.0.1:46635 4768s 2024-11-23 21:40:54,780 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42863 4768s 2024-11-23 21:40:54,780 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:40:54,780 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:40:54,780 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:40:54,781 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-2fidpmn3 4768s 2024-11-23 21:40:54,781 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:40:54,782 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37145. Reason: failure-to-start- 4768s 2024-11-23 21:40:54,782 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:40:54,782 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43519. Reason: failure-to-start- 4768s 2024-11-23 21:40:54,783 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:40:54,784 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42863': TLS handshake failed with remote 'tls://127.0.0.1:48870': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:40:54,785 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42863': TLS handshake failed with remote 'tls://127.0.0.1:48886': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:40:54,786 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:40:55,793 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:40:55,802 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41187 4768s 2024-11-23 21:40:55,802 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37391/status 4768s 2024-11-23 21:40:55,802 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:40:55,820 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33613 4768s 2024-11-23 21:40:55,821 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33613 4768s 2024-11-23 21:40:55,821 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:40:55,821 - distributed.worker - INFO - dashboard at: 127.0.0.1:42953 4768s 2024-11-23 21:40:55,821 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41187 4768s 2024-11-23 21:40:55,821 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:40:55,821 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:40:55,821 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:40:55,821 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-yx9_5ete 4768s 2024-11-23 21:40:55,821 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:40:55,824 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37427 4768s 2024-11-23 21:40:55,824 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37427 4768s 2024-11-23 21:40:55,824 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:40:55,824 - distributed.worker - INFO - dashboard at: 127.0.0.1:39205 4768s 2024-11-23 21:40:55,824 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41187 4768s 2024-11-23 21:40:55,824 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:40:55,824 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:40:55,824 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:40:55,825 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-6vqr_p7q 4768s 2024-11-23 21:40:55,825 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:40:55,826 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33613. Reason: failure-to-start- 4768s 2024-11-23 21:40:55,826 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:40:55,827 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37427. Reason: failure-to-start- 4768s 2024-11-23 21:40:55,827 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:40:55,828 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41187': TLS handshake failed with remote 'tls://127.0.0.1:58384': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:40:55,829 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41187': TLS handshake failed with remote 'tls://127.0.0.1:58400': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:40:55,830 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:40:56,837 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:40:56,845 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35065 4768s 2024-11-23 21:40:56,845 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37045/status 4768s 2024-11-23 21:40:56,845 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:40:56,861 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37413 4768s 2024-11-23 21:40:56,861 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37413 4768s 2024-11-23 21:40:56,861 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:40:56,861 - distributed.worker - INFO - dashboard at: 127.0.0.1:41435 4768s 2024-11-23 21:40:56,861 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35065 4768s 2024-11-23 21:40:56,861 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:40:56,861 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:40:56,861 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:40:56,861 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ys77gmm5 4768s 2024-11-23 21:40:56,862 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:40:56,864 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36273 4768s 2024-11-23 21:40:56,864 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36273 4768s 2024-11-23 21:40:56,864 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:40:56,864 - distributed.worker - INFO - dashboard at: 127.0.0.1:36903 4768s 2024-11-23 21:40:56,864 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35065 4768s 2024-11-23 21:40:56,864 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:40:56,864 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:40:56,864 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:40:56,864 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-cvo0h42y 4768s 2024-11-23 21:40:56,865 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:40:56,866 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37413. Reason: failure-to-start- 4768s 2024-11-23 21:40:56,866 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:40:56,867 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36273. Reason: failure-to-start- 4768s 2024-11-23 21:40:56,868 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:40:56,870 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35065': TLS handshake failed with remote 'tls://127.0.0.1:57294': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:40:56,870 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35065': TLS handshake failed with remote 'tls://127.0.0.1:57306': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:40:56,872 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:40:57,878 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:40:57,886 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44357 4768s 2024-11-23 21:40:57,887 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35807/status 4768s 2024-11-23 21:40:57,887 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:40:57,902 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33861 4768s 2024-11-23 21:40:57,902 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33861 4768s 2024-11-23 21:40:57,902 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:40:57,902 - distributed.worker - INFO - dashboard at: 127.0.0.1:42165 4768s 2024-11-23 21:40:57,902 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44357 4768s 2024-11-23 21:40:57,902 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:40:57,902 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:40:57,902 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:40:57,902 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-sml6g8oy 4768s 2024-11-23 21:40:57,902 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:40:57,904 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44039 4768s 2024-11-23 21:40:57,905 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44039 4768s 2024-11-23 21:40:57,905 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:40:57,905 - distributed.worker - INFO - dashboard at: 127.0.0.1:36991 4768s 2024-11-23 21:40:57,905 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44357 4768s 2024-11-23 21:40:57,905 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:40:57,905 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:40:57,905 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:40:57,905 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ebl25orj 4768s 2024-11-23 21:40:57,905 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:40:57,907 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33861. Reason: failure-to-start- 4768s 2024-11-23 21:40:57,907 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:40:57,907 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44039. Reason: failure-to-start- 4768s 2024-11-23 21:40:57,907 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:40:57,909 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44357': TLS handshake failed with remote 'tls://127.0.0.1:51498': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:40:57,909 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44357': TLS handshake failed with remote 'tls://127.0.0.1:51514': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:40:57,911 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:40:58,916 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:40:58,926 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43055 4768s 2024-11-23 21:40:58,926 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40035/status 4768s 2024-11-23 21:40:58,927 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:40:58,944 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35141 4768s 2024-11-23 21:40:58,944 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35141 4768s 2024-11-23 21:40:58,944 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:40:58,944 - distributed.worker - INFO - dashboard at: 127.0.0.1:44591 4768s 2024-11-23 21:40:58,944 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43055 4768s 2024-11-23 21:40:58,944 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:40:58,944 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:40:58,944 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:40:58,944 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-_wgvenzh 4768s 2024-11-23 21:40:58,944 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:40:58,947 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35263 4768s 2024-11-23 21:40:58,947 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35263 4768s 2024-11-23 21:40:58,947 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:40:58,947 - distributed.worker - INFO - dashboard at: 127.0.0.1:42317 4768s 2024-11-23 21:40:58,947 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43055 4768s 2024-11-23 21:40:58,947 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:40:58,947 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:40:58,947 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:40:58,947 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-jd08nria 4768s 2024-11-23 21:40:58,948 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:40:58,949 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35141. Reason: failure-to-start- 4768s 2024-11-23 21:40:58,949 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:40:58,950 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35263. Reason: failure-to-start- 4768s 2024-11-23 21:40:58,950 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:40:58,951 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43055': TLS handshake failed with remote 'tls://127.0.0.1:49474': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:40:58,952 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43055': TLS handshake failed with remote 'tls://127.0.0.1:49486': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:40:58,953 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:40:59,960 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:40:59,968 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34729 4768s 2024-11-23 21:40:59,968 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33067/status 4768s 2024-11-23 21:40:59,969 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:40:59,986 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:32807 4768s 2024-11-23 21:40:59,986 - distributed.worker - INFO - Listening to: tls://127.0.0.1:32807 4768s 2024-11-23 21:40:59,986 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:40:59,986 - distributed.worker - INFO - dashboard at: 127.0.0.1:44345 4768s 2024-11-23 21:40:59,986 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34729 4768s 2024-11-23 21:40:59,986 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:40:59,986 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:40:59,986 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:40:59,986 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-csg8wxjn 4768s 2024-11-23 21:40:59,986 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:40:59,989 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33991 4768s 2024-11-23 21:40:59,989 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33991 4768s 2024-11-23 21:40:59,989 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:40:59,989 - distributed.worker - INFO - dashboard at: 127.0.0.1:38289 4768s 2024-11-23 21:40:59,989 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34729 4768s 2024-11-23 21:40:59,989 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:40:59,989 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:40:59,989 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:40:59,989 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-4uae04vx 4768s 2024-11-23 21:40:59,990 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:40:59,991 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:32807. Reason: failure-to-start- 4768s 2024-11-23 21:40:59,991 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:40:59,992 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33991. Reason: failure-to-start- 4768s 2024-11-23 21:40:59,992 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:40:59,993 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34729': TLS handshake failed with remote 'tls://127.0.0.1:47636': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:40:59,994 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34729': TLS handshake failed with remote 'tls://127.0.0.1:47640': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:40:59,995 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:41:01,001 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:41:01,010 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46445 4768s 2024-11-23 21:41:01,010 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38605/status 4768s 2024-11-23 21:41:01,011 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:41:01,027 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43431 4768s 2024-11-23 21:41:01,028 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43431 4768s 2024-11-23 21:41:01,028 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:41:01,028 - distributed.worker - INFO - dashboard at: 127.0.0.1:45195 4768s 2024-11-23 21:41:01,028 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46445 4768s 2024-11-23 21:41:01,028 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:41:01,028 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:41:01,028 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:41:01,028 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-roiiosu7 4768s 2024-11-23 21:41:01,028 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:41:01,030 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46015 4768s 2024-11-23 21:41:01,031 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46015 4768s 2024-11-23 21:41:01,031 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:41:01,031 - distributed.worker - INFO - dashboard at: 127.0.0.1:39075 4768s 2024-11-23 21:41:01,032 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46445 4768s 2024-11-23 21:41:01,032 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:41:01,032 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:41:01,032 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:41:01,032 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-k65hl6fe 4768s 2024-11-23 21:41:01,032 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:41:01,034 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43431. Reason: failure-to-start- 4768s 2024-11-23 21:41:01,034 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:41:01,034 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46015. Reason: failure-to-start- 4768s 2024-11-23 21:41:01,035 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:41:01,039 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46445': TLS handshake failed with remote 'tls://127.0.0.1:59114': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:41:01,039 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46445': TLS handshake failed with remote 'tls://127.0.0.1:59120': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:41:01,041 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:41:02,047 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:41:02,056 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33751 4768s 2024-11-23 21:41:02,057 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42471/status 4768s 2024-11-23 21:41:02,057 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:41:02,074 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38459 4768s 2024-11-23 21:41:02,074 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38459 4768s 2024-11-23 21:41:02,074 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:41:02,074 - distributed.worker - INFO - dashboard at: 127.0.0.1:33777 4768s 2024-11-23 21:41:02,074 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33751 4768s 2024-11-23 21:41:02,074 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:41:02,074 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:41:02,074 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:41:02,074 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-h7s2uomy 4768s 2024-11-23 21:41:02,074 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:41:02,077 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43525 4768s 2024-11-23 21:41:02,077 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43525 4768s 2024-11-23 21:41:02,077 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:41:02,077 - distributed.worker - INFO - dashboard at: 127.0.0.1:46679 4768s 2024-11-23 21:41:02,077 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33751 4768s 2024-11-23 21:41:02,077 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:41:02,077 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:41:02,078 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:41:02,078 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ioxpegsh 4768s 2024-11-23 21:41:02,078 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:41:02,082 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38459. Reason: failure-to-start- 4768s 2024-11-23 21:41:02,082 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:41:02,083 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43525. Reason: failure-to-start- 4768s 2024-11-23 21:41:02,083 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:41:02,084 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33751': TLS handshake failed with remote 'tls://127.0.0.1:51022': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:41:02,084 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33751': TLS handshake failed with remote 'tls://127.0.0.1:51030': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:41:02,086 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:41:03,094 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:41:03,102 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46037 4768s 2024-11-23 21:41:03,102 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33587/status 4768s 2024-11-23 21:41:03,102 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:41:03,122 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37629 4768s 2024-11-23 21:41:03,122 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37629 4768s 2024-11-23 21:41:03,122 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:41:03,123 - distributed.worker - INFO - dashboard at: 127.0.0.1:39899 4768s 2024-11-23 21:41:03,123 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46037 4768s 2024-11-23 21:41:03,123 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:41:03,123 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:41:03,123 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:41:03,123 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ujaicjh6 4768s 2024-11-23 21:41:03,123 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:41:03,125 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38273 4768s 2024-11-23 21:41:03,126 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38273 4768s 2024-11-23 21:41:03,126 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:41:03,126 - distributed.worker - INFO - dashboard at: 127.0.0.1:42205 4768s 2024-11-23 21:41:03,126 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46037 4768s 2024-11-23 21:41:03,126 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:41:03,126 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:41:03,126 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:41:03,126 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-lfrp3j6v 4768s 2024-11-23 21:41:03,126 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:41:03,127 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37629. Reason: failure-to-start- 4768s 2024-11-23 21:41:03,128 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:41:03,128 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38273. Reason: failure-to-start- 4768s 2024-11-23 21:41:03,128 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:41:03,130 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46037': TLS handshake failed with remote 'tls://127.0.0.1:58740': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:41:03,130 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46037': TLS handshake failed with remote 'tls://127.0.0.1:58752': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:41:03,132 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:41:04,138 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:41:04,146 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33917 4768s 2024-11-23 21:41:04,146 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37783/status 4768s 2024-11-23 21:41:04,146 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:41:04,180 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45165 4768s 2024-11-23 21:41:04,181 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45165 4768s 2024-11-23 21:41:04,181 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:41:04,181 - distributed.worker - INFO - dashboard at: 127.0.0.1:44807 4768s 2024-11-23 21:41:04,181 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33917 4768s 2024-11-23 21:41:04,181 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:41:04,181 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:41:04,181 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:41:04,181 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-m_md01al 4768s 2024-11-23 21:41:04,181 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:41:04,183 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40859 4768s 2024-11-23 21:41:04,184 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40859 4768s 2024-11-23 21:41:04,184 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:41:04,184 - distributed.worker - INFO - dashboard at: 127.0.0.1:34905 4768s 2024-11-23 21:41:04,184 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33917 4768s 2024-11-23 21:41:04,184 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:41:04,184 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:41:04,184 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:41:04,184 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-tmq53pee 4768s 2024-11-23 21:41:04,184 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:41:04,186 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45165. Reason: failure-to-start- 4768s 2024-11-23 21:41:04,186 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:41:04,186 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40859. Reason: failure-to-start- 4768s 2024-11-23 21:41:04,186 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:41:04,191 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33917': TLS handshake failed with remote 'tls://127.0.0.1:56604': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:41:04,191 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33917': TLS handshake failed with remote 'tls://127.0.0.1:56610': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:41:04,193 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:41:05,199 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:41:05,207 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36699 4768s 2024-11-23 21:41:05,207 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37501/status 4768s 2024-11-23 21:41:05,207 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:41:05,223 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38965 4768s 2024-11-23 21:41:05,224 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38965 4768s 2024-11-23 21:41:05,224 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:41:05,224 - distributed.worker - INFO - dashboard at: 127.0.0.1:43985 4768s 2024-11-23 21:41:05,224 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36699 4768s 2024-11-23 21:41:05,224 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:41:05,224 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:41:05,224 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:41:05,224 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-vuer8hu_ 4768s 2024-11-23 21:41:05,224 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:41:05,228 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34373 4768s 2024-11-23 21:41:05,228 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34373 4768s 2024-11-23 21:41:05,228 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:41:05,228 - distributed.worker - INFO - dashboard at: 127.0.0.1:34939 4768s 2024-11-23 21:41:05,228 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36699 4768s 2024-11-23 21:41:05,228 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:41:05,228 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:41:05,228 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:41:05,228 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-wvldr4z_ 4768s 2024-11-23 21:41:05,228 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:41:05,230 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38965. Reason: failure-to-start- 4768s 2024-11-23 21:41:05,230 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:41:05,230 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34373. Reason: failure-to-start- 4768s 2024-11-23 21:41:05,231 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:41:05,235 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36699': TLS handshake failed with remote 'tls://127.0.0.1:45306': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:41:05,235 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36699': TLS handshake failed with remote 'tls://127.0.0.1:45308': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:41:05,236 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:41:06,244 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:41:06,252 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42489 4768s 2024-11-23 21:41:06,252 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41279/status 4768s 2024-11-23 21:41:06,252 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:41:06,269 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35455 4768s 2024-11-23 21:41:06,269 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35455 4768s 2024-11-23 21:41:06,269 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:41:06,269 - distributed.worker - INFO - dashboard at: 127.0.0.1:41775 4768s 2024-11-23 21:41:06,269 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42489 4768s 2024-11-23 21:41:06,269 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:41:06,269 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:41:06,269 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:41:06,270 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-rxdb0np3 4768s 2024-11-23 21:41:06,270 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:41:06,272 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45107 4768s 2024-11-23 21:41:06,272 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45107 4768s 2024-11-23 21:41:06,272 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:41:06,272 - distributed.worker - INFO - dashboard at: 127.0.0.1:33777 4768s 2024-11-23 21:41:06,272 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42489 4768s 2024-11-23 21:41:06,272 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:41:06,272 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:41:06,272 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:41:06,272 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-e6upl61m 4768s 2024-11-23 21:41:06,273 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:41:06,277 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35455. Reason: failure-to-start- 4768s 2024-11-23 21:41:06,278 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:41:06,278 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45107. Reason: failure-to-start- 4768s 2024-11-23 21:41:06,278 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:41:06,280 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42489': TLS handshake failed with remote 'tls://127.0.0.1:42936': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:41:06,280 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42489': TLS handshake failed with remote 'tls://127.0.0.1:42952': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:41:06,282 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:41:07,290 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:41:07,298 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39063 4768s 2024-11-23 21:41:07,299 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35823/status 4768s 2024-11-23 21:41:07,299 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:41:07,317 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44553 4768s 2024-11-23 21:41:07,317 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44553 4768s 2024-11-23 21:41:07,317 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:41:07,317 - distributed.worker - INFO - dashboard at: 127.0.0.1:39341 4768s 2024-11-23 21:41:07,317 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39063 4768s 2024-11-23 21:41:07,317 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:41:07,317 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:41:07,317 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:41:07,317 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-vtdtexda 4768s 2024-11-23 21:41:07,317 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:41:07,320 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43813 4768s 2024-11-23 21:41:07,320 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43813 4768s 2024-11-23 21:41:07,320 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:41:07,320 - distributed.worker - INFO - dashboard at: 127.0.0.1:34731 4768s 2024-11-23 21:41:07,320 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39063 4768s 2024-11-23 21:41:07,320 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:41:07,320 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:41:07,320 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:41:07,320 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-s1aqf475 4768s 2024-11-23 21:41:07,320 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:41:07,325 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44553. Reason: failure-to-start- 4768s 2024-11-23 21:41:07,326 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:41:07,326 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43813. Reason: failure-to-start- 4768s 2024-11-23 21:41:07,326 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:41:07,328 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39063': TLS handshake failed with remote 'tls://127.0.0.1:52280': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:41:07,328 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39063': TLS handshake failed with remote 'tls://127.0.0.1:52296': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:41:07,330 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:41:08,336 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:41:08,345 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34139 4768s 2024-11-23 21:41:08,345 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33301/status 4768s 2024-11-23 21:41:08,345 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:41:08,365 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41257 4768s 2024-11-23 21:41:08,365 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41257 4768s 2024-11-23 21:41:08,365 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:41:08,365 - distributed.worker - INFO - dashboard at: 127.0.0.1:36505 4768s 2024-11-23 21:41:08,365 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34139 4768s 2024-11-23 21:41:08,365 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:41:08,365 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:41:08,365 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:41:08,365 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ci4zww3m 4768s 2024-11-23 21:41:08,365 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:41:08,368 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42507 4768s 2024-11-23 21:41:08,368 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42507 4768s 2024-11-23 21:41:08,368 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:41:08,368 - distributed.worker - INFO - dashboard at: 127.0.0.1:46881 4768s 2024-11-23 21:41:08,368 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34139 4768s 2024-11-23 21:41:08,368 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:41:08,368 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:41:08,368 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:41:08,368 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-4x_9zd4v 4768s 2024-11-23 21:41:08,368 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:41:08,372 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41257. Reason: failure-to-start- 4768s 2024-11-23 21:41:08,373 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:41:08,373 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42507. Reason: failure-to-start- 4768s 2024-11-23 21:41:08,373 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:41:08,375 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34139': TLS handshake failed with remote 'tls://127.0.0.1:45684': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:41:08,375 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34139': TLS handshake failed with remote 'tls://127.0.0.1:45696': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:41:08,377 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:41:09,383 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:41:09,391 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33987 4768s 2024-11-23 21:41:09,392 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41523/status 4768s 2024-11-23 21:41:09,392 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:41:09,413 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41295 4768s 2024-11-23 21:41:09,413 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41295 4768s 2024-11-23 21:41:09,413 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:41:09,413 - distributed.worker - INFO - dashboard at: 127.0.0.1:43155 4768s 2024-11-23 21:41:09,413 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33987 4768s 2024-11-23 21:41:09,413 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:41:09,413 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:41:09,413 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:41:09,413 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-uyvgw6qz 4768s 2024-11-23 21:41:09,413 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:41:09,416 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34899 4768s 2024-11-23 21:41:09,416 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34899 4768s 2024-11-23 21:41:09,416 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:41:09,416 - distributed.worker - INFO - dashboard at: 127.0.0.1:32805 4768s 2024-11-23 21:41:09,416 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33987 4768s 2024-11-23 21:41:09,416 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:41:09,416 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:41:09,416 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:41:09,416 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-5jcg37wj 4768s 2024-11-23 21:41:09,416 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:41:09,418 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41295. Reason: failure-to-start- 4768s 2024-11-23 21:41:09,418 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:41:09,419 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34899. Reason: failure-to-start- 4768s 2024-11-23 21:41:09,419 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:41:09,420 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33987': TLS handshake failed with remote 'tls://127.0.0.1:32938': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:41:09,420 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33987': TLS handshake failed with remote 'tls://127.0.0.1:32952': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:41:09,422 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:41:10,428 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:41:10,436 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44239 4768s 2024-11-23 21:41:10,436 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39047/status 4768s 2024-11-23 21:41:10,437 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:41:10,456 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33557 4768s 2024-11-23 21:41:10,457 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33557 4768s 2024-11-23 21:41:10,457 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:41:10,457 - distributed.worker - INFO - dashboard at: 127.0.0.1:36845 4768s 2024-11-23 21:41:10,457 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44239 4768s 2024-11-23 21:41:10,457 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:41:10,457 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:41:10,457 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:41:10,457 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-3xz9owpg 4768s 2024-11-23 21:41:10,457 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:41:10,459 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38405 4768s 2024-11-23 21:41:10,460 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38405 4768s 2024-11-23 21:41:10,460 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:41:10,460 - distributed.worker - INFO - dashboard at: 127.0.0.1:46419 4768s 2024-11-23 21:41:10,460 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44239 4768s 2024-11-23 21:41:10,460 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:41:10,460 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:41:10,460 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:41:10,460 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-unl5f378 4768s 2024-11-23 21:41:10,460 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:41:10,463 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33557. Reason: failure-to-start- 4768s 2024-11-23 21:41:10,463 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:41:10,464 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38405. Reason: failure-to-start- 4768s 2024-11-23 21:41:10,464 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:41:10,465 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44239': TLS handshake failed with remote 'tls://127.0.0.1:58600': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:41:10,466 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44239': TLS handshake failed with remote 'tls://127.0.0.1:58604': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:41:10,467 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:41:11,477 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:41:11,485 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45935 4768s 2024-11-23 21:41:11,485 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39945/status 4768s 2024-11-23 21:41:11,486 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:41:11,504 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41319 4768s 2024-11-23 21:41:11,504 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41319 4768s 2024-11-23 21:41:11,504 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:41:11,504 - distributed.worker - INFO - dashboard at: 127.0.0.1:43621 4768s 2024-11-23 21:41:11,504 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45935 4768s 2024-11-23 21:41:11,504 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:41:11,504 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:41:11,504 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:41:11,504 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-v975yt_h 4768s 2024-11-23 21:41:11,504 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:41:11,507 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38255 4768s 2024-11-23 21:41:11,507 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38255 4768s 2024-11-23 21:41:11,507 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:41:11,507 - distributed.worker - INFO - dashboard at: 127.0.0.1:40121 4768s 2024-11-23 21:41:11,508 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45935 4768s 2024-11-23 21:41:11,508 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:41:11,508 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:41:11,508 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:41:11,508 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-vn2all7k 4768s 2024-11-23 21:41:11,508 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:41:11,509 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41319. Reason: failure-to-start- 4768s 2024-11-23 21:41:11,510 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:41:11,510 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38255. Reason: failure-to-start- 4768s 2024-11-23 21:41:11,511 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:41:11,512 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45935': TLS handshake failed with remote 'tls://127.0.0.1:56628': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:41:11,512 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45935': TLS handshake failed with remote 'tls://127.0.0.1:56640': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:41:11,518 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:41:12,526 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:41:12,535 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33175 4768s 2024-11-23 21:41:12,535 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35597/status 4768s 2024-11-23 21:41:12,536 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:41:12,561 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40753 4768s 2024-11-23 21:41:12,561 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40753 4768s 2024-11-23 21:41:12,561 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:41:12,561 - distributed.worker - INFO - dashboard at: 127.0.0.1:45113 4768s 2024-11-23 21:41:12,561 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33175 4768s 2024-11-23 21:41:12,561 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:41:12,561 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:41:12,562 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:41:12,562 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-pnmxncck 4768s 2024-11-23 21:41:12,562 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:41:12,564 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44483 4768s 2024-11-23 21:41:12,565 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44483 4768s 2024-11-23 21:41:12,565 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:41:12,565 - distributed.worker - INFO - dashboard at: 127.0.0.1:46361 4768s 2024-11-23 21:41:12,565 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33175 4768s 2024-11-23 21:41:12,565 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:41:12,565 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:41:12,565 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:41:12,565 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-1gmjjo3v 4768s 2024-11-23 21:41:12,565 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:41:12,570 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40753. Reason: failure-to-start- 4768s 2024-11-23 21:41:12,570 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:41:12,571 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44483. Reason: failure-to-start- 4768s 2024-11-23 21:41:12,571 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:41:12,573 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33175': TLS handshake failed with remote 'tls://127.0.0.1:34158': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:41:12,573 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33175': TLS handshake failed with remote 'tls://127.0.0.1:34162': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:41:12,578 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:41:13,585 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:41:13,593 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35465 4768s 2024-11-23 21:41:13,593 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41707/status 4768s 2024-11-23 21:41:13,594 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:41:13,611 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45315 4768s 2024-11-23 21:41:13,612 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45315 4768s 2024-11-23 21:41:13,612 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:41:13,612 - distributed.worker - INFO - dashboard at: 127.0.0.1:38747 4768s 2024-11-23 21:41:13,612 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35465 4768s 2024-11-23 21:41:13,612 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:41:13,612 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:41:13,612 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:41:13,612 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-olotq7xr 4768s 2024-11-23 21:41:13,612 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:41:13,614 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39553 4768s 2024-11-23 21:41:13,615 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39553 4768s 2024-11-23 21:41:13,615 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:41:13,615 - distributed.worker - INFO - dashboard at: 127.0.0.1:40843 4768s 2024-11-23 21:41:13,615 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35465 4768s 2024-11-23 21:41:13,615 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:41:13,615 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:41:13,615 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:41:13,615 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-38b8kljo 4768s 2024-11-23 21:41:13,615 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:41:13,621 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45315. Reason: failure-to-start- 4768s 2024-11-23 21:41:13,621 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:41:13,622 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39553. Reason: failure-to-start- 4768s 2024-11-23 21:41:13,622 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:41:13,624 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35465': TLS handshake failed with remote 'tls://127.0.0.1:41934': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:41:13,624 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35465': TLS handshake failed with remote 'tls://127.0.0.1:41942': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:41:13,625 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:41:14,632 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:41:14,640 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37711 4768s 2024-11-23 21:41:14,640 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37087/status 4768s 2024-11-23 21:41:14,641 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:41:14,663 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33365 4768s 2024-11-23 21:41:14,663 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33365 4768s 2024-11-23 21:41:14,664 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:41:14,664 - distributed.worker - INFO - dashboard at: 127.0.0.1:43683 4768s 2024-11-23 21:41:14,664 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37711 4768s 2024-11-23 21:41:14,664 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:41:14,664 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:41:14,664 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:41:14,664 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-dbblpd_9 4768s 2024-11-23 21:41:14,664 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:41:14,666 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38741 4768s 2024-11-23 21:41:14,666 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38741 4768s 2024-11-23 21:41:14,667 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:41:14,667 - distributed.worker - INFO - dashboard at: 127.0.0.1:46311 4768s 2024-11-23 21:41:14,667 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37711 4768s 2024-11-23 21:41:14,667 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:41:14,667 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:41:14,667 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:41:14,667 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-2sthy96h 4768s 2024-11-23 21:41:14,667 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:41:14,672 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33365. Reason: failure-to-start- 4768s 2024-11-23 21:41:14,672 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:41:14,672 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38741. Reason: failure-to-start- 4768s 2024-11-23 21:41:14,672 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:41:14,674 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37711': TLS handshake failed with remote 'tls://127.0.0.1:47080': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:41:14,674 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37711': TLS handshake failed with remote 'tls://127.0.0.1:47092': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:41:14,676 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:41:15,682 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:41:15,691 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35187 4768s 2024-11-23 21:41:15,691 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33903/status 4768s 2024-11-23 21:41:15,692 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:41:15,714 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40639 4768s 2024-11-23 21:41:15,715 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40639 4768s 2024-11-23 21:41:15,715 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:41:15,715 - distributed.worker - INFO - dashboard at: 127.0.0.1:44065 4768s 2024-11-23 21:41:15,715 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35187 4768s 2024-11-23 21:41:15,715 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:41:15,715 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:41:15,715 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:41:15,715 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-cpjfozt2 4768s 2024-11-23 21:41:15,715 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:41:15,718 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33741 4768s 2024-11-23 21:41:15,719 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33741 4768s 2024-11-23 21:41:15,719 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:41:15,720 - distributed.worker - INFO - dashboard at: 127.0.0.1:35477 4768s 2024-11-23 21:41:15,720 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35187 4768s 2024-11-23 21:41:15,720 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:41:15,720 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:41:15,720 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:41:15,720 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-lgfjcdo3 4768s 2024-11-23 21:41:15,720 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:41:15,725 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40639. Reason: failure-to-start- 4768s 2024-11-23 21:41:15,725 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:41:15,726 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33741. Reason: failure-to-start- 4768s 2024-11-23 21:41:15,726 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:41:15,728 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35187': TLS handshake failed with remote 'tls://127.0.0.1:49224': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:41:15,728 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35187': TLS handshake failed with remote 'tls://127.0.0.1:49238': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:41:15,733 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:41:16,738 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:41:16,747 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45117 4768s 2024-11-23 21:41:16,748 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33637/status 4768s 2024-11-23 21:41:16,748 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:41:16,766 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36043 4768s 2024-11-23 21:41:16,767 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36043 4768s 2024-11-23 21:41:16,767 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:41:16,767 - distributed.worker - INFO - dashboard at: 127.0.0.1:39863 4768s 2024-11-23 21:41:16,767 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45117 4768s 2024-11-23 21:41:16,767 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:41:16,767 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:41:16,767 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:41:16,767 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-2hjg4o4o 4768s 2024-11-23 21:41:16,767 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:41:16,770 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38115 4768s 2024-11-23 21:41:16,770 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38115 4768s 2024-11-23 21:41:16,770 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:41:16,770 - distributed.worker - INFO - dashboard at: 127.0.0.1:36233 4768s 2024-11-23 21:41:16,770 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45117 4768s 2024-11-23 21:41:16,770 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:41:16,770 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:41:16,770 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:41:16,771 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-s4gd45pl 4768s 2024-11-23 21:41:16,771 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:41:16,779 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36043. Reason: failure-to-start- 4768s 2024-11-23 21:41:16,779 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:41:16,780 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38115. Reason: failure-to-start- 4768s 2024-11-23 21:41:16,780 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:41:16,782 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45117': TLS handshake failed with remote 'tls://127.0.0.1:49452': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:41:16,782 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45117': TLS handshake failed with remote 'tls://127.0.0.1:49466': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:41:16,784 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:41:17,790 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:41:17,798 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33549 4768s 2024-11-23 21:41:17,799 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37541/status 4768s 2024-11-23 21:41:17,799 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:41:17,819 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44895 4768s 2024-11-23 21:41:17,819 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44895 4768s 2024-11-23 21:41:17,819 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:41:17,819 - distributed.worker - INFO - dashboard at: 127.0.0.1:33517 4768s 2024-11-23 21:41:17,819 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33549 4768s 2024-11-23 21:41:17,819 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:41:17,819 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:41:17,819 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:41:17,819 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-w1mb2hrx 4768s 2024-11-23 21:41:17,820 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:41:17,822 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41891 4768s 2024-11-23 21:41:17,823 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41891 4768s 2024-11-23 21:41:17,823 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:41:17,823 - distributed.worker - INFO - dashboard at: 127.0.0.1:37747 4768s 2024-11-23 21:41:17,823 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33549 4768s 2024-11-23 21:41:17,823 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:41:17,823 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:41:17,823 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:41:17,823 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-4frbus2r 4768s 2024-11-23 21:41:17,823 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:41:17,828 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44895. Reason: failure-to-start- 4768s 2024-11-23 21:41:17,828 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:41:17,828 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41891. Reason: failure-to-start- 4768s 2024-11-23 21:41:17,829 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:41:17,831 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33549': TLS handshake failed with remote 'tls://127.0.0.1:58980': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:41:17,831 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33549': TLS handshake failed with remote 'tls://127.0.0.1:58986': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:41:17,833 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:41:18,841 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:41:18,849 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43915 4768s 2024-11-23 21:41:18,850 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44999/status 4768s 2024-11-23 21:41:18,850 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:41:18,872 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37609 4768s 2024-11-23 21:41:18,872 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37609 4768s 2024-11-23 21:41:18,872 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:41:18,872 - distributed.worker - INFO - dashboard at: 127.0.0.1:38113 4768s 2024-11-23 21:41:18,872 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43915 4768s 2024-11-23 21:41:18,872 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:41:18,873 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:41:18,873 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:41:18,873 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-jepe624u 4768s 2024-11-23 21:41:18,873 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:41:18,875 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42123 4768s 2024-11-23 21:41:18,875 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42123 4768s 2024-11-23 21:41:18,875 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:41:18,875 - distributed.worker - INFO - dashboard at: 127.0.0.1:39349 4768s 2024-11-23 21:41:18,875 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43915 4768s 2024-11-23 21:41:18,875 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:41:18,875 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:41:18,875 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:41:18,876 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-zjhtlwil 4768s 2024-11-23 21:41:18,876 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:41:18,877 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37609. Reason: failure-to-start- 4768s 2024-11-23 21:41:18,877 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:41:18,878 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42123. Reason: failure-to-start- 4768s 2024-11-23 21:41:18,878 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:41:18,880 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43915': TLS handshake failed with remote 'tls://127.0.0.1:45496': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:41:18,880 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43915': TLS handshake failed with remote 'tls://127.0.0.1:45508': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:41:18,881 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:41:19,888 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:41:19,895 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45485 4768s 2024-11-23 21:41:19,896 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35685/status 4768s 2024-11-23 21:41:19,896 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:41:19,935 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35825 4768s 2024-11-23 21:41:19,936 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35825 4768s 2024-11-23 21:41:19,936 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:41:19,936 - distributed.worker - INFO - dashboard at: 127.0.0.1:38523 4768s 2024-11-23 21:41:19,936 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45485 4768s 2024-11-23 21:41:19,936 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:41:19,936 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:41:19,936 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:41:19,936 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-0zpr28xi 4768s 2024-11-23 21:41:19,936 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:41:19,938 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45185 4768s 2024-11-23 21:41:19,938 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45185 4768s 2024-11-23 21:41:19,938 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:41:19,939 - distributed.worker - INFO - dashboard at: 127.0.0.1:43951 4768s 2024-11-23 21:41:19,939 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45485 4768s 2024-11-23 21:41:19,939 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:41:19,939 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:41:19,939 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:41:19,939 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-erab7x4d 4768s 2024-11-23 21:41:19,939 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:41:19,943 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35825. Reason: failure-to-start- 4768s 2024-11-23 21:41:19,943 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:41:19,944 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45185. Reason: failure-to-start- 4768s 2024-11-23 21:41:19,944 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:41:19,946 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45485': TLS handshake failed with remote 'tls://127.0.0.1:55412': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:41:19,946 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45485': TLS handshake failed with remote 'tls://127.0.0.1:55418': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:41:19,950 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s _________________________________ test_scatter _________________________________ 4768s 4768s fut = , timeout = 0 4768s 4768s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 4768s async with asyncio.timeout(timeout): 4768s > return await fut 4768s 4768s /usr/lib/python3/dist-packages/distributed/utils.py:1960: 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s /usr/lib/python3/dist-packages/distributed/worker.py:1480: in start_unsafe 4768s await self._register_with_scheduler() 4768s /usr/lib/python3/dist-packages/distributed/worker.py:1179: in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s /usr/lib/python3/dist-packages/distributed/comm/core.py:342: in connect 4768s comm = await wait_for( 4768s /usr/lib/python3/dist-packages/distributed/utils.py:1960: in wait_for 4768s return await fut 4768s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:546: in connect 4768s stream = await self.client.connect( 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s 4768s self = , host = '127.0.0.1' 4768s port = 37589, af = 4768s ssl_options = 4768s max_buffer_size = 8364507136.0, source_ip = None, source_port = None 4768s timeout = None 4768s 4768s async def connect( 4768s self, 4768s host: str, 4768s port: int, 4768s af: socket.AddressFamily = socket.AF_UNSPEC, 4768s ssl_options: Optional[Union[Dict[str, Any], ssl.SSLContext]] = None, 4768s max_buffer_size: Optional[int] = None, 4768s source_ip: Optional[str] = None, 4768s source_port: Optional[int] = None, 4768s timeout: Optional[Union[float, datetime.timedelta]] = None, 4768s ) -> IOStream: 4768s """Connect to the given host and port. 4768s 4768s Asynchronously returns an `.IOStream` (or `.SSLIOStream` if 4768s ``ssl_options`` is not None). 4768s 4768s Using the ``source_ip`` kwarg, one can specify the source 4768s IP address to use when establishing the connection. 4768s In case the user needs to resolve and 4768s use a specific interface, it has to be handled outside 4768s of Tornado as this depends very much on the platform. 4768s 4768s Raises `TimeoutError` if the input future does not complete before 4768s ``timeout``, which may be specified in any form allowed by 4768s `.IOLoop.add_timeout` (i.e. a `datetime.timedelta` or an absolute time 4768s relative to `.IOLoop.time`) 4768s 4768s Similarly, when the user requires a certain source port, it can 4768s be specified using the ``source_port`` arg. 4768s 4768s .. versionchanged:: 4.5 4768s Added the ``source_ip`` and ``source_port`` arguments. 4768s 4768s .. versionchanged:: 5.0 4768s Added the ``timeout`` argument. 4768s """ 4768s if timeout is not None: 4768s if isinstance(timeout, numbers.Real): 4768s timeout = IOLoop.current().time() + timeout 4768s elif isinstance(timeout, datetime.timedelta): 4768s timeout = IOLoop.current().time() + timeout.total_seconds() 4768s else: 4768s raise TypeError("Unsupported timeout %r" % timeout) 4768s if timeout is not None: 4768s addrinfo = await gen.with_timeout( 4768s timeout, self.resolver.resolve(host, port, af) 4768s ) 4768s else: 4768s addrinfo = await self.resolver.resolve(host, port, af) 4768s connector = _Connector( 4768s addrinfo, 4768s functools.partial( 4768s self._create_stream, 4768s max_buffer_size, 4768s source_ip=source_ip, 4768s source_port=source_port, 4768s ), 4768s ) 4768s > af, addr, stream = await connector.start(connect_timeout=timeout) 4768s E asyncio.exceptions.CancelledError 4768s 4768s /usr/lib/python3/dist-packages/tornado/tcpclient.py:279: CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s self = 4768s 4768s @final 4768s async def start(self): 4768s async with self._startup_lock: 4768s if self.status == Status.failed: 4768s assert self.__startup_exc is not None 4768s raise self.__startup_exc 4768s elif self.status != Status.init: 4768s return self 4768s timeout = getattr(self, "death_timeout", None) 4768s 4768s async def _close_on_failure(exc: Exception) -> None: 4768s await self.close(reason=f"failure-to-start-{str(type(exc))}") 4768s self.status = Status.failed 4768s self.__startup_exc = exc 4768s 4768s try: 4768s > await wait_for(self.start_unsafe(), timeout=timeout) 4768s 4768s /usr/lib/python3/dist-packages/distributed/core.py:664: 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 4768s async with asyncio.timeout(timeout): 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s 4768s self = 4768s exc_type = 4768s exc_val = CancelledError(), exc_tb = 4768s 4768s async def __aexit__( 4768s self, 4768s exc_type: Optional[Type[BaseException]], 4768s exc_val: Optional[BaseException], 4768s exc_tb: Optional[TracebackType], 4768s ) -> Optional[bool]: 4768s assert self._state in (_State.ENTERED, _State.EXPIRING) 4768s 4768s if self._timeout_handler is not None: 4768s self._timeout_handler.cancel() 4768s self._timeout_handler = None 4768s 4768s if self._state is _State.EXPIRING: 4768s self._state = _State.EXPIRED 4768s 4768s if self._task.uncancel() <= self._cancelling and exc_type is not None: 4768s # Since there are no new cancel requests, we're 4768s # handling this. 4768s if issubclass(exc_type, exceptions.CancelledError): 4768s > raise TimeoutError from exc_val 4768s E TimeoutError 4768s 4768s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s @contextlib.asynccontextmanager 4768s async def _cluster_factory(): 4768s workers = [] 4768s s = None 4768s try: 4768s for _ in range(60): 4768s try: 4768s > s, ws = await start_cluster( 4768s nthreads, 4768s scheduler, 4768s security=security, 4768s Worker=Worker, 4768s scheduler_kwargs=scheduler_kwargs, 4768s worker_kwargs=merge( 4768s {"death_timeout": min(15, int(deadline.remaining))}, 4768s worker_kwargs, 4768s ), 4768s ) 4768s 4768s /usr/lib/python3/dist-packages/distributed/utils_test.py:966: 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s /usr/lib/python3/dist-packages/distributed/utils_test.py:789: in start_cluster 4768s await asyncio.gather(*workers) 4768s /usr/lib/python3.13/asyncio/tasks.py:737: in _wrap_awaitable 4768s return await awaitable 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s 4768s self = 4768s 4768s @final 4768s async def start(self): 4768s async with self._startup_lock: 4768s if self.status == Status.failed: 4768s assert self.__startup_exc is not None 4768s raise self.__startup_exc 4768s elif self.status != Status.init: 4768s return self 4768s timeout = getattr(self, "death_timeout", None) 4768s 4768s async def _close_on_failure(exc: Exception) -> None: 4768s await self.close(reason=f"failure-to-start-{str(type(exc))}") 4768s self.status = Status.failed 4768s self.__startup_exc = exc 4768s 4768s try: 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s except asyncio.TimeoutError as exc: 4768s await _close_on_failure(exc) 4768s > raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s E TimeoutError: Worker start timed out after 0s. 4768s 4768s /usr/lib/python3/dist-packages/distributed/core.py:667: TimeoutError 4768s 4768s During handling of the above exception, another exception occurred: 4768s 4768s fut = ._..test_func..async_fn at 0xe99adcd8> 4768s timeout = 60 4768s 4768s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 4768s async with asyncio.timeout(timeout): 4768s > return await fut 4768s 4768s /usr/lib/python3/dist-packages/distributed/utils.py:1960: 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s /usr/lib/python3/dist-packages/distributed/utils_test.py:999: in async_fn 4768s _cluster_factory() as (s, workers), 4768s /usr/lib/python3.13/contextlib.py:214: in __aenter__ 4768s return await anext(self.gen) 4768s /usr/lib/python3/dist-packages/distributed/utils_test.py:983: in _cluster_factory 4768s await asyncio.sleep(1) 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s 4768s delay = 1, result = None 4768s 4768s async def sleep(delay, result=None): 4768s """Coroutine that completes after a given time (in seconds).""" 4768s if delay <= 0: 4768s await __sleep0() 4768s return result 4768s 4768s if math.isnan(delay): 4768s raise ValueError("Invalid delay: NaN (not a number)") 4768s 4768s loop = events.get_running_loop() 4768s future = loop.create_future() 4768s h = loop.call_later(delay, 4768s futures._set_result_unless_cancelled, 4768s future, result) 4768s try: 4768s > return await future 4768s E asyncio.exceptions.CancelledError 4768s 4768s /usr/lib/python3.13/asyncio/tasks.py:718: CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s args = (), kwds = {} 4768s 4768s @wraps(func) 4768s def inner(*args, **kwds): 4768s with self._recreate_cm(): 4768s > return func(*args, **kwds) 4768s 4768s /usr/lib/python3.13/contextlib.py:85: 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s /usr/lib/python3.13/contextlib.py:85: in inner 4768s return func(*args, **kwds) 4768s /usr/lib/python3/dist-packages/distributed/utils_test.py:1102: in test_func 4768s return _run_and_close_tornado(async_fn_outer) 4768s /usr/lib/python3/dist-packages/distributed/utils_test.py:378: in _run_and_close_tornado 4768s return asyncio_run(inner_fn(), loop_factory=get_loop_factory()) 4768s /usr/lib/python3.13/asyncio/runners.py:194: in run 4768s return runner.run(main) 4768s /usr/lib/python3.13/asyncio/runners.py:118: in run 4768s return self._loop.run_until_complete(task) 4768s /usr/lib/python3.13/asyncio/base_events.py:720: in run_until_complete 4768s return future.result() 4768s /usr/lib/python3/dist-packages/distributed/utils_test.py:375: in inner_fn 4768s return await async_fn(*args, **kwargs) 4768s /usr/lib/python3/dist-packages/distributed/utils_test.py:1099: in async_fn_outer 4768s return await utils_wait_for(async_fn(), timeout=timeout * 2) 4768s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 4768s async with asyncio.timeout(timeout): 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s 4768s self = 4768s exc_type = 4768s exc_val = CancelledError(), exc_tb = 4768s 4768s async def __aexit__( 4768s self, 4768s exc_type: Optional[Type[BaseException]], 4768s exc_val: Optional[BaseException], 4768s exc_tb: Optional[TracebackType], 4768s ) -> Optional[bool]: 4768s assert self._state in (_State.ENTERED, _State.EXPIRING) 4768s 4768s if self._timeout_handler is not None: 4768s self._timeout_handler.cancel() 4768s self._timeout_handler = None 4768s 4768s if self._state is _State.EXPIRING: 4768s self._state = _State.EXPIRED 4768s 4768s if self._task.uncancel() <= self._cancelling and exc_type is not None: 4768s # Since there are no new cancel requests, we're 4768s # handling this. 4768s if issubclass(exc_type, exceptions.CancelledError): 4768s > raise TimeoutError from exc_val 4768s E TimeoutError 4768s 4768s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 4768s ----------------------------- Captured stderr call ----------------------------- 4768s 2024-11-23 21:41:21,037 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:41:21,046 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:21,046 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44579/status 4768s 2024-11-23 21:41:21,046 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:41:21,063 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40293 4768s 2024-11-23 21:41:21,063 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40293 4768s 2024-11-23 21:41:21,063 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:41:21,063 - distributed.worker - INFO - dashboard at: 127.0.0.1:38075 4768s 2024-11-23 21:41:21,063 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:21,063 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:41:21,063 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:41:21,063 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:41:21,063 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-73uqk9ew 4768s 2024-11-23 21:41:21,063 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:41:21,066 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45199 4768s 2024-11-23 21:41:21,066 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45199 4768s 2024-11-23 21:41:21,066 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:41:21,066 - distributed.worker - INFO - dashboard at: 127.0.0.1:45269 4768s 2024-11-23 21:41:21,066 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:21,066 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:41:21,066 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:41:21,066 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:41:21,066 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-9u5mjk0_ 4768s 2024-11-23 21:41:21,066 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:41:21,079 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:21,080 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:21,080 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:34708': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:21,080 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:34724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:21,193 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:21,193 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:21,193 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:34732': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:21,193 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:34742': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:21,306 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:21,306 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:21,307 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:34746': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:21,307 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:34762': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:21,421 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:21,422 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:21,422 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:34772': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:21,422 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:34788': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:21,535 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:21,535 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:21,535 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:34800': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:21,535 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:34814': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:21,648 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:21,648 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:21,649 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:35444': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:21,649 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:35458': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:21,761 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:21,761 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:21,762 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:35464': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:21,762 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:35474': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:21,875 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:21,875 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:21,876 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:35478': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:21,876 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:35492': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:21,989 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:21,990 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:21,990 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:35498': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:21,990 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:35502': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:22,103 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:22,103 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:22,104 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:35504': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:22,104 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:35514': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:22,217 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:22,218 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:22,218 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:35524': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:22,218 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:35534': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:22,331 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:22,331 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:22,331 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:35546': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:22,331 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:35558': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:22,444 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:22,444 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:22,444 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:35574': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:22,444 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:35582': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:22,562 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:22,562 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:22,563 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:35594': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:22,563 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:35610': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:22,675 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:22,675 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:22,676 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:35618': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:22,676 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:35622': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:22,789 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:22,789 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:22,789 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:35628': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:22,789 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:35642': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:22,903 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:22,903 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:22,904 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:35648': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:22,904 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:35664': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:23,016 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:23,016 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:23,017 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:35678': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:23,017 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:35690': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:23,133 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:23,134 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:23,134 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:35696': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:23,134 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:35712': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:23,246 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:23,247 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:23,247 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:35716': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:23,247 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:35726': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:23,359 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:23,360 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:23,360 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:35736': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:23,360 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:35742': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:23,472 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:23,473 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:23,473 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:35758': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:23,473 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:35772': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:23,587 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:23,587 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:23,587 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:35776': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:23,587 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:35790': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:23,699 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:23,700 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:23,700 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:35796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:23,700 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:35806': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:23,813 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:23,813 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:23,814 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:35820': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:23,814 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:35828': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:23,928 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:23,928 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:23,929 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:35840': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:23,929 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:35848': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:24,041 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:24,041 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:24,042 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:35856': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:24,042 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:35864': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:24,155 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:24,155 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:24,155 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:35868': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:24,155 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:35872': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:24,267 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:24,268 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:24,268 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:35886': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:24,268 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:35896': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:24,381 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:24,381 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:24,382 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:35908': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:24,382 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:35922': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:24,495 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:24,495 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:24,496 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:35928': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:24,496 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:35936': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:24,609 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:24,610 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:24,610 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:35948': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:24,610 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:35954': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:24,723 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:24,723 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:24,724 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:35964': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:24,724 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:35972': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:24,838 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:24,838 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:24,838 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:35988': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:24,838 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:35996': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:24,952 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:24,953 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:24,953 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:36010': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:24,953 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:36014': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:25,066 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:25,066 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:25,067 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:36026': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:25,067 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:36030': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:25,179 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:25,180 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:25,180 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:36038': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:25,180 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:36044': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:25,292 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:25,293 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:25,293 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:36056': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:25,293 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:36062': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:25,406 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:25,406 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:25,406 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:36074': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:25,406 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:36086': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:25,519 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:25,519 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:25,519 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:36098': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:25,519 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:36104': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:25,633 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:25,634 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:25,634 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:36108': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:25,634 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:36122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:25,747 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:25,747 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:25,748 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:36134': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:25,748 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:36138': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:25,862 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:25,862 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:25,862 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:36148': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:25,862 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:36150': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:25,975 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:25,975 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:25,976 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:36166': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:25,976 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:36172': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:26,089 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:26,089 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:26,089 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:36188': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:26,090 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:36194': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:26,202 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:26,202 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:26,203 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:36202': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:26,203 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:36218': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:26,316 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:26,316 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:26,317 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:36234': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:26,317 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:36248': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:26,429 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:26,429 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:26,430 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:36262': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:26,430 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:36276': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:26,544 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:26,544 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:26,545 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:36292': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:26,545 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:36302': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:26,658 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:26,658 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:26,659 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:36310': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:26,659 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:36314': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:26,773 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:26,773 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:26,773 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:36326': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:26,774 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:36332': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:26,888 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:26,888 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:26,888 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:36346': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:26,888 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:36356': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:27,000 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:27,001 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:27,001 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:36368': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:27,002 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:36384': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:27,109 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:27,114 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:36398': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:27,115 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:27,116 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:36408': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:27,217 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:27,218 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:36414': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:27,224 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:27,225 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:36424': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:27,325 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:27,325 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:36434': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:27,332 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:27,332 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:36442': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:27,433 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:27,434 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:36458': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:27,440 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:27,441 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:36464': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:27,542 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:27,543 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:36478': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:27,550 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:27,554 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:36492': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:27,651 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:27,652 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:36498': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:27,658 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:27,659 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:36500': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:27,758 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:27,759 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:36506': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:27,765 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:27,766 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:36512': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:27,866 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:27,866 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:36520': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:27,873 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:27,873 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:36534': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:27,974 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:27,975 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:36538': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:27,981 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:27,982 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:36550': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:28,082 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:28,083 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:36556': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:28,089 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:28,090 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:36562': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:28,189 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:28,190 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:36578': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:28,196 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:28,197 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:36582': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:28,298 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:28,299 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:36584': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:28,306 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:28,306 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:36592': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:28,406 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:28,406 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:36608': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:28,413 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:28,415 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:36620': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:28,514 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:28,515 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:36628': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:28,522 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:28,522 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:36636': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:28,623 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:28,623 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:36644': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:28,630 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:28,630 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:36648': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:28,731 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:28,731 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:36650': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:28,738 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:28,738 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:36666': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:28,838 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:28,839 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:36670': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:28,845 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:28,846 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:36676': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:28,946 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:28,947 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:36686': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:28,953 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:28,954 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:36694': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:29,057 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:29,058 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:36698': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:29,065 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:29,065 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:36710': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:29,165 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:29,166 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:36722': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:29,172 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:29,173 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:36726': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:29,274 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:29,275 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:36732': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:29,281 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:29,282 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:36744': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:29,382 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:29,383 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:36746': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:29,389 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:29,390 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:36752': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:29,491 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:29,492 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:36768': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:29,498 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:29,499 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:36774': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:29,600 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:29,601 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:36778': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:29,607 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:29,608 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:36792': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:29,707 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:29,708 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:36798': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:29,714 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:29,715 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:36810': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:29,815 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:29,816 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:36822': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:29,822 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:29,823 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:36832': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:29,923 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:29,924 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:36848': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:29,930 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:29,931 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:36858': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:30,032 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:30,033 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:36870': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:30,039 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:30,040 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:36880': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:30,141 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:30,141 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:36894': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:30,148 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:30,149 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:36900': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:30,250 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:30,251 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:36912': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:30,257 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:30,258 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:36922': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:30,358 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:30,358 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:36938': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:30,365 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:30,365 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:36952': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:30,465 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:30,466 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:36962': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:30,472 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:30,473 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:36970': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:30,573 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:30,573 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:36980': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:30,580 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:30,581 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:36990': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:30,682 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:30,683 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:37006': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:30,689 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:30,690 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:37022': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:30,790 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:30,790 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:37034': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:30,797 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:30,798 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:37038': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:30,898 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:30,898 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:37044': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:30,905 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:30,906 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:37054': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:31,005 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:31,006 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:37070': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:31,013 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:31,013 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:37086': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:31,113 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:31,114 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:37096': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:31,121 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:31,121 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:37108': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:31,221 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:31,222 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:37122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:31,229 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:31,229 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:37132': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:31,329 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:31,330 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:37134': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:31,337 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:31,337 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:37146': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:31,437 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:31,438 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:37152': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:31,444 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:31,445 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:37168': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:31,545 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:31,545 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:49670': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:31,556 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:31,557 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:49674': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:31,654 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:31,654 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:49676': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:31,664 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:31,665 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:49688': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:31,764 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:31,764 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:49694': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:31,771 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:31,772 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:49710': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:31,871 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:31,872 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:49722': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:31,879 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:31,879 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:49734': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:31,979 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:31,980 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:49740': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:31,987 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:31,987 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:49742': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:32,087 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:32,088 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:49746': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:32,095 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:32,095 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:49758': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:32,195 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:32,196 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:49760': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:32,203 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:32,203 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:49768': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:32,304 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:32,304 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:49770': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:32,311 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:32,312 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:49778': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:32,412 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:32,413 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:49794': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:32,419 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:32,420 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:49806': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:32,521 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:32,522 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:49820': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:32,528 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:32,528 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:49834': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:32,629 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:32,630 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:49846': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:32,636 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:32,637 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:49856': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:32,738 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:32,739 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:49864': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:32,745 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:32,746 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:49868': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:32,846 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:32,847 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:49884': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:32,853 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:32,854 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:49888': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:32,954 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:32,955 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:49900': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:32,962 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:32,962 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:49908': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:33,062 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:33,062 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:49912': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:33,069 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:33,069 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:49918': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:33,170 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:33,171 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:49920': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:33,177 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:33,178 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:49926': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:33,278 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:33,278 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:49934': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:33,285 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:33,286 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:49936': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:33,386 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:33,386 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:49950': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:33,395 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:33,395 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:49964': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:33,495 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:33,495 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:49976': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:33,502 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:33,502 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:49982': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:33,603 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:33,603 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:49990': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:33,610 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:33,610 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:50004': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:33,711 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:33,711 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:50014': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:33,718 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:33,718 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:50024': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:33,819 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:33,819 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:50032': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:33,826 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:33,827 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:50046': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:33,927 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:33,928 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:50056': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:33,935 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:33,935 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:50070': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:34,036 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:34,036 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:50086': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:34,043 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:34,043 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:50096': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:34,144 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:34,144 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:50110': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:34,151 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:34,151 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:50120': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:34,252 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:34,253 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:50124': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:34,259 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:34,260 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:50132': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:34,360 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:34,361 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:50134': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:34,368 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:34,368 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:50136': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:34,469 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:34,471 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:50140': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:34,477 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:34,477 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:50148': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:34,578 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:34,578 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:50150': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:34,585 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:34,585 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:50160': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:34,685 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:34,686 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:50168': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:34,692 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:34,693 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:50180': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:34,793 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:34,793 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:50188': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:34,800 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:34,801 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:50202': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:34,900 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:34,901 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:50204': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:34,908 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:34,908 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:50212': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:35,008 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:35,009 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:50218': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:35,015 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:35,016 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:50224': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:35,116 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:35,116 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:50230': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:35,123 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:35,124 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:50242': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:35,224 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:35,225 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:50254': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:35,231 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:35,232 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:50256': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:35,332 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:35,333 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:50262': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:35,340 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:35,340 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:50266': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:35,440 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:35,441 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:50280': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:35,447 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:35,448 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:50282': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:35,549 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:35,553 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:50284': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:35,559 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:35,560 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:50292': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:35,656 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:35,657 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:50298': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:35,667 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:35,668 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:50306': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:35,764 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:35,765 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:50322': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:35,775 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:35,775 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:50330': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:35,873 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:35,874 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:50336': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:35,883 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:35,883 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:50350': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:35,982 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:35,982 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:50364': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:35,990 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42587 4768s 2024-11-23 21:41:35,991 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42587': TLS handshake failed with remote 'tls://127.0.0.1:50374': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:36,062 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40293. Reason: failure-to-start- 4768s 2024-11-23 21:41:36,062 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:41:36,065 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45199. Reason: failure-to-start- 4768s 2024-11-23 21:41:36,065 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:41:36,065 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 15s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 4768s stream = await stream.start_tls( 4768s ^^^^^^^^^^^^^^^^^^^^^^^ 4768s False, ssl_options=ssl_options, server_hostname=host 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 4768s self.socket.do_handshake() 4768s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 4768s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 4768s self._sslobj.do_handshake() 4768s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 4768s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 4768s raise FatalCommClosedError( 4768s ...<2 lines>... 4768s ) from err 4768s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 4768s 4768s During handling of the above exception, another exception occurred: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1218, in _register_with_scheduler 4768s await asyncio.sleep(0.1) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 718, in sleep 4768s return await future 4768s ^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 15s. 4768s 2024-11-23 21:41:37,072 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:41:37,080 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:37,081 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44489/status 4768s 2024-11-23 21:41:37,081 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:41:37,099 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35519 4768s 2024-11-23 21:41:37,100 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35519 4768s 2024-11-23 21:41:37,100 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:41:37,100 - distributed.worker - INFO - dashboard at: 127.0.0.1:46875 4768s 2024-11-23 21:41:37,100 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:37,100 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:41:37,100 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:41:37,100 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:41:37,100 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-hrriva1u 4768s 2024-11-23 21:41:37,100 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:41:37,102 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36033 4768s 2024-11-23 21:41:37,102 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36033 4768s 2024-11-23 21:41:37,102 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:41:37,103 - distributed.worker - INFO - dashboard at: 127.0.0.1:39523 4768s 2024-11-23 21:41:37,103 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:37,103 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:41:37,103 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:41:37,103 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:41:37,103 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-il3ouz6m 4768s 2024-11-23 21:41:37,103 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:41:37,116 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:37,116 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:37,117 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37066': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:37,117 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37070': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:37,229 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:37,230 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:37,230 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37078': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:37,230 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37094': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:37,343 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:37,343 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:37,344 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37110': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:37,344 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37112': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:37,456 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:37,456 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:37,457 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37124': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:37,457 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37138': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:37,570 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:37,570 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:37,570 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37144': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:37,571 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37156': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:37,684 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:37,684 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:37,685 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37164': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:37,685 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37168': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:37,797 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:37,798 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:37,798 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37176': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:37,798 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37184': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:37,911 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:37,911 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:37,911 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37198': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:37,912 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37204': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:38,024 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:38,024 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:38,024 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37206': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:38,025 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37222': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:38,137 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:38,137 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:38,138 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37228': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:38,138 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37242': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:38,252 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:38,252 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:38,253 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37252': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:38,253 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37268': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:38,365 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:38,366 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:38,366 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37278': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:38,366 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37288': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:38,479 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:38,479 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:38,479 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37298': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:38,479 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37310': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:38,595 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:38,596 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:38,596 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37324': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:38,596 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37330': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:38,708 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:38,709 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:38,709 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37338': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:38,709 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37348': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:38,822 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:38,823 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:38,823 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37350': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:38,823 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37354': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:38,937 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:38,937 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:38,938 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37368': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:38,938 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37374': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:39,050 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:39,051 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:39,054 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37382': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:39,055 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37392': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:39,164 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:39,165 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:39,165 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37404': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:39,165 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37418': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:39,279 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:39,279 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:39,280 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37428': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:39,280 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37442': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:39,393 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:39,393 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:39,394 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37454': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:39,394 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37462': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:39,506 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:39,507 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:39,507 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37478': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:39,507 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37480': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:39,615 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:39,620 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37484': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:39,621 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:39,621 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37500': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:39,724 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:39,725 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37506': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:39,731 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:39,732 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37510': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:39,833 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:39,834 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37522': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:39,841 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:39,841 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37530': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:39,942 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:39,943 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37534': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:39,950 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:39,950 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37550': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:40,052 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:40,057 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37564': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:40,064 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:40,064 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37572': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:40,161 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:40,161 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37578': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:40,171 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:40,172 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37592': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:40,269 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:40,269 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37598': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:40,280 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:40,280 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37608': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:40,377 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:40,377 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37616': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:40,388 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:40,388 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37620': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:40,485 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:40,486 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37628': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:40,496 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:40,496 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37632': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:40,594 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:40,594 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37642': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:40,604 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:40,604 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37652': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:40,704 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:40,705 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37658': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:40,711 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:40,712 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37662': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:40,813 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:40,814 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37678': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:40,820 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:40,821 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37690': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:40,921 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:40,922 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37698': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:40,928 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:40,929 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37706': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:41,029 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:41,030 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37708': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:41,036 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:41,037 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37720': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:41,138 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:41,138 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37728': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:41,145 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:41,146 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37744': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:41,246 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:41,246 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37748': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:41,253 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:41,254 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37754': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:41,353 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:41,354 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37760': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:41,361 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:41,361 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37768': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:41,462 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:41,462 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37782': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:41,469 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:41,469 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:41,569 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:41,570 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37236': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:41,576 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:41,577 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37240': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:41,677 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:41,679 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37242': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:41,686 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:41,686 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37256': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:41,786 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:41,787 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37270': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:41,794 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:41,794 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37276': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:41,894 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:41,895 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37286': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:41,901 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:41,902 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37302': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:42,003 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:42,004 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37306': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:42,010 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:42,011 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37318': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:42,112 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:42,113 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37320': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:42,120 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:42,120 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37326': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:42,221 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:42,221 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37338': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:42,228 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:42,229 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37350': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:42,329 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:42,330 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37358': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:42,337 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:42,337 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37362': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:42,439 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:42,440 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37364': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:42,446 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:42,447 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37370': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:42,547 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:42,547 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37382': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:42,558 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:42,558 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37384': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:42,655 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:42,655 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37386': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:42,665 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:42,666 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37390': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:42,763 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:42,764 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37392': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:42,773 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:42,774 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37396': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:42,871 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:42,871 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37398': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:42,882 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:42,882 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37400': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:42,979 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:42,980 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37412': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:42,989 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:42,989 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37426': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:43,091 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:43,092 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37434': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:43,098 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:43,099 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37440': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:43,200 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:43,201 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37450': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:43,207 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:43,208 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37466': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:43,308 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:43,308 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37474': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:43,319 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:43,320 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37480': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:43,416 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:43,417 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37492': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:43,427 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:43,428 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37496': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:43,524 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:43,524 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37502': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:43,534 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:43,535 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37518': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:43,632 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:43,633 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37526': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:43,642 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:43,643 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37536': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:43,740 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:43,741 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37540': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:43,750 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:43,751 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37554': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:43,848 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:43,849 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37568': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:43,858 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:43,859 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37584': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:43,956 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:43,957 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37588': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:43,966 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:43,967 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37604': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:44,064 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:44,065 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37608': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:44,073 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:44,074 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37624': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:44,173 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:44,174 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37640': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:44,181 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:44,181 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37644': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:44,283 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:44,284 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37654': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:44,290 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:44,291 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37670': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:44,391 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:44,391 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37678': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:44,398 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:44,399 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37682': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:44,500 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:44,501 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37686': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:44,507 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:44,508 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37690': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:44,608 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:44,608 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37698': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:44,615 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:44,616 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37710': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:44,717 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:44,718 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37726': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:44,724 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:44,725 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37732': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:44,825 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:44,826 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37736': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:44,833 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:44,833 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37750': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:44,934 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:44,935 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37752': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:44,942 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:44,942 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37768': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:45,044 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:45,045 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37774': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:45,056 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:45,057 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37788': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:45,153 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:45,153 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37800': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:45,165 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:45,165 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37810': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:45,261 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:45,262 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37816': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:45,273 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:45,273 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37826': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:45,370 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:45,370 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37828': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:45,381 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:45,381 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37844': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:45,478 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:45,478 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37852': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:45,489 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:45,489 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37860': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:45,586 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:45,590 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37866': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:45,597 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:45,598 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37874': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:45,694 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:45,694 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37882': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:45,705 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:45,706 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37892': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:45,803 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:45,803 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37898': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:45,813 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:45,814 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37908': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:45,912 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:45,912 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37910': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:45,921 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:45,922 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37912': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:46,020 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:46,020 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37926': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:46,029 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:46,030 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37930': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:46,128 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:46,129 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37944': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:46,137 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:46,137 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37952': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:46,236 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:46,237 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37968': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:46,245 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:46,246 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37982': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:46,344 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:46,345 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37986': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:46,353 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:46,354 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:37992': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:46,453 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:46,454 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:38004': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:46,460 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:46,461 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:38008': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:46,561 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:46,562 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:38014': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:46,569 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:46,569 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:38026': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:46,669 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:46,670 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:38030': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:46,678 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:46,679 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:38046': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:46,777 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:46,778 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:38058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:46,786 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:46,787 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:38068': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:46,885 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:46,886 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:38078': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:46,894 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:46,895 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:38088': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:46,994 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:46,994 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:38102': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:47,001 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:47,002 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:38116': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:47,102 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:47,102 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:38132': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:47,109 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:47,110 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:38136': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:47,210 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:47,211 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:38152': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:47,217 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:47,218 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:38168': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:47,318 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:47,319 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:38174': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:47,326 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:47,326 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:38178': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:47,427 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:47,427 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:38182': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:47,434 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:47,434 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:38190': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:47,535 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:47,535 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:38200': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:47,542 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:47,542 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:38204': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:47,643 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:47,645 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:38212': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:47,651 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:47,652 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:38220': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:47,751 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:47,752 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:38230': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:47,759 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:47,759 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:38232': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:47,860 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:47,861 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:38236': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:47,867 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:47,868 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:38248': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:47,969 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:47,970 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:38264': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:47,977 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:47,977 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:38270': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:48,078 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:48,079 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:38282': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:48,086 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:48,090 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:38290': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:48,187 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:48,188 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:38294': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:48,194 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:48,195 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:38306': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:48,295 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:48,295 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:38312': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:48,304 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:48,305 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:38320': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:48,404 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:48,405 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:38334': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:48,411 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:48,412 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:38346': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:48,512 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:48,513 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:38358': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:48,520 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:48,520 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:38374': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:48,620 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:48,621 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:38382': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:48,628 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:48,628 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:38398': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:48,728 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:48,729 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:38414': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:48,736 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:48,736 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:38422': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:48,836 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:48,837 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:38424': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:48,844 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:48,844 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:38436': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:48,945 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:48,945 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:38438': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:48,952 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:48,953 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:38448': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:49,057 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:49,058 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:38458': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:49,064 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:49,064 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:38468': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:49,164 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:49,165 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:38472': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:49,172 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:49,172 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:38478': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:49,272 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:49,273 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:38484': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:49,279 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:49,280 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:38492': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:49,381 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:49,382 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:38504': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:49,388 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:49,389 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:38506': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:49,488 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:49,489 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:38510': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:49,496 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:49,496 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:38514': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:49,596 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:49,597 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:38526': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:49,603 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:49,604 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:38528': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:49,704 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:49,704 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:38536': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:49,711 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:49,711 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:38546': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:49,811 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:49,812 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:38552': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:49,818 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:49,819 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:38554': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:49,919 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:49,919 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:38564': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:49,926 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:49,926 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:38580': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:50,028 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:50,030 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:38594': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:50,036 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39013 4768s 2024-11-23 21:41:50,037 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39013': TLS handshake failed with remote 'tls://127.0.0.1:38610': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:41:50,098 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35519. Reason: failure-to-start- 4768s 2024-11-23 21:41:50,098 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:41:50,101 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 13s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 4768s stream = await stream.start_tls( 4768s ^^^^^^^^^^^^^^^^^^^^^^^ 4768s False, ssl_options=ssl_options, server_hostname=host 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 4768s self.socket.do_handshake() 4768s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 4768s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 4768s self._sslobj.do_handshake() 4768s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 4768s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 4768s raise FatalCommClosedError( 4768s ...<2 lines>... 4768s ) from err 4768s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 4768s 4768s During handling of the above exception, another exception occurred: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1218, in _register_with_scheduler 4768s await asyncio.sleep(0.1) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 718, in sleep 4768s return await future 4768s ^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 13s. 4768s 2024-11-23 21:41:50,104 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36033. Reason: failure-to-start- 4768s 2024-11-23 21:41:50,104 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:41:51,108 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:41:51,116 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33705 4768s 2024-11-23 21:41:51,117 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34291/status 4768s 2024-11-23 21:41:51,117 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:41:51,135 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42127 4768s 2024-11-23 21:41:51,135 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42127 4768s 2024-11-23 21:41:51,135 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:41:51,135 - distributed.worker - INFO - dashboard at: 127.0.0.1:40565 4768s 2024-11-23 21:41:51,135 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33705 4768s 2024-11-23 21:41:51,135 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:41:51,135 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:41:51,135 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:41:51,135 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-2h3s9s6o 4768s 2024-11-23 21:41:51,135 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:41:51,138 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36055 4768s 2024-11-23 21:41:51,138 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36055 4768s 2024-11-23 21:41:51,138 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:41:51,138 - distributed.worker - INFO - dashboard at: 127.0.0.1:35377 4768s 2024-11-23 21:41:51,138 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33705 4768s 2024-11-23 21:41:51,138 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:41:51,138 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:41:51,138 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:41:51,138 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-m78on0_a 4768s 2024-11-23 21:41:51,139 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:41:51,140 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42127. Reason: failure-to-start- 4768s 2024-11-23 21:41:51,140 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:41:51,140 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36055. Reason: failure-to-start- 4768s 2024-11-23 21:41:51,140 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:41:51,142 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33705': TLS handshake failed with remote 'tls://127.0.0.1:38972': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:41:51,142 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33705': TLS handshake failed with remote 'tls://127.0.0.1:38986': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:41:51,144 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:41:52,149 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:41:52,157 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42011 4768s 2024-11-23 21:41:52,158 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41195/status 4768s 2024-11-23 21:41:52,160 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:41:52,176 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42435 4768s 2024-11-23 21:41:52,177 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42435 4768s 2024-11-23 21:41:52,177 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:41:52,177 - distributed.worker - INFO - dashboard at: 127.0.0.1:46869 4768s 2024-11-23 21:41:52,177 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42011 4768s 2024-11-23 21:41:52,177 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:41:52,177 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:41:52,177 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:41:52,177 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-li63ssh3 4768s 2024-11-23 21:41:52,177 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:41:52,179 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39559 4768s 2024-11-23 21:41:52,180 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39559 4768s 2024-11-23 21:41:52,180 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:41:52,180 - distributed.worker - INFO - dashboard at: 127.0.0.1:38285 4768s 2024-11-23 21:41:52,180 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42011 4768s 2024-11-23 21:41:52,180 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:41:52,180 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:41:52,180 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:41:52,180 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-j3ikphae 4768s 2024-11-23 21:41:52,180 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:41:52,181 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42435. Reason: failure-to-start- 4768s 2024-11-23 21:41:52,181 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:41:52,182 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39559. Reason: failure-to-start- 4768s 2024-11-23 21:41:52,182 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:41:52,183 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42011': TLS handshake failed with remote 'tls://127.0.0.1:59992': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:41:52,184 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42011': TLS handshake failed with remote 'tls://127.0.0.1:60006': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:41:52,185 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:41:53,191 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:41:53,200 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40903 4768s 2024-11-23 21:41:53,200 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43119/status 4768s 2024-11-23 21:41:53,200 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:41:53,219 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42391 4768s 2024-11-23 21:41:53,219 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42391 4768s 2024-11-23 21:41:53,219 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:41:53,219 - distributed.worker - INFO - dashboard at: 127.0.0.1:39657 4768s 2024-11-23 21:41:53,219 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40903 4768s 2024-11-23 21:41:53,219 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:41:53,219 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:41:53,219 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:41:53,219 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-nct4o6dh 4768s 2024-11-23 21:41:53,219 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:41:53,222 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45503 4768s 2024-11-23 21:41:53,222 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45503 4768s 2024-11-23 21:41:53,222 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:41:53,222 - distributed.worker - INFO - dashboard at: 127.0.0.1:34129 4768s 2024-11-23 21:41:53,222 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40903 4768s 2024-11-23 21:41:53,222 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:41:53,222 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:41:53,222 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:41:53,222 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-e9b3rwy9 4768s 2024-11-23 21:41:53,222 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:41:53,223 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42391. Reason: failure-to-start- 4768s 2024-11-23 21:41:53,224 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:41:53,224 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45503. Reason: failure-to-start- 4768s 2024-11-23 21:41:53,224 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:41:53,226 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40903': TLS handshake failed with remote 'tls://127.0.0.1:48734': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:41:53,226 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40903': TLS handshake failed with remote 'tls://127.0.0.1:48750': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:41:53,227 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:41:54,235 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:41:54,243 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41787 4768s 2024-11-23 21:41:54,243 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36475/status 4768s 2024-11-23 21:41:54,244 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:41:54,260 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39843 4768s 2024-11-23 21:41:54,260 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39843 4768s 2024-11-23 21:41:54,261 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:41:54,261 - distributed.worker - INFO - dashboard at: 127.0.0.1:37611 4768s 2024-11-23 21:41:54,261 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41787 4768s 2024-11-23 21:41:54,261 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:41:54,261 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:41:54,261 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:41:54,261 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-3vellfps 4768s 2024-11-23 21:41:54,261 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:41:54,263 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35527 4768s 2024-11-23 21:41:54,264 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35527 4768s 2024-11-23 21:41:54,264 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:41:54,264 - distributed.worker - INFO - dashboard at: 127.0.0.1:37895 4768s 2024-11-23 21:41:54,264 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41787 4768s 2024-11-23 21:41:54,264 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:41:54,264 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:41:54,264 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:41:54,264 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-cmmnur8g 4768s 2024-11-23 21:41:54,264 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:41:54,265 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39843. Reason: failure-to-start- 4768s 2024-11-23 21:41:54,265 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:41:54,266 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35527. Reason: failure-to-start- 4768s 2024-11-23 21:41:54,266 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:41:54,268 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41787': TLS handshake failed with remote 'tls://127.0.0.1:51222': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:41:54,268 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41787': TLS handshake failed with remote 'tls://127.0.0.1:51232': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:41:54,269 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:41:55,277 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:41:55,286 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36681 4768s 2024-11-23 21:41:55,286 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44829/status 4768s 2024-11-23 21:41:55,287 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:41:55,304 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37033 4768s 2024-11-23 21:41:55,304 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37033 4768s 2024-11-23 21:41:55,304 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:41:55,304 - distributed.worker - INFO - dashboard at: 127.0.0.1:42617 4768s 2024-11-23 21:41:55,304 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36681 4768s 2024-11-23 21:41:55,304 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:41:55,304 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:41:55,304 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:41:55,304 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-s9i52xnn 4768s 2024-11-23 21:41:55,305 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:41:55,307 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37043 4768s 2024-11-23 21:41:55,307 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37043 4768s 2024-11-23 21:41:55,307 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:41:55,307 - distributed.worker - INFO - dashboard at: 127.0.0.1:34031 4768s 2024-11-23 21:41:55,307 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36681 4768s 2024-11-23 21:41:55,307 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:41:55,307 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:41:55,307 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:41:55,307 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-0hdelg92 4768s 2024-11-23 21:41:55,308 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:41:55,309 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37033. Reason: failure-to-start- 4768s 2024-11-23 21:41:55,309 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:41:55,309 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37043. Reason: failure-to-start- 4768s 2024-11-23 21:41:55,310 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:41:55,311 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36681': TLS handshake failed with remote 'tls://127.0.0.1:36480': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:41:55,311 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36681': TLS handshake failed with remote 'tls://127.0.0.1:36492': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:41:55,313 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:41:56,319 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:41:56,327 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35067 4768s 2024-11-23 21:41:56,328 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38773/status 4768s 2024-11-23 21:41:56,328 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:41:56,347 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36713 4768s 2024-11-23 21:41:56,348 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36713 4768s 2024-11-23 21:41:56,348 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:41:56,348 - distributed.worker - INFO - dashboard at: 127.0.0.1:36101 4768s 2024-11-23 21:41:56,348 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35067 4768s 2024-11-23 21:41:56,348 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:41:56,348 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:41:56,348 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:41:56,348 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-g4dz_ff2 4768s 2024-11-23 21:41:56,348 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:41:56,351 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36097 4768s 2024-11-23 21:41:56,351 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36097 4768s 2024-11-23 21:41:56,351 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:41:56,351 - distributed.worker - INFO - dashboard at: 127.0.0.1:33959 4768s 2024-11-23 21:41:56,351 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35067 4768s 2024-11-23 21:41:56,351 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:41:56,351 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:41:56,351 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:41:56,351 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-y82yu3uy 4768s 2024-11-23 21:41:56,351 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:41:56,353 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36713. Reason: failure-to-start- 4768s 2024-11-23 21:41:56,353 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:41:56,354 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36097. Reason: failure-to-start- 4768s 2024-11-23 21:41:56,354 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:41:56,355 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35067': TLS handshake failed with remote 'tls://127.0.0.1:49666': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:41:56,355 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35067': TLS handshake failed with remote 'tls://127.0.0.1:49668': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:41:56,357 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:41:57,363 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:41:57,372 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45723 4768s 2024-11-23 21:41:57,372 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44573/status 4768s 2024-11-23 21:41:57,373 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:41:57,391 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36635 4768s 2024-11-23 21:41:57,391 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36635 4768s 2024-11-23 21:41:57,391 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:41:57,391 - distributed.worker - INFO - dashboard at: 127.0.0.1:36939 4768s 2024-11-23 21:41:57,392 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45723 4768s 2024-11-23 21:41:57,392 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:41:57,392 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:41:57,392 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:41:57,392 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-jq8_nyr5 4768s 2024-11-23 21:41:57,393 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:41:57,395 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46547 4768s 2024-11-23 21:41:57,395 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46547 4768s 2024-11-23 21:41:57,395 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:41:57,395 - distributed.worker - INFO - dashboard at: 127.0.0.1:46009 4768s 2024-11-23 21:41:57,395 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45723 4768s 2024-11-23 21:41:57,396 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:41:57,396 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:41:57,396 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:41:57,396 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-d0_9u39j 4768s 2024-11-23 21:41:57,396 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:41:57,397 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36635. Reason: failure-to-start- 4768s 2024-11-23 21:41:57,397 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:41:57,398 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46547. Reason: failure-to-start- 4768s 2024-11-23 21:41:57,398 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:41:57,399 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45723': TLS handshake failed with remote 'tls://127.0.0.1:45406': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:41:57,399 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45723': TLS handshake failed with remote 'tls://127.0.0.1:45408': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:41:57,401 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:41:58,407 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:41:58,415 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45569 4768s 2024-11-23 21:41:58,415 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39651/status 4768s 2024-11-23 21:41:58,416 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:41:58,432 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46793 4768s 2024-11-23 21:41:58,432 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46793 4768s 2024-11-23 21:41:58,432 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:41:58,432 - distributed.worker - INFO - dashboard at: 127.0.0.1:40143 4768s 2024-11-23 21:41:58,432 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:41:58,432 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:41:58,433 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:41:58,433 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:41:58,433 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-iupw9izo 4768s 2024-11-23 21:41:58,433 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:41:58,435 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34835 4768s 2024-11-23 21:41:58,435 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34835 4768s 2024-11-23 21:41:58,436 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:41:58,436 - distributed.worker - INFO - dashboard at: 127.0.0.1:43825 4768s 2024-11-23 21:41:58,436 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:41:58,436 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:41:58,436 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:41:58,436 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:41:58,436 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-j3gi3q33 4768s 2024-11-23 21:41:58,436 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:41:58,437 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46793. Reason: failure-to-start- 4768s 2024-11-23 21:41:58,437 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:41:58,438 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34835. Reason: failure-to-start- 4768s 2024-11-23 21:41:58,438 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:41:58,440 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:52270': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:41:58,440 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:52274': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:41:58,441 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:41:59,448 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:41:59,457 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35463 4768s 2024-11-23 21:41:59,457 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46781/status 4768s 2024-11-23 21:41:59,458 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:41:59,474 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43209 4768s 2024-11-23 21:41:59,474 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43209 4768s 2024-11-23 21:41:59,474 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:41:59,475 - distributed.worker - INFO - dashboard at: 127.0.0.1:37265 4768s 2024-11-23 21:41:59,475 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35463 4768s 2024-11-23 21:41:59,475 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:41:59,475 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:41:59,475 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:41:59,475 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-53ufd_3w 4768s 2024-11-23 21:41:59,475 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:41:59,477 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42451 4768s 2024-11-23 21:41:59,477 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42451 4768s 2024-11-23 21:41:59,477 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:41:59,478 - distributed.worker - INFO - dashboard at: 127.0.0.1:33803 4768s 2024-11-23 21:41:59,478 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35463 4768s 2024-11-23 21:41:59,478 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:41:59,478 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:41:59,478 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:41:59,478 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-8db505py 4768s 2024-11-23 21:41:59,478 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:41:59,479 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43209. Reason: failure-to-start- 4768s 2024-11-23 21:41:59,479 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:41:59,480 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42451. Reason: failure-to-start- 4768s 2024-11-23 21:41:59,480 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:41:59,481 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35463': TLS handshake failed with remote 'tls://127.0.0.1:48286': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:41:59,482 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35463': TLS handshake failed with remote 'tls://127.0.0.1:48300': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:41:59,483 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:42:00,489 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:42:00,498 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40011 4768s 2024-11-23 21:42:00,498 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38189/status 4768s 2024-11-23 21:42:00,499 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:42:00,517 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40381 4768s 2024-11-23 21:42:00,517 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40381 4768s 2024-11-23 21:42:00,518 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:42:00,518 - distributed.worker - INFO - dashboard at: 127.0.0.1:40725 4768s 2024-11-23 21:42:00,518 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40011 4768s 2024-11-23 21:42:00,518 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:42:00,518 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:42:00,518 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:42:00,518 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-1p_9dsds 4768s 2024-11-23 21:42:00,518 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:42:00,520 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41315 4768s 2024-11-23 21:42:00,521 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41315 4768s 2024-11-23 21:42:00,521 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:42:00,521 - distributed.worker - INFO - dashboard at: 127.0.0.1:38723 4768s 2024-11-23 21:42:00,521 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40011 4768s 2024-11-23 21:42:00,521 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:42:00,521 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:42:00,521 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:42:00,521 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-igu1cmlg 4768s 2024-11-23 21:42:00,521 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:42:00,522 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40381. Reason: failure-to-start- 4768s 2024-11-23 21:42:00,523 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:42:00,523 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41315. Reason: failure-to-start- 4768s 2024-11-23 21:42:00,523 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:42:00,525 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40011': TLS handshake failed with remote 'tls://127.0.0.1:51346': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:42:00,525 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40011': TLS handshake failed with remote 'tls://127.0.0.1:51352': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:42:00,527 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:42:01,532 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:42:01,541 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35793 4768s 2024-11-23 21:42:01,541 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43569/status 4768s 2024-11-23 21:42:01,542 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:42:01,558 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40465 4768s 2024-11-23 21:42:01,558 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40465 4768s 2024-11-23 21:42:01,559 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:42:01,559 - distributed.worker - INFO - dashboard at: 127.0.0.1:34261 4768s 2024-11-23 21:42:01,559 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35793 4768s 2024-11-23 21:42:01,559 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:42:01,559 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:42:01,559 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:42:01,559 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-8hi23kix 4768s 2024-11-23 21:42:01,559 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:42:01,571 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42617 4768s 2024-11-23 21:42:01,571 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42617 4768s 2024-11-23 21:42:01,571 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:42:01,571 - distributed.worker - INFO - dashboard at: 127.0.0.1:40817 4768s 2024-11-23 21:42:01,571 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35793 4768s 2024-11-23 21:42:01,572 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:42:01,572 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:42:01,572 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:42:01,572 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-4pv2vir_ 4768s 2024-11-23 21:42:01,572 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:42:01,576 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40465. Reason: failure-to-start- 4768s 2024-11-23 21:42:01,577 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:42:01,577 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42617. Reason: failure-to-start- 4768s 2024-11-23 21:42:01,577 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:42:01,579 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35793': TLS handshake failed with remote 'tls://127.0.0.1:56878': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:42:01,579 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35793': TLS handshake failed with remote 'tls://127.0.0.1:56880': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:42:01,581 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:42:02,588 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:42:02,597 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33839 4768s 2024-11-23 21:42:02,597 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36395/status 4768s 2024-11-23 21:42:02,597 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:42:02,616 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41007 4768s 2024-11-23 21:42:02,616 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41007 4768s 2024-11-23 21:42:02,616 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:42:02,616 - distributed.worker - INFO - dashboard at: 127.0.0.1:34079 4768s 2024-11-23 21:42:02,616 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33839 4768s 2024-11-23 21:42:02,616 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:42:02,616 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:42:02,616 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:42:02,616 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-9ee9gswj 4768s 2024-11-23 21:42:02,616 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:42:02,619 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33055 4768s 2024-11-23 21:42:02,619 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33055 4768s 2024-11-23 21:42:02,619 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:42:02,619 - distributed.worker - INFO - dashboard at: 127.0.0.1:42109 4768s 2024-11-23 21:42:02,619 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33839 4768s 2024-11-23 21:42:02,619 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:42:02,620 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:42:02,620 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:42:02,620 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-pft84ee1 4768s 2024-11-23 21:42:02,620 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:42:02,621 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41007. Reason: failure-to-start- 4768s 2024-11-23 21:42:02,622 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:42:02,622 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33055. Reason: failure-to-start- 4768s 2024-11-23 21:42:02,622 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:42:02,627 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33839': TLS handshake failed with remote 'tls://127.0.0.1:50134': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:42:02,627 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33839': TLS handshake failed with remote 'tls://127.0.0.1:50142': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:42:02,629 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:42:03,635 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:42:03,646 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44103 4768s 2024-11-23 21:42:03,647 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37259/status 4768s 2024-11-23 21:42:03,647 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:42:03,665 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46745 4768s 2024-11-23 21:42:03,665 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46745 4768s 2024-11-23 21:42:03,665 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:42:03,665 - distributed.worker - INFO - dashboard at: 127.0.0.1:33547 4768s 2024-11-23 21:42:03,665 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44103 4768s 2024-11-23 21:42:03,665 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:42:03,665 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:42:03,665 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:42:03,665 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-fln969pc 4768s 2024-11-23 21:42:03,665 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:42:03,668 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37297 4768s 2024-11-23 21:42:03,668 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37297 4768s 2024-11-23 21:42:03,668 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:42:03,668 - distributed.worker - INFO - dashboard at: 127.0.0.1:41221 4768s 2024-11-23 21:42:03,668 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44103 4768s 2024-11-23 21:42:03,668 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:42:03,668 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:42:03,668 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:42:03,669 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-pe1zm4vc 4768s 2024-11-23 21:42:03,669 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:42:03,673 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46745. Reason: failure-to-start- 4768s 2024-11-23 21:42:03,673 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:42:03,674 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37297. Reason: failure-to-start- 4768s 2024-11-23 21:42:03,674 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:42:03,676 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44103': TLS handshake failed with remote 'tls://127.0.0.1:54534': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:42:03,676 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44103': TLS handshake failed with remote 'tls://127.0.0.1:54546': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:42:03,678 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:42:04,684 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:42:04,693 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35547 4768s 2024-11-23 21:42:04,694 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44403/status 4768s 2024-11-23 21:42:04,694 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:42:04,715 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45023 4768s 2024-11-23 21:42:04,715 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45023 4768s 2024-11-23 21:42:04,715 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:42:04,715 - distributed.worker - INFO - dashboard at: 127.0.0.1:42167 4768s 2024-11-23 21:42:04,715 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35547 4768s 2024-11-23 21:42:04,715 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:42:04,716 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:42:04,716 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:42:04,716 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-yzz8kqfr 4768s 2024-11-23 21:42:04,716 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:42:04,718 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42349 4768s 2024-11-23 21:42:04,719 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42349 4768s 2024-11-23 21:42:04,719 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:42:04,719 - distributed.worker - INFO - dashboard at: 127.0.0.1:34505 4768s 2024-11-23 21:42:04,719 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35547 4768s 2024-11-23 21:42:04,719 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:42:04,719 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:42:04,719 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:42:04,719 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-vu5s6_34 4768s 2024-11-23 21:42:04,719 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:42:04,724 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45023. Reason: failure-to-start- 4768s 2024-11-23 21:42:04,724 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:42:04,725 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42349. Reason: failure-to-start- 4768s 2024-11-23 21:42:04,725 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:42:04,727 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35547': TLS handshake failed with remote 'tls://127.0.0.1:47166': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:42:04,727 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35547': TLS handshake failed with remote 'tls://127.0.0.1:47170': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:42:04,729 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:42:05,734 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:42:05,743 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37009 4768s 2024-11-23 21:42:05,743 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39203/status 4768s 2024-11-23 21:42:05,744 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:42:05,763 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38631 4768s 2024-11-23 21:42:05,764 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38631 4768s 2024-11-23 21:42:05,764 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:42:05,764 - distributed.worker - INFO - dashboard at: 127.0.0.1:46729 4768s 2024-11-23 21:42:05,764 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37009 4768s 2024-11-23 21:42:05,764 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:42:05,764 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:42:05,764 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:42:05,764 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-7gnm4bh_ 4768s 2024-11-23 21:42:05,764 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:42:05,767 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37041 4768s 2024-11-23 21:42:05,767 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37041 4768s 2024-11-23 21:42:05,767 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:42:05,767 - distributed.worker - INFO - dashboard at: 127.0.0.1:38597 4768s 2024-11-23 21:42:05,767 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37009 4768s 2024-11-23 21:42:05,767 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:42:05,767 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:42:05,767 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:42:05,767 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-f8o005z7 4768s 2024-11-23 21:42:05,767 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:42:05,770 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38631. Reason: failure-to-start- 4768s 2024-11-23 21:42:05,770 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:42:05,771 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37041. Reason: failure-to-start- 4768s 2024-11-23 21:42:05,771 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:42:05,772 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37009': TLS handshake failed with remote 'tls://127.0.0.1:45832': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:42:05,773 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37009': TLS handshake failed with remote 'tls://127.0.0.1:45842': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:42:05,774 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:42:06,780 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:42:06,789 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44441 4768s 2024-11-23 21:42:06,790 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34691/status 4768s 2024-11-23 21:42:06,790 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:42:06,811 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40175 4768s 2024-11-23 21:42:06,812 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40175 4768s 2024-11-23 21:42:06,812 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:42:06,812 - distributed.worker - INFO - dashboard at: 127.0.0.1:33497 4768s 2024-11-23 21:42:06,812 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44441 4768s 2024-11-23 21:42:06,812 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:42:06,812 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:42:06,812 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:42:06,812 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ors5fuve 4768s 2024-11-23 21:42:06,812 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:42:06,815 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34079 4768s 2024-11-23 21:42:06,815 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34079 4768s 2024-11-23 21:42:06,815 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:42:06,815 - distributed.worker - INFO - dashboard at: 127.0.0.1:36477 4768s 2024-11-23 21:42:06,815 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44441 4768s 2024-11-23 21:42:06,815 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:42:06,815 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:42:06,815 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:42:06,815 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-22i3mgzr 4768s 2024-11-23 21:42:06,815 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:42:06,817 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40175. Reason: failure-to-start- 4768s 2024-11-23 21:42:06,817 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:42:06,818 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34079. Reason: failure-to-start- 4768s 2024-11-23 21:42:06,818 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:42:06,820 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44441': TLS handshake failed with remote 'tls://127.0.0.1:38944': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:42:06,820 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44441': TLS handshake failed with remote 'tls://127.0.0.1:38950': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:42:06,822 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:42:07,828 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:42:07,838 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46483 4768s 2024-11-23 21:42:07,838 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40313/status 4768s 2024-11-23 21:42:07,839 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:42:07,859 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43999 4768s 2024-11-23 21:42:07,860 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43999 4768s 2024-11-23 21:42:07,860 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:42:07,860 - distributed.worker - INFO - dashboard at: 127.0.0.1:35851 4768s 2024-11-23 21:42:07,860 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46483 4768s 2024-11-23 21:42:07,860 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:42:07,860 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:42:07,860 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:42:07,860 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-8pm9pgw1 4768s 2024-11-23 21:42:07,860 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:42:07,862 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37129 4768s 2024-11-23 21:42:07,863 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37129 4768s 2024-11-23 21:42:07,863 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:42:07,863 - distributed.worker - INFO - dashboard at: 127.0.0.1:37999 4768s 2024-11-23 21:42:07,863 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46483 4768s 2024-11-23 21:42:07,863 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:42:07,863 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:42:07,863 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:42:07,863 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-rho7vb_h 4768s 2024-11-23 21:42:07,863 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:42:07,865 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43999. Reason: failure-to-start- 4768s 2024-11-23 21:42:07,865 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:42:07,865 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37129. Reason: failure-to-start- 4768s 2024-11-23 21:42:07,866 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:42:07,867 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46483': TLS handshake failed with remote 'tls://127.0.0.1:57056': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:42:07,867 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46483': TLS handshake failed with remote 'tls://127.0.0.1:57060': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:42:07,869 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:42:08,875 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:42:08,884 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41637 4768s 2024-11-23 21:42:08,884 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36857/status 4768s 2024-11-23 21:42:08,884 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:42:08,907 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45051 4768s 2024-11-23 21:42:08,907 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45051 4768s 2024-11-23 21:42:08,907 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:42:08,907 - distributed.worker - INFO - dashboard at: 127.0.0.1:33285 4768s 2024-11-23 21:42:08,907 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41637 4768s 2024-11-23 21:42:08,907 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:42:08,907 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:42:08,907 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:42:08,907 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-9wa7ckwn 4768s 2024-11-23 21:42:08,907 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:42:08,910 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42465 4768s 2024-11-23 21:42:08,910 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42465 4768s 2024-11-23 21:42:08,910 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:42:08,910 - distributed.worker - INFO - dashboard at: 127.0.0.1:39599 4768s 2024-11-23 21:42:08,910 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41637 4768s 2024-11-23 21:42:08,910 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:42:08,910 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:42:08,911 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:42:08,911 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-qoka1pkj 4768s 2024-11-23 21:42:08,911 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:42:08,912 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45051. Reason: failure-to-start- 4768s 2024-11-23 21:42:08,912 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:42:08,913 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42465. Reason: failure-to-start- 4768s 2024-11-23 21:42:08,913 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:42:08,915 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41637': TLS handshake failed with remote 'tls://127.0.0.1:56296': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:42:08,915 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41637': TLS handshake failed with remote 'tls://127.0.0.1:56310': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:42:08,916 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:42:09,924 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:42:09,932 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39787 4768s 2024-11-23 21:42:09,932 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35789/status 4768s 2024-11-23 21:42:09,932 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:42:09,950 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36941 4768s 2024-11-23 21:42:09,951 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36941 4768s 2024-11-23 21:42:09,951 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:42:09,951 - distributed.worker - INFO - dashboard at: 127.0.0.1:42571 4768s 2024-11-23 21:42:09,951 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 4768s 2024-11-23 21:42:09,951 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:42:09,951 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:42:09,951 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:42:09,951 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-nj8r9tmp 4768s 2024-11-23 21:42:09,951 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:42:09,953 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41289 4768s 2024-11-23 21:42:09,954 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41289 4768s 2024-11-23 21:42:09,954 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:42:09,954 - distributed.worker - INFO - dashboard at: 127.0.0.1:38541 4768s 2024-11-23 21:42:09,954 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 4768s 2024-11-23 21:42:09,954 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:42:09,954 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:42:09,955 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:42:09,955 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-1xfjbys8 4768s 2024-11-23 21:42:09,955 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:42:09,957 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36941. Reason: failure-to-start- 4768s 2024-11-23 21:42:09,957 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:42:09,958 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41289. Reason: failure-to-start- 4768s 2024-11-23 21:42:09,958 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:42:09,959 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:34230': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:42:09,960 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:34246': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:42:09,964 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:42:10,970 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:42:10,978 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35307 4768s 2024-11-23 21:42:10,979 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43577/status 4768s 2024-11-23 21:42:10,979 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:42:10,996 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45473 4768s 2024-11-23 21:42:10,996 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45473 4768s 2024-11-23 21:42:10,996 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:42:10,996 - distributed.worker - INFO - dashboard at: 127.0.0.1:42349 4768s 2024-11-23 21:42:10,996 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35307 4768s 2024-11-23 21:42:10,997 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:42:10,997 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:42:10,997 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:42:10,997 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-mlebl5w9 4768s 2024-11-23 21:42:10,997 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:42:10,999 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34751 4768s 2024-11-23 21:42:10,999 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34751 4768s 2024-11-23 21:42:10,999 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:42:10,999 - distributed.worker - INFO - dashboard at: 127.0.0.1:38315 4768s 2024-11-23 21:42:11,000 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35307 4768s 2024-11-23 21:42:11,000 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:42:11,000 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:42:11,000 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:42:11,000 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-990feicv 4768s 2024-11-23 21:42:11,000 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:42:11,003 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45473. Reason: failure-to-start- 4768s 2024-11-23 21:42:11,003 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:42:11,003 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34751. Reason: failure-to-start- 4768s 2024-11-23 21:42:11,003 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:42:11,008 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35307': TLS handshake failed with remote 'tls://127.0.0.1:35026': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:42:11,008 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35307': TLS handshake failed with remote 'tls://127.0.0.1:35030': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:42:11,010 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:42:12,016 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:42:12,024 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35387 4768s 2024-11-23 21:42:12,024 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35475/status 4768s 2024-11-23 21:42:12,025 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:42:12,042 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45579 4768s 2024-11-23 21:42:12,043 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45579 4768s 2024-11-23 21:42:12,043 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:42:12,043 - distributed.worker - INFO - dashboard at: 127.0.0.1:33577 4768s 2024-11-23 21:42:12,043 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35387 4768s 2024-11-23 21:42:12,043 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:42:12,043 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:42:12,043 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:42:12,043 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-0pnay1o6 4768s 2024-11-23 21:42:12,043 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:42:12,046 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37665 4768s 2024-11-23 21:42:12,046 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37665 4768s 2024-11-23 21:42:12,046 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:42:12,046 - distributed.worker - INFO - dashboard at: 127.0.0.1:38353 4768s 2024-11-23 21:42:12,046 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35387 4768s 2024-11-23 21:42:12,046 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:42:12,046 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:42:12,046 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:42:12,046 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-_frbp63d 4768s 2024-11-23 21:42:12,046 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:42:12,048 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45579. Reason: failure-to-start- 4768s 2024-11-23 21:42:12,048 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:42:12,049 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37665. Reason: failure-to-start- 4768s 2024-11-23 21:42:12,051 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:42:12,058 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35387': TLS handshake failed with remote 'tls://127.0.0.1:47326': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:42:12,058 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35387': TLS handshake failed with remote 'tls://127.0.0.1:47338': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:42:12,061 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:42:13,067 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:42:13,075 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36655 4768s 2024-11-23 21:42:13,076 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34569/status 4768s 2024-11-23 21:42:13,076 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:42:13,093 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38201 4768s 2024-11-23 21:42:13,093 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38201 4768s 2024-11-23 21:42:13,093 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:42:13,093 - distributed.worker - INFO - dashboard at: 127.0.0.1:39893 4768s 2024-11-23 21:42:13,093 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36655 4768s 2024-11-23 21:42:13,093 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:42:13,093 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:42:13,093 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:42:13,093 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-noina8dq 4768s 2024-11-23 21:42:13,094 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:42:13,096 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45945 4768s 2024-11-23 21:42:13,096 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45945 4768s 2024-11-23 21:42:13,096 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:42:13,096 - distributed.worker - INFO - dashboard at: 127.0.0.1:39549 4768s 2024-11-23 21:42:13,096 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36655 4768s 2024-11-23 21:42:13,096 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:42:13,096 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:42:13,096 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:42:13,096 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-xllx5squ 4768s 2024-11-23 21:42:13,097 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:42:13,102 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38201. Reason: failure-to-start- 4768s 2024-11-23 21:42:13,102 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:42:13,103 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45945. Reason: failure-to-start- 4768s 2024-11-23 21:42:13,103 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:42:13,104 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36655': TLS handshake failed with remote 'tls://127.0.0.1:51484': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:42:13,105 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36655': TLS handshake failed with remote 'tls://127.0.0.1:51494': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:42:13,109 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:42:14,115 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:42:14,126 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40921 4768s 2024-11-23 21:42:14,126 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46511/status 4768s 2024-11-23 21:42:14,127 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:42:14,147 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42147 4768s 2024-11-23 21:42:14,148 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42147 4768s 2024-11-23 21:42:14,148 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:42:14,148 - distributed.worker - INFO - dashboard at: 127.0.0.1:44681 4768s 2024-11-23 21:42:14,148 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40921 4768s 2024-11-23 21:42:14,148 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:42:14,148 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:42:14,148 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:42:14,148 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-i1ogdspn 4768s 2024-11-23 21:42:14,148 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:42:14,151 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33295 4768s 2024-11-23 21:42:14,151 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33295 4768s 2024-11-23 21:42:14,151 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:42:14,151 - distributed.worker - INFO - dashboard at: 127.0.0.1:38055 4768s 2024-11-23 21:42:14,151 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40921 4768s 2024-11-23 21:42:14,151 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:42:14,151 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:42:14,151 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:42:14,151 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-dx5bci2m 4768s 2024-11-23 21:42:14,152 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:42:14,153 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42147. Reason: failure-to-start- 4768s 2024-11-23 21:42:14,153 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:42:14,154 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33295. Reason: failure-to-start- 4768s 2024-11-23 21:42:14,154 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:42:14,159 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40921': TLS handshake failed with remote 'tls://127.0.0.1:44354': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:42:14,159 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40921': TLS handshake failed with remote 'tls://127.0.0.1:44364': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:42:14,161 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:42:15,166 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:42:15,175 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43081 4768s 2024-11-23 21:42:15,175 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44463/status 4768s 2024-11-23 21:42:15,176 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:42:15,197 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43069 4768s 2024-11-23 21:42:15,197 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43069 4768s 2024-11-23 21:42:15,197 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:42:15,197 - distributed.worker - INFO - dashboard at: 127.0.0.1:44577 4768s 2024-11-23 21:42:15,197 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43081 4768s 2024-11-23 21:42:15,197 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:42:15,197 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:42:15,198 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:42:15,198 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-d9obxl2g 4768s 2024-11-23 21:42:15,198 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:42:15,200 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40673 4768s 2024-11-23 21:42:15,200 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40673 4768s 2024-11-23 21:42:15,201 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:42:15,201 - distributed.worker - INFO - dashboard at: 127.0.0.1:45763 4768s 2024-11-23 21:42:15,201 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43081 4768s 2024-11-23 21:42:15,201 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:42:15,201 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:42:15,201 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:42:15,201 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-0rjcypx9 4768s 2024-11-23 21:42:15,201 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:42:15,206 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43069. Reason: failure-to-start- 4768s 2024-11-23 21:42:15,206 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:42:15,207 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40673. Reason: failure-to-start- 4768s 2024-11-23 21:42:15,207 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:42:15,212 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43081': TLS handshake failed with remote 'tls://127.0.0.1:51232': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:42:15,212 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43081': TLS handshake failed with remote 'tls://127.0.0.1:51244': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:42:15,214 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:42:16,220 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:42:16,229 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39453 4768s 2024-11-23 21:42:16,230 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45155/status 4768s 2024-11-23 21:42:16,230 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:42:16,247 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38279 4768s 2024-11-23 21:42:16,248 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38279 4768s 2024-11-23 21:42:16,248 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:42:16,248 - distributed.worker - INFO - dashboard at: 127.0.0.1:43747 4768s 2024-11-23 21:42:16,248 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39453 4768s 2024-11-23 21:42:16,248 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:42:16,248 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:42:16,248 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:42:16,248 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-vnrnetad 4768s 2024-11-23 21:42:16,248 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:42:16,252 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36921 4768s 2024-11-23 21:42:16,252 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36921 4768s 2024-11-23 21:42:16,252 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:42:16,252 - distributed.worker - INFO - dashboard at: 127.0.0.1:46431 4768s 2024-11-23 21:42:16,252 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39453 4768s 2024-11-23 21:42:16,253 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:42:16,253 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:42:16,253 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:42:16,253 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-glhw48k_ 4768s 2024-11-23 21:42:16,253 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:42:16,261 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38279. Reason: failure-to-start- 4768s 2024-11-23 21:42:16,261 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:42:16,262 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36921. Reason: failure-to-start- 4768s 2024-11-23 21:42:16,262 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:42:16,263 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39453': TLS handshake failed with remote 'tls://127.0.0.1:37724': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:42:16,264 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39453': TLS handshake failed with remote 'tls://127.0.0.1:37726': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:42:16,265 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:42:17,272 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:42:17,281 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41697 4768s 2024-11-23 21:42:17,282 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40687/status 4768s 2024-11-23 21:42:17,282 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:42:17,300 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36825 4768s 2024-11-23 21:42:17,300 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36825 4768s 2024-11-23 21:42:17,300 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:42:17,300 - distributed.worker - INFO - dashboard at: 127.0.0.1:44589 4768s 2024-11-23 21:42:17,300 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41697 4768s 2024-11-23 21:42:17,300 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:42:17,300 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:42:17,300 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:42:17,300 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-cx5nbe_a 4768s 2024-11-23 21:42:17,300 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:42:17,303 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38469 4768s 2024-11-23 21:42:17,303 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38469 4768s 2024-11-23 21:42:17,303 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:42:17,303 - distributed.worker - INFO - dashboard at: 127.0.0.1:36837 4768s 2024-11-23 21:42:17,303 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41697 4768s 2024-11-23 21:42:17,303 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:42:17,303 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:42:17,304 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:42:17,304 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-3cb5k53w 4768s 2024-11-23 21:42:17,304 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:42:17,327 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36825. Reason: failure-to-start- 4768s 2024-11-23 21:42:17,327 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:42:17,328 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38469. Reason: failure-to-start- 4768s 2024-11-23 21:42:17,328 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:42:17,330 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41697': TLS handshake failed with remote 'tls://127.0.0.1:52892': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:42:17,330 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41697': TLS handshake failed with remote 'tls://127.0.0.1:52894': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:42:17,335 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:42:18,340 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:42:18,349 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40157 4768s 2024-11-23 21:42:18,350 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38273/status 4768s 2024-11-23 21:42:18,350 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:42:18,371 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:32893 4768s 2024-11-23 21:42:18,371 - distributed.worker - INFO - Listening to: tls://127.0.0.1:32893 4768s 2024-11-23 21:42:18,371 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:42:18,371 - distributed.worker - INFO - dashboard at: 127.0.0.1:44539 4768s 2024-11-23 21:42:18,371 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40157 4768s 2024-11-23 21:42:18,371 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:42:18,371 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:42:18,371 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:42:18,371 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-xz43lsmz 4768s 2024-11-23 21:42:18,371 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:42:18,374 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33709 4768s 2024-11-23 21:42:18,374 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33709 4768s 2024-11-23 21:42:18,374 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:42:18,374 - distributed.worker - INFO - dashboard at: 127.0.0.1:34851 4768s 2024-11-23 21:42:18,374 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40157 4768s 2024-11-23 21:42:18,375 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:42:18,375 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:42:18,375 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:42:18,375 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-wpa5ht7c 4768s 2024-11-23 21:42:18,375 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:42:18,376 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:32893. Reason: failure-to-start- 4768s 2024-11-23 21:42:18,377 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:42:18,377 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33709. Reason: failure-to-start- 4768s 2024-11-23 21:42:18,377 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:42:18,382 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40157': TLS handshake failed with remote 'tls://127.0.0.1:53272': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:42:18,382 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40157': TLS handshake failed with remote 'tls://127.0.0.1:53286': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:42:18,384 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:42:19,390 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:42:19,399 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44105 4768s 2024-11-23 21:42:19,400 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35453/status 4768s 2024-11-23 21:42:19,403 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:42:19,423 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41383 4768s 2024-11-23 21:42:19,423 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41383 4768s 2024-11-23 21:42:19,424 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:42:19,424 - distributed.worker - INFO - dashboard at: 127.0.0.1:40431 4768s 2024-11-23 21:42:19,424 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44105 4768s 2024-11-23 21:42:19,424 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:42:19,424 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:42:19,424 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:42:19,424 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-3hygl161 4768s 2024-11-23 21:42:19,424 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:42:19,426 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34739 4768s 2024-11-23 21:42:19,427 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34739 4768s 2024-11-23 21:42:19,427 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:42:19,427 - distributed.worker - INFO - dashboard at: 127.0.0.1:38983 4768s 2024-11-23 21:42:19,427 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44105 4768s 2024-11-23 21:42:19,427 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:42:19,427 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:42:19,427 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:42:19,427 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-iic965k4 4768s 2024-11-23 21:42:19,427 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:42:19,431 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41383. Reason: failure-to-start- 4768s 2024-11-23 21:42:19,432 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:42:19,432 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34739. Reason: failure-to-start- 4768s 2024-11-23 21:42:19,432 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:42:19,434 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44105': TLS handshake failed with remote 'tls://127.0.0.1:44462': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:42:19,434 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44105': TLS handshake failed with remote 'tls://127.0.0.1:44470': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:42:19,439 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:42:20,445 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:42:20,454 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37589 4768s 2024-11-23 21:42:20,455 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40435/status 4768s 2024-11-23 21:42:20,455 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:42:20,476 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41055 4768s 2024-11-23 21:42:20,476 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41055 4768s 2024-11-23 21:42:20,476 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:42:20,476 - distributed.worker - INFO - dashboard at: 127.0.0.1:43091 4768s 2024-11-23 21:42:20,476 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 4768s 2024-11-23 21:42:20,476 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:42:20,476 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:42:20,476 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:42:20,476 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-k5l04qb6 4768s 2024-11-23 21:42:20,476 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:42:20,479 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37761 4768s 2024-11-23 21:42:20,479 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37761 4768s 2024-11-23 21:42:20,479 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:42:20,479 - distributed.worker - INFO - dashboard at: 127.0.0.1:41991 4768s 2024-11-23 21:42:20,479 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37589 4768s 2024-11-23 21:42:20,479 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:42:20,480 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:42:20,480 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:42:20,480 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-d0jcialf 4768s 2024-11-23 21:42:20,480 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:42:20,484 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41055. Reason: failure-to-start- 4768s 2024-11-23 21:42:20,484 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:42:20,485 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37761. Reason: failure-to-start- 4768s 2024-11-23 21:42:20,485 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:42:20,490 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:47192': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:42:20,490 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37589': TLS handshake failed with remote 'tls://127.0.0.1:47206': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:42:20,492 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s __________________________________ test_nanny __________________________________ 4768s 4768s fut = , timeout = 0 4768s 4768s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 4768s async with asyncio.timeout(timeout): 4768s > return await fut 4768s 4768s /usr/lib/python3/dist-packages/distributed/utils.py:1960: 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s /usr/lib/python3/dist-packages/distributed/nanny.py:358: in start_unsafe 4768s comm = await self.rpc.connect(saddr) 4768s /usr/lib/python3/dist-packages/distributed/core.py:1620: in connect 4768s return await self._connect(addr=addr, timeout=timeout) 4768s /usr/lib/python3/dist-packages/distributed/core.py:1564: in _connect 4768s comm = await connect( 4768s /usr/lib/python3/dist-packages/distributed/comm/core.py:342: in connect 4768s comm = await wait_for( 4768s /usr/lib/python3/dist-packages/distributed/utils.py:1960: in wait_for 4768s return await fut 4768s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:546: in connect 4768s stream = await self.client.connect( 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s 4768s self = , host = '127.0.0.1' 4768s port = 41039, af = 4768s ssl_options = 4768s max_buffer_size = 8364507136.0, source_ip = None, source_port = None 4768s timeout = None 4768s 4768s async def connect( 4768s self, 4768s host: str, 4768s port: int, 4768s af: socket.AddressFamily = socket.AF_UNSPEC, 4768s ssl_options: Optional[Union[Dict[str, Any], ssl.SSLContext]] = None, 4768s max_buffer_size: Optional[int] = None, 4768s source_ip: Optional[str] = None, 4768s source_port: Optional[int] = None, 4768s timeout: Optional[Union[float, datetime.timedelta]] = None, 4768s ) -> IOStream: 4768s """Connect to the given host and port. 4768s 4768s Asynchronously returns an `.IOStream` (or `.SSLIOStream` if 4768s ``ssl_options`` is not None). 4768s 4768s Using the ``source_ip`` kwarg, one can specify the source 4768s IP address to use when establishing the connection. 4768s In case the user needs to resolve and 4768s use a specific interface, it has to be handled outside 4768s of Tornado as this depends very much on the platform. 4768s 4768s Raises `TimeoutError` if the input future does not complete before 4768s ``timeout``, which may be specified in any form allowed by 4768s `.IOLoop.add_timeout` (i.e. a `datetime.timedelta` or an absolute time 4768s relative to `.IOLoop.time`) 4768s 4768s Similarly, when the user requires a certain source port, it can 4768s be specified using the ``source_port`` arg. 4768s 4768s .. versionchanged:: 4.5 4768s Added the ``source_ip`` and ``source_port`` arguments. 4768s 4768s .. versionchanged:: 5.0 4768s Added the ``timeout`` argument. 4768s """ 4768s if timeout is not None: 4768s if isinstance(timeout, numbers.Real): 4768s timeout = IOLoop.current().time() + timeout 4768s elif isinstance(timeout, datetime.timedelta): 4768s timeout = IOLoop.current().time() + timeout.total_seconds() 4768s else: 4768s raise TypeError("Unsupported timeout %r" % timeout) 4768s if timeout is not None: 4768s addrinfo = await gen.with_timeout( 4768s timeout, self.resolver.resolve(host, port, af) 4768s ) 4768s else: 4768s addrinfo = await self.resolver.resolve(host, port, af) 4768s connector = _Connector( 4768s addrinfo, 4768s functools.partial( 4768s self._create_stream, 4768s max_buffer_size, 4768s source_ip=source_ip, 4768s source_port=source_port, 4768s ), 4768s ) 4768s > af, addr, stream = await connector.start(connect_timeout=timeout) 4768s E asyncio.exceptions.CancelledError 4768s 4768s /usr/lib/python3/dist-packages/tornado/tcpclient.py:279: CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s self = 4768s 4768s @final 4768s async def start(self): 4768s async with self._startup_lock: 4768s if self.status == Status.failed: 4768s assert self.__startup_exc is not None 4768s raise self.__startup_exc 4768s elif self.status != Status.init: 4768s return self 4768s timeout = getattr(self, "death_timeout", None) 4768s 4768s async def _close_on_failure(exc: Exception) -> None: 4768s await self.close(reason=f"failure-to-start-{str(type(exc))}") 4768s self.status = Status.failed 4768s self.__startup_exc = exc 4768s 4768s try: 4768s > await wait_for(self.start_unsafe(), timeout=timeout) 4768s 4768s /usr/lib/python3/dist-packages/distributed/core.py:664: 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 4768s async with asyncio.timeout(timeout): 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s 4768s self = 4768s exc_type = 4768s exc_val = CancelledError(), exc_tb = 4768s 4768s async def __aexit__( 4768s self, 4768s exc_type: Optional[Type[BaseException]], 4768s exc_val: Optional[BaseException], 4768s exc_tb: Optional[TracebackType], 4768s ) -> Optional[bool]: 4768s assert self._state in (_State.ENTERED, _State.EXPIRING) 4768s 4768s if self._timeout_handler is not None: 4768s self._timeout_handler.cancel() 4768s self._timeout_handler = None 4768s 4768s if self._state is _State.EXPIRING: 4768s self._state = _State.EXPIRED 4768s 4768s if self._task.uncancel() <= self._cancelling and exc_type is not None: 4768s # Since there are no new cancel requests, we're 4768s # handling this. 4768s if issubclass(exc_type, exceptions.CancelledError): 4768s > raise TimeoutError from exc_val 4768s E TimeoutError 4768s 4768s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s @contextlib.asynccontextmanager 4768s async def _cluster_factory(): 4768s workers = [] 4768s s = None 4768s try: 4768s for _ in range(60): 4768s try: 4768s > s, ws = await start_cluster( 4768s nthreads, 4768s scheduler, 4768s security=security, 4768s Worker=Worker, 4768s scheduler_kwargs=scheduler_kwargs, 4768s worker_kwargs=merge( 4768s {"death_timeout": min(15, int(deadline.remaining))}, 4768s worker_kwargs, 4768s ), 4768s ) 4768s 4768s /usr/lib/python3/dist-packages/distributed/utils_test.py:966: 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s /usr/lib/python3/dist-packages/distributed/utils_test.py:789: in start_cluster 4768s await asyncio.gather(*workers) 4768s /usr/lib/python3.13/asyncio/tasks.py:737: in _wrap_awaitable 4768s return await awaitable 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s 4768s self = 4768s 4768s @final 4768s async def start(self): 4768s async with self._startup_lock: 4768s if self.status == Status.failed: 4768s assert self.__startup_exc is not None 4768s raise self.__startup_exc 4768s elif self.status != Status.init: 4768s return self 4768s timeout = getattr(self, "death_timeout", None) 4768s 4768s async def _close_on_failure(exc: Exception) -> None: 4768s await self.close(reason=f"failure-to-start-{str(type(exc))}") 4768s self.status = Status.failed 4768s self.__startup_exc = exc 4768s 4768s try: 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s except asyncio.TimeoutError as exc: 4768s await _close_on_failure(exc) 4768s > raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s E TimeoutError: Nanny start timed out after 0s. 4768s 4768s /usr/lib/python3/dist-packages/distributed/core.py:667: TimeoutError 4768s 4768s During handling of the above exception, another exception occurred: 4768s 4768s fut = ._..test_func..async_fn at 0xe99ad938> 4768s timeout = 60 4768s 4768s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 4768s async with asyncio.timeout(timeout): 4768s > return await fut 4768s 4768s /usr/lib/python3/dist-packages/distributed/utils.py:1960: 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s /usr/lib/python3/dist-packages/distributed/utils_test.py:999: in async_fn 4768s _cluster_factory() as (s, workers), 4768s /usr/lib/python3.13/contextlib.py:214: in __aenter__ 4768s return await anext(self.gen) 4768s /usr/lib/python3/dist-packages/distributed/utils_test.py:983: in _cluster_factory 4768s await asyncio.sleep(1) 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s 4768s delay = 1, result = None 4768s 4768s async def sleep(delay, result=None): 4768s """Coroutine that completes after a given time (in seconds).""" 4768s if delay <= 0: 4768s await __sleep0() 4768s return result 4768s 4768s if math.isnan(delay): 4768s raise ValueError("Invalid delay: NaN (not a number)") 4768s 4768s loop = events.get_running_loop() 4768s future = loop.create_future() 4768s h = loop.call_later(delay, 4768s futures._set_result_unless_cancelled, 4768s future, result) 4768s try: 4768s > return await future 4768s E asyncio.exceptions.CancelledError 4768s 4768s /usr/lib/python3.13/asyncio/tasks.py:718: CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s args = (), kwds = {} 4768s 4768s @wraps(func) 4768s def inner(*args, **kwds): 4768s with self._recreate_cm(): 4768s > return func(*args, **kwds) 4768s 4768s /usr/lib/python3.13/contextlib.py:85: 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s /usr/lib/python3.13/contextlib.py:85: in inner 4768s return func(*args, **kwds) 4768s /usr/lib/python3/dist-packages/distributed/utils_test.py:1102: in test_func 4768s return _run_and_close_tornado(async_fn_outer) 4768s /usr/lib/python3/dist-packages/distributed/utils_test.py:378: in _run_and_close_tornado 4768s return asyncio_run(inner_fn(), loop_factory=get_loop_factory()) 4768s /usr/lib/python3.13/asyncio/runners.py:194: in run 4768s return runner.run(main) 4768s /usr/lib/python3.13/asyncio/runners.py:118: in run 4768s return self._loop.run_until_complete(task) 4768s /usr/lib/python3.13/asyncio/base_events.py:720: in run_until_complete 4768s return future.result() 4768s /usr/lib/python3/dist-packages/distributed/utils_test.py:375: in inner_fn 4768s return await async_fn(*args, **kwargs) 4768s /usr/lib/python3/dist-packages/distributed/utils_test.py:1099: in async_fn_outer 4768s return await utils_wait_for(async_fn(), timeout=timeout * 2) 4768s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 4768s async with asyncio.timeout(timeout): 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s 4768s self = 4768s exc_type = 4768s exc_val = CancelledError(), exc_tb = 4768s 4768s async def __aexit__( 4768s self, 4768s exc_type: Optional[Type[BaseException]], 4768s exc_val: Optional[BaseException], 4768s exc_tb: Optional[TracebackType], 4768s ) -> Optional[bool]: 4768s assert self._state in (_State.ENTERED, _State.EXPIRING) 4768s 4768s if self._timeout_handler is not None: 4768s self._timeout_handler.cancel() 4768s self._timeout_handler = None 4768s 4768s if self._state is _State.EXPIRING: 4768s self._state = _State.EXPIRED 4768s 4768s if self._task.uncancel() <= self._cancelling and exc_type is not None: 4768s # Since there are no new cancel requests, we're 4768s # handling this. 4768s if issubclass(exc_type, exceptions.CancelledError): 4768s > raise TimeoutError from exc_val 4768s E TimeoutError 4768s 4768s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 4768s ----------------------------- Captured stderr call ----------------------------- 4768s 2024-11-23 21:42:21,626 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:42:21,635 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42095 4768s 2024-11-23 21:42:21,636 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46863/status 4768s 2024-11-23 21:42:21,636 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:42:21,664 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:39513'. Reason: failure-to-start- 4768s 2024-11-23 21:42:21,665 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:37697'. Reason: failure-to-start- 4768s 2024-11-23 21:42:21,665 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42095': TLS handshake failed with remote 'tls://127.0.0.1:41708': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:42:21,665 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42095': TLS handshake failed with remote 'tls://127.0.0.1:41712': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:42:21,665 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 4768s stream = await stream.start_tls( 4768s ^^^^^^^^^^^^^^^^^^^^^^^ 4768s False, ssl_options=ssl_options, server_hostname=host 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 4768s self.socket.do_handshake() 4768s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 4768s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 4768s self._sslobj.do_handshake() 4768s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 4768s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 4768s comm = await self.rpc.connect(saddr) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 4768s return await self._connect(addr=addr, timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 4768s comm = await connect( 4768s ^^^^^^^^^^^^^^ 4768s ...<4 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 4768s raise FatalCommClosedError( 4768s ...<2 lines>... 4768s ) from err 4768s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 4768s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 4768s RuntimeError: Nanny failed to start. 4768s 2024-11-23 21:42:22,673 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:42:22,683 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39847 4768s 2024-11-23 21:42:22,684 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42471/status 4768s 2024-11-23 21:42:22,684 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:42:22,715 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:45301'. Reason: failure-to-start- 4768s 2024-11-23 21:42:22,716 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:36039'. Reason: failure-to-start- 4768s 2024-11-23 21:42:22,716 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39847': TLS handshake failed with remote 'tls://127.0.0.1:48870': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:42:22,716 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39847': TLS handshake failed with remote 'tls://127.0.0.1:48880': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:42:22,716 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 4768s stream = await stream.start_tls( 4768s ^^^^^^^^^^^^^^^^^^^^^^^ 4768s False, ssl_options=ssl_options, server_hostname=host 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 4768s self.socket.do_handshake() 4768s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 4768s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 4768s self._sslobj.do_handshake() 4768s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 4768s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 4768s comm = await self.rpc.connect(saddr) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 4768s return await self._connect(addr=addr, timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 4768s comm = await connect( 4768s ^^^^^^^^^^^^^^ 4768s ...<4 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 4768s raise FatalCommClosedError( 4768s ...<2 lines>... 4768s ) from err 4768s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 4768s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 4768s RuntimeError: Nanny failed to start. 4768s 2024-11-23 21:42:23,723 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:42:23,733 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43449 4768s 2024-11-23 21:42:23,733 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36397/status 4768s 2024-11-23 21:42:23,734 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:42:23,762 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:42737'. Reason: failure-to-start- 4768s 2024-11-23 21:42:23,762 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:37105'. Reason: failure-to-start- 4768s 2024-11-23 21:42:23,763 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43449': TLS handshake failed with remote 'tls://127.0.0.1:54718': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:42:23,763 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43449': TLS handshake failed with remote 'tls://127.0.0.1:54734': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:42:23,763 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 4768s stream = await stream.start_tls( 4768s ^^^^^^^^^^^^^^^^^^^^^^^ 4768s False, ssl_options=ssl_options, server_hostname=host 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 4768s self.socket.do_handshake() 4768s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 4768s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 4768s self._sslobj.do_handshake() 4768s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 4768s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 4768s comm = await self.rpc.connect(saddr) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 4768s return await self._connect(addr=addr, timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 4768s comm = await connect( 4768s ^^^^^^^^^^^^^^ 4768s ...<4 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 4768s raise FatalCommClosedError( 4768s ...<2 lines>... 4768s ) from err 4768s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 4768s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 4768s RuntimeError: Nanny failed to start. 4768s 2024-11-23 21:42:24,769 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:42:24,778 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37587 4768s 2024-11-23 21:42:24,778 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45833/status 4768s 2024-11-23 21:42:24,779 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:42:24,808 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:38917'. Reason: failure-to-start- 4768s 2024-11-23 21:42:24,808 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:36117'. Reason: failure-to-start- 4768s 2024-11-23 21:42:24,809 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37587': TLS handshake failed with remote 'tls://127.0.0.1:56792': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:42:24,809 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37587': TLS handshake failed with remote 'tls://127.0.0.1:56794': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:42:24,809 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 4768s stream = await stream.start_tls( 4768s ^^^^^^^^^^^^^^^^^^^^^^^ 4768s False, ssl_options=ssl_options, server_hostname=host 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 4768s self.socket.do_handshake() 4768s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 4768s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 4768s self._sslobj.do_handshake() 4768s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 4768s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 4768s comm = await self.rpc.connect(saddr) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 4768s return await self._connect(addr=addr, timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 4768s comm = await connect( 4768s ^^^^^^^^^^^^^^ 4768s ...<4 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 4768s raise FatalCommClosedError( 4768s ...<2 lines>... 4768s ) from err 4768s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 4768s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 4768s RuntimeError: Nanny failed to start. 4768s 2024-11-23 21:42:25,816 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:42:25,825 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:32963 4768s 2024-11-23 21:42:25,826 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41481/status 4768s 2024-11-23 21:42:25,826 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:42:25,854 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:38833'. Reason: failure-to-start- 4768s 2024-11-23 21:42:25,854 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:38943'. Reason: failure-to-start- 4768s 2024-11-23 21:42:25,855 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:32963': TLS handshake failed with remote 'tls://127.0.0.1:35978': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:42:25,855 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:32963': TLS handshake failed with remote 'tls://127.0.0.1:35986': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:42:25,855 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 4768s stream = await stream.start_tls( 4768s ^^^^^^^^^^^^^^^^^^^^^^^ 4768s False, ssl_options=ssl_options, server_hostname=host 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 4768s self.socket.do_handshake() 4768s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 4768s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 4768s self._sslobj.do_handshake() 4768s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 4768s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 4768s comm = await self.rpc.connect(saddr) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 4768s return await self._connect(addr=addr, timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 4768s comm = await connect( 4768s ^^^^^^^^^^^^^^ 4768s ...<4 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 4768s raise FatalCommClosedError( 4768s ...<2 lines>... 4768s ) from err 4768s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 4768s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 4768s RuntimeError: Nanny failed to start. 4768s 2024-11-23 21:42:26,862 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:42:26,870 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42067 4768s 2024-11-23 21:42:26,870 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:32901/status 4768s 2024-11-23 21:42:26,871 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:42:26,898 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:38257'. Reason: failure-to-start- 4768s 2024-11-23 21:42:26,899 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:45895'. Reason: failure-to-start- 4768s 2024-11-23 21:42:26,899 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42067': TLS handshake failed with remote 'tls://127.0.0.1:50478': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:42:26,899 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42067': TLS handshake failed with remote 'tls://127.0.0.1:50492': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:42:26,900 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 4768s stream = await stream.start_tls( 4768s ^^^^^^^^^^^^^^^^^^^^^^^ 4768s False, ssl_options=ssl_options, server_hostname=host 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 4768s self.socket.do_handshake() 4768s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 4768s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 4768s self._sslobj.do_handshake() 4768s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 4768s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 4768s comm = await self.rpc.connect(saddr) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 4768s return await self._connect(addr=addr, timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 4768s comm = await connect( 4768s ^^^^^^^^^^^^^^ 4768s ...<4 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 4768s raise FatalCommClosedError( 4768s ...<2 lines>... 4768s ) from err 4768s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 4768s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 4768s RuntimeError: Nanny failed to start. 4768s 2024-11-23 21:42:27,905 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:42:27,914 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33493 4768s 2024-11-23 21:42:27,914 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38021/status 4768s 2024-11-23 21:42:27,914 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:42:27,940 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:41395'. Reason: failure-to-start- 4768s 2024-11-23 21:42:27,940 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:35873'. Reason: failure-to-start- 4768s 2024-11-23 21:42:27,941 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33493': TLS handshake failed with remote 'tls://127.0.0.1:53560': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:42:27,941 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33493': TLS handshake failed with remote 'tls://127.0.0.1:53566': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:42:27,941 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 4768s stream = await stream.start_tls( 4768s ^^^^^^^^^^^^^^^^^^^^^^^ 4768s False, ssl_options=ssl_options, server_hostname=host 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 4768s self.socket.do_handshake() 4768s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 4768s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 4768s self._sslobj.do_handshake() 4768s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 4768s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 4768s comm = await self.rpc.connect(saddr) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 4768s return await self._connect(addr=addr, timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 4768s comm = await connect( 4768s ^^^^^^^^^^^^^^ 4768s ...<4 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 4768s raise FatalCommClosedError( 4768s ...<2 lines>... 4768s ) from err 4768s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 4768s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 4768s RuntimeError: Nanny failed to start. 4768s 2024-11-23 21:42:28,948 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:42:28,956 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40847 4768s 2024-11-23 21:42:28,957 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44709/status 4768s 2024-11-23 21:42:28,957 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:42:28,985 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:40927'. Reason: failure-to-start- 4768s 2024-11-23 21:42:28,986 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:44625'. Reason: failure-to-start- 4768s 2024-11-23 21:42:28,987 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40847': TLS handshake failed with remote 'tls://127.0.0.1:40880': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:42:28,987 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40847': TLS handshake failed with remote 'tls://127.0.0.1:40882': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:42:28,987 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 4768s stream = await stream.start_tls( 4768s ^^^^^^^^^^^^^^^^^^^^^^^ 4768s False, ssl_options=ssl_options, server_hostname=host 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 4768s self.socket.do_handshake() 4768s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 4768s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 4768s self._sslobj.do_handshake() 4768s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 4768s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 4768s comm = await self.rpc.connect(saddr) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 4768s return await self._connect(addr=addr, timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 4768s comm = await connect( 4768s ^^^^^^^^^^^^^^ 4768s ...<4 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 4768s raise FatalCommClosedError( 4768s ...<2 lines>... 4768s ) from err 4768s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 4768s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 4768s RuntimeError: Nanny failed to start. 4768s 2024-11-23 21:42:29,993 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:42:30,002 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43427 4768s 2024-11-23 21:42:30,002 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33101/status 4768s 2024-11-23 21:42:30,003 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:42:30,030 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:40431'. Reason: failure-to-start- 4768s 2024-11-23 21:42:30,030 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:40781'. Reason: failure-to-start- 4768s 2024-11-23 21:42:30,031 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43427': TLS handshake failed with remote 'tls://127.0.0.1:35634': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:42:30,031 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43427': TLS handshake failed with remote 'tls://127.0.0.1:35646': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:42:30,031 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 4768s stream = await stream.start_tls( 4768s ^^^^^^^^^^^^^^^^^^^^^^^ 4768s False, ssl_options=ssl_options, server_hostname=host 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 4768s self.socket.do_handshake() 4768s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 4768s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 4768s self._sslobj.do_handshake() 4768s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 4768s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 4768s comm = await self.rpc.connect(saddr) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 4768s return await self._connect(addr=addr, timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 4768s comm = await connect( 4768s ^^^^^^^^^^^^^^ 4768s ...<4 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 4768s raise FatalCommClosedError( 4768s ...<2 lines>... 4768s ) from err 4768s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 4768s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 4768s RuntimeError: Nanny failed to start. 4768s 2024-11-23 21:42:31,037 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:42:31,046 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45771 4768s 2024-11-23 21:42:31,047 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35659/status 4768s 2024-11-23 21:42:31,047 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:42:31,078 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:43041'. Reason: failure-to-start- 4768s 2024-11-23 21:42:31,079 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:43243'. Reason: failure-to-start- 4768s 2024-11-23 21:42:31,080 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45771': TLS handshake failed with remote 'tls://127.0.0.1:34248': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:42:31,080 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45771': TLS handshake failed with remote 'tls://127.0.0.1:34250': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:42:31,080 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 4768s stream = await stream.start_tls( 4768s ^^^^^^^^^^^^^^^^^^^^^^^ 4768s False, ssl_options=ssl_options, server_hostname=host 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 4768s self.socket.do_handshake() 4768s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 4768s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 4768s self._sslobj.do_handshake() 4768s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 4768s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 4768s comm = await self.rpc.connect(saddr) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 4768s return await self._connect(addr=addr, timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 4768s comm = await connect( 4768s ^^^^^^^^^^^^^^ 4768s ...<4 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 4768s raise FatalCommClosedError( 4768s ...<2 lines>... 4768s ) from err 4768s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 4768s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 4768s RuntimeError: Nanny failed to start. 4768s 2024-11-23 21:42:32,087 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:42:32,096 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:32775 4768s 2024-11-23 21:42:32,096 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41637/status 4768s 2024-11-23 21:42:32,097 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:42:32,125 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:38071'. Reason: failure-to-start- 4768s 2024-11-23 21:42:32,126 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:42985'. Reason: failure-to-start- 4768s 2024-11-23 21:42:32,127 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:32775': TLS handshake failed with remote 'tls://127.0.0.1:49990': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:42:32,127 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:32775': TLS handshake failed with remote 'tls://127.0.0.1:50002': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:42:32,127 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 4768s stream = await stream.start_tls( 4768s ^^^^^^^^^^^^^^^^^^^^^^^ 4768s False, ssl_options=ssl_options, server_hostname=host 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 4768s self.socket.do_handshake() 4768s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 4768s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 4768s self._sslobj.do_handshake() 4768s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 4768s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 4768s comm = await self.rpc.connect(saddr) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 4768s return await self._connect(addr=addr, timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 4768s comm = await connect( 4768s ^^^^^^^^^^^^^^ 4768s ...<4 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 4768s raise FatalCommClosedError( 4768s ...<2 lines>... 4768s ) from err 4768s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 4768s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 4768s RuntimeError: Nanny failed to start. 4768s 2024-11-23 21:42:33,133 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:42:33,142 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46483 4768s 2024-11-23 21:42:33,143 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39995/status 4768s 2024-11-23 21:42:33,143 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:42:33,175 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:33623'. Reason: failure-to-start- 4768s 2024-11-23 21:42:33,175 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:34691'. Reason: failure-to-start- 4768s 2024-11-23 21:42:33,176 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46483': TLS handshake failed with remote 'tls://127.0.0.1:42750': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:42:33,176 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46483': TLS handshake failed with remote 'tls://127.0.0.1:42756': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:42:33,176 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 4768s stream = await stream.start_tls( 4768s ^^^^^^^^^^^^^^^^^^^^^^^ 4768s False, ssl_options=ssl_options, server_hostname=host 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 4768s self.socket.do_handshake() 4768s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 4768s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 4768s self._sslobj.do_handshake() 4768s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 4768s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 4768s comm = await self.rpc.connect(saddr) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 4768s return await self._connect(addr=addr, timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 4768s comm = await connect( 4768s ^^^^^^^^^^^^^^ 4768s ...<4 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 4768s raise FatalCommClosedError( 4768s ...<2 lines>... 4768s ) from err 4768s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 4768s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 4768s RuntimeError: Nanny failed to start. 4768s 2024-11-23 21:42:34,183 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:42:34,191 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44887 4768s 2024-11-23 21:42:34,191 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42593/status 4768s 2024-11-23 21:42:34,192 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:42:34,221 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:40935'. Reason: failure-to-start- 4768s 2024-11-23 21:42:34,221 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:40445'. Reason: failure-to-start- 4768s 2024-11-23 21:42:34,222 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44887': TLS handshake failed with remote 'tls://127.0.0.1:60108': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:42:34,222 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44887': TLS handshake failed with remote 'tls://127.0.0.1:60118': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:42:34,222 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 4768s stream = await stream.start_tls( 4768s ^^^^^^^^^^^^^^^^^^^^^^^ 4768s False, ssl_options=ssl_options, server_hostname=host 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 4768s self.socket.do_handshake() 4768s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 4768s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 4768s self._sslobj.do_handshake() 4768s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 4768s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 4768s comm = await self.rpc.connect(saddr) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 4768s return await self._connect(addr=addr, timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 4768s comm = await connect( 4768s ^^^^^^^^^^^^^^ 4768s ...<4 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 4768s raise FatalCommClosedError( 4768s ...<2 lines>... 4768s ) from err 4768s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 4768s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 4768s RuntimeError: Nanny failed to start. 4768s 2024-11-23 21:42:35,229 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:42:35,238 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34313 4768s 2024-11-23 21:42:35,238 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42697/status 4768s 2024-11-23 21:42:35,239 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:42:35,271 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:36221'. Reason: failure-to-start- 4768s 2024-11-23 21:42:35,272 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:35637'. Reason: failure-to-start- 4768s 2024-11-23 21:42:35,273 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34313': TLS handshake failed with remote 'tls://127.0.0.1:33718': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:42:35,273 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34313': TLS handshake failed with remote 'tls://127.0.0.1:33722': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:42:35,273 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 4768s stream = await stream.start_tls( 4768s ^^^^^^^^^^^^^^^^^^^^^^^ 4768s False, ssl_options=ssl_options, server_hostname=host 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 4768s self.socket.do_handshake() 4768s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 4768s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 4768s self._sslobj.do_handshake() 4768s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 4768s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 4768s comm = await self.rpc.connect(saddr) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 4768s return await self._connect(addr=addr, timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 4768s comm = await connect( 4768s ^^^^^^^^^^^^^^ 4768s ...<4 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 4768s raise FatalCommClosedError( 4768s ...<2 lines>... 4768s ) from err 4768s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 4768s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 4768s RuntimeError: Nanny failed to start. 4768s 2024-11-23 21:42:36,279 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:42:36,287 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35763 4768s 2024-11-23 21:42:36,288 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44241/status 4768s 2024-11-23 21:42:36,288 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:42:36,318 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:45491'. Reason: failure-to-start- 4768s 2024-11-23 21:42:36,319 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:42865'. Reason: failure-to-start- 4768s 2024-11-23 21:42:36,319 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35763': TLS handshake failed with remote 'tls://127.0.0.1:42346': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:42:36,320 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35763': TLS handshake failed with remote 'tls://127.0.0.1:42352': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:42:36,320 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 4768s stream = await stream.start_tls( 4768s ^^^^^^^^^^^^^^^^^^^^^^^ 4768s False, ssl_options=ssl_options, server_hostname=host 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 4768s self.socket.do_handshake() 4768s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 4768s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 4768s self._sslobj.do_handshake() 4768s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 4768s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 4768s comm = await self.rpc.connect(saddr) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 4768s return await self._connect(addr=addr, timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 4768s comm = await connect( 4768s ^^^^^^^^^^^^^^ 4768s ...<4 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 4768s raise FatalCommClosedError( 4768s ...<2 lines>... 4768s ) from err 4768s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 4768s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 4768s RuntimeError: Nanny failed to start. 4768s 2024-11-23 21:42:37,326 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:42:37,334 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45011 4768s 2024-11-23 21:42:37,335 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44017/status 4768s 2024-11-23 21:42:37,335 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:42:37,368 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:34087'. Reason: failure-to-start- 4768s 2024-11-23 21:42:37,369 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:45131'. Reason: failure-to-start- 4768s 2024-11-23 21:42:37,370 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45011': TLS handshake failed with remote 'tls://127.0.0.1:39454': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:42:37,370 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45011': TLS handshake failed with remote 'tls://127.0.0.1:39460': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:42:37,370 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 4768s stream = await stream.start_tls( 4768s ^^^^^^^^^^^^^^^^^^^^^^^ 4768s False, ssl_options=ssl_options, server_hostname=host 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 4768s self.socket.do_handshake() 4768s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 4768s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 4768s self._sslobj.do_handshake() 4768s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 4768s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 4768s comm = await self.rpc.connect(saddr) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 4768s return await self._connect(addr=addr, timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 4768s comm = await connect( 4768s ^^^^^^^^^^^^^^ 4768s ...<4 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 4768s raise FatalCommClosedError( 4768s ...<2 lines>... 4768s ) from err 4768s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 4768s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 4768s RuntimeError: Nanny failed to start. 4768s 2024-11-23 21:42:38,378 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:42:38,387 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41909 4768s 2024-11-23 21:42:38,387 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43185/status 4768s 2024-11-23 21:42:38,388 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:42:38,416 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:42369'. Reason: failure-to-start- 4768s 2024-11-23 21:42:38,416 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:37227'. Reason: failure-to-start- 4768s 2024-11-23 21:42:38,417 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41909': TLS handshake failed with remote 'tls://127.0.0.1:37674': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:42:38,417 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41909': TLS handshake failed with remote 'tls://127.0.0.1:37686': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:42:38,420 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 4768s stream = await stream.start_tls( 4768s ^^^^^^^^^^^^^^^^^^^^^^^ 4768s False, ssl_options=ssl_options, server_hostname=host 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 4768s self.socket.do_handshake() 4768s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 4768s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 4768s self._sslobj.do_handshake() 4768s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 4768s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 4768s comm = await self.rpc.connect(saddr) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 4768s return await self._connect(addr=addr, timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 4768s comm = await connect( 4768s ^^^^^^^^^^^^^^ 4768s ...<4 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 4768s raise FatalCommClosedError( 4768s ...<2 lines>... 4768s ) from err 4768s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 4768s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 4768s RuntimeError: Nanny failed to start. 4768s 2024-11-23 21:42:39,426 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:42:39,435 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36661 4768s 2024-11-23 21:42:39,435 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39161/status 4768s 2024-11-23 21:42:39,436 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:42:39,465 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:46771'. Reason: failure-to-start- 4768s 2024-11-23 21:42:39,466 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:40885'. Reason: failure-to-start- 4768s 2024-11-23 21:42:39,469 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36661': TLS handshake failed with remote 'tls://127.0.0.1:52094': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:42:39,469 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36661': TLS handshake failed with remote 'tls://127.0.0.1:52106': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:42:39,469 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 4768s stream = await stream.start_tls( 4768s ^^^^^^^^^^^^^^^^^^^^^^^ 4768s False, ssl_options=ssl_options, server_hostname=host 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 4768s self.socket.do_handshake() 4768s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 4768s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 4768s self._sslobj.do_handshake() 4768s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 4768s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 4768s comm = await self.rpc.connect(saddr) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 4768s return await self._connect(addr=addr, timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 4768s comm = await connect( 4768s ^^^^^^^^^^^^^^ 4768s ...<4 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 4768s raise FatalCommClosedError( 4768s ...<2 lines>... 4768s ) from err 4768s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 4768s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 4768s RuntimeError: Nanny failed to start. 4768s 2024-11-23 21:42:40,476 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:42:40,484 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35747 4768s 2024-11-23 21:42:40,485 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37565/status 4768s 2024-11-23 21:42:40,485 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:42:40,513 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:39525'. Reason: failure-to-start- 4768s 2024-11-23 21:42:40,514 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:33387'. Reason: failure-to-start- 4768s 2024-11-23 21:42:40,517 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35747': TLS handshake failed with remote 'tls://127.0.0.1:56162': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:42:40,517 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35747': TLS handshake failed with remote 'tls://127.0.0.1:56164': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:42:40,518 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 4768s stream = await stream.start_tls( 4768s ^^^^^^^^^^^^^^^^^^^^^^^ 4768s False, ssl_options=ssl_options, server_hostname=host 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 4768s self.socket.do_handshake() 4768s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 4768s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 4768s self._sslobj.do_handshake() 4768s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 4768s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 4768s comm = await self.rpc.connect(saddr) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 4768s return await self._connect(addr=addr, timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 4768s comm = await connect( 4768s ^^^^^^^^^^^^^^ 4768s ...<4 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 4768s raise FatalCommClosedError( 4768s ...<2 lines>... 4768s ) from err 4768s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 4768s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 4768s RuntimeError: Nanny failed to start. 4768s 2024-11-23 21:42:41,524 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:42:41,532 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45217 4768s 2024-11-23 21:42:41,533 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39853/status 4768s 2024-11-23 21:42:41,533 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:42:41,567 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:41435'. Reason: failure-to-start- 4768s 2024-11-23 21:42:41,567 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:39419'. Reason: failure-to-start- 4768s 2024-11-23 21:42:41,568 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45217': TLS handshake failed with remote 'tls://127.0.0.1:60522': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:42:41,568 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45217': TLS handshake failed with remote 'tls://127.0.0.1:60530': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:42:41,568 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 4768s stream = await stream.start_tls( 4768s ^^^^^^^^^^^^^^^^^^^^^^^ 4768s False, ssl_options=ssl_options, server_hostname=host 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 4768s self.socket.do_handshake() 4768s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 4768s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 4768s self._sslobj.do_handshake() 4768s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 4768s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 4768s comm = await self.rpc.connect(saddr) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 4768s return await self._connect(addr=addr, timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 4768s comm = await connect( 4768s ^^^^^^^^^^^^^^ 4768s ...<4 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 4768s raise FatalCommClosedError( 4768s ...<2 lines>... 4768s ) from err 4768s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 4768s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 4768s RuntimeError: Nanny failed to start. 4768s 2024-11-23 21:42:42,576 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:42:42,584 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37355 4768s 2024-11-23 21:42:42,585 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37585/status 4768s 2024-11-23 21:42:42,585 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:42:42,617 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:33305'. Reason: failure-to-start- 4768s 2024-11-23 21:42:42,618 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:39279'. Reason: failure-to-start- 4768s 2024-11-23 21:42:42,618 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37355': TLS handshake failed with remote 'tls://127.0.0.1:40228': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:42:42,619 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37355': TLS handshake failed with remote 'tls://127.0.0.1:40244': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:42:42,619 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 4768s stream = await stream.start_tls( 4768s ^^^^^^^^^^^^^^^^^^^^^^^ 4768s False, ssl_options=ssl_options, server_hostname=host 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 4768s self.socket.do_handshake() 4768s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 4768s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 4768s self._sslobj.do_handshake() 4768s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 4768s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 4768s comm = await self.rpc.connect(saddr) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 4768s return await self._connect(addr=addr, timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 4768s comm = await connect( 4768s ^^^^^^^^^^^^^^ 4768s ...<4 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 4768s raise FatalCommClosedError( 4768s ...<2 lines>... 4768s ) from err 4768s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 4768s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 4768s RuntimeError: Nanny failed to start. 4768s 2024-11-23 21:42:43,625 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:42:43,635 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46673 4768s 2024-11-23 21:42:43,635 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34823/status 4768s 2024-11-23 21:42:43,637 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:42:43,672 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:41975'. Reason: failure-to-start- 4768s 2024-11-23 21:42:43,672 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:43203'. Reason: failure-to-start- 4768s 2024-11-23 21:42:43,673 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46673': TLS handshake failed with remote 'tls://127.0.0.1:43730': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:42:43,673 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46673': TLS handshake failed with remote 'tls://127.0.0.1:43742': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:42:43,673 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 4768s stream = await stream.start_tls( 4768s ^^^^^^^^^^^^^^^^^^^^^^^ 4768s False, ssl_options=ssl_options, server_hostname=host 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 4768s self.socket.do_handshake() 4768s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 4768s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 4768s self._sslobj.do_handshake() 4768s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 4768s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 4768s comm = await self.rpc.connect(saddr) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 4768s return await self._connect(addr=addr, timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 4768s comm = await connect( 4768s ^^^^^^^^^^^^^^ 4768s ...<4 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 4768s raise FatalCommClosedError( 4768s ...<2 lines>... 4768s ) from err 4768s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 4768s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 4768s RuntimeError: Nanny failed to start. 4768s 2024-11-23 21:42:44,679 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:42:44,688 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36617 4768s 2024-11-23 21:42:44,689 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42679/status 4768s 2024-11-23 21:42:44,689 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:42:44,724 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:36101'. Reason: failure-to-start- 4768s 2024-11-23 21:42:44,724 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:34757'. Reason: failure-to-start- 4768s 2024-11-23 21:42:44,725 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36617': TLS handshake failed with remote 'tls://127.0.0.1:37146': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:42:44,725 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36617': TLS handshake failed with remote 'tls://127.0.0.1:37154': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:42:44,725 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 4768s stream = await stream.start_tls( 4768s ^^^^^^^^^^^^^^^^^^^^^^^ 4768s False, ssl_options=ssl_options, server_hostname=host 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 4768s self.socket.do_handshake() 4768s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 4768s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 4768s self._sslobj.do_handshake() 4768s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 4768s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 4768s comm = await self.rpc.connect(saddr) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 4768s return await self._connect(addr=addr, timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 4768s comm = await connect( 4768s ^^^^^^^^^^^^^^ 4768s ...<4 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 4768s raise FatalCommClosedError( 4768s ...<2 lines>... 4768s ) from err 4768s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 4768s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 4768s RuntimeError: Nanny failed to start. 4768s 2024-11-23 21:42:45,731 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:42:45,759 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39183 4768s 2024-11-23 21:42:45,759 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45183/status 4768s 2024-11-23 21:42:45,760 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:42:45,799 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:39795'. Reason: failure-to-start- 4768s 2024-11-23 21:42:45,800 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:40353'. Reason: failure-to-start- 4768s 2024-11-23 21:42:45,804 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39183': TLS handshake failed with remote 'tls://127.0.0.1:58780': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:42:45,804 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39183': TLS handshake failed with remote 'tls://127.0.0.1:58786': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:42:45,804 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 4768s stream = await stream.start_tls( 4768s ^^^^^^^^^^^^^^^^^^^^^^^ 4768s False, ssl_options=ssl_options, server_hostname=host 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 4768s self.socket.do_handshake() 4768s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 4768s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 4768s self._sslobj.do_handshake() 4768s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 4768s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 4768s comm = await self.rpc.connect(saddr) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 4768s return await self._connect(addr=addr, timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 4768s comm = await connect( 4768s ^^^^^^^^^^^^^^ 4768s ...<4 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 4768s raise FatalCommClosedError( 4768s ...<2 lines>... 4768s ) from err 4768s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 4768s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 4768s RuntimeError: Nanny failed to start. 4768s 2024-11-23 21:42:46,810 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:42:46,819 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36783 4768s 2024-11-23 21:42:46,819 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42883/status 4768s 2024-11-23 21:42:46,820 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:42:46,854 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:45325'. Reason: failure-to-start- 4768s 2024-11-23 21:42:46,854 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:33835'. Reason: failure-to-start- 4768s 2024-11-23 21:42:46,855 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36783': TLS handshake failed with remote 'tls://127.0.0.1:56046': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:42:46,855 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36783': TLS handshake failed with remote 'tls://127.0.0.1:56062': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:42:46,855 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 4768s stream = await stream.start_tls( 4768s ^^^^^^^^^^^^^^^^^^^^^^^ 4768s False, ssl_options=ssl_options, server_hostname=host 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 4768s self.socket.do_handshake() 4768s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 4768s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 4768s self._sslobj.do_handshake() 4768s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 4768s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 4768s comm = await self.rpc.connect(saddr) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 4768s return await self._connect(addr=addr, timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 4768s comm = await connect( 4768s ^^^^^^^^^^^^^^ 4768s ...<4 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 4768s raise FatalCommClosedError( 4768s ...<2 lines>... 4768s ) from err 4768s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 4768s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 4768s RuntimeError: Nanny failed to start. 4768s 2024-11-23 21:42:47,862 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:42:48,242 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38115 4768s 2024-11-23 21:42:48,242 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45271/status 4768s 2024-11-23 21:42:48,243 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:42:48,325 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:38103'. Reason: failure-to-start- 4768s 2024-11-23 21:42:48,326 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:35589'. Reason: failure-to-start- 4768s 2024-11-23 21:42:48,329 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38115': TLS handshake failed with remote 'tls://127.0.0.1:56936': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:42:48,329 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38115': TLS handshake failed with remote 'tls://127.0.0.1:56952': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:42:48,329 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 4768s stream = await stream.start_tls( 4768s ^^^^^^^^^^^^^^^^^^^^^^^ 4768s False, ssl_options=ssl_options, server_hostname=host 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 4768s self.socket.do_handshake() 4768s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 4768s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 4768s self._sslobj.do_handshake() 4768s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 4768s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 4768s comm = await self.rpc.connect(saddr) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 4768s return await self._connect(addr=addr, timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 4768s comm = await connect( 4768s ^^^^^^^^^^^^^^ 4768s ...<4 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 4768s raise FatalCommClosedError( 4768s ...<2 lines>... 4768s ) from err 4768s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 4768s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 4768s RuntimeError: Nanny failed to start. 4768s 2024-11-23 21:42:49,336 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:42:49,344 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33593 4768s 2024-11-23 21:42:49,344 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34495/status 4768s 2024-11-23 21:42:49,345 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:42:49,377 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:34931'. Reason: failure-to-start- 4768s 2024-11-23 21:42:49,377 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:38677'. Reason: failure-to-start- 4768s 2024-11-23 21:42:49,381 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33593': TLS handshake failed with remote 'tls://127.0.0.1:58958': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:42:49,381 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33593': TLS handshake failed with remote 'tls://127.0.0.1:58970': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:42:49,381 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 4768s stream = await stream.start_tls( 4768s ^^^^^^^^^^^^^^^^^^^^^^^ 4768s False, ssl_options=ssl_options, server_hostname=host 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 4768s self.socket.do_handshake() 4768s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 4768s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 4768s self._sslobj.do_handshake() 4768s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 4768s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 4768s comm = await self.rpc.connect(saddr) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 4768s return await self._connect(addr=addr, timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 4768s comm = await connect( 4768s ^^^^^^^^^^^^^^ 4768s ...<4 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 4768s raise FatalCommClosedError( 4768s ...<2 lines>... 4768s ) from err 4768s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 4768s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 4768s RuntimeError: Nanny failed to start. 4768s 2024-11-23 21:42:50,387 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:42:50,395 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42375 4768s 2024-11-23 21:42:50,396 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44443/status 4768s 2024-11-23 21:42:50,396 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:42:50,432 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:37335'. Reason: failure-to-start- 4768s 2024-11-23 21:42:50,432 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:36263'. Reason: failure-to-start- 4768s 2024-11-23 21:42:50,433 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42375': TLS handshake failed with remote 'tls://127.0.0.1:34646': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:42:50,433 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42375': TLS handshake failed with remote 'tls://127.0.0.1:34662': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:42:50,433 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 4768s stream = await stream.start_tls( 4768s ^^^^^^^^^^^^^^^^^^^^^^^ 4768s False, ssl_options=ssl_options, server_hostname=host 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 4768s self.socket.do_handshake() 4768s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 4768s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 4768s self._sslobj.do_handshake() 4768s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 4768s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 4768s comm = await self.rpc.connect(saddr) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 4768s return await self._connect(addr=addr, timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 4768s comm = await connect( 4768s ^^^^^^^^^^^^^^ 4768s ...<4 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 4768s raise FatalCommClosedError( 4768s ...<2 lines>... 4768s ) from err 4768s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 4768s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 4768s RuntimeError: Nanny failed to start. 4768s 2024-11-23 21:42:51,439 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:42:51,447 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39753 4768s 2024-11-23 21:42:51,447 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41177/status 4768s 2024-11-23 21:42:51,450 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:42:51,468 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:34475'. Reason: failure-to-start- 4768s 2024-11-23 21:42:51,468 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:46427'. Reason: failure-to-start- 4768s 2024-11-23 21:42:51,469 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39753': TLS handshake failed with remote 'tls://127.0.0.1:53288': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:42:51,469 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39753': TLS handshake failed with remote 'tls://127.0.0.1:53296': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:42:51,469 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 4768s comm = await self.rpc.connect(saddr) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 4768s return await self._connect(addr=addr, timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 4768s comm = await connect( 4768s ^^^^^^^^^^^^^^ 4768s ...<4 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Nanny start timed out after 0s. 4768s 2024-11-23 21:42:52,475 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:42:52,483 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44445 4768s 2024-11-23 21:42:52,484 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39351/status 4768s 2024-11-23 21:42:52,484 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:42:52,505 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:36271'. Reason: failure-to-start- 4768s 2024-11-23 21:42:52,505 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:43133'. Reason: failure-to-start- 4768s 2024-11-23 21:42:52,509 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44445': TLS handshake failed with remote 'tls://127.0.0.1:44868': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:42:52,509 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44445': TLS handshake failed with remote 'tls://127.0.0.1:44876': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:42:52,509 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 4768s comm = await self.rpc.connect(saddr) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 4768s return await self._connect(addr=addr, timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 4768s comm = await connect( 4768s ^^^^^^^^^^^^^^ 4768s ...<4 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Nanny start timed out after 0s. 4768s 2024-11-23 21:42:53,515 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:42:53,524 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37969 4768s 2024-11-23 21:42:53,524 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44219/status 4768s 2024-11-23 21:42:53,525 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:42:53,543 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:36689'. Reason: failure-to-start- 4768s 2024-11-23 21:42:53,543 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:38991'. Reason: failure-to-start- 4768s 2024-11-23 21:42:53,544 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37969': TLS handshake failed with remote 'tls://127.0.0.1:42820': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:42:53,544 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37969': TLS handshake failed with remote 'tls://127.0.0.1:42836': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:42:53,545 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 4768s comm = await self.rpc.connect(saddr) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 4768s return await self._connect(addr=addr, timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 4768s comm = await connect( 4768s ^^^^^^^^^^^^^^ 4768s ...<4 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Nanny start timed out after 0s. 4768s 2024-11-23 21:42:54,551 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:42:54,562 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33743 4768s 2024-11-23 21:42:54,562 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38917/status 4768s 2024-11-23 21:42:54,565 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:42:54,581 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:37633'. Reason: failure-to-start- 4768s 2024-11-23 21:42:54,581 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:32795'. Reason: failure-to-start- 4768s 2024-11-23 21:42:54,582 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33743': TLS handshake failed with remote 'tls://127.0.0.1:46502': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:42:54,582 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33743': TLS handshake failed with remote 'tls://127.0.0.1:46508': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:42:54,583 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 4768s comm = await self.rpc.connect(saddr) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 4768s return await self._connect(addr=addr, timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 4768s comm = await connect( 4768s ^^^^^^^^^^^^^^ 4768s ...<4 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Nanny start timed out after 0s. 4768s 2024-11-23 21:42:55,589 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:42:55,597 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40467 4768s 2024-11-23 21:42:55,598 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46117/status 4768s 2024-11-23 21:42:55,601 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:42:55,619 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:41779'. Reason: failure-to-start- 4768s 2024-11-23 21:42:55,620 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:45027'. Reason: failure-to-start- 4768s 2024-11-23 21:42:55,620 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40467': TLS handshake failed with remote 'tls://127.0.0.1:34936': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:42:55,621 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40467': TLS handshake failed with remote 'tls://127.0.0.1:34942': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:42:55,621 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 4768s comm = await self.rpc.connect(saddr) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 4768s return await self._connect(addr=addr, timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 4768s comm = await connect( 4768s ^^^^^^^^^^^^^^ 4768s ...<4 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Nanny start timed out after 0s. 4768s 2024-11-23 21:42:56,627 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:42:56,638 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39715 4768s 2024-11-23 21:42:56,639 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33723/status 4768s 2024-11-23 21:42:56,639 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:42:56,664 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:38599'. Reason: failure-to-start- 4768s 2024-11-23 21:42:56,665 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:40979'. Reason: failure-to-start- 4768s 2024-11-23 21:42:56,666 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39715': TLS handshake failed with remote 'tls://127.0.0.1:36428': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:42:56,666 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39715': TLS handshake failed with remote 'tls://127.0.0.1:36438': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:42:56,666 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 4768s comm = await self.rpc.connect(saddr) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 4768s return await self._connect(addr=addr, timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 4768s comm = await connect( 4768s ^^^^^^^^^^^^^^ 4768s ...<4 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Nanny start timed out after 0s. 4768s 2024-11-23 21:42:57,672 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:42:57,680 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36651 4768s 2024-11-23 21:42:57,681 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44609/status 4768s 2024-11-23 21:42:57,681 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:42:57,699 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:41961'. Reason: failure-to-start- 4768s 2024-11-23 21:42:57,699 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:39981'. Reason: failure-to-start- 4768s 2024-11-23 21:42:57,705 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36651': TLS handshake failed with remote 'tls://127.0.0.1:60572': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:42:57,705 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36651': TLS handshake failed with remote 'tls://127.0.0.1:60574': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:42:57,705 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 4768s comm = await self.rpc.connect(saddr) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 4768s return await self._connect(addr=addr, timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 4768s comm = await connect( 4768s ^^^^^^^^^^^^^^ 4768s ...<4 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Nanny start timed out after 0s. 4768s 2024-11-23 21:42:58,712 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:42:58,723 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35753 4768s 2024-11-23 21:42:58,723 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41951/status 4768s 2024-11-23 21:42:58,723 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:42:58,742 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:37455'. Reason: failure-to-start- 4768s 2024-11-23 21:42:58,742 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:38899'. Reason: failure-to-start- 4768s 2024-11-23 21:42:58,744 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35753': TLS handshake failed with remote 'tls://127.0.0.1:41986': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:42:58,744 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35753': TLS handshake failed with remote 'tls://127.0.0.1:41988': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:42:58,744 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 4768s comm = await self.rpc.connect(saddr) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 4768s return await self._connect(addr=addr, timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 4768s comm = await connect( 4768s ^^^^^^^^^^^^^^ 4768s ...<4 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Nanny start timed out after 0s. 4768s 2024-11-23 21:42:59,750 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:42:59,758 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41937 4768s 2024-11-23 21:42:59,758 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44337/status 4768s 2024-11-23 21:42:59,759 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:42:59,779 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:46019'. Reason: failure-to-start- 4768s 2024-11-23 21:42:59,779 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:44535'. Reason: failure-to-start- 4768s 2024-11-23 21:42:59,780 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41937': TLS handshake failed with remote 'tls://127.0.0.1:57710': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:42:59,780 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41937': TLS handshake failed with remote 'tls://127.0.0.1:57712': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:42:59,780 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 4768s comm = await self.rpc.connect(saddr) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 4768s return await self._connect(addr=addr, timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 4768s comm = await connect( 4768s ^^^^^^^^^^^^^^ 4768s ...<4 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Nanny start timed out after 0s. 4768s 2024-11-23 21:43:00,786 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:43:00,798 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46587 4768s 2024-11-23 21:43:00,798 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43773/status 4768s 2024-11-23 21:43:00,799 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:43:00,820 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:38375'. Reason: failure-to-start- 4768s 2024-11-23 21:43:00,821 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:36895'. Reason: failure-to-start- 4768s 2024-11-23 21:43:00,822 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46587': TLS handshake failed with remote 'tls://127.0.0.1:53332': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:43:00,822 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46587': TLS handshake failed with remote 'tls://127.0.0.1:53344': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:43:00,825 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 4768s comm = await self.rpc.connect(saddr) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 4768s return await self._connect(addr=addr, timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 4768s comm = await connect( 4768s ^^^^^^^^^^^^^^ 4768s ...<4 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Nanny start timed out after 0s. 4768s 2024-11-23 21:43:01,832 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:43:01,840 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44669 4768s 2024-11-23 21:43:01,841 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44573/status 4768s 2024-11-23 21:43:01,841 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:43:01,863 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:40981'. Reason: failure-to-start- 4768s 2024-11-23 21:43:01,864 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:45623'. Reason: failure-to-start- 4768s 2024-11-23 21:43:01,865 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44669': TLS handshake failed with remote 'tls://127.0.0.1:47642': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:43:01,865 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44669': TLS handshake failed with remote 'tls://127.0.0.1:47650': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:43:01,865 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 4768s comm = await self.rpc.connect(saddr) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 4768s return await self._connect(addr=addr, timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 4768s comm = await connect( 4768s ^^^^^^^^^^^^^^ 4768s ...<4 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Nanny start timed out after 0s. 4768s 2024-11-23 21:43:02,874 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:43:02,883 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35599 4768s 2024-11-23 21:43:02,884 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36797/status 4768s 2024-11-23 21:43:02,884 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:43:02,909 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:33337'. Reason: failure-to-start- 4768s 2024-11-23 21:43:02,909 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:34257'. Reason: failure-to-start- 4768s 2024-11-23 21:43:02,915 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35599': TLS handshake failed with remote 'tls://127.0.0.1:35472': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:43:02,915 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35599': TLS handshake failed with remote 'tls://127.0.0.1:35486': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:43:02,915 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 4768s comm = await self.rpc.connect(saddr) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 4768s return await self._connect(addr=addr, timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 4768s comm = await connect( 4768s ^^^^^^^^^^^^^^ 4768s ...<4 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Nanny start timed out after 0s. 4768s 2024-11-23 21:43:03,922 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:43:03,932 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44741 4768s 2024-11-23 21:43:03,932 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42761/status 4768s 2024-11-23 21:43:03,933 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:43:03,954 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:35607'. Reason: failure-to-start- 4768s 2024-11-23 21:43:03,955 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:36047'. Reason: failure-to-start- 4768s 2024-11-23 21:43:03,956 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44741': TLS handshake failed with remote 'tls://127.0.0.1:48236': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:43:03,956 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44741': TLS handshake failed with remote 'tls://127.0.0.1:48238': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:43:03,959 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 4768s comm = await self.rpc.connect(saddr) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 4768s return await self._connect(addr=addr, timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 4768s comm = await connect( 4768s ^^^^^^^^^^^^^^ 4768s ...<4 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Nanny start timed out after 0s. 4768s 2024-11-23 21:43:04,965 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:43:04,973 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44931 4768s 2024-11-23 21:43:04,973 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41891/status 4768s 2024-11-23 21:43:04,973 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:43:04,990 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:46689'. Reason: failure-to-start- 4768s 2024-11-23 21:43:04,990 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:36607'. Reason: failure-to-start- 4768s 2024-11-23 21:43:04,997 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:34214': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:43:04,997 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44931': TLS handshake failed with remote 'tls://127.0.0.1:34224': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:43:04,997 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 4768s comm = await self.rpc.connect(saddr) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 4768s return await self._connect(addr=addr, timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 4768s comm = await connect( 4768s ^^^^^^^^^^^^^^ 4768s ...<4 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Nanny start timed out after 0s. 4768s 2024-11-23 21:43:06,003 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:43:06,011 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40521 4768s 2024-11-23 21:43:06,012 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40979/status 4768s 2024-11-23 21:43:06,012 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:43:06,039 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:39189'. Reason: failure-to-start- 4768s 2024-11-23 21:43:06,039 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:37801'. Reason: failure-to-start- 4768s 2024-11-23 21:43:06,044 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40521': TLS handshake failed with remote 'tls://127.0.0.1:47192': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:43:06,044 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40521': TLS handshake failed with remote 'tls://127.0.0.1:47208': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:43:06,044 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 4768s comm = await self.rpc.connect(saddr) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 4768s return await self._connect(addr=addr, timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 4768s comm = await connect( 4768s ^^^^^^^^^^^^^^ 4768s ...<4 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Nanny start timed out after 0s. 4768s 2024-11-23 21:43:07,050 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:43:07,059 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41145 4768s 2024-11-23 21:43:07,059 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40061/status 4768s 2024-11-23 21:43:07,060 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:43:07,085 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:42801'. Reason: failure-to-start- 4768s 2024-11-23 21:43:07,085 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:44359'. Reason: failure-to-start- 4768s 2024-11-23 21:43:07,086 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41145': TLS handshake failed with remote 'tls://127.0.0.1:52414': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:43:07,087 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41145': TLS handshake failed with remote 'tls://127.0.0.1:52418': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:43:07,087 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 4768s comm = await self.rpc.connect(saddr) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 4768s return await self._connect(addr=addr, timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 4768s comm = await connect( 4768s ^^^^^^^^^^^^^^ 4768s ...<4 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Nanny start timed out after 0s. 4768s 2024-11-23 21:43:08,093 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:43:08,101 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44375 4768s 2024-11-23 21:43:08,101 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45551/status 4768s 2024-11-23 21:43:08,104 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:43:08,125 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:45209'. Reason: failure-to-start- 4768s 2024-11-23 21:43:08,126 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:43127'. Reason: failure-to-start- 4768s 2024-11-23 21:43:08,127 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44375': TLS handshake failed with remote 'tls://127.0.0.1:40522': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:43:08,127 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44375': TLS handshake failed with remote 'tls://127.0.0.1:40536': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:43:08,127 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 4768s comm = await self.rpc.connect(saddr) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 4768s return await self._connect(addr=addr, timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 4768s comm = await connect( 4768s ^^^^^^^^^^^^^^ 4768s ...<4 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Nanny start timed out after 0s. 4768s 2024-11-23 21:43:09,133 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:43:09,142 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35365 4768s 2024-11-23 21:43:09,142 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34247/status 4768s 2024-11-23 21:43:09,143 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:43:09,171 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:40009'. Reason: failure-to-start- 4768s 2024-11-23 21:43:09,172 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:39819'. Reason: failure-to-start- 4768s 2024-11-23 21:43:09,173 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35365': TLS handshake failed with remote 'tls://127.0.0.1:37242': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:43:09,173 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35365': TLS handshake failed with remote 'tls://127.0.0.1:37252': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:43:09,173 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 4768s comm = await self.rpc.connect(saddr) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 4768s return await self._connect(addr=addr, timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 4768s comm = await connect( 4768s ^^^^^^^^^^^^^^ 4768s ...<4 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Nanny start timed out after 0s. 4768s 2024-11-23 21:43:10,179 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:43:10,200 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46283 4768s 2024-11-23 21:43:10,201 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36787/status 4768s 2024-11-23 21:43:10,201 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:43:10,234 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:38999'. Reason: failure-to-start- 4768s 2024-11-23 21:43:10,235 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:34379'. Reason: failure-to-start- 4768s 2024-11-23 21:43:10,236 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46283': TLS handshake failed with remote 'tls://127.0.0.1:32812': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:43:10,236 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46283': TLS handshake failed with remote 'tls://127.0.0.1:32826': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:43:10,236 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 4768s comm = await self.rpc.connect(saddr) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 4768s return await self._connect(addr=addr, timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 4768s comm = await connect( 4768s ^^^^^^^^^^^^^^ 4768s ...<4 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Nanny start timed out after 0s. 4768s 2024-11-23 21:43:11,242 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:43:11,251 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40691 4768s 2024-11-23 21:43:11,251 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35331/status 4768s 2024-11-23 21:43:11,252 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:43:11,280 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:34701'. Reason: failure-to-start- 4768s 2024-11-23 21:43:11,284 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:35701'. Reason: failure-to-start- 4768s 2024-11-23 21:43:11,285 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40691': TLS handshake failed with remote 'tls://127.0.0.1:39016': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:43:11,285 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40691': TLS handshake failed with remote 'tls://127.0.0.1:39030': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:43:11,288 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 4768s comm = await self.rpc.connect(saddr) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 4768s return await self._connect(addr=addr, timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 4768s comm = await connect( 4768s ^^^^^^^^^^^^^^ 4768s ...<4 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Nanny start timed out after 0s. 4768s 2024-11-23 21:43:12,298 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:43:12,306 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40797 4768s 2024-11-23 21:43:12,307 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35619/status 4768s 2024-11-23 21:43:12,307 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:43:12,329 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:38689'. Reason: failure-to-start- 4768s 2024-11-23 21:43:12,330 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:39417'. Reason: failure-to-start- 4768s 2024-11-23 21:43:12,331 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40797': TLS handshake failed with remote 'tls://127.0.0.1:34998': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:43:12,331 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40797': TLS handshake failed with remote 'tls://127.0.0.1:35002': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:43:12,333 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 4768s comm = await self.rpc.connect(saddr) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 4768s return await self._connect(addr=addr, timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 4768s comm = await connect( 4768s ^^^^^^^^^^^^^^ 4768s ...<4 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Nanny start timed out after 0s. 4768s 2024-11-23 21:43:13,339 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:43:13,347 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40943 4768s 2024-11-23 21:43:13,347 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45707/status 4768s 2024-11-23 21:43:13,348 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:43:13,374 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:38795'. Reason: failure-to-start- 4768s 2024-11-23 21:43:13,375 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:38937'. Reason: failure-to-start- 4768s 2024-11-23 21:43:13,378 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40943': TLS handshake failed with remote 'tls://127.0.0.1:56384': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:43:13,379 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40943': TLS handshake failed with remote 'tls://127.0.0.1:56386': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:43:13,379 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 4768s comm = await self.rpc.connect(saddr) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 4768s return await self._connect(addr=addr, timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 4768s comm = await connect( 4768s ^^^^^^^^^^^^^^ 4768s ...<4 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Nanny start timed out after 0s. 4768s 2024-11-23 21:43:14,385 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:43:14,394 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42225 4768s 2024-11-23 21:43:14,394 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37483/status 4768s 2024-11-23 21:43:14,395 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:43:14,421 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:40171'. Reason: failure-to-start- 4768s 2024-11-23 21:43:14,421 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:34409'. Reason: failure-to-start- 4768s 2024-11-23 21:43:14,426 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42225': TLS handshake failed with remote 'tls://127.0.0.1:46276': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:43:14,426 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42225': TLS handshake failed with remote 'tls://127.0.0.1:46288': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:43:14,426 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 4768s comm = await self.rpc.connect(saddr) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 4768s return await self._connect(addr=addr, timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 4768s comm = await connect( 4768s ^^^^^^^^^^^^^^ 4768s ...<4 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Nanny start timed out after 0s. 4768s 2024-11-23 21:43:15,433 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:43:15,441 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42647 4768s 2024-11-23 21:43:15,442 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35203/status 4768s 2024-11-23 21:43:15,442 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:43:15,473 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:42175'. Reason: failure-to-start- 4768s 2024-11-23 21:43:15,473 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:42123'. Reason: failure-to-start- 4768s 2024-11-23 21:43:15,475 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42647': TLS handshake failed with remote 'tls://127.0.0.1:40468': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:43:15,475 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42647': TLS handshake failed with remote 'tls://127.0.0.1:40480': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:43:15,475 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 4768s comm = await self.rpc.connect(saddr) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 4768s return await self._connect(addr=addr, timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 4768s comm = await connect( 4768s ^^^^^^^^^^^^^^ 4768s ...<4 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Nanny start timed out after 0s. 4768s 2024-11-23 21:43:16,481 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:43:16,490 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35091 4768s 2024-11-23 21:43:16,490 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40369/status 4768s 2024-11-23 21:43:16,491 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:43:16,517 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:41929'. Reason: failure-to-start- 4768s 2024-11-23 21:43:16,517 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:38881'. Reason: failure-to-start- 4768s 2024-11-23 21:43:16,519 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35091': TLS handshake failed with remote 'tls://127.0.0.1:55188': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:43:16,519 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35091': TLS handshake failed with remote 'tls://127.0.0.1:55202': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:43:16,522 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 4768s comm = await self.rpc.connect(saddr) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 4768s return await self._connect(addr=addr, timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 4768s comm = await connect( 4768s ^^^^^^^^^^^^^^ 4768s ...<4 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Nanny start timed out after 0s. 4768s 2024-11-23 21:43:17,528 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:43:17,536 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40327 4768s 2024-11-23 21:43:17,537 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38093/status 4768s 2024-11-23 21:43:17,537 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:43:17,582 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:38423'. Reason: failure-to-start- 4768s 2024-11-23 21:43:17,583 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:38979'. Reason: failure-to-start- 4768s 2024-11-23 21:43:17,590 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40327': TLS handshake failed with remote 'tls://127.0.0.1:60620': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:43:17,590 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40327': TLS handshake failed with remote 'tls://127.0.0.1:60636': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:43:17,591 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 4768s comm = await self.rpc.connect(saddr) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 4768s return await self._connect(addr=addr, timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 4768s comm = await connect( 4768s ^^^^^^^^^^^^^^ 4768s ...<4 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Nanny start timed out after 0s. 4768s 2024-11-23 21:43:18,598 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:43:18,606 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37413 4768s 2024-11-23 21:43:18,607 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42933/status 4768s 2024-11-23 21:43:18,607 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:43:18,633 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:44631'. Reason: failure-to-start- 4768s 2024-11-23 21:43:18,634 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:42497'. Reason: failure-to-start- 4768s 2024-11-23 21:43:18,635 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37413': TLS handshake failed with remote 'tls://127.0.0.1:46546': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:43:18,635 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37413': TLS handshake failed with remote 'tls://127.0.0.1:46558': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:43:18,635 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 4768s comm = await self.rpc.connect(saddr) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 4768s return await self._connect(addr=addr, timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 4768s comm = await connect( 4768s ^^^^^^^^^^^^^^ 4768s ...<4 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Nanny start timed out after 0s. 4768s 2024-11-23 21:43:19,643 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:43:19,651 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:32979 4768s 2024-11-23 21:43:19,651 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44579/status 4768s 2024-11-23 21:43:19,652 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:43:19,683 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:33893'. Reason: failure-to-start- 4768s 2024-11-23 21:43:19,684 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:46255'. Reason: failure-to-start- 4768s 2024-11-23 21:43:19,688 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:32979': TLS handshake failed with remote 'tls://127.0.0.1:37312': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:43:19,688 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:32979': TLS handshake failed with remote 'tls://127.0.0.1:37326': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:43:19,688 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 4768s comm = await self.rpc.connect(saddr) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 4768s return await self._connect(addr=addr, timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 4768s comm = await connect( 4768s ^^^^^^^^^^^^^^ 4768s ...<4 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Nanny start timed out after 0s. 4768s 2024-11-23 21:43:20,694 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:43:20,703 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41039 4768s 2024-11-23 21:43:20,703 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36243/status 4768s 2024-11-23 21:43:20,704 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:43:20,728 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:45681'. Reason: failure-to-start- 4768s 2024-11-23 21:43:20,728 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:43899'. Reason: failure-to-start- 4768s 2024-11-23 21:43:20,732 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41039': TLS handshake failed with remote 'tls://127.0.0.1:38406': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:43:20,732 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41039': TLS handshake failed with remote 'tls://127.0.0.1:38416': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:43:20,732 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 4768s comm = await self.rpc.connect(saddr) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 4768s return await self._connect(addr=addr, timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 4768s comm = await connect( 4768s ^^^^^^^^^^^^^^ 4768s ...<4 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Nanny start timed out after 0s. 4768s ________________________________ test_rebalance ________________________________ 4768s 4768s fut = , timeout = 0 4768s 4768s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 4768s async with asyncio.timeout(timeout): 4768s > return await fut 4768s 4768s /usr/lib/python3/dist-packages/distributed/utils.py:1960: 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s /usr/lib/python3/dist-packages/distributed/worker.py:1480: in start_unsafe 4768s await self._register_with_scheduler() 4768s /usr/lib/python3/dist-packages/distributed/worker.py:1179: in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s /usr/lib/python3/dist-packages/distributed/comm/core.py:342: in connect 4768s comm = await wait_for( 4768s /usr/lib/python3/dist-packages/distributed/utils.py:1960: in wait_for 4768s return await fut 4768s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:546: in connect 4768s stream = await self.client.connect( 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s 4768s self = , host = '127.0.0.1' 4768s port = 41307, af = 4768s ssl_options = 4768s max_buffer_size = 8364507136.0, source_ip = None, source_port = None 4768s timeout = None 4768s 4768s async def connect( 4768s self, 4768s host: str, 4768s port: int, 4768s af: socket.AddressFamily = socket.AF_UNSPEC, 4768s ssl_options: Optional[Union[Dict[str, Any], ssl.SSLContext]] = None, 4768s max_buffer_size: Optional[int] = None, 4768s source_ip: Optional[str] = None, 4768s source_port: Optional[int] = None, 4768s timeout: Optional[Union[float, datetime.timedelta]] = None, 4768s ) -> IOStream: 4768s """Connect to the given host and port. 4768s 4768s Asynchronously returns an `.IOStream` (or `.SSLIOStream` if 4768s ``ssl_options`` is not None). 4768s 4768s Using the ``source_ip`` kwarg, one can specify the source 4768s IP address to use when establishing the connection. 4768s In case the user needs to resolve and 4768s use a specific interface, it has to be handled outside 4768s of Tornado as this depends very much on the platform. 4768s 4768s Raises `TimeoutError` if the input future does not complete before 4768s ``timeout``, which may be specified in any form allowed by 4768s `.IOLoop.add_timeout` (i.e. a `datetime.timedelta` or an absolute time 4768s relative to `.IOLoop.time`) 4768s 4768s Similarly, when the user requires a certain source port, it can 4768s be specified using the ``source_port`` arg. 4768s 4768s .. versionchanged:: 4.5 4768s Added the ``source_ip`` and ``source_port`` arguments. 4768s 4768s .. versionchanged:: 5.0 4768s Added the ``timeout`` argument. 4768s """ 4768s if timeout is not None: 4768s if isinstance(timeout, numbers.Real): 4768s timeout = IOLoop.current().time() + timeout 4768s elif isinstance(timeout, datetime.timedelta): 4768s timeout = IOLoop.current().time() + timeout.total_seconds() 4768s else: 4768s raise TypeError("Unsupported timeout %r" % timeout) 4768s if timeout is not None: 4768s addrinfo = await gen.with_timeout( 4768s timeout, self.resolver.resolve(host, port, af) 4768s ) 4768s else: 4768s addrinfo = await self.resolver.resolve(host, port, af) 4768s connector = _Connector( 4768s addrinfo, 4768s functools.partial( 4768s self._create_stream, 4768s max_buffer_size, 4768s source_ip=source_ip, 4768s source_port=source_port, 4768s ), 4768s ) 4768s > af, addr, stream = await connector.start(connect_timeout=timeout) 4768s E asyncio.exceptions.CancelledError 4768s 4768s /usr/lib/python3/dist-packages/tornado/tcpclient.py:279: CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s self = 4768s 4768s @final 4768s async def start(self): 4768s async with self._startup_lock: 4768s if self.status == Status.failed: 4768s assert self.__startup_exc is not None 4768s raise self.__startup_exc 4768s elif self.status != Status.init: 4768s return self 4768s timeout = getattr(self, "death_timeout", None) 4768s 4768s async def _close_on_failure(exc: Exception) -> None: 4768s await self.close(reason=f"failure-to-start-{str(type(exc))}") 4768s self.status = Status.failed 4768s self.__startup_exc = exc 4768s 4768s try: 4768s > await wait_for(self.start_unsafe(), timeout=timeout) 4768s 4768s /usr/lib/python3/dist-packages/distributed/core.py:664: 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 4768s async with asyncio.timeout(timeout): 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s 4768s self = 4768s exc_type = 4768s exc_val = CancelledError(), exc_tb = 4768s 4768s async def __aexit__( 4768s self, 4768s exc_type: Optional[Type[BaseException]], 4768s exc_val: Optional[BaseException], 4768s exc_tb: Optional[TracebackType], 4768s ) -> Optional[bool]: 4768s assert self._state in (_State.ENTERED, _State.EXPIRING) 4768s 4768s if self._timeout_handler is not None: 4768s self._timeout_handler.cancel() 4768s self._timeout_handler = None 4768s 4768s if self._state is _State.EXPIRING: 4768s self._state = _State.EXPIRED 4768s 4768s if self._task.uncancel() <= self._cancelling and exc_type is not None: 4768s # Since there are no new cancel requests, we're 4768s # handling this. 4768s if issubclass(exc_type, exceptions.CancelledError): 4768s > raise TimeoutError from exc_val 4768s E TimeoutError 4768s 4768s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s @contextlib.asynccontextmanager 4768s async def _cluster_factory(): 4768s workers = [] 4768s s = None 4768s try: 4768s for _ in range(60): 4768s try: 4768s > s, ws = await start_cluster( 4768s nthreads, 4768s scheduler, 4768s security=security, 4768s Worker=Worker, 4768s scheduler_kwargs=scheduler_kwargs, 4768s worker_kwargs=merge( 4768s {"death_timeout": min(15, int(deadline.remaining))}, 4768s worker_kwargs, 4768s ), 4768s ) 4768s 4768s /usr/lib/python3/dist-packages/distributed/utils_test.py:966: 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s /usr/lib/python3/dist-packages/distributed/utils_test.py:789: in start_cluster 4768s await asyncio.gather(*workers) 4768s /usr/lib/python3.13/asyncio/tasks.py:737: in _wrap_awaitable 4768s return await awaitable 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s 4768s self = 4768s 4768s @final 4768s async def start(self): 4768s async with self._startup_lock: 4768s if self.status == Status.failed: 4768s assert self.__startup_exc is not None 4768s raise self.__startup_exc 4768s elif self.status != Status.init: 4768s return self 4768s timeout = getattr(self, "death_timeout", None) 4768s 4768s async def _close_on_failure(exc: Exception) -> None: 4768s await self.close(reason=f"failure-to-start-{str(type(exc))}") 4768s self.status = Status.failed 4768s self.__startup_exc = exc 4768s 4768s try: 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s except asyncio.TimeoutError as exc: 4768s await _close_on_failure(exc) 4768s > raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s E TimeoutError: Worker start timed out after 0s. 4768s 4768s /usr/lib/python3/dist-packages/distributed/core.py:667: TimeoutError 4768s 4768s During handling of the above exception, another exception occurred: 4768s 4768s fut = ._..test_func..async_fn at 0xe99ada20> 4768s timeout = 60 4768s 4768s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 4768s async with asyncio.timeout(timeout): 4768s > return await fut 4768s 4768s /usr/lib/python3/dist-packages/distributed/utils.py:1960: 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s /usr/lib/python3/dist-packages/distributed/utils_test.py:999: in async_fn 4768s _cluster_factory() as (s, workers), 4768s /usr/lib/python3.13/contextlib.py:214: in __aenter__ 4768s return await anext(self.gen) 4768s /usr/lib/python3/dist-packages/distributed/utils_test.py:983: in _cluster_factory 4768s await asyncio.sleep(1) 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s 4768s delay = 1, result = None 4768s 4768s async def sleep(delay, result=None): 4768s """Coroutine that completes after a given time (in seconds).""" 4768s if delay <= 0: 4768s await __sleep0() 4768s return result 4768s 4768s if math.isnan(delay): 4768s raise ValueError("Invalid delay: NaN (not a number)") 4768s 4768s loop = events.get_running_loop() 4768s future = loop.create_future() 4768s h = loop.call_later(delay, 4768s futures._set_result_unless_cancelled, 4768s future, result) 4768s try: 4768s > return await future 4768s E asyncio.exceptions.CancelledError 4768s 4768s /usr/lib/python3.13/asyncio/tasks.py:718: CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s args = (), kwds = {} 4768s 4768s @wraps(func) 4768s def inner(*args, **kwds): 4768s with self._recreate_cm(): 4768s > return func(*args, **kwds) 4768s 4768s /usr/lib/python3.13/contextlib.py:85: 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s /usr/lib/python3.13/contextlib.py:85: in inner 4768s return func(*args, **kwds) 4768s /usr/lib/python3/dist-packages/distributed/utils_test.py:1102: in test_func 4768s return _run_and_close_tornado(async_fn_outer) 4768s /usr/lib/python3/dist-packages/distributed/utils_test.py:378: in _run_and_close_tornado 4768s return asyncio_run(inner_fn(), loop_factory=get_loop_factory()) 4768s /usr/lib/python3.13/asyncio/runners.py:194: in run 4768s return runner.run(main) 4768s /usr/lib/python3.13/asyncio/runners.py:118: in run 4768s return self._loop.run_until_complete(task) 4768s /usr/lib/python3.13/asyncio/base_events.py:720: in run_until_complete 4768s return future.result() 4768s /usr/lib/python3/dist-packages/distributed/utils_test.py:375: in inner_fn 4768s return await async_fn(*args, **kwargs) 4768s /usr/lib/python3/dist-packages/distributed/utils_test.py:1099: in async_fn_outer 4768s return await utils_wait_for(async_fn(), timeout=timeout * 2) 4768s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 4768s async with asyncio.timeout(timeout): 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s 4768s self = 4768s exc_type = 4768s exc_val = CancelledError(), exc_tb = 4768s 4768s async def __aexit__( 4768s self, 4768s exc_type: Optional[Type[BaseException]], 4768s exc_val: Optional[BaseException], 4768s exc_tb: Optional[TracebackType], 4768s ) -> Optional[bool]: 4768s assert self._state in (_State.ENTERED, _State.EXPIRING) 4768s 4768s if self._timeout_handler is not None: 4768s self._timeout_handler.cancel() 4768s self._timeout_handler = None 4768s 4768s if self._state is _State.EXPIRING: 4768s self._state = _State.EXPIRED 4768s 4768s if self._task.uncancel() <= self._cancelling and exc_type is not None: 4768s # Since there are no new cancel requests, we're 4768s # handling this. 4768s if issubclass(exc_type, exceptions.CancelledError): 4768s > raise TimeoutError from exc_val 4768s E TimeoutError 4768s 4768s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 4768s ----------------------------- Captured stderr call ----------------------------- 4768s 2024-11-23 21:43:22,175 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:43:22,185 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:22,185 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37489/status 4768s 2024-11-23 21:43:22,185 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:43:22,203 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46763 4768s 2024-11-23 21:43:22,203 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46763 4768s 2024-11-23 21:43:22,204 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:43:22,204 - distributed.worker - INFO - dashboard at: 127.0.0.1:44429 4768s 2024-11-23 21:43:22,204 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:22,204 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:43:22,204 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:43:22,204 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:43:22,204 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-wqdqvncc 4768s 2024-11-23 21:43:22,204 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:43:22,206 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34073 4768s 2024-11-23 21:43:22,207 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34073 4768s 2024-11-23 21:43:22,207 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:43:22,207 - distributed.worker - INFO - dashboard at: 127.0.0.1:46393 4768s 2024-11-23 21:43:22,207 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:22,207 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:43:22,207 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:43:22,207 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:43:22,207 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ij55nrvq 4768s 2024-11-23 21:43:22,207 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:43:22,221 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:22,221 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:22,222 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:48956': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:22,222 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:48972': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:22,335 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:22,335 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:22,335 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:48974': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:22,335 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:48986': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:22,450 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:22,450 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:22,450 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:49002': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:22,451 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:49018': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:22,564 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:22,564 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:22,564 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:49022': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:22,565 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:49038': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:22,678 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:22,678 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:22,678 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:49042': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:22,678 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:49044': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:22,792 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:22,792 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:22,793 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:49046': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:22,793 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:49060': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:22,906 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:22,906 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:22,907 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:49070': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:22,907 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:49082': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:23,020 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:23,020 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:23,020 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:49092': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:23,021 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:49100': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:23,133 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:23,133 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:23,134 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:49106': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:23,134 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:49120': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:23,247 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:23,248 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:23,248 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:49126': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:23,248 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:49142': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:23,361 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:23,361 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:23,361 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:49156': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:23,362 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:49158': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:23,475 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:23,475 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:23,475 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:49168': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:23,476 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:49184': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:23,589 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:23,589 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:23,589 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:49196': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:23,590 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:49198': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:23,703 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:23,703 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:23,704 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:49208': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:23,704 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:49212': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:23,816 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:23,817 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:23,817 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:49218': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:23,817 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:49230': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:23,929 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:23,930 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:23,930 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:49242': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:23,930 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:49246': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:24,045 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:24,046 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:24,046 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:49248': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:24,046 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:49250': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:24,160 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:24,160 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:24,161 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:49262': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:24,161 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:49268': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:24,275 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:24,276 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:24,276 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:49274': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:24,276 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:49278': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:24,389 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:24,389 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:24,390 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:49282': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:24,390 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:49290': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:24,503 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:24,503 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:24,504 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:49294': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:24,504 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:49300': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:24,617 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:24,617 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:24,617 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:49308': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:24,617 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:49320': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:24,731 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:24,731 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:24,731 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:49334': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:24,732 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:49336': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:24,844 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:24,844 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:24,845 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:49344': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:24,845 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:49358': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:24,958 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:24,958 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:24,958 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:49372': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:24,958 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:49380': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:25,072 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:25,072 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:25,073 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:49384': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:25,073 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:49398': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:25,186 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:25,186 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:25,186 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:49400': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:25,187 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:49402': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:25,299 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:25,300 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:25,300 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:49418': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:25,300 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:49432': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:25,414 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:25,414 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:25,415 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:49446': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:25,415 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:49448': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:25,533 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:25,534 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:25,534 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:49464': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:25,534 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:49478': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:25,647 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:25,647 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:25,647 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:49490': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:25,647 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:49506': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:25,760 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:25,761 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:25,761 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:49522': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:25,761 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:49524': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:25,875 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:25,875 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:25,875 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:49530': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:25,876 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:49546': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:25,989 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:25,989 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:25,990 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:49550': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:25,990 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:49552': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:26,102 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:26,103 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:26,103 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:49568': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:26,103 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:49570': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:26,217 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:26,217 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:26,217 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:49578': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:26,217 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:49580': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:26,331 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:26,331 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:26,332 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:49586': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:26,332 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:49596': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:26,445 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:26,445 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:26,446 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:49606': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:26,446 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:49616': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:26,560 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:26,560 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:26,560 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:49624': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:26,560 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:49640': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:26,674 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:26,675 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:26,675 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:49656': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:26,675 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:49666': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:26,788 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:26,788 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:26,788 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:49682': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:26,789 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:49686': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:26,901 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:26,902 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:26,902 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:49698': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:26,902 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:49710': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:27,015 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:27,015 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:27,016 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:49724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:27,016 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:49726': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:27,128 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:27,129 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:27,129 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:49730': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:27,129 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:49746': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:27,241 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:27,242 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:27,242 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:49750': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:27,242 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:49756': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:27,356 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:27,357 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:27,357 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:49758': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:27,357 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:49760': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:27,470 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:27,471 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:27,471 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:49766': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:27,471 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:49778': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:27,584 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:27,584 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:27,584 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:49792': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:27,585 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:49794': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:27,703 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:27,703 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:27,704 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:49810': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:27,704 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:49818': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:27,816 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:27,816 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:27,817 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:49820': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:27,817 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:49822': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:27,929 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:27,930 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:27,930 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:49838': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:27,930 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:49848': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:28,043 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:28,043 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:28,044 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:49850': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:28,044 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:49860': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:28,156 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:28,157 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:28,157 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:49874': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:28,157 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:49882': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:28,271 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:28,272 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:28,272 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:49892': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:28,272 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:49894': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:28,385 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:28,385 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:28,385 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:49902': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:28,385 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:49910': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:28,498 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:28,499 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:28,499 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:49924': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:28,499 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:49936': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:28,612 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:28,612 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:28,612 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:49938': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:28,612 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:49950': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:28,726 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:28,726 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:28,726 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:49958': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:28,726 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:49972': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:28,839 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:28,839 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:28,839 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:49978': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:28,839 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:49984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:28,952 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:28,952 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:28,953 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:49990': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:28,953 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:49996': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:29,066 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:29,067 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:29,067 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:50002': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:29,067 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:50010': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:29,180 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:29,180 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:29,180 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:50020': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:29,180 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:50026': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:29,294 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:29,294 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:29,294 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:50034': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:29,294 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:50036': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:29,407 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:29,407 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:29,408 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:50040': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:29,408 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:50046': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:29,521 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:29,522 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:29,522 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:50058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:29,522 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:50062': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:29,634 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:29,635 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:29,635 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:50076': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:29,635 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:50082': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:29,751 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:29,751 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:29,752 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:50092': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:29,752 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:50100': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:29,867 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:29,867 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:29,868 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:50116': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:29,868 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:50122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:29,983 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:29,983 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:29,984 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:50124': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:29,984 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:50136': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:30,099 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:30,119 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:30,125 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:50142': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:30,125 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:50144': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:30,241 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:30,242 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:30,242 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:50152': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:30,242 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:50154': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:30,355 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:30,355 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:30,356 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:50168': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:30,356 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:50184': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:30,469 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:30,470 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:30,470 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:50190': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:30,470 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:50206': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:30,583 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:30,583 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:30,584 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:50216': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:30,584 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:50220': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:30,704 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:30,704 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:30,705 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:50226': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:30,705 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:50230': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:30,818 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:30,819 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:30,819 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:50244': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:30,819 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:50252': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:30,933 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:30,933 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:30,933 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:50256': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:30,933 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:50266': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:31,046 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:31,046 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:31,047 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:50270': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:31,047 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:50282': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:31,160 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:31,160 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:31,161 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:50284': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:31,161 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:50298': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:31,274 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:31,274 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:31,274 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:50308': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:31,274 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:50316': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:31,390 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:31,390 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:31,391 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:50320': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:31,391 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:50324': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:31,504 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:31,504 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:31,504 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:50328': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:31,504 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:50342': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:31,617 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:31,617 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:31,618 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:60904': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:31,618 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:60914': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:31,732 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:31,732 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:31,732 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:60920': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:31,732 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:60930': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:31,844 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:31,845 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:31,845 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:60946': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:31,845 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:60952': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:31,959 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:31,959 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:31,960 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:60954': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:31,960 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:60960': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:32,074 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:32,074 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:32,074 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:60966': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:32,074 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:60968': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:32,188 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:32,189 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:32,194 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:60976': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:32,194 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:60978': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:32,302 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:32,302 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:32,303 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:60984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:32,303 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:60994': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:32,417 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:32,418 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:32,418 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:60998': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:32,418 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:32774': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:32,537 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:32,538 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:32,539 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:32782': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:32,539 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:32798': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:32,652 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:32,653 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:32,654 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:32812': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:32,654 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:32816': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:32,766 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:32,767 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:32,767 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:32820': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:32,767 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:32836': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:32,880 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:32,880 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:32,881 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:32842': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:32,881 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:32850': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:32,994 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:32,994 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:32,994 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:32866': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:32,994 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:32872': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:33,108 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:33,108 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:33,108 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:32878': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:33,109 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:32884': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:33,224 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:33,224 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:33,224 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:32900': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:33,224 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:32912': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:33,337 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:33,337 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:33,337 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:32928': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:33,337 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:32940': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:33,450 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:33,450 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:33,451 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:32944': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:33,451 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:32950': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:33,564 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:33,564 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:33,565 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:32958': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:33,565 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:32968': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:33,678 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:33,678 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:33,678 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:32984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:33,678 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:32986': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:33,791 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:33,792 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:33,792 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:32998': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:33,792 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:33002': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:33,904 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:33,905 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:33,905 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:33008': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:33,905 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:33014': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:34,020 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:34,020 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:34,021 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:33022': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:34,021 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:33038': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:34,133 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:34,134 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:34,134 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:33042': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:34,134 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:33050': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:34,247 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:34,248 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:34,248 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:33066': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:34,248 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:33082': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:34,362 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:34,363 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:34,363 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:33098': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:34,363 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:33112': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:34,477 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:34,477 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:34,478 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:33118': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:34,478 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:33128': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:34,590 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:34,591 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:34,591 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:33138': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:34,591 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:33148': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:34,704 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:34,704 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:34,705 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:33150': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:34,705 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:33158': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:34,819 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:34,819 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:34,819 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:33174': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:34,820 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:33180': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:34,932 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:34,932 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:34,933 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:33182': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:34,933 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:33186': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:35,047 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:35,048 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:35,048 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:33200': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:35,048 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:33206': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:35,161 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:35,161 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:35,161 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:33222': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:35,161 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:33236': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:35,276 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:35,276 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:35,276 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:33238': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:35,276 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:33250': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:35,389 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:35,389 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:35,390 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:33252': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:35,390 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:33264': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:35,503 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:35,503 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:35,503 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:33278': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:35,504 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:33284': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:35,616 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:35,617 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:35,617 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:33298': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:35,625 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:33312': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:35,730 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:35,730 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:35,730 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:33324': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:35,730 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:33334': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:35,843 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:35,843 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:35,843 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:33340': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:35,843 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:33352': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:35,957 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:35,958 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:35,958 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:33368': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:35,958 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:33372': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:36,072 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:36,072 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:36,073 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:33388': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:36,073 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:33394': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:36,185 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:36,186 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:36,186 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:33402': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:36,186 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:33418': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:36,299 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:36,300 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:36,300 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:33428': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:36,300 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:33438': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:36,414 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:36,414 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:36,414 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:33448': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:36,414 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:33464': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:36,527 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:36,528 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:36,528 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:33476': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:36,528 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:33486': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:36,640 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:36,641 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:36,641 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:33498': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:36,641 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:33500': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:36,754 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:36,754 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:36,754 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:33504': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:36,754 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:33506': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:36,869 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:36,869 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:36,869 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:33514': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:36,870 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:33526': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:36,983 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:36,983 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:36,983 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:33528': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:36,984 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:33532': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:37,096 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:37,097 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41885 4768s 2024-11-23 21:43:37,097 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:33540': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:37,097 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:33548': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:37,210 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46763. Reason: failure-to-start- 4768s 2024-11-23 21:43:37,210 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:43:37,212 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34073. Reason: failure-to-start- 4768s 2024-11-23 21:43:37,214 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:43:37,215 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:33564': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:37,215 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41885': TLS handshake failed with remote 'tls://127.0.0.1:33570': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:37,218 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 15s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 4768s stream = await stream.start_tls( 4768s ^^^^^^^^^^^^^^^^^^^^^^^ 4768s False, ssl_options=ssl_options, server_hostname=host 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 15s. 4768s 2024-11-23 21:43:38,226 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:43:38,237 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:38,238 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:32863/status 4768s 2024-11-23 21:43:38,238 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:43:38,254 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40899 4768s 2024-11-23 21:43:38,255 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40899 4768s 2024-11-23 21:43:38,255 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:43:38,255 - distributed.worker - INFO - dashboard at: 127.0.0.1:44085 4768s 2024-11-23 21:43:38,255 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:38,255 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:43:38,255 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:43:38,255 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:43:38,255 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-pjim8rnf 4768s 2024-11-23 21:43:38,255 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:43:38,257 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37457 4768s 2024-11-23 21:43:38,258 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37457 4768s 2024-11-23 21:43:38,258 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:43:38,258 - distributed.worker - INFO - dashboard at: 127.0.0.1:43483 4768s 2024-11-23 21:43:38,258 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:38,258 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:43:38,258 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:43:38,258 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:43:38,258 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-2haepd2z 4768s 2024-11-23 21:43:38,258 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:43:38,271 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:38,271 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:38,272 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:33782': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:38,272 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:33786': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:38,385 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:38,385 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:38,386 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:33794': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:38,386 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:33810': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:38,499 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:38,499 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:38,500 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:33822': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:38,500 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:33834': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:38,613 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:38,614 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:38,614 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:33836': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:38,614 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:33842': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:38,727 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:38,728 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:38,728 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:33846': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:38,728 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:33852': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:38,841 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:38,842 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:38,842 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:33868': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:38,842 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:33874': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:38,955 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:38,955 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:38,956 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:33890': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:38,956 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:33902': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:39,069 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:39,069 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:39,069 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:33906': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:39,069 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:33916': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:39,193 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:39,193 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:39,199 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:33926': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:39,200 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:33934': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:39,307 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:39,307 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:39,308 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:33940': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:39,308 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:33952': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:39,421 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:39,421 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:39,421 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:33958': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:39,421 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:33960': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:39,534 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:39,534 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:39,535 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:33970': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:39,535 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:33986': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:39,648 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:39,648 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:39,648 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:33990': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:39,648 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:34004': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:39,761 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:39,762 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:39,762 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:34016': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:39,762 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:34028': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:39,875 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:39,876 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:39,876 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:34038': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:39,876 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:34052': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:39,989 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:39,990 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:39,990 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:34068': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:39,990 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:34080': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:40,104 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:40,104 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:40,105 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:34096': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:40,105 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:34102': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:40,219 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:40,219 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:40,219 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:34116': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:40,220 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:34126': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:40,333 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:40,333 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:40,334 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:34132': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:40,334 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:34144': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:40,447 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:40,447 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:40,447 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:34154': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:40,447 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:34170': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:40,560 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:40,560 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:40,561 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:34180': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:40,561 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:34182': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:40,674 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:40,674 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:40,674 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:34192': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:40,674 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:34202': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:40,788 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:40,788 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:40,788 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:34204': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:40,789 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:34218': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:40,901 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:40,901 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:40,901 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:34228': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:40,902 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:34242': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:41,014 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:41,015 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:41,015 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:34246': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:41,015 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:34262': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:41,128 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:41,129 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:41,129 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:34272': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:41,129 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:34274': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:41,241 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:41,241 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:41,245 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:34290': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:41,245 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:34294': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:41,355 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:41,355 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:41,355 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:34302': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:41,356 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:34314': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:41,469 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:41,469 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:41,470 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:34326': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:41,470 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:34336': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:41,583 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:41,583 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:41,584 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:42888': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:41,584 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:42894': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:41,700 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:41,701 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:41,701 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:42902': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:41,701 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:42904': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:41,814 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:41,814 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:41,815 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:42910': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:41,815 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:42926': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:41,930 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:41,930 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:41,931 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:42934': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:41,931 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:42948': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:42,044 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:42,044 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:42,045 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:42960': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:42,045 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:42972': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:42,158 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:42,158 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:42,159 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:42984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:42,159 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:42996': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:42,272 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:42,272 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:42,272 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:43006': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:42,272 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:43022': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:42,409 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:42,410 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:42,411 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:43036': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:42,411 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:43044': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:42,521 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:42,526 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:43048': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:42,527 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:42,528 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:43054': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:42,631 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:42,631 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:43068': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:42,637 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:42,638 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:43084': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:42,739 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:42,739 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:43086': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:42,749 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:42,750 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:43088': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:42,847 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:42,848 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:43090': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:42,857 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:42,857 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:43098': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:42,956 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:42,957 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:43108': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:42,963 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:42,964 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:43116': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:43,065 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:43,066 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:43118': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:43,072 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:43,072 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:43126': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:43,172 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:43,173 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:43130': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:43,179 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:43,180 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:43140': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:43,280 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:43,280 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:43156': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:43,287 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:43,287 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:43164': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:43,388 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:43,388 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:43172': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:43,395 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:43,395 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:43182': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:43,496 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:43,496 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:43184': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:43,503 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:43,503 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:43188': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:43,603 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:43,604 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:43200': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:43,611 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:43,611 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:43210': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:43,713 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:43,714 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:43224': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:43,721 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:43,721 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:43234': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:43,821 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:43,822 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:43238': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:43,829 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:43,829 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:43248': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:43,930 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:43,931 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:43252': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:43,937 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:43,938 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:43268': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:44,038 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:44,039 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:43284': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:44,046 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:44,046 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:43300': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:44,147 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:44,148 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:43314': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:44,154 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:44,154 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:43324': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:44,255 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:44,255 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:43334': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:44,262 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:44,262 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:43344': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:44,362 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:44,363 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:43346': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:44,370 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:44,370 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:43358': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:44,470 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:44,471 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:43372': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:44,478 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:44,479 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:43384': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:44,579 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:44,579 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:43400': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:44,586 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:44,587 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:43412': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:44,687 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:44,691 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:43420': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:44,698 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:44,698 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:43434': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:44,795 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:44,796 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:43438': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:44,806 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:44,807 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:43452': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:44,904 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:44,904 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:43464': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:44,913 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:44,914 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:43470': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:45,012 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:45,013 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:43482': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:45,031 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:45,034 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:43496': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:45,121 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:45,121 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:43508': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:45,143 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:45,143 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:43516': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:45,229 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:45,229 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:43532': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:45,251 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:45,251 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:43538': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:45,339 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:45,339 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:43544': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:45,359 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:45,359 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:43556': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:45,448 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:45,448 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:43560': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:45,466 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:45,467 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:43574': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:45,557 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:45,557 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:43588': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:45,574 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:45,575 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:43596': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:45,666 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:45,666 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:43606': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:45,683 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:45,684 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:43620': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:45,774 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:45,774 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:43628': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:45,792 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:45,792 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:43642': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:45,882 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:45,882 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:43644': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:45,899 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:45,899 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:43654': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:45,990 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:45,991 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:43666': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:46,006 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:46,007 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:43680': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:46,098 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:46,098 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:43696': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:46,114 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:46,114 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:43710': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:46,207 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:46,208 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:43718': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:46,221 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:46,221 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:43734': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:46,316 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:46,316 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:43738': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:46,328 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:46,329 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:43752': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:46,424 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:46,424 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:43756': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:46,436 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:46,437 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:43762': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:46,533 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:46,534 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:43768': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:46,544 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:46,544 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:43776': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:46,641 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:46,642 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:43780': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:46,652 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:46,652 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:43786': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:46,749 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:46,750 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:43792': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:46,760 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:46,760 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:43796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:46,857 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:46,858 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:43812': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:46,867 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:46,867 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:43824': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:46,966 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:46,966 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:43828': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:46,976 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:46,976 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:43836': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:47,074 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:47,074 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:43852': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:47,083 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:47,083 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:43868': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:47,182 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:47,183 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:43878': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:47,191 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:47,195 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:43894': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:47,290 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:47,291 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:43906': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:47,299 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:47,299 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:43914': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:47,398 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:47,398 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:43918': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:47,406 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:47,407 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:43928': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:47,506 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:47,506 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:43938': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:47,514 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:47,515 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:43940': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:47,614 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:47,614 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:43944': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:47,622 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:47,622 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:43946': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:47,722 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:47,722 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:43960': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:47,729 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:47,729 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:43972': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:47,831 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:47,832 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:43984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:47,838 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:47,838 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:43990': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:47,939 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:47,941 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:44006': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:47,947 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:47,947 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:44008': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:48,047 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:48,048 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:44016': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:48,054 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:48,055 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:44018': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:48,155 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:48,155 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:44034': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:48,162 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:48,162 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:44050': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:48,263 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:48,264 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:44054': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:48,270 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:48,271 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:44064': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:48,371 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:48,372 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:44070': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:48,378 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:48,379 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:44072': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:48,479 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:48,479 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:44084': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:48,486 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:48,486 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:44090': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:48,586 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:48,587 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:44102': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:48,593 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:48,594 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:44114': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:48,698 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:48,699 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:44116': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:48,705 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:48,706 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:44130': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:48,807 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:48,808 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:44146': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:48,814 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:48,815 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:44150': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:48,916 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:48,916 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:44166': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:48,923 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:48,923 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:44180': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:49,023 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:49,024 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:44190': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:49,030 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:49,031 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:44198': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:49,131 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:49,132 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:44200': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:49,138 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:49,139 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:44216': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:49,240 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:49,245 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:44222': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:49,251 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:49,251 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:44232': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:49,347 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:49,348 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:44244': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:49,359 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:49,359 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:44258': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:49,456 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:49,456 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:44274': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:49,466 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:49,467 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:44280': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:49,565 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:49,565 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:44294': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:49,574 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:49,575 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:44302': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:49,674 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:49,674 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:44308': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:49,682 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:49,682 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:44322': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:49,781 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:49,782 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:44338': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:49,788 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:49,789 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:44344': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:49,890 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:49,891 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:44356': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:49,897 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:49,897 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:44370': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:49,997 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:49,998 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:44376': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:50,004 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:50,005 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:44384': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:50,105 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:50,106 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:44386': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:50,112 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:50,112 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:44388': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:50,213 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:50,214 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:44400': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:50,220 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:50,221 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:44406': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:50,322 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:50,323 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:44408': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:50,329 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:50,329 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:44414': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:50,431 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:50,432 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:44428': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:50,438 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:50,438 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:44430': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:50,539 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:50,539 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:44442': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:50,546 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:50,546 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:44446': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:50,648 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:50,649 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:44456': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:50,655 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:50,655 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:44466': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:50,755 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:50,756 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:44474': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:50,762 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:50,763 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:44486': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:50,863 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:50,875 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:44498': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:50,887 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:50,888 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:44508': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:50,971 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:50,972 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:44510': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:50,994 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:50,995 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:44522': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:51,079 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:51,079 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:44536': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:51,102 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:51,102 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:44542': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:51,187 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:51,192 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:44550': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:51,210 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39291 4768s 2024-11-23 21:43:51,210 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39291': TLS handshake failed with remote 'tls://127.0.0.1:44562': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:43:51,253 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40899. Reason: failure-to-start- 4768s 2024-11-23 21:43:51,253 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:43:51,256 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37457. Reason: failure-to-start- 4768s 2024-11-23 21:43:51,256 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:43:51,258 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 13s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 4768s stream = await stream.start_tls( 4768s ^^^^^^^^^^^^^^^^^^^^^^^ 4768s False, ssl_options=ssl_options, server_hostname=host 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 4768s self.socket.do_handshake() 4768s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 4768s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 4768s self._sslobj.do_handshake() 4768s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 4768s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 4768s raise FatalCommClosedError( 4768s ...<2 lines>... 4768s ) from err 4768s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 4768s 4768s During handling of the above exception, another exception occurred: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1218, in _register_with_scheduler 4768s await asyncio.sleep(0.1) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 718, in sleep 4768s return await future 4768s ^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 13s. 4768s 2024-11-23 21:43:52,271 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:43:52,282 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35185 4768s 2024-11-23 21:43:52,282 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43387/status 4768s 2024-11-23 21:43:52,283 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:43:52,302 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41919 4768s 2024-11-23 21:43:52,302 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41919 4768s 2024-11-23 21:43:52,302 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:43:52,302 - distributed.worker - INFO - dashboard at: 127.0.0.1:45593 4768s 2024-11-23 21:43:52,302 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35185 4768s 2024-11-23 21:43:52,302 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:43:52,302 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:43:52,302 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:43:52,302 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-blvjbosx 4768s 2024-11-23 21:43:52,302 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:43:52,305 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34855 4768s 2024-11-23 21:43:52,305 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34855 4768s 2024-11-23 21:43:52,305 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:43:52,305 - distributed.worker - INFO - dashboard at: 127.0.0.1:39657 4768s 2024-11-23 21:43:52,305 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35185 4768s 2024-11-23 21:43:52,305 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:43:52,305 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:43:52,305 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:43:52,305 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-gflr44wu 4768s 2024-11-23 21:43:52,305 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:43:52,306 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41919. Reason: failure-to-start- 4768s 2024-11-23 21:43:52,306 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:43:52,307 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34855. Reason: failure-to-start- 4768s 2024-11-23 21:43:52,307 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:43:52,308 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35185': TLS handshake failed with remote 'tls://127.0.0.1:59060': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:43:52,309 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35185': TLS handshake failed with remote 'tls://127.0.0.1:59076': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:43:52,310 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:43:53,317 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:43:53,325 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46321 4768s 2024-11-23 21:43:53,325 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36647/status 4768s 2024-11-23 21:43:53,326 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:43:53,343 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45377 4768s 2024-11-23 21:43:53,343 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45377 4768s 2024-11-23 21:43:53,343 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:43:53,343 - distributed.worker - INFO - dashboard at: 127.0.0.1:36519 4768s 2024-11-23 21:43:53,343 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46321 4768s 2024-11-23 21:43:53,343 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:43:53,343 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:43:53,343 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:43:53,343 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-w0rmltb2 4768s 2024-11-23 21:43:53,343 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:43:53,345 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38363 4768s 2024-11-23 21:43:53,346 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38363 4768s 2024-11-23 21:43:53,346 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:43:53,346 - distributed.worker - INFO - dashboard at: 127.0.0.1:35697 4768s 2024-11-23 21:43:53,346 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46321 4768s 2024-11-23 21:43:53,346 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:43:53,346 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:43:53,346 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:43:53,346 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-jutu5pyy 4768s 2024-11-23 21:43:53,346 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:43:53,348 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45377. Reason: failure-to-start- 4768s 2024-11-23 21:43:53,348 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:43:53,349 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38363. Reason: failure-to-start- 4768s 2024-11-23 21:43:53,349 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:43:53,350 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46321': TLS handshake failed with remote 'tls://127.0.0.1:53504': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:43:53,350 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46321': TLS handshake failed with remote 'tls://127.0.0.1:53518': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:43:53,352 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:43:54,357 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:43:54,366 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37669 4768s 2024-11-23 21:43:54,366 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35565/status 4768s 2024-11-23 21:43:54,367 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:43:54,384 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38859 4768s 2024-11-23 21:43:54,384 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38859 4768s 2024-11-23 21:43:54,384 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:43:54,384 - distributed.worker - INFO - dashboard at: 127.0.0.1:41707 4768s 2024-11-23 21:43:54,384 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 4768s 2024-11-23 21:43:54,384 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:43:54,384 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:43:54,384 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:43:54,384 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-t_x1da20 4768s 2024-11-23 21:43:54,384 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:43:54,387 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43775 4768s 2024-11-23 21:43:54,387 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43775 4768s 2024-11-23 21:43:54,387 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:43:54,387 - distributed.worker - INFO - dashboard at: 127.0.0.1:39867 4768s 2024-11-23 21:43:54,387 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37669 4768s 2024-11-23 21:43:54,387 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:43:54,387 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:43:54,387 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:43:54,387 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-80fxnawg 4768s 2024-11-23 21:43:54,387 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:43:54,388 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38859. Reason: failure-to-start- 4768s 2024-11-23 21:43:54,388 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:43:54,389 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43775. Reason: failure-to-start- 4768s 2024-11-23 21:43:54,389 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:43:54,390 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:37178': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:43:54,391 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37669': TLS handshake failed with remote 'tls://127.0.0.1:37188': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:43:54,392 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:43:55,398 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:43:55,415 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38441 4768s 2024-11-23 21:43:55,416 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37271/status 4768s 2024-11-23 21:43:55,416 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:43:55,432 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38147 4768s 2024-11-23 21:43:55,432 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38147 4768s 2024-11-23 21:43:55,432 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:43:55,433 - distributed.worker - INFO - dashboard at: 127.0.0.1:35073 4768s 2024-11-23 21:43:55,433 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38441 4768s 2024-11-23 21:43:55,433 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:43:55,433 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:43:55,433 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:43:55,433 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-fae7qdup 4768s 2024-11-23 21:43:55,433 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:43:55,435 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44479 4768s 2024-11-23 21:43:55,435 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44479 4768s 2024-11-23 21:43:55,435 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:43:55,435 - distributed.worker - INFO - dashboard at: 127.0.0.1:43837 4768s 2024-11-23 21:43:55,435 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38441 4768s 2024-11-23 21:43:55,435 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:43:55,436 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:43:55,436 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:43:55,436 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-e_h6ch92 4768s 2024-11-23 21:43:55,436 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:43:55,437 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38147. Reason: failure-to-start- 4768s 2024-11-23 21:43:55,437 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:43:55,437 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44479. Reason: failure-to-start- 4768s 2024-11-23 21:43:55,438 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:43:55,439 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38441': TLS handshake failed with remote 'tls://127.0.0.1:37180': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:43:55,439 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38441': TLS handshake failed with remote 'tls://127.0.0.1:37192': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:43:55,441 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:43:56,447 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:43:56,456 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41707 4768s 2024-11-23 21:43:56,456 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45307/status 4768s 2024-11-23 21:43:56,456 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:43:56,474 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42975 4768s 2024-11-23 21:43:56,474 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42975 4768s 2024-11-23 21:43:56,474 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:43:56,474 - distributed.worker - INFO - dashboard at: 127.0.0.1:46825 4768s 2024-11-23 21:43:56,474 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41707 4768s 2024-11-23 21:43:56,474 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:43:56,474 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:43:56,474 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:43:56,474 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-t8esvnum 4768s 2024-11-23 21:43:56,474 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:43:56,476 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38477 4768s 2024-11-23 21:43:56,477 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38477 4768s 2024-11-23 21:43:56,477 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:43:56,477 - distributed.worker - INFO - dashboard at: 127.0.0.1:35997 4768s 2024-11-23 21:43:56,477 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41707 4768s 2024-11-23 21:43:56,477 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:43:56,477 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:43:56,477 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:43:56,477 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-brzwi50j 4768s 2024-11-23 21:43:56,477 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:43:56,478 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42975. Reason: failure-to-start- 4768s 2024-11-23 21:43:56,478 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:43:56,479 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38477. Reason: failure-to-start- 4768s 2024-11-23 21:43:56,479 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:43:56,480 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41707': TLS handshake failed with remote 'tls://127.0.0.1:34824': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:43:56,480 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41707': TLS handshake failed with remote 'tls://127.0.0.1:34840': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:43:56,482 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:43:57,488 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:43:57,496 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34535 4768s 2024-11-23 21:43:57,496 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40319/status 4768s 2024-11-23 21:43:57,497 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:43:57,513 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43629 4768s 2024-11-23 21:43:57,513 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43629 4768s 2024-11-23 21:43:57,513 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:43:57,513 - distributed.worker - INFO - dashboard at: 127.0.0.1:41281 4768s 2024-11-23 21:43:57,513 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34535 4768s 2024-11-23 21:43:57,513 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:43:57,513 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:43:57,513 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:43:57,513 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-rfn9wwqp 4768s 2024-11-23 21:43:57,513 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:43:57,516 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43285 4768s 2024-11-23 21:43:57,516 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43285 4768s 2024-11-23 21:43:57,516 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:43:57,516 - distributed.worker - INFO - dashboard at: 127.0.0.1:41667 4768s 2024-11-23 21:43:57,516 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34535 4768s 2024-11-23 21:43:57,516 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:43:57,516 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:43:57,516 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:43:57,516 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-qixfgy0w 4768s 2024-11-23 21:43:57,516 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:43:57,518 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43629. Reason: failure-to-start- 4768s 2024-11-23 21:43:57,518 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:43:57,518 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43285. Reason: failure-to-start- 4768s 2024-11-23 21:43:57,518 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:43:57,520 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34535': TLS handshake failed with remote 'tls://127.0.0.1:50128': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:43:57,520 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34535': TLS handshake failed with remote 'tls://127.0.0.1:50142': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:43:57,521 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:43:58,529 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:43:58,537 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41627 4768s 2024-11-23 21:43:58,538 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37177/status 4768s 2024-11-23 21:43:58,538 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:43:58,554 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35601 4768s 2024-11-23 21:43:58,554 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35601 4768s 2024-11-23 21:43:58,554 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:43:58,554 - distributed.worker - INFO - dashboard at: 127.0.0.1:38169 4768s 2024-11-23 21:43:58,554 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41627 4768s 2024-11-23 21:43:58,555 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:43:58,555 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:43:58,555 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:43:58,555 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-fgq1tmhi 4768s 2024-11-23 21:43:58,555 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:43:58,557 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45077 4768s 2024-11-23 21:43:58,557 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45077 4768s 2024-11-23 21:43:58,557 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:43:58,557 - distributed.worker - INFO - dashboard at: 127.0.0.1:42405 4768s 2024-11-23 21:43:58,557 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41627 4768s 2024-11-23 21:43:58,557 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:43:58,557 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:43:58,557 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:43:58,557 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-787x_fvc 4768s 2024-11-23 21:43:58,557 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:43:58,558 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35601. Reason: failure-to-start- 4768s 2024-11-23 21:43:58,559 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:43:58,559 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45077. Reason: failure-to-start- 4768s 2024-11-23 21:43:58,559 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:43:58,561 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41627': TLS handshake failed with remote 'tls://127.0.0.1:59542': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:43:58,561 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41627': TLS handshake failed with remote 'tls://127.0.0.1:59558': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:43:58,562 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:43:59,569 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:43:59,577 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34129 4768s 2024-11-23 21:43:59,577 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34449/status 4768s 2024-11-23 21:43:59,578 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:43:59,596 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42577 4768s 2024-11-23 21:43:59,596 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42577 4768s 2024-11-23 21:43:59,596 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:43:59,596 - distributed.worker - INFO - dashboard at: 127.0.0.1:36521 4768s 2024-11-23 21:43:59,596 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34129 4768s 2024-11-23 21:43:59,596 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:43:59,596 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:43:59,596 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:43:59,596 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-pvhm5a7y 4768s 2024-11-23 21:43:59,596 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:43:59,598 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39491 4768s 2024-11-23 21:43:59,599 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39491 4768s 2024-11-23 21:43:59,599 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:43:59,599 - distributed.worker - INFO - dashboard at: 127.0.0.1:33947 4768s 2024-11-23 21:43:59,599 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34129 4768s 2024-11-23 21:43:59,599 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:43:59,599 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:43:59,599 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:43:59,599 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-80wof3lq 4768s 2024-11-23 21:43:59,599 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:43:59,600 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42577. Reason: failure-to-start- 4768s 2024-11-23 21:43:59,600 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:43:59,601 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39491. Reason: failure-to-start- 4768s 2024-11-23 21:43:59,601 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:43:59,602 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34129': TLS handshake failed with remote 'tls://127.0.0.1:38146': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:43:59,602 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34129': TLS handshake failed with remote 'tls://127.0.0.1:38154': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:43:59,604 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:44:00,611 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:44:00,623 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41713 4768s 2024-11-23 21:44:00,623 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46285/status 4768s 2024-11-23 21:44:00,624 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:44:00,672 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33923 4768s 2024-11-23 21:44:00,672 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33923 4768s 2024-11-23 21:44:00,672 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:44:00,672 - distributed.worker - INFO - dashboard at: 127.0.0.1:44575 4768s 2024-11-23 21:44:00,672 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 4768s 2024-11-23 21:44:00,672 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:44:00,672 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:44:00,673 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:44:00,673 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-nrutb3hh 4768s 2024-11-23 21:44:00,673 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:44:00,677 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36091 4768s 2024-11-23 21:44:00,677 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36091 4768s 2024-11-23 21:44:00,677 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:44:00,677 - distributed.worker - INFO - dashboard at: 127.0.0.1:40447 4768s 2024-11-23 21:44:00,677 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 4768s 2024-11-23 21:44:00,677 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:44:00,677 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:44:00,677 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:44:00,677 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-9xh73gkf 4768s 2024-11-23 21:44:00,677 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:44:00,679 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33923. Reason: failure-to-start- 4768s 2024-11-23 21:44:00,679 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:44:00,680 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36091. Reason: failure-to-start- 4768s 2024-11-23 21:44:00,680 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:44:00,681 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:42184': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:44:00,682 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:42186': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:44:00,683 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:44:01,694 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:44:01,703 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41901 4768s 2024-11-23 21:44:01,703 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44461/status 4768s 2024-11-23 21:44:01,704 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:44:01,719 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44147 4768s 2024-11-23 21:44:01,719 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44147 4768s 2024-11-23 21:44:01,720 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:44:01,720 - distributed.worker - INFO - dashboard at: 127.0.0.1:37033 4768s 2024-11-23 21:44:01,720 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41901 4768s 2024-11-23 21:44:01,720 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:44:01,720 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:44:01,720 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:44:01,720 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-pho7c0ka 4768s 2024-11-23 21:44:01,720 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:44:01,722 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39367 4768s 2024-11-23 21:44:01,722 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39367 4768s 2024-11-23 21:44:01,722 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:44:01,722 - distributed.worker - INFO - dashboard at: 127.0.0.1:36681 4768s 2024-11-23 21:44:01,722 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41901 4768s 2024-11-23 21:44:01,722 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:44:01,722 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:44:01,722 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:44:01,722 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-_gwqht4h 4768s 2024-11-23 21:44:01,723 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:44:01,724 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44147. Reason: failure-to-start- 4768s 2024-11-23 21:44:01,724 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:44:01,725 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39367. Reason: failure-to-start- 4768s 2024-11-23 21:44:01,725 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:44:01,726 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41901': TLS handshake failed with remote 'tls://127.0.0.1:53324': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:44:01,726 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41901': TLS handshake failed with remote 'tls://127.0.0.1:53326': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:44:01,728 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:44:02,733 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:44:02,744 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37963 4768s 2024-11-23 21:44:02,744 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37547/status 4768s 2024-11-23 21:44:02,745 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:44:02,765 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45877 4768s 2024-11-23 21:44:02,765 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45877 4768s 2024-11-23 21:44:02,765 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:44:02,765 - distributed.worker - INFO - dashboard at: 127.0.0.1:35533 4768s 2024-11-23 21:44:02,765 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37963 4768s 2024-11-23 21:44:02,765 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:44:02,765 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:44:02,765 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:44:02,765 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-rm2epzwc 4768s 2024-11-23 21:44:02,765 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:44:02,767 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44175 4768s 2024-11-23 21:44:02,768 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44175 4768s 2024-11-23 21:44:02,768 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:44:02,768 - distributed.worker - INFO - dashboard at: 127.0.0.1:42271 4768s 2024-11-23 21:44:02,768 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37963 4768s 2024-11-23 21:44:02,768 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:44:02,768 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:44:02,768 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:44:02,768 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-q_wkfujy 4768s 2024-11-23 21:44:02,768 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:44:02,769 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45877. Reason: failure-to-start- 4768s 2024-11-23 21:44:02,769 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:44:02,770 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44175. Reason: failure-to-start- 4768s 2024-11-23 21:44:02,770 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:44:02,772 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37963': TLS handshake failed with remote 'tls://127.0.0.1:59940': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:44:02,772 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37963': TLS handshake failed with remote 'tls://127.0.0.1:59948': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:44:02,773 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:44:03,780 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:44:03,788 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37809 4768s 2024-11-23 21:44:03,788 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38393/status 4768s 2024-11-23 21:44:03,789 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:44:03,808 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43007 4768s 2024-11-23 21:44:03,809 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43007 4768s 2024-11-23 21:44:03,809 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:44:03,809 - distributed.worker - INFO - dashboard at: 127.0.0.1:34267 4768s 2024-11-23 21:44:03,809 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37809 4768s 2024-11-23 21:44:03,809 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:44:03,809 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:44:03,809 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:44:03,809 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-gab5zk2c 4768s 2024-11-23 21:44:03,809 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:44:03,811 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38671 4768s 2024-11-23 21:44:03,811 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38671 4768s 2024-11-23 21:44:03,811 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:44:03,811 - distributed.worker - INFO - dashboard at: 127.0.0.1:42057 4768s 2024-11-23 21:44:03,812 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37809 4768s 2024-11-23 21:44:03,812 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:44:03,812 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:44:03,812 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:44:03,812 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-0rkqsic1 4768s 2024-11-23 21:44:03,812 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:44:03,813 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43007. Reason: failure-to-start- 4768s 2024-11-23 21:44:03,813 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:44:03,814 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38671. Reason: failure-to-start- 4768s 2024-11-23 21:44:03,814 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:44:03,815 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37809': TLS handshake failed with remote 'tls://127.0.0.1:52164': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:44:03,815 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37809': TLS handshake failed with remote 'tls://127.0.0.1:52178': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:44:03,817 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:44:04,823 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:44:04,831 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35627 4768s 2024-11-23 21:44:04,831 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45903/status 4768s 2024-11-23 21:44:04,832 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:44:04,850 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:32789 4768s 2024-11-23 21:44:04,850 - distributed.worker - INFO - Listening to: tls://127.0.0.1:32789 4768s 2024-11-23 21:44:04,850 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:44:04,850 - distributed.worker - INFO - dashboard at: 127.0.0.1:36699 4768s 2024-11-23 21:44:04,850 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35627 4768s 2024-11-23 21:44:04,850 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:44:04,850 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:44:04,850 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:44:04,850 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-tz3k1nge 4768s 2024-11-23 21:44:04,850 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:44:04,853 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37659 4768s 2024-11-23 21:44:04,853 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37659 4768s 2024-11-23 21:44:04,853 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:44:04,853 - distributed.worker - INFO - dashboard at: 127.0.0.1:45559 4768s 2024-11-23 21:44:04,853 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35627 4768s 2024-11-23 21:44:04,853 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:44:04,853 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:44:04,853 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:44:04,853 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-2ze4km86 4768s 2024-11-23 21:44:04,853 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:44:04,856 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:32789. Reason: failure-to-start- 4768s 2024-11-23 21:44:04,856 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:44:04,856 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37659. Reason: failure-to-start- 4768s 2024-11-23 21:44:04,856 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:44:04,858 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35627': TLS handshake failed with remote 'tls://127.0.0.1:59238': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:44:04,858 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35627': TLS handshake failed with remote 'tls://127.0.0.1:59246': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:44:04,860 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:44:05,865 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:44:05,873 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:32891 4768s 2024-11-23 21:44:05,874 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34653/status 4768s 2024-11-23 21:44:05,874 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:44:05,893 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33593 4768s 2024-11-23 21:44:05,893 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33593 4768s 2024-11-23 21:44:05,893 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:44:05,893 - distributed.worker - INFO - dashboard at: 127.0.0.1:42701 4768s 2024-11-23 21:44:05,893 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:32891 4768s 2024-11-23 21:44:05,893 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:44:05,893 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:44:05,893 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:44:05,893 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-y95xf6f3 4768s 2024-11-23 21:44:05,894 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:44:05,896 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41229 4768s 2024-11-23 21:44:05,896 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41229 4768s 2024-11-23 21:44:05,896 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:44:05,896 - distributed.worker - INFO - dashboard at: 127.0.0.1:38829 4768s 2024-11-23 21:44:05,896 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:32891 4768s 2024-11-23 21:44:05,896 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:44:05,896 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:44:05,896 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:44:05,896 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-eixi7_x1 4768s 2024-11-23 21:44:05,896 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:44:05,898 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33593. Reason: failure-to-start- 4768s 2024-11-23 21:44:05,898 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:44:05,898 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41229. Reason: failure-to-start- 4768s 2024-11-23 21:44:05,899 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:44:05,900 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:32891': TLS handshake failed with remote 'tls://127.0.0.1:34120': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:44:05,900 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:32891': TLS handshake failed with remote 'tls://127.0.0.1:34122': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:44:05,902 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:44:06,908 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:44:06,919 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33379 4768s 2024-11-23 21:44:06,919 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33455/status 4768s 2024-11-23 21:44:06,920 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:44:06,939 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43275 4768s 2024-11-23 21:44:06,939 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43275 4768s 2024-11-23 21:44:06,939 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:44:06,939 - distributed.worker - INFO - dashboard at: 127.0.0.1:36699 4768s 2024-11-23 21:44:06,939 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33379 4768s 2024-11-23 21:44:06,939 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:44:06,939 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:44:06,939 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:44:06,939 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-hr35incz 4768s 2024-11-23 21:44:06,939 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:44:06,942 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37705 4768s 2024-11-23 21:44:06,942 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37705 4768s 2024-11-23 21:44:06,942 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:44:06,942 - distributed.worker - INFO - dashboard at: 127.0.0.1:39119 4768s 2024-11-23 21:44:06,942 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33379 4768s 2024-11-23 21:44:06,942 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:44:06,942 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:44:06,942 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:44:06,942 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-6gw60trq 4768s 2024-11-23 21:44:06,942 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:44:06,944 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43275. Reason: failure-to-start- 4768s 2024-11-23 21:44:06,944 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:44:06,944 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37705. Reason: failure-to-start- 4768s 2024-11-23 21:44:06,945 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:44:06,946 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33379': TLS handshake failed with remote 'tls://127.0.0.1:56948': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:44:06,947 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33379': TLS handshake failed with remote 'tls://127.0.0.1:56952': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:44:06,948 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:44:07,954 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:44:07,962 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36137 4768s 2024-11-23 21:44:07,962 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40951/status 4768s 2024-11-23 21:44:07,963 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:44:07,984 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41347 4768s 2024-11-23 21:44:07,984 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41347 4768s 2024-11-23 21:44:07,984 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:44:07,984 - distributed.worker - INFO - dashboard at: 127.0.0.1:39705 4768s 2024-11-23 21:44:07,984 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36137 4768s 2024-11-23 21:44:07,984 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:44:07,984 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:44:07,984 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:44:07,984 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-tgxz7731 4768s 2024-11-23 21:44:07,985 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:44:07,987 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44667 4768s 2024-11-23 21:44:07,987 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44667 4768s 2024-11-23 21:44:07,987 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:44:07,987 - distributed.worker - INFO - dashboard at: 127.0.0.1:45889 4768s 2024-11-23 21:44:07,987 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36137 4768s 2024-11-23 21:44:07,987 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:44:07,987 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:44:07,987 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:44:07,987 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-00xs86z4 4768s 2024-11-23 21:44:07,987 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:44:07,989 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41347. Reason: failure-to-start- 4768s 2024-11-23 21:44:07,989 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:44:07,989 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44667. Reason: failure-to-start- 4768s 2024-11-23 21:44:07,989 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:44:07,991 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36137': TLS handshake failed with remote 'tls://127.0.0.1:36054': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:44:07,991 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36137': TLS handshake failed with remote 'tls://127.0.0.1:36056': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:44:07,993 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:44:09,002 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:44:09,011 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43847 4768s 2024-11-23 21:44:09,012 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41143/status 4768s 2024-11-23 21:44:09,012 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:44:09,032 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46475 4768s 2024-11-23 21:44:09,033 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46475 4768s 2024-11-23 21:44:09,033 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:44:09,033 - distributed.worker - INFO - dashboard at: 127.0.0.1:34411 4768s 2024-11-23 21:44:09,033 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43847 4768s 2024-11-23 21:44:09,033 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:44:09,033 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:44:09,033 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:44:09,033 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-8nq0oe_d 4768s 2024-11-23 21:44:09,033 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:44:09,035 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38959 4768s 2024-11-23 21:44:09,036 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38959 4768s 2024-11-23 21:44:09,036 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:44:09,036 - distributed.worker - INFO - dashboard at: 127.0.0.1:38553 4768s 2024-11-23 21:44:09,036 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43847 4768s 2024-11-23 21:44:09,036 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:44:09,036 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:44:09,036 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:44:09,036 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-59npduef 4768s 2024-11-23 21:44:09,036 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:44:09,039 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46475. Reason: failure-to-start- 4768s 2024-11-23 21:44:09,039 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:44:09,039 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38959. Reason: failure-to-start- 4768s 2024-11-23 21:44:09,040 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:44:09,041 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43847': TLS handshake failed with remote 'tls://127.0.0.1:57744': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:44:09,042 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43847': TLS handshake failed with remote 'tls://127.0.0.1:57760': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:44:09,046 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:44:10,052 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:44:10,061 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34531 4768s 2024-11-23 21:44:10,061 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34771/status 4768s 2024-11-23 21:44:10,061 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:44:10,077 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44507 4768s 2024-11-23 21:44:10,077 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44507 4768s 2024-11-23 21:44:10,077 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:44:10,077 - distributed.worker - INFO - dashboard at: 127.0.0.1:39537 4768s 2024-11-23 21:44:10,077 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34531 4768s 2024-11-23 21:44:10,077 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:44:10,077 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:44:10,077 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:44:10,077 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-1m98piu4 4768s 2024-11-23 21:44:10,077 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:44:10,079 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38413 4768s 2024-11-23 21:44:10,079 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38413 4768s 2024-11-23 21:44:10,080 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:44:10,080 - distributed.worker - INFO - dashboard at: 127.0.0.1:43157 4768s 2024-11-23 21:44:10,080 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34531 4768s 2024-11-23 21:44:10,080 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:44:10,080 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:44:10,080 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:44:10,080 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-y3db22bx 4768s 2024-11-23 21:44:10,080 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:44:10,082 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44507. Reason: failure-to-start- 4768s 2024-11-23 21:44:10,082 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:44:10,083 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38413. Reason: failure-to-start- 4768s 2024-11-23 21:44:10,083 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:44:10,087 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34531': TLS handshake failed with remote 'tls://127.0.0.1:40392': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:44:10,087 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34531': TLS handshake failed with remote 'tls://127.0.0.1:40400': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:44:10,088 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:44:11,094 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:44:11,104 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44577 4768s 2024-11-23 21:44:11,105 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39673/status 4768s 2024-11-23 21:44:11,105 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:44:11,120 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39195 4768s 2024-11-23 21:44:11,120 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39195 4768s 2024-11-23 21:44:11,120 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:44:11,120 - distributed.worker - INFO - dashboard at: 127.0.0.1:42829 4768s 2024-11-23 21:44:11,120 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44577 4768s 2024-11-23 21:44:11,121 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:44:11,121 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:44:11,121 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:44:11,121 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-8dlsyt33 4768s 2024-11-23 21:44:11,121 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:44:11,123 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38301 4768s 2024-11-23 21:44:11,123 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38301 4768s 2024-11-23 21:44:11,123 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:44:11,123 - distributed.worker - INFO - dashboard at: 127.0.0.1:42583 4768s 2024-11-23 21:44:11,123 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44577 4768s 2024-11-23 21:44:11,123 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:44:11,123 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:44:11,123 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:44:11,123 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-98meerot 4768s 2024-11-23 21:44:11,124 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:44:11,126 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39195. Reason: failure-to-start- 4768s 2024-11-23 21:44:11,127 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:44:11,127 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38301. Reason: failure-to-start- 4768s 2024-11-23 21:44:11,127 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:44:11,129 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44577': TLS handshake failed with remote 'tls://127.0.0.1:57542': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:44:11,129 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44577': TLS handshake failed with remote 'tls://127.0.0.1:57546': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:44:11,133 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:44:12,139 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:44:12,148 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46001 4768s 2024-11-23 21:44:12,148 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34307/status 4768s 2024-11-23 21:44:12,148 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:44:12,181 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41445 4768s 2024-11-23 21:44:12,181 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41445 4768s 2024-11-23 21:44:12,181 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:44:12,181 - distributed.worker - INFO - dashboard at: 127.0.0.1:40711 4768s 2024-11-23 21:44:12,181 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46001 4768s 2024-11-23 21:44:12,181 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:44:12,181 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:44:12,181 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:44:12,181 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-otquidff 4768s 2024-11-23 21:44:12,181 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:44:12,183 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39337 4768s 2024-11-23 21:44:12,184 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39337 4768s 2024-11-23 21:44:12,184 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:44:12,184 - distributed.worker - INFO - dashboard at: 127.0.0.1:41223 4768s 2024-11-23 21:44:12,184 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46001 4768s 2024-11-23 21:44:12,184 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:44:12,184 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:44:12,184 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:44:12,184 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-yxpahe50 4768s 2024-11-23 21:44:12,184 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:44:12,186 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41445. Reason: failure-to-start- 4768s 2024-11-23 21:44:12,186 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:44:12,186 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39337. Reason: failure-to-start- 4768s 2024-11-23 21:44:12,186 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:44:12,188 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46001': TLS handshake failed with remote 'tls://127.0.0.1:45332': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:44:12,188 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46001': TLS handshake failed with remote 'tls://127.0.0.1:45342': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:44:12,193 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:44:13,207 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:44:13,219 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44477 4768s 2024-11-23 21:44:13,220 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41869/status 4768s 2024-11-23 21:44:13,220 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:44:13,242 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43817 4768s 2024-11-23 21:44:13,242 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43817 4768s 2024-11-23 21:44:13,242 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:44:13,242 - distributed.worker - INFO - dashboard at: 127.0.0.1:35403 4768s 2024-11-23 21:44:13,242 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44477 4768s 2024-11-23 21:44:13,242 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:44:13,242 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:44:13,242 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:44:13,242 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ph5wsqmo 4768s 2024-11-23 21:44:13,242 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:44:13,246 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36549 4768s 2024-11-23 21:44:13,246 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36549 4768s 2024-11-23 21:44:13,246 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:44:13,246 - distributed.worker - INFO - dashboard at: 127.0.0.1:35569 4768s 2024-11-23 21:44:13,246 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44477 4768s 2024-11-23 21:44:13,246 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:44:13,246 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:44:13,246 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:44:13,246 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-1uzyzzcu 4768s 2024-11-23 21:44:13,246 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:44:13,252 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43817. Reason: failure-to-start- 4768s 2024-11-23 21:44:13,252 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:44:13,252 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36549. Reason: failure-to-start- 4768s 2024-11-23 21:44:13,252 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:44:13,254 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44477': TLS handshake failed with remote 'tls://127.0.0.1:59530': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:44:13,254 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44477': TLS handshake failed with remote 'tls://127.0.0.1:59532': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:44:13,259 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:44:14,265 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:44:14,273 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44773 4768s 2024-11-23 21:44:14,274 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34325/status 4768s 2024-11-23 21:44:14,274 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:44:14,291 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44861 4768s 2024-11-23 21:44:14,292 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44861 4768s 2024-11-23 21:44:14,292 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:44:14,292 - distributed.worker - INFO - dashboard at: 127.0.0.1:46053 4768s 2024-11-23 21:44:14,292 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44773 4768s 2024-11-23 21:44:14,292 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:44:14,292 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:44:14,292 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:44:14,292 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-y__sm0i6 4768s 2024-11-23 21:44:14,292 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:44:14,294 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43107 4768s 2024-11-23 21:44:14,294 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43107 4768s 2024-11-23 21:44:14,294 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:44:14,295 - distributed.worker - INFO - dashboard at: 127.0.0.1:33255 4768s 2024-11-23 21:44:14,295 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44773 4768s 2024-11-23 21:44:14,295 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:44:14,295 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:44:14,295 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:44:14,295 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-8hazrp59 4768s 2024-11-23 21:44:14,295 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:44:14,299 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44861. Reason: failure-to-start- 4768s 2024-11-23 21:44:14,299 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:44:14,300 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43107. Reason: failure-to-start- 4768s 2024-11-23 21:44:14,300 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:44:14,304 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44773': TLS handshake failed with remote 'tls://127.0.0.1:47658': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:44:14,304 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44773': TLS handshake failed with remote 'tls://127.0.0.1:47660': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:44:14,306 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:44:15,312 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:44:15,323 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37543 4768s 2024-11-23 21:44:15,323 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38155/status 4768s 2024-11-23 21:44:15,324 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:44:15,341 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40849 4768s 2024-11-23 21:44:15,341 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40849 4768s 2024-11-23 21:44:15,341 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:44:15,341 - distributed.worker - INFO - dashboard at: 127.0.0.1:40041 4768s 2024-11-23 21:44:15,341 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37543 4768s 2024-11-23 21:44:15,341 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:44:15,341 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:44:15,341 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:44:15,341 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-sdp9s9ex 4768s 2024-11-23 21:44:15,341 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:44:15,344 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41043 4768s 2024-11-23 21:44:15,344 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41043 4768s 2024-11-23 21:44:15,344 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:44:15,344 - distributed.worker - INFO - dashboard at: 127.0.0.1:35483 4768s 2024-11-23 21:44:15,344 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37543 4768s 2024-11-23 21:44:15,344 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:44:15,344 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:44:15,344 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:44:15,344 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ok8ud7s0 4768s 2024-11-23 21:44:15,344 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:44:15,350 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40849. Reason: failure-to-start- 4768s 2024-11-23 21:44:15,350 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:44:15,351 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41043. Reason: failure-to-start- 4768s 2024-11-23 21:44:15,351 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:44:15,352 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37543': TLS handshake failed with remote 'tls://127.0.0.1:35804': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:44:15,352 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37543': TLS handshake failed with remote 'tls://127.0.0.1:35818': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:44:15,354 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:44:16,360 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:44:16,368 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39375 4768s 2024-11-23 21:44:16,368 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39445/status 4768s 2024-11-23 21:44:16,369 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:44:16,391 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45377 4768s 2024-11-23 21:44:16,391 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45377 4768s 2024-11-23 21:44:16,391 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:44:16,391 - distributed.worker - INFO - dashboard at: 127.0.0.1:38335 4768s 2024-11-23 21:44:16,391 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39375 4768s 2024-11-23 21:44:16,392 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:44:16,392 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:44:16,392 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:44:16,392 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-t4at9q_v 4768s 2024-11-23 21:44:16,392 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:44:16,394 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38265 4768s 2024-11-23 21:44:16,394 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38265 4768s 2024-11-23 21:44:16,394 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:44:16,394 - distributed.worker - INFO - dashboard at: 127.0.0.1:42423 4768s 2024-11-23 21:44:16,394 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39375 4768s 2024-11-23 21:44:16,394 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:44:16,394 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:44:16,395 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:44:16,395 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-_2bfj2ay 4768s 2024-11-23 21:44:16,395 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:44:16,399 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45377. Reason: failure-to-start- 4768s 2024-11-23 21:44:16,399 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:44:16,399 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38265. Reason: failure-to-start- 4768s 2024-11-23 21:44:16,400 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:44:16,401 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39375': TLS handshake failed with remote 'tls://127.0.0.1:42380': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:44:16,401 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39375': TLS handshake failed with remote 'tls://127.0.0.1:42386': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:44:16,403 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:44:17,411 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:44:17,422 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40119 4768s 2024-11-23 21:44:17,423 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43949/status 4768s 2024-11-23 21:44:17,423 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:44:17,444 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44017 4768s 2024-11-23 21:44:17,445 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44017 4768s 2024-11-23 21:44:17,445 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:44:17,445 - distributed.worker - INFO - dashboard at: 127.0.0.1:35563 4768s 2024-11-23 21:44:17,445 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40119 4768s 2024-11-23 21:44:17,445 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:44:17,445 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:44:17,445 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:44:17,445 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ymqe4os1 4768s 2024-11-23 21:44:17,445 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:44:17,447 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43681 4768s 2024-11-23 21:44:17,447 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43681 4768s 2024-11-23 21:44:17,447 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:44:17,447 - distributed.worker - INFO - dashboard at: 127.0.0.1:46017 4768s 2024-11-23 21:44:17,447 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40119 4768s 2024-11-23 21:44:17,447 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:44:17,447 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:44:17,447 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:44:17,447 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-dhfbpft6 4768s 2024-11-23 21:44:17,447 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:44:17,450 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44017. Reason: failure-to-start- 4768s 2024-11-23 21:44:17,450 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:44:17,451 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43681. Reason: failure-to-start- 4768s 2024-11-23 21:44:17,451 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:44:17,452 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40119': TLS handshake failed with remote 'tls://127.0.0.1:38800': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:44:17,452 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40119': TLS handshake failed with remote 'tls://127.0.0.1:38812': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:44:17,454 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:44:18,460 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:44:18,469 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40531 4768s 2024-11-23 21:44:18,469 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35787/status 4768s 2024-11-23 21:44:18,472 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:44:18,491 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35501 4768s 2024-11-23 21:44:18,491 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35501 4768s 2024-11-23 21:44:18,491 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:44:18,491 - distributed.worker - INFO - dashboard at: 127.0.0.1:37037 4768s 2024-11-23 21:44:18,491 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40531 4768s 2024-11-23 21:44:18,491 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:44:18,491 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:44:18,491 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:44:18,491 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-b87xkn8w 4768s 2024-11-23 21:44:18,491 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:44:18,493 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44345 4768s 2024-11-23 21:44:18,493 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44345 4768s 2024-11-23 21:44:18,494 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:44:18,494 - distributed.worker - INFO - dashboard at: 127.0.0.1:41167 4768s 2024-11-23 21:44:18,494 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40531 4768s 2024-11-23 21:44:18,494 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:44:18,494 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:44:18,494 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:44:18,494 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-f7q5otmq 4768s 2024-11-23 21:44:18,494 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:44:18,495 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35501. Reason: failure-to-start- 4768s 2024-11-23 21:44:18,495 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:44:18,496 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44345. Reason: failure-to-start- 4768s 2024-11-23 21:44:18,496 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:44:18,497 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40531': TLS handshake failed with remote 'tls://127.0.0.1:50160': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:44:18,497 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40531': TLS handshake failed with remote 'tls://127.0.0.1:50164': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:44:18,502 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:44:19,507 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:44:19,517 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42573 4768s 2024-11-23 21:44:19,517 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42783/status 4768s 2024-11-23 21:44:19,518 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:44:19,536 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41329 4768s 2024-11-23 21:44:19,536 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41329 4768s 2024-11-23 21:44:19,536 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:44:19,536 - distributed.worker - INFO - dashboard at: 127.0.0.1:43675 4768s 2024-11-23 21:44:19,536 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42573 4768s 2024-11-23 21:44:19,537 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:44:19,537 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:44:19,537 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:44:19,537 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-et2nmf44 4768s 2024-11-23 21:44:19,537 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:44:19,539 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40083 4768s 2024-11-23 21:44:19,539 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40083 4768s 2024-11-23 21:44:19,539 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:44:19,539 - distributed.worker - INFO - dashboard at: 127.0.0.1:32813 4768s 2024-11-23 21:44:19,539 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42573 4768s 2024-11-23 21:44:19,539 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:44:19,539 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:44:19,539 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:44:19,539 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ot7bit33 4768s 2024-11-23 21:44:19,539 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:44:19,541 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41329. Reason: failure-to-start- 4768s 2024-11-23 21:44:19,541 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:44:19,542 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40083. Reason: failure-to-start- 4768s 2024-11-23 21:44:19,543 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:44:19,547 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42573': TLS handshake failed with remote 'tls://127.0.0.1:33558': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:44:19,547 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42573': TLS handshake failed with remote 'tls://127.0.0.1:33574': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:44:19,548 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:44:20,554 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:44:20,562 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41799 4768s 2024-11-23 21:44:20,563 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41841/status 4768s 2024-11-23 21:44:20,563 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:44:20,585 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40781 4768s 2024-11-23 21:44:20,585 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40781 4768s 2024-11-23 21:44:20,586 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:44:20,586 - distributed.worker - INFO - dashboard at: 127.0.0.1:39183 4768s 2024-11-23 21:44:20,586 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41799 4768s 2024-11-23 21:44:20,586 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:44:20,586 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:44:20,586 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:44:20,586 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-03a70mw9 4768s 2024-11-23 21:44:20,586 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:44:20,588 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45315 4768s 2024-11-23 21:44:20,588 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45315 4768s 2024-11-23 21:44:20,588 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:44:20,588 - distributed.worker - INFO - dashboard at: 127.0.0.1:40845 4768s 2024-11-23 21:44:20,588 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41799 4768s 2024-11-23 21:44:20,588 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:44:20,588 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:44:20,589 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:44:20,589 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-eggprg2d 4768s 2024-11-23 21:44:20,589 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:44:20,594 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40781. Reason: failure-to-start- 4768s 2024-11-23 21:44:20,594 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:44:20,594 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45315. Reason: failure-to-start- 4768s 2024-11-23 21:44:20,595 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:44:20,596 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41799': TLS handshake failed with remote 'tls://127.0.0.1:57992': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:44:20,596 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41799': TLS handshake failed with remote 'tls://127.0.0.1:58006': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:44:20,598 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:44:21,605 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:44:21,613 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41307 4768s 2024-11-23 21:44:21,614 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33035/status 4768s 2024-11-23 21:44:21,614 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:44:21,633 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44971 4768s 2024-11-23 21:44:21,633 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44971 4768s 2024-11-23 21:44:21,633 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:44:21,633 - distributed.worker - INFO - dashboard at: 127.0.0.1:45343 4768s 2024-11-23 21:44:21,633 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41307 4768s 2024-11-23 21:44:21,633 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:44:21,633 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:44:21,634 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:44:21,634 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ql9_g2p0 4768s 2024-11-23 21:44:21,634 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:44:21,637 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36313 4768s 2024-11-23 21:44:21,637 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36313 4768s 2024-11-23 21:44:21,637 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:44:21,637 - distributed.worker - INFO - dashboard at: 127.0.0.1:38087 4768s 2024-11-23 21:44:21,637 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41307 4768s 2024-11-23 21:44:21,637 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:44:21,638 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:44:21,638 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:44:21,638 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-xaf6gmj3 4768s 2024-11-23 21:44:21,638 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:44:21,644 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44971. Reason: failure-to-start- 4768s 2024-11-23 21:44:21,644 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:44:21,644 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36313. Reason: failure-to-start- 4768s 2024-11-23 21:44:21,644 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:44:21,646 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41307': TLS handshake failed with remote 'tls://127.0.0.1:49796': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:44:21,646 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41307': TLS handshake failed with remote 'tls://127.0.0.1:49800': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:44:21,648 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s ______________________________ test_work_stealing ______________________________ 4768s 4768s fut = , timeout = 0 4768s 4768s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 4768s async with asyncio.timeout(timeout): 4768s > return await fut 4768s 4768s /usr/lib/python3/dist-packages/distributed/utils.py:1960: 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s /usr/lib/python3/dist-packages/distributed/worker.py:1480: in start_unsafe 4768s await self._register_with_scheduler() 4768s /usr/lib/python3/dist-packages/distributed/worker.py:1179: in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s /usr/lib/python3/dist-packages/distributed/comm/core.py:342: in connect 4768s comm = await wait_for( 4768s /usr/lib/python3/dist-packages/distributed/utils.py:1960: in wait_for 4768s return await fut 4768s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:546: in connect 4768s stream = await self.client.connect( 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s 4768s self = , host = '127.0.0.1' 4768s port = 35239, af = 4768s ssl_options = 4768s max_buffer_size = 8364507136.0, source_ip = None, source_port = None 4768s timeout = None 4768s 4768s async def connect( 4768s self, 4768s host: str, 4768s port: int, 4768s af: socket.AddressFamily = socket.AF_UNSPEC, 4768s ssl_options: Optional[Union[Dict[str, Any], ssl.SSLContext]] = None, 4768s max_buffer_size: Optional[int] = None, 4768s source_ip: Optional[str] = None, 4768s source_port: Optional[int] = None, 4768s timeout: Optional[Union[float, datetime.timedelta]] = None, 4768s ) -> IOStream: 4768s """Connect to the given host and port. 4768s 4768s Asynchronously returns an `.IOStream` (or `.SSLIOStream` if 4768s ``ssl_options`` is not None). 4768s 4768s Using the ``source_ip`` kwarg, one can specify the source 4768s IP address to use when establishing the connection. 4768s In case the user needs to resolve and 4768s use a specific interface, it has to be handled outside 4768s of Tornado as this depends very much on the platform. 4768s 4768s Raises `TimeoutError` if the input future does not complete before 4768s ``timeout``, which may be specified in any form allowed by 4768s `.IOLoop.add_timeout` (i.e. a `datetime.timedelta` or an absolute time 4768s relative to `.IOLoop.time`) 4768s 4768s Similarly, when the user requires a certain source port, it can 4768s be specified using the ``source_port`` arg. 4768s 4768s .. versionchanged:: 4.5 4768s Added the ``source_ip`` and ``source_port`` arguments. 4768s 4768s .. versionchanged:: 5.0 4768s Added the ``timeout`` argument. 4768s """ 4768s if timeout is not None: 4768s if isinstance(timeout, numbers.Real): 4768s timeout = IOLoop.current().time() + timeout 4768s elif isinstance(timeout, datetime.timedelta): 4768s timeout = IOLoop.current().time() + timeout.total_seconds() 4768s else: 4768s raise TypeError("Unsupported timeout %r" % timeout) 4768s if timeout is not None: 4768s addrinfo = await gen.with_timeout( 4768s timeout, self.resolver.resolve(host, port, af) 4768s ) 4768s else: 4768s addrinfo = await self.resolver.resolve(host, port, af) 4768s connector = _Connector( 4768s addrinfo, 4768s functools.partial( 4768s self._create_stream, 4768s max_buffer_size, 4768s source_ip=source_ip, 4768s source_port=source_port, 4768s ), 4768s ) 4768s > af, addr, stream = await connector.start(connect_timeout=timeout) 4768s E asyncio.exceptions.CancelledError 4768s 4768s /usr/lib/python3/dist-packages/tornado/tcpclient.py:279: CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s self = 4768s 4768s @final 4768s async def start(self): 4768s async with self._startup_lock: 4768s if self.status == Status.failed: 4768s assert self.__startup_exc is not None 4768s raise self.__startup_exc 4768s elif self.status != Status.init: 4768s return self 4768s timeout = getattr(self, "death_timeout", None) 4768s 4768s async def _close_on_failure(exc: Exception) -> None: 4768s await self.close(reason=f"failure-to-start-{str(type(exc))}") 4768s self.status = Status.failed 4768s self.__startup_exc = exc 4768s 4768s try: 4768s > await wait_for(self.start_unsafe(), timeout=timeout) 4768s 4768s /usr/lib/python3/dist-packages/distributed/core.py:664: 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 4768s async with asyncio.timeout(timeout): 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s 4768s self = 4768s exc_type = 4768s exc_val = CancelledError(), exc_tb = 4768s 4768s async def __aexit__( 4768s self, 4768s exc_type: Optional[Type[BaseException]], 4768s exc_val: Optional[BaseException], 4768s exc_tb: Optional[TracebackType], 4768s ) -> Optional[bool]: 4768s assert self._state in (_State.ENTERED, _State.EXPIRING) 4768s 4768s if self._timeout_handler is not None: 4768s self._timeout_handler.cancel() 4768s self._timeout_handler = None 4768s 4768s if self._state is _State.EXPIRING: 4768s self._state = _State.EXPIRED 4768s 4768s if self._task.uncancel() <= self._cancelling and exc_type is not None: 4768s # Since there are no new cancel requests, we're 4768s # handling this. 4768s if issubclass(exc_type, exceptions.CancelledError): 4768s > raise TimeoutError from exc_val 4768s E TimeoutError 4768s 4768s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s @contextlib.asynccontextmanager 4768s async def _cluster_factory(): 4768s workers = [] 4768s s = None 4768s try: 4768s for _ in range(60): 4768s try: 4768s > s, ws = await start_cluster( 4768s nthreads, 4768s scheduler, 4768s security=security, 4768s Worker=Worker, 4768s scheduler_kwargs=scheduler_kwargs, 4768s worker_kwargs=merge( 4768s {"death_timeout": min(15, int(deadline.remaining))}, 4768s worker_kwargs, 4768s ), 4768s ) 4768s 4768s /usr/lib/python3/dist-packages/distributed/utils_test.py:966: 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s /usr/lib/python3/dist-packages/distributed/utils_test.py:789: in start_cluster 4768s await asyncio.gather(*workers) 4768s /usr/lib/python3.13/asyncio/tasks.py:737: in _wrap_awaitable 4768s return await awaitable 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s 4768s self = 4768s 4768s @final 4768s async def start(self): 4768s async with self._startup_lock: 4768s if self.status == Status.failed: 4768s assert self.__startup_exc is not None 4768s raise self.__startup_exc 4768s elif self.status != Status.init: 4768s return self 4768s timeout = getattr(self, "death_timeout", None) 4768s 4768s async def _close_on_failure(exc: Exception) -> None: 4768s await self.close(reason=f"failure-to-start-{str(type(exc))}") 4768s self.status = Status.failed 4768s self.__startup_exc = exc 4768s 4768s try: 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s except asyncio.TimeoutError as exc: 4768s await _close_on_failure(exc) 4768s > raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s E TimeoutError: Worker start timed out after 0s. 4768s 4768s /usr/lib/python3/dist-packages/distributed/core.py:667: TimeoutError 4768s 4768s During handling of the above exception, another exception occurred: 4768s 4768s fut = ._..test_func..async_fn at 0xe99addc0> 4768s timeout = 60 4768s 4768s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 4768s async with asyncio.timeout(timeout): 4768s > return await fut 4768s 4768s /usr/lib/python3/dist-packages/distributed/utils.py:1960: 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s /usr/lib/python3/dist-packages/distributed/utils_test.py:999: in async_fn 4768s _cluster_factory() as (s, workers), 4768s /usr/lib/python3.13/contextlib.py:214: in __aenter__ 4768s return await anext(self.gen) 4768s /usr/lib/python3/dist-packages/distributed/utils_test.py:983: in _cluster_factory 4768s await asyncio.sleep(1) 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s 4768s delay = 1, result = None 4768s 4768s async def sleep(delay, result=None): 4768s """Coroutine that completes after a given time (in seconds).""" 4768s if delay <= 0: 4768s await __sleep0() 4768s return result 4768s 4768s if math.isnan(delay): 4768s raise ValueError("Invalid delay: NaN (not a number)") 4768s 4768s loop = events.get_running_loop() 4768s future = loop.create_future() 4768s h = loop.call_later(delay, 4768s futures._set_result_unless_cancelled, 4768s future, result) 4768s try: 4768s > return await future 4768s E asyncio.exceptions.CancelledError 4768s 4768s /usr/lib/python3.13/asyncio/tasks.py:718: CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s args = (), kwds = {} 4768s 4768s @wraps(func) 4768s def inner(*args, **kwds): 4768s with self._recreate_cm(): 4768s > return func(*args, **kwds) 4768s 4768s /usr/lib/python3.13/contextlib.py:85: 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s /usr/lib/python3.13/contextlib.py:85: in inner 4768s return func(*args, **kwds) 4768s /usr/lib/python3/dist-packages/distributed/utils_test.py:1102: in test_func 4768s return _run_and_close_tornado(async_fn_outer) 4768s /usr/lib/python3/dist-packages/distributed/utils_test.py:378: in _run_and_close_tornado 4768s return asyncio_run(inner_fn(), loop_factory=get_loop_factory()) 4768s /usr/lib/python3.13/asyncio/runners.py:194: in run 4768s return runner.run(main) 4768s /usr/lib/python3.13/asyncio/runners.py:118: in run 4768s return self._loop.run_until_complete(task) 4768s /usr/lib/python3.13/asyncio/base_events.py:720: in run_until_complete 4768s return future.result() 4768s /usr/lib/python3/dist-packages/distributed/utils_test.py:375: in inner_fn 4768s return await async_fn(*args, **kwargs) 4768s /usr/lib/python3/dist-packages/distributed/utils_test.py:1099: in async_fn_outer 4768s return await utils_wait_for(async_fn(), timeout=timeout * 2) 4768s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 4768s async with asyncio.timeout(timeout): 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s 4768s self = 4768s exc_type = 4768s exc_val = CancelledError(), exc_tb = 4768s 4768s async def __aexit__( 4768s self, 4768s exc_type: Optional[Type[BaseException]], 4768s exc_val: Optional[BaseException], 4768s exc_tb: Optional[TracebackType], 4768s ) -> Optional[bool]: 4768s assert self._state in (_State.ENTERED, _State.EXPIRING) 4768s 4768s if self._timeout_handler is not None: 4768s self._timeout_handler.cancel() 4768s self._timeout_handler = None 4768s 4768s if self._state is _State.EXPIRING: 4768s self._state = _State.EXPIRED 4768s 4768s if self._task.uncancel() <= self._cancelling and exc_type is not None: 4768s # Since there are no new cancel requests, we're 4768s # handling this. 4768s if issubclass(exc_type, exceptions.CancelledError): 4768s > raise TimeoutError from exc_val 4768s E TimeoutError 4768s 4768s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 4768s ----------------------------- Captured stderr call ----------------------------- 4768s 2024-11-23 21:44:22,726 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:44:22,734 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:22,735 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45215/status 4768s 2024-11-23 21:44:22,735 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:44:22,751 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45093 4768s 2024-11-23 21:44:22,751 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45093 4768s 2024-11-23 21:44:22,751 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:44:22,751 - distributed.worker - INFO - dashboard at: 127.0.0.1:33771 4768s 2024-11-23 21:44:22,751 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:22,751 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:44:22,751 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:44:22,751 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:44:22,751 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-lpa2e9sa 4768s 2024-11-23 21:44:22,751 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:44:22,753 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38849 4768s 2024-11-23 21:44:22,754 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38849 4768s 2024-11-23 21:44:22,754 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:44:22,754 - distributed.worker - INFO - dashboard at: 127.0.0.1:33813 4768s 2024-11-23 21:44:22,754 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:22,754 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:44:22,754 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:44:22,754 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:44:22,754 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-f1ll0u_f 4768s 2024-11-23 21:44:22,754 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:44:22,767 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:22,767 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:22,768 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:44840': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:22,768 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:44844': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:22,881 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:22,881 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:22,882 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:44852': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:22,882 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:44862': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:22,995 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:22,995 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:22,995 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:44872': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:22,996 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:44876': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:23,110 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:23,111 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:23,111 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:44882': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:23,111 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:44894': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:23,223 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:23,224 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:23,224 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:44908': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:23,224 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:44924': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:23,350 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:23,350 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:23,354 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:44936': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:23,354 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:44938': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:23,464 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:23,465 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:23,465 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:44942': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:23,465 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:44958': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:23,578 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:23,578 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:23,579 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:44964': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:23,579 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:44980': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:23,692 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:23,692 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:23,693 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:44986': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:23,693 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:45000': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:23,807 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:23,807 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:23,808 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:45004': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:23,808 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:45008': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:23,921 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:23,921 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:23,921 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:45024': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:23,921 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:45036': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:24,033 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:24,034 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:24,034 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:45048': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:24,034 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:45054': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:24,147 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:24,147 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:24,148 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:45056': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:24,148 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:45068': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:24,260 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:24,260 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:24,261 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:45082': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:24,261 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:45098': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:24,372 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:24,373 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:24,373 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:45102': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:24,373 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:45104': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:24,486 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:24,486 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:24,487 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:45118': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:24,487 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:45132': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:24,600 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:24,600 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:24,600 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:45148': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:24,600 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:45162': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:24,712 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:24,712 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:24,713 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:45174': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:24,713 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:45178': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:24,827 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:24,827 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:24,827 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:45194': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:24,827 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:45204': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:24,940 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:24,940 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:24,941 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:45218': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:24,941 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:45234': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:25,052 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:25,053 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:25,053 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:45236': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:25,053 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:45252': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:25,167 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:25,167 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:25,167 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:45262': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:25,167 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:45278': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:25,280 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:25,280 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:25,280 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:45292': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:25,280 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:45302': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:25,392 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:25,393 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:25,393 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:45308': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:25,393 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:45324': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:25,505 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:25,506 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:25,506 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:45330': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:25,506 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:45342': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:25,618 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:25,618 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:25,619 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:45356': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:25,619 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:45358': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:25,731 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:25,731 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:25,731 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:45366': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:25,731 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:45372': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:25,844 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:25,844 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:25,845 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:45382': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:25,845 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:45390': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:25,957 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:25,957 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:25,957 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:45400': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:25,958 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:45410': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:26,070 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:26,070 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:26,071 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:45412': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:26,071 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:45424': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:26,185 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:26,185 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:26,185 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:45440': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:26,185 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:45442': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:26,300 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:26,300 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:26,300 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:45458': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:26,300 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:45472': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:26,414 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:26,414 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:26,415 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:45480': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:26,415 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:45488': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:26,528 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:26,528 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:26,528 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:45502': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:26,528 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:45512': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:26,643 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:26,643 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:26,643 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:45528': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:26,643 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:45530': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:26,755 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:26,756 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:26,756 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:45540': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:26,756 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:45542': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:26,869 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:26,869 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:26,869 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:45546': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:26,869 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:45548': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:26,982 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:26,982 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:26,983 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:45550': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:26,983 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:45552': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:27,095 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:27,096 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:27,096 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:45568': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:27,096 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:45584': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:27,209 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:27,209 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:27,209 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:45600': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:27,209 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:45614': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:27,322 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:27,323 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:27,323 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:45628': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:27,323 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:45630': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:27,437 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:27,437 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:27,437 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:45634': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:27,438 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:45644': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:27,550 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:27,550 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:27,551 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:45646': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:27,551 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:45650': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:27,663 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:27,663 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:27,664 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:45662': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:27,664 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:45668': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:27,777 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:27,777 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:27,777 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:45680': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:27,777 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:45684': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:27,890 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:27,890 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:27,890 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:45696': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:27,891 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:45712': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:28,003 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:28,004 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:28,004 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:45726': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:28,004 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:45728': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:28,117 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:28,117 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:28,118 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:45742': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:28,118 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:45750': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:28,231 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:28,231 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:28,232 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:45764': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:28,232 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:45770': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:28,344 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:28,345 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:28,345 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:45780': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:28,345 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:45790': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:28,460 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:28,461 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:28,461 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:45800': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:28,461 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:45810': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:28,573 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:28,574 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:28,574 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:45812': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:28,574 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:45824': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:28,687 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:28,687 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:28,687 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:45828': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:28,687 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:45840': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:28,801 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:28,801 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:28,802 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:45844': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:28,802 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:45846': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:28,915 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:28,915 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:28,916 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:45850': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:28,916 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:45852': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:29,029 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:29,029 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:29,030 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:45862': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:29,030 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:45870': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:29,143 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:29,143 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:29,143 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:45878': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:29,144 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:45890': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:29,256 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:29,256 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:29,257 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:45892': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:29,257 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:45904': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:29,370 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:29,371 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:29,371 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:45910': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:29,371 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:45916': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:29,484 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:29,484 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:29,484 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:45918': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:29,484 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:45934': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:29,598 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:29,598 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:29,598 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:45946': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:29,598 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:45948': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:29,712 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:29,712 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:29,712 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:45964': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:29,712 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:45976': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:29,826 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:29,826 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:29,826 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:45990': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:29,827 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:46006': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:29,939 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:29,940 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:29,940 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:46018': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:29,940 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:46028': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:30,054 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:30,054 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:30,055 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:46036': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:30,055 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:46044': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:30,168 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:30,169 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:30,169 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:46058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:30,169 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:46060': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:30,284 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:30,284 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:30,285 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:46062': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:30,285 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:46070': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:30,398 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:30,398 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:30,398 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:46072': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:30,398 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:46084': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:30,520 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:30,521 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:30,521 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:46092': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:30,521 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:46104': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:30,635 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:30,635 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:30,635 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:46110': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:30,636 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:46122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:30,758 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:30,759 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:30,759 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:46128': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:30,759 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:46134': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:30,872 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:30,872 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:30,872 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:46136': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:30,873 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:46150': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:30,986 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:30,987 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:30,987 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:46156': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:30,987 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:46168': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:31,100 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:31,101 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:31,101 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:46172': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:31,101 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:46180': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:31,215 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:31,215 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:31,216 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:46182': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:31,216 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:46188': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:31,330 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:31,330 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:31,330 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:46200': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:31,330 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:46210': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:31,443 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:31,443 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:31,444 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:46218': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:31,444 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:46228': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:31,557 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:31,557 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:31,557 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:49948': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:31,557 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:49956': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:31,670 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:31,671 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:31,671 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:49958': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:31,671 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:49974': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:31,784 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:31,785 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:31,785 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:49980': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:31,785 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:49988': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:31,899 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:31,899 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:31,899 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:49990': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:31,899 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:50002': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:32,012 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:32,012 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:32,013 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:50004': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:32,013 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:50006': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:32,127 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:32,127 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:32,128 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:50022': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:32,128 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:50034': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:32,242 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:32,242 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:32,246 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:50038': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:32,246 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:50046': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:32,355 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:32,356 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:32,356 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:50058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:32,356 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:50062': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:32,469 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:32,469 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:32,470 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:50076': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:32,470 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:50086': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:32,583 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:32,584 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:32,584 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:50088': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:32,584 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:50098': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:32,697 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:32,697 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:32,697 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:50102': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:32,697 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:50106': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:32,811 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:32,811 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:32,811 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:50110': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:32,811 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:50118': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:32,924 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:32,924 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:32,925 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:50128': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:32,925 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:50138': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:33,038 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:33,038 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:33,039 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:50152': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:33,039 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:50160': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:33,152 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:33,152 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:33,152 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:50176': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:33,152 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:50178': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:33,266 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:33,266 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:33,266 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:50180': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:33,266 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:50188': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:33,379 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:33,379 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:33,380 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:50192': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:33,380 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:50198': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:33,492 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:33,493 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:33,493 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:50212': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:33,493 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:50216': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:33,606 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:33,606 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:33,607 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:50218': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:33,607 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:50224': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:33,720 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:33,721 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:33,721 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:50232': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:33,721 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:50236': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:33,834 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:33,834 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:33,834 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:50246': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:33,835 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:50248': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:33,952 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:33,952 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:33,953 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:50250': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:33,953 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:50252': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:34,065 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:34,066 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:34,066 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:50262': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:34,066 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:50266': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:34,179 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:34,179 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:34,180 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:50282': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:34,180 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:50288': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:34,293 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:34,293 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:34,293 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:50298': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:34,293 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:50308': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:34,406 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:34,406 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:34,406 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:50320': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:34,406 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:50336': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:34,519 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:34,520 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:34,520 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:50352': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:34,520 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:50358': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:34,632 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:34,632 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:34,633 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:50368': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:34,633 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:50374': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:34,749 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:34,750 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:34,750 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:50388': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:34,750 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:50392': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:34,863 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:34,863 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:34,863 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:50408': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:34,863 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:50410': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:34,977 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:34,977 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:34,977 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:50424': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:34,978 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:50426': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:35,090 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:35,090 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:35,090 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:50438': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:35,090 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:50444': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:35,203 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:35,203 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:35,203 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:50460': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:35,204 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:50472': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:35,316 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:35,317 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:35,317 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:50476': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:35,317 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:50482': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:35,429 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:35,430 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:35,430 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:50484': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:35,430 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:50494': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:35,543 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:35,543 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:35,544 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:50506': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:35,544 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:50508': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:35,656 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:35,656 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:35,658 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:50520': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:35,658 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:50522': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:35,769 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:35,769 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:35,770 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:50536': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:35,770 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:50540': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:35,883 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:35,883 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:35,884 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:50550': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:35,884 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:50552': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:35,997 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:35,997 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:35,998 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:50568': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:35,998 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:50570': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:36,111 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:36,111 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:36,111 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:50576': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:36,111 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:50586': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:36,223 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:36,223 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:36,224 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:50596': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:36,224 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:50612': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:36,336 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:36,337 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:36,337 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:50616': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:36,337 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:50626': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:36,449 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:36,449 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:36,450 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:50630': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:36,450 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:50646': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:36,562 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:36,562 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:36,563 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:50662': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:36,563 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:50672': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:36,676 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:36,676 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:36,677 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:50682': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:36,677 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:50684': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:36,790 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:36,790 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:36,791 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:50690': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:36,791 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:50704': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:36,903 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:36,903 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:36,904 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:50708': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:36,904 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:50722': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:37,018 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:37,018 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:37,018 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:50734': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:37,018 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:50750': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:37,131 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:37,131 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:37,131 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:50752': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:37,131 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:50766': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:37,245 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:37,245 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:37,249 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:50770': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:37,249 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:50784': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:37,359 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:37,359 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:37,360 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:50786': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:37,360 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:50802': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:37,474 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:37,474 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:37,475 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:50806': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:37,475 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:50814': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:37,588 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:37,588 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:37,588 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:50816': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:37,588 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:50818': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:37,702 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:37,702 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 4768s 2024-11-23 21:44:37,702 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:50828': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:37,702 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:50842': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:37,750 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45093. Reason: failure-to-start- 4768s 2024-11-23 21:44:37,750 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:44:37,753 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38849. Reason: failure-to-start- 4768s 2024-11-23 21:44:37,753 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:44:37,754 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 15s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 4768s stream = await stream.start_tls( 4768s ^^^^^^^^^^^^^^^^^^^^^^^ 4768s False, ssl_options=ssl_options, server_hostname=host 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 4768s self.socket.do_handshake() 4768s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 4768s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 4768s self._sslobj.do_handshake() 4768s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 4768s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 4768s raise FatalCommClosedError( 4768s ...<2 lines>... 4768s ) from err 4768s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 4768s 4768s During handling of the above exception, another exception occurred: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1218, in _register_with_scheduler 4768s await asyncio.sleep(0.1) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 718, in sleep 4768s return await future 4768s ^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 15s. 4768s 2024-11-23 21:44:38,763 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:44:38,774 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:38,774 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36467/status 4768s 2024-11-23 21:44:38,774 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:44:38,813 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42101 4768s 2024-11-23 21:44:38,813 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42101 4768s 2024-11-23 21:44:38,813 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:44:38,813 - distributed.worker - INFO - dashboard at: 127.0.0.1:35877 4768s 2024-11-23 21:44:38,813 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:38,813 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:44:38,813 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:44:38,813 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:44:38,813 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-5js44ly5 4768s 2024-11-23 21:44:38,813 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:44:38,815 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37495 4768s 2024-11-23 21:44:38,815 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37495 4768s 2024-11-23 21:44:38,816 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:44:38,816 - distributed.worker - INFO - dashboard at: 127.0.0.1:39703 4768s 2024-11-23 21:44:38,816 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:38,816 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:44:38,816 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:44:38,816 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:44:38,816 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-n9te7s7e 4768s 2024-11-23 21:44:38,816 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:44:38,830 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:38,830 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:38,831 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:41332': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:38,831 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:41348': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:38,943 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:38,943 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:38,944 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:41354': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:38,944 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:41362': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:39,057 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:39,057 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:39,057 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:41372': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:39,058 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:41386': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:39,170 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:39,170 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:39,171 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:41388': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:39,171 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:41390': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:39,283 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:39,284 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:39,287 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:41404': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:39,287 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:41418': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:39,397 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:39,398 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:39,398 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:41426': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:39,398 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:41428': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:39,510 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:39,511 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:39,511 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:41434': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:39,511 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:41436': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:39,625 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:39,625 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:39,625 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:41438': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:39,626 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:41444': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:39,738 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:39,738 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:39,742 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:41448': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:39,742 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:41456': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:39,851 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:39,851 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:39,852 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:41466': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:39,852 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:41480': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:39,964 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:39,965 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:39,965 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:41490': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:39,965 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:41506': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:40,078 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:40,078 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:40,079 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:41510': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:40,079 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:41512': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:40,191 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:40,191 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:40,192 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:41518': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:40,192 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:41526': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:40,304 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:40,304 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:40,304 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:41530': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:40,304 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:41546': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:40,416 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:40,417 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:40,417 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:41558': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:40,417 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:41568': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:40,530 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:40,531 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:40,531 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:41584': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:40,531 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:41596': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:40,644 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:40,645 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:40,645 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:41600': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:40,645 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:41604': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:40,760 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:40,760 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:40,760 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:41606': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:40,760 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:41614': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:40,873 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:40,874 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:40,874 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:41624': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:40,874 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:41636': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:40,986 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:40,987 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:40,987 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:41648': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:40,987 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:41650': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:41,100 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:41,100 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:41,100 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:41666': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:41,101 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:41672': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:41,213 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:41,213 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:41,214 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:41678': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:41,214 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:41694': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:41,326 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:41,326 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:41,327 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:41700': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:41,327 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:41708': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:41,439 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:41,439 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:41,440 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:41718': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:41,440 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:41724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:41,552 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:41,553 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:41,553 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:36840': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:41,553 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:36852': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:41,665 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:41,665 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:41,666 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:36860': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:41,666 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:36866': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:41,780 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:41,780 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:41,784 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:36872': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:41,784 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:36878': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:41,893 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:41,893 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:41,893 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:36882': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:41,894 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:36888': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:42,006 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:42,006 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:42,007 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:36902': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:42,007 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:36914': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:42,119 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:42,119 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:42,120 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:36924': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:42,120 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:36928': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:42,232 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:42,232 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:42,233 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:36930': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:42,233 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:36942': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:42,346 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:42,346 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:42,346 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:36946': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:42,347 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:36954': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:42,460 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:42,460 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:42,460 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:36964': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:42,461 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:36974': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:42,575 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:42,575 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:42,576 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:36978': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:42,576 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:36990': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:42,688 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:42,688 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:42,688 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:37002': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:42,688 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:37004': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:42,801 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:42,801 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:42,801 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:37006': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:42,801 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:37008': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:42,915 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:42,915 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:42,915 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:37024': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:42,915 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:37034': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:43,028 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:43,028 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:43,029 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:37050': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:43,029 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:37064': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:43,141 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:43,142 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:43,142 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:37072': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:43,142 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:37082': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:43,258 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:43,258 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:43,259 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:37088': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:43,259 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:37102': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:43,375 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:43,375 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:43,376 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:37112': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:43,376 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:37118': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:43,491 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:43,491 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:43,492 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:37134': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:43,492 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:37140': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:43,607 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:43,607 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:43,608 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:37146': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:43,608 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:37156': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:43,723 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:43,723 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:43,724 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:37160': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:43,724 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:37170': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:43,839 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:43,840 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:43,841 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:37180': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:43,841 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:37192': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:43,955 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:43,956 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:43,957 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:37198': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:43,957 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:37210': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:44,072 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:44,072 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:44,073 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:37218': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:44,073 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:37224': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:44,189 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:44,189 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:44,190 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:37234': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:44,190 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:37236': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:44,307 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:44,308 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:44,308 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:37250': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:44,310 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:37252': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:44,423 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:44,424 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:44,424 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:37260': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:44,425 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:37272': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:44,540 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:44,541 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:44,541 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:37274': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:44,542 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:37280': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:44,657 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:44,657 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:44,658 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:37282': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:44,658 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:37286': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:44,773 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:44,773 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:44,774 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:37300': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:44,774 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:37306': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:44,890 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:44,890 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:44,891 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:37312': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:44,891 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:37314': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:45,006 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:45,007 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:45,008 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:37318': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:45,008 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:37324': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:45,123 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:45,124 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:45,124 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:37326': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:45,125 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:37336': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:45,273 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:45,273 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:45,274 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:37346': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:45,274 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:37358': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:45,387 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:45,387 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:45,387 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:37370': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:45,388 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:37378': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:45,500 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:45,500 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:45,500 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:37386': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:45,500 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:37392': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:45,613 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:45,614 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:45,614 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:37408': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:45,614 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:37414': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:45,727 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:45,727 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:45,727 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:37430': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:45,727 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:37444': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:45,840 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:45,841 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:45,841 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:37446': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:45,841 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:37448': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:45,954 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:45,954 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:45,954 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:37452': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:45,955 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:37462': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:46,068 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:46,069 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:46,069 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:37472': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:46,069 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:37482': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:46,184 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:46,184 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:46,185 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:37486': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:46,185 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:37496': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:46,296 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:46,297 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:46,297 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:37508': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:46,297 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:37520': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:46,410 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:46,410 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:46,410 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:37532': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:46,410 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:37536': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:46,523 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:46,523 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:46,523 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:37544': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:46,523 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:37550': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:46,636 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:46,636 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:46,637 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:37566': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:46,637 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:37568': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:46,751 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:46,752 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:46,752 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:37576': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:46,752 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:37580': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:46,859 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:46,864 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:37588': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:46,865 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:46,866 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:37596': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:46,968 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:46,969 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:37600': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:46,974 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:46,975 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:37602': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:47,075 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:47,076 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:37606': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:47,082 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:47,082 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:37614': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:47,183 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:47,183 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:37618': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:47,190 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:47,190 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:37632': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:47,291 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:47,292 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:37648': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:47,298 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:47,298 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:37652': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:47,399 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:47,399 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:37656': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:47,406 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:47,406 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:37670': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:47,508 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:47,508 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:37686': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:47,514 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:47,514 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:37698': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:47,616 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:47,616 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:37708': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:47,622 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:47,623 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:37710': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:47,723 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:47,724 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:37722': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:47,730 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:47,730 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:37736': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:47,831 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:47,831 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:37746': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:47,837 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:47,839 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:37750': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:47,940 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:47,941 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:37762': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:47,947 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:47,947 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:37770': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:48,047 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:48,048 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:37782': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:48,054 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:48,054 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:37784': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:48,155 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:48,155 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:37800': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:48,161 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:48,162 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:37810': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:48,263 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:48,264 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:37814': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:48,269 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:48,270 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:37826': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:48,370 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:48,371 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:37832': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:48,377 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:48,378 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:37846': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:48,478 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:48,479 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:37848': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:48,485 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:48,486 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:37850': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:48,586 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:48,587 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:37860': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:48,593 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:48,593 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:37862': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:48,694 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:48,695 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:37872': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:48,701 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:48,701 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:37884': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:48,802 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:48,802 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:37890': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:48,808 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:48,809 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:37894': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:48,910 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:48,911 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:37900': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:48,916 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:48,917 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:37916': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:49,017 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:49,018 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:37918': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:49,024 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:49,024 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:37932': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:49,126 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:49,127 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:37942': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:49,133 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:49,133 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:37946': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:49,234 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:49,234 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:37950': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:49,244 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:49,244 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:37962': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:49,342 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:49,343 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:37968': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:49,351 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:49,352 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:37984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:49,450 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:49,450 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:37986': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:49,459 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:49,460 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:38002': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:49,560 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:49,561 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:38010': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:49,568 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:49,568 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:38014': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:49,669 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:49,670 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:38024': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:49,676 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:49,677 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:38034': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:49,777 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:49,781 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:38036': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:49,787 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:49,788 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:38040': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:49,885 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:49,885 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:38044': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:49,895 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:49,895 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:38052': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:49,992 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:49,993 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:38062': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:50,003 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:50,003 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:38074': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:50,100 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:50,100 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:38084': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:50,110 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:50,110 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:38088': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:50,207 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:50,208 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:38090': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:50,217 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:50,218 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:38094': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:50,315 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:50,316 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:38106': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:50,324 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:50,325 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:38116': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:50,423 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:50,423 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:38132': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:50,432 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:50,432 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:38142': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:50,530 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:50,530 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:38150': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:50,539 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:50,540 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:38158': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:50,638 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:50,639 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:38172': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:50,646 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:50,646 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:38178': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:50,745 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:50,746 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:38192': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:50,754 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:50,754 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:38208': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:50,853 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:50,853 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:38210': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:50,861 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:50,861 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:38216': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:50,960 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:50,961 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:38228': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:50,968 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:50,969 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:38244': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:51,069 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:51,069 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:38256': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:51,076 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:51,076 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:38266': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:51,176 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:51,177 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:38280': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:51,185 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:51,186 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:38292': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:51,285 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:51,285 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:38298': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:51,293 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:51,293 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:38300': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:51,394 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:51,394 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:38316': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:51,401 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:51,401 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:38320': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:51,502 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:51,502 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:38332': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:51,508 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:51,509 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:38344': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:51,610 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:51,611 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:41846': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:51,616 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:51,617 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:41854': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:51,717 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:51,718 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:41868': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:51,724 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43545 4768s 2024-11-23 21:44:51,725 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43545': TLS handshake failed with remote 'tls://127.0.0.1:41876': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:44:51,813 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42101. Reason: failure-to-start- 4768s 2024-11-23 21:44:51,813 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:44:51,814 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37495. Reason: failure-to-start- 4768s 2024-11-23 21:44:51,814 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:44:51,815 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 13s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 4768s stream = await stream.start_tls( 4768s ^^^^^^^^^^^^^^^^^^^^^^^ 4768s False, ssl_options=ssl_options, server_hostname=host 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 4768s self.socket.do_handshake() 4768s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 4768s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 4768s self._sslobj.do_handshake() 4768s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 4768s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 4768s raise FatalCommClosedError( 4768s ...<2 lines>... 4768s ) from err 4768s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 4768s 4768s During handling of the above exception, another exception occurred: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1218, in _register_with_scheduler 4768s await asyncio.sleep(0.1) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 718, in sleep 4768s return await future 4768s ^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 13s. 4768s 2024-11-23 21:44:52,824 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:44:52,833 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39855 4768s 2024-11-23 21:44:52,833 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45721/status 4768s 2024-11-23 21:44:52,833 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:44:52,850 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39783 4768s 2024-11-23 21:44:52,850 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39783 4768s 2024-11-23 21:44:52,850 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:44:52,850 - distributed.worker - INFO - dashboard at: 127.0.0.1:39213 4768s 2024-11-23 21:44:52,851 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39855 4768s 2024-11-23 21:44:52,851 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:44:52,851 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:44:52,851 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:44:52,851 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ergy_arn 4768s 2024-11-23 21:44:52,851 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:44:52,854 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36973 4768s 2024-11-23 21:44:52,854 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36973 4768s 2024-11-23 21:44:52,854 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:44:52,854 - distributed.worker - INFO - dashboard at: 127.0.0.1:37029 4768s 2024-11-23 21:44:52,854 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39855 4768s 2024-11-23 21:44:52,854 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:44:52,854 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:44:52,854 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:44:52,854 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-mrll2nf_ 4768s 2024-11-23 21:44:52,855 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:44:52,856 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39783. Reason: failure-to-start- 4768s 2024-11-23 21:44:52,856 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:44:52,856 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36973. Reason: failure-to-start- 4768s 2024-11-23 21:44:52,856 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:44:52,859 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39855': TLS handshake failed with remote 'tls://127.0.0.1:45464': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:44:52,859 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39855': TLS handshake failed with remote 'tls://127.0.0.1:45478': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:44:52,860 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:44:53,868 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:44:53,875 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45313 4768s 2024-11-23 21:44:53,876 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36361/status 4768s 2024-11-23 21:44:53,876 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:44:53,891 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38211 4768s 2024-11-23 21:44:53,891 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38211 4768s 2024-11-23 21:44:53,891 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:44:53,891 - distributed.worker - INFO - dashboard at: 127.0.0.1:39397 4768s 2024-11-23 21:44:53,891 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45313 4768s 2024-11-23 21:44:53,891 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:44:53,891 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:44:53,891 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:44:53,891 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-i_2vcv_f 4768s 2024-11-23 21:44:53,891 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:44:53,894 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33299 4768s 2024-11-23 21:44:53,894 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33299 4768s 2024-11-23 21:44:53,894 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:44:53,894 - distributed.worker - INFO - dashboard at: 127.0.0.1:42029 4768s 2024-11-23 21:44:53,894 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45313 4768s 2024-11-23 21:44:53,894 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:44:53,894 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:44:53,894 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:44:53,894 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-l14bt4es 4768s 2024-11-23 21:44:53,894 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:44:53,895 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38211. Reason: failure-to-start- 4768s 2024-11-23 21:44:53,895 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:44:53,896 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33299. Reason: failure-to-start- 4768s 2024-11-23 21:44:53,896 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:44:53,897 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45313': TLS handshake failed with remote 'tls://127.0.0.1:34358': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:44:53,897 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45313': TLS handshake failed with remote 'tls://127.0.0.1:34368': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:44:53,899 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:44:54,904 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:44:54,917 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36591 4768s 2024-11-23 21:44:54,917 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40535/status 4768s 2024-11-23 21:44:54,918 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:44:54,933 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35133 4768s 2024-11-23 21:44:54,933 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35133 4768s 2024-11-23 21:44:54,933 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:44:54,933 - distributed.worker - INFO - dashboard at: 127.0.0.1:33387 4768s 2024-11-23 21:44:54,933 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36591 4768s 2024-11-23 21:44:54,933 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:44:54,933 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:44:54,933 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:44:54,933 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-wj1x5fp1 4768s 2024-11-23 21:44:54,933 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:44:54,935 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44835 4768s 2024-11-23 21:44:54,935 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44835 4768s 2024-11-23 21:44:54,936 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:44:54,936 - distributed.worker - INFO - dashboard at: 127.0.0.1:38425 4768s 2024-11-23 21:44:54,936 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36591 4768s 2024-11-23 21:44:54,936 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:44:54,936 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:44:54,936 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:44:54,936 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-5v9_tc1x 4768s 2024-11-23 21:44:54,936 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:44:54,949 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35133. Reason: failure-to-start- 4768s 2024-11-23 21:44:54,949 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:44:54,951 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44835. Reason: failure-to-start- 4768s 2024-11-23 21:44:54,951 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:44:54,953 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36591': TLS handshake failed with remote 'tls://127.0.0.1:39216': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:44:54,953 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36591': TLS handshake failed with remote 'tls://127.0.0.1:39218': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:44:54,956 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:44:55,966 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:44:55,975 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34639 4768s 2024-11-23 21:44:55,976 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40041/status 4768s 2024-11-23 21:44:55,976 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:44:55,995 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42617 4768s 2024-11-23 21:44:55,995 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42617 4768s 2024-11-23 21:44:55,995 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:44:55,995 - distributed.worker - INFO - dashboard at: 127.0.0.1:34043 4768s 2024-11-23 21:44:55,995 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34639 4768s 2024-11-23 21:44:55,995 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:44:55,995 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:44:55,995 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:44:55,995 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-pbqcpwg2 4768s 2024-11-23 21:44:55,995 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:44:55,997 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33717 4768s 2024-11-23 21:44:55,998 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33717 4768s 2024-11-23 21:44:55,998 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:44:55,998 - distributed.worker - INFO - dashboard at: 127.0.0.1:45931 4768s 2024-11-23 21:44:55,998 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34639 4768s 2024-11-23 21:44:55,998 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:44:55,998 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:44:55,998 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:44:55,998 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-vtt74c4h 4768s 2024-11-23 21:44:55,998 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:44:55,999 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42617. Reason: failure-to-start- 4768s 2024-11-23 21:44:55,999 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:44:56,000 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33717. Reason: failure-to-start- 4768s 2024-11-23 21:44:56,000 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:44:56,001 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34639': TLS handshake failed with remote 'tls://127.0.0.1:50862': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:44:56,001 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34639': TLS handshake failed with remote 'tls://127.0.0.1:50878': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:44:56,003 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:44:57,012 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:44:57,022 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:32921 4768s 2024-11-23 21:44:57,023 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41671/status 4768s 2024-11-23 21:44:57,023 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:44:57,040 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37339 4768s 2024-11-23 21:44:57,040 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37339 4768s 2024-11-23 21:44:57,040 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:44:57,040 - distributed.worker - INFO - dashboard at: 127.0.0.1:43565 4768s 2024-11-23 21:44:57,041 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:32921 4768s 2024-11-23 21:44:57,041 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:44:57,041 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:44:57,041 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:44:57,041 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-2rylecdk 4768s 2024-11-23 21:44:57,041 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:44:57,043 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34409 4768s 2024-11-23 21:44:57,043 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34409 4768s 2024-11-23 21:44:57,043 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:44:57,044 - distributed.worker - INFO - dashboard at: 127.0.0.1:38553 4768s 2024-11-23 21:44:57,044 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:32921 4768s 2024-11-23 21:44:57,044 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:44:57,044 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:44:57,044 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:44:57,044 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-_fzbcuv0 4768s 2024-11-23 21:44:57,044 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:44:57,045 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37339. Reason: failure-to-start- 4768s 2024-11-23 21:44:57,045 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:44:57,047 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34409. Reason: failure-to-start- 4768s 2024-11-23 21:44:57,047 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:44:57,049 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:32921': TLS handshake failed with remote 'tls://127.0.0.1:47990': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:44:57,049 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:32921': TLS handshake failed with remote 'tls://127.0.0.1:48006': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:44:57,050 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:44:58,058 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:44:58,067 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34843 4768s 2024-11-23 21:44:58,067 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43321/status 4768s 2024-11-23 21:44:58,068 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:44:58,085 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44109 4768s 2024-11-23 21:44:58,085 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44109 4768s 2024-11-23 21:44:58,085 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:44:58,085 - distributed.worker - INFO - dashboard at: 127.0.0.1:44341 4768s 2024-11-23 21:44:58,085 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34843 4768s 2024-11-23 21:44:58,085 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:44:58,085 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:44:58,085 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:44:58,085 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-2b7aopx2 4768s 2024-11-23 21:44:58,086 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:44:58,089 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40847 4768s 2024-11-23 21:44:58,089 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40847 4768s 2024-11-23 21:44:58,089 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:44:58,089 - distributed.worker - INFO - dashboard at: 127.0.0.1:38695 4768s 2024-11-23 21:44:58,089 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34843 4768s 2024-11-23 21:44:58,089 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:44:58,089 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:44:58,089 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:44:58,089 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-yh52hk2e 4768s 2024-11-23 21:44:58,089 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:44:58,091 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44109. Reason: failure-to-start- 4768s 2024-11-23 21:44:58,091 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:44:58,091 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40847. Reason: failure-to-start- 4768s 2024-11-23 21:44:58,091 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:44:58,093 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34843': TLS handshake failed with remote 'tls://127.0.0.1:36488': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:44:58,093 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34843': TLS handshake failed with remote 'tls://127.0.0.1:36496': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:44:58,095 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:44:59,102 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:44:59,114 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40249 4768s 2024-11-23 21:44:59,114 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38365/status 4768s 2024-11-23 21:44:59,114 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:44:59,132 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35991 4768s 2024-11-23 21:44:59,132 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35991 4768s 2024-11-23 21:44:59,132 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:44:59,132 - distributed.worker - INFO - dashboard at: 127.0.0.1:40413 4768s 2024-11-23 21:44:59,132 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40249 4768s 2024-11-23 21:44:59,132 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:44:59,133 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:44:59,133 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:44:59,133 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-o16_kz9x 4768s 2024-11-23 21:44:59,133 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:44:59,135 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36007 4768s 2024-11-23 21:44:59,135 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36007 4768s 2024-11-23 21:44:59,136 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:44:59,136 - distributed.worker - INFO - dashboard at: 127.0.0.1:40667 4768s 2024-11-23 21:44:59,136 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40249 4768s 2024-11-23 21:44:59,136 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:44:59,136 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:44:59,136 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:44:59,136 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-u1ywel30 4768s 2024-11-23 21:44:59,136 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:44:59,137 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35991. Reason: failure-to-start- 4768s 2024-11-23 21:44:59,137 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:44:59,138 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36007. Reason: failure-to-start- 4768s 2024-11-23 21:44:59,138 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:44:59,140 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40249': TLS handshake failed with remote 'tls://127.0.0.1:34356': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:44:59,140 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40249': TLS handshake failed with remote 'tls://127.0.0.1:34372': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:44:59,142 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:45:00,148 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:45:00,157 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45845 4768s 2024-11-23 21:45:00,157 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42275/status 4768s 2024-11-23 21:45:00,158 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:45:00,174 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41845 4768s 2024-11-23 21:45:00,174 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41845 4768s 2024-11-23 21:45:00,174 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:45:00,174 - distributed.worker - INFO - dashboard at: 127.0.0.1:35591 4768s 2024-11-23 21:45:00,174 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45845 4768s 2024-11-23 21:45:00,174 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:45:00,175 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:45:00,175 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:45:00,175 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-oi56lpkg 4768s 2024-11-23 21:45:00,175 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:45:00,177 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37347 4768s 2024-11-23 21:45:00,177 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37347 4768s 2024-11-23 21:45:00,177 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:45:00,177 - distributed.worker - INFO - dashboard at: 127.0.0.1:36315 4768s 2024-11-23 21:45:00,177 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45845 4768s 2024-11-23 21:45:00,177 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:45:00,177 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:45:00,177 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:45:00,177 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-aze4pjxa 4768s 2024-11-23 21:45:00,177 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:45:00,178 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41845. Reason: failure-to-start- 4768s 2024-11-23 21:45:00,179 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:45:00,179 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37347. Reason: failure-to-start- 4768s 2024-11-23 21:45:00,179 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:45:00,181 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45845': TLS handshake failed with remote 'tls://127.0.0.1:37052': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:45:00,181 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45845': TLS handshake failed with remote 'tls://127.0.0.1:37054': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:45:00,182 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:45:01,188 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:45:01,196 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36735 4768s 2024-11-23 21:45:01,196 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41343/status 4768s 2024-11-23 21:45:01,196 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:45:01,212 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39511 4768s 2024-11-23 21:45:01,212 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39511 4768s 2024-11-23 21:45:01,212 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:45:01,212 - distributed.worker - INFO - dashboard at: 127.0.0.1:42053 4768s 2024-11-23 21:45:01,213 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36735 4768s 2024-11-23 21:45:01,213 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:45:01,213 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:45:01,213 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:45:01,213 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-meqovuyb 4768s 2024-11-23 21:45:01,213 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:45:01,215 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38679 4768s 2024-11-23 21:45:01,215 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38679 4768s 2024-11-23 21:45:01,215 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:45:01,215 - distributed.worker - INFO - dashboard at: 127.0.0.1:40771 4768s 2024-11-23 21:45:01,216 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36735 4768s 2024-11-23 21:45:01,216 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:45:01,216 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:45:01,216 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:45:01,216 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-zw6wl0xz 4768s 2024-11-23 21:45:01,216 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:45:01,218 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39511. Reason: failure-to-start- 4768s 2024-11-23 21:45:01,218 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:45:01,218 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38679. Reason: failure-to-start- 4768s 2024-11-23 21:45:01,218 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:45:01,220 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36735': TLS handshake failed with remote 'tls://127.0.0.1:59766': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:45:01,220 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36735': TLS handshake failed with remote 'tls://127.0.0.1:59776': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:45:01,222 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:45:02,227 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:45:02,236 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43231 4768s 2024-11-23 21:45:02,236 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44187/status 4768s 2024-11-23 21:45:02,236 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:45:02,254 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37207 4768s 2024-11-23 21:45:02,255 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37207 4768s 2024-11-23 21:45:02,255 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:45:02,255 - distributed.worker - INFO - dashboard at: 127.0.0.1:38083 4768s 2024-11-23 21:45:02,255 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43231 4768s 2024-11-23 21:45:02,255 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:45:02,255 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:45:02,255 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:45:02,255 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-59xbcleg 4768s 2024-11-23 21:45:02,255 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:45:02,257 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42997 4768s 2024-11-23 21:45:02,257 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42997 4768s 2024-11-23 21:45:02,257 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:45:02,257 - distributed.worker - INFO - dashboard at: 127.0.0.1:38177 4768s 2024-11-23 21:45:02,257 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43231 4768s 2024-11-23 21:45:02,257 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:45:02,257 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:45:02,257 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:45:02,258 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ur9wncec 4768s 2024-11-23 21:45:02,258 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:45:02,259 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37207. Reason: failure-to-start- 4768s 2024-11-23 21:45:02,259 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:45:02,259 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42997. Reason: failure-to-start- 4768s 2024-11-23 21:45:02,259 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:45:02,261 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43231': TLS handshake failed with remote 'tls://127.0.0.1:36810': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:45:02,261 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43231': TLS handshake failed with remote 'tls://127.0.0.1:36822': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:45:02,262 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:45:03,268 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:45:03,277 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39185 4768s 2024-11-23 21:45:03,278 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33199/status 4768s 2024-11-23 21:45:03,278 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:45:03,295 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38001 4768s 2024-11-23 21:45:03,296 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38001 4768s 2024-11-23 21:45:03,296 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:45:03,296 - distributed.worker - INFO - dashboard at: 127.0.0.1:33355 4768s 2024-11-23 21:45:03,296 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39185 4768s 2024-11-23 21:45:03,296 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:45:03,296 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:45:03,296 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:45:03,296 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-nffbmhb8 4768s 2024-11-23 21:45:03,296 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:45:03,298 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43203 4768s 2024-11-23 21:45:03,298 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43203 4768s 2024-11-23 21:45:03,298 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:45:03,298 - distributed.worker - INFO - dashboard at: 127.0.0.1:45097 4768s 2024-11-23 21:45:03,298 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39185 4768s 2024-11-23 21:45:03,298 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:45:03,299 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:45:03,299 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:45:03,299 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-341n9_qr 4768s 2024-11-23 21:45:03,299 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:45:03,313 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38001. Reason: failure-to-start- 4768s 2024-11-23 21:45:03,313 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:45:03,317 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43203. Reason: failure-to-start- 4768s 2024-11-23 21:45:03,317 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:45:03,321 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39185': TLS handshake failed with remote 'tls://127.0.0.1:56324': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:45:03,321 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39185': TLS handshake failed with remote 'tls://127.0.0.1:56334': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:45:03,324 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:45:04,335 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:45:04,347 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41877 4768s 2024-11-23 21:45:04,347 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44641/status 4768s 2024-11-23 21:45:04,348 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:45:04,371 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38383 4768s 2024-11-23 21:45:04,371 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38383 4768s 2024-11-23 21:45:04,371 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:45:04,372 - distributed.worker - INFO - dashboard at: 127.0.0.1:38179 4768s 2024-11-23 21:45:04,372 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41877 4768s 2024-11-23 21:45:04,372 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:45:04,372 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:45:04,372 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:45:04,372 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-wa69t9v6 4768s 2024-11-23 21:45:04,372 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:45:04,374 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38667 4768s 2024-11-23 21:45:04,374 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38667 4768s 2024-11-23 21:45:04,374 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:45:04,374 - distributed.worker - INFO - dashboard at: 127.0.0.1:41547 4768s 2024-11-23 21:45:04,374 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41877 4768s 2024-11-23 21:45:04,374 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:45:04,375 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:45:04,375 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:45:04,375 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-zudwoztp 4768s 2024-11-23 21:45:04,375 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:45:04,376 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38383. Reason: failure-to-start- 4768s 2024-11-23 21:45:04,376 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:45:04,377 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38667. Reason: failure-to-start- 4768s 2024-11-23 21:45:04,377 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:45:04,378 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41877': TLS handshake failed with remote 'tls://127.0.0.1:50126': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:45:04,378 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41877': TLS handshake failed with remote 'tls://127.0.0.1:50134': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:45:04,383 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:45:05,392 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:45:05,401 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40567 4768s 2024-11-23 21:45:05,401 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38959/status 4768s 2024-11-23 21:45:05,402 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:45:05,417 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36759 4768s 2024-11-23 21:45:05,417 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36759 4768s 2024-11-23 21:45:05,417 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:45:05,417 - distributed.worker - INFO - dashboard at: 127.0.0.1:46281 4768s 2024-11-23 21:45:05,417 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40567 4768s 2024-11-23 21:45:05,417 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:45:05,417 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:45:05,418 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:45:05,418 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-xeb9hl0h 4768s 2024-11-23 21:45:05,418 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:45:05,420 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42379 4768s 2024-11-23 21:45:05,420 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42379 4768s 2024-11-23 21:45:05,420 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:45:05,420 - distributed.worker - INFO - dashboard at: 127.0.0.1:39549 4768s 2024-11-23 21:45:05,420 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40567 4768s 2024-11-23 21:45:05,420 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:45:05,420 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:45:05,420 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:45:05,421 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-qzan4xaq 4768s 2024-11-23 21:45:05,421 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:45:05,423 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36759. Reason: failure-to-start- 4768s 2024-11-23 21:45:05,423 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:45:05,424 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42379. Reason: failure-to-start- 4768s 2024-11-23 21:45:05,424 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:45:05,427 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40567': TLS handshake failed with remote 'tls://127.0.0.1:37308': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:45:05,427 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40567': TLS handshake failed with remote 'tls://127.0.0.1:37310': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:45:05,429 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:45:06,435 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:45:06,442 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39925 4768s 2024-11-23 21:45:06,443 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44045/status 4768s 2024-11-23 21:45:06,443 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:45:06,460 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33583 4768s 2024-11-23 21:45:06,460 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33583 4768s 2024-11-23 21:45:06,460 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:45:06,460 - distributed.worker - INFO - dashboard at: 127.0.0.1:43281 4768s 2024-11-23 21:45:06,460 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39925 4768s 2024-11-23 21:45:06,460 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:45:06,460 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:45:06,460 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:45:06,460 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-p6qv2zik 4768s 2024-11-23 21:45:06,460 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:45:06,463 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36655 4768s 2024-11-23 21:45:06,463 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36655 4768s 2024-11-23 21:45:06,463 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:45:06,464 - distributed.worker - INFO - dashboard at: 127.0.0.1:34631 4768s 2024-11-23 21:45:06,464 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39925 4768s 2024-11-23 21:45:06,464 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:45:06,464 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:45:06,464 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:45:06,464 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-2bccf15l 4768s 2024-11-23 21:45:06,464 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:45:06,465 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33583. Reason: failure-to-start- 4768s 2024-11-23 21:45:06,465 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:45:06,466 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36655. Reason: failure-to-start- 4768s 2024-11-23 21:45:06,466 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:45:06,467 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39925': TLS handshake failed with remote 'tls://127.0.0.1:60948': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:45:06,468 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39925': TLS handshake failed with remote 'tls://127.0.0.1:60956': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:45:06,470 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:45:07,477 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:45:07,487 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38357 4768s 2024-11-23 21:45:07,487 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44629/status 4768s 2024-11-23 21:45:07,487 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:45:07,506 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:32887 4768s 2024-11-23 21:45:07,506 - distributed.worker - INFO - Listening to: tls://127.0.0.1:32887 4768s 2024-11-23 21:45:07,506 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:45:07,506 - distributed.worker - INFO - dashboard at: 127.0.0.1:43403 4768s 2024-11-23 21:45:07,506 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38357 4768s 2024-11-23 21:45:07,507 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:45:07,507 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:45:07,507 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:45:07,507 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-i5b1nphx 4768s 2024-11-23 21:45:07,507 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:45:07,509 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37207 4768s 2024-11-23 21:45:07,509 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37207 4768s 2024-11-23 21:45:07,509 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:45:07,509 - distributed.worker - INFO - dashboard at: 127.0.0.1:41505 4768s 2024-11-23 21:45:07,509 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38357 4768s 2024-11-23 21:45:07,509 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:45:07,510 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:45:07,510 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:45:07,510 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-3v49ia3k 4768s 2024-11-23 21:45:07,510 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:45:07,511 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:32887. Reason: failure-to-start- 4768s 2024-11-23 21:45:07,511 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:45:07,512 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37207. Reason: failure-to-start- 4768s 2024-11-23 21:45:07,512 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:45:07,513 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38357': TLS handshake failed with remote 'tls://127.0.0.1:51352': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:45:07,513 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38357': TLS handshake failed with remote 'tls://127.0.0.1:51354': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:45:07,515 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:45:08,521 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:45:08,529 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39639 4768s 2024-11-23 21:45:08,529 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41735/status 4768s 2024-11-23 21:45:08,530 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:45:08,551 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38145 4768s 2024-11-23 21:45:08,551 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38145 4768s 2024-11-23 21:45:08,551 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:45:08,551 - distributed.worker - INFO - dashboard at: 127.0.0.1:34417 4768s 2024-11-23 21:45:08,551 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39639 4768s 2024-11-23 21:45:08,551 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:45:08,551 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:45:08,551 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:45:08,551 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-kxb9xadr 4768s 2024-11-23 21:45:08,551 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:45:08,553 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40371 4768s 2024-11-23 21:45:08,554 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40371 4768s 2024-11-23 21:45:08,554 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:45:08,554 - distributed.worker - INFO - dashboard at: 127.0.0.1:44731 4768s 2024-11-23 21:45:08,554 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39639 4768s 2024-11-23 21:45:08,554 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:45:08,554 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:45:08,554 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:45:08,554 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-w6ovrvi3 4768s 2024-11-23 21:45:08,554 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:45:08,556 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38145. Reason: failure-to-start- 4768s 2024-11-23 21:45:08,556 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:45:08,557 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40371. Reason: failure-to-start- 4768s 2024-11-23 21:45:08,557 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:45:08,558 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39639': TLS handshake failed with remote 'tls://127.0.0.1:57210': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:45:08,558 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39639': TLS handshake failed with remote 'tls://127.0.0.1:57220': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:45:08,560 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:45:09,566 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:45:09,574 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39413 4768s 2024-11-23 21:45:09,574 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34047/status 4768s 2024-11-23 21:45:09,575 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:45:09,594 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41431 4768s 2024-11-23 21:45:09,594 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41431 4768s 2024-11-23 21:45:09,594 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:45:09,594 - distributed.worker - INFO - dashboard at: 127.0.0.1:42583 4768s 2024-11-23 21:45:09,595 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39413 4768s 2024-11-23 21:45:09,595 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:45:09,595 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:45:09,595 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:45:09,595 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-wl64govq 4768s 2024-11-23 21:45:09,595 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:45:09,622 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45587 4768s 2024-11-23 21:45:09,623 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45587 4768s 2024-11-23 21:45:09,623 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:45:09,623 - distributed.worker - INFO - dashboard at: 127.0.0.1:40993 4768s 2024-11-23 21:45:09,623 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39413 4768s 2024-11-23 21:45:09,623 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:45:09,623 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:45:09,623 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:45:09,624 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-cu_j2ck6 4768s 2024-11-23 21:45:09,624 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:45:09,626 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41431. Reason: failure-to-start- 4768s 2024-11-23 21:45:09,627 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:45:09,627 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45587. Reason: failure-to-start- 4768s 2024-11-23 21:45:09,627 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:45:09,634 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39413': TLS handshake failed with remote 'tls://127.0.0.1:48842': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:45:09,634 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39413': TLS handshake failed with remote 'tls://127.0.0.1:48850': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:45:09,636 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:45:10,643 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:45:10,653 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39943 4768s 2024-11-23 21:45:10,653 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41859/status 4768s 2024-11-23 21:45:10,654 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:45:10,670 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33267 4768s 2024-11-23 21:45:10,670 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33267 4768s 2024-11-23 21:45:10,670 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:45:10,670 - distributed.worker - INFO - dashboard at: 127.0.0.1:44863 4768s 2024-11-23 21:45:10,670 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39943 4768s 2024-11-23 21:45:10,670 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:45:10,670 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:45:10,671 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:45:10,671 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-74xwp7_d 4768s 2024-11-23 21:45:10,671 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:45:10,673 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36303 4768s 2024-11-23 21:45:10,673 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36303 4768s 2024-11-23 21:45:10,673 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:45:10,673 - distributed.worker - INFO - dashboard at: 127.0.0.1:45803 4768s 2024-11-23 21:45:10,673 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39943 4768s 2024-11-23 21:45:10,673 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:45:10,673 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:45:10,673 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:45:10,673 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-6beql4vv 4768s 2024-11-23 21:45:10,674 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:45:10,691 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33267. Reason: failure-to-start- 4768s 2024-11-23 21:45:10,691 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:45:10,692 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36303. Reason: failure-to-start- 4768s 2024-11-23 21:45:10,692 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:45:10,694 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39943': TLS handshake failed with remote 'tls://127.0.0.1:37998': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:45:10,694 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39943': TLS handshake failed with remote 'tls://127.0.0.1:38008': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:45:10,696 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:45:11,703 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:45:11,710 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37335 4768s 2024-11-23 21:45:11,710 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40895/status 4768s 2024-11-23 21:45:11,711 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:45:11,728 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37091 4768s 2024-11-23 21:45:11,728 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37091 4768s 2024-11-23 21:45:11,728 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:45:11,728 - distributed.worker - INFO - dashboard at: 127.0.0.1:43969 4768s 2024-11-23 21:45:11,728 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37335 4768s 2024-11-23 21:45:11,728 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:45:11,728 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:45:11,728 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:45:11,728 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-r_nj551n 4768s 2024-11-23 21:45:11,728 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:45:11,730 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38869 4768s 2024-11-23 21:45:11,730 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38869 4768s 2024-11-23 21:45:11,730 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:45:11,731 - distributed.worker - INFO - dashboard at: 127.0.0.1:36133 4768s 2024-11-23 21:45:11,731 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37335 4768s 2024-11-23 21:45:11,731 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:45:11,731 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:45:11,731 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:45:11,731 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-kabeqjbt 4768s 2024-11-23 21:45:11,731 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:45:11,732 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37091. Reason: failure-to-start- 4768s 2024-11-23 21:45:11,732 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:45:11,732 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38869. Reason: failure-to-start- 4768s 2024-11-23 21:45:11,733 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:45:11,734 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37335': TLS handshake failed with remote 'tls://127.0.0.1:44886': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:45:11,734 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37335': TLS handshake failed with remote 'tls://127.0.0.1:44894': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:45:11,736 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:45:12,741 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:45:12,748 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36011 4768s 2024-11-23 21:45:12,749 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36777/status 4768s 2024-11-23 21:45:12,749 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:45:12,770 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38521 4768s 2024-11-23 21:45:12,770 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38521 4768s 2024-11-23 21:45:12,770 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:45:12,770 - distributed.worker - INFO - dashboard at: 127.0.0.1:37297 4768s 2024-11-23 21:45:12,770 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36011 4768s 2024-11-23 21:45:12,770 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:45:12,770 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:45:12,770 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:45:12,770 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-0wna6l_j 4768s 2024-11-23 21:45:12,770 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:45:12,772 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39307 4768s 2024-11-23 21:45:12,772 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39307 4768s 2024-11-23 21:45:12,772 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:45:12,773 - distributed.worker - INFO - dashboard at: 127.0.0.1:34001 4768s 2024-11-23 21:45:12,773 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36011 4768s 2024-11-23 21:45:12,773 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:45:12,773 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:45:12,773 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:45:12,773 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-qn5fe1ty 4768s 2024-11-23 21:45:12,773 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:45:12,774 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38521. Reason: failure-to-start- 4768s 2024-11-23 21:45:12,774 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:45:12,774 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39307. Reason: failure-to-start- 4768s 2024-11-23 21:45:12,775 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:45:12,776 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36011': TLS handshake failed with remote 'tls://127.0.0.1:40008': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:45:12,776 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36011': TLS handshake failed with remote 'tls://127.0.0.1:40010': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:45:12,781 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:45:13,791 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:45:13,801 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44319 4768s 2024-11-23 21:45:13,802 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38335/status 4768s 2024-11-23 21:45:13,802 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:45:13,820 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42543 4768s 2024-11-23 21:45:13,820 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42543 4768s 2024-11-23 21:45:13,820 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:45:13,820 - distributed.worker - INFO - dashboard at: 127.0.0.1:42929 4768s 2024-11-23 21:45:13,820 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44319 4768s 2024-11-23 21:45:13,820 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:45:13,820 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:45:13,820 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:45:13,820 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-2lx809f3 4768s 2024-11-23 21:45:13,821 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:45:13,823 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45343 4768s 2024-11-23 21:45:13,823 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45343 4768s 2024-11-23 21:45:13,823 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:45:13,823 - distributed.worker - INFO - dashboard at: 127.0.0.1:33459 4768s 2024-11-23 21:45:13,823 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44319 4768s 2024-11-23 21:45:13,823 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:45:13,823 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:45:13,823 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:45:13,823 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-13y428wy 4768s 2024-11-23 21:45:13,823 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:45:13,825 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42543. Reason: failure-to-start- 4768s 2024-11-23 21:45:13,825 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:45:13,826 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45343. Reason: failure-to-start- 4768s 2024-11-23 21:45:13,826 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:45:13,828 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44319': TLS handshake failed with remote 'tls://127.0.0.1:52714': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:45:13,828 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44319': TLS handshake failed with remote 'tls://127.0.0.1:52718': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:45:13,830 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:45:14,859 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:45:14,872 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40857 4768s 2024-11-23 21:45:14,872 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46585/status 4768s 2024-11-23 21:45:14,873 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:45:14,896 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37215 4768s 2024-11-23 21:45:14,896 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37215 4768s 2024-11-23 21:45:14,896 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:45:14,896 - distributed.worker - INFO - dashboard at: 127.0.0.1:40817 4768s 2024-11-23 21:45:14,897 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40857 4768s 2024-11-23 21:45:14,897 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:45:14,897 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:45:14,897 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:45:14,897 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-t_s6h6yd 4768s 2024-11-23 21:45:14,897 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:45:14,899 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46163 4768s 2024-11-23 21:45:14,899 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46163 4768s 2024-11-23 21:45:14,899 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:45:14,899 - distributed.worker - INFO - dashboard at: 127.0.0.1:43661 4768s 2024-11-23 21:45:14,899 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40857 4768s 2024-11-23 21:45:14,899 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:45:14,899 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:45:14,900 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:45:14,900 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-zk2vakxt 4768s 2024-11-23 21:45:14,900 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:45:14,904 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37215. Reason: failure-to-start- 4768s 2024-11-23 21:45:14,904 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:45:14,905 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46163. Reason: failure-to-start- 4768s 2024-11-23 21:45:14,905 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:45:14,910 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40857': TLS handshake failed with remote 'tls://127.0.0.1:56576': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:45:14,910 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40857': TLS handshake failed with remote 'tls://127.0.0.1:56588': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:45:14,912 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:45:15,920 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:45:15,929 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42497 4768s 2024-11-23 21:45:15,929 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35739/status 4768s 2024-11-23 21:45:15,930 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:45:15,949 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38599 4768s 2024-11-23 21:45:15,949 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38599 4768s 2024-11-23 21:45:15,949 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:45:15,949 - distributed.worker - INFO - dashboard at: 127.0.0.1:34301 4768s 2024-11-23 21:45:15,949 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42497 4768s 2024-11-23 21:45:15,949 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:45:15,949 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:45:15,949 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:45:15,949 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-rfnlpbqg 4768s 2024-11-23 21:45:15,950 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:45:15,952 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37349 4768s 2024-11-23 21:45:15,952 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37349 4768s 2024-11-23 21:45:15,952 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:45:15,952 - distributed.worker - INFO - dashboard at: 127.0.0.1:34711 4768s 2024-11-23 21:45:15,952 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42497 4768s 2024-11-23 21:45:15,952 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:45:15,952 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:45:15,952 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:45:15,952 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-fkz8aic5 4768s 2024-11-23 21:45:15,952 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:45:15,956 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38599. Reason: failure-to-start- 4768s 2024-11-23 21:45:15,956 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:45:15,957 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37349. Reason: failure-to-start- 4768s 2024-11-23 21:45:15,957 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:45:15,958 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42497': TLS handshake failed with remote 'tls://127.0.0.1:57400': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:45:15,958 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42497': TLS handshake failed with remote 'tls://127.0.0.1:57402': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:45:15,960 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:45:16,965 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:45:16,973 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36707 4768s 2024-11-23 21:45:16,973 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35447/status 4768s 2024-11-23 21:45:16,974 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:45:16,991 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38833 4768s 2024-11-23 21:45:16,991 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38833 4768s 2024-11-23 21:45:16,991 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:45:16,991 - distributed.worker - INFO - dashboard at: 127.0.0.1:41171 4768s 2024-11-23 21:45:16,992 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36707 4768s 2024-11-23 21:45:16,992 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:45:16,992 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:45:16,992 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:45:16,992 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ro013p55 4768s 2024-11-23 21:45:16,992 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:45:16,994 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35227 4768s 2024-11-23 21:45:16,994 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35227 4768s 2024-11-23 21:45:16,994 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:45:16,994 - distributed.worker - INFO - dashboard at: 127.0.0.1:34971 4768s 2024-11-23 21:45:16,994 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36707 4768s 2024-11-23 21:45:16,994 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:45:16,994 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:45:16,994 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:45:16,994 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-iyaw8dmj 4768s 2024-11-23 21:45:16,994 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:45:16,998 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38833. Reason: failure-to-start- 4768s 2024-11-23 21:45:16,998 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:45:16,999 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35227. Reason: failure-to-start- 4768s 2024-11-23 21:45:16,999 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:45:17,002 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36707': TLS handshake failed with remote 'tls://127.0.0.1:49872': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:45:17,002 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36707': TLS handshake failed with remote 'tls://127.0.0.1:49880': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:45:17,004 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:45:18,009 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:45:18,017 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46155 4768s 2024-11-23 21:45:18,018 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36579/status 4768s 2024-11-23 21:45:18,018 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:45:18,034 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45517 4768s 2024-11-23 21:45:18,035 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45517 4768s 2024-11-23 21:45:18,035 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:45:18,035 - distributed.worker - INFO - dashboard at: 127.0.0.1:42755 4768s 2024-11-23 21:45:18,035 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46155 4768s 2024-11-23 21:45:18,035 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:45:18,035 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:45:18,035 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:45:18,035 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-gpsblp4f 4768s 2024-11-23 21:45:18,035 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:45:18,038 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44457 4768s 2024-11-23 21:45:18,038 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44457 4768s 2024-11-23 21:45:18,038 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:45:18,039 - distributed.worker - INFO - dashboard at: 127.0.0.1:46613 4768s 2024-11-23 21:45:18,039 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46155 4768s 2024-11-23 21:45:18,039 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:45:18,039 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:45:18,039 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:45:18,039 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-nk5fgscb 4768s 2024-11-23 21:45:18,039 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:45:18,045 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45517. Reason: failure-to-start- 4768s 2024-11-23 21:45:18,045 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:45:18,046 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44457. Reason: failure-to-start- 4768s 2024-11-23 21:45:18,046 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:45:18,047 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46155': TLS handshake failed with remote 'tls://127.0.0.1:48898': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:45:18,048 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46155': TLS handshake failed with remote 'tls://127.0.0.1:48914': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:45:18,049 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:45:19,055 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:45:19,063 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39663 4768s 2024-11-23 21:45:19,064 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45227/status 4768s 2024-11-23 21:45:19,064 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:45:19,081 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:32983 4768s 2024-11-23 21:45:19,081 - distributed.worker - INFO - Listening to: tls://127.0.0.1:32983 4768s 2024-11-23 21:45:19,082 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:45:19,082 - distributed.worker - INFO - dashboard at: 127.0.0.1:41045 4768s 2024-11-23 21:45:19,082 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39663 4768s 2024-11-23 21:45:19,082 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:45:19,082 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:45:19,082 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:45:19,082 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-8vf1n0n_ 4768s 2024-11-23 21:45:19,082 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:45:19,084 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41347 4768s 2024-11-23 21:45:19,084 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41347 4768s 2024-11-23 21:45:19,084 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:45:19,084 - distributed.worker - INFO - dashboard at: 127.0.0.1:38373 4768s 2024-11-23 21:45:19,084 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39663 4768s 2024-11-23 21:45:19,084 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:45:19,085 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:45:19,085 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:45:19,085 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-8rfuqnh3 4768s 2024-11-23 21:45:19,085 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:45:19,093 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:32983. Reason: failure-to-start- 4768s 2024-11-23 21:45:19,093 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:45:19,094 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41347. Reason: failure-to-start- 4768s 2024-11-23 21:45:19,094 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:45:19,095 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39663': TLS handshake failed with remote 'tls://127.0.0.1:47444': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:45:19,096 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39663': TLS handshake failed with remote 'tls://127.0.0.1:47456': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:45:19,097 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:45:20,106 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:45:20,114 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34571 4768s 2024-11-23 21:45:20,115 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:32891/status 4768s 2024-11-23 21:45:20,115 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:45:20,135 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37447 4768s 2024-11-23 21:45:20,135 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37447 4768s 2024-11-23 21:45:20,135 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:45:20,135 - distributed.worker - INFO - dashboard at: 127.0.0.1:33227 4768s 2024-11-23 21:45:20,135 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34571 4768s 2024-11-23 21:45:20,135 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:45:20,135 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:45:20,135 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:45:20,135 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-6vru6mmm 4768s 2024-11-23 21:45:20,135 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:45:20,137 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36413 4768s 2024-11-23 21:45:20,138 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36413 4768s 2024-11-23 21:45:20,138 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:45:20,138 - distributed.worker - INFO - dashboard at: 127.0.0.1:39869 4768s 2024-11-23 21:45:20,138 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34571 4768s 2024-11-23 21:45:20,138 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:45:20,138 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:45:20,138 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:45:20,138 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-s8n0fkgj 4768s 2024-11-23 21:45:20,138 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:45:20,140 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37447. Reason: failure-to-start- 4768s 2024-11-23 21:45:20,140 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:45:20,140 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36413. Reason: failure-to-start- 4768s 2024-11-23 21:45:20,140 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:45:20,142 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34571': TLS handshake failed with remote 'tls://127.0.0.1:50476': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:45:20,142 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34571': TLS handshake failed with remote 'tls://127.0.0.1:50478': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:45:20,143 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:45:21,149 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:45:21,159 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39135 4768s 2024-11-23 21:45:21,159 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46533/status 4768s 2024-11-23 21:45:21,160 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:45:21,182 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43677 4768s 2024-11-23 21:45:21,182 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43677 4768s 2024-11-23 21:45:21,182 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:45:21,182 - distributed.worker - INFO - dashboard at: 127.0.0.1:35073 4768s 2024-11-23 21:45:21,182 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39135 4768s 2024-11-23 21:45:21,182 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:45:21,182 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:45:21,182 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:45:21,182 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-3g6qwuuc 4768s 2024-11-23 21:45:21,182 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:45:21,184 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46047 4768s 2024-11-23 21:45:21,185 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46047 4768s 2024-11-23 21:45:21,185 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:45:21,185 - distributed.worker - INFO - dashboard at: 127.0.0.1:44423 4768s 2024-11-23 21:45:21,185 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39135 4768s 2024-11-23 21:45:21,185 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:45:21,185 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:45:21,185 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:45:21,185 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-9p4amdgn 4768s 2024-11-23 21:45:21,185 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:45:21,186 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43677. Reason: failure-to-start- 4768s 2024-11-23 21:45:21,187 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:45:21,187 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46047. Reason: failure-to-start- 4768s 2024-11-23 21:45:21,187 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:45:21,189 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39135': TLS handshake failed with remote 'tls://127.0.0.1:50624': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:45:21,189 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39135': TLS handshake failed with remote 'tls://127.0.0.1:50626': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:45:21,190 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:45:22,196 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:45:22,205 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35239 4768s 2024-11-23 21:45:22,206 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41461/status 4768s 2024-11-23 21:45:22,206 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:45:22,228 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39133 4768s 2024-11-23 21:45:22,229 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39133 4768s 2024-11-23 21:45:22,229 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:45:22,229 - distributed.worker - INFO - dashboard at: 127.0.0.1:39545 4768s 2024-11-23 21:45:22,229 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35239 4768s 2024-11-23 21:45:22,229 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:45:22,229 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:45:22,229 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:45:22,229 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-s0o2j_x_ 4768s 2024-11-23 21:45:22,229 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:45:22,231 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41963 4768s 2024-11-23 21:45:22,231 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41963 4768s 2024-11-23 21:45:22,231 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:45:22,232 - distributed.worker - INFO - dashboard at: 127.0.0.1:46239 4768s 2024-11-23 21:45:22,232 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35239 4768s 2024-11-23 21:45:22,232 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:45:22,232 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:45:22,232 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:45:22,232 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-hu6m0a1l 4768s 2024-11-23 21:45:22,232 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:45:22,236 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39133. Reason: failure-to-start- 4768s 2024-11-23 21:45:22,236 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:45:22,237 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41963. Reason: failure-to-start- 4768s 2024-11-23 21:45:22,237 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:45:22,239 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35239': TLS handshake failed with remote 'tls://127.0.0.1:44704': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:45:22,240 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35239': TLS handshake failed with remote 'tls://127.0.0.1:44714': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:45:22,246 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s ______________________________ test_worker_client ______________________________ 4768s 4768s fut = , timeout = 0 4768s 4768s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 4768s async with asyncio.timeout(timeout): 4768s > return await fut 4768s 4768s /usr/lib/python3/dist-packages/distributed/utils.py:1960: 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s /usr/lib/python3/dist-packages/distributed/worker.py:1480: in start_unsafe 4768s await self._register_with_scheduler() 4768s /usr/lib/python3/dist-packages/distributed/worker.py:1179: in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s /usr/lib/python3/dist-packages/distributed/comm/core.py:342: in connect 4768s comm = await wait_for( 4768s /usr/lib/python3/dist-packages/distributed/utils.py:1960: in wait_for 4768s return await fut 4768s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:546: in connect 4768s stream = await self.client.connect( 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s 4768s self = , host = '127.0.0.1' 4768s port = 45399, af = 4768s ssl_options = 4768s max_buffer_size = 8364507136.0, source_ip = None, source_port = None 4768s timeout = None 4768s 4768s async def connect( 4768s self, 4768s host: str, 4768s port: int, 4768s af: socket.AddressFamily = socket.AF_UNSPEC, 4768s ssl_options: Optional[Union[Dict[str, Any], ssl.SSLContext]] = None, 4768s max_buffer_size: Optional[int] = None, 4768s source_ip: Optional[str] = None, 4768s source_port: Optional[int] = None, 4768s timeout: Optional[Union[float, datetime.timedelta]] = None, 4768s ) -> IOStream: 4768s """Connect to the given host and port. 4768s 4768s Asynchronously returns an `.IOStream` (or `.SSLIOStream` if 4768s ``ssl_options`` is not None). 4768s 4768s Using the ``source_ip`` kwarg, one can specify the source 4768s IP address to use when establishing the connection. 4768s In case the user needs to resolve and 4768s use a specific interface, it has to be handled outside 4768s of Tornado as this depends very much on the platform. 4768s 4768s Raises `TimeoutError` if the input future does not complete before 4768s ``timeout``, which may be specified in any form allowed by 4768s `.IOLoop.add_timeout` (i.e. a `datetime.timedelta` or an absolute time 4768s relative to `.IOLoop.time`) 4768s 4768s Similarly, when the user requires a certain source port, it can 4768s be specified using the ``source_port`` arg. 4768s 4768s .. versionchanged:: 4.5 4768s Added the ``source_ip`` and ``source_port`` arguments. 4768s 4768s .. versionchanged:: 5.0 4768s Added the ``timeout`` argument. 4768s """ 4768s if timeout is not None: 4768s if isinstance(timeout, numbers.Real): 4768s timeout = IOLoop.current().time() + timeout 4768s elif isinstance(timeout, datetime.timedelta): 4768s timeout = IOLoop.current().time() + timeout.total_seconds() 4768s else: 4768s raise TypeError("Unsupported timeout %r" % timeout) 4768s if timeout is not None: 4768s addrinfo = await gen.with_timeout( 4768s timeout, self.resolver.resolve(host, port, af) 4768s ) 4768s else: 4768s addrinfo = await self.resolver.resolve(host, port, af) 4768s connector = _Connector( 4768s addrinfo, 4768s functools.partial( 4768s self._create_stream, 4768s max_buffer_size, 4768s source_ip=source_ip, 4768s source_port=source_port, 4768s ), 4768s ) 4768s > af, addr, stream = await connector.start(connect_timeout=timeout) 4768s E asyncio.exceptions.CancelledError 4768s 4768s /usr/lib/python3/dist-packages/tornado/tcpclient.py:279: CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s self = 4768s 4768s @final 4768s async def start(self): 4768s async with self._startup_lock: 4768s if self.status == Status.failed: 4768s assert self.__startup_exc is not None 4768s raise self.__startup_exc 4768s elif self.status != Status.init: 4768s return self 4768s timeout = getattr(self, "death_timeout", None) 4768s 4768s async def _close_on_failure(exc: Exception) -> None: 4768s await self.close(reason=f"failure-to-start-{str(type(exc))}") 4768s self.status = Status.failed 4768s self.__startup_exc = exc 4768s 4768s try: 4768s > await wait_for(self.start_unsafe(), timeout=timeout) 4768s 4768s /usr/lib/python3/dist-packages/distributed/core.py:664: 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 4768s async with asyncio.timeout(timeout): 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s 4768s self = 4768s exc_type = 4768s exc_val = CancelledError(), exc_tb = 4768s 4768s async def __aexit__( 4768s self, 4768s exc_type: Optional[Type[BaseException]], 4768s exc_val: Optional[BaseException], 4768s exc_tb: Optional[TracebackType], 4768s ) -> Optional[bool]: 4768s assert self._state in (_State.ENTERED, _State.EXPIRING) 4768s 4768s if self._timeout_handler is not None: 4768s self._timeout_handler.cancel() 4768s self._timeout_handler = None 4768s 4768s if self._state is _State.EXPIRING: 4768s self._state = _State.EXPIRED 4768s 4768s if self._task.uncancel() <= self._cancelling and exc_type is not None: 4768s # Since there are no new cancel requests, we're 4768s # handling this. 4768s if issubclass(exc_type, exceptions.CancelledError): 4768s > raise TimeoutError from exc_val 4768s E TimeoutError 4768s 4768s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s @contextlib.asynccontextmanager 4768s async def _cluster_factory(): 4768s workers = [] 4768s s = None 4768s try: 4768s for _ in range(60): 4768s try: 4768s > s, ws = await start_cluster( 4768s nthreads, 4768s scheduler, 4768s security=security, 4768s Worker=Worker, 4768s scheduler_kwargs=scheduler_kwargs, 4768s worker_kwargs=merge( 4768s {"death_timeout": min(15, int(deadline.remaining))}, 4768s worker_kwargs, 4768s ), 4768s ) 4768s 4768s /usr/lib/python3/dist-packages/distributed/utils_test.py:966: 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s /usr/lib/python3/dist-packages/distributed/utils_test.py:789: in start_cluster 4768s await asyncio.gather(*workers) 4768s /usr/lib/python3.13/asyncio/tasks.py:737: in _wrap_awaitable 4768s return await awaitable 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s 4768s self = 4768s 4768s @final 4768s async def start(self): 4768s async with self._startup_lock: 4768s if self.status == Status.failed: 4768s assert self.__startup_exc is not None 4768s raise self.__startup_exc 4768s elif self.status != Status.init: 4768s return self 4768s timeout = getattr(self, "death_timeout", None) 4768s 4768s async def _close_on_failure(exc: Exception) -> None: 4768s await self.close(reason=f"failure-to-start-{str(type(exc))}") 4768s self.status = Status.failed 4768s self.__startup_exc = exc 4768s 4768s try: 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s except asyncio.TimeoutError as exc: 4768s await _close_on_failure(exc) 4768s > raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s E TimeoutError: Worker start timed out after 0s. 4768s 4768s /usr/lib/python3/dist-packages/distributed/core.py:667: TimeoutError 4768s 4768s During handling of the above exception, another exception occurred: 4768s 4768s fut = ._..test_func..async_fn at 0xe99adbf0> 4768s timeout = 60 4768s 4768s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 4768s async with asyncio.timeout(timeout): 4768s > return await fut 4768s 4768s /usr/lib/python3/dist-packages/distributed/utils.py:1960: 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s /usr/lib/python3/dist-packages/distributed/utils_test.py:999: in async_fn 4768s _cluster_factory() as (s, workers), 4768s /usr/lib/python3.13/contextlib.py:214: in __aenter__ 4768s return await anext(self.gen) 4768s /usr/lib/python3/dist-packages/distributed/utils_test.py:983: in _cluster_factory 4768s await asyncio.sleep(1) 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s 4768s delay = 1, result = None 4768s 4768s async def sleep(delay, result=None): 4768s """Coroutine that completes after a given time (in seconds).""" 4768s if delay <= 0: 4768s await __sleep0() 4768s return result 4768s 4768s if math.isnan(delay): 4768s raise ValueError("Invalid delay: NaN (not a number)") 4768s 4768s loop = events.get_running_loop() 4768s future = loop.create_future() 4768s h = loop.call_later(delay, 4768s futures._set_result_unless_cancelled, 4768s future, result) 4768s try: 4768s > return await future 4768s E asyncio.exceptions.CancelledError 4768s 4768s /usr/lib/python3.13/asyncio/tasks.py:718: CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s args = (), kwds = {} 4768s 4768s @wraps(func) 4768s def inner(*args, **kwds): 4768s with self._recreate_cm(): 4768s > return func(*args, **kwds) 4768s 4768s /usr/lib/python3.13/contextlib.py:85: 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s /usr/lib/python3.13/contextlib.py:85: in inner 4768s return func(*args, **kwds) 4768s /usr/lib/python3/dist-packages/distributed/utils_test.py:1102: in test_func 4768s return _run_and_close_tornado(async_fn_outer) 4768s /usr/lib/python3/dist-packages/distributed/utils_test.py:378: in _run_and_close_tornado 4768s return asyncio_run(inner_fn(), loop_factory=get_loop_factory()) 4768s /usr/lib/python3.13/asyncio/runners.py:194: in run 4768s return runner.run(main) 4768s /usr/lib/python3.13/asyncio/runners.py:118: in run 4768s return self._loop.run_until_complete(task) 4768s /usr/lib/python3.13/asyncio/base_events.py:720: in run_until_complete 4768s return future.result() 4768s /usr/lib/python3/dist-packages/distributed/utils_test.py:375: in inner_fn 4768s return await async_fn(*args, **kwargs) 4768s /usr/lib/python3/dist-packages/distributed/utils_test.py:1099: in async_fn_outer 4768s return await utils_wait_for(async_fn(), timeout=timeout * 2) 4768s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 4768s async with asyncio.timeout(timeout): 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s 4768s self = 4768s exc_type = 4768s exc_val = CancelledError(), exc_tb = 4768s 4768s async def __aexit__( 4768s self, 4768s exc_type: Optional[Type[BaseException]], 4768s exc_val: Optional[BaseException], 4768s exc_tb: Optional[TracebackType], 4768s ) -> Optional[bool]: 4768s assert self._state in (_State.ENTERED, _State.EXPIRING) 4768s 4768s if self._timeout_handler is not None: 4768s self._timeout_handler.cancel() 4768s self._timeout_handler = None 4768s 4768s if self._state is _State.EXPIRING: 4768s self._state = _State.EXPIRED 4768s 4768s if self._task.uncancel() <= self._cancelling and exc_type is not None: 4768s # Since there are no new cancel requests, we're 4768s # handling this. 4768s if issubclass(exc_type, exceptions.CancelledError): 4768s > raise TimeoutError from exc_val 4768s E TimeoutError 4768s 4768s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 4768s ----------------------------- Captured stderr call ----------------------------- 4768s 2024-11-23 21:45:23,305 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:45:23,314 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:23,314 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40155/status 4768s 2024-11-23 21:45:23,315 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:45:23,331 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39657 4768s 2024-11-23 21:45:23,331 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39657 4768s 2024-11-23 21:45:23,332 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:45:23,332 - distributed.worker - INFO - dashboard at: 127.0.0.1:45655 4768s 2024-11-23 21:45:23,332 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:23,332 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:45:23,332 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:45:23,332 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:45:23,332 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-a5qz1e7c 4768s 2024-11-23 21:45:23,332 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:45:23,334 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42563 4768s 2024-11-23 21:45:23,334 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42563 4768s 2024-11-23 21:45:23,334 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:45:23,334 - distributed.worker - INFO - dashboard at: 127.0.0.1:43989 4768s 2024-11-23 21:45:23,334 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:23,334 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:45:23,334 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:45:23,334 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:45:23,334 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-c7vbb9t8 4768s 2024-11-23 21:45:23,334 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:45:23,347 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:23,348 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:23,348 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:43488': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:23,348 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:43496': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:23,461 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:23,461 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:23,462 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:43502': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:23,462 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:43508': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:23,574 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:23,574 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:23,576 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:43514': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:23,576 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:43518': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:23,688 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:23,688 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:23,688 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:43534': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:23,688 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:43536': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:23,801 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:23,802 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:23,802 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:43544': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:23,802 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:43552': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:23,915 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:23,915 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:23,915 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:43560': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:23,915 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:43576': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:24,028 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:24,029 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:24,029 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:43578': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:24,029 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:43584': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:24,142 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:24,142 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:24,142 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:43592': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:24,142 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:43606': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:24,255 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:24,256 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:24,256 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:43608': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:24,256 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:43624': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:24,369 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:24,369 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:24,370 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:43626': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:24,370 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:43634': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:24,483 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:24,483 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:24,483 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:43642': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:24,484 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:43648': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:24,597 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:24,597 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:24,597 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:43658': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:24,597 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:43668': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:24,710 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:24,710 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:24,711 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:43680': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:24,711 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:43694': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:24,824 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:24,824 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:24,828 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:43706': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:24,828 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:43716': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:24,937 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:24,937 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:24,938 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:43732': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:24,938 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:43736': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:25,072 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:25,073 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:25,075 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:43746': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:25,075 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:43756': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:25,189 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:25,189 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:25,190 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:43772': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:25,190 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:43778': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:25,302 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:25,302 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:25,304 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:43794': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:25,304 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:43804': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:25,415 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:25,415 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:25,415 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:43814': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:25,416 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:43822': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:25,528 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:25,528 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:25,529 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:43834': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:25,529 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:43844': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:25,641 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:25,641 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:25,642 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:43848': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:25,642 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:43850': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:25,754 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:25,755 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:25,755 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:43860': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:25,755 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:43876': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:25,868 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:25,869 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:25,869 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:43884': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:25,869 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:43892': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:25,981 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:25,981 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:25,981 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:43898': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:25,981 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:43904': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:26,093 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:26,093 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:26,094 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:43914': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:26,094 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:43920': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:26,206 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:26,207 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:26,207 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:43936': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:26,207 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:43940': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:26,320 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:26,320 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:26,324 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:43948': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:26,324 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:43950': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:26,432 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:26,432 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:26,433 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:43952': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:26,433 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:43954': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:26,544 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:26,545 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:26,545 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:43960': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:26,545 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:43974': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:26,657 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:26,657 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:26,657 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:43980': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:26,657 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:43986': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:26,770 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:26,770 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:26,770 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:44000': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:26,771 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:44010': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:26,884 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:26,884 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:26,884 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:44020': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:26,885 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:44024': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:26,998 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:26,998 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:26,999 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:44030': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:26,999 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:44036': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:27,113 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:27,114 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:27,114 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:44040': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:27,114 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:44052': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:27,227 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:27,228 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:27,228 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:44056': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:27,228 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:44058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:27,343 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:27,343 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:27,343 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:44072': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:27,343 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:44074': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:27,457 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:27,457 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:27,458 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:44086': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:27,458 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:44100': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:27,570 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:27,570 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:27,571 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:44108': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:27,571 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:44116': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:27,684 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:27,684 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:27,684 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:44122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:27,684 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:44128': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:27,797 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:27,797 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:27,798 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:44144': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:27,798 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:44150': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:27,911 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:27,912 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:27,912 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:44152': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:27,912 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:44162': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:28,026 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:28,026 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:28,027 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:44174': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:28,027 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:44178': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:28,140 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:28,141 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:28,141 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:44182': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:28,141 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:44196': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:28,254 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:28,254 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:28,254 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:44204': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:28,254 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:44212': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:28,368 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:28,368 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:28,369 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:44214': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:28,369 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:44228': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:28,482 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:28,482 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:28,483 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:44240': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:28,483 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:44252': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:28,596 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:28,597 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:28,597 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:44256': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:28,597 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:44264': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:28,709 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:28,710 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:28,710 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:44276': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:28,710 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:44292': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:28,825 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:28,825 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:28,830 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:44308': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:28,830 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:44314': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:28,940 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:28,941 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:28,941 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:44328': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:28,941 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:44340': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:29,054 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:29,055 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:29,055 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:44350': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:29,056 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:44356': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:29,169 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:29,169 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:29,169 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:44366': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:29,169 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:44380': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:29,282 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:29,283 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:29,283 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:44382': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:29,283 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:44388': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:29,396 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:29,396 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:29,397 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:44404': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:29,397 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:44418': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:29,511 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:29,512 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:29,512 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:44422': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:29,512 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:44432': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:29,626 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:29,626 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:29,627 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:44436': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:29,627 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:44444': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:29,740 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:29,740 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:29,740 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:44446': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:29,740 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:44458': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:29,854 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:29,854 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:29,854 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:44468': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:29,854 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:44474': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:29,967 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:29,967 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:29,967 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:44478': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:29,967 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:44484': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:30,082 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:30,082 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:30,082 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:44492': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:30,082 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:44508': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:30,195 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:30,195 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:30,195 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:44518': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:30,196 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:44526': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:30,308 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:30,308 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:30,308 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:44538': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:30,308 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:44554': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:30,421 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:30,421 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:30,422 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:44556': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:30,422 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:44564': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:30,534 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:30,534 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:30,534 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:44566': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:30,535 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:44582': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:30,648 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:30,648 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:30,649 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:44596': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:30,649 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:44608': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:30,762 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:30,762 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:30,763 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:44612': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:30,763 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:44616': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:30,875 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:30,875 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:30,876 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:44622': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:30,876 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:44624': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:30,988 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:30,988 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:30,988 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:44628': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:30,988 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:44644': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:31,102 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:31,102 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:31,102 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:44648': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:31,102 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:44660': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:31,215 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:31,215 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:31,215 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:44662': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:31,215 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:44666': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:31,331 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:31,331 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:31,332 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:44676': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:31,332 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:44686': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:31,444 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:31,444 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:31,444 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:44696': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:31,444 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:44706': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:31,556 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:31,557 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:31,557 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:47790': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:31,557 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:47798': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:31,669 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:31,669 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:31,669 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:47802': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:31,670 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:47804': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:31,781 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:31,781 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:31,782 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:47810': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:31,782 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:47812': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:31,894 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:31,894 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:31,895 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:47824': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:31,895 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:47832': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:32,007 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:32,008 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:32,008 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:47834': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:32,008 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:47842': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:32,120 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:32,120 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:32,121 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:47854': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:32,121 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:47860': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:32,233 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:32,234 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:32,234 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:47872': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:32,234 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:47878': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:32,346 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:32,346 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:32,347 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:47888': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:32,347 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:47902': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:32,459 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:32,460 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:32,460 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:47904': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:32,460 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:47920': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:32,575 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:32,575 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:32,576 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:47934': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:32,576 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:47950': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:32,688 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:32,689 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:32,689 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:47956': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:32,689 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:47966': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:32,802 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:32,802 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:32,802 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:47968': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:32,803 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:47970': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:32,915 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:32,915 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:32,916 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:47972': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:32,916 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:47986': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:33,043 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:33,045 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:33,045 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:47996': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:33,046 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:48000': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:33,153 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:33,158 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:48004': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:33,159 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:33,159 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:48008': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:33,261 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:33,261 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:48014': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:33,267 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:33,267 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:48030': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:33,368 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:33,368 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:48042': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:33,374 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:33,375 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:48048': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:33,475 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:33,475 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:48054': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:33,481 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:33,482 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:48060': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:33,582 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:33,582 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:48062': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:33,588 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:33,589 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:48076': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:33,689 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:33,689 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:48084': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:33,695 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:33,695 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:48100': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:33,796 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:33,796 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:48102': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:33,802 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:33,803 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:48106': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:33,906 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:33,907 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:48110': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:33,915 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:33,916 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:48118': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:34,016 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:34,017 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:48126': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:34,026 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:34,027 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:48132': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:34,127 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:34,127 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:48136': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:34,136 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:34,137 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:48148': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:34,238 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:34,239 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:48154': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:34,247 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:34,248 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:48156': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:34,663 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:34,663 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:34,663 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:48166': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:34,664 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:48182': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:34,776 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:34,776 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:34,776 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:48188': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:34,776 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:48204': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:34,888 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:34,889 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:34,889 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:48220': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:34,889 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:48226': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:35,002 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:35,002 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:35,003 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:48240': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:35,003 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:48250': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:35,115 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:35,115 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:35,116 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:48258': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:35,116 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:48270': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:35,223 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:35,227 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:48282': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:35,228 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:35,229 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:48286': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:35,330 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:35,331 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:48300': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:35,337 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:35,337 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:48316': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:35,438 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:35,438 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:48318': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:35,444 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:35,445 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:48320': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:35,545 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:35,546 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:48324': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:35,552 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:35,552 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:48340': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:35,664 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:35,669 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:48344': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:35,670 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:35,671 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:48348': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:35,773 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:35,774 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:48364': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:35,780 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:35,780 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:48380': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:35,881 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:35,881 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:48392': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:35,889 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:35,890 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:48408': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:35,988 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:35,989 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:48422': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:35,996 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:35,996 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:48430': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:36,096 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:36,096 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:48442': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:36,103 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:36,103 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:48454': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:36,204 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:36,204 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:48458': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:36,211 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:36,211 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:48460': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:36,312 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:36,313 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:48474': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:36,319 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:36,323 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:48488': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:36,420 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:36,421 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:48502': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:36,427 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:36,427 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:48510': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:36,528 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:36,528 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:48526': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:36,534 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:36,535 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:48536': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:36,636 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:36,637 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:48552': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:36,643 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:36,644 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:48556': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:36,744 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:36,745 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:48558': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:36,751 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:36,751 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:48574': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:36,854 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:36,854 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:48578': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:36,861 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:36,862 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:48594': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:36,961 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:36,961 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:48606': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:36,968 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:36,968 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:48608': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:37,068 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:37,069 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:48612': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:37,075 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:37,075 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:48620': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:37,176 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:37,176 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:48628': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:37,182 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:37,183 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:48632': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:37,283 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:37,284 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:48638': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:37,290 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:37,290 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:48640': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:37,391 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:37,391 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:48642': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:37,398 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:37,398 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:48648': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:37,499 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:37,499 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:48660': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:37,505 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:37,506 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:48672': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:37,607 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:37,607 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:48676': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:37,614 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:37,614 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:48686': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:37,714 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:37,715 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:48694': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:37,723 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:37,723 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:48706': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:37,825 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:37,826 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:48714': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:37,833 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:37,833 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:48726': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:37,933 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:37,934 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:48732': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:37,940 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:37,941 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:48734': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:38,043 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:38,044 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:48742': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:38,050 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:38,050 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:48754': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:38,151 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:38,152 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:48756': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:38,158 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:38,158 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:48772': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:38,260 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:38,260 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:48776': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:38,285 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39613 4768s 2024-11-23 21:45:38,286 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39613': TLS handshake failed with remote 'tls://127.0.0.1:48780': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:38,331 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39657. Reason: failure-to-start- 4768s 2024-11-23 21:45:38,331 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:45:38,336 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42563. Reason: failure-to-start- 4768s 2024-11-23 21:45:38,337 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:45:38,340 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 15s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 4768s stream = await stream.start_tls( 4768s ^^^^^^^^^^^^^^^^^^^^^^^ 4768s False, ssl_options=ssl_options, server_hostname=host 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 4768s self.socket.do_handshake() 4768s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 4768s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 4768s self._sslobj.do_handshake() 4768s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 4768s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 4768s raise FatalCommClosedError( 4768s ...<2 lines>... 4768s ) from err 4768s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 4768s 4768s During handling of the above exception, another exception occurred: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1218, in _register_with_scheduler 4768s await asyncio.sleep(0.1) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 718, in sleep 4768s return await future 4768s ^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 15s. 4768s 2024-11-23 21:45:39,352 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:45:39,361 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:39,361 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43657/status 4768s 2024-11-23 21:45:39,362 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:45:39,378 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36925 4768s 2024-11-23 21:45:39,378 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36925 4768s 2024-11-23 21:45:39,378 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:45:39,378 - distributed.worker - INFO - dashboard at: 127.0.0.1:42233 4768s 2024-11-23 21:45:39,378 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:39,379 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:45:39,379 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:45:39,379 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:45:39,379 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-3c_aewxd 4768s 2024-11-23 21:45:39,379 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:45:39,381 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34531 4768s 2024-11-23 21:45:39,381 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34531 4768s 2024-11-23 21:45:39,381 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:45:39,381 - distributed.worker - INFO - dashboard at: 127.0.0.1:37683 4768s 2024-11-23 21:45:39,381 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:39,381 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:45:39,381 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:45:39,381 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:45:39,381 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-hcp_lger 4768s 2024-11-23 21:45:39,381 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:45:39,394 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:39,394 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:39,394 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:48152': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:39,394 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:48158': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:39,506 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:39,507 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:39,507 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:48174': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:39,507 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:48180': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:39,619 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:39,620 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:39,620 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:48188': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:39,620 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:48196': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:39,732 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:39,733 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:39,733 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:48206': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:39,733 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:48222': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:39,845 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:39,845 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:39,846 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:48224': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:39,846 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:48232': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:39,957 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:39,958 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:39,958 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:48234': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:39,958 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:48236': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:40,070 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:40,070 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:40,071 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:48252': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:40,071 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:48256': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:40,184 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:40,184 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:40,185 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:48272': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:40,185 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:48286': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:40,297 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:40,297 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:40,299 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:48288': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:40,299 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:48298': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:40,410 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:40,410 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:40,410 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:48312': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:40,410 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:48316': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:40,522 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:40,523 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:40,523 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:48322': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:40,523 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:48330': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:40,635 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:40,635 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:40,635 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:48340': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:40,636 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:48344': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:40,747 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:40,748 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:40,748 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:48356': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:40,748 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:48362': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:40,861 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:40,861 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:40,861 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:48368': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:40,861 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:48374': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:40,974 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:40,974 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:40,974 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:48382': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:40,974 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:48398': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:41,088 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:41,088 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:41,088 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:48402': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:41,088 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:48408': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:41,203 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:41,203 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:41,203 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:48412': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:41,204 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:48414': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:41,316 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:41,316 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:41,317 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:48418': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:41,317 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:48420': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:41,429 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:41,430 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:41,430 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:48430': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:41,430 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:48432': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:41,542 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:41,543 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:41,543 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:53156': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:41,543 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:53168': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:41,655 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:41,656 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:41,656 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:53174': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:41,656 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:53180': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:41,769 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:41,769 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:41,769 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:53184': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:41,769 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:53200': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:41,881 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:41,881 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:41,882 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:53202': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:41,882 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:53216': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:41,994 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:41,994 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:41,995 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:53230': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:41,995 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:53234': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:42,107 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:42,107 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:42,107 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:53250': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:42,107 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:53258': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:42,220 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:42,220 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:42,221 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:53274': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:42,221 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:53276': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:42,334 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:42,334 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:42,335 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:53280': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:42,335 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:53294': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:42,448 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:42,448 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:42,448 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:53304': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:42,448 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:53320': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:42,561 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:42,561 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:42,561 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:53336': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:42,561 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:53348': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:42,674 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:42,674 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:42,674 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:53354': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:42,674 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:53366': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:42,787 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:42,787 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:42,787 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:53376': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:42,787 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:53392': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:42,899 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:42,899 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:42,900 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:53404': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:42,900 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:53408': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:43,012 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:43,012 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:43,012 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:53412': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:43,013 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:53420': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:43,125 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:43,125 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:43,126 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:53422': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:43,126 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:53428': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:43,238 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:43,238 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:43,239 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:53440': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:43,239 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:53442': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:43,351 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:43,351 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:43,352 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:53454': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:43,352 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:53464': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:43,465 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:43,465 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:43,466 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:53472': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:43,466 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:53486': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:43,578 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:43,578 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:43,578 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:53488': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:43,579 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:53490': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:43,690 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:43,691 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:43,691 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:53506': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:43,691 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:53514': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:43,803 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:43,803 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:43,804 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:53524': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:43,804 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:53538': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:43,916 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:43,916 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:43,916 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:53554': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:43,917 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:53568': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:44,027 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:44,028 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:44,029 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:53580': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:44,029 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:53592': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:44,136 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:44,141 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:53608': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:44,142 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:44,142 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:53614': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:44,244 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:44,244 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:53618': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:44,250 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:44,251 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:53624': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:44,353 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:44,353 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:53634': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:44,359 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:44,359 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:53636': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:44,460 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:44,460 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:53652': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:44,467 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:44,467 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:53668': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:44,568 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:44,568 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:53680': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:44,574 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:44,575 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:53688': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:44,675 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:44,676 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:53702': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:44,682 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:44,682 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:53708': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:44,784 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:44,785 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:53714': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:44,791 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:44,791 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:53726': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:44,892 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:44,893 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:53728': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:44,899 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:44,899 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:53736': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:45,001 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:45,001 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:53748': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:45,007 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:45,007 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:53756': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:45,109 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:45,110 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:53766': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:45,116 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:45,117 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:53770': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:45,217 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:45,218 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:53784': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:45,224 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:45,224 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:53796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:45,325 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:45,326 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:53808': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:45,332 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:45,332 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:53822': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:45,432 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:45,433 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:53832': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:45,439 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:45,439 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:53836': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:45,540 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:45,540 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:53846': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:45,546 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:45,547 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:53856': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:45,647 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:45,648 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:53870': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:45,654 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:45,654 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:53882': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:45,755 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:45,755 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:53888': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:45,761 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:45,761 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:53890': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:45,863 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:45,867 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:53898': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:45,873 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:45,874 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:53914': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:45,971 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:45,971 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:53918': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:45,980 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:45,980 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:53922': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:46,079 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:46,079 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:53934': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:46,087 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:46,087 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:53948': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:46,186 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:46,187 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:53954': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:46,194 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:46,194 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:53960': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:46,294 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:46,294 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:53972': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:46,300 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:46,301 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:53988': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:46,401 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:46,401 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:53998': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:46,408 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:46,408 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:54010': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:46,510 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:46,511 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:54014': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:46,517 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:46,518 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:54028': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:46,618 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:46,619 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:54036': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:46,625 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:46,626 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:54042': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:46,726 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:46,727 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:54050': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:46,733 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:46,733 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:54054': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:46,833 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:46,834 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:54064': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:46,861 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:46,862 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:54072': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:46,942 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:46,942 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:54076': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:46,969 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:46,969 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:54078': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:47,049 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:47,050 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:54088': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:47,076 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:47,076 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:54096': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:47,156 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:47,157 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:54104': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:47,183 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:47,184 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:54118': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:47,264 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:47,264 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:54124': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:47,291 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:47,291 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:54126': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:47,371 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:47,372 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:54132': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:47,398 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:47,399 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:54148': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:47,479 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:47,480 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:54162': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:47,505 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:47,506 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:54176': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:47,586 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:47,587 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:54190': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:47,612 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:47,613 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:54192': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:47,693 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:47,694 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:54208': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:47,720 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:47,720 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:54216': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:47,801 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:47,802 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:54228': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:47,826 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:47,827 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:54236': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:47,909 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:47,909 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:54242': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:47,933 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:47,934 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:54246': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:48,017 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:48,018 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:54262': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:48,040 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:48,041 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:54278': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:48,125 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:48,125 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:54280': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:48,148 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:48,149 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:54294': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:48,234 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:48,234 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:54298': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:48,256 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:48,256 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:54314': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:48,341 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:48,342 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:54318': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:48,363 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:48,368 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:54330': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:48,449 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:48,449 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:54336': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:48,471 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:48,472 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:54346': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:48,556 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:48,556 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:54348': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:48,578 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:48,579 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:54356': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:48,663 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:48,664 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:54366': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:48,685 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:48,686 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:54374': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:48,770 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:48,770 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:54380': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:48,792 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:48,792 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:54388': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:48,878 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:48,878 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:54398': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:48,900 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:48,900 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:54402': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:48,985 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:48,986 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:54406': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:49,007 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:49,007 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:54414': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:49,093 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:49,094 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:54428': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:49,114 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:49,115 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:54432': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:49,201 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:49,202 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:54438': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:49,223 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:49,223 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:54448': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:49,309 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:49,309 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:54462': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:49,329 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:49,330 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:54474': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:49,417 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:49,417 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:54484': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:49,438 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:49,438 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:54494': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:49,525 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:49,525 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:54508': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:49,546 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:49,546 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:54510': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:49,632 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:49,633 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:54518': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:49,653 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:49,654 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:54528': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:49,741 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:49,741 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:54540': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:49,760 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:49,760 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:54550': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:49,848 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:49,849 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:54558': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:49,870 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:49,871 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:54568': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:49,957 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:49,957 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:54572': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:49,979 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:49,980 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:54588': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:50,064 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:50,065 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:54590': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:50,086 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:50,087 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:54606': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:50,171 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:50,172 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:54616': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:50,194 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:50,194 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:54632': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:50,280 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:50,280 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:54640': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:50,301 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:50,301 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:54646': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:50,387 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:50,388 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:54650': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:50,408 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:50,409 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:54666': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:50,495 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:50,495 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:54682': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:50,516 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:50,516 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:54692': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:50,602 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:50,603 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:54706': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:50,623 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:50,623 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:54712': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:50,709 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:50,710 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:54726': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:50,730 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:50,730 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:54730': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:50,817 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:50,820 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:54732': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:50,837 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:50,838 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:54738': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:50,924 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:50,924 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:54740': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:50,945 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:50,946 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:54742': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:51,033 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:51,033 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:54752': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:51,054 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:51,054 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:54756': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:51,142 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:51,142 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:54766': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:51,161 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:51,161 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:54768': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:51,250 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:51,250 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:54784': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:51,268 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:51,269 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:54794': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:51,358 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:51,358 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:54802': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:51,375 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:51,375 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:54804': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:51,465 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:51,465 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:54814': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:51,482 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:51,483 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:54830': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:51,572 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:51,573 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:58106': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:51,589 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:51,589 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:58110': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:51,680 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:51,680 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:58120': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:51,697 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:51,697 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:58136': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:51,788 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:51,789 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:58152': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:51,805 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:51,805 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:58168': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:51,896 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:51,897 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:58176': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:51,913 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:51,914 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:58182': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:52,004 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:52,004 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:58186': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:52,021 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:52,021 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:58198': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:52,111 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:52,112 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:58214': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:52,128 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:52,128 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:58230': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:52,219 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:52,220 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:58246': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:52,236 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:52,237 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:58258': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:52,326 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:52,326 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:58268': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:52,344 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46079 4768s 2024-11-23 21:45:52,344 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46079': TLS handshake failed with remote 'tls://127.0.0.1:58270': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:45:52,377 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36925. Reason: failure-to-start- 4768s 2024-11-23 21:45:52,377 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:45:52,379 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 13s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 4768s stream = await stream.start_tls( 4768s ^^^^^^^^^^^^^^^^^^^^^^^ 4768s False, ssl_options=ssl_options, server_hostname=host 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 4768s self.socket.do_handshake() 4768s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 4768s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 4768s self._sslobj.do_handshake() 4768s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 4768s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 4768s raise FatalCommClosedError( 4768s ...<2 lines>... 4768s ) from err 4768s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 4768s 4768s During handling of the above exception, another exception occurred: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1218, in _register_with_scheduler 4768s await asyncio.sleep(0.1) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 718, in sleep 4768s return await future 4768s ^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 13s. 4768s 2024-11-23 21:45:52,383 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34531. Reason: failure-to-start- 4768s 2024-11-23 21:45:52,383 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:45:53,390 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:45:53,399 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45729 4768s 2024-11-23 21:45:53,399 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37111/status 4768s 2024-11-23 21:45:53,399 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:45:53,413 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46615 4768s 2024-11-23 21:45:53,413 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46615 4768s 2024-11-23 21:45:53,413 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:45:53,413 - distributed.worker - INFO - dashboard at: 127.0.0.1:43447 4768s 2024-11-23 21:45:53,413 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45729 4768s 2024-11-23 21:45:53,413 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:45:53,413 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:45:53,413 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:45:53,413 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-qf7787z7 4768s 2024-11-23 21:45:53,414 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:45:53,415 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39899 4768s 2024-11-23 21:45:53,416 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39899 4768s 2024-11-23 21:45:53,416 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:45:53,416 - distributed.worker - INFO - dashboard at: 127.0.0.1:35633 4768s 2024-11-23 21:45:53,416 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45729 4768s 2024-11-23 21:45:53,416 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:45:53,416 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:45:53,416 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:45:53,416 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-6bir1onk 4768s 2024-11-23 21:45:53,416 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:45:53,417 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46615. Reason: failure-to-start- 4768s 2024-11-23 21:45:53,417 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:45:53,417 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39899. Reason: failure-to-start- 4768s 2024-11-23 21:45:53,417 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:45:53,419 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45729': TLS handshake failed with remote 'tls://127.0.0.1:33214': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:45:53,419 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45729': TLS handshake failed with remote 'tls://127.0.0.1:33216': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:45:53,420 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:45:54,429 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:45:54,436 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46837 4768s 2024-11-23 21:45:54,437 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33809/status 4768s 2024-11-23 21:45:54,437 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:45:54,452 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37701 4768s 2024-11-23 21:45:54,453 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37701 4768s 2024-11-23 21:45:54,453 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:45:54,453 - distributed.worker - INFO - dashboard at: 127.0.0.1:40221 4768s 2024-11-23 21:45:54,453 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46837 4768s 2024-11-23 21:45:54,453 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:45:54,453 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:45:54,453 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:45:54,453 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-7ustmtxg 4768s 2024-11-23 21:45:54,453 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:45:54,455 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37451 4768s 2024-11-23 21:45:54,455 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37451 4768s 2024-11-23 21:45:54,455 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:45:54,455 - distributed.worker - INFO - dashboard at: 127.0.0.1:38673 4768s 2024-11-23 21:45:54,455 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46837 4768s 2024-11-23 21:45:54,455 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:45:54,455 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:45:54,455 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:45:54,455 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-4v4qe23x 4768s 2024-11-23 21:45:54,456 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:45:54,457 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37701. Reason: failure-to-start- 4768s 2024-11-23 21:45:54,457 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:45:54,457 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37451. Reason: failure-to-start- 4768s 2024-11-23 21:45:54,457 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:45:54,458 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46837': TLS handshake failed with remote 'tls://127.0.0.1:41178': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:45:54,458 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46837': TLS handshake failed with remote 'tls://127.0.0.1:41180': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:45:54,460 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:45:55,472 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:45:55,481 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39951 4768s 2024-11-23 21:45:55,481 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41967/status 4768s 2024-11-23 21:45:55,481 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:45:55,495 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36675 4768s 2024-11-23 21:45:55,495 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36675 4768s 2024-11-23 21:45:55,495 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:45:55,495 - distributed.worker - INFO - dashboard at: 127.0.0.1:35289 4768s 2024-11-23 21:45:55,495 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39951 4768s 2024-11-23 21:45:55,495 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:45:55,495 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:45:55,495 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:45:55,495 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-t_06ltho 4768s 2024-11-23 21:45:55,496 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:45:55,499 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44261 4768s 2024-11-23 21:45:55,499 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44261 4768s 2024-11-23 21:45:55,499 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:45:55,499 - distributed.worker - INFO - dashboard at: 127.0.0.1:34269 4768s 2024-11-23 21:45:55,499 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39951 4768s 2024-11-23 21:45:55,499 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:45:55,499 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:45:55,499 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:45:55,499 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-qhxrbkpo 4768s 2024-11-23 21:45:55,499 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:45:55,500 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36675. Reason: failure-to-start- 4768s 2024-11-23 21:45:55,500 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:45:55,500 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44261. Reason: failure-to-start- 4768s 2024-11-23 21:45:55,500 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:45:55,502 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39951': TLS handshake failed with remote 'tls://127.0.0.1:58544': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:45:55,502 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39951': TLS handshake failed with remote 'tls://127.0.0.1:58558': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:45:55,503 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:45:56,509 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:45:56,517 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41201 4768s 2024-11-23 21:45:56,517 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40979/status 4768s 2024-11-23 21:45:56,517 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:45:56,530 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39781 4768s 2024-11-23 21:45:56,530 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39781 4768s 2024-11-23 21:45:56,530 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:45:56,530 - distributed.worker - INFO - dashboard at: 127.0.0.1:39475 4768s 2024-11-23 21:45:56,530 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41201 4768s 2024-11-23 21:45:56,530 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:45:56,530 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:45:56,530 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:45:56,530 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-3r5oehny 4768s 2024-11-23 21:45:56,530 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:45:56,532 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33545 4768s 2024-11-23 21:45:56,532 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33545 4768s 2024-11-23 21:45:56,532 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:45:56,532 - distributed.worker - INFO - dashboard at: 127.0.0.1:38207 4768s 2024-11-23 21:45:56,533 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41201 4768s 2024-11-23 21:45:56,533 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:45:56,533 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:45:56,533 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:45:56,533 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-bcvcrp1g 4768s 2024-11-23 21:45:56,533 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:45:56,534 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39781. Reason: failure-to-start- 4768s 2024-11-23 21:45:56,534 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:45:56,534 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33545. Reason: failure-to-start- 4768s 2024-11-23 21:45:56,534 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:45:56,535 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41201': TLS handshake failed with remote 'tls://127.0.0.1:40716': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:45:56,535 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41201': TLS handshake failed with remote 'tls://127.0.0.1:40724': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:45:56,537 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:45:57,543 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:45:57,551 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33353 4768s 2024-11-23 21:45:57,551 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40591/status 4768s 2024-11-23 21:45:57,551 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:45:57,564 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40171 4768s 2024-11-23 21:45:57,564 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40171 4768s 2024-11-23 21:45:57,564 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:45:57,565 - distributed.worker - INFO - dashboard at: 127.0.0.1:36299 4768s 2024-11-23 21:45:57,565 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33353 4768s 2024-11-23 21:45:57,565 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:45:57,565 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:45:57,565 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:45:57,565 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ygd50tcf 4768s 2024-11-23 21:45:57,565 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:45:57,567 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42113 4768s 2024-11-23 21:45:57,568 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42113 4768s 2024-11-23 21:45:57,568 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:45:57,568 - distributed.worker - INFO - dashboard at: 127.0.0.1:35291 4768s 2024-11-23 21:45:57,568 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33353 4768s 2024-11-23 21:45:57,568 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:45:57,568 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:45:57,568 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:45:57,568 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-pstiqahw 4768s 2024-11-23 21:45:57,568 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:45:57,569 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40171. Reason: failure-to-start- 4768s 2024-11-23 21:45:57,569 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:45:57,569 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42113. Reason: failure-to-start- 4768s 2024-11-23 21:45:57,570 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:45:57,571 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33353': TLS handshake failed with remote 'tls://127.0.0.1:36816': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:45:57,571 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33353': TLS handshake failed with remote 'tls://127.0.0.1:36818': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:45:57,572 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:45:58,578 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:45:58,585 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44721 4768s 2024-11-23 21:45:58,585 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34851/status 4768s 2024-11-23 21:45:58,585 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:45:58,600 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44001 4768s 2024-11-23 21:45:58,600 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44001 4768s 2024-11-23 21:45:58,601 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:45:58,601 - distributed.worker - INFO - dashboard at: 127.0.0.1:38799 4768s 2024-11-23 21:45:58,601 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44721 4768s 2024-11-23 21:45:58,601 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:45:58,601 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:45:58,601 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:45:58,601 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-5akw7k0c 4768s 2024-11-23 21:45:58,601 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:45:58,603 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40859 4768s 2024-11-23 21:45:58,603 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40859 4768s 2024-11-23 21:45:58,603 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:45:58,603 - distributed.worker - INFO - dashboard at: 127.0.0.1:45747 4768s 2024-11-23 21:45:58,603 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44721 4768s 2024-11-23 21:45:58,603 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:45:58,603 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:45:58,603 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:45:58,603 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-og0zac5o 4768s 2024-11-23 21:45:58,603 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:45:58,604 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44001. Reason: failure-to-start- 4768s 2024-11-23 21:45:58,604 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:45:58,605 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40859. Reason: failure-to-start- 4768s 2024-11-23 21:45:58,605 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:45:58,606 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44721': TLS handshake failed with remote 'tls://127.0.0.1:44516': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:45:58,606 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44721': TLS handshake failed with remote 'tls://127.0.0.1:44530': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:45:58,607 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:45:59,613 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:45:59,620 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46183 4768s 2024-11-23 21:45:59,620 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42299/status 4768s 2024-11-23 21:45:59,620 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:45:59,634 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35017 4768s 2024-11-23 21:45:59,634 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35017 4768s 2024-11-23 21:45:59,634 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:45:59,634 - distributed.worker - INFO - dashboard at: 127.0.0.1:46025 4768s 2024-11-23 21:45:59,634 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46183 4768s 2024-11-23 21:45:59,634 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:45:59,634 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:45:59,634 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:45:59,634 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-xsntzfof 4768s 2024-11-23 21:45:59,634 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:45:59,637 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38771 4768s 2024-11-23 21:45:59,637 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38771 4768s 2024-11-23 21:45:59,637 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:45:59,637 - distributed.worker - INFO - dashboard at: 127.0.0.1:44667 4768s 2024-11-23 21:45:59,637 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46183 4768s 2024-11-23 21:45:59,637 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:45:59,637 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:45:59,637 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:45:59,637 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-isnntxfr 4768s 2024-11-23 21:45:59,637 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:45:59,638 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35017. Reason: failure-to-start- 4768s 2024-11-23 21:45:59,639 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:45:59,639 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38771. Reason: failure-to-start- 4768s 2024-11-23 21:45:59,639 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:45:59,640 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46183': TLS handshake failed with remote 'tls://127.0.0.1:59156': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:45:59,640 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46183': TLS handshake failed with remote 'tls://127.0.0.1:59168': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:45:59,642 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:46:00,648 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:46:00,655 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35603 4768s 2024-11-23 21:46:00,655 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38337/status 4768s 2024-11-23 21:46:00,655 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:46:00,669 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33899 4768s 2024-11-23 21:46:00,669 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33899 4768s 2024-11-23 21:46:00,669 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:46:00,669 - distributed.worker - INFO - dashboard at: 127.0.0.1:43853 4768s 2024-11-23 21:46:00,669 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35603 4768s 2024-11-23 21:46:00,670 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:46:00,670 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:46:00,670 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:46:00,670 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-n_11pwr3 4768s 2024-11-23 21:46:00,670 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:46:00,672 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34367 4768s 2024-11-23 21:46:00,673 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34367 4768s 2024-11-23 21:46:00,673 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:46:00,673 - distributed.worker - INFO - dashboard at: 127.0.0.1:36915 4768s 2024-11-23 21:46:00,673 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35603 4768s 2024-11-23 21:46:00,673 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:46:00,673 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:46:00,673 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:46:00,673 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-6dvwm_0l 4768s 2024-11-23 21:46:00,673 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:46:00,674 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33899. Reason: failure-to-start- 4768s 2024-11-23 21:46:00,674 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:46:00,675 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34367. Reason: failure-to-start- 4768s 2024-11-23 21:46:00,675 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:46:00,676 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35603': TLS handshake failed with remote 'tls://127.0.0.1:38194': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:46:00,676 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35603': TLS handshake failed with remote 'tls://127.0.0.1:38198': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:46:00,678 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:46:01,685 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:46:01,692 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40927 4768s 2024-11-23 21:46:01,692 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44313/status 4768s 2024-11-23 21:46:01,692 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:46:01,706 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41765 4768s 2024-11-23 21:46:01,706 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41765 4768s 2024-11-23 21:46:01,706 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:46:01,706 - distributed.worker - INFO - dashboard at: 127.0.0.1:40717 4768s 2024-11-23 21:46:01,706 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40927 4768s 2024-11-23 21:46:01,706 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:46:01,706 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:46:01,706 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:46:01,706 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-nq7pizl6 4768s 2024-11-23 21:46:01,706 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:46:01,709 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43501 4768s 2024-11-23 21:46:01,709 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43501 4768s 2024-11-23 21:46:01,709 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:46:01,709 - distributed.worker - INFO - dashboard at: 127.0.0.1:36013 4768s 2024-11-23 21:46:01,709 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40927 4768s 2024-11-23 21:46:01,709 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:46:01,709 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:46:01,709 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:46:01,709 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-w53dsvs8 4768s 2024-11-23 21:46:01,709 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:46:01,711 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41765. Reason: failure-to-start- 4768s 2024-11-23 21:46:01,711 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:46:01,712 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43501. Reason: failure-to-start- 4768s 2024-11-23 21:46:01,712 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:46:01,713 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40927': TLS handshake failed with remote 'tls://127.0.0.1:38276': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:46:01,713 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40927': TLS handshake failed with remote 'tls://127.0.0.1:38288': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:46:01,714 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:46:02,721 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:46:02,729 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34973 4768s 2024-11-23 21:46:02,729 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38363/status 4768s 2024-11-23 21:46:02,730 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:46:02,746 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42457 4768s 2024-11-23 21:46:02,746 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42457 4768s 2024-11-23 21:46:02,746 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:46:02,746 - distributed.worker - INFO - dashboard at: 127.0.0.1:45415 4768s 2024-11-23 21:46:02,746 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34973 4768s 2024-11-23 21:46:02,746 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:46:02,746 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:46:02,746 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:46:02,746 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-nq4xclxw 4768s 2024-11-23 21:46:02,746 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:46:02,749 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39465 4768s 2024-11-23 21:46:02,749 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39465 4768s 2024-11-23 21:46:02,749 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:46:02,749 - distributed.worker - INFO - dashboard at: 127.0.0.1:33967 4768s 2024-11-23 21:46:02,749 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34973 4768s 2024-11-23 21:46:02,749 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:46:02,749 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:46:02,749 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:46:02,749 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-_dfwdlow 4768s 2024-11-23 21:46:02,749 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:46:02,750 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42457. Reason: failure-to-start- 4768s 2024-11-23 21:46:02,751 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:46:02,751 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39465. Reason: failure-to-start- 4768s 2024-11-23 21:46:02,751 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:46:02,752 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34973': TLS handshake failed with remote 'tls://127.0.0.1:55586': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:46:02,753 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34973': TLS handshake failed with remote 'tls://127.0.0.1:55602': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:46:02,754 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:46:03,760 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:46:03,768 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34487 4768s 2024-11-23 21:46:03,769 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38679/status 4768s 2024-11-23 21:46:03,769 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:46:03,784 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33487 4768s 2024-11-23 21:46:03,784 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33487 4768s 2024-11-23 21:46:03,785 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:46:03,785 - distributed.worker - INFO - dashboard at: 127.0.0.1:42499 4768s 2024-11-23 21:46:03,785 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34487 4768s 2024-11-23 21:46:03,785 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:46:03,785 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:46:03,785 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:46:03,785 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-jyki5fc5 4768s 2024-11-23 21:46:03,785 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:46:03,787 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44153 4768s 2024-11-23 21:46:03,787 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44153 4768s 2024-11-23 21:46:03,787 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:46:03,787 - distributed.worker - INFO - dashboard at: 127.0.0.1:33961 4768s 2024-11-23 21:46:03,787 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34487 4768s 2024-11-23 21:46:03,787 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:46:03,787 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:46:03,787 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:46:03,787 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-j8zc7saw 4768s 2024-11-23 21:46:03,787 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:46:03,788 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33487. Reason: failure-to-start- 4768s 2024-11-23 21:46:03,788 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:46:03,789 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44153. Reason: failure-to-start- 4768s 2024-11-23 21:46:03,789 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:46:03,790 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34487': TLS handshake failed with remote 'tls://127.0.0.1:47554': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:46:03,790 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34487': TLS handshake failed with remote 'tls://127.0.0.1:47564': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:46:03,791 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:46:04,797 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:46:04,804 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34847 4768s 2024-11-23 21:46:04,804 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43437/status 4768s 2024-11-23 21:46:04,805 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:46:04,818 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35265 4768s 2024-11-23 21:46:04,818 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35265 4768s 2024-11-23 21:46:04,818 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:46:04,818 - distributed.worker - INFO - dashboard at: 127.0.0.1:40267 4768s 2024-11-23 21:46:04,818 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34847 4768s 2024-11-23 21:46:04,818 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:46:04,818 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:46:04,819 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:46:04,819 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-w8p1zm3p 4768s 2024-11-23 21:46:04,819 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:46:04,821 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43861 4768s 2024-11-23 21:46:04,821 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43861 4768s 2024-11-23 21:46:04,821 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:46:04,822 - distributed.worker - INFO - dashboard at: 127.0.0.1:37401 4768s 2024-11-23 21:46:04,822 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34847 4768s 2024-11-23 21:46:04,822 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:46:04,822 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:46:04,822 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:46:04,822 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-hpfz90ol 4768s 2024-11-23 21:46:04,822 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:46:04,825 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35265. Reason: failure-to-start- 4768s 2024-11-23 21:46:04,825 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:46:04,826 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43861. Reason: failure-to-start- 4768s 2024-11-23 21:46:04,826 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:46:04,827 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34847': TLS handshake failed with remote 'tls://127.0.0.1:51954': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:46:04,827 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34847': TLS handshake failed with remote 'tls://127.0.0.1:51956': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:46:04,828 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:46:05,837 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:46:05,844 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35853 4768s 2024-11-23 21:46:05,845 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41215/status 4768s 2024-11-23 21:46:05,845 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:46:05,860 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37407 4768s 2024-11-23 21:46:05,860 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37407 4768s 2024-11-23 21:46:05,860 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:46:05,860 - distributed.worker - INFO - dashboard at: 127.0.0.1:41759 4768s 2024-11-23 21:46:05,861 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35853 4768s 2024-11-23 21:46:05,861 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:46:05,861 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:46:05,861 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:46:05,861 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-d2p2o0qh 4768s 2024-11-23 21:46:05,861 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:46:05,863 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34943 4768s 2024-11-23 21:46:05,864 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34943 4768s 2024-11-23 21:46:05,864 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:46:05,864 - distributed.worker - INFO - dashboard at: 127.0.0.1:46625 4768s 2024-11-23 21:46:05,864 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35853 4768s 2024-11-23 21:46:05,864 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:46:05,864 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:46:05,864 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:46:05,864 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-osgucnp0 4768s 2024-11-23 21:46:05,864 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:46:05,866 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37407. Reason: failure-to-start- 4768s 2024-11-23 21:46:05,866 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:46:05,866 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34943. Reason: failure-to-start- 4768s 2024-11-23 21:46:05,867 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:46:05,870 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35853': TLS handshake failed with remote 'tls://127.0.0.1:44822': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:46:05,870 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35853': TLS handshake failed with remote 'tls://127.0.0.1:44832': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:46:05,872 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:46:06,878 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:46:06,885 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46395 4768s 2024-11-23 21:46:06,885 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38787/status 4768s 2024-11-23 21:46:06,885 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:46:06,899 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:32795 4768s 2024-11-23 21:46:06,899 - distributed.worker - INFO - Listening to: tls://127.0.0.1:32795 4768s 2024-11-23 21:46:06,899 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:46:06,899 - distributed.worker - INFO - dashboard at: 127.0.0.1:39767 4768s 2024-11-23 21:46:06,899 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 4768s 2024-11-23 21:46:06,899 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:46:06,899 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:46:06,899 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:46:06,899 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-hqk556ju 4768s 2024-11-23 21:46:06,899 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:46:06,901 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44247 4768s 2024-11-23 21:46:06,901 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44247 4768s 2024-11-23 21:46:06,901 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:46:06,901 - distributed.worker - INFO - dashboard at: 127.0.0.1:40831 4768s 2024-11-23 21:46:06,901 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 4768s 2024-11-23 21:46:06,901 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:46:06,902 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:46:06,902 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:46:06,902 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-pth71l76 4768s 2024-11-23 21:46:06,902 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:46:06,903 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:32795. Reason: failure-to-start- 4768s 2024-11-23 21:46:06,903 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:46:06,903 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44247. Reason: failure-to-start- 4768s 2024-11-23 21:46:06,904 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:46:06,907 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:34534': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:46:06,907 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:34536': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:46:06,909 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:46:07,914 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:46:07,920 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33223 4768s 2024-11-23 21:46:07,921 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42051/status 4768s 2024-11-23 21:46:07,921 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:46:07,935 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44435 4768s 2024-11-23 21:46:07,935 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44435 4768s 2024-11-23 21:46:07,935 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:46:07,935 - distributed.worker - INFO - dashboard at: 127.0.0.1:46853 4768s 2024-11-23 21:46:07,935 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33223 4768s 2024-11-23 21:46:07,935 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:46:07,935 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:46:07,935 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:46:07,935 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-v2dhu381 4768s 2024-11-23 21:46:07,935 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:46:07,937 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34691 4768s 2024-11-23 21:46:07,937 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34691 4768s 2024-11-23 21:46:07,937 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:46:07,937 - distributed.worker - INFO - dashboard at: 127.0.0.1:39099 4768s 2024-11-23 21:46:07,937 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33223 4768s 2024-11-23 21:46:07,937 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:46:07,937 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:46:07,937 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:46:07,937 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ohzuv9wv 4768s 2024-11-23 21:46:07,937 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:46:07,939 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44435. Reason: failure-to-start- 4768s 2024-11-23 21:46:07,939 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:46:07,939 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34691. Reason: failure-to-start- 4768s 2024-11-23 21:46:07,939 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:46:07,943 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33223': TLS handshake failed with remote 'tls://127.0.0.1:47658': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:46:07,943 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33223': TLS handshake failed with remote 'tls://127.0.0.1:47662': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:46:07,945 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:46:08,953 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:46:08,961 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38315 4768s 2024-11-23 21:46:08,961 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38539/status 4768s 2024-11-23 21:46:08,962 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:46:08,988 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43295 4768s 2024-11-23 21:46:08,988 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43295 4768s 2024-11-23 21:46:08,988 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:46:08,988 - distributed.worker - INFO - dashboard at: 127.0.0.1:35701 4768s 2024-11-23 21:46:08,988 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38315 4768s 2024-11-23 21:46:08,988 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:46:08,988 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:46:08,988 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:46:08,988 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-5ozsu_kp 4768s 2024-11-23 21:46:08,988 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:46:08,990 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36945 4768s 2024-11-23 21:46:08,990 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36945 4768s 2024-11-23 21:46:08,990 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:46:08,990 - distributed.worker - INFO - dashboard at: 127.0.0.1:37977 4768s 2024-11-23 21:46:08,990 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38315 4768s 2024-11-23 21:46:08,990 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:46:08,990 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:46:08,990 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:46:08,990 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-s0ggklh3 4768s 2024-11-23 21:46:08,990 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:46:08,994 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43295. Reason: failure-to-start- 4768s 2024-11-23 21:46:08,994 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:46:08,994 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36945. Reason: failure-to-start- 4768s 2024-11-23 21:46:08,994 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:46:08,995 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38315': TLS handshake failed with remote 'tls://127.0.0.1:42474': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:46:08,996 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38315': TLS handshake failed with remote 'tls://127.0.0.1:42486': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:46:08,997 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:46:10,002 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:46:10,009 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33771 4768s 2024-11-23 21:46:10,010 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39829/status 4768s 2024-11-23 21:46:10,010 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:46:10,024 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42793 4768s 2024-11-23 21:46:10,024 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42793 4768s 2024-11-23 21:46:10,024 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:46:10,024 - distributed.worker - INFO - dashboard at: 127.0.0.1:36537 4768s 2024-11-23 21:46:10,024 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33771 4768s 2024-11-23 21:46:10,024 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:46:10,024 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:46:10,024 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:46:10,024 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-6dz5lew5 4768s 2024-11-23 21:46:10,024 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:46:10,026 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42527 4768s 2024-11-23 21:46:10,026 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42527 4768s 2024-11-23 21:46:10,026 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:46:10,026 - distributed.worker - INFO - dashboard at: 127.0.0.1:38283 4768s 2024-11-23 21:46:10,026 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33771 4768s 2024-11-23 21:46:10,026 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:46:10,026 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:46:10,026 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:46:10,026 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-dda67ofg 4768s 2024-11-23 21:46:10,026 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:46:10,031 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42793. Reason: failure-to-start- 4768s 2024-11-23 21:46:10,031 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:46:10,031 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42527. Reason: failure-to-start- 4768s 2024-11-23 21:46:10,031 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:46:10,033 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33771': TLS handshake failed with remote 'tls://127.0.0.1:44450': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:46:10,033 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33771': TLS handshake failed with remote 'tls://127.0.0.1:44464': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:46:10,034 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:46:11,039 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:46:11,046 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44439 4768s 2024-11-23 21:46:11,046 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37359/status 4768s 2024-11-23 21:46:11,047 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:46:11,060 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37139 4768s 2024-11-23 21:46:11,060 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37139 4768s 2024-11-23 21:46:11,060 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:46:11,060 - distributed.worker - INFO - dashboard at: 127.0.0.1:43335 4768s 2024-11-23 21:46:11,060 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44439 4768s 2024-11-23 21:46:11,060 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:46:11,060 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:46:11,060 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:46:11,060 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-sda61a11 4768s 2024-11-23 21:46:11,060 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:46:11,062 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39245 4768s 2024-11-23 21:46:11,062 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39245 4768s 2024-11-23 21:46:11,062 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:46:11,062 - distributed.worker - INFO - dashboard at: 127.0.0.1:46527 4768s 2024-11-23 21:46:11,063 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44439 4768s 2024-11-23 21:46:11,063 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:46:11,063 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:46:11,063 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:46:11,063 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-7iw_eeml 4768s 2024-11-23 21:46:11,063 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:46:11,066 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37139. Reason: failure-to-start- 4768s 2024-11-23 21:46:11,066 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:46:11,066 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39245. Reason: failure-to-start- 4768s 2024-11-23 21:46:11,067 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:46:11,068 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44439': TLS handshake failed with remote 'tls://127.0.0.1:51462': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:46:11,068 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44439': TLS handshake failed with remote 'tls://127.0.0.1:51476': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:46:11,069 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:46:12,080 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:46:12,091 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42559 4768s 2024-11-23 21:46:12,092 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40807/status 4768s 2024-11-23 21:46:12,092 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:46:12,109 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38151 4768s 2024-11-23 21:46:12,110 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38151 4768s 2024-11-23 21:46:12,110 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:46:12,110 - distributed.worker - INFO - dashboard at: 127.0.0.1:42645 4768s 2024-11-23 21:46:12,110 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42559 4768s 2024-11-23 21:46:12,110 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:46:12,110 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:46:12,110 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:46:12,110 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-rm3t1iem 4768s 2024-11-23 21:46:12,110 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:46:12,112 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:32935 4768s 2024-11-23 21:46:12,112 - distributed.worker - INFO - Listening to: tls://127.0.0.1:32935 4768s 2024-11-23 21:46:12,112 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:46:12,112 - distributed.worker - INFO - dashboard at: 127.0.0.1:41765 4768s 2024-11-23 21:46:12,112 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42559 4768s 2024-11-23 21:46:12,112 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:46:12,112 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:46:12,112 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:46:12,113 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-wiyzlp8w 4768s 2024-11-23 21:46:12,113 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:46:12,114 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38151. Reason: failure-to-start- 4768s 2024-11-23 21:46:12,114 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:46:12,114 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:32935. Reason: failure-to-start- 4768s 2024-11-23 21:46:12,115 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:46:12,116 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42559': TLS handshake failed with remote 'tls://127.0.0.1:47124': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:46:12,116 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42559': TLS handshake failed with remote 'tls://127.0.0.1:47140': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:46:12,117 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:46:13,123 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:46:13,131 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43001 4768s 2024-11-23 21:46:13,131 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45403/status 4768s 2024-11-23 21:46:13,134 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:46:13,149 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38773 4768s 2024-11-23 21:46:13,149 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38773 4768s 2024-11-23 21:46:13,149 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:46:13,149 - distributed.worker - INFO - dashboard at: 127.0.0.1:40439 4768s 2024-11-23 21:46:13,150 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43001 4768s 2024-11-23 21:46:13,150 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:46:13,150 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:46:13,150 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:46:13,150 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-w_cw2loq 4768s 2024-11-23 21:46:13,150 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:46:13,152 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39463 4768s 2024-11-23 21:46:13,152 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39463 4768s 2024-11-23 21:46:13,152 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:46:13,152 - distributed.worker - INFO - dashboard at: 127.0.0.1:36017 4768s 2024-11-23 21:46:13,152 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43001 4768s 2024-11-23 21:46:13,152 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:46:13,152 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:46:13,152 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:46:13,152 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-syf48g83 4768s 2024-11-23 21:46:13,152 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:46:13,153 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38773. Reason: failure-to-start- 4768s 2024-11-23 21:46:13,153 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:46:13,153 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39463. Reason: failure-to-start- 4768s 2024-11-23 21:46:13,154 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:46:13,155 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43001': TLS handshake failed with remote 'tls://127.0.0.1:53078': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:46:13,155 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43001': TLS handshake failed with remote 'tls://127.0.0.1:53094': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:46:13,159 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:46:14,164 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:46:14,171 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40317 4768s 2024-11-23 21:46:14,172 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45139/status 4768s 2024-11-23 21:46:14,172 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:46:14,185 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38705 4768s 2024-11-23 21:46:14,185 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38705 4768s 2024-11-23 21:46:14,185 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:46:14,186 - distributed.worker - INFO - dashboard at: 127.0.0.1:35747 4768s 2024-11-23 21:46:14,186 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40317 4768s 2024-11-23 21:46:14,186 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:46:14,186 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:46:14,186 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:46:14,186 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-_3a0ji2u 4768s 2024-11-23 21:46:14,186 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:46:14,189 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42121 4768s 2024-11-23 21:46:14,189 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42121 4768s 2024-11-23 21:46:14,189 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:46:14,189 - distributed.worker - INFO - dashboard at: 127.0.0.1:45417 4768s 2024-11-23 21:46:14,189 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40317 4768s 2024-11-23 21:46:14,189 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:46:14,189 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:46:14,189 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:46:14,189 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-dt6d_qc3 4768s 2024-11-23 21:46:14,189 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:46:14,190 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38705. Reason: failure-to-start- 4768s 2024-11-23 21:46:14,190 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:46:14,191 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42121. Reason: failure-to-start- 4768s 2024-11-23 21:46:14,191 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:46:14,192 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40317': TLS handshake failed with remote 'tls://127.0.0.1:42220': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:46:14,192 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40317': TLS handshake failed with remote 'tls://127.0.0.1:42234': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:46:14,194 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:46:15,198 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:46:15,205 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41743 4768s 2024-11-23 21:46:15,205 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33451/status 4768s 2024-11-23 21:46:15,206 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:46:15,220 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:32865 4768s 2024-11-23 21:46:15,220 - distributed.worker - INFO - Listening to: tls://127.0.0.1:32865 4768s 2024-11-23 21:46:15,220 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:46:15,220 - distributed.worker - INFO - dashboard at: 127.0.0.1:46057 4768s 2024-11-23 21:46:15,220 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41743 4768s 2024-11-23 21:46:15,220 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:46:15,220 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:46:15,220 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:46:15,220 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-q2c1tnrn 4768s 2024-11-23 21:46:15,220 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:46:15,222 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37091 4768s 2024-11-23 21:46:15,222 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37091 4768s 2024-11-23 21:46:15,222 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:46:15,222 - distributed.worker - INFO - dashboard at: 127.0.0.1:41511 4768s 2024-11-23 21:46:15,223 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41743 4768s 2024-11-23 21:46:15,223 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:46:15,223 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:46:15,223 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:46:15,223 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-22cs801b 4768s 2024-11-23 21:46:15,223 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:46:15,224 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:32865. Reason: failure-to-start- 4768s 2024-11-23 21:46:15,224 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:46:15,224 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37091. Reason: failure-to-start- 4768s 2024-11-23 21:46:15,225 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:46:15,226 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41743': TLS handshake failed with remote 'tls://127.0.0.1:39104': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:46:15,226 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41743': TLS handshake failed with remote 'tls://127.0.0.1:39120': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:46:15,227 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:46:16,245 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:46:16,256 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33773 4768s 2024-11-23 21:46:16,257 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35397/status 4768s 2024-11-23 21:46:16,260 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:46:16,275 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41897 4768s 2024-11-23 21:46:16,275 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41897 4768s 2024-11-23 21:46:16,275 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:46:16,275 - distributed.worker - INFO - dashboard at: 127.0.0.1:46301 4768s 2024-11-23 21:46:16,275 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33773 4768s 2024-11-23 21:46:16,275 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:46:16,275 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:46:16,275 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:46:16,275 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-s6rcoboy 4768s 2024-11-23 21:46:16,276 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:46:16,278 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40327 4768s 2024-11-23 21:46:16,278 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40327 4768s 2024-11-23 21:46:16,278 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:46:16,278 - distributed.worker - INFO - dashboard at: 127.0.0.1:44391 4768s 2024-11-23 21:46:16,278 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33773 4768s 2024-11-23 21:46:16,278 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:46:16,278 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:46:16,279 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:46:16,279 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-iba531g2 4768s 2024-11-23 21:46:16,279 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:46:16,282 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41897. Reason: failure-to-start- 4768s 2024-11-23 21:46:16,282 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:46:16,283 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40327. Reason: failure-to-start- 4768s 2024-11-23 21:46:16,283 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:46:16,284 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33773': TLS handshake failed with remote 'tls://127.0.0.1:48544': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:46:16,284 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33773': TLS handshake failed with remote 'tls://127.0.0.1:48550': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:46:16,285 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:46:17,291 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:46:17,299 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37027 4768s 2024-11-23 21:46:17,299 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44791/status 4768s 2024-11-23 21:46:17,299 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:46:17,313 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44569 4768s 2024-11-23 21:46:17,313 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44569 4768s 2024-11-23 21:46:17,313 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:46:17,313 - distributed.worker - INFO - dashboard at: 127.0.0.1:44247 4768s 2024-11-23 21:46:17,313 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37027 4768s 2024-11-23 21:46:17,313 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:46:17,313 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:46:17,313 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:46:17,313 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-jxh2emdw 4768s 2024-11-23 21:46:17,313 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:46:17,315 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42925 4768s 2024-11-23 21:46:17,315 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42925 4768s 2024-11-23 21:46:17,315 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:46:17,315 - distributed.worker - INFO - dashboard at: 127.0.0.1:45933 4768s 2024-11-23 21:46:17,315 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37027 4768s 2024-11-23 21:46:17,315 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:46:17,315 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:46:17,315 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:46:17,315 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-q42ynaeh 4768s 2024-11-23 21:46:17,315 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:46:17,319 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44569. Reason: failure-to-start- 4768s 2024-11-23 21:46:17,319 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:46:17,319 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42925. Reason: failure-to-start- 4768s 2024-11-23 21:46:17,319 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:46:17,323 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37027': TLS handshake failed with remote 'tls://127.0.0.1:39974': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:46:17,323 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37027': TLS handshake failed with remote 'tls://127.0.0.1:39982': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:46:17,324 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:46:18,330 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:46:18,336 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33225 4768s 2024-11-23 21:46:18,336 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38103/status 4768s 2024-11-23 21:46:18,337 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:46:18,352 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33531 4768s 2024-11-23 21:46:18,352 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33531 4768s 2024-11-23 21:46:18,352 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:46:18,352 - distributed.worker - INFO - dashboard at: 127.0.0.1:40789 4768s 2024-11-23 21:46:18,352 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 4768s 2024-11-23 21:46:18,352 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:46:18,353 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:46:18,353 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:46:18,353 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-t_p9_sck 4768s 2024-11-23 21:46:18,353 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:46:18,354 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46635 4768s 2024-11-23 21:46:18,355 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46635 4768s 2024-11-23 21:46:18,355 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:46:18,355 - distributed.worker - INFO - dashboard at: 127.0.0.1:39927 4768s 2024-11-23 21:46:18,355 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33225 4768s 2024-11-23 21:46:18,355 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:46:18,355 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:46:18,355 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:46:18,355 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-pib2023z 4768s 2024-11-23 21:46:18,355 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:46:18,358 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33531. Reason: failure-to-start- 4768s 2024-11-23 21:46:18,359 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:46:18,359 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46635. Reason: failure-to-start- 4768s 2024-11-23 21:46:18,359 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:46:18,360 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:40608': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:46:18,361 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33225': TLS handshake failed with remote 'tls://127.0.0.1:40614': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:46:18,362 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:46:19,368 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:46:19,375 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35151 4768s 2024-11-23 21:46:19,375 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33627/status 4768s 2024-11-23 21:46:19,375 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:46:19,390 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37495 4768s 2024-11-23 21:46:19,390 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37495 4768s 2024-11-23 21:46:19,390 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:46:19,390 - distributed.worker - INFO - dashboard at: 127.0.0.1:45397 4768s 2024-11-23 21:46:19,390 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35151 4768s 2024-11-23 21:46:19,390 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:46:19,390 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:46:19,390 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:46:19,390 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-qyyjyrby 4768s 2024-11-23 21:46:19,390 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:46:19,392 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41585 4768s 2024-11-23 21:46:19,392 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41585 4768s 2024-11-23 21:46:19,392 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:46:19,392 - distributed.worker - INFO - dashboard at: 127.0.0.1:44901 4768s 2024-11-23 21:46:19,392 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35151 4768s 2024-11-23 21:46:19,392 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:46:19,392 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:46:19,392 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:46:19,392 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-f8loukic 4768s 2024-11-23 21:46:19,393 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:46:19,397 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37495. Reason: failure-to-start- 4768s 2024-11-23 21:46:19,397 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:46:19,398 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41585. Reason: failure-to-start- 4768s 2024-11-23 21:46:19,398 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:46:19,399 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35151': TLS handshake failed with remote 'tls://127.0.0.1:49310': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:46:19,399 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35151': TLS handshake failed with remote 'tls://127.0.0.1:49324': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:46:19,403 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:46:20,407 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:46:20,414 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38491 4768s 2024-11-23 21:46:20,414 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46881/status 4768s 2024-11-23 21:46:20,414 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:46:20,429 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37819 4768s 2024-11-23 21:46:20,429 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37819 4768s 2024-11-23 21:46:20,429 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:46:20,429 - distributed.worker - INFO - dashboard at: 127.0.0.1:33967 4768s 2024-11-23 21:46:20,429 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38491 4768s 2024-11-23 21:46:20,429 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:46:20,429 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:46:20,429 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:46:20,429 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-c5f35xro 4768s 2024-11-23 21:46:20,430 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:46:20,431 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33985 4768s 2024-11-23 21:46:20,432 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33985 4768s 2024-11-23 21:46:20,432 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:46:20,432 - distributed.worker - INFO - dashboard at: 127.0.0.1:41531 4768s 2024-11-23 21:46:20,432 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38491 4768s 2024-11-23 21:46:20,432 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:46:20,432 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:46:20,432 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:46:20,432 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ak3n7ehk 4768s 2024-11-23 21:46:20,432 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:46:20,436 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37819. Reason: failure-to-start- 4768s 2024-11-23 21:46:20,437 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:46:20,437 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33985. Reason: failure-to-start- 4768s 2024-11-23 21:46:20,437 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:46:20,438 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38491': TLS handshake failed with remote 'tls://127.0.0.1:40804': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:46:20,438 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38491': TLS handshake failed with remote 'tls://127.0.0.1:40814': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:46:20,442 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:46:21,449 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:46:21,455 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45829 4768s 2024-11-23 21:46:21,455 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35217/status 4768s 2024-11-23 21:46:21,455 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:46:21,470 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42281 4768s 2024-11-23 21:46:21,470 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42281 4768s 2024-11-23 21:46:21,470 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:46:21,470 - distributed.worker - INFO - dashboard at: 127.0.0.1:40629 4768s 2024-11-23 21:46:21,470 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45829 4768s 2024-11-23 21:46:21,470 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:46:21,470 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:46:21,470 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:46:21,470 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-sdbz96b_ 4768s 2024-11-23 21:46:21,471 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:46:21,472 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36647 4768s 2024-11-23 21:46:21,472 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36647 4768s 2024-11-23 21:46:21,472 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:46:21,472 - distributed.worker - INFO - dashboard at: 127.0.0.1:40137 4768s 2024-11-23 21:46:21,472 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45829 4768s 2024-11-23 21:46:21,473 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:46:21,473 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:46:21,473 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:46:21,473 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-886t9tjk 4768s 2024-11-23 21:46:21,473 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:46:21,477 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42281. Reason: failure-to-start- 4768s 2024-11-23 21:46:21,477 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:46:21,477 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36647. Reason: failure-to-start- 4768s 2024-11-23 21:46:21,477 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:46:21,480 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45829': TLS handshake failed with remote 'tls://127.0.0.1:34118': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:46:21,480 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45829': TLS handshake failed with remote 'tls://127.0.0.1:34126': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:46:21,481 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:46:22,488 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:46:22,495 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45399 4768s 2024-11-23 21:46:22,496 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36743/status 4768s 2024-11-23 21:46:22,496 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:46:22,510 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40557 4768s 2024-11-23 21:46:22,510 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40557 4768s 2024-11-23 21:46:22,510 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:46:22,510 - distributed.worker - INFO - dashboard at: 127.0.0.1:42811 4768s 2024-11-23 21:46:22,510 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45399 4768s 2024-11-23 21:46:22,510 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:46:22,510 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:46:22,510 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:46:22,510 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-_0hq0cr_ 4768s 2024-11-23 21:46:22,510 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:46:22,512 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39695 4768s 2024-11-23 21:46:22,512 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39695 4768s 2024-11-23 21:46:22,512 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:46:22,512 - distributed.worker - INFO - dashboard at: 127.0.0.1:40855 4768s 2024-11-23 21:46:22,512 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45399 4768s 2024-11-23 21:46:22,512 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:46:22,512 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:46:22,512 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:46:22,512 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-mqcribcp 4768s 2024-11-23 21:46:22,512 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:46:22,513 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40557. Reason: failure-to-start- 4768s 2024-11-23 21:46:22,514 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:46:22,514 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39695. Reason: failure-to-start- 4768s 2024-11-23 21:46:22,514 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:46:22,517 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45399': TLS handshake failed with remote 'tls://127.0.0.1:41008': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:46:22,518 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45399': TLS handshake failed with remote 'tls://127.0.0.1:41014': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:46:22,521 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s __________________________ test_worker_client_gather ___________________________ 4768s 4768s fut = , timeout = 0 4768s 4768s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 4768s async with asyncio.timeout(timeout): 4768s > return await fut 4768s 4768s /usr/lib/python3/dist-packages/distributed/utils.py:1960: 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s /usr/lib/python3/dist-packages/distributed/worker.py:1480: in start_unsafe 4768s await self._register_with_scheduler() 4768s /usr/lib/python3/dist-packages/distributed/worker.py:1179: in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s /usr/lib/python3/dist-packages/distributed/comm/core.py:342: in connect 4768s comm = await wait_for( 4768s /usr/lib/python3/dist-packages/distributed/utils.py:1960: in wait_for 4768s return await fut 4768s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:546: in connect 4768s stream = await self.client.connect( 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s 4768s self = , host = '127.0.0.1' 4768s port = 42105, af = 4768s ssl_options = 4768s max_buffer_size = 8364507136.0, source_ip = None, source_port = None 4768s timeout = None 4768s 4768s async def connect( 4768s self, 4768s host: str, 4768s port: int, 4768s af: socket.AddressFamily = socket.AF_UNSPEC, 4768s ssl_options: Optional[Union[Dict[str, Any], ssl.SSLContext]] = None, 4768s max_buffer_size: Optional[int] = None, 4768s source_ip: Optional[str] = None, 4768s source_port: Optional[int] = None, 4768s timeout: Optional[Union[float, datetime.timedelta]] = None, 4768s ) -> IOStream: 4768s """Connect to the given host and port. 4768s 4768s Asynchronously returns an `.IOStream` (or `.SSLIOStream` if 4768s ``ssl_options`` is not None). 4768s 4768s Using the ``source_ip`` kwarg, one can specify the source 4768s IP address to use when establishing the connection. 4768s In case the user needs to resolve and 4768s use a specific interface, it has to be handled outside 4768s of Tornado as this depends very much on the platform. 4768s 4768s Raises `TimeoutError` if the input future does not complete before 4768s ``timeout``, which may be specified in any form allowed by 4768s `.IOLoop.add_timeout` (i.e. a `datetime.timedelta` or an absolute time 4768s relative to `.IOLoop.time`) 4768s 4768s Similarly, when the user requires a certain source port, it can 4768s be specified using the ``source_port`` arg. 4768s 4768s .. versionchanged:: 4.5 4768s Added the ``source_ip`` and ``source_port`` arguments. 4768s 4768s .. versionchanged:: 5.0 4768s Added the ``timeout`` argument. 4768s """ 4768s if timeout is not None: 4768s if isinstance(timeout, numbers.Real): 4768s timeout = IOLoop.current().time() + timeout 4768s elif isinstance(timeout, datetime.timedelta): 4768s timeout = IOLoop.current().time() + timeout.total_seconds() 4768s else: 4768s raise TypeError("Unsupported timeout %r" % timeout) 4768s if timeout is not None: 4768s addrinfo = await gen.with_timeout( 4768s timeout, self.resolver.resolve(host, port, af) 4768s ) 4768s else: 4768s addrinfo = await self.resolver.resolve(host, port, af) 4768s connector = _Connector( 4768s addrinfo, 4768s functools.partial( 4768s self._create_stream, 4768s max_buffer_size, 4768s source_ip=source_ip, 4768s source_port=source_port, 4768s ), 4768s ) 4768s > af, addr, stream = await connector.start(connect_timeout=timeout) 4768s E asyncio.exceptions.CancelledError 4768s 4768s /usr/lib/python3/dist-packages/tornado/tcpclient.py:279: CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s self = 4768s 4768s @final 4768s async def start(self): 4768s async with self._startup_lock: 4768s if self.status == Status.failed: 4768s assert self.__startup_exc is not None 4768s raise self.__startup_exc 4768s elif self.status != Status.init: 4768s return self 4768s timeout = getattr(self, "death_timeout", None) 4768s 4768s async def _close_on_failure(exc: Exception) -> None: 4768s await self.close(reason=f"failure-to-start-{str(type(exc))}") 4768s self.status = Status.failed 4768s self.__startup_exc = exc 4768s 4768s try: 4768s > await wait_for(self.start_unsafe(), timeout=timeout) 4768s 4768s /usr/lib/python3/dist-packages/distributed/core.py:664: 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 4768s async with asyncio.timeout(timeout): 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s 4768s self = 4768s exc_type = 4768s exc_val = CancelledError(), exc_tb = 4768s 4768s async def __aexit__( 4768s self, 4768s exc_type: Optional[Type[BaseException]], 4768s exc_val: Optional[BaseException], 4768s exc_tb: Optional[TracebackType], 4768s ) -> Optional[bool]: 4768s assert self._state in (_State.ENTERED, _State.EXPIRING) 4768s 4768s if self._timeout_handler is not None: 4768s self._timeout_handler.cancel() 4768s self._timeout_handler = None 4768s 4768s if self._state is _State.EXPIRING: 4768s self._state = _State.EXPIRED 4768s 4768s if self._task.uncancel() <= self._cancelling and exc_type is not None: 4768s # Since there are no new cancel requests, we're 4768s # handling this. 4768s if issubclass(exc_type, exceptions.CancelledError): 4768s > raise TimeoutError from exc_val 4768s E TimeoutError 4768s 4768s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s @contextlib.asynccontextmanager 4768s async def _cluster_factory(): 4768s workers = [] 4768s s = None 4768s try: 4768s for _ in range(60): 4768s try: 4768s > s, ws = await start_cluster( 4768s nthreads, 4768s scheduler, 4768s security=security, 4768s Worker=Worker, 4768s scheduler_kwargs=scheduler_kwargs, 4768s worker_kwargs=merge( 4768s {"death_timeout": min(15, int(deadline.remaining))}, 4768s worker_kwargs, 4768s ), 4768s ) 4768s 4768s /usr/lib/python3/dist-packages/distributed/utils_test.py:966: 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s /usr/lib/python3/dist-packages/distributed/utils_test.py:789: in start_cluster 4768s await asyncio.gather(*workers) 4768s /usr/lib/python3.13/asyncio/tasks.py:737: in _wrap_awaitable 4768s return await awaitable 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s 4768s self = 4768s 4768s @final 4768s async def start(self): 4768s async with self._startup_lock: 4768s if self.status == Status.failed: 4768s assert self.__startup_exc is not None 4768s raise self.__startup_exc 4768s elif self.status != Status.init: 4768s return self 4768s timeout = getattr(self, "death_timeout", None) 4768s 4768s async def _close_on_failure(exc: Exception) -> None: 4768s await self.close(reason=f"failure-to-start-{str(type(exc))}") 4768s self.status = Status.failed 4768s self.__startup_exc = exc 4768s 4768s try: 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s except asyncio.TimeoutError as exc: 4768s await _close_on_failure(exc) 4768s > raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s E TimeoutError: Worker start timed out after 0s. 4768s 4768s /usr/lib/python3/dist-packages/distributed/core.py:667: TimeoutError 4768s 4768s During handling of the above exception, another exception occurred: 4768s 4768s fut = ._..test_func..async_fn at 0xe99ad938> 4768s timeout = 60 4768s 4768s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 4768s async with asyncio.timeout(timeout): 4768s > return await fut 4768s 4768s /usr/lib/python3/dist-packages/distributed/utils.py:1960: 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s /usr/lib/python3/dist-packages/distributed/utils_test.py:999: in async_fn 4768s _cluster_factory() as (s, workers), 4768s /usr/lib/python3.13/contextlib.py:214: in __aenter__ 4768s return await anext(self.gen) 4768s /usr/lib/python3/dist-packages/distributed/utils_test.py:983: in _cluster_factory 4768s await asyncio.sleep(1) 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s 4768s delay = 1, result = None 4768s 4768s async def sleep(delay, result=None): 4768s """Coroutine that completes after a given time (in seconds).""" 4768s if delay <= 0: 4768s await __sleep0() 4768s return result 4768s 4768s if math.isnan(delay): 4768s raise ValueError("Invalid delay: NaN (not a number)") 4768s 4768s loop = events.get_running_loop() 4768s future = loop.create_future() 4768s h = loop.call_later(delay, 4768s futures._set_result_unless_cancelled, 4768s future, result) 4768s try: 4768s > return await future 4768s E asyncio.exceptions.CancelledError 4768s 4768s /usr/lib/python3.13/asyncio/tasks.py:718: CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s args = (), kwds = {} 4768s 4768s @wraps(func) 4768s def inner(*args, **kwds): 4768s with self._recreate_cm(): 4768s > return func(*args, **kwds) 4768s 4768s /usr/lib/python3.13/contextlib.py:85: 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s /usr/lib/python3.13/contextlib.py:85: in inner 4768s return func(*args, **kwds) 4768s /usr/lib/python3/dist-packages/distributed/utils_test.py:1102: in test_func 4768s return _run_and_close_tornado(async_fn_outer) 4768s /usr/lib/python3/dist-packages/distributed/utils_test.py:378: in _run_and_close_tornado 4768s return asyncio_run(inner_fn(), loop_factory=get_loop_factory()) 4768s /usr/lib/python3.13/asyncio/runners.py:194: in run 4768s return runner.run(main) 4768s /usr/lib/python3.13/asyncio/runners.py:118: in run 4768s return self._loop.run_until_complete(task) 4768s /usr/lib/python3.13/asyncio/base_events.py:720: in run_until_complete 4768s return future.result() 4768s /usr/lib/python3/dist-packages/distributed/utils_test.py:375: in inner_fn 4768s return await async_fn(*args, **kwargs) 4768s /usr/lib/python3/dist-packages/distributed/utils_test.py:1099: in async_fn_outer 4768s return await utils_wait_for(async_fn(), timeout=timeout * 2) 4768s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 4768s async with asyncio.timeout(timeout): 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s 4768s self = 4768s exc_type = 4768s exc_val = CancelledError(), exc_tb = 4768s 4768s async def __aexit__( 4768s self, 4768s exc_type: Optional[Type[BaseException]], 4768s exc_val: Optional[BaseException], 4768s exc_tb: Optional[TracebackType], 4768s ) -> Optional[bool]: 4768s assert self._state in (_State.ENTERED, _State.EXPIRING) 4768s 4768s if self._timeout_handler is not None: 4768s self._timeout_handler.cancel() 4768s self._timeout_handler = None 4768s 4768s if self._state is _State.EXPIRING: 4768s self._state = _State.EXPIRED 4768s 4768s if self._task.uncancel() <= self._cancelling and exc_type is not None: 4768s # Since there are no new cancel requests, we're 4768s # handling this. 4768s if issubclass(exc_type, exceptions.CancelledError): 4768s > raise TimeoutError from exc_val 4768s E TimeoutError 4768s 4768s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 4768s ----------------------------- Captured stderr call ----------------------------- 4768s 2024-11-23 21:46:23,827 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:46:23,836 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:23,836 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46827/status 4768s 2024-11-23 21:46:23,836 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:46:23,852 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35149 4768s 2024-11-23 21:46:23,852 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35149 4768s 2024-11-23 21:46:23,852 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:46:23,852 - distributed.worker - INFO - dashboard at: 127.0.0.1:36669 4768s 2024-11-23 21:46:23,852 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:23,852 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:46:23,852 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:46:23,852 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:46:23,852 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-k10k8gta 4768s 2024-11-23 21:46:23,852 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:46:23,854 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40485 4768s 2024-11-23 21:46:23,854 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40485 4768s 2024-11-23 21:46:23,854 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:46:23,854 - distributed.worker - INFO - dashboard at: 127.0.0.1:44233 4768s 2024-11-23 21:46:23,854 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:23,854 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:46:23,854 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:46:23,854 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:46:23,854 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-h14qe8h7 4768s 2024-11-23 21:46:23,854 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:46:23,867 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:23,867 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:23,868 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:38204': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:23,868 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:38206': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:23,980 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:23,980 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:23,980 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:38222': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:23,980 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:38238': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:24,093 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:24,093 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:24,093 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:38248': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:24,093 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:38254': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:24,205 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:24,205 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:24,205 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:38270': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:24,205 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:38284': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:24,317 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:24,317 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:24,317 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:38290': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:24,317 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:38306': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:24,429 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:24,430 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:24,430 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:38314': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:24,430 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:38326': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:24,543 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:24,543 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:24,543 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:38332': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:24,543 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:38346': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:24,655 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:24,655 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:24,655 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:38356': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:24,655 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:38364': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:24,767 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:24,768 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:24,768 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:38376': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:24,768 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:38382': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:24,880 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:24,880 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:24,880 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:38386': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:24,880 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:38394': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:24,992 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:24,992 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:24,992 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:38408': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:24,992 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:38414': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:25,104 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:25,104 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:25,104 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:38430': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:25,105 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:38438': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:25,217 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:25,217 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:25,217 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:38444': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:25,218 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:38456': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:25,330 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:25,330 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:25,330 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:38472': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:25,330 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:38484': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:25,442 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:25,443 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:25,443 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:38498': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:25,443 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:38502': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:25,554 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:25,554 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:25,555 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:38518': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:25,555 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:38524': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:25,667 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:25,667 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:25,668 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:38540': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:25,668 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:38548': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:25,781 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:25,781 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:25,781 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:38552': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:25,781 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:38556': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:25,893 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:25,894 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:25,894 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:38564': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:25,894 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:38576': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:26,006 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:26,006 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:26,006 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:38584': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:26,006 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:38588': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:26,118 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:26,118 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:26,119 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:38598': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:26,119 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:38612': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:26,231 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:26,231 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:26,231 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:38622': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:26,231 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:38626': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:26,344 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:26,344 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:26,348 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:38632': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:26,348 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:38646': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:26,456 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:26,456 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:26,456 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:38648': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:26,456 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:38650': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:26,569 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:26,569 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:26,569 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:38662': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:26,569 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:38670': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:26,682 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:26,682 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:26,682 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:38672': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:26,682 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:38674': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:26,794 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:26,795 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:26,795 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:38690': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:26,795 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:38704': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:26,908 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:26,908 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:26,908 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:38712': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:26,908 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:38728': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:27,020 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:27,020 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:27,020 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:38740': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:27,020 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:38752': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:27,132 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:27,132 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:27,133 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:38756': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:27,133 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:38772': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:27,245 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:27,246 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:27,246 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:38776': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:27,246 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:38788': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:27,358 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:27,358 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:27,359 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:38796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:27,359 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:38806': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:27,471 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:27,471 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:27,472 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:38822': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:27,472 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:38834': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:27,585 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:27,586 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:27,586 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:38844': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:27,586 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:38846': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:27,698 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:27,698 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:27,699 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:38862': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:27,699 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:38868': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:27,811 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:27,811 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:27,812 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:38884': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:27,812 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:38888': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:27,923 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:27,923 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:27,924 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:38904': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:27,924 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:38908': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:28,036 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:28,036 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:28,037 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:38924': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:28,037 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:38938': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:28,148 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:28,148 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:28,149 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:38954': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:28,149 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:38958': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:28,261 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:28,261 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:28,261 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:38966': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:28,262 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:38976': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:28,374 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:28,374 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:28,374 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:38978': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:28,374 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:38992': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:28,486 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:28,487 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:28,487 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:39006': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:28,487 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:39020': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:28,599 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:28,599 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:28,599 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:39026': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:28,599 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:39030': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:28,712 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:28,712 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:28,712 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:39038': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:28,713 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:39044': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:28,824 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:28,824 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:28,824 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:39056': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:28,824 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:39062': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:28,937 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:28,937 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:28,937 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:39072': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:28,938 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:39076': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:29,048 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:29,049 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:29,049 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:39086': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:29,050 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:39088': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:29,157 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:29,161 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:39098': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:29,162 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:29,162 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:39112': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:29,265 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:29,266 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:39124': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:29,272 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:29,272 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:39126': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:29,372 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:29,375 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:39134': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:29,381 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:29,381 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:39150': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:29,481 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:29,481 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:39152': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:29,505 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:29,507 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:39166': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:29,590 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:29,591 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:39174': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:29,613 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:29,613 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:39184': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:29,697 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:29,698 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:39200': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:29,720 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:29,720 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:39204': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:29,805 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:29,805 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:39214': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:29,828 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:29,828 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:39226': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:29,912 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:29,913 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:39236': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:29,934 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:29,935 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:39250': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:30,020 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:30,020 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:39254': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:30,042 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:30,042 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:39260': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:30,127 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:30,127 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:39272': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:30,149 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:30,149 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:39278': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:30,234 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:30,235 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:39284': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:30,257 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:30,258 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:39286': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:30,346 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:30,346 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:39296': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:30,364 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:30,365 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:39308': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:30,453 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:30,453 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:39320': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:30,472 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:30,472 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:39336': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:30,560 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:30,560 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:39348': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:30,579 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:30,579 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:39362': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:30,668 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:30,668 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:39370': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:30,686 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:30,687 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:39384': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:30,775 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:30,775 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:39394': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:30,794 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:30,794 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:39398': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:30,882 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:30,882 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:39414': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:30,901 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:30,901 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:39416': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:30,990 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:30,990 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:39418': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:31,008 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:31,008 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:39432': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:31,097 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:31,097 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:39448': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:31,115 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:31,115 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:39454': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:31,204 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:31,205 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:39458': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:31,222 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:31,223 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:39468': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:31,312 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:31,312 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:39480': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:31,330 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:31,330 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:39494': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:31,420 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:31,421 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:39498': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:31,437 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:31,438 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:39510': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:31,527 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:31,528 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:39520': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:31,544 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:31,545 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:57646': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:31,634 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:31,635 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:57650': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:31,652 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:31,652 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:57660': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:31,742 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:31,742 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:57672': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:31,758 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:31,759 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:57676': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:31,849 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:31,849 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:57682': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:31,866 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:31,866 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:57692': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:31,956 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:31,956 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:57706': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:31,973 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:31,973 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:57708': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:32,063 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:32,064 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:57722': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:32,080 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:32,080 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:57730': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:32,170 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:32,171 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:57732': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:32,187 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:32,187 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:57744': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:32,277 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:32,278 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:57748': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:32,294 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:32,294 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:57764': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:32,385 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:32,386 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:57780': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:32,402 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:32,402 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:57782': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:32,492 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:32,493 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:57794': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:32,509 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:32,510 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:57798': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:32,599 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:32,600 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:57814': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:32,616 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:32,617 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:57816': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:32,707 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:32,709 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:57820': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:32,723 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:32,724 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:57824': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:32,816 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:32,817 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:57838': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:32,830 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:32,831 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:57842': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:32,923 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:32,924 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:57846': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:32,937 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:32,938 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:57848': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:33,030 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:33,031 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:57860': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:33,044 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:33,045 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:57870': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:33,138 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:33,138 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:57882': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:33,152 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:33,152 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:57888': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:33,245 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:33,245 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:57904': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:33,259 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:33,259 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:57906': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:33,352 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:33,352 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:57908': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:33,366 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:33,366 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:57918': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:33,459 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:33,459 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:57934': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:33,473 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:33,473 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:57944': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:33,566 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:33,567 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:57948': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:33,580 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:33,581 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:57952': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:33,673 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:33,674 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:57956': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:33,687 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:33,688 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:57970': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:33,781 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:33,781 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:57978': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:33,795 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:33,795 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:57990': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:33,888 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:33,888 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:58004': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:33,902 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:33,902 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:58014': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:33,995 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:33,996 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:58030': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:34,009 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:34,010 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:58042': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:34,104 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:34,104 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:58054': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:34,116 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:34,116 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:58056': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:34,212 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:34,212 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:58058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:34,222 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:34,223 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:58060': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:34,319 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:34,319 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:58062': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:34,329 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:34,331 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:58076': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:34,426 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:34,427 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:58082': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:34,437 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:34,437 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:58086': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:34,534 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:34,534 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:58098': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:34,544 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:34,544 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:58112': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:34,641 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:34,642 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:58114': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:34,651 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:34,651 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:58124': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:34,748 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:34,748 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:58134': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:34,758 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:34,758 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:58146': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:34,855 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:34,855 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:58150': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:34,864 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:34,865 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:58154': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:34,962 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:34,962 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:58158': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:34,971 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:34,972 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:58172': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:35,068 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:35,069 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:58176': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:35,078 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:35,078 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:58178': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:35,176 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:35,176 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:58184': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:35,184 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:35,185 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:58198': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:35,283 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:35,283 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:58202': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:35,291 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:35,292 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:58210': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:35,390 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:35,390 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:58224': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:35,398 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:35,399 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:58226': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:35,497 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:35,497 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:58236': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:35,505 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:35,506 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:58238': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:35,604 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:35,604 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:58242': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:35,612 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:35,613 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:58256': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:35,712 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:35,712 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:58266': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:35,719 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:35,719 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:58280': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:35,819 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:35,820 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:58296': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:35,826 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:35,826 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:58304': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:35,927 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:35,928 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:58312': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:35,933 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:35,934 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:58324': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:36,036 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:36,037 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:58330': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:36,042 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:36,043 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:58346': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:36,144 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:36,145 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:58362': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:36,151 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:36,151 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:58364': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:36,252 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:36,252 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:58370': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:36,258 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:36,258 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:58384': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:36,359 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:36,359 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:58400': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:36,365 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:36,365 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:58402': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:36,466 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:36,467 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:58418': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:36,472 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:36,473 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:58434': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:36,574 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:36,575 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:58438': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:36,580 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:36,581 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:58452': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:36,681 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:36,681 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:58464': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:36,687 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:36,688 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:58474': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:36,789 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:36,789 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:58478': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:36,795 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:36,795 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:58494': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:36,896 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:36,897 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:58498': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:36,902 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:36,903 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:58514': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:37,004 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:37,005 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:58518': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:37,010 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:37,010 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:58520': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:37,111 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:37,111 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:58532': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:37,117 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:37,117 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:58544': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:37,218 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:37,219 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:58558': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:37,224 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:37,224 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:58560': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:37,325 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:37,326 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:58574': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:37,331 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:37,332 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:58590': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:37,448 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:37,452 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:58604': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:37,453 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:37,454 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:58612': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:37,556 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:37,556 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:58614': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:37,562 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:37,562 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:58628': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:37,663 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:37,663 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:58636': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:37,670 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:37,670 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:58652': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:37,770 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:37,771 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:58668': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:37,777 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:37,777 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:58678': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:37,879 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:37,880 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:58690': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:37,886 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:37,886 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:58700': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:37,987 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:37,987 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:58704': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:37,993 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:37,993 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:58720': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:38,094 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:38,094 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:58724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:38,100 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:38,100 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:58738': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:38,201 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:38,202 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:58740': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:38,207 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:38,207 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:58746': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:38,308 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:38,309 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:58762': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:38,314 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:38,315 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:58776': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:38,415 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:38,415 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:58788': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:38,421 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:38,421 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:58796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:38,522 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:38,523 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:58806': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:38,528 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:38,529 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:58814': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:38,629 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:38,630 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:58816': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:38,635 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:38,636 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:58818': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:38,736 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:38,737 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:58834': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:38,742 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:38,743 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:58838': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:38,846 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:38,847 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:58850': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:38,852 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37747 4768s 2024-11-23 21:46:38,853 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35149. Reason: failure-to-start- 4768s 2024-11-23 21:46:38,853 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:46:38,855 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37747': TLS handshake failed with remote 'tls://127.0.0.1:58858': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:38,856 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40485. Reason: failure-to-start- 4768s 2024-11-23 21:46:38,856 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:46:38,858 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 15s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 4768s stream = await stream.start_tls( 4768s ^^^^^^^^^^^^^^^^^^^^^^^ 4768s False, ssl_options=ssl_options, server_hostname=host 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 4768s self.socket.do_handshake() 4768s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 4768s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 4768s self._sslobj.do_handshake() 4768s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 4768s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 4768s raise FatalCommClosedError( 4768s ...<2 lines>... 4768s ) from err 4768s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 4768s 4768s During handling of the above exception, another exception occurred: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1218, in _register_with_scheduler 4768s await asyncio.sleep(0.1) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 718, in sleep 4768s return await future 4768s ^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 15s. 4768s 2024-11-23 21:46:39,872 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:46:39,882 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:39,883 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46267/status 4768s 2024-11-23 21:46:39,883 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:46:39,896 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37113 4768s 2024-11-23 21:46:39,897 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37113 4768s 2024-11-23 21:46:39,897 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:46:39,897 - distributed.worker - INFO - dashboard at: 127.0.0.1:45177 4768s 2024-11-23 21:46:39,897 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:39,897 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:46:39,897 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:46:39,897 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:46:39,897 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ydk6dzwj 4768s 2024-11-23 21:46:39,897 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:46:39,899 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44449 4768s 2024-11-23 21:46:39,899 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44449 4768s 2024-11-23 21:46:39,899 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:46:39,899 - distributed.worker - INFO - dashboard at: 127.0.0.1:45593 4768s 2024-11-23 21:46:39,899 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:39,899 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:46:39,899 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:46:39,899 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:46:39,899 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-4az2qpge 4768s 2024-11-23 21:46:39,899 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:46:39,912 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:39,912 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:39,912 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:39518': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:39,912 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:39526': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:40,024 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:40,024 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:40,024 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:39528': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:40,024 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:39544': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:40,136 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:40,136 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:40,136 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:39556': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:40,137 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:39568': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:40,249 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:40,249 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:40,249 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:39570': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:40,250 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:39572': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:40,362 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:40,362 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:40,362 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:39576': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:40,362 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:39590': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:40,474 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:40,474 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:40,475 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:39600': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:40,475 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:39608': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:40,587 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:40,588 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:40,588 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:39616': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:40,588 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:39628': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:40,700 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:40,700 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:40,701 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:39630': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:40,701 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:39632': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:40,813 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:40,813 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:40,814 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:39648': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:40,814 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:39664': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:40,925 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:40,925 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:40,926 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:39668': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:40,926 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:39670': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:41,037 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:41,037 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:41,038 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:39674': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:41,038 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:39680': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:41,149 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:41,149 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:41,150 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:39696': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:41,150 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:39702': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:41,261 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:41,261 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:41,261 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:39706': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:41,261 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:39712': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:41,373 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:41,374 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:41,374 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:39718': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:41,374 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:39724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:41,487 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:41,487 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:41,487 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:39736': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:41,487 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:39746': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:41,599 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:41,599 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:41,599 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:59148': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:41,599 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:59158': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:41,712 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:41,712 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:41,712 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:59168': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:41,712 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:59176': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:41,825 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:41,825 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:41,825 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:59178': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:41,825 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:59188': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:41,944 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:41,946 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:41,947 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:59200': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:41,947 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:59214': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:42,059 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:42,059 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:42,059 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:59216': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:42,059 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:59232': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:42,172 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:42,172 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:42,173 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:59244': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:42,173 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:59252': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:42,284 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:42,284 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:42,284 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:59262': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:42,284 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:59268': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:42,398 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:42,398 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:42,399 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:59284': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:42,399 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:59294': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:42,510 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:42,512 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:42,513 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:59300': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:42,513 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:59306': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:42,625 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:42,625 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:42,625 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:59318': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:42,625 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:59334': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:42,737 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:42,737 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:42,738 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:59346': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:42,738 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:59360': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:42,851 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:42,852 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:42,852 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:59370': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:42,852 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:59384': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:42,959 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:42,963 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:59394': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:42,964 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:42,965 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:59406': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:43,066 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:43,067 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:59418': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:43,072 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:43,073 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:59426': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:43,173 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:43,174 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:59440': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:43,179 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:43,180 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:59448': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:43,281 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:43,282 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:59454': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:43,287 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:43,288 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:59462': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:43,393 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:43,394 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:59468': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:43,399 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:43,399 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:59470': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:43,501 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:43,502 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:59482': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:43,507 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:43,508 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:59486': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:43,609 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:43,609 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:59498': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:43,615 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:43,615 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:59514': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:43,716 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:43,716 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:59518': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:43,722 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:43,722 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:59528': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:43,822 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:43,822 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:59540': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:43,828 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:43,828 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:59554': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:43,930 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:43,931 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:59570': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:43,936 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:43,936 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:59578': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:44,038 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:44,038 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:59592': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:44,044 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:44,044 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:59594': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:44,145 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:44,145 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:59598': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:44,151 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:44,151 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:59614': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:44,254 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:44,255 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:59620': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:44,260 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:44,261 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:59622': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:44,361 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:44,362 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:59634': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:44,367 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:44,368 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:59642': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:44,469 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:44,469 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:59656': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:44,475 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:44,475 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:59672': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:44,575 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:44,576 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:59682': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:44,582 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:44,582 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:59698': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:44,683 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:44,683 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:59710': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:44,689 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:44,689 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:59720': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:44,790 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:44,791 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:59722': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:44,796 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:44,797 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:59728': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:44,897 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:44,897 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:59744': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:44,903 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:44,903 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:59748': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:45,004 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:45,005 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:59756': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:45,011 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:45,011 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:59758': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:45,113 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:45,113 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:59762': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:45,119 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:45,119 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:59770': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:45,220 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:45,221 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:59782': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:45,226 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:45,227 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:59796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:45,327 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:45,328 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:59810': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:45,334 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:45,334 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:59816': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:45,434 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:45,435 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:59832': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:45,441 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:45,441 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:59838': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:45,543 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:45,544 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:59842': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:45,549 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:45,550 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:59856': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:45,650 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:45,650 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:59870': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:45,656 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:45,656 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:59874': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:45,758 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:45,759 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:59890': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:45,765 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:45,765 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:59906': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:45,866 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:45,868 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:59914': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:45,873 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:45,887 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:59918': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:45,976 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:45,977 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:59928': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:45,982 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:45,983 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:59936': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:46,083 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:46,084 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:59950': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:46,090 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:46,090 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:59956': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:46,191 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:46,191 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:59972': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:46,197 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:46,197 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:59988': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:46,298 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:46,299 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:60004': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:46,304 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:46,304 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:60018': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:46,406 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:46,406 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:60026': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:46,412 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:46,412 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:60030': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:46,512 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:46,513 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:60044': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:46,518 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:46,519 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:60058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:46,620 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:46,621 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:60060': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:46,627 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:46,627 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:60070': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:46,728 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:46,729 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:60084': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:46,734 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:46,734 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:60092': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:46,835 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:46,836 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:60098': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:46,844 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:46,845 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:60106': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:46,943 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:46,944 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:60114': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:46,950 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:46,951 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:60128': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:47,050 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:47,050 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:60132': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:47,057 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:47,058 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:60144': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:47,158 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:47,158 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:60152': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:47,164 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:47,164 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:60162': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:47,264 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:47,265 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:60164': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:47,270 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:47,271 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:60172': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:47,371 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:47,372 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:60174': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:47,377 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:47,378 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:60186': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:47,479 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:47,479 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:60202': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:47,486 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:47,486 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:60214': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:47,586 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:47,587 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:60218': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:47,592 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:47,593 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:60222': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:47,693 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:47,694 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:60234': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:47,699 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:47,700 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:60244': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:47,800 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:47,800 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:60252': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:47,806 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:47,807 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:60264': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:47,908 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:47,908 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:60278': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:47,914 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:47,914 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:60292': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:48,015 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:48,015 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:60302': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:48,021 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:48,021 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:60308': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:48,122 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:48,122 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:60320': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:48,128 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:48,128 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:60324': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:48,229 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:48,230 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:60328': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:48,235 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:48,236 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:60344': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:48,337 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:48,337 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:60358': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:48,346 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:48,346 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:60366': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:48,443 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:48,444 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:60378': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:48,453 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:48,453 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:60382': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:48,550 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:48,551 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:60394': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:48,559 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:48,560 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:60408': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:48,658 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:48,659 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:60410': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:48,666 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:48,666 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:60426': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:48,766 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:48,766 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:60438': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:48,772 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:48,772 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:60454': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:48,873 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:48,873 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:60464': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:48,879 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:48,879 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:60478': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:48,981 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:48,982 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:60480': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:48,987 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:48,988 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:60488': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:49,088 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:49,089 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:60498': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:49,094 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:49,095 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:60502': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:49,201 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:49,202 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:60518': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:49,206 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:49,207 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:60534': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:49,309 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:49,309 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:60536': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:49,315 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:49,315 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:60538': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:49,415 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:49,416 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:60544': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:49,422 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:49,422 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:60546': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:49,522 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:49,523 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:60554': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:49,528 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:49,529 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:60558': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:49,630 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:49,631 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:60574': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:49,637 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:49,637 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:60590': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:49,738 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:49,739 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:60600': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:49,745 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:49,745 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:60610': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:49,847 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:49,847 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:60612': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:49,853 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:49,853 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:60624': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:49,954 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:49,955 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:60630': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:49,961 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:49,961 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:60644': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:50,062 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:50,063 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:60650': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:50,069 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:50,069 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:60652': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:50,171 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:50,172 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:60668': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:50,177 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:50,178 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:60674': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:50,278 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:50,278 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:60688': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:50,284 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:50,285 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:60694': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:50,386 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:50,390 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:60708': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:50,396 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:50,396 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:60716': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:50,493 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:50,494 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:60720': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:50,502 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:50,502 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:60736': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:50,601 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:50,601 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:60742': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:50,608 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:50,609 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:60746': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:50,709 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:50,710 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:60762': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:50,716 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:50,716 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:60778': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:50,817 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:50,819 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:60792': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:50,825 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:50,825 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:60806': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:50,924 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:50,924 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:60822': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:50,931 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:50,932 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:60826': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:51,031 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:51,031 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:60832': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:51,038 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:51,039 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:60846': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:51,138 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:51,139 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:60860': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:51,145 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:51,145 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:60864': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:51,245 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:51,245 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:60880': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:51,251 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:51,252 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:60892': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:51,352 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:51,352 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:60898': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:51,358 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:51,359 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:60906': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:51,459 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:51,460 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:60918': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:51,466 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:51,466 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:60932': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:51,566 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:51,567 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:59990': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:51,573 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:51,573 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:59998': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:51,673 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:51,674 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:60008': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:51,679 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:51,680 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:60018': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:51,781 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:51,781 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:60022': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:51,787 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:51,788 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:60038': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:51,892 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:51,892 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:60048': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:51,898 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:51,898 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:60058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:51,998 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:51,999 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:60074': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:52,005 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:52,005 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:60086': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:52,107 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:52,107 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:60096': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:52,113 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:52,113 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:60102': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:52,223 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:52,225 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:60110': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:52,230 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:52,231 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:60112': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:52,332 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:52,332 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:60122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:52,338 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:52,344 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:60138': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:52,439 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:52,440 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:60142': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:52,448 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:52,448 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:60148': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:52,547 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:52,547 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:60162': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:52,555 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:52,556 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:60172': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:52,654 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:52,654 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:60182': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:52,661 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:52,662 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:60186': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:52,761 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:52,761 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:60188': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:52,768 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:52,769 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:60204': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:52,868 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:52,869 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:60218': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:52,875 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41721 4768s 2024-11-23 21:46:52,875 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41721': TLS handshake failed with remote 'tls://127.0.0.1:60220': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:46:52,897 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37113. Reason: failure-to-start- 4768s 2024-11-23 21:46:52,897 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:46:52,898 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44449. Reason: failure-to-start- 4768s 2024-11-23 21:46:52,899 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:46:52,902 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 13s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 4768s stream = await stream.start_tls( 4768s ^^^^^^^^^^^^^^^^^^^^^^^ 4768s False, ssl_options=ssl_options, server_hostname=host 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 4768s self.socket.do_handshake() 4768s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 4768s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 4768s self._sslobj.do_handshake() 4768s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 4768s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 4768s raise FatalCommClosedError( 4768s ...<2 lines>... 4768s ) from err 4768s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 4768s 4768s During handling of the above exception, another exception occurred: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1218, in _register_with_scheduler 4768s await asyncio.sleep(0.1) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 718, in sleep 4768s return await future 4768s ^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 13s. 4768s 2024-11-23 21:46:53,918 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:46:53,927 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39443 4768s 2024-11-23 21:46:53,928 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44475/status 4768s 2024-11-23 21:46:53,928 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:46:53,948 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41401 4768s 2024-11-23 21:46:53,948 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41401 4768s 2024-11-23 21:46:53,948 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:46:53,948 - distributed.worker - INFO - dashboard at: 127.0.0.1:37417 4768s 2024-11-23 21:46:53,948 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39443 4768s 2024-11-23 21:46:53,948 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:46:53,948 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:46:53,948 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:46:53,948 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-26szx3h_ 4768s 2024-11-23 21:46:53,948 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:46:53,951 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43621 4768s 2024-11-23 21:46:53,951 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43621 4768s 2024-11-23 21:46:53,951 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:46:53,951 - distributed.worker - INFO - dashboard at: 127.0.0.1:35561 4768s 2024-11-23 21:46:53,951 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39443 4768s 2024-11-23 21:46:53,951 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:46:53,951 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:46:53,951 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:46:53,951 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-6a2xg1tl 4768s 2024-11-23 21:46:53,952 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:46:53,953 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41401. Reason: failure-to-start- 4768s 2024-11-23 21:46:53,954 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:46:53,954 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43621. Reason: failure-to-start- 4768s 2024-11-23 21:46:53,954 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:46:53,956 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39443': TLS handshake failed with remote 'tls://127.0.0.1:43124': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:46:53,956 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39443': TLS handshake failed with remote 'tls://127.0.0.1:43132': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:46:53,958 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:46:54,964 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:46:54,972 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43341 4768s 2024-11-23 21:46:54,972 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46557/status 4768s 2024-11-23 21:46:54,973 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:46:54,988 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34911 4768s 2024-11-23 21:46:54,988 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34911 4768s 2024-11-23 21:46:54,988 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:46:54,988 - distributed.worker - INFO - dashboard at: 127.0.0.1:44005 4768s 2024-11-23 21:46:54,988 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43341 4768s 2024-11-23 21:46:54,988 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:46:54,988 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:46:54,988 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:46:54,988 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-b3ypzc9l 4768s 2024-11-23 21:46:54,988 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:46:54,990 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35685 4768s 2024-11-23 21:46:54,990 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35685 4768s 2024-11-23 21:46:54,990 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:46:54,990 - distributed.worker - INFO - dashboard at: 127.0.0.1:43455 4768s 2024-11-23 21:46:54,991 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43341 4768s 2024-11-23 21:46:54,991 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:46:54,991 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:46:54,991 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:46:54,991 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-_mpolmol 4768s 2024-11-23 21:46:54,991 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:46:54,992 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34911. Reason: failure-to-start- 4768s 2024-11-23 21:46:54,992 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:46:54,992 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35685. Reason: failure-to-start- 4768s 2024-11-23 21:46:54,992 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:46:54,994 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43341': TLS handshake failed with remote 'tls://127.0.0.1:44034': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:46:54,994 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43341': TLS handshake failed with remote 'tls://127.0.0.1:44036': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:46:54,995 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:46:56,002 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:46:56,010 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41299 4768s 2024-11-23 21:46:56,010 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44853/status 4768s 2024-11-23 21:46:56,010 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:46:56,048 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43591 4768s 2024-11-23 21:46:56,048 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43591 4768s 2024-11-23 21:46:56,048 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:46:56,048 - distributed.worker - INFO - dashboard at: 127.0.0.1:34983 4768s 2024-11-23 21:46:56,048 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41299 4768s 2024-11-23 21:46:56,048 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:46:56,048 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:46:56,048 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:46:56,048 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-87kr1fmt 4768s 2024-11-23 21:46:56,048 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:46:56,051 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45609 4768s 2024-11-23 21:46:56,051 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45609 4768s 2024-11-23 21:46:56,051 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:46:56,051 - distributed.worker - INFO - dashboard at: 127.0.0.1:36151 4768s 2024-11-23 21:46:56,051 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41299 4768s 2024-11-23 21:46:56,051 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:46:56,051 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:46:56,051 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:46:56,051 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-56f9bw92 4768s 2024-11-23 21:46:56,051 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:46:56,053 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43591. Reason: failure-to-start- 4768s 2024-11-23 21:46:56,053 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:46:56,053 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45609. Reason: failure-to-start- 4768s 2024-11-23 21:46:56,054 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:46:56,055 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41299': TLS handshake failed with remote 'tls://127.0.0.1:35392': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:46:56,055 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41299': TLS handshake failed with remote 'tls://127.0.0.1:35404': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:46:56,056 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:46:57,063 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:46:57,071 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46425 4768s 2024-11-23 21:46:57,071 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37967/status 4768s 2024-11-23 21:46:57,071 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:46:57,086 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45069 4768s 2024-11-23 21:46:57,086 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45069 4768s 2024-11-23 21:46:57,086 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:46:57,086 - distributed.worker - INFO - dashboard at: 127.0.0.1:37653 4768s 2024-11-23 21:46:57,086 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46425 4768s 2024-11-23 21:46:57,086 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:46:57,087 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:46:57,087 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:46:57,087 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-u58_65i7 4768s 2024-11-23 21:46:57,087 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:46:57,088 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37285 4768s 2024-11-23 21:46:57,089 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37285 4768s 2024-11-23 21:46:57,089 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:46:57,089 - distributed.worker - INFO - dashboard at: 127.0.0.1:40671 4768s 2024-11-23 21:46:57,089 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46425 4768s 2024-11-23 21:46:57,089 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:46:57,089 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:46:57,089 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:46:57,089 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-n13emqwo 4768s 2024-11-23 21:46:57,089 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:46:57,090 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45069. Reason: failure-to-start- 4768s 2024-11-23 21:46:57,090 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:46:57,090 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37285. Reason: failure-to-start- 4768s 2024-11-23 21:46:57,091 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:46:57,092 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46425': TLS handshake failed with remote 'tls://127.0.0.1:35576': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:46:57,092 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46425': TLS handshake failed with remote 'tls://127.0.0.1:35586': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:46:57,093 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:46:58,099 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:46:58,106 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39795 4768s 2024-11-23 21:46:58,107 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36841/status 4768s 2024-11-23 21:46:58,107 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:46:58,120 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33277 4768s 2024-11-23 21:46:58,120 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33277 4768s 2024-11-23 21:46:58,120 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:46:58,120 - distributed.worker - INFO - dashboard at: 127.0.0.1:45257 4768s 2024-11-23 21:46:58,120 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39795 4768s 2024-11-23 21:46:58,120 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:46:58,121 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:46:58,121 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:46:58,121 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-69l2d5u4 4768s 2024-11-23 21:46:58,121 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:46:58,123 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38697 4768s 2024-11-23 21:46:58,123 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38697 4768s 2024-11-23 21:46:58,123 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:46:58,123 - distributed.worker - INFO - dashboard at: 127.0.0.1:40523 4768s 2024-11-23 21:46:58,123 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39795 4768s 2024-11-23 21:46:58,123 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:46:58,124 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:46:58,124 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:46:58,124 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ozfmzc6u 4768s 2024-11-23 21:46:58,124 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:46:58,125 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33277. Reason: failure-to-start- 4768s 2024-11-23 21:46:58,125 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:46:58,126 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38697. Reason: failure-to-start- 4768s 2024-11-23 21:46:58,126 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:46:58,127 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39795': TLS handshake failed with remote 'tls://127.0.0.1:51102': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:46:58,127 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39795': TLS handshake failed with remote 'tls://127.0.0.1:51108': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:46:58,129 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:46:59,133 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:46:59,140 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38989 4768s 2024-11-23 21:46:59,140 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34081/status 4768s 2024-11-23 21:46:59,141 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:46:59,155 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:32995 4768s 2024-11-23 21:46:59,155 - distributed.worker - INFO - Listening to: tls://127.0.0.1:32995 4768s 2024-11-23 21:46:59,155 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:46:59,155 - distributed.worker - INFO - dashboard at: 127.0.0.1:34259 4768s 2024-11-23 21:46:59,155 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38989 4768s 2024-11-23 21:46:59,155 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:46:59,155 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:46:59,155 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:46:59,155 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-_w42ohpo 4768s 2024-11-23 21:46:59,155 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:46:59,157 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46273 4768s 2024-11-23 21:46:59,157 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46273 4768s 2024-11-23 21:46:59,157 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:46:59,157 - distributed.worker - INFO - dashboard at: 127.0.0.1:38851 4768s 2024-11-23 21:46:59,157 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38989 4768s 2024-11-23 21:46:59,157 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:46:59,157 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:46:59,157 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:46:59,157 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-jy_wmh64 4768s 2024-11-23 21:46:59,157 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:46:59,158 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:32995. Reason: failure-to-start- 4768s 2024-11-23 21:46:59,158 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:46:59,159 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46273. Reason: failure-to-start- 4768s 2024-11-23 21:46:59,159 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:46:59,160 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38989': TLS handshake failed with remote 'tls://127.0.0.1:38334': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:46:59,160 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38989': TLS handshake failed with remote 'tls://127.0.0.1:38346': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:46:59,162 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:47:00,167 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:47:00,175 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33555 4768s 2024-11-23 21:47:00,175 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34021/status 4768s 2024-11-23 21:47:00,176 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:47:00,188 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34609 4768s 2024-11-23 21:47:00,189 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34609 4768s 2024-11-23 21:47:00,189 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:47:00,189 - distributed.worker - INFO - dashboard at: 127.0.0.1:39229 4768s 2024-11-23 21:47:00,189 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33555 4768s 2024-11-23 21:47:00,189 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:47:00,189 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:47:00,189 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:47:00,189 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-sl6vqt5b 4768s 2024-11-23 21:47:00,189 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:47:00,191 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39967 4768s 2024-11-23 21:47:00,191 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39967 4768s 2024-11-23 21:47:00,191 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:47:00,191 - distributed.worker - INFO - dashboard at: 127.0.0.1:35123 4768s 2024-11-23 21:47:00,191 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33555 4768s 2024-11-23 21:47:00,191 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:47:00,191 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:47:00,191 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:47:00,191 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-cydecuuz 4768s 2024-11-23 21:47:00,191 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:47:00,192 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34609. Reason: failure-to-start- 4768s 2024-11-23 21:47:00,192 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:47:00,193 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39967. Reason: failure-to-start- 4768s 2024-11-23 21:47:00,193 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:47:00,194 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33555': TLS handshake failed with remote 'tls://127.0.0.1:57484': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:47:00,194 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33555': TLS handshake failed with remote 'tls://127.0.0.1:57498': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:47:00,195 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:47:01,202 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:47:01,214 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43895 4768s 2024-11-23 21:47:01,215 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44215/status 4768s 2024-11-23 21:47:01,215 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:47:01,241 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45557 4768s 2024-11-23 21:47:01,242 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45557 4768s 2024-11-23 21:47:01,242 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:47:01,242 - distributed.worker - INFO - dashboard at: 127.0.0.1:32999 4768s 2024-11-23 21:47:01,242 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43895 4768s 2024-11-23 21:47:01,242 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:47:01,242 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:47:01,242 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:47:01,242 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-z3x5a8ay 4768s 2024-11-23 21:47:01,242 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:47:01,246 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36541 4768s 2024-11-23 21:47:01,247 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36541 4768s 2024-11-23 21:47:01,247 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:47:01,247 - distributed.worker - INFO - dashboard at: 127.0.0.1:42051 4768s 2024-11-23 21:47:01,247 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43895 4768s 2024-11-23 21:47:01,247 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:47:01,247 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:47:01,247 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:47:01,247 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-juzj4v0t 4768s 2024-11-23 21:47:01,247 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:47:01,250 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45557. Reason: failure-to-start- 4768s 2024-11-23 21:47:01,250 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:47:01,251 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36541. Reason: failure-to-start- 4768s 2024-11-23 21:47:01,251 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:47:01,254 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43895': TLS handshake failed with remote 'tls://127.0.0.1:36188': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:47:01,254 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43895': TLS handshake failed with remote 'tls://127.0.0.1:36198': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:47:01,256 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:47:02,265 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:47:02,277 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34497 4768s 2024-11-23 21:47:02,278 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40531/status 4768s 2024-11-23 21:47:02,279 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:47:02,301 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33297 4768s 2024-11-23 21:47:02,301 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33297 4768s 2024-11-23 21:47:02,301 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:47:02,302 - distributed.worker - INFO - dashboard at: 127.0.0.1:33131 4768s 2024-11-23 21:47:02,302 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34497 4768s 2024-11-23 21:47:02,302 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:47:02,302 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:47:02,302 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:47:02,302 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-3igjufjn 4768s 2024-11-23 21:47:02,302 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:47:02,304 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33371 4768s 2024-11-23 21:47:02,304 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33371 4768s 2024-11-23 21:47:02,304 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:47:02,304 - distributed.worker - INFO - dashboard at: 127.0.0.1:45805 4768s 2024-11-23 21:47:02,304 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34497 4768s 2024-11-23 21:47:02,304 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:47:02,304 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:47:02,304 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:47:02,304 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-fyw42oee 4768s 2024-11-23 21:47:02,304 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:47:02,307 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33297. Reason: failure-to-start- 4768s 2024-11-23 21:47:02,307 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:47:02,307 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33371. Reason: failure-to-start- 4768s 2024-11-23 21:47:02,308 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:47:02,309 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34497': TLS handshake failed with remote 'tls://127.0.0.1:47958': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:47:02,309 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34497': TLS handshake failed with remote 'tls://127.0.0.1:47968': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:47:02,310 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:47:03,315 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:47:03,322 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34637 4768s 2024-11-23 21:47:03,322 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35673/status 4768s 2024-11-23 21:47:03,322 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:47:03,335 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35309 4768s 2024-11-23 21:47:03,335 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35309 4768s 2024-11-23 21:47:03,335 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:47:03,335 - distributed.worker - INFO - dashboard at: 127.0.0.1:39755 4768s 2024-11-23 21:47:03,335 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34637 4768s 2024-11-23 21:47:03,335 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:47:03,335 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:47:03,335 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:47:03,335 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-bc2d4nj0 4768s 2024-11-23 21:47:03,335 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:47:03,337 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35463 4768s 2024-11-23 21:47:03,337 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35463 4768s 2024-11-23 21:47:03,337 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:47:03,337 - distributed.worker - INFO - dashboard at: 127.0.0.1:37191 4768s 2024-11-23 21:47:03,337 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34637 4768s 2024-11-23 21:47:03,337 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:47:03,337 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:47:03,337 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:47:03,337 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-rs2vvsk4 4768s 2024-11-23 21:47:03,337 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:47:03,338 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35309. Reason: failure-to-start- 4768s 2024-11-23 21:47:03,338 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:47:03,339 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35463. Reason: failure-to-start- 4768s 2024-11-23 21:47:03,339 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:47:03,342 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34637': TLS handshake failed with remote 'tls://127.0.0.1:44506': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:47:03,342 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34637': TLS handshake failed with remote 'tls://127.0.0.1:44510': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:47:03,343 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:47:04,351 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:47:04,358 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34017 4768s 2024-11-23 21:47:04,358 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42695/status 4768s 2024-11-23 21:47:04,359 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:47:04,372 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36685 4768s 2024-11-23 21:47:04,372 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36685 4768s 2024-11-23 21:47:04,372 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:47:04,372 - distributed.worker - INFO - dashboard at: 127.0.0.1:44325 4768s 2024-11-23 21:47:04,372 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34017 4768s 2024-11-23 21:47:04,372 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:47:04,372 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:47:04,372 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:47:04,372 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-nyev3cin 4768s 2024-11-23 21:47:04,372 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:47:04,374 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35393 4768s 2024-11-23 21:47:04,374 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35393 4768s 2024-11-23 21:47:04,374 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:47:04,374 - distributed.worker - INFO - dashboard at: 127.0.0.1:35771 4768s 2024-11-23 21:47:04,374 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34017 4768s 2024-11-23 21:47:04,374 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:47:04,374 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:47:04,374 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:47:04,374 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-9qq5dx00 4768s 2024-11-23 21:47:04,374 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:47:04,377 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36685. Reason: failure-to-start- 4768s 2024-11-23 21:47:04,377 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:47:04,378 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35393. Reason: failure-to-start- 4768s 2024-11-23 21:47:04,378 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:47:04,380 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34017': TLS handshake failed with remote 'tls://127.0.0.1:48426': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:47:04,380 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34017': TLS handshake failed with remote 'tls://127.0.0.1:48428': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:47:04,381 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:47:05,388 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:47:05,394 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46153 4768s 2024-11-23 21:47:05,394 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41545/status 4768s 2024-11-23 21:47:05,394 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:47:05,408 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45813 4768s 2024-11-23 21:47:05,408 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45813 4768s 2024-11-23 21:47:05,408 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:47:05,408 - distributed.worker - INFO - dashboard at: 127.0.0.1:35461 4768s 2024-11-23 21:47:05,408 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46153 4768s 2024-11-23 21:47:05,408 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:47:05,408 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:47:05,408 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:47:05,409 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-uq0pwurb 4768s 2024-11-23 21:47:05,409 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:47:05,410 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44449 4768s 2024-11-23 21:47:05,410 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44449 4768s 2024-11-23 21:47:05,411 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:47:05,411 - distributed.worker - INFO - dashboard at: 127.0.0.1:40859 4768s 2024-11-23 21:47:05,411 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46153 4768s 2024-11-23 21:47:05,411 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:47:05,411 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:47:05,411 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:47:05,411 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-o6yodftf 4768s 2024-11-23 21:47:05,411 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:47:05,412 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45813. Reason: failure-to-start- 4768s 2024-11-23 21:47:05,412 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:47:05,412 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44449. Reason: failure-to-start- 4768s 2024-11-23 21:47:05,412 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:47:05,414 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46153': TLS handshake failed with remote 'tls://127.0.0.1:55590': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:47:05,414 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46153': TLS handshake failed with remote 'tls://127.0.0.1:55594': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:47:05,415 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:47:06,420 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:47:06,426 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36867 4768s 2024-11-23 21:47:06,427 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33367/status 4768s 2024-11-23 21:47:06,427 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:47:06,440 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43391 4768s 2024-11-23 21:47:06,440 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43391 4768s 2024-11-23 21:47:06,440 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:47:06,441 - distributed.worker - INFO - dashboard at: 127.0.0.1:37529 4768s 2024-11-23 21:47:06,441 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36867 4768s 2024-11-23 21:47:06,441 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:47:06,441 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:47:06,441 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:47:06,441 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-kjz1npxa 4768s 2024-11-23 21:47:06,441 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:47:06,450 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46089 4768s 2024-11-23 21:47:06,451 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46089 4768s 2024-11-23 21:47:06,452 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:47:06,452 - distributed.worker - INFO - dashboard at: 127.0.0.1:43679 4768s 2024-11-23 21:47:06,452 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36867 4768s 2024-11-23 21:47:06,452 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:47:06,452 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:47:06,452 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:47:06,452 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-3s1jdeuh 4768s 2024-11-23 21:47:06,452 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:47:06,455 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43391. Reason: failure-to-start- 4768s 2024-11-23 21:47:06,455 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:47:06,456 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46089. Reason: failure-to-start- 4768s 2024-11-23 21:47:06,456 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:47:06,457 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36867': TLS handshake failed with remote 'tls://127.0.0.1:42818': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:47:06,457 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36867': TLS handshake failed with remote 'tls://127.0.0.1:42820': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:47:06,459 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:47:07,464 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:47:07,470 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46793 4768s 2024-11-23 21:47:07,471 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45565/status 4768s 2024-11-23 21:47:07,471 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:47:07,484 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43581 4768s 2024-11-23 21:47:07,485 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43581 4768s 2024-11-23 21:47:07,485 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:47:07,485 - distributed.worker - INFO - dashboard at: 127.0.0.1:42697 4768s 2024-11-23 21:47:07,485 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46793 4768s 2024-11-23 21:47:07,485 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:47:07,485 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:47:07,485 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:47:07,485 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-53ehbqsw 4768s 2024-11-23 21:47:07,485 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:47:07,487 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45039 4768s 2024-11-23 21:47:07,487 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45039 4768s 2024-11-23 21:47:07,487 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:47:07,487 - distributed.worker - INFO - dashboard at: 127.0.0.1:42087 4768s 2024-11-23 21:47:07,487 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46793 4768s 2024-11-23 21:47:07,487 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:47:07,487 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:47:07,487 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:47:07,487 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-tjg5h1iq 4768s 2024-11-23 21:47:07,487 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:47:07,490 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43581. Reason: failure-to-start- 4768s 2024-11-23 21:47:07,491 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:47:07,491 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45039. Reason: failure-to-start- 4768s 2024-11-23 21:47:07,491 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:47:07,492 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46793': TLS handshake failed with remote 'tls://127.0.0.1:55976': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:47:07,493 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46793': TLS handshake failed with remote 'tls://127.0.0.1:55988': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:47:07,494 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:47:08,499 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:47:08,507 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37249 4768s 2024-11-23 21:47:08,507 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38205/status 4768s 2024-11-23 21:47:08,507 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:47:08,520 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41209 4768s 2024-11-23 21:47:08,520 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41209 4768s 2024-11-23 21:47:08,520 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:47:08,520 - distributed.worker - INFO - dashboard at: 127.0.0.1:32985 4768s 2024-11-23 21:47:08,520 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37249 4768s 2024-11-23 21:47:08,520 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:47:08,520 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:47:08,520 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:47:08,520 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-nwx97qdy 4768s 2024-11-23 21:47:08,520 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:47:08,522 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38581 4768s 2024-11-23 21:47:08,522 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38581 4768s 2024-11-23 21:47:08,522 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:47:08,522 - distributed.worker - INFO - dashboard at: 127.0.0.1:33163 4768s 2024-11-23 21:47:08,522 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37249 4768s 2024-11-23 21:47:08,522 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:47:08,522 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:47:08,522 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:47:08,522 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-73_dhxg6 4768s 2024-11-23 21:47:08,522 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:47:08,525 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41209. Reason: failure-to-start- 4768s 2024-11-23 21:47:08,525 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:47:08,526 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38581. Reason: failure-to-start- 4768s 2024-11-23 21:47:08,526 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:47:08,527 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37249': TLS handshake failed with remote 'tls://127.0.0.1:56260': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:47:08,527 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37249': TLS handshake failed with remote 'tls://127.0.0.1:56266': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:47:08,529 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:47:09,538 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:47:09,549 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40669 4768s 2024-11-23 21:47:09,550 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46639/status 4768s 2024-11-23 21:47:09,550 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:47:09,566 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37571 4768s 2024-11-23 21:47:09,567 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37571 4768s 2024-11-23 21:47:09,567 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:47:09,567 - distributed.worker - INFO - dashboard at: 127.0.0.1:39033 4768s 2024-11-23 21:47:09,567 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40669 4768s 2024-11-23 21:47:09,567 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:47:09,568 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:47:09,568 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:47:09,568 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ys0zcs01 4768s 2024-11-23 21:47:09,568 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:47:09,570 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40707 4768s 2024-11-23 21:47:09,570 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40707 4768s 2024-11-23 21:47:09,570 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:47:09,570 - distributed.worker - INFO - dashboard at: 127.0.0.1:44815 4768s 2024-11-23 21:47:09,570 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40669 4768s 2024-11-23 21:47:09,570 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:47:09,570 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:47:09,570 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:47:09,570 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-4f2c_1pv 4768s 2024-11-23 21:47:09,570 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:47:09,571 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37571. Reason: failure-to-start- 4768s 2024-11-23 21:47:09,571 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:47:09,571 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40707. Reason: failure-to-start- 4768s 2024-11-23 21:47:09,572 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:47:09,573 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40669': TLS handshake failed with remote 'tls://127.0.0.1:54654': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:47:09,573 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40669': TLS handshake failed with remote 'tls://127.0.0.1:54656': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:47:09,577 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:47:10,583 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:47:10,590 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38577 4768s 2024-11-23 21:47:10,590 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34815/status 4768s 2024-11-23 21:47:10,590 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:47:10,603 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45773 4768s 2024-11-23 21:47:10,603 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45773 4768s 2024-11-23 21:47:10,603 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:47:10,603 - distributed.worker - INFO - dashboard at: 127.0.0.1:41547 4768s 2024-11-23 21:47:10,603 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38577 4768s 2024-11-23 21:47:10,603 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:47:10,603 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:47:10,603 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:47:10,603 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-4coqiozk 4768s 2024-11-23 21:47:10,603 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:47:10,605 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34847 4768s 2024-11-23 21:47:10,605 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34847 4768s 2024-11-23 21:47:10,605 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:47:10,605 - distributed.worker - INFO - dashboard at: 127.0.0.1:46339 4768s 2024-11-23 21:47:10,605 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38577 4768s 2024-11-23 21:47:10,605 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:47:10,605 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:47:10,605 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:47:10,605 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-wjww4ts0 4768s 2024-11-23 21:47:10,605 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:47:10,607 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45773. Reason: failure-to-start- 4768s 2024-11-23 21:47:10,607 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:47:10,608 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34847. Reason: failure-to-start- 4768s 2024-11-23 21:47:10,608 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:47:10,609 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38577': TLS handshake failed with remote 'tls://127.0.0.1:35684': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:47:10,609 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38577': TLS handshake failed with remote 'tls://127.0.0.1:35688': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:47:10,613 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:47:11,618 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:47:11,625 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36457 4768s 2024-11-23 21:47:11,625 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40137/status 4768s 2024-11-23 21:47:11,625 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:47:11,639 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38983 4768s 2024-11-23 21:47:11,639 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38983 4768s 2024-11-23 21:47:11,639 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:47:11,639 - distributed.worker - INFO - dashboard at: 127.0.0.1:36113 4768s 2024-11-23 21:47:11,639 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36457 4768s 2024-11-23 21:47:11,639 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:47:11,639 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:47:11,639 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:47:11,639 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-5k4dgk7f 4768s 2024-11-23 21:47:11,639 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:47:11,641 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37707 4768s 2024-11-23 21:47:11,641 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37707 4768s 2024-11-23 21:47:11,641 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:47:11,641 - distributed.worker - INFO - dashboard at: 127.0.0.1:36395 4768s 2024-11-23 21:47:11,641 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36457 4768s 2024-11-23 21:47:11,641 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:47:11,642 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:47:11,642 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:47:11,642 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-a3m6cwg6 4768s 2024-11-23 21:47:11,642 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:47:11,644 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38983. Reason: failure-to-start- 4768s 2024-11-23 21:47:11,644 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:47:11,645 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37707. Reason: failure-to-start- 4768s 2024-11-23 21:47:11,645 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:47:11,649 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36457': TLS handshake failed with remote 'tls://127.0.0.1:57008': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:47:11,649 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36457': TLS handshake failed with remote 'tls://127.0.0.1:57018': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:47:11,651 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:47:12,657 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:47:12,663 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39577 4768s 2024-11-23 21:47:12,664 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42835/status 4768s 2024-11-23 21:47:12,664 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:47:12,677 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35609 4768s 2024-11-23 21:47:12,677 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35609 4768s 2024-11-23 21:47:12,677 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:47:12,677 - distributed.worker - INFO - dashboard at: 127.0.0.1:38733 4768s 2024-11-23 21:47:12,677 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39577 4768s 2024-11-23 21:47:12,677 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:47:12,677 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:47:12,677 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:47:12,677 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-svrxkqvq 4768s 2024-11-23 21:47:12,677 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:47:12,679 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39693 4768s 2024-11-23 21:47:12,679 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39693 4768s 2024-11-23 21:47:12,679 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:47:12,679 - distributed.worker - INFO - dashboard at: 127.0.0.1:34493 4768s 2024-11-23 21:47:12,679 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39577 4768s 2024-11-23 21:47:12,679 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:47:12,679 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:47:12,679 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:47:12,679 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-d1qwvb_g 4768s 2024-11-23 21:47:12,679 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:47:12,680 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35609. Reason: failure-to-start- 4768s 2024-11-23 21:47:12,680 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:47:12,681 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39693. Reason: failure-to-start- 4768s 2024-11-23 21:47:12,681 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:47:12,684 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39577': TLS handshake failed with remote 'tls://127.0.0.1:47280': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:47:12,684 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39577': TLS handshake failed with remote 'tls://127.0.0.1:47290': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:47:12,686 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:47:13,690 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:47:13,697 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34359 4768s 2024-11-23 21:47:13,697 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35597/status 4768s 2024-11-23 21:47:13,697 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:47:13,711 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33857 4768s 2024-11-23 21:47:13,712 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33857 4768s 2024-11-23 21:47:13,712 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:47:13,712 - distributed.worker - INFO - dashboard at: 127.0.0.1:45127 4768s 2024-11-23 21:47:13,712 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34359 4768s 2024-11-23 21:47:13,712 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:47:13,712 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:47:13,712 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:47:13,712 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-mz7a7yez 4768s 2024-11-23 21:47:13,712 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:47:13,714 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:32943 4768s 2024-11-23 21:47:13,714 - distributed.worker - INFO - Listening to: tls://127.0.0.1:32943 4768s 2024-11-23 21:47:13,714 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:47:13,714 - distributed.worker - INFO - dashboard at: 127.0.0.1:34895 4768s 2024-11-23 21:47:13,714 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34359 4768s 2024-11-23 21:47:13,714 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:47:13,714 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:47:13,714 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:47:13,714 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-8bflgg2g 4768s 2024-11-23 21:47:13,714 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:47:13,715 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33857. Reason: failure-to-start- 4768s 2024-11-23 21:47:13,715 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:47:13,716 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:32943. Reason: failure-to-start- 4768s 2024-11-23 21:47:13,716 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:47:13,717 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34359': TLS handshake failed with remote 'tls://127.0.0.1:37478': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:47:13,717 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34359': TLS handshake failed with remote 'tls://127.0.0.1:37494': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:47:13,721 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:47:14,726 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:47:14,732 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37895 4768s 2024-11-23 21:47:14,733 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36415/status 4768s 2024-11-23 21:47:14,733 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:47:14,747 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37295 4768s 2024-11-23 21:47:14,747 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37295 4768s 2024-11-23 21:47:14,747 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:47:14,747 - distributed.worker - INFO - dashboard at: 127.0.0.1:43199 4768s 2024-11-23 21:47:14,747 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37895 4768s 2024-11-23 21:47:14,747 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:47:14,747 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:47:14,747 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:47:14,747 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-423p_vcy 4768s 2024-11-23 21:47:14,747 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:47:14,749 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42321 4768s 2024-11-23 21:47:14,749 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42321 4768s 2024-11-23 21:47:14,749 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:47:14,749 - distributed.worker - INFO - dashboard at: 127.0.0.1:43705 4768s 2024-11-23 21:47:14,749 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37895 4768s 2024-11-23 21:47:14,749 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:47:14,749 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:47:14,749 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:47:14,749 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-osi2_q1p 4768s 2024-11-23 21:47:14,749 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:47:14,750 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37295. Reason: failure-to-start- 4768s 2024-11-23 21:47:14,750 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:47:14,751 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42321. Reason: failure-to-start- 4768s 2024-11-23 21:47:14,751 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:47:14,752 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37895': TLS handshake failed with remote 'tls://127.0.0.1:37736': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:47:14,752 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37895': TLS handshake failed with remote 'tls://127.0.0.1:37752': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:47:14,753 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:47:15,758 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:47:15,767 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43859 4768s 2024-11-23 21:47:15,767 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35563/status 4768s 2024-11-23 21:47:15,767 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:47:15,781 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44879 4768s 2024-11-23 21:47:15,781 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44879 4768s 2024-11-23 21:47:15,781 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:47:15,781 - distributed.worker - INFO - dashboard at: 127.0.0.1:45829 4768s 2024-11-23 21:47:15,781 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43859 4768s 2024-11-23 21:47:15,781 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:47:15,781 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:47:15,782 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:47:15,782 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ex5z_34z 4768s 2024-11-23 21:47:15,782 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:47:15,785 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39747 4768s 2024-11-23 21:47:15,785 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39747 4768s 2024-11-23 21:47:15,785 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:47:15,785 - distributed.worker - INFO - dashboard at: 127.0.0.1:45661 4768s 2024-11-23 21:47:15,785 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43859 4768s 2024-11-23 21:47:15,785 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:47:15,785 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:47:15,785 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:47:15,785 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-8y6q98tp 4768s 2024-11-23 21:47:15,785 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:47:15,790 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44879. Reason: failure-to-start- 4768s 2024-11-23 21:47:15,790 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:47:15,790 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39747. Reason: failure-to-start- 4768s 2024-11-23 21:47:15,791 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:47:15,792 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43859': TLS handshake failed with remote 'tls://127.0.0.1:48020': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:47:15,793 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43859': TLS handshake failed with remote 'tls://127.0.0.1:48030': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:47:15,794 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:47:16,799 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:47:16,807 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45133 4768s 2024-11-23 21:47:16,807 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39989/status 4768s 2024-11-23 21:47:16,808 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:47:16,822 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35485 4768s 2024-11-23 21:47:16,822 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35485 4768s 2024-11-23 21:47:16,822 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:47:16,822 - distributed.worker - INFO - dashboard at: 127.0.0.1:41069 4768s 2024-11-23 21:47:16,822 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45133 4768s 2024-11-23 21:47:16,822 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:47:16,822 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:47:16,822 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:47:16,822 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-c90z295m 4768s 2024-11-23 21:47:16,822 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:47:16,824 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36635 4768s 2024-11-23 21:47:16,824 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36635 4768s 2024-11-23 21:47:16,824 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:47:16,824 - distributed.worker - INFO - dashboard at: 127.0.0.1:46341 4768s 2024-11-23 21:47:16,825 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45133 4768s 2024-11-23 21:47:16,825 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:47:16,825 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:47:16,825 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:47:16,825 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-4b4y4rrl 4768s 2024-11-23 21:47:16,825 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:47:16,826 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35485. Reason: failure-to-start- 4768s 2024-11-23 21:47:16,826 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:47:16,826 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36635. Reason: failure-to-start- 4768s 2024-11-23 21:47:16,827 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:47:16,831 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45133': TLS handshake failed with remote 'tls://127.0.0.1:33220': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:47:16,831 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45133': TLS handshake failed with remote 'tls://127.0.0.1:33230': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:47:16,832 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:47:17,837 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:47:17,845 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42137 4768s 2024-11-23 21:47:17,845 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46483/status 4768s 2024-11-23 21:47:17,845 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:47:17,860 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38393 4768s 2024-11-23 21:47:17,860 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38393 4768s 2024-11-23 21:47:17,860 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:47:17,860 - distributed.worker - INFO - dashboard at: 127.0.0.1:32867 4768s 2024-11-23 21:47:17,860 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42137 4768s 2024-11-23 21:47:17,860 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:47:17,860 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:47:17,860 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:47:17,860 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-w1y2f189 4768s 2024-11-23 21:47:17,860 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:47:17,862 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42813 4768s 2024-11-23 21:47:17,862 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42813 4768s 2024-11-23 21:47:17,862 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:47:17,862 - distributed.worker - INFO - dashboard at: 127.0.0.1:44189 4768s 2024-11-23 21:47:17,862 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42137 4768s 2024-11-23 21:47:17,862 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:47:17,862 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:47:17,862 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:47:17,862 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-any8sdtz 4768s 2024-11-23 21:47:17,862 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:47:17,864 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38393. Reason: failure-to-start- 4768s 2024-11-23 21:47:17,864 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:47:17,864 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42813. Reason: failure-to-start- 4768s 2024-11-23 21:47:17,864 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:47:17,868 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42137': TLS handshake failed with remote 'tls://127.0.0.1:52698': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:47:17,868 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42137': TLS handshake failed with remote 'tls://127.0.0.1:52708': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:47:17,869 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:47:18,874 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:47:18,881 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37243 4768s 2024-11-23 21:47:18,881 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40859/status 4768s 2024-11-23 21:47:18,881 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:47:18,895 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37621 4768s 2024-11-23 21:47:18,895 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37621 4768s 2024-11-23 21:47:18,896 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:47:18,896 - distributed.worker - INFO - dashboard at: 127.0.0.1:45477 4768s 2024-11-23 21:47:18,896 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37243 4768s 2024-11-23 21:47:18,896 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:47:18,896 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:47:18,896 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:47:18,896 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-rfv6ppl_ 4768s 2024-11-23 21:47:18,896 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:47:18,897 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41413 4768s 2024-11-23 21:47:18,898 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41413 4768s 2024-11-23 21:47:18,898 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:47:18,898 - distributed.worker - INFO - dashboard at: 127.0.0.1:42783 4768s 2024-11-23 21:47:18,898 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37243 4768s 2024-11-23 21:47:18,898 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:47:18,898 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:47:18,898 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:47:18,898 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-xl5803n1 4768s 2024-11-23 21:47:18,898 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:47:18,901 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37621. Reason: failure-to-start- 4768s 2024-11-23 21:47:18,901 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:47:18,902 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41413. Reason: failure-to-start- 4768s 2024-11-23 21:47:18,902 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:47:18,906 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37243': TLS handshake failed with remote 'tls://127.0.0.1:42812': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:47:18,906 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37243': TLS handshake failed with remote 'tls://127.0.0.1:42824': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:47:18,907 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:47:19,914 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:47:19,922 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33575 4768s 2024-11-23 21:47:19,923 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46539/status 4768s 2024-11-23 21:47:19,923 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:47:19,934 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45291 4768s 2024-11-23 21:47:19,935 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45291 4768s 2024-11-23 21:47:19,935 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:47:19,935 - distributed.worker - INFO - dashboard at: 127.0.0.1:46637 4768s 2024-11-23 21:47:19,935 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33575 4768s 2024-11-23 21:47:19,935 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:47:19,935 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:47:19,935 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:47:19,935 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-urtbdr9a 4768s 2024-11-23 21:47:19,935 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:47:19,937 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40207 4768s 2024-11-23 21:47:19,937 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40207 4768s 2024-11-23 21:47:19,937 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:47:19,937 - distributed.worker - INFO - dashboard at: 127.0.0.1:37469 4768s 2024-11-23 21:47:19,938 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33575 4768s 2024-11-23 21:47:19,938 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:47:19,938 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:47:19,938 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:47:19,938 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-lkk4j48h 4768s 2024-11-23 21:47:19,938 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:47:19,942 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45291. Reason: failure-to-start- 4768s 2024-11-23 21:47:19,943 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:47:19,943 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40207. Reason: failure-to-start- 4768s 2024-11-23 21:47:19,943 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:47:19,944 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33575': TLS handshake failed with remote 'tls://127.0.0.1:43894': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:47:19,944 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33575': TLS handshake failed with remote 'tls://127.0.0.1:43908': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:47:19,946 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:47:20,951 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:47:20,958 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37547 4768s 2024-11-23 21:47:20,959 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40089/status 4768s 2024-11-23 21:47:20,959 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:47:20,973 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41151 4768s 2024-11-23 21:47:20,974 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41151 4768s 2024-11-23 21:47:20,974 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:47:20,974 - distributed.worker - INFO - dashboard at: 127.0.0.1:32911 4768s 2024-11-23 21:47:20,974 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37547 4768s 2024-11-23 21:47:20,974 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:47:20,974 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:47:20,974 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:47:20,974 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-phkqczuk 4768s 2024-11-23 21:47:20,974 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:47:20,976 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39877 4768s 2024-11-23 21:47:20,976 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39877 4768s 2024-11-23 21:47:20,976 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:47:20,977 - distributed.worker - INFO - dashboard at: 127.0.0.1:39991 4768s 2024-11-23 21:47:20,977 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37547 4768s 2024-11-23 21:47:20,977 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:47:20,977 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:47:20,977 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:47:20,977 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-w1li_5cz 4768s 2024-11-23 21:47:20,977 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:47:20,981 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41151. Reason: failure-to-start- 4768s 2024-11-23 21:47:20,981 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:47:20,981 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39877. Reason: failure-to-start- 4768s 2024-11-23 21:47:20,981 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:47:20,985 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37547': TLS handshake failed with remote 'tls://127.0.0.1:45496': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:47:20,985 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37547': TLS handshake failed with remote 'tls://127.0.0.1:45504': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:47:20,987 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:47:21,992 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:47:22,001 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41823 4768s 2024-11-23 21:47:22,001 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35543/status 4768s 2024-11-23 21:47:22,001 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:47:22,015 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46065 4768s 2024-11-23 21:47:22,015 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46065 4768s 2024-11-23 21:47:22,015 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:47:22,015 - distributed.worker - INFO - dashboard at: 127.0.0.1:34835 4768s 2024-11-23 21:47:22,015 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41823 4768s 2024-11-23 21:47:22,015 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:47:22,015 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:47:22,015 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:47:22,015 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-qjnxpn1g 4768s 2024-11-23 21:47:22,016 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:47:22,017 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37425 4768s 2024-11-23 21:47:22,017 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37425 4768s 2024-11-23 21:47:22,017 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:47:22,017 - distributed.worker - INFO - dashboard at: 127.0.0.1:42659 4768s 2024-11-23 21:47:22,017 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41823 4768s 2024-11-23 21:47:22,017 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:47:22,017 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:47:22,017 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:47:22,018 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-4rnealtv 4768s 2024-11-23 21:47:22,018 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:47:22,022 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46065. Reason: failure-to-start- 4768s 2024-11-23 21:47:22,022 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:47:22,023 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37425. Reason: failure-to-start- 4768s 2024-11-23 21:47:22,023 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:47:22,024 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41823': TLS handshake failed with remote 'tls://127.0.0.1:35688': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:47:22,024 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41823': TLS handshake failed with remote 'tls://127.0.0.1:35704': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:47:22,025 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:47:23,031 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:47:23,046 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42105 4768s 2024-11-23 21:47:23,047 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45931/status 4768s 2024-11-23 21:47:23,047 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:47:23,060 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35355 4768s 2024-11-23 21:47:23,061 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35355 4768s 2024-11-23 21:47:23,061 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:47:23,061 - distributed.worker - INFO - dashboard at: 127.0.0.1:46673 4768s 2024-11-23 21:47:23,061 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42105 4768s 2024-11-23 21:47:23,061 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:47:23,061 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:47:23,061 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:47:23,061 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-gn0xq9sw 4768s 2024-11-23 21:47:23,061 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:47:23,063 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38129 4768s 2024-11-23 21:47:23,063 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38129 4768s 2024-11-23 21:47:23,063 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:47:23,063 - distributed.worker - INFO - dashboard at: 127.0.0.1:44011 4768s 2024-11-23 21:47:23,063 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42105 4768s 2024-11-23 21:47:23,063 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:47:23,063 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:47:23,063 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:47:23,063 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-74xs91xg 4768s 2024-11-23 21:47:23,063 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:47:23,066 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35355. Reason: failure-to-start- 4768s 2024-11-23 21:47:23,066 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:47:23,067 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38129. Reason: failure-to-start- 4768s 2024-11-23 21:47:23,067 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:47:23,068 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42105': TLS handshake failed with remote 'tls://127.0.0.1:52118': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:47:23,068 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42105': TLS handshake failed with remote 'tls://127.0.0.1:52120': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:47:23,069 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s _________________________ test_worker_client_executor __________________________ 4768s 4768s fut = , timeout = 0 4768s 4768s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 4768s async with asyncio.timeout(timeout): 4768s > return await fut 4768s 4768s /usr/lib/python3/dist-packages/distributed/utils.py:1960: 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s /usr/lib/python3/dist-packages/distributed/worker.py:1480: in start_unsafe 4768s await self._register_with_scheduler() 4768s /usr/lib/python3/dist-packages/distributed/worker.py:1179: in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s /usr/lib/python3/dist-packages/distributed/comm/core.py:342: in connect 4768s comm = await wait_for( 4768s /usr/lib/python3/dist-packages/distributed/utils.py:1960: in wait_for 4768s return await fut 4768s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:546: in connect 4768s stream = await self.client.connect( 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s 4768s self = , host = '127.0.0.1' 4768s port = 35807, af = 4768s ssl_options = 4768s max_buffer_size = 8364507136.0, source_ip = None, source_port = None 4768s timeout = None 4768s 4768s async def connect( 4768s self, 4768s host: str, 4768s port: int, 4768s af: socket.AddressFamily = socket.AF_UNSPEC, 4768s ssl_options: Optional[Union[Dict[str, Any], ssl.SSLContext]] = None, 4768s max_buffer_size: Optional[int] = None, 4768s source_ip: Optional[str] = None, 4768s source_port: Optional[int] = None, 4768s timeout: Optional[Union[float, datetime.timedelta]] = None, 4768s ) -> IOStream: 4768s """Connect to the given host and port. 4768s 4768s Asynchronously returns an `.IOStream` (or `.SSLIOStream` if 4768s ``ssl_options`` is not None). 4768s 4768s Using the ``source_ip`` kwarg, one can specify the source 4768s IP address to use when establishing the connection. 4768s In case the user needs to resolve and 4768s use a specific interface, it has to be handled outside 4768s of Tornado as this depends very much on the platform. 4768s 4768s Raises `TimeoutError` if the input future does not complete before 4768s ``timeout``, which may be specified in any form allowed by 4768s `.IOLoop.add_timeout` (i.e. a `datetime.timedelta` or an absolute time 4768s relative to `.IOLoop.time`) 4768s 4768s Similarly, when the user requires a certain source port, it can 4768s be specified using the ``source_port`` arg. 4768s 4768s .. versionchanged:: 4.5 4768s Added the ``source_ip`` and ``source_port`` arguments. 4768s 4768s .. versionchanged:: 5.0 4768s Added the ``timeout`` argument. 4768s """ 4768s if timeout is not None: 4768s if isinstance(timeout, numbers.Real): 4768s timeout = IOLoop.current().time() + timeout 4768s elif isinstance(timeout, datetime.timedelta): 4768s timeout = IOLoop.current().time() + timeout.total_seconds() 4768s else: 4768s raise TypeError("Unsupported timeout %r" % timeout) 4768s if timeout is not None: 4768s addrinfo = await gen.with_timeout( 4768s timeout, self.resolver.resolve(host, port, af) 4768s ) 4768s else: 4768s addrinfo = await self.resolver.resolve(host, port, af) 4768s connector = _Connector( 4768s addrinfo, 4768s functools.partial( 4768s self._create_stream, 4768s max_buffer_size, 4768s source_ip=source_ip, 4768s source_port=source_port, 4768s ), 4768s ) 4768s > af, addr, stream = await connector.start(connect_timeout=timeout) 4768s E asyncio.exceptions.CancelledError 4768s 4768s /usr/lib/python3/dist-packages/tornado/tcpclient.py:279: CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s self = 4768s 4768s @final 4768s async def start(self): 4768s async with self._startup_lock: 4768s if self.status == Status.failed: 4768s assert self.__startup_exc is not None 4768s raise self.__startup_exc 4768s elif self.status != Status.init: 4768s return self 4768s timeout = getattr(self, "death_timeout", None) 4768s 4768s async def _close_on_failure(exc: Exception) -> None: 4768s await self.close(reason=f"failure-to-start-{str(type(exc))}") 4768s self.status = Status.failed 4768s self.__startup_exc = exc 4768s 4768s try: 4768s > await wait_for(self.start_unsafe(), timeout=timeout) 4768s 4768s /usr/lib/python3/dist-packages/distributed/core.py:664: 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 4768s async with asyncio.timeout(timeout): 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s 4768s self = 4768s exc_type = 4768s exc_val = CancelledError(), exc_tb = 4768s 4768s async def __aexit__( 4768s self, 4768s exc_type: Optional[Type[BaseException]], 4768s exc_val: Optional[BaseException], 4768s exc_tb: Optional[TracebackType], 4768s ) -> Optional[bool]: 4768s assert self._state in (_State.ENTERED, _State.EXPIRING) 4768s 4768s if self._timeout_handler is not None: 4768s self._timeout_handler.cancel() 4768s self._timeout_handler = None 4768s 4768s if self._state is _State.EXPIRING: 4768s self._state = _State.EXPIRED 4768s 4768s if self._task.uncancel() <= self._cancelling and exc_type is not None: 4768s # Since there are no new cancel requests, we're 4768s # handling this. 4768s if issubclass(exc_type, exceptions.CancelledError): 4768s > raise TimeoutError from exc_val 4768s E TimeoutError 4768s 4768s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s @contextlib.asynccontextmanager 4768s async def _cluster_factory(): 4768s workers = [] 4768s s = None 4768s try: 4768s for _ in range(60): 4768s try: 4768s > s, ws = await start_cluster( 4768s nthreads, 4768s scheduler, 4768s security=security, 4768s Worker=Worker, 4768s scheduler_kwargs=scheduler_kwargs, 4768s worker_kwargs=merge( 4768s {"death_timeout": min(15, int(deadline.remaining))}, 4768s worker_kwargs, 4768s ), 4768s ) 4768s 4768s /usr/lib/python3/dist-packages/distributed/utils_test.py:966: 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s /usr/lib/python3/dist-packages/distributed/utils_test.py:789: in start_cluster 4768s await asyncio.gather(*workers) 4768s /usr/lib/python3.13/asyncio/tasks.py:737: in _wrap_awaitable 4768s return await awaitable 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s 4768s self = 4768s 4768s @final 4768s async def start(self): 4768s async with self._startup_lock: 4768s if self.status == Status.failed: 4768s assert self.__startup_exc is not None 4768s raise self.__startup_exc 4768s elif self.status != Status.init: 4768s return self 4768s timeout = getattr(self, "death_timeout", None) 4768s 4768s async def _close_on_failure(exc: Exception) -> None: 4768s await self.close(reason=f"failure-to-start-{str(type(exc))}") 4768s self.status = Status.failed 4768s self.__startup_exc = exc 4768s 4768s try: 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s except asyncio.TimeoutError as exc: 4768s await _close_on_failure(exc) 4768s > raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s E TimeoutError: Worker start timed out after 0s. 4768s 4768s /usr/lib/python3/dist-packages/distributed/core.py:667: TimeoutError 4768s 4768s During handling of the above exception, another exception occurred: 4768s 4768s fut = ._..test_func..async_fn at 0xe99adcd8> 4768s timeout = 60 4768s 4768s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 4768s async with asyncio.timeout(timeout): 4768s > return await fut 4768s 4768s /usr/lib/python3/dist-packages/distributed/utils.py:1960: 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s /usr/lib/python3/dist-packages/distributed/utils_test.py:999: in async_fn 4768s _cluster_factory() as (s, workers), 4768s /usr/lib/python3.13/contextlib.py:214: in __aenter__ 4768s return await anext(self.gen) 4768s /usr/lib/python3/dist-packages/distributed/utils_test.py:983: in _cluster_factory 4768s await asyncio.sleep(1) 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s 4768s delay = 1, result = None 4768s 4768s async def sleep(delay, result=None): 4768s """Coroutine that completes after a given time (in seconds).""" 4768s if delay <= 0: 4768s await __sleep0() 4768s return result 4768s 4768s if math.isnan(delay): 4768s raise ValueError("Invalid delay: NaN (not a number)") 4768s 4768s loop = events.get_running_loop() 4768s future = loop.create_future() 4768s h = loop.call_later(delay, 4768s futures._set_result_unless_cancelled, 4768s future, result) 4768s try: 4768s > return await future 4768s E asyncio.exceptions.CancelledError 4768s 4768s /usr/lib/python3.13/asyncio/tasks.py:718: CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s args = (), kwds = {} 4768s 4768s @wraps(func) 4768s def inner(*args, **kwds): 4768s with self._recreate_cm(): 4768s > return func(*args, **kwds) 4768s 4768s /usr/lib/python3.13/contextlib.py:85: 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s /usr/lib/python3.13/contextlib.py:85: in inner 4768s return func(*args, **kwds) 4768s /usr/lib/python3/dist-packages/distributed/utils_test.py:1102: in test_func 4768s return _run_and_close_tornado(async_fn_outer) 4768s /usr/lib/python3/dist-packages/distributed/utils_test.py:378: in _run_and_close_tornado 4768s return asyncio_run(inner_fn(), loop_factory=get_loop_factory()) 4768s /usr/lib/python3.13/asyncio/runners.py:194: in run 4768s return runner.run(main) 4768s /usr/lib/python3.13/asyncio/runners.py:118: in run 4768s return self._loop.run_until_complete(task) 4768s /usr/lib/python3.13/asyncio/base_events.py:720: in run_until_complete 4768s return future.result() 4768s /usr/lib/python3/dist-packages/distributed/utils_test.py:375: in inner_fn 4768s return await async_fn(*args, **kwargs) 4768s /usr/lib/python3/dist-packages/distributed/utils_test.py:1099: in async_fn_outer 4768s return await utils_wait_for(async_fn(), timeout=timeout * 2) 4768s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 4768s async with asyncio.timeout(timeout): 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s 4768s self = 4768s exc_type = 4768s exc_val = CancelledError(), exc_tb = 4768s 4768s async def __aexit__( 4768s self, 4768s exc_type: Optional[Type[BaseException]], 4768s exc_val: Optional[BaseException], 4768s exc_tb: Optional[TracebackType], 4768s ) -> Optional[bool]: 4768s assert self._state in (_State.ENTERED, _State.EXPIRING) 4768s 4768s if self._timeout_handler is not None: 4768s self._timeout_handler.cancel() 4768s self._timeout_handler = None 4768s 4768s if self._state is _State.EXPIRING: 4768s self._state = _State.EXPIRED 4768s 4768s if self._task.uncancel() <= self._cancelling and exc_type is not None: 4768s # Since there are no new cancel requests, we're 4768s # handling this. 4768s if issubclass(exc_type, exceptions.CancelledError): 4768s > raise TimeoutError from exc_val 4768s E TimeoutError 4768s 4768s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 4768s ----------------------------- Captured stderr call ----------------------------- 4768s 2024-11-23 21:47:24,300 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:47:24,308 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:24,308 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34743/status 4768s 2024-11-23 21:47:24,308 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:47:24,321 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35361 4768s 2024-11-23 21:47:24,321 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35361 4768s 2024-11-23 21:47:24,321 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:47:24,321 - distributed.worker - INFO - dashboard at: 127.0.0.1:46443 4768s 2024-11-23 21:47:24,322 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:24,322 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:47:24,322 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:47:24,322 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:47:24,322 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-dedkvm59 4768s 2024-11-23 21:47:24,322 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:47:24,324 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33885 4768s 2024-11-23 21:47:24,324 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33885 4768s 2024-11-23 21:47:24,324 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:47:24,324 - distributed.worker - INFO - dashboard at: 127.0.0.1:43525 4768s 2024-11-23 21:47:24,324 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:24,324 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:47:24,324 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:47:24,324 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:47:24,324 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-rimzw6_y 4768s 2024-11-23 21:47:24,324 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:47:24,337 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:24,337 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:24,337 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:49634': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:24,337 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:49646': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:24,449 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:24,449 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:24,450 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:49654': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:24,450 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:49664': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:24,562 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:24,562 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:24,562 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:49680': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:24,562 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:49686': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:24,675 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:24,675 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:24,676 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:49700': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:24,676 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:49710': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:24,789 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:24,789 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:24,789 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:49714': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:24,789 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:49730': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:24,900 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:24,901 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:24,901 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:49746': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:24,901 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:49750': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:25,013 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:25,013 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:25,014 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:49766': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:25,014 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:49774': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:25,125 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:25,125 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:25,125 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:49790': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:25,125 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:49792': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:25,237 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:25,237 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:25,238 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:49794': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:25,238 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:49808': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:25,350 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:25,350 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:25,350 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:49814': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:25,350 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:49818': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:25,462 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:25,462 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:25,463 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:49820': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:25,463 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:49828': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:25,574 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:25,574 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:25,574 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:49832': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:25,574 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:49842': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:25,686 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:25,686 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:25,687 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:49844': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:25,687 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:49858': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:25,798 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:25,799 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:25,799 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:49874': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:25,799 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:49890': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:25,911 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:25,911 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:25,911 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:49898': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:25,911 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:49910': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:26,023 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:26,023 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:26,023 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:49924': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:26,023 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:49932': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:26,136 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:26,136 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:26,137 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:49946': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:26,137 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:49952': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:26,249 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:26,249 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:26,249 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:49954': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:26,249 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:49966': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:26,364 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:26,364 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:26,364 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:49982': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:26,365 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:49992': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:26,477 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:26,477 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:26,477 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:49994': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:26,477 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:49996': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:26,588 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:26,589 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:26,589 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:50004': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:26,589 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:50014': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:26,701 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:26,701 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:26,701 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:50020': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:26,702 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:50034': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:26,813 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:26,814 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:26,817 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:50042': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:26,817 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:50044': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:26,926 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:26,926 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:26,926 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:50050': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:26,926 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:50062': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:27,038 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:27,039 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:27,039 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:50072': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:27,039 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:50084': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:27,150 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:27,150 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:27,151 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:50100': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:27,151 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:50104': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:27,263 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:27,263 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:27,263 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:50120': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:27,263 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:50134': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:27,375 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:27,375 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:27,375 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:50142': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:27,375 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:50152': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:27,487 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:27,488 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:27,488 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:50168': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:27,488 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:50172': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:27,599 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:27,599 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:27,599 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:50174': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:27,600 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:50188': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:27,711 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:27,712 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:27,712 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:50202': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:27,712 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:50204': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:27,823 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:27,824 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:27,824 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:50214': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:27,824 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:50228': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:27,936 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:27,936 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:27,936 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:50240': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:27,936 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:50252': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:28,048 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:28,049 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:28,049 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:50260': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:28,049 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:50274': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:28,162 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:28,162 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:28,162 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:50284': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:28,163 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:50290': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:28,274 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:28,275 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:28,275 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:50296': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:28,275 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:50302': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:28,387 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:28,387 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:28,388 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:50316': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:28,388 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:50332': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:28,500 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:28,500 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:28,500 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:50342': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:28,500 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:50348': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:28,612 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:28,612 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:28,612 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:50364': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:28,612 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:50366': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:28,724 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:28,724 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:28,724 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:50378': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:28,724 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:50390': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:28,836 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:28,837 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:28,837 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:50404': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:28,837 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:50406': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:28,949 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:28,949 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:28,949 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:50414': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:28,949 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:50428': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:29,061 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:29,061 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:29,062 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:50430': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:29,062 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:50442': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:29,174 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:29,174 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:29,174 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:50458': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:29,174 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:50464': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:29,286 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:29,286 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:29,287 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:50472': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:29,287 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:50488': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:29,398 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:29,398 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:29,399 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:50504': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:29,399 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:50512': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:29,511 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:29,511 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:29,511 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:50526': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:29,511 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:50536': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:29,623 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:29,623 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:29,623 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:50552': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:29,623 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:50562': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:29,736 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:29,736 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:29,737 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:50570': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:29,737 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:50582': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:29,848 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:29,849 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:29,849 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:50594': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:29,849 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:50610': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:29,962 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:29,962 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:29,962 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:50612': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:29,962 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:50622': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:30,073 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:30,074 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:30,074 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:50628': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:30,074 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:50630': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:30,181 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:30,185 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:50646': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:30,186 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:30,186 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:50654': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:30,289 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:30,289 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:50656': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:30,295 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:30,295 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:50664': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:30,396 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:30,397 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:50666': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:30,402 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:30,402 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:50676': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:30,504 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:30,505 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:50692': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:30,510 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:30,511 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:50702': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:30,611 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:30,611 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:50706': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:30,617 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:30,617 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:50714': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:30,718 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:30,719 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:50718': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:30,725 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:30,725 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:50732': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:30,825 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:30,825 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:50748': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:30,831 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:30,831 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:50754': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:30,933 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:30,933 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:50762': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:30,939 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:30,939 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:50764': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:31,039 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:31,040 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:50770': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:31,045 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:31,046 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:50774': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:31,147 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:31,148 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:50786': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:31,153 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:31,153 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:50800': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:31,254 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:31,254 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:50812': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:31,260 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:31,260 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:50824': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:31,361 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:31,362 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:50840': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:31,367 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:31,368 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:50846': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:31,469 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:31,470 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:50858': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:31,475 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:31,476 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:50870': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:31,576 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:31,576 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:60356': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:31,582 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:31,582 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:60358': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:31,685 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:31,686 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:60374': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:31,691 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:31,691 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:60380': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:31,792 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:31,792 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:60384': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:31,798 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:31,799 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:60388': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:31,899 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:31,899 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:60390': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:31,905 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:31,905 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:60406': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:32,006 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:32,006 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:60420': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:32,012 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:32,013 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:60422': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:32,114 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:32,114 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:60424': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:32,120 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:32,120 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:60426': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:32,221 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:32,221 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:60434': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:32,227 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:32,227 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:60440': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:32,329 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:32,330 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:60448': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:32,335 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:32,336 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:60452': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:32,437 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:32,437 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:60454': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:32,443 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:32,443 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:60470': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:32,544 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:32,544 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:60480': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:32,550 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:32,550 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:60494': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:32,650 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:32,651 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:60510': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:32,656 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:32,657 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:60520': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:32,758 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:32,759 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:60536': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:32,764 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:32,764 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:60546': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:32,865 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:32,866 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:60554': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:32,871 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:32,871 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:60564': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:32,972 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:32,973 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:60580': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:32,979 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:32,979 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:60584': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:33,080 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:33,081 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:60592': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:33,086 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:33,086 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:60606': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:33,189 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:33,190 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:60616': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:33,195 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:33,195 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:60622': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:33,296 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:33,298 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:60624': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:33,303 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:33,304 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:60634': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:33,403 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:33,403 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:60650': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:33,410 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:33,411 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:60660': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:33,510 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:33,510 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:60668': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:33,516 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:33,517 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:60670': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:33,617 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:33,618 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:60672': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:33,623 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:33,624 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:60680': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:33,725 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:33,726 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:60682': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:33,731 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:33,731 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:60698': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:33,833 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:33,834 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:60702': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:33,839 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:33,839 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:60704': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:33,940 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:33,941 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:60706': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:33,946 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:33,946 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:60722': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:34,047 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:34,048 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:60730': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:34,053 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:34,053 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:60742': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:34,154 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:34,155 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:60750': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:34,160 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:34,161 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:60756': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:34,262 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:34,262 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:60766': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:34,268 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:34,268 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:60782': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:34,369 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:34,369 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:60798': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:34,375 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:34,375 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:60810': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:34,476 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:34,476 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:60812': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:34,482 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:34,482 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:60822': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:34,582 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:34,583 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:60828': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:34,588 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:34,589 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:60840': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:34,689 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:34,690 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:60844': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:34,696 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:34,696 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:60848': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:34,797 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:34,797 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:60854': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:34,803 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:34,803 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:60864': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:34,904 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:34,905 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:60880': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:34,911 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:34,912 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:60882': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:35,011 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:35,012 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:60894': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:35,017 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:35,018 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:60908': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:35,118 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:35,118 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:60920': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:35,124 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:35,124 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:60924': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:35,226 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:35,227 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:60928': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:35,232 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:35,232 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:60942': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:35,333 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:35,333 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:60952': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:35,339 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:35,339 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:60954': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:35,440 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:35,441 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:60956': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:35,446 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:35,447 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:60970': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:35,547 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:35,548 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:60976': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:35,553 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:35,554 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:60988': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:35,655 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:35,656 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:60996': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:35,661 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:35,661 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:32768': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:35,762 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:35,763 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:32784': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:35,768 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:35,769 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:32788': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:35,869 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:35,870 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:32796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:35,876 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:35,876 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:32798': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:35,977 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:35,977 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:32800': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:35,983 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:35,983 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:32802': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:36,085 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:36,086 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:32806': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:36,091 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:36,091 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:32808': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:36,192 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:36,193 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:32812': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:36,198 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:36,198 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:32816': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:36,299 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:36,299 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:32832': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:36,305 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:36,305 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:32836': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:36,407 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:36,408 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:32838': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:36,413 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:36,413 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:32842': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:36,514 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:36,515 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:32850': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:36,520 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:36,520 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:32864': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:36,623 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:36,623 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:32874': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:36,628 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:36,629 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:32880': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:36,729 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:36,730 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:32890': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:36,735 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:36,735 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:32902': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:36,837 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:36,837 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:32904': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:36,842 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:36,843 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:32908': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:36,944 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:36,944 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:32916': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:36,950 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:36,950 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:32924': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:37,051 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:37,051 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:32926': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:37,057 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:37,057 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:32942': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:37,158 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:37,158 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:32944': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:37,164 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:37,164 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:32950': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:37,265 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:37,266 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:32966': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:37,271 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:37,271 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:32978': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:37,372 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:37,373 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:32992': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:37,378 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:37,378 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:33002': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:37,479 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:37,479 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:33010': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:37,485 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:37,485 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:33014': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:37,586 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:37,587 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:33026': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:37,593 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:37,593 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:33042': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:37,694 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:37,695 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:33054': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:37,700 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:37,701 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:33058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:37,801 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:37,802 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:33068': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:37,807 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:37,808 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:33082': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:37,908 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:37,909 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:33092': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:37,915 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:37,915 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:33102': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:38,015 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:38,016 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:33110': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:38,021 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:38,022 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:33122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:38,123 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:38,123 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:33126': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:38,129 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:38,129 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:33138': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:38,230 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:38,232 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:33140': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:38,237 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:38,238 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:33156': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:38,339 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:38,339 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:33170': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:38,344 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:38,345 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:33184': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:38,445 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:38,445 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:33200': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:38,451 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:38,451 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:33212': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:38,553 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:38,554 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:33228': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:38,559 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:38,559 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:33236': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:38,660 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:38,661 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:33244': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:38,666 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:38,666 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:33248': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:38,767 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:38,767 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:33252': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:38,773 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:38,773 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:33256': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:38,874 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:38,874 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:33272': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:38,880 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:38,880 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:33286': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:38,981 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:38,981 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:33300': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:38,987 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:38,987 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:33308': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:39,087 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:39,087 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:33322': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:39,093 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:39,093 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:33332': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:39,194 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:39,194 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:33340': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:39,200 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:39,200 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:33350': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:39,301 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:39,301 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:33354': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:39,307 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41431 4768s 2024-11-23 21:47:39,307 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41431': TLS handshake failed with remote 'tls://127.0.0.1:33370': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:39,320 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35361. Reason: failure-to-start- 4768s 2024-11-23 21:47:39,321 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:47:39,323 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 15s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 4768s stream = await stream.start_tls( 4768s ^^^^^^^^^^^^^^^^^^^^^^^ 4768s False, ssl_options=ssl_options, server_hostname=host 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 4768s self.socket.do_handshake() 4768s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 4768s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 4768s self._sslobj.do_handshake() 4768s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 4768s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 4768s raise FatalCommClosedError( 4768s ...<2 lines>... 4768s ) from err 4768s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 4768s 4768s During handling of the above exception, another exception occurred: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1218, in _register_with_scheduler 4768s await asyncio.sleep(0.1) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 718, in sleep 4768s return await future 4768s ^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 15s. 4768s 2024-11-23 21:47:39,326 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33885. Reason: failure-to-start- 4768s 2024-11-23 21:47:39,326 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:47:40,329 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:47:40,335 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:40,336 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38455/status 4768s 2024-11-23 21:47:40,336 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:47:40,349 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46051 4768s 2024-11-23 21:47:40,349 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46051 4768s 2024-11-23 21:47:40,349 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:47:40,349 - distributed.worker - INFO - dashboard at: 127.0.0.1:40505 4768s 2024-11-23 21:47:40,349 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:40,349 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:47:40,349 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:47:40,349 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:47:40,349 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-3s1c05wn 4768s 2024-11-23 21:47:40,349 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:47:40,351 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44299 4768s 2024-11-23 21:47:40,351 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44299 4768s 2024-11-23 21:47:40,351 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:47:40,351 - distributed.worker - INFO - dashboard at: 127.0.0.1:37493 4768s 2024-11-23 21:47:40,351 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:40,351 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:47:40,351 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:47:40,351 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:47:40,351 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ggsv33ef 4768s 2024-11-23 21:47:40,351 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:47:40,363 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:40,363 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:40,364 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:40030': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:40,364 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:40032': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:40,477 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:40,477 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:40,477 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:40034': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:40,477 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:40036': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:40,590 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:40,590 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:40,590 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:40040': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:40,590 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:40044': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:40,701 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:40,701 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:40,701 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:40050': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:40,701 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:40066': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:40,813 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:40,813 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:40,816 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:40068': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:40,816 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:40078': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:40,925 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:40,925 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:40,925 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:40080': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:40,925 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:40094': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:41,032 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:41,036 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:40108': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:41,037 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:41,037 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:40112': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:41,139 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:41,139 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:40118': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:41,145 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:41,145 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:40122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:41,246 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:41,247 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:40124': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:41,252 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:41,252 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:40134': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:41,352 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:41,352 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:40146': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:41,359 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:41,359 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:40152': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:41,459 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:41,459 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:40162': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:41,465 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:41,466 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:40168': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:41,566 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:41,566 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:53348': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:41,572 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:41,572 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:53354': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:41,673 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:41,674 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:53362': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:41,679 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:41,680 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:53370': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:41,780 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:41,781 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:53380': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:41,786 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:41,786 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:53392': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:41,887 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:41,888 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:53396': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:41,893 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:41,893 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:53402': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:41,994 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:41,995 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:53410': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:42,000 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:42,000 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:53420': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:42,102 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:42,103 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:53432': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:42,108 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:42,108 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:53438': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:42,210 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:42,210 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:53448': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:42,216 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:42,216 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:53464': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:42,317 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:42,318 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:53472': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:42,323 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:42,324 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:53486': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:42,425 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:42,426 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:53490': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:42,431 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:42,431 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:53492': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:42,532 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:42,533 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:53500': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:42,538 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:42,539 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:53514': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:42,639 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:42,639 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:53518': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:42,645 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:42,645 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:53520': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:42,746 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:42,746 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:53536': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:42,752 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:42,752 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:53550': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:42,852 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:42,853 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:53560': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:42,858 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:42,859 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:53564': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:42,960 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:42,960 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:53580': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:42,967 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:42,967 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:53592': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:43,066 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:43,067 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:53604': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:43,072 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:43,073 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:53612': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:43,173 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:43,173 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:53616': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:43,179 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:43,179 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:53630': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:43,280 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:43,281 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:53632': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:43,286 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:43,286 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:53636': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:43,387 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:43,387 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:53650': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:43,393 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:43,393 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:53666': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:43,493 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:43,493 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:53676': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:43,499 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:43,499 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:53688': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:43,600 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:43,601 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:53698': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:43,606 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:43,606 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:53702': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:43,707 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:43,708 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:53708': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:43,713 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:43,713 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:53710': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:43,818 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:43,819 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:53722': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:43,824 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:43,824 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:53738': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:43,926 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:43,927 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:53746': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:43,932 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:43,932 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:53760': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:44,033 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:44,034 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:53774': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:44,039 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:44,040 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:53782': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:44,141 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:44,141 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:53790': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:44,146 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:44,147 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:53800': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:44,248 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:44,248 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:53814': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:44,253 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:44,254 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:53822': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:44,355 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:44,356 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:53824': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:44,361 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:44,361 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:53828': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:44,462 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:44,463 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:53836': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:44,468 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:44,468 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:53844': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:44,569 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:44,570 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:53854': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:44,575 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:44,575 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:53864': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:44,678 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:44,678 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:53872': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:44,684 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:44,684 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:53888': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:44,785 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:44,785 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:53902': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:44,791 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:44,791 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:53916': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:44,892 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:44,893 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:53920': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:44,898 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:44,898 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:53922': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:44,999 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:45,000 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:53938': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:45,005 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:45,005 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:53948': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:45,107 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:45,107 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:53960': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:45,113 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:45,113 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:53974': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:45,215 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:45,215 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:53980': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:45,221 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:45,221 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:53996': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:45,321 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:45,322 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:53998': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:45,327 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:45,327 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:54008': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:45,429 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:45,430 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:54020': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:45,435 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:45,436 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:54036': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:45,538 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:45,538 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:54044': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:45,544 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:45,544 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:54054': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:45,645 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:45,646 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:54064': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:45,651 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:45,651 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:54074': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:45,753 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:45,753 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:54086': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:45,759 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:45,759 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:54094': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:45,860 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:45,860 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:54096': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:45,866 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:45,866 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:54108': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:45,966 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:45,966 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:54118': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:45,972 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:45,972 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:54128': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:46,073 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:46,073 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:54130': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:46,079 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:46,079 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:54140': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:46,180 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:46,181 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:54146': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:46,186 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:46,186 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:54148': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:46,287 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:46,290 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:54154': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:46,295 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:46,295 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:54160': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:46,394 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:46,394 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:54168': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:46,401 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:46,401 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:54184': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:46,501 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:46,501 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:54200': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:46,507 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:46,507 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:54206': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:46,608 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:46,609 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:54210': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:46,614 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:46,614 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:54218': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:46,716 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:46,716 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:54234': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:46,722 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:46,722 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:54250': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:46,822 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:46,822 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:54254': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:46,828 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:46,828 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:54262': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:46,929 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:46,930 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:54274': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:46,935 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:46,935 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:54282': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:47,036 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:47,036 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:54286': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:47,042 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:47,042 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:54296': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:47,143 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:47,144 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:54302': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:47,149 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:47,149 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:54306': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:47,251 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:47,251 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:54316': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:47,257 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:47,257 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:54328': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:47,358 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:47,358 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:54332': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:47,364 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:47,364 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:54336': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:47,465 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:47,466 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:54352': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:47,471 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:47,471 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:54362': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:47,572 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:47,573 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:54376': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:47,578 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:47,578 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:54392': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:47,679 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:47,679 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:54402': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:47,685 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:47,685 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:54404': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:47,786 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:47,786 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:54418': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:47,791 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:47,792 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:54434': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:47,892 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:47,893 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:54442': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:47,898 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:47,899 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:54450': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:48,000 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:48,000 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:54456': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:48,005 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:48,006 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:54458': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:48,107 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:48,108 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:54462': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:48,113 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:48,114 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:54476': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:48,216 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:48,216 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:54484': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:48,221 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:48,222 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:54494': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:48,322 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:48,323 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:54502': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:48,328 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:48,328 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:54518': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:48,430 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:48,430 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:54530': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:48,435 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:48,436 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:54540': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:48,536 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:48,537 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:54542': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:48,542 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:48,543 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:54556': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:48,643 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:48,643 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:54568': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:48,649 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:48,649 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:54572': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:48,750 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:48,750 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:54576': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:48,756 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:48,756 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:54582': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:48,856 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:48,857 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:54596': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:48,862 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:48,862 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:54610': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:48,964 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:48,965 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:54614': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:48,970 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:48,970 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:54618': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:49,070 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:49,071 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:54628': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:49,076 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:49,076 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:54640': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:49,178 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:49,179 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:54656': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:49,184 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:49,184 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:54658': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:49,285 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:49,285 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:54668': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:49,291 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:49,291 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:54678': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:49,391 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:49,392 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:54680': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:49,397 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:49,398 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:54694': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:49,499 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:49,500 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:54708': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:49,505 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:49,505 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:54724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:49,608 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:49,609 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:54732': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:49,614 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:49,615 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:54736': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:49,716 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:49,717 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:54746': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:49,722 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:49,722 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:54752': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:49,822 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:49,823 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:54764': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:49,828 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:49,828 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:54776': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:49,930 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:49,930 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:54780': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:49,936 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:49,936 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:54784': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:50,037 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:50,037 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:54798': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:50,043 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:50,043 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:54800': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:50,143 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:50,144 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:54810': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:50,149 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:50,149 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:54814': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:50,250 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:50,251 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:54824': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:50,256 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:50,256 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:54838': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:50,357 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:50,358 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:54852': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:50,363 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:50,363 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:54864': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:50,464 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:50,465 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:54870': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:50,470 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:50,470 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:54878': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:50,570 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:50,571 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:54892': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:50,576 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:50,577 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:54896': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:50,679 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:50,679 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:54906': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:50,685 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:50,685 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:54914': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:50,785 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:50,786 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:54920': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:50,791 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:50,792 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:54928': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:50,893 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:50,893 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:54936': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:50,899 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:50,899 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:54946': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:51,000 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:51,001 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:54956': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:51,006 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:51,006 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:54968': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:51,108 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:51,108 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:54976': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:51,114 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:51,114 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:54986': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:51,216 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:51,218 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:54996': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:51,223 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:51,224 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:55010': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:51,323 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:51,323 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:55026': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:51,330 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:51,330 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:55036': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:51,429 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:51,430 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:55050': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:51,437 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:51,437 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:55066': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:51,537 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:51,537 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:45526': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:51,542 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:51,543 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:45532': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:51,643 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:51,643 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:45544': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:51,649 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:51,649 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:45546': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:51,750 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:51,751 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:45552': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:51,757 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:51,757 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:45556': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:51,857 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:51,857 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:45566': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:51,863 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:51,863 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:45580': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:51,964 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:51,964 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:45584': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:51,970 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:51,970 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:45592': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:52,070 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:52,070 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:45602': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:52,076 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:52,076 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:45608': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:52,177 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:52,177 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:45624': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:52,183 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:52,183 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:45640': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:52,284 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:52,285 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:45642': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:52,290 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:52,290 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:45644': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:52,392 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:52,392 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:45660': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:52,398 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:52,398 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:45674': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:52,499 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:52,500 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:45676': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:52,505 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:52,506 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:45680': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:52,607 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:52,608 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:45688': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:52,613 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:52,614 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:45690': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:52,716 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:52,716 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:45702': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:52,722 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:52,722 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:45704': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:52,822 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:52,822 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:45708': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:52,828 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:52,828 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:45722': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:52,929 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:52,929 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:45734': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:52,935 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:52,935 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:45750': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:53,036 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:53,036 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:45758': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:53,042 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:53,042 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:45762': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:53,143 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:53,144 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:45778': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:53,149 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:53,149 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:45786': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:53,250 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:53,251 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:45794': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:53,256 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45569 4768s 2024-11-23 21:47:53,256 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45569': TLS handshake failed with remote 'tls://127.0.0.1:45802': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:47:53,348 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46051. Reason: failure-to-start- 4768s 2024-11-23 21:47:53,348 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:47:53,350 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 13s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 4768s stream = await stream.start_tls( 4768s ^^^^^^^^^^^^^^^^^^^^^^^ 4768s False, ssl_options=ssl_options, server_hostname=host 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 4768s self.socket.do_handshake() 4768s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 4768s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 4768s self._sslobj.do_handshake() 4768s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 4768s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 4768s raise FatalCommClosedError( 4768s ...<2 lines>... 4768s ) from err 4768s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 4768s 4768s During handling of the above exception, another exception occurred: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1218, in _register_with_scheduler 4768s await asyncio.sleep(0.1) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 718, in sleep 4768s return await future 4768s ^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 13s. 4768s 2024-11-23 21:47:53,353 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44299. Reason: failure-to-start- 4768s 2024-11-23 21:47:53,353 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:47:54,356 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:47:54,362 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36893 4768s 2024-11-23 21:47:54,362 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45053/status 4768s 2024-11-23 21:47:54,362 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:47:54,374 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40381 4768s 2024-11-23 21:47:54,374 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40381 4768s 2024-11-23 21:47:54,374 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:47:54,374 - distributed.worker - INFO - dashboard at: 127.0.0.1:42723 4768s 2024-11-23 21:47:54,374 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36893 4768s 2024-11-23 21:47:54,374 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:47:54,374 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:47:54,374 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:47:54,374 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-spv6jtyl 4768s 2024-11-23 21:47:54,375 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:47:54,376 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35671 4768s 2024-11-23 21:47:54,376 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35671 4768s 2024-11-23 21:47:54,376 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:47:54,376 - distributed.worker - INFO - dashboard at: 127.0.0.1:37873 4768s 2024-11-23 21:47:54,376 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36893 4768s 2024-11-23 21:47:54,376 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:47:54,376 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:47:54,377 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:47:54,377 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-t_milvog 4768s 2024-11-23 21:47:54,377 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:47:54,377 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40381. Reason: failure-to-start- 4768s 2024-11-23 21:47:54,377 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:47:54,379 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35671. Reason: failure-to-start- 4768s 2024-11-23 21:47:54,379 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:47:54,380 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36893': TLS handshake failed with remote 'tls://127.0.0.1:58270': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:47:54,380 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36893': TLS handshake failed with remote 'tls://127.0.0.1:58286': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:47:54,382 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:47:55,386 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:47:55,393 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37913 4768s 2024-11-23 21:47:55,393 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37335/status 4768s 2024-11-23 21:47:55,393 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:47:55,404 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33451 4768s 2024-11-23 21:47:55,404 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33451 4768s 2024-11-23 21:47:55,404 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:47:55,404 - distributed.worker - INFO - dashboard at: 127.0.0.1:32789 4768s 2024-11-23 21:47:55,405 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37913 4768s 2024-11-23 21:47:55,405 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:47:55,405 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:47:55,405 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:47:55,405 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-uzgsacim 4768s 2024-11-23 21:47:55,405 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:47:55,406 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43019 4768s 2024-11-23 21:47:55,406 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43019 4768s 2024-11-23 21:47:55,406 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:47:55,406 - distributed.worker - INFO - dashboard at: 127.0.0.1:42591 4768s 2024-11-23 21:47:55,407 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37913 4768s 2024-11-23 21:47:55,407 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:47:55,407 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:47:55,407 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:47:55,407 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-xqwhvje9 4768s 2024-11-23 21:47:55,407 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:47:55,407 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33451. Reason: failure-to-start- 4768s 2024-11-23 21:47:55,408 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:47:55,408 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43019. Reason: failure-to-start- 4768s 2024-11-23 21:47:55,408 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:47:55,409 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37913': TLS handshake failed with remote 'tls://127.0.0.1:52372': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:47:55,409 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37913': TLS handshake failed with remote 'tls://127.0.0.1:52380': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:47:55,411 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:47:56,416 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:47:56,423 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39605 4768s 2024-11-23 21:47:56,424 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35369/status 4768s 2024-11-23 21:47:56,424 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:47:56,435 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36209 4768s 2024-11-23 21:47:56,435 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36209 4768s 2024-11-23 21:47:56,435 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:47:56,435 - distributed.worker - INFO - dashboard at: 127.0.0.1:34627 4768s 2024-11-23 21:47:56,435 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39605 4768s 2024-11-23 21:47:56,435 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:47:56,435 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:47:56,435 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:47:56,435 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-mthxtp3n 4768s 2024-11-23 21:47:56,435 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:47:56,437 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35885 4768s 2024-11-23 21:47:56,437 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35885 4768s 2024-11-23 21:47:56,437 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:47:56,437 - distributed.worker - INFO - dashboard at: 127.0.0.1:32779 4768s 2024-11-23 21:47:56,437 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39605 4768s 2024-11-23 21:47:56,437 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:47:56,437 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:47:56,437 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:47:56,437 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-fhe7f__d 4768s 2024-11-23 21:47:56,437 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:47:56,438 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36209. Reason: failure-to-start- 4768s 2024-11-23 21:47:56,438 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:47:56,438 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35885. Reason: failure-to-start- 4768s 2024-11-23 21:47:56,439 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:47:56,440 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39605': TLS handshake failed with remote 'tls://127.0.0.1:39490': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:47:56,440 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39605': TLS handshake failed with remote 'tls://127.0.0.1:39502': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:47:56,441 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:47:57,446 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:47:57,452 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40085 4768s 2024-11-23 21:47:57,453 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35413/status 4768s 2024-11-23 21:47:57,453 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:47:57,466 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41949 4768s 2024-11-23 21:47:57,466 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41949 4768s 2024-11-23 21:47:57,466 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:47:57,466 - distributed.worker - INFO - dashboard at: 127.0.0.1:38691 4768s 2024-11-23 21:47:57,467 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40085 4768s 2024-11-23 21:47:57,467 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:47:57,467 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:47:57,467 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:47:57,467 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-0k3k4h2o 4768s 2024-11-23 21:47:57,467 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:47:57,468 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36503 4768s 2024-11-23 21:47:57,469 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36503 4768s 2024-11-23 21:47:57,469 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:47:57,469 - distributed.worker - INFO - dashboard at: 127.0.0.1:42621 4768s 2024-11-23 21:47:57,469 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40085 4768s 2024-11-23 21:47:57,469 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:47:57,469 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:47:57,469 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:47:57,469 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-5lhd9qu3 4768s 2024-11-23 21:47:57,469 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:47:57,470 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41949. Reason: failure-to-start- 4768s 2024-11-23 21:47:57,470 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:47:57,470 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36503. Reason: failure-to-start- 4768s 2024-11-23 21:47:57,470 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:47:57,471 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40085': TLS handshake failed with remote 'tls://127.0.0.1:32914': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:47:57,471 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40085': TLS handshake failed with remote 'tls://127.0.0.1:32920': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:47:57,473 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:47:58,477 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:47:58,483 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43281 4768s 2024-11-23 21:47:58,484 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44739/status 4768s 2024-11-23 21:47:58,484 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:47:58,496 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46221 4768s 2024-11-23 21:47:58,496 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46221 4768s 2024-11-23 21:47:58,496 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:47:58,496 - distributed.worker - INFO - dashboard at: 127.0.0.1:41357 4768s 2024-11-23 21:47:58,496 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43281 4768s 2024-11-23 21:47:58,496 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:47:58,496 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:47:58,496 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:47:58,496 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-8fy6sf3z 4768s 2024-11-23 21:47:58,496 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:47:58,498 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38505 4768s 2024-11-23 21:47:58,498 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38505 4768s 2024-11-23 21:47:58,498 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:47:58,498 - distributed.worker - INFO - dashboard at: 127.0.0.1:38955 4768s 2024-11-23 21:47:58,498 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43281 4768s 2024-11-23 21:47:58,498 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:47:58,498 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:47:58,498 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:47:58,498 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-5b602wah 4768s 2024-11-23 21:47:58,498 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:47:58,499 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46221. Reason: failure-to-start- 4768s 2024-11-23 21:47:58,499 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:47:58,500 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38505. Reason: failure-to-start- 4768s 2024-11-23 21:47:58,500 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:47:58,501 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43281': TLS handshake failed with remote 'tls://127.0.0.1:54778': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:47:58,501 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43281': TLS handshake failed with remote 'tls://127.0.0.1:54792': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:47:58,502 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:47:59,508 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:47:59,513 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40495 4768s 2024-11-23 21:47:59,513 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45611/status 4768s 2024-11-23 21:47:59,514 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:47:59,526 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33051 4768s 2024-11-23 21:47:59,526 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33051 4768s 2024-11-23 21:47:59,526 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:47:59,526 - distributed.worker - INFO - dashboard at: 127.0.0.1:38895 4768s 2024-11-23 21:47:59,526 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40495 4768s 2024-11-23 21:47:59,526 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:47:59,526 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:47:59,526 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:47:59,526 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-yqvyjdlc 4768s 2024-11-23 21:47:59,527 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:47:59,528 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41841 4768s 2024-11-23 21:47:59,528 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41841 4768s 2024-11-23 21:47:59,528 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:47:59,528 - distributed.worker - INFO - dashboard at: 127.0.0.1:34255 4768s 2024-11-23 21:47:59,528 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40495 4768s 2024-11-23 21:47:59,529 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:47:59,529 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:47:59,529 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:47:59,529 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-elb86df2 4768s 2024-11-23 21:47:59,529 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:47:59,530 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33051. Reason: failure-to-start- 4768s 2024-11-23 21:47:59,530 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:47:59,530 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41841. Reason: failure-to-start- 4768s 2024-11-23 21:47:59,530 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:47:59,531 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40495': TLS handshake failed with remote 'tls://127.0.0.1:34634': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:47:59,531 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40495': TLS handshake failed with remote 'tls://127.0.0.1:34648': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:47:59,533 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:48:00,537 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:48:00,544 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42653 4768s 2024-11-23 21:48:00,544 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33521/status 4768s 2024-11-23 21:48:00,544 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:48:00,557 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43039 4768s 2024-11-23 21:48:00,557 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43039 4768s 2024-11-23 21:48:00,557 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:48:00,557 - distributed.worker - INFO - dashboard at: 127.0.0.1:38017 4768s 2024-11-23 21:48:00,557 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42653 4768s 2024-11-23 21:48:00,557 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:48:00,558 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:48:00,558 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:48:00,558 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-or0j95yn 4768s 2024-11-23 21:48:00,558 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:48:00,559 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43053 4768s 2024-11-23 21:48:00,559 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43053 4768s 2024-11-23 21:48:00,560 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:48:00,560 - distributed.worker - INFO - dashboard at: 127.0.0.1:41581 4768s 2024-11-23 21:48:00,560 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42653 4768s 2024-11-23 21:48:00,560 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:48:00,560 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:48:00,560 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:48:00,560 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-dnv2scj0 4768s 2024-11-23 21:48:00,560 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:48:00,561 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43039. Reason: failure-to-start- 4768s 2024-11-23 21:48:00,561 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:48:00,562 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43053. Reason: failure-to-start- 4768s 2024-11-23 21:48:00,562 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:48:00,563 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42653': TLS handshake failed with remote 'tls://127.0.0.1:45136': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:48:00,563 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42653': TLS handshake failed with remote 'tls://127.0.0.1:45144': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:48:00,564 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:48:01,569 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:48:01,576 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40951 4768s 2024-11-23 21:48:01,576 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36039/status 4768s 2024-11-23 21:48:01,576 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:48:01,589 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38117 4768s 2024-11-23 21:48:01,589 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38117 4768s 2024-11-23 21:48:01,589 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:48:01,589 - distributed.worker - INFO - dashboard at: 127.0.0.1:32821 4768s 2024-11-23 21:48:01,590 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40951 4768s 2024-11-23 21:48:01,590 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:48:01,590 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:48:01,590 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:48:01,590 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-u21mqs75 4768s 2024-11-23 21:48:01,590 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:48:01,592 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36743 4768s 2024-11-23 21:48:01,592 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36743 4768s 2024-11-23 21:48:01,592 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:48:01,592 - distributed.worker - INFO - dashboard at: 127.0.0.1:33593 4768s 2024-11-23 21:48:01,592 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40951 4768s 2024-11-23 21:48:01,592 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:48:01,592 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:48:01,592 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:48:01,592 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-bvy0jnl3 4768s 2024-11-23 21:48:01,592 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:48:01,593 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38117. Reason: failure-to-start- 4768s 2024-11-23 21:48:01,593 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:48:01,594 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36743. Reason: failure-to-start- 4768s 2024-11-23 21:48:01,594 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:48:01,595 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40951': TLS handshake failed with remote 'tls://127.0.0.1:49870': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:48:01,595 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40951': TLS handshake failed with remote 'tls://127.0.0.1:49880': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:48:01,596 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:48:02,602 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:48:02,608 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40875 4768s 2024-11-23 21:48:02,608 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39481/status 4768s 2024-11-23 21:48:02,609 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:48:02,620 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38773 4768s 2024-11-23 21:48:02,621 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38773 4768s 2024-11-23 21:48:02,621 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:48:02,621 - distributed.worker - INFO - dashboard at: 127.0.0.1:36229 4768s 2024-11-23 21:48:02,621 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40875 4768s 2024-11-23 21:48:02,621 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:48:02,621 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:48:02,621 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:48:02,621 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-1jffidkz 4768s 2024-11-23 21:48:02,621 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:48:02,623 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34977 4768s 2024-11-23 21:48:02,623 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34977 4768s 2024-11-23 21:48:02,623 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:48:02,623 - distributed.worker - INFO - dashboard at: 127.0.0.1:39197 4768s 2024-11-23 21:48:02,623 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40875 4768s 2024-11-23 21:48:02,623 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:48:02,623 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:48:02,623 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:48:02,623 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-u4k7k2fc 4768s 2024-11-23 21:48:02,623 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:48:02,624 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38773. Reason: failure-to-start- 4768s 2024-11-23 21:48:02,625 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:48:02,625 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34977. Reason: failure-to-start- 4768s 2024-11-23 21:48:02,625 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:48:02,626 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40875': TLS handshake failed with remote 'tls://127.0.0.1:53506': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:48:02,626 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40875': TLS handshake failed with remote 'tls://127.0.0.1:53508': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:48:02,628 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:48:03,633 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:48:03,639 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36673 4768s 2024-11-23 21:48:03,640 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43213/status 4768s 2024-11-23 21:48:03,640 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:48:03,652 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41061 4768s 2024-11-23 21:48:03,652 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41061 4768s 2024-11-23 21:48:03,652 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:48:03,652 - distributed.worker - INFO - dashboard at: 127.0.0.1:46331 4768s 2024-11-23 21:48:03,652 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36673 4768s 2024-11-23 21:48:03,652 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:48:03,652 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:48:03,652 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:48:03,652 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-i8mceymk 4768s 2024-11-23 21:48:03,653 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:48:03,654 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41255 4768s 2024-11-23 21:48:03,654 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41255 4768s 2024-11-23 21:48:03,654 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:48:03,654 - distributed.worker - INFO - dashboard at: 127.0.0.1:41083 4768s 2024-11-23 21:48:03,654 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36673 4768s 2024-11-23 21:48:03,654 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:48:03,654 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:48:03,654 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:48:03,654 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-5cczfrjj 4768s 2024-11-23 21:48:03,654 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:48:03,655 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41061. Reason: failure-to-start- 4768s 2024-11-23 21:48:03,655 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:48:03,656 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41255. Reason: failure-to-start- 4768s 2024-11-23 21:48:03,656 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:48:03,657 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36673': TLS handshake failed with remote 'tls://127.0.0.1:34744': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:48:03,657 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36673': TLS handshake failed with remote 'tls://127.0.0.1:34760': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:48:03,658 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:48:04,664 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:48:04,670 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44271 4768s 2024-11-23 21:48:04,670 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35575/status 4768s 2024-11-23 21:48:04,670 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:48:04,690 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35139 4768s 2024-11-23 21:48:04,690 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35139 4768s 2024-11-23 21:48:04,690 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:48:04,690 - distributed.worker - INFO - dashboard at: 127.0.0.1:42285 4768s 2024-11-23 21:48:04,690 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44271 4768s 2024-11-23 21:48:04,691 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:48:04,691 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:48:04,691 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:48:04,691 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-rr7jcigd 4768s 2024-11-23 21:48:04,691 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:48:04,692 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42273 4768s 2024-11-23 21:48:04,693 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42273 4768s 2024-11-23 21:48:04,693 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:48:04,693 - distributed.worker - INFO - dashboard at: 127.0.0.1:35943 4768s 2024-11-23 21:48:04,693 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44271 4768s 2024-11-23 21:48:04,693 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:48:04,693 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:48:04,693 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:48:04,693 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-nrwma8gm 4768s 2024-11-23 21:48:04,693 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:48:04,694 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35139. Reason: failure-to-start- 4768s 2024-11-23 21:48:04,694 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:48:04,695 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42273. Reason: failure-to-start- 4768s 2024-11-23 21:48:04,695 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:48:04,696 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44271': TLS handshake failed with remote 'tls://127.0.0.1:39894': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:48:04,696 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44271': TLS handshake failed with remote 'tls://127.0.0.1:39904': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:48:04,698 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:48:05,703 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:48:05,709 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38137 4768s 2024-11-23 21:48:05,710 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34285/status 4768s 2024-11-23 21:48:05,710 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:48:05,723 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41269 4768s 2024-11-23 21:48:05,723 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41269 4768s 2024-11-23 21:48:05,723 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:48:05,723 - distributed.worker - INFO - dashboard at: 127.0.0.1:39767 4768s 2024-11-23 21:48:05,723 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38137 4768s 2024-11-23 21:48:05,723 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:48:05,724 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:48:05,724 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:48:05,724 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-yao1bivq 4768s 2024-11-23 21:48:05,724 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:48:05,726 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39701 4768s 2024-11-23 21:48:05,726 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39701 4768s 2024-11-23 21:48:05,726 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:48:05,726 - distributed.worker - INFO - dashboard at: 127.0.0.1:39355 4768s 2024-11-23 21:48:05,726 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38137 4768s 2024-11-23 21:48:05,726 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:48:05,726 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:48:05,726 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:48:05,727 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-x4rtrbk4 4768s 2024-11-23 21:48:05,727 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:48:05,727 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41269. Reason: failure-to-start- 4768s 2024-11-23 21:48:05,728 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:48:05,728 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39701. Reason: failure-to-start- 4768s 2024-11-23 21:48:05,728 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:48:05,729 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38137': TLS handshake failed with remote 'tls://127.0.0.1:46832': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:48:05,729 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38137': TLS handshake failed with remote 'tls://127.0.0.1:46838': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:48:05,731 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:48:06,737 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:48:06,743 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42011 4768s 2024-11-23 21:48:06,744 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38731/status 4768s 2024-11-23 21:48:06,744 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:48:06,756 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45005 4768s 2024-11-23 21:48:06,757 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45005 4768s 2024-11-23 21:48:06,757 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:48:06,757 - distributed.worker - INFO - dashboard at: 127.0.0.1:43267 4768s 2024-11-23 21:48:06,757 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42011 4768s 2024-11-23 21:48:06,757 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:48:06,757 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:48:06,757 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:48:06,757 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ch2ajd_2 4768s 2024-11-23 21:48:06,757 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:48:06,759 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34165 4768s 2024-11-23 21:48:06,759 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34165 4768s 2024-11-23 21:48:06,759 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:48:06,759 - distributed.worker - INFO - dashboard at: 127.0.0.1:42297 4768s 2024-11-23 21:48:06,759 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42011 4768s 2024-11-23 21:48:06,759 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:48:06,759 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:48:06,759 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:48:06,759 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-047x1whh 4768s 2024-11-23 21:48:06,759 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:48:06,760 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45005. Reason: failure-to-start- 4768s 2024-11-23 21:48:06,760 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:48:06,761 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34165. Reason: failure-to-start- 4768s 2024-11-23 21:48:06,761 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:48:06,762 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42011': TLS handshake failed with remote 'tls://127.0.0.1:59464': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:48:06,762 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42011': TLS handshake failed with remote 'tls://127.0.0.1:59474': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:48:06,763 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:48:07,768 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:48:07,776 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45893 4768s 2024-11-23 21:48:07,777 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35599/status 4768s 2024-11-23 21:48:07,777 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:48:07,790 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36141 4768s 2024-11-23 21:48:07,790 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36141 4768s 2024-11-23 21:48:07,790 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:48:07,790 - distributed.worker - INFO - dashboard at: 127.0.0.1:32921 4768s 2024-11-23 21:48:07,790 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45893 4768s 2024-11-23 21:48:07,790 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:48:07,790 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:48:07,790 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:48:07,791 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-i7pf50cl 4768s 2024-11-23 21:48:07,791 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:48:07,792 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39327 4768s 2024-11-23 21:48:07,793 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39327 4768s 2024-11-23 21:48:07,793 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:48:07,793 - distributed.worker - INFO - dashboard at: 127.0.0.1:35275 4768s 2024-11-23 21:48:07,793 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45893 4768s 2024-11-23 21:48:07,793 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:48:07,793 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:48:07,793 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:48:07,793 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-zibzwk4t 4768s 2024-11-23 21:48:07,793 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:48:07,794 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36141. Reason: failure-to-start- 4768s 2024-11-23 21:48:07,794 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:48:07,794 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39327. Reason: failure-to-start- 4768s 2024-11-23 21:48:07,795 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:48:07,796 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45893': TLS handshake failed with remote 'tls://127.0.0.1:47320': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:48:07,796 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45893': TLS handshake failed with remote 'tls://127.0.0.1:47334': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:48:07,797 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:48:08,802 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:48:08,808 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35201 4768s 2024-11-23 21:48:08,809 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45283/status 4768s 2024-11-23 21:48:08,809 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:48:08,823 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45577 4768s 2024-11-23 21:48:08,824 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45577 4768s 2024-11-23 21:48:08,824 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:48:08,824 - distributed.worker - INFO - dashboard at: 127.0.0.1:37977 4768s 2024-11-23 21:48:08,824 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35201 4768s 2024-11-23 21:48:08,824 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:48:08,824 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:48:08,824 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:48:08,824 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-632tzpmp 4768s 2024-11-23 21:48:08,824 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:48:08,826 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33529 4768s 2024-11-23 21:48:08,826 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33529 4768s 2024-11-23 21:48:08,826 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:48:08,826 - distributed.worker - INFO - dashboard at: 127.0.0.1:43293 4768s 2024-11-23 21:48:08,826 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35201 4768s 2024-11-23 21:48:08,826 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:48:08,826 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:48:08,826 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:48:08,826 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-jyyeot36 4768s 2024-11-23 21:48:08,826 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:48:08,827 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45577. Reason: failure-to-start- 4768s 2024-11-23 21:48:08,827 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:48:08,828 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33529. Reason: failure-to-start- 4768s 2024-11-23 21:48:08,828 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:48:08,829 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35201': TLS handshake failed with remote 'tls://127.0.0.1:34558': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:48:08,829 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35201': TLS handshake failed with remote 'tls://127.0.0.1:34570': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:48:08,830 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:48:09,835 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:48:09,842 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35823 4768s 2024-11-23 21:48:09,842 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40351/status 4768s 2024-11-23 21:48:09,843 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:48:09,857 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46221 4768s 2024-11-23 21:48:09,857 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46221 4768s 2024-11-23 21:48:09,857 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:48:09,857 - distributed.worker - INFO - dashboard at: 127.0.0.1:44001 4768s 2024-11-23 21:48:09,857 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35823 4768s 2024-11-23 21:48:09,858 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:48:09,858 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:48:09,858 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:48:09,858 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-1o39mcpw 4768s 2024-11-23 21:48:09,858 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:48:09,860 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41019 4768s 2024-11-23 21:48:09,860 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41019 4768s 2024-11-23 21:48:09,860 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:48:09,860 - distributed.worker - INFO - dashboard at: 127.0.0.1:45857 4768s 2024-11-23 21:48:09,860 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35823 4768s 2024-11-23 21:48:09,860 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:48:09,861 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:48:09,861 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:48:09,861 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-hk7scg_k 4768s 2024-11-23 21:48:09,861 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:48:09,862 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46221. Reason: failure-to-start- 4768s 2024-11-23 21:48:09,862 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:48:09,862 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41019. Reason: failure-to-start- 4768s 2024-11-23 21:48:09,862 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:48:09,863 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35823': TLS handshake failed with remote 'tls://127.0.0.1:46132': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:48:09,863 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35823': TLS handshake failed with remote 'tls://127.0.0.1:46140': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:48:09,867 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:48:10,872 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:48:10,878 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37195 4768s 2024-11-23 21:48:10,878 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42375/status 4768s 2024-11-23 21:48:10,878 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:48:10,891 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42207 4768s 2024-11-23 21:48:10,891 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42207 4768s 2024-11-23 21:48:10,891 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:48:10,891 - distributed.worker - INFO - dashboard at: 127.0.0.1:40349 4768s 2024-11-23 21:48:10,891 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37195 4768s 2024-11-23 21:48:10,891 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:48:10,891 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:48:10,891 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:48:10,891 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-y0tq9ow7 4768s 2024-11-23 21:48:10,891 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:48:10,893 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46661 4768s 2024-11-23 21:48:10,893 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46661 4768s 2024-11-23 21:48:10,893 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:48:10,893 - distributed.worker - INFO - dashboard at: 127.0.0.1:36483 4768s 2024-11-23 21:48:10,893 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37195 4768s 2024-11-23 21:48:10,894 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:48:10,894 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:48:10,894 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:48:10,894 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-3b5vhqoj 4768s 2024-11-23 21:48:10,894 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:48:10,895 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42207. Reason: failure-to-start- 4768s 2024-11-23 21:48:10,895 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:48:10,895 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46661. Reason: failure-to-start- 4768s 2024-11-23 21:48:10,895 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:48:10,898 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37195': TLS handshake failed with remote 'tls://127.0.0.1:33618': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:48:10,899 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37195': TLS handshake failed with remote 'tls://127.0.0.1:33634': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:48:10,900 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:48:11,905 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:48:11,912 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40901 4768s 2024-11-23 21:48:11,912 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41345/status 4768s 2024-11-23 21:48:11,912 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:48:11,925 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37321 4768s 2024-11-23 21:48:11,925 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37321 4768s 2024-11-23 21:48:11,925 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:48:11,925 - distributed.worker - INFO - dashboard at: 127.0.0.1:42169 4768s 2024-11-23 21:48:11,925 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40901 4768s 2024-11-23 21:48:11,925 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:48:11,925 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:48:11,925 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:48:11,926 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-u6ptlx1b 4768s 2024-11-23 21:48:11,926 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:48:11,927 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39073 4768s 2024-11-23 21:48:11,927 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39073 4768s 2024-11-23 21:48:11,927 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:48:11,927 - distributed.worker - INFO - dashboard at: 127.0.0.1:33311 4768s 2024-11-23 21:48:11,927 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40901 4768s 2024-11-23 21:48:11,927 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:48:11,928 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:48:11,928 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:48:11,928 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-axrkgkil 4768s 2024-11-23 21:48:11,928 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:48:11,929 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37321. Reason: failure-to-start- 4768s 2024-11-23 21:48:11,929 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:48:11,929 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39073. Reason: failure-to-start- 4768s 2024-11-23 21:48:11,929 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:48:11,932 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40901': TLS handshake failed with remote 'tls://127.0.0.1:37784': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:48:11,932 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40901': TLS handshake failed with remote 'tls://127.0.0.1:37798': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:48:11,934 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:48:12,939 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:48:12,946 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40451 4768s 2024-11-23 21:48:12,946 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36097/status 4768s 2024-11-23 21:48:12,947 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:48:12,961 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39903 4768s 2024-11-23 21:48:12,961 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39903 4768s 2024-11-23 21:48:12,961 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:48:12,961 - distributed.worker - INFO - dashboard at: 127.0.0.1:34627 4768s 2024-11-23 21:48:12,961 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 4768s 2024-11-23 21:48:12,961 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:48:12,961 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:48:12,961 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:48:12,962 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-vpoo8wi6 4768s 2024-11-23 21:48:12,962 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:48:12,963 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45617 4768s 2024-11-23 21:48:12,963 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45617 4768s 2024-11-23 21:48:12,963 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:48:12,963 - distributed.worker - INFO - dashboard at: 127.0.0.1:34685 4768s 2024-11-23 21:48:12,963 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40451 4768s 2024-11-23 21:48:12,964 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:48:12,964 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:48:12,964 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:48:12,964 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-y2r8w3jp 4768s 2024-11-23 21:48:12,964 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:48:12,967 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39903. Reason: failure-to-start- 4768s 2024-11-23 21:48:12,967 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:48:12,967 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45617. Reason: failure-to-start- 4768s 2024-11-23 21:48:12,967 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:48:12,968 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:39162': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:48:12,968 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40451': TLS handshake failed with remote 'tls://127.0.0.1:39172': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:48:12,970 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:48:13,974 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:48:13,982 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39543 4768s 2024-11-23 21:48:13,983 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33207/status 4768s 2024-11-23 21:48:13,983 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:48:13,997 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37841 4768s 2024-11-23 21:48:13,998 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37841 4768s 2024-11-23 21:48:13,998 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:48:13,998 - distributed.worker - INFO - dashboard at: 127.0.0.1:33839 4768s 2024-11-23 21:48:13,998 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39543 4768s 2024-11-23 21:48:13,998 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:48:13,998 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:48:13,998 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:48:13,998 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-0g15xhf_ 4768s 2024-11-23 21:48:13,998 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:48:14,000 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42195 4768s 2024-11-23 21:48:14,000 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42195 4768s 2024-11-23 21:48:14,000 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:48:14,000 - distributed.worker - INFO - dashboard at: 127.0.0.1:34377 4768s 2024-11-23 21:48:14,000 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39543 4768s 2024-11-23 21:48:14,000 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:48:14,000 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:48:14,000 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:48:14,001 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-k6ogc23u 4768s 2024-11-23 21:48:14,001 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:48:14,004 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37841. Reason: failure-to-start- 4768s 2024-11-23 21:48:14,004 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:48:14,004 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42195. Reason: failure-to-start- 4768s 2024-11-23 21:48:14,004 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:48:14,005 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39543': TLS handshake failed with remote 'tls://127.0.0.1:33430': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:48:14,006 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39543': TLS handshake failed with remote 'tls://127.0.0.1:33446': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:48:14,007 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:48:15,011 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:48:15,019 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37131 4768s 2024-11-23 21:48:15,019 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39191/status 4768s 2024-11-23 21:48:15,019 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:48:15,035 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38057 4768s 2024-11-23 21:48:15,035 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38057 4768s 2024-11-23 21:48:15,035 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:48:15,035 - distributed.worker - INFO - dashboard at: 127.0.0.1:36169 4768s 2024-11-23 21:48:15,036 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37131 4768s 2024-11-23 21:48:15,036 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:48:15,036 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:48:15,036 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:48:15,036 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-p145zc22 4768s 2024-11-23 21:48:15,036 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:48:15,038 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37651 4768s 2024-11-23 21:48:15,038 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37651 4768s 2024-11-23 21:48:15,038 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:48:15,038 - distributed.worker - INFO - dashboard at: 127.0.0.1:42179 4768s 2024-11-23 21:48:15,038 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37131 4768s 2024-11-23 21:48:15,038 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:48:15,038 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:48:15,038 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:48:15,038 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-v67eqa19 4768s 2024-11-23 21:48:15,038 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:48:15,040 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38057. Reason: failure-to-start- 4768s 2024-11-23 21:48:15,040 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:48:15,040 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37651. Reason: failure-to-start- 4768s 2024-11-23 21:48:15,041 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:48:15,042 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37131': TLS handshake failed with remote 'tls://127.0.0.1:58338': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:48:15,042 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37131': TLS handshake failed with remote 'tls://127.0.0.1:58348': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:48:15,043 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:48:16,049 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:48:16,056 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33533 4768s 2024-11-23 21:48:16,056 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42379/status 4768s 2024-11-23 21:48:16,057 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:48:16,070 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34483 4768s 2024-11-23 21:48:16,071 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34483 4768s 2024-11-23 21:48:16,071 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:48:16,071 - distributed.worker - INFO - dashboard at: 127.0.0.1:46107 4768s 2024-11-23 21:48:16,071 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33533 4768s 2024-11-23 21:48:16,071 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:48:16,071 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:48:16,071 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:48:16,071 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-oxqkt3bl 4768s 2024-11-23 21:48:16,071 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:48:16,073 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33803 4768s 2024-11-23 21:48:16,073 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33803 4768s 2024-11-23 21:48:16,073 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:48:16,073 - distributed.worker - INFO - dashboard at: 127.0.0.1:43011 4768s 2024-11-23 21:48:16,073 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33533 4768s 2024-11-23 21:48:16,073 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:48:16,073 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:48:16,073 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:48:16,073 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-4f185mfw 4768s 2024-11-23 21:48:16,073 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:48:16,074 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34483. Reason: failure-to-start- 4768s 2024-11-23 21:48:16,075 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:48:16,075 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33803. Reason: failure-to-start- 4768s 2024-11-23 21:48:16,075 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:48:16,076 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33533': TLS handshake failed with remote 'tls://127.0.0.1:35918': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:48:16,076 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33533': TLS handshake failed with remote 'tls://127.0.0.1:35932': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:48:16,080 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:48:17,085 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:48:17,093 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44255 4768s 2024-11-23 21:48:17,093 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45733/status 4768s 2024-11-23 21:48:17,094 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:48:17,107 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42895 4768s 2024-11-23 21:48:17,108 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42895 4768s 2024-11-23 21:48:17,108 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:48:17,108 - distributed.worker - INFO - dashboard at: 127.0.0.1:46801 4768s 2024-11-23 21:48:17,108 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44255 4768s 2024-11-23 21:48:17,108 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:48:17,108 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:48:17,108 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:48:17,108 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-j6qoomww 4768s 2024-11-23 21:48:17,108 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:48:17,110 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37567 4768s 2024-11-23 21:48:17,110 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37567 4768s 2024-11-23 21:48:17,110 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:48:17,110 - distributed.worker - INFO - dashboard at: 127.0.0.1:42245 4768s 2024-11-23 21:48:17,110 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44255 4768s 2024-11-23 21:48:17,110 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:48:17,110 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:48:17,110 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:48:17,110 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-kbjsma_3 4768s 2024-11-23 21:48:17,110 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:48:17,111 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42895. Reason: failure-to-start- 4768s 2024-11-23 21:48:17,112 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:48:17,112 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37567. Reason: failure-to-start- 4768s 2024-11-23 21:48:17,112 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:48:17,116 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44255': TLS handshake failed with remote 'tls://127.0.0.1:53754': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:48:17,116 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44255': TLS handshake failed with remote 'tls://127.0.0.1:53762': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:48:17,118 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:48:18,123 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:48:18,129 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35611 4768s 2024-11-23 21:48:18,130 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44563/status 4768s 2024-11-23 21:48:18,130 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:48:18,144 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36021 4768s 2024-11-23 21:48:18,144 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36021 4768s 2024-11-23 21:48:18,144 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:48:18,144 - distributed.worker - INFO - dashboard at: 127.0.0.1:43621 4768s 2024-11-23 21:48:18,144 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35611 4768s 2024-11-23 21:48:18,144 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:48:18,144 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:48:18,144 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:48:18,145 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-rabnhzrj 4768s 2024-11-23 21:48:18,145 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:48:18,146 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39539 4768s 2024-11-23 21:48:18,146 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39539 4768s 2024-11-23 21:48:18,146 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:48:18,146 - distributed.worker - INFO - dashboard at: 127.0.0.1:45351 4768s 2024-11-23 21:48:18,147 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35611 4768s 2024-11-23 21:48:18,147 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:48:18,147 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:48:18,147 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:48:18,147 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-d8koysw0 4768s 2024-11-23 21:48:18,147 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:48:18,150 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36021. Reason: failure-to-start- 4768s 2024-11-23 21:48:18,150 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:48:18,151 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39539. Reason: failure-to-start- 4768s 2024-11-23 21:48:18,151 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:48:18,152 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35611': TLS handshake failed with remote 'tls://127.0.0.1:46676': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:48:18,152 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35611': TLS handshake failed with remote 'tls://127.0.0.1:46688': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:48:18,153 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:48:19,159 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:48:19,165 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41747 4768s 2024-11-23 21:48:19,166 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46401/status 4768s 2024-11-23 21:48:19,166 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:48:19,181 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46453 4768s 2024-11-23 21:48:19,181 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46453 4768s 2024-11-23 21:48:19,181 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:48:19,181 - distributed.worker - INFO - dashboard at: 127.0.0.1:40239 4768s 2024-11-23 21:48:19,181 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41747 4768s 2024-11-23 21:48:19,181 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:48:19,181 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:48:19,181 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:48:19,181 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-l_sbc8y7 4768s 2024-11-23 21:48:19,181 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:48:19,184 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35701 4768s 2024-11-23 21:48:19,184 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35701 4768s 2024-11-23 21:48:19,184 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:48:19,184 - distributed.worker - INFO - dashboard at: 127.0.0.1:42697 4768s 2024-11-23 21:48:19,184 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41747 4768s 2024-11-23 21:48:19,184 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:48:19,185 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:48:19,185 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:48:19,185 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-t1dvnlz5 4768s 2024-11-23 21:48:19,185 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:48:19,188 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46453. Reason: failure-to-start- 4768s 2024-11-23 21:48:19,188 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:48:19,189 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35701. Reason: failure-to-start- 4768s 2024-11-23 21:48:19,189 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:48:19,190 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41747': TLS handshake failed with remote 'tls://127.0.0.1:43596': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:48:19,190 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41747': TLS handshake failed with remote 'tls://127.0.0.1:43602': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:48:19,191 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:48:20,196 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:48:20,203 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38351 4768s 2024-11-23 21:48:20,203 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38345/status 4768s 2024-11-23 21:48:20,203 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:48:20,216 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34807 4768s 2024-11-23 21:48:20,217 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34807 4768s 2024-11-23 21:48:20,217 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:48:20,217 - distributed.worker - INFO - dashboard at: 127.0.0.1:42871 4768s 2024-11-23 21:48:20,217 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38351 4768s 2024-11-23 21:48:20,217 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:48:20,217 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:48:20,217 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:48:20,217 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-bhje7xzw 4768s 2024-11-23 21:48:20,217 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:48:20,219 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43235 4768s 2024-11-23 21:48:20,219 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43235 4768s 2024-11-23 21:48:20,219 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:48:20,219 - distributed.worker - INFO - dashboard at: 127.0.0.1:42739 4768s 2024-11-23 21:48:20,219 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38351 4768s 2024-11-23 21:48:20,219 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:48:20,219 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:48:20,219 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:48:20,219 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-s5l3g9mv 4768s 2024-11-23 21:48:20,219 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:48:20,231 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34807. Reason: failure-to-start- 4768s 2024-11-23 21:48:20,231 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:48:20,231 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43235. Reason: failure-to-start- 4768s 2024-11-23 21:48:20,232 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:48:20,233 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38351': TLS handshake failed with remote 'tls://127.0.0.1:54516': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:48:20,233 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38351': TLS handshake failed with remote 'tls://127.0.0.1:54526': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:48:20,234 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:48:21,239 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:48:21,246 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35737 4768s 2024-11-23 21:48:21,246 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33847/status 4768s 2024-11-23 21:48:21,247 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:48:21,263 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42803 4768s 2024-11-23 21:48:21,263 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42803 4768s 2024-11-23 21:48:21,264 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:48:21,264 - distributed.worker - INFO - dashboard at: 127.0.0.1:33673 4768s 2024-11-23 21:48:21,264 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35737 4768s 2024-11-23 21:48:21,264 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:48:21,264 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:48:21,264 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:48:21,264 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-h5r8j1z4 4768s 2024-11-23 21:48:21,264 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:48:21,266 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38897 4768s 2024-11-23 21:48:21,266 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38897 4768s 2024-11-23 21:48:21,266 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:48:21,266 - distributed.worker - INFO - dashboard at: 127.0.0.1:33811 4768s 2024-11-23 21:48:21,266 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35737 4768s 2024-11-23 21:48:21,266 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:48:21,266 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:48:21,266 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:48:21,266 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ty3q3giy 4768s 2024-11-23 21:48:21,266 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:48:21,267 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42803. Reason: failure-to-start- 4768s 2024-11-23 21:48:21,268 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:48:21,268 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38897. Reason: failure-to-start- 4768s 2024-11-23 21:48:21,268 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:48:21,269 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35737': TLS handshake failed with remote 'tls://127.0.0.1:54698': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:48:21,269 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35737': TLS handshake failed with remote 'tls://127.0.0.1:54704': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:48:21,271 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:48:22,276 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:48:22,285 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44701 4768s 2024-11-23 21:48:22,285 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43461/status 4768s 2024-11-23 21:48:22,285 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:48:22,553 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36455 4768s 2024-11-23 21:48:22,554 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36455 4768s 2024-11-23 21:48:22,554 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:48:22,554 - distributed.worker - INFO - dashboard at: 127.0.0.1:46075 4768s 2024-11-23 21:48:22,554 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44701 4768s 2024-11-23 21:48:22,554 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:48:22,554 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:48:22,554 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:48:22,554 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-srlruwcf 4768s 2024-11-23 21:48:22,554 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:48:22,556 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38187 4768s 2024-11-23 21:48:22,556 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38187 4768s 2024-11-23 21:48:22,556 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:48:22,556 - distributed.worker - INFO - dashboard at: 127.0.0.1:42027 4768s 2024-11-23 21:48:22,556 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44701 4768s 2024-11-23 21:48:22,556 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:48:22,556 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:48:22,556 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:48:22,556 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-b77l04h_ 4768s 2024-11-23 21:48:22,556 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:48:22,563 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36455. Reason: failure-to-start- 4768s 2024-11-23 21:48:22,563 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:48:22,563 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38187. Reason: failure-to-start- 4768s 2024-11-23 21:48:22,564 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:48:22,567 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44701': TLS handshake failed with remote 'tls://127.0.0.1:50946': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:48:22,567 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44701': TLS handshake failed with remote 'tls://127.0.0.1:50952': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:48:22,568 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:48:23,573 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:48:23,580 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35807 4768s 2024-11-23 21:48:23,581 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41047/status 4768s 2024-11-23 21:48:23,581 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:48:23,596 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44165 4768s 2024-11-23 21:48:23,596 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44165 4768s 2024-11-23 21:48:23,596 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:48:23,596 - distributed.worker - INFO - dashboard at: 127.0.0.1:35509 4768s 2024-11-23 21:48:23,596 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35807 4768s 2024-11-23 21:48:23,596 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:48:23,596 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:48:23,596 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:48:23,596 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-39j2fp60 4768s 2024-11-23 21:48:23,596 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:48:23,597 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45727 4768s 2024-11-23 21:48:23,597 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45727 4768s 2024-11-23 21:48:23,598 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:48:23,598 - distributed.worker - INFO - dashboard at: 127.0.0.1:35665 4768s 2024-11-23 21:48:23,598 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35807 4768s 2024-11-23 21:48:23,598 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:48:23,598 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:48:23,598 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:48:23,598 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-98nn4tqk 4768s 2024-11-23 21:48:23,598 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:48:23,601 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44165. Reason: failure-to-start- 4768s 2024-11-23 21:48:23,601 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:48:23,601 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45727. Reason: failure-to-start- 4768s 2024-11-23 21:48:23,601 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:48:23,603 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35807': TLS handshake failed with remote 'tls://127.0.0.1:48402': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:48:23,603 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35807': TLS handshake failed with remote 'tls://127.0.0.1:48410': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:48:23,604 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s _____________________________ test_retire_workers ______________________________ 4768s 4768s fut = , timeout = 0 4768s 4768s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 4768s async with asyncio.timeout(timeout): 4768s > return await fut 4768s 4768s /usr/lib/python3/dist-packages/distributed/utils.py:1960: 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s /usr/lib/python3/dist-packages/distributed/nanny.py:358: in start_unsafe 4768s comm = await self.rpc.connect(saddr) 4768s /usr/lib/python3/dist-packages/distributed/core.py:1620: in connect 4768s return await self._connect(addr=addr, timeout=timeout) 4768s /usr/lib/python3/dist-packages/distributed/core.py:1564: in _connect 4768s comm = await connect( 4768s /usr/lib/python3/dist-packages/distributed/comm/core.py:342: in connect 4768s comm = await wait_for( 4768s /usr/lib/python3/dist-packages/distributed/utils.py:1960: in wait_for 4768s return await fut 4768s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:546: in connect 4768s stream = await self.client.connect( 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s 4768s self = , host = '127.0.0.1' 4768s port = 35249, af = 4768s ssl_options = 4768s max_buffer_size = 8364507136.0, source_ip = None, source_port = None 4768s timeout = None 4768s 4768s async def connect( 4768s self, 4768s host: str, 4768s port: int, 4768s af: socket.AddressFamily = socket.AF_UNSPEC, 4768s ssl_options: Optional[Union[Dict[str, Any], ssl.SSLContext]] = None, 4768s max_buffer_size: Optional[int] = None, 4768s source_ip: Optional[str] = None, 4768s source_port: Optional[int] = None, 4768s timeout: Optional[Union[float, datetime.timedelta]] = None, 4768s ) -> IOStream: 4768s """Connect to the given host and port. 4768s 4768s Asynchronously returns an `.IOStream` (or `.SSLIOStream` if 4768s ``ssl_options`` is not None). 4768s 4768s Using the ``source_ip`` kwarg, one can specify the source 4768s IP address to use when establishing the connection. 4768s In case the user needs to resolve and 4768s use a specific interface, it has to be handled outside 4768s of Tornado as this depends very much on the platform. 4768s 4768s Raises `TimeoutError` if the input future does not complete before 4768s ``timeout``, which may be specified in any form allowed by 4768s `.IOLoop.add_timeout` (i.e. a `datetime.timedelta` or an absolute time 4768s relative to `.IOLoop.time`) 4768s 4768s Similarly, when the user requires a certain source port, it can 4768s be specified using the ``source_port`` arg. 4768s 4768s .. versionchanged:: 4.5 4768s Added the ``source_ip`` and ``source_port`` arguments. 4768s 4768s .. versionchanged:: 5.0 4768s Added the ``timeout`` argument. 4768s """ 4768s if timeout is not None: 4768s if isinstance(timeout, numbers.Real): 4768s timeout = IOLoop.current().time() + timeout 4768s elif isinstance(timeout, datetime.timedelta): 4768s timeout = IOLoop.current().time() + timeout.total_seconds() 4768s else: 4768s raise TypeError("Unsupported timeout %r" % timeout) 4768s if timeout is not None: 4768s addrinfo = await gen.with_timeout( 4768s timeout, self.resolver.resolve(host, port, af) 4768s ) 4768s else: 4768s addrinfo = await self.resolver.resolve(host, port, af) 4768s connector = _Connector( 4768s addrinfo, 4768s functools.partial( 4768s self._create_stream, 4768s max_buffer_size, 4768s source_ip=source_ip, 4768s source_port=source_port, 4768s ), 4768s ) 4768s > af, addr, stream = await connector.start(connect_timeout=timeout) 4768s E asyncio.exceptions.CancelledError 4768s 4768s /usr/lib/python3/dist-packages/tornado/tcpclient.py:279: CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s self = 4768s 4768s @final 4768s async def start(self): 4768s async with self._startup_lock: 4768s if self.status == Status.failed: 4768s assert self.__startup_exc is not None 4768s raise self.__startup_exc 4768s elif self.status != Status.init: 4768s return self 4768s timeout = getattr(self, "death_timeout", None) 4768s 4768s async def _close_on_failure(exc: Exception) -> None: 4768s await self.close(reason=f"failure-to-start-{str(type(exc))}") 4768s self.status = Status.failed 4768s self.__startup_exc = exc 4768s 4768s try: 4768s > await wait_for(self.start_unsafe(), timeout=timeout) 4768s 4768s /usr/lib/python3/dist-packages/distributed/core.py:664: 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 4768s async with asyncio.timeout(timeout): 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s 4768s self = 4768s exc_type = 4768s exc_val = CancelledError(), exc_tb = 4768s 4768s async def __aexit__( 4768s self, 4768s exc_type: Optional[Type[BaseException]], 4768s exc_val: Optional[BaseException], 4768s exc_tb: Optional[TracebackType], 4768s ) -> Optional[bool]: 4768s assert self._state in (_State.ENTERED, _State.EXPIRING) 4768s 4768s if self._timeout_handler is not None: 4768s self._timeout_handler.cancel() 4768s self._timeout_handler = None 4768s 4768s if self._state is _State.EXPIRING: 4768s self._state = _State.EXPIRED 4768s 4768s if self._task.uncancel() <= self._cancelling and exc_type is not None: 4768s # Since there are no new cancel requests, we're 4768s # handling this. 4768s if issubclass(exc_type, exceptions.CancelledError): 4768s > raise TimeoutError from exc_val 4768s E TimeoutError 4768s 4768s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s @contextlib.asynccontextmanager 4768s async def _cluster_factory(): 4768s workers = [] 4768s s = None 4768s try: 4768s for _ in range(60): 4768s try: 4768s > s, ws = await start_cluster( 4768s nthreads, 4768s scheduler, 4768s security=security, 4768s Worker=Worker, 4768s scheduler_kwargs=scheduler_kwargs, 4768s worker_kwargs=merge( 4768s {"death_timeout": min(15, int(deadline.remaining))}, 4768s worker_kwargs, 4768s ), 4768s ) 4768s 4768s /usr/lib/python3/dist-packages/distributed/utils_test.py:966: 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s /usr/lib/python3/dist-packages/distributed/utils_test.py:789: in start_cluster 4768s await asyncio.gather(*workers) 4768s /usr/lib/python3.13/asyncio/tasks.py:737: in _wrap_awaitable 4768s return await awaitable 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s 4768s self = 4768s 4768s @final 4768s async def start(self): 4768s async with self._startup_lock: 4768s if self.status == Status.failed: 4768s assert self.__startup_exc is not None 4768s raise self.__startup_exc 4768s elif self.status != Status.init: 4768s return self 4768s timeout = getattr(self, "death_timeout", None) 4768s 4768s async def _close_on_failure(exc: Exception) -> None: 4768s await self.close(reason=f"failure-to-start-{str(type(exc))}") 4768s self.status = Status.failed 4768s self.__startup_exc = exc 4768s 4768s try: 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s except asyncio.TimeoutError as exc: 4768s await _close_on_failure(exc) 4768s > raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s E TimeoutError: Nanny start timed out after 0s. 4768s 4768s /usr/lib/python3/dist-packages/distributed/core.py:667: TimeoutError 4768s 4768s During handling of the above exception, another exception occurred: 4768s 4768s fut = ._..test_func..async_fn at 0xe99ada20> 4768s timeout = 60 4768s 4768s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 4768s async with asyncio.timeout(timeout): 4768s > return await fut 4768s 4768s /usr/lib/python3/dist-packages/distributed/utils.py:1960: 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s /usr/lib/python3/dist-packages/distributed/utils_test.py:999: in async_fn 4768s _cluster_factory() as (s, workers), 4768s /usr/lib/python3.13/contextlib.py:214: in __aenter__ 4768s return await anext(self.gen) 4768s /usr/lib/python3/dist-packages/distributed/utils_test.py:983: in _cluster_factory 4768s await asyncio.sleep(1) 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s 4768s delay = 1, result = None 4768s 4768s async def sleep(delay, result=None): 4768s """Coroutine that completes after a given time (in seconds).""" 4768s if delay <= 0: 4768s await __sleep0() 4768s return result 4768s 4768s if math.isnan(delay): 4768s raise ValueError("Invalid delay: NaN (not a number)") 4768s 4768s loop = events.get_running_loop() 4768s future = loop.create_future() 4768s h = loop.call_later(delay, 4768s futures._set_result_unless_cancelled, 4768s future, result) 4768s try: 4768s > return await future 4768s E asyncio.exceptions.CancelledError 4768s 4768s /usr/lib/python3.13/asyncio/tasks.py:718: CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s args = (), kwds = {} 4768s 4768s @wraps(func) 4768s def inner(*args, **kwds): 4768s with self._recreate_cm(): 4768s > return func(*args, **kwds) 4768s 4768s /usr/lib/python3.13/contextlib.py:85: 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s /usr/lib/python3.13/contextlib.py:85: in inner 4768s return func(*args, **kwds) 4768s /usr/lib/python3/dist-packages/distributed/utils_test.py:1102: in test_func 4768s return _run_and_close_tornado(async_fn_outer) 4768s /usr/lib/python3/dist-packages/distributed/utils_test.py:378: in _run_and_close_tornado 4768s return asyncio_run(inner_fn(), loop_factory=get_loop_factory()) 4768s /usr/lib/python3.13/asyncio/runners.py:194: in run 4768s return runner.run(main) 4768s /usr/lib/python3.13/asyncio/runners.py:118: in run 4768s return self._loop.run_until_complete(task) 4768s /usr/lib/python3.13/asyncio/base_events.py:720: in run_until_complete 4768s return future.result() 4768s /usr/lib/python3/dist-packages/distributed/utils_test.py:375: in inner_fn 4768s return await async_fn(*args, **kwargs) 4768s /usr/lib/python3/dist-packages/distributed/utils_test.py:1099: in async_fn_outer 4768s return await utils_wait_for(async_fn(), timeout=timeout * 2) 4768s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 4768s async with asyncio.timeout(timeout): 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s 4768s self = 4768s exc_type = 4768s exc_val = CancelledError(), exc_tb = 4768s 4768s async def __aexit__( 4768s self, 4768s exc_type: Optional[Type[BaseException]], 4768s exc_val: Optional[BaseException], 4768s exc_tb: Optional[TracebackType], 4768s ) -> Optional[bool]: 4768s assert self._state in (_State.ENTERED, _State.EXPIRING) 4768s 4768s if self._timeout_handler is not None: 4768s self._timeout_handler.cancel() 4768s self._timeout_handler = None 4768s 4768s if self._state is _State.EXPIRING: 4768s self._state = _State.EXPIRED 4768s 4768s if self._task.uncancel() <= self._cancelling and exc_type is not None: 4768s # Since there are no new cancel requests, we're 4768s # handling this. 4768s if issubclass(exc_type, exceptions.CancelledError): 4768s > raise TimeoutError from exc_val 4768s E TimeoutError 4768s 4768s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 4768s ----------------------------- Captured stderr call ----------------------------- 4768s 2024-11-23 21:48:24,886 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:48:24,900 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36729 4768s 2024-11-23 21:48:24,901 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35983/status 4768s 2024-11-23 21:48:24,901 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:48:24,941 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:41099'. Reason: failure-to-start- 4768s 2024-11-23 21:48:24,942 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:42609'. Reason: failure-to-start- 4768s 2024-11-23 21:48:24,943 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36729': TLS handshake failed with remote 'tls://127.0.0.1:46496': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:48:24,943 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36729': TLS handshake failed with remote 'tls://127.0.0.1:46510': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:48:24,943 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 4768s stream = await stream.start_tls( 4768s ^^^^^^^^^^^^^^^^^^^^^^^ 4768s False, ssl_options=ssl_options, server_hostname=host 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 4768s self.socket.do_handshake() 4768s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 4768s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 4768s self._sslobj.do_handshake() 4768s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 4768s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 4768s comm = await self.rpc.connect(saddr) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 4768s return await self._connect(addr=addr, timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 4768s comm = await connect( 4768s ^^^^^^^^^^^^^^ 4768s ...<4 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 4768s raise FatalCommClosedError( 4768s ...<2 lines>... 4768s ) from err 4768s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 4768s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 4768s RuntimeError: Nanny failed to start. 4768s 2024-11-23 21:48:25,952 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:48:25,963 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37419 4768s 2024-11-23 21:48:25,963 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38395/status 4768s 2024-11-23 21:48:25,963 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:48:25,994 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:33443'. Reason: failure-to-start- 4768s 2024-11-23 21:48:25,995 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:39483'. Reason: failure-to-start- 4768s 2024-11-23 21:48:25,995 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37419': TLS handshake failed with remote 'tls://127.0.0.1:42192': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:48:25,995 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37419': TLS handshake failed with remote 'tls://127.0.0.1:42202': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:48:25,995 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 4768s stream = await stream.start_tls( 4768s ^^^^^^^^^^^^^^^^^^^^^^^ 4768s False, ssl_options=ssl_options, server_hostname=host 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 4768s self.socket.do_handshake() 4768s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 4768s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 4768s self._sslobj.do_handshake() 4768s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 4768s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 4768s comm = await self.rpc.connect(saddr) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 4768s return await self._connect(addr=addr, timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 4768s comm = await connect( 4768s ^^^^^^^^^^^^^^ 4768s ...<4 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 4768s raise FatalCommClosedError( 4768s ...<2 lines>... 4768s ) from err 4768s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 4768s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 4768s RuntimeError: Nanny failed to start. 4768s 2024-11-23 21:48:27,001 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:48:27,008 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45923 4768s 2024-11-23 21:48:27,009 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34863/status 4768s 2024-11-23 21:48:27,009 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:48:27,032 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:40849'. Reason: failure-to-start- 4768s 2024-11-23 21:48:27,032 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:45397'. Reason: failure-to-start- 4768s 2024-11-23 21:48:27,033 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45923': TLS handshake failed with remote 'tls://127.0.0.1:53174': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:48:27,033 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45923': TLS handshake failed with remote 'tls://127.0.0.1:53188': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:48:27,033 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 4768s stream = await stream.start_tls( 4768s ^^^^^^^^^^^^^^^^^^^^^^^ 4768s False, ssl_options=ssl_options, server_hostname=host 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 4768s self.socket.do_handshake() 4768s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 4768s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 4768s self._sslobj.do_handshake() 4768s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 4768s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 4768s comm = await self.rpc.connect(saddr) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 4768s return await self._connect(addr=addr, timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 4768s comm = await connect( 4768s ^^^^^^^^^^^^^^ 4768s ...<4 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 4768s raise FatalCommClosedError( 4768s ...<2 lines>... 4768s ) from err 4768s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 4768s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 4768s RuntimeError: Nanny failed to start. 4768s 2024-11-23 21:48:28,038 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:48:28,045 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43391 4768s 2024-11-23 21:48:28,045 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40583/status 4768s 2024-11-23 21:48:28,046 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:48:28,069 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:37145'. Reason: failure-to-start- 4768s 2024-11-23 21:48:28,070 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:42929'. Reason: failure-to-start- 4768s 2024-11-23 21:48:28,070 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43391': TLS handshake failed with remote 'tls://127.0.0.1:38904': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:48:28,070 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43391': TLS handshake failed with remote 'tls://127.0.0.1:38916': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:48:28,071 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 4768s stream = await stream.start_tls( 4768s ^^^^^^^^^^^^^^^^^^^^^^^ 4768s False, ssl_options=ssl_options, server_hostname=host 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 4768s self.socket.do_handshake() 4768s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 4768s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 4768s self._sslobj.do_handshake() 4768s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 4768s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 4768s comm = await self.rpc.connect(saddr) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 4768s return await self._connect(addr=addr, timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 4768s comm = await connect( 4768s ^^^^^^^^^^^^^^ 4768s ...<4 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 4768s raise FatalCommClosedError( 4768s ...<2 lines>... 4768s ) from err 4768s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 4768s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 4768s RuntimeError: Nanny failed to start. 4768s 2024-11-23 21:48:29,076 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:48:29,084 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39939 4768s 2024-11-23 21:48:29,084 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44657/status 4768s 2024-11-23 21:48:29,084 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:48:29,106 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:46149'. Reason: failure-to-start- 4768s 2024-11-23 21:48:29,106 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:40067'. Reason: failure-to-start- 4768s 2024-11-23 21:48:29,106 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39939': TLS handshake failed with remote 'tls://127.0.0.1:50510': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:48:29,106 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39939': TLS handshake failed with remote 'tls://127.0.0.1:50520': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:48:29,106 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 4768s stream = await stream.start_tls( 4768s ^^^^^^^^^^^^^^^^^^^^^^^ 4768s False, ssl_options=ssl_options, server_hostname=host 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 4768s self.socket.do_handshake() 4768s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 4768s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 4768s self._sslobj.do_handshake() 4768s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 4768s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 4768s comm = await self.rpc.connect(saddr) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 4768s return await self._connect(addr=addr, timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 4768s comm = await connect( 4768s ^^^^^^^^^^^^^^ 4768s ...<4 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 4768s raise FatalCommClosedError( 4768s ...<2 lines>... 4768s ) from err 4768s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 4768s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 4768s RuntimeError: Nanny failed to start. 4768s 2024-11-23 21:48:30,112 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:48:30,119 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43047 4768s 2024-11-23 21:48:30,119 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41065/status 4768s 2024-11-23 21:48:30,119 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:48:30,143 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:34437'. Reason: failure-to-start- 4768s 2024-11-23 21:48:30,143 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:43631'. Reason: failure-to-start- 4768s 2024-11-23 21:48:30,144 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43047': TLS handshake failed with remote 'tls://127.0.0.1:49066': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:48:30,144 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43047': TLS handshake failed with remote 'tls://127.0.0.1:49078': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:48:30,144 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 4768s stream = await stream.start_tls( 4768s ^^^^^^^^^^^^^^^^^^^^^^^ 4768s False, ssl_options=ssl_options, server_hostname=host 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 4768s self.socket.do_handshake() 4768s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 4768s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 4768s self._sslobj.do_handshake() 4768s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 4768s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 4768s comm = await self.rpc.connect(saddr) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 4768s return await self._connect(addr=addr, timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 4768s comm = await connect( 4768s ^^^^^^^^^^^^^^ 4768s ...<4 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 4768s raise FatalCommClosedError( 4768s ...<2 lines>... 4768s ) from err 4768s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 4768s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 4768s RuntimeError: Nanny failed to start. 4768s 2024-11-23 21:48:31,149 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:48:31,155 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34305 4768s 2024-11-23 21:48:31,155 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41833/status 4768s 2024-11-23 21:48:31,155 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:48:31,176 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:46313'. Reason: failure-to-start- 4768s 2024-11-23 21:48:31,176 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:42851'. Reason: failure-to-start- 4768s 2024-11-23 21:48:31,177 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34305': TLS handshake failed with remote 'tls://127.0.0.1:50206': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:48:31,177 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34305': TLS handshake failed with remote 'tls://127.0.0.1:50222': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:48:31,177 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 4768s stream = await stream.start_tls( 4768s ^^^^^^^^^^^^^^^^^^^^^^^ 4768s False, ssl_options=ssl_options, server_hostname=host 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 4768s self.socket.do_handshake() 4768s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 4768s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 4768s self._sslobj.do_handshake() 4768s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 4768s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 4768s comm = await self.rpc.connect(saddr) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 4768s return await self._connect(addr=addr, timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 4768s comm = await connect( 4768s ^^^^^^^^^^^^^^ 4768s ...<4 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 4768s raise FatalCommClosedError( 4768s ...<2 lines>... 4768s ) from err 4768s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 4768s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 4768s RuntimeError: Nanny failed to start. 4768s 2024-11-23 21:48:32,182 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:48:32,189 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45311 4768s 2024-11-23 21:48:32,189 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43933/status 4768s 2024-11-23 21:48:32,189 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:48:32,211 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:44113'. Reason: failure-to-start- 4768s 2024-11-23 21:48:32,212 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:35855'. Reason: failure-to-start- 4768s 2024-11-23 21:48:32,212 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45311': TLS handshake failed with remote 'tls://127.0.0.1:37770': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:48:32,212 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45311': TLS handshake failed with remote 'tls://127.0.0.1:37772': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:48:32,213 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 4768s stream = await stream.start_tls( 4768s ^^^^^^^^^^^^^^^^^^^^^^^ 4768s False, ssl_options=ssl_options, server_hostname=host 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 4768s self.socket.do_handshake() 4768s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 4768s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 4768s self._sslobj.do_handshake() 4768s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 4768s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 4768s comm = await self.rpc.connect(saddr) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 4768s return await self._connect(addr=addr, timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 4768s comm = await connect( 4768s ^^^^^^^^^^^^^^ 4768s ...<4 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 4768s raise FatalCommClosedError( 4768s ...<2 lines>... 4768s ) from err 4768s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 4768s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 4768s RuntimeError: Nanny failed to start. 4768s 2024-11-23 21:48:33,217 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:48:33,223 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39709 4768s 2024-11-23 21:48:33,224 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33005/status 4768s 2024-11-23 21:48:33,224 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:48:33,245 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:35783'. Reason: failure-to-start- 4768s 2024-11-23 21:48:33,246 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:41139'. Reason: failure-to-start- 4768s 2024-11-23 21:48:33,246 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39709': TLS handshake failed with remote 'tls://127.0.0.1:47166': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:48:33,246 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39709': TLS handshake failed with remote 'tls://127.0.0.1:47172': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:48:33,246 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 4768s stream = await stream.start_tls( 4768s ^^^^^^^^^^^^^^^^^^^^^^^ 4768s False, ssl_options=ssl_options, server_hostname=host 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 4768s self.socket.do_handshake() 4768s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 4768s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 4768s self._sslobj.do_handshake() 4768s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 4768s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 4768s comm = await self.rpc.connect(saddr) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 4768s return await self._connect(addr=addr, timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 4768s comm = await connect( 4768s ^^^^^^^^^^^^^^ 4768s ...<4 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 4768s raise FatalCommClosedError( 4768s ...<2 lines>... 4768s ) from err 4768s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 4768s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 4768s RuntimeError: Nanny failed to start. 4768s 2024-11-23 21:48:34,251 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:48:34,257 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43623 4768s 2024-11-23 21:48:34,258 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33735/status 4768s 2024-11-23 21:48:34,258 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:48:34,279 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:46241'. Reason: failure-to-start- 4768s 2024-11-23 21:48:34,279 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:35201'. Reason: failure-to-start- 4768s 2024-11-23 21:48:34,280 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:43456': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:48:34,280 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:43472': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:48:34,280 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 4768s stream = await stream.start_tls( 4768s ^^^^^^^^^^^^^^^^^^^^^^^ 4768s False, ssl_options=ssl_options, server_hostname=host 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 4768s self.socket.do_handshake() 4768s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 4768s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 4768s self._sslobj.do_handshake() 4768s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 4768s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 4768s comm = await self.rpc.connect(saddr) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 4768s return await self._connect(addr=addr, timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 4768s comm = await connect( 4768s ^^^^^^^^^^^^^^ 4768s ...<4 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 4768s raise FatalCommClosedError( 4768s ...<2 lines>... 4768s ) from err 4768s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 4768s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 4768s RuntimeError: Nanny failed to start. 4768s 2024-11-23 21:48:35,286 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:48:35,293 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40871 4768s 2024-11-23 21:48:35,293 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45663/status 4768s 2024-11-23 21:48:35,293 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:48:35,315 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:46785'. Reason: failure-to-start- 4768s 2024-11-23 21:48:35,315 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:36785'. Reason: failure-to-start- 4768s 2024-11-23 21:48:35,315 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40871': TLS handshake failed with remote 'tls://127.0.0.1:51358': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:48:35,315 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40871': TLS handshake failed with remote 'tls://127.0.0.1:51364': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:48:35,315 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 4768s stream = await stream.start_tls( 4768s ^^^^^^^^^^^^^^^^^^^^^^^ 4768s False, ssl_options=ssl_options, server_hostname=host 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 4768s self.socket.do_handshake() 4768s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 4768s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 4768s self._sslobj.do_handshake() 4768s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 4768s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 4768s comm = await self.rpc.connect(saddr) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 4768s return await self._connect(addr=addr, timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 4768s comm = await connect( 4768s ^^^^^^^^^^^^^^ 4768s ...<4 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 4768s raise FatalCommClosedError( 4768s ...<2 lines>... 4768s ) from err 4768s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 4768s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 4768s RuntimeError: Nanny failed to start. 4768s 2024-11-23 21:48:36,322 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:48:36,329 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34621 4768s 2024-11-23 21:48:36,329 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34991/status 4768s 2024-11-23 21:48:36,330 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:48:36,351 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:41373'. Reason: failure-to-start- 4768s 2024-11-23 21:48:36,352 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:41297'. Reason: failure-to-start- 4768s 2024-11-23 21:48:36,352 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34621': TLS handshake failed with remote 'tls://127.0.0.1:39308': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:48:36,352 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34621': TLS handshake failed with remote 'tls://127.0.0.1:39318': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:48:36,352 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 4768s stream = await stream.start_tls( 4768s ^^^^^^^^^^^^^^^^^^^^^^^ 4768s False, ssl_options=ssl_options, server_hostname=host 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 4768s self.socket.do_handshake() 4768s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 4768s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 4768s self._sslobj.do_handshake() 4768s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 4768s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 4768s comm = await self.rpc.connect(saddr) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 4768s return await self._connect(addr=addr, timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 4768s comm = await connect( 4768s ^^^^^^^^^^^^^^ 4768s ...<4 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 4768s raise FatalCommClosedError( 4768s ...<2 lines>... 4768s ) from err 4768s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 4768s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 4768s RuntimeError: Nanny failed to start. 4768s 2024-11-23 21:48:37,357 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:48:37,364 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44821 4768s 2024-11-23 21:48:37,365 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38879/status 4768s 2024-11-23 21:48:37,365 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:48:37,389 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:39345'. Reason: failure-to-start- 4768s 2024-11-23 21:48:37,390 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:37001'. Reason: failure-to-start- 4768s 2024-11-23 21:48:37,390 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44821': TLS handshake failed with remote 'tls://127.0.0.1:37470': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:48:37,390 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44821': TLS handshake failed with remote 'tls://127.0.0.1:37486': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:48:37,391 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 4768s stream = await stream.start_tls( 4768s ^^^^^^^^^^^^^^^^^^^^^^^ 4768s False, ssl_options=ssl_options, server_hostname=host 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 4768s self.socket.do_handshake() 4768s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 4768s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 4768s self._sslobj.do_handshake() 4768s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 4768s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 4768s comm = await self.rpc.connect(saddr) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 4768s return await self._connect(addr=addr, timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 4768s comm = await connect( 4768s ^^^^^^^^^^^^^^ 4768s ...<4 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 4768s raise FatalCommClosedError( 4768s ...<2 lines>... 4768s ) from err 4768s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 4768s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 4768s RuntimeError: Nanny failed to start. 4768s 2024-11-23 21:48:38,400 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:48:38,412 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36845 4768s 2024-11-23 21:48:38,413 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41191/status 4768s 2024-11-23 21:48:38,414 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:48:38,457 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:38017'. Reason: failure-to-start- 4768s 2024-11-23 21:48:38,458 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:43431'. Reason: failure-to-start- 4768s 2024-11-23 21:48:38,460 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36845': TLS handshake failed with remote 'tls://127.0.0.1:46474': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:48:38,460 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36845': TLS handshake failed with remote 'tls://127.0.0.1:46476': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:48:38,460 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 4768s stream = await stream.start_tls( 4768s ^^^^^^^^^^^^^^^^^^^^^^^ 4768s False, ssl_options=ssl_options, server_hostname=host 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 4768s self.socket.do_handshake() 4768s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 4768s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 4768s self._sslobj.do_handshake() 4768s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 4768s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 4768s comm = await self.rpc.connect(saddr) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 4768s return await self._connect(addr=addr, timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 4768s comm = await connect( 4768s ^^^^^^^^^^^^^^ 4768s ...<4 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 4768s raise FatalCommClosedError( 4768s ...<2 lines>... 4768s ) from err 4768s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 4768s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 4768s RuntimeError: Nanny failed to start. 4768s 2024-11-23 21:48:39,468 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:48:39,474 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40325 4768s 2024-11-23 21:48:39,474 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35401/status 4768s 2024-11-23 21:48:39,475 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:48:39,496 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:41709'. Reason: failure-to-start- 4768s 2024-11-23 21:48:39,496 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:46659'. Reason: failure-to-start- 4768s 2024-11-23 21:48:39,497 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40325': TLS handshake failed with remote 'tls://127.0.0.1:49186': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:48:39,497 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40325': TLS handshake failed with remote 'tls://127.0.0.1:49188': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:48:39,497 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 4768s stream = await stream.start_tls( 4768s ^^^^^^^^^^^^^^^^^^^^^^^ 4768s False, ssl_options=ssl_options, server_hostname=host 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 4768s self.socket.do_handshake() 4768s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 4768s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 4768s self._sslobj.do_handshake() 4768s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 4768s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 4768s comm = await self.rpc.connect(saddr) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 4768s return await self._connect(addr=addr, timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 4768s comm = await connect( 4768s ^^^^^^^^^^^^^^ 4768s ...<4 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 4768s raise FatalCommClosedError( 4768s ...<2 lines>... 4768s ) from err 4768s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 4768s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 4768s RuntimeError: Nanny failed to start. 4768s 2024-11-23 21:48:40,501 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:48:40,507 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40687 4768s 2024-11-23 21:48:40,508 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34765/status 4768s 2024-11-23 21:48:40,508 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:48:40,531 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:40091'. Reason: failure-to-start- 4768s 2024-11-23 21:48:40,532 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:37977'. Reason: failure-to-start- 4768s 2024-11-23 21:48:40,532 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40687': TLS handshake failed with remote 'tls://127.0.0.1:49278': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:48:40,532 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40687': TLS handshake failed with remote 'tls://127.0.0.1:49284': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:48:40,532 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 4768s stream = await stream.start_tls( 4768s ^^^^^^^^^^^^^^^^^^^^^^^ 4768s False, ssl_options=ssl_options, server_hostname=host 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 4768s self.socket.do_handshake() 4768s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 4768s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 4768s self._sslobj.do_handshake() 4768s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 4768s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 4768s comm = await self.rpc.connect(saddr) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 4768s return await self._connect(addr=addr, timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 4768s comm = await connect( 4768s ^^^^^^^^^^^^^^ 4768s ...<4 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 4768s raise FatalCommClosedError( 4768s ...<2 lines>... 4768s ) from err 4768s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 4768s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 4768s RuntimeError: Nanny failed to start. 4768s 2024-11-23 21:48:41,537 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:48:41,543 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34435 4768s 2024-11-23 21:48:41,543 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44989/status 4768s 2024-11-23 21:48:41,543 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:48:41,567 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:45121'. Reason: failure-to-start- 4768s 2024-11-23 21:48:41,567 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:32817'. Reason: failure-to-start- 4768s 2024-11-23 21:48:41,567 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34435': TLS handshake failed with remote 'tls://127.0.0.1:49678': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:48:41,567 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34435': TLS handshake failed with remote 'tls://127.0.0.1:49680': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:48:41,568 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 4768s stream = await stream.start_tls( 4768s ^^^^^^^^^^^^^^^^^^^^^^^ 4768s False, ssl_options=ssl_options, server_hostname=host 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 4768s self.socket.do_handshake() 4768s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 4768s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 4768s self._sslobj.do_handshake() 4768s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 4768s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 4768s comm = await self.rpc.connect(saddr) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 4768s return await self._connect(addr=addr, timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 4768s comm = await connect( 4768s ^^^^^^^^^^^^^^ 4768s ...<4 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 4768s raise FatalCommClosedError( 4768s ...<2 lines>... 4768s ) from err 4768s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 4768s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 4768s RuntimeError: Nanny failed to start. 4768s 2024-11-23 21:48:42,572 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:48:42,579 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38483 4768s 2024-11-23 21:48:42,579 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38625/status 4768s 2024-11-23 21:48:42,579 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:48:42,603 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:43215'. Reason: failure-to-start- 4768s 2024-11-23 21:48:42,604 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:43907'. Reason: failure-to-start- 4768s 2024-11-23 21:48:42,604 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38483': TLS handshake failed with remote 'tls://127.0.0.1:53312': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:48:42,604 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38483': TLS handshake failed with remote 'tls://127.0.0.1:53318': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:48:42,604 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 4768s stream = await stream.start_tls( 4768s ^^^^^^^^^^^^^^^^^^^^^^^ 4768s False, ssl_options=ssl_options, server_hostname=host 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 4768s self.socket.do_handshake() 4768s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 4768s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 4768s self._sslobj.do_handshake() 4768s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 4768s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 4768s comm = await self.rpc.connect(saddr) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 4768s return await self._connect(addr=addr, timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 4768s comm = await connect( 4768s ^^^^^^^^^^^^^^ 4768s ...<4 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 4768s raise FatalCommClosedError( 4768s ...<2 lines>... 4768s ) from err 4768s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 4768s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 4768s RuntimeError: Nanny failed to start. 4768s 2024-11-23 21:48:43,609 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:48:43,615 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46351 4768s 2024-11-23 21:48:43,615 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37269/status 4768s 2024-11-23 21:48:43,616 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:48:43,639 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:43481'. Reason: failure-to-start- 4768s 2024-11-23 21:48:43,639 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:43059'. Reason: failure-to-start- 4768s 2024-11-23 21:48:43,640 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46351': TLS handshake failed with remote 'tls://127.0.0.1:58288': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:48:43,640 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46351': TLS handshake failed with remote 'tls://127.0.0.1:58300': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:48:43,640 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 4768s stream = await stream.start_tls( 4768s ^^^^^^^^^^^^^^^^^^^^^^^ 4768s False, ssl_options=ssl_options, server_hostname=host 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 4768s self.socket.do_handshake() 4768s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 4768s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 4768s self._sslobj.do_handshake() 4768s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 4768s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 4768s comm = await self.rpc.connect(saddr) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 4768s return await self._connect(addr=addr, timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 4768s comm = await connect( 4768s ^^^^^^^^^^^^^^ 4768s ...<4 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 4768s raise FatalCommClosedError( 4768s ...<2 lines>... 4768s ) from err 4768s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 4768s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 4768s RuntimeError: Nanny failed to start. 4768s 2024-11-23 21:48:44,646 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:48:44,652 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45575 4768s 2024-11-23 21:48:44,652 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39931/status 4768s 2024-11-23 21:48:44,653 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:48:44,677 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:45027'. Reason: failure-to-start- 4768s 2024-11-23 21:48:44,678 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:34479'. Reason: failure-to-start- 4768s 2024-11-23 21:48:44,678 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45575': TLS handshake failed with remote 'tls://127.0.0.1:44816': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:48:44,678 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45575': TLS handshake failed with remote 'tls://127.0.0.1:44830': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:48:44,678 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 4768s stream = await stream.start_tls( 4768s ^^^^^^^^^^^^^^^^^^^^^^^ 4768s False, ssl_options=ssl_options, server_hostname=host 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 4768s self.socket.do_handshake() 4768s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 4768s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 4768s self._sslobj.do_handshake() 4768s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 4768s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 4768s comm = await self.rpc.connect(saddr) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 4768s return await self._connect(addr=addr, timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 4768s comm = await connect( 4768s ^^^^^^^^^^^^^^ 4768s ...<4 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 4768s raise FatalCommClosedError( 4768s ...<2 lines>... 4768s ) from err 4768s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 4768s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 4768s RuntimeError: Nanny failed to start. 4768s 2024-11-23 21:48:45,683 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:48:45,688 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39911 4768s 2024-11-23 21:48:45,689 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36821/status 4768s 2024-11-23 21:48:45,689 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:48:45,713 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:43873'. Reason: failure-to-start- 4768s 2024-11-23 21:48:45,714 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:34255'. Reason: failure-to-start- 4768s 2024-11-23 21:48:45,714 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39911': TLS handshake failed with remote 'tls://127.0.0.1:48816': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:48:45,714 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39911': TLS handshake failed with remote 'tls://127.0.0.1:48830': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:48:45,714 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 4768s stream = await stream.start_tls( 4768s ^^^^^^^^^^^^^^^^^^^^^^^ 4768s False, ssl_options=ssl_options, server_hostname=host 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 4768s self.socket.do_handshake() 4768s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 4768s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 4768s self._sslobj.do_handshake() 4768s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 4768s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 4768s comm = await self.rpc.connect(saddr) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 4768s return await self._connect(addr=addr, timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 4768s comm = await connect( 4768s ^^^^^^^^^^^^^^ 4768s ...<4 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 4768s raise FatalCommClosedError( 4768s ...<2 lines>... 4768s ) from err 4768s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 4768s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 4768s RuntimeError: Nanny failed to start. 4768s 2024-11-23 21:48:46,719 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:48:46,725 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46237 4768s 2024-11-23 21:48:46,725 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41409/status 4768s 2024-11-23 21:48:46,726 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:48:46,750 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:44159'. Reason: failure-to-start- 4768s 2024-11-23 21:48:46,750 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:41887'. Reason: failure-to-start- 4768s 2024-11-23 21:48:46,750 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:47162': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:48:46,751 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:47170': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:48:46,751 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 4768s stream = await stream.start_tls( 4768s ^^^^^^^^^^^^^^^^^^^^^^^ 4768s False, ssl_options=ssl_options, server_hostname=host 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 4768s self.socket.do_handshake() 4768s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 4768s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 4768s self._sslobj.do_handshake() 4768s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 4768s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 4768s comm = await self.rpc.connect(saddr) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 4768s return await self._connect(addr=addr, timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 4768s comm = await connect( 4768s ^^^^^^^^^^^^^^ 4768s ...<4 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 4768s raise FatalCommClosedError( 4768s ...<2 lines>... 4768s ) from err 4768s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 4768s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 4768s RuntimeError: Nanny failed to start. 4768s 2024-11-23 21:48:47,756 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:48:47,762 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42779 4768s 2024-11-23 21:48:47,762 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35093/status 4768s 2024-11-23 21:48:47,762 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:48:47,789 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:33299'. Reason: failure-to-start- 4768s 2024-11-23 21:48:47,789 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:43229'. Reason: failure-to-start- 4768s 2024-11-23 21:48:47,790 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42779': TLS handshake failed with remote 'tls://127.0.0.1:50874': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:48:47,790 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42779': TLS handshake failed with remote 'tls://127.0.0.1:50886': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:48:47,790 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 4768s stream = await stream.start_tls( 4768s ^^^^^^^^^^^^^^^^^^^^^^^ 4768s False, ssl_options=ssl_options, server_hostname=host 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 4768s self.socket.do_handshake() 4768s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 4768s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 4768s self._sslobj.do_handshake() 4768s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 4768s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 4768s comm = await self.rpc.connect(saddr) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 4768s return await self._connect(addr=addr, timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 4768s comm = await connect( 4768s ^^^^^^^^^^^^^^ 4768s ...<4 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 4768s raise FatalCommClosedError( 4768s ...<2 lines>... 4768s ) from err 4768s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 4768s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 4768s RuntimeError: Nanny failed to start. 4768s 2024-11-23 21:48:48,795 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:48:48,801 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44373 4768s 2024-11-23 21:48:48,801 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34593/status 4768s 2024-11-23 21:48:48,801 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:48:48,824 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:42341'. Reason: failure-to-start- 4768s 2024-11-23 21:48:48,824 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:46845'. Reason: failure-to-start- 4768s 2024-11-23 21:48:48,825 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44373': TLS handshake failed with remote 'tls://127.0.0.1:47440': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:48:48,825 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44373': TLS handshake failed with remote 'tls://127.0.0.1:47452': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:48:48,825 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 4768s stream = await stream.start_tls( 4768s ^^^^^^^^^^^^^^^^^^^^^^^ 4768s False, ssl_options=ssl_options, server_hostname=host 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 4768s self.socket.do_handshake() 4768s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 4768s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 4768s self._sslobj.do_handshake() 4768s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 4768s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 4768s comm = await self.rpc.connect(saddr) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 4768s return await self._connect(addr=addr, timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 4768s comm = await connect( 4768s ^^^^^^^^^^^^^^ 4768s ...<4 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 4768s raise FatalCommClosedError( 4768s ...<2 lines>... 4768s ) from err 4768s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 4768s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 4768s RuntimeError: Nanny failed to start. 4768s 2024-11-23 21:48:49,829 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:48:49,835 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46129 4768s 2024-11-23 21:48:49,836 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41193/status 4768s 2024-11-23 21:48:49,836 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:48:49,868 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:33693'. Reason: failure-to-start- 4768s 2024-11-23 21:48:49,868 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:37345'. Reason: failure-to-start- 4768s 2024-11-23 21:48:49,870 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46129': TLS handshake failed with remote 'tls://127.0.0.1:48722': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:48:49,871 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46129': TLS handshake failed with remote 'tls://127.0.0.1:48730': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:48:49,871 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 4768s stream = await stream.start_tls( 4768s ^^^^^^^^^^^^^^^^^^^^^^^ 4768s False, ssl_options=ssl_options, server_hostname=host 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 4768s self.socket.do_handshake() 4768s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 4768s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 4768s self._sslobj.do_handshake() 4768s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 4768s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 4768s comm = await self.rpc.connect(saddr) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 4768s return await self._connect(addr=addr, timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 4768s comm = await connect( 4768s ^^^^^^^^^^^^^^ 4768s ...<4 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 4768s raise FatalCommClosedError( 4768s ...<2 lines>... 4768s ) from err 4768s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 4768s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 4768s RuntimeError: Nanny failed to start. 4768s 2024-11-23 21:48:50,876 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:48:50,882 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39681 4768s 2024-11-23 21:48:50,882 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41857/status 4768s 2024-11-23 21:48:50,882 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:48:50,905 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:40621'. Reason: failure-to-start- 4768s 2024-11-23 21:48:50,905 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:45745'. Reason: failure-to-start- 4768s 2024-11-23 21:48:50,908 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39681': TLS handshake failed with remote 'tls://127.0.0.1:58520': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:48:50,908 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39681': TLS handshake failed with remote 'tls://127.0.0.1:58526': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:48:50,908 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 4768s stream = await stream.start_tls( 4768s ^^^^^^^^^^^^^^^^^^^^^^^ 4768s False, ssl_options=ssl_options, server_hostname=host 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 4768s self.socket.do_handshake() 4768s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 4768s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 4768s self._sslobj.do_handshake() 4768s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 4768s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 4768s comm = await self.rpc.connect(saddr) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 4768s return await self._connect(addr=addr, timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 4768s comm = await connect( 4768s ^^^^^^^^^^^^^^ 4768s ...<4 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 4768s raise FatalCommClosedError( 4768s ...<2 lines>... 4768s ) from err 4768s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 4768s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 4768s RuntimeError: Nanny failed to start. 4768s 2024-11-23 21:48:51,913 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:48:51,920 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33929 4768s 2024-11-23 21:48:51,920 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35875/status 4768s 2024-11-23 21:48:51,921 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:48:51,944 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:45397'. Reason: failure-to-start- 4768s 2024-11-23 21:48:51,944 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:45961'. Reason: failure-to-start- 4768s 2024-11-23 21:48:51,945 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33929': TLS handshake failed with remote 'tls://127.0.0.1:57710': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:48:51,945 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33929': TLS handshake failed with remote 'tls://127.0.0.1:57712': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:48:51,945 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 4768s stream = await stream.start_tls( 4768s ^^^^^^^^^^^^^^^^^^^^^^^ 4768s False, ssl_options=ssl_options, server_hostname=host 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 4768s self.socket.do_handshake() 4768s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 4768s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 4768s self._sslobj.do_handshake() 4768s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 4768s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 4768s comm = await self.rpc.connect(saddr) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 4768s return await self._connect(addr=addr, timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 4768s comm = await connect( 4768s ^^^^^^^^^^^^^^ 4768s ...<4 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 4768s raise FatalCommClosedError( 4768s ...<2 lines>... 4768s ) from err 4768s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 4768s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 4768s RuntimeError: Nanny failed to start. 4768s 2024-11-23 21:48:52,950 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:48:52,956 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44547 4768s 2024-11-23 21:48:52,956 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37467/status 4768s 2024-11-23 21:48:52,956 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:48:52,981 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:38733'. Reason: failure-to-start- 4768s 2024-11-23 21:48:52,981 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:41439'. Reason: failure-to-start- 4768s 2024-11-23 21:48:52,983 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44547': TLS handshake failed with remote 'tls://127.0.0.1:60490': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:48:52,983 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44547': TLS handshake failed with remote 'tls://127.0.0.1:60502': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:48:52,984 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 4768s stream = await stream.start_tls( 4768s ^^^^^^^^^^^^^^^^^^^^^^^ 4768s False, ssl_options=ssl_options, server_hostname=host 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 4768s self.socket.do_handshake() 4768s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 4768s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 4768s self._sslobj.do_handshake() 4768s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 4768s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 4768s comm = await self.rpc.connect(saddr) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 4768s return await self._connect(addr=addr, timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 4768s comm = await connect( 4768s ^^^^^^^^^^^^^^ 4768s ...<4 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 4768s raise FatalCommClosedError( 4768s ...<2 lines>... 4768s ) from err 4768s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 4768s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 4768s RuntimeError: Nanny failed to start. 4768s 2024-11-23 21:48:53,988 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:48:53,995 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46263 4768s 2024-11-23 21:48:53,996 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40571/status 4768s 2024-11-23 21:48:53,996 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:48:54,007 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:40721'. Reason: failure-to-start- 4768s 2024-11-23 21:48:54,007 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:44865'. Reason: failure-to-start- 4768s 2024-11-23 21:48:54,008 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46263': TLS handshake failed with remote 'tls://127.0.0.1:35466': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:48:54,008 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46263': TLS handshake failed with remote 'tls://127.0.0.1:35472': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:48:54,008 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 4768s comm = await self.rpc.connect(saddr) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 4768s return await self._connect(addr=addr, timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 4768s comm = await connect( 4768s ^^^^^^^^^^^^^^ 4768s ...<4 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Nanny start timed out after 0s. 4768s 2024-11-23 21:48:55,014 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:48:55,020 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36227 4768s 2024-11-23 21:48:55,020 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35235/status 4768s 2024-11-23 21:48:55,020 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:48:55,031 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:45017'. Reason: failure-to-start- 4768s 2024-11-23 21:48:55,032 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:40337'. Reason: failure-to-start- 4768s 2024-11-23 21:48:55,032 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36227': TLS handshake failed with remote 'tls://127.0.0.1:44052': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:48:55,032 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36227': TLS handshake failed with remote 'tls://127.0.0.1:44060': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:48:55,032 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 4768s comm = await self.rpc.connect(saddr) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 4768s return await self._connect(addr=addr, timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 4768s comm = await connect( 4768s ^^^^^^^^^^^^^^ 4768s ...<4 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Nanny start timed out after 0s. 4768s 2024-11-23 21:48:56,037 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:48:56,045 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37973 4768s 2024-11-23 21:48:56,045 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42673/status 4768s 2024-11-23 21:48:56,046 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:48:56,060 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:34695'. Reason: failure-to-start- 4768s 2024-11-23 21:48:56,060 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:38285'. Reason: failure-to-start- 4768s 2024-11-23 21:48:56,060 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37973': TLS handshake failed with remote 'tls://127.0.0.1:53248': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:48:56,061 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37973': TLS handshake failed with remote 'tls://127.0.0.1:53256': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:48:56,061 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 4768s comm = await self.rpc.connect(saddr) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 4768s return await self._connect(addr=addr, timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 4768s comm = await connect( 4768s ^^^^^^^^^^^^^^ 4768s ...<4 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Nanny start timed out after 0s. 4768s 2024-11-23 21:48:57,065 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:48:57,072 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40769 4768s 2024-11-23 21:48:57,072 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37923/status 4768s 2024-11-23 21:48:57,072 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:48:57,085 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:34667'. Reason: failure-to-start- 4768s 2024-11-23 21:48:57,085 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:38503'. Reason: failure-to-start- 4768s 2024-11-23 21:48:57,086 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40769': TLS handshake failed with remote 'tls://127.0.0.1:55980': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:48:57,086 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40769': TLS handshake failed with remote 'tls://127.0.0.1:55986': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:48:57,088 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 4768s comm = await self.rpc.connect(saddr) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 4768s return await self._connect(addr=addr, timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 4768s comm = await connect( 4768s ^^^^^^^^^^^^^^ 4768s ...<4 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Nanny start timed out after 0s. 4768s 2024-11-23 21:48:58,093 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:48:58,100 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33411 4768s 2024-11-23 21:48:58,101 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41663/status 4768s 2024-11-23 21:48:58,101 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:48:58,112 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:46533'. Reason: failure-to-start- 4768s 2024-11-23 21:48:58,112 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:43935'. Reason: failure-to-start- 4768s 2024-11-23 21:48:58,113 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33411': TLS handshake failed with remote 'tls://127.0.0.1:38862': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:48:58,113 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33411': TLS handshake failed with remote 'tls://127.0.0.1:38866': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:48:58,113 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 4768s comm = await self.rpc.connect(saddr) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 4768s return await self._connect(addr=addr, timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 4768s comm = await connect( 4768s ^^^^^^^^^^^^^^ 4768s ...<4 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Nanny start timed out after 0s. 4768s 2024-11-23 21:48:59,118 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:48:59,125 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43937 4768s 2024-11-23 21:48:59,125 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46481/status 4768s 2024-11-23 21:48:59,125 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:48:59,139 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:42403'. Reason: failure-to-start- 4768s 2024-11-23 21:48:59,139 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:34999'. Reason: failure-to-start- 4768s 2024-11-23 21:48:59,140 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43937': TLS handshake failed with remote 'tls://127.0.0.1:57670': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:48:59,140 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43937': TLS handshake failed with remote 'tls://127.0.0.1:57686': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:48:59,140 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 4768s comm = await self.rpc.connect(saddr) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 4768s return await self._connect(addr=addr, timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 4768s comm = await connect( 4768s ^^^^^^^^^^^^^^ 4768s ...<4 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Nanny start timed out after 0s. 4768s 2024-11-23 21:49:00,147 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:49:00,154 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43597 4768s 2024-11-23 21:49:00,154 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39625/status 4768s 2024-11-23 21:49:00,154 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:49:00,170 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:40225'. Reason: failure-to-start- 4768s 2024-11-23 21:49:00,170 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:35789'. Reason: failure-to-start- 4768s 2024-11-23 21:49:00,171 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43597': TLS handshake failed with remote 'tls://127.0.0.1:33888': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:49:00,171 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43597': TLS handshake failed with remote 'tls://127.0.0.1:33890': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:49:00,171 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 4768s comm = await self.rpc.connect(saddr) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 4768s return await self._connect(addr=addr, timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 4768s comm = await connect( 4768s ^^^^^^^^^^^^^^ 4768s ...<4 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Nanny start timed out after 0s. 4768s 2024-11-23 21:49:01,176 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:49:01,182 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34655 4768s 2024-11-23 21:49:01,182 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46065/status 4768s 2024-11-23 21:49:01,183 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:49:01,198 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:36685'. Reason: failure-to-start- 4768s 2024-11-23 21:49:01,199 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:42681'. Reason: failure-to-start- 4768s 2024-11-23 21:49:01,199 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34655': TLS handshake failed with remote 'tls://127.0.0.1:55136': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:49:01,200 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34655': TLS handshake failed with remote 'tls://127.0.0.1:55144': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:49:01,200 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 4768s comm = await self.rpc.connect(saddr) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 4768s return await self._connect(addr=addr, timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 4768s comm = await connect( 4768s ^^^^^^^^^^^^^^ 4768s ...<4 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Nanny start timed out after 0s. 4768s 2024-11-23 21:49:02,204 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:49:02,210 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35463 4768s 2024-11-23 21:49:02,210 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34285/status 4768s 2024-11-23 21:49:02,210 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:49:02,221 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:43453'. Reason: failure-to-start- 4768s 2024-11-23 21:49:02,221 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:34291'. Reason: failure-to-start- 4768s 2024-11-23 21:49:02,222 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35463': TLS handshake failed with remote 'tls://127.0.0.1:54584': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:49:02,222 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35463': TLS handshake failed with remote 'tls://127.0.0.1:54588': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:49:02,222 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 4768s comm = await self.rpc.connect(saddr) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 4768s return await self._connect(addr=addr, timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 4768s comm = await connect( 4768s ^^^^^^^^^^^^^^ 4768s ...<4 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Nanny start timed out after 0s. 4768s 2024-11-23 21:49:03,229 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:49:03,235 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39371 4768s 2024-11-23 21:49:03,235 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34643/status 4768s 2024-11-23 21:49:03,235 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:49:03,250 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:40783'. Reason: failure-to-start- 4768s 2024-11-23 21:49:03,250 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:38799'. Reason: failure-to-start- 4768s 2024-11-23 21:49:03,251 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39371': TLS handshake failed with remote 'tls://127.0.0.1:43132': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:49:03,251 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39371': TLS handshake failed with remote 'tls://127.0.0.1:43142': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:49:03,251 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 4768s comm = await self.rpc.connect(saddr) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 4768s return await self._connect(addr=addr, timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 4768s comm = await connect( 4768s ^^^^^^^^^^^^^^ 4768s ...<4 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Nanny start timed out after 0s. 4768s 2024-11-23 21:49:04,258 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:49:04,271 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45211 4768s 2024-11-23 21:49:04,272 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44865/status 4768s 2024-11-23 21:49:04,273 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:49:04,301 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:45225'. Reason: failure-to-start- 4768s 2024-11-23 21:49:04,302 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:45245'. Reason: failure-to-start- 4768s 2024-11-23 21:49:04,303 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45211': TLS handshake failed with remote 'tls://127.0.0.1:49086': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:49:04,303 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45211': TLS handshake failed with remote 'tls://127.0.0.1:49092': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:49:04,303 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 4768s comm = await self.rpc.connect(saddr) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 4768s return await self._connect(addr=addr, timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 4768s comm = await connect( 4768s ^^^^^^^^^^^^^^ 4768s ...<4 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Nanny start timed out after 0s. 4768s 2024-11-23 21:49:05,307 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:49:05,314 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41773 4768s 2024-11-23 21:49:05,315 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33059/status 4768s 2024-11-23 21:49:05,315 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:49:05,326 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:41417'. Reason: failure-to-start- 4768s 2024-11-23 21:49:05,326 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:42359'. Reason: failure-to-start- 4768s 2024-11-23 21:49:05,327 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41773': TLS handshake failed with remote 'tls://127.0.0.1:36544': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:49:05,327 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41773': TLS handshake failed with remote 'tls://127.0.0.1:36556': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:49:05,327 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 4768s comm = await self.rpc.connect(saddr) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 4768s return await self._connect(addr=addr, timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 4768s comm = await connect( 4768s ^^^^^^^^^^^^^^ 4768s ...<4 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Nanny start timed out after 0s. 4768s 2024-11-23 21:49:06,332 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:49:06,339 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39531 4768s 2024-11-23 21:49:06,339 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40753/status 4768s 2024-11-23 21:49:06,341 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:49:06,356 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:35677'. Reason: failure-to-start- 4768s 2024-11-23 21:49:06,357 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:33955'. Reason: failure-to-start- 4768s 2024-11-23 21:49:06,357 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39531': TLS handshake failed with remote 'tls://127.0.0.1:40390': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:49:06,358 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39531': TLS handshake failed with remote 'tls://127.0.0.1:40406': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:49:06,358 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 4768s comm = await self.rpc.connect(saddr) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 4768s return await self._connect(addr=addr, timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 4768s comm = await connect( 4768s ^^^^^^^^^^^^^^ 4768s ...<4 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Nanny start timed out after 0s. 4768s 2024-11-23 21:49:07,362 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:49:07,370 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43259 4768s 2024-11-23 21:49:07,370 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42669/status 4768s 2024-11-23 21:49:07,371 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:49:07,384 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:39577'. Reason: failure-to-start- 4768s 2024-11-23 21:49:07,385 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:35151'. Reason: failure-to-start- 4768s 2024-11-23 21:49:07,387 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43259': TLS handshake failed with remote 'tls://127.0.0.1:57380': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:49:07,387 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43259': TLS handshake failed with remote 'tls://127.0.0.1:57390': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:49:07,387 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 4768s comm = await self.rpc.connect(saddr) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 4768s return await self._connect(addr=addr, timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 4768s comm = await connect( 4768s ^^^^^^^^^^^^^^ 4768s ...<4 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Nanny start timed out after 0s. 4768s 2024-11-23 21:49:08,392 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:49:08,399 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36233 4768s 2024-11-23 21:49:08,399 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33915/status 4768s 2024-11-23 21:49:08,399 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:49:08,412 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:44841'. Reason: failure-to-start- 4768s 2024-11-23 21:49:08,412 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:43387'. Reason: failure-to-start- 4768s 2024-11-23 21:49:08,413 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36233': TLS handshake failed with remote 'tls://127.0.0.1:60132': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:49:08,413 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36233': TLS handshake failed with remote 'tls://127.0.0.1:60148': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:49:08,413 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 4768s comm = await self.rpc.connect(saddr) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 4768s return await self._connect(addr=addr, timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 4768s comm = await connect( 4768s ^^^^^^^^^^^^^^ 4768s ...<4 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Nanny start timed out after 0s. 4768s 2024-11-23 21:49:09,418 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:49:09,426 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44189 4768s 2024-11-23 21:49:09,427 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37883/status 4768s 2024-11-23 21:49:09,427 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:49:09,442 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:46029'. Reason: failure-to-start- 4768s 2024-11-23 21:49:09,442 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:34813'. Reason: failure-to-start- 4768s 2024-11-23 21:49:09,443 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44189': TLS handshake failed with remote 'tls://127.0.0.1:50208': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:49:09,443 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44189': TLS handshake failed with remote 'tls://127.0.0.1:50220': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:49:09,443 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 4768s comm = await self.rpc.connect(saddr) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 4768s return await self._connect(addr=addr, timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 4768s comm = await connect( 4768s ^^^^^^^^^^^^^^ 4768s ...<4 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Nanny start timed out after 0s. 4768s 2024-11-23 21:49:10,451 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:49:10,464 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37803 4768s 2024-11-23 21:49:10,465 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44257/status 4768s 2024-11-23 21:49:10,465 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:49:10,501 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:45345'. Reason: failure-to-start- 4768s 2024-11-23 21:49:10,502 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:41877'. Reason: failure-to-start- 4768s 2024-11-23 21:49:10,508 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37803': TLS handshake failed with remote 'tls://127.0.0.1:51104': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:49:10,508 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37803': TLS handshake failed with remote 'tls://127.0.0.1:51118': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:49:10,508 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 4768s comm = await self.rpc.connect(saddr) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 4768s return await self._connect(addr=addr, timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 4768s comm = await connect( 4768s ^^^^^^^^^^^^^^ 4768s ...<4 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Nanny start timed out after 0s. 4768s 2024-11-23 21:49:11,520 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:49:11,538 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38343 4768s 2024-11-23 21:49:11,539 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42693/status 4768s 2024-11-23 21:49:11,539 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:49:11,580 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:35107'. Reason: failure-to-start- 4768s 2024-11-23 21:49:11,580 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:45739'. Reason: failure-to-start- 4768s 2024-11-23 21:49:11,583 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38343': TLS handshake failed with remote 'tls://127.0.0.1:41664': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:49:11,583 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38343': TLS handshake failed with remote 'tls://127.0.0.1:41674': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:49:11,588 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 4768s comm = await self.rpc.connect(saddr) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 4768s return await self._connect(addr=addr, timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 4768s comm = await connect( 4768s ^^^^^^^^^^^^^^ 4768s ...<4 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Nanny start timed out after 0s. 4768s 2024-11-23 21:49:12,596 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:49:12,610 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41251 4768s 2024-11-23 21:49:12,610 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41179/status 4768s 2024-11-23 21:49:12,611 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:49:12,655 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:38965'. Reason: failure-to-start- 4768s 2024-11-23 21:49:12,655 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:46863'. Reason: failure-to-start- 4768s 2024-11-23 21:49:12,656 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41251': TLS handshake failed with remote 'tls://127.0.0.1:58778': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:49:12,656 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41251': TLS handshake failed with remote 'tls://127.0.0.1:58782': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:49:12,659 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 4768s comm = await self.rpc.connect(saddr) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 4768s return await self._connect(addr=addr, timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 4768s comm = await connect( 4768s ^^^^^^^^^^^^^^ 4768s ...<4 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Nanny start timed out after 0s. 4768s 2024-11-23 21:49:13,663 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:49:13,676 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46097 4768s 2024-11-23 21:49:13,677 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35835/status 4768s 2024-11-23 21:49:13,677 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:49:13,691 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:36253'. Reason: failure-to-start- 4768s 2024-11-23 21:49:13,691 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:36759'. Reason: failure-to-start- 4768s 2024-11-23 21:49:13,692 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46097': TLS handshake failed with remote 'tls://127.0.0.1:43238': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:49:13,692 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46097': TLS handshake failed with remote 'tls://127.0.0.1:43252': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:49:13,696 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 4768s comm = await self.rpc.connect(saddr) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 4768s return await self._connect(addr=addr, timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 4768s comm = await connect( 4768s ^^^^^^^^^^^^^^ 4768s ...<4 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Nanny start timed out after 0s. 4768s 2024-11-23 21:49:14,700 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:49:14,707 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34741 4768s 2024-11-23 21:49:14,707 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45933/status 4768s 2024-11-23 21:49:14,708 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:49:14,723 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:40897'. Reason: failure-to-start- 4768s 2024-11-23 21:49:14,723 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:39063'. Reason: failure-to-start- 4768s 2024-11-23 21:49:14,724 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34741': TLS handshake failed with remote 'tls://127.0.0.1:39384': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:49:14,724 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34741': TLS handshake failed with remote 'tls://127.0.0.1:39394': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:49:14,724 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 4768s comm = await self.rpc.connect(saddr) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 4768s return await self._connect(addr=addr, timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 4768s comm = await connect( 4768s ^^^^^^^^^^^^^^ 4768s ...<4 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Nanny start timed out after 0s. 4768s 2024-11-23 21:49:15,729 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:49:15,738 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35453 4768s 2024-11-23 21:49:15,738 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35927/status 4768s 2024-11-23 21:49:15,738 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:49:15,754 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:40659'. Reason: failure-to-start- 4768s 2024-11-23 21:49:15,754 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:33547'. Reason: failure-to-start- 4768s 2024-11-23 21:49:15,755 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35453': TLS handshake failed with remote 'tls://127.0.0.1:44804': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:49:15,755 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35453': TLS handshake failed with remote 'tls://127.0.0.1:44806': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:49:15,755 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 4768s comm = await self.rpc.connect(saddr) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 4768s return await self._connect(addr=addr, timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 4768s comm = await connect( 4768s ^^^^^^^^^^^^^^ 4768s ...<4 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Nanny start timed out after 0s. 4768s 2024-11-23 21:49:16,760 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:49:16,766 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38021 4768s 2024-11-23 21:49:16,766 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34411/status 4768s 2024-11-23 21:49:16,767 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:49:16,790 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:36273'. Reason: failure-to-start- 4768s 2024-11-23 21:49:16,791 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:34369'. Reason: failure-to-start- 4768s 2024-11-23 21:49:16,794 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38021': TLS handshake failed with remote 'tls://127.0.0.1:47318': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:49:16,794 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38021': TLS handshake failed with remote 'tls://127.0.0.1:47322': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:49:16,795 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 4768s comm = await self.rpc.connect(saddr) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 4768s return await self._connect(addr=addr, timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 4768s comm = await connect( 4768s ^^^^^^^^^^^^^^ 4768s ...<4 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Nanny start timed out after 0s. 4768s 2024-11-23 21:49:17,799 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:49:17,807 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35661 4768s 2024-11-23 21:49:17,807 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41153/status 4768s 2024-11-23 21:49:17,807 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:49:17,822 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:38287'. Reason: failure-to-start- 4768s 2024-11-23 21:49:17,822 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:43159'. Reason: failure-to-start- 4768s 2024-11-23 21:49:17,823 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35661': TLS handshake failed with remote 'tls://127.0.0.1:39778': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:49:17,823 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35661': TLS handshake failed with remote 'tls://127.0.0.1:39786': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:49:17,823 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 4768s comm = await self.rpc.connect(saddr) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 4768s return await self._connect(addr=addr, timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 4768s comm = await connect( 4768s ^^^^^^^^^^^^^^ 4768s ...<4 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Nanny start timed out after 0s. 4768s 2024-11-23 21:49:18,831 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:49:18,844 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41951 4768s 2024-11-23 21:49:18,845 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43737/status 4768s 2024-11-23 21:49:18,845 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:49:18,890 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:43045'. Reason: failure-to-start- 4768s 2024-11-23 21:49:18,890 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:35735'. Reason: failure-to-start- 4768s 2024-11-23 21:49:18,897 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41951': TLS handshake failed with remote 'tls://127.0.0.1:36532': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:49:18,897 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41951': TLS handshake failed with remote 'tls://127.0.0.1:36548': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:49:18,902 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 4768s comm = await self.rpc.connect(saddr) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 4768s return await self._connect(addr=addr, timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 4768s comm = await connect( 4768s ^^^^^^^^^^^^^^ 4768s ...<4 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Nanny start timed out after 0s. 4768s 2024-11-23 21:49:19,908 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:49:19,914 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42645 4768s 2024-11-23 21:49:19,914 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39941/status 4768s 2024-11-23 21:49:19,915 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:49:19,931 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:35415'. Reason: failure-to-start- 4768s 2024-11-23 21:49:19,931 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:37947'. Reason: failure-to-start- 4768s 2024-11-23 21:49:19,932 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42645': TLS handshake failed with remote 'tls://127.0.0.1:38712': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:49:19,932 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42645': TLS handshake failed with remote 'tls://127.0.0.1:38714': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:49:19,932 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 4768s comm = await self.rpc.connect(saddr) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 4768s return await self._connect(addr=addr, timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 4768s comm = await connect( 4768s ^^^^^^^^^^^^^^ 4768s ...<4 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Nanny start timed out after 0s. 4768s 2024-11-23 21:49:20,937 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:49:20,943 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34815 4768s 2024-11-23 21:49:20,943 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39243/status 4768s 2024-11-23 21:49:20,944 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:49:20,958 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:35429'. Reason: failure-to-start- 4768s 2024-11-23 21:49:20,958 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:40921'. Reason: failure-to-start- 4768s 2024-11-23 21:49:20,959 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34815': TLS handshake failed with remote 'tls://127.0.0.1:60888': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:49:20,959 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34815': TLS handshake failed with remote 'tls://127.0.0.1:60902': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:49:20,961 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 4768s comm = await self.rpc.connect(saddr) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 4768s return await self._connect(addr=addr, timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 4768s comm = await connect( 4768s ^^^^^^^^^^^^^^ 4768s ...<4 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Nanny start timed out after 0s. 4768s 2024-11-23 21:49:21,969 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:49:21,975 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40005 4768s 2024-11-23 21:49:21,976 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36219/status 4768s 2024-11-23 21:49:21,976 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:49:21,991 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:40247'. Reason: failure-to-start- 4768s 2024-11-23 21:49:21,991 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:40789'. Reason: failure-to-start- 4768s 2024-11-23 21:49:21,992 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40005': TLS handshake failed with remote 'tls://127.0.0.1:41944': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:49:21,992 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40005': TLS handshake failed with remote 'tls://127.0.0.1:41946': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:49:21,992 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 4768s comm = await self.rpc.connect(saddr) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 4768s return await self._connect(addr=addr, timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 4768s comm = await connect( 4768s ^^^^^^^^^^^^^^ 4768s ...<4 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Nanny start timed out after 0s. 4768s 2024-11-23 21:49:22,997 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:49:23,002 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44045 4768s 2024-11-23 21:49:23,003 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37851/status 4768s 2024-11-23 21:49:23,003 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:49:23,020 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:40023'. Reason: failure-to-start- 4768s 2024-11-23 21:49:23,020 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:35963'. Reason: failure-to-start- 4768s 2024-11-23 21:49:23,021 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44045': TLS handshake failed with remote 'tls://127.0.0.1:56650': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:49:23,021 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44045': TLS handshake failed with remote 'tls://127.0.0.1:56666': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:49:23,021 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 4768s comm = await self.rpc.connect(saddr) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 4768s return await self._connect(addr=addr, timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 4768s comm = await connect( 4768s ^^^^^^^^^^^^^^ 4768s ...<4 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Nanny start timed out after 0s. 4768s 2024-11-23 21:49:24,026 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:49:24,032 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35249 4768s 2024-11-23 21:49:24,033 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36933/status 4768s 2024-11-23 21:49:24,033 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:49:24,044 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:43611'. Reason: failure-to-start- 4768s 2024-11-23 21:49:24,045 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:36049'. Reason: failure-to-start- 4768s 2024-11-23 21:49:24,048 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35249': TLS handshake failed with remote 'tls://127.0.0.1:59928': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:49:24,048 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35249': TLS handshake failed with remote 'tls://127.0.0.1:59932': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:49:24,048 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 4768s comm = await self.rpc.connect(saddr) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 4768s return await self._connect(addr=addr, timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 4768s comm = await connect( 4768s ^^^^^^^^^^^^^^ 4768s ...<4 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Nanny start timed out after 0s. 4768s ___________________________ test_security_dict_input ___________________________ 4768s 4768s self = 4768s address = '127.0.0.1:40465', deserialize = True 4768s connection_args = {'extra_conn_args': {}, 'require_encryption': True, 'ssl_context': } 4768s ip = '127.0.0.1', port = 40465 4768s kwargs = {'ssl_options': } 4768s 4768s async def connect(self, address, deserialize=True, **connection_args): 4768s self._check_encryption(address, connection_args) 4768s ip, port = parse_host_port(address) 4768s kwargs = self._get_connect_args(**connection_args) 4768s 4768s try: 4768s # server_hostname option (for SNI) only works with tornado.iostream.IOStream 4768s if "server_hostname" in kwargs: 4768s stream = await self.client.connect( 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE 4768s ) 4768s stream = await stream.start_tls(False, **kwargs) 4768s else: 4768s > stream = await self.client.connect( 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ) 4768s 4768s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:546: 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s /usr/lib/python3/dist-packages/tornado/tcpclient.py:292: in connect 4768s stream = await stream.start_tls( 4768s /usr/lib/python3/dist-packages/tornado/iostream.py:1367: in _do_ssl_handshake 4768s self.socket.do_handshake() 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s 4768s self = , block = False 4768s 4768s @_sslcopydoc 4768s def do_handshake(self, block=False): 4768s self._check_connected() 4768s timeout = self.gettimeout() 4768s try: 4768s if timeout == 0.0 and block: 4768s self.settimeout(None) 4768s > self._sslobj.do_handshake() 4768s E ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 4768s 4768s /usr/lib/python3.13/ssl.py:1372: SSLCertVerificationError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s self = 4768s 4768s async def _register_with_scheduler(self) -> None: 4768s self.periodic_callbacks["keep-alive"].stop() 4768s self.periodic_callbacks["heartbeat"].stop() 4768s start = time() 4768s if self.contact_address is None: 4768s self.contact_address = self.address 4768s logger.info("-" * 49) 4768s 4768s # Worker reconnection is not supported 4768s assert not self.data 4768s assert not self.state.tasks 4768s 4768s while True: 4768s try: 4768s _start = time() 4768s > comm = await connect(self.scheduler.address, **self.connection_args) 4768s 4768s /usr/lib/python3/dist-packages/distributed/worker.py:1179: 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s /usr/lib/python3/dist-packages/distributed/comm/core.py:342: in connect 4768s comm = await wait_for( 4768s /usr/lib/python3/dist-packages/distributed/utils.py:1960: in wait_for 4768s return await fut 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s 4768s self = 4768s address = '127.0.0.1:40465', deserialize = True 4768s connection_args = {'extra_conn_args': {}, 'require_encryption': True, 'ssl_context': } 4768s ip = '127.0.0.1', port = 40465 4768s kwargs = {'ssl_options': } 4768s 4768s async def connect(self, address, deserialize=True, **connection_args): 4768s self._check_encryption(address, connection_args) 4768s ip, port = parse_host_port(address) 4768s kwargs = self._get_connect_args(**connection_args) 4768s 4768s try: 4768s # server_hostname option (for SNI) only works with tornado.iostream.IOStream 4768s if "server_hostname" in kwargs: 4768s stream = await self.client.connect( 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE 4768s ) 4768s stream = await stream.start_tls(False, **kwargs) 4768s else: 4768s stream = await self.client.connect( 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ) 4768s 4768s # Under certain circumstances tornado will have a closed connection with an 4768s # error and not raise a StreamClosedError. 4768s # 4768s # This occurs with tornado 5.x and openssl 1.1+ 4768s if stream.closed() and stream.error: 4768s raise StreamClosedError(stream.error) 4768s 4768s except StreamClosedError as e: 4768s # The socket connect() call failed 4768s convert_stream_closed_error(self, e) 4768s except SSLCertVerificationError as err: 4768s > raise FatalCommClosedError( 4768s "TLS certificate does not match. Check your security settings. " 4768s "More info at https://distributed.dask.org/en/latest/tls.html" 4768s ) from err 4768s E distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 4768s 4768s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:561: FatalCommClosedError 4768s 4768s During handling of the above exception, another exception occurred: 4768s 4768s @gen_test() 4768s async def test_security_dict_input(): 4768s conf = tls_config() 4768s ca_file = conf["distributed"]["comm"]["tls"]["ca-file"] 4768s client = conf["distributed"]["comm"]["tls"]["client"]["cert"] 4768s worker = conf["distributed"]["comm"]["tls"]["worker"]["cert"] 4768s scheduler = conf["distributed"]["comm"]["tls"]["scheduler"]["cert"] 4768s 4768s async with Scheduler( 4768s host="localhost", 4768s dashboard_address=":0", 4768s security={"tls_ca_file": ca_file, "tls_scheduler_cert": scheduler}, 4768s ) as s: 4768s assert s.address.startswith("tls://") 4768s > async with Worker( 4768s s.address, security={"tls_ca_file": ca_file, "tls_worker_cert": worker} 4768s ) as w: 4768s 4768s /usr/lib/python3/dist-packages/distributed/tests/test_tls_functional.py:225: 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s /usr/lib/python3/dist-packages/distributed/core.py:678: in __aenter__ 4768s await self 4768s /usr/lib/python3/dist-packages/distributed/core.py:664: in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s /usr/lib/python3/dist-packages/distributed/utils.py:1960: in wait_for 4768s return await fut 4768s /usr/lib/python3/dist-packages/distributed/worker.py:1480: in start_unsafe 4768s await self._register_with_scheduler() 4768s /usr/lib/python3/dist-packages/distributed/worker.py:1218: in _register_with_scheduler 4768s await asyncio.sleep(0.1) 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s 4768s delay = 0.1, result = None 4768s 4768s async def sleep(delay, result=None): 4768s """Coroutine that completes after a given time (in seconds).""" 4768s if delay <= 0: 4768s await __sleep0() 4768s return result 4768s 4768s if math.isnan(delay): 4768s raise ValueError("Invalid delay: NaN (not a number)") 4768s 4768s loop = events.get_running_loop() 4768s future = loop.create_future() 4768s h = loop.call_later(delay, 4768s futures._set_result_unless_cancelled, 4768s future, result) 4768s try: 4768s > return await future 4768s E asyncio.exceptions.CancelledError 4768s 4768s /usr/lib/python3.13/asyncio/tasks.py:718: CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s args = (), kwds = {} 4768s 4768s @wraps(func) 4768s def inner(*args, **kwds): 4768s with self._recreate_cm(): 4768s > return func(*args, **kwds) 4768s 4768s /usr/lib/python3.13/contextlib.py:85: 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s /usr/lib/python3.13/contextlib.py:85: in inner 4768s return func(*args, **kwds) 4768s /usr/lib/python3/dist-packages/distributed/utils_test.py:746: in test_func 4768s return _run_and_close_tornado(async_fn_outer, func, *args, **kwargs) 4768s /usr/lib/python3/dist-packages/distributed/utils_test.py:378: in _run_and_close_tornado 4768s return asyncio_run(inner_fn(), loop_factory=get_loop_factory()) 4768s /usr/lib/python3.13/asyncio/runners.py:194: in run 4768s return runner.run(main) 4768s /usr/lib/python3.13/asyncio/runners.py:118: in run 4768s return self._loop.run_until_complete(task) 4768s /usr/lib/python3.13/asyncio/base_events.py:720: in run_until_complete 4768s return future.result() 4768s /usr/lib/python3/dist-packages/distributed/utils_test.py:375: in inner_fn 4768s return await async_fn(*args, **kwargs) 4768s /usr/lib/python3/dist-packages/distributed/utils_test.py:736: in async_fn_outer 4768s return await utils_wait_for(async_fn(*args, **kwargs), timeout) 4768s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 4768s async with asyncio.timeout(timeout): 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s 4768s self = 4768s exc_type = 4768s exc_val = CancelledError(), exc_tb = 4768s 4768s async def __aexit__( 4768s self, 4768s exc_type: Optional[Type[BaseException]], 4768s exc_val: Optional[BaseException], 4768s exc_tb: Optional[TracebackType], 4768s ) -> Optional[bool]: 4768s assert self._state in (_State.ENTERED, _State.EXPIRING) 4768s 4768s if self._timeout_handler is not None: 4768s self._timeout_handler.cancel() 4768s self._timeout_handler = None 4768s 4768s if self._state is _State.EXPIRING: 4768s self._state = _State.EXPIRED 4768s 4768s if self._task.uncancel() <= self._cancelling and exc_type is not None: 4768s # Since there are no new cancel requests, we're 4768s # handling this. 4768s if issubclass(exc_type, exceptions.CancelledError): 4768s > raise TimeoutError from exc_val 4768s E TimeoutError 4768s 4768s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 4768s ----------------------------- Captured stderr call ----------------------------- 4768s 2024-11-23 21:49:25,332 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:49:25,340 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:25,341 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38253/status 4768s 2024-11-23 21:49:25,341 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:49:25,348 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33423 4768s 2024-11-23 21:49:25,348 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33423 4768s 2024-11-23 21:49:25,348 - distributed.worker - INFO - dashboard at: 127.0.0.1:38283 4768s 2024-11-23 21:49:25,348 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:25,348 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:49:25,348 - distributed.worker - INFO - Threads: 8 4768s 2024-11-23 21:49:25,348 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:49:25,348 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-scfncysx 4768s 2024-11-23 21:49:25,348 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:49:25,355 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:25,356 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:32830': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:25,462 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:25,463 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:32844': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:25,569 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:25,570 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:32854': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:25,676 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:25,676 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:32868': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:25,782 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:25,783 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:32876': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:25,890 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:25,890 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:32880': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:25,998 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:25,998 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:32890': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:26,105 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:26,105 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:32904': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:26,212 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:26,212 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:32910': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:26,318 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:26,319 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:32924': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:26,426 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:26,426 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:32934': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:26,533 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:26,533 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:32936': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:26,640 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:26,640 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:32948': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:26,747 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:26,747 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:32962': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:26,853 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:26,853 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:32964': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:26,960 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:26,960 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:32976': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:27,067 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:27,068 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:32980': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:27,174 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:27,175 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:32996': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:27,281 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:27,281 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:33002': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:27,389 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:27,389 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:33018': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:27,495 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:27,496 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:33026': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:27,602 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:27,602 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:33038': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:27,709 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:27,709 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:33044': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:27,816 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:27,816 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:33048': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:27,922 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:27,922 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:33050': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:28,029 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:28,029 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:33060': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:28,135 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:28,136 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:33076': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:28,242 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:28,242 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:33092': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:28,351 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:28,351 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:33108': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:28,458 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:28,458 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:33118': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:28,565 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:28,565 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:33134': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:28,671 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:28,671 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:33144': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:28,779 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:28,780 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:33154': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:28,886 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:28,886 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:33162': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:28,993 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:28,993 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:33172': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:29,100 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:29,100 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:33182': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:29,207 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:29,208 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:33188': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:29,314 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:29,315 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:33192': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:29,423 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:29,423 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:33208': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:29,529 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:29,530 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:33216': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:29,637 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:29,637 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:33224': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:29,743 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:29,744 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:33240': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:29,851 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:29,852 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:33242': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:29,958 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:29,959 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:33248': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:30,065 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:30,065 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:33260': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:30,171 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:30,172 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:33274': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:30,278 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:30,278 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:33282': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:30,384 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:30,385 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:33288': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:30,491 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:30,492 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:33296': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:30,598 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:30,598 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:33300': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:30,705 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:30,705 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:33304': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:30,812 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:30,812 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:33318': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:30,919 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:30,919 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:33328': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:31,026 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:31,026 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:33336': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:31,133 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:31,133 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:33340': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:31,240 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:31,240 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:33352': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:31,350 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:31,350 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:33354': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:31,457 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:31,457 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:33356': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:31,564 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:31,564 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:39146': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:31,671 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:31,671 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:39152': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:31,779 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:31,779 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:39164': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:31,886 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:31,886 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:39176': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:31,993 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:31,993 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:39192': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:32,100 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:32,100 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:39208': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:32,208 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:32,209 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:39220': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:32,316 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:32,316 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:39228': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:32,424 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:32,424 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:39232': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:32,531 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:32,531 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:39248': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:32,638 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:32,638 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:39256': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:32,745 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:32,745 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:39260': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:32,851 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:32,851 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:39272': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:32,958 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:32,958 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:39276': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:33,064 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:33,065 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:39284': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:33,171 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:33,171 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:39292': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:33,278 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:33,278 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:39298': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:33,385 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:33,385 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:39314': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:33,492 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:33,492 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:39316': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:33,599 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:33,599 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:39332': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:33,706 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:33,706 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:39338': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:33,813 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:33,813 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:39352': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:33,920 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:33,920 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:39364': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:34,027 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:34,027 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:39366': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:34,135 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:34,135 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:39376': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:34,242 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:34,242 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:39378': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:34,352 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:34,352 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:39382': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:34,458 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:34,459 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:39384': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:34,565 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:34,565 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:39392': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:34,672 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:34,672 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:39398': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:34,779 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:34,779 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:39404': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:34,886 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:34,887 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:39414': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:34,993 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:34,994 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:39426': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:35,100 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:35,100 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:39436': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:35,208 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:35,208 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:39442': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:35,316 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:35,316 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:39452': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:35,424 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:35,424 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:39456': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:35,531 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:35,531 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:39460': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:35,638 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:35,639 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:39468': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:35,745 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:35,745 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:39480': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:35,852 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:35,852 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:39496': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:35,959 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:35,959 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:39500': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:36,067 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:36,067 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:39502': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:36,175 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:36,175 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:39508': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:36,282 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:36,282 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:39512': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:36,389 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:36,389 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:39520': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:36,496 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:36,496 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:39536': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:36,603 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:36,603 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:39540': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:36,710 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:36,710 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:39542': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:36,817 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:36,818 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:39546': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:36,925 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:36,925 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:39556': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:37,032 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:37,032 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:39560': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:37,139 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:37,139 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:39568': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:37,246 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:37,246 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:39582': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:37,353 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:37,353 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:39596': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:37,461 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:37,461 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:39602': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:37,568 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:37,568 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:39618': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:37,675 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:37,675 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:39624': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:37,782 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:37,782 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:39632': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:37,890 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:37,890 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:39636': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:37,997 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:37,997 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:39648': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:38,104 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:38,104 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:39652': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:38,211 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:38,211 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:39656': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:38,318 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:38,318 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:39662': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:38,425 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:38,425 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:39666': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:38,532 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:38,532 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:39682': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:38,639 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:38,639 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:39696': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:38,746 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:38,746 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:39700': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:38,853 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:38,853 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:39716': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:38,960 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:38,960 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:39732': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:39,067 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:39,068 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:39740': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:39,174 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:39,175 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:39742': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:39,281 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:39,282 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:39754': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:39,388 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:39,389 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:39758': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:39,495 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:39,496 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:39760': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:39,602 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:39,603 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:39762': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:39,709 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:39,710 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:39770': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:39,816 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:39,816 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:39784': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:39,925 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:39,925 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:39796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:40,032 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:40,032 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:39804': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:40,139 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:40,139 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:39814': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:40,246 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:40,246 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:39830': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:40,352 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:40,353 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:39846': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:40,460 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:40,460 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:39854': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:40,567 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:40,567 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:39870': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:40,673 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:40,673 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:39886': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:40,780 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:40,780 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:39888': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:40,887 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:40,887 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:39894': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:40,994 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:40,994 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:39902': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:41,101 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:41,101 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:39914': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:41,208 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:41,208 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:39924': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:41,314 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:41,315 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:39928': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:41,423 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:41,423 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:39932': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:41,530 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:41,530 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:48836': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:41,636 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:41,636 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:48844': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:41,743 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:41,743 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:48850': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:41,851 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:41,851 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:48860': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:41,958 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:41,959 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:48872': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:42,065 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:42,066 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:48886': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:42,173 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:42,173 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:48894': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:42,279 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:42,280 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:48910': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:42,386 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:42,387 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:48924': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:42,494 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:42,495 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:48940': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:42,601 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:42,602 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:48948': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:42,708 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:42,708 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:48952': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:42,816 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:42,816 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:48954': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:42,923 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:42,924 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:48960': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:43,030 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:43,031 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:48974': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:43,138 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:43,138 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:48980': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:43,245 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:43,245 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:48996': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:43,352 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:43,352 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:49010': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:43,459 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:43,459 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:49024': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:43,567 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:43,567 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:49030': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:43,675 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:43,675 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:49032': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:43,782 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:43,782 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:49048': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:43,890 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:43,890 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:49054': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:43,997 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:43,997 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:49056': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:44,103 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:44,104 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:49062': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:44,210 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:44,210 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:49072': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:44,317 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:44,317 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:49076': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:44,424 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:44,424 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:49086': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:44,532 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:44,532 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:49090': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:44,639 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:44,639 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:49096': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:44,746 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:44,746 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:49108': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:44,853 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:44,853 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:49124': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:44,960 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:44,961 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:49132': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:45,067 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:45,068 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:49148': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:45,174 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:45,175 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:49158': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:45,281 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:45,282 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:49164': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:45,389 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:45,389 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:49176': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:45,496 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:45,496 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:49186': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:45,603 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:45,603 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:49202': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:45,710 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:45,710 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:49218': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:45,817 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:45,817 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:49224': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:45,925 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:45,926 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:49236': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:46,032 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:46,033 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:49250': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:46,140 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:46,140 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:49260': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:46,247 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:46,247 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:49270': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:46,353 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:46,353 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:49276': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:46,460 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:46,460 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:49280': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:46,567 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:46,567 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:49296': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:46,675 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:46,676 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:49300': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:46,783 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:46,783 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:49304': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:46,890 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:46,891 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:49314': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:46,997 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:46,997 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:49320': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:47,104 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:47,104 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:49332': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:47,211 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:47,211 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:49348': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:47,318 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:47,318 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:49352': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:47,425 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:47,425 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:49362': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:47,532 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:47,532 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:49368': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:47,639 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:47,639 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:49376': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:47,746 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:47,746 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:49390': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:47,852 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:47,852 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:49404': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:47,959 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:47,959 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:49420': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:48,067 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:48,067 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:49436': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:48,175 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:48,175 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:49442': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:48,282 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:48,282 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:49446': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:48,389 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:48,389 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:49452': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:48,496 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:48,496 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:49468': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:48,603 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:48,603 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:49476': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:48,710 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:48,710 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:49482': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:48,817 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:48,817 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:49484': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:48,924 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:48,924 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:49488': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:49,031 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:49,031 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:49498': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:49,138 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:49,138 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:49508': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:49,245 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:49,245 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:49512': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:49,352 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:49,353 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:49522': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:49,459 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:49,460 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:49524': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:49,567 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:49,568 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:49532': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:49,675 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:49,675 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:49534': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:49,782 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:49,785 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:49546': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:49,889 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:49,889 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:49548': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:49,996 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:49,996 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:49562': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:50,103 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:50,103 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:49572': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:50,210 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:50,210 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:49576': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:50,317 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:50,318 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:49584': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:50,425 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:50,425 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:49594': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:50,532 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:50,532 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:49606': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:50,639 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:50,639 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:49612': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:50,746 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:50,746 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:49624': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:50,852 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:50,853 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:49638': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:50,960 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:50,960 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:49654': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:51,068 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:51,068 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:49670': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:51,175 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:51,175 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:49672': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:51,282 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:51,283 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:49680': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:51,390 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:51,390 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:49682': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:51,497 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:51,497 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:49686': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:51,603 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:51,604 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:48800': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:51,710 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:51,711 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:48812': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:51,817 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:51,817 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:48828': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:51,925 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:51,925 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:48844': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:52,032 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:52,033 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:48854': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:52,140 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:52,140 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:48864': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:52,248 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:52,248 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:48872': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:52,355 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:52,355 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:48874': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:52,462 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:52,462 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:48882': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:52,569 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:52,569 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:48896': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:52,676 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:52,676 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:48904': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:52,784 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:52,784 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:48920': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:52,891 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:52,891 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:48922': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:52,998 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:52,998 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:48924': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:53,105 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:53,105 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:48934': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:53,212 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:53,212 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:48948': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:53,319 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:53,320 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:48954': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:53,426 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:53,426 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:48958': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:53,532 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:53,533 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:48970': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:53,639 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:53,640 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:48984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:53,746 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:53,746 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:49000': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:53,852 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:53,853 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:49012': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:53,959 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:53,960 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:49018': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:54,067 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:54,068 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:49034': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:54,175 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:54,175 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:49038': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:54,281 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:54,282 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:49050': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:54,388 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:54,388 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:49056': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:54,494 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:54,495 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:49072': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:54,601 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:54,602 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:49078': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:54,708 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:54,708 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:49080': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:54,816 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:54,816 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:49082': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:54,924 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:54,924 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:49088': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:55,030 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:55,031 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:49092': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:55,137 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:55,138 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:49104': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:55,244 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40465 4768s 2024-11-23 21:49:55,245 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40465': TLS handshake failed with remote 'tls://127.0.0.1:49110': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:55,315 - distributed.scheduler - INFO - Scheduler closing due to unknown reason... 4768s 2024-11-23 21:49:55,316 - distributed.scheduler - INFO - Scheduler closing all comms 4768s _____________________________ test_gen_cluster_tls _____________________________ 4768s 4768s fut = , timeout = 0 4768s 4768s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 4768s async with asyncio.timeout(timeout): 4768s > return await fut 4768s 4768s /usr/lib/python3/dist-packages/distributed/utils.py:1960: 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s /usr/lib/python3/dist-packages/distributed/worker.py:1480: in start_unsafe 4768s await self._register_with_scheduler() 4768s /usr/lib/python3/dist-packages/distributed/worker.py:1179: in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s /usr/lib/python3/dist-packages/distributed/comm/core.py:342: in connect 4768s comm = await wait_for( 4768s /usr/lib/python3/dist-packages/distributed/utils.py:1960: in wait_for 4768s return await fut 4768s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:546: in connect 4768s stream = await self.client.connect( 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s 4768s self = , host = '127.0.0.1' 4768s port = 43765, af = 4768s ssl_options = 4768s max_buffer_size = 8364507136.0, source_ip = None, source_port = None 4768s timeout = None 4768s 4768s async def connect( 4768s self, 4768s host: str, 4768s port: int, 4768s af: socket.AddressFamily = socket.AF_UNSPEC, 4768s ssl_options: Optional[Union[Dict[str, Any], ssl.SSLContext]] = None, 4768s max_buffer_size: Optional[int] = None, 4768s source_ip: Optional[str] = None, 4768s source_port: Optional[int] = None, 4768s timeout: Optional[Union[float, datetime.timedelta]] = None, 4768s ) -> IOStream: 4768s """Connect to the given host and port. 4768s 4768s Asynchronously returns an `.IOStream` (or `.SSLIOStream` if 4768s ``ssl_options`` is not None). 4768s 4768s Using the ``source_ip`` kwarg, one can specify the source 4768s IP address to use when establishing the connection. 4768s In case the user needs to resolve and 4768s use a specific interface, it has to be handled outside 4768s of Tornado as this depends very much on the platform. 4768s 4768s Raises `TimeoutError` if the input future does not complete before 4768s ``timeout``, which may be specified in any form allowed by 4768s `.IOLoop.add_timeout` (i.e. a `datetime.timedelta` or an absolute time 4768s relative to `.IOLoop.time`) 4768s 4768s Similarly, when the user requires a certain source port, it can 4768s be specified using the ``source_port`` arg. 4768s 4768s .. versionchanged:: 4.5 4768s Added the ``source_ip`` and ``source_port`` arguments. 4768s 4768s .. versionchanged:: 5.0 4768s Added the ``timeout`` argument. 4768s """ 4768s if timeout is not None: 4768s if isinstance(timeout, numbers.Real): 4768s timeout = IOLoop.current().time() + timeout 4768s elif isinstance(timeout, datetime.timedelta): 4768s timeout = IOLoop.current().time() + timeout.total_seconds() 4768s else: 4768s raise TypeError("Unsupported timeout %r" % timeout) 4768s if timeout is not None: 4768s addrinfo = await gen.with_timeout( 4768s timeout, self.resolver.resolve(host, port, af) 4768s ) 4768s else: 4768s addrinfo = await self.resolver.resolve(host, port, af) 4768s connector = _Connector( 4768s addrinfo, 4768s functools.partial( 4768s self._create_stream, 4768s max_buffer_size, 4768s source_ip=source_ip, 4768s source_port=source_port, 4768s ), 4768s ) 4768s > af, addr, stream = await connector.start(connect_timeout=timeout) 4768s E asyncio.exceptions.CancelledError 4768s 4768s /usr/lib/python3/dist-packages/tornado/tcpclient.py:279: CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s self = 4768s 4768s @final 4768s async def start(self): 4768s async with self._startup_lock: 4768s if self.status == Status.failed: 4768s assert self.__startup_exc is not None 4768s raise self.__startup_exc 4768s elif self.status != Status.init: 4768s return self 4768s timeout = getattr(self, "death_timeout", None) 4768s 4768s async def _close_on_failure(exc: Exception) -> None: 4768s await self.close(reason=f"failure-to-start-{str(type(exc))}") 4768s self.status = Status.failed 4768s self.__startup_exc = exc 4768s 4768s try: 4768s > await wait_for(self.start_unsafe(), timeout=timeout) 4768s 4768s /usr/lib/python3/dist-packages/distributed/core.py:664: 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 4768s async with asyncio.timeout(timeout): 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s 4768s self = 4768s exc_type = 4768s exc_val = CancelledError(), exc_tb = 4768s 4768s async def __aexit__( 4768s self, 4768s exc_type: Optional[Type[BaseException]], 4768s exc_val: Optional[BaseException], 4768s exc_tb: Optional[TracebackType], 4768s ) -> Optional[bool]: 4768s assert self._state in (_State.ENTERED, _State.EXPIRING) 4768s 4768s if self._timeout_handler is not None: 4768s self._timeout_handler.cancel() 4768s self._timeout_handler = None 4768s 4768s if self._state is _State.EXPIRING: 4768s self._state = _State.EXPIRED 4768s 4768s if self._task.uncancel() <= self._cancelling and exc_type is not None: 4768s # Since there are no new cancel requests, we're 4768s # handling this. 4768s if issubclass(exc_type, exceptions.CancelledError): 4768s > raise TimeoutError from exc_val 4768s E TimeoutError 4768s 4768s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s @contextlib.asynccontextmanager 4768s async def _cluster_factory(): 4768s workers = [] 4768s s = None 4768s try: 4768s for _ in range(60): 4768s try: 4768s > s, ws = await start_cluster( 4768s nthreads, 4768s scheduler, 4768s security=security, 4768s Worker=Worker, 4768s scheduler_kwargs=scheduler_kwargs, 4768s worker_kwargs=merge( 4768s {"death_timeout": min(15, int(deadline.remaining))}, 4768s worker_kwargs, 4768s ), 4768s ) 4768s 4768s /usr/lib/python3/dist-packages/distributed/utils_test.py:966: 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s /usr/lib/python3/dist-packages/distributed/utils_test.py:789: in start_cluster 4768s await asyncio.gather(*workers) 4768s /usr/lib/python3.13/asyncio/tasks.py:737: in _wrap_awaitable 4768s return await awaitable 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s 4768s self = 4768s 4768s @final 4768s async def start(self): 4768s async with self._startup_lock: 4768s if self.status == Status.failed: 4768s assert self.__startup_exc is not None 4768s raise self.__startup_exc 4768s elif self.status != Status.init: 4768s return self 4768s timeout = getattr(self, "death_timeout", None) 4768s 4768s async def _close_on_failure(exc: Exception) -> None: 4768s await self.close(reason=f"failure-to-start-{str(type(exc))}") 4768s self.status = Status.failed 4768s self.__startup_exc = exc 4768s 4768s try: 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s except asyncio.TimeoutError as exc: 4768s await _close_on_failure(exc) 4768s > raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s E TimeoutError: Worker start timed out after 0s. 4768s 4768s /usr/lib/python3/dist-packages/distributed/core.py:667: TimeoutError 4768s 4768s During handling of the above exception, another exception occurred: 4768s 4768s fut = ._..test_func..async_fn at 0xe99addc0> 4768s timeout = 60 4768s 4768s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 4768s async with asyncio.timeout(timeout): 4768s > return await fut 4768s 4768s /usr/lib/python3/dist-packages/distributed/utils.py:1960: 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s /usr/lib/python3/dist-packages/distributed/utils_test.py:999: in async_fn 4768s _cluster_factory() as (s, workers), 4768s /usr/lib/python3.13/contextlib.py:214: in __aenter__ 4768s return await anext(self.gen) 4768s /usr/lib/python3/dist-packages/distributed/utils_test.py:983: in _cluster_factory 4768s await asyncio.sleep(1) 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s 4768s delay = 1, result = None 4768s 4768s async def sleep(delay, result=None): 4768s """Coroutine that completes after a given time (in seconds).""" 4768s if delay <= 0: 4768s await __sleep0() 4768s return result 4768s 4768s if math.isnan(delay): 4768s raise ValueError("Invalid delay: NaN (not a number)") 4768s 4768s loop = events.get_running_loop() 4768s future = loop.create_future() 4768s h = loop.call_later(delay, 4768s futures._set_result_unless_cancelled, 4768s future, result) 4768s try: 4768s > return await future 4768s E asyncio.exceptions.CancelledError 4768s 4768s /usr/lib/python3.13/asyncio/tasks.py:718: CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s args = (), kwds = {} 4768s 4768s @wraps(func) 4768s def inner(*args, **kwds): 4768s with self._recreate_cm(): 4768s > return func(*args, **kwds) 4768s 4768s /usr/lib/python3.13/contextlib.py:85: 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s /usr/lib/python3.13/contextlib.py:85: in inner 4768s return func(*args, **kwds) 4768s /usr/lib/python3/dist-packages/distributed/utils_test.py:1102: in test_func 4768s return _run_and_close_tornado(async_fn_outer) 4768s /usr/lib/python3/dist-packages/distributed/utils_test.py:378: in _run_and_close_tornado 4768s return asyncio_run(inner_fn(), loop_factory=get_loop_factory()) 4768s /usr/lib/python3.13/asyncio/runners.py:194: in run 4768s return runner.run(main) 4768s /usr/lib/python3.13/asyncio/runners.py:118: in run 4768s return self._loop.run_until_complete(task) 4768s /usr/lib/python3.13/asyncio/base_events.py:720: in run_until_complete 4768s return future.result() 4768s /usr/lib/python3/dist-packages/distributed/utils_test.py:375: in inner_fn 4768s return await async_fn(*args, **kwargs) 4768s /usr/lib/python3/dist-packages/distributed/utils_test.py:1099: in async_fn_outer 4768s return await utils_wait_for(async_fn(), timeout=timeout * 2) 4768s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 4768s async with asyncio.timeout(timeout): 4768s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 4768s 4768s self = 4768s exc_type = 4768s exc_val = CancelledError(), exc_tb = 4768s 4768s async def __aexit__( 4768s self, 4768s exc_type: Optional[Type[BaseException]], 4768s exc_val: Optional[BaseException], 4768s exc_tb: Optional[TracebackType], 4768s ) -> Optional[bool]: 4768s assert self._state in (_State.ENTERED, _State.EXPIRING) 4768s 4768s if self._timeout_handler is not None: 4768s self._timeout_handler.cancel() 4768s self._timeout_handler = None 4768s 4768s if self._state is _State.EXPIRING: 4768s self._state = _State.EXPIRED 4768s 4768s if self._task.uncancel() <= self._cancelling and exc_type is not None: 4768s # Since there are no new cancel requests, we're 4768s # handling this. 4768s if issubclass(exc_type, exceptions.CancelledError): 4768s > raise TimeoutError from exc_val 4768s E TimeoutError 4768s 4768s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 4768s ----------------------------- Captured stderr call ----------------------------- 4768s 2024-11-23 21:49:55,742 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:49:55,749 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37391 4768s 2024-11-23 21:49:55,750 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44769/status 4768s 2024-11-23 21:49:55,750 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:49:55,762 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43079 4768s 2024-11-23 21:49:55,762 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43079 4768s 2024-11-23 21:49:55,762 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:49:55,762 - distributed.worker - INFO - dashboard at: 127.0.0.1:42855 4768s 2024-11-23 21:49:55,762 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:49:55,762 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:49:55,762 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:49:55,762 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:49:55,762 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-6lebx_8s 4768s 2024-11-23 21:49:55,762 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:49:55,764 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41383 4768s 2024-11-23 21:49:55,764 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41383 4768s 2024-11-23 21:49:55,764 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:49:55,764 - distributed.worker - INFO - dashboard at: 127.0.0.1:42051 4768s 2024-11-23 21:49:55,764 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:49:55,764 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:49:55,764 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:49:55,764 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:49:55,764 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-u84w2p3a 4768s 2024-11-23 21:49:55,764 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:49:55,776 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:49:55,776 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:49:55,776 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:55152': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:55,776 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:55168': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:55,888 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:49:55,888 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:49:55,888 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:55180': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:55,889 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:55182': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:56,001 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:49:56,001 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:49:56,001 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:55184': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:56,001 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:55192': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:56,113 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:49:56,113 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:49:56,113 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:55200': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:56,113 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:55210': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:56,225 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:49:56,225 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:49:56,225 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:55214': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:56,225 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:55218': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:56,337 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:49:56,337 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:49:56,337 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:55220': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:56,337 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:55234': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:56,448 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:49:56,449 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:49:56,449 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:55240': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:56,449 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:55252': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:56,561 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:49:56,561 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:49:56,561 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:55262': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:56,561 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:55266': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:56,673 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:49:56,673 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:49:56,674 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:55274': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:56,674 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:55278': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:56,785 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:49:56,786 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:49:56,786 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:55292': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:56,786 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:55296': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:56,898 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:49:56,898 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:49:56,898 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:55304': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:56,898 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:55310': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:57,010 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:49:57,010 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:49:57,011 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:55314': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:57,011 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:55316': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:57,122 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:49:57,123 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:49:57,123 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:55318': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:57,123 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:55334': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:57,235 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:49:57,235 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:49:57,236 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:55348': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:57,236 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:55364': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:57,347 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:49:57,347 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:49:57,347 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:55378': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:57,347 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:55382': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:57,459 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:49:57,459 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:49:57,459 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:55384': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:57,460 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:55394': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:57,571 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:49:57,572 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:49:57,572 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:55406': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:57,572 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:55420': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:57,685 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:49:57,685 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:49:57,685 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:55428': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:57,685 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:55438': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:57,796 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:49:57,797 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:49:57,797 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:55448': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:57,797 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:55452': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:57,908 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:49:57,909 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:49:57,909 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:55466': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:57,909 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:55480': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:58,020 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:49:58,020 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:49:58,020 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:55492': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:58,020 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:55502': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:58,132 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:49:58,132 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:49:58,133 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:55514': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:58,133 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:55530': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:58,244 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:49:58,244 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:49:58,245 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:55532': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:58,245 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:55548': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:58,357 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:49:58,357 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:49:58,357 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:55562': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:58,357 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:55574': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:58,469 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:49:58,469 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:49:58,469 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:55580': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:58,469 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:55590': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:58,582 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:49:58,582 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:49:58,582 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:55594': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:58,582 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:55610': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:58,694 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:49:58,694 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:49:58,695 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:55624': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:58,695 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:55626': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:58,807 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:49:58,807 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:49:58,807 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:55628': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:58,807 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:55640': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:58,919 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:49:58,919 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:49:58,920 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:55644': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:58,920 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:55648': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:59,032 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:49:59,032 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:49:59,032 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:55658': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:59,033 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:55662': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:59,144 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:49:59,144 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:49:59,145 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:55670': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:59,145 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:55682': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:59,257 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:49:59,257 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:49:59,260 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:55684': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:59,261 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:55694': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:59,370 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:49:59,370 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:49:59,371 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:55706': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:59,371 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:55718': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:59,482 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:49:59,482 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:49:59,483 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:55726': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:59,483 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:55738': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:59,594 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:49:59,594 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:49:59,594 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:55752': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:59,594 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:55762': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:59,705 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:49:59,706 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:49:59,706 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:55764': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:59,706 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:55776': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:59,817 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:49:59,817 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:49:59,818 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:55792': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:59,818 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:55804': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:59,930 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:49:59,930 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:49:59,930 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:55806': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:49:59,930 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:55816': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:00,042 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:00,042 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:00,043 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:55830': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:00,043 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:55838': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:00,154 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:00,155 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:00,155 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:55842': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:00,155 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:55850': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:00,266 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:00,266 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:00,266 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:55856': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:00,266 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:55862': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:00,378 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:00,378 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:00,378 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:55876': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:00,378 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:55886': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:00,490 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:00,490 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:00,490 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:55900': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:00,490 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:55906': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:00,601 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:00,602 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:00,602 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:55910': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:00,602 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:55912': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:00,714 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:00,714 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:00,714 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:55920': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:00,714 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:55928': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:00,826 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:00,826 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:00,826 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:55940': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:00,826 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:55946': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:00,938 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:00,938 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:00,938 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:55956': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:00,938 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:55960': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:01,050 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:01,050 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:01,051 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:55970': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:01,051 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:55984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:01,164 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:01,164 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:01,164 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:55986': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:01,164 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:56000': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:01,275 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:01,276 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:01,276 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:56012': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:01,276 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:56020': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:01,387 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:01,387 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:01,388 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:56030': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:01,388 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:56034': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:01,499 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:01,500 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:01,500 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:56036': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:01,500 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:56046': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:01,611 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:01,611 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:01,612 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:35146': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:01,612 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:35148': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:01,723 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:01,724 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:01,724 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:35152': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:01,724 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:35158': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:01,835 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:01,836 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:01,836 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:35168': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:01,836 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:35178': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:01,948 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:01,948 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:01,948 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:35190': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:01,948 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:35196': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:02,059 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:02,059 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:02,060 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:35202': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:02,060 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:35210': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:02,172 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:02,173 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:02,173 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:35224': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:02,173 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:35240': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:02,285 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:02,285 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:02,285 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:35242': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:02,285 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:35244': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:02,397 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:02,397 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:02,397 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:35258': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:02,397 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:35268': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:02,509 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:02,509 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:02,510 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:35272': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:02,510 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:35276': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:02,622 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:02,622 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:02,623 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:35282': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:02,623 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:35286': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:02,735 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:02,736 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:02,736 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:35300': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:02,736 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:35308': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:02,848 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:02,848 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:02,849 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:35312': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:02,849 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:35324': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:02,961 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:02,961 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:02,961 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:35330': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:02,961 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:35332': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:03,072 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:03,072 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:03,072 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:35334': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:03,072 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:35346': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:03,184 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:03,184 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:03,185 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:35348': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:03,185 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:35362': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:03,296 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:03,296 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:03,296 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:35372': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:03,296 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:35374': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:03,407 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:03,407 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:03,408 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:35380': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:03,408 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:35396': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:03,519 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:03,519 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:03,519 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:35398': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:03,519 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:35406': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:03,631 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:03,631 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:03,631 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:35416': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:03,631 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:35422': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:03,743 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:03,743 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:03,744 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:35424': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:03,744 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:35426': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:03,855 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:03,856 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:03,856 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:35434': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:03,856 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:35436': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:03,968 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:03,968 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:03,968 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:35444': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:03,968 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:35446': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:04,079 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:04,079 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:04,080 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:35448': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:04,080 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:35460': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:04,191 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:04,191 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:04,191 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:35476': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:04,192 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:35486': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:04,303 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:04,303 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:04,303 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:35496': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:04,303 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:35506': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:04,415 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:04,415 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:04,416 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:35518': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:04,416 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:35520': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:04,527 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:04,527 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:04,527 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:35530': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:04,527 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:35538': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:04,640 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:04,640 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:04,640 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:35546': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:04,640 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:35556': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:04,753 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:04,753 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:04,756 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:35558': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:04,756 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:35562': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:04,865 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:04,865 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:04,866 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:35574': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:04,866 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:35580': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:04,978 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:04,978 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:04,978 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:35584': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:04,978 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:35588': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:05,089 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:05,089 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:05,089 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:35602': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:05,089 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:35612': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:05,201 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:05,201 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:05,201 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:35624': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:05,201 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:35638': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:05,313 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:05,313 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:05,313 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:35654': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:05,313 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:35668': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:05,425 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:05,425 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:05,425 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:35672': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:05,425 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:35678': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:05,537 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:05,537 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:05,537 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:35694': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:05,537 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:35700': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:05,649 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:05,649 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:05,649 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:35706': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:05,649 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:35708': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:05,762 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:05,763 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:05,763 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:35718': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:05,763 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:35726': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:05,870 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:05,874 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:35738': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:05,875 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:05,875 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:35748': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:05,977 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:05,977 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:35764': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:05,983 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:05,983 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:35770': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:06,084 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:06,085 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:35774': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:06,090 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:06,090 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:35788': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:06,191 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:06,191 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:35792': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:06,196 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:06,197 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:35796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:06,298 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:06,298 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:35798': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:06,303 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:06,304 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:35804': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:06,405 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:06,406 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:35810': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:06,411 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:06,411 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:35812': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:06,513 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:06,514 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:35814': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:06,519 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:06,519 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:35822': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:06,620 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:06,621 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:35830': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:06,626 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:06,626 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:35834': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:06,727 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:06,727 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:35844': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:06,733 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:06,733 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:35852': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:06,834 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:06,835 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:35854': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:06,840 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:06,840 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:35870': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:06,941 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:06,941 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:35874': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:06,947 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:06,947 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:35884': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:07,048 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:07,049 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:35896': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:07,054 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:07,054 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:35908': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:07,155 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:07,155 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:35918': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:07,160 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:07,161 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:35932': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:07,262 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:07,262 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:35940': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:07,268 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:07,268 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:35944': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:07,368 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:07,369 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:35960': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:07,374 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:07,374 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:35970': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:07,476 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:07,476 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:35972': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:07,482 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:07,482 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:35980': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:07,583 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:07,583 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:35984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:07,589 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:07,589 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:35994': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:07,691 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:07,691 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:36000': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:07,697 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:07,697 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:36010': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:07,797 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:07,798 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:36022': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:07,803 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:07,803 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:36030': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:07,904 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:07,904 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:36046': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:07,910 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:07,910 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:36062': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:08,011 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:08,012 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:36072': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:08,018 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:08,018 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:36076': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:08,117 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:08,118 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:36088': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:08,124 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:08,125 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:36104': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:08,225 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:08,226 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:36112': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:08,231 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:08,232 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:36116': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:08,333 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:08,333 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:36130': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:08,339 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:08,339 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:36142': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:08,439 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:08,440 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:36158': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:08,445 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:08,445 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:36172': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:08,546 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:08,547 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:36174': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:08,552 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:08,552 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:36186': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:08,653 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:08,653 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:36200': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:08,659 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:08,659 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:36208': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:08,760 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:08,760 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:36222': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:08,766 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:08,766 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:36236': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:08,868 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:08,869 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:36246': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:08,874 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:08,874 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:36260': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:08,975 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:08,975 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:36264': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:08,981 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:08,981 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:36268': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:09,081 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:09,082 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:36270': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:09,087 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:09,087 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:36284': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:09,188 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:09,188 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:36296': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:09,194 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:09,194 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:36306': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:09,294 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:09,294 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:36308': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:09,300 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:09,300 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:36314': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:09,401 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:09,401 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:36328': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:09,407 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:09,407 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:36340': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:09,507 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:09,508 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:36350': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:09,513 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:09,514 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:36362': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:09,614 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:09,614 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:36366': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:09,620 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:09,620 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:36374': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:09,722 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:09,722 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:36378': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:09,728 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:09,728 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:36388': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:09,828 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:09,829 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:36402': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:09,834 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:09,835 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:36418': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:09,936 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:09,936 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:36420': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:09,942 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:09,942 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:36430': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:10,043 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:10,043 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:36442': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:10,049 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:10,049 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:36452': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:10,149 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:10,150 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:36464': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:10,156 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:10,156 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:36470': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:10,259 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:10,260 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:36484': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:10,265 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:10,265 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:36494': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:10,367 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:10,367 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:36496': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:10,373 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:10,373 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:36502': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:10,473 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:10,474 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:36514': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:10,479 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:10,480 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:36516': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:10,580 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:10,581 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:36528': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:10,586 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:10,587 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:36542': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:10,687 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:10,688 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:36556': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:10,693 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37391 4768s 2024-11-23 21:50:10,694 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37391': TLS handshake failed with remote 'tls://127.0.0.1:36572': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:10,761 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43079. Reason: failure-to-start- 4768s 2024-11-23 21:50:10,761 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:50:10,763 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 15s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 4768s stream = await stream.start_tls( 4768s ^^^^^^^^^^^^^^^^^^^^^^^ 4768s False, ssl_options=ssl_options, server_hostname=host 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 4768s self.socket.do_handshake() 4768s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 4768s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 4768s self._sslobj.do_handshake() 4768s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 4768s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 4768s raise FatalCommClosedError( 4768s ...<2 lines>... 4768s ) from err 4768s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 4768s 4768s During handling of the above exception, another exception occurred: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1218, in _register_with_scheduler 4768s await asyncio.sleep(0.1) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 718, in sleep 4768s return await future 4768s ^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 15s. 4768s 2024-11-23 21:50:10,766 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41383. Reason: failure-to-start- 4768s 2024-11-23 21:50:10,766 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:50:11,768 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:50:11,775 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:11,775 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41843/status 4768s 2024-11-23 21:50:11,775 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:50:11,791 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35317 4768s 2024-11-23 21:50:11,791 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35317 4768s 2024-11-23 21:50:11,791 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:50:11,791 - distributed.worker - INFO - dashboard at: 127.0.0.1:34737 4768s 2024-11-23 21:50:11,791 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:11,791 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:50:11,791 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:50:11,791 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:50:11,791 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-c_z_s7o3 4768s 2024-11-23 21:50:11,791 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:50:11,793 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34251 4768s 2024-11-23 21:50:11,793 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34251 4768s 2024-11-23 21:50:11,793 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:50:11,793 - distributed.worker - INFO - dashboard at: 127.0.0.1:37039 4768s 2024-11-23 21:50:11,793 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:11,793 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:50:11,793 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:50:11,793 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:50:11,793 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-sqq_38mr 4768s 2024-11-23 21:50:11,793 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:50:11,805 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:11,805 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:11,806 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:49986': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:11,806 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:49992': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:11,917 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:11,917 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:11,917 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:49998': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:11,917 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:50012': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:12,028 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:12,029 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:12,029 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:50014': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:12,029 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:50016': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:12,141 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:12,141 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:12,141 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:50020': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:12,141 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:50022': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:12,253 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:12,253 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:12,257 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:50034': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:12,257 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:50046': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:12,365 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:12,365 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:12,365 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:50062': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:12,365 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:50072': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:12,476 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:12,476 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:12,477 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:50082': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:12,477 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:50098': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:12,588 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:12,588 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:12,588 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:50112': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:12,588 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:50122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:12,700 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:12,700 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:12,700 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:50124': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:12,700 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:50140': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:12,812 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:12,812 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:12,812 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:50148': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:12,813 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:50152': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:12,925 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:12,925 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:12,925 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:50168': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:12,926 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:50178': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:13,036 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:13,037 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:13,037 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:50190': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:13,037 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:50196': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:13,149 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:13,149 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:13,149 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:50212': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:13,149 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:50224': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:13,264 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:13,264 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:13,264 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:50230': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:13,264 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:50234': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:13,375 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:13,376 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:13,376 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:50238': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:13,376 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:50242': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:13,487 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:13,487 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:13,487 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:50244': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:13,487 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:50260': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:13,600 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:13,600 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:13,600 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:50276': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:13,600 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:50284': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:13,710 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:13,711 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:13,711 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:50288': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:13,711 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:50294': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:13,822 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:13,822 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:13,822 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:50310': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:13,823 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:50326': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:13,933 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:13,934 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:13,934 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:50328': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:13,934 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:50332': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:14,045 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:14,045 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:14,046 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:50340': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:14,046 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:50350': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:14,157 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:14,157 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:14,158 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:50358': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:14,158 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:50370': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:14,269 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:14,269 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:14,269 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:50376': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:14,269 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:50384': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:14,380 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:14,381 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:14,381 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:50388': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:14,381 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:50394': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:14,492 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:14,493 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:14,493 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:50402': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:14,493 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:50418': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:14,604 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:14,605 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:14,606 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:50428': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:14,606 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:50444': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:14,712 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:14,712 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:50454': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:14,717 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:14,717 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:50458': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:14,818 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:14,819 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:50464': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:14,824 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:14,825 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:50470': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:14,925 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:14,925 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:50478': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:14,931 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:14,931 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:50480': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:15,032 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:15,033 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:50492': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:15,038 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:15,038 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:50508': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:15,139 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:15,139 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:50524': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:15,145 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:15,145 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:50536': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:15,246 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:15,246 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:50552': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:15,252 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:15,255 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:50562': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:15,354 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:15,354 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:50574': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:15,360 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:15,360 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:50576': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:15,460 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:15,461 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:50578': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:15,466 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:15,467 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:50582': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:15,567 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:15,568 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:50596': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:15,573 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:15,573 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:50612': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:15,674 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:15,674 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:50626': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:15,680 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:15,680 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:50638': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:15,784 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:15,784 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:50652': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:15,790 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:15,790 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:50656': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:15,891 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:15,891 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:50664': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:15,896 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:15,897 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:50678': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:15,997 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:15,998 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:50686': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:16,003 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:16,003 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:50690': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:16,105 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:16,105 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:50692': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:16,111 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:16,111 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:50694': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:16,212 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:16,212 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:50708': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:16,218 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:16,218 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:50714': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:16,319 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:16,319 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:50718': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:16,325 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:16,325 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:50734': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:16,426 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:16,426 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:50742': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:16,432 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:16,432 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:50756': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:16,533 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:16,533 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:50772': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:16,539 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:16,539 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:50776': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:16,639 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:16,640 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:50778': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:16,646 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:16,646 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:50784': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:16,747 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:16,747 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:50792': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:16,753 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:16,756 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:50798': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:16,854 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:16,854 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:50800': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:16,860 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:16,860 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:50804': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:16,961 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:16,961 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:50814': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:16,967 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:16,967 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:50822': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:17,068 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:17,069 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:50830': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:17,074 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:17,074 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:50834': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:17,176 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:17,177 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:50840': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:17,182 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:17,183 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:50850': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:17,285 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:17,285 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:50856': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:17,291 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:17,291 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:50858': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:17,393 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:17,393 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:50872': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:17,398 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:17,399 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:50878': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:17,500 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:17,500 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:50884': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:17,506 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:17,506 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:50894': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:17,606 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:17,606 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:50906': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:17,612 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:17,612 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:50912': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:17,713 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:17,714 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:50920': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:17,719 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:17,720 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:50932': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:17,821 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:17,821 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:50938': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:17,827 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:17,827 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:50946': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:17,929 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:17,929 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:50950': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:17,935 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:17,935 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:50964': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:18,035 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:18,036 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:50972': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:18,041 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:18,041 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:50980': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:18,142 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:18,143 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:50990': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:18,148 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:18,149 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:51006': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:18,251 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:18,251 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:51016': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:18,260 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:18,260 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:51032': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:18,358 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:18,358 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:51042': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:18,367 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:18,367 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:51054': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:18,464 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:18,465 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:51070': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:18,473 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:18,474 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:51072': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:18,571 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:18,572 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:51074': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:18,580 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:18,580 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:51080': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:18,679 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:18,679 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:51084': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:18,686 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:18,686 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:51098': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:18,786 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:18,786 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:51102': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:18,792 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:18,792 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:51112': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:18,893 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:18,894 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:51122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:18,899 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:18,900 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:51134': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:19,002 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:19,002 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:51142': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:19,008 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:19,008 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:51146': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:19,109 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:19,109 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:51150': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:19,115 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:19,115 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:51164': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:19,216 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:19,216 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:51166': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:19,221 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:19,222 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:51176': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:19,322 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:19,323 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:51192': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:19,328 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:19,328 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:51204': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:19,429 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:19,430 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:51206': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:19,435 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:19,435 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:51208': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:19,536 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:19,538 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:51218': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:19,543 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:19,543 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:51226': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:19,643 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:19,643 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:51234': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:19,649 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:19,649 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:51242': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:19,750 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:19,751 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:51252': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:19,760 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:19,760 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:51266': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:19,858 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:19,858 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:51278': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:19,866 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:19,867 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:51288': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:19,965 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:19,965 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:51298': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:19,973 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:19,973 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:51314': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:20,071 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:20,072 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:51326': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:20,079 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:20,080 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:51340': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:20,178 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:20,178 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:51354': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:20,186 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:20,186 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:51370': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:20,285 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:20,285 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:51374': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:20,293 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:20,293 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:51388': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:20,393 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:20,393 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:51404': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:20,399 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:20,399 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:51406': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:20,501 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:20,501 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:51412': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:20,507 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:20,507 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:51420': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:20,607 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:20,607 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:51432': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:20,613 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:20,613 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:51438': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:20,714 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:20,714 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:51452': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:20,719 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:20,720 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:51462': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:20,820 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:20,820 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:51474': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:20,826 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:20,826 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:51480': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:20,927 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:20,927 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:51496': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:20,933 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:20,933 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:51504': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:21,033 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:21,034 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:51514': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:21,039 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:21,040 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:51524': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:21,140 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:21,141 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:51536': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:21,147 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:21,147 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:51544': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:21,247 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:21,247 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:51546': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:21,253 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:21,256 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:51554': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:21,354 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:21,354 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:51570': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:21,360 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:21,360 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:51580': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:21,461 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:21,461 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:51586': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:21,467 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:21,467 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:51598': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:21,567 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:21,567 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:42982': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:21,573 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:21,573 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:42988': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:21,674 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:21,675 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:43000': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:21,680 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:21,681 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:43002': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:21,784 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:21,784 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:43010': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:21,790 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:21,790 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:43020': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:21,891 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:21,891 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:43024': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:21,897 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:21,897 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:43038': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:21,998 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:21,998 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:43046': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:22,004 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:22,004 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:43062': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:22,104 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:22,104 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:43074': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:22,110 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:22,110 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:43084': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:22,213 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:22,213 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:43092': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:22,219 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:22,219 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:43094': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:22,320 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:22,321 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:43102': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:22,326 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:22,326 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:43116': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:22,427 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:22,428 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:43122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:22,433 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:22,434 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:43134': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:22,534 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:22,534 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:43146': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:22,540 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:22,540 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:43160': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:22,642 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:22,643 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:43166': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:22,648 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:22,648 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:43176': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:22,750 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:22,751 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:43190': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:22,761 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:22,761 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:43194': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:22,858 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:22,859 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:43196': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:22,868 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:22,868 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:43198': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:22,965 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:22,965 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:43206': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:22,975 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:22,975 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:43208': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:23,072 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:23,072 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:43210': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:23,082 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:23,082 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:43224': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:23,179 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:23,179 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:43238': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:23,188 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:23,189 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:43248': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:23,285 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:23,285 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:43252': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:23,295 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:23,296 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:43258': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:23,393 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:23,393 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:43262': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:23,402 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:23,402 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:43278': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:23,500 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:23,501 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:43294': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:23,508 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:23,508 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:43296': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:23,607 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:23,607 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:43308': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:23,614 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:23,615 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:43312': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:23,714 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:23,714 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:43314': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:23,721 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:23,722 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:43330': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:23,823 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:23,823 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:43342': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:23,829 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:23,829 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:43356': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:23,930 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:23,931 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:43370': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:23,937 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:23,937 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:43380': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:24,038 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:24,039 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:43382': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:24,044 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:24,044 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:43394': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:24,145 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:24,145 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:43396': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:24,151 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:24,151 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:43402': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:24,252 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:24,256 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:43404': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:24,262 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:24,262 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:43412': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:24,358 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:24,359 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:43420': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:24,369 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:24,369 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:43424': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:24,466 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:24,467 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:43438': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:24,476 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:24,476 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:43440': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:24,574 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:24,574 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:43444': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:24,582 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:24,583 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:43450': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:24,681 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:24,681 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:43462': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:24,689 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:24,690 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:43472': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:24,788 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41179 4768s 2024-11-23 21:50:24,789 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:43474': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:24,790 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35317. Reason: failure-to-start- 4768s 2024-11-23 21:50:24,790 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:50:24,797 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34251. Reason: failure-to-start- 4768s 2024-11-23 21:50:24,797 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:50:24,800 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 13s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 4768s stream = await stream.start_tls( 4768s ^^^^^^^^^^^^^^^^^^^^^^^ 4768s False, ssl_options=ssl_options, server_hostname=host 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 4768s self.socket.do_handshake() 4768s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 4768s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 4768s self._sslobj.do_handshake() 4768s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 4768s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 4768s raise FatalCommClosedError( 4768s ...<2 lines>... 4768s ) from err 4768s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 4768s 4768s During handling of the above exception, another exception occurred: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1218, in _register_with_scheduler 4768s await asyncio.sleep(0.1) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 718, in sleep 4768s return await future 4768s ^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 13s. 4768s 2024-11-23 21:50:24,804 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41179': TLS handshake failed with remote 'tls://127.0.0.1:43484': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 4768s 2024-11-23 21:50:25,806 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:50:25,813 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36027 4768s 2024-11-23 21:50:25,813 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45233/status 4768s 2024-11-23 21:50:25,814 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:50:25,827 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38725 4768s 2024-11-23 21:50:25,827 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38725 4768s 2024-11-23 21:50:25,827 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:50:25,827 - distributed.worker - INFO - dashboard at: 127.0.0.1:41151 4768s 2024-11-23 21:50:25,827 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36027 4768s 2024-11-23 21:50:25,827 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:50:25,827 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:50:25,827 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:50:25,827 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ygmfl29d 4768s 2024-11-23 21:50:25,827 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:50:25,829 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43049 4768s 2024-11-23 21:50:25,829 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43049 4768s 2024-11-23 21:50:25,829 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:50:25,829 - distributed.worker - INFO - dashboard at: 127.0.0.1:43635 4768s 2024-11-23 21:50:25,829 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36027 4768s 2024-11-23 21:50:25,829 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:50:25,829 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:50:25,829 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:50:25,829 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-96l9eylv 4768s 2024-11-23 21:50:25,829 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:50:25,830 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38725. Reason: failure-to-start- 4768s 2024-11-23 21:50:25,830 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:50:25,830 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43049. Reason: failure-to-start- 4768s 2024-11-23 21:50:25,830 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:50:25,831 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36027': TLS handshake failed with remote 'tls://127.0.0.1:42030': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:50:25,831 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36027': TLS handshake failed with remote 'tls://127.0.0.1:42036': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:50:25,833 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:50:26,839 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:50:26,846 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37017 4768s 2024-11-23 21:50:26,847 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41071/status 4768s 2024-11-23 21:50:26,847 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:50:26,861 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45149 4768s 2024-11-23 21:50:26,861 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45149 4768s 2024-11-23 21:50:26,861 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:50:26,861 - distributed.worker - INFO - dashboard at: 127.0.0.1:34249 4768s 2024-11-23 21:50:26,861 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37017 4768s 2024-11-23 21:50:26,861 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:50:26,861 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:50:26,861 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:50:26,861 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-4twp4oou 4768s 2024-11-23 21:50:26,861 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:50:26,863 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34695 4768s 2024-11-23 21:50:26,863 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34695 4768s 2024-11-23 21:50:26,863 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:50:26,863 - distributed.worker - INFO - dashboard at: 127.0.0.1:36577 4768s 2024-11-23 21:50:26,863 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37017 4768s 2024-11-23 21:50:26,863 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:50:26,863 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:50:26,863 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:50:26,863 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-t1uoidk6 4768s 2024-11-23 21:50:26,863 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:50:26,864 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45149. Reason: failure-to-start- 4768s 2024-11-23 21:50:26,864 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:50:26,865 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34695. Reason: failure-to-start- 4768s 2024-11-23 21:50:26,865 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:50:26,866 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37017': TLS handshake failed with remote 'tls://127.0.0.1:38682': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:50:26,866 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37017': TLS handshake failed with remote 'tls://127.0.0.1:38698': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:50:26,867 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:50:27,873 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:50:27,882 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33575 4768s 2024-11-23 21:50:27,882 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44731/status 4768s 2024-11-23 21:50:27,882 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:50:27,896 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44429 4768s 2024-11-23 21:50:27,897 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44429 4768s 2024-11-23 21:50:27,897 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:50:27,897 - distributed.worker - INFO - dashboard at: 127.0.0.1:36863 4768s 2024-11-23 21:50:27,897 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33575 4768s 2024-11-23 21:50:27,897 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:50:27,897 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:50:27,897 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:50:27,897 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-iw8riryo 4768s 2024-11-23 21:50:27,897 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:50:27,899 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37353 4768s 2024-11-23 21:50:27,899 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37353 4768s 2024-11-23 21:50:27,899 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:50:27,899 - distributed.worker - INFO - dashboard at: 127.0.0.1:40765 4768s 2024-11-23 21:50:27,899 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33575 4768s 2024-11-23 21:50:27,899 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:50:27,899 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:50:27,899 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:50:27,899 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-uxobml58 4768s 2024-11-23 21:50:27,899 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:50:27,900 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44429. Reason: failure-to-start- 4768s 2024-11-23 21:50:27,900 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:50:27,900 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37353. Reason: failure-to-start- 4768s 2024-11-23 21:50:27,900 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:50:27,901 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33575': TLS handshake failed with remote 'tls://127.0.0.1:53050': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:50:27,901 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33575': TLS handshake failed with remote 'tls://127.0.0.1:53056': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:50:27,903 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:50:28,908 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:50:28,915 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34217 4768s 2024-11-23 21:50:28,915 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41003/status 4768s 2024-11-23 21:50:28,916 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:50:28,930 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42053 4768s 2024-11-23 21:50:28,930 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42053 4768s 2024-11-23 21:50:28,930 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:50:28,930 - distributed.worker - INFO - dashboard at: 127.0.0.1:37313 4768s 2024-11-23 21:50:28,930 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34217 4768s 2024-11-23 21:50:28,930 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:50:28,930 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:50:28,930 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:50:28,930 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-uszyg8yr 4768s 2024-11-23 21:50:28,930 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:50:28,932 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39987 4768s 2024-11-23 21:50:28,932 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39987 4768s 2024-11-23 21:50:28,932 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:50:28,932 - distributed.worker - INFO - dashboard at: 127.0.0.1:42695 4768s 2024-11-23 21:50:28,932 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34217 4768s 2024-11-23 21:50:28,932 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:50:28,932 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:50:28,932 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:50:28,932 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-co0ykq22 4768s 2024-11-23 21:50:28,932 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:50:28,933 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42053. Reason: failure-to-start- 4768s 2024-11-23 21:50:28,933 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:50:28,934 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39987. Reason: failure-to-start- 4768s 2024-11-23 21:50:28,934 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:50:28,935 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34217': TLS handshake failed with remote 'tls://127.0.0.1:58644': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:50:28,935 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34217': TLS handshake failed with remote 'tls://127.0.0.1:58658': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:50:28,936 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:50:29,941 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:50:29,950 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35645 4768s 2024-11-23 21:50:29,951 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45121/status 4768s 2024-11-23 21:50:29,951 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:50:29,965 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44937 4768s 2024-11-23 21:50:29,965 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44937 4768s 2024-11-23 21:50:29,965 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:50:29,965 - distributed.worker - INFO - dashboard at: 127.0.0.1:40409 4768s 2024-11-23 21:50:29,965 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35645 4768s 2024-11-23 21:50:29,965 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:50:29,965 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:50:29,965 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:50:29,965 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-c730e49n 4768s 2024-11-23 21:50:29,965 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:50:29,967 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36531 4768s 2024-11-23 21:50:29,967 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36531 4768s 2024-11-23 21:50:29,967 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:50:29,967 - distributed.worker - INFO - dashboard at: 127.0.0.1:34975 4768s 2024-11-23 21:50:29,967 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35645 4768s 2024-11-23 21:50:29,967 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:50:29,967 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:50:29,967 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:50:29,967 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-bf8fthbf 4768s 2024-11-23 21:50:29,967 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:50:29,968 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44937. Reason: failure-to-start- 4768s 2024-11-23 21:50:29,968 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:50:29,968 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36531. Reason: failure-to-start- 4768s 2024-11-23 21:50:29,968 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:50:29,970 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35645': TLS handshake failed with remote 'tls://127.0.0.1:54750': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:50:29,970 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35645': TLS handshake failed with remote 'tls://127.0.0.1:54764': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:50:29,971 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:50:30,980 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:50:30,989 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41141 4768s 2024-11-23 21:50:30,989 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44901/status 4768s 2024-11-23 21:50:30,990 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:50:31,003 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45779 4768s 2024-11-23 21:50:31,003 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45779 4768s 2024-11-23 21:50:31,003 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:50:31,003 - distributed.worker - INFO - dashboard at: 127.0.0.1:38257 4768s 2024-11-23 21:50:31,003 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41141 4768s 2024-11-23 21:50:31,003 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:50:31,003 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:50:31,004 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:50:31,004 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-65kv2w0x 4768s 2024-11-23 21:50:31,004 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:50:31,005 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46569 4768s 2024-11-23 21:50:31,005 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46569 4768s 2024-11-23 21:50:31,005 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:50:31,005 - distributed.worker - INFO - dashboard at: 127.0.0.1:38445 4768s 2024-11-23 21:50:31,005 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41141 4768s 2024-11-23 21:50:31,006 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:50:31,006 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:50:31,006 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:50:31,006 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-s2aw0t4r 4768s 2024-11-23 21:50:31,006 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:50:31,007 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45779. Reason: failure-to-start- 4768s 2024-11-23 21:50:31,007 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:50:31,007 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46569. Reason: failure-to-start- 4768s 2024-11-23 21:50:31,007 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:50:31,008 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41141': TLS handshake failed with remote 'tls://127.0.0.1:58656': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:50:31,009 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41141': TLS handshake failed with remote 'tls://127.0.0.1:58660': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:50:31,010 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:50:32,015 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:50:32,021 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39259 4768s 2024-11-23 21:50:32,022 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40959/status 4768s 2024-11-23 21:50:32,022 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:50:32,035 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33503 4768s 2024-11-23 21:50:32,035 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33503 4768s 2024-11-23 21:50:32,035 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:50:32,035 - distributed.worker - INFO - dashboard at: 127.0.0.1:36669 4768s 2024-11-23 21:50:32,036 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39259 4768s 2024-11-23 21:50:32,036 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:50:32,036 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:50:32,036 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:50:32,036 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ifktf8fc 4768s 2024-11-23 21:50:32,036 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:50:32,037 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45843 4768s 2024-11-23 21:50:32,037 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45843 4768s 2024-11-23 21:50:32,037 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:50:32,037 - distributed.worker - INFO - dashboard at: 127.0.0.1:37491 4768s 2024-11-23 21:50:32,037 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39259 4768s 2024-11-23 21:50:32,038 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:50:32,038 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:50:32,038 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:50:32,038 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-p1lwsrej 4768s 2024-11-23 21:50:32,038 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:50:32,038 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33503. Reason: failure-to-start- 4768s 2024-11-23 21:50:32,039 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:50:32,039 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45843. Reason: failure-to-start- 4768s 2024-11-23 21:50:32,039 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:50:32,040 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39259': TLS handshake failed with remote 'tls://127.0.0.1:39454': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:50:32,040 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39259': TLS handshake failed with remote 'tls://127.0.0.1:39458': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:50:32,041 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:50:33,047 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:50:33,053 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36295 4768s 2024-11-23 21:50:33,054 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35855/status 4768s 2024-11-23 21:50:33,054 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:50:33,067 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43803 4768s 2024-11-23 21:50:33,067 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43803 4768s 2024-11-23 21:50:33,067 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:50:33,067 - distributed.worker - INFO - dashboard at: 127.0.0.1:33089 4768s 2024-11-23 21:50:33,067 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36295 4768s 2024-11-23 21:50:33,067 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:50:33,067 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:50:33,067 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:50:33,067 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-tyvv7_25 4768s 2024-11-23 21:50:33,067 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:50:33,070 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34863 4768s 2024-11-23 21:50:33,070 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34863 4768s 2024-11-23 21:50:33,070 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:50:33,070 - distributed.worker - INFO - dashboard at: 127.0.0.1:40855 4768s 2024-11-23 21:50:33,070 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36295 4768s 2024-11-23 21:50:33,070 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:50:33,070 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:50:33,070 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:50:33,070 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-_hmwer_w 4768s 2024-11-23 21:50:33,070 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:50:33,071 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43803. Reason: failure-to-start- 4768s 2024-11-23 21:50:33,071 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:50:33,071 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34863. Reason: failure-to-start- 4768s 2024-11-23 21:50:33,071 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:50:33,072 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36295': TLS handshake failed with remote 'tls://127.0.0.1:51830': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:50:33,072 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36295': TLS handshake failed with remote 'tls://127.0.0.1:51832': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:50:33,074 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:50:34,078 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:50:34,084 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42911 4768s 2024-11-23 21:50:34,084 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46623/status 4768s 2024-11-23 21:50:34,084 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:50:34,096 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41133 4768s 2024-11-23 21:50:34,096 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41133 4768s 2024-11-23 21:50:34,096 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:50:34,096 - distributed.worker - INFO - dashboard at: 127.0.0.1:39941 4768s 2024-11-23 21:50:34,096 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42911 4768s 2024-11-23 21:50:34,096 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:50:34,096 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:50:34,096 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:50:34,096 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-8ja80wy9 4768s 2024-11-23 21:50:34,096 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:50:34,097 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37389 4768s 2024-11-23 21:50:34,097 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37389 4768s 2024-11-23 21:50:34,098 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:50:34,098 - distributed.worker - INFO - dashboard at: 127.0.0.1:38815 4768s 2024-11-23 21:50:34,098 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42911 4768s 2024-11-23 21:50:34,098 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:50:34,098 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:50:34,098 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:50:34,098 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-8geyq3hn 4768s 2024-11-23 21:50:34,098 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:50:34,099 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41133. Reason: failure-to-start- 4768s 2024-11-23 21:50:34,099 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:50:34,099 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37389. Reason: failure-to-start- 4768s 2024-11-23 21:50:34,099 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:50:34,100 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42911': TLS handshake failed with remote 'tls://127.0.0.1:55992': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:50:34,100 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42911': TLS handshake failed with remote 'tls://127.0.0.1:55994': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:50:34,101 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:50:35,106 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:50:35,114 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36829 4768s 2024-11-23 21:50:35,114 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42005/status 4768s 2024-11-23 21:50:35,115 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:50:35,127 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37809 4768s 2024-11-23 21:50:35,127 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37809 4768s 2024-11-23 21:50:35,127 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:50:35,127 - distributed.worker - INFO - dashboard at: 127.0.0.1:43483 4768s 2024-11-23 21:50:35,127 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36829 4768s 2024-11-23 21:50:35,127 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:50:35,127 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:50:35,127 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:50:35,127 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-wvh0iqdv 4768s 2024-11-23 21:50:35,127 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:50:35,129 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35917 4768s 2024-11-23 21:50:35,129 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35917 4768s 2024-11-23 21:50:35,129 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:50:35,129 - distributed.worker - INFO - dashboard at: 127.0.0.1:37569 4768s 2024-11-23 21:50:35,129 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36829 4768s 2024-11-23 21:50:35,129 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:50:35,129 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:50:35,129 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:50:35,129 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-6pjc4r_b 4768s 2024-11-23 21:50:35,129 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:50:35,130 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37809. Reason: failure-to-start- 4768s 2024-11-23 21:50:35,130 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:50:35,130 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35917. Reason: failure-to-start- 4768s 2024-11-23 21:50:35,130 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:50:35,131 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36829': TLS handshake failed with remote 'tls://127.0.0.1:59526': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:50:35,132 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36829': TLS handshake failed with remote 'tls://127.0.0.1:59534': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:50:35,133 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:50:36,138 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:50:36,144 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40837 4768s 2024-11-23 21:50:36,144 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43561/status 4768s 2024-11-23 21:50:36,144 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:50:36,157 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35381 4768s 2024-11-23 21:50:36,157 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35381 4768s 2024-11-23 21:50:36,157 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:50:36,157 - distributed.worker - INFO - dashboard at: 127.0.0.1:40349 4768s 2024-11-23 21:50:36,157 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40837 4768s 2024-11-23 21:50:36,157 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:50:36,157 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:50:36,157 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:50:36,157 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-gn1_uos5 4768s 2024-11-23 21:50:36,157 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:50:36,159 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33591 4768s 2024-11-23 21:50:36,159 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33591 4768s 2024-11-23 21:50:36,159 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:50:36,159 - distributed.worker - INFO - dashboard at: 127.0.0.1:43663 4768s 2024-11-23 21:50:36,159 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40837 4768s 2024-11-23 21:50:36,159 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:50:36,159 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:50:36,159 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:50:36,159 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-f89j5ld9 4768s 2024-11-23 21:50:36,159 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:50:36,160 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35381. Reason: failure-to-start- 4768s 2024-11-23 21:50:36,160 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:50:36,161 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33591. Reason: failure-to-start- 4768s 2024-11-23 21:50:36,161 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:50:36,162 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40837': TLS handshake failed with remote 'tls://127.0.0.1:33854': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:50:36,162 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40837': TLS handshake failed with remote 'tls://127.0.0.1:33868': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:50:36,163 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:50:37,168 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:50:37,174 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38579 4768s 2024-11-23 21:50:37,174 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33437/status 4768s 2024-11-23 21:50:37,175 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:50:37,186 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33287 4768s 2024-11-23 21:50:37,186 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33287 4768s 2024-11-23 21:50:37,186 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:50:37,186 - distributed.worker - INFO - dashboard at: 127.0.0.1:40325 4768s 2024-11-23 21:50:37,186 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38579 4768s 2024-11-23 21:50:37,186 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:50:37,186 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:50:37,186 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:50:37,186 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-cuscb9ea 4768s 2024-11-23 21:50:37,187 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:50:37,189 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35651 4768s 2024-11-23 21:50:37,189 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35651 4768s 2024-11-23 21:50:37,189 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:50:37,189 - distributed.worker - INFO - dashboard at: 127.0.0.1:41911 4768s 2024-11-23 21:50:37,189 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38579 4768s 2024-11-23 21:50:37,189 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:50:37,189 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:50:37,189 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:50:37,189 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-wz0v1ime 4768s 2024-11-23 21:50:37,189 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:50:37,190 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33287. Reason: failure-to-start- 4768s 2024-11-23 21:50:37,190 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:50:37,190 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35651. Reason: failure-to-start- 4768s 2024-11-23 21:50:37,191 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:50:37,192 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38579': TLS handshake failed with remote 'tls://127.0.0.1:47658': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:50:37,192 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38579': TLS handshake failed with remote 'tls://127.0.0.1:47674': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:50:37,193 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:50:38,198 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:50:38,204 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46021 4768s 2024-11-23 21:50:38,204 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39715/status 4768s 2024-11-23 21:50:38,204 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:50:38,215 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39459 4768s 2024-11-23 21:50:38,216 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39459 4768s 2024-11-23 21:50:38,216 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:50:38,216 - distributed.worker - INFO - dashboard at: 127.0.0.1:36397 4768s 2024-11-23 21:50:38,216 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46021 4768s 2024-11-23 21:50:38,216 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:50:38,216 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:50:38,216 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:50:38,216 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-zbugzssz 4768s 2024-11-23 21:50:38,216 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:50:38,217 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35873 4768s 2024-11-23 21:50:38,217 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35873 4768s 2024-11-23 21:50:38,217 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:50:38,217 - distributed.worker - INFO - dashboard at: 127.0.0.1:40829 4768s 2024-11-23 21:50:38,217 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46021 4768s 2024-11-23 21:50:38,218 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:50:38,218 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:50:38,218 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:50:38,218 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-812_8m0i 4768s 2024-11-23 21:50:38,218 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:50:38,218 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39459. Reason: failure-to-start- 4768s 2024-11-23 21:50:38,219 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:50:38,219 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35873. Reason: failure-to-start- 4768s 2024-11-23 21:50:38,219 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:50:38,220 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46021': TLS handshake failed with remote 'tls://127.0.0.1:35264': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:50:38,220 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46021': TLS handshake failed with remote 'tls://127.0.0.1:35276': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:50:38,221 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:50:39,227 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:50:39,233 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33213 4768s 2024-11-23 21:50:39,234 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46571/status 4768s 2024-11-23 21:50:39,234 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:50:39,245 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40995 4768s 2024-11-23 21:50:39,245 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40995 4768s 2024-11-23 21:50:39,245 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:50:39,245 - distributed.worker - INFO - dashboard at: 127.0.0.1:40219 4768s 2024-11-23 21:50:39,245 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33213 4768s 2024-11-23 21:50:39,246 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:50:39,246 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:50:39,246 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:50:39,246 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-lja0qsml 4768s 2024-11-23 21:50:39,246 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:50:39,247 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37071 4768s 2024-11-23 21:50:39,247 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37071 4768s 2024-11-23 21:50:39,247 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:50:39,247 - distributed.worker - INFO - dashboard at: 127.0.0.1:38523 4768s 2024-11-23 21:50:39,248 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33213 4768s 2024-11-23 21:50:39,248 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:50:39,248 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:50:39,248 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:50:39,248 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-0f5mxjkf 4768s 2024-11-23 21:50:39,248 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:50:39,249 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40995. Reason: failure-to-start- 4768s 2024-11-23 21:50:39,249 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:50:39,249 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37071. Reason: failure-to-start- 4768s 2024-11-23 21:50:39,249 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:50:39,250 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33213': TLS handshake failed with remote 'tls://127.0.0.1:37346': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:50:39,251 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33213': TLS handshake failed with remote 'tls://127.0.0.1:37352': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:50:39,253 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:50:40,258 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:50:40,264 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45875 4768s 2024-11-23 21:50:40,264 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44479/status 4768s 2024-11-23 21:50:40,264 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:50:40,278 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36091 4768s 2024-11-23 21:50:40,278 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36091 4768s 2024-11-23 21:50:40,278 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:50:40,278 - distributed.worker - INFO - dashboard at: 127.0.0.1:38465 4768s 2024-11-23 21:50:40,278 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45875 4768s 2024-11-23 21:50:40,278 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:50:40,278 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:50:40,278 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:50:40,278 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-bzks6jgr 4768s 2024-11-23 21:50:40,278 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:50:40,280 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40523 4768s 2024-11-23 21:50:40,280 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40523 4768s 2024-11-23 21:50:40,280 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:50:40,280 - distributed.worker - INFO - dashboard at: 127.0.0.1:37845 4768s 2024-11-23 21:50:40,280 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45875 4768s 2024-11-23 21:50:40,280 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:50:40,280 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:50:40,280 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:50:40,280 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-y3z1hyq0 4768s 2024-11-23 21:50:40,280 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:50:40,283 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36091. Reason: failure-to-start- 4768s 2024-11-23 21:50:40,283 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:50:40,284 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40523. Reason: failure-to-start- 4768s 2024-11-23 21:50:40,284 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:50:40,285 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45875': TLS handshake failed with remote 'tls://127.0.0.1:58338': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:50:40,285 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45875': TLS handshake failed with remote 'tls://127.0.0.1:58340': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:50:40,286 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:50:41,291 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:50:41,297 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34307 4768s 2024-11-23 21:50:41,297 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40397/status 4768s 2024-11-23 21:50:41,297 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:50:41,309 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46007 4768s 2024-11-23 21:50:41,309 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46007 4768s 2024-11-23 21:50:41,309 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:50:41,310 - distributed.worker - INFO - dashboard at: 127.0.0.1:42967 4768s 2024-11-23 21:50:41,310 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34307 4768s 2024-11-23 21:50:41,310 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:50:41,310 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:50:41,310 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:50:41,310 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-jtq2q_ly 4768s 2024-11-23 21:50:41,310 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:50:41,312 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38467 4768s 2024-11-23 21:50:41,312 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38467 4768s 2024-11-23 21:50:41,312 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:50:41,312 - distributed.worker - INFO - dashboard at: 127.0.0.1:40977 4768s 2024-11-23 21:50:41,312 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34307 4768s 2024-11-23 21:50:41,312 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:50:41,313 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:50:41,313 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:50:41,313 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-tch6j6p6 4768s 2024-11-23 21:50:41,313 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:50:41,313 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46007. Reason: failure-to-start- 4768s 2024-11-23 21:50:41,314 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:50:41,314 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38467. Reason: failure-to-start- 4768s 2024-11-23 21:50:41,314 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:50:41,315 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34307': TLS handshake failed with remote 'tls://127.0.0.1:58462': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:50:41,315 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34307': TLS handshake failed with remote 'tls://127.0.0.1:58476': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:50:41,318 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:50:42,323 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:50:42,329 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45535 4768s 2024-11-23 21:50:42,329 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33949/status 4768s 2024-11-23 21:50:42,329 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:50:42,341 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34995 4768s 2024-11-23 21:50:42,341 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34995 4768s 2024-11-23 21:50:42,341 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:50:42,341 - distributed.worker - INFO - dashboard at: 127.0.0.1:46789 4768s 2024-11-23 21:50:42,341 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45535 4768s 2024-11-23 21:50:42,341 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:50:42,341 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:50:42,341 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:50:42,341 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-p_3kldej 4768s 2024-11-23 21:50:42,341 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:50:42,343 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45877 4768s 2024-11-23 21:50:42,343 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45877 4768s 2024-11-23 21:50:42,343 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:50:42,343 - distributed.worker - INFO - dashboard at: 127.0.0.1:39937 4768s 2024-11-23 21:50:42,343 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45535 4768s 2024-11-23 21:50:42,343 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:50:42,343 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:50:42,343 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:50:42,343 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-lcxf3umr 4768s 2024-11-23 21:50:42,343 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:50:42,344 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34995. Reason: failure-to-start- 4768s 2024-11-23 21:50:42,344 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:50:42,345 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45877. Reason: failure-to-start- 4768s 2024-11-23 21:50:42,345 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:50:42,346 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45535': TLS handshake failed with remote 'tls://127.0.0.1:51038': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:50:42,346 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45535': TLS handshake failed with remote 'tls://127.0.0.1:51052': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:50:42,347 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:50:43,353 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:50:43,359 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42283 4768s 2024-11-23 21:50:43,360 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34057/status 4768s 2024-11-23 21:50:43,360 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:50:43,372 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33241 4768s 2024-11-23 21:50:43,372 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33241 4768s 2024-11-23 21:50:43,372 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:50:43,372 - distributed.worker - INFO - dashboard at: 127.0.0.1:44659 4768s 2024-11-23 21:50:43,372 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42283 4768s 2024-11-23 21:50:43,372 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:50:43,372 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:50:43,372 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:50:43,372 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-aec3s20s 4768s 2024-11-23 21:50:43,372 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:50:43,374 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36285 4768s 2024-11-23 21:50:43,374 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36285 4768s 2024-11-23 21:50:43,374 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:50:43,374 - distributed.worker - INFO - dashboard at: 127.0.0.1:33679 4768s 2024-11-23 21:50:43,374 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42283 4768s 2024-11-23 21:50:43,374 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:50:43,374 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:50:43,374 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:50:43,374 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-rx_dguu0 4768s 2024-11-23 21:50:43,374 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:50:43,375 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33241. Reason: failure-to-start- 4768s 2024-11-23 21:50:43,375 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:50:43,375 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36285. Reason: failure-to-start- 4768s 2024-11-23 21:50:43,376 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:50:43,377 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42283': TLS handshake failed with remote 'tls://127.0.0.1:40088': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:50:43,377 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42283': TLS handshake failed with remote 'tls://127.0.0.1:40092': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:50:43,378 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:50:44,383 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:50:44,389 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33717 4768s 2024-11-23 21:50:44,390 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33711/status 4768s 2024-11-23 21:50:44,390 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:50:44,405 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38191 4768s 2024-11-23 21:50:44,405 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38191 4768s 2024-11-23 21:50:44,405 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:50:44,405 - distributed.worker - INFO - dashboard at: 127.0.0.1:41509 4768s 2024-11-23 21:50:44,406 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33717 4768s 2024-11-23 21:50:44,406 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:50:44,406 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:50:44,406 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:50:44,406 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-x48ey143 4768s 2024-11-23 21:50:44,406 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:50:44,407 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42725 4768s 2024-11-23 21:50:44,407 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42725 4768s 2024-11-23 21:50:44,407 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:50:44,408 - distributed.worker - INFO - dashboard at: 127.0.0.1:40875 4768s 2024-11-23 21:50:44,408 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33717 4768s 2024-11-23 21:50:44,408 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:50:44,408 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:50:44,408 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:50:44,408 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-34sk0azl 4768s 2024-11-23 21:50:44,408 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:50:44,409 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38191. Reason: failure-to-start- 4768s 2024-11-23 21:50:44,409 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:50:44,409 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42725. Reason: failure-to-start- 4768s 2024-11-23 21:50:44,409 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:50:44,410 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33717': TLS handshake failed with remote 'tls://127.0.0.1:49072': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:50:44,411 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33717': TLS handshake failed with remote 'tls://127.0.0.1:49086': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:50:44,412 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:50:45,417 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:50:45,423 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42447 4768s 2024-11-23 21:50:45,424 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33105/status 4768s 2024-11-23 21:50:45,424 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:50:45,439 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40433 4768s 2024-11-23 21:50:45,439 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40433 4768s 2024-11-23 21:50:45,439 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:50:45,439 - distributed.worker - INFO - dashboard at: 127.0.0.1:45289 4768s 2024-11-23 21:50:45,439 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42447 4768s 2024-11-23 21:50:45,439 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:50:45,439 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:50:45,439 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:50:45,439 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-vmtca7s_ 4768s 2024-11-23 21:50:45,439 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:50:45,441 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40037 4768s 2024-11-23 21:50:45,441 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40037 4768s 2024-11-23 21:50:45,441 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:50:45,441 - distributed.worker - INFO - dashboard at: 127.0.0.1:46169 4768s 2024-11-23 21:50:45,441 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42447 4768s 2024-11-23 21:50:45,441 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:50:45,441 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:50:45,441 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:50:45,441 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-easquqw6 4768s 2024-11-23 21:50:45,441 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:50:45,442 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40433. Reason: failure-to-start- 4768s 2024-11-23 21:50:45,442 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:50:45,443 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40037. Reason: failure-to-start- 4768s 2024-11-23 21:50:45,443 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:50:45,444 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42447': TLS handshake failed with remote 'tls://127.0.0.1:53404': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:50:45,444 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42447': TLS handshake failed with remote 'tls://127.0.0.1:53418': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:50:45,445 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:50:46,451 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:50:46,457 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42723 4768s 2024-11-23 21:50:46,458 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42265/status 4768s 2024-11-23 21:50:46,458 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:50:46,473 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41015 4768s 2024-11-23 21:50:46,473 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41015 4768s 2024-11-23 21:50:46,473 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:50:46,473 - distributed.worker - INFO - dashboard at: 127.0.0.1:34541 4768s 2024-11-23 21:50:46,473 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42723 4768s 2024-11-23 21:50:46,473 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:50:46,473 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:50:46,473 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:50:46,473 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-azyd24y8 4768s 2024-11-23 21:50:46,473 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:50:46,475 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35583 4768s 2024-11-23 21:50:46,475 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35583 4768s 2024-11-23 21:50:46,475 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:50:46,475 - distributed.worker - INFO - dashboard at: 127.0.0.1:38081 4768s 2024-11-23 21:50:46,475 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42723 4768s 2024-11-23 21:50:46,476 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:50:46,476 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:50:46,476 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:50:46,476 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ffviw99r 4768s 2024-11-23 21:50:46,476 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:50:46,477 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41015. Reason: failure-to-start- 4768s 2024-11-23 21:50:46,477 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:50:46,486 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35583. Reason: failure-to-start- 4768s 2024-11-23 21:50:46,486 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:50:46,488 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42723': TLS handshake failed with remote 'tls://127.0.0.1:36014': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:50:46,488 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42723': TLS handshake failed with remote 'tls://127.0.0.1:36024': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:50:46,489 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:50:47,494 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:50:47,500 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40385 4768s 2024-11-23 21:50:47,501 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36371/status 4768s 2024-11-23 21:50:47,501 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:50:47,513 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37559 4768s 2024-11-23 21:50:47,513 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37559 4768s 2024-11-23 21:50:47,513 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:50:47,514 - distributed.worker - INFO - dashboard at: 127.0.0.1:41733 4768s 2024-11-23 21:50:47,514 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40385 4768s 2024-11-23 21:50:47,514 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:50:47,514 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:50:47,514 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:50:47,514 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-t8yrs_69 4768s 2024-11-23 21:50:47,514 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:50:47,515 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36083 4768s 2024-11-23 21:50:47,515 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36083 4768s 2024-11-23 21:50:47,515 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:50:47,516 - distributed.worker - INFO - dashboard at: 127.0.0.1:44953 4768s 2024-11-23 21:50:47,516 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40385 4768s 2024-11-23 21:50:47,516 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:50:47,516 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:50:47,516 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:50:47,516 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-56f2efc9 4768s 2024-11-23 21:50:47,516 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:50:47,517 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37559. Reason: failure-to-start- 4768s 2024-11-23 21:50:47,517 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:50:47,517 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36083. Reason: failure-to-start- 4768s 2024-11-23 21:50:47,517 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:50:47,518 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40385': TLS handshake failed with remote 'tls://127.0.0.1:54594': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:50:47,518 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40385': TLS handshake failed with remote 'tls://127.0.0.1:54604': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:50:47,520 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:50:48,524 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:50:48,531 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42933 4768s 2024-11-23 21:50:48,531 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36107/status 4768s 2024-11-23 21:50:48,531 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:50:48,547 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45239 4768s 2024-11-23 21:50:48,547 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45239 4768s 2024-11-23 21:50:48,547 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:50:48,547 - distributed.worker - INFO - dashboard at: 127.0.0.1:33197 4768s 2024-11-23 21:50:48,547 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42933 4768s 2024-11-23 21:50:48,547 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:50:48,547 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:50:48,548 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:50:48,548 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-4hg4ahx_ 4768s 2024-11-23 21:50:48,548 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:50:48,549 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41029 4768s 2024-11-23 21:50:48,549 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41029 4768s 2024-11-23 21:50:48,549 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:50:48,549 - distributed.worker - INFO - dashboard at: 127.0.0.1:35869 4768s 2024-11-23 21:50:48,549 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42933 4768s 2024-11-23 21:50:48,549 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:50:48,549 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:50:48,549 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:50:48,550 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ym3syamq 4768s 2024-11-23 21:50:48,550 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:50:48,550 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45239. Reason: failure-to-start- 4768s 2024-11-23 21:50:48,550 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:50:48,551 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41029. Reason: failure-to-start- 4768s 2024-11-23 21:50:48,551 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:50:48,552 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42933': TLS handshake failed with remote 'tls://127.0.0.1:40836': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:50:48,552 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42933': TLS handshake failed with remote 'tls://127.0.0.1:40852': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:50:48,554 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:50:49,559 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:50:49,566 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:32789 4768s 2024-11-23 21:50:49,567 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38171/status 4768s 2024-11-23 21:50:49,567 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:50:49,582 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38849 4768s 2024-11-23 21:50:49,582 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38849 4768s 2024-11-23 21:50:49,582 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:50:49,582 - distributed.worker - INFO - dashboard at: 127.0.0.1:46415 4768s 2024-11-23 21:50:49,582 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:32789 4768s 2024-11-23 21:50:49,582 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:50:49,582 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:50:49,582 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:50:49,582 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-r0eu71f6 4768s 2024-11-23 21:50:49,582 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:50:49,584 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38935 4768s 2024-11-23 21:50:49,584 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38935 4768s 2024-11-23 21:50:49,584 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:50:49,584 - distributed.worker - INFO - dashboard at: 127.0.0.1:41967 4768s 2024-11-23 21:50:49,584 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:32789 4768s 2024-11-23 21:50:49,584 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:50:49,584 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:50:49,584 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:50:49,584 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-t6vayf5q 4768s 2024-11-23 21:50:49,585 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:50:49,586 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38849. Reason: failure-to-start- 4768s 2024-11-23 21:50:49,586 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:50:49,586 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38935. Reason: failure-to-start- 4768s 2024-11-23 21:50:49,586 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:50:49,589 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:32789': TLS handshake failed with remote 'tls://127.0.0.1:50230': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:50:49,589 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:32789': TLS handshake failed with remote 'tls://127.0.0.1:50234': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:50:49,591 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:50:50,595 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:50:50,602 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35775 4768s 2024-11-23 21:50:50,602 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33713/status 4768s 2024-11-23 21:50:50,602 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:50:50,616 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41851 4768s 2024-11-23 21:50:50,616 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41851 4768s 2024-11-23 21:50:50,616 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:50:50,616 - distributed.worker - INFO - dashboard at: 127.0.0.1:40937 4768s 2024-11-23 21:50:50,616 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35775 4768s 2024-11-23 21:50:50,616 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:50:50,616 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:50:50,616 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:50:50,616 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-kt07i9r4 4768s 2024-11-23 21:50:50,616 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:50:50,618 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35495 4768s 2024-11-23 21:50:50,618 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35495 4768s 2024-11-23 21:50:50,618 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:50:50,618 - distributed.worker - INFO - dashboard at: 127.0.0.1:36769 4768s 2024-11-23 21:50:50,618 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35775 4768s 2024-11-23 21:50:50,618 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:50:50,618 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:50:50,618 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:50:50,618 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-f3k3544e 4768s 2024-11-23 21:50:50,618 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:50:50,619 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41851. Reason: failure-to-start- 4768s 2024-11-23 21:50:50,619 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:50:50,620 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35495. Reason: failure-to-start- 4768s 2024-11-23 21:50:50,620 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:50:50,623 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35775': TLS handshake failed with remote 'tls://127.0.0.1:50308': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:50:50,623 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35775': TLS handshake failed with remote 'tls://127.0.0.1:50324': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:50:50,624 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:50:51,631 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:50:51,638 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33767 4768s 2024-11-23 21:50:51,638 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46695/status 4768s 2024-11-23 21:50:51,638 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:50:51,653 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33051 4768s 2024-11-23 21:50:51,653 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33051 4768s 2024-11-23 21:50:51,653 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:50:51,653 - distributed.worker - INFO - dashboard at: 127.0.0.1:33723 4768s 2024-11-23 21:50:51,653 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33767 4768s 2024-11-23 21:50:51,653 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:50:51,653 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:50:51,653 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:50:51,653 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-6q_hna3f 4768s 2024-11-23 21:50:51,653 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:50:51,655 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40559 4768s 2024-11-23 21:50:51,655 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40559 4768s 2024-11-23 21:50:51,655 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:50:51,655 - distributed.worker - INFO - dashboard at: 127.0.0.1:32877 4768s 2024-11-23 21:50:51,655 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33767 4768s 2024-11-23 21:50:51,655 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:50:51,655 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:50:51,655 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:50:51,655 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-zur4h0b9 4768s 2024-11-23 21:50:51,655 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:50:51,658 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33051. Reason: failure-to-start- 4768s 2024-11-23 21:50:51,659 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:50:51,659 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40559. Reason: failure-to-start- 4768s 2024-11-23 21:50:51,659 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:50:51,660 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33767': TLS handshake failed with remote 'tls://127.0.0.1:35672': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:50:51,660 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33767': TLS handshake failed with remote 'tls://127.0.0.1:35688': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:50:51,662 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:50:52,666 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:50:52,672 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43657 4768s 2024-11-23 21:50:52,673 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37881/status 4768s 2024-11-23 21:50:52,673 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:50:52,687 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33197 4768s 2024-11-23 21:50:52,687 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33197 4768s 2024-11-23 21:50:52,687 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:50:52,687 - distributed.worker - INFO - dashboard at: 127.0.0.1:45807 4768s 2024-11-23 21:50:52,687 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43657 4768s 2024-11-23 21:50:52,687 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:50:52,687 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:50:52,687 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:50:52,687 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ynhvfvo1 4768s 2024-11-23 21:50:52,687 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:50:52,689 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42561 4768s 2024-11-23 21:50:52,689 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42561 4768s 2024-11-23 21:50:52,689 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:50:52,689 - distributed.worker - INFO - dashboard at: 127.0.0.1:36057 4768s 2024-11-23 21:50:52,689 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43657 4768s 2024-11-23 21:50:52,689 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:50:52,689 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:50:52,689 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:50:52,689 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-5b519rlo 4768s 2024-11-23 21:50:52,689 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:50:52,692 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33197. Reason: failure-to-start- 4768s 2024-11-23 21:50:52,692 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:50:52,692 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42561. Reason: failure-to-start- 4768s 2024-11-23 21:50:52,692 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:50:52,693 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43657': TLS handshake failed with remote 'tls://127.0.0.1:47394': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:50:52,693 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43657': TLS handshake failed with remote 'tls://127.0.0.1:47398': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:50:52,694 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:50:53,700 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:50:53,706 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39217 4768s 2024-11-23 21:50:53,706 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43367/status 4768s 2024-11-23 21:50:53,707 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:50:53,721 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38849 4768s 2024-11-23 21:50:53,721 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38849 4768s 2024-11-23 21:50:53,721 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:50:53,721 - distributed.worker - INFO - dashboard at: 127.0.0.1:45673 4768s 2024-11-23 21:50:53,721 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39217 4768s 2024-11-23 21:50:53,721 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:50:53,721 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:50:53,721 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:50:53,721 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-fou1ba9y 4768s 2024-11-23 21:50:53,721 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:50:53,724 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42891 4768s 2024-11-23 21:50:53,724 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42891 4768s 2024-11-23 21:50:53,724 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:50:53,724 - distributed.worker - INFO - dashboard at: 127.0.0.1:33283 4768s 2024-11-23 21:50:53,724 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39217 4768s 2024-11-23 21:50:53,724 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:50:53,724 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:50:53,724 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:50:53,724 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-cvw8nvj7 4768s 2024-11-23 21:50:53,724 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:50:53,725 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38849. Reason: failure-to-start- 4768s 2024-11-23 21:50:53,725 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:50:53,726 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42891. Reason: failure-to-start- 4768s 2024-11-23 21:50:53,726 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:50:53,727 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39217': TLS handshake failed with remote 'tls://127.0.0.1:60478': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:50:53,727 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39217': TLS handshake failed with remote 'tls://127.0.0.1:60490': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:50:53,728 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s 2024-11-23 21:50:54,735 - distributed.scheduler - INFO - State start 4768s 2024-11-23 21:50:54,748 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43765 4768s 2024-11-23 21:50:54,749 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35025/status 4768s 2024-11-23 21:50:54,750 - distributed.scheduler - INFO - Registering Worker plugin shuffle 4768s 2024-11-23 21:50:54,784 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44887 4768s 2024-11-23 21:50:54,784 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44887 4768s 2024-11-23 21:50:54,784 - distributed.worker - INFO - Worker name: 0 4768s 2024-11-23 21:50:54,784 - distributed.worker - INFO - dashboard at: 127.0.0.1:37681 4768s 2024-11-23 21:50:54,784 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43765 4768s 2024-11-23 21:50:54,784 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:50:54,784 - distributed.worker - INFO - Threads: 1 4768s 2024-11-23 21:50:54,784 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:50:54,785 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-f4821bz1 4768s 2024-11-23 21:50:54,785 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:50:54,789 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38851 4768s 2024-11-23 21:50:54,789 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38851 4768s 2024-11-23 21:50:54,789 - distributed.worker - INFO - Worker name: 1 4768s 2024-11-23 21:50:54,789 - distributed.worker - INFO - dashboard at: 127.0.0.1:39025 4768s 2024-11-23 21:50:54,789 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43765 4768s 2024-11-23 21:50:54,789 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:50:54,789 - distributed.worker - INFO - Threads: 2 4768s 2024-11-23 21:50:54,789 - distributed.worker - INFO - Memory: 15.58 GiB 4768s 2024-11-23 21:50:54,789 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-vkbbkfve 4768s 2024-11-23 21:50:54,790 - distributed.worker - INFO - ------------------------------------------------- 4768s 2024-11-23 21:50:54,802 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44887. Reason: failure-to-start- 4768s 2024-11-23 21:50:54,802 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:50:54,803 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38851. Reason: failure-to-start- 4768s 2024-11-23 21:50:54,804 - distributed.worker - INFO - Closed worker has not yet started: Status.init 4768s 2024-11-23 21:50:54,806 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43765': TLS handshake failed with remote 'tls://127.0.0.1:46882': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:50:54,807 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43765': TLS handshake failed with remote 'tls://127.0.0.1:46886': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 4768s 2024-11-23 21:50:54,813 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 4768s await self._register_with_scheduler() 4768s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 4768s comm = await connect(self.scheduler.address, **self.connection_args) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 4768s comm = await wait_for( 4768s ^^^^^^^^^^^^^^^ 4768s ...<2 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 4768s return await fut 4768s ^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 4768s stream = await self.client.connect( 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 4768s af, addr, stream = await connector.start(connect_timeout=timeout) 4768s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s asyncio.exceptions.CancelledError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 4768s await wait_for(self.start_unsafe(), timeout=timeout) 4768s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 4768s async with asyncio.timeout(timeout): 4768s ~~~~~~~~~~~~~~~^^^^^^^^^ 4768s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 4768s raise TimeoutError from exc_val 4768s TimeoutError 4768s 4768s The above exception was the direct cause of the following exception: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 4768s s, ws = await start_cluster( 4768s ^^^^^^^^^^^^^^^^^^^^ 4768s ...<9 lines>... 4768s ) 4768s ^ 4768s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 4768s await asyncio.gather(*workers) 4768s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 4768s return await awaitable 4768s ^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 4768s raise asyncio.TimeoutError( 4768s f"{type(self).__name__} start timed out after {timeout}s." 4768s ) from exc 4768s TimeoutError: Worker start timed out after 0s. 4768s ------------------------------ Captured log call ------------------------------- 4768s ERROR asyncio:base_events.py:1864 Exception in callback None() 4768s handle: 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 4768s self.socket.do_handshake() 4768s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 4768s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 4768s self._sslobj.do_handshake() 4768s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 4768s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 4768s 4768s During handling of the above exception, another exception occurred: 4768s 4768s Traceback (most recent call last): 4768s File "/usr/lib/python3.13/asyncio/events.py", line 89, in _run 4768s self._context.run(self._callback, *self._args) 4768s ~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/tornado/platform/asyncio.py", line 202, in _handle_events 4768s handler_func(fileobj, events) 4768s ~~~~~~~~~~~~^^^^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 691, in _handle_events 4768s self._handle_read() 4768s ~~~~~~~~~~~~~~~~~^^ 4768s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1427, in _handle_read 4768s self._do_ssl_handshake() 4768s ~~~~~~~~~~~~~~~~~~~~~~^^ 4768s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1385, in _do_ssl_handshake 4768s return self.close(exc_info=err) 4768s ~~~~~~~~~~^^^^^^^^^^^^^^ 4768s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 606, in close 4768s self._signal_closed() 4768s ~~~~~~~~~~~~~~~~~~~^^ 4768s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 636, in _signal_closed 4768s self._ssl_connect_future.exception() 4768s ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^ 4768s asyncio.exceptions.CancelledError 4768s ============================= slowest 20 durations ============================= 4768s 300.01s setup tests/test_utils_test.py::test_tls_cluster 4768s 60.03s call tests/test_tls_functional.py::test_work_stealing 4768s 60.02s call tests/test_tls_functional.py::test_worker_client_gather 4768s 60.02s call tests/test_tls_functional.py::test_worker_client 4768s 60.01s call tests/test_tls_functional.py::test_rebalance 4768s 60.01s call tests/test_utils_test.py::test_gen_cluster_tls 4768s 60.01s call tests/test_tls_functional.py::test_retire_workers 4768s 60.01s call tests/test_tls_functional.py::test_client_submit 4768s 60.01s call tests/test_tls_functional.py::test_worker_client_executor 4768s 60.01s call tests/test_scheduler.py::test_broadcast_tls 4768s 60.01s call tests/test_tls_functional.py::test_nanny 4768s 60.01s call tests/test_tls_functional.py::test_gather 4768s 60.01s call tests/test_tls_functional.py::test_Queue 4768s 60.01s call tests/test_tls_functional.py::test_basic 4768s 60.01s call tests/test_tls_functional.py::test_scatter 4768s 30.01s call tests/test_tls_functional.py::test_security_dict_input 4768s 3.25s call cli/tests/test_tls_cli.py::test_use_config_file 4768s 3.14s call cli/tests/test_tls_cli.py::test_nanny 4768s 3.13s call cli/tests/test_tls_cli.py::test_basic 4768s 3.11s call cli/tests/test_tls_cli.py::test_sni 4768s =========================== short test summary info ============================ 4768s FAILED cli/tests/test_dask_scheduler.py::test_preload_file - distributed.comm.core.CommClosedError: in : Stream is closed 4768s FAILED cli/tests/test_dask_scheduler.py::test_preload_module - distributed.comm.core.CommClosedError: in : Stream is closed 4768s FAILED cli/tests/test_dask_scheduler.py::test_preload_remote_module - distributed.comm.core.CommClosedError: in : Stream is closed 4768s FAILED cli/tests/test_dask_scheduler.py::test_preload_config - SystemError: no locals found when setting up annotations 4768s FAILED cli/tests/test_dask_scheduler.py::test_preload_command - distributed.comm.core.CommClosedError: in : Stream is closed 4768s FAILED cli/tests/test_dask_scheduler.py::test_preload_command_default - distributed.comm.core.CommClosedError: in : Stream is closed 4768s FAILED cli/tests/test_dask_scheduler.py::test_multiple_workers_2 - SystemError: no locals found when setting up annotations 4768s FAILED cli/tests/test_tls_cli.py::test_basic - distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 4768s FAILED cli/tests/test_tls_cli.py::test_sni - distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 4768s FAILED cli/tests/test_tls_cli.py::test_nanny - distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 4768s FAILED cli/tests/test_tls_cli.py::test_separate_key_cert - distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 4768s FAILED cli/tests/test_tls_cli.py::test_use_config_file - distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 4768s FAILED deploy/tests/test_subprocess.py::test_basic - SystemError: no locals found when setting up annotations 4768s FAILED deploy/tests/test_subprocess.py::test_n_workers - SystemError: no locals found when setting up annotations 4768s FAILED tests/test_client.py::test_upload_file_zip - KeyError: '/tmp/dask-scratch-space/scheduler-i9w7e1_c/myfile.zip' 4768s FAILED tests/test_profile.py::test_info_frame_f_lineno[22-4] - TypeError: '<=' not supported between instances of 'int' and 'NoneType' 4768s FAILED tests/test_profile.py::test_info_frame_f_lineno[23-4] - TypeError: '<=' not supported between instances of 'int' and 'NoneType' 4768s FAILED tests/test_profile.py::test_call_stack_f_lineno[22-4] - TypeError: '<=' not supported between instances of 'int' and 'NoneType' 4768s FAILED tests/test_profile.py::test_call_stack_f_lineno[23-4] - TypeError: '<=' not supported between instances of 'int' and 'NoneType' 4768s FAILED tests/test_scheduler.py::test_broadcast_tls - TimeoutError 4768s FAILED tests/test_security.py::test_repr_temp_keys - ImportError: Using `Security.temporary` requires `cryptography`, please install it using either pip or conda 4768s FAILED tests/test_security.py::test_temporary_credentials - ImportError: Using `Security.temporary` requires `cryptography`, please install it using either pip or conda 4768s FAILED tests/test_security.py::test_extra_conn_args_in_temporary_credentials - ImportError: Using `Security.temporary` requires `cryptography`, please install it using either pip or conda 4768s FAILED tests/test_tls_functional.py::test_basic - TimeoutError 4768s FAILED tests/test_tls_functional.py::test_Queue - TimeoutError 4768s FAILED tests/test_tls_functional.py::test_client_submit - TimeoutError 4768s FAILED tests/test_tls_functional.py::test_gather - TimeoutError 4768s FAILED tests/test_tls_functional.py::test_scatter - TimeoutError 4768s FAILED tests/test_tls_functional.py::test_nanny - TimeoutError 4768s FAILED tests/test_tls_functional.py::test_rebalance - TimeoutError 4768s FAILED tests/test_tls_functional.py::test_work_stealing - TimeoutError 4768s FAILED tests/test_tls_functional.py::test_worker_client - TimeoutError 4768s FAILED tests/test_tls_functional.py::test_worker_client_gather - TimeoutError 4768s FAILED tests/test_tls_functional.py::test_worker_client_executor - TimeoutError 4768s FAILED tests/test_tls_functional.py::test_retire_workers - TimeoutError 4768s FAILED tests/test_tls_functional.py::test_security_dict_input - TimeoutError 4768s FAILED tests/test_utils_test.py::test_gen_cluster_tls - TimeoutError 4768s ERROR tests/test_utils_test.py::test_tls_cluster - Failed: Timeout >300.0s 4768s ==== 37 failed, 30 skipped, 3311 deselected, 1 error in 1228.10s (0:20:28) ===== 4769s *** END OF RUN 2: NOT ALL TESTS HAVE YET PASSED/XFAILED *** 4769s *** STARTING RUN 3: python3.13 -m pytest --pyargs distributed --verbose --color=no --timeout-method=signal --timeout=300 -m not avoid_ci -rfE --last-failed --last-failed-no-failures none --ignore=../../../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_comms.py --ignore=../../../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_ws.py --ignore=../../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_adaptive.py --ignore=../../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py --ignore=../../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_slow_adaptive.py --ignore=../../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_spec_cluster.py --deselect=cli/tests/test_dask_scheduler.py::test_no_dashboard --deselect=deploy/tests/test_local.py::test_localcluster_get_client --deselect=deploy/tests/test_old_ssh.py::test_cluster --deselect=deploy/tests/test_old_ssh.py::test_old_ssh_nprocs_renamed_to_n_workers --deselect=deploy/tests/test_old_ssh.py::test_nprocs_attribute_is_deprecated --deselect=deploy/tests/test_ssh.py::test_nprocs_attribute_is_deprecated --deselect=http/tests/test_core.py::test_prometheus_api_doc --deselect=tests/test_init.py::test_git_revision --deselect=tests/test_jupyter.py::test_jupyter_idle_timeout --deselect=tests/test_jupyter.py::test_jupyter_idle_timeout_returned --deselect=tests/test_jupyter.py::test_jupyter_server --deselect=tests/test_jupyter.py::test_shutsdown_cleanly --deselect=tests/test_profile.py::test_stack_overflow --deselect=tests/test_pubsub.py::test_client_worker --deselect=tests/test_queues.py::test_queue_in_task --deselect=tests/test_spill.py::test_spillbuffer_oserror --deselect=tests/test_steal.py::test_steal_twice --deselect=tests/test_utils_test.py::test_cluster --deselect=tests/test_variable.py::test_variable_in_task --deselect=tests/test_worker.py::test_process_executor_kills_process --deselect=tests/test_worker_memory.py::test_fail_to_pickle_execute_1 --deselect=tests/test_worker_state_machine.py::test_task_state_instance_are_garbage_collected --deselect=protocol/tests/test_protocol.py::test_deeply_nested_structures --deselect=protocol/tests/test_serialize.py::test_deeply_nested_structures --deselect=deploy/tests/test_local.py::test_local_cluster_redundant_kwarg --deselect=deploy/tests/test_slow_adaptive.py::test_adaptive --deselect=tests/test_client.py::test_futures_in_subgraphs --deselect=tests/test_dask_collections.py::test_dataframe_groupby_tasks --deselect=tests/test_dask_collections.py::test_dataframes --deselect=tests/test_dask_collections.py::test_rolling_sync --deselect=tests/test_scheduler.py::test_balance_many_workers_2 --deselect=tests/test_scheduler.py::test_default_task_duration_splits --deselect=tests/test_steal.py::test_blocklist_shuffle_split --deselect=cli/tests/test_dask_scheduler.py::test_defaults --deselect=cli/tests/test_dask_scheduler.py::test_hostport --deselect=cli/tests/test_dask_spec.py::test_errors --deselect=cli/tests/test_dask_worker.py::test_scheduler_file --deselect=cli/tests/test_dask_worker.py::test_scheduler_file --deselect=cli/tests/test_dask_worker.py::test_scheduler_file --deselect=dashboard/tests/test_scheduler_bokeh.py::test_counters --deselect=dashboard/tests/test_worker_bokeh.py::test_counters --deselect=deploy/tests/test_local.py::test_adapt_then_manual --deselect=deploy/tests/test_local.py::test_async_with --deselect=deploy/tests/test_local.py::test_close_twice --deselect=deploy/tests/test_local.py::test_cluster_info_sync --deselect=deploy/tests/test_local.py::test_local_tls --deselect=deploy/tests/test_local.py::test_no_dangling_asyncio_tasks --deselect=deploy/tests/test_local.py::test_only_local_access --deselect=deploy/tests/test_local.py::test_remote_access --deselect=diagnostics/tests/test_progress_widgets.py::test_serializers --deselect=diagnostics/tests/test_scheduler_plugin.py::test_lifecycle --deselect=http/scheduler/tests/test_missing_bokeh.py::test_missing_bokeh --deselect=http/scheduler/tests/test_scheduler_http.py::test_metrics_when_prometheus_client_not_installed --deselect=protocol/tests/test_serialize.py::test_errors --deselect=tests/test_batched.py::test_BatchedSend --deselect=tests/test_batched.py::test_close_closed --deselect=tests/test_batched.py::test_close_twice --deselect=tests/test_batched.py::test_send_after_stream_start --deselect=tests/test_batched.py::test_send_before_close --deselect=tests/test_batched.py::test_send_before_start --deselect=tests/test_batched.py::test_sending_traffic_jam --deselect=tests/test_batched.py::test_serializers --deselect=tests/test_client.py::TestClientSecurityLoader::test_security_loader --deselect=tests/test_client.py::TestClientSecurityLoader::test_security_loader_ignored_if_explicit_security_provided --deselect=tests/test_client.py::TestClientSecurityLoader::test_security_loader_ignored_if_returns_none --deselect=tests/test_client.py::test_async_with --deselect=tests/test_client.py::test_client_is_quiet_cluster_close --deselect=tests/test_client.py::test_dashboard_link_cluster --deselect=tests/test_client.py::test_dashboard_link_inproc --deselect=tests/test_client.py::test_file_descriptors_dont_leak --deselect=tests/test_client.py::test_mixing_clients_different_scheduler --deselect=tests/test_client.py::test_quiet_client_close --deselect=tests/test_client.py::test_rebalance_sync --deselect=tests/test_client.py::test_repr_localcluster --deselect=tests/test_client.py::test_security_loader --deselect=tests/test_client.py::test_security_loader_ignored_if_explicit_security_provided --deselect=tests/test_client.py::test_security_loader_ignored_if_returns_none --deselect=tests/test_client.py::test_shutdown --deselect=tests/test_client.py::test_shutdown_is_quiet_with_cluster --deselect=tests/test_client.py::test_shutdown_localcluster --deselect=tests/test_client.py::test_shutdown_stops_callbacks --deselect=tests/test_client_loop.py::test_close_loop_sync_start_new_loop --deselect=tests/test_client_loop.py::test_close_loop_sync_use_running_loop --deselect=tests/test_core.py::test_close_fast_without_active_handlers --deselect=tests/test_core.py::test_close_grace_period_for_handlers --deselect=tests/test_core.py::test_close_properly --deselect=tests/test_core.py::test_compression --deselect=tests/test_core.py::test_connection_pool --deselect=tests/test_core.py::test_connection_pool_close_while_connecting --deselect=tests/test_core.py::test_connection_pool_detects_remote_close --deselect=tests/test_core.py::test_connection_pool_outside_cancellation --deselect=tests/test_core.py::test_connection_pool_remove --deselect=tests/test_core.py::test_connection_pool_respects_limit --deselect=tests/test_core.py::test_connection_pool_tls --deselect=tests/test_core.py::test_counters --deselect=tests/test_core.py::test_deserialize_error --deselect=tests/test_core.py::test_errors --deselect=tests/test_core.py::test_identity_inproc --deselect=tests/test_core.py::test_identity_tcp --deselect=tests/test_core.py::test_large_packets_inproc --deselect=tests/test_core.py::test_messages_are_ordered_bsend --deselect=tests/test_core.py::test_messages_are_ordered_raw --deselect=tests/test_core.py::test_ports --deselect=tests/test_core.py::test_rpc_default --deselect=tests/test_core.py::test_rpc_inproc --deselect=tests/test_core.py::test_rpc_message_lifetime_default --deselect=tests/test_core.py::test_rpc_message_lifetime_inproc --deselect=tests/test_core.py::test_rpc_message_lifetime_tcp --deselect=tests/test_core.py::test_rpc_serialization --deselect=tests/test_core.py::test_rpc_tcp --deselect=tests/test_core.py::test_rpc_tls --deselect=tests/test_core.py::test_rpc_with_many_connections_inproc --deselect=tests/test_core.py::test_rpc_with_many_connections_tcp --deselect=tests/test_core.py::test_send_recv_args --deselect=tests/test_core.py::test_send_recv_cancelled --deselect=tests/test_core.py::test_server --deselect=tests/test_core.py::test_server_comms_mark_active_handlers --deselect=tests/test_core.py::test_server_raises_on_blocked_handlers --deselect=tests/test_jupyter.py::test_jupyter_idle_timeout --deselect=tests/test_jupyter.py::test_jupyter_server --deselect=tests/test_locks.py::test_errors --deselect=tests/test_nanny.py::test_scheduler_file --deselect=tests/test_nanny.py::test_scheduler_file --deselect=tests/test_nanny.py::test_scheduler_file --deselect=tests/test_nanny.py::test_worker_uses_same_host_as_nanny --deselect=tests/test_preload.py::test_failure_doesnt_crash_scheduler --deselect=tests/test_preload.py::test_preload_import_time --deselect=tests/test_preload.py::test_preload_manager_sequence --deselect=tests/test_preload.py::test_worker_preload_text --deselect=tests/test_scheduler.py::test_allowed_failures_config --deselect=tests/test_scheduler.py::test_async_context_manager --deselect=tests/test_scheduler.py::test_dashboard_host --deselect=tests/test_scheduler.py::test_file_descriptors_dont_leak --deselect=tests/test_scheduler.py::test_finished --deselect=tests/test_scheduler.py::test_multiple_listeners --deselect=tests/test_scheduler.py::test_no_dangling_asyncio_tasks --deselect=tests/test_scheduler.py::test_scheduler_file --deselect=tests/test_scheduler.py::test_scheduler_file --deselect=tests/test_scheduler.py::test_scheduler_file --deselect=tests/test_security.py::test_require_encryption --deselect=tests/test_security.py::test_tls_listen_connect --deselect=tests/test_security.py::test_tls_temporary_credentials_functional --deselect=tests/test_semaphore.py::test_threadpoolworkers_pick_correct_ioloop --deselect=tests/test_tls_functional.py::test_security_dict_input_no_security --deselect=tests/test_utils_test.py::test_ensure_no_new_clients --deselect=tests/test_utils_test.py::test_freeze_batched_send --deselect=tests/test_utils_test.py::test_locked_comm_drop_in_replacement --deselect=tests/test_utils_test.py::test_locked_comm_intercept_read --deselect=tests/test_utils_test.py::test_locked_comm_intercept_write --deselect=tests/test_worker.py::test_host_uses_scheduler_protocol --deselect=tests/test_worker.py::test_plugin_exception --deselect=tests/test_worker.py::test_plugin_internal_exception --deselect=tests/test_worker.py::test_plugin_multiple_exceptions --deselect=tests/test_worker.py::test_scheduler_file --deselect=tests/test_worker.py::test_scheduler_file --deselect=tests/test_worker.py::test_scheduler_file --deselect=tests/test_worker_client.py::test_dont_override_default_get 4770s ============================= test session starts ============================== 4770s platform linux -- Python 3.13.0, pytest-8.3.3, pluggy-1.5.0 -- /usr/bin/python3.13 4770s cachedir: .pytest_cache 4770s rootdir: /tmp/autopkgtest.1vd31g/autopkgtest_tmp/build 4770s configfile: pyproject.toml 4770s plugins: typeguard-4.4.1, anyio-4.6.2, rerunfailures-14.0, timeout-2.3.1 4770s timeout: 300.0s 4770s timeout method: signal 4770s timeout func_only: False 4778s collecting ... collected 3349 items / 3311 deselected / 30 skipped / 38 selected 4778s run-last-failure: rerun previous 38 failures 4778s 4780s cli/tests/test_dask_scheduler.py::test_preload_file <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py FAILED [ 2%] 4781s cli/tests/test_dask_scheduler.py::test_preload_module <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py FAILED [ 5%] 4782s cli/tests/test_dask_scheduler.py::test_preload_remote_module <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py FAILED [ 7%] 4784s cli/tests/test_dask_scheduler.py::test_preload_config <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py FAILED [ 10%] 4785s cli/tests/test_dask_scheduler.py::test_preload_command <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py FAILED [ 13%] 4787s cli/tests/test_dask_scheduler.py::test_preload_command_default <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py FAILED [ 15%] 4789s cli/tests/test_dask_scheduler.py::test_multiple_workers_2 <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py FAILED [ 18%] 4791s cli/tests/test_tls_cli.py::test_basic <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_tls_cli.py FAILED [ 21%] 4794s cli/tests/test_tls_cli.py::test_sni <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_tls_cli.py FAILED [ 23%] 4796s cli/tests/test_tls_cli.py::test_nanny <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_tls_cli.py FAILED [ 26%] 4799s cli/tests/test_tls_cli.py::test_separate_key_cert <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_tls_cli.py FAILED [ 28%] 4801s cli/tests/test_tls_cli.py::test_use_config_file <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_tls_cli.py FAILED [ 31%] 4803s deploy/tests/test_subprocess.py::test_basic <- ../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_subprocess.py FAILED [ 34%] 4805s deploy/tests/test_subprocess.py::test_n_workers <- ../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_subprocess.py FAILED [ 36%] 4806s tests/test_client.py::test_upload_file_zip <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py FAILED [ 39%] 4806s tests/test_profile.py::test_info_frame_f_lineno[22-4] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py FAILED [ 42%] 4806s tests/test_profile.py::test_info_frame_f_lineno[23-4] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py FAILED [ 44%] 4806s tests/test_profile.py::test_call_stack_f_lineno[22-4] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py FAILED [ 47%] 4806s tests/test_profile.py::test_call_stack_f_lineno[23-4] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py FAILED [ 50%] 4868s tests/test_scheduler.py::test_broadcast_tls <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py FAILED [ 52%] 4868s tests/test_security.py::test_repr_temp_keys <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py FAILED [ 55%] 4868s tests/test_security.py::test_temporary_credentials <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py FAILED [ 57%] 4868s tests/test_security.py::test_extra_conn_args_in_temporary_credentials <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py FAILED [ 60%] 4928s tests/test_tls_functional.py::test_basic <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_tls_functional.py FAILED [ 63%] 4989s tests/test_tls_functional.py::test_Queue <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_tls_functional.py FAILED [ 65%] 5050s tests/test_tls_functional.py::test_client_submit <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_tls_functional.py FAILED [ 68%] 5110s tests/test_tls_functional.py::test_gather <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_tls_functional.py FAILED [ 71%] 5171s tests/test_tls_functional.py::test_scatter <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_tls_functional.py FAILED [ 73%] 5231s tests/test_tls_functional.py::test_nanny <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_tls_functional.py FAILED [ 76%] 5291s tests/test_tls_functional.py::test_rebalance <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_tls_functional.py FAILED [ 78%] 5352s tests/test_tls_functional.py::test_work_stealing <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_tls_functional.py FAILED [ 81%] 5412s tests/test_tls_functional.py::test_worker_client <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_tls_functional.py FAILED [ 84%] 5473s tests/test_tls_functional.py::test_worker_client_gather <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_tls_functional.py FAILED [ 86%] 5534s tests/test_tls_functional.py::test_worker_client_executor <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_tls_functional.py FAILED [ 89%] 5594s tests/test_tls_functional.py::test_retire_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_tls_functional.py FAILED [ 92%] 5624s tests/test_tls_functional.py::test_security_dict_input <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_tls_functional.py FAILED [ 94%] 5685s tests/test_utils_test.py::test_gen_cluster_tls <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py FAILED [ 97%] 5985s tests/test_utils_test.py::test_tls_cluster <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py +++++++++++++++++++++++++++++++++++ Timeout ++++++++++++++++++++++++++++++++++++ 5985s ~~~~~~~~~~~~~~~~~~~~~ Stack of test IOLoop_0 (3685479424) ~~~~~~~~~~~~~~~~~~~~~~ 5985s File "/usr/lib/python3.13/threading.py", line 1012, in _bootstrap 5985s self._bootstrap_inner() 5985s File "/usr/lib/python3.13/threading.py", line 1041, in _bootstrap_inner 5985s self.run() 5985s File "/usr/lib/python3.13/threading.py", line 992, in run 5985s self._target(*self._args, **self._kwargs) 5985s File "/usr/lib/python3.13/concurrent/futures/thread.py", line 92, in _worker 5985s work_item.run() 5985s File "/usr/lib/python3.13/concurrent/futures/thread.py", line 58, in run 5985s result = self.fn(*self.args, **self.kwargs) 5985s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 378, in _run_and_close_tornado 5985s return asyncio_run(inner_fn(), loop_factory=get_loop_factory()) 5985s File "/usr/lib/python3.13/asyncio/runners.py", line 194, in run 5985s return runner.run(main) 5985s File "/usr/lib/python3.13/asyncio/runners.py", line 118, in run 5985s return self._loop.run_until_complete(task) 5985s File "/usr/lib/python3.13/asyncio/base_events.py", line 707, in run_until_complete 5985s self.run_forever() 5985s File "/usr/lib/python3.13/asyncio/base_events.py", line 678, in run_forever 5985s self._run_once() 5985s File "/usr/lib/python3.13/asyncio/base_events.py", line 1995, in _run_once 5985s event_list = self._selector.select(timeout) 5985s File "/usr/lib/python3.13/selectors.py", line 452, in select 5985s fd_event_list = self._selector.poll(timeout, max_ev) 5985s ~~~~~~~~~~~~~~~~~~~~~ Stack of Dask-Offload_0 (3857708032) ~~~~~~~~~~~~~~~~~~~~~ 5985s File "/usr/lib/python3.13/threading.py", line 1012, in _bootstrap 5985s self._bootstrap_inner() 5985s File "/usr/lib/python3.13/threading.py", line 1041, in _bootstrap_inner 5985s self.run() 5985s File "/usr/lib/python3.13/threading.py", line 992, in run 5985s self._target(*self._args, **self._kwargs) 5985s File "/usr/lib/python3.13/concurrent/futures/thread.py", line 89, in _worker 5985s work_item = work_queue.get(block=True) 5985s +++++++++++++++++++++++++++++++++++ Timeout ++++++++++++++++++++++++++++++++++++ 5985s ERROR [100%] 5985s 5985s ==================================== ERRORS ==================================== 5985s ______________________ ERROR at setup of test_tls_cluster ______________________ 5985s 5985s loop = 5985s security = Security(require_encryption=True, tls_ca_file=Local (/usr/lib/python3/dist-packages/distributed/tests/tls-ca-cert.pem)...ted/tests/tls-key-cert.pem), tls_worker_cert=Local (/usr/lib/python3/dist-packages/distributed/tests/tls-key-cert.pem)) 5985s 5985s @pytest.fixture 5985s def tls_cluster(loop, security): 5985s > with tls_cluster_context(security=security) as (scheduler, workers): 5985s 5985s /usr/lib/python3/dist-packages/distributed/utils_test.py:573: 5985s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5985s /usr/lib/python3.13/contextlib.py:141: in __enter__ 5985s return next(self.gen) 5985s /usr/lib/python3/dist-packages/distributed/utils_test.py:565: in tls_cluster_context 5985s with cluster( 5985s /usr/lib/python3.13/contextlib.py:141: in __enter__ 5985s return next(self.gen) 5985s /usr/lib/python3/dist-packages/distributed/utils_test.py:672: in cluster 5985s pid, addr_or_exception = q.get() 5985s /usr/lib/python3.13/multiprocessing/queues.py:101: in get 5985s res = self._recv_bytes() 5985s /usr/lib/python3.13/multiprocessing/connection.py:216: in recv_bytes 5985s buf = self._recv_bytes(maxlength) 5985s /usr/lib/python3.13/multiprocessing/connection.py:430: in _recv_bytes 5985s buf = self._recv(4) 5985s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5985s 5985s self = , size = 4 5985s read = 5985s 5985s def _recv(self, size, read=_read): 5985s buf = io.BytesIO() 5985s handle = self._handle 5985s remaining = size 5985s while remaining > 0: 5985s > chunk = read(handle, remaining) 5985s E Failed: Timeout >300.0s 5985s 5985s /usr/lib/python3.13/multiprocessing/connection.py:395: Failed 5985s ---------------------------- Captured stderr setup ----------------------------- 5985s 2024-11-23 22:11:15,233 - distributed.http.proxy - INFO - To route to workers diagnostics web server please install jupyter-server-proxy: python -m pip install jupyter-server-proxy 5985s 2024-11-23 22:11:15,235 - distributed.scheduler - INFO - State start 5985s 2024-11-23 22:11:15,245 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:15,245 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:8787/status 5985s 2024-11-23 22:11:15,246 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5985s 2024-11-23 22:11:15,277 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43797 5985s 2024-11-23 22:11:15,277 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43797 5985s 2024-11-23 22:11:15,277 - distributed.worker - INFO - dashboard at: 127.0.0.1:38979 5985s 2024-11-23 22:11:15,277 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:15,277 - distributed.worker - INFO - ------------------------------------------------- 5985s 2024-11-23 22:11:15,277 - distributed.worker - INFO - Threads: 1 5985s 2024-11-23 22:11:15,277 - distributed.worker - INFO - Memory: 15.58 GiB 5985s 2024-11-23 22:11:15,277 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-hi7uzv51 5985s 2024-11-23 22:11:15,277 - distributed.worker - INFO - ------------------------------------------------- 5985s 2024-11-23 22:11:15,279 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38125 5985s 2024-11-23 22:11:15,280 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38125 5985s 2024-11-23 22:11:15,280 - distributed.worker - INFO - dashboard at: 127.0.0.1:44289 5985s 2024-11-23 22:11:15,280 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:15,280 - distributed.worker - INFO - ------------------------------------------------- 5985s 2024-11-23 22:11:15,280 - distributed.worker - INFO - Threads: 1 5985s 2024-11-23 22:11:15,280 - distributed.worker - INFO - Memory: 15.58 GiB 5985s 2024-11-23 22:11:15,280 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-fkd100hr 5985s 2024-11-23 22:11:15,280 - distributed.worker - INFO - ------------------------------------------------- 5985s 2024-11-23 22:11:15,285 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:15,289 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:45240': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:15,289 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:45248': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:15,289 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:15,391 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:15,395 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:45252': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:15,395 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:45256': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:15,396 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:15,498 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:15,502 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:45264': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:15,502 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:45272': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:15,502 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:15,604 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:15,608 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:45278': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:15,608 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:45286': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:15,608 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:15,710 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:15,714 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:45292': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:15,714 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:45300': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:15,714 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:15,816 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:15,820 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:45304': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:15,820 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:45312': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:15,820 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:15,923 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:15,926 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:45326': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:15,927 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:45340': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:15,927 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:16,029 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:16,032 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:45342': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:16,033 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:45350': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:16,033 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:16,135 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:16,138 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:45364': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:16,139 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:45374': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:16,139 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:16,241 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:16,245 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:45384': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:16,245 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:45386': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:16,245 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:16,347 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:16,351 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:45396': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:16,352 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:45406': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:16,352 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:16,454 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:16,457 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:45410': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:16,458 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:45424': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:16,458 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:16,560 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:16,564 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:45440': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:16,564 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:45446': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:16,564 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:16,666 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:16,670 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:45450': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:16,670 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:45464': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:16,670 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:16,772 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:16,776 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:45468': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:16,777 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:45474': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:16,777 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:16,879 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:16,882 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:45482': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:16,883 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:45490': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:16,883 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:16,986 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:16,989 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:45504': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:16,990 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:45512': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:16,990 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:17,093 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:17,096 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:45526': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:17,097 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:45530': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:17,097 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:17,199 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:17,203 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:45536': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:17,203 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:45548': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:17,203 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:17,305 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:17,309 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:45558': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:17,309 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:45564': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:17,309 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:17,412 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:17,415 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:45576': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:17,416 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:45578': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:17,416 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:17,518 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:17,521 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:45582': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:17,522 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:45594': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:17,522 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:17,624 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:17,628 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:45608': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:17,628 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:45622': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:17,628 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:17,731 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:17,734 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:45634': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:17,735 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:45648': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:17,735 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:17,837 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:17,841 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:45652': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:17,841 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:45662': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:17,841 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:17,943 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:17,947 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:45666': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:17,948 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:45674': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:17,948 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:18,050 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:18,054 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:45680': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:18,055 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:45692': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:18,055 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:18,156 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:45708': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:18,156 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:18,161 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:45720': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:18,161 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:18,262 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:45736': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:18,263 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:18,267 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:45742': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:18,267 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:18,369 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:45752': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:18,369 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:18,374 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:45756': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:18,374 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:18,475 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:45764': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:18,475 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:18,480 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:45766': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:18,480 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:18,581 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:18,581 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:45780': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:18,586 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:45790': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:18,586 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:18,689 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:18,692 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:45804': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:18,693 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:45810': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:18,693 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:18,795 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:18,799 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:45826': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:18,799 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:45834': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:18,799 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:18,902 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:18,905 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:45848': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:18,906 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:45862': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:18,906 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:19,008 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:19,012 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:45864': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:19,012 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:45874': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:19,012 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:19,114 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:19,118 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:45884': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:19,118 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:45898': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:19,118 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:19,221 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:19,224 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:45910': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:19,225 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:45914': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:19,225 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:19,327 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:19,331 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:45926': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:19,331 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:45928': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:19,331 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:19,434 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:19,437 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:45938': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:19,438 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:45948': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:19,438 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:19,540 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:19,543 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:45952': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:19,544 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:45962': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:19,544 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:19,646 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:19,650 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:45966': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:19,650 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:45974': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:19,650 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:19,754 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:19,758 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:45990': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:19,758 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46004': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:19,758 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:19,860 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:19,864 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46016': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:19,864 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46030': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:19,864 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:19,967 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:19,970 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46038': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:19,971 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46040': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:19,971 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:20,073 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:20,076 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46042': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:20,077 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46048': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:20,077 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:20,179 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:20,182 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:20,183 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46070': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:20,183 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:20,285 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:20,289 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46084': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:20,289 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46094': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:20,289 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:20,392 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:20,396 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46098': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:20,396 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46110': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:20,396 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:20,498 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:20,502 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46118': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:20,503 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46120': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:20,503 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:20,605 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:20,608 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46126': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:20,609 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46142': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:20,609 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:20,711 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:20,714 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46150': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:20,715 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46152': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:20,715 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:20,817 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:20,820 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46166': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:20,821 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46170': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:20,821 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:20,923 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:20,927 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46180': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:20,927 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46196': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:20,927 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:21,030 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:21,033 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46210': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:21,034 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46214': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:21,034 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:21,136 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:21,140 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46226': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:21,140 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46228': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:21,140 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:21,243 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:21,246 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46238': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:21,247 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:21,249 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46242': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:21,349 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:21,353 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46258': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:21,353 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46270': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:21,353 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:21,455 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:21,459 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46284': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:21,459 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46286': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:21,459 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:21,562 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:21,565 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:51986': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:21,566 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:51994': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:21,566 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:21,669 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:21,672 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52008': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:21,673 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52018': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:21,673 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:21,775 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:21,779 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52034': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:21,779 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52042': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:21,779 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:21,882 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:21,885 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52056': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:21,886 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52062': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:21,886 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:21,988 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:21,991 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52076': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:21,992 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52084': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:21,992 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:22,095 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:22,099 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52092': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:22,099 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52098': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:22,099 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:22,202 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:22,205 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52108': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:22,206 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52112': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:22,206 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:22,308 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:22,312 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52126': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:22,312 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52136': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:22,312 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:22,415 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:22,418 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52140': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:22,419 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52154': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:22,419 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:22,521 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:22,525 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52166': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:22,525 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52172': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:22,525 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:22,628 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:22,631 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52186': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:22,632 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52202': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:22,632 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:22,734 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:22,737 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52214': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:22,738 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52218': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:22,738 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:22,840 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:22,844 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52220': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:22,844 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52236': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:22,844 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:22,946 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:22,950 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52242': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:22,950 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52256': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:22,950 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:23,053 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:23,057 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52270': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:23,057 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52278': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:23,057 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:23,159 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:23,163 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52280': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:23,164 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52284': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:23,164 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:23,265 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:23,269 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52300': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:23,270 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52312': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:23,270 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:23,372 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:23,375 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52326': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:23,376 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52334': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:23,376 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:23,478 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:23,481 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52346': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:23,482 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52352': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:23,482 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:23,584 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:23,587 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52368': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:23,588 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52384': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:23,588 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:23,690 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:23,694 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52398': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:23,694 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52414': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:23,694 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:23,797 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:23,801 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52416': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:23,801 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52426': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:23,801 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:23,903 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:23,907 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52442': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:23,907 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52456': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:23,907 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:24,010 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:24,013 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52472': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:24,014 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52488': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:24,014 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:24,116 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:24,119 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52502': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:24,120 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52518': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:24,120 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:24,222 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:24,225 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52524': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:24,226 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52532': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:24,226 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:24,328 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:24,332 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52546': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:24,332 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52548': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:24,332 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:24,434 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:24,438 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52558': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:24,439 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52564': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:24,439 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:24,541 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:24,544 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52574': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:24,545 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52584': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:24,545 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:24,647 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:24,650 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52596': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:24,651 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52608': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:24,651 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:24,754 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:24,758 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52624': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:24,758 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52636': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:24,758 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:24,860 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:24,864 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52648': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:24,865 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52660': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:24,865 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:24,967 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:24,970 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52668': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:24,971 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52684': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:24,971 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:25,073 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:25,076 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52698': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:25,077 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52712': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:25,077 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:25,179 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:25,183 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52718': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:25,183 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:25,183 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:25,285 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:25,289 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52732': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:25,289 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52748': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:25,289 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:25,392 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:25,395 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52764': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:25,396 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52768': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:25,396 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:25,499 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:25,502 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52772': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:25,503 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52786': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:25,503 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:25,605 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:25,609 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52798': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:25,609 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52810': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:25,609 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:25,712 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:25,715 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52822': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:25,716 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52838': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:25,716 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:25,818 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:25,821 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52854': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:25,822 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52862': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:25,822 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:25,924 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:25,928 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52866': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:25,928 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52868': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:25,928 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:26,030 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:26,034 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52872': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:26,034 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52878': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:26,034 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:26,136 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:26,140 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52892': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:26,140 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52904': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:26,140 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:26,242 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:26,246 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52908': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:26,247 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:26,248 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52910': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:26,349 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:26,352 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52924': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:26,353 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52928': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:26,353 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:26,455 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:26,458 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52944': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:26,459 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52956': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:26,459 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:26,561 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:26,565 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52966': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:26,565 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52976': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:26,565 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:26,667 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:26,671 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:26,671 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52998': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:26,671 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:26,774 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:26,777 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53008': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:26,778 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53022': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:26,778 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:26,880 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:26,883 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53036': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:26,884 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53040': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:26,884 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:26,986 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:26,990 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53050': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:26,991 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53056': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:26,991 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:27,093 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:27,096 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53060': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:27,097 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53066': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:27,097 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:27,200 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:27,203 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53072': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:27,204 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53086': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:27,204 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:27,306 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:27,310 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53094': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:27,310 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53096': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:27,310 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:27,413 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53098': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:27,413 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:27,417 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53110': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:27,417 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:27,519 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:27,519 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:27,524 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53128': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:27,524 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:27,625 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53138': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:27,625 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:27,630 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:27,630 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53154': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:27,731 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:27,732 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53160': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:27,736 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53176': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:27,736 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:27,838 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:27,838 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53190': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:27,843 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53198': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:27,843 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:27,944 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:27,944 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53212': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:27,949 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53216': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:27,949 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:28,050 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53220': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:28,050 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:28,055 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53234': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:28,055 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:28,156 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53248': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:28,157 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:28,161 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53264': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:28,162 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:28,263 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53276': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:28,263 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:28,268 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53278': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:28,268 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:28,369 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53282': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:28,369 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:28,374 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53288': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:28,374 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:28,475 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:28,475 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53296': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:28,480 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53298': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:28,480 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:28,582 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:28,586 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53302': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:28,587 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53312': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:28,587 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:28,688 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53318': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:28,688 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:28,693 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53326': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:28,693 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:28,795 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:28,799 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53330': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:28,799 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53338': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:28,799 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:28,902 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:28,906 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53344': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:28,906 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53358': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:28,906 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:29,008 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:29,012 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53374': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:29,012 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53390': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:29,012 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:29,115 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:29,118 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53406': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:29,119 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53410': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:29,119 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:29,221 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:29,225 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53422': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:29,225 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53428': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:29,225 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:29,327 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:29,331 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53442': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:29,331 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53444': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:29,331 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:29,433 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:29,437 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53458': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:29,438 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53460': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:29,438 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:29,540 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:29,543 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53476': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:29,544 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53490': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:29,544 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:29,646 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:29,649 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53502': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:29,650 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:29,650 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53514': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:29,755 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:29,758 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53516': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:29,759 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53522': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:29,759 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:29,861 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:29,864 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53538': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:29,865 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53542': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:29,865 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:29,967 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:29,971 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53552': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:29,971 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53560': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:29,971 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:30,073 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:30,077 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53574': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:30,077 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:30,077 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53576': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:30,179 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:30,183 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53580': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:30,184 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53594': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:30,184 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:30,286 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:30,289 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53602': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:30,290 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53606': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:30,290 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:30,392 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:30,395 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53616': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:30,396 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53632': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:30,396 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:30,498 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:30,502 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53644': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:30,503 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53652': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:30,503 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:30,605 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:30,609 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53658': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:30,610 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53666': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:30,610 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:30,711 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:30,715 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53682': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:30,716 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53698': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:30,716 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:30,818 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:30,822 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53710': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:30,822 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:30,822 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:30,924 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:30,928 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53732': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:30,928 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53734': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:30,928 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:31,030 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:31,034 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53746': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:31,034 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53754': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:31,034 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:31,136 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:31,140 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53766': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:31,141 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53774': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:31,141 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:31,243 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:31,247 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53776': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:31,247 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:31,249 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53786': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:31,349 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:31,353 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53790': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:31,353 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53794': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:31,353 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:31,455 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:31,459 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:31,459 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53812': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:31,459 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:31,562 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:31,565 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:55502': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:31,566 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:55516': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:31,566 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:31,668 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:31,672 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:55526': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:31,672 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:55538': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:31,672 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:31,774 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:31,778 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:55554': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:31,779 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:55556': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:31,779 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:31,881 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:31,884 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:55566': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:31,885 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:55574': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:31,885 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:31,987 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:31,991 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:55586': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:31,991 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:55592': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:31,991 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:32,093 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:32,096 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:55594': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:32,097 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:55606': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:32,097 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:32,199 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:32,203 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:55618': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:32,203 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:55622': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:32,203 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:32,306 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:32,310 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:55636': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:32,310 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:55640': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:32,310 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:32,412 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:32,416 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:55654': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:32,416 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:55656': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:32,416 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:32,518 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:32,522 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:55662': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:32,523 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:55672': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:32,523 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:32,625 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:32,629 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:55680': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:32,629 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:55684': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:32,629 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:32,731 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:32,735 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:55690': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:32,735 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:55696': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:32,735 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:32,838 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:32,841 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:55706': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:32,841 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:55722': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:32,842 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:32,944 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:32,948 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:55732': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:32,948 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:55742': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:32,948 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:33,050 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:33,054 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:55744': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:33,054 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:55748': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:33,054 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:33,156 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:33,160 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:55762': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:33,160 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:55772': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:33,160 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:33,263 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:33,266 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:55782': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:33,267 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:55788': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:33,267 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:33,369 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:33,372 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:55796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:33,373 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:55806': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:33,373 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:33,475 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:33,479 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:55820': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:33,479 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:55832': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:33,479 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:33,582 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:33,585 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:55844': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:33,586 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:55846': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:33,586 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:33,688 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:33,692 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:55848': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:33,692 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:55856': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:33,692 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:33,794 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:33,798 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:55860': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:33,799 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:55874': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:33,799 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:33,901 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:33,904 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:55876': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:33,905 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:55888': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:33,905 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:34,008 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:34,011 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:55894': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:34,012 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:55896': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:34,012 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:34,114 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:34,117 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:55898': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:34,118 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:55902': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:34,118 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:34,220 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:34,224 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:55904': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:34,224 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:55918': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:34,225 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:34,327 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:34,330 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:55926': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:34,331 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:55940': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:34,331 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:34,433 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:34,436 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:55948': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:34,437 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:55960': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:34,437 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:34,539 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:34,542 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:55970': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:34,543 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:55980': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:34,543 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:34,645 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:34,649 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:55992': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:34,650 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:55998': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:34,650 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:34,753 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:34,757 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56010': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:34,758 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56016': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:34,758 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:34,860 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:34,863 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56022': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:34,864 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56034': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:34,864 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:34,966 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:34,969 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56046': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:34,970 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56048': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:34,970 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:35,072 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:35,076 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56050': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:35,076 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:35,076 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56064': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:35,178 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:35,182 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56070': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:35,182 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56074': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:35,182 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:35,284 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:35,288 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56086': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:35,289 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56094': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:35,289 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:35,391 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:35,394 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56096': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:35,395 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56104': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:35,395 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:35,497 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:35,500 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56120': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:35,501 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56134': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:35,501 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:35,603 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:35,607 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56136': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:35,607 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56146': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:35,607 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:35,710 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:35,714 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56150': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:35,714 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56160': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:35,714 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:35,817 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:35,820 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56176': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:35,821 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56178': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:35,821 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:35,923 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:35,927 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56192': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:35,927 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56196': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:35,927 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:36,029 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:36,033 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56206': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:36,034 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:36,034 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56220': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:36,136 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:36,140 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56228': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:36,140 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56236': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:36,141 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:36,243 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:36,247 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56250': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:36,247 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:36,249 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56264': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:36,350 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:36,353 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56276': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:36,354 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56290': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:36,354 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:36,456 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:36,460 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56304': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:36,460 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56310': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:36,460 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:36,562 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:36,566 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56320': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:36,566 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56332': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:36,566 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:36,669 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:36,672 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56348': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:36,673 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56350': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:36,673 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:36,775 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:36,779 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56354': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:36,779 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56364': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:36,779 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:36,881 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:36,885 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56380': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:36,886 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56388': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:36,886 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:36,988 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:36,991 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56390': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:36,992 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56392': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:36,992 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:37,094 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:37,098 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56408': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:37,098 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56414': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:37,098 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:37,200 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:37,204 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56426': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:37,205 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56432': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:37,205 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:37,307 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:37,310 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56438': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:37,311 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56440': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:37,311 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:37,414 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:37,417 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56442': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:37,418 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56458': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:37,418 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:37,520 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:37,523 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56474': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:37,524 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56490': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:37,524 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:37,626 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:37,630 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56506': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:37,630 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56516': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:37,630 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:37,732 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:37,736 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56520': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:37,736 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56536': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:37,736 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:37,838 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:37,842 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56548': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:37,843 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56550': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:37,843 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:37,945 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:37,949 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56564': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:37,949 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56572': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:37,949 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:38,051 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:38,055 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56584': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:38,055 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56592': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:38,055 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:38,158 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:38,161 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56604': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:38,162 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56606': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:38,162 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:38,264 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:38,267 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56614': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:38,268 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56616': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:38,268 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:38,370 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:38,374 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56622': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:38,374 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56638': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:38,374 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:38,476 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:38,480 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56642': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:38,480 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56646': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:38,480 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:38,582 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:38,586 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56656': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:38,587 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56670': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:38,587 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:38,689 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:38,692 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56682': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:38,693 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56696': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:38,693 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:38,795 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:38,799 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56702': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:38,799 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56706': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:38,799 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:38,901 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:38,905 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56720': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:38,906 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56722': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:38,906 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:39,008 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56728': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:39,008 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:39,012 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56732': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:39,012 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:39,115 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:39,118 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56748': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:39,119 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56762': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:39,119 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:39,221 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:39,225 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56772': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:39,225 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56778': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:39,225 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:39,327 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:39,331 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56794': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:39,331 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:39,331 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:39,434 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:39,437 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56806': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:39,438 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56816': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:39,438 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:39,540 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:39,544 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56826': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:39,544 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56840': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:39,544 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:39,646 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:39,650 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56844': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:39,650 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56858': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:39,651 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:39,754 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:39,758 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56874': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:39,758 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56878': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:39,758 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:39,861 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:39,864 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56892': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:39,865 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56902': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:39,865 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:39,967 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:39,971 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56914': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:39,971 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56918': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:39,971 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:40,073 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:40,077 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56934': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:40,077 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56938': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:40,077 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:40,179 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:40,183 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56950': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:40,184 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56952': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:40,184 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:40,286 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:40,289 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56956': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:40,290 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56968': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:40,290 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:40,392 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:40,396 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56972': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:40,397 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56988': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:40,397 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:40,499 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:40,503 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56998': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:40,504 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57002': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:40,504 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:40,606 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:40,610 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57012': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:40,610 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57020': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:40,610 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:40,713 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:40,718 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57034': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:40,719 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57046': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:40,719 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:40,821 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:40,824 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57054': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:40,825 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57060': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:40,825 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:40,927 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:40,930 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57074': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:40,931 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57080': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:40,931 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:41,033 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:41,037 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57086': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:41,037 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57096': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:41,037 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:41,139 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:41,143 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57110': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:41,144 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:41,144 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:41,246 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:41,250 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57132': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:41,250 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:41,252 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57136': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:41,352 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:41,356 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57146': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:41,356 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57150': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:41,356 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:41,459 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:41,462 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57158': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:41,463 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57164': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:41,463 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:41,565 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:41,568 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36670': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:41,569 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36680': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:41,569 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:41,671 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:41,675 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36686': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:41,675 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36688': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:41,675 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:41,777 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:41,781 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36690': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:41,782 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:41,782 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36698': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:41,883 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:41,887 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36700': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:41,888 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36714': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:41,888 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:41,990 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:41,993 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36716': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:41,994 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36728': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:41,994 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:42,096 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:42,099 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36736': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:42,100 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36748': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:42,100 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:42,202 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:42,206 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36760': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:42,206 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36770': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:42,206 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:42,308 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:42,312 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36772': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:42,312 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36782': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:42,312 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:42,415 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:42,418 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36790': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:42,419 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36792': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:42,419 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:42,522 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:42,525 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:42,526 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36806': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:42,526 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:42,628 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:42,631 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36808': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:42,632 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36810': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:42,632 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:42,734 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:42,738 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36824': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:42,738 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36826': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:42,738 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:42,840 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:42,844 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36834': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:42,844 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36846': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:42,845 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:42,947 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:42,951 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36858': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:42,951 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36868': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:42,951 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:43,053 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:43,056 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36872': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:43,057 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36876': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:43,057 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:43,159 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:43,163 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36880': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:43,163 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36882': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:43,163 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:43,266 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:43,269 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36884': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:43,270 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36892': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:43,270 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:43,372 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:43,376 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36900': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:43,376 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36906': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:43,376 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:43,478 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:43,482 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36916': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:43,483 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36926': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:43,483 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:43,584 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:43,584 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36942': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:43,589 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36954': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:43,589 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:43,690 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:43,690 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36958': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:43,695 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36972': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:43,695 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:43,796 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36976': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:43,796 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:43,801 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36980': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:43,801 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:43,903 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:43,903 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36986': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:43,907 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36990': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:43,907 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:44,009 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37000': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:44,009 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:44,014 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37014': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:44,014 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:44,115 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37018': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:44,115 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:44,120 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37034': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:44,120 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:44,222 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:44,226 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37038': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:44,226 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37044': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:44,226 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:44,328 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:44,332 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37046': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:44,333 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37050': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:44,333 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:44,435 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:44,438 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:44,439 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37068': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:44,439 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:44,541 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:44,544 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37080': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:44,545 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37086': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:44,545 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:44,647 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:44,651 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37098': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:44,651 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37112': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:44,651 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:44,754 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:44,758 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:44,758 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37128': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:44,759 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:44,861 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:44,864 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37134': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:44,865 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37144': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:44,865 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:44,968 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:44,971 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37156': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:44,972 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37170': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:44,972 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:45,074 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:45,077 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37180': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:45,078 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37182': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:45,078 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:45,185 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:45,189 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37186': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:45,189 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37202': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:45,189 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:45,292 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:45,295 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37206': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:45,296 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37214': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:45,296 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:45,398 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:45,402 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37216': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:45,402 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37222': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:45,402 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:45,505 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:45,508 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37232': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:45,509 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37236': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:45,509 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:45,611 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:45,614 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37240': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:45,615 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37242': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:45,615 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:45,717 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:45,721 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37250': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:45,721 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37260': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:45,721 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:45,823 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:45,827 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37264': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:45,827 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37280': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:45,828 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:45,930 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:45,934 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37296': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:45,935 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37308': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:45,935 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:46,037 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:46,040 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37322': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:46,041 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37338': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:46,041 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:46,143 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:46,147 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37342': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:46,147 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37348': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:46,147 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:46,249 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:46,255 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37356': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:46,256 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37364': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:46,256 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:46,355 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37368': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:46,355 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:46,362 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37372': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:46,362 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:46,462 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37382': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:46,462 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:46,468 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37396': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:46,468 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:46,568 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37412': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:46,568 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:46,574 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37424': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:46,574 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:46,674 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37434': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:46,674 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:46,680 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37446': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:46,680 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:46,780 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37454': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:46,780 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:46,786 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:46,786 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37466': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:46,887 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37474': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:46,887 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:46,892 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37486': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:46,892 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:46,993 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37494': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:46,993 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:46,998 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37496': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:46,998 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:47,099 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37498': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:47,099 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:47,104 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37508': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:47,105 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:47,206 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:47,206 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37514': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:47,211 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37530': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:47,211 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:47,312 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37538': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:47,312 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:47,317 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37546': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:47,317 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:47,418 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:47,418 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37558': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:47,423 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37572': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:47,423 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:47,524 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37584': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:47,524 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:47,529 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37596': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:47,529 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:47,631 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:47,635 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37610': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:47,636 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37618': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:47,636 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:47,738 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:47,741 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37620': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:47,742 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37622': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:47,742 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:47,844 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:47,847 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37628': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:47,848 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37632': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:47,848 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:47,950 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:47,954 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37636': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:47,954 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37638': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:47,954 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:48,056 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:48,060 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37642': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:48,061 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37644': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:48,061 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:48,163 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:48,166 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37658': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:48,167 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37666': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:48,167 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:48,269 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:48,272 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37680': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:48,273 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37696': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:48,273 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:48,375 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:48,379 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37702': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:48,386 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37714': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:48,386 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:48,482 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37728': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:48,482 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:48,493 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37736': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:48,493 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:48,588 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37752': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:48,588 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:48,599 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37754': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:48,599 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:48,694 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:48,694 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37764': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:48,705 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37768': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:48,705 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:48,800 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37770': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:48,800 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:48,812 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37782': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:48,812 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:48,907 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:48,907 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:48,918 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37812': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:48,918 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:49,013 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:49,013 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37818': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:49,024 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37826': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:49,024 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:49,120 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37828': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:49,120 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:49,131 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37830': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:49,131 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:49,226 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:49,226 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37836': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:49,237 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37850': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:49,237 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:49,333 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:49,333 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37858': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:49,343 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37864': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:49,343 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:49,440 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37866': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:49,440 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:49,450 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37880': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:49,450 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:49,546 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:49,546 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37886': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:49,556 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37898': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:49,556 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:49,653 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37902': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:49,653 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:49,662 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37910': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:49,662 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:49,759 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37918': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:49,759 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:49,768 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37928': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:49,768 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:49,865 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37936': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:49,865 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:49,874 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37946': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:49,874 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:49,972 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37948': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:49,972 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:49,980 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37962': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:49,980 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:50,079 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37966': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:50,079 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:50,087 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37974': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:50,087 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:50,185 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37990': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:50,185 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:50,193 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37994': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:50,193 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:50,292 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38004': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:50,292 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:50,299 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38010': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:50,299 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:50,398 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38024': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:50,398 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:50,405 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38040': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:50,405 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:50,504 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38054': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:50,504 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:50,512 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38070': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:50,512 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:50,611 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38078': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:50,611 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:50,618 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38080': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:50,618 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:50,717 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38084': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:50,717 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:50,724 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38090': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:50,724 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:50,824 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38092': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:50,824 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:50,830 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38100': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:50,830 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:50,930 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38116': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:50,930 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:50,936 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38120': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:50,936 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:51,038 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:51,038 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38130': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:51,042 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38132': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:51,042 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:51,144 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38142': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:51,144 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:51,149 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38148': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:51,149 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:51,250 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:51,253 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38156': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:51,257 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38158': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:51,257 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:51,357 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38160': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:51,357 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:51,364 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38164': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:51,364 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:51,463 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38168': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:51,463 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:51,470 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38176': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:51,470 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:51,570 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36596': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:51,570 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:51,576 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36600': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:51,576 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:51,676 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36604': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:51,676 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:51,682 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36620': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:51,683 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:51,783 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36630': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:51,783 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:51,789 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36642': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:51,789 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:51,889 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36646': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:51,889 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:51,895 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36650': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:51,895 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:51,996 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:51,996 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36658': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:52,001 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36670': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:52,001 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:52,102 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:52,102 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36676': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:52,107 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36692': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:52,107 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:52,208 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36696': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:52,208 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:52,213 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36704': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:52,213 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:52,315 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:52,319 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36714': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:52,319 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36718': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:52,319 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:52,421 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:52,425 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36730': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:52,425 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36740': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:52,425 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:52,527 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:52,531 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36750': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:52,531 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36752': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:52,532 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:52,634 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:52,637 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36760': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:52,638 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36762': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:52,638 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:52,741 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:52,744 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36768': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:52,745 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36776': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:52,745 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:52,848 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:52,851 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36788': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:52,852 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36802': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:52,852 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:52,954 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:52,958 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36806': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:52,958 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36808': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:52,958 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:53,060 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:53,064 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36822': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:53,064 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36838': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:53,064 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:53,167 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:53,170 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36840': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:53,171 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36854': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:53,171 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:53,273 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:53,276 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36862': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:53,277 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36866': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:53,277 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:53,379 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:53,383 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36874': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:53,383 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36880': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:53,383 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:53,485 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36896': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:53,485 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:53,489 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36910': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:53,490 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:53,591 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36924': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:53,591 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:53,596 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36930': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:53,596 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:53,697 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36940': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:53,697 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:53,702 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36944': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:53,702 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:53,804 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:53,808 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36958': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:53,809 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36970': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:53,809 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:53,911 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:53,914 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:53,915 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37000': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:53,915 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:54,017 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:54,021 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37012': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:54,021 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37028': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:54,021 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:54,124 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:54,127 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37036': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:54,128 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37040': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:54,128 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:54,230 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:54,234 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37048': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:54,235 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37060': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:54,235 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:54,336 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37076': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:54,336 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:54,341 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37082': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:54,341 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:54,450 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:54,454 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37084': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:54,454 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37094': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:54,454 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:54,557 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:54,560 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37106': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:54,561 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37108': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:54,561 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:54,663 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:54,666 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37124': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:54,667 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37134': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:54,667 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:54,769 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:54,773 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37144': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:54,773 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37148': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:54,773 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:54,875 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:54,879 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37158': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:54,879 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37166': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:54,879 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:54,981 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:54,985 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37178': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:54,985 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37194': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:54,985 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:55,088 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:55,091 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37200': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:55,092 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37212': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:55,092 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:55,194 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:55,198 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37214': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:55,198 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37226': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:55,198 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:55,300 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:55,304 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37236': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:55,304 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37244': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:55,304 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:55,407 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:55,410 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37260': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:55,411 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37266': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:55,411 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:55,513 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:55,516 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37272': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:55,517 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37282': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:55,517 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:55,619 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:55,623 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37294': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:55,623 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37304': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:55,623 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:55,725 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:55,729 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37320': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:55,730 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37328': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:55,730 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:55,832 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:55,836 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37332': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:55,836 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37334': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:55,836 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:55,938 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:55,942 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37344': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:55,942 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37350': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:55,942 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:56,045 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:56,048 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37354': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:56,049 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37356': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:56,049 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:56,152 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:56,155 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37360': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:56,156 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37374': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:56,156 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:56,258 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:56,261 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37386': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:56,262 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37398': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:56,262 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:56,364 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:56,367 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37400': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:56,368 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37408': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:56,368 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:56,470 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:56,474 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37414': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:56,474 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37428': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:56,474 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:56,577 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:56,580 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37436': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:56,581 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37440': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:56,581 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:56,683 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:56,686 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37454': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:56,687 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37468': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:56,687 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:56,789 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:56,792 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37472': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:56,793 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37476': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:56,793 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:56,895 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:56,899 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37480': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:56,900 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37486': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:56,900 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:57,002 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:57,005 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37502': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:57,006 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37508': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:57,006 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:57,108 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:57,112 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37522': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:57,112 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37528': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:57,112 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:57,214 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:57,218 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37536': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:57,218 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:57,218 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37550': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:57,320 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:57,324 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37552': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:57,324 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37566': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:57,324 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:57,427 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:57,430 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37580': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:57,431 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37584': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:57,431 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:57,533 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:57,536 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37594': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:57,537 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37602': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:57,537 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:57,639 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:57,642 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37608': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:57,643 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37622': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:57,643 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:57,745 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:57,748 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37638': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:57,749 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:57,752 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37644': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:57,852 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:57,855 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37658': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:57,856 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37672': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:57,856 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:57,958 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:57,961 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37678': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:57,962 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37690': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:57,962 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:58,064 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:58,068 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37698': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:58,068 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37712': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:58,068 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:58,171 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:58,175 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37720': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:58,176 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37722': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:58,176 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:58,278 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:58,281 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37736': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:58,282 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37738': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:58,282 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:58,384 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:58,387 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37744': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:58,388 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37754': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:58,388 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:58,490 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:58,493 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37768': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:58,494 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37776': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:58,494 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:58,596 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:58,600 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37788': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:58,600 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37802': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:58,600 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:58,702 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:58,706 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37808': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:58,706 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37820': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:58,706 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:58,808 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:58,812 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37822': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:58,812 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37834': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:58,812 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:58,914 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:58,918 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37836': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:58,918 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37852': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:58,918 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:59,021 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:59,024 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37866': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:59,025 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37882': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:59,025 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:59,127 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:59,130 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37888': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:59,131 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37902': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:59,131 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:59,233 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:59,236 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37906': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:59,237 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37920': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:59,237 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:59,339 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:59,343 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37932': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:59,343 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37946': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:59,343 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:59,445 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37950': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:59,445 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:59,450 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37964': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:59,450 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:59,552 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:59,556 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37976': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:59,556 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37990': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:59,556 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:59,658 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:59,662 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37992': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:59,662 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38006': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:59,662 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:59,764 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:59,768 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38016': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:59,769 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38030': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:59,769 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:59,870 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:59,874 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38038': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:59,875 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38046': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:59,875 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:59,977 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:11:59,980 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38056': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:59,981 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38062': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:11:59,981 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:00,083 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:00,087 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38066': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:00,087 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38076': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:00,087 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:00,189 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:00,193 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38092': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:00,194 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38100': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:00,194 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:00,296 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:00,299 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38104': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:00,300 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38106': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:00,300 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:00,402 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:00,406 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38114': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:00,406 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38118': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:00,406 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:00,508 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:00,512 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38124': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:00,512 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38132': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:00,512 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:00,614 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:00,618 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38136': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:00,618 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38150': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:00,618 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:00,720 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:00,724 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38164': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:00,724 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38180': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:00,724 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:00,827 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:00,830 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38188': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:00,831 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38202': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:00,831 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:00,933 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:00,937 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38210': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:00,937 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38214': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:00,937 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:01,039 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:01,043 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38226': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:01,043 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38236': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:01,044 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:01,146 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:01,149 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38238': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:01,150 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38254': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:01,150 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:01,254 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:01,258 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38262': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:01,259 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38264': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:01,259 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:01,361 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:01,364 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38272': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:01,365 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38284': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:01,365 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:01,467 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:01,471 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38298': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:01,471 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38300': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:01,471 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:01,573 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:01,577 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36440': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:01,577 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36444': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:01,577 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:01,679 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:01,683 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36454': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:01,683 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36466': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:01,683 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:01,786 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:01,789 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36468': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:01,790 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36478': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:01,790 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:01,892 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:01,895 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36480': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:01,896 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36494': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:01,896 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:01,998 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:02,002 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36510': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:02,002 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36522': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:02,002 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:02,105 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:02,108 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36534': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:02,109 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36544': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:02,109 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:02,211 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:02,214 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36552': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:02,215 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36568': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:02,215 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:02,317 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:02,321 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36576': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:02,321 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36588': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:02,321 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:02,424 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:02,427 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36596': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:02,427 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36600': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:02,428 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:02,530 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:02,533 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36612': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:02,534 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36624': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:02,534 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:02,636 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:02,640 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36628': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:02,640 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36640': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:02,640 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:02,755 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:02,755 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36652': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:02,756 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:02,758 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36656': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:02,861 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:02,865 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36666': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:02,866 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36670': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:02,866 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:02,969 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:02,972 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36672': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:02,973 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36678': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:02,973 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:03,075 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:03,079 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36686': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:03,079 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36700': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:03,079 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:03,182 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:03,185 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36712': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:03,186 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:03,186 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:03,288 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:03,291 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36728': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:03,292 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36730': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:03,292 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:03,394 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:03,398 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36740': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:03,398 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36750': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:03,398 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:03,500 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:03,504 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36766': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:03,504 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36770': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:03,505 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:03,607 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:03,610 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36784': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:03,611 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36786': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:03,611 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:03,713 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:03,716 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36792': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:03,717 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36806': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:03,717 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:03,819 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:03,822 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36808': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:03,823 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36822': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:03,823 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:03,925 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:03,929 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36834': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:03,929 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36848': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:03,929 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:04,031 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:04,035 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36856': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:04,035 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36858': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:04,035 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:04,137 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:04,141 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36864': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:04,142 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36872': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:04,142 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:04,243 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:04,247 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36888': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:04,248 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:04,250 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36892': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:04,350 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:04,354 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36896': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:04,354 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36898': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:04,354 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:04,456 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:04,460 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36904': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:04,460 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36910': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:04,460 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:04,562 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:04,566 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36914': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:04,566 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36930': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:04,566 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:04,670 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:04,673 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36938': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:04,674 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36954': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:04,674 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:04,776 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:04,780 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36970': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:04,781 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36974': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:04,781 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:04,882 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:04,886 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36980': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:04,886 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36996': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:04,887 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:04,988 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:04,992 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36998': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:04,993 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37004': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:04,993 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:05,095 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:05,098 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37006': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:05,099 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37010': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:05,099 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:05,201 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:05,205 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37020': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:05,205 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37034': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:05,205 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:05,307 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:05,311 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37042': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:05,312 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:05,312 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:05,414 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:05,417 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37068': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:05,418 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37084': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:05,418 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:05,520 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:05,523 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37094': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:05,524 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37110': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:05,524 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:05,626 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:05,630 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37124': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:05,630 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37130': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:05,630 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:05,733 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:05,736 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37132': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:05,737 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37148': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:05,737 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:05,839 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:05,843 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37154': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:05,843 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37168': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:05,843 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:05,945 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:05,949 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37172': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:05,949 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37184': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:05,949 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:06,051 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:06,055 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37186': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:06,056 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37188': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:06,056 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:06,158 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:06,161 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37198': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:06,162 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37208': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:06,162 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:06,264 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:06,268 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37212': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:06,268 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37226': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:06,268 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:06,371 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:06,375 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37242': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:06,375 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37254': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:06,375 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:06,478 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:06,481 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37260': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:06,482 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37264': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:06,482 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:06,584 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:06,587 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37270': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:06,588 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37284': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:06,588 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:06,690 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:06,694 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37294': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:06,694 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37310': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:06,694 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:06,797 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:06,800 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37316': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:06,801 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37326': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:06,801 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:06,903 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:06,906 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37334': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:06,907 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37342': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:06,907 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:07,011 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:07,015 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37344': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:07,015 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37350': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:07,015 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:07,118 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:07,121 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37354': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:07,122 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37368': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:07,122 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:07,224 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:07,228 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37372': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:07,228 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37374': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:07,228 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:07,330 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:07,334 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37382': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:07,334 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37390': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:07,334 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:07,436 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:07,440 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37394': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:07,441 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37398': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:07,441 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:07,543 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:07,546 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37402': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:07,547 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37410': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:07,547 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:07,649 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:07,652 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37418': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:07,653 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37420': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:07,653 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:07,755 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:07,758 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37436': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:07,759 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37452': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:07,759 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:07,861 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:07,864 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37454': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:07,865 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37462': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:07,865 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:07,967 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:07,971 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37464': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:07,971 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37472': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:07,971 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:08,074 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:08,078 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37480': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:08,078 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37482': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:08,078 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:08,180 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:08,184 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37484': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:08,184 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37488': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:08,184 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:08,286 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:08,290 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37496': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:08,291 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37502': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:08,291 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:08,393 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:08,396 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37512': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:08,397 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37520': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:08,397 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:08,499 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:08,502 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37524': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:08,503 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37528': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:08,503 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:08,605 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:08,609 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37530': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:08,609 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37542': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:08,609 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:08,711 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:08,715 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37548': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:08,715 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37560': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:08,715 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:08,818 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:08,821 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37576': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:08,822 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37586': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:08,822 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:08,924 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:08,928 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37592': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:08,928 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37600': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:08,928 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:09,030 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:09,034 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37604': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:09,034 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37608': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:09,034 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:09,136 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:09,140 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37614': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:09,141 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37616': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:09,141 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:09,243 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:09,246 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37630': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:09,247 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:09,249 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37646': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:09,349 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:09,353 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37650': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:09,353 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37658': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:09,353 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:09,455 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:09,459 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37660': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:09,459 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37674': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:09,459 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:09,562 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:09,565 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37680': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:09,566 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37682': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:09,566 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:09,668 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:09,671 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37686': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:09,672 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37702': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:09,672 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:09,775 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:09,778 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37706': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:09,779 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37716': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:09,779 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:09,881 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:09,884 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37722': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:09,885 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:09,885 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:09,987 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:09,990 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37738': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:09,991 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37750': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:09,991 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:10,095 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:10,099 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37760': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:10,099 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37764': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:10,099 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:10,201 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:10,205 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37770': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:10,205 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37780': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:10,205 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:10,307 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:10,311 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37784': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:10,312 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37786': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:10,312 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:10,413 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:10,417 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37792': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:10,418 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37798': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:10,418 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:10,519 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37812': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:10,519 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:10,524 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37824': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:10,524 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:10,625 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37836': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:10,626 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:10,630 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37844': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:10,630 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:10,732 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37858': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:10,732 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:10,736 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37874': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:10,736 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:10,838 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:10,838 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37876': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:10,843 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37878': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:10,843 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:10,944 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:10,944 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37880': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:10,949 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37896': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:10,949 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:11,050 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37902': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:11,050 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:11,055 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37910': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:11,055 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:11,156 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37916': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:11,156 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:11,161 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37920': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:11,161 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:11,262 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37928': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:11,262 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:11,267 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37936': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:11,267 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:11,368 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37946': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:11,368 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:11,372 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37962': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:11,372 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:11,475 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:11,478 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37964': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:11,479 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37966': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:11,479 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:11,581 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:35590': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:11,581 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:11,586 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:35604': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:11,586 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:11,687 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:35614': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:11,687 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:11,692 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:35622': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:11,692 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:11,793 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:11,793 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:35636': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:11,798 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:35640': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:11,798 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:11,900 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:35648': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:11,900 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:11,904 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:35656': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:11,904 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:12,006 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:12,006 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:35668': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:12,011 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:35682': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:12,011 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:12,112 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:12,112 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:35696': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:12,116 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:35710': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:12,116 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:12,218 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:12,218 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:35712': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:12,223 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:35714': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:12,223 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:12,324 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:12,324 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:35722': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:12,329 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:35732': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:12,329 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:12,430 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:12,430 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:35738': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:12,435 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:35746': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:12,435 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:12,536 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:12,536 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:35754': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:12,542 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:35758': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:12,542 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:12,643 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:12,643 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:35768': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:12,648 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:35774': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:12,648 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:12,749 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:12,751 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:35786': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:12,756 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:35798': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:12,756 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:12,856 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:35814': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:12,856 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:12,862 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:35816': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:12,862 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:12,962 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:35828': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:12,962 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:12,968 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:35842': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:12,968 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:13,077 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:13,080 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:35844': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:13,080 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:35846': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:13,081 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:13,184 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:13,187 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:35862': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:13,188 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:35868': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:13,188 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:13,290 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:13,293 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:35876': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:13,294 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:35884': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:13,294 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:13,396 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:13,399 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:35888': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:13,400 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:35898': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:13,400 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:13,502 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:13,506 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:35902': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:13,506 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:35912': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:13,507 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:13,609 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:13,612 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:35918': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:13,613 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:35934': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:13,613 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:13,715 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:13,718 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:35940': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:13,719 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:35944': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:13,719 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:13,821 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:13,825 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:35948': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:13,825 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:35960': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:13,825 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:13,928 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:13,931 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:35964': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:13,932 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:35980': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:13,932 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:14,034 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:14,037 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:35992': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:14,038 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:35996': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:14,038 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:14,140 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:14,144 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36006': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:14,144 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36020': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:14,144 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:14,246 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:14,252 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36032': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:14,253 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36044': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:14,253 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:14,352 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36050': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:14,352 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:14,359 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36062': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:14,359 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:14,458 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36078': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:14,458 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:14,465 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36094': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:14,465 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:14,564 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36110': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:14,564 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:14,571 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36114': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:14,571 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:14,670 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:14,670 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:14,677 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36126': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:14,677 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:14,776 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36136': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:14,776 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:14,783 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36144': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:14,783 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:14,883 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36152': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:14,883 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:14,889 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36168': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:14,889 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:14,990 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:14,990 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36176': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:14,995 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36180': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:14,995 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:15,096 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:15,096 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36184': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:15,102 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36192': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:15,102 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:15,202 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36206': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:15,202 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:15,208 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36222': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:15,208 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:15,309 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36230': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:15,309 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:15,314 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36240': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:15,314 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:15,415 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36246': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:15,415 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:15,420 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36258': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:15,420 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:15,521 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:15,521 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36268': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:15,526 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:15,526 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36276': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:15,627 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:15,627 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36278': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:15,632 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36280': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:15,632 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:15,734 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:15,734 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36294': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:15,739 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36298': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:15,739 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:15,840 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36312': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:15,840 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:15,845 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36328': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:15,845 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:15,946 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36330': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:15,946 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:15,951 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36332': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:15,951 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:16,053 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:16,056 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36340': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:16,057 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36356': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:16,057 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:16,159 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:16,162 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36372': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:16,163 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36376': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:16,163 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:16,265 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36380': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:16,265 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:16,270 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36382': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:16,270 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:16,372 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:16,372 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36398': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:16,376 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36412': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:16,376 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:16,478 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:16,478 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36422': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:16,482 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36436': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:16,482 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:16,585 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:16,588 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36446': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:16,589 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36454': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:16,589 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:16,691 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:16,694 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36456': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:16,695 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36472': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:16,695 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:16,797 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:16,801 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36482': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:16,801 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36488': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:16,801 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:16,903 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:16,907 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36492': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:16,907 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36498': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:16,907 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:17,009 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36502': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:17,009 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:17,014 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36512': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:17,014 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:17,115 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:17,115 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36528': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:17,120 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36534': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:17,120 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:17,221 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36550': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:17,221 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:17,226 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36552': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:17,226 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:17,327 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36556': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:17,327 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:17,332 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36564': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:17,332 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:17,433 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36570': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:17,433 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:17,438 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36582': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:17,439 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:17,540 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:17,540 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36596': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:17,545 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36604': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:17,545 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:17,646 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:17,646 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36608': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:17,651 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36624': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:17,651 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:17,754 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:17,758 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36628': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:17,758 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36642': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:17,758 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:17,860 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:17,864 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36654': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:17,865 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36668': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:17,865 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:17,966 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:17,970 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36676': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:17,971 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36680': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:17,971 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:18,073 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:18,076 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36686': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:18,077 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36692': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:18,077 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:18,179 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:18,182 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36708': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:18,183 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36710': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:18,183 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:18,285 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:18,289 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36720': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:18,290 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36722': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:18,290 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:18,392 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:18,395 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36736': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:18,396 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36750': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:18,396 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:18,498 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:18,501 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36760': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:18,502 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36770': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:18,502 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:18,604 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:18,608 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36786': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:18,608 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36790': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:18,608 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:18,710 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:18,714 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:18,714 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36804': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:18,714 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:18,816 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:18,820 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36814': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:18,820 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36830': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:18,820 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:18,922 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:18,926 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36840': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:18,927 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36844': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:18,927 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:19,028 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36848': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:19,028 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:19,033 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36852': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:19,033 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:19,135 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:19,138 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36862': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:19,139 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36870': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:19,139 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:19,241 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36882': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:19,241 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:19,246 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36892': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:19,246 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:19,347 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36902': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:19,347 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:19,352 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36904': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:19,352 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:19,453 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:19,453 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36918': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:19,458 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36924': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:19,458 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:19,559 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36928': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:19,559 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:19,564 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36942': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:19,564 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:19,666 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:19,669 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36948': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:19,670 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36952': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:19,670 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:19,772 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:19,776 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36956': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:19,776 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36970': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:19,776 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:19,878 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:19,882 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36974': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:19,882 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36976': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:19,882 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:19,985 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:19,989 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:19,989 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36998': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:19,989 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:20,091 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:20,095 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37008': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:20,095 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37020': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:20,095 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:20,198 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:20,201 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37026': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:20,202 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37028': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:20,202 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:20,304 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:20,307 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37040': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:20,308 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37050': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:20,308 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:20,410 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:20,413 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37056': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:20,414 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37070': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:20,414 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:20,516 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:20,520 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37080': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:20,520 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37082': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:20,520 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:20,622 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:20,626 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37090': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:20,626 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37098': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:20,626 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:20,728 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:20,732 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37102': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:20,733 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37110': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:20,733 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:20,835 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:20,838 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37116': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:20,839 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:20,839 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:20,941 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:20,944 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37134': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:20,945 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37138': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:20,945 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:21,048 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:21,051 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37148': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:21,052 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37156': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:21,052 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:21,154 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:21,158 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37160': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:21,158 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37166': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:21,158 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:21,260 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:21,264 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37180': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:21,264 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37182': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:21,264 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:21,367 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:21,370 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37194': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:21,371 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37202': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:21,371 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:21,473 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:21,476 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37216': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:21,477 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37220': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:21,477 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:21,579 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:21,583 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37116': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:21,583 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37124': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:21,583 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:21,686 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:21,690 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37128': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:21,690 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37142': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:21,690 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:21,793 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:21,796 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37158': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:21,797 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37170': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:21,797 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:21,899 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:21,903 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37174': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:21,903 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37190': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:21,903 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:22,005 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:22,009 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37192': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:22,009 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37206': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:22,009 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:22,112 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:22,115 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37208': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:22,116 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37212': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:22,116 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:22,218 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:22,221 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37228': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:22,222 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37244': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:22,222 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:22,324 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:22,327 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37260': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:22,328 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37276': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:22,328 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:22,430 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:22,434 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37286': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:22,435 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37290': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:22,435 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:22,536 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:22,536 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37300': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:22,541 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37314': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:22,541 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:22,642 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:22,642 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37316': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:22,648 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37332': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:22,648 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:22,748 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:22,751 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37334': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:22,756 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37346': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:22,756 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:22,855 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37360': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:22,855 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:22,862 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37372': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:22,862 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:22,961 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37374': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:22,961 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:22,968 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37388': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:22,968 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:23,067 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37404': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:23,067 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:23,075 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37410': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:23,075 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:23,173 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37412': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:23,173 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:23,181 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37426': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:23,181 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:23,279 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37440': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:23,279 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:23,287 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37450': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:23,287 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:23,386 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37466': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:23,386 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:23,393 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37468': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:23,393 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:23,492 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37476': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:23,492 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:23,499 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37486': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:23,499 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:23,598 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37502': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:23,598 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:23,605 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37506': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:23,605 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:23,704 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:23,704 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37520': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:23,711 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37526': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:23,711 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:23,810 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37538': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:23,810 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:23,817 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37546': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:23,817 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:23,916 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37548': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:23,916 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:23,923 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37560': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:23,923 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:24,022 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37566': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:24,022 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:24,029 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37568': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:24,029 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:24,128 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37584': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:24,128 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:24,135 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37598': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:24,135 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:24,235 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37608': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:24,235 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:24,241 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37612': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:24,241 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:24,341 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37618': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:24,341 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:24,347 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37624': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:24,347 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:24,447 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37628': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:24,447 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:24,453 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37640': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:24,453 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:24,553 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:24,553 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37650': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:24,558 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37652': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:24,558 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:24,660 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:24,663 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37658': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:24,664 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37674': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:24,664 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:24,766 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:24,769 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37686': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:24,770 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37694': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:24,770 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:24,872 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:24,875 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37710': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:24,876 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:24,876 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:24,978 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:24,982 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37728': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:24,982 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37744': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:24,982 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:25,085 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:25,088 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37758': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:25,089 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37764': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:25,089 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:25,191 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:25,195 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37766': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:25,195 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37776': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:25,195 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:25,297 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:25,301 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37780': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:25,302 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:25,302 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:25,404 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:25,407 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37804': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:25,408 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37808': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:25,408 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:25,510 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:25,513 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37822': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:25,514 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37826': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:25,514 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:25,616 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:25,619 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37838': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:25,620 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37844': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:25,620 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:25,722 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:25,726 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37848': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:25,726 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37860': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:25,726 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:25,838 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:25,841 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37870': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:25,841 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37886': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:25,841 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:25,944 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:25,947 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37898': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:25,948 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37902': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:25,948 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:26,050 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:26,054 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37906': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:26,054 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37916': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:26,054 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:26,156 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:26,160 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37928': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:26,160 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37938': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:26,161 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:26,262 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:26,266 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37952': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:26,267 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37956': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:26,267 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:26,369 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:26,372 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37960': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:26,373 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37970': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:26,373 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:26,475 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:26,478 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37972': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:26,479 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:26,479 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:26,581 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:26,585 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37988': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:26,585 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38002': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:26,585 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:26,687 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:26,691 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38014': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:26,691 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38028': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:26,691 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:26,794 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:26,798 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38042': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:26,798 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38054': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:26,798 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:26,900 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:26,904 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38056': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:26,904 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38060': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:26,904 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:27,007 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:27,010 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38074': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:27,011 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38078': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:27,011 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:27,113 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:27,117 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38082': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:27,117 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38088': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:27,117 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:27,220 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:27,223 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38100': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:27,223 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38106': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:27,223 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:27,326 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:27,329 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38110': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:27,330 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38124': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:27,330 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:27,432 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:27,435 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38134': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:27,436 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38138': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:27,436 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:27,538 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:27,542 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38150': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:27,542 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38154': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:27,542 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:27,644 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:27,648 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38170': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:27,648 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38184': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:27,648 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:27,753 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:27,756 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38194': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:27,757 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38204': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:27,757 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:27,859 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:27,863 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38212': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:27,864 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38216': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:27,864 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:27,966 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:27,969 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38226': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:27,970 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38240': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:27,970 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:28,072 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:28,075 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38248': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:28,076 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38256': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:28,076 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:28,178 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:28,181 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38266': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:28,182 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38282': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:28,182 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:28,284 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:28,288 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38288': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:28,288 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38294': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:28,288 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:28,391 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:28,394 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38300': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:28,395 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38310': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:28,395 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:28,497 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:28,501 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38324': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:28,502 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38336': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:28,502 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:28,604 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:28,607 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38342': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:28,608 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38358': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:28,608 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:28,710 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:28,713 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38360': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:28,714 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38374': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:28,714 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:28,816 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:28,820 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38380': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:28,820 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38388': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:28,820 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:28,923 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:28,926 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38396': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:28,927 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38408': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:28,927 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:29,029 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:29,032 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38414': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:29,033 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38430': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:29,033 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:29,135 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:29,139 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38442': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:29,139 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38454': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:29,139 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:29,241 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:29,245 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38458': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:29,245 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38474': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:29,245 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:29,348 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:29,351 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38480': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:29,352 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38488': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:29,352 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:29,454 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:29,457 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38500': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:29,458 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38502': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:29,458 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:29,560 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:29,564 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38512': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:29,564 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38522': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:29,564 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:29,666 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:29,670 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38534': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:29,671 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38548': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:29,671 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:29,772 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:29,776 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38550': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:29,777 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38562': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:29,777 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:29,879 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38578': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:29,879 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:29,883 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38584': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:29,883 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:29,985 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38600': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:29,985 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:29,990 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38604': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:29,990 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:30,091 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:30,091 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38616': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:30,096 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38630': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:30,096 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:30,198 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:30,202 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38638': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:30,202 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38642': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:30,202 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:30,304 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:30,308 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38650': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:30,309 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38656': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:30,309 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:30,410 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38658': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:30,410 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:30,415 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38670': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:30,415 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:30,517 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38672': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:30,517 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:30,521 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38680': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:30,522 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:30,623 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:30,624 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38682': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:30,629 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38690': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:30,629 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:30,730 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:30,730 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38696': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:30,735 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38702': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:30,735 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:30,836 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:30,836 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38716': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:30,841 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38728': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:30,841 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:30,942 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:30,942 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38740': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:30,947 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38742': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:30,947 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:31,048 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:31,048 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38750': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:31,053 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38766': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:31,053 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:31,155 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38776': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:31,154 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:31,160 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38790': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:31,160 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:31,261 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:31,261 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38792': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:31,266 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:31,266 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:31,367 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38800': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:31,367 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:31,372 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38810': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:31,372 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:31,473 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:31,473 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38820': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:31,478 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38832': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:31,478 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:31,579 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:31,579 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:55872': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:31,584 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:55884': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:31,584 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:31,686 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:55888': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:31,686 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:31,691 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:55904': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:31,691 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:31,792 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:55906': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:31,792 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:31,797 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:55916': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:31,797 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:31,899 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:31,902 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:55924': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:31,903 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:55938': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:31,903 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:32,005 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:32,009 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:55950': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:32,009 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:55954': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:32,009 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:32,111 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:32,115 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:55956': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:32,116 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:55960': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:32,116 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:32,217 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:32,217 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:55972': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:32,223 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:55982': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:32,223 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:32,324 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:32,324 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:55996': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:32,329 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56006': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:32,329 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:32,430 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56008': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:32,430 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:32,435 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56024': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:32,435 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:32,536 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56030': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:32,536 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:32,542 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56034': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:32,542 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:32,642 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56048': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:32,642 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:32,648 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56064': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:32,648 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:32,748 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:32,750 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56080': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:32,755 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56084': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:32,755 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:32,854 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56088': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:32,855 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:32,861 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56092': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:32,861 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:32,961 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56100': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:32,961 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:32,967 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56116': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:32,967 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:33,067 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56132': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:33,067 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:33,073 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56140': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:33,073 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:33,174 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:33,174 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56156': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:33,179 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56164': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:33,179 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:33,280 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56170': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:33,280 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:33,285 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56182': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:33,285 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:33,387 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:33,387 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56186': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:33,391 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56190': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:33,391 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:33,493 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:33,497 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56198': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:33,497 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56210': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:33,497 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:33,600 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:33,603 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56212': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:33,604 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56214': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:33,604 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:33,706 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:33,709 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56224': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:33,710 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56240': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:33,710 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:33,813 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:33,816 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56250': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:33,817 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56262': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:33,817 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:33,919 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:33,922 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56276': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:33,923 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56292': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:33,923 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:34,025 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:34,029 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56300': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:34,030 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56308': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:34,030 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:34,132 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:34,135 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56324': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:34,136 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56336': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:34,136 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:34,238 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:34,242 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56346': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:34,242 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56348': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:34,242 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:34,344 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:34,348 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56364': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:34,349 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56366': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:34,349 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:34,450 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:34,454 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56368': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:34,455 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56378': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:34,455 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:34,557 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:34,560 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56394': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:34,561 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56404': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:34,561 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:34,663 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:34,666 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56418': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:34,667 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56434': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:34,667 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:34,769 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:34,773 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56438': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:34,773 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56440': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:34,773 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:34,875 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:34,879 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56444': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:34,880 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56460': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:34,880 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:34,982 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:34,985 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56466': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:34,986 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56474': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:34,986 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:35,088 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:35,091 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56476': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:35,092 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56490': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:35,092 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:35,194 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:35,197 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56502': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:35,198 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56518': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:35,198 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:35,301 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:35,305 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56526': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:35,305 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56540': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:35,305 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:35,409 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:35,412 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56542': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:35,413 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56552': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:35,413 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:35,515 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:35,518 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56568': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:35,519 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56580': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:35,519 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:35,621 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:35,625 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56582': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:35,625 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56592': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:35,625 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:35,727 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:35,731 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56598': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:35,731 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56600': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:35,731 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:35,834 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:35,837 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56616': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:35,838 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56632': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:35,838 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:35,940 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:35,943 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56638': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:35,944 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56650': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:35,944 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:36,047 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:36,050 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56666': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:36,051 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56674': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:36,051 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:36,153 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:36,156 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56678': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:36,157 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56686': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:36,157 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:36,259 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:36,262 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56696': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:36,263 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56704': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:36,263 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:36,366 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:36,369 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56714': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:36,370 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56726': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:36,370 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:36,472 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:36,475 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56736': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:36,476 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56746': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:36,476 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:36,578 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:36,582 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56762': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:36,582 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56766': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:36,582 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:36,685 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:36,688 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56778': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:36,689 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56782': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:36,689 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:36,791 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:36,794 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56786': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:36,795 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56790': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:36,795 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:36,897 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:36,901 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56802': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:36,901 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56816': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:36,901 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:37,004 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:37,008 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56826': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:37,008 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56834': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:37,008 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:37,111 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:37,114 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56850': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:37,115 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56866': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:37,115 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:37,217 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:37,221 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56878': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:37,222 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56888': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:37,222 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:37,323 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56902': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:37,323 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:37,328 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56914': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:37,328 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:37,429 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56922': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:37,429 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:37,435 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56932': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:37,435 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:37,536 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:37,536 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56936': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:37,541 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56940': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:37,541 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:37,642 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:37,642 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56954': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:37,647 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56958': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:37,647 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:37,748 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:37,750 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56960': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:37,755 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56966': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:37,755 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:37,854 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56978': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:37,854 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:37,861 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56986': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:37,861 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:37,960 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57002': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:37,960 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:37,968 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57016': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:37,968 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:38,067 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57026': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:38,067 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:38,074 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57028': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:38,074 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:38,173 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57044': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:38,173 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:38,180 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57046': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:38,180 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:38,279 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57062': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:38,279 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:38,286 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57070': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:38,286 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:38,385 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57072': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:38,385 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:38,392 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57084': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:38,392 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:38,492 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57088': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:38,492 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:38,498 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:38,498 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57092': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:38,598 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57100': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:38,598 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:38,604 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57104': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:38,604 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:38,706 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:38,709 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57114': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:38,710 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57130': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:38,710 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:38,812 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:38,816 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57132': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:38,816 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57146': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:38,816 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:38,918 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:38,922 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57150': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:38,922 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57166': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:38,922 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:39,024 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:39,028 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57176': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:39,028 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57178': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:39,028 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:39,130 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:39,134 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57190': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:39,134 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57200': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:39,134 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:39,236 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:39,240 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57210': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:39,241 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57218': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:39,241 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:39,343 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:39,346 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57220': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:39,347 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57222': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:39,347 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:39,449 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:39,453 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57236': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:39,453 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57252': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:39,453 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:39,555 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:39,559 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57262': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:39,559 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57266': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:39,559 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:39,661 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:39,665 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57280': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:39,665 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57282': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:39,665 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:39,767 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:39,771 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57296': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:39,772 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57304': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:39,772 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:39,874 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:39,877 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57316': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:39,878 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57330': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:39,878 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:39,980 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:39,983 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57342': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:39,984 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57354': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:39,984 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:40,086 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:40,089 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57368': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:40,090 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57374': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:40,090 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:40,193 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:40,197 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57376': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:40,197 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57388': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:40,197 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:40,299 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:40,303 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57404': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:40,304 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57406': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:40,304 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:40,406 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:40,410 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57418': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:40,411 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:40,411 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57428': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:40,513 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:40,516 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57434': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:40,517 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57450': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:40,517 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:40,619 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:40,623 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57458': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:40,623 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57466': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:40,623 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:40,725 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:40,729 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57476': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:40,730 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57486': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:40,730 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:40,832 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:40,835 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57498': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:40,836 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57502': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:40,836 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:40,938 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:40,941 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57508': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:40,942 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57520': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:40,942 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:41,044 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:41,048 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57530': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:41,048 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57536': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:41,048 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:41,150 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:41,154 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57544': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:41,155 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57558': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:41,155 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:41,257 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:41,261 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57562': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:41,261 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57578': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:41,261 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:41,363 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57582': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:41,363 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:41,368 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57590': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:41,368 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:41,469 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:41,469 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57596': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:41,474 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57608': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:41,474 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:41,575 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:41,576 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56288': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:41,581 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56302': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:41,581 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:41,682 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56308': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:41,682 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:41,687 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56318': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:41,687 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:41,790 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:41,794 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56330': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:41,794 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56344': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:41,795 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:41,897 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:41,900 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56350': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:41,901 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56352': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:41,901 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:42,003 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:42,007 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56368': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:42,007 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56378': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:42,007 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:42,110 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:42,114 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56380': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:42,114 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56388': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:42,114 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:42,217 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:42,220 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56394': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:42,221 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56400': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:42,221 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:42,323 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:42,327 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56408': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:42,327 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56416': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:42,327 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:42,429 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:42,433 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56424': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:42,433 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56438': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:42,433 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:42,535 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:42,539 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56450': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:42,539 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56466': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:42,539 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:42,641 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:42,645 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56482': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:42,646 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56490': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:42,646 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:42,748 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:42,754 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56502': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:42,754 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56508': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:42,754 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:42,854 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56518': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:42,854 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:42,860 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56532': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:42,860 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:42,960 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56538': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:42,960 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:42,967 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56540': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:42,967 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:43,067 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56552': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:43,067 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:43,073 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56556': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:43,073 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:43,174 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56572': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:43,174 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:43,179 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56580': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:43,179 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:43,280 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56582': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:43,280 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:43,286 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56594': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:43,286 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:43,387 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56606': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:43,387 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:43,392 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56610': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:43,392 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:43,493 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:43,493 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56620': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:43,498 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56622': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:43,498 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:43,600 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56626': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:43,600 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:43,605 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56634': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:43,605 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:43,706 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56642': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:43,706 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:43,711 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56654': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:43,711 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:43,814 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:43,817 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56670': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:43,818 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56684': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:43,818 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:43,920 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:43,924 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56696': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:43,924 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56702': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:43,924 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:44,027 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:44,030 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56710': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:44,031 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56712': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:44,031 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:44,133 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:44,137 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56720': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:44,137 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56730': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:44,137 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:44,239 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:44,243 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56732': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:44,243 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56744': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:44,243 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:44,346 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:44,349 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56756': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:44,350 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56766': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:44,350 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:44,452 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:44,456 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56776': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:44,456 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56780': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:44,456 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:44,558 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:44,562 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56784': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:44,563 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56790': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:44,563 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:44,665 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:44,668 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:44,669 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56812': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:44,669 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:44,771 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:44,775 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56820': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:44,775 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56834': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:44,776 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:44,877 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56840': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:44,877 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:44,882 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56846': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:44,882 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:44,985 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56862': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:44,985 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:44,990 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56866': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:44,990 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:45,093 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:45,096 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56882': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:45,097 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56896': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:45,097 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:45,199 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:45,203 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56912': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:45,204 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56918': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:45,204 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:45,305 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:45,309 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56934': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:45,310 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56944': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:45,310 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:45,412 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:45,415 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56956': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:45,416 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56964': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:45,416 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:45,518 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:45,522 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56978': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:45,523 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56982': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:45,523 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:45,625 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:45,628 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:56994': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:45,629 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57008': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:45,629 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:45,731 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:45,735 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57022': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:45,735 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57038': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:45,735 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:45,837 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:45,841 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57040': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:45,841 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57052': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:45,841 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:45,944 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:45,947 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:45,948 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57064': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:45,948 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:46,050 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:46,054 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57070': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:46,054 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57076': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:46,054 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:46,156 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:46,160 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57084': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:46,160 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57088': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:46,161 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:46,263 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:46,266 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57098': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:46,267 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57100': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:46,267 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:46,369 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:46,372 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57116': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:46,373 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57130': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:46,373 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:46,475 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:46,478 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57138': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:46,479 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57140': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:46,479 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:46,581 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:46,585 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57150': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:46,585 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57160': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:46,585 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:46,687 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:46,691 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57172': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:46,691 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57182': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:46,692 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:46,794 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:46,797 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57194': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:46,798 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57202': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:46,798 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:46,900 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:46,903 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57208': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:46,904 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57216': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:46,904 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:47,006 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:47,009 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57218': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:47,010 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57230': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:47,010 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:47,112 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:47,116 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57242': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:47,116 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:47,117 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57244': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:47,220 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:47,223 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57248': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:47,224 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57254': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:47,224 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:47,326 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:47,329 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57270': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:47,330 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57286': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:47,330 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:47,432 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:47,436 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57288': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:47,436 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57302': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:47,436 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:47,539 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:47,542 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57316': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:47,543 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57326': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:47,543 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:47,645 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:47,649 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57342': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:47,649 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57346': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:47,649 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:47,754 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:47,757 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57352': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:47,758 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57360': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:47,758 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:47,860 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:47,864 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57362': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:47,864 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57370': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:47,864 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:47,966 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:47,970 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57384': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:47,970 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57390': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:47,970 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:48,073 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:48,076 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57404': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:48,077 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57408': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:48,077 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:48,179 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:48,182 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57418': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:48,183 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57420': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:48,183 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:48,285 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:48,289 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57424': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:48,289 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57430': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:48,289 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:48,391 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:48,395 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57446': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:48,396 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57458': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:48,396 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:48,498 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:48,502 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57462': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:48,503 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57478': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:48,503 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:48,605 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:48,608 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57486': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:48,609 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57488': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:48,609 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:48,711 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:48,715 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57500': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:48,715 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57510': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:48,715 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:48,817 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:48,820 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57512': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:48,821 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57524': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:48,821 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:48,923 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:48,927 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57528': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:48,928 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57538': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:48,928 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:49,030 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:49,033 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57544': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:49,034 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57558': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:49,034 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:49,136 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:49,139 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57564': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:49,140 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57568': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:49,140 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:49,242 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:49,246 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57584': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:49,246 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:49,249 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57588': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:49,348 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:49,352 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57594': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:49,353 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57610': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:49,353 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:49,454 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:49,458 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57626': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:49,459 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57640': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:49,459 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:49,561 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:49,565 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57650': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:49,565 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57664': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:49,565 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:49,667 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:49,671 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57672': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:49,672 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57682': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:49,672 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:49,774 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57686': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:49,774 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:49,787 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57702': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:49,788 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:49,882 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57708': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:49,882 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:49,894 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57710': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:49,894 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:49,989 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57722': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:49,989 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:50,001 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57738': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:50,001 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:50,095 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57750': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:50,095 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:50,107 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57764': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:50,107 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:50,201 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57770': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:50,201 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:50,214 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57776': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:50,214 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:50,308 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57784': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:50,308 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:50,320 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:50,320 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:50,414 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:50,414 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57812': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:50,426 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57828': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:50,426 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:50,520 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57836': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:50,520 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:50,532 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57844': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:50,532 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:50,628 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57858': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:50,628 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:50,638 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57864': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:50,639 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:50,734 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57880': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:50,734 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:50,745 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57892': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:50,745 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:50,840 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57904': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:50,840 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:50,851 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57914': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:50,851 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:50,946 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:50,946 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57920': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:50,958 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57924': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:50,958 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:51,053 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57928': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:51,053 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:51,064 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57930': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:51,064 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:51,159 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57944': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:51,159 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:51,171 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57954': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:51,171 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:51,266 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57962': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:51,266 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:51,277 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57976': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:51,277 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:51,372 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57982': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:51,372 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:51,383 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57996': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:51,383 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:51,478 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58008': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:51,478 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:51,490 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58014': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:51,490 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:51,585 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47644': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:51,585 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:51,596 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47648': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:51,596 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:51,691 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47652': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:51,691 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:51,702 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47660': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:51,702 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:51,797 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47662': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:51,797 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:51,808 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47666': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:51,808 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:51,904 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47680': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:51,904 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:51,915 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47686': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:51,915 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:52,010 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47702': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:52,010 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:52,021 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47704': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:52,021 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:52,116 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:52,116 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47710': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:52,128 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47714': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:52,128 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:52,223 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47726': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:52,223 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:52,234 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47730': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:52,234 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:52,330 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47744': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:52,330 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:52,340 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47760': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:52,340 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:52,448 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:52,451 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47764': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:52,452 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47770': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:52,452 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:52,554 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:52,558 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47778': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:52,559 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47792': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:52,559 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:52,660 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:52,660 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:52,665 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47798': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:52,665 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:52,766 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47810': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:52,767 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:52,771 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47816': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:52,771 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:52,873 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47826': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:52,873 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:52,878 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47828': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:52,878 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:52,979 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47840': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:52,979 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:52,984 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47844': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:52,984 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:53,085 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:53,085 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47858': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:53,091 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:53,091 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47874': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:53,192 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47888': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:53,192 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:53,197 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47904': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:53,197 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:53,298 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47912': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:53,298 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:53,303 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47922': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:53,303 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:53,405 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47930': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:53,405 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:53,410 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47942': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:53,410 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:53,511 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:53,515 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47952': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:53,516 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47960': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:53,516 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:53,618 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47962': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:53,618 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:53,623 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47968': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:53,623 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:53,724 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:53,724 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:53,731 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47996': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:53,731 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:53,830 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48012': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:53,830 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:53,840 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48026': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:53,840 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:53,936 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48030': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:53,936 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:53,949 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48040': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:53,949 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:54,044 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48050': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:54,044 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:54,057 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:54,058 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:54,150 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48068': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:54,150 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:54,166 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48078': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:54,166 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:54,256 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48092': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:54,256 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:54,275 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48102': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:54,275 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:54,363 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:54,363 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48114': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:54,384 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48130': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:54,384 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:54,470 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48132': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:54,470 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:54,492 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48138': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:54,493 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:54,577 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48142': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:54,577 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:54,603 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48156': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:54,603 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:54,684 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48162': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:54,684 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:54,711 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48176': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:54,712 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:54,790 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48192': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:54,790 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:54,820 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48202': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:54,821 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:54,896 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48214': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:54,896 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:54,929 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48224': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:54,930 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:55,003 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48232': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:55,003 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:55,038 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48236': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:55,039 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:55,109 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48242': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:55,109 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:55,147 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48254': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:55,148 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:55,216 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48268': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:55,216 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:55,256 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48274': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:55,257 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:55,322 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48284': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:55,322 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:55,365 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48296': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:55,365 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:55,429 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48304': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:55,429 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:55,474 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48308': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:55,474 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:55,535 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48318': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:55,535 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:55,583 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48326': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:55,583 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:55,642 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48332': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:55,642 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:55,692 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48336': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:55,692 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:55,749 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:55,753 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48340': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:55,801 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48346': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:55,801 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:55,855 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48360': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:55,855 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:55,909 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48362': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:55,910 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:55,961 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48364': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:55,961 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:56,018 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48370': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:56,019 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:56,068 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48380': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:56,068 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:56,127 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48390': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:56,127 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:56,174 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48396': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:56,174 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:56,250 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:56,259 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48410': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:56,282 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:56,282 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48420': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:56,360 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48430': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:56,360 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:56,390 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:56,390 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48446': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:56,470 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48448': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:56,470 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:56,497 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:56,497 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48464': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:56,580 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48478': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:56,580 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:56,605 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:56,605 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48486': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:56,690 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48490': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:56,690 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:56,712 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:56,712 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48500': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:56,799 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48516': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:56,799 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:56,819 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:56,820 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48532': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:56,909 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48542': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:56,909 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:56,927 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:56,927 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48546': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:57,019 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48552': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:57,019 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:57,034 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:57,035 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48560': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:57,130 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48568': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:57,130 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:57,141 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:57,141 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48582': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:57,240 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48588': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:57,240 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:57,248 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:57,254 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48604': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:57,349 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48606': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:57,349 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:57,356 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:57,356 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48614': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:57,459 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:57,464 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48628': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:57,464 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:57,465 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48634': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:57,568 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:57,573 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48640': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:57,573 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:57,573 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48646': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:57,678 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:57,682 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48650': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:57,682 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:57,683 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48658': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:57,787 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:57,792 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48674': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:57,792 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:57,792 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48688': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:57,898 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:57,902 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48698': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:57,902 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:57,902 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48700': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:58,007 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:58,011 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48702': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:58,011 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:58,012 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48704': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:58,117 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:58,121 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48708': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:58,121 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:58,121 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:58,226 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:58,230 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48730': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:58,231 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:58,231 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48742': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:58,336 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:58,340 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48750': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:58,340 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:58,341 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48752': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:58,445 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:58,450 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:58,450 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48760': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:58,451 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48768': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:58,555 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:58,559 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48770': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:58,560 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:58,560 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48784': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:58,665 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:58,669 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48794': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:58,669 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:58,670 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48806': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:58,774 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:58,778 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48814': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:58,779 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:58,779 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48818': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:58,884 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:58,888 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48828': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:58,888 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:58,889 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48830': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:58,993 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:58,998 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:58,998 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48844': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:58,999 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48846': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:59,103 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:59,107 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48856': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:59,107 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:59,108 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48864': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:59,213 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:59,218 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48880': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:59,218 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:59,218 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48888': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:59,322 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:59,327 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48890': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:59,327 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:59,327 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48902': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:59,433 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:59,437 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48908': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:59,437 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:59,437 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48916': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:59,544 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:59,548 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:59,548 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48924': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:59,549 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48938': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:59,654 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:59,658 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48950': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:59,658 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:59,659 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48952': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:59,764 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:59,768 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48958': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:59,768 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:59,769 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48972': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:59,874 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:59,878 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48974': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:59,878 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:59,879 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48978': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:59,983 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:59,987 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48986': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:12:59,988 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:12:59,988 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48988': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:00,093 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:00,097 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:49004': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:00,097 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:00,098 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:49012': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:00,203 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:00,207 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:49018': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:00,207 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:00,208 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:49030': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:00,312 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:00,316 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:49038': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:00,317 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:00,317 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:49040': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:00,422 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:00,426 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:49050': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:00,426 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:00,427 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:49056': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:00,532 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:00,536 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:49060': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:00,536 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:00,537 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:49066': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:00,642 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:00,646 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:49076': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:00,646 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:00,647 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:49086': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:00,751 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:00,761 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:49090': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:00,762 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:00,762 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:49102': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:00,861 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:00,861 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:49110': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:00,869 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:00,869 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:49116': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:00,971 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:00,976 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:49128': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:00,977 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:00,977 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:49132': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:01,081 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:01,085 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:49146': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:01,085 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:01,086 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:49162': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:01,191 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:01,195 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:49172': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:01,195 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:01,196 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:49174': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:01,300 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:01,304 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:49176': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:01,305 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:01,305 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:49190': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:01,419 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:01,424 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:49206': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:01,425 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:49212': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:01,425 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:01,526 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:01,527 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:49226': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:01,535 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43232': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:01,535 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:01,634 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:01,634 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43236': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:01,645 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43238': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:01,645 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:01,742 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:01,742 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43244': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:01,761 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43246': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:01,761 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:01,849 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:01,849 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43262': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:01,871 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43274': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:01,871 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:01,957 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:01,957 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43286': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:01,981 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43302': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:01,981 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:02,064 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:02,064 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43312': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:02,091 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43314': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:02,091 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:02,172 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:02,172 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43328': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:02,201 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43330': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:02,201 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:02,279 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:02,280 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43338': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:02,310 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43344': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:02,311 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:02,387 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:02,387 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43346': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:02,420 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43356': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:02,420 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:02,494 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:02,495 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43364': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:02,530 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43376': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:02,530 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:02,602 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:02,602 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43382': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:02,640 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43398': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:02,640 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:02,709 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:02,709 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43408': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:02,750 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:02,755 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43416': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:02,816 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:02,817 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43424': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:02,860 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43440': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:02,860 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:02,924 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:02,924 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43448': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:02,970 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43458': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:02,970 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:03,031 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:03,032 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43462': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:03,079 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43474': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:03,080 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:03,139 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:03,139 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43478': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:03,189 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43484': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:03,189 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:03,247 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:03,252 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43492': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:03,299 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43508': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:03,299 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:03,354 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:03,354 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43510': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:03,409 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43520': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:03,409 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:03,461 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:03,461 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43536': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:03,518 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43548': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:03,518 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:03,569 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:03,569 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43562': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:03,628 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43570': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:03,628 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:03,676 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:03,676 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43574': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:03,737 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43588': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:03,738 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:03,784 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:03,784 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43590': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:03,847 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43592': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:03,847 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:03,891 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:03,892 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43604': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:03,957 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43606': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:03,957 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:03,999 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:03,999 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43608': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:04,067 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43610': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:04,067 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:04,106 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:04,107 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43620': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:04,177 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43628': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:04,177 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:04,214 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:04,214 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43642': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:04,287 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43656': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:04,287 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:04,322 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:04,323 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43670': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:04,396 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43684': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:04,396 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:04,430 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:04,430 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43686': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:04,508 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43702': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:04,508 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:04,537 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:04,537 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43708': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:04,618 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43716': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:04,618 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:04,645 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:04,645 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43728': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:04,728 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43740': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:04,728 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:04,760 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:04,768 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43748': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:04,844 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43752': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:04,844 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:04,868 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:04,868 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43756': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:04,955 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43770': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:04,955 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:04,976 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:04,976 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43772': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:05,064 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43780': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:05,064 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:05,083 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:05,083 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43788': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:05,173 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43804': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:05,173 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:05,191 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:05,191 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43816': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:05,283 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43820': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:05,283 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:05,298 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:05,298 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43834': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:05,393 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43848': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:05,393 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:05,406 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:05,406 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43856': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:05,503 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:05,503 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43868': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:05,513 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:05,513 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43876': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:05,613 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43878': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:05,613 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:05,620 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:05,620 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43890': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:05,722 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:05,727 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43892': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:05,727 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:05,728 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43898': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:05,832 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:05,836 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43910': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:05,836 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:05,836 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43918': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:05,942 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:05,946 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43930': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:05,946 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:05,947 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43944': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:06,052 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:06,056 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43958': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:06,056 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:06,056 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43970': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:06,161 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:06,165 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43974': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:06,165 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:06,166 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:06,271 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:06,276 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43986': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:06,276 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:06,276 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43998': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:06,381 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:06,385 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44010': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:06,385 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:06,386 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44012': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:06,491 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:06,495 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44022': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:06,495 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:06,496 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44036': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:06,601 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:06,605 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44048': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:06,605 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:06,606 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:06,711 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:06,715 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44068': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:06,715 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:06,715 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44074': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:06,820 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:06,824 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44084': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:06,825 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:06,825 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44096': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:06,930 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:06,934 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44110': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:06,934 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:06,935 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44126': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:07,039 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:07,043 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44140': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:07,044 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:07,044 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44146': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:07,149 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:07,153 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44154': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:07,153 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:07,154 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44164': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:07,260 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:07,264 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44178': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:07,264 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:07,265 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44190': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:07,370 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:07,374 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44204': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:07,374 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:07,374 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44212': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:07,479 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:07,483 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44226': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:07,484 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:07,484 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44234': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:07,608 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:07,613 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44240': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:07,614 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44244': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:07,615 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:07,716 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:07,716 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44250': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:07,724 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44260': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:07,724 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:07,824 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:07,824 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44270': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:07,834 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44276': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:07,834 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:07,931 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:07,931 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44286': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:07,943 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44300': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:07,943 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:08,040 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:08,040 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44316': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:08,053 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44330': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:08,053 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:08,147 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:08,147 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44336': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:08,162 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44350': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:08,162 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:08,259 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:08,259 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44352': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:08,272 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44356': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:08,272 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:08,366 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:08,366 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44364': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:08,382 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44368': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:08,382 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:08,474 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:08,474 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44376': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:08,492 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44388': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:08,492 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:08,581 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:08,581 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44400': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:08,602 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44404': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:08,602 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:08,689 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:08,689 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44416': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:08,711 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44418': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:08,711 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:08,796 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:08,796 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44424': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:08,821 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44434': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:08,821 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:08,903 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:08,903 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44442': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:08,931 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44446': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:08,931 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:09,012 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:09,013 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44458': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:09,059 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:09,068 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44468': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:09,120 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:09,120 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44476': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:09,168 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44484': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:09,168 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:09,229 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:09,229 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44496': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:09,278 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44504': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:09,278 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:09,336 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:09,337 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44508': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:09,388 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44510': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:09,388 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:09,444 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:09,444 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44522': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:09,500 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44530': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:09,500 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:09,551 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:09,552 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44534': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:09,609 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44544': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:09,609 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:09,659 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:09,659 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44556': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:09,719 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44566': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:09,719 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:09,767 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:09,767 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44578': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:09,829 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44588': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:09,829 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:09,874 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:09,874 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44596': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:09,938 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44600': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:09,938 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:09,981 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:09,982 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44602': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:10,048 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44606': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:10,048 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:10,089 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:10,089 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44616': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:10,158 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44628': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:10,158 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:10,196 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:10,197 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44636': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:10,267 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44644': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:10,267 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:10,304 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:10,304 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44656': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:10,377 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44672': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:10,377 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:10,413 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:10,414 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44676': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:10,507 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44692': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:10,507 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:10,521 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:10,521 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44702': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:10,617 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44714': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:10,617 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:10,628 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:10,628 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44726': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:10,727 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44740': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:10,727 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:10,735 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:10,735 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44750': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:10,837 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:10,841 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44758': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:10,842 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:10,842 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44760': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:10,946 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:10,951 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44764': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:10,951 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:10,952 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44774': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:11,055 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:11,060 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44776': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:11,060 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:11,060 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44784': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:11,165 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:11,169 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44800': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:11,170 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:11,170 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44804': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:11,274 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:11,278 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44808': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:11,279 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:11,279 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44824': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:11,384 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:11,388 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44834': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:11,388 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:11,389 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44842': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:11,494 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:11,498 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44856': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:11,499 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44868': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:11,499 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:11,603 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:11,607 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:45410': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:11,608 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:45426': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:11,608 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:11,713 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:11,716 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:45440': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:11,717 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:45442': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:11,717 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:11,822 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:11,826 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:45446': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:11,827 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:45458': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:11,827 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:11,932 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:11,935 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:45462': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:11,936 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:45466': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:11,936 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:12,042 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:12,045 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:45476': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:12,046 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:45492': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:12,046 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:12,151 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:12,155 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:45498': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:12,156 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:45510': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:12,156 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:12,260 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:12,264 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:45526': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:12,265 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:45530': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:12,265 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:12,370 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:12,373 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:45536': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:12,374 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:45538': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:12,374 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:12,479 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:12,483 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:45552': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:12,484 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:45556': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:12,484 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:12,589 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:12,592 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:45562': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:12,593 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:45568': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:12,593 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:12,698 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:12,701 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:45574': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:12,702 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:45588': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:12,702 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:12,808 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:12,811 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:45596': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:12,812 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:45612': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:12,812 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:12,917 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:12,921 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:45624': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:12,921 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:45630': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:12,922 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:13,027 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:13,030 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:45634': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:13,031 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:45648': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:13,031 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:13,136 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:13,140 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:45652': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:13,140 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:45654': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:13,141 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:13,245 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:13,250 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:45666': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:13,251 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:13,256 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:45676': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:13,355 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:13,358 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:45680': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:13,359 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:45694': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:13,359 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:13,464 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:13,467 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:45710': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:13,468 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:45724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:13,468 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:13,573 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:13,577 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:45734': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:13,578 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:45746': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:13,578 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:13,682 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:13,686 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:45754': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:13,687 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:45766': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:13,687 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:13,792 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:13,796 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:45774': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:13,796 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:13,796 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:45786': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:13,901 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:13,905 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:45790': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:13,905 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:13,906 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:45798': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:14,011 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:14,015 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:45812': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:14,015 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:14,015 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:45826': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:14,120 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:14,124 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:45830': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:14,125 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:14,125 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:45844': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:14,230 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:14,234 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:45850': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:14,234 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:14,235 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:45858': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:14,340 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:14,344 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:45874': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:14,344 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:14,344 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:45888': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:14,451 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:14,455 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:14,455 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:45896': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:14,456 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:45902': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:14,560 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:14,564 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:45918': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:14,565 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:14,565 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:45928': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:14,670 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:14,673 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:45934': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:14,674 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:14,674 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:45948': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:14,779 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:14,783 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:45964': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:14,783 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:14,784 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:45970': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:14,894 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:14,898 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:45976': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:14,900 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:45982': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:14,900 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:15,001 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:15,002 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:45990': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:15,010 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46004': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:15,010 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:15,109 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:15,109 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46012': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:15,120 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46022': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:15,120 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:15,216 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:15,216 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46028': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:15,230 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46040': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:15,230 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:15,323 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:15,323 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46048': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:15,339 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46054': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:15,339 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:15,430 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:15,431 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46066': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:15,448 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46068': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:15,449 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:15,538 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:15,538 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46076': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:15,558 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46088': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:15,558 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:15,645 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:15,645 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46092': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:15,668 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46100': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:15,668 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:15,758 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:15,759 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46104': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:15,777 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46114': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:15,777 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:15,866 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:15,866 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46124': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:15,886 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46136': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:15,886 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:15,973 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:15,973 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46138': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:15,996 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46140': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:15,996 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:16,080 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:16,080 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46156': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:16,105 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46168': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:16,105 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:16,187 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:16,188 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46174': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:16,214 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46184': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:16,214 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:16,295 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:16,295 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46194': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:16,324 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46210': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:16,324 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:16,402 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:16,402 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46212': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:16,433 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46220': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:16,433 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:16,510 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:16,510 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46232': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:16,543 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46242': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:16,543 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:16,618 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:16,618 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46246': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:16,653 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46248': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:16,653 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:16,725 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:16,725 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46258': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:16,763 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46274': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:16,763 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:16,833 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:16,833 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46284': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:16,872 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46290': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:16,873 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:16,940 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:16,940 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46304': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:16,982 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46320': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:16,982 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:17,047 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:17,047 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46336': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:17,092 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46338': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:17,092 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:17,154 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:17,154 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46348': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:17,202 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:17,202 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46362': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:17,261 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:17,261 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46378': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:17,311 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46390': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:17,311 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:17,368 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:17,368 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46398': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:17,420 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46408': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:17,421 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:17,476 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:17,476 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46410': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:17,530 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46412': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:17,530 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:17,583 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:17,584 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46418': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:17,640 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46428': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:17,640 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:17,691 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:17,691 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46440': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:17,749 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:17,753 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46454': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:17,798 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:17,798 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46468': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:17,858 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46480': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:17,858 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:17,905 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:17,905 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46488': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:17,968 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:17,968 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46496': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:18,012 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:18,012 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46500': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:18,077 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:18,077 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46502': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:18,119 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:18,120 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46504': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:18,186 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:18,186 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46514': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:18,227 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:18,227 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46522': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:18,296 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:18,296 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46536': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:18,334 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:18,334 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46552': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:18,405 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46562': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:18,405 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:18,441 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:18,442 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46568': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:18,515 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46580': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:18,515 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:18,549 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:18,549 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46588': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:18,625 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46594': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:18,625 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:18,656 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:18,656 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46610': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:18,734 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46622': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:18,735 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:18,763 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:18,763 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46626': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:18,844 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46642': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:18,844 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:18,870 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:18,870 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46646': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:18,954 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46656': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:18,954 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:19,005 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:19,008 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46670': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:19,069 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46686': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:19,070 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:19,113 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:19,113 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46690': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:19,180 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46704': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:19,180 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:19,220 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:19,221 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46714': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:19,289 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46718': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:19,289 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:19,328 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:19,329 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46722': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:19,400 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46728': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:19,400 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:19,435 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:19,436 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46732': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:19,510 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46734': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:19,510 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:19,543 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:19,543 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46748': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:19,619 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46756': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:19,619 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:19,650 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:19,651 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46766': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:19,729 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46776': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:19,729 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:19,758 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:19,758 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46788': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:19,838 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46798': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:19,838 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:19,865 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:19,865 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46812': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:19,947 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46818': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:19,947 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:19,972 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:19,973 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46830': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:20,056 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46836': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:20,056 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:20,079 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:20,080 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46852': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:20,165 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46866': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:20,165 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:20,187 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:20,187 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46874': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:20,275 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46878': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:20,275 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:20,294 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:20,294 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46884': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:20,385 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46892': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:20,385 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:20,401 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:20,401 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46900': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:20,494 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46906': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:20,494 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:20,508 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:20,508 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46910': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:20,603 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46924': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:20,603 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:20,615 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:20,615 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46930': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:20,712 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46946': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:20,712 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:20,723 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:20,723 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46948': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:20,821 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46954': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:20,821 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:20,830 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:20,830 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46958': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:20,931 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46962': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:20,931 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:20,937 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:20,937 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46964': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:21,040 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:21,044 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46976': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:21,044 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:21,045 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46978': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:21,149 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:21,154 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46994': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:21,154 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:21,154 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47004': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:21,258 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:21,262 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47006': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:21,263 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:21,263 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47020': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:21,367 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:21,372 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47022': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:21,372 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:21,372 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47028': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:21,477 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:21,481 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47032': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:21,481 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:21,481 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47040': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:21,586 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:21,590 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47010': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:21,590 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:21,591 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47014': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:21,695 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:21,699 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47028': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:21,700 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:21,700 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47040': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:21,805 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:21,808 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47054': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:21,809 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:21,809 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:21,914 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:21,918 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47072': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:21,918 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:21,919 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47088': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:22,024 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:22,028 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47104': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:22,028 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:22,029 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47120': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:22,133 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:22,137 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47128': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:22,137 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:22,138 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47134': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:22,242 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:22,247 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:22,248 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47136': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:22,254 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47142': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:22,352 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:22,356 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47158': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:22,356 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:22,356 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47166': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:22,460 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:22,464 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47176': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:22,465 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:22,465 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47186': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:22,570 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:22,574 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47198': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:22,574 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:22,574 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47206': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:22,679 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:22,683 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47212': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:22,683 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:22,683 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47214': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:22,787 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:22,792 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47224': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:22,792 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:22,792 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47228': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:22,896 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:22,900 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47244': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:22,901 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:22,901 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47252': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:23,005 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:23,009 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47258': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:23,010 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:23,010 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47272': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:23,114 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:23,118 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47278': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:23,119 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:23,119 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47292': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:23,223 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:23,227 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47300': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:23,228 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:23,228 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47306': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:23,332 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:23,336 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47316': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:23,336 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:23,337 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47318': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:23,441 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:23,445 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47330': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:23,446 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:23,446 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47342': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:23,550 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:23,555 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47346': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:23,555 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:23,555 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47362': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:23,659 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:23,664 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47364': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:23,664 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:23,664 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47368': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:23,769 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:23,773 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47378': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:23,773 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:23,774 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47390': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:23,878 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:23,882 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47396': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:23,883 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:23,883 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47404': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:23,987 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:23,992 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47410': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:23,992 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:23,992 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47422': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:24,097 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:24,101 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47430': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:24,101 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:24,101 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47446': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:24,206 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:24,210 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47456': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:24,211 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:24,211 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47462': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:24,317 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:24,321 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47470': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:24,322 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:24,322 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47478': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:24,426 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:24,431 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47486': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:24,431 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:24,431 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47502': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:24,536 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:24,540 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47504': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:24,540 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:24,541 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47508': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:24,645 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:24,649 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47514': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:24,650 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:24,650 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47524': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:24,759 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:24,762 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47532': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:24,763 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47542': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:24,763 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:24,868 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:24,872 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47552': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:24,873 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:24,873 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47554': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:24,977 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:24,981 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47568': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:24,982 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:24,982 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47580': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:25,086 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:25,091 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47582': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:25,091 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:25,091 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47588': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:25,196 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:25,200 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47590': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:25,200 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:25,200 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47592': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:25,305 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:25,309 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47594': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:25,309 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:25,310 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47600': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:25,414 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:25,418 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47616': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:25,419 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:25,419 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47622': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:25,524 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:25,528 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47632': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:25,529 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:25,529 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47644': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:25,633 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:25,637 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47646': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:25,638 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:25,638 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47648': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:25,743 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:25,747 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47664': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:25,747 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:25,753 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47668': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:25,852 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:25,856 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47682': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:25,857 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:25,858 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47686': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:25,961 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:25,965 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47688': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:25,965 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:25,966 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47692': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:26,070 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:26,074 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47696': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:26,075 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:26,075 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47706': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:26,180 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:26,184 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47716': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:26,184 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:26,184 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47718': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:26,289 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:26,293 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:26,293 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:26,293 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47740': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:26,398 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:26,402 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47756': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:26,402 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:26,402 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47770': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:26,507 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:26,511 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47786': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:26,511 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:26,512 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47802': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:26,616 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:26,620 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47810': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:26,621 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:26,621 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47818': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:26,725 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:26,729 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47832': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:26,730 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:26,730 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47848': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:26,835 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:26,839 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47858': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:26,839 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:26,839 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47862': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:26,944 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:26,948 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47878': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:26,948 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:26,949 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47886': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:27,053 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:27,057 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47896': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:27,058 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:27,058 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47900': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:27,162 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:27,166 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47910': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:27,166 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:27,167 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47926': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:27,272 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:27,276 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47928': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:27,276 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:27,277 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47944': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:27,381 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:27,387 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47950': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:27,387 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:27,387 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47952': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:27,490 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:27,494 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47962': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:27,494 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:27,494 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47964': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:27,599 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:27,603 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47972': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:27,603 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:27,604 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47982': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:27,708 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:27,712 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47988': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:27,712 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:27,713 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47998': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:27,817 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:27,821 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48004': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:27,821 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:27,822 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48010': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:27,926 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:27,930 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48014': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:27,931 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:27,931 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48024': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:28,035 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:28,040 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48032': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:28,040 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:28,040 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48048': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:28,145 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:28,149 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48052': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:28,149 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:28,150 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48064': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:28,259 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:28,262 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48068': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:28,262 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:28,263 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48076': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:28,367 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:28,371 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48084': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:28,372 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:28,372 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48086': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:28,476 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:28,480 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48088': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:28,480 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:28,481 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48100': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:28,585 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:28,589 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48102': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:28,590 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:28,590 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48110': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:28,694 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:28,723 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:28,725 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48132': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:28,726 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48124': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:28,809 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48144': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:28,809 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:28,832 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:28,832 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48150': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:28,918 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48156': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:28,918 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:28,940 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:28,940 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48168': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:29,028 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48172': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:29,028 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:29,047 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:29,047 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48176': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:29,137 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48188': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:29,137 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:29,154 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:29,154 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48198': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:29,250 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:29,255 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48202': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:29,261 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:29,262 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48206': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:29,359 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48214': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:29,359 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:29,368 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:29,369 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48226': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:29,493 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:29,497 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:29,497 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48234': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:29,500 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48242': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:29,603 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:29,607 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48250': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:29,607 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:29,607 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48262': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:29,711 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:29,715 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48278': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:29,716 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:29,716 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48286': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:29,820 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:29,824 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48294': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:29,824 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:29,825 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48308': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:29,929 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:29,933 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48312': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:29,933 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:29,934 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48324': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:30,038 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:30,042 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48336': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:30,042 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:30,042 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48342': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:30,147 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:30,151 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48356': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:30,152 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:30,152 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48360': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:30,266 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:30,271 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:30,271 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48364': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:30,272 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48378': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:30,376 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:30,380 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48384': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:30,380 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:30,381 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48394': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:30,485 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:30,489 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48396': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:30,489 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:30,490 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48410': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:30,594 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:30,598 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48420': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:30,599 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:30,599 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48432': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:30,703 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:30,707 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48442': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:30,707 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:30,708 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48448': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:30,813 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:30,817 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48460': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:30,817 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:30,817 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48468': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:30,922 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:30,926 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48476': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:30,926 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:30,926 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48492': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:31,031 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:31,035 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48494': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:31,035 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:31,035 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48508': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:31,140 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:31,144 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48514': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:31,144 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:31,144 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48524': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:31,249 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:31,258 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48528': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:31,259 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:31,259 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48538': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:31,357 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48554': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:31,357 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:31,366 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:31,366 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48560': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:31,466 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48568': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:31,466 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:31,473 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:31,473 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:48580': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:31,575 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:31,579 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41978': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:31,580 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:31,580 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41982': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:31,684 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:31,688 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41986': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:31,689 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:31,689 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42000': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:31,793 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:31,797 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42004': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:31,798 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:31,798 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42018': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:31,902 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:31,907 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:31,907 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42028': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:31,907 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42040': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:32,018 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:32,022 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42056': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:32,023 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42070': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:32,023 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:32,126 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:32,127 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42074': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:32,133 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42084': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:32,133 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:32,233 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:32,233 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42086': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:32,241 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42092': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:32,241 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:32,341 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:32,341 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42106': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:32,350 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42118': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:32,350 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:32,448 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:32,449 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42128': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:32,458 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42144': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:32,458 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:32,557 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:32,557 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42148': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:32,568 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42152': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:32,568 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:32,664 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:32,665 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42160': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:32,677 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42168': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:32,677 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:32,772 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:32,772 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42182': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:32,786 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42194': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:32,786 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:32,879 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:32,879 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42196': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:32,894 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42204': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:32,894 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:32,986 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:32,986 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42214': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:33,003 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42226': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:33,003 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:33,094 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:33,094 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42242': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:33,113 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42252': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:33,113 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:33,201 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:33,202 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42262': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:33,222 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42270': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:33,222 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:33,309 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:33,309 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42274': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:33,331 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42286': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:33,331 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:33,416 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:33,417 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42294': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:33,439 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42300': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:33,439 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:33,524 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:33,524 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42308': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:33,548 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42314': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:33,548 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:33,632 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:33,632 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42318': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:33,657 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42326': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:33,657 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:33,741 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:33,741 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42328': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:33,766 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42344': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:33,766 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:33,848 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:33,848 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42348': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:33,875 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42356': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:33,875 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:33,955 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:33,955 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42358': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:33,984 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42374': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:33,984 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:34,063 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:34,063 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42390': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:34,093 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42406': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:34,093 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:34,170 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:34,170 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42410': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:34,204 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42426': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:34,204 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:34,278 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:34,278 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42438': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:34,313 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42446': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:34,313 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:34,386 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:34,386 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42450': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:34,422 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42454': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:34,422 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:34,493 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:34,493 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42470': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:34,531 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42484': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:34,531 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:34,601 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:34,601 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42486': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:34,640 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42498': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:34,640 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:34,708 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:34,709 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42508': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:34,749 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:34,753 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42516': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:34,816 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:34,816 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42520': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:34,858 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42532': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:34,858 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:34,923 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:34,924 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42538': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:34,967 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42548': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:34,967 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:35,031 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:35,031 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42554': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:35,076 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42568': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:35,076 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:35,138 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:35,138 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42578': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:35,185 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42590': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:35,185 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:35,245 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:35,245 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42600': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:35,294 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42612': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:35,294 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:35,353 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:35,353 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42620': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:35,403 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42636': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:35,403 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:35,461 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:35,461 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42646': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:35,511 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42648': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:35,511 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:35,568 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:35,568 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42658': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:35,620 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42668': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:35,620 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:35,676 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:35,676 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42684': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:35,729 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42696': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:35,729 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:35,784 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:35,784 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42712': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:35,838 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42718': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:35,838 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:35,891 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:35,891 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42734': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:35,947 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42742': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:35,947 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:36,000 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:36,000 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42744': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:36,056 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42754': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:36,056 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:36,107 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:36,107 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42768': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:36,165 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42782': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:36,165 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:36,215 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:36,215 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42788': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:36,274 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42802': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:36,274 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:36,322 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:36,323 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42806': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:36,383 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42808': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:36,383 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:36,430 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:36,430 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42822': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:36,492 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42830': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:36,492 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:36,537 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:36,537 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42832': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:36,601 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42846': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:36,601 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:36,645 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:36,645 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42858': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:36,710 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42868': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:36,710 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:36,758 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:36,758 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42870': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:36,819 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:36,819 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42874': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:36,865 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:36,866 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42878': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:36,928 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42884': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:36,928 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:36,973 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:36,973 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42892': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:37,037 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:37,037 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42900': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:37,080 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:37,081 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42912': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:37,146 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:37,146 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42922': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:37,188 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:37,188 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42938': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:37,258 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42948': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:37,258 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:37,296 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:37,296 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42956': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:37,367 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42962': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:37,367 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:37,403 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:37,403 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42974': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:37,476 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42978': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:37,476 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:37,511 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:37,511 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42992': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:37,613 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43008': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:37,614 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:37,621 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:37,621 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43024': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:37,725 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:37,730 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43030': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:37,730 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:37,731 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43046': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:37,834 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:37,838 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43052': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:37,839 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:37,839 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43056': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:37,943 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:37,947 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:37,948 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:37,948 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43068': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:38,052 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:38,056 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43080': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:38,056 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:38,057 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43092': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:38,161 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:38,165 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43100': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:38,165 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:38,165 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43116': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:38,270 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:38,274 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43118': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:38,274 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:38,275 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43124': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:38,387 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:38,391 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43146': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:38,393 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43136': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:38,392 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:38,495 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:38,495 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43162': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:38,501 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43174': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:38,501 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:38,604 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:38,604 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43182': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:38,610 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43184': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:38,610 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:38,711 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:38,712 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43190': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:38,719 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43206': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:38,719 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:38,819 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:38,819 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43212': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:38,827 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43228': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:38,827 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:38,927 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:38,927 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43234': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:38,936 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43238': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:38,936 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:39,034 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:39,034 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43248': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:39,045 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43264': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:39,045 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:39,142 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:39,142 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43268': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:39,156 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43274': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:39,156 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:39,249 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:39,254 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43280': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:39,265 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43288': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:39,265 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:39,357 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:39,357 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43304': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:39,373 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43318': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:39,373 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:39,464 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:39,465 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43326': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:39,482 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43340': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:39,482 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:39,572 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:39,572 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43348': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:39,591 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43358': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:39,591 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:39,679 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:39,679 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43370': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:39,700 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43376': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:39,700 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:39,786 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:39,787 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43392': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:39,826 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:39,825 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43402': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:39,896 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:39,896 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43410': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:39,935 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43426': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:39,935 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:40,003 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:40,004 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43436': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:40,043 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:40,043 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43450': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:40,111 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:40,111 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43462': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:40,152 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:40,152 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43466': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:40,219 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:40,219 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43470': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:40,261 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43480': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:40,261 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:40,326 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:40,326 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43486': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:40,370 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43492': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:40,370 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:40,434 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:40,434 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43502': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:40,479 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43508': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:40,479 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:40,541 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:40,541 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43514': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:40,588 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43522': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:40,588 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:40,649 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:40,649 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43526': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:40,697 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43534': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:40,697 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:40,757 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:40,757 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43538': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:40,805 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:40,805 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43548': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:40,865 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:40,865 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43562': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:40,914 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:40,914 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43566': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:40,973 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:40,973 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43578': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:41,023 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43590': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:41,023 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:41,081 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:41,081 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43604': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:41,132 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43616': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:41,132 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:41,188 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:41,188 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43628': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:41,242 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43640': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:41,242 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:41,296 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:41,297 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43656': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:41,351 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43664': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:41,351 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:41,404 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:41,404 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43668': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:41,460 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43678': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:41,460 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:41,512 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:41,512 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43694': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:41,569 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:41,569 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36720': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:41,619 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:41,619 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:41,678 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36728': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:41,678 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:41,727 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:41,728 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36730': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:41,787 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36740': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:41,787 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:41,835 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:41,835 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36754': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:41,896 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36766': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:41,896 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:41,943 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:41,943 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36778': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:42,005 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36780': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:42,005 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:42,051 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:42,051 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36790': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:42,114 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36794': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:42,114 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:42,158 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:42,158 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36806': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:42,223 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36814': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:42,223 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:42,266 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:42,266 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36820': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:42,332 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36830': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:42,332 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:42,374 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:42,374 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36836': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:42,441 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:42,441 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36850': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:42,481 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:42,481 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36858': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:42,550 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36872': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:42,550 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:42,589 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:42,589 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36886': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:42,658 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36890': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:42,659 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:42,696 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:42,697 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36898': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:42,767 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36906': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:42,768 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:42,804 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:42,804 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36920': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:42,876 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36930': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:42,876 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:42,912 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:42,912 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36938': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:42,986 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36946': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:42,986 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:43,019 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:43,019 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36956': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:43,095 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36968': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:43,095 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:43,127 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:43,127 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36972': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:43,204 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36980': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:43,204 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:43,234 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:43,234 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:43,313 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36990': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:43,313 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:43,342 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:43,342 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36996': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:43,422 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37000': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:43,422 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:43,451 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:43,451 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37012': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:43,531 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37026': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:43,531 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:43,558 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:43,559 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37042': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:43,640 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37056': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:43,640 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:43,666 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:43,666 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37070': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:43,749 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:43,754 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37082': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:43,773 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:43,774 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37092': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:43,858 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37108': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:43,858 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:43,881 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:43,881 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37114': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:43,967 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37128': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:43,967 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:43,988 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:43,988 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37130': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:44,080 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37132': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:44,080 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:44,096 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:44,096 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37136': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:44,189 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37142': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:44,189 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:44,203 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:44,203 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37150': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:44,298 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37152': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:44,298 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:44,310 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:44,310 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37162': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:44,407 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37172': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:44,407 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:44,416 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:44,417 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37174': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:44,516 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37188': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:44,516 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:44,523 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:44,523 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37196': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:44,625 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:44,630 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37212': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:44,630 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:44,631 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37226': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:44,735 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:44,739 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37240': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:44,739 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37246': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:44,739 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:44,844 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:44,848 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37254': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:44,848 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:44,849 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37270': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:44,953 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:44,957 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37284': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:44,957 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37290': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:44,957 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:45,062 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:45,066 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37298': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:45,066 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:45,066 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37310': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:45,171 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:45,175 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37324': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:45,175 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:45,175 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37340': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:45,287 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:45,290 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37350': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:45,290 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:45,291 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37364': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:45,396 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:45,400 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37376': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:45,401 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:45,401 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37386': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:45,506 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:45,510 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37394': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:45,510 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:45,510 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37408': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:45,615 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:45,619 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37422': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:45,619 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:45,619 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37434': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:45,724 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:45,728 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37448': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:45,728 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:45,728 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37454': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:45,833 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:45,837 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37458': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:45,837 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:45,837 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37468': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:45,942 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:45,946 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37482': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:45,946 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:45,946 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37494': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:46,050 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:46,054 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37498': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:46,055 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:46,055 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37500': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:46,157 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:46,161 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37504': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:46,162 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:46,162 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37516': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:46,264 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:46,264 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37524': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:46,270 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:46,270 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37530': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:46,371 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:46,376 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37532': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:46,377 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:46,377 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37538': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:46,479 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:46,484 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37550': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:46,485 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:46,485 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37552': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:46,587 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:46,591 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37566': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:46,592 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:46,592 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37580': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:46,723 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:46,723 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:46,723 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37584': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:46,725 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37600': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:46,831 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:46,835 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37602': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:46,837 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37614': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:46,837 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:46,938 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:46,938 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37616': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:46,945 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37630': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:46,945 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:47,046 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:47,046 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37636': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:47,054 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37638': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:47,054 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:47,153 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:47,153 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37648': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:47,162 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37656': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:47,162 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:47,260 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:47,261 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37668': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:47,271 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37680': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:47,271 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:47,368 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:47,368 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37694': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:47,379 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37702': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:47,380 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:47,475 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:47,475 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37714': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:47,488 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:47,488 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:47,583 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:47,583 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37728': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:47,597 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37734': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:47,597 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:47,690 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:47,691 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37740': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:47,706 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37752': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:47,706 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:47,798 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:47,798 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37766': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:47,815 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37780': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:47,815 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:47,905 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:47,906 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:47,924 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37812': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:47,924 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:48,013 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:48,014 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37818': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:48,033 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37826': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:48,033 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:48,121 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:48,121 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37830': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:48,141 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:48,141 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37840': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:48,229 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:48,230 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37842': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:48,250 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:48,253 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37844': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:48,338 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:48,338 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37848': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:48,359 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37850': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:48,359 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:48,445 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:48,445 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37862': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:48,468 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37866': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:48,468 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:48,552 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:48,553 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37882': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:48,577 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37894': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:48,577 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:48,660 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:48,660 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37900': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:48,686 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37910': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:48,686 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:48,767 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:48,767 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37912': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:48,795 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37922': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:48,795 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:48,874 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:48,875 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37932': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:48,904 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37942': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:48,904 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:48,982 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:48,982 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37954': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:49,015 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37968': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:49,015 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:49,089 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:49,090 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:49,124 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37998': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:49,124 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:49,197 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:49,197 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38012': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:49,233 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38014': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:49,233 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:49,305 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:49,305 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38016': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:49,342 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38026': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:49,342 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:49,413 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:49,413 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38042': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:49,451 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38044': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:49,451 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:49,520 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:49,521 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38052': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:49,560 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:49,560 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38056': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:49,628 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:49,628 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38062': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:49,668 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38070': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:49,668 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:49,736 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:49,736 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38072': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:49,776 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38076': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:49,776 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:49,843 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:49,843 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38078': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:49,885 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38092': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:49,885 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:49,951 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:49,952 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38106': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:49,993 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38118': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:49,993 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:50,059 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:50,059 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38132': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:50,102 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38148': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:50,102 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:50,166 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:50,167 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38162': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:50,211 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38164': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:50,211 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:50,274 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:50,274 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38178': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:50,320 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38190': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:50,320 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:50,381 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:50,381 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38194': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:50,429 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38204': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:50,429 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:50,489 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:50,489 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38214': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:50,538 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38218': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:50,539 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:50,596 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:50,597 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38220': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:50,648 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38224': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:50,648 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:50,704 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:50,704 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38230': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:50,759 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38244': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:50,759 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:50,811 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:50,812 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38256': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:50,868 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38260': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:50,868 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:50,919 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:50,919 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38266': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:50,977 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:50,977 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38274': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:51,027 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:51,027 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38280': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:51,084 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:51,084 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38292': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:51,134 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:51,134 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38308': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:51,191 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:51,191 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38318': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:51,242 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:51,242 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38328': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:51,299 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:51,299 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38342': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:51,349 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:51,349 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38358': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:51,406 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:51,406 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38362': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:51,456 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:51,456 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38366': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:51,514 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:51,514 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38370': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:51,564 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:51,564 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36706': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:51,621 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:51,621 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36710': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:51,672 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:51,672 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:51,728 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:51,728 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36734': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:51,779 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:51,779 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36750': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:51,836 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:51,836 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36752': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:51,886 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:51,886 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36766': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:51,943 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:51,943 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36772': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:51,993 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:51,993 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36778': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:52,051 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:52,051 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36794': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:52,101 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:52,101 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36810': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:52,159 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:52,159 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36816': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:52,208 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:52,208 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36824': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:52,266 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:52,266 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36834': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:52,316 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:52,316 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36842': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:52,373 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:52,374 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36850': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:52,423 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:52,424 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36866': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:52,481 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:52,481 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36868': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:52,530 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:52,531 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36874': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:52,589 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:52,589 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36882': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:52,638 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:52,638 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36888': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:52,696 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:52,696 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36902': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:52,745 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:52,745 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36916': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:52,804 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:52,804 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36930': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:52,853 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:52,853 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36936': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:52,911 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:52,912 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36950': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:52,960 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:52,960 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36958': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:53,019 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:53,019 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36972': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:53,067 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:53,068 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36974': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:53,128 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36976': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:53,128 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:53,176 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:53,176 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:36986': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:53,237 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37000': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:53,237 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:53,283 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:53,283 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37002': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:53,346 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37018': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:53,346 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:53,391 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:53,391 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37024': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:53,455 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37026': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:53,455 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:53,508 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:53,509 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37030': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:53,569 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37034': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:53,569 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:53,616 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:53,616 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37050': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:53,679 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37052': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:53,679 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:53,723 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:53,723 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37062': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:53,789 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37076': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:53,789 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:53,831 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:53,831 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37088': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:53,900 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37098': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:53,900 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:53,938 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:53,938 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37104': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:54,009 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37106': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:54,009 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:54,046 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:54,046 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37116': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:54,118 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37126': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:54,118 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:54,153 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:54,153 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37134': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:54,227 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37146': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:54,227 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:54,260 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:54,261 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37150': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:54,336 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37166': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:54,336 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:54,367 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:54,368 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37178': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:54,445 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37192': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:54,445 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:54,475 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:54,475 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37204': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:54,554 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37206': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:54,554 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:54,582 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:54,582 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37222': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:54,663 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37234': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:54,663 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:54,689 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:54,690 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37244': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:54,772 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37254': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:54,772 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:54,797 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:54,797 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37270': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:54,881 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37278': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:54,881 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:54,904 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:54,904 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37282': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:54,990 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37288': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:54,990 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:55,011 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:55,011 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37300': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:55,099 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37304': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:55,099 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:55,119 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:55,119 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37320': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:55,232 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:55,237 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37332': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:55,239 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37328': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:55,240 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:55,340 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:55,340 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37342': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:55,348 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37348': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:55,349 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:55,447 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:55,447 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37360': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:55,457 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37368': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:55,457 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:55,554 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:55,555 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37380': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:55,566 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37394': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:55,566 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:55,662 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:55,662 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37396': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:55,675 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37400': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:55,675 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:55,769 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:55,769 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37414': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:55,784 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37426': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:55,784 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:55,877 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:55,877 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37434': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:55,892 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37444': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:55,892 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:55,984 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:55,984 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37460': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:56,001 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37476': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:56,001 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:56,092 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:56,092 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37484': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:56,110 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37486': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:56,110 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:56,199 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:56,199 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37490': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:56,219 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37504': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:56,219 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:56,307 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:56,307 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37512': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:56,327 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37514': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:56,328 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:56,414 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:56,415 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37522': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:56,436 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37530': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:56,436 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:56,522 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:56,522 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37544': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:56,546 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37558': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:56,546 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:56,629 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:56,629 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37568': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:56,655 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37570': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:56,655 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:56,737 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:56,737 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37576': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:56,764 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37582': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:56,764 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:56,844 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:56,844 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37596': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:56,873 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37604': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:56,873 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:56,952 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:56,952 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37612': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:56,982 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37618': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:56,982 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:57,059 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:57,059 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37632': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:57,091 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37646': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:57,091 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:57,166 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:57,166 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37650': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:57,200 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37658': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:57,200 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:57,273 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:57,274 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37660': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:57,309 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37668': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:57,309 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:57,381 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:57,381 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37678': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:57,418 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37692': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:57,418 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:57,488 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:57,488 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37696': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:57,527 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37704': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:57,527 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:57,595 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:57,596 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37720': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:57,636 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37728': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:57,636 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:57,703 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:57,703 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37742': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:57,745 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37746': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:57,745 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:57,810 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:57,811 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37754': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:57,854 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37770': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:57,854 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:57,918 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:57,918 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37776': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:57,963 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37778': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:57,963 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:58,026 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:58,027 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37790': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:58,072 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37802': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:58,072 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:58,134 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:58,134 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37804': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:58,181 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37814': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:58,181 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:58,241 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:58,241 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37818': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:58,290 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37820': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:58,290 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:58,349 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:58,349 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37822': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:58,399 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37828': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:58,399 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:58,456 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:58,456 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37834': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:58,508 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37836': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:58,508 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:58,563 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:58,563 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37848': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:58,618 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37858': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:58,618 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:58,671 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:58,671 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37870': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:58,727 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37876': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:58,727 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:58,778 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:58,778 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37884': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:58,837 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37896': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:58,838 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:58,885 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:58,885 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37910': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:58,946 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:58,946 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37912': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:58,992 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:58,992 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37918': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:59,055 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37928': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:59,055 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:59,099 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:59,100 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37930': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:59,164 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37944': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:59,164 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:59,207 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:59,207 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37948': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:59,273 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37958': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:59,273 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:59,314 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:59,315 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37966': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:59,382 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37972': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:59,382 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:59,422 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:59,422 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37978': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:59,491 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:59,491 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:59,530 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:59,530 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37994': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:59,600 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38002': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:59,600 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:59,637 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:59,637 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38018': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:59,708 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38030': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:59,709 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:59,743 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:59,743 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38046': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:59,817 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38048': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:59,817 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:59,850 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38060': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:59,850 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:59,925 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38076': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:13:59,926 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:59,957 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:13:59,957 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38084': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:00,034 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38088': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:00,034 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:00,064 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:00,064 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38098': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:00,143 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38114': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:00,143 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:00,171 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38124': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:00,171 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:00,251 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:00,254 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38128': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:00,277 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38132': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:00,277 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:00,361 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38148': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:00,362 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:00,384 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:00,384 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38158': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:00,470 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38164': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:00,470 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:00,491 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38172': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:00,491 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:00,578 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38188': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:00,579 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:00,598 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38190': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:00,598 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:00,687 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38194': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:00,687 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:00,705 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:00,705 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38202': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:00,795 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38208': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:00,796 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:00,812 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:00,812 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38218': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:00,904 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38228': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:00,904 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:00,919 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38232': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:00,919 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:01,012 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38248': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:01,012 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:01,026 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38254': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:01,026 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:01,120 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38270': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:01,121 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:01,133 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38280': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:01,133 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:01,229 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38282': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:01,229 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:01,240 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38286': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:01,240 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:01,337 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38302': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:01,337 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:01,351 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38306': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:01,351 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:01,448 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38308': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:01,448 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:01,458 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38314': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:01,458 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:01,556 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58418': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:01,557 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:01,564 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58432': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:01,564 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:01,664 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58440': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:01,665 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:01,671 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:01,671 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58450': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:01,773 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58454': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:01,773 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:01,778 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:01,778 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58464': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:01,881 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:01,885 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58480': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:01,885 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58494': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:01,885 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:01,989 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:01,993 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58500': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:01,993 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58508': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:01,993 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:02,099 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:02,102 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58524': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:02,102 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58532': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:02,102 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:02,207 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:02,210 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58536': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:02,211 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58548': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:02,211 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:02,315 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:02,319 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58556': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:02,319 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58572': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:02,319 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:02,424 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:02,427 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58586': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:02,427 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:02,428 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58596': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:02,532 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:02,535 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58602': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:02,535 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58618': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:02,535 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:02,640 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:02,643 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58630': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:02,644 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58640': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:02,644 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:02,749 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:02,757 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58654': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:02,757 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58668': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:02,757 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:02,857 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58676': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:02,857 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:02,865 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58690': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:02,865 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:02,966 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58694': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:02,966 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:02,972 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58696': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:02,972 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:03,074 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:03,078 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58710': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:03,078 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58720': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:03,078 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:03,182 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:03,185 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58726': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:03,186 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58736': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:03,186 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:03,291 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:03,294 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58746': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:03,294 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58748': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:03,295 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:03,399 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:03,402 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58750': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:03,403 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58756': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:03,403 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:03,508 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:03,511 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58766': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:03,511 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58772': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:03,511 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:03,617 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:03,620 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58784': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:03,621 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58792': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:03,621 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:03,727 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:03,730 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58802': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:03,731 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58804': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:03,731 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:03,836 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:03,840 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58810': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:03,840 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58824': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:03,840 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:03,945 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:03,948 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58834': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:03,949 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58850': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:03,949 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:04,053 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:04,056 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58860': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:04,057 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58866': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:04,057 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:04,162 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:04,165 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58882': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:04,165 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58898': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:04,165 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:04,270 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:04,273 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58912': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:04,274 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58916': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:04,274 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:04,379 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:04,382 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58930': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:04,382 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58940': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:04,382 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:04,487 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:04,490 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58950': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:04,491 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58954': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:04,491 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:04,596 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:04,599 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58970': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:04,599 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:04,599 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:04,704 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:04,707 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58990': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:04,708 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:59000': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:04,708 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:04,813 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:04,816 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:59008': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:04,816 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:59012': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:04,816 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:04,921 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:04,924 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:59016': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:04,925 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:59026': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:04,925 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:05,030 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:05,033 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:59038': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:05,033 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:59052': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:05,033 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:05,138 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:05,141 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:59066': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:05,142 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:59068': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:05,142 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:05,247 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:05,250 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:59080': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:05,250 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:05,254 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:59088': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:05,355 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:05,358 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:59094': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:05,359 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:59106': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:05,359 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:05,464 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:05,467 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:59120': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:05,467 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:59122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:05,467 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:05,573 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:05,576 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:59138': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:05,576 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:59152': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:05,576 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:05,681 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:05,684 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:59156': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:05,685 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:59158': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:05,685 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:05,790 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:05,793 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:59166': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:05,793 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:59178': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:05,793 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:05,898 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:05,901 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:59184': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:05,902 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:59196': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:05,902 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:06,007 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:06,010 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:59210': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:06,010 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:59222': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:06,010 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:06,115 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:06,118 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:59236': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:06,119 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:59244': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:06,119 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:06,224 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:06,227 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:59254': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:06,228 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:59260': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:06,228 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:06,332 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:06,335 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:59266': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:06,336 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:59276': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:06,336 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:06,441 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:06,444 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:59290': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:06,444 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:59298': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:06,444 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:06,549 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:06,552 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:59302': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:06,553 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:59318': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:06,553 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:06,657 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:06,660 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:59332': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:06,661 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:59336': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:06,661 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:06,766 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:06,769 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:59350': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:06,770 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:59356': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:06,770 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:06,874 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:06,877 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:59370': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:06,878 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:59382': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:06,878 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:06,982 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:06,986 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:59384': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:06,986 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:59398': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:06,986 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:07,091 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:07,094 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:59410': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:07,094 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:59424': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:07,094 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:07,199 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:07,202 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:59436': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:07,202 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:59444': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:07,202 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:07,308 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:07,311 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:59446': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:07,312 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:59452': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:07,312 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:07,416 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:07,419 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:59460': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:07,420 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:59466': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:07,421 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:07,525 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:07,528 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:59474': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:07,528 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:59482': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:07,528 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:07,633 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:07,636 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:59488': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:07,637 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:59490': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:07,637 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:07,741 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:07,744 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:59502': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:07,745 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:59506': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:07,745 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:07,850 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:07,853 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:59520': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:07,853 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:59522': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:07,853 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:07,958 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:07,961 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:59530': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:07,962 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:59544': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:07,962 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:08,066 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:08,069 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:59556': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:08,070 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:59562': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:08,070 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:08,175 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:08,178 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:59574': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:08,178 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:59578': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:08,178 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:08,283 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:08,286 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:59584': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:08,287 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:59600': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:08,287 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:08,392 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:08,395 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:59608': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:08,395 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:59620': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:08,396 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:08,500 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:08,503 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:59628': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:08,504 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:08,504 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:59636': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:08,610 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:08,613 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:59642': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:08,614 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:59658': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:08,614 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:08,719 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:08,722 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:59674': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:08,722 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:59688': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:08,722 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:08,827 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:08,830 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:59702': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:08,831 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:59718': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:08,831 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:08,936 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:08,939 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:59732': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:08,939 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:59740': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:08,939 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:09,045 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:09,048 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:59752': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:09,049 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:59758': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:09,049 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:09,153 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:09,156 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:59766': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:09,157 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:59780': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:09,157 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:09,261 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:09,265 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:59786': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:09,265 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:59802': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:09,265 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:09,370 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:09,373 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:59810': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:09,374 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:59820': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:09,374 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:09,479 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:09,482 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:59836': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:09,482 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:59852': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:09,482 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:09,587 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:09,590 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:59862': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:09,591 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:59866': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:09,591 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:09,695 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:09,698 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:59878': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:09,699 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:59892': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:09,699 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:09,804 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:09,807 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:59904': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:09,807 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:59912': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:09,807 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:09,912 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:09,916 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:59918': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:09,916 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:59922': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:09,916 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:10,021 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:10,024 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:59924': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:10,024 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:10,025 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:59930': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:10,129 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:10,132 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:59932': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:10,133 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:59934': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:10,133 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:10,238 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:10,240 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:59942': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:10,241 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:59952': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:10,241 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:10,347 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:10,350 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:59960': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:10,350 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:59962': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:10,350 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:10,455 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:10,458 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:59966': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:10,459 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:59968': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:10,459 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:10,563 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:10,566 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:59982': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:10,567 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:59996': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:10,567 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:10,672 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:10,675 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:60012': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:10,676 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:60022': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:10,676 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:10,781 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:10,784 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:60026': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:10,785 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:60030': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:10,785 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:10,890 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:10,893 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:60034': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:10,894 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:60040': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:10,894 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:10,998 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:11,002 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:60050': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:11,002 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:60054': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:11,002 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:11,107 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:11,110 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:60062': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:11,111 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:60076': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:11,111 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:11,216 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:11,219 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:60082': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:11,219 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:60086': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:11,219 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:11,324 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:11,327 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:60090': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:11,328 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:60092': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:11,328 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:11,433 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:11,436 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:60096': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:11,437 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:60106': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:11,437 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:11,542 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:11,545 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:49912': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:11,546 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:49928': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:11,546 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:11,650 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:11,653 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:49936': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:11,654 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:49938': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:11,654 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:11,759 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:11,761 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:49940': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:11,762 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:49954': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:11,762 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:11,867 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:11,870 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:49970': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:11,870 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:49984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:11,871 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:11,976 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:11,979 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:49992': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:11,979 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:50004': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:11,979 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:12,084 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:12,087 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:50016': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:12,088 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:50022': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:12,088 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:12,193 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:12,196 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:50030': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:12,196 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:50032': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:12,196 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:12,302 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:12,304 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:50036': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:12,305 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:50046': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:12,305 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:12,410 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:12,413 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:50050': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:12,414 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:50058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:12,414 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:12,520 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:12,523 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:50068': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:12,524 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:50080': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:12,524 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:12,629 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:12,632 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:50086': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:12,632 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:50088': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:12,632 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:12,737 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:12,740 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:50102': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:12,741 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:50118': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:12,741 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:12,846 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:12,849 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:50126': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:12,850 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:50134': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:12,850 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:12,955 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:12,958 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:50150': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:12,958 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:50154': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:12,959 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:13,063 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:13,066 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:50160': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:13,067 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:50170': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:13,067 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:13,172 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:13,175 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:50172': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:13,175 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:50180': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:13,175 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:13,281 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:13,283 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:50184': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:13,284 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:50192': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:13,284 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:13,389 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:13,392 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:50208': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:13,393 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:50218': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:13,393 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:13,500 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:13,502 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:50232': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:13,503 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:50234': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:13,503 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:13,608 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:13,611 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:50242': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:13,612 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:50244': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:13,612 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:13,717 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:13,720 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:50254': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:13,720 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:50266': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:13,720 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:13,825 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:13,828 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:50278': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:13,829 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:50294': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:13,829 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:13,934 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:13,937 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:50302': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:13,937 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:50312': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:13,937 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:14,042 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:14,045 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:50318': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:14,046 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:50324': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:14,046 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:14,151 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:14,154 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:50338': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:14,154 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:50352': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:14,154 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:14,260 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:14,263 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:50366': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:14,263 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:50382': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:14,263 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:14,368 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:14,371 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:50392': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:14,372 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:50408': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:14,372 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:14,476 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:14,479 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:50420': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:14,480 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:50436': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:14,480 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:14,585 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:14,588 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:50446': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:14,589 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:50454': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:14,589 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:14,693 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:14,696 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:50470': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:14,697 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:50474': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:14,697 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:14,805 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:14,809 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:50500': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:14,810 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:50490': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:14,811 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:14,912 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:14,912 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:50514': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:14,920 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:50516': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:14,920 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:15,019 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:15,019 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:50532': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:15,028 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:50536': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:15,028 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:15,125 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:50550': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:15,125 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:15,136 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:50566': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:15,137 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:15,232 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:15,232 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:50580': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:15,245 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:50582': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:15,245 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:15,339 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:50588': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:15,339 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:15,353 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:50602': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:15,353 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:15,446 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:15,446 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:50608': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:15,470 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:50612': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:15,471 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:15,554 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:50624': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:15,554 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:15,579 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:50628': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:15,580 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:15,661 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:15,661 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:50632': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:15,689 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:50640': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:15,689 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:15,768 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:50654': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:15,768 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:15,797 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:50658': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:15,797 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:15,875 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:15,875 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:50668': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:15,906 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:50676': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:15,906 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:15,983 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:50678': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:15,983 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:16,014 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:50688': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:16,014 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:16,090 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:16,090 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:50704': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:16,122 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:50708': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:16,123 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:16,197 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:50712': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:16,197 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:16,231 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:50728': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:16,231 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:16,304 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:16,304 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:50740': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:16,339 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:50754': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:16,339 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:16,411 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:16,411 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:50768': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:16,448 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:50774': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:16,448 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:16,517 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:16,517 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:50778': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:16,556 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:50784': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:16,556 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:16,624 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:16,624 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:50786': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:16,664 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:50792': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:16,664 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:16,731 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:16,731 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:50798': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:16,772 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:50802': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:16,772 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:16,838 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:50818': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:16,839 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:16,880 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:50832': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:16,881 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:16,945 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:50838': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:16,945 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:16,989 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:50844': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:16,989 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:17,052 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:50846': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:17,052 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:17,097 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:50862': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:17,098 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:17,159 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:50878': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:17,159 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:17,206 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:50882': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:17,206 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:17,266 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:50886': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:17,266 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:17,314 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:50890': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:17,314 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:17,373 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:50902': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:17,373 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:17,423 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:50904': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:17,423 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:17,483 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:50914': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:17,483 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:17,531 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:50930': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:17,531 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:17,590 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:50934': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:17,590 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:17,640 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:50950': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:17,640 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:17,698 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:17,698 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:50956': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:17,748 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:17,752 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:50960': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:17,805 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:17,805 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:50974': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:17,857 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:50988': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:17,857 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:17,912 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:50998': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:17,912 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:17,965 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:51002': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:17,966 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:18,019 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:18,019 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:51010': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:18,073 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:51026': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:18,073 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:18,126 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:51036': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:18,126 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:18,180 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:51038': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:18,180 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:18,233 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:51042': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:18,233 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:18,288 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:18,288 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:51050': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:18,340 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:51066': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:18,340 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:18,395 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:51078': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:18,395 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:18,447 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:51088': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:18,447 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:18,502 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:51104': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:18,502 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:18,554 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:51110': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:18,554 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:18,610 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:51114': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:18,610 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:18,661 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:18,661 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:51122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:18,717 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:51132': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:18,717 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:18,768 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:51136': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:18,768 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:18,824 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:51144': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:18,824 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:18,875 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:51148': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:18,875 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:18,939 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:51160': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:18,940 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:18,988 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:51172': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:18,988 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:19,048 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:51184': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:19,048 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:19,095 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:19,095 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:51186': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:19,156 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:51202': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:19,156 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:19,202 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:51208': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:19,202 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:19,264 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:51216': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:19,264 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:19,309 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:19,309 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:51222': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:19,372 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:51228': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:19,373 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:19,417 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:51230': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:19,417 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:19,481 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:51232': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:19,481 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:19,524 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:51236': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:19,524 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:19,589 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:51250': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:19,589 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:19,631 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:19,631 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:51252': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:19,697 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:51268': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:19,698 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:19,738 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:19,738 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:51282': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:19,806 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:51294': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:19,806 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:19,845 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:19,845 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:51308': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:19,914 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:51324': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:19,914 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:19,952 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:51326': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:19,952 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:20,023 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:51332': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:20,023 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:20,059 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:20,059 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:51346': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:20,131 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:51356': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:20,132 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:20,166 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:51364': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:20,166 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:20,240 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:51376': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:20,240 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:20,272 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:51390': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:20,272 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:20,349 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:51398': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:20,349 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:20,379 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:51402': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:20,379 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:20,457 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:51406': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:20,457 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:20,486 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:20,486 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:51408': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:20,566 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:51412': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:20,566 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:20,593 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:20,593 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:51416': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:20,675 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:51426': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:20,675 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:20,700 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:51430': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:20,700 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:20,783 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:51432': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:20,783 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:20,807 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:20,807 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:51436': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:20,892 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:51452': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:20,892 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:20,913 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:51466': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:20,913 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:21,000 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:51472': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:21,000 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:21,020 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:21,020 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:51476': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:21,108 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:51488': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:21,109 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:21,128 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:21,128 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:51494': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:21,217 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:51498': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:21,217 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:21,235 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:21,235 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:51502': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:21,325 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:51506': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:21,326 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:21,342 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:21,342 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:51508': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:21,454 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:21,455 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:51518': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:21,456 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:51528': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:21,456 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:21,563 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:21,566 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39730': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:21,567 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39714': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:21,567 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:21,670 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:21,670 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39740': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:21,676 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39752': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:21,676 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:21,777 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:21,777 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39756': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:21,784 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39770': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:21,784 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:21,883 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39772': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:21,883 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:21,892 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39778': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:21,892 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:21,990 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:21,990 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39794': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:22,000 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39800': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:22,001 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:22,097 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39802': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:22,097 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:22,109 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39804': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:22,109 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:22,204 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39820': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:22,204 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:22,217 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39822': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:22,217 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:22,312 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39834': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:22,312 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:22,325 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39850': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:22,326 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:22,419 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39856': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:22,419 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:22,434 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39862': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:22,434 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:22,526 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39878': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:22,526 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:22,542 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39884': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:22,543 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:22,633 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39888': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:22,633 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:22,651 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39902': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:22,651 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:22,740 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39904': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:22,740 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:22,759 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39908': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:22,759 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:22,847 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39916': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:22,847 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:22,868 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39930': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:22,869 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:22,954 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:22,954 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39936': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:22,977 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39940': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:22,977 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:23,061 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:23,061 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39942': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:23,085 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39948': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:23,086 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:23,168 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:23,168 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39964': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:23,194 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39970': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:23,194 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:23,275 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39974': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:23,275 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:23,304 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:23,304 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:23,381 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:23,382 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39996': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:23,412 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40006': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:23,413 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:23,488 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40010': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:23,488 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:23,521 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40020': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:23,521 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:23,595 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:23,595 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40024': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:23,629 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40038': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:23,629 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:23,702 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:23,702 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40048': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:23,737 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40050': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:23,738 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:23,809 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:23,809 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:23,846 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40068': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:23,846 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:23,916 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:23,916 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40074': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:23,954 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40084': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:23,955 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:24,023 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40098': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:24,023 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:24,063 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40102': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:24,063 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:24,130 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:24,130 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40118': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:24,171 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40124': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:24,171 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:24,237 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40126': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:24,237 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:24,279 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40130': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:24,279 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:24,344 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:24,344 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40132': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:24,387 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40146': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:24,388 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:24,451 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40156': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:24,451 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:24,496 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40166': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:24,496 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:24,558 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40170': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:24,558 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:24,605 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40184': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:24,605 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:24,665 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:24,665 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40186': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:24,713 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40190': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:24,714 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:24,772 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40206': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:24,772 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:24,822 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40220': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:24,822 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:24,879 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40222': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:24,879 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:24,930 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40228': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:24,930 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:24,986 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40230': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:24,986 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:25,038 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40234': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:25,039 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:25,093 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:25,093 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40244': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:25,147 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40252': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:25,147 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:25,199 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40260': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:25,199 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:25,256 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40266': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:25,256 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:25,306 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40274': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:25,306 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:25,364 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40286': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:25,364 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:25,413 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40292': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:25,413 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:25,472 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40296': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:25,473 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:25,520 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40310': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:25,520 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:25,580 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40326': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:25,581 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:25,627 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40330': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:25,627 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:25,689 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40332': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:25,689 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:25,734 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40348': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:25,734 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:25,797 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40362': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:25,797 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:25,841 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:25,841 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40368': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:25,905 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40372': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:25,905 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:25,948 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40374': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:25,948 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:26,013 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40382': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:26,014 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:26,055 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40392': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:26,055 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:26,122 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40396': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:26,122 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:26,162 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40406': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:26,162 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:26,230 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40422': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:26,230 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:26,269 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40436': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:26,269 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:26,339 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40442': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:26,339 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:26,376 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40454': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:26,376 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:26,447 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40464': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:26,447 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:26,483 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40478': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:26,483 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:26,556 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40490': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:26,556 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:26,590 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:26,590 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40504': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:26,664 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40514': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:26,665 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:26,696 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40528': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:26,696 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:26,773 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40544': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:26,773 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:26,803 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40552': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:26,803 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:26,881 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40564': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:26,882 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:26,910 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40580': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:26,910 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:26,990 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40584': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:26,990 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:27,017 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40588': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:27,017 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:27,098 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40602': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:27,099 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:27,125 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40606': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:27,125 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:27,207 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40620': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:27,207 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:27,232 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40626': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:27,232 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:27,315 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40632': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:27,315 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:27,339 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40640': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:27,339 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:27,424 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40656': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:27,424 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:27,446 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:27,446 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40666': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:27,532 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40682': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:27,532 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:27,553 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40694': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:27,553 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:27,640 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40696': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:27,641 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:27,660 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:27,660 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40712': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:27,749 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:27,752 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:27,767 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40732': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:27,767 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:27,857 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40736': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:27,857 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:27,874 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40748': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:27,874 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:27,966 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40764': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:27,966 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:27,981 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40776': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:27,981 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:28,075 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40786': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:28,075 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:28,088 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:28,088 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40802': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:28,185 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40812': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:28,185 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:28,195 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:28,195 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40824': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:28,293 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40828': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:28,294 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:28,301 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40832': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:28,301 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:28,402 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40844': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:28,402 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:28,408 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40854': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:28,408 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:28,510 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:28,514 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40856': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:28,515 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40868': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:28,515 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:28,618 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:28,626 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40878': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:28,627 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40886': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:28,628 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:28,728 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40890': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:28,728 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:28,734 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40904': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:28,734 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:28,837 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:28,840 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40910': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:28,841 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40924': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:28,841 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:28,945 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:28,948 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40940': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:28,949 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40942': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:28,949 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:29,054 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:29,057 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40956': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:29,057 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:29,057 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40960': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:29,162 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:29,165 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40966': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:29,166 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40976': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:29,166 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:29,270 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:29,273 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40990': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:29,274 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41006': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:29,274 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:29,378 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:29,382 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41010': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:29,382 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41012': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:29,382 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:29,487 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:29,490 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41014': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:29,490 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41028': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:29,490 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:29,595 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:29,598 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41038': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:29,599 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41040': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:29,599 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:29,703 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:29,706 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41052': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:29,707 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41062': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:29,707 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:29,812 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:29,816 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41068': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:29,816 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41074': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:29,816 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:29,921 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:29,924 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41084': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:29,925 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41088': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:29,925 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:30,029 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:30,032 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41104': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:30,033 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41118': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:30,033 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:30,138 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:30,141 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:30,141 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41138': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:30,141 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:30,246 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:30,249 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41144': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:30,250 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:30,253 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41154': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:30,354 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:30,357 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41168': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:30,358 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41176': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:30,358 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:30,462 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:30,466 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41182': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:30,466 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41186': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:30,466 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:30,571 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:30,574 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41190': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:30,575 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41194': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:30,575 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:30,679 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:30,682 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41198': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:30,683 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41212': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:30,683 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:30,787 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:30,790 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41228': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:30,791 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41234': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:30,791 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:30,896 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:30,898 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41244': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:30,899 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41252': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:30,899 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:31,004 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:31,007 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41266': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:31,007 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41270': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:31,007 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:31,112 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:31,115 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41284': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:31,116 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41286': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:31,116 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:31,220 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:31,223 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41296': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:31,224 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41302': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:31,224 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:31,329 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:31,332 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41316': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:31,332 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41324': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:31,332 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:31,437 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:31,440 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41326': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:31,441 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41334': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:31,441 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:31,546 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:31,549 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46230': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:31,550 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46244': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:31,550 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:31,654 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:31,658 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46258': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:31,658 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46262': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:31,658 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:31,762 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:31,766 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46278': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:31,766 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46280': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:31,766 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:31,871 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:31,874 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46286': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:31,874 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46298': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:31,874 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:31,979 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:31,982 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46302': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:31,983 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46318': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:31,983 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:32,087 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:32,091 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46332': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:32,091 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46334': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:32,091 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:32,196 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:32,199 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46344': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:32,200 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46352': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:32,200 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:32,304 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:32,307 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46362': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:32,308 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46376': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:32,308 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:32,412 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:32,415 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46390': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:32,416 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46406': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:32,416 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:32,521 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:32,524 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46414': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:32,524 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46420': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:32,524 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:32,629 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:32,632 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46426': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:32,633 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46430': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:32,633 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:32,738 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:32,741 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46442': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:32,741 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46448': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:32,741 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:32,846 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:32,849 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46458': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:32,850 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46470': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:32,850 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:32,954 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:32,957 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46472': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:32,958 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46480': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:32,958 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:33,064 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:33,067 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46492': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:33,068 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46494': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:33,068 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:33,172 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:33,175 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46506': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:33,176 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:33,176 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46510': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:33,281 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:33,285 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46516': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:33,285 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46520': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:33,285 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:33,390 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:33,393 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46522': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:33,393 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46536': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:33,393 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:33,501 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:33,505 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46548': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:33,506 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46552': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:33,506 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:33,608 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46564': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:33,609 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:33,614 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46580': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:33,615 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:33,716 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:33,716 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46596': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:33,723 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46612': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:33,723 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:33,822 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46624': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:33,822 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:33,831 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46638': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:33,831 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:33,929 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:33,929 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46650': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:33,939 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46656': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:33,939 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:34,036 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46672': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:34,036 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:34,047 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46684': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:34,047 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:34,143 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:34,143 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46686': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:34,155 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46698': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:34,156 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:34,250 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:34,253 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46708': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:34,264 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46712': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:34,264 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:34,357 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:34,357 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46726': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:34,372 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46742': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:34,372 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:34,464 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:34,464 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46744': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:34,480 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46746': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:34,480 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:34,572 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46756': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:34,572 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:34,588 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46772': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:34,588 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:34,679 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:34,679 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46774': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:34,696 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46782': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:34,696 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:34,786 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46786': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:34,786 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:34,804 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46802': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:34,804 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:34,893 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:34,893 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46816': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:34,912 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46828': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:34,913 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:35,001 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:35,001 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46832': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:35,021 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46840': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:35,021 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:35,108 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46848': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:35,108 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:35,129 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46854': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:35,129 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:35,215 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46868': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:35,215 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:35,237 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46874': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:35,237 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:35,322 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46880': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:35,322 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:35,346 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46892': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:35,346 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:35,429 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:35,429 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46900': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:35,454 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46914': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:35,454 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:35,536 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46928': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:35,536 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:35,562 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46936': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:35,562 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:35,643 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:35,643 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46950': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:35,671 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46964': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:35,671 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:35,750 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:35,754 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46978': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:35,780 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46986': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:35,780 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:35,858 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:46988': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:35,858 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:35,888 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47000': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:35,888 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:35,965 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:35,965 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47002': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:35,997 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47016': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:35,997 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:36,072 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47022': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:36,072 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:36,105 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47028': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:36,105 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:36,179 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47032': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:36,179 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:36,213 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47038': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:36,213 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:36,286 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47042': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:36,286 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:36,321 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47054': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:36,321 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:36,393 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:36,393 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:36,430 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47074': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:36,430 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:36,500 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47080': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:36,500 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:36,538 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47084': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:36,539 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:36,607 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47092': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:36,607 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:36,647 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47108': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:36,647 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:36,715 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:36,715 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47120': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:36,757 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:36,757 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:36,824 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47138': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:36,824 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:36,865 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47142': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:36,866 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:36,931 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47156': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:36,931 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:36,975 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47166': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:36,975 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:37,038 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47180': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:37,038 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:37,083 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47194': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:37,083 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:37,145 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47208': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:37,145 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:37,192 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47210': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:37,192 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:37,255 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47224': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:37,255 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:37,300 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47236': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:37,301 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:37,362 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:37,362 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47240': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:37,409 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47256': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:37,409 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:37,469 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47268': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:37,469 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:37,518 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47274': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:37,518 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:37,576 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47276': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:37,577 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:37,626 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47292': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:37,626 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:37,684 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47296': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:37,684 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:37,735 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47298': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:37,735 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:37,791 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:37,791 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47302': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:37,843 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47312': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:37,844 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:37,898 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:37,898 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47324': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:37,954 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47326': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:37,954 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:38,005 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47328': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:38,005 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:38,062 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47340': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:38,062 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:38,112 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47356': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:38,112 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:38,171 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47360': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:38,171 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:38,219 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47366': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:38,219 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:38,279 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47376': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:38,280 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:38,327 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:38,327 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47388': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:38,388 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47396': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:38,388 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:38,435 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:38,435 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47412': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:38,497 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47416': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:38,497 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:38,542 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47426': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:38,542 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:38,605 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47434': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:38,605 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:38,649 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:38,649 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47440': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:38,714 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47452': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:38,714 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:38,756 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47454': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:38,756 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:38,822 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47470': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:38,822 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:38,863 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47484': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:38,863 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:38,931 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47498': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:38,931 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:38,970 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47504': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:38,970 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:39,039 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47518': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:39,039 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:39,077 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:39,077 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47530': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:39,148 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47544': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:39,148 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:39,185 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47550': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:39,185 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:39,256 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47558': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:39,256 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:39,291 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47572': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:39,291 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:39,365 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47582': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:39,365 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:39,399 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:39,399 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47584': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:39,473 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47586': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:39,474 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:39,506 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:39,506 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47588': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:39,582 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47604': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:39,582 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:39,613 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47616': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:39,613 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:39,690 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47622': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:39,690 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:39,720 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47626': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:39,720 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:39,799 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47640': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:39,799 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:39,827 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:39,827 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47648': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:39,907 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47652': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:39,908 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:39,934 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47664': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:39,934 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:40,016 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47666': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:40,016 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:40,042 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47680': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:40,042 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:40,124 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47688': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:40,125 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:40,150 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47694': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:40,150 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:40,233 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47698': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:40,233 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:40,257 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47712': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:40,257 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:40,342 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47720': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:40,342 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:40,364 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47736': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:40,364 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:40,450 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47750': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:40,451 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:40,471 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:40,471 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47758': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:40,559 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47762': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:40,559 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:40,578 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:40,578 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47764': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:40,668 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47778': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:40,668 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:40,685 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:40,685 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47790': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:40,776 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47802': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:40,776 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:40,792 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:40,792 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47806': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:40,885 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47810': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:40,885 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:40,900 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:40,900 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47822': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:40,993 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47830': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:40,993 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:41,011 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:41,011 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47846': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:41,102 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47850': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:41,103 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:41,118 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:41,118 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47866': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:41,211 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47872': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:41,211 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:41,225 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:41,225 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47878': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:41,320 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47890': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:41,320 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:41,332 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47902': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:41,332 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:41,428 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47916': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:41,428 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:41,439 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:47928': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:41,439 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:41,537 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:59942': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:41,537 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:41,545 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:59944': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:41,545 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:41,646 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:59956': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:41,646 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:41,653 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:41,653 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:59964': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:41,756 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:41,759 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:59980': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:41,760 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:59986': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:41,760 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:41,865 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:41,868 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:59994': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:41,869 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:60000': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:41,869 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:41,973 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:41,976 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:60010': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:41,977 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:60014': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:41,977 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:42,089 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:42,090 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:60024': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:42,091 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:60028': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:42,091 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:42,197 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:42,200 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:60030': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:42,201 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:60042': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:42,201 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:42,305 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:42,308 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:60056': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:42,309 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:60062': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:42,309 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:42,414 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:42,417 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:60078': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:42,417 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:60082': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:42,417 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:42,523 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:42,525 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:60090': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:42,526 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:60106': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:42,526 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:42,632 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:42,634 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:60118': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:42,635 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:60132': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:42,635 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:42,741 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:42,744 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:60136': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:42,744 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:60148': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:42,744 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:42,851 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:42,854 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:60168': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:42,855 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:60156': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:42,855 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:42,957 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:42,957 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:60172': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:42,964 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:60176': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:42,964 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:43,064 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:60178': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:43,064 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:43,072 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:60186': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:43,072 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:43,171 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:43,171 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:60198': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:43,180 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:60206': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:43,181 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:43,278 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:43,278 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:60214': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:43,289 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:60216': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:43,289 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:43,384 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:60230': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:43,384 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:43,397 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:60244': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:43,397 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:43,491 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:43,491 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:60252': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:43,506 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:60258': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:43,506 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:43,597 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:43,597 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:60266': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:43,615 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:60278': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:43,615 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:43,704 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:60282': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:43,704 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:43,724 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:60294': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:43,724 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:43,811 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:60302': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:43,811 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:43,832 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:60304': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:43,832 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:43,918 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:43,918 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:60318': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:43,941 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:60326': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:43,941 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:44,025 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:44,025 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:60334': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:44,049 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:60346': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:44,049 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:44,133 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:44,133 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:60352': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:44,158 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:60368': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:44,158 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:44,240 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:60376': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:44,240 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:44,266 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:60384': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:44,267 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:44,346 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:60400': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:44,346 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:44,375 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:60416': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:44,375 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:44,458 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:44,458 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:60420': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:44,486 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:60436': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:44,486 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:44,565 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:44,565 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:60438': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:44,594 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:60448': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:44,594 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:44,672 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:44,672 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:60464': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:44,703 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:60480': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:44,703 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:44,779 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:44,779 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:60492': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:44,811 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:60508': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:44,812 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:44,886 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:44,886 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:60514': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:44,920 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:60522': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:44,920 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:44,993 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:44,993 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:60530': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:45,028 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:60538': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:45,029 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:45,100 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:45,100 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:60540': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:45,137 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:60542': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:45,137 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:45,207 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:60552': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:45,207 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:45,245 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:60554': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:45,245 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:45,314 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:45,314 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:60566': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:45,354 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:60582': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:45,355 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:45,421 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:45,421 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:60584': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:45,463 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:60586': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:45,463 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:45,529 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:45,529 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:60602': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:45,571 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:60614': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:45,572 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:45,636 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:45,636 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:60622': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:45,680 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:60626': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:45,680 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:45,743 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:45,743 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:60634': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:45,788 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:60636': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:45,788 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:45,849 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:45,849 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:60638': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:45,897 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:60654': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:45,911 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:45,957 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:45,957 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:60670': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:46,023 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:60676': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:46,023 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:46,064 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:46,064 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:60680': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:46,131 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:60684': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:46,132 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:46,171 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:60690': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:46,171 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:46,240 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:60694': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:46,240 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:46,278 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:60698': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:46,278 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:46,348 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:60714': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:46,349 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:46,385 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:60718': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:46,385 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:46,457 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:60728': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:46,458 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:46,493 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:60732': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:46,493 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:46,566 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:60748': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:46,566 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:46,600 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:46,600 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:60762': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:46,674 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:60776': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:46,675 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:46,707 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:46,707 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:60778': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:46,783 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:60794': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:46,783 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:46,814 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:46,814 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:60802': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:46,891 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:60818': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:46,892 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:46,921 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:46,921 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:60826': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:47,000 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:60838': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:47,000 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:47,027 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:47,027 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:60850': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:47,109 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:60864': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:47,109 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:47,134 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:47,134 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:60866': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:47,218 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:60872': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:47,218 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:47,241 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:47,241 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:60888': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:47,326 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:60892': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:47,326 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:47,348 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:47,348 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:60908': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:47,435 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:60912': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:47,435 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:47,454 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:60924': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:47,454 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:47,543 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:60928': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:47,543 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:47,561 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:47,561 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:60936': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:47,652 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:60948': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:47,652 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:47,667 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:60960': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:47,667 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:47,762 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:60966': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:47,762 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:47,774 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:60980': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:47,774 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:47,871 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:60986': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:47,871 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:47,880 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:60992': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:47,880 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:47,979 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:32776': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:47,979 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:47,986 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:47,986 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:32784': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:48,088 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:48,092 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:32798': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:48,092 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:32800': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:48,093 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:48,196 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:48,199 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:32804': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:48,200 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:32812': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:48,200 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:48,305 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:48,308 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:32828': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:48,309 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:32832': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:48,309 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:48,414 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:48,416 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:32848': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:48,417 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:32856': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:48,417 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:48,522 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:48,525 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:32864': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:48,526 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:32874': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:48,526 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:48,630 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:48,633 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:32890': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:48,634 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:32902': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:48,634 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:48,739 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:48,742 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:32908': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:48,743 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:32920': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:48,743 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:48,849 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:48,851 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:32934': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:48,852 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:32942': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:48,852 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:48,957 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:48,960 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:32952': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:48,960 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:32966': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:48,960 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:49,066 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:49,069 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:32982': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:49,069 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:32984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:49,069 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:49,174 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:49,177 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:32994': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:49,178 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:33000': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:49,178 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:49,282 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:49,285 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:33012': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:49,286 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:33026': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:49,286 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:49,391 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:49,394 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:33042': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:49,394 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:33044': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:49,394 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:49,500 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:49,503 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:33060': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:49,503 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:33066': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:49,503 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:49,608 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:49,611 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:33078': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:49,612 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:33086': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:49,612 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:49,717 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:49,720 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:33096': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:49,720 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:33102': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:49,720 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:49,825 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:49,828 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:33108': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:49,829 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:33118': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:49,829 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:49,934 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:49,937 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:33122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:49,938 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:33128': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:49,938 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:50,042 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:50,045 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:33144': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:50,046 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:33160': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:50,046 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:50,151 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:50,154 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:33166': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:50,154 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:33168': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:50,154 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:50,259 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:50,262 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:33176': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:50,263 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:33182': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:50,263 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:50,368 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:50,371 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:33194': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:50,371 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:50,371 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:33210': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:50,476 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:50,479 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:33222': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:50,480 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:33234': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:50,480 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:50,585 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:50,588 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:33250': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:50,589 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:33266': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:50,589 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:50,694 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:50,697 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:33272': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:50,697 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:33286': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:50,697 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:50,803 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:50,806 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:33298': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:50,806 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:33304': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:50,806 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:50,911 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:50,914 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:33314': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:50,914 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:33326': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:50,914 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:51,019 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:51,022 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:33328': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:51,023 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:33334': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:51,023 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:51,128 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:51,131 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:33340': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:51,132 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:33346': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:51,132 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:51,237 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:51,240 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:33352': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:51,241 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:33368': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:51,241 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:51,346 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:51,349 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:33378': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:51,349 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:33392': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:51,349 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:51,455 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:51,457 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:33394': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:51,458 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:33396': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:51,458 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:51,563 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:51,566 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40352': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:51,567 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40360': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:51,567 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:51,672 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:51,674 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40374': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:51,675 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40384': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:51,675 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:51,780 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:51,783 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40400': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:51,784 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40414': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:51,784 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:51,889 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:51,892 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40428': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:51,892 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40436': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:51,892 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:51,997 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:52,000 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40440': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:52,001 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40452': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:52,001 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:52,106 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:52,109 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40462': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:52,110 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40474': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:52,110 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:52,214 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:52,217 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40488': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:52,218 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40504': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:52,218 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:52,324 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:52,327 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40520': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:52,328 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40534': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:52,328 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:52,432 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:52,435 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40550': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:52,436 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40556': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:52,436 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:52,541 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:52,544 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40572': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:52,544 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40580': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:52,545 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:52,651 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:52,654 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40592': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:52,655 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40608': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:52,655 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:52,759 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:52,762 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40616': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:52,763 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40624': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:52,763 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:52,868 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:52,871 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40638': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:52,872 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40648': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:52,872 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:52,976 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:52,980 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40652': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:52,980 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40664': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:52,980 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:53,085 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:53,088 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40670': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:53,089 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:53,089 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40672': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:53,194 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:53,197 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40684': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:53,197 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40686': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:53,197 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:53,302 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:53,306 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40700': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:53,306 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40704': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:53,306 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:53,411 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:53,414 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40712': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:53,414 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40722': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:53,414 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:53,519 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:53,523 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40736': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:53,523 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40748': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:53,523 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:53,628 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:53,631 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40762': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:53,631 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40768': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:53,631 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:53,736 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:53,739 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40772': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:53,740 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40786': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:53,740 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:53,845 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:53,848 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40798': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:53,848 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40804': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:53,848 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:53,953 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:53,956 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40808': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:53,957 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40818': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:53,957 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:54,063 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:54,066 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40826': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:54,066 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40834': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:54,066 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:54,171 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:54,174 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40850': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:54,175 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40864': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:54,175 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:54,280 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:54,283 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40878': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:54,283 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40890': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:54,283 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:54,389 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:54,391 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40904': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:54,392 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40910': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:54,392 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:54,497 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:54,500 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40924': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:54,501 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40934': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:54,501 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:54,606 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:54,609 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40948': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:54,609 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40960': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:54,609 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:54,714 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:54,717 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40968': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:54,718 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40970': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:54,718 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:54,823 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:54,826 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40982': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:54,827 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40998': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:54,827 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:54,932 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:54,935 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41006': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:54,935 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:54,935 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41014': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:55,040 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:55,043 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41022': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:55,044 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41036': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:55,044 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:55,149 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:55,152 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41038': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:55,153 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:55,153 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41054': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:55,258 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:55,261 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41056': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:55,261 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41068': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:55,261 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:55,366 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:55,369 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41084': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:55,370 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41086': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:55,370 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:55,474 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:55,477 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41102': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:55,478 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41116': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:55,478 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:55,583 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:55,586 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41130': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:55,587 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41144': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:55,587 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:55,691 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:55,694 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41152': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:55,695 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41160': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:55,695 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:55,801 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:55,804 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41172': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:55,805 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41184': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:55,805 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:55,909 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:55,913 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41194': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:55,913 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41204': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:55,913 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:56,018 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:56,028 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41216': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:56,028 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41222': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:56,028 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:56,132 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:56,135 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41226': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:56,135 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41234': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:56,135 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:56,240 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:56,243 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41240': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:56,244 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41244': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:56,244 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:56,348 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:56,351 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41254': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:56,352 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41262': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:56,352 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:56,456 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:56,459 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41274': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:56,460 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41286': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:56,460 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:56,565 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:56,568 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41294': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:56,569 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41304': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:56,569 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:56,673 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:56,677 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41318': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:56,677 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41328': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:56,677 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:56,782 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:56,785 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41330': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:56,786 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41342': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:56,786 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:56,890 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:56,894 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41354': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:56,894 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:56,894 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41360': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:56,999 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:57,002 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41364': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:57,002 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41380': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:57,002 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:57,107 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:57,110 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41394': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:57,111 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41400': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:57,111 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:57,216 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:57,219 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41408': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:57,220 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:57,220 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41418': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:57,324 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:57,327 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41428': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:57,328 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41438': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:57,328 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:57,432 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:57,435 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41454': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:57,436 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:57,436 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41468': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:57,543 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:57,546 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41482': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:57,546 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41494': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:57,546 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:57,651 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:57,654 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41496': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:57,655 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41512': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:57,655 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:57,759 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:57,762 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41528': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:57,763 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41544': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:57,763 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:57,868 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:57,871 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41560': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:57,871 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41574': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:57,871 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:57,975 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:57,979 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41580': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:57,979 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41594': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:57,979 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:58,084 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:58,087 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41602': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:58,088 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41616': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:58,088 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:58,192 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:58,195 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41618': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:58,196 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41634': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:58,196 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:58,300 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:58,303 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41638': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:58,304 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41650': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:58,304 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:58,409 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:58,412 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41654': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:58,412 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41662': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:58,412 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:58,517 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:58,520 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41670': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:58,521 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41676': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:58,521 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:58,625 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:58,628 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41692': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:58,629 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41704': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:58,629 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:58,734 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:58,737 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41718': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:58,738 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41734': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:58,738 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:58,842 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:58,845 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41744': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:58,846 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41760': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:58,846 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:58,950 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:58,954 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41768': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:58,954 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41776': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:58,954 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:59,059 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:59,062 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41780': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:59,063 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41784': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:59,063 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:59,167 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:59,170 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41800': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:59,171 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41806': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:59,171 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:59,276 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:59,279 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41814': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:59,280 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41816': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:59,280 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:59,384 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:59,388 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41832': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:59,388 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:59,388 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41840': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:59,493 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:59,496 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41852': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:59,496 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41868': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:59,496 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:59,601 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:59,604 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41884': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:59,604 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41886': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:59,604 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:59,709 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:59,712 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41902': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:59,712 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41910': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:59,712 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:59,817 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:59,820 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41924': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:59,821 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41926': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:59,821 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:59,925 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:14:59,928 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41928': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:59,929 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41942': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:14:59,929 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:00,033 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:00,037 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41954': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:00,037 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41956': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:00,037 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:00,142 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:00,145 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41970': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:00,145 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41982': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:00,146 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:00,250 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:00,257 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:00,257 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41992': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:00,257 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:00,358 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41994': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:00,358 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:00,364 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42006': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:00,364 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:00,466 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42008': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:00,466 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:00,471 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42024': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:00,471 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:00,574 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:00,577 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42040': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:00,578 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42042': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:00,578 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:00,683 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:00,686 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:00,686 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:00,686 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42070': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:00,791 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:00,794 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42076': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:00,795 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42088': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:00,795 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:00,900 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:00,903 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42098': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:00,903 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42114': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:00,903 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:01,009 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:01,012 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42126': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:01,012 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42138': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:01,012 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:01,117 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:01,120 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42142': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:01,121 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:01,121 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42144': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:01,226 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:01,229 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42150': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:01,229 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42166': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:01,229 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:01,334 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:01,338 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42174': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:01,338 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42188': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:01,338 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:01,443 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:01,446 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42190': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:01,446 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42192': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:01,446 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:01,551 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:01,554 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41592': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:01,555 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41600': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:01,555 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:01,660 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:01,663 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41604': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:01,663 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41612': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:01,663 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:01,770 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:01,773 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41622': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:01,774 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41618': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:01,774 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:01,876 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41634': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:01,877 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:01,882 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41640': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:01,882 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:01,983 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41650': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:01,983 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:01,990 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41666': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:01,991 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:02,090 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:02,090 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41682': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:02,098 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41696': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:02,098 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:02,196 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41700': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:02,196 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:02,206 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41704': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:02,206 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:02,303 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41720': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:02,303 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:02,314 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41722': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:02,314 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:02,409 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41734': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:02,409 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:02,424 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41740': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:02,424 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:02,515 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41746': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:02,515 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:02,532 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41756': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:02,533 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:02,622 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41760': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:02,622 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:02,640 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41764': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:02,641 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:02,729 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41768': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:02,729 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:02,749 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:02,751 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41772': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:02,836 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41774': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:02,836 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:02,857 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41786': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:02,857 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:02,942 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41800': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:02,942 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:02,965 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41804': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:02,965 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:03,049 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41806': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:03,049 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:03,073 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41820': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:03,074 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:03,155 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41826': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:03,156 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:03,182 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41834': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:03,182 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:03,262 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:03,263 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41850': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:03,291 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41854': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:03,291 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:03,370 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:03,370 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41858': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:03,400 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41872': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:03,400 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:03,498 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41878': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:03,498 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:03,512 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41886': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:03,512 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:03,604 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41894': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:03,604 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:03,620 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41906': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:03,620 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:03,711 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41918': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:03,711 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:03,728 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41924': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:03,728 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:03,817 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:03,817 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41930': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:03,836 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41940': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:03,836 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:03,925 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:03,925 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41956': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:03,945 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41958': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:03,945 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:04,032 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41972': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:04,032 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:04,053 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41982': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:04,053 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:04,138 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41992': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:04,138 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:04,161 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42002': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:04,161 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:04,245 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:04,245 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42016': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:04,270 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42024': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:04,270 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:04,352 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:04,352 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42038': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:04,378 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42050': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:04,378 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:04,460 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:04,460 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42056': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:04,488 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42070': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:04,488 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:04,567 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:04,568 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42084': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:04,598 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42086': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:04,598 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:04,675 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:04,675 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42088': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:04,707 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42094': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:04,707 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:04,782 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:04,782 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42098': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:04,815 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42106': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:04,816 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:04,890 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:04,890 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42112': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:04,924 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42120': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:04,924 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:04,997 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:04,997 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42134': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:05,033 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:05,033 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42144': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:05,104 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:05,105 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42158': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:05,142 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42174': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:05,143 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:05,212 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:05,212 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42190': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:05,251 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:05,255 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42206': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:05,319 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:05,319 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42216': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:05,360 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42232': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:05,360 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:05,426 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:05,427 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42236': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:05,469 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42248': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:05,469 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:05,534 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:05,534 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42258': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:05,579 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42260': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:05,579 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:05,641 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:05,642 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42274': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:05,688 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42290': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:05,688 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:05,749 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:05,753 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42296': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:05,797 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:05,797 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42310': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:05,857 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:05,857 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42320': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:05,906 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42328': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:05,906 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:05,965 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:05,965 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42344': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:06,015 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42356': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:06,015 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:06,072 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:06,073 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42368': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:06,124 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42374': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:06,124 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:06,181 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:06,181 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42378': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:06,234 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:06,234 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42382': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:06,287 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42388': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:06,287 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:06,342 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42400': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:06,342 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:06,395 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:06,395 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42402': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:06,451 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42418': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:06,451 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:06,501 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42420': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:06,501 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:06,560 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42432': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:06,560 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:06,608 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:06,608 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42438': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:06,668 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42440': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:06,669 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:06,715 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42442': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:06,715 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:06,777 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42454': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:06,777 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:06,822 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42468': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:06,822 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:06,885 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42484': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:06,886 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:06,929 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:06,929 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42490': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:06,994 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42496': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:06,994 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:07,037 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:07,037 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42512': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:07,102 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42526': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:07,103 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:07,144 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:07,144 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42534': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:07,211 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42538': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:07,211 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:07,251 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:07,254 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42554': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:07,321 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42568': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:07,321 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:07,358 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42570': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:07,358 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:07,429 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42580': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:07,429 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:07,465 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42582': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:07,465 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:07,538 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42598': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:07,538 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:07,572 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:07,572 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42606': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:07,646 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42612': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:07,646 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:07,679 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42624': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:07,679 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:07,755 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42626': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:07,755 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:07,786 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:07,786 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42628': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:07,863 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42632': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:07,864 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:07,894 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:07,894 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42646': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:07,972 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42658': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:07,972 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:08,000 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:08,000 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42660': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:08,080 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42674': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:08,080 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:08,107 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42684': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:08,107 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:08,189 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42690': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:08,189 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:08,215 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42704': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:08,215 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:08,297 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42708': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:08,297 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:08,322 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42710': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:08,322 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:08,430 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:08,433 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42738': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:08,435 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:08,435 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:08,537 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:08,537 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42746': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:08,543 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42748': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:08,543 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:08,643 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42758': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:08,643 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:08,651 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42770': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:08,651 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:08,750 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:08,756 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42786': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:08,762 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42788': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:08,762 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:08,857 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42794': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:08,857 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:08,870 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42810': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:08,870 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:08,964 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42814': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:08,964 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:08,978 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42816': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:08,979 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:09,071 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42828': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:09,071 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:09,087 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42830': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:09,087 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:09,178 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42838': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:09,178 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:09,195 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42842': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:09,195 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:09,286 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42850': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:09,286 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:09,308 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42854': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:09,309 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:09,393 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42862': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:09,393 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:09,416 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42878': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:09,417 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:09,500 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:09,500 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42882': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:09,525 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42884': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:09,525 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:09,607 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42888': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:09,607 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:09,634 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42898': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:09,634 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:09,714 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42910': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:09,714 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:09,742 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42924': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:09,742 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:09,821 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:09,821 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42928': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:09,850 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42930': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:09,850 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:09,928 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:09,928 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42940': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:09,958 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42950': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:09,959 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:10,035 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:10,035 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42966': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:10,067 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42978': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:10,067 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:10,142 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42994': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:10,142 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:10,175 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43002': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:10,175 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:10,249 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:10,253 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43004': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:10,283 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43012': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:10,283 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:10,356 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43028': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:10,356 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:10,391 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43032': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:10,391 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:10,463 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43046': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:10,463 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:10,499 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43052': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:10,499 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:10,570 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43064': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:10,570 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:10,608 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43066': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:10,608 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:10,677 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43072': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:10,677 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:10,716 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43086': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:10,716 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:10,784 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43088': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:10,784 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:10,824 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43102': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:10,824 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:10,891 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43110': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:10,891 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:10,932 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43114': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:10,932 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:10,998 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:10,998 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43130': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:11,040 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43146': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:11,040 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:11,105 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43154': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:11,105 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:11,148 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43162': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:11,148 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:11,212 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43168': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:11,212 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:11,280 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43178': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:11,283 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:11,319 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:11,319 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43180': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:11,392 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43192': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:11,393 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:11,426 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43194': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:11,426 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:11,501 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43208': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:11,501 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:11,532 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57854': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:11,532 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:11,609 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57860': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:11,609 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:11,639 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:11,639 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57870': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:11,717 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57880': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:11,717 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:11,746 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:11,746 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57890': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:11,825 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57902': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:11,826 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:11,853 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:11,853 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57910': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:11,934 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57926': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:11,934 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:11,959 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57938': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:11,959 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:12,042 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57950': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:12,042 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:12,066 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57964': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:12,066 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:12,151 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57966': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:12,151 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:12,172 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57970': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:12,172 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:12,261 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57986': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:12,261 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:12,279 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57988': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:12,279 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:12,369 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:57996': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:12,370 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:12,386 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58006': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:12,386 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:12,478 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58008': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:12,478 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:12,493 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58024': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:12,493 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:12,586 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58034': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:12,586 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:12,599 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:12,599 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58036': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:12,694 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58046': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:12,694 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:12,706 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58054': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:12,706 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:12,803 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58070': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:12,803 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:12,812 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58086': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:12,812 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:12,911 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58092': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:12,911 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:12,919 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58098': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:12,919 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:13,019 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58100': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:13,019 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:13,026 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58102': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:13,026 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:13,128 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:13,132 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58110': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:13,132 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58112': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:13,132 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:13,236 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:13,239 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58114': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:13,240 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58118': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:13,240 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:13,345 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:13,348 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:13,348 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58132': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:13,348 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:13,453 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:13,456 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58136': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:13,457 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58146': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:13,457 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:13,562 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:13,565 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58158': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:13,565 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58166': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:13,565 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:13,670 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:13,673 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58180': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:13,674 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58196': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:13,674 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:13,778 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:13,781 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58210': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:13,782 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58218': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:13,782 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:13,887 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:13,890 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58230': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:13,890 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58240': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:13,891 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:13,995 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:13,998 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58252': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:13,999 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58258': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:13,999 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:14,114 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58260': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:14,114 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58266': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:14,114 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:14,115 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:14,221 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:14,225 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58274': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:14,226 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58278': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:14,226 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:14,328 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:14,328 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58294': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:14,334 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58310': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:14,334 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:14,435 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:14,435 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58324': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:14,442 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58334': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:14,442 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:14,542 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58350': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:14,542 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:14,550 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58358': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:14,551 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:14,649 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58368': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:14,649 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:14,659 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58382': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:14,659 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:14,757 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58396': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:14,757 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:14,767 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58404': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:14,767 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:14,865 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58414': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:14,865 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:14,875 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58416': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:14,875 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:14,972 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58420': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:14,972 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:14,984 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58432': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:14,984 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:15,079 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:15,079 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58440': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:15,092 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58442': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:15,092 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:15,186 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58446': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:15,186 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:15,200 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58462': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:15,200 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:15,293 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58470': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:15,293 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:15,308 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58474': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:15,308 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:15,400 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:15,400 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58480': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:15,417 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58494': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:15,417 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:15,507 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:15,507 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58498': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:15,525 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58500': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:15,525 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:15,615 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:15,615 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58512': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:15,633 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58526': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:15,634 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:15,722 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58536': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:15,722 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:15,742 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58548': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:15,742 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:15,829 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58558': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:15,829 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:15,850 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58564': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:15,851 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:15,936 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:15,936 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58568': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:15,959 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58574': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:15,959 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:16,043 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58590': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:16,043 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:16,068 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58598': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:16,068 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:16,150 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58602': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:16,150 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:16,176 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58606': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:16,176 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:16,257 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58612': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:16,257 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:16,284 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58624': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:16,284 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:16,364 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:16,364 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58634': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:16,393 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58638': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:16,393 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:16,471 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:16,471 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58646': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:16,501 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58662': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:16,501 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:16,578 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:16,578 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58678': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:16,609 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58692': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:16,609 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:16,685 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:16,685 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58704': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:16,717 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58712': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:16,718 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:16,792 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58718': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:16,792 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:16,826 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58726': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:16,826 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:16,899 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:16,899 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58728': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:16,935 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58730': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:16,935 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:17,006 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58738': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:17,006 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:17,043 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58744': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:17,043 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:17,113 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:17,113 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58748': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:17,153 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58760': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:17,153 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:17,220 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58772': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:17,220 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:17,261 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58784': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:17,261 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:17,327 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:17,327 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:17,370 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58798': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:17,370 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:17,434 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58800': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:17,434 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:17,478 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58802': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:17,478 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:17,541 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58806': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:17,541 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:17,586 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58812': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:17,586 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:17,648 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:17,648 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58826': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:17,694 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58834': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:17,694 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:17,755 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58850': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:17,755 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:17,802 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58858': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:17,802 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:17,862 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:17,862 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58874': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:17,911 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58888': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:17,911 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:17,969 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:17,969 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58904': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:18,019 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58912': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:18,019 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:18,076 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:18,076 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58922': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:18,127 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58924': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:18,127 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:18,183 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:18,183 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58928': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:18,235 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58930': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:18,236 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:18,291 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:18,291 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58938': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:18,344 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58942': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:18,344 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:18,398 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:18,398 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58950': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:18,452 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58954': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:18,452 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:18,505 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58956': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:18,505 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:18,560 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58958': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:18,560 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:18,612 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58966': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:18,612 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:18,669 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58972': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:18,669 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:18,719 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58978': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:18,719 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:18,778 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58988': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:18,778 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:18,826 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:18,826 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:58998': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:18,886 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:59002': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:18,886 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:18,933 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:59012': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:18,933 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:18,995 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:59016': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:18,995 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:19,040 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:19,040 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:59028': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:19,103 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:59038': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:19,103 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:19,147 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:59042': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:19,147 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:19,211 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:59048': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:19,211 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:19,255 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:59054': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:19,255 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:19,319 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:59064': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:19,319 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:19,362 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:19,362 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:59070': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:19,428 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:59082': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:19,428 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:19,469 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:19,469 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:59086': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:19,536 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:59100': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:19,536 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:19,576 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:59108': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:19,576 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:19,644 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:59110': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:19,644 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:19,683 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:19,683 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:59120': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:19,755 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:59128': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:19,756 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:19,790 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:59144': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:19,790 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:19,864 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:59150': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:19,864 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:19,897 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:19,897 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:59154': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:19,972 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:59156': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:19,972 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:20,005 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:20,005 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:59166': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:20,080 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:59168': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:20,080 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:20,112 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:59184': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:20,112 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:20,188 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:59190': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:20,189 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:20,220 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:59200': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:20,220 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:20,297 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:59208': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:20,297 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:20,326 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:59216': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:20,326 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:20,406 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:59220': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:20,406 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:20,434 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:59224': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:20,434 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:20,514 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:59232': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:20,515 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:20,541 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:59242': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:20,541 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:20,623 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:59254': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:20,623 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:20,648 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:59270': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:20,648 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:20,731 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:59280': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:20,731 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:20,756 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:59282': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:20,756 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:20,839 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:59290': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:20,839 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:20,863 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:59302': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:20,863 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:20,948 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:59312': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:20,948 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:20,970 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:59318': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:20,970 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:21,057 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:59324': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:21,057 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:21,077 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:59330': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:21,077 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:21,166 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:59344': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:21,166 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:21,186 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:59356': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:21,186 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:21,283 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:59358': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:21,285 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:21,294 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:21,294 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:59370': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:21,395 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:59382': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:21,395 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:21,401 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:59390': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:21,401 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:21,503 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:21,507 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:59406': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:21,507 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:59410': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:21,507 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:21,612 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:21,615 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43372': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:21,616 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43382': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:21,616 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:21,721 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:21,724 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43398': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:21,725 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43404': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:21,726 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:21,830 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:21,833 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43420': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:21,834 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43422': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:21,834 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:21,938 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:21,941 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43426': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:21,942 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43428': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:21,943 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:22,049 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:22,053 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43442': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:22,054 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43452': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:22,054 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:22,158 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:22,161 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43454': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:22,161 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43464': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:22,162 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:22,266 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:22,269 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43472': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:22,269 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43474': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:22,269 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:22,374 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:22,377 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43480': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:22,377 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43488': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:22,377 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:22,482 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:22,485 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43498': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:22,486 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43512': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:22,486 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:22,591 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:22,594 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43524': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:22,594 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43532': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:22,594 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:22,699 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:22,702 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43536': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:22,703 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43552': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:22,703 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:22,807 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:22,810 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43564': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:22,811 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43572': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:22,811 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:22,916 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:22,918 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43586': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:22,919 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43588': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:22,919 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:23,024 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:23,028 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43598': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:23,029 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43610': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:23,029 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:23,132 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:23,135 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43624': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:23,136 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43636': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:23,136 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:23,241 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:23,244 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43640': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:23,244 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43646': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:23,244 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:23,349 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:23,352 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43648': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:23,353 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43650': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:23,353 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:23,457 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:23,461 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43662': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:23,462 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43670': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:23,462 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:23,565 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:23,568 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43680': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:23,569 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43690': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:23,569 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:23,673 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:23,677 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43692': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:23,677 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43700': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:23,677 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:23,781 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:23,785 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43708': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:23,785 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43710': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:23,785 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:23,890 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:23,893 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43722': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:23,893 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43732': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:23,893 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:23,998 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:24,001 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43738': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:24,002 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43740': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:24,002 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:24,106 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:24,109 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43746': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:24,110 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43748': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:24,110 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:24,214 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:24,217 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43750': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:24,218 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43766': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:24,218 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:24,322 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:24,325 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43780': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:24,326 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43786': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:24,326 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:24,430 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:24,433 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43794': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:24,434 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43810': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:24,434 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:24,538 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:24,541 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43820': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:24,542 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43826': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:24,542 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:24,646 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:24,649 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43842': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:24,650 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43848': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:24,650 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:24,756 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:24,759 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43862': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:24,760 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43872': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:24,760 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:24,864 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:24,867 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43878': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:24,868 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43888': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:24,868 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:24,972 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:24,975 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43904': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:24,976 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43906': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:24,976 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:25,081 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:25,084 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43912': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:25,084 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:25,084 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43920': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:25,189 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:25,193 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43932': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:25,193 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43938': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:25,193 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:25,297 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:25,300 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43950': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:25,300 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43958': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:25,300 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:25,405 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:25,408 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43970': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:25,408 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43972': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:25,408 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:25,513 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:25,516 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43980': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:25,517 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43988': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:25,517 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:25,622 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:25,625 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43996': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:25,625 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44000': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:25,625 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:25,730 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:25,733 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44008': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:25,734 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44020': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:25,734 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:25,838 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:25,841 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44036': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:25,842 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44038': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:25,842 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:25,946 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:25,949 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44054': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:25,950 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44064': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:25,950 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:26,054 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:26,057 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44068': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:26,058 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44084': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:26,058 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:26,163 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:26,166 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44100': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:26,166 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44114': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:26,166 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:26,271 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:26,274 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44130': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:26,275 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44138': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:26,275 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:26,380 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:26,383 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44142': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:26,383 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44144': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:26,383 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:26,488 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:26,491 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44156': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:26,492 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44164': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:26,492 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:26,597 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:26,600 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44180': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:26,601 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44186': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:26,601 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:26,706 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:26,709 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44198': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:26,709 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44208': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:26,709 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:26,814 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:26,817 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44210': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:26,818 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44216': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:26,818 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:26,924 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:26,928 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44226': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:26,929 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44238': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:26,929 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:27,033 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:27,037 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44250': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:27,037 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:27,038 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44262': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:27,142 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:27,146 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44270': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:27,147 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:27,147 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44276': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:27,251 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:27,261 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44286': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:27,261 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:27,261 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44294': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:27,360 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:27,360 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44300': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:27,368 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:27,368 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44314': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:27,469 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44322': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:27,469 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:27,475 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:27,475 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44336': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:27,578 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:27,582 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44342': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:27,582 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:27,583 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44346': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:27,687 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:27,691 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44356': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:27,691 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:27,691 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44368': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:27,796 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:27,800 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44374': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:27,800 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:27,800 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44382': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:27,905 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:27,909 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44396': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:27,909 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:27,909 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44398': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:28,014 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:28,018 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44400': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:28,018 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:28,019 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44404': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:28,123 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:28,128 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44416': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:28,129 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:28,129 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44428': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:28,231 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:28,236 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44444': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:28,236 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:28,236 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44456': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:28,364 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:28,369 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44470': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:28,370 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44472': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:28,370 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:28,474 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:28,479 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44480': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:28,479 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44490': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:28,479 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:28,583 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:28,587 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44500': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:28,588 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:28,588 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44512': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:28,692 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:28,697 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44518': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:28,697 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:28,698 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44522': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:28,801 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:28,805 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44528': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:28,805 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:28,805 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44540': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:28,909 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:28,913 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44552': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:28,914 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:28,914 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44556': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:29,018 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:29,022 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44560': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:29,023 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:29,023 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44568': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:29,127 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:29,131 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44578': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:29,132 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:29,132 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44592': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:29,236 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:29,240 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44594': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:29,240 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:29,241 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44610': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:29,345 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:29,349 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44614': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:29,349 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:29,350 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44630': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:29,453 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:29,457 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44636': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:29,458 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:29,458 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44638': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:29,562 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:29,566 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44642': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:29,566 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:29,567 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44648': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:29,670 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:29,674 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44664': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:29,675 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:29,675 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44678': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:29,779 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:29,783 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44694': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:29,783 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:29,783 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44706': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:29,888 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:29,892 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44708': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:29,892 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:29,892 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:29,997 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:30,001 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44734': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:30,001 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:30,002 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44740': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:30,114 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:30,119 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44754': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:30,121 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44742': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:30,121 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:30,223 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:30,223 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44762': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:30,229 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44772': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:30,229 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:30,330 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:30,330 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44788': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:30,338 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44804': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:30,338 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:30,438 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:30,438 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44818': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:30,447 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44828': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:30,447 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:30,546 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:30,546 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44832': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:30,555 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44838': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:30,556 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:30,653 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:30,653 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44844': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:30,664 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44854': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:30,664 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:30,761 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:30,761 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44870': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:30,773 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44876': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:30,773 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:30,868 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:30,868 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44880': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:30,882 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44884': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:30,882 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:30,976 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:30,976 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44890': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:30,990 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44892': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:30,990 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:31,083 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:31,083 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44906': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:31,099 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44916': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:31,099 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:31,191 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:31,192 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44932': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:31,208 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44946': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:31,208 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:31,299 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:31,299 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44956': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:31,317 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:31,317 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44968': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:31,407 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:31,407 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:31,426 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:44990': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:31,426 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:31,515 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:31,515 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:45000': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:31,535 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38630': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:31,535 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:31,622 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:31,622 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38642': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:31,644 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38646': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:31,644 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:31,730 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:31,730 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38656': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:31,758 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38672': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:31,758 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:31,838 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:31,838 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38676': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:31,869 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38682': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:31,869 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:31,945 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:31,945 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38694': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:31,978 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38710': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:31,978 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:32,053 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:32,053 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38722': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:32,087 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38732': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:32,087 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:32,160 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:32,160 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38742': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:32,197 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38748': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:32,197 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:32,267 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:32,268 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38750': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:32,306 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38760': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:32,306 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:32,382 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:32,382 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38776': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:32,419 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38792': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:32,419 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:32,491 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:32,491 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38804': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:32,529 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38814': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:32,529 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:32,598 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:32,598 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38828': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:32,638 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38844': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:32,638 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:32,706 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:32,706 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38856': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:32,748 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:32,760 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38870': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:32,813 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38876': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:32,813 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:32,856 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38882': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:32,856 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:32,920 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:32,920 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38892': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:32,964 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38902': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:32,964 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:33,027 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:33,027 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38906': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:33,073 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38918': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:33,073 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:33,135 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:33,135 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38928': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:33,181 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38942': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:33,181 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:33,242 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:33,242 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38956': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:33,289 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38958': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:33,289 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:33,349 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38974': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:33,349 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:33,397 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38988': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:33,397 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:33,456 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:33,456 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39000': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:33,505 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39010': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:33,505 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:33,563 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39012': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:33,563 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:33,613 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39024': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:33,614 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:33,670 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:33,670 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39036': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:33,722 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39044': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:33,722 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:33,777 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39046': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:33,777 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:33,830 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39052': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:33,830 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:33,885 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:33,885 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:33,939 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39074': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:33,939 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:33,992 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:33,992 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39078': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:34,047 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39080': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:34,047 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:34,099 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39094': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:34,099 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:34,155 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39100': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:34,155 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:34,206 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39112': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:34,206 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:34,263 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39128': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:34,264 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:34,313 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39130': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:34,313 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:34,372 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39144': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:34,372 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:34,420 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39148': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:34,420 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:34,481 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39160': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:34,481 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:34,527 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39170': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:34,527 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:34,589 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39174': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:34,589 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:34,635 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39180': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:34,635 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:34,698 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39194': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:34,698 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:34,742 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39208': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:34,742 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:34,806 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39220': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:34,806 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:34,849 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39236': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:34,849 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:34,914 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39240': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:34,915 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:34,956 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39244': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:34,956 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:35,023 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39248': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:35,023 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:35,064 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39260': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:35,064 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:35,131 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39276': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:35,131 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:35,171 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:35,171 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39286': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:35,239 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39296': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:35,239 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:35,279 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39306': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:35,279 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:35,347 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39320': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:35,348 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:35,386 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:35,386 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39326': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:35,456 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39340': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:35,456 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:35,502 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:35,502 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39346': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:35,569 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39352': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:35,569 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:35,609 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39368': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:35,609 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:35,679 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39376': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:35,679 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:35,716 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39386': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:35,716 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:35,787 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39392': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:35,788 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:35,824 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39406': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:35,824 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:35,895 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39414': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:35,896 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:35,931 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39416': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:35,931 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:36,003 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39432': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:36,004 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:36,038 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39436': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:36,038 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:36,112 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39452': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:36,112 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:36,147 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39468': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:36,147 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:36,220 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39472': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:36,220 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:36,256 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39488': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:36,256 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:36,329 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39496': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:36,329 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:36,365 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39500': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:36,365 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:36,437 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39516': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:36,437 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:36,473 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39530': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:36,474 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:36,546 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39538': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:36,546 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:36,582 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39542': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:36,583 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:36,654 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39548': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:36,654 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:36,691 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39564': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:36,691 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:36,765 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39572': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:36,765 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:36,799 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39576': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:36,800 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:36,873 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39586': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:36,874 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:36,908 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39592': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:36,908 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:36,982 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39598': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:36,982 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:37,017 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39612': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:37,017 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:37,090 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39626': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:37,090 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:37,125 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39636': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:37,126 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:37,199 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39640': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:37,199 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:37,234 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39656': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:37,235 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:37,307 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39668': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:37,308 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:37,343 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39682': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:37,343 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:37,417 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39690': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:37,417 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:37,451 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39704': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:37,452 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:37,525 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39712': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:37,526 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:37,560 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39718': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:37,560 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:37,634 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39728': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:37,634 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:37,668 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39742': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:37,669 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:37,742 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39752': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:37,742 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:37,776 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39754': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:37,777 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:37,851 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39768': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:37,851 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:37,885 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39774': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:37,885 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:37,960 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39788': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:37,960 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:37,994 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39790': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:37,994 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:38,068 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39794': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:38,068 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:38,103 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39806': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:38,103 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:38,176 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39812': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:38,176 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:38,211 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39828': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:38,211 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:38,285 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39830': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:38,285 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:38,320 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39846': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:38,320 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:38,394 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39860': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:38,394 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:38,428 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:38,428 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39870': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:38,503 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39880': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:38,503 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:38,536 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:38,536 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39884': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:38,612 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39886': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:38,612 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:38,644 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:38,644 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39892': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:38,721 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39906': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:38,721 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:38,751 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:38,756 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39920': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:38,830 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39934': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:38,830 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:38,859 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:38,859 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39948': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:38,939 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39962': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:38,939 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:38,967 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:38,967 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39968': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:39,048 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39974': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:39,048 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:39,074 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:39,075 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39980': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:39,157 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39990': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:39,157 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:39,182 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:39,182 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39998': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:39,266 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40002': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:39,266 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:39,289 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:39,289 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40012': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:39,375 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40026': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:39,375 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:39,396 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:39,397 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40030': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:39,484 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40044': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:39,484 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:39,504 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:39,504 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40054': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:39,593 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40064': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:39,593 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:39,611 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:39,611 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40080': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:39,701 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40082': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:39,701 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:39,719 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:39,719 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40092': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:39,810 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40108': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:39,810 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:39,826 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:39,826 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40112': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:39,919 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:39,919 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:39,936 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:39,936 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40130': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:40,028 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40144': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:40,028 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:40,043 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:40,043 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40156': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:40,137 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40164': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:40,137 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:40,151 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:40,151 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40174': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:40,247 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:40,247 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40190': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:40,258 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:40,258 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40200': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:40,356 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:40,356 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40214': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:40,366 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:40,366 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40230': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:40,465 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40242': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:40,465 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:40,473 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:40,473 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40258': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:40,574 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40268': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:40,574 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:40,581 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:40,581 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40282': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:40,683 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:40,687 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40294': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:40,688 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:40,688 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40300': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:40,792 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:40,797 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40316': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:40,797 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:40,797 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40328': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:40,902 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:40,906 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40338': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:40,906 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:40,907 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40350': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:41,011 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:41,014 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40358': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:41,015 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40366': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:41,015 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:41,119 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:41,123 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40382': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:41,124 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:41,124 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40384': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:41,228 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:41,232 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40392': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:41,232 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:41,233 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40408': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:41,336 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:41,340 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40416': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:41,341 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:41,341 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40424': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:41,445 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:41,449 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40434': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:41,450 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:41,450 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40444': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:41,554 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:41,558 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39472': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:41,559 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:41,559 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39476': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:41,665 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:41,669 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39482': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:41,670 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:41,670 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39490': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:41,774 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:41,778 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39498': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:41,779 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39512': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:41,779 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:41,882 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:41,887 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39526': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:41,887 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:41,887 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39538': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:41,991 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:41,995 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39548': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:41,996 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:41,996 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39550': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:42,100 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:42,104 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39566': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:42,105 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:42,105 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39582': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:42,208 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:42,213 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39594': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:42,213 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:42,213 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39606': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:42,317 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:42,321 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39614': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:42,321 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:42,321 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39620': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:42,425 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:42,429 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39624': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:42,430 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:42,430 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39626': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:42,534 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:42,538 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39642': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:42,539 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:42,539 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39654': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:42,643 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:42,647 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39664': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:42,648 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:42,648 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39672': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:42,751 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:42,761 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39684': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:42,761 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:42,762 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39686': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:42,860 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:42,860 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39696': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:42,868 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:42,868 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39712': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:42,968 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39716': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:42,968 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:42,975 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:42,975 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:43,077 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:43,082 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39728': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:43,083 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:43,083 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39730': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:43,185 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:43,189 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39732': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:43,190 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:43,190 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39736': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:43,293 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:43,298 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39738': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:43,298 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:43,298 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39746': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:43,402 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:43,406 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39748': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:43,407 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:43,407 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39762': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:43,510 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:43,515 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39778': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:43,515 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:43,515 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39788': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:43,619 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:43,623 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39790': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:43,624 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:43,624 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39792': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:43,727 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:43,731 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39798': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:43,732 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:43,732 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39806': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:43,836 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:43,840 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39808': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:43,841 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:43,841 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39814': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:43,945 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:43,949 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39828': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:43,949 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:43,950 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39830': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:44,053 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:44,057 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39842': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:44,058 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:44,058 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39844': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:44,162 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:44,166 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39856': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:44,166 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:44,166 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39858': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:44,270 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:44,274 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39862': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:44,275 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:44,275 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39874': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:44,380 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:44,384 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39884': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:44,384 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:44,385 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39888': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:44,489 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:44,493 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39896': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:44,493 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:44,493 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39906': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:44,598 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:44,602 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39910': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:44,602 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:44,602 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39912': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:44,706 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:44,710 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39918': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:44,710 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:44,710 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39932': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:44,814 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:44,814 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39940': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:44,889 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:44,889 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39946': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:44,923 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39958': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:44,923 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:44,996 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:44,997 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39974': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:45,031 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:45,032 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39980': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:45,104 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:45,104 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39992': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:45,140 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:45,140 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39996': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:45,211 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:45,211 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40002': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:45,249 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:45,253 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40016': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:45,318 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:45,319 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40032': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:45,358 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40042': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:45,358 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:45,426 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:45,426 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40044': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:45,466 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:45,467 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:45,533 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:45,534 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40070': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:45,575 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:45,575 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40078': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:45,641 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:45,641 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40090': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:45,683 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:45,683 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40094': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:45,748 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:45,753 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40108': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:45,792 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40110': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:45,792 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:45,855 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:45,856 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40112': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:45,900 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:45,900 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40124': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:45,963 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:45,963 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40140': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:46,009 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40154': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:46,009 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:46,070 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:46,070 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40158': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:46,119 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40170': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:46,119 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:46,177 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:46,177 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40174': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:46,229 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40176': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:46,229 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:46,285 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:46,285 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40178': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:46,338 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40190': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:46,338 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:46,392 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:46,392 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40200': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:46,447 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:46,447 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40208': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:46,499 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:46,499 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40214': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:46,606 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:46,607 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40216': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:46,714 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:46,714 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40230': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:46,729 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40232': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:46,729 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:46,821 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:46,822 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40234': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:46,837 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40250': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:46,837 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:46,929 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:46,929 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40258': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:46,946 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40266': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:46,946 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:47,036 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:47,036 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40274': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:47,055 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40286': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:47,055 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:47,144 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:47,144 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40298': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:47,164 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40304': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:47,164 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:47,251 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:47,255 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40306': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:47,273 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40318': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:47,273 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:47,358 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:47,358 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40330': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:47,381 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40338': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:47,382 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:47,466 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:47,466 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40350': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:47,491 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40358': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:47,491 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:47,573 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:47,573 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40368': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:47,599 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40378': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:47,599 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:47,680 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:47,680 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40380': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:47,708 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40388': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:47,708 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:47,788 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:47,788 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40402': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:47,817 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40418': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:47,817 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:47,895 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:47,895 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40424': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:47,927 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40432': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:47,927 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:48,002 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:48,002 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40440': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:48,036 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40448': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:48,036 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:48,110 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:48,110 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40456': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:48,145 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40464': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:48,145 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:48,217 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:48,217 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40470': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:48,260 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40478': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:48,260 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:48,324 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40488': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:48,325 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:48,369 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:48,369 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40502': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:48,433 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:48,433 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40518': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:48,477 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:48,477 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40524': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:48,540 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:48,540 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40528': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:48,586 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40532': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:48,586 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:48,647 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:48,647 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40534': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:48,695 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40536': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:48,695 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:48,757 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:48,757 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40542': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:48,804 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40554': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:48,804 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:48,864 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:48,865 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40564': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:48,913 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40566': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:48,913 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:48,972 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:48,972 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40570': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:49,022 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40586': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:49,022 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:49,079 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:49,079 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40598': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:49,131 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40612': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:49,131 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:49,186 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:49,187 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40616': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:49,240 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:49,240 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40630': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:49,294 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:49,294 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40646': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:49,349 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40650': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:49,349 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:49,401 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:49,401 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40666': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:49,458 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40668': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:49,458 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:49,508 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:49,508 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40682': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:49,567 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40694': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:49,567 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:49,615 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:49,616 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40708': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:49,676 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40712': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:49,676 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:49,723 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:49,723 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:49,785 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40740': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:49,785 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:49,830 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:49,830 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40742': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:49,894 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40744': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:49,894 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:49,937 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:49,938 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40746': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:50,003 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40754': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:50,003 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:50,045 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:50,045 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40768': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:50,112 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40778': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:50,112 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:50,152 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:50,153 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40792': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:50,221 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40808': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:50,222 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:50,260 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:50,260 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40810': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:50,331 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40818': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:50,331 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:50,367 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:50,367 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40822': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:50,440 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:50,440 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40828': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:50,474 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:50,475 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40844': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:50,549 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40852': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:50,549 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:50,582 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:50,582 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40854': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:50,658 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40866': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:50,658 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:50,689 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:50,690 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40882': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:50,767 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40888': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:50,767 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:50,797 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:50,797 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40892': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:50,876 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40898': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:50,876 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:50,905 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:50,905 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40908': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:50,985 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40916': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:50,985 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:51,012 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:51,012 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40930': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:51,094 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:51,094 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40932': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:51,119 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:51,119 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40936': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:51,203 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:51,203 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40940': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:51,227 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:51,227 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40942': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:51,312 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40944': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:51,312 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:51,334 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:51,334 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40960': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:51,421 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40966': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:51,421 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:51,442 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:51,442 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40972': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:51,530 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:40984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:51,530 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:51,549 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:51,550 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52154': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:51,639 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52160': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:51,640 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:51,657 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:51,657 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52166': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:51,748 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:51,753 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52174': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:51,764 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:51,764 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52186': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:51,857 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52190': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:51,857 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:51,871 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:51,872 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52204': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:51,966 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52220': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:51,966 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:51,979 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:51,979 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52228': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:52,075 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52230': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:52,075 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:52,086 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:52,086 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52244': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:52,184 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:52,184 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52260': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:52,194 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:52,194 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52268': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:52,293 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52270': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:52,293 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:52,301 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:52,301 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52284': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:52,402 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:52,403 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52288': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:52,408 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:52,408 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52294': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:52,511 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:52,515 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52300': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:52,515 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:52,516 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52310': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:52,620 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:52,624 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52312': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:52,624 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52326': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:52,625 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:52,729 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:52,733 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52332': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:52,733 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:52,733 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52348': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:52,837 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:52,841 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52358': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:52,842 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:52,842 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52360': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:52,946 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:52,950 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52370': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:52,950 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:52,951 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52386': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:53,054 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:53,058 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52402': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:53,059 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:53,059 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52418': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:53,164 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:53,168 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52426': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:53,168 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:53,168 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52428': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:53,397 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:53,400 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52440': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:53,401 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52448': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:53,401 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:53,506 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:53,510 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52462': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:53,510 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:53,511 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52476': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:53,615 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:53,619 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52492': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:53,619 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:53,619 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52508': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:53,724 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:53,728 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52518': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:53,729 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52522': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:53,729 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:53,833 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:53,837 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52526': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:53,837 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:53,838 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52542': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:53,942 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:53,946 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52544': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:53,946 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:53,946 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52560': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:54,050 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:54,055 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52572': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:54,055 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:54,055 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52586': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:54,159 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:54,163 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52598': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:54,164 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:54,164 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52606': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:54,268 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:54,272 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52612': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:54,272 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:54,272 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52628': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:54,377 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:54,380 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52640': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:54,381 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:54,381 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52646': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:54,486 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:54,490 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52648': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:54,490 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:54,490 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52664': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:54,594 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:54,598 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52668': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:54,599 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:54,599 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52670': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:54,704 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:54,707 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52678': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:54,707 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52680': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:54,707 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:54,812 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:54,816 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52686': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:54,816 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:54,817 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52702': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:54,920 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:54,924 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52706': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:54,924 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:54,925 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52718': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:55,028 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:55,032 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52734': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:55,033 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52742': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:55,033 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:55,136 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:55,140 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52754': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:55,141 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52756': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:55,141 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:55,244 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:55,249 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52758': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:55,249 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:55,254 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52768': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:55,352 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:55,356 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52776': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:55,357 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52786': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:55,357 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:55,460 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:55,464 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52792': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:55,464 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52800': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:55,464 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:55,568 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:55,572 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52810': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:55,572 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52826': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:55,572 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:55,675 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:55,679 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52830': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:55,680 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52834': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:55,680 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:55,783 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:55,787 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52842': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:55,788 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52846': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:55,788 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:55,891 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:55,895 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52854': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:55,896 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52856': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:55,896 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:55,999 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:56,003 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52872': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:56,004 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52874': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:56,004 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:56,107 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:56,111 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52888': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:56,111 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52902': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:56,111 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:56,214 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:56,218 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52912': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:56,219 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52916': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:56,219 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:56,322 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:56,326 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52920': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:56,327 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52936': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:56,327 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:56,430 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:56,434 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52938': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:56,435 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:56,435 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52954': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:56,538 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:56,542 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52962': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:56,543 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:56,543 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52974': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:56,646 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:56,650 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:52990': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:56,651 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:56,651 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53004': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:56,758 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:56,762 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53020': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:56,763 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53022': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:56,763 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:56,866 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:56,870 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53028': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:56,871 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53036': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:56,871 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:56,974 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:56,978 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53040': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:56,979 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53050': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:56,979 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:57,082 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:57,086 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53062': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:57,087 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:57,087 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53074': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:57,190 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:57,194 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53078': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:57,195 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53084': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:57,195 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:57,298 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:57,302 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53094': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:57,303 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:57,303 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53102': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:57,406 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:57,410 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53106': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:57,411 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53120': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:57,410 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:57,514 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:57,519 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53136': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:57,520 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53152': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:57,520 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:57,622 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53166': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:57,622 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:57,627 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:57,627 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53180': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:57,730 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:57,734 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53196': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:57,734 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:57,734 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53206': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:57,838 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:57,842 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53216': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:57,842 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:57,843 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53230': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:57,946 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:57,950 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53238': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:57,950 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:57,950 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53248': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:58,054 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:58,058 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53262': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:58,058 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53266': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:58,058 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:58,161 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:58,165 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53268': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:58,166 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:58,166 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53280': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:58,269 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:58,273 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53284': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:58,274 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:58,274 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53300': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:58,378 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:58,382 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53316': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:58,383 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:58,383 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53330': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:58,488 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:58,492 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53344': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:58,492 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:58,492 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53360': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:58,597 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:58,601 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53376': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:58,601 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:58,601 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53384': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:58,706 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:58,710 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53390': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:58,710 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:58,710 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53392': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:58,815 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:58,819 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53400': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:58,819 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:58,819 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53412': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:58,924 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:58,928 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53426': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:58,928 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:58,928 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53436': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:59,033 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:59,036 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53446': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:59,037 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:59,037 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53450': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:59,143 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:59,145 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53452': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:59,146 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:59,146 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53460': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:59,252 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:59,261 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53472': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:59,262 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:59,262 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53474': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:59,361 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53476': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:59,361 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:59,369 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:59,369 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53482': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:59,470 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53492': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:59,470 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:59,476 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:59,476 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53506': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:59,579 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:59,583 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53520': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:59,583 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:59,583 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53528': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:59,688 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:59,691 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53538': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:59,692 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53552': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:59,692 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:59,796 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:59,800 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53564': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:59,801 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:59,801 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53568': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:59,904 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:59,908 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53582': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:15:59,909 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:15:59,909 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53586': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:00,013 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:00,017 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53600': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:00,018 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:00,018 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53616': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:00,122 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:00,126 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53624': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:00,127 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:00,127 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53626': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:00,232 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:00,236 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53642': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:00,237 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:00,237 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53646': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:00,341 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:00,345 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53654': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:00,346 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:00,346 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53662': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:00,450 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:00,455 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53678': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:00,455 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53692': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:00,455 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:00,559 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:00,563 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53708': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:00,564 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:00,564 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:00,669 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:00,672 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53740': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:00,673 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:00,673 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53746': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:00,778 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:00,782 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53756': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:00,782 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:00,782 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53772': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:00,887 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:00,891 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53778': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:00,892 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:00,892 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53788': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:00,996 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:01,000 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53804': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:01,000 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:01,001 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53820': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:01,105 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:01,109 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53834': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:01,109 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:01,110 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53850': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:01,214 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:01,218 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53852': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:01,218 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:01,218 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53866': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:01,323 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:01,327 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53880': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:01,327 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:01,328 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53892': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:01,432 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:01,436 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53902': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:01,436 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:01,437 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:53910': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:01,541 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:01,545 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37686': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:01,545 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:01,545 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37698': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:01,650 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:01,654 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37712': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:01,654 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:01,654 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37722': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:01,758 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:01,762 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37726': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:01,763 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37730': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:01,763 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:01,867 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:01,871 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37744': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:01,871 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:01,872 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37760': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:01,977 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:01,981 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37768': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:01,981 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:01,981 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37772': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:02,086 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:02,089 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37774': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:02,090 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:02,090 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37782': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:02,195 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:02,200 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37792': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:02,200 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:02,201 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37806': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:02,303 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:02,307 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37816': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:02,308 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:02,308 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37818': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:02,412 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:02,417 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37832': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:02,417 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:02,417 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37840': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:02,521 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:02,525 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37854': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:02,525 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:02,526 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37870': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:02,630 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:02,634 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37878': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:02,634 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:02,635 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37890': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:02,739 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:02,743 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37898': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:02,743 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:02,744 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37902': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:02,848 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:02,852 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37918': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:02,853 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37934': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:02,853 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:02,957 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:02,961 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37936': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:02,961 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:02,962 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37938': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:03,066 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:03,070 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37948': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:03,070 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:03,071 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37964': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:03,175 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:03,179 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37968': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:03,179 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:03,179 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37980': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:03,284 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:03,288 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:37994': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:03,288 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:03,288 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38006': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:03,393 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:03,397 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38010': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:03,398 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:03,398 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38022': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:03,502 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:03,506 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38034': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:03,507 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:03,507 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38042': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:03,611 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:03,615 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:03,615 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:03,616 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38066': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:03,723 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:03,727 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38076': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:03,727 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:03,727 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38080': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:03,832 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:03,836 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38086': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:03,836 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:03,836 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38102': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:03,941 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:03,945 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38108': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:03,945 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:03,945 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38116': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:04,050 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:04,054 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38120': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:04,054 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:04,055 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38134': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:04,159 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:04,162 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38150': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:04,163 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:04,163 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38162': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:04,267 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:04,271 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38172': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:04,271 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:04,272 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38180': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:04,376 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:04,380 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38196': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:04,380 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:04,381 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38198': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:04,485 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:04,489 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38206': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:04,489 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:04,489 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38222': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:04,594 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:04,598 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38230': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:04,598 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:04,598 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38246': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:04,703 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:04,707 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38260': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:04,707 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:04,707 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38264': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:04,812 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:04,816 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38270': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:04,816 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:04,816 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38278': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:04,920 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:04,925 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38284': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:04,925 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:04,925 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38300': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:05,029 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:05,033 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38310': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:05,033 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:05,034 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38316': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:05,138 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:05,142 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38320': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:05,142 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:05,143 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38326': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:05,247 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:05,252 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:05,257 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38328': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:05,257 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38342': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:05,356 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:05,360 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38352': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:05,360 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:05,360 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38364': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:05,465 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:05,470 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38374': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:05,470 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:05,470 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38380': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:05,574 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:05,578 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38388': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:05,579 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:05,579 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38398': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:05,683 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:05,687 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38402': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:05,688 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:05,688 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38414': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:05,792 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:05,796 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38416': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:05,796 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:05,797 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38432': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:05,901 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:05,905 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38444': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:05,905 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:05,905 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38460': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:06,010 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:06,014 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38464': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:06,014 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:06,014 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38474': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:06,119 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:06,123 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38490': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:06,123 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:06,123 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38498': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:06,227 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:06,231 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38510': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:06,232 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:06,232 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38514': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:06,336 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:06,340 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38520': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:06,341 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38530': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:06,341 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:06,445 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:06,449 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38544': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:06,450 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:06,450 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38556': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:06,554 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:06,558 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38568': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:06,558 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:06,558 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38578': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:06,662 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:06,666 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38594': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:06,667 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:06,667 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38600': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:06,771 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:06,775 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38602': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:06,775 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:06,776 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38618': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:06,880 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:06,885 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38628': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:06,886 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:06,886 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38632': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:06,989 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:06,993 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38640': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:06,993 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:06,994 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38654': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:07,098 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:07,102 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38668': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:07,102 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:07,103 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38676': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:07,208 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:07,212 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38684': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:07,212 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:07,213 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38694': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:07,317 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:07,321 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38708': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:07,321 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:07,321 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38716': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:07,426 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:07,430 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38720': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:07,430 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:07,431 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38726': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:07,535 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:07,539 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38734': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:07,539 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:07,540 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38740': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:07,644 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:07,648 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38750': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:07,648 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:07,649 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38752': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:07,757 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:07,762 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38766': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:07,762 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:07,763 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38768': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:07,866 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:07,870 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38776': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:07,870 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:07,871 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38790': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:07,975 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:07,979 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38802': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:07,979 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:07,980 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38818': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:08,084 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:08,088 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38824': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:08,088 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:08,088 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38840': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:08,194 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:08,198 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38844': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:08,199 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:08,199 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38846': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:08,303 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:08,307 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38862': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:08,308 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:08,308 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38874': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:08,413 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:08,416 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38890': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:08,417 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:08,417 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38896': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:08,522 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:08,526 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38906': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:08,526 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:08,526 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38908': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:08,631 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:08,635 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38914': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:08,635 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:08,635 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38930': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:08,740 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:08,744 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38942': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:08,744 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:08,744 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38954': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:08,848 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:08,853 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38964': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:08,853 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:08,853 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38980': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:08,958 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:08,962 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:38990': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:08,962 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:08,963 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39004': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:09,067 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:09,071 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39020': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:09,071 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:09,072 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39032': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:09,176 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:09,180 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39038': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:09,180 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:09,180 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39048': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:09,285 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:09,288 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39064': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:09,289 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:09,289 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39074': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:09,394 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:09,398 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39086': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:09,398 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:09,398 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39100': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:09,502 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:09,506 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39112': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:09,507 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:09,507 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:09,611 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:09,615 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39130': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:09,616 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:09,616 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39144': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:09,720 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:09,724 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39158': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:09,724 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:09,724 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39160': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:09,829 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:09,833 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39166': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:09,833 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:09,833 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39176': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:09,938 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:09,942 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39184': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:09,942 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:09,942 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39186': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:10,046 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:10,050 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39200': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:10,050 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:10,051 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39212': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:10,155 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:10,159 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39226': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:10,159 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:10,159 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39234': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:10,264 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:10,268 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39238': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:10,268 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:10,268 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39246': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:10,373 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:10,376 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39260': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:10,377 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:10,377 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39266': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:10,482 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:10,486 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39280': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:10,487 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:10,487 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39290': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:10,591 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:10,595 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39300': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:10,595 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:10,596 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39312': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:10,701 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:10,705 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39324': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:10,705 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:10,705 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39326': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:10,809 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:10,814 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39336': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:10,814 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:10,814 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39350': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:10,918 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:10,922 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39362': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:10,923 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:10,923 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39372': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:11,027 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:11,031 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39380': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:11,031 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:11,031 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39394': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:11,135 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:11,139 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39398': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:11,140 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:11,140 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39412': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:11,244 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:11,248 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39418': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:11,249 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:11,254 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39426': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:11,353 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:11,357 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39442': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:11,357 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:11,357 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39452': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:11,461 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:11,465 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39460': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:11,466 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:11,466 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:39470': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:11,570 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:11,575 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41682': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:11,576 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:11,576 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41698': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:11,679 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:11,683 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41704': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:11,683 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:11,683 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41720': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:11,787 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:11,791 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41722': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:11,792 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41728': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:11,792 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:11,896 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:11,900 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41736': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:11,900 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:11,901 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41738': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:12,005 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:12,009 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41742': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:12,009 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:12,009 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41754': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:12,114 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:12,118 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41758': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:12,118 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:12,118 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41766': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:12,222 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:12,226 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41770': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:12,227 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:12,227 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41774': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:12,331 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:12,335 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41784': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:12,336 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:12,336 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41792': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:12,441 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:12,445 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41794': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:12,445 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:12,446 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41802': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:12,549 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:12,553 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41818': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:12,554 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:12,554 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41820': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:12,659 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:12,663 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41830': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:12,664 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41842': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:12,664 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:12,767 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:12,771 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41844': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:12,772 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41850': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:12,771 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:12,875 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:12,879 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41854': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:12,880 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41864': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:12,880 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:12,983 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:12,987 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41872': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:12,988 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41878': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:12,988 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:13,091 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:13,095 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41882': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:13,096 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41898': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:13,096 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:13,199 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:13,203 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41910': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:13,204 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41912': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:13,204 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:13,307 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:13,311 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41922': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:13,312 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41934': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:13,312 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:13,415 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:13,419 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41944': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:13,420 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41952': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:13,420 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:13,523 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:13,527 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41958': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:13,527 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41964': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:13,527 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:13,631 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:13,635 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41968': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:13,635 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41982': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:13,635 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:13,739 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:13,743 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:41994': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:13,744 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42004': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:13,744 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:13,847 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:13,851 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42018': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:13,852 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42028': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:13,852 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:13,955 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:13,959 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42030': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:13,959 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42038': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:13,959 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:14,063 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:14,067 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42048': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:14,067 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42056': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:14,067 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:14,171 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s 2024-11-23 22:16:14,175 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42064': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:14,176 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:42066': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 22:16:14,176 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 5985s =================================== FAILURES =================================== 5985s ______________________________ test_preload_file _______________________________ 5985s 5985s self = 5985s deserializers = None 5985s 5985s async def read(self, deserializers=None): 5985s stream = self.stream 5985s if stream is None: 5985s raise CommClosedError() 5985s 5985s fmt = "Q" 5985s fmt_size = struct.calcsize(fmt) 5985s 5985s try: 5985s # Don't store multiple numpy or parquet buffers into the same buffer, or 5985s # none will be released until all are released. 5985s > frames_nosplit_nbytes_bin = await stream.read_bytes(fmt_size) 5985s E tornado.iostream.StreamClosedError: Stream is closed 5985s 5985s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:225: StreamClosedError 5985s 5985s The above exception was the direct cause of the following exception: 5985s 5985s loop = 5985s tmp_path = PosixPath('/tmp/pytest-of-ubuntu/pytest-2/test_preload_file0') 5985s 5985s def test_preload_file(loop, tmp_path): 5985s def check_scheduler(): 5985s import scheduler_info 5985s 5985s return scheduler_info.get_scheduler_address() 5985s 5985s path = tmp_path / "scheduler_info.py" 5985s with open(path, "w") as f: 5985s f.write(PRELOAD_TEXT) 5985s with tmpfile() as fn: 5985s with popen( 5985s [ 5985s "dask", 5985s "scheduler", 5985s "--scheduler-file", 5985s fn, 5985s "--preload", 5985s path, 5985s f"--port={open_port()}", 5985s ] 5985s ): 5985s with Client(scheduler_file=fn, loop=loop) as c: 5985s > assert c.run_on_scheduler(check_scheduler) == c.scheduler.address 5985s 5985s /usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py:342: 5985s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5985s /usr/lib/python3/dist-packages/distributed/client.py:2858: in run_on_scheduler 5985s return self.sync(self._run_on_scheduler, function, *args, **kwargs) 5985s /usr/lib/python3/dist-packages/distributed/utils.py:362: in sync 5985s return sync( 5985s /usr/lib/python3/dist-packages/distributed/utils.py:438: in sync 5985s raise error 5985s /usr/lib/python3/dist-packages/distributed/utils.py:412: in f 5985s result = yield future 5985s /usr/lib/python3/dist-packages/tornado/gen.py:766: in run 5985s value = future.result() 5985s /usr/lib/python3/dist-packages/distributed/client.py:2809: in _run_on_scheduler 5985s response = await self.scheduler.run_function( 5985s /usr/lib/python3/dist-packages/distributed/core.py:1395: in send_recv_from_rpc 5985s return await send_recv(comm=comm, op=key, **kwargs) 5985s /usr/lib/python3/dist-packages/distributed/core.py:1154: in send_recv 5985s response = await comm.read(deserializers=deserializers) 5985s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:236: in read 5985s convert_stream_closed_error(self, e) 5985s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5985s 5985s obj = 5985s exc = StreamClosedError('Stream is closed') 5985s 5985s def convert_stream_closed_error(obj, exc): 5985s """ 5985s Re-raise StreamClosedError as CommClosedError. 5985s """ 5985s if exc.real_error is not None: 5985s # The stream was closed because of an underlying OS error 5985s exc = exc.real_error 5985s if isinstance(exc, ssl.SSLError): 5985s if exc.reason and "UNKNOWN_CA" in exc.reason: 5985s raise FatalCommClosedError(f"in {obj}: {exc.__class__.__name__}: {exc}") 5985s raise CommClosedError(f"in {obj}: {exc.__class__.__name__}: {exc}") from exc 5985s else: 5985s > raise CommClosedError(f"in {obj}: {exc}") from exc 5985s E distributed.comm.core.CommClosedError: in : Stream is closed 5985s 5985s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:142: CommClosedError 5985s ----------------------------- Captured stderr call ----------------------------- 5985s 2024-11-23 21:56:08,162 - distributed.utils - INFO - Reload module scheduler_info from .py file 5985s 2024-11-23 21:56:08,163 - distributed.preloading - INFO - Import preload module: /tmp/pytest-of-ubuntu/pytest-2/test_preload_file0/scheduler_info.py 5985s 2024-11-23 21:56:08,163 - distributed.scheduler - INFO - ----------------------------------------------- 5985s 2024-11-23 21:56:08,165 - distributed.preloading - INFO - Creating preload: /tmp/pytest-of-ubuntu/pytest-2/test_preload_file0/scheduler_info.py 5985s 2024-11-23 21:56:08,165 - distributed.utils - INFO - Reload module scheduler_info from .py file 5985s 2024-11-23 21:56:08,166 - distributed.preloading - INFO - Import preload module: /tmp/pytest-of-ubuntu/pytest-2/test_preload_file0/scheduler_info.py 5985s 2024-11-23 21:56:08,184 - distributed.http.proxy - INFO - To route to workers diagnostics web server please install jupyter-server-proxy: python -m pip install jupyter-server-proxy 5985s 2024-11-23 21:56:08,187 - distributed.scheduler - INFO - State start 5985s 2024-11-23 21:56:08,188 - distributed.diskutils - INFO - Found stale lock file and directory '/tmp/dask-scratch-space/scheduler-2opdtlhi', purging 5985s 2024-11-23 21:56:08,189 - distributed.diskutils - INFO - Found stale lock file and directory '/tmp/dask-scratch-space/worker-xc6umy1h', purging 5985s 2024-11-23 21:56:08,189 - distributed.diskutils - INFO - Found stale lock file and directory '/tmp/dask-scratch-space/worker-xzpbtwav', purging 5985s 2024-11-23 21:56:08,194 - distributed.scheduler - INFO - ----------------------------------------------- 5985s 2024-11-23 21:56:08,195 - distributed.scheduler - INFO - Scheduler at: tcp://10.0.4.73:38083 5985s 2024-11-23 21:56:08,195 - distributed.scheduler - INFO - dashboard at: http://10.0.4.73:8787/status 5985s 2024-11-23 21:56:08,195 - distributed.preloading - INFO - Run preload setup: /tmp/pytest-of-ubuntu/pytest-2/test_preload_file0/scheduler_info.py 5985s 2024-11-23 21:56:08,196 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5985s 2024-11-23 21:56:08,209 - distributed.scheduler - INFO - Receive client connection: Client-be43621e-a9e5-11ef-bc9b-00163e4db70f 5985s 2024-11-23 21:56:08,463 - distributed.core - INFO - Starting established connection to tcp://10.0.4.73:36236 5985s 2024-11-23 21:56:08,466 - distributed.worker - INFO - Run out-of-band function 'check_scheduler' 5985s 2024-11-23 21:56:08,831 - distributed.client - ERROR - 5985s ConnectionRefusedError: [Errno 111] Connection refused 5985s 5985s The above exception was the direct cause of the following exception: 5985s 5985s Traceback (most recent call last): 5985s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5985s comm = await wait_for( 5985s ^^^^^^^^^^^^^^^ 5985s ...<2 lines>... 5985s ) 5985s ^ 5985s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5985s return await fut 5985s ^^^^^^^^^ 5985s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 559, in connect 5985s convert_stream_closed_error(self, e) 5985s ~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^ 5985s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 140, in convert_stream_closed_error 5985s raise CommClosedError(f"in {obj}: {exc.__class__.__name__}: {exc}") from exc 5985s distributed.comm.core.CommClosedError: in : ConnectionRefusedError: [Errno 111] Connection refused 5985s 5985s During handling of the above exception, another exception occurred: 5985s 5985s Traceback (most recent call last): 5985s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 836, in wrapper 5985s return await func(*args, **kwargs) 5985s ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5985s File "/usr/lib/python3/dist-packages/distributed/client.py", line 1331, in _reconnect 5985s await self._ensure_connected(timeout=timeout) 5985s File "/usr/lib/python3/dist-packages/distributed/client.py", line 1361, in _ensure_connected 5985s comm = await connect( 5985s ^^^^^^^^^^^^^^ 5985s self.scheduler.address, timeout=timeout, **self.connection_args 5985s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5985s ) 5985s ^ 5985s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 366, in connect 5985s await asyncio.sleep(backoff) 5985s File "/usr/lib/python3.13/asyncio/tasks.py", line 718, in sleep 5985s return await future 5985s ^^^^^^^^^^^^ 5985s asyncio.exceptions.CancelledError 5985s _____________________________ test_preload_module ______________________________ 5985s 5985s self = 5985s deserializers = None 5985s 5985s async def read(self, deserializers=None): 5985s stream = self.stream 5985s if stream is None: 5985s raise CommClosedError() 5985s 5985s fmt = "Q" 5985s fmt_size = struct.calcsize(fmt) 5985s 5985s try: 5985s # Don't store multiple numpy or parquet buffers into the same buffer, or 5985s # none will be released until all are released. 5985s > frames_nosplit_nbytes_bin = await stream.read_bytes(fmt_size) 5985s E tornado.iostream.StreamClosedError: Stream is closed 5985s 5985s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:225: StreamClosedError 5985s 5985s The above exception was the direct cause of the following exception: 5985s 5985s loop = 5985s tmp_path = PosixPath('/tmp/pytest-of-ubuntu/pytest-2/test_preload_module0') 5985s 5985s def test_preload_module(loop, tmp_path): 5985s def check_scheduler(): 5985s import scheduler_info 5985s 5985s return scheduler_info.get_scheduler_address() 5985s 5985s path = tmp_path / "scheduler_info.py" 5985s with open(path, "w") as f: 5985s f.write(PRELOAD_TEXT) 5985s env = os.environ.copy() 5985s if "PYTHONPATH" in env: 5985s env["PYTHONPATH"] = str(tmp_path) + ":" + env["PYTHONPATH"] 5985s else: 5985s env["PYTHONPATH"] = str(tmp_path) 5985s with tmpfile() as fn: 5985s with popen( 5985s [ 5985s "dask", 5985s "scheduler", 5985s "--scheduler-file", 5985s fn, 5985s "--preload", 5985s "scheduler_info", 5985s f"--port={open_port()}", 5985s ], 5985s env=env, 5985s ): 5985s with Client(scheduler_file=fn, loop=loop) as c: 5985s > assert c.run_on_scheduler(check_scheduler) == c.scheduler.address 5985s 5985s /usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py:373: 5985s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5985s /usr/lib/python3/dist-packages/distributed/client.py:2858: in run_on_scheduler 5985s return self.sync(self._run_on_scheduler, function, *args, **kwargs) 5985s /usr/lib/python3/dist-packages/distributed/utils.py:362: in sync 5985s return sync( 5985s /usr/lib/python3/dist-packages/distributed/utils.py:438: in sync 5985s raise error 5985s /usr/lib/python3/dist-packages/distributed/utils.py:412: in f 5985s result = yield future 5985s /usr/lib/python3/dist-packages/tornado/gen.py:766: in run 5985s value = future.result() 5985s /usr/lib/python3/dist-packages/distributed/client.py:2809: in _run_on_scheduler 5985s response = await self.scheduler.run_function( 5985s /usr/lib/python3/dist-packages/distributed/core.py:1395: in send_recv_from_rpc 5985s return await send_recv(comm=comm, op=key, **kwargs) 5985s /usr/lib/python3/dist-packages/distributed/core.py:1154: in send_recv 5985s response = await comm.read(deserializers=deserializers) 5985s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:236: in read 5985s convert_stream_closed_error(self, e) 5985s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5985s 5985s obj = 5985s exc = StreamClosedError('Stream is closed') 5985s 5985s def convert_stream_closed_error(obj, exc): 5985s """ 5985s Re-raise StreamClosedError as CommClosedError. 5985s """ 5985s if exc.real_error is not None: 5985s # The stream was closed because of an underlying OS error 5985s exc = exc.real_error 5985s if isinstance(exc, ssl.SSLError): 5985s if exc.reason and "UNKNOWN_CA" in exc.reason: 5985s raise FatalCommClosedError(f"in {obj}: {exc.__class__.__name__}: {exc}") 5985s raise CommClosedError(f"in {obj}: {exc.__class__.__name__}: {exc}") from exc 5985s else: 5985s > raise CommClosedError(f"in {obj}: {exc}") from exc 5985s E distributed.comm.core.CommClosedError: in : Stream is closed 5985s 5985s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:142: CommClosedError 5985s ----------------------------- Captured stderr call ----------------------------- 5985s 2024-11-23 21:56:09,628 - distributed.preloading - INFO - Import preload module: scheduler_info 5985s 2024-11-23 21:56:09,629 - distributed.scheduler - INFO - ----------------------------------------------- 5985s 2024-11-23 21:56:09,631 - distributed.preloading - INFO - Creating preload: scheduler_info 5985s 2024-11-23 21:56:09,631 - distributed.preloading - INFO - Import preload module: scheduler_info 5985s 2024-11-23 21:56:09,648 - distributed.http.proxy - INFO - To route to workers diagnostics web server please install jupyter-server-proxy: python -m pip install jupyter-server-proxy 5985s 2024-11-23 21:56:09,651 - distributed.scheduler - INFO - State start 5985s 2024-11-23 21:56:09,652 - distributed.diskutils - INFO - Found stale lock file and directory '/tmp/dask-scratch-space/scheduler-2lxgam80', purging 5985s 2024-11-23 21:56:09,657 - distributed.scheduler - INFO - ----------------------------------------------- 5985s 2024-11-23 21:56:09,657 - distributed.scheduler - INFO - Scheduler at: tcp://10.0.4.73:34013 5985s 2024-11-23 21:56:09,658 - distributed.scheduler - INFO - dashboard at: http://10.0.4.73:8787/status 5985s 2024-11-23 21:56:09,658 - distributed.preloading - INFO - Run preload setup: scheduler_info 5985s 2024-11-23 21:56:09,658 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5985s 2024-11-23 21:56:09,671 - distributed.scheduler - INFO - Receive client connection: Client-bf2296ce-a9e5-11ef-bc9b-00163e4db70f 5985s 2024-11-23 21:56:09,926 - distributed.core - INFO - Starting established connection to tcp://10.0.4.73:56656 5985s 2024-11-23 21:56:09,930 - distributed.worker - INFO - Run out-of-band function 'check_scheduler' 5985s 2024-11-23 21:56:10,293 - distributed.client - ERROR - 5985s ConnectionRefusedError: [Errno 111] Connection refused 5985s 5985s The above exception was the direct cause of the following exception: 5985s 5985s Traceback (most recent call last): 5985s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5985s comm = await wait_for( 5985s ^^^^^^^^^^^^^^^ 5985s ...<2 lines>... 5985s ) 5985s ^ 5985s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5985s return await fut 5985s ^^^^^^^^^ 5985s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 559, in connect 5985s convert_stream_closed_error(self, e) 5985s ~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^ 5985s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 140, in convert_stream_closed_error 5985s raise CommClosedError(f"in {obj}: {exc.__class__.__name__}: {exc}") from exc 5985s distributed.comm.core.CommClosedError: in : ConnectionRefusedError: [Errno 111] Connection refused 5985s 5985s During handling of the above exception, another exception occurred: 5985s 5985s Traceback (most recent call last): 5985s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 836, in wrapper 5985s return await func(*args, **kwargs) 5985s ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5985s File "/usr/lib/python3/dist-packages/distributed/client.py", line 1331, in _reconnect 5985s await self._ensure_connected(timeout=timeout) 5985s File "/usr/lib/python3/dist-packages/distributed/client.py", line 1361, in _ensure_connected 5985s comm = await connect( 5985s ^^^^^^^^^^^^^^ 5985s self.scheduler.address, timeout=timeout, **self.connection_args 5985s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5985s ) 5985s ^ 5985s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 366, in connect 5985s await asyncio.sleep(backoff) 5985s File "/usr/lib/python3.13/asyncio/tasks.py", line 718, in sleep 5985s return await future 5985s ^^^^^^^^^^^^ 5985s asyncio.exceptions.CancelledError 5985s __________________________ test_preload_remote_module __________________________ 5985s 5985s self = 5985s deserializers = None 5985s 5985s async def read(self, deserializers=None): 5985s stream = self.stream 5985s if stream is None: 5985s raise CommClosedError() 5985s 5985s fmt = "Q" 5985s fmt_size = struct.calcsize(fmt) 5985s 5985s try: 5985s # Don't store multiple numpy or parquet buffers into the same buffer, or 5985s # none will be released until all are released. 5985s > frames_nosplit_nbytes_bin = await stream.read_bytes(fmt_size) 5985s E tornado.iostream.StreamClosedError: Stream is closed 5985s 5985s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:225: StreamClosedError 5985s 5985s The above exception was the direct cause of the following exception: 5985s 5985s loop = 5985s tmp_path = PosixPath('/tmp/pytest-of-ubuntu/pytest-2/test_preload_remote_module0') 5985s 5985s def test_preload_remote_module(loop, tmp_path): 5985s with open(tmp_path / "scheduler_info.py", "w") as f: 5985s f.write(PRELOAD_TEXT) 5985s http_server_port = open_port() 5985s with popen( 5985s [sys.executable, "-m", "http.server", str(http_server_port)], cwd=tmp_path 5985s ): 5985s with popen( 5985s [ 5985s "dask", 5985s "scheduler", 5985s "--scheduler-file", 5985s str(tmp_path / "scheduler-file.json"), 5985s "--preload", 5985s f"http://localhost:{http_server_port}/scheduler_info.py", 5985s f"--port={open_port()}", 5985s ] 5985s ) as proc: 5985s with Client( 5985s scheduler_file=tmp_path / "scheduler-file.json", loop=loop 5985s ) as c: 5985s > assert ( 5985s c.run_on_scheduler( 5985s lambda dask_scheduler: getattr(dask_scheduler, "foo", None) 5985s ) 5985s == "bar" 5985s ) 5985s 5985s /usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py:397: 5985s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5985s /usr/lib/python3/dist-packages/distributed/client.py:2858: in run_on_scheduler 5985s return self.sync(self._run_on_scheduler, function, *args, **kwargs) 5985s /usr/lib/python3/dist-packages/distributed/utils.py:362: in sync 5985s return sync( 5985s /usr/lib/python3/dist-packages/distributed/utils.py:438: in sync 5985s raise error 5985s /usr/lib/python3/dist-packages/distributed/utils.py:412: in f 5985s result = yield future 5985s /usr/lib/python3/dist-packages/tornado/gen.py:766: in run 5985s value = future.result() 5985s /usr/lib/python3/dist-packages/distributed/client.py:2809: in _run_on_scheduler 5985s response = await self.scheduler.run_function( 5985s /usr/lib/python3/dist-packages/distributed/core.py:1395: in send_recv_from_rpc 5985s return await send_recv(comm=comm, op=key, **kwargs) 5985s /usr/lib/python3/dist-packages/distributed/core.py:1154: in send_recv 5985s response = await comm.read(deserializers=deserializers) 5985s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:236: in read 5985s convert_stream_closed_error(self, e) 5985s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5985s 5985s obj = 5985s exc = StreamClosedError('Stream is closed') 5985s 5985s def convert_stream_closed_error(obj, exc): 5985s """ 5985s Re-raise StreamClosedError as CommClosedError. 5985s """ 5985s if exc.real_error is not None: 5985s # The stream was closed because of an underlying OS error 5985s exc = exc.real_error 5985s if isinstance(exc, ssl.SSLError): 5985s if exc.reason and "UNKNOWN_CA" in exc.reason: 5985s raise FatalCommClosedError(f"in {obj}: {exc.__class__.__name__}: {exc}") 5985s raise CommClosedError(f"in {obj}: {exc.__class__.__name__}: {exc}") from exc 5985s else: 5985s > raise CommClosedError(f"in {obj}: {exc}") from exc 5985s E distributed.comm.core.CommClosedError: in : Stream is closed 5985s 5985s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:142: CommClosedError 5985s ----------------------------- Captured stdout call ----------------------------- 5985s Serving HTTP on 0.0.0.0 port 50937 (http://0.0.0.0:50937/) ... 5985s 5985s Keyboard interrupt received, exiting. 5985s ----------------------------- Captured stderr call ----------------------------- 5985s 2024-11-23 21:56:11,007 - distributed.scheduler - INFO - ----------------------------------------------- 5985s 2024-11-23 21:56:11,009 - distributed.preloading - INFO - Creating preload: http://localhost:50937/scheduler_info.py 5985s 2024-11-23 21:56:11,009 - distributed.preloading - INFO - Downloading preload at http://localhost:50937/scheduler_info.py 5985s 127.0.0.1 - - [23/Nov/2024 21:56:11] "GET /scheduler_info.py HTTP/1.1" 200 - 5985s 2024-11-23 21:56:11,051 - distributed.http.proxy - INFO - To route to workers diagnostics web server please install jupyter-server-proxy: python -m pip install jupyter-server-proxy 5985s 2024-11-23 21:56:11,053 - distributed.scheduler - INFO - State start 5985s 2024-11-23 21:56:11,054 - distributed.diskutils - INFO - Found stale lock file and directory '/tmp/dask-scratch-space/scheduler-og7q_54z', purging 5985s 2024-11-23 21:56:11,058 - distributed.scheduler - INFO - ----------------------------------------------- 5985s 2024-11-23 21:56:11,059 - distributed.scheduler - INFO - Scheduler at: tcp://10.0.4.73:43221 5985s 2024-11-23 21:56:11,059 - distributed.scheduler - INFO - dashboard at: http://10.0.4.73:8787/status 5985s 2024-11-23 21:56:11,059 - distributed.preloading - INFO - Run preload setup: http://localhost:50937/scheduler_info.py 5985s 2024-11-23 21:56:11,060 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5985s 2024-11-23 21:56:11,072 - distributed.scheduler - INFO - Receive client connection: Client-bff9d036-a9e5-11ef-bc9b-00163e4db70f 5985s 2024-11-23 21:56:11,331 - distributed.core - INFO - Starting established connection to tcp://10.0.4.73:54140 5985s 2024-11-23 21:56:11,334 - distributed.worker - INFO - Run out-of-band function 'lambda' 5985s 2024-11-23 21:56:11,690 - distributed.client - ERROR - 5985s ConnectionRefusedError: [Errno 111] Connection refused 5985s 5985s The above exception was the direct cause of the following exception: 5985s 5985s Traceback (most recent call last): 5985s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5985s comm = await wait_for( 5985s ^^^^^^^^^^^^^^^ 5985s ...<2 lines>... 5985s ) 5985s ^ 5985s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5985s return await fut 5985s ^^^^^^^^^ 5985s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 559, in connect 5985s convert_stream_closed_error(self, e) 5985s ~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^ 5985s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 140, in convert_stream_closed_error 5985s raise CommClosedError(f"in {obj}: {exc.__class__.__name__}: {exc}") from exc 5985s distributed.comm.core.CommClosedError: in : ConnectionRefusedError: [Errno 111] Connection refused 5985s 5985s During handling of the above exception, another exception occurred: 5985s 5985s Traceback (most recent call last): 5985s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 836, in wrapper 5985s return await func(*args, **kwargs) 5985s ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5985s File "/usr/lib/python3/dist-packages/distributed/client.py", line 1331, in _reconnect 5985s await self._ensure_connected(timeout=timeout) 5985s File "/usr/lib/python3/dist-packages/distributed/client.py", line 1361, in _ensure_connected 5985s comm = await connect( 5985s ^^^^^^^^^^^^^^ 5985s self.scheduler.address, timeout=timeout, **self.connection_args 5985s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5985s ) 5985s ^ 5985s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 366, in connect 5985s await asyncio.sleep(backoff) 5985s File "/usr/lib/python3.13/asyncio/tasks.py", line 718, in sleep 5985s return await future 5985s ^^^^^^^^^^^^ 5985s asyncio.exceptions.CancelledError 5985s _____________________________ test_preload_config ______________________________ 5985s 5985s loop = 5985s 5985s def test_preload_config(loop): 5985s # Ensure dask scheduler pulls the preload from the Dask config if 5985s # not specified via a command line option 5985s with tmpfile() as fn: 5985s env = os.environ.copy() 5985s env["DASK_DISTRIBUTED__SCHEDULER__PRELOAD"] = PRELOAD_TEXT 5985s with popen(["dask", "scheduler", "--scheduler-file", fn], env=env): 5985s with Client(scheduler_file=fn, loop=loop) as c: 5985s > assert ( 5985s c.run_on_scheduler(lambda dask_scheduler: dask_scheduler.foo) 5985s == "bar" 5985s ) 5985s 5985s /usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py:413: 5985s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5985s /usr/lib/python3/dist-packages/distributed/client.py:2858: in run_on_scheduler 5985s return self.sync(self._run_on_scheduler, function, *args, **kwargs) 5985s /usr/lib/python3/dist-packages/distributed/utils.py:362: in sync 5985s return sync( 5985s /usr/lib/python3/dist-packages/distributed/utils.py:438: in sync 5985s raise error 5985s /usr/lib/python3/dist-packages/distributed/utils.py:412: in f 5985s result = yield future 5985s /usr/lib/python3/dist-packages/tornado/gen.py:766: in run 5985s value = future.result() 5985s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5985s 5985s self = 5985s function = . at 0xde7aed98> 5985s wait = True, args = (), kwargs = {} 5985s response = {'exception': b'\x80\x05\x953\x02\x00\x00\x00\x00\x00\x00\x8c\x16tblib.pickling_support\x94\x8c\x12unpickle_exception\...ext': "SystemError('no locals found when setting up annotations')", 'status': 'error', 'traceback': b'\x80\x05N.', ...} 5985s typ = 5985s exc = SystemError('no locals found when setting up annotations'), tb = None 5985s 5985s async def _run_on_scheduler(self, function, *args, wait=True, **kwargs): 5985s response = await self.scheduler.run_function( 5985s function=dumps(function), 5985s args=dumps(args), 5985s kwargs=dumps(kwargs), 5985s wait=wait, 5985s ) 5985s if response["status"] == "error": 5985s typ, exc, tb = clean_exception(**response) 5985s > raise exc.with_traceback(tb) 5985s E SystemError: no locals found when setting up annotations 5985s 5985s /usr/lib/python3/dist-packages/distributed/client.py:2817: SystemError 5985s ----------------------------- Captured stderr call ----------------------------- 5985s 2024-11-23 21:56:12,435 - distributed.scheduler - INFO - ----------------------------------------------- 5985s 2024-11-23 21:56:12,437 - distributed.preloading - INFO - Creating preload: 5985s _scheduler_info = {} 5985s 5985s def dask_setup(scheduler): 5985s _scheduler_info['address'] = scheduler.address 5985s scheduler.foo = "bar" 5985s 5985s def get_scheduler_address(): 5985s return _scheduler_info['address'] 5985s 5985s 2024-11-23 21:56:12,437 - distributed.utils - INFO - Reload module tmp5vp_i49e from .py file 5985s 2024-11-23 21:56:12,438 - distributed.preloading - INFO - Import preload module: /tmp/tmp5vp_i49e.py 5985s 2024-11-23 21:56:12,455 - distributed.http.proxy - INFO - To route to workers diagnostics web server please install jupyter-server-proxy: python -m pip install jupyter-server-proxy 5985s 2024-11-23 21:56:12,458 - distributed.scheduler - INFO - State start 5985s 2024-11-23 21:56:12,459 - distributed.diskutils - INFO - Found stale lock file and directory '/tmp/dask-scratch-space/scheduler-1ka2exw9', purging 5985s 2024-11-23 21:56:12,463 - distributed.scheduler - INFO - ----------------------------------------------- 5985s 2024-11-23 21:56:12,463 - distributed.scheduler - INFO - Scheduler at: tcp://10.0.4.73:8786 5985s 2024-11-23 21:56:12,464 - distributed.scheduler - INFO - dashboard at: http://10.0.4.73:8787/status 5985s 2024-11-23 21:56:12,464 - distributed.preloading - INFO - Run preload setup: 5985s _scheduler_info = {} 5985s 5985s def dask_setup(scheduler): 5985s _scheduler_info['address'] = scheduler.address 5985s scheduler.foo = "bar" 5985s 5985s def get_scheduler_address(): 5985s return _scheduler_info['address'] 5985s 5985s 2024-11-23 21:56:12,464 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5985s 2024-11-23 21:56:12,471 - distributed.scheduler - INFO - Receive client connection: Client-c0d3fc36-a9e5-11ef-bc9b-00163e4db70f 5985s 2024-11-23 21:56:12,712 - distributed.core - INFO - Starting established connection to tcp://10.0.4.73:43320 5985s 2024-11-23 21:56:12,715 - distributed.worker - INFO - Run out-of-band function 'lambda' 5985s 2024-11-23 21:56:12,715 - distributed.worker - WARNING - Run Failed 5985s Function: lambda 5985s args: () 5985s kwargs: {'dask_scheduler': } 5985s Traceback (most recent call last): 5985s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 3182, in run 5985s result = function(*args, **kwargs) 5985s ^^^^^^^^^^^^^^^^^^^^^^^^^ 5985s SystemError: no locals found when setting up annotations 5985s 2024-11-23 21:56:12,724 - distributed.scheduler - INFO - Remove client Client-c0d3fc36-a9e5-11ef-bc9b-00163e4db70f 5985s 2024-11-23 21:56:12,725 - distributed.core - INFO - Received 'close-stream' from tcp://10.0.4.73:43320; closing. 5985s 2024-11-23 21:56:12,725 - distributed.scheduler - INFO - Remove client Client-c0d3fc36-a9e5-11ef-bc9b-00163e4db70f 5985s 2024-11-23 21:56:12,725 - distributed.scheduler - INFO - Close client connection: Client-c0d3fc36-a9e5-11ef-bc9b-00163e4db70f 5985s 2024-11-23 21:56:12,726 - distributed._signals - INFO - Received signal SIGINT (2) 5985s 2024-11-23 21:56:12,726 - distributed.scheduler - INFO - Scheduler closing due to signal-2... 5985s 2024-11-23 21:56:12,726 - distributed.scheduler - INFO - Scheduler closing all comms 5985s 2024-11-23 21:56:12,727 - distributed.scheduler - INFO - Stopped scheduler at 'tcp://10.0.4.73:8786' 5985s 2024-11-23 21:56:12,727 - distributed.scheduler - INFO - End scheduler 5985s _____________________________ test_preload_command _____________________________ 5985s 5985s self = 5985s deserializers = None 5985s 5985s async def read(self, deserializers=None): 5985s stream = self.stream 5985s if stream is None: 5985s raise CommClosedError() 5985s 5985s fmt = "Q" 5985s fmt_size = struct.calcsize(fmt) 5985s 5985s try: 5985s # Don't store multiple numpy or parquet buffers into the same buffer, or 5985s # none will be released until all are released. 5985s > frames_nosplit_nbytes_bin = await stream.read_bytes(fmt_size) 5985s E tornado.iostream.StreamClosedError: Stream is closed 5985s 5985s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:225: StreamClosedError 5985s 5985s The above exception was the direct cause of the following exception: 5985s 5985s loop = 5985s 5985s def test_preload_command(loop): 5985s def check_passthrough(): 5985s import passthrough_info 5985s 5985s return passthrough_info.get_passthrough() 5985s 5985s tmpdir = tempfile.mkdtemp() 5985s try: 5985s path = os.path.join(tmpdir, "passthrough_info.py") 5985s with open(path, "w") as f: 5985s f.write(PRELOAD_COMMAND_TEXT) 5985s 5985s with tmpfile() as fn: 5985s print(fn) 5985s with popen( 5985s [ 5985s "dask", 5985s "scheduler", 5985s "--scheduler-file", 5985s fn, 5985s "--preload", 5985s path, 5985s "--passthrough", 5985s "foobar", 5985s ] 5985s ): 5985s with Client(scheduler_file=fn, loop=loop) as c: 5985s > assert c.run_on_scheduler(check_passthrough) == "foobar" 5985s 5985s /usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py:460: 5985s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5985s /usr/lib/python3/dist-packages/distributed/client.py:2858: in run_on_scheduler 5985s return self.sync(self._run_on_scheduler, function, *args, **kwargs) 5985s /usr/lib/python3/dist-packages/distributed/utils.py:362: in sync 5985s return sync( 5985s /usr/lib/python3/dist-packages/distributed/utils.py:438: in sync 5985s raise error 5985s /usr/lib/python3/dist-packages/distributed/utils.py:412: in f 5985s result = yield future 5985s /usr/lib/python3/dist-packages/tornado/gen.py:766: in run 5985s value = future.result() 5985s /usr/lib/python3/dist-packages/distributed/client.py:2809: in _run_on_scheduler 5985s response = await self.scheduler.run_function( 5985s /usr/lib/python3/dist-packages/distributed/core.py:1395: in send_recv_from_rpc 5985s return await send_recv(comm=comm, op=key, **kwargs) 5985s /usr/lib/python3/dist-packages/distributed/core.py:1154: in send_recv 5985s response = await comm.read(deserializers=deserializers) 5985s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:236: in read 5985s convert_stream_closed_error(self, e) 5985s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5985s 5985s obj = 5985s exc = StreamClosedError('Stream is closed') 5985s 5985s def convert_stream_closed_error(obj, exc): 5985s """ 5985s Re-raise StreamClosedError as CommClosedError. 5985s """ 5985s if exc.real_error is not None: 5985s # The stream was closed because of an underlying OS error 5985s exc = exc.real_error 5985s if isinstance(exc, ssl.SSLError): 5985s if exc.reason and "UNKNOWN_CA" in exc.reason: 5985s raise FatalCommClosedError(f"in {obj}: {exc.__class__.__name__}: {exc}") 5985s raise CommClosedError(f"in {obj}: {exc.__class__.__name__}: {exc}") from exc 5985s else: 5985s > raise CommClosedError(f"in {obj}: {exc}") from exc 5985s E distributed.comm.core.CommClosedError: in : Stream is closed 5985s 5985s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:142: CommClosedError 5985s ----------------------------- Captured stdout call ----------------------------- 5985s /tmp/tmpbmbk0p32 5985s ----------------------------- Captured stderr call ----------------------------- 5985s 2024-11-23 21:56:13,600 - distributed.utils - INFO - Reload module passthrough_info from .py file 5985s 2024-11-23 21:56:13,601 - distributed.preloading - INFO - Import preload module: /tmp/tmp4v621e_4/passthrough_info.py 5985s 2024-11-23 21:56:13,602 - distributed.scheduler - INFO - ----------------------------------------------- 5985s 2024-11-23 21:56:13,603 - distributed.preloading - INFO - Creating preload: /tmp/tmp4v621e_4/passthrough_info.py 5985s 2024-11-23 21:56:13,603 - distributed.utils - INFO - Reload module passthrough_info from .py file 5985s 2024-11-23 21:56:13,604 - distributed.preloading - INFO - Import preload module: /tmp/tmp4v621e_4/passthrough_info.py 5985s 2024-11-23 21:56:13,622 - distributed.http.proxy - INFO - To route to workers diagnostics web server please install jupyter-server-proxy: python -m pip install jupyter-server-proxy 5985s 2024-11-23 21:56:13,625 - distributed.scheduler - INFO - State start 5985s 2024-11-23 21:56:13,630 - distributed.scheduler - INFO - ----------------------------------------------- 5985s 2024-11-23 21:56:13,631 - distributed.scheduler - INFO - Scheduler at: tcp://10.0.4.73:8786 5985s 2024-11-23 21:56:13,631 - distributed.scheduler - INFO - dashboard at: http://10.0.4.73:8787/status 5985s 2024-11-23 21:56:13,632 - distributed.preloading - INFO - Run preload setup: /tmp/tmp4v621e_4/passthrough_info.py 5985s 2024-11-23 21:56:13,632 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5985s 2024-11-23 21:56:13,637 - distributed.scheduler - INFO - Receive client connection: Client-c18474ba-a9e5-11ef-bc9b-00163e4db70f 5985s 2024-11-23 21:56:13,886 - distributed.core - INFO - Starting established connection to tcp://10.0.4.73:43330 5985s 2024-11-23 21:56:13,888 - distributed.worker - INFO - Run out-of-band function 'check_passthrough' 5985s 2024-11-23 21:56:14,241 - distributed.client - ERROR - 5985s ConnectionRefusedError: [Errno 111] Connection refused 5985s 5985s The above exception was the direct cause of the following exception: 5985s 5985s Traceback (most recent call last): 5985s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5985s comm = await wait_for( 5985s ^^^^^^^^^^^^^^^ 5985s ...<2 lines>... 5985s ) 5985s ^ 5985s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5985s return await fut 5985s ^^^^^^^^^ 5985s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 559, in connect 5985s convert_stream_closed_error(self, e) 5985s ~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^ 5985s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 140, in convert_stream_closed_error 5985s raise CommClosedError(f"in {obj}: {exc.__class__.__name__}: {exc}") from exc 5985s distributed.comm.core.CommClosedError: in : ConnectionRefusedError: [Errno 111] Connection refused 5985s 5985s During handling of the above exception, another exception occurred: 5985s 5985s Traceback (most recent call last): 5985s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 836, in wrapper 5985s return await func(*args, **kwargs) 5985s ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5985s File "/usr/lib/python3/dist-packages/distributed/client.py", line 1331, in _reconnect 5985s await self._ensure_connected(timeout=timeout) 5985s File "/usr/lib/python3/dist-packages/distributed/client.py", line 1361, in _ensure_connected 5985s comm = await connect( 5985s ^^^^^^^^^^^^^^ 5985s self.scheduler.address, timeout=timeout, **self.connection_args 5985s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5985s ) 5985s ^ 5985s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 366, in connect 5985s await asyncio.sleep(backoff) 5985s File "/usr/lib/python3.13/asyncio/tasks.py", line 718, in sleep 5985s return await future 5985s ^^^^^^^^^^^^ 5985s asyncio.exceptions.CancelledError 5985s _________________________ test_preload_command_default _________________________ 5985s 5985s self = 5985s deserializers = None 5985s 5985s async def read(self, deserializers=None): 5985s stream = self.stream 5985s if stream is None: 5985s raise CommClosedError() 5985s 5985s fmt = "Q" 5985s fmt_size = struct.calcsize(fmt) 5985s 5985s try: 5985s # Don't store multiple numpy or parquet buffers into the same buffer, or 5985s # none will be released until all are released. 5985s > frames_nosplit_nbytes_bin = await stream.read_bytes(fmt_size) 5985s E tornado.iostream.StreamClosedError: Stream is closed 5985s 5985s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:225: StreamClosedError 5985s 5985s The above exception was the direct cause of the following exception: 5985s 5985s loop = 5985s 5985s def test_preload_command_default(loop): 5985s def check_passthrough(): 5985s import passthrough_info 5985s 5985s return passthrough_info.get_passthrough() 5985s 5985s tmpdir = tempfile.mkdtemp() 5985s try: 5985s path = os.path.join(tmpdir, "passthrough_info.py") 5985s with open(path, "w") as f: 5985s f.write(PRELOAD_COMMAND_TEXT) 5985s 5985s with tmpfile() as fn2: 5985s print(fn2) 5985s with popen( 5985s ["dask", "scheduler", "--scheduler-file", fn2, "--preload", path], 5985s stdout=sys.stdout, 5985s stderr=sys.stderr, 5985s ): 5985s with Client(scheduler_file=fn2, loop=loop) as c: 5985s > assert c.run_on_scheduler(check_passthrough) == "default" 5985s 5985s /usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py:485: 5985s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5985s /usr/lib/python3/dist-packages/distributed/client.py:2858: in run_on_scheduler 5985s return self.sync(self._run_on_scheduler, function, *args, **kwargs) 5985s /usr/lib/python3/dist-packages/distributed/utils.py:362: in sync 5985s return sync( 5985s /usr/lib/python3/dist-packages/distributed/utils.py:438: in sync 5985s raise error 5985s /usr/lib/python3/dist-packages/distributed/utils.py:412: in f 5985s result = yield future 5985s /usr/lib/python3/dist-packages/tornado/gen.py:766: in run 5985s value = future.result() 5985s /usr/lib/python3/dist-packages/distributed/client.py:2809: in _run_on_scheduler 5985s response = await self.scheduler.run_function( 5985s /usr/lib/python3/dist-packages/distributed/core.py:1395: in send_recv_from_rpc 5985s return await send_recv(comm=comm, op=key, **kwargs) 5985s /usr/lib/python3/dist-packages/distributed/core.py:1154: in send_recv 5985s response = await comm.read(deserializers=deserializers) 5985s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:236: in read 5985s convert_stream_closed_error(self, e) 5985s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5985s 5985s obj = 5985s exc = StreamClosedError('Stream is closed') 5985s 5985s def convert_stream_closed_error(obj, exc): 5985s """ 5985s Re-raise StreamClosedError as CommClosedError. 5985s """ 5985s if exc.real_error is not None: 5985s # The stream was closed because of an underlying OS error 5985s exc = exc.real_error 5985s if isinstance(exc, ssl.SSLError): 5985s if exc.reason and "UNKNOWN_CA" in exc.reason: 5985s raise FatalCommClosedError(f"in {obj}: {exc.__class__.__name__}: {exc}") 5985s raise CommClosedError(f"in {obj}: {exc.__class__.__name__}: {exc}") from exc 5985s else: 5985s > raise CommClosedError(f"in {obj}: {exc}") from exc 5985s E distributed.comm.core.CommClosedError: in : Stream is closed 5985s 5985s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:142: CommClosedError 5985s ----------------------------- Captured stdout call ----------------------------- 5985s /tmp/tmpzb8tnwm7 5985s ----------------------------- Captured stderr call ----------------------------- 5985s 2024-11-23 21:56:15,135 - distributed.utils - INFO - Reload module passthrough_info from .py file 5985s 2024-11-23 21:56:15,136 - distributed.preloading - INFO - Import preload module: /tmp/tmpzauxklpe/passthrough_info.py 5985s 2024-11-23 21:56:15,136 - distributed.scheduler - INFO - ----------------------------------------------- 5985s 2024-11-23 21:56:15,138 - distributed.preloading - INFO - Creating preload: /tmp/tmpzauxklpe/passthrough_info.py 5985s 2024-11-23 21:56:15,138 - distributed.utils - INFO - Reload module passthrough_info from .py file 5985s 2024-11-23 21:56:15,139 - distributed.preloading - INFO - Import preload module: /tmp/tmpzauxklpe/passthrough_info.py 5985s 2024-11-23 21:56:15,157 - distributed.http.proxy - INFO - To route to workers diagnostics web server please install jupyter-server-proxy: python -m pip install jupyter-server-proxy 5985s 2024-11-23 21:56:15,159 - distributed.scheduler - INFO - State start 5985s 2024-11-23 21:56:15,161 - distributed.diskutils - INFO - Found stale lock file and directory '/tmp/dask-scratch-space/scheduler-f7z2hose', purging 5985s 2024-11-23 21:56:15,165 - distributed.scheduler - INFO - ----------------------------------------------- 5985s 2024-11-23 21:56:15,166 - distributed.scheduler - INFO - Scheduler at: tcp://10.0.4.73:8786 5985s 2024-11-23 21:56:15,166 - distributed.scheduler - INFO - dashboard at: http://10.0.4.73:8787/status 5985s 2024-11-23 21:56:15,166 - distributed.preloading - INFO - Run preload setup: /tmp/tmpzauxklpe/passthrough_info.py 5985s 2024-11-23 21:56:15,167 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5985s 2024-11-23 21:56:15,179 - distributed.scheduler - INFO - Receive client connection: Client-c26e0b0d-a9e5-11ef-bc9b-00163e4db70f 5985s 2024-11-23 21:56:15,429 - distributed.core - INFO - Starting established connection to tcp://10.0.4.73:43404 5985s 2024-11-23 21:56:15,432 - distributed.worker - INFO - Run out-of-band function 'check_passthrough' 5985s 2024-11-23 21:56:15,782 - distributed.client - ERROR - 5985s ConnectionRefusedError: [Errno 111] Connection refused 5985s 5985s The above exception was the direct cause of the following exception: 5985s 5985s Traceback (most recent call last): 5985s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5985s comm = await wait_for( 5985s ^^^^^^^^^^^^^^^ 5985s ...<2 lines>... 5985s ) 5985s ^ 5985s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5985s return await fut 5985s ^^^^^^^^^ 5985s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 559, in connect 5985s convert_stream_closed_error(self, e) 5985s ~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^ 5985s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 140, in convert_stream_closed_error 5985s raise CommClosedError(f"in {obj}: {exc.__class__.__name__}: {exc}") from exc 5985s distributed.comm.core.CommClosedError: in : ConnectionRefusedError: [Errno 111] Connection refused 5985s 5985s During handling of the above exception, another exception occurred: 5985s 5985s Traceback (most recent call last): 5985s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 836, in wrapper 5985s return await func(*args, **kwargs) 5985s ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5985s File "/usr/lib/python3/dist-packages/distributed/client.py", line 1331, in _reconnect 5985s await self._ensure_connected(timeout=timeout) 5985s File "/usr/lib/python3/dist-packages/distributed/client.py", line 1361, in _ensure_connected 5985s comm = await connect( 5985s ^^^^^^^^^^^^^^ 5985s self.scheduler.address, timeout=timeout, **self.connection_args 5985s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5985s ) 5985s ^ 5985s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 366, in connect 5985s await asyncio.sleep(backoff) 5985s File "/usr/lib/python3.13/asyncio/tasks.py", line 718, in sleep 5985s return await future 5985s ^^^^^^^^^^^^ 5985s asyncio.exceptions.CancelledError 5985s ___________________________ test_multiple_workers_2 ____________________________ 5985s 5985s loop = 5985s 5985s def test_multiple_workers_2(loop): 5985s text = """ 5985s def dask_setup(worker): 5985s worker.foo = 'setup' 5985s """ 5985s port = open_port() 5985s with popen( 5985s ["dask", "scheduler", "--no-dashboard", "--host", f"127.0.0.1:{port}"] 5985s ) as s: 5985s with popen( 5985s [ 5985s "dask", 5985s "worker", 5985s f"localhost:{port}", 5985s "--no-dashboard", 5985s "--preload", 5985s text, 5985s "--preload-nanny", 5985s text, 5985s ] 5985s ) as a: 5985s with Client(f"127.0.0.1:{port}", loop=loop) as c: 5985s c.wait_for_workers(1) 5985s > [foo] = c.run(lambda dask_worker: dask_worker.foo).values() 5985s 5985s /usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py:549: 5985s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5985s /usr/lib/python3/dist-packages/distributed/client.py:2993: in run 5985s return self.sync( 5985s /usr/lib/python3/dist-packages/distributed/utils.py:362: in sync 5985s return sync( 5985s /usr/lib/python3/dist-packages/distributed/utils.py:438: in sync 5985s raise error 5985s /usr/lib/python3/dist-packages/distributed/utils.py:412: in f 5985s result = yield future 5985s /usr/lib/python3/dist-packages/tornado/gen.py:766: in run 5985s value = future.result() 5985s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5985s 5985s self = 5985s function = . at 0xde65bac8> 5985s nanny = False, workers = None, wait = True, on_error = 'raise', args = () 5985s kwargs = {} 5985s responses = {'tcp://127.0.0.1:43501': {'exception': b'\x80\x05\x953\x02\x00\x00\x00\x00\x00\x00\x8c\x16tblib.pickling_support\x94\...xt': "SystemError('no locals found when setting up annotations')", 'status': 'error', 'traceback': b'\x80\x05N.', ...}} 5985s results = {}, key = 'tcp://127.0.0.1:43501' 5985s resp = {'exception': b'\x80\x05\x953\x02\x00\x00\x00\x00\x00\x00\x8c\x16tblib.pickling_support\x94\x8c\x12unpickle_exception\...ext': "SystemError('no locals found when setting up annotations')", 'status': 'error', 'traceback': b'\x80\x05N.', ...} 5985s exc = SystemError('no locals found when setting up annotations') 5985s _ = 5985s 5985s async def _run( 5985s self, 5985s function, 5985s *args, 5985s nanny: bool = False, 5985s workers: list[str] | None = None, 5985s wait: bool = True, 5985s on_error: Literal["raise", "return", "ignore"] = "raise", 5985s **kwargs, 5985s ): 5985s responses = await self.scheduler.broadcast( 5985s msg=dict( 5985s op="run", 5985s function=dumps(function), 5985s args=dumps(args), 5985s wait=wait, 5985s kwargs=dumps(kwargs), 5985s ), 5985s workers=workers, 5985s nanny=nanny, 5985s on_error="return_pickle", 5985s ) 5985s results = {} 5985s for key, resp in responses.items(): 5985s if isinstance(resp, bytes): 5985s # Pickled RPC exception 5985s exc = loads(resp) 5985s assert isinstance(exc, Exception) 5985s elif resp["status"] == "error": 5985s # Exception raised by the remote function 5985s _, exc, tb = clean_exception(**resp) 5985s exc = exc.with_traceback(tb) 5985s else: 5985s assert resp["status"] == "OK" 5985s results[key] = resp["result"] 5985s continue 5985s 5985s if on_error == "raise": 5985s > raise exc 5985s E SystemError: no locals found when setting up annotations 5985s 5985s /usr/lib/python3/dist-packages/distributed/client.py:2898: SystemError 5985s ----------------------------- Captured stderr call ----------------------------- 5985s 2024-11-23 21:56:16,501 - distributed.utils - INFO - Reload module tmpk1p359dc from .py file 5985s 2024-11-23 21:56:16,502 - distributed.preloading - INFO - Import preload module: /tmp/tmpk1p359dc.py 5985s 2024-11-23 21:56:16,508 - distributed.scheduler - INFO - ----------------------------------------------- 5985s 2024-11-23 21:56:16,509 - distributed.preloading - INFO - Creating preload: 5985s def dask_setup(worker): 5985s worker.foo = 'setup' 5985s 5985s 2024-11-23 21:56:16,509 - distributed.utils - INFO - Reload module tmpbgmhymg2 from .py file 5985s 2024-11-23 21:56:16,510 - distributed.preloading - INFO - Import preload module: /tmp/tmpbgmhymg2.py 5985s 2024-11-23 21:56:16,511 - distributed.preloading - INFO - Run preload setup: 5985s def dask_setup(worker): 5985s worker.foo = 'setup' 5985s 5985s 2024-11-23 21:56:16,524 - distributed.http.proxy - INFO - To route to workers diagnostics web server please install jupyter-server-proxy: python -m pip install jupyter-server-proxy 5985s 2024-11-23 21:56:16,527 - distributed.scheduler - INFO - State start 5985s 2024-11-23 21:56:16,528 - distributed.diskutils - INFO - Found stale lock file and directory '/tmp/dask-scratch-space/scheduler-iwf6ex8o', purging 5985s 2024-11-23 21:56:16,533 - distributed.scheduler - INFO - ----------------------------------------------- 5985s 2024-11-23 21:56:16,533 - distributed.scheduler - INFO - Scheduler at: tcp://127.0.0.1:53081 5985s 2024-11-23 21:56:16,533 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:8787/status 5985s 2024-11-23 21:56:16,533 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5985s 2024-11-23 21:56:16,549 - distributed.nanny - INFO - Start Nanny at: 'tcp://127.0.0.1:33257' 5985s 2024-11-23 21:56:16,997 - distributed.scheduler - INFO - Receive client connection: Client-c3406547-a9e5-11ef-bc9b-00163e4db70f 5985s 2024-11-23 21:56:17,045 - distributed.preloading - INFO - Creating preload: 5985s def dask_setup(worker): 5985s worker.foo = 'setup' 5985s 5985s 2024-11-23 21:56:17,046 - distributed.utils - INFO - Reload module tmpczc9lztc from .py file 5985s 2024-11-23 21:56:17,046 - distributed.preloading - INFO - Import preload module: /tmp/tmpczc9lztc.py 5985s 2024-11-23 21:56:17,067 - distributed.preloading - INFO - Run preload setup: 5985s def dask_setup(worker): 5985s worker.foo = 'setup' 5985s 5985s 2024-11-23 21:56:17,067 - distributed.worker - INFO - Start worker at: tcp://127.0.0.1:43501 5985s 2024-11-23 21:56:17,067 - distributed.worker - INFO - Listening to: tcp://127.0.0.1:43501 5985s 2024-11-23 21:56:17,067 - distributed.worker - INFO - dashboard at: 127.0.0.1:43609 5985s 2024-11-23 21:56:17,067 - distributed.worker - INFO - Waiting to connect to: tcp://localhost:53081 5985s 2024-11-23 21:56:17,067 - distributed.worker - INFO - ------------------------------------------------- 5985s 2024-11-23 21:56:17,067 - distributed.worker - INFO - Threads: 8 5985s 2024-11-23 21:56:17,067 - distributed.worker - INFO - Memory: 15.58 GiB 5985s 2024-11-23 21:56:17,067 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-9irhtv76 5985s 2024-11-23 21:56:17,067 - distributed.worker - INFO - ------------------------------------------------- 5985s 2024-11-23 21:56:17,238 - distributed.core - INFO - Starting established connection to tcp://127.0.0.1:38298 5985s 2024-11-23 21:56:17,483 - distributed.scheduler - INFO - Register worker 5985s 2024-11-23 21:56:17,484 - distributed.scheduler - INFO - Starting worker compute stream, tcp://127.0.0.1:43501 5985s 2024-11-23 21:56:17,484 - distributed.core - INFO - Starting established connection to tcp://127.0.0.1:38306 5985s 2024-11-23 21:56:17,485 - distributed.worker - INFO - Starting Worker plugin shuffle 5985s 2024-11-23 21:56:17,485 - distributed.worker - INFO - Registered to: tcp://localhost:53081 5985s 2024-11-23 21:56:17,486 - distributed.worker - INFO - ------------------------------------------------- 5985s 2024-11-23 21:56:17,486 - distributed.core - INFO - Starting established connection to tcp://localhost:53081 5985s 2024-11-23 21:56:17,549 - distributed.worker - INFO - Run out-of-band function 'lambda' 5985s 2024-11-23 21:56:17,550 - distributed.worker - WARNING - Run Failed 5985s Function: lambda 5985s args: () 5985s kwargs: {'dask_worker': } 5985s Traceback (most recent call last): 5985s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 3182, in run 5985s result = function(*args, **kwargs) 5985s ^^^^^^^^^^^^^^^^^^^^^^^^^ 5985s SystemError: no locals found when setting up annotations 5985s 2024-11-23 21:56:17,554 - distributed.scheduler - INFO - Remove client Client-c3406547-a9e5-11ef-bc9b-00163e4db70f 5985s 2024-11-23 21:56:17,554 - distributed.core - INFO - Received 'close-stream' from tcp://127.0.0.1:38298; closing. 5985s 2024-11-23 21:56:17,555 - distributed.scheduler - INFO - Remove client Client-c3406547-a9e5-11ef-bc9b-00163e4db70f 5985s 2024-11-23 21:56:17,555 - distributed.scheduler - INFO - Close client connection: Client-c3406547-a9e5-11ef-bc9b-00163e4db70f 5985s 2024-11-23 21:56:17,555 - distributed._signals - INFO - Received signal SIGINT (2) 5985s 2024-11-23 21:56:17,556 - distributed.nanny - INFO - Closing Nanny at 'tcp://127.0.0.1:33257'. Reason: signal-2 5985s 2024-11-23 21:56:17,556 - distributed.nanny - INFO - Nanny asking worker to close. Reason: signal-2 5985s 2024-11-23 21:56:17,557 - distributed.worker - INFO - Stopping worker at tcp://127.0.0.1:43501. Reason: signal-2 5985s 2024-11-23 21:56:17,558 - distributed.core - INFO - Received 'close-stream' from tcp://127.0.0.1:38306; closing. 5985s 2024-11-23 21:56:17,558 - distributed.core - INFO - Connection to tcp://localhost:53081 has been closed. 5985s 2024-11-23 21:56:17,558 - distributed.scheduler - INFO - Remove worker (stimulus_id='handle-worker-cleanup-1732398977.5588815') 5985s 2024-11-23 21:56:17,559 - distributed.scheduler - INFO - Lost all workers 5985s 2024-11-23 21:56:17,559 - distributed.nanny - INFO - Worker closed 5985s 2024-11-23 21:56:17,733 - distributed.dask_worker - INFO - End worker 5985s 2024-11-23 21:56:17,870 - distributed._signals - INFO - Received signal SIGINT (2) 5985s 2024-11-23 21:56:17,870 - distributed.scheduler - INFO - Scheduler closing due to signal-2... 5985s 2024-11-23 21:56:17,871 - distributed.scheduler - INFO - Scheduler closing all comms 5985s 2024-11-23 21:56:17,871 - distributed.scheduler - INFO - Stopped scheduler at 'tcp://127.0.0.1:53081' 5985s 2024-11-23 21:56:17,871 - distributed.scheduler - INFO - End scheduler 5985s __________________________________ test_basic __________________________________ 5985s 5985s self = 5985s address = '127.0.0.1:8786', deserialize = True 5985s connection_args = {'extra_conn_args': {}, 'require_encryption': False, 'ssl_context': } 5985s ip = '127.0.0.1', port = 8786 5985s kwargs = {'ssl_options': } 5985s 5985s async def connect(self, address, deserialize=True, **connection_args): 5985s self._check_encryption(address, connection_args) 5985s ip, port = parse_host_port(address) 5985s kwargs = self._get_connect_args(**connection_args) 5985s 5985s try: 5985s # server_hostname option (for SNI) only works with tornado.iostream.IOStream 5985s if "server_hostname" in kwargs: 5985s stream = await self.client.connect( 5985s ip, port, max_buffer_size=MAX_BUFFER_SIZE 5985s ) 5985s stream = await stream.start_tls(False, **kwargs) 5985s else: 5985s > stream = await self.client.connect( 5985s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5985s ) 5985s 5985s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:546: 5985s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5985s /usr/lib/python3/dist-packages/tornado/tcpclient.py:292: in connect 5985s stream = await stream.start_tls( 5985s /usr/lib/python3/dist-packages/tornado/iostream.py:1367: in _do_ssl_handshake 5985s self.socket.do_handshake() 5985s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5985s 5985s self = , block = False 5985s 5985s @_sslcopydoc 5985s def do_handshake(self, block=False): 5985s self._check_connected() 5985s timeout = self.gettimeout() 5985s try: 5985s if timeout == 0.0 and block: 5985s self.settimeout(None) 5985s > self._sslobj.do_handshake() 5985s E ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 5985s 5985s /usr/lib/python3.13/ssl.py:1372: SSLCertVerificationError 5985s 5985s The above exception was the direct cause of the following exception: 5985s 5985s loop = 5985s requires_default_ports = None 5985s 5985s def test_basic(loop, requires_default_ports): 5985s with ( 5985s popen(["dask", "scheduler", "--no-dashboard"] + tls_args), 5985s popen(["dask", "worker", "--no-dashboard", "tls://127.0.0.1:8786"] + tls_args), 5985s > Client("tls://127.0.0.1:8786", loop=loop, security=tls_security()) as c, 5985s ): 5985s 5985s /usr/lib/python3/dist-packages/distributed/cli/tests/test_tls_cli.py:37: 5985s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5985s /usr/lib/python3/dist-packages/distributed/client.py:1018: in __init__ 5985s self.start(timeout=timeout) 5985s /usr/lib/python3/dist-packages/distributed/client.py:1220: in start 5985s sync(self.loop, self._start, **kwargs) 5985s /usr/lib/python3/dist-packages/distributed/utils.py:438: in sync 5985s raise error 5985s /usr/lib/python3/dist-packages/distributed/utils.py:412: in f 5985s result = yield future 5985s /usr/lib/python3/dist-packages/tornado/gen.py:766: in run 5985s value = future.result() 5985s /usr/lib/python3/dist-packages/distributed/client.py:1299: in _start 5985s await self._ensure_connected(timeout=timeout) 5985s /usr/lib/python3/dist-packages/distributed/client.py:1361: in _ensure_connected 5985s comm = await connect( 5985s /usr/lib/python3/dist-packages/distributed/comm/core.py:342: in connect 5985s comm = await wait_for( 5985s /usr/lib/python3/dist-packages/distributed/utils.py:1960: in wait_for 5985s return await fut 5985s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5985s 5985s self = 5985s address = '127.0.0.1:8786', deserialize = True 5985s connection_args = {'extra_conn_args': {}, 'require_encryption': False, 'ssl_context': } 5985s ip = '127.0.0.1', port = 8786 5985s kwargs = {'ssl_options': } 5985s 5985s async def connect(self, address, deserialize=True, **connection_args): 5985s self._check_encryption(address, connection_args) 5985s ip, port = parse_host_port(address) 5985s kwargs = self._get_connect_args(**connection_args) 5985s 5985s try: 5985s # server_hostname option (for SNI) only works with tornado.iostream.IOStream 5985s if "server_hostname" in kwargs: 5985s stream = await self.client.connect( 5985s ip, port, max_buffer_size=MAX_BUFFER_SIZE 5985s ) 5985s stream = await stream.start_tls(False, **kwargs) 5985s else: 5985s stream = await self.client.connect( 5985s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5985s ) 5985s 5985s # Under certain circumstances tornado will have a closed connection with an 5985s # error and not raise a StreamClosedError. 5985s # 5985s # This occurs with tornado 5.x and openssl 1.1+ 5985s if stream.closed() and stream.error: 5985s raise StreamClosedError(stream.error) 5985s 5985s except StreamClosedError as e: 5985s # The socket connect() call failed 5985s convert_stream_closed_error(self, e) 5985s except SSLCertVerificationError as err: 5985s > raise FatalCommClosedError( 5985s "TLS certificate does not match. Check your security settings. " 5985s "More info at https://distributed.dask.org/en/latest/tls.html" 5985s ) from err 5985s E distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 5985s 5985s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:561: FatalCommClosedError 5985s ----------------------------- Captured stderr call ----------------------------- 5985s 2024-11-23 21:56:18,737 - distributed.scheduler - INFO - ----------------------------------------------- 5985s 2024-11-23 21:56:18,755 - distributed.http.proxy - INFO - To route to workers diagnostics web server please install jupyter-server-proxy: python -m pip install jupyter-server-proxy 5985s 2024-11-23 21:56:18,758 - distributed.scheduler - INFO - State start 5985s 2024-11-23 21:56:18,763 - distributed.scheduler - INFO - ----------------------------------------------- 5985s 2024-11-23 21:56:18,765 - distributed.scheduler - INFO - Scheduler at: tls://10.0.4.73:8786 5985s 2024-11-23 21:56:18,765 - distributed.scheduler - INFO - dashboard at: http://10.0.4.73:8787/status 5985s 2024-11-23 21:56:18,765 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5985s 2024-11-23 21:56:18,781 - distributed.nanny - INFO - Start Nanny at: 'tls://127.0.0.1:44567' 5985s 2024-11-23 21:56:18,980 - distributed.comm.tcp - WARNING - Listener on 'tls://0.0.0.0:8786': TLS handshake failed with remote 'tls://127.0.0.1:43324': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1000) 5985s 2024-11-23 21:56:18,981 - distributed._signals - INFO - Received signal SIGINT (2) 5985s 2024-11-23 21:56:18,981 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:44567'. Reason: signal-2 5985s 2024-11-23 21:56:19,285 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46049 5985s 2024-11-23 21:56:19,285 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46049 5985s 2024-11-23 21:56:19,285 - distributed.worker - INFO - dashboard at: 127.0.0.1:38267 5985s 2024-11-23 21:56:19,285 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:8786 5985s 2024-11-23 21:56:19,285 - distributed.worker - INFO - ------------------------------------------------- 5985s 2024-11-23 21:56:19,285 - distributed.worker - INFO - Threads: 8 5985s 2024-11-23 21:56:19,285 - distributed.worker - INFO - Memory: 15.58 GiB 5985s 2024-11-23 21:56:19,285 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-kqsbp9k6 5985s 2024-11-23 21:56:19,285 - distributed.worker - INFO - ------------------------------------------------- 5985s 2024-11-23 21:56:19,545 - distributed.scheduler - INFO - Register worker 5985s 2024-11-23 21:56:19,802 - distributed.scheduler - INFO - Starting worker compute stream, tls://127.0.0.1:46049 5985s 2024-11-23 21:56:19,802 - distributed.core - INFO - Starting established connection to tls://127.0.0.1:43338 5985s 2024-11-23 21:56:19,802 - distributed.worker - INFO - Starting Worker plugin shuffle 5985s 2024-11-23 21:56:19,803 - distributed.worker - INFO - Registered to: tls://127.0.0.1:8786 5985s 2024-11-23 21:56:19,803 - distributed.worker - INFO - ------------------------------------------------- 5985s 2024-11-23 21:56:19,804 - distributed.core - INFO - Starting established connection to tls://127.0.0.1:8786 5985s 2024-11-23 21:56:19,843 - distributed.nanny - INFO - Nanny asking worker to close. Reason: signal-2 5985s 2024-11-23 21:56:19,844 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46049. Reason: signal-2 5985s 2024-11-23 21:56:19,845 - distributed.core - INFO - Received 'close-stream' from tls://127.0.0.1:43338; closing. 5985s 2024-11-23 21:56:19,845 - distributed.core - INFO - Connection to tls://127.0.0.1:8786 has been closed. 5985s 2024-11-23 21:56:19,846 - distributed.scheduler - INFO - Remove worker (stimulus_id='handle-worker-cleanup-1732398979.84598') 5985s 2024-11-23 21:56:19,846 - distributed.scheduler - INFO - Lost all workers 5985s 2024-11-23 21:56:19,847 - distributed.nanny - INFO - Worker closed 5985s 2024-11-23 21:56:20,019 - distributed.dask_worker - INFO - End worker 5985s 2024-11-23 21:56:20,148 - distributed._signals - INFO - Received signal SIGINT (2) 5985s 2024-11-23 21:56:20,148 - distributed.scheduler - INFO - Scheduler closing due to signal-2... 5985s 2024-11-23 21:56:20,148 - distributed.scheduler - INFO - Scheduler closing all comms 5985s 2024-11-23 21:56:20,149 - distributed.scheduler - INFO - Stopped scheduler at 'tls://10.0.4.73:8786' 5985s 2024-11-23 21:56:20,150 - distributed.scheduler - INFO - End scheduler 5985s ___________________________________ test_sni ___________________________________ 5985s 5985s self = 5985s address = '127.0.0.1:34457', deserialize = True 5985s connection_args = {'extra_conn_args': {}, 'require_encryption': False, 'ssl_context': } 5985s ip = '127.0.0.1', port = 34457 5985s kwargs = {'ssl_options': } 5985s 5985s async def connect(self, address, deserialize=True, **connection_args): 5985s self._check_encryption(address, connection_args) 5985s ip, port = parse_host_port(address) 5985s kwargs = self._get_connect_args(**connection_args) 5985s 5985s try: 5985s # server_hostname option (for SNI) only works with tornado.iostream.IOStream 5985s if "server_hostname" in kwargs: 5985s stream = await self.client.connect( 5985s ip, port, max_buffer_size=MAX_BUFFER_SIZE 5985s ) 5985s stream = await stream.start_tls(False, **kwargs) 5985s else: 5985s > stream = await self.client.connect( 5985s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5985s ) 5985s 5985s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:546: 5985s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5985s /usr/lib/python3/dist-packages/tornado/tcpclient.py:292: in connect 5985s stream = await stream.start_tls( 5985s /usr/lib/python3/dist-packages/tornado/iostream.py:1367: in _do_ssl_handshake 5985s self.socket.do_handshake() 5985s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5985s 5985s self = , block = False 5985s 5985s @_sslcopydoc 5985s def do_handshake(self, block=False): 5985s self._check_connected() 5985s timeout = self.gettimeout() 5985s try: 5985s if timeout == 0.0 and block: 5985s self.settimeout(None) 5985s > self._sslobj.do_handshake() 5985s E ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 5985s 5985s /usr/lib/python3.13/ssl.py:1372: SSLCertVerificationError 5985s 5985s The above exception was the direct cause of the following exception: 5985s 5985s loop = 5985s 5985s def test_sni(loop): 5985s port = open_port() 5985s with popen( 5985s ["dask", "scheduler", "--no-dashboard", f"--port={port}"] + tls_args 5985s ) as s: 5985s with popen( 5985s [ 5985s "dask", 5985s "worker", 5985s "--no-dashboard", 5985s "--scheduler-sni", 5985s "localhost", 5985s f"tls://127.0.0.1:{port}", 5985s ] 5985s + tls_args 5985s ) as w: 5985s > with Client( 5985s f"tls://127.0.0.1:{port}", loop=loop, security=tls_security() 5985s ) as c: 5985s 5985s /usr/lib/python3/dist-packages/distributed/cli/tests/test_tls_cli.py:58: 5985s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5985s /usr/lib/python3/dist-packages/distributed/client.py:1018: in __init__ 5985s self.start(timeout=timeout) 5985s /usr/lib/python3/dist-packages/distributed/client.py:1220: in start 5985s sync(self.loop, self._start, **kwargs) 5985s /usr/lib/python3/dist-packages/distributed/utils.py:438: in sync 5985s raise error 5985s /usr/lib/python3/dist-packages/distributed/utils.py:412: in f 5985s result = yield future 5985s /usr/lib/python3/dist-packages/tornado/gen.py:766: in run 5985s value = future.result() 5985s /usr/lib/python3/dist-packages/distributed/client.py:1299: in _start 5985s await self._ensure_connected(timeout=timeout) 5985s /usr/lib/python3/dist-packages/distributed/client.py:1361: in _ensure_connected 5985s comm = await connect( 5985s /usr/lib/python3/dist-packages/distributed/comm/core.py:342: in connect 5985s comm = await wait_for( 5985s /usr/lib/python3/dist-packages/distributed/utils.py:1960: in wait_for 5985s return await fut 5985s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5985s 5985s self = 5985s address = '127.0.0.1:34457', deserialize = True 5985s connection_args = {'extra_conn_args': {}, 'require_encryption': False, 'ssl_context': } 5985s ip = '127.0.0.1', port = 34457 5985s kwargs = {'ssl_options': } 5985s 5985s async def connect(self, address, deserialize=True, **connection_args): 5985s self._check_encryption(address, connection_args) 5985s ip, port = parse_host_port(address) 5985s kwargs = self._get_connect_args(**connection_args) 5985s 5985s try: 5985s # server_hostname option (for SNI) only works with tornado.iostream.IOStream 5985s if "server_hostname" in kwargs: 5985s stream = await self.client.connect( 5985s ip, port, max_buffer_size=MAX_BUFFER_SIZE 5985s ) 5985s stream = await stream.start_tls(False, **kwargs) 5985s else: 5985s stream = await self.client.connect( 5985s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5985s ) 5985s 5985s # Under certain circumstances tornado will have a closed connection with an 5985s # error and not raise a StreamClosedError. 5985s # 5985s # This occurs with tornado 5.x and openssl 1.1+ 5985s if stream.closed() and stream.error: 5985s raise StreamClosedError(stream.error) 5985s 5985s except StreamClosedError as e: 5985s # The socket connect() call failed 5985s convert_stream_closed_error(self, e) 5985s except SSLCertVerificationError as err: 5985s > raise FatalCommClosedError( 5985s "TLS certificate does not match. Check your security settings. " 5985s "More info at https://distributed.dask.org/en/latest/tls.html" 5985s ) from err 5985s E distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 5985s 5985s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:561: FatalCommClosedError 5985s ----------------------------- Captured stderr call ----------------------------- 5985s 2024-11-23 21:56:21,161 - distributed.scheduler - INFO - ----------------------------------------------- 5985s 2024-11-23 21:56:21,179 - distributed.http.proxy - INFO - To route to workers diagnostics web server please install jupyter-server-proxy: python -m pip install jupyter-server-proxy 5985s 2024-11-23 21:56:21,182 - distributed.scheduler - INFO - State start 5985s 2024-11-23 21:56:21,187 - distributed.scheduler - INFO - ----------------------------------------------- 5985s 2024-11-23 21:56:21,189 - distributed.scheduler - INFO - Scheduler at: tls://10.0.4.73:34457 5985s 2024-11-23 21:56:21,190 - distributed.scheduler - INFO - dashboard at: http://10.0.4.73:8787/status 5985s 2024-11-23 21:56:21,190 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5985s 2024-11-23 21:56:21,205 - distributed.nanny - INFO - Start Nanny at: 'tls://127.0.0.1:41343' 5985s 2024-11-23 21:56:21,374 - distributed.comm.tcp - WARNING - Listener on 'tls://0.0.0.0:34457': TLS handshake failed with remote 'tls://127.0.0.1:47690': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1000) 5985s 2024-11-23 21:56:21,375 - distributed._signals - INFO - Received signal SIGINT (2) 5985s 2024-11-23 21:56:21,375 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:41343'. Reason: signal-2 5985s 2024-11-23 21:56:21,724 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44513 5985s 2024-11-23 21:56:21,724 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44513 5985s 2024-11-23 21:56:21,724 - distributed.worker - INFO - dashboard at: 127.0.0.1:38273 5985s 2024-11-23 21:56:21,724 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34457 5985s 2024-11-23 21:56:21,724 - distributed.worker - INFO - ------------------------------------------------- 5985s 2024-11-23 21:56:21,724 - distributed.worker - INFO - Threads: 8 5985s 2024-11-23 21:56:21,724 - distributed.worker - INFO - Memory: 15.58 GiB 5985s 2024-11-23 21:56:21,724 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-9e_wwn34 5985s 2024-11-23 21:56:21,724 - distributed.worker - INFO - ------------------------------------------------- 5985s 2024-11-23 21:56:21,979 - distributed.scheduler - INFO - Register worker 5985s 2024-11-23 21:56:22,238 - distributed.scheduler - INFO - Starting worker compute stream, tls://127.0.0.1:44513 5985s 2024-11-23 21:56:22,238 - distributed.core - INFO - Starting established connection to tls://127.0.0.1:33296 5985s 2024-11-23 21:56:22,239 - distributed.worker - INFO - Starting Worker plugin shuffle 5985s 2024-11-23 21:56:22,239 - distributed.worker - INFO - Registered to: tls://127.0.0.1:34457 5985s 2024-11-23 21:56:22,240 - distributed.worker - INFO - ------------------------------------------------- 5985s 2024-11-23 21:56:22,240 - distributed.core - INFO - Starting established connection to tls://127.0.0.1:34457 5985s 2024-11-23 21:56:22,267 - distributed.nanny - INFO - Nanny asking worker to close. Reason: signal-2 5985s 2024-11-23 21:56:22,268 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44513. Reason: signal-2 5985s 2024-11-23 21:56:22,269 - distributed.core - INFO - Received 'close-stream' from tls://127.0.0.1:33296; closing. 5985s 2024-11-23 21:56:22,269 - distributed.core - INFO - Connection to tls://127.0.0.1:34457 has been closed. 5985s 2024-11-23 21:56:22,269 - distributed.scheduler - INFO - Remove worker (stimulus_id='handle-worker-cleanup-1732398982.269941') 5985s 2024-11-23 21:56:22,270 - distributed.scheduler - INFO - Lost all workers 5985s 2024-11-23 21:56:22,271 - distributed.nanny - INFO - Worker closed 5985s 2024-11-23 21:56:22,460 - distributed.dask_worker - INFO - End worker 5985s 2024-11-23 21:56:22,593 - distributed._signals - INFO - Received signal SIGINT (2) 5985s 2024-11-23 21:56:22,593 - distributed.scheduler - INFO - Scheduler closing due to signal-2... 5985s 2024-11-23 21:56:22,593 - distributed.scheduler - INFO - Scheduler closing all comms 5985s 2024-11-23 21:56:22,594 - distributed.scheduler - INFO - Stopped scheduler at 'tls://10.0.4.73:34457' 5985s 2024-11-23 21:56:22,594 - distributed.scheduler - INFO - End scheduler 5985s __________________________________ test_nanny __________________________________ 5985s 5985s self = 5985s address = '127.0.0.1:46375', deserialize = True 5985s connection_args = {'extra_conn_args': {}, 'require_encryption': False, 'ssl_context': } 5985s ip = '127.0.0.1', port = 46375 5985s kwargs = {'ssl_options': } 5985s 5985s async def connect(self, address, deserialize=True, **connection_args): 5985s self._check_encryption(address, connection_args) 5985s ip, port = parse_host_port(address) 5985s kwargs = self._get_connect_args(**connection_args) 5985s 5985s try: 5985s # server_hostname option (for SNI) only works with tornado.iostream.IOStream 5985s if "server_hostname" in kwargs: 5985s stream = await self.client.connect( 5985s ip, port, max_buffer_size=MAX_BUFFER_SIZE 5985s ) 5985s stream = await stream.start_tls(False, **kwargs) 5985s else: 5985s > stream = await self.client.connect( 5985s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5985s ) 5985s 5985s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:546: 5985s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5985s /usr/lib/python3/dist-packages/tornado/tcpclient.py:292: in connect 5985s stream = await stream.start_tls( 5985s /usr/lib/python3/dist-packages/tornado/iostream.py:1367: in _do_ssl_handshake 5985s self.socket.do_handshake() 5985s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5985s 5985s self = , block = False 5985s 5985s @_sslcopydoc 5985s def do_handshake(self, block=False): 5985s self._check_connected() 5985s timeout = self.gettimeout() 5985s try: 5985s if timeout == 0.0 and block: 5985s self.settimeout(None) 5985s > self._sslobj.do_handshake() 5985s E ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 5985s 5985s /usr/lib/python3.13/ssl.py:1372: SSLCertVerificationError 5985s 5985s The above exception was the direct cause of the following exception: 5985s 5985s loop = 5985s 5985s def test_nanny(loop): 5985s port = open_port() 5985s with popen( 5985s [ 5985s "dask", 5985s "scheduler", 5985s "--no-dashboard", 5985s f"--port={port}", 5985s ] 5985s + tls_args 5985s ) as s: 5985s with popen( 5985s ["dask", "worker", "--no-dashboard", "--nanny", f"tls://127.0.0.1:{port}"] 5985s + tls_args 5985s ) as w: 5985s > with Client( 5985s f"tls://127.0.0.1:{port}", loop=loop, security=tls_security() 5985s ) as c: 5985s 5985s /usr/lib/python3/dist-packages/distributed/cli/tests/test_tls_cli.py:79: 5985s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5985s /usr/lib/python3/dist-packages/distributed/client.py:1018: in __init__ 5985s self.start(timeout=timeout) 5985s /usr/lib/python3/dist-packages/distributed/client.py:1220: in start 5985s sync(self.loop, self._start, **kwargs) 5985s /usr/lib/python3/dist-packages/distributed/utils.py:438: in sync 5985s raise error 5985s /usr/lib/python3/dist-packages/distributed/utils.py:412: in f 5985s result = yield future 5985s /usr/lib/python3/dist-packages/tornado/gen.py:766: in run 5985s value = future.result() 5985s /usr/lib/python3/dist-packages/distributed/client.py:1299: in _start 5985s await self._ensure_connected(timeout=timeout) 5985s /usr/lib/python3/dist-packages/distributed/client.py:1361: in _ensure_connected 5985s comm = await connect( 5985s /usr/lib/python3/dist-packages/distributed/comm/core.py:342: in connect 5985s comm = await wait_for( 5985s /usr/lib/python3/dist-packages/distributed/utils.py:1960: in wait_for 5985s return await fut 5985s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5985s 5985s self = 5985s address = '127.0.0.1:46375', deserialize = True 5985s connection_args = {'extra_conn_args': {}, 'require_encryption': False, 'ssl_context': } 5985s ip = '127.0.0.1', port = 46375 5985s kwargs = {'ssl_options': } 5985s 5985s async def connect(self, address, deserialize=True, **connection_args): 5985s self._check_encryption(address, connection_args) 5985s ip, port = parse_host_port(address) 5985s kwargs = self._get_connect_args(**connection_args) 5985s 5985s try: 5985s # server_hostname option (for SNI) only works with tornado.iostream.IOStream 5985s if "server_hostname" in kwargs: 5985s stream = await self.client.connect( 5985s ip, port, max_buffer_size=MAX_BUFFER_SIZE 5985s ) 5985s stream = await stream.start_tls(False, **kwargs) 5985s else: 5985s stream = await self.client.connect( 5985s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5985s ) 5985s 5985s # Under certain circumstances tornado will have a closed connection with an 5985s # error and not raise a StreamClosedError. 5985s # 5985s # This occurs with tornado 5.x and openssl 1.1+ 5985s if stream.closed() and stream.error: 5985s raise StreamClosedError(stream.error) 5985s 5985s except StreamClosedError as e: 5985s # The socket connect() call failed 5985s convert_stream_closed_error(self, e) 5985s except SSLCertVerificationError as err: 5985s > raise FatalCommClosedError( 5985s "TLS certificate does not match. Check your security settings. " 5985s "More info at https://distributed.dask.org/en/latest/tls.html" 5985s ) from err 5985s E distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 5985s 5985s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:561: FatalCommClosedError 5985s ----------------------------- Captured stderr call ----------------------------- 5985s 2024-11-23 21:56:23,628 - distributed.scheduler - INFO - ----------------------------------------------- 5985s 2024-11-23 21:56:23,646 - distributed.http.proxy - INFO - To route to workers diagnostics web server please install jupyter-server-proxy: python -m pip install jupyter-server-proxy 5985s 2024-11-23 21:56:23,648 - distributed.scheduler - INFO - State start 5985s 2024-11-23 21:56:23,653 - distributed.scheduler - INFO - ----------------------------------------------- 5985s 2024-11-23 21:56:23,655 - distributed.scheduler - INFO - Scheduler at: tls://10.0.4.73:46375 5985s 2024-11-23 21:56:23,655 - distributed.scheduler - INFO - dashboard at: http://10.0.4.73:8787/status 5985s 2024-11-23 21:56:23,656 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5985s 2024-11-23 21:56:23,687 - distributed.nanny - INFO - Start Nanny at: 'tls://127.0.0.1:34491' 5985s 2024-11-23 21:56:24,239 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34271 5985s 2024-11-23 21:56:24,239 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34271 5985s 2024-11-23 21:56:24,239 - distributed.worker - INFO - dashboard at: 127.0.0.1:33225 5985s 2024-11-23 21:56:24,239 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46375 5985s 2024-11-23 21:56:24,239 - distributed.worker - INFO - ------------------------------------------------- 5985s 2024-11-23 21:56:24,240 - distributed.worker - INFO - Threads: 8 5985s 2024-11-23 21:56:24,240 - distributed.worker - INFO - Memory: 15.58 GiB 5985s 2024-11-23 21:56:24,240 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-x3mvs7l6 5985s 2024-11-23 21:56:24,240 - distributed.worker - INFO - ------------------------------------------------- 5985s 2024-11-23 21:56:24,519 - distributed.scheduler - INFO - Register worker 5985s 2024-11-23 21:56:24,780 - distributed.scheduler - INFO - Starting worker compute stream, tls://127.0.0.1:34271 5985s 2024-11-23 21:56:24,780 - distributed.core - INFO - Starting established connection to tls://127.0.0.1:45806 5985s 2024-11-23 21:56:24,780 - distributed.worker - INFO - Starting Worker plugin shuffle 5985s 2024-11-23 21:56:24,781 - distributed.worker - INFO - Registered to: tls://127.0.0.1:46375 5985s 2024-11-23 21:56:24,781 - distributed.worker - INFO - ------------------------------------------------- 5985s 2024-11-23 21:56:24,782 - distributed.core - INFO - Starting established connection to tls://127.0.0.1:46375 5985s 2024-11-23 21:56:24,788 - distributed.comm.tcp - WARNING - Listener on 'tls://0.0.0.0:46375': TLS handshake failed with remote 'tls://127.0.0.1:45814': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1000) 5985s 2024-11-23 21:56:24,788 - distributed._signals - INFO - Received signal SIGINT (2) 5985s 2024-11-23 21:56:24,788 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:34491'. Reason: signal-2 5985s 2024-11-23 21:56:24,798 - distributed.nanny - INFO - Nanny asking worker to close. Reason: signal-2 5985s 2024-11-23 21:56:24,798 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34271. Reason: signal-2 5985s 2024-11-23 21:56:24,800 - distributed.core - INFO - Received 'close-stream' from tls://127.0.0.1:45806; closing. 5985s 2024-11-23 21:56:24,800 - distributed.core - INFO - Connection to tls://127.0.0.1:46375 has been closed. 5985s 2024-11-23 21:56:24,800 - distributed.scheduler - INFO - Remove worker (stimulus_id='handle-worker-cleanup-1732398984.8006873') 5985s 2024-11-23 21:56:24,800 - distributed.scheduler - INFO - Lost all workers 5985s 2024-11-23 21:56:24,802 - distributed.nanny - INFO - Worker closed 5985s 2024-11-23 21:56:25,011 - distributed.dask_worker - INFO - End worker 5985s 2024-11-23 21:56:25,153 - distributed._signals - INFO - Received signal SIGINT (2) 5985s 2024-11-23 21:56:25,153 - distributed.scheduler - INFO - Scheduler closing due to signal-2... 5985s 2024-11-23 21:56:25,153 - distributed.scheduler - INFO - Scheduler closing all comms 5985s 2024-11-23 21:56:25,154 - distributed.scheduler - INFO - Stopped scheduler at 'tls://10.0.4.73:46375' 5985s 2024-11-23 21:56:25,154 - distributed.scheduler - INFO - End scheduler 5985s ____________________________ test_separate_key_cert ____________________________ 5985s 5985s self = 5985s address = '127.0.0.1:44297', deserialize = True 5985s connection_args = {'extra_conn_args': {}, 'require_encryption': False, 'ssl_context': } 5985s ip = '127.0.0.1', port = 44297 5985s kwargs = {'ssl_options': } 5985s 5985s async def connect(self, address, deserialize=True, **connection_args): 5985s self._check_encryption(address, connection_args) 5985s ip, port = parse_host_port(address) 5985s kwargs = self._get_connect_args(**connection_args) 5985s 5985s try: 5985s # server_hostname option (for SNI) only works with tornado.iostream.IOStream 5985s if "server_hostname" in kwargs: 5985s stream = await self.client.connect( 5985s ip, port, max_buffer_size=MAX_BUFFER_SIZE 5985s ) 5985s stream = await stream.start_tls(False, **kwargs) 5985s else: 5985s > stream = await self.client.connect( 5985s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5985s ) 5985s 5985s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:546: 5985s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5985s /usr/lib/python3/dist-packages/tornado/tcpclient.py:292: in connect 5985s stream = await stream.start_tls( 5985s /usr/lib/python3/dist-packages/tornado/iostream.py:1367: in _do_ssl_handshake 5985s self.socket.do_handshake() 5985s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5985s 5985s self = , block = False 5985s 5985s @_sslcopydoc 5985s def do_handshake(self, block=False): 5985s self._check_connected() 5985s timeout = self.gettimeout() 5985s try: 5985s if timeout == 0.0 and block: 5985s self.settimeout(None) 5985s > self._sslobj.do_handshake() 5985s E ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 5985s 5985s /usr/lib/python3.13/ssl.py:1372: SSLCertVerificationError 5985s 5985s The above exception was the direct cause of the following exception: 5985s 5985s loop = 5985s 5985s def test_separate_key_cert(loop): 5985s port = open_port() 5985s with popen( 5985s [ 5985s "dask", 5985s "scheduler", 5985s "--no-dashboard", 5985s f"--port={port}", 5985s ] 5985s + tls_args_2 5985s ) as s: 5985s with popen( 5985s ["dask", "worker", "--no-dashboard", f"tls://127.0.0.1:{port}"] + tls_args_2 5985s ) as w: 5985s > with Client( 5985s f"tls://127.0.0.1:{port}", loop=loop, security=tls_security() 5985s ) as c: 5985s 5985s /usr/lib/python3/dist-packages/distributed/cli/tests/test_tls_cli.py:99: 5985s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5985s /usr/lib/python3/dist-packages/distributed/client.py:1018: in __init__ 5985s self.start(timeout=timeout) 5985s /usr/lib/python3/dist-packages/distributed/client.py:1220: in start 5985s sync(self.loop, self._start, **kwargs) 5985s /usr/lib/python3/dist-packages/distributed/utils.py:438: in sync 5985s raise error 5985s /usr/lib/python3/dist-packages/distributed/utils.py:412: in f 5985s result = yield future 5985s /usr/lib/python3/dist-packages/tornado/gen.py:766: in run 5985s value = future.result() 5985s /usr/lib/python3/dist-packages/distributed/client.py:1299: in _start 5985s await self._ensure_connected(timeout=timeout) 5985s /usr/lib/python3/dist-packages/distributed/client.py:1361: in _ensure_connected 5985s comm = await connect( 5985s /usr/lib/python3/dist-packages/distributed/comm/core.py:342: in connect 5985s comm = await wait_for( 5985s /usr/lib/python3/dist-packages/distributed/utils.py:1960: in wait_for 5985s return await fut 5985s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5985s 5985s self = 5985s address = '127.0.0.1:44297', deserialize = True 5985s connection_args = {'extra_conn_args': {}, 'require_encryption': False, 'ssl_context': } 5985s ip = '127.0.0.1', port = 44297 5985s kwargs = {'ssl_options': } 5985s 5985s async def connect(self, address, deserialize=True, **connection_args): 5985s self._check_encryption(address, connection_args) 5985s ip, port = parse_host_port(address) 5985s kwargs = self._get_connect_args(**connection_args) 5985s 5985s try: 5985s # server_hostname option (for SNI) only works with tornado.iostream.IOStream 5985s if "server_hostname" in kwargs: 5985s stream = await self.client.connect( 5985s ip, port, max_buffer_size=MAX_BUFFER_SIZE 5985s ) 5985s stream = await stream.start_tls(False, **kwargs) 5985s else: 5985s stream = await self.client.connect( 5985s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5985s ) 5985s 5985s # Under certain circumstances tornado will have a closed connection with an 5985s # error and not raise a StreamClosedError. 5985s # 5985s # This occurs with tornado 5.x and openssl 1.1+ 5985s if stream.closed() and stream.error: 5985s raise StreamClosedError(stream.error) 5985s 5985s except StreamClosedError as e: 5985s # The socket connect() call failed 5985s convert_stream_closed_error(self, e) 5985s except SSLCertVerificationError as err: 5985s > raise FatalCommClosedError( 5985s "TLS certificate does not match. Check your security settings. " 5985s "More info at https://distributed.dask.org/en/latest/tls.html" 5985s ) from err 5985s E distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 5985s 5985s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:561: FatalCommClosedError 5985s ----------------------------- Captured stderr call ----------------------------- 5985s 2024-11-23 21:56:26,162 - distributed.scheduler - INFO - ----------------------------------------------- 5985s 2024-11-23 21:56:26,182 - distributed.http.proxy - INFO - To route to workers diagnostics web server please install jupyter-server-proxy: python -m pip install jupyter-server-proxy 5985s 2024-11-23 21:56:26,185 - distributed.scheduler - INFO - State start 5985s 2024-11-23 21:56:26,190 - distributed.scheduler - INFO - ----------------------------------------------- 5985s 2024-11-23 21:56:26,192 - distributed.scheduler - INFO - Scheduler at: tls://10.0.4.73:44297 5985s 2024-11-23 21:56:26,192 - distributed.scheduler - INFO - dashboard at: http://10.0.4.73:8787/status 5985s 2024-11-23 21:56:26,192 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5985s 2024-11-23 21:56:26,212 - distributed.nanny - INFO - Start Nanny at: 'tls://127.0.0.1:35589' 5985s 2024-11-23 21:56:26,641 - distributed.comm.tcp - WARNING - Listener on 'tls://0.0.0.0:44297': TLS handshake failed with remote 'tls://127.0.0.1:40494': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1000) 5985s 2024-11-23 21:56:26,642 - distributed._signals - INFO - Received signal SIGINT (2) 5985s 2024-11-23 21:56:26,642 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:35589'. Reason: signal-2 5985s 2024-11-23 21:56:26,753 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42763 5985s 2024-11-23 21:56:26,753 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42763 5985s 2024-11-23 21:56:26,753 - distributed.worker - INFO - dashboard at: 127.0.0.1:45375 5985s 2024-11-23 21:56:26,754 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44297 5985s 2024-11-23 21:56:26,754 - distributed.worker - INFO - ------------------------------------------------- 5985s 2024-11-23 21:56:26,754 - distributed.worker - INFO - Threads: 8 5985s 2024-11-23 21:56:26,754 - distributed.worker - INFO - Memory: 15.58 GiB 5985s 2024-11-23 21:56:26,754 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-x6s3jd10 5985s 2024-11-23 21:56:26,754 - distributed.worker - INFO - ------------------------------------------------- 5985s 2024-11-23 21:56:27,010 - distributed.scheduler - INFO - Register worker 5985s 2024-11-23 21:56:27,264 - distributed.scheduler - INFO - Starting worker compute stream, tls://127.0.0.1:42763 5985s 2024-11-23 21:56:27,264 - distributed.core - INFO - Starting established connection to tls://127.0.0.1:40510 5985s 2024-11-23 21:56:27,264 - distributed.worker - INFO - Starting Worker plugin shuffle 5985s 2024-11-23 21:56:27,265 - distributed.worker - INFO - Registered to: tls://127.0.0.1:44297 5985s 2024-11-23 21:56:27,265 - distributed.worker - INFO - ------------------------------------------------- 5985s 2024-11-23 21:56:27,266 - distributed.core - INFO - Starting established connection to tls://127.0.0.1:44297 5985s 2024-11-23 21:56:27,273 - distributed.nanny - INFO - Nanny asking worker to close. Reason: signal-2 5985s 2024-11-23 21:56:27,274 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42763. Reason: signal-2 5985s 2024-11-23 21:56:27,276 - distributed.core - INFO - Received 'close-stream' from tls://127.0.0.1:40510; closing. 5985s 2024-11-23 21:56:27,276 - distributed.core - INFO - Connection to tls://127.0.0.1:44297 has been closed. 5985s 2024-11-23 21:56:27,276 - distributed.scheduler - INFO - Remove worker (stimulus_id='handle-worker-cleanup-1732398987.2765648') 5985s 2024-11-23 21:56:27,276 - distributed.scheduler - INFO - Lost all workers 5985s 2024-11-23 21:56:27,278 - distributed.nanny - INFO - Worker closed 5985s 2024-11-23 21:56:27,469 - distributed.dask_worker - INFO - End worker 5985s 2024-11-23 21:56:27,608 - distributed._signals - INFO - Received signal SIGINT (2) 5985s 2024-11-23 21:56:27,608 - distributed.scheduler - INFO - Scheduler closing due to signal-2... 5985s 2024-11-23 21:56:27,608 - distributed.scheduler - INFO - Scheduler closing all comms 5985s 2024-11-23 21:56:27,609 - distributed.scheduler - INFO - Stopped scheduler at 'tls://10.0.4.73:44297' 5985s 2024-11-23 21:56:27,609 - distributed.scheduler - INFO - End scheduler 5985s _____________________________ test_use_config_file _____________________________ 5985s 5985s self = 5985s address = '127.0.0.1:38975', deserialize = True 5985s connection_args = {'extra_conn_args': {}, 'require_encryption': False, 'ssl_context': } 5985s ip = '127.0.0.1', port = 38975 5985s kwargs = {'ssl_options': } 5985s 5985s async def connect(self, address, deserialize=True, **connection_args): 5985s self._check_encryption(address, connection_args) 5985s ip, port = parse_host_port(address) 5985s kwargs = self._get_connect_args(**connection_args) 5985s 5985s try: 5985s # server_hostname option (for SNI) only works with tornado.iostream.IOStream 5985s if "server_hostname" in kwargs: 5985s stream = await self.client.connect( 5985s ip, port, max_buffer_size=MAX_BUFFER_SIZE 5985s ) 5985s stream = await stream.start_tls(False, **kwargs) 5985s else: 5985s > stream = await self.client.connect( 5985s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5985s ) 5985s 5985s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:546: 5985s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5985s /usr/lib/python3/dist-packages/tornado/tcpclient.py:292: in connect 5985s stream = await stream.start_tls( 5985s /usr/lib/python3/dist-packages/tornado/iostream.py:1367: in _do_ssl_handshake 5985s self.socket.do_handshake() 5985s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5985s 5985s self = , block = False 5985s 5985s @_sslcopydoc 5985s def do_handshake(self, block=False): 5985s self._check_connected() 5985s timeout = self.gettimeout() 5985s try: 5985s if timeout == 0.0 and block: 5985s self.settimeout(None) 5985s > self._sslobj.do_handshake() 5985s E ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 5985s 5985s /usr/lib/python3.13/ssl.py:1372: SSLCertVerificationError 5985s 5985s The above exception was the direct cause of the following exception: 5985s 5985s loop = 5985s 5985s def test_use_config_file(loop): 5985s port = open_port() 5985s with new_config_file(tls_only_config()): 5985s with popen( 5985s [ 5985s "dask", 5985s "scheduler", 5985s "--no-dashboard", 5985s "--host", 5985s "tls://", 5985s "--port", 5985s str(port), 5985s ] 5985s ) as s: 5985s with popen( 5985s ["dask", "worker", "--no-dashboard", f"tls://127.0.0.1:{port}"] 5985s ) as w: 5985s > with Client( 5985s f"tls://127.0.0.1:{port}", loop=loop, security=tls_security() 5985s ) as c: 5985s 5985s /usr/lib/python3/dist-packages/distributed/cli/tests/test_tls_cli.py:122: 5985s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5985s /usr/lib/python3/dist-packages/distributed/client.py:1018: in __init__ 5985s self.start(timeout=timeout) 5985s /usr/lib/python3/dist-packages/distributed/client.py:1220: in start 5985s sync(self.loop, self._start, **kwargs) 5985s /usr/lib/python3/dist-packages/distributed/utils.py:438: in sync 5985s raise error 5985s /usr/lib/python3/dist-packages/distributed/utils.py:412: in f 5985s result = yield future 5985s /usr/lib/python3/dist-packages/tornado/gen.py:766: in run 5985s value = future.result() 5985s /usr/lib/python3/dist-packages/distributed/client.py:1299: in _start 5985s await self._ensure_connected(timeout=timeout) 5985s /usr/lib/python3/dist-packages/distributed/client.py:1361: in _ensure_connected 5985s comm = await connect( 5985s /usr/lib/python3/dist-packages/distributed/comm/core.py:342: in connect 5985s comm = await wait_for( 5985s /usr/lib/python3/dist-packages/distributed/utils.py:1960: in wait_for 5985s return await fut 5985s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5985s 5985s self = 5985s address = '127.0.0.1:38975', deserialize = True 5985s connection_args = {'extra_conn_args': {}, 'require_encryption': False, 'ssl_context': } 5985s ip = '127.0.0.1', port = 38975 5985s kwargs = {'ssl_options': } 5985s 5985s async def connect(self, address, deserialize=True, **connection_args): 5985s self._check_encryption(address, connection_args) 5985s ip, port = parse_host_port(address) 5985s kwargs = self._get_connect_args(**connection_args) 5985s 5985s try: 5985s # server_hostname option (for SNI) only works with tornado.iostream.IOStream 5985s if "server_hostname" in kwargs: 5985s stream = await self.client.connect( 5985s ip, port, max_buffer_size=MAX_BUFFER_SIZE 5985s ) 5985s stream = await stream.start_tls(False, **kwargs) 5985s else: 5985s stream = await self.client.connect( 5985s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5985s ) 5985s 5985s # Under certain circumstances tornado will have a closed connection with an 5985s # error and not raise a StreamClosedError. 5985s # 5985s # This occurs with tornado 5.x and openssl 1.1+ 5985s if stream.closed() and stream.error: 5985s raise StreamClosedError(stream.error) 5985s 5985s except StreamClosedError as e: 5985s # The socket connect() call failed 5985s convert_stream_closed_error(self, e) 5985s except SSLCertVerificationError as err: 5985s > raise FatalCommClosedError( 5985s "TLS certificate does not match. Check your security settings. " 5985s "More info at https://distributed.dask.org/en/latest/tls.html" 5985s ) from err 5985s E distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 5985s 5985s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:561: FatalCommClosedError 5985s ----------------------------- Captured stderr call ----------------------------- 5985s 2024-11-23 21:56:28,619 - distributed.scheduler - INFO - ----------------------------------------------- 5985s 2024-11-23 21:56:28,638 - distributed.http.proxy - INFO - To route to workers diagnostics web server please install jupyter-server-proxy: python -m pip install jupyter-server-proxy 5985s 2024-11-23 21:56:28,640 - distributed.scheduler - INFO - State start 5985s 2024-11-23 21:56:28,646 - distributed.scheduler - INFO - ----------------------------------------------- 5985s 2024-11-23 21:56:28,647 - distributed.scheduler - INFO - Scheduler at: tls://10.0.4.73:38975 5985s 2024-11-23 21:56:28,648 - distributed.scheduler - INFO - dashboard at: http://10.0.4.73:8787/status 5985s 2024-11-23 21:56:28,648 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5985s 2024-11-23 21:56:28,662 - distributed.nanny - INFO - Start Nanny at: 'tls://127.0.0.1:44587' 5985s 2024-11-23 21:56:29,217 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35943 5985s 2024-11-23 21:56:29,218 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35943 5985s 2024-11-23 21:56:29,218 - distributed.worker - INFO - dashboard at: 127.0.0.1:35961 5985s 2024-11-23 21:56:29,218 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38975 5985s 2024-11-23 21:56:29,218 - distributed.worker - INFO - ------------------------------------------------- 5985s 2024-11-23 21:56:29,218 - distributed.worker - INFO - Threads: 8 5985s 2024-11-23 21:56:29,218 - distributed.worker - INFO - Memory: 15.58 GiB 5985s 2024-11-23 21:56:29,218 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-4o8zujcg 5985s 2024-11-23 21:56:29,218 - distributed.worker - INFO - ------------------------------------------------- 5985s 2024-11-23 21:56:29,512 - distributed.scheduler - INFO - Register worker 5985s 2024-11-23 21:56:29,783 - distributed.scheduler - INFO - Starting worker compute stream, tls://127.0.0.1:35943 5985s 2024-11-23 21:56:29,783 - distributed.core - INFO - Starting established connection to tls://127.0.0.1:45934 5985s 2024-11-23 21:56:29,783 - distributed.worker - INFO - Starting Worker plugin shuffle 5985s 2024-11-23 21:56:29,784 - distributed.worker - INFO - Registered to: tls://127.0.0.1:38975 5985s 2024-11-23 21:56:29,784 - distributed.worker - INFO - ------------------------------------------------- 5985s 2024-11-23 21:56:29,786 - distributed.core - INFO - Starting established connection to tls://127.0.0.1:38975 5985s 2024-11-23 21:56:29,792 - distributed.comm.tcp - WARNING - Listener on 'tls://0.0.0.0:38975': TLS handshake failed with remote 'tls://127.0.0.1:45936': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1000) 5985s 2024-11-23 21:56:29,792 - distributed._signals - INFO - Received signal SIGINT (2) 5985s 2024-11-23 21:56:29,792 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:44587'. Reason: signal-2 5985s 2024-11-23 21:56:29,825 - distributed.nanny - INFO - Nanny asking worker to close. Reason: signal-2 5985s 2024-11-23 21:56:29,826 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35943. Reason: signal-2 5985s 2024-11-23 21:56:29,827 - distributed.core - INFO - Received 'close-stream' from tls://127.0.0.1:45934; closing. 5985s 2024-11-23 21:56:29,827 - distributed.core - INFO - Connection to tls://127.0.0.1:38975 has been closed. 5985s 2024-11-23 21:56:29,827 - distributed.scheduler - INFO - Remove worker (stimulus_id='handle-worker-cleanup-1732398989.8279312') 5985s 2024-11-23 21:56:29,828 - distributed.scheduler - INFO - Lost all workers 5985s 2024-11-23 21:56:29,829 - distributed.nanny - INFO - Worker closed 5985s 2024-11-23 21:56:30,022 - distributed.dask_worker - INFO - End worker 5985s 2024-11-23 21:56:30,157 - distributed._signals - INFO - Received signal SIGINT (2) 5985s 2024-11-23 21:56:30,157 - distributed.scheduler - INFO - Scheduler closing due to signal-2... 5985s 2024-11-23 21:56:30,157 - distributed.scheduler - INFO - Scheduler closing all comms 5985s 2024-11-23 21:56:30,158 - distributed.scheduler - INFO - Stopped scheduler at 'tls://10.0.4.73:38975' 5985s 2024-11-23 21:56:30,158 - distributed.scheduler - INFO - End scheduler 5985s __________________________________ test_basic __________________________________ 5985s 5985s @pytest.mark.skipif(WINDOWS, reason="distributed#7434") 5985s @gen_test() 5985s async def test_basic(): 5985s async with SubprocessCluster( 5985s asynchronous=True, 5985s dashboard_address=":0", 5985s scheduler_kwargs={"idle_timeout": "5s"}, 5985s worker_kwargs={"death_timeout": "5s"}, 5985s ) as cluster: 5985s async with Client(cluster, asynchronous=True) as client: 5985s > result = await client.submit(lambda x: x + 1, 10) 5985s 5985s /usr/lib/python3/dist-packages/distributed/deploy/tests/test_subprocess.py:27: 5985s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5985s 5985s self = 5985s raiseit = True 5985s 5985s async def _result(self, raiseit=True): 5985s await self._state.wait() 5985s if self.status == "error": 5985s exc = clean_exception(self._state.exception, self._state.traceback) 5985s if raiseit: 5985s typ, exc, tb = exc 5985s > raise exc.with_traceback(tb) 5985s E SystemError: no locals found when setting up annotations 5985s 5985s /usr/lib/python3/dist-packages/distributed/client.py:337: SystemError 5985s ----------------------------- Captured stderr call ----------------------------- 5985s 2024-11-23 21:56:32,618 - distributed.worker - WARNING - Compute Failed 5985s Key: lambda-f3b41d234e8d3805a39c193d3564145c 5985s Function: lambda 5985s args: (10) 5985s kwargs: {} 5985s Exception: "SystemError('no locals found when setting up annotations')" 5985s 5985s ________________________________ test_n_workers ________________________________ 5985s 5985s @pytest.mark.skipif(WINDOWS, reason="distributed#7434") 5985s @gen_test() 5985s async def test_n_workers(): 5985s async with SubprocessCluster( 5985s asynchronous=True, dashboard_address=":0", n_workers=2 5985s ) as cluster: 5985s async with Client(cluster, asynchronous=True) as client: 5985s assert len(cluster.workers) == 2 5985s > result = await client.submit(lambda x: x + 1, 10) 5985s 5985s /usr/lib/python3/dist-packages/distributed/deploy/tests/test_subprocess.py:41: 5985s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5985s 5985s self = 5985s raiseit = True 5985s 5985s async def _result(self, raiseit=True): 5985s await self._state.wait() 5985s if self.status == "error": 5985s exc = clean_exception(self._state.exception, self._state.traceback) 5985s if raiseit: 5985s typ, exc, tb = exc 5985s > raise exc.with_traceback(tb) 5985s E SystemError: no locals found when setting up annotations 5985s 5985s /usr/lib/python3/dist-packages/distributed/client.py:337: SystemError 5985s ----------------------------- Captured stderr call ----------------------------- 5985s 2024-11-23 21:56:34,648 - distributed.worker - WARNING - Compute Failed 5985s Key: lambda-181b28c0c705f6e48fbf22b0c3a995c6 5985s Function: lambda 5985s args: (10) 5985s kwargs: {} 5985s Exception: "SystemError('no locals found when setting up annotations')" 5985s 5985s _____________________________ test_upload_file_zip _____________________________ 5985s 5985s c = 5985s s = 5985s a = 5985s b = 5985s 5985s @gen_cluster(client=True) 5985s async def test_upload_file_zip(c, s, a, b): 5985s def g(): 5985s import myfile 5985s 5985s return myfile.f() 5985s 5985s with save_sys_modules(): 5985s try: 5985s for value in [123, 456]: 5985s with tmp_text( 5985s "myfile.py", f"def f():\n return {value}" 5985s ) as fn_my_file: 5985s with zipfile.ZipFile("myfile.zip", "w") as z: 5985s z.write(fn_my_file, arcname=os.path.basename(fn_my_file)) 5985s > await c.upload_file("myfile.zip") 5985s 5985s /usr/lib/python3/dist-packages/distributed/tests/test_client.py:1716: 5985s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5985s /usr/lib/python3/dist-packages/distributed/client.py:3824: in _ 5985s results = await asyncio.gather( 5985s /usr/lib/python3/dist-packages/distributed/client.py:4939: in _register_scheduler_plugin 5985s return await self.scheduler.register_scheduler_plugin( 5985s /usr/lib/python3/dist-packages/distributed/core.py:1395: in send_recv_from_rpc 5985s return await send_recv(comm=comm, op=key, **kwargs) 5985s /usr/lib/python3/dist-packages/distributed/core.py:1179: in send_recv 5985s raise exc.with_traceback(tb) 5985s /usr/lib/python3/dist-packages/distributed/core.py:970: in _handle_comm 5985s result = await result 5985s /usr/lib/python3/dist-packages/distributed/scheduler.py:6035: in register_scheduler_plugin 5985s await result 5985s /usr/lib/python3/dist-packages/distributed/diagnostics/plugin.py:396: in start 5985s await scheduler.upload_file(self.filename, self.data, load=self.load) 5985s /usr/lib/python3/dist-packages/distributed/core.py:563: in upload_file 5985s raise e 5985s /usr/lib/python3/dist-packages/distributed/core.py:560: in upload_file 5985s import_file(out_filename) 5985s /usr/lib/python3/dist-packages/distributed/utils.py:1162: in import_file 5985s names_to_import.extend(names) 5985s /usr/lib/python3/dist-packages/distributed/utils.py:1161: in 5985s names = (mod_info.name for mod_info in pkgutil.iter_modules([path])) 5985s /usr/lib/python3.13/pkgutil.py:116: in iter_modules 5985s for name, ispkg in iter_importer_modules(i, prefix): 5985s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5985s 5985s """Utilities to support packages.""" 5985s 5985s from collections import namedtuple 5985s from functools import singledispatch as simplegeneric 5985s import importlib 5985s import importlib.util 5985s import importlib.machinery 5985s import os 5985s import os.path 5985s import sys 5985s from types import ModuleType 5985s import warnings 5985s 5985s __all__ = [ 5985s 'get_importer', 'iter_importers', 'get_loader', 'find_loader', 5985s 'walk_packages', 'iter_modules', 'get_data', 5985s 'read_code', 'extend_path', 5985s 'ModuleInfo', 5985s ] 5985s 5985s 5985s ModuleInfo = namedtuple('ModuleInfo', 'module_finder name ispkg') 5985s ModuleInfo.__doc__ = 'A namedtuple with minimal info about a module.' 5985s 5985s 5985s def read_code(stream): 5985s # This helper is needed in order for the PEP 302 emulation to 5985s # correctly handle compiled files 5985s import marshal 5985s 5985s magic = stream.read(4) 5985s if magic != importlib.util.MAGIC_NUMBER: 5985s return None 5985s 5985s stream.read(12) # Skip rest of the header 5985s return marshal.load(stream) 5985s 5985s 5985s def walk_packages(path=None, prefix='', onerror=None): 5985s """Yields ModuleInfo for all modules recursively 5985s on path, or, if path is None, all accessible modules. 5985s 5985s 'path' should be either None or a list of paths to look for 5985s modules in. 5985s 5985s 'prefix' is a string to output on the front of every module name 5985s on output. 5985s 5985s Note that this function must import all *packages* (NOT all 5985s modules!) on the given path, in order to access the __path__ 5985s attribute to find submodules. 5985s 5985s 'onerror' is a function which gets called with one argument (the 5985s name of the package which was being imported) if any exception 5985s occurs while trying to import a package. If no onerror function is 5985s supplied, ImportErrors are caught and ignored, while all other 5985s exceptions are propagated, terminating the search. 5985s 5985s Examples: 5985s 5985s # list all modules python can access 5985s walk_packages() 5985s 5985s # list all submodules of ctypes 5985s walk_packages(ctypes.__path__, ctypes.__name__+'.') 5985s """ 5985s 5985s def seen(p, m={}): 5985s if p in m: 5985s return True 5985s m[p] = True 5985s 5985s for info in iter_modules(path, prefix): 5985s yield info 5985s 5985s if info.ispkg: 5985s try: 5985s __import__(info.name) 5985s except ImportError: 5985s if onerror is not None: 5985s onerror(info.name) 5985s except Exception: 5985s if onerror is not None: 5985s onerror(info.name) 5985s else: 5985s raise 5985s else: 5985s path = getattr(sys.modules[info.name], '__path__', None) or [] 5985s 5985s # don't traverse path items we've seen before 5985s path = [p for p in path if not seen(p)] 5985s 5985s yield from walk_packages(path, info.name+'.', onerror) 5985s 5985s 5985s def iter_modules(path=None, prefix=''): 5985s """Yields ModuleInfo for all submodules on path, 5985s or, if path is None, all top-level modules on sys.path. 5985s 5985s 'path' should be either None or a list of paths to look for 5985s modules in. 5985s 5985s 'prefix' is a string to output on the front of every module name 5985s on output. 5985s """ 5985s if path is None: 5985s importers = iter_importers() 5985s elif isinstance(path, str): 5985s raise ValueError("path must be None or list of paths to look for " 5985s "modules in") 5985s else: 5985s importers = map(get_importer, path) 5985s 5985s yielded = {} 5985s for i in importers: 5985s for name, ispkg in iter_importer_modules(i, prefix): 5985s if name not in yielded: 5985s yielded[name] = 1 5985s yield ModuleInfo(i, name, ispkg) 5985s 5985s 5985s @simplegeneric 5985s def iter_importer_modules(importer, prefix=''): 5985s if not hasattr(importer, 'iter_modules'): 5985s return [] 5985s return importer.iter_modules(prefix) 5985s 5985s 5985s # Implement a file walker for the normal importlib path hook 5985s def _iter_file_finder_modules(importer, prefix=''): 5985s if importer.path is None or not os.path.isdir(importer.path): 5985s return 5985s 5985s yielded = {} 5985s import inspect 5985s try: 5985s filenames = os.listdir(importer.path) 5985s except OSError: 5985s # ignore unreadable directories like import does 5985s filenames = [] 5985s filenames.sort() # handle packages before same-named modules 5985s 5985s for fn in filenames: 5985s modname = inspect.getmodulename(fn) 5985s if modname=='__init__' or modname in yielded: 5985s continue 5985s 5985s path = os.path.join(importer.path, fn) 5985s ispkg = False 5985s 5985s if not modname and os.path.isdir(path) and '.' not in fn: 5985s modname = fn 5985s try: 5985s dircontents = os.listdir(path) 5985s except OSError: 5985s # ignore unreadable directories like import does 5985s dircontents = [] 5985s for fn in dircontents: 5985s subname = inspect.getmodulename(fn) 5985s if subname=='__init__': 5985s ispkg = True 5985s break 5985s else: 5985s continue # not a package 5985s 5985s if modname and '.' not in modname: 5985s yielded[modname] = 1 5985s yield prefix + modname, ispkg 5985s 5985s iter_importer_modules.register( 5985s importlib.machinery.FileFinder, _iter_file_finder_modules) 5985s 5985s 5985s try: 5985s import zipimport 5985s from zipimport import zipimporter 5985s 5985s def iter_zipimport_modules(importer, prefix=''): 5985s > dirlist = sorted(zipimport._zip_directory_cache[importer.archive]) 5985s E KeyError: '/tmp/dask-scratch-space/scheduler-u2xnb8z2/myfile.zip' 5985s 5985s /usr/lib/python3.13/pkgutil.py:179: KeyError 5985s ----------------------------- Captured stdout call ----------------------------- 5985s Dumped cluster state to test_cluster_dump/test_upload_file_zip.yaml 5985s ----------------------------- Captured stderr call ----------------------------- 5985s 2024-11-23 21:56:34,779 - distributed.http.proxy - INFO - To route to workers diagnostics web server please install jupyter-server-proxy: python -m pip install jupyter-server-proxy 5985s 2024-11-23 21:56:34,782 - distributed.scheduler - INFO - State start 5985s 2024-11-23 21:56:34,783 - distributed.diskutils - INFO - Found stale lock file and directory '/tmp/dask-scratch-space/worker-qpjqdtj6', purging 5985s 2024-11-23 21:56:34,783 - distributed.diskutils - INFO - Found stale lock file and directory '/tmp/dask-scratch-space/worker-skzbz7qb', purging 5985s 2024-11-23 21:56:34,789 - distributed.scheduler - INFO - Scheduler at: tcp://127.0.0.1:43199 5985s 2024-11-23 21:56:34,789 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35295/status 5985s 2024-11-23 21:56:34,789 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5985s 2024-11-23 21:56:34,800 - distributed.worker - INFO - Start worker at: tcp://127.0.0.1:45687 5985s 2024-11-23 21:56:34,800 - distributed.worker - INFO - Listening to: tcp://127.0.0.1:45687 5985s 2024-11-23 21:56:34,800 - distributed.worker - INFO - Worker name: 0 5985s 2024-11-23 21:56:34,800 - distributed.worker - INFO - dashboard at: 127.0.0.1:38699 5985s 2024-11-23 21:56:34,800 - distributed.worker - INFO - Waiting to connect to: tcp://127.0.0.1:43199 5985s 2024-11-23 21:56:34,800 - distributed.worker - INFO - ------------------------------------------------- 5985s 2024-11-23 21:56:34,800 - distributed.worker - INFO - Threads: 1 5985s 2024-11-23 21:56:34,800 - distributed.worker - INFO - Memory: 15.58 GiB 5985s 2024-11-23 21:56:34,800 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-3uz71ohl 5985s 2024-11-23 21:56:34,800 - distributed.worker - INFO - ------------------------------------------------- 5985s 2024-11-23 21:56:34,801 - distributed.worker - INFO - Start worker at: tcp://127.0.0.1:35417 5985s 2024-11-23 21:56:34,801 - distributed.worker - INFO - Listening to: tcp://127.0.0.1:35417 5985s 2024-11-23 21:56:34,801 - distributed.worker - INFO - Worker name: 1 5985s 2024-11-23 21:56:34,802 - distributed.worker - INFO - dashboard at: 127.0.0.1:33157 5985s 2024-11-23 21:56:34,802 - distributed.worker - INFO - Waiting to connect to: tcp://127.0.0.1:43199 5985s 2024-11-23 21:56:34,802 - distributed.worker - INFO - ------------------------------------------------- 5985s 2024-11-23 21:56:34,802 - distributed.worker - INFO - Threads: 2 5985s 2024-11-23 21:56:34,802 - distributed.worker - INFO - Memory: 15.58 GiB 5985s 2024-11-23 21:56:34,802 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-99gssipg 5985s 2024-11-23 21:56:34,802 - distributed.worker - INFO - ------------------------------------------------- 5985s 2024-11-23 21:56:34,805 - distributed.scheduler - INFO - Register worker 5985s 2024-11-23 21:56:34,806 - distributed.scheduler - INFO - Starting worker compute stream, tcp://127.0.0.1:45687 5985s 2024-11-23 21:56:34,806 - distributed.core - INFO - Starting established connection to tcp://127.0.0.1:54534 5985s 2024-11-23 21:56:34,807 - distributed.scheduler - INFO - Register worker 5985s 2024-11-23 21:56:34,807 - distributed.scheduler - INFO - Starting worker compute stream, tcp://127.0.0.1:35417 5985s 2024-11-23 21:56:34,807 - distributed.core - INFO - Starting established connection to tcp://127.0.0.1:54536 5985s 2024-11-23 21:56:34,808 - distributed.worker - INFO - Starting Worker plugin shuffle 5985s 2024-11-23 21:56:34,808 - distributed.worker - INFO - Starting Worker plugin shuffle 5985s 2024-11-23 21:56:34,809 - distributed.worker - INFO - Registered to: tcp://127.0.0.1:43199 5985s 2024-11-23 21:56:34,809 - distributed.worker - INFO - ------------------------------------------------- 5985s 2024-11-23 21:56:34,809 - distributed.worker - INFO - Registered to: tcp://127.0.0.1:43199 5985s 2024-11-23 21:56:34,809 - distributed.worker - INFO - ------------------------------------------------- 5985s 2024-11-23 21:56:34,809 - distributed.core - INFO - Starting established connection to tcp://127.0.0.1:43199 5985s 2024-11-23 21:56:34,809 - distributed.core - INFO - Starting established connection to tcp://127.0.0.1:43199 5985s 2024-11-23 21:56:34,813 - distributed.scheduler - INFO - Receive client connection: Client-ce742e44-a9e5-11ef-bc9b-00163e4db70f 5985s 2024-11-23 21:56:34,814 - distributed.core - INFO - Starting established connection to tcp://127.0.0.1:54550 5985s 2024-11-23 21:56:34,819 - distributed.utils - INFO - Reload module myfile from .zip file 5985s 2024-11-23 21:56:34,821 - distributed.scheduler - INFO - Registering Worker plugin myfile.zipe5215bf6-f0a0-4961-9d47-75a461fe1452 5985s 2024-11-23 21:56:34,823 - distributed.worker - INFO - Starting Worker plugin myfile.zipe5215bf6-f0a0-4961-9d47-75a461fe1452 5985s 2024-11-23 21:56:34,824 - distributed.utils - INFO - Reload module myfile from .zip file 5985s 2024-11-23 21:56:34,825 - distributed.worker - INFO - Starting Worker plugin myfile.zipe5215bf6-f0a0-4961-9d47-75a461fe1452 5985s 2024-11-23 21:56:34,827 - distributed.utils - INFO - Reload module myfile from .zip file 5985s 2024-11-23 21:56:34,840 - distributed.core - ERROR - '/tmp/dask-scratch-space/scheduler-u2xnb8z2/myfile.zip' 5985s Traceback (most recent call last): 5985s File "/usr/lib/python3/dist-packages/distributed/core.py", line 560, in upload_file 5985s import_file(out_filename) 5985s ~~~~~~~~~~~^^^^^^^^^^^^^^ 5985s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1162, in import_file 5985s names_to_import.extend(names) 5985s ~~~~~~~~~~~~~~~~~~~~~~^^^^^^^ 5985s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1161, in 5985s names = (mod_info.name for mod_info in pkgutil.iter_modules([path])) 5985s ~~~~~~~~~~~~~~~~~~~~^^^^^^^^ 5985s File "/usr/lib/python3.13/pkgutil.py", line 116, in iter_modules 5985s for name, ispkg in iter_importer_modules(i, prefix): 5985s ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^ 5985s File "/usr/lib/python3.13/pkgutil.py", line 179, in iter_zipimport_modules 5985s dirlist = sorted(zipimport._zip_directory_cache[importer.archive]) 5985s ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^ 5985s KeyError: '/tmp/dask-scratch-space/scheduler-u2xnb8z2/myfile.zip' 5985s 2024-11-23 21:56:34,842 - distributed.core - ERROR - Exception while handling op register_scheduler_plugin 5985s Traceback (most recent call last): 5985s File "/usr/lib/python3/dist-packages/distributed/core.py", line 970, in _handle_comm 5985s result = await result 5985s ^^^^^^^^^^^^ 5985s File "/usr/lib/python3/dist-packages/distributed/scheduler.py", line 6035, in register_scheduler_plugin 5985s await result 5985s File "/usr/lib/python3/dist-packages/distributed/diagnostics/plugin.py", line 396, in start 5985s await scheduler.upload_file(self.filename, self.data, load=self.load) 5985s File "/usr/lib/python3/dist-packages/distributed/core.py", line 563, in upload_file 5985s raise e 5985s File "/usr/lib/python3/dist-packages/distributed/core.py", line 560, in upload_file 5985s import_file(out_filename) 5985s ~~~~~~~~~~~^^^^^^^^^^^^^^ 5985s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1162, in import_file 5985s names_to_import.extend(names) 5985s ~~~~~~~~~~~~~~~~~~~~~~^^^^^^^ 5985s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1161, in 5985s names = (mod_info.name for mod_info in pkgutil.iter_modules([path])) 5985s ~~~~~~~~~~~~~~~~~~~~^^^^^^^^ 5985s File "/usr/lib/python3.13/pkgutil.py", line 116, in iter_modules 5985s for name, ispkg in iter_importer_modules(i, prefix): 5985s ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^ 5985s File "/usr/lib/python3.13/pkgutil.py", line 179, in iter_zipimport_modules 5985s dirlist = sorted(zipimport._zip_directory_cache[importer.archive]) 5985s ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^ 5985s KeyError: '/tmp/dask-scratch-space/scheduler-u2xnb8z2/myfile.zip' 5985s 2024-11-23 21:56:34,849 - distributed.scheduler - INFO - Registering Worker plugin myfile.zip0e6134f5-c6c5-4d1c-8847-eff2e6372374 5985s 2024-11-23 21:56:34,851 - distributed.worker - INFO - Starting Worker plugin myfile.zip0e6134f5-c6c5-4d1c-8847-eff2e6372374 5985s 2024-11-23 21:56:34,853 - distributed.core - ERROR - '/tmp/dask-scratch-space/worker-99gssipg/myfile.zip' 5985s Traceback (most recent call last): 5985s File "/usr/lib/python3/dist-packages/distributed/core.py", line 560, in upload_file 5985s import_file(out_filename) 5985s ~~~~~~~~~~~^^^^^^^^^^^^^^ 5985s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1162, in import_file 5985s names_to_import.extend(names) 5985s ~~~~~~~~~~~~~~~~~~~~~~^^^^^^^ 5985s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1161, in 5985s names = (mod_info.name for mod_info in pkgutil.iter_modules([path])) 5985s ~~~~~~~~~~~~~~~~~~~~^^^^^^^^ 5985s File "/usr/lib/python3.13/pkgutil.py", line 116, in iter_modules 5985s for name, ispkg in iter_importer_modules(i, prefix): 5985s ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^ 5985s File "/usr/lib/python3.13/pkgutil.py", line 179, in iter_zipimport_modules 5985s dirlist = sorted(zipimport._zip_directory_cache[importer.archive]) 5985s ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^ 5985s KeyError: '/tmp/dask-scratch-space/worker-99gssipg/myfile.zip' 5985s 2024-11-23 21:56:34,920 - distributed.worker - INFO - Starting Worker plugin myfile.zip0e6134f5-c6c5-4d1c-8847-eff2e6372374 5985s 2024-11-23 21:56:34,922 - distributed.utils - INFO - Reload module myfile from .zip file 5985s 2024-11-23 21:56:34,924 - distributed.scheduler - INFO - Remove client Client-ce742e44-a9e5-11ef-bc9b-00163e4db70f 5985s 2024-11-23 21:56:34,924 - distributed.core - INFO - Received 'close-stream' from tcp://127.0.0.1:54550; closing. 5985s 2024-11-23 21:56:34,924 - distributed.scheduler - INFO - Remove client Client-ce742e44-a9e5-11ef-bc9b-00163e4db70f 5985s 2024-11-23 21:56:34,926 - distributed.scheduler - INFO - Close client connection: Client-ce742e44-a9e5-11ef-bc9b-00163e4db70f 5985s 2024-11-23 21:56:34,927 - distributed.worker - INFO - Stopping worker at tcp://127.0.0.1:45687. Reason: worker-close 5985s 2024-11-23 21:56:34,927 - distributed.worker - INFO - Stopping worker at tcp://127.0.0.1:35417. Reason: worker-close 5985s 2024-11-23 21:56:34,929 - distributed.core - INFO - Connection to tcp://127.0.0.1:43199 has been closed. 5985s 2024-11-23 21:56:34,930 - distributed.core - INFO - Connection to tcp://127.0.0.1:43199 has been closed. 5985s 2024-11-23 21:56:34,931 - distributed.core - INFO - Received 'close-stream' from tcp://127.0.0.1:54534; closing. 5985s 2024-11-23 21:56:34,931 - distributed.core - INFO - Received 'close-stream' from tcp://127.0.0.1:54536; closing. 5985s 2024-11-23 21:56:34,931 - distributed.scheduler - INFO - Remove worker (stimulus_id='handle-worker-cleanup-1732398994.9315512') 5985s 2024-11-23 21:56:34,931 - distributed.scheduler - INFO - Remove worker (stimulus_id='handle-worker-cleanup-1732398994.931894') 5985s 2024-11-23 21:56:34,932 - distributed.scheduler - INFO - Lost all workers 5985s 2024-11-23 21:56:34,934 - distributed.scheduler - INFO - Scheduler closing due to unknown reason... 5985s 2024-11-23 21:56:34,934 - distributed.scheduler - INFO - Scheduler closing all comms 5985s ________________________ test_info_frame_f_lineno[22-4] ________________________ 5985s 5985s f_lasti = 22, f_lineno = 4 5985s 5985s @pytest.mark.parametrize( 5985s "f_lasti,f_lineno", 5985s [ 5985s (-1, 1), 5985s (0, 2), 5985s (1, 2), 5985s (11, 2), 5985s (12, 3), 5985s (21, 4), 5985s (22, 4), 5985s (23, 4), 5985s (24, 2), 5985s (25, 2), 5985s (26, 2), 5985s (27, 2), 5985s (100, 2), 5985s ], 5985s ) 5985s def test_info_frame_f_lineno(f_lasti: int, f_lineno: int) -> None: 5985s > assert info_frame(FakeFrame(f_lasti=f_lasti, f_code=FAKE_CODE)) == { # type: ignore 5985s "filename": "", 5985s "name": "example", 5985s "line_number": f_lineno, 5985s "line": "", 5985s } 5985s 5985s /usr/lib/python3/dist-packages/distributed/tests/test_profile.py:327: 5985s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5985s /usr/lib/python3/dist-packages/distributed/profile.py:115: in info_frame 5985s line = linecache.getline(co.co_filename, f_lineno, frame.f_globals).lstrip() 5985s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5985s 5985s filename = '', lineno = None, module_globals = {} 5985s 5985s def getline(filename, lineno, module_globals=None): 5985s """Get a line for a Python source file from the cache. 5985s Update the cache if it doesn't contain an entry for this file already.""" 5985s 5985s lines = getlines(filename, module_globals) 5985s > if 1 <= lineno <= len(lines): 5985s E TypeError: '<=' not supported between instances of 'int' and 'NoneType' 5985s 5985s /usr/lib/python3.13/linecache.py:26: TypeError 5985s ________________________ test_info_frame_f_lineno[23-4] ________________________ 5985s 5985s f_lasti = 23, f_lineno = 4 5985s 5985s @pytest.mark.parametrize( 5985s "f_lasti,f_lineno", 5985s [ 5985s (-1, 1), 5985s (0, 2), 5985s (1, 2), 5985s (11, 2), 5985s (12, 3), 5985s (21, 4), 5985s (22, 4), 5985s (23, 4), 5985s (24, 2), 5985s (25, 2), 5985s (26, 2), 5985s (27, 2), 5985s (100, 2), 5985s ], 5985s ) 5985s def test_info_frame_f_lineno(f_lasti: int, f_lineno: int) -> None: 5985s > assert info_frame(FakeFrame(f_lasti=f_lasti, f_code=FAKE_CODE)) == { # type: ignore 5985s "filename": "", 5985s "name": "example", 5985s "line_number": f_lineno, 5985s "line": "", 5985s } 5985s 5985s /usr/lib/python3/dist-packages/distributed/tests/test_profile.py:327: 5985s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5985s /usr/lib/python3/dist-packages/distributed/profile.py:115: in info_frame 5985s line = linecache.getline(co.co_filename, f_lineno, frame.f_globals).lstrip() 5985s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5985s 5985s filename = '', lineno = None, module_globals = {} 5985s 5985s def getline(filename, lineno, module_globals=None): 5985s """Get a line for a Python source file from the cache. 5985s Update the cache if it doesn't contain an entry for this file already.""" 5985s 5985s lines = getlines(filename, module_globals) 5985s > if 1 <= lineno <= len(lines): 5985s E TypeError: '<=' not supported between instances of 'int' and 'NoneType' 5985s 5985s /usr/lib/python3.13/linecache.py:26: TypeError 5985s ________________________ test_call_stack_f_lineno[22-4] ________________________ 5985s 5985s f_lasti = 22, f_lineno = 4 5985s 5985s @pytest.mark.parametrize( 5985s "f_lasti,f_lineno", 5985s [ 5985s (-1, 1), 5985s (0, 2), 5985s (1, 2), 5985s (11, 2), 5985s (12, 3), 5985s (21, 4), 5985s (22, 4), 5985s (23, 4), 5985s (24, 2), 5985s (25, 2), 5985s (26, 2), 5985s (27, 2), 5985s (100, 2), 5985s ], 5985s ) 5985s def test_call_stack_f_lineno(f_lasti: int, f_lineno: int) -> None: 5985s > assert call_stack(FakeFrame(f_lasti=f_lasti, f_code=FAKE_CODE)) == [ # type: ignore 5985s f' File "", line {f_lineno}, in example\n\t' 5985s ] 5985s 5985s /usr/lib/python3/dist-packages/distributed/tests/test_profile.py:354: 5985s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5985s /usr/lib/python3/dist-packages/distributed/profile.py:263: in call_stack 5985s L.append(repr_frame(cur_frame)) 5985s /usr/lib/python3/dist-packages/distributed/profile.py:105: in repr_frame 5985s line = linecache.getline(co.co_filename, f_lineno, frame.f_globals).lstrip() 5985s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5985s 5985s filename = '', lineno = None, module_globals = {} 5985s 5985s def getline(filename, lineno, module_globals=None): 5985s """Get a line for a Python source file from the cache. 5985s Update the cache if it doesn't contain an entry for this file already.""" 5985s 5985s lines = getlines(filename, module_globals) 5985s > if 1 <= lineno <= len(lines): 5985s E TypeError: '<=' not supported between instances of 'int' and 'NoneType' 5985s 5985s /usr/lib/python3.13/linecache.py:26: TypeError 5985s ________________________ test_call_stack_f_lineno[23-4] ________________________ 5985s 5985s f_lasti = 23, f_lineno = 4 5985s 5985s @pytest.mark.parametrize( 5985s "f_lasti,f_lineno", 5985s [ 5985s (-1, 1), 5985s (0, 2), 5985s (1, 2), 5985s (11, 2), 5985s (12, 3), 5985s (21, 4), 5985s (22, 4), 5985s (23, 4), 5985s (24, 2), 5985s (25, 2), 5985s (26, 2), 5985s (27, 2), 5985s (100, 2), 5985s ], 5985s ) 5985s def test_call_stack_f_lineno(f_lasti: int, f_lineno: int) -> None: 5985s > assert call_stack(FakeFrame(f_lasti=f_lasti, f_code=FAKE_CODE)) == [ # type: ignore 5985s f' File "", line {f_lineno}, in example\n\t' 5985s ] 5985s 5985s /usr/lib/python3/dist-packages/distributed/tests/test_profile.py:354: 5985s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5985s /usr/lib/python3/dist-packages/distributed/profile.py:263: in call_stack 5985s L.append(repr_frame(cur_frame)) 5985s /usr/lib/python3/dist-packages/distributed/profile.py:105: in repr_frame 5985s line = linecache.getline(co.co_filename, f_lineno, frame.f_globals).lstrip() 5985s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5985s 5985s filename = '', lineno = None, module_globals = {} 5985s 5985s def getline(filename, lineno, module_globals=None): 5985s """Get a line for a Python source file from the cache. 5985s Update the cache if it doesn't contain an entry for this file already.""" 5985s 5985s lines = getlines(filename, module_globals) 5985s > if 1 <= lineno <= len(lines): 5985s E TypeError: '<=' not supported between instances of 'int' and 'NoneType' 5985s 5985s /usr/lib/python3.13/linecache.py:26: TypeError 5985s ______________________________ test_broadcast_tls ______________________________ 5985s 5985s fut = , timeout = 1 5985s 5985s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 5985s async with asyncio.timeout(timeout): 5985s > return await fut 5985s 5985s /usr/lib/python3/dist-packages/distributed/utils.py:1960: 5985s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5985s /usr/lib/python3/dist-packages/distributed/utils_test.py:124: in cleanup_global_workers 5985s await worker.close(executor_wait=False) 5985s /usr/lib/python3/dist-packages/distributed/utils.py:836: in wrapper 5985s return await func(*args, **kwargs) 5985s /usr/lib/python3/dist-packages/distributed/worker.py:1523: in close 5985s await self.finished() 5985s /usr/lib/python3/dist-packages/distributed/core.py:630: in finished 5985s await self._event_finished.wait() 5985s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5985s 5985s self = 5985s 5985s async def wait(self): 5985s """Block until the internal flag is true. 5985s 5985s If the internal flag is true on entry, return True 5985s immediately. Otherwise, block until another task calls 5985s set() to set the flag to true, then return True. 5985s """ 5985s if self._value: 5985s return True 5985s 5985s fut = self._get_loop().create_future() 5985s self._waiters.append(fut) 5985s try: 5985s > await fut 5985s E asyncio.exceptions.CancelledError 5985s 5985s /usr/lib/python3.13/asyncio/locks.py:213: CancelledError 5985s 5985s The above exception was the direct cause of the following exception: 5985s 5985s args = (), kwds = {} 5985s 5985s @wraps(func) 5985s def inner(*args, **kwds): 5985s with self._recreate_cm(): 5985s > return func(*args, **kwds) 5985s 5985s /usr/lib/python3.13/contextlib.py:85: 5985s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5985s /usr/lib/python3.13/contextlib.py:85: in inner 5985s return func(*args, **kwds) 5985s /usr/lib/python3/dist-packages/distributed/utils_test.py:1102: in test_func 5985s return _run_and_close_tornado(async_fn_outer) 5985s /usr/lib/python3/dist-packages/distributed/utils_test.py:378: in _run_and_close_tornado 5985s return asyncio_run(inner_fn(), loop_factory=get_loop_factory()) 5985s /usr/lib/python3.13/asyncio/runners.py:194: in run 5985s return runner.run(main) 5985s /usr/lib/python3.13/asyncio/runners.py:118: in run 5985s return self._loop.run_until_complete(task) 5985s /usr/lib/python3.13/asyncio/base_events.py:720: in run_until_complete 5985s return future.result() 5985s /usr/lib/python3/dist-packages/distributed/utils_test.py:375: in inner_fn 5985s return await async_fn(*args, **kwargs) 5985s /usr/lib/python3/dist-packages/distributed/utils_test.py:1099: in async_fn_outer 5985s return await utils_wait_for(async_fn(), timeout=timeout * 2) 5985s /usr/lib/python3/dist-packages/distributed/utils.py:1960: in wait_for 5985s return await fut 5985s /usr/lib/python3/dist-packages/distributed/utils_test.py:999: in async_fn 5985s _cluster_factory() as (s, workers), 5985s /usr/lib/python3.13/contextlib.py:214: in __aenter__ 5985s return await anext(self.gen) 5985s /usr/lib/python3/dist-packages/distributed/utils_test.py:993: in _cluster_factory 5985s await utils_wait_for(cleanup_global_workers(), 1) 5985s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 5985s async with asyncio.timeout(timeout): 5985s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5985s 5985s self = 5985s exc_type = 5985s exc_val = CancelledError(), exc_tb = 5985s 5985s async def __aexit__( 5985s self, 5985s exc_type: Optional[Type[BaseException]], 5985s exc_val: Optional[BaseException], 5985s exc_tb: Optional[TracebackType], 5985s ) -> Optional[bool]: 5985s assert self._state in (_State.ENTERED, _State.EXPIRING) 5985s 5985s if self._timeout_handler is not None: 5985s self._timeout_handler.cancel() 5985s self._timeout_handler = None 5985s 5985s if self._state is _State.EXPIRING: 5985s self._state = _State.EXPIRED 5985s 5985s if self._task.uncancel() <= self._cancelling and exc_type is not None: 5985s # Since there are no new cancel requests, we're 5985s # handling this. 5985s if issubclass(exc_type, exceptions.CancelledError): 5985s > raise TimeoutError from exc_val 5985s E TimeoutError 5985s 5985s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 5985s ----------------------------- Captured stderr call ----------------------------- 5985s 2024-11-23 21:56:35,676 - distributed.scheduler - INFO - State start 5985s 2024-11-23 21:56:35,683 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39461 5985s 2024-11-23 21:56:35,683 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35843/status 5985s 2024-11-23 21:56:35,683 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5985s 2024-11-23 21:56:35,696 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45375 5985s 2024-11-23 21:56:35,696 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45375 5985s 2024-11-23 21:56:35,696 - distributed.worker - INFO - Worker name: 0 5985s 2024-11-23 21:56:35,696 - distributed.worker - INFO - dashboard at: 127.0.0.1:37667 5985s 2024-11-23 21:56:35,696 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5985s 2024-11-23 21:56:35,696 - distributed.worker - INFO - ------------------------------------------------- 5985s 2024-11-23 21:56:35,696 - distributed.worker - INFO - Threads: 1 5985s 2024-11-23 21:56:35,696 - distributed.worker - INFO - Memory: 15.58 GiB 5985s 2024-11-23 21:56:35,696 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-jxdulr20 5985s 2024-11-23 21:56:35,696 - distributed.worker - INFO - ------------------------------------------------- 5985s 2024-11-23 21:56:35,698 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46501 5985s 2024-11-23 21:56:35,698 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46501 5985s 2024-11-23 21:56:35,698 - distributed.worker - INFO - Worker name: 1 5985s 2024-11-23 21:56:35,698 - distributed.worker - INFO - dashboard at: 127.0.0.1:36715 5985s 2024-11-23 21:56:35,698 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5985s 2024-11-23 21:56:35,698 - distributed.worker - INFO - ------------------------------------------------- 5985s 2024-11-23 21:56:35,698 - distributed.worker - INFO - Threads: 2 5985s 2024-11-23 21:56:35,698 - distributed.worker - INFO - Memory: 15.58 GiB 5985s 2024-11-23 21:56:35,698 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-v6ywjcjl 5985s 2024-11-23 21:56:35,698 - distributed.worker - INFO - ------------------------------------------------- 5985s 2024-11-23 21:56:35,710 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5985s 2024-11-23 21:56:35,710 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5985s 2024-11-23 21:56:35,710 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56164': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 21:56:35,711 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56168': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 21:56:35,822 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5985s 2024-11-23 21:56:35,822 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5985s 2024-11-23 21:56:35,823 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56184': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 21:56:35,823 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56196': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 21:56:35,935 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5985s 2024-11-23 21:56:35,935 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5985s 2024-11-23 21:56:35,936 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56212': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 21:56:35,936 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56214': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5985s 2024-11-23 21:56:36,048 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5985s 2024-11-23 21:56:36,049 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5985s 2024-11-23 21:56:36,049 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56222': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:36,049 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56230': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:36,161 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:36,161 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:36,161 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56240': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:36,161 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56252': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:36,272 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:36,273 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:36,273 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56254': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:36,273 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56266': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:36,385 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:36,385 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:36,385 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56282': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:36,385 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56294': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:36,496 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:36,496 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:36,496 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56302': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:36,497 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56314': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:36,607 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:36,608 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:36,608 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56330': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:36,608 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56334': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:36,719 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:36,719 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:36,720 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56346': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:36,720 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56352': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:36,832 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:36,833 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:36,833 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56360': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:36,833 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56376': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:36,945 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:36,945 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:36,945 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56382': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:36,945 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56396': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:37,057 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:37,057 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:37,057 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56404': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:37,057 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56412': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:37,169 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:37,169 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:37,169 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56418': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:37,170 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56420': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:37,281 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:37,281 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:37,282 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56432': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:37,282 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56440': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:37,393 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:37,393 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:37,394 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56456': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:37,394 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56462': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:37,507 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:37,508 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:37,508 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56478': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:37,508 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56494': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:37,619 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:37,620 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:37,620 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56504': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:37,620 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56510': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:37,732 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:37,732 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:37,732 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56520': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:37,732 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56532': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:37,844 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:37,844 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:37,844 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56534': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:37,844 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56550': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:37,955 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:37,956 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:37,956 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56560': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:37,956 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56570': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:38,069 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:38,069 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:38,069 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56582': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:38,069 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56588': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:38,181 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:38,181 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:38,181 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56600': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:38,181 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56616': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:38,293 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:38,294 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:38,294 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56626': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:38,294 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56640': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:38,406 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:38,406 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:38,406 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56656': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:38,406 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56664': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:38,518 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:38,518 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:38,518 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56672': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:38,518 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56682': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:38,630 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:38,630 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:38,630 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56690': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:38,630 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56698': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:38,742 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:38,742 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:38,742 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56714': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:38,742 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56722': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:38,854 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:38,854 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:38,854 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56736': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:38,854 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56752': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:38,965 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:38,966 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:38,966 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56766': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:38,966 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56782': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:39,078 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:39,078 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:39,079 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56792': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:39,079 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56808': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:39,191 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:39,191 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:39,194 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56812': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:39,194 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56826': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:39,303 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:39,303 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:39,303 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56840': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:39,303 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56846': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:39,415 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:39,415 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:39,416 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56854': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:39,416 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56858': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:39,528 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:39,528 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:39,528 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56866': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:39,528 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56874': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:39,640 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:39,640 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:39,640 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56876': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:39,640 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56892': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:39,752 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:39,752 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:39,752 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56906': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:39,752 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56914': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:39,864 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:39,864 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:39,864 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56924': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:39,864 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56926': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:39,975 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:39,975 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:39,976 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56942': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:39,976 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56956': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:40,087 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:40,088 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:40,088 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56968': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:40,088 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56976': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:40,199 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:40,199 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:40,199 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56980': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:40,199 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56994': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:40,311 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:40,311 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:40,311 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:57004': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:40,311 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:57010': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:40,423 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:40,423 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:40,423 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:57022': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:40,423 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:57028': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:40,535 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:40,535 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:40,536 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:57032': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:40,536 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:57046': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:40,649 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:40,649 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:40,649 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:57048': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:40,649 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:57054': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:40,761 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:40,761 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:40,762 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:57058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:40,762 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:57060': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:40,873 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:40,873 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:40,874 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:57074': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:40,874 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:57076': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:40,986 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:40,986 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:40,986 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:57090': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:40,986 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:57098': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:41,106 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:41,106 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:41,107 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:57100': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:41,107 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:57104': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:41,219 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:41,219 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:41,219 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:57106': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:41,219 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:57118': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:41,332 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:41,333 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:41,333 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:57128': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:41,333 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:57142': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:41,445 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:41,445 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:41,445 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:57152': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:41,445 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:57162': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:41,557 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:41,557 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:41,557 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:55474': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:41,557 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:55490': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:41,669 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:41,669 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:41,670 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:55498': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:41,670 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:55500': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:41,781 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:41,781 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:41,782 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:55504': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:41,782 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:55514': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:41,893 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:41,894 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:41,894 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:55518': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:41,894 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:55524': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:42,005 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:42,005 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:42,005 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:55538': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:42,006 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:55546': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:42,117 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:42,117 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:42,118 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:55552': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:42,118 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:55564': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:42,229 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:42,230 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:42,230 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:55574': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:42,230 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:55578': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:42,342 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:42,343 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:42,343 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:55592': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:42,343 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:55600': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:42,454 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:42,454 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:42,454 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:55606': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:42,454 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:55610': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:42,566 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:42,566 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:42,566 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:55624': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:42,566 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:55632': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:42,678 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:42,678 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:42,678 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:55644': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:42,679 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:55648': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:42,790 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:42,790 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:42,790 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:55658': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:42,791 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:55668': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:42,902 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:42,903 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:42,903 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:55674': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:42,903 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:55690': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:43,015 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:43,015 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:43,016 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:55694': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:43,016 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:55702': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:43,127 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:43,128 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:43,128 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:55712': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:43,128 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:55720': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:43,239 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:43,239 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:43,239 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:55722': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:43,240 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:55732': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:43,351 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:43,352 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:43,352 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:55740': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:43,352 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:55746': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:43,463 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:43,463 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:43,464 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:55756': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:43,464 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:55760': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:43,576 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:43,576 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:43,576 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:55772': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:43,576 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:55784': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:43,688 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:43,688 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:43,696 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:55800': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:43,696 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:55812': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:43,801 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:43,801 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:43,801 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:55828': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:43,801 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:55830': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:43,914 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:43,914 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:43,914 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:55842': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:43,914 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:55844': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:44,026 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:44,026 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:44,027 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:55846': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:44,027 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:55858': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:44,138 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:44,139 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:44,139 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:55868': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:44,139 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:55884': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:44,252 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:44,252 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:44,252 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:55900': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:44,252 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:55910': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:44,364 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:44,364 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:44,364 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:55914': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:44,365 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:55928': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:44,476 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:44,476 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:44,476 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:55930': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:44,476 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:55942': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:44,588 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:44,588 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:44,589 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:55952': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:44,589 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:55968': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:44,701 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:44,701 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:44,701 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:55972': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:44,701 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:55980': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:44,814 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:44,814 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:44,815 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:55992': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:44,815 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56004': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:44,926 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:44,926 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:44,926 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56020': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:44,926 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56026': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:45,037 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:45,038 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:45,038 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56034': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:45,038 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56040': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:45,150 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:45,150 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:45,150 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56044': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:45,150 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56056': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:45,262 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:45,262 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:45,262 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56062': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:45,262 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56076': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:45,374 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:45,374 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:45,374 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56088': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:45,374 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56094': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:45,486 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:45,486 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:45,486 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56102': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:45,487 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56114': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:45,598 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:45,599 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:45,599 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56128': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:45,599 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56144': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:45,710 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:45,710 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:45,711 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56152': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:45,711 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56168': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:45,822 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:45,823 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:45,823 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56172': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:45,823 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56184': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:45,935 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:45,935 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:45,935 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56188': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:45,935 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56192': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:46,047 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:46,048 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:46,048 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56202': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:46,048 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56218': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:46,160 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:46,160 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:46,160 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56228': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:46,161 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56240': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:46,273 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:46,273 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:46,274 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56244': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:46,274 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56258': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:46,386 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:46,386 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:46,386 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56274': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:46,386 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56282': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:46,498 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:46,498 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:46,499 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56298': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:46,499 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56306': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:46,611 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:46,611 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:46,611 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56318': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:46,611 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56332': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:46,722 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:46,722 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:46,723 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56334': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:46,723 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56346': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:46,834 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:46,835 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:46,835 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56348': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:46,835 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56356': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:46,947 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:46,947 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:46,947 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56362': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:46,947 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56376': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:47,059 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:47,060 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:47,060 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56386': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:47,060 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56400': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:47,172 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:47,173 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:47,173 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56416': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:47,173 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56422': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:47,284 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:47,284 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:47,285 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56434': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:47,285 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56444': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:47,396 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:47,397 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:47,397 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56446': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:47,397 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56460': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:47,508 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:47,508 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:47,509 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56468': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:47,509 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56480': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:47,620 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:47,621 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:47,621 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56496': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:47,621 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56506': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:47,732 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:47,732 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:47,732 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56518': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:47,732 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56528': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:47,844 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:47,845 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:47,845 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56544': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:47,845 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56550': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:47,956 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:47,957 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:47,957 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56560': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:47,957 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56574': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:48,069 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:48,069 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:48,069 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56590': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:48,069 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56594': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:48,181 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:48,181 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:48,182 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56604': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:48,182 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56618': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:48,295 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:48,295 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:48,295 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56630': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:48,295 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56644': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:48,407 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:48,407 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:48,407 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56650': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:48,407 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56658': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:48,519 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:48,519 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:48,519 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56666': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:48,519 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56678': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:48,631 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:48,632 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:48,632 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56694': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:48,632 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56704': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:48,744 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:48,744 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:48,745 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56718': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:48,745 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56722': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:48,857 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:48,857 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:48,857 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56738': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:48,857 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56744': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:48,968 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:48,968 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:48,969 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56748': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:48,969 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56756': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:49,081 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:49,081 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:49,081 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56758': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:49,081 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56762': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:49,196 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:49,196 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:49,197 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56768': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:49,197 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56774': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:49,309 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:49,309 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:49,309 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56782': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:49,309 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56790': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:49,421 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:49,421 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:49,421 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:49,421 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56802': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:49,533 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:49,533 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:49,534 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56804': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:49,534 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56808': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:49,646 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:49,646 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:49,646 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56810': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:49,646 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56822': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:49,758 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:49,759 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:49,759 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56836': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:49,759 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56844': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:49,871 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:49,871 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:49,871 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56848': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:49,871 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56864': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:49,983 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:49,983 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:49,984 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56870': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:49,984 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56884': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:50,096 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:50,096 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:50,097 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56892': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:50,097 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56898': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:50,208 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:50,208 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:50,209 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56906': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:50,209 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56912': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:50,321 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:50,321 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:50,321 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56928': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:50,321 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56938': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:50,434 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:50,434 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:50,434 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56948': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:50,435 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56960': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:50,546 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:50,546 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:50,546 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56972': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:50,547 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56976': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:50,658 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:50,658 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39461 5986s 2024-11-23 21:56:50,658 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56980': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:50,658 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39461': TLS handshake failed with remote 'tls://127.0.0.1:56992': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:50,695 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45375. Reason: failure-to-start- 5986s 2024-11-23 21:56:50,695 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:56:50,696 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46501. Reason: failure-to-start- 5986s 2024-11-23 21:56:50,697 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:56:50,698 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 15s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 5986s stream = await stream.start_tls( 5986s ^^^^^^^^^^^^^^^^^^^^^^^ 5986s False, ssl_options=ssl_options, server_hostname=host 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 5986s self.socket.do_handshake() 5986s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 5986s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 5986s self._sslobj.do_handshake() 5986s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 5986s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 5986s raise FatalCommClosedError( 5986s ...<2 lines>... 5986s ) from err 5986s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 5986s 5986s During handling of the above exception, another exception occurred: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1218, in _register_with_scheduler 5986s await asyncio.sleep(0.1) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 718, in sleep 5986s return await future 5986s ^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 15s. 5986s 2024-11-23 21:56:51,706 - distributed.scheduler - INFO - State start 5986s 2024-11-23 21:56:51,713 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44549 5986s 2024-11-23 21:56:51,713 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37201/status 5986s 2024-11-23 21:56:51,713 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 21:56:51,723 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39183 5986s 2024-11-23 21:56:51,724 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39183 5986s 2024-11-23 21:56:51,724 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 21:56:51,724 - distributed.worker - INFO - dashboard at: 127.0.0.1:42469 5986s 2024-11-23 21:56:51,724 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:56:51,724 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:56:51,724 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 21:56:51,724 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:56:51,724 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ugme_z6l 5986s 2024-11-23 21:56:51,724 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:56:51,726 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45071 5986s 2024-11-23 21:56:51,726 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45071 5986s 2024-11-23 21:56:51,726 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 21:56:51,726 - distributed.worker - INFO - dashboard at: 127.0.0.1:38191 5986s 2024-11-23 21:56:51,726 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:56:51,726 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:56:51,726 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 21:56:51,726 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:56:51,726 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-c0iv78dp 5986s 2024-11-23 21:56:51,726 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:56:51,738 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:56:51,738 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:56:51,742 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:36656': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:51,742 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:36668': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:51,850 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:56:51,850 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:56:51,850 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:36684': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:51,850 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:36694': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:51,961 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:56:51,962 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:56:51,962 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:36710': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:51,962 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:36724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:52,074 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:56:52,074 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:56:52,074 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:36736': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:52,074 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:36744': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:52,186 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:56:52,186 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:56:52,189 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:36754': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:52,189 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:36770': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:52,298 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:56:52,298 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:56:52,298 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:36774': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:52,298 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:36778': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:52,410 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:56:52,410 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:56:52,411 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:36790': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:52,411 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:36804': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:52,522 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:56:52,523 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:56:52,523 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:36818': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:52,523 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:36832': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:52,635 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:56:52,635 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:56:52,635 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:36838': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:52,635 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:36854': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:52,748 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:56:52,749 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:56:52,749 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:36856': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:52,749 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:36872': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:52,860 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:56:52,860 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:56:52,860 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:36878': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:52,861 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:36894': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:52,973 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:56:52,974 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:56:52,974 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:36896': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:52,974 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:36910': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:53,086 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:56:53,086 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:56:53,086 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:36912': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:53,086 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:36916': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:53,197 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:56:53,198 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:56:53,198 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:36924': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:53,198 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:36940': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:53,310 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:56:53,311 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:56:53,311 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:36954': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:53,311 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:36970': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:53,423 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:56:53,423 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:56:53,424 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:36984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:53,424 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:36986': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:53,536 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:56:53,536 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:56:53,536 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:37002': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:53,537 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:37010': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:53,649 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:56:53,649 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:56:53,649 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:37016': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:53,649 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:37020': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:53,761 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:56:53,761 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:56:53,761 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:37022': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:53,761 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:37036': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:53,873 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:56:53,873 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:56:53,873 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:37050': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:53,873 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:37062': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:53,986 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:56:53,986 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:56:53,986 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:37066': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:53,986 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:37076': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:54,097 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:56:54,098 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:56:54,098 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:37086': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:54,098 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:37092': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:54,209 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:56:54,209 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:56:54,209 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:37096': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:54,209 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:37110': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:54,321 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:56:54,321 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:56:54,322 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:37114': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:54,322 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:37126': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:54,433 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:56:54,433 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:56:54,433 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:37142': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:54,433 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:37150': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:54,545 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:56:54,546 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:56:54,546 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:37164': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:54,546 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:37178': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:54,657 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:56:54,657 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:56:54,657 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:37190': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:54,658 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:37198': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:54,776 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:56:54,777 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:56:54,777 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:37208': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:54,777 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:37222': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:54,889 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:56:54,889 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:56:54,889 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:37230': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:54,889 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:37242': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:55,001 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:56:55,002 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:56:55,002 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:37258': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:55,002 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:37266': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:55,113 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:56:55,113 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:56:55,113 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:37270': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:55,113 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:37286': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:55,228 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:56:55,229 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:56:55,229 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:37296': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:55,229 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:37312': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:55,341 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:56:55,341 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:56:55,342 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:37320': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:55,342 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:37324': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:55,453 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:56:55,453 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:56:55,453 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:37332': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:55,453 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:37346': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:55,565 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:56:55,565 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:56:55,566 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:37352': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:55,566 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:37364': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:55,677 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:56:55,677 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:56:55,677 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:37372': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:55,677 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:37388': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:55,789 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:56:55,789 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:56:55,790 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:37400': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:55,790 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:37408': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:55,901 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:56:55,902 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:56:55,902 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:37414': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:55,902 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:37418': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:56,015 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:56:56,015 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:56:56,015 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:37428': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:56,015 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:37434': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:56,127 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:56:56,127 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:56:56,127 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:37436': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:56,127 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:37438': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:56,239 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:56:56,239 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:56:56,240 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:37440': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:56,240 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:37444': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:56,353 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:56:56,353 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:56:56,353 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:37450': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:56,353 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:37464': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:56,464 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:56:56,464 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:56:56,465 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:37480': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:56,465 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:37490': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:56,576 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:56:56,576 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:56:56,576 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:37496': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:56,576 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:37510': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:56,690 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:56:56,690 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:56:56,693 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:37516': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:56,693 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:37530': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:56,802 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:56:56,802 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:56:56,802 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:37540': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:56,802 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:37542': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:56,914 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:56:56,914 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:56:56,915 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:37548': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:56,915 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:37562': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:57,026 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:56:57,027 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:56:57,027 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:37574': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:57,027 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:37586': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:57,140 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:56:57,140 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:56:57,140 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:37588': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:57,140 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:37590': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:57,252 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:56:57,252 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:56:57,252 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:37598': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:57,252 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:37600': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:57,364 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:56:57,364 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:56:57,364 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:37608': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:57,364 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:37614': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:57,475 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:56:57,476 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:56:57,476 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:37630': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:57,476 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:37644': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:57,588 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:56:57,588 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:56:57,588 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:37652': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:57,588 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:37662': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:57,700 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:56:57,700 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:56:57,701 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:37666': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:57,701 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:37680': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:57,812 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:56:57,812 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:56:57,812 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:37688': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:57,812 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:37690': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:57,924 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:56:57,924 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:56:57,924 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:37700': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:57,925 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:37708': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:58,036 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:56:58,036 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:56:58,036 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:37722': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:58,037 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:37724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:58,148 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:56:58,148 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:56:58,148 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:37730': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:58,148 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:37736': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:58,259 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:56:58,259 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:56:58,260 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:37750': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:58,260 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:37752': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:58,372 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:56:58,372 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:56:58,373 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:37756': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:58,373 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:37766': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:58,485 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:56:58,485 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:56:58,485 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:37778': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:58,485 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:37794': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:58,596 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:56:58,596 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:56:58,597 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:37802': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:58,597 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:37814': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:58,708 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:56:58,708 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:56:58,708 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:37824': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:58,708 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:37828': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:58,819 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:56:58,819 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:56:58,820 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:37844': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:58,820 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:37860': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:58,932 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:56:58,932 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:56:58,932 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:37864': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:58,932 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:37880': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:59,045 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:56:59,045 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:56:59,045 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:37892': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:59,045 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:37904': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:59,156 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:56:59,156 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:56:59,157 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:37916': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:59,157 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:37918': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:59,268 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:56:59,268 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:56:59,268 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:37920': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:59,268 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:37932': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:59,380 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:56:59,380 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:56:59,380 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:37936': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:59,380 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:37944': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:59,492 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:56:59,492 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:56:59,493 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:37950': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:59,493 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:37966': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:59,604 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:56:59,604 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:56:59,604 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:37970': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:59,604 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:37984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:59,717 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:56:59,717 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:56:59,720 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:38000': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:59,720 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:38006': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:59,829 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:56:59,829 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:56:59,829 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:38014': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:59,829 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:38028': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:59,940 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:56:59,940 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:56:59,941 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:38042': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:56:59,941 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:38054': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:00,052 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:57:00,053 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:57:00,053 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:38064': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:00,053 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:38074': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:00,164 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:57:00,164 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:57:00,164 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:38084': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:00,165 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:38094': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:00,277 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:57:00,277 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:57:00,277 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:38098': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:00,277 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:38114': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:00,388 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:57:00,388 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:57:00,389 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:38116': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:00,389 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:38132': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:00,500 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:57:00,500 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:57:00,501 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:38144': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:00,501 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:38154': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:00,612 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:57:00,612 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:57:00,612 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:38160': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:00,612 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:38174': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:00,728 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:57:00,728 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:57:00,728 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:38184': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:00,728 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:38194': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:00,839 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:57:00,840 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:57:00,840 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:38208': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:00,840 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:38212': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:00,951 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:57:00,952 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:57:00,952 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:38220': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:00,952 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:38230': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:01,063 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:57:01,063 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:57:01,064 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:38246': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:01,064 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:38248': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:01,175 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:57:01,176 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:57:01,176 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:38250': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:01,176 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:38260': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:01,288 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:57:01,288 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:57:01,288 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:38272': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:01,288 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:38276': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:01,399 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:57:01,399 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:57:01,400 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:38278': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:01,400 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:38282': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:01,511 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:57:01,511 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:57:01,511 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:38294': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:01,511 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:38296': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:01,622 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:57:01,622 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:57:01,623 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:35172': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:01,623 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:35174': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:01,734 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:57:01,734 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:57:01,735 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:35176': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:01,735 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:35184': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:01,846 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:57:01,846 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:57:01,846 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:35200': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:01,846 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:35204': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:01,961 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:57:01,962 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:57:01,962 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:35220': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:01,962 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:35226': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:02,072 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:57:02,073 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:57:02,074 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:35242': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:02,074 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:35246': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:02,186 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:57:02,186 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:57:02,190 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:35258': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:02,190 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:35260': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:02,298 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:57:02,299 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:57:02,299 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:35262': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:02,299 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:35274': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:02,410 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:57:02,410 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:57:02,410 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:35276': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:02,410 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:35282': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:02,523 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:57:02,523 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:57:02,523 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:35284': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:02,523 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:35296': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:02,636 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:57:02,636 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:57:02,636 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:35300': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:02,636 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:35312': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:02,747 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:57:02,747 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:57:02,748 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:35326': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:02,748 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:35328': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:02,859 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:57:02,859 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:57:02,859 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:35332': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:02,859 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:35334': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:02,970 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:57:02,970 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:57:02,971 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:35336': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:02,971 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:35352': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:03,083 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:57:03,083 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:57:03,083 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:35356': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:03,083 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:35360': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:03,198 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:57:03,198 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:57:03,198 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:35368': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:03,199 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:35382': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:03,310 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:57:03,310 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:57:03,310 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:35390': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:03,310 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:35406': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:03,422 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:57:03,423 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:57:03,423 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:35422': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:03,423 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:35432': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:03,535 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:57:03,535 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:57:03,536 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:35442': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:03,536 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:35448': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:03,648 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:57:03,648 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:57:03,648 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:35450': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:03,648 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:35462': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:03,760 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:57:03,760 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:57:03,760 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:35466': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:03,760 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:35468': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:03,872 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:57:03,873 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:57:03,873 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:35478': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:03,873 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:35486': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:03,985 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:57:03,986 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:57:03,986 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:35494': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:03,986 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:35498': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:04,097 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:57:04,097 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:57:04,098 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:35500': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:04,098 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:35502': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:04,209 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:57:04,209 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:57:04,209 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:35514': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:04,210 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:35526': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:04,322 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:57:04,322 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:57:04,322 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:35530': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:04,322 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:35542': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:04,433 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:57:04,434 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:57:04,434 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:35558': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:04,434 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:35570': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:04,545 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:57:04,545 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:57:04,546 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:35584': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:04,546 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:35590': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:04,657 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:57:04,657 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44549 5986s 2024-11-23 21:57:04,657 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:35606': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:04,658 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44549': TLS handshake failed with remote 'tls://127.0.0.1:35622': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:04,723 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39183. Reason: failure-to-start- 5986s 2024-11-23 21:57:04,723 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:57:04,724 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 13s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 5986s stream = await stream.start_tls( 5986s ^^^^^^^^^^^^^^^^^^^^^^^ 5986s False, ssl_options=ssl_options, server_hostname=host 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 5986s self.socket.do_handshake() 5986s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 5986s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 5986s self._sslobj.do_handshake() 5986s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 5986s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 5986s raise FatalCommClosedError( 5986s ...<2 lines>... 5986s ) from err 5986s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 5986s 5986s During handling of the above exception, another exception occurred: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1218, in _register_with_scheduler 5986s await asyncio.sleep(0.1) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 718, in sleep 5986s return await future 5986s ^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 13s. 5986s 2024-11-23 21:57:04,728 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45071. Reason: failure-to-start- 5986s 2024-11-23 21:57:04,728 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:57:05,731 - distributed.scheduler - INFO - State start 5986s 2024-11-23 21:57:05,736 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43319 5986s 2024-11-23 21:57:05,737 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44369/status 5986s 2024-11-23 21:57:05,737 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 21:57:05,748 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38427 5986s 2024-11-23 21:57:05,748 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38427 5986s 2024-11-23 21:57:05,748 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 21:57:05,748 - distributed.worker - INFO - dashboard at: 127.0.0.1:36989 5986s 2024-11-23 21:57:05,748 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43319 5986s 2024-11-23 21:57:05,748 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:57:05,748 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 21:57:05,748 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:57:05,748 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-yunarn38 5986s 2024-11-23 21:57:05,749 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:57:05,750 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38079 5986s 2024-11-23 21:57:05,750 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38079 5986s 2024-11-23 21:57:05,750 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 21:57:05,750 - distributed.worker - INFO - dashboard at: 127.0.0.1:43657 5986s 2024-11-23 21:57:05,750 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43319 5986s 2024-11-23 21:57:05,750 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:57:05,750 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 21:57:05,750 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:57:05,750 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-cff99q8j 5986s 2024-11-23 21:57:05,751 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:57:05,751 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38427. Reason: failure-to-start- 5986s 2024-11-23 21:57:05,751 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:57:05,752 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38079. Reason: failure-to-start- 5986s 2024-11-23 21:57:05,752 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:57:05,753 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43319': TLS handshake failed with remote 'tls://127.0.0.1:39380': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:57:05,753 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43319': TLS handshake failed with remote 'tls://127.0.0.1:39388': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:57:05,754 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 21:57:06,759 - distributed.scheduler - INFO - State start 5986s 2024-11-23 21:57:06,765 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37923 5986s 2024-11-23 21:57:06,765 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42161/status 5986s 2024-11-23 21:57:06,765 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 21:57:06,776 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36641 5986s 2024-11-23 21:57:06,776 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36641 5986s 2024-11-23 21:57:06,776 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 21:57:06,776 - distributed.worker - INFO - dashboard at: 127.0.0.1:42901 5986s 2024-11-23 21:57:06,776 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37923 5986s 2024-11-23 21:57:06,776 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:57:06,776 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 21:57:06,776 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:57:06,776 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-vbwnrdyy 5986s 2024-11-23 21:57:06,776 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:57:06,778 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33307 5986s 2024-11-23 21:57:06,778 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33307 5986s 2024-11-23 21:57:06,778 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 21:57:06,778 - distributed.worker - INFO - dashboard at: 127.0.0.1:45843 5986s 2024-11-23 21:57:06,779 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37923 5986s 2024-11-23 21:57:06,779 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:57:06,779 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 21:57:06,779 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:57:06,779 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-3wo9wmfr 5986s 2024-11-23 21:57:06,779 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:57:06,779 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36641. Reason: failure-to-start- 5986s 2024-11-23 21:57:06,779 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:57:06,780 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33307. Reason: failure-to-start- 5986s 2024-11-23 21:57:06,780 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:57:06,781 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37923': TLS handshake failed with remote 'tls://127.0.0.1:43490': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:57:06,781 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37923': TLS handshake failed with remote 'tls://127.0.0.1:43494': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:57:06,782 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 21:57:07,786 - distributed.scheduler - INFO - State start 5986s 2024-11-23 21:57:07,792 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41995 5986s 2024-11-23 21:57:07,792 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33455/status 5986s 2024-11-23 21:57:07,793 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 21:57:07,803 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45877 5986s 2024-11-23 21:57:07,803 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45877 5986s 2024-11-23 21:57:07,803 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 21:57:07,803 - distributed.worker - INFO - dashboard at: 127.0.0.1:35731 5986s 2024-11-23 21:57:07,803 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41995 5986s 2024-11-23 21:57:07,804 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:57:07,804 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 21:57:07,804 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:57:07,804 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-x1dr71ev 5986s 2024-11-23 21:57:07,804 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:57:07,805 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43601 5986s 2024-11-23 21:57:07,805 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43601 5986s 2024-11-23 21:57:07,805 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 21:57:07,805 - distributed.worker - INFO - dashboard at: 127.0.0.1:39101 5986s 2024-11-23 21:57:07,805 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41995 5986s 2024-11-23 21:57:07,806 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:57:07,806 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 21:57:07,806 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:57:07,806 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-hpp2ihgm 5986s 2024-11-23 21:57:07,806 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:57:07,806 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45877. Reason: failure-to-start- 5986s 2024-11-23 21:57:07,807 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:57:07,807 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43601. Reason: failure-to-start- 5986s 2024-11-23 21:57:07,807 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:57:07,808 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41995': TLS handshake failed with remote 'tls://127.0.0.1:59662': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:57:07,808 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41995': TLS handshake failed with remote 'tls://127.0.0.1:59664': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:57:07,809 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 21:57:08,813 - distributed.scheduler - INFO - State start 5986s 2024-11-23 21:57:08,821 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42083 5986s 2024-11-23 21:57:08,821 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37017/status 5986s 2024-11-23 21:57:08,821 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 21:57:08,831 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43639 5986s 2024-11-23 21:57:08,831 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43639 5986s 2024-11-23 21:57:08,831 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 21:57:08,831 - distributed.worker - INFO - dashboard at: 127.0.0.1:44837 5986s 2024-11-23 21:57:08,831 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42083 5986s 2024-11-23 21:57:08,831 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:57:08,831 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 21:57:08,831 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:57:08,831 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-6jhwqk_h 5986s 2024-11-23 21:57:08,831 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:57:08,833 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33039 5986s 2024-11-23 21:57:08,833 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33039 5986s 2024-11-23 21:57:08,833 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 21:57:08,833 - distributed.worker - INFO - dashboard at: 127.0.0.1:42663 5986s 2024-11-23 21:57:08,833 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42083 5986s 2024-11-23 21:57:08,833 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:57:08,833 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 21:57:08,833 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:57:08,833 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-fuu6ojfq 5986s 2024-11-23 21:57:08,833 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:57:08,834 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43639. Reason: failure-to-start- 5986s 2024-11-23 21:57:08,834 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:57:08,835 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33039. Reason: failure-to-start- 5986s 2024-11-23 21:57:08,835 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:57:08,836 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42083': TLS handshake failed with remote 'tls://127.0.0.1:57966': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:57:08,836 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42083': TLS handshake failed with remote 'tls://127.0.0.1:57978': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:57:08,837 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 21:57:09,842 - distributed.scheduler - INFO - State start 5986s 2024-11-23 21:57:09,847 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46035 5986s 2024-11-23 21:57:09,848 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38437/status 5986s 2024-11-23 21:57:09,848 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 21:57:09,859 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39293 5986s 2024-11-23 21:57:09,859 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39293 5986s 2024-11-23 21:57:09,859 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 21:57:09,859 - distributed.worker - INFO - dashboard at: 127.0.0.1:33281 5986s 2024-11-23 21:57:09,859 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46035 5986s 2024-11-23 21:57:09,859 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:57:09,859 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 21:57:09,859 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:57:09,859 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-k007fr88 5986s 2024-11-23 21:57:09,860 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:57:09,861 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37337 5986s 2024-11-23 21:57:09,861 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37337 5986s 2024-11-23 21:57:09,861 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 21:57:09,861 - distributed.worker - INFO - dashboard at: 127.0.0.1:41943 5986s 2024-11-23 21:57:09,861 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46035 5986s 2024-11-23 21:57:09,861 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:57:09,861 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 21:57:09,861 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:57:09,861 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-44idfpb8 5986s 2024-11-23 21:57:09,861 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:57:09,862 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39293. Reason: failure-to-start- 5986s 2024-11-23 21:57:09,862 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:57:09,863 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37337. Reason: failure-to-start- 5986s 2024-11-23 21:57:09,863 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:57:09,863 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46035': TLS handshake failed with remote 'tls://127.0.0.1:44554': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:57:09,863 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46035': TLS handshake failed with remote 'tls://127.0.0.1:44568': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:57:09,864 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 21:57:10,870 - distributed.scheduler - INFO - State start 5986s 2024-11-23 21:57:10,876 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38269 5986s 2024-11-23 21:57:10,876 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45569/status 5986s 2024-11-23 21:57:10,877 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 21:57:10,895 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37067 5986s 2024-11-23 21:57:10,895 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37067 5986s 2024-11-23 21:57:10,895 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 21:57:10,895 - distributed.worker - INFO - dashboard at: 127.0.0.1:39017 5986s 2024-11-23 21:57:10,895 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38269 5986s 2024-11-23 21:57:10,895 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:57:10,895 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 21:57:10,895 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:57:10,895 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-aufbzhi0 5986s 2024-11-23 21:57:10,895 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:57:10,902 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33681 5986s 2024-11-23 21:57:10,902 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33681 5986s 2024-11-23 21:57:10,902 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 21:57:10,902 - distributed.worker - INFO - dashboard at: 127.0.0.1:38571 5986s 2024-11-23 21:57:10,902 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38269 5986s 2024-11-23 21:57:10,902 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:57:10,902 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 21:57:10,902 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:57:10,902 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-y145erwn 5986s 2024-11-23 21:57:10,902 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:57:10,903 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37067. Reason: failure-to-start- 5986s 2024-11-23 21:57:10,903 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:57:10,903 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33681. Reason: failure-to-start- 5986s 2024-11-23 21:57:10,904 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:57:10,905 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38269': TLS handshake failed with remote 'tls://127.0.0.1:47152': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:57:10,905 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38269': TLS handshake failed with remote 'tls://127.0.0.1:47168': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:57:10,906 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 21:57:11,911 - distributed.scheduler - INFO - State start 5986s 2024-11-23 21:57:11,918 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41979 5986s 2024-11-23 21:57:11,918 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33013/status 5986s 2024-11-23 21:57:11,918 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 21:57:11,930 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35597 5986s 2024-11-23 21:57:11,930 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35597 5986s 2024-11-23 21:57:11,930 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 21:57:11,930 - distributed.worker - INFO - dashboard at: 127.0.0.1:40193 5986s 2024-11-23 21:57:11,930 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41979 5986s 2024-11-23 21:57:11,930 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:57:11,931 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 21:57:11,931 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:57:11,931 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-7vnpkjyg 5986s 2024-11-23 21:57:11,931 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:57:11,932 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35347 5986s 2024-11-23 21:57:11,932 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35347 5986s 2024-11-23 21:57:11,932 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 21:57:11,932 - distributed.worker - INFO - dashboard at: 127.0.0.1:39307 5986s 2024-11-23 21:57:11,932 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41979 5986s 2024-11-23 21:57:11,933 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:57:11,933 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 21:57:11,933 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:57:11,933 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-6udex0pv 5986s 2024-11-23 21:57:11,933 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:57:11,934 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35597. Reason: failure-to-start- 5986s 2024-11-23 21:57:11,934 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:57:11,934 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35347. Reason: failure-to-start- 5986s 2024-11-23 21:57:11,934 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:57:11,935 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41979': TLS handshake failed with remote 'tls://127.0.0.1:35446': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:57:11,935 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41979': TLS handshake failed with remote 'tls://127.0.0.1:35458': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:57:11,936 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 21:57:12,940 - distributed.scheduler - INFO - State start 5986s 2024-11-23 21:57:12,948 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42777 5986s 2024-11-23 21:57:12,948 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37379/status 5986s 2024-11-23 21:57:12,948 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 21:57:12,959 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40509 5986s 2024-11-23 21:57:12,959 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40509 5986s 2024-11-23 21:57:12,959 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 21:57:12,959 - distributed.worker - INFO - dashboard at: 127.0.0.1:41595 5986s 2024-11-23 21:57:12,959 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 5986s 2024-11-23 21:57:12,959 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:57:12,959 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 21:57:12,959 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:57:12,959 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-pb0ybstx 5986s 2024-11-23 21:57:12,959 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:57:12,961 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33349 5986s 2024-11-23 21:57:12,961 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33349 5986s 2024-11-23 21:57:12,961 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 21:57:12,961 - distributed.worker - INFO - dashboard at: 127.0.0.1:40955 5986s 2024-11-23 21:57:12,961 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 5986s 2024-11-23 21:57:12,961 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:57:12,961 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 21:57:12,961 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:57:12,961 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-pj27a7s7 5986s 2024-11-23 21:57:12,961 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:57:12,962 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40509. Reason: failure-to-start- 5986s 2024-11-23 21:57:12,962 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:57:12,962 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33349. Reason: failure-to-start- 5986s 2024-11-23 21:57:12,963 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:57:12,963 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:37430': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:57:12,964 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:37432': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:57:12,965 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 21:57:13,969 - distributed.scheduler - INFO - State start 5986s 2024-11-23 21:57:13,976 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46025 5986s 2024-11-23 21:57:13,976 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41251/status 5986s 2024-11-23 21:57:13,976 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 21:57:13,990 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37969 5986s 2024-11-23 21:57:13,990 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37969 5986s 2024-11-23 21:57:13,990 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 21:57:13,990 - distributed.worker - INFO - dashboard at: 127.0.0.1:33481 5986s 2024-11-23 21:57:13,990 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46025 5986s 2024-11-23 21:57:13,990 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:57:13,990 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 21:57:13,991 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:57:13,991 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ugemtmiw 5986s 2024-11-23 21:57:13,991 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:57:13,992 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34775 5986s 2024-11-23 21:57:13,992 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34775 5986s 2024-11-23 21:57:13,992 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 21:57:13,992 - distributed.worker - INFO - dashboard at: 127.0.0.1:43129 5986s 2024-11-23 21:57:13,992 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46025 5986s 2024-11-23 21:57:13,992 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:57:13,992 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 21:57:13,993 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:57:13,993 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-lexx29n3 5986s 2024-11-23 21:57:13,993 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:57:13,994 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37969. Reason: failure-to-start- 5986s 2024-11-23 21:57:13,994 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:57:13,994 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34775. Reason: failure-to-start- 5986s 2024-11-23 21:57:13,994 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:57:13,995 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46025': TLS handshake failed with remote 'tls://127.0.0.1:44134': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:57:13,995 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46025': TLS handshake failed with remote 'tls://127.0.0.1:44138': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:57:13,996 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 21:57:15,001 - distributed.scheduler - INFO - State start 5986s 2024-11-23 21:57:15,008 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41069 5986s 2024-11-23 21:57:15,008 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44273/status 5986s 2024-11-23 21:57:15,008 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 21:57:15,020 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42165 5986s 2024-11-23 21:57:15,020 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42165 5986s 2024-11-23 21:57:15,020 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 21:57:15,020 - distributed.worker - INFO - dashboard at: 127.0.0.1:39607 5986s 2024-11-23 21:57:15,020 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41069 5986s 2024-11-23 21:57:15,020 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:57:15,020 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 21:57:15,020 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:57:15,020 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-12xt052b 5986s 2024-11-23 21:57:15,020 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:57:15,022 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42641 5986s 2024-11-23 21:57:15,022 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42641 5986s 2024-11-23 21:57:15,022 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 21:57:15,022 - distributed.worker - INFO - dashboard at: 127.0.0.1:33713 5986s 2024-11-23 21:57:15,022 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41069 5986s 2024-11-23 21:57:15,022 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:57:15,022 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 21:57:15,022 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:57:15,022 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-zs8kzsva 5986s 2024-11-23 21:57:15,023 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:57:15,024 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42165. Reason: failure-to-start- 5986s 2024-11-23 21:57:15,024 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:57:15,025 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42641. Reason: failure-to-start- 5986s 2024-11-23 21:57:15,025 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:57:15,026 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41069': TLS handshake failed with remote 'tls://127.0.0.1:55628': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:57:15,026 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41069': TLS handshake failed with remote 'tls://127.0.0.1:55634': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:57:15,027 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 21:57:16,032 - distributed.scheduler - INFO - State start 5986s 2024-11-23 21:57:16,038 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36313 5986s 2024-11-23 21:57:16,038 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41477/status 5986s 2024-11-23 21:57:16,039 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 21:57:16,050 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45061 5986s 2024-11-23 21:57:16,050 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45061 5986s 2024-11-23 21:57:16,050 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 21:57:16,050 - distributed.worker - INFO - dashboard at: 127.0.0.1:37005 5986s 2024-11-23 21:57:16,050 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36313 5986s 2024-11-23 21:57:16,050 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:57:16,050 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 21:57:16,050 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:57:16,050 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-k1725uf6 5986s 2024-11-23 21:57:16,050 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:57:16,053 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39599 5986s 2024-11-23 21:57:16,053 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39599 5986s 2024-11-23 21:57:16,053 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 21:57:16,053 - distributed.worker - INFO - dashboard at: 127.0.0.1:41727 5986s 2024-11-23 21:57:16,053 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36313 5986s 2024-11-23 21:57:16,053 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:57:16,053 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 21:57:16,053 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:57:16,053 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-7dg4gac1 5986s 2024-11-23 21:57:16,053 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:57:16,054 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45061. Reason: failure-to-start- 5986s 2024-11-23 21:57:16,054 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:57:16,054 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39599. Reason: failure-to-start- 5986s 2024-11-23 21:57:16,055 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:57:16,055 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36313': TLS handshake failed with remote 'tls://127.0.0.1:60592': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:57:16,056 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36313': TLS handshake failed with remote 'tls://127.0.0.1:60594': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:57:16,057 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 21:57:17,061 - distributed.scheduler - INFO - State start 5986s 2024-11-23 21:57:17,069 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41163 5986s 2024-11-23 21:57:17,069 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41145/status 5986s 2024-11-23 21:57:17,069 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 21:57:17,081 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33057 5986s 2024-11-23 21:57:17,081 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33057 5986s 2024-11-23 21:57:17,081 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 21:57:17,081 - distributed.worker - INFO - dashboard at: 127.0.0.1:34823 5986s 2024-11-23 21:57:17,081 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41163 5986s 2024-11-23 21:57:17,081 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:57:17,081 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 21:57:17,081 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:57:17,081 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-o46jbg52 5986s 2024-11-23 21:57:17,081 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:57:17,083 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43515 5986s 2024-11-23 21:57:17,083 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43515 5986s 2024-11-23 21:57:17,083 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 21:57:17,083 - distributed.worker - INFO - dashboard at: 127.0.0.1:43797 5986s 2024-11-23 21:57:17,083 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41163 5986s 2024-11-23 21:57:17,083 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:57:17,083 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 21:57:17,083 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:57:17,083 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-rbj2wyg4 5986s 2024-11-23 21:57:17,083 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:57:17,084 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33057. Reason: failure-to-start- 5986s 2024-11-23 21:57:17,084 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:57:17,085 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43515. Reason: failure-to-start- 5986s 2024-11-23 21:57:17,085 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:57:17,086 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41163': TLS handshake failed with remote 'tls://127.0.0.1:38990': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:57:17,086 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41163': TLS handshake failed with remote 'tls://127.0.0.1:39006': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:57:17,087 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 21:57:18,093 - distributed.scheduler - INFO - State start 5986s 2024-11-23 21:57:18,102 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45079 5986s 2024-11-23 21:57:18,103 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33789/status 5986s 2024-11-23 21:57:18,103 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 21:57:18,118 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37071 5986s 2024-11-23 21:57:18,118 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37071 5986s 2024-11-23 21:57:18,118 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 21:57:18,118 - distributed.worker - INFO - dashboard at: 127.0.0.1:44565 5986s 2024-11-23 21:57:18,118 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45079 5986s 2024-11-23 21:57:18,118 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:57:18,118 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 21:57:18,118 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:57:18,118 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-mmc4vv3d 5986s 2024-11-23 21:57:18,118 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:57:18,120 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34877 5986s 2024-11-23 21:57:18,120 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34877 5986s 2024-11-23 21:57:18,120 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 21:57:18,120 - distributed.worker - INFO - dashboard at: 127.0.0.1:38631 5986s 2024-11-23 21:57:18,120 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45079 5986s 2024-11-23 21:57:18,120 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:57:18,120 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 21:57:18,120 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:57:18,120 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-pcl80v9t 5986s 2024-11-23 21:57:18,120 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:57:18,121 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37071. Reason: failure-to-start- 5986s 2024-11-23 21:57:18,121 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:57:18,122 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34877. Reason: failure-to-start- 5986s 2024-11-23 21:57:18,122 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:57:18,123 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45079': TLS handshake failed with remote 'tls://127.0.0.1:54912': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:57:18,123 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45079': TLS handshake failed with remote 'tls://127.0.0.1:54914': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:57:18,124 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 21:57:19,129 - distributed.scheduler - INFO - State start 5986s 2024-11-23 21:57:19,136 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44553 5986s 2024-11-23 21:57:19,136 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:32987/status 5986s 2024-11-23 21:57:19,136 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 21:57:19,148 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41067 5986s 2024-11-23 21:57:19,148 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41067 5986s 2024-11-23 21:57:19,148 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 21:57:19,148 - distributed.worker - INFO - dashboard at: 127.0.0.1:44399 5986s 2024-11-23 21:57:19,148 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44553 5986s 2024-11-23 21:57:19,148 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:57:19,148 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 21:57:19,148 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:57:19,148 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-cn1vvndj 5986s 2024-11-23 21:57:19,148 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:57:19,151 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41835 5986s 2024-11-23 21:57:19,151 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41835 5986s 2024-11-23 21:57:19,151 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 21:57:19,151 - distributed.worker - INFO - dashboard at: 127.0.0.1:37815 5986s 2024-11-23 21:57:19,151 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44553 5986s 2024-11-23 21:57:19,151 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:57:19,151 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 21:57:19,151 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:57:19,151 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-pcs72kch 5986s 2024-11-23 21:57:19,151 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:57:19,152 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41067. Reason: failure-to-start- 5986s 2024-11-23 21:57:19,152 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:57:19,152 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41835. Reason: failure-to-start- 5986s 2024-11-23 21:57:19,153 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:57:19,154 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44553': TLS handshake failed with remote 'tls://127.0.0.1:34506': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:57:19,154 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44553': TLS handshake failed with remote 'tls://127.0.0.1:34518': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:57:19,155 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 21:57:20,160 - distributed.scheduler - INFO - State start 5986s 2024-11-23 21:57:20,167 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42871 5986s 2024-11-23 21:57:20,167 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44849/status 5986s 2024-11-23 21:57:20,167 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 21:57:20,178 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41845 5986s 2024-11-23 21:57:20,178 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41845 5986s 2024-11-23 21:57:20,178 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 21:57:20,178 - distributed.worker - INFO - dashboard at: 127.0.0.1:38557 5986s 2024-11-23 21:57:20,178 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42871 5986s 2024-11-23 21:57:20,178 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:57:20,178 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 21:57:20,178 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:57:20,178 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-9ku7fx9s 5986s 2024-11-23 21:57:20,178 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:57:20,180 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38145 5986s 2024-11-23 21:57:20,180 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38145 5986s 2024-11-23 21:57:20,180 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 21:57:20,180 - distributed.worker - INFO - dashboard at: 127.0.0.1:42325 5986s 2024-11-23 21:57:20,180 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42871 5986s 2024-11-23 21:57:20,180 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:57:20,180 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 21:57:20,180 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:57:20,180 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-izkjb066 5986s 2024-11-23 21:57:20,180 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:57:20,181 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41845. Reason: failure-to-start- 5986s 2024-11-23 21:57:20,181 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:57:20,182 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38145. Reason: failure-to-start- 5986s 2024-11-23 21:57:20,182 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:57:20,183 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42871': TLS handshake failed with remote 'tls://127.0.0.1:35484': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:57:20,183 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42871': TLS handshake failed with remote 'tls://127.0.0.1:35498': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:57:20,184 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 21:57:21,190 - distributed.scheduler - INFO - State start 5986s 2024-11-23 21:57:21,196 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45695 5986s 2024-11-23 21:57:21,196 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33645/status 5986s 2024-11-23 21:57:21,196 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 21:57:21,207 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35101 5986s 2024-11-23 21:57:21,207 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35101 5986s 2024-11-23 21:57:21,208 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 21:57:21,208 - distributed.worker - INFO - dashboard at: 127.0.0.1:32805 5986s 2024-11-23 21:57:21,208 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45695 5986s 2024-11-23 21:57:21,208 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:57:21,208 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 21:57:21,208 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:57:21,208 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-qa2t4h3d 5986s 2024-11-23 21:57:21,208 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:57:21,210 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37425 5986s 2024-11-23 21:57:21,210 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37425 5986s 2024-11-23 21:57:21,210 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 21:57:21,210 - distributed.worker - INFO - dashboard at: 127.0.0.1:45503 5986s 2024-11-23 21:57:21,210 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45695 5986s 2024-11-23 21:57:21,210 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:57:21,210 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 21:57:21,210 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:57:21,210 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-b4u4q9az 5986s 2024-11-23 21:57:21,210 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:57:21,211 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35101. Reason: failure-to-start- 5986s 2024-11-23 21:57:21,211 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:57:21,212 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37425. Reason: failure-to-start- 5986s 2024-11-23 21:57:21,212 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:57:21,213 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45695': TLS handshake failed with remote 'tls://127.0.0.1:43274': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:57:21,213 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45695': TLS handshake failed with remote 'tls://127.0.0.1:43286': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:57:21,214 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 21:57:22,219 - distributed.scheduler - INFO - State start 5986s 2024-11-23 21:57:22,225 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43829 5986s 2024-11-23 21:57:22,226 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38385/status 5986s 2024-11-23 21:57:22,226 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 21:57:22,239 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39353 5986s 2024-11-23 21:57:22,239 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39353 5986s 2024-11-23 21:57:22,239 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 21:57:22,239 - distributed.worker - INFO - dashboard at: 127.0.0.1:45125 5986s 2024-11-23 21:57:22,240 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43829 5986s 2024-11-23 21:57:22,240 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:57:22,240 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 21:57:22,240 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:57:22,240 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-8n23_59k 5986s 2024-11-23 21:57:22,240 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:57:22,241 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43769 5986s 2024-11-23 21:57:22,242 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43769 5986s 2024-11-23 21:57:22,242 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 21:57:22,242 - distributed.worker - INFO - dashboard at: 127.0.0.1:43207 5986s 2024-11-23 21:57:22,242 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43829 5986s 2024-11-23 21:57:22,242 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:57:22,242 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 21:57:22,242 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:57:22,242 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-kdx8oscd 5986s 2024-11-23 21:57:22,242 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:57:22,245 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39353. Reason: failure-to-start- 5986s 2024-11-23 21:57:22,245 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:57:22,246 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43769. Reason: failure-to-start- 5986s 2024-11-23 21:57:22,246 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:57:22,247 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43829': TLS handshake failed with remote 'tls://127.0.0.1:46482': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:57:22,247 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43829': TLS handshake failed with remote 'tls://127.0.0.1:46492': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:57:22,248 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 21:57:23,253 - distributed.scheduler - INFO - State start 5986s 2024-11-23 21:57:23,260 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33819 5986s 2024-11-23 21:57:23,260 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35461/status 5986s 2024-11-23 21:57:23,260 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 21:57:23,272 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45135 5986s 2024-11-23 21:57:23,272 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45135 5986s 2024-11-23 21:57:23,273 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 21:57:23,273 - distributed.worker - INFO - dashboard at: 127.0.0.1:34811 5986s 2024-11-23 21:57:23,273 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33819 5986s 2024-11-23 21:57:23,273 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:57:23,273 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 21:57:23,273 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:57:23,273 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-nijzuxae 5986s 2024-11-23 21:57:23,273 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:57:23,275 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45631 5986s 2024-11-23 21:57:23,275 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45631 5986s 2024-11-23 21:57:23,275 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 21:57:23,275 - distributed.worker - INFO - dashboard at: 127.0.0.1:34301 5986s 2024-11-23 21:57:23,275 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33819 5986s 2024-11-23 21:57:23,275 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:57:23,275 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 21:57:23,275 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:57:23,275 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-t_0pnovo 5986s 2024-11-23 21:57:23,275 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:57:23,279 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45135. Reason: failure-to-start- 5986s 2024-11-23 21:57:23,279 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:57:23,279 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45631. Reason: failure-to-start- 5986s 2024-11-23 21:57:23,279 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:57:23,280 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33819': TLS handshake failed with remote 'tls://127.0.0.1:45046': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:57:23,280 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33819': TLS handshake failed with remote 'tls://127.0.0.1:45052': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:57:23,281 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 21:57:24,286 - distributed.scheduler - INFO - State start 5986s 2024-11-23 21:57:24,302 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44469 5986s 2024-11-23 21:57:24,303 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39171/status 5986s 2024-11-23 21:57:24,303 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 21:57:24,318 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35827 5986s 2024-11-23 21:57:24,318 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35827 5986s 2024-11-23 21:57:24,318 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 21:57:24,318 - distributed.worker - INFO - dashboard at: 127.0.0.1:38381 5986s 2024-11-23 21:57:24,318 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44469 5986s 2024-11-23 21:57:24,318 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:57:24,318 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 21:57:24,319 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:57:24,319 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-n77ejqsq 5986s 2024-11-23 21:57:24,319 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:57:24,320 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46741 5986s 2024-11-23 21:57:24,320 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46741 5986s 2024-11-23 21:57:24,321 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 21:57:24,321 - distributed.worker - INFO - dashboard at: 127.0.0.1:45327 5986s 2024-11-23 21:57:24,321 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44469 5986s 2024-11-23 21:57:24,321 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:57:24,321 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 21:57:24,321 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:57:24,321 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-rwqjs420 5986s 2024-11-23 21:57:24,322 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:57:24,323 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35827. Reason: failure-to-start- 5986s 2024-11-23 21:57:24,323 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:57:24,323 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46741. Reason: failure-to-start- 5986s 2024-11-23 21:57:24,324 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:57:24,327 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44469': TLS handshake failed with remote 'tls://127.0.0.1:51752': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:57:24,327 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44469': TLS handshake failed with remote 'tls://127.0.0.1:51754': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:57:24,328 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 21:57:25,333 - distributed.scheduler - INFO - State start 5986s 2024-11-23 21:57:25,338 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42897 5986s 2024-11-23 21:57:25,338 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43739/status 5986s 2024-11-23 21:57:25,338 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 21:57:25,348 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40087 5986s 2024-11-23 21:57:25,348 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40087 5986s 2024-11-23 21:57:25,348 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 21:57:25,348 - distributed.worker - INFO - dashboard at: 127.0.0.1:34127 5986s 2024-11-23 21:57:25,348 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42897 5986s 2024-11-23 21:57:25,349 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:57:25,349 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 21:57:25,349 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:57:25,349 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-l6mjsru9 5986s 2024-11-23 21:57:25,349 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:57:25,350 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44147 5986s 2024-11-23 21:57:25,350 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44147 5986s 2024-11-23 21:57:25,351 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 21:57:25,351 - distributed.worker - INFO - dashboard at: 127.0.0.1:35891 5986s 2024-11-23 21:57:25,351 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42897 5986s 2024-11-23 21:57:25,351 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:57:25,351 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 21:57:25,351 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:57:25,351 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-jj3saf9c 5986s 2024-11-23 21:57:25,351 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:57:25,352 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40087. Reason: failure-to-start- 5986s 2024-11-23 21:57:25,352 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:57:25,352 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44147. Reason: failure-to-start- 5986s 2024-11-23 21:57:25,352 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:57:25,355 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42897': TLS handshake failed with remote 'tls://127.0.0.1:44550': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:57:25,355 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42897': TLS handshake failed with remote 'tls://127.0.0.1:44560': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:57:25,356 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 21:57:26,362 - distributed.scheduler - INFO - State start 5986s 2024-11-23 21:57:26,367 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42177 5986s 2024-11-23 21:57:26,367 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41949/status 5986s 2024-11-23 21:57:26,367 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 21:57:26,377 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34553 5986s 2024-11-23 21:57:26,378 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34553 5986s 2024-11-23 21:57:26,378 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 21:57:26,378 - distributed.worker - INFO - dashboard at: 127.0.0.1:41739 5986s 2024-11-23 21:57:26,378 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42177 5986s 2024-11-23 21:57:26,378 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:57:26,378 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 21:57:26,378 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:57:26,378 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-c3xo2uek 5986s 2024-11-23 21:57:26,378 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:57:26,380 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38571 5986s 2024-11-23 21:57:26,380 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38571 5986s 2024-11-23 21:57:26,380 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 21:57:26,380 - distributed.worker - INFO - dashboard at: 127.0.0.1:45325 5986s 2024-11-23 21:57:26,380 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42177 5986s 2024-11-23 21:57:26,380 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:57:26,380 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 21:57:26,380 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:57:26,380 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-h_20o8ab 5986s 2024-11-23 21:57:26,380 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:57:26,381 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34553. Reason: failure-to-start- 5986s 2024-11-23 21:57:26,381 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:57:26,381 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38571. Reason: failure-to-start- 5986s 2024-11-23 21:57:26,382 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:57:26,384 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42177': TLS handshake failed with remote 'tls://127.0.0.1:55676': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:57:26,384 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42177': TLS handshake failed with remote 'tls://127.0.0.1:55690': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:57:26,386 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 21:57:27,390 - distributed.scheduler - INFO - State start 5986s 2024-11-23 21:57:27,396 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37423 5986s 2024-11-23 21:57:27,396 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46355/status 5986s 2024-11-23 21:57:27,396 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 21:57:27,416 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:32985 5986s 2024-11-23 21:57:27,416 - distributed.worker - INFO - Listening to: tls://127.0.0.1:32985 5986s 2024-11-23 21:57:27,416 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 21:57:27,416 - distributed.worker - INFO - dashboard at: 127.0.0.1:46175 5986s 2024-11-23 21:57:27,416 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37423 5986s 2024-11-23 21:57:27,416 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:57:27,416 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 21:57:27,416 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:57:27,416 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-y01fakwh 5986s 2024-11-23 21:57:27,416 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:57:27,418 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39009 5986s 2024-11-23 21:57:27,418 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39009 5986s 2024-11-23 21:57:27,418 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 21:57:27,418 - distributed.worker - INFO - dashboard at: 127.0.0.1:46627 5986s 2024-11-23 21:57:27,418 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37423 5986s 2024-11-23 21:57:27,418 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:57:27,418 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 21:57:27,418 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:57:27,419 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-bfpj273x 5986s 2024-11-23 21:57:27,419 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:57:27,420 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:32985. Reason: failure-to-start- 5986s 2024-11-23 21:57:27,420 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:57:27,420 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39009. Reason: failure-to-start- 5986s 2024-11-23 21:57:27,420 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:57:27,423 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37423': TLS handshake failed with remote 'tls://127.0.0.1:59372': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:57:27,423 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37423': TLS handshake failed with remote 'tls://127.0.0.1:59380': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:57:27,424 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 21:57:28,430 - distributed.scheduler - INFO - State start 5986s 2024-11-23 21:57:28,436 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38727 5986s 2024-11-23 21:57:28,436 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38529/status 5986s 2024-11-23 21:57:28,436 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 21:57:28,447 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38287 5986s 2024-11-23 21:57:28,448 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38287 5986s 2024-11-23 21:57:28,448 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 21:57:28,448 - distributed.worker - INFO - dashboard at: 127.0.0.1:43709 5986s 2024-11-23 21:57:28,448 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38727 5986s 2024-11-23 21:57:28,448 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:57:28,448 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 21:57:28,448 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:57:28,448 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-s5rk42xe 5986s 2024-11-23 21:57:28,448 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:57:28,450 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42863 5986s 2024-11-23 21:57:28,450 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42863 5986s 2024-11-23 21:57:28,450 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 21:57:28,450 - distributed.worker - INFO - dashboard at: 127.0.0.1:38503 5986s 2024-11-23 21:57:28,450 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38727 5986s 2024-11-23 21:57:28,451 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:57:28,451 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 21:57:28,451 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:57:28,451 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-xnyuys92 5986s 2024-11-23 21:57:28,451 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:57:28,452 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38287. Reason: failure-to-start- 5986s 2024-11-23 21:57:28,452 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:57:28,452 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42863. Reason: failure-to-start- 5986s 2024-11-23 21:57:28,452 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:57:28,455 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38727': TLS handshake failed with remote 'tls://127.0.0.1:34940': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:57:28,455 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38727': TLS handshake failed with remote 'tls://127.0.0.1:34950': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:57:28,456 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 21:57:29,463 - distributed.scheduler - INFO - State start 5986s 2024-11-23 21:57:29,468 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36387 5986s 2024-11-23 21:57:29,469 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42783/status 5986s 2024-11-23 21:57:29,469 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 21:57:29,480 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41879 5986s 2024-11-23 21:57:29,480 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41879 5986s 2024-11-23 21:57:29,480 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 21:57:29,480 - distributed.worker - INFO - dashboard at: 127.0.0.1:39877 5986s 2024-11-23 21:57:29,480 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36387 5986s 2024-11-23 21:57:29,480 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:57:29,480 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 21:57:29,480 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:57:29,480 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-sg1yg75r 5986s 2024-11-23 21:57:29,480 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:57:29,482 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41387 5986s 2024-11-23 21:57:29,482 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41387 5986s 2024-11-23 21:57:29,482 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 21:57:29,482 - distributed.worker - INFO - dashboard at: 127.0.0.1:38957 5986s 2024-11-23 21:57:29,482 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36387 5986s 2024-11-23 21:57:29,482 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:57:29,482 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 21:57:29,482 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:57:29,482 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-e2u6vrtd 5986s 2024-11-23 21:57:29,482 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:57:29,485 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41879. Reason: failure-to-start- 5986s 2024-11-23 21:57:29,485 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:57:29,486 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41387. Reason: failure-to-start- 5986s 2024-11-23 21:57:29,486 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:57:29,487 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36387': TLS handshake failed with remote 'tls://127.0.0.1:46702': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:57:29,487 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36387': TLS handshake failed with remote 'tls://127.0.0.1:46718': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:57:29,488 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 21:57:30,494 - distributed.scheduler - INFO - State start 5986s 2024-11-23 21:57:30,499 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35583 5986s 2024-11-23 21:57:30,499 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:32883/status 5986s 2024-11-23 21:57:30,499 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 21:57:30,510 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39929 5986s 2024-11-23 21:57:30,510 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39929 5986s 2024-11-23 21:57:30,510 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 21:57:30,510 - distributed.worker - INFO - dashboard at: 127.0.0.1:38631 5986s 2024-11-23 21:57:30,510 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35583 5986s 2024-11-23 21:57:30,510 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:57:30,510 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 21:57:30,511 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:57:30,511 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ag5b1pzn 5986s 2024-11-23 21:57:30,511 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:57:30,512 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34901 5986s 2024-11-23 21:57:30,512 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34901 5986s 2024-11-23 21:57:30,512 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 21:57:30,512 - distributed.worker - INFO - dashboard at: 127.0.0.1:45891 5986s 2024-11-23 21:57:30,512 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35583 5986s 2024-11-23 21:57:30,512 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:57:30,512 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 21:57:30,513 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:57:30,513 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-lo8_ny9x 5986s 2024-11-23 21:57:30,513 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:57:30,515 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39929. Reason: failure-to-start- 5986s 2024-11-23 21:57:30,515 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:57:30,516 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34901. Reason: failure-to-start- 5986s 2024-11-23 21:57:30,516 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:57:30,517 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35583': TLS handshake failed with remote 'tls://127.0.0.1:33362': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:57:30,517 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35583': TLS handshake failed with remote 'tls://127.0.0.1:33368': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:57:30,518 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 21:57:31,522 - distributed.scheduler - INFO - State start 5986s 2024-11-23 21:57:31,528 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45741 5986s 2024-11-23 21:57:31,528 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40795/status 5986s 2024-11-23 21:57:31,528 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 21:57:31,540 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39445 5986s 2024-11-23 21:57:31,541 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39445 5986s 2024-11-23 21:57:31,541 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 21:57:31,541 - distributed.worker - INFO - dashboard at: 127.0.0.1:34979 5986s 2024-11-23 21:57:31,541 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45741 5986s 2024-11-23 21:57:31,541 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:57:31,541 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 21:57:31,541 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:57:31,541 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-x_2dj_by 5986s 2024-11-23 21:57:31,541 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:57:31,543 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37267 5986s 2024-11-23 21:57:31,543 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37267 5986s 2024-11-23 21:57:31,543 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 21:57:31,543 - distributed.worker - INFO - dashboard at: 127.0.0.1:45247 5986s 2024-11-23 21:57:31,543 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45741 5986s 2024-11-23 21:57:31,543 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:57:31,543 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 21:57:31,543 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:57:31,543 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-68w50xql 5986s 2024-11-23 21:57:31,543 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:57:31,546 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39445. Reason: failure-to-start- 5986s 2024-11-23 21:57:31,546 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:57:31,546 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37267. Reason: failure-to-start- 5986s 2024-11-23 21:57:31,546 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:57:31,548 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45741': TLS handshake failed with remote 'tls://127.0.0.1:38538': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:57:31,548 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45741': TLS handshake failed with remote 'tls://127.0.0.1:38546': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:57:31,549 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 21:57:32,553 - distributed.scheduler - INFO - State start 5986s 2024-11-23 21:57:32,560 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38581 5986s 2024-11-23 21:57:32,560 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46745/status 5986s 2024-11-23 21:57:32,560 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 21:57:32,574 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45995 5986s 2024-11-23 21:57:32,574 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45995 5986s 2024-11-23 21:57:32,574 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 21:57:32,574 - distributed.worker - INFO - dashboard at: 127.0.0.1:33871 5986s 2024-11-23 21:57:32,574 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38581 5986s 2024-11-23 21:57:32,574 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:57:32,574 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 21:57:32,574 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:57:32,574 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-akv3mat7 5986s 2024-11-23 21:57:32,574 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:57:32,576 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36035 5986s 2024-11-23 21:57:32,576 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36035 5986s 2024-11-23 21:57:32,576 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 21:57:32,576 - distributed.worker - INFO - dashboard at: 127.0.0.1:45073 5986s 2024-11-23 21:57:32,576 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38581 5986s 2024-11-23 21:57:32,576 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:57:32,576 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 21:57:32,576 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:57:32,576 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-thb86yeu 5986s 2024-11-23 21:57:32,576 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:57:32,579 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45995. Reason: failure-to-start- 5986s 2024-11-23 21:57:32,579 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:57:32,580 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36035. Reason: failure-to-start- 5986s 2024-11-23 21:57:32,580 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:57:32,581 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38581': TLS handshake failed with remote 'tls://127.0.0.1:36622': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:57:32,581 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38581': TLS handshake failed with remote 'tls://127.0.0.1:36638': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:57:32,582 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 21:57:33,588 - distributed.scheduler - INFO - State start 5986s 2024-11-23 21:57:33,594 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35753 5986s 2024-11-23 21:57:33,594 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33869/status 5986s 2024-11-23 21:57:33,594 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 21:57:33,606 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45131 5986s 2024-11-23 21:57:33,606 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45131 5986s 2024-11-23 21:57:33,606 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 21:57:33,606 - distributed.worker - INFO - dashboard at: 127.0.0.1:36481 5986s 2024-11-23 21:57:33,606 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35753 5986s 2024-11-23 21:57:33,606 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:57:33,606 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 21:57:33,606 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:57:33,606 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-6miebk4b 5986s 2024-11-23 21:57:33,606 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:57:33,608 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44839 5986s 2024-11-23 21:57:33,608 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44839 5986s 2024-11-23 21:57:33,608 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 21:57:33,608 - distributed.worker - INFO - dashboard at: 127.0.0.1:38671 5986s 2024-11-23 21:57:33,608 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35753 5986s 2024-11-23 21:57:33,608 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:57:33,608 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 21:57:33,608 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:57:33,608 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-aujcv59k 5986s 2024-11-23 21:57:33,608 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:57:33,613 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45131. Reason: failure-to-start- 5986s 2024-11-23 21:57:33,613 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:57:33,613 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44839. Reason: failure-to-start- 5986s 2024-11-23 21:57:33,613 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:57:33,614 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35753': TLS handshake failed with remote 'tls://127.0.0.1:44520': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:57:33,614 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35753': TLS handshake failed with remote 'tls://127.0.0.1:44528': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:57:33,616 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 21:57:34,620 - distributed.scheduler - INFO - State start 5986s 2024-11-23 21:57:34,626 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34501 5986s 2024-11-23 21:57:34,626 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34613/status 5986s 2024-11-23 21:57:34,626 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 21:57:34,638 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33533 5986s 2024-11-23 21:57:34,639 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33533 5986s 2024-11-23 21:57:34,639 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 21:57:34,639 - distributed.worker - INFO - dashboard at: 127.0.0.1:37853 5986s 2024-11-23 21:57:34,639 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34501 5986s 2024-11-23 21:57:34,639 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:57:34,639 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 21:57:34,639 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:57:34,639 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-1wqmul2x 5986s 2024-11-23 21:57:34,639 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:57:34,641 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39523 5986s 2024-11-23 21:57:34,641 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39523 5986s 2024-11-23 21:57:34,641 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 21:57:34,641 - distributed.worker - INFO - dashboard at: 127.0.0.1:40407 5986s 2024-11-23 21:57:34,641 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34501 5986s 2024-11-23 21:57:34,641 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:57:34,641 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 21:57:34,641 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:57:34,641 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-6rd509vc 5986s 2024-11-23 21:57:34,641 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:57:34,645 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33533. Reason: failure-to-start- 5986s 2024-11-23 21:57:34,645 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:57:34,645 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39523. Reason: failure-to-start- 5986s 2024-11-23 21:57:34,645 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:57:34,646 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34501': TLS handshake failed with remote 'tls://127.0.0.1:42896': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:57:34,646 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34501': TLS handshake failed with remote 'tls://127.0.0.1:42898': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:57:34,647 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 21:57:35,653 - distributed.scheduler - INFO - State start 5986s 2024-11-23 21:57:35,659 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35449 5986s 2024-11-23 21:57:35,659 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41941/status 5986s 2024-11-23 21:57:35,659 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 21:57:35,671 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45807 5986s 2024-11-23 21:57:35,671 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45807 5986s 2024-11-23 21:57:35,671 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 21:57:35,671 - distributed.worker - INFO - dashboard at: 127.0.0.1:34921 5986s 2024-11-23 21:57:35,671 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35449 5986s 2024-11-23 21:57:35,671 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:57:35,671 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 21:57:35,671 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:57:35,671 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-dfc_pp3b 5986s 2024-11-23 21:57:35,671 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:57:35,673 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42331 5986s 2024-11-23 21:57:35,673 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42331 5986s 2024-11-23 21:57:35,673 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 21:57:35,673 - distributed.worker - INFO - dashboard at: 127.0.0.1:46257 5986s 2024-11-23 21:57:35,673 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35449 5986s 2024-11-23 21:57:35,673 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:57:35,673 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 21:57:35,673 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:57:35,673 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-x7y1okf3 5986s 2024-11-23 21:57:35,673 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:57:35,676 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45807. Reason: failure-to-start- 5986s 2024-11-23 21:57:35,676 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:57:35,677 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42331. Reason: failure-to-start- 5986s 2024-11-23 21:57:35,677 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:57:35,678 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35449': TLS handshake failed with remote 'tls://127.0.0.1:41942': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:57:35,678 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35449': TLS handshake failed with remote 'tls://127.0.0.1:41948': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:57:35,678 - distributed.worker - ERROR - 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 836, in wrapper 5986s return await func(*args, **kwargs) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1644, in close 5986s await asyncio.to_thread( 5986s _close, executor=executor, wait=executor_wait 5986s ) 5986s File "/usr/lib/python3.13/asyncio/threads.py", line 25, in to_thread 5986s return await loop.run_in_executor(None, func_call) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 2024-11-23 21:57:35,680 - distributed.worker - ERROR - 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 836, in wrapper 5986s return await func(*args, **kwargs) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1644, in close 5986s await asyncio.to_thread( 5986s _close, executor=executor, wait=executor_wait 5986s ) 5986s File "/usr/lib/python3.13/asyncio/threads.py", line 25, in to_thread 5986s return await loop.run_in_executor(None, func_call) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 2024-11-23 21:57:36,682 - distributed.worker - ERROR - 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 836, in wrapper 5986s return await func(*args, **kwargs) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1523, in close 5986s await self.finished() 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 630, in finished 5986s await self._event_finished.wait() 5986s File "/usr/lib/python3.13/asyncio/locks.py", line 213, in wait 5986s await fut 5986s asyncio.exceptions.CancelledError 5986s _____________________________ test_repr_temp_keys ______________________________ 5986s 5986s cls = , kwargs = {} 5986s 5986s @classmethod 5986s def temporary(cls, **kwargs): 5986s """Create a new temporary Security object. 5986s 5986s This creates a new self-signed key/cert pair suitable for securing 5986s communication for all roles in a Dask cluster. These keys/certs exist 5986s only in memory, and are stored in this object. 5986s 5986s This method requires the library ``cryptography`` be installed. 5986s """ 5986s try: 5986s > from cryptography import x509 5986s 5986s /usr/lib/python3/dist-packages/distributed/security.py:165: 5986s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5986s /usr/lib/python3/dist-packages/cryptography/x509/__init__.py:7: in 5986s from cryptography.x509 import certificate_transparency, verification 5986s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5986s 5986s # This file is dual licensed under the terms of the Apache License, Version 5986s # 2.0, and the BSD License. See the LICENSE file in the root of this repository 5986s # for complete details. 5986s 5986s from __future__ import annotations 5986s 5986s import abc 5986s import datetime 5986s 5986s from cryptography import utils 5986s > from cryptography.hazmat.bindings._rust import x509 as rust_x509 5986s E ImportError: cannot import name 'x509' from 'cryptography.hazmat.bindings._rust' (unknown location) 5986s 5986s /usr/lib/python3/dist-packages/cryptography/x509/certificate_transparency.py:11: ImportError 5986s 5986s During handling of the above exception, another exception occurred: 5986s 5986s def test_repr_temp_keys(): 5986s > xfail_ssl_issue5601() 5986s 5986s /usr/lib/python3/dist-packages/distributed/tests/test_security.py:155: 5986s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5986s /usr/lib/python3/dist-packages/distributed/utils_test.py:1945: in xfail_ssl_issue5601 5986s Security.temporary() 5986s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5986s 5986s cls = , kwargs = {} 5986s 5986s @classmethod 5986s def temporary(cls, **kwargs): 5986s """Create a new temporary Security object. 5986s 5986s This creates a new self-signed key/cert pair suitable for securing 5986s communication for all roles in a Dask cluster. These keys/certs exist 5986s only in memory, and are stored in this object. 5986s 5986s This method requires the library ``cryptography`` be installed. 5986s """ 5986s try: 5986s from cryptography import x509 5986s from cryptography.hazmat.backends import default_backend 5986s from cryptography.hazmat.primitives import hashes, serialization 5986s from cryptography.hazmat.primitives.asymmetric import rsa 5986s from cryptography.x509.oid import NameOID 5986s except ImportError: 5986s > raise ImportError( 5986s "Using `Security.temporary` requires `cryptography`, please " 5986s "install it using either pip or conda" 5986s ) 5986s E ImportError: Using `Security.temporary` requires `cryptography`, please install it using either pip or conda 5986s 5986s /usr/lib/python3/dist-packages/distributed/security.py:171: ImportError 5986s __________________________ test_temporary_credentials __________________________ 5986s 5986s cls = , kwargs = {} 5986s 5986s @classmethod 5986s def temporary(cls, **kwargs): 5986s """Create a new temporary Security object. 5986s 5986s This creates a new self-signed key/cert pair suitable for securing 5986s communication for all roles in a Dask cluster. These keys/certs exist 5986s only in memory, and are stored in this object. 5986s 5986s This method requires the library ``cryptography`` be installed. 5986s """ 5986s try: 5986s > from cryptography import x509 5986s 5986s /usr/lib/python3/dist-packages/distributed/security.py:165: 5986s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5986s /usr/lib/python3/dist-packages/cryptography/x509/__init__.py:7: in 5986s from cryptography.x509 import certificate_transparency, verification 5986s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5986s 5986s # This file is dual licensed under the terms of the Apache License, Version 5986s # 2.0, and the BSD License. See the LICENSE file in the root of this repository 5986s # for complete details. 5986s 5986s from __future__ import annotations 5986s 5986s import abc 5986s import datetime 5986s 5986s from cryptography import utils 5986s > from cryptography.hazmat.bindings._rust import x509 as rust_x509 5986s E ImportError: cannot import name 'x509' from 'cryptography.hazmat.bindings._rust' (unknown location) 5986s 5986s /usr/lib/python3/dist-packages/cryptography/x509/certificate_transparency.py:11: ImportError 5986s 5986s During handling of the above exception, another exception occurred: 5986s 5986s def test_temporary_credentials(): 5986s > xfail_ssl_issue5601() 5986s 5986s /usr/lib/python3/dist-packages/distributed/tests/test_security.py:448: 5986s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5986s /usr/lib/python3/dist-packages/distributed/utils_test.py:1945: in xfail_ssl_issue5601 5986s Security.temporary() 5986s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5986s 5986s cls = , kwargs = {} 5986s 5986s @classmethod 5986s def temporary(cls, **kwargs): 5986s """Create a new temporary Security object. 5986s 5986s This creates a new self-signed key/cert pair suitable for securing 5986s communication for all roles in a Dask cluster. These keys/certs exist 5986s only in memory, and are stored in this object. 5986s 5986s This method requires the library ``cryptography`` be installed. 5986s """ 5986s try: 5986s from cryptography import x509 5986s from cryptography.hazmat.backends import default_backend 5986s from cryptography.hazmat.primitives import hashes, serialization 5986s from cryptography.hazmat.primitives.asymmetric import rsa 5986s from cryptography.x509.oid import NameOID 5986s except ImportError: 5986s > raise ImportError( 5986s "Using `Security.temporary` requires `cryptography`, please " 5986s "install it using either pip or conda" 5986s ) 5986s E ImportError: Using `Security.temporary` requires `cryptography`, please install it using either pip or conda 5986s 5986s /usr/lib/python3/dist-packages/distributed/security.py:171: ImportError 5986s ________________ test_extra_conn_args_in_temporary_credentials _________________ 5986s 5986s cls = , kwargs = {} 5986s 5986s @classmethod 5986s def temporary(cls, **kwargs): 5986s """Create a new temporary Security object. 5986s 5986s This creates a new self-signed key/cert pair suitable for securing 5986s communication for all roles in a Dask cluster. These keys/certs exist 5986s only in memory, and are stored in this object. 5986s 5986s This method requires the library ``cryptography`` be installed. 5986s """ 5986s try: 5986s > from cryptography import x509 5986s 5986s /usr/lib/python3/dist-packages/distributed/security.py:165: 5986s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5986s /usr/lib/python3/dist-packages/cryptography/x509/__init__.py:7: in 5986s from cryptography.x509 import certificate_transparency, verification 5986s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5986s 5986s # This file is dual licensed under the terms of the Apache License, Version 5986s # 2.0, and the BSD License. See the LICENSE file in the root of this repository 5986s # for complete details. 5986s 5986s from __future__ import annotations 5986s 5986s import abc 5986s import datetime 5986s 5986s from cryptography import utils 5986s > from cryptography.hazmat.bindings._rust import x509 as rust_x509 5986s E ImportError: cannot import name 'x509' from 'cryptography.hazmat.bindings._rust' (unknown location) 5986s 5986s /usr/lib/python3/dist-packages/cryptography/x509/certificate_transparency.py:11: ImportError 5986s 5986s During handling of the above exception, another exception occurred: 5986s 5986s def test_extra_conn_args_in_temporary_credentials(): 5986s > xfail_ssl_issue5601() 5986s 5986s /usr/lib/python3/dist-packages/distributed/tests/test_security.py:466: 5986s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5986s /usr/lib/python3/dist-packages/distributed/utils_test.py:1945: in xfail_ssl_issue5601 5986s Security.temporary() 5986s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5986s 5986s cls = , kwargs = {} 5986s 5986s @classmethod 5986s def temporary(cls, **kwargs): 5986s """Create a new temporary Security object. 5986s 5986s This creates a new self-signed key/cert pair suitable for securing 5986s communication for all roles in a Dask cluster. These keys/certs exist 5986s only in memory, and are stored in this object. 5986s 5986s This method requires the library ``cryptography`` be installed. 5986s """ 5986s try: 5986s from cryptography import x509 5986s from cryptography.hazmat.backends import default_backend 5986s from cryptography.hazmat.primitives import hashes, serialization 5986s from cryptography.hazmat.primitives.asymmetric import rsa 5986s from cryptography.x509.oid import NameOID 5986s except ImportError: 5986s > raise ImportError( 5986s "Using `Security.temporary` requires `cryptography`, please " 5986s "install it using either pip or conda" 5986s ) 5986s E ImportError: Using `Security.temporary` requires `cryptography`, please install it using either pip or conda 5986s 5986s /usr/lib/python3/dist-packages/distributed/security.py:171: ImportError 5986s __________________________________ test_basic __________________________________ 5986s 5986s fut = , timeout = 0 5986s 5986s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 5986s async with asyncio.timeout(timeout): 5986s > return await fut 5986s 5986s /usr/lib/python3/dist-packages/distributed/utils.py:1960: 5986s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5986s /usr/lib/python3/dist-packages/distributed/worker.py:1480: in start_unsafe 5986s await self._register_with_scheduler() 5986s /usr/lib/python3/dist-packages/distributed/worker.py:1179: in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s /usr/lib/python3/dist-packages/distributed/comm/core.py:342: in connect 5986s comm = await wait_for( 5986s /usr/lib/python3/dist-packages/distributed/utils.py:1960: in wait_for 5986s return await fut 5986s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:546: in connect 5986s stream = await self.client.connect( 5986s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5986s 5986s self = , host = '127.0.0.1' 5986s port = 39863, af = 5986s ssl_options = 5986s max_buffer_size = 8364507136.0, source_ip = None, source_port = None 5986s timeout = None 5986s 5986s async def connect( 5986s self, 5986s host: str, 5986s port: int, 5986s af: socket.AddressFamily = socket.AF_UNSPEC, 5986s ssl_options: Optional[Union[Dict[str, Any], ssl.SSLContext]] = None, 5986s max_buffer_size: Optional[int] = None, 5986s source_ip: Optional[str] = None, 5986s source_port: Optional[int] = None, 5986s timeout: Optional[Union[float, datetime.timedelta]] = None, 5986s ) -> IOStream: 5986s """Connect to the given host and port. 5986s 5986s Asynchronously returns an `.IOStream` (or `.SSLIOStream` if 5986s ``ssl_options`` is not None). 5986s 5986s Using the ``source_ip`` kwarg, one can specify the source 5986s IP address to use when establishing the connection. 5986s In case the user needs to resolve and 5986s use a specific interface, it has to be handled outside 5986s of Tornado as this depends very much on the platform. 5986s 5986s Raises `TimeoutError` if the input future does not complete before 5986s ``timeout``, which may be specified in any form allowed by 5986s `.IOLoop.add_timeout` (i.e. a `datetime.timedelta` or an absolute time 5986s relative to `.IOLoop.time`) 5986s 5986s Similarly, when the user requires a certain source port, it can 5986s be specified using the ``source_port`` arg. 5986s 5986s .. versionchanged:: 4.5 5986s Added the ``source_ip`` and ``source_port`` arguments. 5986s 5986s .. versionchanged:: 5.0 5986s Added the ``timeout`` argument. 5986s """ 5986s if timeout is not None: 5986s if isinstance(timeout, numbers.Real): 5986s timeout = IOLoop.current().time() + timeout 5986s elif isinstance(timeout, datetime.timedelta): 5986s timeout = IOLoop.current().time() + timeout.total_seconds() 5986s else: 5986s raise TypeError("Unsupported timeout %r" % timeout) 5986s if timeout is not None: 5986s addrinfo = await gen.with_timeout( 5986s timeout, self.resolver.resolve(host, port, af) 5986s ) 5986s else: 5986s addrinfo = await self.resolver.resolve(host, port, af) 5986s connector = _Connector( 5986s addrinfo, 5986s functools.partial( 5986s self._create_stream, 5986s max_buffer_size, 5986s source_ip=source_ip, 5986s source_port=source_port, 5986s ), 5986s ) 5986s > af, addr, stream = await connector.start(connect_timeout=timeout) 5986s E asyncio.exceptions.CancelledError 5986s 5986s /usr/lib/python3/dist-packages/tornado/tcpclient.py:279: CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s self = 5986s 5986s @final 5986s async def start(self): 5986s async with self._startup_lock: 5986s if self.status == Status.failed: 5986s assert self.__startup_exc is not None 5986s raise self.__startup_exc 5986s elif self.status != Status.init: 5986s return self 5986s timeout = getattr(self, "death_timeout", None) 5986s 5986s async def _close_on_failure(exc: Exception) -> None: 5986s await self.close(reason=f"failure-to-start-{str(type(exc))}") 5986s self.status = Status.failed 5986s self.__startup_exc = exc 5986s 5986s try: 5986s > await wait_for(self.start_unsafe(), timeout=timeout) 5986s 5986s /usr/lib/python3/dist-packages/distributed/core.py:664: 5986s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5986s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 5986s async with asyncio.timeout(timeout): 5986s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5986s 5986s self = 5986s exc_type = 5986s exc_val = CancelledError(), exc_tb = 5986s 5986s async def __aexit__( 5986s self, 5986s exc_type: Optional[Type[BaseException]], 5986s exc_val: Optional[BaseException], 5986s exc_tb: Optional[TracebackType], 5986s ) -> Optional[bool]: 5986s assert self._state in (_State.ENTERED, _State.EXPIRING) 5986s 5986s if self._timeout_handler is not None: 5986s self._timeout_handler.cancel() 5986s self._timeout_handler = None 5986s 5986s if self._state is _State.EXPIRING: 5986s self._state = _State.EXPIRED 5986s 5986s if self._task.uncancel() <= self._cancelling and exc_type is not None: 5986s # Since there are no new cancel requests, we're 5986s # handling this. 5986s if issubclass(exc_type, exceptions.CancelledError): 5986s > raise TimeoutError from exc_val 5986s E TimeoutError 5986s 5986s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s @contextlib.asynccontextmanager 5986s async def _cluster_factory(): 5986s workers = [] 5986s s = None 5986s try: 5986s for _ in range(60): 5986s try: 5986s > s, ws = await start_cluster( 5986s nthreads, 5986s scheduler, 5986s security=security, 5986s Worker=Worker, 5986s scheduler_kwargs=scheduler_kwargs, 5986s worker_kwargs=merge( 5986s {"death_timeout": min(15, int(deadline.remaining))}, 5986s worker_kwargs, 5986s ), 5986s ) 5986s 5986s /usr/lib/python3/dist-packages/distributed/utils_test.py:966: 5986s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5986s /usr/lib/python3/dist-packages/distributed/utils_test.py:789: in start_cluster 5986s await asyncio.gather(*workers) 5986s /usr/lib/python3.13/asyncio/tasks.py:737: in _wrap_awaitable 5986s return await awaitable 5986s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5986s 5986s self = 5986s 5986s @final 5986s async def start(self): 5986s async with self._startup_lock: 5986s if self.status == Status.failed: 5986s assert self.__startup_exc is not None 5986s raise self.__startup_exc 5986s elif self.status != Status.init: 5986s return self 5986s timeout = getattr(self, "death_timeout", None) 5986s 5986s async def _close_on_failure(exc: Exception) -> None: 5986s await self.close(reason=f"failure-to-start-{str(type(exc))}") 5986s self.status = Status.failed 5986s self.__startup_exc = exc 5986s 5986s try: 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s except asyncio.TimeoutError as exc: 5986s await _close_on_failure(exc) 5986s > raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s E TimeoutError: Worker start timed out after 0s. 5986s 5986s /usr/lib/python3/dist-packages/distributed/core.py:667: TimeoutError 5986s 5986s During handling of the above exception, another exception occurred: 5986s 5986s fut = ._..test_func..async_fn at 0xde81a938> 5986s timeout = 60 5986s 5986s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 5986s async with asyncio.timeout(timeout): 5986s > return await fut 5986s 5986s /usr/lib/python3/dist-packages/distributed/utils.py:1960: 5986s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5986s /usr/lib/python3/dist-packages/distributed/utils_test.py:999: in async_fn 5986s _cluster_factory() as (s, workers), 5986s /usr/lib/python3.13/contextlib.py:214: in __aenter__ 5986s return await anext(self.gen) 5986s /usr/lib/python3/dist-packages/distributed/utils_test.py:983: in _cluster_factory 5986s await asyncio.sleep(1) 5986s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5986s 5986s delay = 1, result = None 5986s 5986s async def sleep(delay, result=None): 5986s """Coroutine that completes after a given time (in seconds).""" 5986s if delay <= 0: 5986s await __sleep0() 5986s return result 5986s 5986s if math.isnan(delay): 5986s raise ValueError("Invalid delay: NaN (not a number)") 5986s 5986s loop = events.get_running_loop() 5986s future = loop.create_future() 5986s h = loop.call_later(delay, 5986s futures._set_result_unless_cancelled, 5986s future, result) 5986s try: 5986s > return await future 5986s E asyncio.exceptions.CancelledError 5986s 5986s /usr/lib/python3.13/asyncio/tasks.py:718: CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s args = (), kwds = {} 5986s 5986s @wraps(func) 5986s def inner(*args, **kwds): 5986s with self._recreate_cm(): 5986s > return func(*args, **kwds) 5986s 5986s /usr/lib/python3.13/contextlib.py:85: 5986s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5986s /usr/lib/python3.13/contextlib.py:85: in inner 5986s return func(*args, **kwds) 5986s /usr/lib/python3/dist-packages/distributed/utils_test.py:1102: in test_func 5986s return _run_and_close_tornado(async_fn_outer) 5986s /usr/lib/python3/dist-packages/distributed/utils_test.py:378: in _run_and_close_tornado 5986s return asyncio_run(inner_fn(), loop_factory=get_loop_factory()) 5986s /usr/lib/python3.13/asyncio/runners.py:194: in run 5986s return runner.run(main) 5986s /usr/lib/python3.13/asyncio/runners.py:118: in run 5986s return self._loop.run_until_complete(task) 5986s /usr/lib/python3.13/asyncio/base_events.py:720: in run_until_complete 5986s return future.result() 5986s /usr/lib/python3/dist-packages/distributed/utils_test.py:375: in inner_fn 5986s return await async_fn(*args, **kwargs) 5986s /usr/lib/python3/dist-packages/distributed/utils_test.py:1099: in async_fn_outer 5986s return await utils_wait_for(async_fn(), timeout=timeout * 2) 5986s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 5986s async with asyncio.timeout(timeout): 5986s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5986s 5986s self = 5986s exc_type = 5986s exc_val = CancelledError(), exc_tb = 5986s 5986s async def __aexit__( 5986s self, 5986s exc_type: Optional[Type[BaseException]], 5986s exc_val: Optional[BaseException], 5986s exc_tb: Optional[TracebackType], 5986s ) -> Optional[bool]: 5986s assert self._state in (_State.ENTERED, _State.EXPIRING) 5986s 5986s if self._timeout_handler is not None: 5986s self._timeout_handler.cancel() 5986s self._timeout_handler = None 5986s 5986s if self._state is _State.EXPIRING: 5986s self._state = _State.EXPIRED 5986s 5986s if self._task.uncancel() <= self._cancelling and exc_type is not None: 5986s # Since there are no new cancel requests, we're 5986s # handling this. 5986s if issubclass(exc_type, exceptions.CancelledError): 5986s > raise TimeoutError from exc_val 5986s E TimeoutError 5986s 5986s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 5986s ----------------------------- Captured stderr call ----------------------------- 5986s 2024-11-23 21:57:37,268 - distributed.scheduler - INFO - State start 5986s 2024-11-23 21:57:37,275 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:37,275 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41167/status 5986s 2024-11-23 21:57:37,275 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 21:57:37,287 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38505 5986s 2024-11-23 21:57:37,287 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38505 5986s 2024-11-23 21:57:37,287 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 21:57:37,287 - distributed.worker - INFO - dashboard at: 127.0.0.1:35033 5986s 2024-11-23 21:57:37,288 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:37,288 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:57:37,288 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 21:57:37,288 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:57:37,288 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-vgsfs1ge 5986s 2024-11-23 21:57:37,288 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:57:37,289 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33227 5986s 2024-11-23 21:57:37,289 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33227 5986s 2024-11-23 21:57:37,290 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 21:57:37,290 - distributed.worker - INFO - dashboard at: 127.0.0.1:41385 5986s 2024-11-23 21:57:37,290 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:37,290 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:57:37,290 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 21:57:37,290 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:57:37,290 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-kh1syfki 5986s 2024-11-23 21:57:37,290 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:57:37,302 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:37,302 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:37,302 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:50890': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:37,302 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:50892': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:37,415 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:37,415 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:37,416 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:50906': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:37,416 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:50908': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:37,528 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:37,528 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:37,529 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:50914': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:37,529 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:50930': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:37,640 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:37,641 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:37,641 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:50938': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:37,641 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:50944': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:37,753 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:37,754 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:37,754 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:50952': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:37,754 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:50964': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:37,865 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:37,866 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:37,866 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:50968': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:37,866 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:50972': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:37,973 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:37,977 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:50978': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:37,978 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:37,978 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:50990': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:38,080 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:38,081 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:51002': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:38,086 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:38,087 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:51008': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:38,187 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:38,188 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:51022': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:38,193 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:38,194 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:51032': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:38,295 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:38,296 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:51048': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:38,301 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:38,301 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:51060': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:38,402 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:38,403 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:51070': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:38,408 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:38,409 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:51082': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:38,518 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:38,519 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:51098': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:38,524 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:38,524 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:51100': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:38,625 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:38,625 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:51116': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:38,631 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:38,631 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:51124': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:38,732 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:38,733 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:51126': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:38,738 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:38,738 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:51136': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:38,840 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:38,841 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:51144': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:38,846 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:38,847 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:51152': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:38,948 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:38,948 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:51156': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:38,954 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:38,954 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:51172': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:39,055 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:39,055 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:51176': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:39,061 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:39,061 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:51188': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:39,162 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:39,165 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:51204': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:39,171 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:39,171 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:51212': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:39,269 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:39,269 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:51222': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:39,277 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:39,280 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:51224': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:39,376 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:39,376 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:51236': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:39,384 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:39,385 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:51250': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:39,482 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:39,482 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:51266': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:39,490 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:39,491 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:51282': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:39,589 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:39,589 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:51296': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:39,597 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:39,597 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:51300': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:39,697 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:39,697 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:51304': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:39,703 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:39,703 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:51320': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:39,803 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:39,804 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:51336': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:39,809 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:39,810 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:51344': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:39,910 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:39,911 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:51350': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:39,917 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:39,917 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:51362': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:40,018 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:40,018 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:51372': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:40,024 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:40,024 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:51388': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:40,125 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:40,126 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:51402': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:40,131 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:40,131 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:51408': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:40,232 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:40,233 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:51424': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:40,238 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:40,239 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:51438': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:40,340 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:40,340 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:51448': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:40,346 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:40,346 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:51452': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:40,447 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:40,447 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:51456': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:40,453 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:40,453 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:51468': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:40,554 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:40,554 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:51482': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:40,560 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:40,560 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:51498': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:40,661 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:40,661 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:51508': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:40,667 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:40,667 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:51518': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:40,769 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:40,769 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:51532': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:40,775 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:40,775 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:51540': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:40,948 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:40,949 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:40,949 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:51550': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:40,949 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:51552': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:41,060 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:41,060 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:41,061 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:51562': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:41,061 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:51576': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:41,173 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:41,173 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:41,173 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:51580': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:41,173 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:51596': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:41,288 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:41,288 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:41,289 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:51600': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:41,289 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:51606': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:41,401 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:41,401 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:41,401 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:51608': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:41,401 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:51618': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:41,513 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:41,513 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:41,514 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:51622': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:41,514 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:51636': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:41,625 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:41,625 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:41,625 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:33022': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:41,625 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:33030': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:41,738 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:41,738 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:41,738 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:33032': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:41,738 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:33046': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:41,854 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:41,854 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:41,854 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:33060': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:41,855 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:33064': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:41,967 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:41,967 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:41,967 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:33068': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:41,967 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:33082': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:42,078 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:42,079 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:42,079 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:33098': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:42,079 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:33106': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:42,192 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:42,192 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:42,193 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:33120': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:42,193 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:33126': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:42,305 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:42,305 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:42,305 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:33130': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:42,305 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:33134': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:42,417 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:42,418 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:42,418 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:33146': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:42,418 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:33156': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:42,530 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:42,531 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:42,531 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:33158': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:42,531 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:33160': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:42,646 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:42,646 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:42,647 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:33166': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:42,647 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:33174': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:42,761 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:42,761 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:42,762 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:33190': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:42,762 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:33198': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:42,874 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:42,874 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:42,874 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:33202': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:42,874 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:33214': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:42,986 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:42,987 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:42,987 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:33230': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:42,987 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:33236': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:43,099 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:43,099 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:43,099 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:33252': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:43,099 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:33268': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:43,212 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:43,212 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:43,212 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:33278': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:43,212 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:33286': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:43,324 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:43,324 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:43,325 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:33292': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:43,325 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:33302': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:43,437 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:43,437 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:43,437 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:33314': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:43,437 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:33328': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:43,549 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:43,549 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:43,550 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:33338': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:43,550 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:33348': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:43,661 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:43,662 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:43,662 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:33362': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:43,662 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:33376': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:43,774 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:43,775 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:43,775 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:33384': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:43,775 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:33388': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:43,888 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:43,888 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:43,889 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:33400': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:43,889 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:33402': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:44,001 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:44,002 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:44,002 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:33414': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:44,002 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:33430': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:44,113 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:44,114 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:44,114 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:33446': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:44,114 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:33458': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:44,226 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:44,226 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:44,226 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:33472': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:44,226 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:33476': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:44,339 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:44,340 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:44,340 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:33484': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:44,340 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:33488': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:44,452 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:44,453 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:44,453 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:33504': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:44,453 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:33510': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:44,566 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:44,566 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:44,567 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:33518': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:44,567 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:33532': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:44,678 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:44,679 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:44,679 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:33538': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:44,679 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:33546': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:44,794 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:44,794 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:44,794 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:33550': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:44,794 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:33564': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:44,906 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:44,906 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:44,906 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:33580': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:44,906 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:33596': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:45,017 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:45,017 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:45,018 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:33610': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:45,018 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:33618': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:45,129 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:45,130 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:45,130 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:33626': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:45,130 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:33632': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:45,243 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:45,244 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:45,244 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:33646': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:45,244 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:33654': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:45,357 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:45,357 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:45,357 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:33666': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:45,357 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:33670': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:45,469 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:45,470 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:45,470 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:33686': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:45,470 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:33690': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:45,582 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:45,582 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:45,583 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:33706': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:45,583 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:33720': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:45,695 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:45,696 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:45,696 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:33730': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:45,696 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:33740': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:45,808 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:45,808 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:45,808 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:33750': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:45,808 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:33758': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:45,920 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:45,920 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:45,920 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:33766': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:45,920 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:33780': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:46,034 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:46,034 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:46,035 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:33796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:46,035 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:33804': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:46,149 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:46,149 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:46,149 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:33808': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:46,149 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:33822': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:46,262 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:46,262 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:46,263 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:33826': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:46,263 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:33836': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:46,375 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:46,375 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:46,375 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:33852': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:46,375 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:33864': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:46,489 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:46,490 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:46,490 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:33870': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:46,490 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:33874': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:46,603 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:46,603 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:46,603 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:33876': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:46,604 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:33882': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:46,717 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:46,717 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:46,717 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:33888': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:46,717 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:33900': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:46,829 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:46,829 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:46,829 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:33904': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:46,829 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:33910': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:46,941 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:46,941 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:46,941 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:33918': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:46,942 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:33926': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:47,054 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:47,054 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:47,054 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:33938': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:47,054 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:33954': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:47,166 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:47,166 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:47,166 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:33958': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:47,166 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:33974': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:47,278 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:47,278 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:47,281 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:33990': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:47,281 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:33996': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:47,390 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:47,391 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:47,391 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:34000': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:47,391 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:34002': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:47,503 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:47,503 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:47,503 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:34004': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:47,503 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:34014': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:47,614 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:47,614 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:47,615 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:34028': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:47,615 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:34030': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:47,727 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:47,727 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:47,727 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:34046': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:47,727 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:34058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:47,838 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:47,839 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:47,839 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:34062': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:47,839 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:34064': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:47,951 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:47,951 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:47,951 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:34072': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:47,951 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:34088': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:48,063 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:48,063 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:48,064 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:34104': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:48,064 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:34118': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:48,176 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:48,176 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:48,176 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:34134': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:48,176 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:34140': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:48,290 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:48,290 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:48,291 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:34154': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:48,291 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:34170': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:48,403 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:48,403 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:48,403 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:34172': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:48,403 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:34176': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:48,515 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:48,515 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:48,516 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:34192': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:48,516 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:34208': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:48,629 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:48,629 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:48,629 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:34212': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:48,629 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:34216': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:48,741 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:48,741 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:48,741 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:34230': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:48,741 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:34232': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:48,852 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:48,853 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:48,853 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:34246': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:48,853 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:34260': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:48,965 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:48,965 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:48,965 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:34272': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:48,965 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:34274': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:49,077 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:49,077 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:49,078 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:34278': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:49,078 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:34290': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:49,190 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:49,190 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:49,190 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:34292': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:49,190 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:34306': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:49,302 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:49,302 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:49,302 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:34316': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:49,302 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:34326': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:49,414 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:49,414 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:49,414 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:34330': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:49,414 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:34344': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:49,526 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:49,526 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:49,527 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:34358': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:49,527 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:34362': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:49,639 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:49,639 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:49,639 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:34374': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:49,639 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:34380': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:49,751 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:49,751 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:49,751 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:34392': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:49,751 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:34402': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:49,866 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:49,866 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:49,866 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:34416': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:49,866 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:34420': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:49,985 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:49,985 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:49,986 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:34436': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:49,986 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:34448': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:50,099 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:50,099 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:50,099 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:34456': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:50,099 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:34470': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:50,210 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:50,210 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:50,212 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:34482': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:50,212 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:34494': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:50,323 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:50,324 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:50,324 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:34508': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:50,324 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:34512': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:50,436 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:50,436 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:50,436 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:34514': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:50,436 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:34528': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:50,548 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:50,548 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:50,549 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:34538': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:50,549 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:34546': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:50,660 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:50,661 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:50,661 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:34548': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:50,661 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:34554': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:50,772 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:50,773 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:50,773 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:34560': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:50,773 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:34568': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:50,885 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:50,885 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:50,886 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:34584': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:50,886 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:34592': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:50,998 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:50,998 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:50,998 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:34594': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:50,998 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:34608': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:51,109 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:51,109 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:51,110 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:34616': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:51,110 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:34630': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:51,222 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:51,222 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:51,222 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:34642': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:51,222 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:34650': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:51,333 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:51,333 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:51,334 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:34666': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:51,334 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:34680': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:51,445 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:51,446 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:51,446 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:34686': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:51,446 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:34702': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:51,557 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:51,557 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:51,557 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:46658': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:51,557 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:46670': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:51,669 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:51,670 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:51,670 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:46672': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:51,670 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:46674': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:51,783 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:51,783 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:51,786 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:46682': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:51,786 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:46698': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:51,894 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:51,894 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:51,895 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:46704': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:51,895 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:46706': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:52,007 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:52,007 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:52,007 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:46718': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:52,007 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:46730': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:52,118 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:52,119 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:52,119 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:46732': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:52,119 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:46742': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:52,231 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:52,231 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34063 5986s 2024-11-23 21:57:52,231 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:46750': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:52,231 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34063': TLS handshake failed with remote 'tls://127.0.0.1:46762': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:52,286 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38505. Reason: failure-to-start- 5986s 2024-11-23 21:57:52,287 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:57:52,289 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 15s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 5986s stream = await stream.start_tls( 5986s ^^^^^^^^^^^^^^^^^^^^^^^ 5986s False, ssl_options=ssl_options, server_hostname=host 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 5986s self.socket.do_handshake() 5986s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 5986s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 5986s self._sslobj.do_handshake() 5986s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 5986s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 5986s raise FatalCommClosedError( 5986s ...<2 lines>... 5986s ) from err 5986s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 5986s 5986s During handling of the above exception, another exception occurred: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1218, in _register_with_scheduler 5986s await asyncio.sleep(0.1) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 718, in sleep 5986s return await future 5986s ^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 15s. 5986s 2024-11-23 21:57:52,292 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33227. Reason: failure-to-start- 5986s 2024-11-23 21:57:52,292 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:57:53,295 - distributed.scheduler - INFO - State start 5986s 2024-11-23 21:57:53,302 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36841 5986s 2024-11-23 21:57:53,302 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40447/status 5986s 2024-11-23 21:57:53,302 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 21:57:53,312 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38963 5986s 2024-11-23 21:57:53,312 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38963 5986s 2024-11-23 21:57:53,312 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 21:57:53,312 - distributed.worker - INFO - dashboard at: 127.0.0.1:41147 5986s 2024-11-23 21:57:53,312 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:57:53,312 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:57:53,312 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 21:57:53,312 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:57:53,312 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-bg21iowx 5986s 2024-11-23 21:57:53,312 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:57:53,314 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46615 5986s 2024-11-23 21:57:53,314 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46615 5986s 2024-11-23 21:57:53,314 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 21:57:53,314 - distributed.worker - INFO - dashboard at: 127.0.0.1:34939 5986s 2024-11-23 21:57:53,314 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:57:53,314 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:57:53,314 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 21:57:53,314 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:57:53,314 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-egng8a5_ 5986s 2024-11-23 21:57:53,314 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:57:53,326 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:57:53,327 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:57:53,327 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:49104': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:53,327 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:49120': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:53,439 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:57:53,439 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:57:53,439 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:49134': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:53,439 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:49150': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:53,550 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:57:53,550 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:57:53,550 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:49164': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:53,550 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:49170': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:53,661 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:57:53,661 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:57:53,662 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:49186': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:53,662 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:49202': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:53,774 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:57:53,774 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:57:53,775 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:49206': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:53,775 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:49220': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:53,886 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:57:53,886 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:57:53,886 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:49222': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:53,886 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:49230': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:53,997 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:57:53,998 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:57:53,998 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:49238': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:53,998 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:49248': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:54,109 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:57:54,109 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:57:54,110 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:49250': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:54,110 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:49266': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:54,222 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:57:54,222 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:57:54,222 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:49268': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:54,222 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:49284': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:54,333 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:57:54,333 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:57:54,334 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:49288': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:54,334 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:49296': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:54,445 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:57:54,445 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:57:54,445 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:49300': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:54,445 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:49302': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:54,557 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:57:54,557 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:57:54,557 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:49316': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:54,557 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:49320': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:54,669 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:57:54,669 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:57:54,670 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:49330': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:54,670 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:49334': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:54,783 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:57:54,783 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:57:54,787 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:49348': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:54,787 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:49354': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:54,895 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:57:54,895 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:57:54,895 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:49358': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:54,895 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:49366': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:55,007 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:57:55,007 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:57:55,008 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:49382': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:55,008 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:49398': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:55,120 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:57:55,120 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:57:55,121 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:49404': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:55,121 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:49416': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:55,231 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:57:55,232 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:57:55,232 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:49432': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:55,232 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:49440': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:55,344 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:57:55,344 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:57:55,345 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:49444': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:55,345 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:49456': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:55,456 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:57:55,456 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:57:55,456 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:49466': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:55,456 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:49476': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:55,567 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:57:55,568 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:57:55,568 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:49488': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:55,568 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:49494': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:55,680 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:57:55,680 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:57:55,680 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:49498': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:55,680 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:49514': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:55,791 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:57:55,791 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:57:55,791 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:49524': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:55,791 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:49534': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:55,903 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:57:55,903 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:57:55,903 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:49548': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:55,903 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:49552': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:56,015 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:57:56,015 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:57:56,016 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:49556': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:56,016 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:49566': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:56,127 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:57:56,127 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:57:56,127 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:49574': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:56,127 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:49580': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:56,239 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:57:56,239 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:57:56,240 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:49594': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:56,240 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:49596': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:56,352 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:57:56,352 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:57:56,352 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:49610': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:56,353 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:49618': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:56,463 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:57:56,464 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:57:56,464 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:49634': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:56,464 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:49648': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:56,575 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:57:56,575 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:57:56,576 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:49664': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:56,576 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:49680': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:56,688 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:57:56,688 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:57:56,688 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:49682': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:56,688 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:49694': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:56,800 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:57:56,801 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:57:56,801 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:49708': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:56,801 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:49722': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:56,913 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:57:56,913 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:57:56,913 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:49724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:56,913 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:49740': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:57,025 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:57:57,025 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:57:57,026 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:49754': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:57,026 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:49760': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:57,137 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:57:57,137 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:57:57,137 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:49772': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:57,137 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:49786': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:57,249 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:57:57,249 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:57:57,250 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:49798': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:57,250 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:49812': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:57,361 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:57:57,361 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:57:57,361 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:49828': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:57,361 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:49830': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:57,472 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:57:57,472 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:57:57,472 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:49836': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:57,472 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:49838': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:57,584 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:57:57,584 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:57:57,584 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:49840': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:57,584 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:49842': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:57,695 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:57:57,696 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:57:57,696 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:49858': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:57,696 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:49862': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:57,808 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:57:57,808 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:57:57,810 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:49874': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:57,811 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:49884': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:57,920 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:57:57,920 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:57:57,921 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:49896': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:57,921 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:49898': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:58,032 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:57:58,032 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:57:58,033 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:49912': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:58,033 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:49916': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:58,144 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:57:58,144 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:57:58,144 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:49920': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:58,144 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:49934': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:58,256 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:57:58,256 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:57:58,257 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:49944': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:58,257 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:49954': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:58,368 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:57:58,368 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:57:58,368 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:49960': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:58,368 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:49974': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:58,480 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:57:58,480 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:57:58,481 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:49980': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:58,481 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:49990': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:58,592 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:57:58,592 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:57:58,593 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:50004': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:58,593 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:50014': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:58,705 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:57:58,706 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:57:58,706 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:50020': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:58,706 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:50034': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:58,818 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:57:58,818 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:57:58,818 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:50046': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:58,818 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:50062': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:58,930 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:57:58,930 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:57:58,931 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:50072': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:58,931 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:50088': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:59,042 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:57:59,042 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:57:59,042 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:50094': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:59,042 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:50104': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:59,154 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:57:59,154 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:57:59,155 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:50108': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:59,155 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:50116': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:59,266 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:57:59,266 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:57:59,266 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:50126': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:59,266 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:50132': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:59,377 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:57:59,377 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:57:59,378 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:50136': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:59,378 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:50142': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:59,490 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:57:59,490 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:57:59,490 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:50152': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:59,490 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:50160': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:59,604 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:57:59,604 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:57:59,604 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:50164': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:59,604 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:50174': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:59,715 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:57:59,715 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:57:59,716 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:50178': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:59,716 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:50184': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:59,827 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:57:59,827 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:57:59,827 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:50192': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:59,827 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:50200': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:59,939 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:57:59,939 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:57:59,939 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:50212': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:57:59,939 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:50216': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:00,051 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:58:00,052 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:58:00,052 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:50218': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:00,052 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:50232': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:00,163 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:58:00,164 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:58:00,164 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:50246': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:00,164 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:50254': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:00,276 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:58:00,276 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:58:00,276 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:50262': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:00,276 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:50268': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:00,389 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:58:00,389 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:58:00,389 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:50272': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:00,389 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:50286': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:00,503 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:58:00,503 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:58:00,503 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:50290': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:00,503 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:50294': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:00,614 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:58:00,615 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:58:00,615 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:50310': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:00,615 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:50320': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:00,726 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:58:00,726 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:58:00,727 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:50322': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:00,727 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:50326': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:00,838 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:58:00,838 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:58:00,839 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:50330': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:00,839 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:50336': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:00,952 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:58:00,952 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:58:00,952 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:50348': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:00,952 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:50362': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:01,064 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:58:01,064 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:58:01,065 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:50366': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:01,065 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:50380': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:01,176 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:58:01,177 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:58:01,177 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:50394': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:01,177 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:50408': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:01,291 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:58:01,291 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:58:01,291 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:50412': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:01,291 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:50420': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:01,403 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:58:01,403 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:58:01,403 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:50428': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:01,404 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:50444': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:01,514 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:58:01,515 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:58:01,515 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:50460': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:01,515 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:50468': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:01,627 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:58:01,627 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:58:01,627 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:40126': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:01,627 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:40140': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:01,738 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:58:01,738 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:58:01,738 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:40142': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:01,739 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:40144': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:01,850 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:58:01,850 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:58:01,850 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:40152': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:01,850 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:40158': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:01,961 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:58:01,962 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:58:01,962 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:40164': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:01,962 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:40180': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:02,074 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:58:02,075 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:58:02,075 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:40194': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:02,075 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:40210': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:02,187 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:58:02,187 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:58:02,188 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:40218': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:02,188 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:40232': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:02,301 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:58:02,301 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:58:02,302 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:40244': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:02,302 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:40250': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:02,413 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:58:02,413 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:58:02,413 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:40254': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:02,413 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:40260': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:02,525 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:58:02,525 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:58:02,526 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:40270': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:02,526 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:40278': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:02,637 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:58:02,637 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:58:02,637 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:40284': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:02,637 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:40288': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:02,748 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:58:02,749 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:58:02,749 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:40292': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:02,749 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:40294': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:02,860 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:58:02,860 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:58:02,861 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:40296': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:02,861 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:40302': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:02,972 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:58:02,972 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:58:02,973 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:40314': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:02,973 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:40330': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:03,084 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:58:03,085 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:58:03,085 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:40334': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:03,085 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:40348': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:03,197 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:58:03,198 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:58:03,198 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:40354': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:03,198 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:40370': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:03,318 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:58:03,318 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:58:03,323 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:40382': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:03,323 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:40396': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:03,431 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:58:03,431 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:58:03,431 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:40400': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:03,431 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:40402': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:03,542 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:58:03,542 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:58:03,542 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:40406': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:03,542 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:40420': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:03,653 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:58:03,653 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:58:03,653 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:40434': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:03,654 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:40450': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:03,765 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:58:03,765 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:58:03,766 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:40452': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:03,766 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:40462': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:03,877 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:58:03,877 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:58:03,877 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:40470': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:03,877 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:40482': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:03,989 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:58:03,989 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:58:03,989 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:40492': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:03,989 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:40506': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:04,102 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:58:04,102 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:58:04,102 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:40518': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:04,102 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:40528': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:04,215 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:58:04,215 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:58:04,215 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:40544': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:04,215 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:40560': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:04,327 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:58:04,327 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:58:04,327 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:40570': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:04,328 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:40576': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:04,438 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:58:04,439 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:58:04,439 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:40584': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:04,439 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:40598': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:04,550 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:58:04,550 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:58:04,551 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:40614': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:04,551 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:40618': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:04,662 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:58:04,662 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:58:04,662 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:40628': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:04,662 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:40632': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:04,776 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:58:04,776 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:58:04,776 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:40640': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:04,777 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:40650': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:04,888 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:58:04,888 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:58:04,889 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:40654': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:04,889 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:40662': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:05,000 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:58:05,000 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:58:05,000 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:40676': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:05,000 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:40680': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:05,112 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:58:05,112 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:58:05,112 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:40692': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:05,112 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:40702': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:05,224 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:58:05,224 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:58:05,224 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:40718': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:05,224 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:40730': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:05,336 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:58:05,336 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:58:05,336 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:40736': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:05,336 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:40746': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:05,447 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:58:05,448 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:58:05,448 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:40754': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:05,448 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:40758': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:05,559 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:58:05,559 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:58:05,560 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:40766': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:05,560 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:40770': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:05,671 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:58:05,672 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:58:05,672 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:40782': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:05,672 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:40792': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:05,784 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:58:05,784 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:58:05,787 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:40802': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:05,787 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:40806': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:05,896 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:58:05,896 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:58:05,896 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:40812': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:05,897 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:40820': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:06,008 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:58:06,008 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:58:06,008 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:40824': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:06,009 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:40834': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:06,120 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:58:06,120 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:58:06,120 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:40838': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:06,120 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:40840': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:06,232 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:58:06,233 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36841 5986s 2024-11-23 21:58:06,233 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:40848': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:06,233 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36841': TLS handshake failed with remote 'tls://127.0.0.1:40860': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:06,311 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38963. Reason: failure-to-start- 5986s 2024-11-23 21:58:06,312 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:58:06,313 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46615. Reason: failure-to-start- 5986s 2024-11-23 21:58:06,313 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:58:06,314 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 13s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 5986s stream = await stream.start_tls( 5986s ^^^^^^^^^^^^^^^^^^^^^^^ 5986s False, ssl_options=ssl_options, server_hostname=host 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 5986s self.socket.do_handshake() 5986s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 5986s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 5986s self._sslobj.do_handshake() 5986s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 5986s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 5986s raise FatalCommClosedError( 5986s ...<2 lines>... 5986s ) from err 5986s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 5986s 5986s During handling of the above exception, another exception occurred: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1218, in _register_with_scheduler 5986s await asyncio.sleep(0.1) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 718, in sleep 5986s return await future 5986s ^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 13s. 5986s 2024-11-23 21:58:07,321 - distributed.scheduler - INFO - State start 5986s 2024-11-23 21:58:07,328 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41699 5986s 2024-11-23 21:58:07,329 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37415/status 5986s 2024-11-23 21:58:07,329 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 21:58:07,339 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:32855 5986s 2024-11-23 21:58:07,339 - distributed.worker - INFO - Listening to: tls://127.0.0.1:32855 5986s 2024-11-23 21:58:07,340 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 21:58:07,340 - distributed.worker - INFO - dashboard at: 127.0.0.1:35811 5986s 2024-11-23 21:58:07,340 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41699 5986s 2024-11-23 21:58:07,340 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:58:07,340 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 21:58:07,340 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:58:07,340 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-d2uekdx2 5986s 2024-11-23 21:58:07,340 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:58:07,341 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42243 5986s 2024-11-23 21:58:07,341 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42243 5986s 2024-11-23 21:58:07,342 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 21:58:07,342 - distributed.worker - INFO - dashboard at: 127.0.0.1:44457 5986s 2024-11-23 21:58:07,342 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41699 5986s 2024-11-23 21:58:07,342 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:58:07,342 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 21:58:07,342 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:58:07,342 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-zim1zp70 5986s 2024-11-23 21:58:07,342 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:58:07,343 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:32855. Reason: failure-to-start- 5986s 2024-11-23 21:58:07,343 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:58:07,343 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42243. Reason: failure-to-start- 5986s 2024-11-23 21:58:07,343 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:58:07,344 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41699': TLS handshake failed with remote 'tls://127.0.0.1:34776': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:58:07,344 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41699': TLS handshake failed with remote 'tls://127.0.0.1:34786': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:58:07,346 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 21:58:08,350 - distributed.scheduler - INFO - State start 5986s 2024-11-23 21:58:08,356 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44605 5986s 2024-11-23 21:58:08,356 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46007/status 5986s 2024-11-23 21:58:08,357 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 21:58:08,369 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41841 5986s 2024-11-23 21:58:08,369 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41841 5986s 2024-11-23 21:58:08,369 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 21:58:08,369 - distributed.worker - INFO - dashboard at: 127.0.0.1:43069 5986s 2024-11-23 21:58:08,369 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44605 5986s 2024-11-23 21:58:08,369 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:58:08,369 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 21:58:08,369 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:58:08,369 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-4yjpqjp4 5986s 2024-11-23 21:58:08,369 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:58:08,371 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45997 5986s 2024-11-23 21:58:08,371 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45997 5986s 2024-11-23 21:58:08,371 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 21:58:08,371 - distributed.worker - INFO - dashboard at: 127.0.0.1:33727 5986s 2024-11-23 21:58:08,371 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44605 5986s 2024-11-23 21:58:08,371 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:58:08,371 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 21:58:08,371 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:58:08,371 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-zic_o2wh 5986s 2024-11-23 21:58:08,371 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:58:08,372 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41841. Reason: failure-to-start- 5986s 2024-11-23 21:58:08,372 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:58:08,373 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45997. Reason: failure-to-start- 5986s 2024-11-23 21:58:08,373 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:58:08,374 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44605': TLS handshake failed with remote 'tls://127.0.0.1:53306': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:58:08,374 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44605': TLS handshake failed with remote 'tls://127.0.0.1:53322': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:58:08,375 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 21:58:09,381 - distributed.scheduler - INFO - State start 5986s 2024-11-23 21:58:09,387 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41943 5986s 2024-11-23 21:58:09,387 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45845/status 5986s 2024-11-23 21:58:09,387 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 21:58:09,399 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39127 5986s 2024-11-23 21:58:09,399 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39127 5986s 2024-11-23 21:58:09,399 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 21:58:09,399 - distributed.worker - INFO - dashboard at: 127.0.0.1:41379 5986s 2024-11-23 21:58:09,399 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41943 5986s 2024-11-23 21:58:09,399 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:58:09,399 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 21:58:09,399 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:58:09,399 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-u_bjbo4q 5986s 2024-11-23 21:58:09,400 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:58:09,402 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41949 5986s 2024-11-23 21:58:09,402 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41949 5986s 2024-11-23 21:58:09,402 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 21:58:09,402 - distributed.worker - INFO - dashboard at: 127.0.0.1:42113 5986s 2024-11-23 21:58:09,402 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41943 5986s 2024-11-23 21:58:09,402 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:58:09,402 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 21:58:09,402 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:58:09,402 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-9t6jlxy3 5986s 2024-11-23 21:58:09,403 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:58:09,403 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39127. Reason: failure-to-start- 5986s 2024-11-23 21:58:09,404 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:58:09,404 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41949. Reason: failure-to-start- 5986s 2024-11-23 21:58:09,404 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:58:09,405 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41943': TLS handshake failed with remote 'tls://127.0.0.1:35210': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:58:09,405 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41943': TLS handshake failed with remote 'tls://127.0.0.1:35212': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:58:09,407 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 21:58:10,411 - distributed.scheduler - INFO - State start 5986s 2024-11-23 21:58:10,417 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39159 5986s 2024-11-23 21:58:10,418 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35475/status 5986s 2024-11-23 21:58:10,418 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 21:58:10,430 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37711 5986s 2024-11-23 21:58:10,430 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37711 5986s 2024-11-23 21:58:10,430 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 21:58:10,430 - distributed.worker - INFO - dashboard at: 127.0.0.1:41365 5986s 2024-11-23 21:58:10,430 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39159 5986s 2024-11-23 21:58:10,430 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:58:10,430 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 21:58:10,430 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:58:10,430 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-541dttkh 5986s 2024-11-23 21:58:10,430 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:58:10,432 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36141 5986s 2024-11-23 21:58:10,432 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36141 5986s 2024-11-23 21:58:10,433 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 21:58:10,433 - distributed.worker - INFO - dashboard at: 127.0.0.1:43895 5986s 2024-11-23 21:58:10,433 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39159 5986s 2024-11-23 21:58:10,433 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:58:10,433 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 21:58:10,433 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:58:10,433 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-717mnb5a 5986s 2024-11-23 21:58:10,433 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:58:10,434 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37711. Reason: failure-to-start- 5986s 2024-11-23 21:58:10,434 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:58:10,434 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36141. Reason: failure-to-start- 5986s 2024-11-23 21:58:10,434 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:58:10,436 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39159': TLS handshake failed with remote 'tls://127.0.0.1:42236': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:58:10,436 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39159': TLS handshake failed with remote 'tls://127.0.0.1:42238': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:58:10,437 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 21:58:11,443 - distributed.scheduler - INFO - State start 5986s 2024-11-23 21:58:11,449 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44809 5986s 2024-11-23 21:58:11,450 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43025/status 5986s 2024-11-23 21:58:11,450 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 21:58:11,460 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40743 5986s 2024-11-23 21:58:11,461 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40743 5986s 2024-11-23 21:58:11,461 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 21:58:11,461 - distributed.worker - INFO - dashboard at: 127.0.0.1:45853 5986s 2024-11-23 21:58:11,461 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44809 5986s 2024-11-23 21:58:11,461 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:58:11,461 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 21:58:11,461 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:58:11,461 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-84vwrovf 5986s 2024-11-23 21:58:11,461 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:58:11,462 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37257 5986s 2024-11-23 21:58:11,463 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37257 5986s 2024-11-23 21:58:11,463 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 21:58:11,463 - distributed.worker - INFO - dashboard at: 127.0.0.1:34927 5986s 2024-11-23 21:58:11,463 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44809 5986s 2024-11-23 21:58:11,463 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:58:11,463 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 21:58:11,463 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:58:11,463 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-a9d3nsu8 5986s 2024-11-23 21:58:11,463 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:58:11,464 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40743. Reason: failure-to-start- 5986s 2024-11-23 21:58:11,464 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:58:11,464 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37257. Reason: failure-to-start- 5986s 2024-11-23 21:58:11,464 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:58:11,465 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44809': TLS handshake failed with remote 'tls://127.0.0.1:42674': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:58:11,465 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44809': TLS handshake failed with remote 'tls://127.0.0.1:42688': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:58:11,467 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 21:58:12,471 - distributed.scheduler - INFO - State start 5986s 2024-11-23 21:58:12,477 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33449 5986s 2024-11-23 21:58:12,477 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45607/status 5986s 2024-11-23 21:58:12,477 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 21:58:12,489 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36199 5986s 2024-11-23 21:58:12,489 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36199 5986s 2024-11-23 21:58:12,489 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 21:58:12,489 - distributed.worker - INFO - dashboard at: 127.0.0.1:40379 5986s 2024-11-23 21:58:12,489 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33449 5986s 2024-11-23 21:58:12,490 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:58:12,490 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 21:58:12,490 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:58:12,490 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-afcp5veo 5986s 2024-11-23 21:58:12,490 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:58:12,491 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39223 5986s 2024-11-23 21:58:12,491 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39223 5986s 2024-11-23 21:58:12,491 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 21:58:12,491 - distributed.worker - INFO - dashboard at: 127.0.0.1:38863 5986s 2024-11-23 21:58:12,492 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33449 5986s 2024-11-23 21:58:12,492 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:58:12,492 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 21:58:12,492 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:58:12,492 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-_in1maqc 5986s 2024-11-23 21:58:12,492 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:58:12,493 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36199. Reason: failure-to-start- 5986s 2024-11-23 21:58:12,493 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:58:12,493 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39223. Reason: failure-to-start- 5986s 2024-11-23 21:58:12,493 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:58:12,494 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33449': TLS handshake failed with remote 'tls://127.0.0.1:59792': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:58:12,494 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33449': TLS handshake failed with remote 'tls://127.0.0.1:59794': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:58:12,496 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 21:58:13,500 - distributed.scheduler - INFO - State start 5986s 2024-11-23 21:58:13,507 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44065 5986s 2024-11-23 21:58:13,507 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46615/status 5986s 2024-11-23 21:58:13,507 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 21:58:13,520 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36483 5986s 2024-11-23 21:58:13,520 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36483 5986s 2024-11-23 21:58:13,520 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 21:58:13,520 - distributed.worker - INFO - dashboard at: 127.0.0.1:36243 5986s 2024-11-23 21:58:13,520 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44065 5986s 2024-11-23 21:58:13,520 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:58:13,520 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 21:58:13,520 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:58:13,520 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-_79cicen 5986s 2024-11-23 21:58:13,520 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:58:13,523 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41983 5986s 2024-11-23 21:58:13,523 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41983 5986s 2024-11-23 21:58:13,523 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 21:58:13,523 - distributed.worker - INFO - dashboard at: 127.0.0.1:36451 5986s 2024-11-23 21:58:13,523 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44065 5986s 2024-11-23 21:58:13,523 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:58:13,523 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 21:58:13,523 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:58:13,523 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-cf_eqnd8 5986s 2024-11-23 21:58:13,523 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:58:13,524 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36483. Reason: failure-to-start- 5986s 2024-11-23 21:58:13,524 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:58:13,524 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41983. Reason: failure-to-start- 5986s 2024-11-23 21:58:13,524 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:58:13,526 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44065': TLS handshake failed with remote 'tls://127.0.0.1:44102': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:58:13,526 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44065': TLS handshake failed with remote 'tls://127.0.0.1:44104': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:58:13,527 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 21:58:14,532 - distributed.scheduler - INFO - State start 5986s 2024-11-23 21:58:14,538 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39607 5986s 2024-11-23 21:58:14,539 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34139/status 5986s 2024-11-23 21:58:14,539 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 21:58:14,551 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43009 5986s 2024-11-23 21:58:14,551 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43009 5986s 2024-11-23 21:58:14,551 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 21:58:14,551 - distributed.worker - INFO - dashboard at: 127.0.0.1:39327 5986s 2024-11-23 21:58:14,551 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39607 5986s 2024-11-23 21:58:14,551 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:58:14,551 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 21:58:14,551 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:58:14,551 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-7nbpnpsi 5986s 2024-11-23 21:58:14,551 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:58:14,553 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46311 5986s 2024-11-23 21:58:14,553 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46311 5986s 2024-11-23 21:58:14,553 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 21:58:14,553 - distributed.worker - INFO - dashboard at: 127.0.0.1:38545 5986s 2024-11-23 21:58:14,553 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39607 5986s 2024-11-23 21:58:14,553 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:58:14,553 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 21:58:14,553 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:58:14,553 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-x0mlgf2j 5986s 2024-11-23 21:58:14,553 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:58:14,554 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43009. Reason: failure-to-start- 5986s 2024-11-23 21:58:14,554 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:58:14,555 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46311. Reason: failure-to-start- 5986s 2024-11-23 21:58:14,555 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:58:14,556 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39607': TLS handshake failed with remote 'tls://127.0.0.1:59766': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:58:14,556 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39607': TLS handshake failed with remote 'tls://127.0.0.1:59778': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:58:14,557 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 21:58:15,563 - distributed.scheduler - INFO - State start 5986s 2024-11-23 21:58:15,570 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37549 5986s 2024-11-23 21:58:15,570 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42551/status 5986s 2024-11-23 21:58:15,570 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 21:58:15,583 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38797 5986s 2024-11-23 21:58:15,583 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38797 5986s 2024-11-23 21:58:15,583 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 21:58:15,583 - distributed.worker - INFO - dashboard at: 127.0.0.1:42111 5986s 2024-11-23 21:58:15,583 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37549 5986s 2024-11-23 21:58:15,583 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:58:15,583 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 21:58:15,583 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:58:15,583 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-1ioebsxq 5986s 2024-11-23 21:58:15,583 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:58:15,585 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46845 5986s 2024-11-23 21:58:15,585 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46845 5986s 2024-11-23 21:58:15,585 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 21:58:15,585 - distributed.worker - INFO - dashboard at: 127.0.0.1:39489 5986s 2024-11-23 21:58:15,585 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37549 5986s 2024-11-23 21:58:15,585 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:58:15,585 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 21:58:15,585 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:58:15,585 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-miujjgqp 5986s 2024-11-23 21:58:15,585 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:58:15,586 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38797. Reason: failure-to-start- 5986s 2024-11-23 21:58:15,586 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:58:15,587 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46845. Reason: failure-to-start- 5986s 2024-11-23 21:58:15,587 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:58:15,588 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37549': TLS handshake failed with remote 'tls://127.0.0.1:34996': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:58:15,588 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37549': TLS handshake failed with remote 'tls://127.0.0.1:34998': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:58:15,589 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 21:58:16,594 - distributed.scheduler - INFO - State start 5986s 2024-11-23 21:58:16,600 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44805 5986s 2024-11-23 21:58:16,601 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40693/status 5986s 2024-11-23 21:58:16,601 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 21:58:16,614 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:32847 5986s 2024-11-23 21:58:16,614 - distributed.worker - INFO - Listening to: tls://127.0.0.1:32847 5986s 2024-11-23 21:58:16,615 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 21:58:16,615 - distributed.worker - INFO - dashboard at: 127.0.0.1:35633 5986s 2024-11-23 21:58:16,615 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44805 5986s 2024-11-23 21:58:16,615 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:58:16,615 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 21:58:16,615 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:58:16,615 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-u583_a7d 5986s 2024-11-23 21:58:16,615 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:58:16,616 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43903 5986s 2024-11-23 21:58:16,617 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43903 5986s 2024-11-23 21:58:16,617 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 21:58:16,617 - distributed.worker - INFO - dashboard at: 127.0.0.1:42609 5986s 2024-11-23 21:58:16,617 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44805 5986s 2024-11-23 21:58:16,617 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:58:16,617 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 21:58:16,617 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:58:16,617 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-r0xpl87b 5986s 2024-11-23 21:58:16,617 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:58:16,618 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:32847. Reason: failure-to-start- 5986s 2024-11-23 21:58:16,618 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:58:16,618 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43903. Reason: failure-to-start- 5986s 2024-11-23 21:58:16,619 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:58:16,620 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44805': TLS handshake failed with remote 'tls://127.0.0.1:55198': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:58:16,620 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44805': TLS handshake failed with remote 'tls://127.0.0.1:55208': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:58:16,621 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 21:58:17,627 - distributed.scheduler - INFO - State start 5986s 2024-11-23 21:58:17,633 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37025 5986s 2024-11-23 21:58:17,633 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37209/status 5986s 2024-11-23 21:58:17,633 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 21:58:17,651 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36405 5986s 2024-11-23 21:58:17,651 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36405 5986s 2024-11-23 21:58:17,651 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 21:58:17,651 - distributed.worker - INFO - dashboard at: 127.0.0.1:38681 5986s 2024-11-23 21:58:17,651 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37025 5986s 2024-11-23 21:58:17,651 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:58:17,651 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 21:58:17,651 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:58:17,651 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-279wnl08 5986s 2024-11-23 21:58:17,651 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:58:17,653 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:32955 5986s 2024-11-23 21:58:17,653 - distributed.worker - INFO - Listening to: tls://127.0.0.1:32955 5986s 2024-11-23 21:58:17,653 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 21:58:17,653 - distributed.worker - INFO - dashboard at: 127.0.0.1:45519 5986s 2024-11-23 21:58:17,653 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37025 5986s 2024-11-23 21:58:17,653 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:58:17,653 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 21:58:17,653 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:58:17,653 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-bcin_ln4 5986s 2024-11-23 21:58:17,653 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:58:17,654 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36405. Reason: failure-to-start- 5986s 2024-11-23 21:58:17,654 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:58:17,655 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:32955. Reason: failure-to-start- 5986s 2024-11-23 21:58:17,655 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:58:17,656 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37025': TLS handshake failed with remote 'tls://127.0.0.1:56104': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:58:17,656 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37025': TLS handshake failed with remote 'tls://127.0.0.1:56116': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:58:17,657 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 21:58:18,662 - distributed.scheduler - INFO - State start 5986s 2024-11-23 21:58:18,668 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39253 5986s 2024-11-23 21:58:18,669 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38805/status 5986s 2024-11-23 21:58:18,669 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 21:58:18,682 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34749 5986s 2024-11-23 21:58:18,682 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34749 5986s 2024-11-23 21:58:18,682 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 21:58:18,682 - distributed.worker - INFO - dashboard at: 127.0.0.1:44949 5986s 2024-11-23 21:58:18,682 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39253 5986s 2024-11-23 21:58:18,682 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:58:18,682 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 21:58:18,682 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:58:18,682 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-bjxq0jql 5986s 2024-11-23 21:58:18,682 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:58:18,684 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40895 5986s 2024-11-23 21:58:18,684 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40895 5986s 2024-11-23 21:58:18,684 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 21:58:18,684 - distributed.worker - INFO - dashboard at: 127.0.0.1:34983 5986s 2024-11-23 21:58:18,684 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39253 5986s 2024-11-23 21:58:18,684 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:58:18,684 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 21:58:18,684 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:58:18,684 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-z7u8m1ly 5986s 2024-11-23 21:58:18,684 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:58:18,685 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34749. Reason: failure-to-start- 5986s 2024-11-23 21:58:18,685 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:58:18,685 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40895. Reason: failure-to-start- 5986s 2024-11-23 21:58:18,686 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:58:18,687 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39253': TLS handshake failed with remote 'tls://127.0.0.1:49326': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:58:18,687 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39253': TLS handshake failed with remote 'tls://127.0.0.1:49336': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:58:18,688 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 21:58:19,695 - distributed.scheduler - INFO - State start 5986s 2024-11-23 21:58:19,701 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34273 5986s 2024-11-23 21:58:19,701 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43805/status 5986s 2024-11-23 21:58:19,702 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 21:58:19,712 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35411 5986s 2024-11-23 21:58:19,712 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35411 5986s 2024-11-23 21:58:19,712 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 21:58:19,713 - distributed.worker - INFO - dashboard at: 127.0.0.1:45305 5986s 2024-11-23 21:58:19,713 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34273 5986s 2024-11-23 21:58:19,713 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:58:19,713 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 21:58:19,713 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:58:19,713 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-56wpm6oj 5986s 2024-11-23 21:58:19,713 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:58:19,714 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37181 5986s 2024-11-23 21:58:19,715 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37181 5986s 2024-11-23 21:58:19,715 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 21:58:19,715 - distributed.worker - INFO - dashboard at: 127.0.0.1:36011 5986s 2024-11-23 21:58:19,715 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34273 5986s 2024-11-23 21:58:19,715 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:58:19,715 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 21:58:19,715 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:58:19,715 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-h0rd6jx0 5986s 2024-11-23 21:58:19,715 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:58:19,716 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35411. Reason: failure-to-start- 5986s 2024-11-23 21:58:19,716 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:58:19,716 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37181. Reason: failure-to-start- 5986s 2024-11-23 21:58:19,716 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:58:19,718 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34273': TLS handshake failed with remote 'tls://127.0.0.1:54218': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:58:19,718 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34273': TLS handshake failed with remote 'tls://127.0.0.1:54222': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:58:19,719 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 21:58:20,725 - distributed.scheduler - INFO - State start 5986s 2024-11-23 21:58:20,731 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33483 5986s 2024-11-23 21:58:20,731 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37441/status 5986s 2024-11-23 21:58:20,731 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 21:58:20,748 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40215 5986s 2024-11-23 21:58:20,748 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40215 5986s 2024-11-23 21:58:20,748 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 21:58:20,748 - distributed.worker - INFO - dashboard at: 127.0.0.1:39975 5986s 2024-11-23 21:58:20,748 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33483 5986s 2024-11-23 21:58:20,748 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:58:20,748 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 21:58:20,748 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:58:20,748 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-pmn54had 5986s 2024-11-23 21:58:20,748 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:58:20,750 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38461 5986s 2024-11-23 21:58:20,750 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38461 5986s 2024-11-23 21:58:20,750 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 21:58:20,750 - distributed.worker - INFO - dashboard at: 127.0.0.1:42347 5986s 2024-11-23 21:58:20,750 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33483 5986s 2024-11-23 21:58:20,750 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:58:20,750 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 21:58:20,750 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:58:20,750 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-uv8ydd7w 5986s 2024-11-23 21:58:20,750 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:58:20,751 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40215. Reason: failure-to-start- 5986s 2024-11-23 21:58:20,751 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:58:20,752 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38461. Reason: failure-to-start- 5986s 2024-11-23 21:58:20,752 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:58:20,753 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33483': TLS handshake failed with remote 'tls://127.0.0.1:48368': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:58:20,753 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33483': TLS handshake failed with remote 'tls://127.0.0.1:48372': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:58:20,754 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 21:58:21,759 - distributed.scheduler - INFO - State start 5986s 2024-11-23 21:58:21,766 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37433 5986s 2024-11-23 21:58:21,766 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43987/status 5986s 2024-11-23 21:58:21,767 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 21:58:21,781 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33763 5986s 2024-11-23 21:58:21,781 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33763 5986s 2024-11-23 21:58:21,781 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 21:58:21,781 - distributed.worker - INFO - dashboard at: 127.0.0.1:33767 5986s 2024-11-23 21:58:21,781 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37433 5986s 2024-11-23 21:58:21,781 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:58:21,781 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 21:58:21,781 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:58:21,781 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-qqtunnqj 5986s 2024-11-23 21:58:21,781 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:58:21,784 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40499 5986s 2024-11-23 21:58:21,784 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40499 5986s 2024-11-23 21:58:21,784 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 21:58:21,784 - distributed.worker - INFO - dashboard at: 127.0.0.1:42389 5986s 2024-11-23 21:58:21,784 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37433 5986s 2024-11-23 21:58:21,784 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:58:21,784 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 21:58:21,784 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:58:21,784 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-nde59sy7 5986s 2024-11-23 21:58:21,784 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:58:21,788 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33763. Reason: failure-to-start- 5986s 2024-11-23 21:58:21,788 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:58:21,788 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40499. Reason: failure-to-start- 5986s 2024-11-23 21:58:21,788 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:58:21,790 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37433': TLS handshake failed with remote 'tls://127.0.0.1:54546': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:58:21,790 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37433': TLS handshake failed with remote 'tls://127.0.0.1:54550': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:58:21,791 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 21:58:22,796 - distributed.scheduler - INFO - State start 5986s 2024-11-23 21:58:22,801 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37895 5986s 2024-11-23 21:58:22,802 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35829/status 5986s 2024-11-23 21:58:22,802 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 21:58:22,814 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38379 5986s 2024-11-23 21:58:22,814 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38379 5986s 2024-11-23 21:58:22,814 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 21:58:22,814 - distributed.worker - INFO - dashboard at: 127.0.0.1:41481 5986s 2024-11-23 21:58:22,814 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37895 5986s 2024-11-23 21:58:22,814 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:58:22,814 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 21:58:22,814 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:58:22,814 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-vb7u3hnx 5986s 2024-11-23 21:58:22,814 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:58:22,816 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36075 5986s 2024-11-23 21:58:22,816 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36075 5986s 2024-11-23 21:58:22,816 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 21:58:22,816 - distributed.worker - INFO - dashboard at: 127.0.0.1:32813 5986s 2024-11-23 21:58:22,816 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37895 5986s 2024-11-23 21:58:22,816 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:58:22,816 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 21:58:22,816 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:58:22,816 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-29s3uac9 5986s 2024-11-23 21:58:22,817 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:58:22,821 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38379. Reason: failure-to-start- 5986s 2024-11-23 21:58:22,821 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:58:22,821 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36075. Reason: failure-to-start- 5986s 2024-11-23 21:58:22,821 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:58:22,822 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37895': TLS handshake failed with remote 'tls://127.0.0.1:58718': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:58:22,823 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37895': TLS handshake failed with remote 'tls://127.0.0.1:58734': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:58:22,824 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 21:58:23,829 - distributed.scheduler - INFO - State start 5986s 2024-11-23 21:58:23,835 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41847 5986s 2024-11-23 21:58:23,835 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45305/status 5986s 2024-11-23 21:58:23,835 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 21:58:23,849 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35835 5986s 2024-11-23 21:58:23,849 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35835 5986s 2024-11-23 21:58:23,849 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 21:58:23,849 - distributed.worker - INFO - dashboard at: 127.0.0.1:39555 5986s 2024-11-23 21:58:23,850 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41847 5986s 2024-11-23 21:58:23,850 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:58:23,850 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 21:58:23,850 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:58:23,850 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-9weiwo8y 5986s 2024-11-23 21:58:23,850 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:58:23,852 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33739 5986s 2024-11-23 21:58:23,852 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33739 5986s 2024-11-23 21:58:23,852 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 21:58:23,852 - distributed.worker - INFO - dashboard at: 127.0.0.1:33337 5986s 2024-11-23 21:58:23,852 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41847 5986s 2024-11-23 21:58:23,852 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:58:23,852 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 21:58:23,852 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:58:23,852 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-m7xc2qf6 5986s 2024-11-23 21:58:23,852 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:58:23,853 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35835. Reason: failure-to-start- 5986s 2024-11-23 21:58:23,853 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:58:23,853 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33739. Reason: failure-to-start- 5986s 2024-11-23 21:58:23,854 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:58:23,855 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41847': TLS handshake failed with remote 'tls://127.0.0.1:51030': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:58:23,855 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41847': TLS handshake failed with remote 'tls://127.0.0.1:51032': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:58:23,856 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 21:58:24,863 - distributed.scheduler - INFO - State start 5986s 2024-11-23 21:58:24,868 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33695 5986s 2024-11-23 21:58:24,868 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36637/status 5986s 2024-11-23 21:58:24,868 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 21:58:24,880 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39809 5986s 2024-11-23 21:58:24,881 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39809 5986s 2024-11-23 21:58:24,881 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 21:58:24,881 - distributed.worker - INFO - dashboard at: 127.0.0.1:46687 5986s 2024-11-23 21:58:24,881 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33695 5986s 2024-11-23 21:58:24,881 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:58:24,881 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 21:58:24,881 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:58:24,881 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-839chmua 5986s 2024-11-23 21:58:24,881 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:58:24,883 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41309 5986s 2024-11-23 21:58:24,883 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41309 5986s 2024-11-23 21:58:24,883 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 21:58:24,883 - distributed.worker - INFO - dashboard at: 127.0.0.1:43837 5986s 2024-11-23 21:58:24,883 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33695 5986s 2024-11-23 21:58:24,883 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:58:24,883 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 21:58:24,883 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:58:24,883 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-26gserk9 5986s 2024-11-23 21:58:24,883 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:58:24,884 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39809. Reason: failure-to-start- 5986s 2024-11-23 21:58:24,884 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:58:24,885 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41309. Reason: failure-to-start- 5986s 2024-11-23 21:58:24,885 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:58:24,886 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33695': TLS handshake failed with remote 'tls://127.0.0.1:40746': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:58:24,886 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33695': TLS handshake failed with remote 'tls://127.0.0.1:40762': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:58:24,887 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 21:58:25,893 - distributed.scheduler - INFO - State start 5986s 2024-11-23 21:58:25,898 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43743 5986s 2024-11-23 21:58:25,898 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37659/status 5986s 2024-11-23 21:58:25,898 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 21:58:25,910 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33349 5986s 2024-11-23 21:58:25,911 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33349 5986s 2024-11-23 21:58:25,911 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 21:58:25,911 - distributed.worker - INFO - dashboard at: 127.0.0.1:41679 5986s 2024-11-23 21:58:25,911 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43743 5986s 2024-11-23 21:58:25,911 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:58:25,911 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 21:58:25,911 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:58:25,911 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-pwlbxnog 5986s 2024-11-23 21:58:25,911 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:58:25,913 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36993 5986s 2024-11-23 21:58:25,913 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36993 5986s 2024-11-23 21:58:25,913 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 21:58:25,913 - distributed.worker - INFO - dashboard at: 127.0.0.1:44713 5986s 2024-11-23 21:58:25,913 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43743 5986s 2024-11-23 21:58:25,913 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:58:25,913 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 21:58:25,913 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:58:25,913 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-7z8dyf1r 5986s 2024-11-23 21:58:25,913 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:58:25,914 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33349. Reason: failure-to-start- 5986s 2024-11-23 21:58:25,914 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:58:25,914 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36993. Reason: failure-to-start- 5986s 2024-11-23 21:58:25,915 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:58:25,916 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43743': TLS handshake failed with remote 'tls://127.0.0.1:58888': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:58:25,916 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43743': TLS handshake failed with remote 'tls://127.0.0.1:58894': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:58:25,917 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 21:58:26,923 - distributed.scheduler - INFO - State start 5986s 2024-11-23 21:58:26,929 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40205 5986s 2024-11-23 21:58:26,929 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45313/status 5986s 2024-11-23 21:58:26,929 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 21:58:26,942 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34455 5986s 2024-11-23 21:58:26,942 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34455 5986s 2024-11-23 21:58:26,942 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 21:58:26,942 - distributed.worker - INFO - dashboard at: 127.0.0.1:44407 5986s 2024-11-23 21:58:26,942 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40205 5986s 2024-11-23 21:58:26,942 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:58:26,942 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 21:58:26,942 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:58:26,942 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-x8b5fcb3 5986s 2024-11-23 21:58:26,942 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:58:26,944 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38577 5986s 2024-11-23 21:58:26,944 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38577 5986s 2024-11-23 21:58:26,944 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 21:58:26,944 - distributed.worker - INFO - dashboard at: 127.0.0.1:36059 5986s 2024-11-23 21:58:26,944 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40205 5986s 2024-11-23 21:58:26,944 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:58:26,944 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 21:58:26,944 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:58:26,944 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-9205q040 5986s 2024-11-23 21:58:26,945 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:58:26,946 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34455. Reason: failure-to-start- 5986s 2024-11-23 21:58:26,946 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:58:26,946 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38577. Reason: failure-to-start- 5986s 2024-11-23 21:58:26,946 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:58:26,947 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40205': TLS handshake failed with remote 'tls://127.0.0.1:38308': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:58:26,947 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40205': TLS handshake failed with remote 'tls://127.0.0.1:38312': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:58:26,948 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 21:58:27,956 - distributed.scheduler - INFO - State start 5986s 2024-11-23 21:58:27,961 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35537 5986s 2024-11-23 21:58:27,962 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33133/status 5986s 2024-11-23 21:58:27,962 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 21:58:27,975 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33787 5986s 2024-11-23 21:58:27,975 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33787 5986s 2024-11-23 21:58:27,975 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 21:58:27,975 - distributed.worker - INFO - dashboard at: 127.0.0.1:44925 5986s 2024-11-23 21:58:27,975 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35537 5986s 2024-11-23 21:58:27,975 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:58:27,975 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 21:58:27,975 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:58:27,975 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-mtwpqnw2 5986s 2024-11-23 21:58:27,975 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:58:27,977 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39899 5986s 2024-11-23 21:58:27,977 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39899 5986s 2024-11-23 21:58:27,977 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 21:58:27,977 - distributed.worker - INFO - dashboard at: 127.0.0.1:40937 5986s 2024-11-23 21:58:27,977 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35537 5986s 2024-11-23 21:58:27,977 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:58:27,977 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 21:58:27,977 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:58:27,977 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-mi4fn12l 5986s 2024-11-23 21:58:27,977 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:58:27,979 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33787. Reason: failure-to-start- 5986s 2024-11-23 21:58:27,979 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:58:27,980 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39899. Reason: failure-to-start- 5986s 2024-11-23 21:58:27,980 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:58:27,983 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35537': TLS handshake failed with remote 'tls://127.0.0.1:47944': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:58:27,983 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35537': TLS handshake failed with remote 'tls://127.0.0.1:47952': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:58:27,984 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 21:58:28,990 - distributed.scheduler - INFO - State start 5986s 2024-11-23 21:58:28,995 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46393 5986s 2024-11-23 21:58:28,996 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41757/status 5986s 2024-11-23 21:58:28,996 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 21:58:29,007 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34325 5986s 2024-11-23 21:58:29,007 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34325 5986s 2024-11-23 21:58:29,007 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 21:58:29,007 - distributed.worker - INFO - dashboard at: 127.0.0.1:37187 5986s 2024-11-23 21:58:29,007 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46393 5986s 2024-11-23 21:58:29,007 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:58:29,007 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 21:58:29,007 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:58:29,008 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-elbeod55 5986s 2024-11-23 21:58:29,008 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:58:29,009 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43871 5986s 2024-11-23 21:58:29,009 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43871 5986s 2024-11-23 21:58:29,009 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 21:58:29,009 - distributed.worker - INFO - dashboard at: 127.0.0.1:43281 5986s 2024-11-23 21:58:29,009 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46393 5986s 2024-11-23 21:58:29,009 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:58:29,009 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 21:58:29,009 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:58:29,009 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-nn9gv1j4 5986s 2024-11-23 21:58:29,009 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:58:29,010 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34325. Reason: failure-to-start- 5986s 2024-11-23 21:58:29,011 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:58:29,011 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43871. Reason: failure-to-start- 5986s 2024-11-23 21:58:29,011 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:58:29,014 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46393': TLS handshake failed with remote 'tls://127.0.0.1:40150': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:58:29,014 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46393': TLS handshake failed with remote 'tls://127.0.0.1:40156': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:58:29,015 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 21:58:30,020 - distributed.scheduler - INFO - State start 5986s 2024-11-23 21:58:30,026 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43161 5986s 2024-11-23 21:58:30,026 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33895/status 5986s 2024-11-23 21:58:30,027 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 21:58:30,039 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35595 5986s 2024-11-23 21:58:30,039 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35595 5986s 2024-11-23 21:58:30,039 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 21:58:30,039 - distributed.worker - INFO - dashboard at: 127.0.0.1:46323 5986s 2024-11-23 21:58:30,039 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43161 5986s 2024-11-23 21:58:30,039 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:58:30,039 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 21:58:30,039 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:58:30,039 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-wo79p_gg 5986s 2024-11-23 21:58:30,039 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:58:30,041 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46549 5986s 2024-11-23 21:58:30,041 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46549 5986s 2024-11-23 21:58:30,041 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 21:58:30,041 - distributed.worker - INFO - dashboard at: 127.0.0.1:45173 5986s 2024-11-23 21:58:30,041 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43161 5986s 2024-11-23 21:58:30,041 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:58:30,041 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 21:58:30,041 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:58:30,041 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-olugup4m 5986s 2024-11-23 21:58:30,041 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:58:30,042 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35595. Reason: failure-to-start- 5986s 2024-11-23 21:58:30,042 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:58:30,043 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46549. Reason: failure-to-start- 5986s 2024-11-23 21:58:30,043 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:58:30,046 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43161': TLS handshake failed with remote 'tls://127.0.0.1:38402': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:58:30,046 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43161': TLS handshake failed with remote 'tls://127.0.0.1:38408': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:58:30,047 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 21:58:31,051 - distributed.scheduler - INFO - State start 5986s 2024-11-23 21:58:31,058 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39847 5986s 2024-11-23 21:58:31,058 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41493/status 5986s 2024-11-23 21:58:31,058 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 21:58:31,072 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40761 5986s 2024-11-23 21:58:31,072 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40761 5986s 2024-11-23 21:58:31,072 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 21:58:31,072 - distributed.worker - INFO - dashboard at: 127.0.0.1:34313 5986s 2024-11-23 21:58:31,072 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39847 5986s 2024-11-23 21:58:31,072 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:58:31,072 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 21:58:31,072 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:58:31,072 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-1v_hvhqe 5986s 2024-11-23 21:58:31,072 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:58:31,074 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38141 5986s 2024-11-23 21:58:31,074 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38141 5986s 2024-11-23 21:58:31,074 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 21:58:31,074 - distributed.worker - INFO - dashboard at: 127.0.0.1:46369 5986s 2024-11-23 21:58:31,074 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39847 5986s 2024-11-23 21:58:31,074 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:58:31,074 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 21:58:31,074 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:58:31,074 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-7m5g38b7 5986s 2024-11-23 21:58:31,075 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:58:31,075 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40761. Reason: failure-to-start- 5986s 2024-11-23 21:58:31,076 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:58:31,076 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38141. Reason: failure-to-start- 5986s 2024-11-23 21:58:31,076 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:58:31,079 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39847': TLS handshake failed with remote 'tls://127.0.0.1:57210': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:58:31,079 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39847': TLS handshake failed with remote 'tls://127.0.0.1:57212': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:58:31,081 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 21:58:32,086 - distributed.scheduler - INFO - State start 5986s 2024-11-23 21:58:32,092 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39441 5986s 2024-11-23 21:58:32,092 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39031/status 5986s 2024-11-23 21:58:32,093 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 21:58:32,106 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35047 5986s 2024-11-23 21:58:32,107 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35047 5986s 2024-11-23 21:58:32,107 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 21:58:32,107 - distributed.worker - INFO - dashboard at: 127.0.0.1:44141 5986s 2024-11-23 21:58:32,107 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39441 5986s 2024-11-23 21:58:32,107 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:58:32,107 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 21:58:32,107 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:58:32,107 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-vj0m2ib_ 5986s 2024-11-23 21:58:32,107 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:58:32,109 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42441 5986s 2024-11-23 21:58:32,109 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42441 5986s 2024-11-23 21:58:32,109 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 21:58:32,109 - distributed.worker - INFO - dashboard at: 127.0.0.1:43797 5986s 2024-11-23 21:58:32,109 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39441 5986s 2024-11-23 21:58:32,109 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:58:32,109 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 21:58:32,109 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:58:32,109 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-lr3nl9hy 5986s 2024-11-23 21:58:32,110 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:58:32,113 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35047. Reason: failure-to-start- 5986s 2024-11-23 21:58:32,113 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:58:32,113 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42441. Reason: failure-to-start- 5986s 2024-11-23 21:58:32,113 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:58:32,115 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39441': TLS handshake failed with remote 'tls://127.0.0.1:55182': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:58:32,115 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39441': TLS handshake failed with remote 'tls://127.0.0.1:55196': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:58:32,116 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 21:58:33,121 - distributed.scheduler - INFO - State start 5986s 2024-11-23 21:58:33,127 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42399 5986s 2024-11-23 21:58:33,128 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35887/status 5986s 2024-11-23 21:58:33,128 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 21:58:33,141 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43941 5986s 2024-11-23 21:58:33,141 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43941 5986s 2024-11-23 21:58:33,141 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 21:58:33,141 - distributed.worker - INFO - dashboard at: 127.0.0.1:44943 5986s 2024-11-23 21:58:33,141 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42399 5986s 2024-11-23 21:58:33,141 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:58:33,141 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 21:58:33,141 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:58:33,141 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-cnmgvzw7 5986s 2024-11-23 21:58:33,141 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:58:33,143 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35881 5986s 2024-11-23 21:58:33,143 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35881 5986s 2024-11-23 21:58:33,143 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 21:58:33,144 - distributed.worker - INFO - dashboard at: 127.0.0.1:41113 5986s 2024-11-23 21:58:33,144 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42399 5986s 2024-11-23 21:58:33,144 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:58:33,144 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 21:58:33,144 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:58:33,144 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-fbafn8gf 5986s 2024-11-23 21:58:33,144 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:58:33,158 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43941. Reason: failure-to-start- 5986s 2024-11-23 21:58:33,158 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:58:33,158 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35881. Reason: failure-to-start- 5986s 2024-11-23 21:58:33,158 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:58:33,160 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42399': TLS handshake failed with remote 'tls://127.0.0.1:51614': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:58:33,160 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42399': TLS handshake failed with remote 'tls://127.0.0.1:51620': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:58:33,161 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 21:58:34,166 - distributed.scheduler - INFO - State start 5986s 2024-11-23 21:58:34,172 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44385 5986s 2024-11-23 21:58:34,173 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37595/status 5986s 2024-11-23 21:58:34,173 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 21:58:34,188 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34527 5986s 2024-11-23 21:58:34,188 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34527 5986s 2024-11-23 21:58:34,188 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 21:58:34,188 - distributed.worker - INFO - dashboard at: 127.0.0.1:41193 5986s 2024-11-23 21:58:34,188 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44385 5986s 2024-11-23 21:58:34,188 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:58:34,188 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 21:58:34,188 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:58:34,188 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-45nj6n38 5986s 2024-11-23 21:58:34,188 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:58:34,190 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42745 5986s 2024-11-23 21:58:34,190 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42745 5986s 2024-11-23 21:58:34,190 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 21:58:34,191 - distributed.worker - INFO - dashboard at: 127.0.0.1:37827 5986s 2024-11-23 21:58:34,191 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44385 5986s 2024-11-23 21:58:34,191 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:58:34,191 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 21:58:34,191 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:58:34,191 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-4d1faou_ 5986s 2024-11-23 21:58:34,191 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:58:34,192 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34527. Reason: failure-to-start- 5986s 2024-11-23 21:58:34,192 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:58:34,192 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42745. Reason: failure-to-start- 5986s 2024-11-23 21:58:34,192 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:58:34,193 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44385': TLS handshake failed with remote 'tls://127.0.0.1:51458': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:58:34,193 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44385': TLS handshake failed with remote 'tls://127.0.0.1:51472': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:58:34,195 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 21:58:35,200 - distributed.scheduler - INFO - State start 5986s 2024-11-23 21:58:35,207 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39957 5986s 2024-11-23 21:58:35,208 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37701/status 5986s 2024-11-23 21:58:35,208 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 21:58:35,224 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33453 5986s 2024-11-23 21:58:35,224 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33453 5986s 2024-11-23 21:58:35,224 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 21:58:35,224 - distributed.worker - INFO - dashboard at: 127.0.0.1:35023 5986s 2024-11-23 21:58:35,224 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39957 5986s 2024-11-23 21:58:35,224 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:58:35,224 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 21:58:35,225 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:58:35,225 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-9c6vyt2u 5986s 2024-11-23 21:58:35,225 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:58:35,227 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38861 5986s 2024-11-23 21:58:35,227 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38861 5986s 2024-11-23 21:58:35,227 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 21:58:35,227 - distributed.worker - INFO - dashboard at: 127.0.0.1:40865 5986s 2024-11-23 21:58:35,227 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39957 5986s 2024-11-23 21:58:35,227 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:58:35,227 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 21:58:35,227 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:58:35,227 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-_1ysjrn9 5986s 2024-11-23 21:58:35,227 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:58:35,228 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33453. Reason: failure-to-start- 5986s 2024-11-23 21:58:35,228 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:58:35,229 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38861. Reason: failure-to-start- 5986s 2024-11-23 21:58:35,229 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:58:35,230 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39957': TLS handshake failed with remote 'tls://127.0.0.1:35108': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:58:35,230 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39957': TLS handshake failed with remote 'tls://127.0.0.1:35118': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:58:35,231 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 21:58:36,237 - distributed.scheduler - INFO - State start 5986s 2024-11-23 21:58:36,243 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39863 5986s 2024-11-23 21:58:36,244 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33231/status 5986s 2024-11-23 21:58:36,244 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 21:58:36,258 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43377 5986s 2024-11-23 21:58:36,259 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43377 5986s 2024-11-23 21:58:36,259 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 21:58:36,259 - distributed.worker - INFO - dashboard at: 127.0.0.1:43085 5986s 2024-11-23 21:58:36,259 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39863 5986s 2024-11-23 21:58:36,259 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:58:36,259 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 21:58:36,259 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:58:36,259 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-6a_h4nhc 5986s 2024-11-23 21:58:36,259 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:58:36,261 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38901 5986s 2024-11-23 21:58:36,261 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38901 5986s 2024-11-23 21:58:36,261 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 21:58:36,261 - distributed.worker - INFO - dashboard at: 127.0.0.1:46693 5986s 2024-11-23 21:58:36,261 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39863 5986s 2024-11-23 21:58:36,261 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:58:36,261 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 21:58:36,261 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:58:36,261 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-v861n0dy 5986s 2024-11-23 21:58:36,261 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:58:36,262 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43377. Reason: failure-to-start- 5986s 2024-11-23 21:58:36,263 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:58:36,263 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38901. Reason: failure-to-start- 5986s 2024-11-23 21:58:36,263 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:58:36,264 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39863': TLS handshake failed with remote 'tls://127.0.0.1:40346': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:58:36,264 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39863': TLS handshake failed with remote 'tls://127.0.0.1:40350': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:58:36,266 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s __________________________________ test_Queue __________________________________ 5986s 5986s fut = , timeout = 0 5986s 5986s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 5986s async with asyncio.timeout(timeout): 5986s > return await fut 5986s 5986s /usr/lib/python3/dist-packages/distributed/utils.py:1960: 5986s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5986s /usr/lib/python3/dist-packages/distributed/worker.py:1480: in start_unsafe 5986s await self._register_with_scheduler() 5986s /usr/lib/python3/dist-packages/distributed/worker.py:1179: in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s /usr/lib/python3/dist-packages/distributed/comm/core.py:342: in connect 5986s comm = await wait_for( 5986s /usr/lib/python3/dist-packages/distributed/utils.py:1960: in wait_for 5986s return await fut 5986s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:546: in connect 5986s stream = await self.client.connect( 5986s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5986s 5986s self = , host = '127.0.0.1' 5986s port = 34099, af = 5986s ssl_options = 5986s max_buffer_size = 8364507136.0, source_ip = None, source_port = None 5986s timeout = None 5986s 5986s async def connect( 5986s self, 5986s host: str, 5986s port: int, 5986s af: socket.AddressFamily = socket.AF_UNSPEC, 5986s ssl_options: Optional[Union[Dict[str, Any], ssl.SSLContext]] = None, 5986s max_buffer_size: Optional[int] = None, 5986s source_ip: Optional[str] = None, 5986s source_port: Optional[int] = None, 5986s timeout: Optional[Union[float, datetime.timedelta]] = None, 5986s ) -> IOStream: 5986s """Connect to the given host and port. 5986s 5986s Asynchronously returns an `.IOStream` (or `.SSLIOStream` if 5986s ``ssl_options`` is not None). 5986s 5986s Using the ``source_ip`` kwarg, one can specify the source 5986s IP address to use when establishing the connection. 5986s In case the user needs to resolve and 5986s use a specific interface, it has to be handled outside 5986s of Tornado as this depends very much on the platform. 5986s 5986s Raises `TimeoutError` if the input future does not complete before 5986s ``timeout``, which may be specified in any form allowed by 5986s `.IOLoop.add_timeout` (i.e. a `datetime.timedelta` or an absolute time 5986s relative to `.IOLoop.time`) 5986s 5986s Similarly, when the user requires a certain source port, it can 5986s be specified using the ``source_port`` arg. 5986s 5986s .. versionchanged:: 4.5 5986s Added the ``source_ip`` and ``source_port`` arguments. 5986s 5986s .. versionchanged:: 5.0 5986s Added the ``timeout`` argument. 5986s """ 5986s if timeout is not None: 5986s if isinstance(timeout, numbers.Real): 5986s timeout = IOLoop.current().time() + timeout 5986s elif isinstance(timeout, datetime.timedelta): 5986s timeout = IOLoop.current().time() + timeout.total_seconds() 5986s else: 5986s raise TypeError("Unsupported timeout %r" % timeout) 5986s if timeout is not None: 5986s addrinfo = await gen.with_timeout( 5986s timeout, self.resolver.resolve(host, port, af) 5986s ) 5986s else: 5986s addrinfo = await self.resolver.resolve(host, port, af) 5986s connector = _Connector( 5986s addrinfo, 5986s functools.partial( 5986s self._create_stream, 5986s max_buffer_size, 5986s source_ip=source_ip, 5986s source_port=source_port, 5986s ), 5986s ) 5986s > af, addr, stream = await connector.start(connect_timeout=timeout) 5986s E asyncio.exceptions.CancelledError 5986s 5986s /usr/lib/python3/dist-packages/tornado/tcpclient.py:279: CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s self = 5986s 5986s @final 5986s async def start(self): 5986s async with self._startup_lock: 5986s if self.status == Status.failed: 5986s assert self.__startup_exc is not None 5986s raise self.__startup_exc 5986s elif self.status != Status.init: 5986s return self 5986s timeout = getattr(self, "death_timeout", None) 5986s 5986s async def _close_on_failure(exc: Exception) -> None: 5986s await self.close(reason=f"failure-to-start-{str(type(exc))}") 5986s self.status = Status.failed 5986s self.__startup_exc = exc 5986s 5986s try: 5986s > await wait_for(self.start_unsafe(), timeout=timeout) 5986s 5986s /usr/lib/python3/dist-packages/distributed/core.py:664: 5986s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5986s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 5986s async with asyncio.timeout(timeout): 5986s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5986s 5986s self = 5986s exc_type = 5986s exc_val = CancelledError(), exc_tb = 5986s 5986s async def __aexit__( 5986s self, 5986s exc_type: Optional[Type[BaseException]], 5986s exc_val: Optional[BaseException], 5986s exc_tb: Optional[TracebackType], 5986s ) -> Optional[bool]: 5986s assert self._state in (_State.ENTERED, _State.EXPIRING) 5986s 5986s if self._timeout_handler is not None: 5986s self._timeout_handler.cancel() 5986s self._timeout_handler = None 5986s 5986s if self._state is _State.EXPIRING: 5986s self._state = _State.EXPIRED 5986s 5986s if self._task.uncancel() <= self._cancelling and exc_type is not None: 5986s # Since there are no new cancel requests, we're 5986s # handling this. 5986s if issubclass(exc_type, exceptions.CancelledError): 5986s > raise TimeoutError from exc_val 5986s E TimeoutError 5986s 5986s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s @contextlib.asynccontextmanager 5986s async def _cluster_factory(): 5986s workers = [] 5986s s = None 5986s try: 5986s for _ in range(60): 5986s try: 5986s > s, ws = await start_cluster( 5986s nthreads, 5986s scheduler, 5986s security=security, 5986s Worker=Worker, 5986s scheduler_kwargs=scheduler_kwargs, 5986s worker_kwargs=merge( 5986s {"death_timeout": min(15, int(deadline.remaining))}, 5986s worker_kwargs, 5986s ), 5986s ) 5986s 5986s /usr/lib/python3/dist-packages/distributed/utils_test.py:966: 5986s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5986s /usr/lib/python3/dist-packages/distributed/utils_test.py:789: in start_cluster 5986s await asyncio.gather(*workers) 5986s /usr/lib/python3.13/asyncio/tasks.py:737: in _wrap_awaitable 5986s return await awaitable 5986s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5986s 5986s self = 5986s 5986s @final 5986s async def start(self): 5986s async with self._startup_lock: 5986s if self.status == Status.failed: 5986s assert self.__startup_exc is not None 5986s raise self.__startup_exc 5986s elif self.status != Status.init: 5986s return self 5986s timeout = getattr(self, "death_timeout", None) 5986s 5986s async def _close_on_failure(exc: Exception) -> None: 5986s await self.close(reason=f"failure-to-start-{str(type(exc))}") 5986s self.status = Status.failed 5986s self.__startup_exc = exc 5986s 5986s try: 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s except asyncio.TimeoutError as exc: 5986s await _close_on_failure(exc) 5986s > raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s E TimeoutError: Worker start timed out after 0s. 5986s 5986s /usr/lib/python3/dist-packages/distributed/core.py:667: TimeoutError 5986s 5986s During handling of the above exception, another exception occurred: 5986s 5986s fut = ._..test_func..async_fn at 0xde81abf0> 5986s timeout = 60 5986s 5986s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 5986s async with asyncio.timeout(timeout): 5986s > return await fut 5986s 5986s /usr/lib/python3/dist-packages/distributed/utils.py:1960: 5986s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5986s /usr/lib/python3/dist-packages/distributed/utils_test.py:999: in async_fn 5986s _cluster_factory() as (s, workers), 5986s /usr/lib/python3.13/contextlib.py:214: in __aenter__ 5986s return await anext(self.gen) 5986s /usr/lib/python3/dist-packages/distributed/utils_test.py:983: in _cluster_factory 5986s await asyncio.sleep(1) 5986s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5986s 5986s delay = 1, result = None 5986s 5986s async def sleep(delay, result=None): 5986s """Coroutine that completes after a given time (in seconds).""" 5986s if delay <= 0: 5986s await __sleep0() 5986s return result 5986s 5986s if math.isnan(delay): 5986s raise ValueError("Invalid delay: NaN (not a number)") 5986s 5986s loop = events.get_running_loop() 5986s future = loop.create_future() 5986s h = loop.call_later(delay, 5986s futures._set_result_unless_cancelled, 5986s future, result) 5986s try: 5986s > return await future 5986s E asyncio.exceptions.CancelledError 5986s 5986s /usr/lib/python3.13/asyncio/tasks.py:718: CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s args = (), kwds = {} 5986s 5986s @wraps(func) 5986s def inner(*args, **kwds): 5986s with self._recreate_cm(): 5986s > return func(*args, **kwds) 5986s 5986s /usr/lib/python3.13/contextlib.py:85: 5986s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5986s /usr/lib/python3.13/contextlib.py:85: in inner 5986s return func(*args, **kwds) 5986s /usr/lib/python3/dist-packages/distributed/utils_test.py:1102: in test_func 5986s return _run_and_close_tornado(async_fn_outer) 5986s /usr/lib/python3/dist-packages/distributed/utils_test.py:378: in _run_and_close_tornado 5986s return asyncio_run(inner_fn(), loop_factory=get_loop_factory()) 5986s /usr/lib/python3.13/asyncio/runners.py:194: in run 5986s return runner.run(main) 5986s /usr/lib/python3.13/asyncio/runners.py:118: in run 5986s return self._loop.run_until_complete(task) 5986s /usr/lib/python3.13/asyncio/base_events.py:720: in run_until_complete 5986s return future.result() 5986s /usr/lib/python3/dist-packages/distributed/utils_test.py:375: in inner_fn 5986s return await async_fn(*args, **kwargs) 5986s /usr/lib/python3/dist-packages/distributed/utils_test.py:1099: in async_fn_outer 5986s return await utils_wait_for(async_fn(), timeout=timeout * 2) 5986s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 5986s async with asyncio.timeout(timeout): 5986s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5986s 5986s self = 5986s exc_type = 5986s exc_val = CancelledError(), exc_tb = 5986s 5986s async def __aexit__( 5986s self, 5986s exc_type: Optional[Type[BaseException]], 5986s exc_val: Optional[BaseException], 5986s exc_tb: Optional[TracebackType], 5986s ) -> Optional[bool]: 5986s assert self._state in (_State.ENTERED, _State.EXPIRING) 5986s 5986s if self._timeout_handler is not None: 5986s self._timeout_handler.cancel() 5986s self._timeout_handler = None 5986s 5986s if self._state is _State.EXPIRING: 5986s self._state = _State.EXPIRED 5986s 5986s if self._task.uncancel() <= self._cancelling and exc_type is not None: 5986s # Since there are no new cancel requests, we're 5986s # handling this. 5986s if issubclass(exc_type, exceptions.CancelledError): 5986s > raise TimeoutError from exc_val 5986s E TimeoutError 5986s 5986s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 5986s ----------------------------- Captured stderr call ----------------------------- 5986s 2024-11-23 21:58:37,793 - distributed.scheduler - INFO - State start 5986s 2024-11-23 21:58:37,799 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:37,800 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40429/status 5986s 2024-11-23 21:58:37,800 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 21:58:37,812 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44127 5986s 2024-11-23 21:58:37,812 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44127 5986s 2024-11-23 21:58:37,812 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 21:58:37,812 - distributed.worker - INFO - dashboard at: 127.0.0.1:40979 5986s 2024-11-23 21:58:37,812 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:37,813 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:58:37,813 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 21:58:37,813 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:58:37,813 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-jafrihar 5986s 2024-11-23 21:58:37,813 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:58:37,815 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46477 5986s 2024-11-23 21:58:37,815 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46477 5986s 2024-11-23 21:58:37,815 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 21:58:37,815 - distributed.worker - INFO - dashboard at: 127.0.0.1:46301 5986s 2024-11-23 21:58:37,815 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:37,815 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:58:37,815 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 21:58:37,815 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:58:37,815 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-j8rdcqoz 5986s 2024-11-23 21:58:37,815 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:58:37,827 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:37,828 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:37,828 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:43326': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:37,828 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:43340': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:37,940 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:37,940 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:37,940 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:43346': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:37,940 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:43356': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:38,052 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:38,052 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:38,053 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:43362': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:38,053 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:43364': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:38,165 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:38,165 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:38,166 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:43368': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:38,166 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:43370': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:38,278 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:38,278 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:38,278 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:43382': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:38,278 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:43386': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:38,390 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:38,390 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:38,391 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:43388': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:38,391 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:43396': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:38,502 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:38,503 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:38,503 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:43410': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:38,503 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:43412': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:38,614 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:38,614 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:38,615 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:43426': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:38,615 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:43432': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:38,726 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:38,726 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:38,727 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:43436': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:38,727 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:43446': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:38,838 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:38,839 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:38,839 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:43448': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:38,839 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:43460': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:38,951 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:38,951 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:38,951 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:43466': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:38,951 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:43482': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:39,058 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:39,062 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:43498': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:39,063 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:39,063 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:43502': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:39,165 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:39,165 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:43514': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:39,171 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:39,171 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:43526': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:39,272 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:39,272 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:43534': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:39,278 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:39,278 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:43538': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:39,379 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:39,380 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:43542': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:39,385 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:39,385 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:43552': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:39,488 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:39,489 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:43560': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:39,494 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:39,494 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:43566': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:39,596 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:39,597 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:43578': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:39,602 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:39,602 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:43594': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:39,704 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:39,704 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:43600': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:39,710 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:39,710 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:43610': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:39,810 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:39,810 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:43626': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:39,816 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:39,816 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:43640': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:39,917 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:39,917 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:43648': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:39,923 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:39,923 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:43662': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:40,024 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:40,024 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:43678': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:40,030 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:40,030 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:43682': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:40,131 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:40,131 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:43688': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:40,137 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:40,137 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:43700': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:40,238 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:40,238 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:43712': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:40,244 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:40,244 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:43724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:40,345 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:40,346 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:43740': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:40,351 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:40,351 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:43754': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:40,452 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:40,453 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:43758': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:40,458 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:40,459 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:43766': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:40,559 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:40,559 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:43782': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:40,564 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:40,565 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:43788': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:40,665 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:40,666 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:43790': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:40,671 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:40,672 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:43792': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:40,772 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:40,773 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:43808': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:40,778 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:40,778 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:43810': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:40,879 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:40,879 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:43818': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:40,885 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:40,885 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:43822': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:40,986 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:40,986 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:43830': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:40,992 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:40,992 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:43836': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:41,094 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:41,094 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:43838': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:41,100 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:41,100 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:43854': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:41,200 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:41,201 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:43866': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:41,206 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:41,206 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:43872': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:41,310 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:41,312 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:43882': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:41,318 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:41,318 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:43888': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:41,418 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:41,418 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:43900': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:41,423 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:41,424 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:43914': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:41,524 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:41,525 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:43920': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:41,530 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:41,531 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:45784': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:41,631 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:41,632 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:45786': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:41,637 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:41,638 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:45802': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:41,738 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:41,738 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:45818': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:41,744 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:41,744 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:45820': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:41,845 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:41,845 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:45824': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:41,851 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:41,851 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:45828': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:41,951 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:41,952 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:45840': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:41,958 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:41,958 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:45854': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:42,058 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:42,058 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:45856': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:42,064 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:42,064 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:45858': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:42,164 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:42,165 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:45874': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:42,170 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:42,171 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:45882': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:42,271 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:42,272 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:45898': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:42,277 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:42,277 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:45904': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:42,378 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:42,379 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:45906': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:42,384 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:42,384 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:45912': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:42,485 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:42,485 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:45924': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:42,491 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:42,491 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:45940': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:42,592 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:42,592 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:45954': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:42,598 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:42,598 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:45958': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:42,699 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:42,699 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:45972': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:42,705 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:42,705 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:45982': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:42,809 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:42,809 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:45984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:42,815 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:42,815 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:45992': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:42,916 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:42,916 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:45996': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:42,922 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:42,922 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:46006': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:43,024 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:43,025 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:46018': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:43,030 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:43,031 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:46028': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:43,132 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:43,132 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:46040': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:43,138 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:43,138 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:46044': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:43,238 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:43,239 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:46060': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:43,244 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:43,245 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:46070': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:43,347 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:43,347 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:46082': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:43,353 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:43,353 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:46086': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:43,454 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:43,454 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:46098': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:43,460 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:43,460 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:46112': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:43,560 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:43,560 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:46114': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:43,566 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:43,566 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:46128': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:43,667 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:43,667 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:46142': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:43,672 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:43,673 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:46154': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:43,773 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:43,773 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:46156': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:43,779 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:43,779 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:46162': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:43,880 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:43,880 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:46176': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:43,886 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:43,886 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:46188': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:43,987 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:43,987 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:46200': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:43,992 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:43,993 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:46212': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:44,094 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:44,095 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:46228': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:44,100 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:44,100 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:46236': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:44,201 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:44,201 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:46252': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:44,207 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:44,207 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:46256': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:44,309 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:44,310 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:46272': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:44,315 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:44,315 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:46274': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:44,417 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:44,418 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:46288': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:44,423 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:44,424 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:46294': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:44,524 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:44,525 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:46304': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:44,530 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:44,530 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:46310': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:44,632 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:44,633 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:46324': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:44,639 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:44,639 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:46330': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:44,739 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:44,740 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:46340': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:44,745 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:44,745 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:46344': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:44,847 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:44,847 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:46358': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:44,853 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:44,853 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:46370': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:44,954 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:44,954 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:46384': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:44,959 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:44,960 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:46398': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:45,060 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:45,061 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:46404': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:45,066 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:45,067 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:46416': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:45,167 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:45,168 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:46422': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:45,174 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:45,174 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:46424': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:45,274 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:45,274 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:46432': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:45,280 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:45,280 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:46444': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:45,381 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:45,381 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:46460': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:45,387 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:45,387 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:46464': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:45,488 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:45,488 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:46476': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:45,494 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:45,494 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:46490': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:45,595 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:45,595 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:46494': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:45,601 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:45,601 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:46508': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:45,701 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:45,702 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:46512': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:45,708 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:45,708 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:46514': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:45,809 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:45,810 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:46526': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:45,815 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:45,815 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:46536': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:45,917 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:45,917 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:46546': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:45,923 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:45,923 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:46552': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:46,024 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:46,025 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:46568': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:46,030 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:46,030 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:46574': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:46,131 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:46,132 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:46580': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:46,137 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:46,137 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:46596': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:46,238 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:46,239 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:46608': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:46,244 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:46,245 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:46624': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:46,345 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:46,345 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:46634': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:46,351 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:46,351 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:46640': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:46,453 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:46,453 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:46654': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:46,459 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:46,459 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:46670': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:46,560 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:46,561 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:46678': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:46,566 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:46,566 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:46680': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:46,667 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:46,668 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:46694': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:46,673 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:46,673 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:46700': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:46,775 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:46,777 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:46712': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:46,782 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:46,782 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:46718': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:46,884 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:46,885 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:46720': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:46,890 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:46,891 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:46730': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:46,992 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:46,992 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:46734': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:46,998 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:46,998 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:46746': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:47,098 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:47,099 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:46754': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:47,104 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:47,105 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:46768': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:47,205 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:47,206 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:46774': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:47,211 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:47,212 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:46776': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:47,312 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:47,312 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:46778': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:47,318 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:47,318 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:46780': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:47,419 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:47,420 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:46790': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:47,425 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:47,425 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:46792': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:47,526 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:47,527 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:46796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:47,532 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:47,533 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:46798': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:47,634 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:47,634 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:46808': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:47,640 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:47,640 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:46810': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:47,741 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:47,742 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:46812': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:47,747 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:47,747 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:46818': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:47,849 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:47,849 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:46824': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:47,854 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:47,855 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:46834': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:47,957 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:47,957 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:46846': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:47,963 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:47,963 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:46848': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:48,063 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:48,064 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:46854': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:48,069 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:48,070 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:46864': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:48,171 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:48,172 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:46866': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:48,177 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:48,178 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:46880': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:48,279 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:48,280 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:46888': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:48,285 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:48,286 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:46904': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:48,386 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:48,386 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:46918': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:48,392 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:48,392 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:46934': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:48,493 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:48,494 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:46946': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:48,499 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:48,500 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:46952': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:48,601 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:48,601 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:46954': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:48,607 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:48,607 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:46970': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:48,708 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:48,708 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:46984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:48,714 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:48,714 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:46998': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:48,814 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:48,814 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:47010': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:48,820 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:48,820 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:47014': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:48,921 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:48,921 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:47024': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:48,927 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:48,927 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:47030': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:49,028 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:49,028 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:47040': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:49,034 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:49,034 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:47044': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:49,135 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:49,135 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:47046': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:49,141 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:49,141 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:47058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:49,242 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:49,242 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:47066': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:49,248 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:49,248 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:47072': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:49,348 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:49,349 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:47086': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:49,354 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:49,355 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:47092': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:49,455 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:49,456 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:47100': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:49,461 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:49,462 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:47106': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:49,563 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:49,564 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:47116': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:49,570 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:49,570 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:47128': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:49,670 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:49,670 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:47136': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:49,676 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:49,676 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:47144': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:49,777 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:49,777 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:47154': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:49,783 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:49,783 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:47170': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:49,884 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:49,885 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:47182': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:49,890 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:49,891 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:47198': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:49,992 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:49,992 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:47210': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:49,998 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:49,998 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:47214': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:50,099 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:50,100 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:47216': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:50,105 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:50,105 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:47220': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:50,206 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:50,206 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:47236': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:50,212 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:50,212 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:47240': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:50,313 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:50,314 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:47248': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:50,320 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:50,320 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:47256': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:50,421 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:50,422 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:47270': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:50,427 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:50,427 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:47274': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:50,529 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:50,530 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:47276': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:50,535 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:50,536 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:47290': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:50,637 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:50,637 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:47304': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:50,643 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:50,643 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:47312': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:50,744 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:50,744 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:47314': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:50,750 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:50,750 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:47320': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:50,851 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:50,852 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:47324': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:50,857 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:50,857 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:47326': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:50,958 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:50,959 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:47330': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:50,964 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:50,965 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:47342': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:51,065 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:51,065 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:47356': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:51,071 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:51,071 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:47368': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:51,172 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:51,173 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:47376': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:51,179 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:51,179 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:47388': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:51,281 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:51,281 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:47396': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:51,287 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:51,287 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:47400': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:51,388 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:51,389 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:47402': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:51,395 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:51,395 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:47406': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:51,496 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:51,497 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:47422': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:51,502 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:51,503 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:47438': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:51,604 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:51,605 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:53258': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:51,610 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:51,611 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:53274': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:51,711 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:51,712 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:53288': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:51,717 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:51,718 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:53292': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:51,820 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:51,820 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:53306': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:51,826 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:51,826 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:53316': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:51,927 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:51,927 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:53326': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:51,933 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:51,933 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:53330': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:52,035 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:52,035 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:53338': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:52,041 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:52,041 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:53344': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:52,141 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:52,142 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:53356': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:52,147 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:52,148 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:53368': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:52,248 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:52,249 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:53378': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:52,254 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:52,255 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:53380': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:52,355 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:52,356 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:53386': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:52,361 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:52,361 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:53402': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:52,463 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:52,463 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:53416': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:52,469 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:52,469 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:53424': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:52,569 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:52,570 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:53440': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:52,576 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:52,576 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:53448': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:52,677 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:52,677 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:53464': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:52,683 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:52,683 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:53466': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:52,784 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:52,785 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:53476': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:52,790 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 5986s 2024-11-23 21:58:52,790 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:53480': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:52,812 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44127. Reason: failure-to-start- 5986s 2024-11-23 21:58:52,812 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:58:52,813 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 15s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 5986s stream = await stream.start_tls( 5986s ^^^^^^^^^^^^^^^^^^^^^^^ 5986s False, ssl_options=ssl_options, server_hostname=host 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 5986s self.socket.do_handshake() 5986s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 5986s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 5986s self._sslobj.do_handshake() 5986s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 5986s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 5986s raise FatalCommClosedError( 5986s ...<2 lines>... 5986s ) from err 5986s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 5986s 5986s During handling of the above exception, another exception occurred: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1218, in _register_with_scheduler 5986s await asyncio.sleep(0.1) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 718, in sleep 5986s return await future 5986s ^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 15s. 5986s 2024-11-23 21:58:52,816 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46477. Reason: failure-to-start- 5986s 2024-11-23 21:58:52,817 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:58:53,819 - distributed.scheduler - INFO - State start 5986s 2024-11-23 21:58:53,825 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43803 5986s 2024-11-23 21:58:53,826 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44153/status 5986s 2024-11-23 21:58:53,826 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 21:58:53,837 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46217 5986s 2024-11-23 21:58:53,837 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46217 5986s 2024-11-23 21:58:53,837 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 21:58:53,837 - distributed.worker - INFO - dashboard at: 127.0.0.1:39169 5986s 2024-11-23 21:58:53,837 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:58:53,837 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:58:53,837 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 21:58:53,838 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:58:53,838 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-qjexm1qj 5986s 2024-11-23 21:58:53,838 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:58:53,839 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39253 5986s 2024-11-23 21:58:53,839 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39253 5986s 2024-11-23 21:58:53,839 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 21:58:53,839 - distributed.worker - INFO - dashboard at: 127.0.0.1:42907 5986s 2024-11-23 21:58:53,839 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:58:53,840 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:58:53,840 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 21:58:53,840 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:58:53,840 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-vr61qr8k 5986s 2024-11-23 21:58:53,840 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:58:53,851 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:58:53,852 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:58:53,852 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:35826': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:53,852 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:35840': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:53,963 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:58:53,964 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:58:53,964 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:35844': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:53,964 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:35860': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:54,076 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:58:54,076 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:58:54,076 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:35874': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:54,077 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:35878': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:54,187 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:58:54,188 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:58:54,188 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:35890': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:54,188 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:35900': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:54,301 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:58:54,301 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:58:54,301 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:35916': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:54,301 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:35920': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:54,413 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:58:54,413 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:58:54,414 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:35934': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:54,414 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:35948': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:54,525 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:58:54,525 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:58:54,525 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:35960': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:54,526 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:35974': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:54,637 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:58:54,637 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:58:54,637 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:35980': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:54,637 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:35986': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:54,749 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:58:54,749 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:58:54,750 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:35996': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:54,750 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:35998': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:54,861 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:58:54,861 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:58:54,861 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:36000': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:54,861 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:36006': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:54,972 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:58:54,972 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:58:54,972 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:36020': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:54,972 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:36028': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:55,084 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:58:55,084 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:58:55,084 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:36044': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:55,084 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:36060': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:55,195 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:58:55,195 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:58:55,196 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:36064': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:55,196 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:36078': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:55,307 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:58:55,307 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:58:55,310 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:36094': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:55,310 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:36108': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:55,418 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:58:55,419 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:58:55,419 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:36124': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:55,419 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:36134': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:55,531 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:58:55,531 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:58:55,532 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:36150': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:55,532 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:36156': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:55,644 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:58:55,644 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:58:55,644 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:36164': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:55,644 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:36170': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:55,756 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:58:55,756 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:58:55,756 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:36186': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:55,756 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:36196': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:55,868 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:58:55,869 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:58:55,869 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:36208': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:55,869 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:36224': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:55,984 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:58:55,984 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:58:55,984 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:36236': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:55,984 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:36238': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:56,096 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:58:56,096 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:58:56,096 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:36242': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:56,096 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:36254': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:56,208 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:58:56,208 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:58:56,208 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:36260': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:56,208 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:36262': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:56,319 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:58:56,320 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:58:56,320 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:36264': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:56,320 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:36278': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:56,432 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:58:56,432 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:58:56,432 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:36288': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:56,432 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:36302': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:56,543 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:58:56,543 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:58:56,544 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:36312': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:56,544 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:36322': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:56,655 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:58:56,655 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:58:56,655 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:36338': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:56,655 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:36352': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:56,767 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:58:56,767 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:58:56,767 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:36362': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:56,767 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:36374': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:56,879 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:58:56,879 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:58:56,879 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:36382': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:56,879 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:36384': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:56,993 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:58:56,993 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:58:56,993 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:36398': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:56,993 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:36414': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:57,104 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:58:57,105 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:58:57,105 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:36418': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:57,105 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:36422': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:57,216 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:58:57,216 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:58:57,217 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:36436': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:57,217 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:36452': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:57,328 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:58:57,329 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:58:57,331 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:36468': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:57,331 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:36470': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:57,441 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:58:57,441 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:58:57,441 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:36486': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:57,441 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:36490': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:57,553 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:58:57,554 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:58:57,554 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:36502': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:57,554 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:36510': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:57,666 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:58:57,666 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:58:57,666 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:36524': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:57,666 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:36532': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:57,778 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:58:57,778 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:58:57,779 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:36534': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:57,779 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:36538': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:57,890 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:58:57,890 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:58:57,891 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:36542': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:57,891 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:36554': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:58,003 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:58:58,003 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:58:58,003 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:36558': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:58,003 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:36562': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:58,114 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:58:58,114 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:58:58,115 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:36578': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:58,115 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:36586': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:58,226 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:58:58,227 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:58:58,227 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:36600': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:58,227 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:36610': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:58,340 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:58:58,340 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:58:58,340 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:36620': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:58,340 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:36636': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:58,451 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:58:58,451 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:58:58,452 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:36642': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:58,452 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:36648': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:58,563 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:58:58,563 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:58:58,563 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:36654': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:58,563 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:36656': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:58,674 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:58:58,675 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:58:58,675 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:36664': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:58,675 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:36676': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:58,787 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:58:58,787 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:58:58,787 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:36682': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:58,787 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:36690': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:58,898 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:58:58,898 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:58:58,899 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:36702': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:58,899 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:36706': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:59,011 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:58:59,011 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:58:59,012 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:36708': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:59,012 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:36722': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:59,123 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:58:59,123 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:58:59,123 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:36736': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:59,123 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:36746': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:59,235 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:58:59,235 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:58:59,236 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:36756': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:59,236 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:36758': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:59,347 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:58:59,347 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:58:59,347 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:36764': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:59,347 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:36772': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:59,458 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:58:59,459 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:58:59,459 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:36778': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:59,460 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:36788': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:59,570 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:58:59,570 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:58:59,571 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:36800': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:59,571 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:36802': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:59,682 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:58:59,682 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:58:59,682 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:36806': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:59,682 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:36810': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:59,793 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:58:59,794 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:58:59,794 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:36818': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:59,794 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:36824': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:59,906 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:58:59,906 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:58:59,906 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:36836': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:58:59,906 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:36848': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:00,017 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:59:00,017 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:59:00,018 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:36852': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:00,018 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:36864': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:00,130 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:59:00,130 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:59:00,130 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:36878': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:00,130 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:36890': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:00,241 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:59:00,242 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:59:00,242 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:36892': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:00,242 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:36898': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:00,354 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:59:00,354 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:59:00,355 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:36914': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:00,355 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:36926': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:00,466 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:59:00,466 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:59:00,466 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:36932': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:00,466 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:36948': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:00,578 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:59:00,578 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:59:00,578 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:36962': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:00,578 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:36964': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:00,689 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:59:00,689 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:59:00,690 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:36974': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:00,690 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:36988': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:00,800 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:59:00,801 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:59:00,801 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:36992': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:00,801 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:37008': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:00,913 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:59:00,913 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:59:00,913 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:37014': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:00,913 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:37030': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:01,025 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:59:01,025 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:59:01,026 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:37044': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:01,026 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:37048': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:01,137 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:59:01,138 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:59:01,138 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:37058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:01,138 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:37070': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:01,250 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:59:01,250 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:59:01,250 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:37084': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:01,250 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:37098': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:01,362 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:59:01,362 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:59:01,362 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:37112': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:01,362 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:37118': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:01,474 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:59:01,474 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:59:01,475 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:37130': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:01,475 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:37144': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:01,586 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:59:01,586 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:59:01,586 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:46892': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:01,586 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:46900': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:01,699 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:59:01,700 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:59:01,700 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:46914': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:01,700 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:46924': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:01,814 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:59:01,815 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:59:01,815 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:46936': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:01,815 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:46940': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:01,928 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:59:01,928 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:59:01,928 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:46948': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:01,928 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:46960': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:02,040 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:59:02,040 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:59:02,040 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:46974': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:02,040 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:46986': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:02,152 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:59:02,152 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:59:02,152 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:46996': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:02,152 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:47012': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:02,264 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:59:02,265 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:59:02,265 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:47024': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:02,265 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:47036': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:02,377 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:59:02,377 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:59:02,378 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:47040': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:02,378 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:47050': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:02,489 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:59:02,489 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:59:02,489 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:47052': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:02,489 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:47066': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:02,600 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:59:02,601 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:59:02,601 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:47072': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:02,601 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:47086': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:02,712 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:59:02,712 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:59:02,713 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:47094': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:02,713 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:47098': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:02,825 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:59:02,825 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:59:02,825 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:47100': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:02,825 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:47104': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:02,937 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:59:02,937 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:59:02,937 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:47120': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:02,937 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:47126': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:03,050 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:59:03,050 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:59:03,051 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:47128': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:03,051 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:47134': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:03,162 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:59:03,162 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:59:03,163 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:47150': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:03,163 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:47166': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:03,275 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:59:03,275 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:59:03,275 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:47170': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:03,275 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:47176': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:03,386 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:59:03,387 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:59:03,387 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:47178': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:03,387 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:47190': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:03,498 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:59:03,498 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:59:03,498 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:47200': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:03,498 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:47202': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:03,610 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:59:03,610 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:59:03,610 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:47208': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:03,610 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:47224': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:03,722 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:59:03,722 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:59:03,723 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:47228': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:03,723 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:47244': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:03,834 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:59:03,834 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:59:03,837 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:47254': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:03,837 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:47264': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:03,946 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:59:03,946 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:59:03,946 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:47278': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:03,946 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:47284': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:04,058 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:59:04,058 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:59:04,059 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:47300': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:04,059 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:47306': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:04,170 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:59:04,170 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:59:04,171 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:47310': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:04,171 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:47324': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:04,282 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:59:04,282 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:59:04,282 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:47328': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:04,282 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:47336': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:04,393 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:59:04,393 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:59:04,394 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:47344': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:04,394 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:47354': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:04,506 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:59:04,506 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:59:04,506 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:47366': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:04,506 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:47378': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:04,618 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:59:04,619 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:59:04,619 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:47388': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:04,619 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:47396': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:04,732 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:59:04,732 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:59:04,732 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:47398': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:04,732 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:47410': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:04,844 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:59:04,844 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:59:04,844 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:47420': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:04,844 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:47432': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:04,955 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:59:04,955 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:59:04,955 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:47440': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:04,956 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:47450': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:05,066 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:59:05,067 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:59:05,067 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:47458': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:05,067 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:47470': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:05,178 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:59:05,178 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:59:05,178 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:47486': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:05,178 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:47492': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:05,290 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:59:05,290 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:59:05,291 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:47504': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:05,291 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:47508': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:05,402 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:59:05,403 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:59:05,403 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:47510': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:05,403 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:47526': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:05,514 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:59:05,514 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:59:05,514 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:47528': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:05,514 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:47536': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:05,626 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:59:05,626 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:59:05,627 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:47542': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:05,627 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:47556': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:05,733 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:59:05,737 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:47558': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:05,738 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:59:05,738 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:47560': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:05,840 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:59:05,840 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:47574': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:05,846 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:59:05,846 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:47590': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:05,948 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:59:05,948 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:47598': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:05,953 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:59:05,954 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:47602': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:06,055 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:59:06,056 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:47608': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:06,061 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:59:06,061 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:47624': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:06,161 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:59:06,162 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:47626': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:06,167 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:59:06,168 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:47634': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:06,270 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:59:06,270 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:47642': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:06,276 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:59:06,276 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:47658': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:06,378 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:59:06,378 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:47668': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:06,383 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:59:06,384 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:47674': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:06,487 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:59:06,487 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:47684': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:06,493 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:59:06,493 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:47692': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:06,594 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:59:06,595 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:47702': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:06,601 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:59:06,601 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:47708': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:06,702 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:59:06,702 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:47716': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:06,708 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:59:06,708 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:47720': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:06,810 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:59:06,810 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:47724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:06,816 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43803 5986s 2024-11-23 21:59:06,816 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43803': TLS handshake failed with remote 'tls://127.0.0.1:47730': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:06,837 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46217. Reason: failure-to-start- 5986s 2024-11-23 21:59:06,837 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:59:06,838 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 13s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 5986s stream = await stream.start_tls( 5986s ^^^^^^^^^^^^^^^^^^^^^^^ 5986s False, ssl_options=ssl_options, server_hostname=host 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 5986s self.socket.do_handshake() 5986s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 5986s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 5986s self._sslobj.do_handshake() 5986s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 5986s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 5986s raise FatalCommClosedError( 5986s ...<2 lines>... 5986s ) from err 5986s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 5986s 5986s During handling of the above exception, another exception occurred: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1218, in _register_with_scheduler 5986s await asyncio.sleep(0.1) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 718, in sleep 5986s return await future 5986s ^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 13s. 5986s 2024-11-23 21:59:06,842 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39253. Reason: failure-to-start- 5986s 2024-11-23 21:59:06,842 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:59:07,845 - distributed.scheduler - INFO - State start 5986s 2024-11-23 21:59:07,851 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41479 5986s 2024-11-23 21:59:07,851 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45411/status 5986s 2024-11-23 21:59:07,851 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 21:59:07,863 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38135 5986s 2024-11-23 21:59:07,864 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38135 5986s 2024-11-23 21:59:07,864 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 21:59:07,864 - distributed.worker - INFO - dashboard at: 127.0.0.1:40849 5986s 2024-11-23 21:59:07,864 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41479 5986s 2024-11-23 21:59:07,864 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:59:07,864 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 21:59:07,864 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:59:07,864 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-4ezuu5ph 5986s 2024-11-23 21:59:07,864 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:59:07,866 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36457 5986s 2024-11-23 21:59:07,866 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36457 5986s 2024-11-23 21:59:07,866 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 21:59:07,866 - distributed.worker - INFO - dashboard at: 127.0.0.1:40007 5986s 2024-11-23 21:59:07,866 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41479 5986s 2024-11-23 21:59:07,866 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:59:07,866 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 21:59:07,866 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:59:07,866 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-1qmtovwp 5986s 2024-11-23 21:59:07,866 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:59:07,867 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38135. Reason: failure-to-start- 5986s 2024-11-23 21:59:07,867 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:59:07,868 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36457. Reason: failure-to-start- 5986s 2024-11-23 21:59:07,868 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:59:07,869 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41479': TLS handshake failed with remote 'tls://127.0.0.1:43960': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:59:07,869 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41479': TLS handshake failed with remote 'tls://127.0.0.1:43970': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:59:07,870 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 21:59:08,876 - distributed.scheduler - INFO - State start 5986s 2024-11-23 21:59:08,882 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41955 5986s 2024-11-23 21:59:08,882 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44149/status 5986s 2024-11-23 21:59:08,883 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 21:59:08,894 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38107 5986s 2024-11-23 21:59:08,894 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38107 5986s 2024-11-23 21:59:08,894 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 21:59:08,894 - distributed.worker - INFO - dashboard at: 127.0.0.1:45271 5986s 2024-11-23 21:59:08,894 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41955 5986s 2024-11-23 21:59:08,895 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:59:08,895 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 21:59:08,895 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:59:08,895 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-xmtleu8q 5986s 2024-11-23 21:59:08,895 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:59:08,896 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41419 5986s 2024-11-23 21:59:08,897 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41419 5986s 2024-11-23 21:59:08,897 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 21:59:08,897 - distributed.worker - INFO - dashboard at: 127.0.0.1:44089 5986s 2024-11-23 21:59:08,897 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41955 5986s 2024-11-23 21:59:08,897 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:59:08,897 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 21:59:08,897 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:59:08,897 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-krckmqc1 5986s 2024-11-23 21:59:08,897 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:59:08,898 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38107. Reason: failure-to-start- 5986s 2024-11-23 21:59:08,898 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:59:08,898 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41419. Reason: failure-to-start- 5986s 2024-11-23 21:59:08,898 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:59:08,899 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41955': TLS handshake failed with remote 'tls://127.0.0.1:53302': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:59:08,899 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41955': TLS handshake failed with remote 'tls://127.0.0.1:53316': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:59:08,900 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 21:59:09,905 - distributed.scheduler - INFO - State start 5986s 2024-11-23 21:59:09,912 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46163 5986s 2024-11-23 21:59:09,912 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41695/status 5986s 2024-11-23 21:59:09,912 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 21:59:09,924 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33251 5986s 2024-11-23 21:59:09,924 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33251 5986s 2024-11-23 21:59:09,924 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 21:59:09,924 - distributed.worker - INFO - dashboard at: 127.0.0.1:40851 5986s 2024-11-23 21:59:09,924 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46163 5986s 2024-11-23 21:59:09,924 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:59:09,924 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 21:59:09,924 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:59:09,924 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-rtdnwjmp 5986s 2024-11-23 21:59:09,925 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:59:09,926 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41613 5986s 2024-11-23 21:59:09,926 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41613 5986s 2024-11-23 21:59:09,926 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 21:59:09,927 - distributed.worker - INFO - dashboard at: 127.0.0.1:37533 5986s 2024-11-23 21:59:09,927 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46163 5986s 2024-11-23 21:59:09,927 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:59:09,927 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 21:59:09,927 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:59:09,927 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-a2pm0csp 5986s 2024-11-23 21:59:09,927 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:59:09,928 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33251. Reason: failure-to-start- 5986s 2024-11-23 21:59:09,928 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:59:09,928 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41613. Reason: failure-to-start- 5986s 2024-11-23 21:59:09,928 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:59:09,929 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46163': TLS handshake failed with remote 'tls://127.0.0.1:60322': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:59:09,929 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46163': TLS handshake failed with remote 'tls://127.0.0.1:60336': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:59:09,930 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 21:59:10,935 - distributed.scheduler - INFO - State start 5986s 2024-11-23 21:59:10,941 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44113 5986s 2024-11-23 21:59:10,941 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46729/status 5986s 2024-11-23 21:59:10,941 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 21:59:10,953 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39345 5986s 2024-11-23 21:59:10,953 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39345 5986s 2024-11-23 21:59:10,953 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 21:59:10,953 - distributed.worker - INFO - dashboard at: 127.0.0.1:40331 5986s 2024-11-23 21:59:10,953 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44113 5986s 2024-11-23 21:59:10,953 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:59:10,953 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 21:59:10,954 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:59:10,954 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-3xgxpmf_ 5986s 2024-11-23 21:59:10,954 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:59:10,955 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40963 5986s 2024-11-23 21:59:10,955 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40963 5986s 2024-11-23 21:59:10,955 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 21:59:10,955 - distributed.worker - INFO - dashboard at: 127.0.0.1:37187 5986s 2024-11-23 21:59:10,955 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44113 5986s 2024-11-23 21:59:10,955 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:59:10,955 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 21:59:10,956 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:59:10,956 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-n0fgchp9 5986s 2024-11-23 21:59:10,956 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:59:10,956 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39345. Reason: failure-to-start- 5986s 2024-11-23 21:59:10,957 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:59:10,957 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40963. Reason: failure-to-start- 5986s 2024-11-23 21:59:10,957 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:59:10,958 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44113': TLS handshake failed with remote 'tls://127.0.0.1:59606': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:59:10,958 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44113': TLS handshake failed with remote 'tls://127.0.0.1:59620': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:59:10,959 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 21:59:11,965 - distributed.scheduler - INFO - State start 5986s 2024-11-23 21:59:11,971 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44375 5986s 2024-11-23 21:59:11,971 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40009/status 5986s 2024-11-23 21:59:11,971 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 21:59:11,983 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33491 5986s 2024-11-23 21:59:11,983 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33491 5986s 2024-11-23 21:59:11,983 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 21:59:11,983 - distributed.worker - INFO - dashboard at: 127.0.0.1:40055 5986s 2024-11-23 21:59:11,983 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44375 5986s 2024-11-23 21:59:11,983 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:59:11,983 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 21:59:11,983 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:59:11,984 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-1d1hl1oe 5986s 2024-11-23 21:59:11,984 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:59:11,985 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42577 5986s 2024-11-23 21:59:11,985 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42577 5986s 2024-11-23 21:59:11,985 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 21:59:11,985 - distributed.worker - INFO - dashboard at: 127.0.0.1:40383 5986s 2024-11-23 21:59:11,985 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44375 5986s 2024-11-23 21:59:11,985 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:59:11,986 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 21:59:11,986 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:59:11,986 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-4kww6x7s 5986s 2024-11-23 21:59:11,986 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:59:11,986 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33491. Reason: failure-to-start- 5986s 2024-11-23 21:59:11,987 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:59:11,988 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42577. Reason: failure-to-start- 5986s 2024-11-23 21:59:11,988 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:59:11,989 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44375': TLS handshake failed with remote 'tls://127.0.0.1:53538': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:59:11,989 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44375': TLS handshake failed with remote 'tls://127.0.0.1:53544': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:59:11,990 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 21:59:12,996 - distributed.scheduler - INFO - State start 5986s 2024-11-23 21:59:13,004 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46363 5986s 2024-11-23 21:59:13,005 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34331/status 5986s 2024-11-23 21:59:13,005 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 21:59:13,018 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46283 5986s 2024-11-23 21:59:13,018 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46283 5986s 2024-11-23 21:59:13,018 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 21:59:13,018 - distributed.worker - INFO - dashboard at: 127.0.0.1:33623 5986s 2024-11-23 21:59:13,018 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46363 5986s 2024-11-23 21:59:13,018 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:59:13,018 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 21:59:13,018 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:59:13,018 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-eaikcei2 5986s 2024-11-23 21:59:13,018 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:59:13,020 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43165 5986s 2024-11-23 21:59:13,020 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43165 5986s 2024-11-23 21:59:13,021 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 21:59:13,021 - distributed.worker - INFO - dashboard at: 127.0.0.1:33257 5986s 2024-11-23 21:59:13,021 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46363 5986s 2024-11-23 21:59:13,021 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:59:13,021 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 21:59:13,021 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:59:13,021 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-h_m3l_q0 5986s 2024-11-23 21:59:13,021 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:59:13,022 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46283. Reason: failure-to-start- 5986s 2024-11-23 21:59:13,022 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:59:13,022 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43165. Reason: failure-to-start- 5986s 2024-11-23 21:59:13,022 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:59:13,023 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46363': TLS handshake failed with remote 'tls://127.0.0.1:34112': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:59:13,024 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46363': TLS handshake failed with remote 'tls://127.0.0.1:34116': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:59:13,025 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 21:59:14,030 - distributed.scheduler - INFO - State start 5986s 2024-11-23 21:59:14,037 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41547 5986s 2024-11-23 21:59:14,038 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36553/status 5986s 2024-11-23 21:59:14,038 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 21:59:14,050 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42339 5986s 2024-11-23 21:59:14,050 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42339 5986s 2024-11-23 21:59:14,051 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 21:59:14,051 - distributed.worker - INFO - dashboard at: 127.0.0.1:33643 5986s 2024-11-23 21:59:14,051 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41547 5986s 2024-11-23 21:59:14,051 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:59:14,051 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 21:59:14,051 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:59:14,051 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-5mubhm4g 5986s 2024-11-23 21:59:14,051 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:59:14,053 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37359 5986s 2024-11-23 21:59:14,053 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37359 5986s 2024-11-23 21:59:14,053 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 21:59:14,053 - distributed.worker - INFO - dashboard at: 127.0.0.1:36031 5986s 2024-11-23 21:59:14,053 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41547 5986s 2024-11-23 21:59:14,053 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:59:14,053 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 21:59:14,053 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:59:14,053 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-__z0l4c_ 5986s 2024-11-23 21:59:14,053 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:59:14,054 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42339. Reason: failure-to-start- 5986s 2024-11-23 21:59:14,054 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:59:14,055 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37359. Reason: failure-to-start- 5986s 2024-11-23 21:59:14,055 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:59:14,056 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41547': TLS handshake failed with remote 'tls://127.0.0.1:45360': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:59:14,056 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41547': TLS handshake failed with remote 'tls://127.0.0.1:45372': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:59:14,057 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 21:59:15,062 - distributed.scheduler - INFO - State start 5986s 2024-11-23 21:59:15,068 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35219 5986s 2024-11-23 21:59:15,069 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36703/status 5986s 2024-11-23 21:59:15,069 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 21:59:15,087 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39479 5986s 2024-11-23 21:59:15,087 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39479 5986s 2024-11-23 21:59:15,087 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 21:59:15,087 - distributed.worker - INFO - dashboard at: 127.0.0.1:43881 5986s 2024-11-23 21:59:15,087 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35219 5986s 2024-11-23 21:59:15,087 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:59:15,087 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 21:59:15,087 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:59:15,088 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-s8tvu90j 5986s 2024-11-23 21:59:15,088 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:59:15,089 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35351 5986s 2024-11-23 21:59:15,089 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35351 5986s 2024-11-23 21:59:15,090 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 21:59:15,090 - distributed.worker - INFO - dashboard at: 127.0.0.1:34607 5986s 2024-11-23 21:59:15,090 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35219 5986s 2024-11-23 21:59:15,090 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:59:15,090 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 21:59:15,090 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:59:15,090 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-gggcvrap 5986s 2024-11-23 21:59:15,090 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:59:15,091 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39479. Reason: failure-to-start- 5986s 2024-11-23 21:59:15,091 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:59:15,091 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35351. Reason: failure-to-start- 5986s 2024-11-23 21:59:15,091 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:59:15,092 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35219': TLS handshake failed with remote 'tls://127.0.0.1:45246': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:59:15,093 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35219': TLS handshake failed with remote 'tls://127.0.0.1:45258': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:59:15,094 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 21:59:16,099 - distributed.scheduler - INFO - State start 5986s 2024-11-23 21:59:16,106 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43815 5986s 2024-11-23 21:59:16,106 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37603/status 5986s 2024-11-23 21:59:16,107 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 21:59:16,119 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41765 5986s 2024-11-23 21:59:16,119 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41765 5986s 2024-11-23 21:59:16,119 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 21:59:16,119 - distributed.worker - INFO - dashboard at: 127.0.0.1:36245 5986s 2024-11-23 21:59:16,119 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43815 5986s 2024-11-23 21:59:16,119 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:59:16,119 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 21:59:16,119 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:59:16,119 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-lu0xj7wl 5986s 2024-11-23 21:59:16,119 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:59:16,121 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40099 5986s 2024-11-23 21:59:16,121 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40099 5986s 2024-11-23 21:59:16,121 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 21:59:16,121 - distributed.worker - INFO - dashboard at: 127.0.0.1:35961 5986s 2024-11-23 21:59:16,121 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43815 5986s 2024-11-23 21:59:16,121 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:59:16,121 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 21:59:16,122 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:59:16,122 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-e5tfjpan 5986s 2024-11-23 21:59:16,122 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:59:16,123 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41765. Reason: failure-to-start- 5986s 2024-11-23 21:59:16,123 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:59:16,124 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40099. Reason: failure-to-start- 5986s 2024-11-23 21:59:16,124 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:59:16,125 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43815': TLS handshake failed with remote 'tls://127.0.0.1:38606': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:59:16,125 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43815': TLS handshake failed with remote 'tls://127.0.0.1:38622': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:59:16,126 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 21:59:17,131 - distributed.scheduler - INFO - State start 5986s 2024-11-23 21:59:17,138 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36279 5986s 2024-11-23 21:59:17,139 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40281/status 5986s 2024-11-23 21:59:17,139 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 21:59:17,151 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46241 5986s 2024-11-23 21:59:17,151 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46241 5986s 2024-11-23 21:59:17,152 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 21:59:17,152 - distributed.worker - INFO - dashboard at: 127.0.0.1:45905 5986s 2024-11-23 21:59:17,152 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36279 5986s 2024-11-23 21:59:17,152 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:59:17,152 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 21:59:17,152 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:59:17,152 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-0wca078q 5986s 2024-11-23 21:59:17,152 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:59:17,154 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38417 5986s 2024-11-23 21:59:17,154 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38417 5986s 2024-11-23 21:59:17,154 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 21:59:17,154 - distributed.worker - INFO - dashboard at: 127.0.0.1:46737 5986s 2024-11-23 21:59:17,154 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36279 5986s 2024-11-23 21:59:17,154 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:59:17,154 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 21:59:17,154 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:59:17,154 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-i9ut9qoz 5986s 2024-11-23 21:59:17,154 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:59:17,155 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46241. Reason: failure-to-start- 5986s 2024-11-23 21:59:17,155 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:59:17,156 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38417. Reason: failure-to-start- 5986s 2024-11-23 21:59:17,156 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:59:17,157 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36279': TLS handshake failed with remote 'tls://127.0.0.1:54474': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:59:17,157 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36279': TLS handshake failed with remote 'tls://127.0.0.1:54486': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:59:17,158 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 21:59:18,163 - distributed.scheduler - INFO - State start 5986s 2024-11-23 21:59:18,170 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37089 5986s 2024-11-23 21:59:18,170 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34447/status 5986s 2024-11-23 21:59:18,171 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 21:59:18,182 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36297 5986s 2024-11-23 21:59:18,182 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36297 5986s 2024-11-23 21:59:18,182 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 21:59:18,182 - distributed.worker - INFO - dashboard at: 127.0.0.1:36227 5986s 2024-11-23 21:59:18,183 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37089 5986s 2024-11-23 21:59:18,183 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:59:18,183 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 21:59:18,183 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:59:18,183 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-lvrqlpsi 5986s 2024-11-23 21:59:18,183 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:59:18,184 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43101 5986s 2024-11-23 21:59:18,184 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43101 5986s 2024-11-23 21:59:18,184 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 21:59:18,185 - distributed.worker - INFO - dashboard at: 127.0.0.1:38949 5986s 2024-11-23 21:59:18,185 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37089 5986s 2024-11-23 21:59:18,185 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:59:18,185 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 21:59:18,185 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:59:18,185 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-h0150b6h 5986s 2024-11-23 21:59:18,185 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:59:18,186 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36297. Reason: failure-to-start- 5986s 2024-11-23 21:59:18,186 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:59:18,186 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43101. Reason: failure-to-start- 5986s 2024-11-23 21:59:18,186 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:59:18,187 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37089': TLS handshake failed with remote 'tls://127.0.0.1:58382': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:59:18,187 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37089': TLS handshake failed with remote 'tls://127.0.0.1:58386': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:59:18,188 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 21:59:19,193 - distributed.scheduler - INFO - State start 5986s 2024-11-23 21:59:19,200 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43489 5986s 2024-11-23 21:59:19,200 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36939/status 5986s 2024-11-23 21:59:19,200 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 21:59:19,214 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:32895 5986s 2024-11-23 21:59:19,214 - distributed.worker - INFO - Listening to: tls://127.0.0.1:32895 5986s 2024-11-23 21:59:19,214 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 21:59:19,214 - distributed.worker - INFO - dashboard at: 127.0.0.1:38025 5986s 2024-11-23 21:59:19,214 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43489 5986s 2024-11-23 21:59:19,214 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:59:19,214 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 21:59:19,214 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:59:19,214 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-fnaed89p 5986s 2024-11-23 21:59:19,214 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:59:19,216 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34829 5986s 2024-11-23 21:59:19,216 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34829 5986s 2024-11-23 21:59:19,216 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 21:59:19,216 - distributed.worker - INFO - dashboard at: 127.0.0.1:43265 5986s 2024-11-23 21:59:19,216 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43489 5986s 2024-11-23 21:59:19,216 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:59:19,216 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 21:59:19,216 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:59:19,216 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ske072te 5986s 2024-11-23 21:59:19,217 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:59:19,217 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:32895. Reason: failure-to-start- 5986s 2024-11-23 21:59:19,218 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:59:19,218 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34829. Reason: failure-to-start- 5986s 2024-11-23 21:59:19,218 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:59:19,219 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43489': TLS handshake failed with remote 'tls://127.0.0.1:44496': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:59:19,219 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43489': TLS handshake failed with remote 'tls://127.0.0.1:44502': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:59:19,220 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 21:59:20,225 - distributed.scheduler - INFO - State start 5986s 2024-11-23 21:59:20,232 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45819 5986s 2024-11-23 21:59:20,232 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41875/status 5986s 2024-11-23 21:59:20,232 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 21:59:20,245 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37553 5986s 2024-11-23 21:59:20,245 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37553 5986s 2024-11-23 21:59:20,245 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 21:59:20,245 - distributed.worker - INFO - dashboard at: 127.0.0.1:39079 5986s 2024-11-23 21:59:20,245 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45819 5986s 2024-11-23 21:59:20,245 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:59:20,245 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 21:59:20,245 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:59:20,245 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-0p70jv7e 5986s 2024-11-23 21:59:20,245 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:59:20,248 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36127 5986s 2024-11-23 21:59:20,248 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36127 5986s 2024-11-23 21:59:20,248 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 21:59:20,248 - distributed.worker - INFO - dashboard at: 127.0.0.1:33131 5986s 2024-11-23 21:59:20,248 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45819 5986s 2024-11-23 21:59:20,248 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:59:20,248 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 21:59:20,248 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:59:20,248 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-9rpnrl2d 5986s 2024-11-23 21:59:20,248 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:59:20,249 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37553. Reason: failure-to-start- 5986s 2024-11-23 21:59:20,249 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:59:20,250 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36127. Reason: failure-to-start- 5986s 2024-11-23 21:59:20,250 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:59:20,251 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45819': TLS handshake failed with remote 'tls://127.0.0.1:40326': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:59:20,251 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45819': TLS handshake failed with remote 'tls://127.0.0.1:40332': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:59:20,252 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 21:59:21,257 - distributed.scheduler - INFO - State start 5986s 2024-11-23 21:59:21,264 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41115 5986s 2024-11-23 21:59:21,264 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39821/status 5986s 2024-11-23 21:59:21,264 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 21:59:21,278 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45541 5986s 2024-11-23 21:59:21,278 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45541 5986s 2024-11-23 21:59:21,278 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 21:59:21,278 - distributed.worker - INFO - dashboard at: 127.0.0.1:43471 5986s 2024-11-23 21:59:21,278 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41115 5986s 2024-11-23 21:59:21,279 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:59:21,279 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 21:59:21,279 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:59:21,279 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-9e636ppy 5986s 2024-11-23 21:59:21,279 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:59:21,280 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40615 5986s 2024-11-23 21:59:21,281 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40615 5986s 2024-11-23 21:59:21,281 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 21:59:21,281 - distributed.worker - INFO - dashboard at: 127.0.0.1:46223 5986s 2024-11-23 21:59:21,281 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41115 5986s 2024-11-23 21:59:21,281 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:59:21,281 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 21:59:21,281 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:59:21,281 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-eblulctl 5986s 2024-11-23 21:59:21,281 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:59:21,282 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45541. Reason: failure-to-start- 5986s 2024-11-23 21:59:21,282 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:59:21,283 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40615. Reason: failure-to-start- 5986s 2024-11-23 21:59:21,283 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:59:21,283 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41115': TLS handshake failed with remote 'tls://127.0.0.1:53084': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:59:21,284 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41115': TLS handshake failed with remote 'tls://127.0.0.1:53096': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:59:21,285 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 21:59:22,290 - distributed.scheduler - INFO - State start 5986s 2024-11-23 21:59:22,296 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36799 5986s 2024-11-23 21:59:22,296 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45519/status 5986s 2024-11-23 21:59:22,296 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 21:59:22,308 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33605 5986s 2024-11-23 21:59:22,309 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33605 5986s 2024-11-23 21:59:22,309 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 21:59:22,309 - distributed.worker - INFO - dashboard at: 127.0.0.1:37945 5986s 2024-11-23 21:59:22,309 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36799 5986s 2024-11-23 21:59:22,309 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:59:22,309 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 21:59:22,309 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:59:22,309 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-q3crt_a9 5986s 2024-11-23 21:59:22,309 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:59:22,311 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41947 5986s 2024-11-23 21:59:22,311 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41947 5986s 2024-11-23 21:59:22,311 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 21:59:22,311 - distributed.worker - INFO - dashboard at: 127.0.0.1:44431 5986s 2024-11-23 21:59:22,311 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36799 5986s 2024-11-23 21:59:22,311 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:59:22,311 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 21:59:22,311 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:59:22,311 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-grhfdo9b 5986s 2024-11-23 21:59:22,311 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:59:22,316 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33605. Reason: failure-to-start- 5986s 2024-11-23 21:59:22,316 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:59:22,317 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41947. Reason: failure-to-start- 5986s 2024-11-23 21:59:22,317 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:59:22,318 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36799': TLS handshake failed with remote 'tls://127.0.0.1:58384': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:59:22,318 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36799': TLS handshake failed with remote 'tls://127.0.0.1:58392': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:59:22,319 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 21:59:23,324 - distributed.scheduler - INFO - State start 5986s 2024-11-23 21:59:23,331 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35783 5986s 2024-11-23 21:59:23,331 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37205/status 5986s 2024-11-23 21:59:23,331 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 21:59:23,346 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36179 5986s 2024-11-23 21:59:23,346 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36179 5986s 2024-11-23 21:59:23,346 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 21:59:23,346 - distributed.worker - INFO - dashboard at: 127.0.0.1:44639 5986s 2024-11-23 21:59:23,346 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35783 5986s 2024-11-23 21:59:23,346 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:59:23,346 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 21:59:23,346 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:59:23,346 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-gujvl3p_ 5986s 2024-11-23 21:59:23,346 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:59:23,348 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44929 5986s 2024-11-23 21:59:23,348 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44929 5986s 2024-11-23 21:59:23,348 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 21:59:23,348 - distributed.worker - INFO - dashboard at: 127.0.0.1:38851 5986s 2024-11-23 21:59:23,348 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35783 5986s 2024-11-23 21:59:23,348 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:59:23,348 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 21:59:23,348 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:59:23,348 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-zsg7m0bp 5986s 2024-11-23 21:59:23,349 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:59:23,349 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36179. Reason: failure-to-start- 5986s 2024-11-23 21:59:23,350 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:59:23,350 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44929. Reason: failure-to-start- 5986s 2024-11-23 21:59:23,350 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:59:23,351 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35783': TLS handshake failed with remote 'tls://127.0.0.1:44346': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:59:23,351 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35783': TLS handshake failed with remote 'tls://127.0.0.1:44352': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:59:23,352 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 21:59:24,357 - distributed.scheduler - INFO - State start 5986s 2024-11-23 21:59:24,363 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45393 5986s 2024-11-23 21:59:24,363 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36705/status 5986s 2024-11-23 21:59:24,364 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 21:59:24,378 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38741 5986s 2024-11-23 21:59:24,378 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38741 5986s 2024-11-23 21:59:24,378 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 21:59:24,378 - distributed.worker - INFO - dashboard at: 127.0.0.1:44629 5986s 2024-11-23 21:59:24,378 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45393 5986s 2024-11-23 21:59:24,378 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:59:24,378 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 21:59:24,378 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:59:24,379 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-jhh_7upe 5986s 2024-11-23 21:59:24,379 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:59:24,380 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41699 5986s 2024-11-23 21:59:24,380 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41699 5986s 2024-11-23 21:59:24,380 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 21:59:24,380 - distributed.worker - INFO - dashboard at: 127.0.0.1:38953 5986s 2024-11-23 21:59:24,381 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45393 5986s 2024-11-23 21:59:24,381 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:59:24,381 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 21:59:24,381 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:59:24,381 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-firta2mt 5986s 2024-11-23 21:59:24,381 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:59:24,382 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38741. Reason: failure-to-start- 5986s 2024-11-23 21:59:24,382 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:59:24,382 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41699. Reason: failure-to-start- 5986s 2024-11-23 21:59:24,382 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:59:24,383 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45393': TLS handshake failed with remote 'tls://127.0.0.1:58488': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:59:24,383 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45393': TLS handshake failed with remote 'tls://127.0.0.1:58496': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:59:24,387 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 21:59:25,392 - distributed.scheduler - INFO - State start 5986s 2024-11-23 21:59:25,398 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40049 5986s 2024-11-23 21:59:25,398 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42237/status 5986s 2024-11-23 21:59:25,398 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 21:59:25,410 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42551 5986s 2024-11-23 21:59:25,410 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42551 5986s 2024-11-23 21:59:25,410 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 21:59:25,410 - distributed.worker - INFO - dashboard at: 127.0.0.1:40079 5986s 2024-11-23 21:59:25,410 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40049 5986s 2024-11-23 21:59:25,411 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:59:25,411 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 21:59:25,411 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:59:25,411 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-in6dqgyw 5986s 2024-11-23 21:59:25,411 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:59:25,412 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45447 5986s 2024-11-23 21:59:25,413 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45447 5986s 2024-11-23 21:59:25,413 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 21:59:25,413 - distributed.worker - INFO - dashboard at: 127.0.0.1:40143 5986s 2024-11-23 21:59:25,413 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40049 5986s 2024-11-23 21:59:25,413 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:59:25,413 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 21:59:25,413 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:59:25,413 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-1wh94lv8 5986s 2024-11-23 21:59:25,413 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:59:25,415 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42551. Reason: failure-to-start- 5986s 2024-11-23 21:59:25,415 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:59:25,415 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45447. Reason: failure-to-start- 5986s 2024-11-23 21:59:25,415 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:59:25,418 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40049': TLS handshake failed with remote 'tls://127.0.0.1:51640': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:59:25,418 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40049': TLS handshake failed with remote 'tls://127.0.0.1:51648': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:59:25,419 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 21:59:26,424 - distributed.scheduler - INFO - State start 5986s 2024-11-23 21:59:26,431 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45367 5986s 2024-11-23 21:59:26,431 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40071/status 5986s 2024-11-23 21:59:26,431 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 21:59:26,444 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41285 5986s 2024-11-23 21:59:26,444 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41285 5986s 2024-11-23 21:59:26,444 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 21:59:26,444 - distributed.worker - INFO - dashboard at: 127.0.0.1:37979 5986s 2024-11-23 21:59:26,444 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45367 5986s 2024-11-23 21:59:26,444 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:59:26,444 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 21:59:26,444 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:59:26,444 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-nx0krwrp 5986s 2024-11-23 21:59:26,444 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:59:26,446 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40347 5986s 2024-11-23 21:59:26,446 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40347 5986s 2024-11-23 21:59:26,446 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 21:59:26,446 - distributed.worker - INFO - dashboard at: 127.0.0.1:35315 5986s 2024-11-23 21:59:26,446 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45367 5986s 2024-11-23 21:59:26,446 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:59:26,446 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 21:59:26,446 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:59:26,446 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-0zk9rhn8 5986s 2024-11-23 21:59:26,446 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:59:26,449 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41285. Reason: failure-to-start- 5986s 2024-11-23 21:59:26,449 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:59:26,450 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40347. Reason: failure-to-start- 5986s 2024-11-23 21:59:26,450 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:59:26,451 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45367': TLS handshake failed with remote 'tls://127.0.0.1:40186': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:59:26,451 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45367': TLS handshake failed with remote 'tls://127.0.0.1:40202': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:59:26,452 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 21:59:27,458 - distributed.scheduler - INFO - State start 5986s 2024-11-23 21:59:27,465 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42199 5986s 2024-11-23 21:59:27,465 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46615/status 5986s 2024-11-23 21:59:27,465 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 21:59:27,478 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36615 5986s 2024-11-23 21:59:27,478 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36615 5986s 2024-11-23 21:59:27,478 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 21:59:27,478 - distributed.worker - INFO - dashboard at: 127.0.0.1:43725 5986s 2024-11-23 21:59:27,478 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42199 5986s 2024-11-23 21:59:27,478 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:59:27,478 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 21:59:27,478 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:59:27,479 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-87mmlivk 5986s 2024-11-23 21:59:27,479 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:59:27,480 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37449 5986s 2024-11-23 21:59:27,480 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37449 5986s 2024-11-23 21:59:27,481 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 21:59:27,481 - distributed.worker - INFO - dashboard at: 127.0.0.1:40569 5986s 2024-11-23 21:59:27,481 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42199 5986s 2024-11-23 21:59:27,481 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:59:27,481 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 21:59:27,481 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:59:27,481 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-4k9gwibg 5986s 2024-11-23 21:59:27,481 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:59:27,484 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36615. Reason: failure-to-start- 5986s 2024-11-23 21:59:27,484 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:59:27,485 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37449. Reason: failure-to-start- 5986s 2024-11-23 21:59:27,485 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:59:27,486 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42199': TLS handshake failed with remote 'tls://127.0.0.1:53346': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:59:27,486 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42199': TLS handshake failed with remote 'tls://127.0.0.1:53350': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:59:27,487 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 21:59:28,492 - distributed.scheduler - INFO - State start 5986s 2024-11-23 21:59:28,498 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33897 5986s 2024-11-23 21:59:28,498 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38857/status 5986s 2024-11-23 21:59:28,498 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 21:59:28,511 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41475 5986s 2024-11-23 21:59:28,511 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41475 5986s 2024-11-23 21:59:28,512 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 21:59:28,512 - distributed.worker - INFO - dashboard at: 127.0.0.1:34955 5986s 2024-11-23 21:59:28,512 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33897 5986s 2024-11-23 21:59:28,512 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:59:28,512 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 21:59:28,512 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:59:28,512 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-22d06058 5986s 2024-11-23 21:59:28,512 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:59:28,514 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40377 5986s 2024-11-23 21:59:28,514 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40377 5986s 2024-11-23 21:59:28,514 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 21:59:28,514 - distributed.worker - INFO - dashboard at: 127.0.0.1:35847 5986s 2024-11-23 21:59:28,514 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33897 5986s 2024-11-23 21:59:28,514 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:59:28,514 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 21:59:28,514 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:59:28,514 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-xo4sm41y 5986s 2024-11-23 21:59:28,514 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:59:28,518 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41475. Reason: failure-to-start- 5986s 2024-11-23 21:59:28,518 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:59:28,518 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40377. Reason: failure-to-start- 5986s 2024-11-23 21:59:28,518 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:59:28,519 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33897': TLS handshake failed with remote 'tls://127.0.0.1:44574': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:59:28,519 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33897': TLS handshake failed with remote 'tls://127.0.0.1:44588': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:59:28,520 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 21:59:29,527 - distributed.scheduler - INFO - State start 5986s 2024-11-23 21:59:29,534 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39193 5986s 2024-11-23 21:59:29,535 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41891/status 5986s 2024-11-23 21:59:29,535 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 21:59:29,548 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39743 5986s 2024-11-23 21:59:29,549 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39743 5986s 2024-11-23 21:59:29,549 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 21:59:29,549 - distributed.worker - INFO - dashboard at: 127.0.0.1:36905 5986s 2024-11-23 21:59:29,549 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39193 5986s 2024-11-23 21:59:29,549 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:59:29,549 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 21:59:29,549 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:59:29,549 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-wxumg47w 5986s 2024-11-23 21:59:29,549 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:59:29,551 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39097 5986s 2024-11-23 21:59:29,551 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39097 5986s 2024-11-23 21:59:29,551 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 21:59:29,551 - distributed.worker - INFO - dashboard at: 127.0.0.1:39969 5986s 2024-11-23 21:59:29,551 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39193 5986s 2024-11-23 21:59:29,551 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:59:29,551 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 21:59:29,552 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:59:29,552 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-zcjzlpuk 5986s 2024-11-23 21:59:29,552 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:59:29,555 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39743. Reason: failure-to-start- 5986s 2024-11-23 21:59:29,555 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:59:29,555 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39097. Reason: failure-to-start- 5986s 2024-11-23 21:59:29,555 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:59:29,557 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39193': TLS handshake failed with remote 'tls://127.0.0.1:52030': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:59:29,557 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39193': TLS handshake failed with remote 'tls://127.0.0.1:52038': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:59:29,558 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 21:59:30,564 - distributed.scheduler - INFO - State start 5986s 2024-11-23 21:59:30,570 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43463 5986s 2024-11-23 21:59:30,571 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38235/status 5986s 2024-11-23 21:59:30,571 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 21:59:30,585 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43665 5986s 2024-11-23 21:59:30,585 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43665 5986s 2024-11-23 21:59:30,586 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 21:59:30,586 - distributed.worker - INFO - dashboard at: 127.0.0.1:42713 5986s 2024-11-23 21:59:30,586 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43463 5986s 2024-11-23 21:59:30,586 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:59:30,586 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 21:59:30,586 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:59:30,586 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ypo0ml1b 5986s 2024-11-23 21:59:30,586 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:59:30,588 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38749 5986s 2024-11-23 21:59:30,588 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38749 5986s 2024-11-23 21:59:30,588 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 21:59:30,588 - distributed.worker - INFO - dashboard at: 127.0.0.1:34353 5986s 2024-11-23 21:59:30,588 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43463 5986s 2024-11-23 21:59:30,588 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:59:30,588 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 21:59:30,588 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:59:30,588 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-4slalhf0 5986s 2024-11-23 21:59:30,588 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:59:30,598 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43665. Reason: failure-to-start- 5986s 2024-11-23 21:59:30,598 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:59:30,598 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38749. Reason: failure-to-start- 5986s 2024-11-23 21:59:30,598 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:59:30,599 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43463': TLS handshake failed with remote 'tls://127.0.0.1:40746': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:59:30,599 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43463': TLS handshake failed with remote 'tls://127.0.0.1:40754': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:59:30,601 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 21:59:31,605 - distributed.scheduler - INFO - State start 5986s 2024-11-23 21:59:31,612 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38705 5986s 2024-11-23 21:59:31,612 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45811/status 5986s 2024-11-23 21:59:31,612 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 21:59:31,626 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34291 5986s 2024-11-23 21:59:31,627 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34291 5986s 2024-11-23 21:59:31,627 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 21:59:31,627 - distributed.worker - INFO - dashboard at: 127.0.0.1:41683 5986s 2024-11-23 21:59:31,627 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38705 5986s 2024-11-23 21:59:31,627 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:59:31,627 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 21:59:31,627 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:59:31,627 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-8i1yi4yk 5986s 2024-11-23 21:59:31,627 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:59:31,629 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37711 5986s 2024-11-23 21:59:31,629 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37711 5986s 2024-11-23 21:59:31,629 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 21:59:31,629 - distributed.worker - INFO - dashboard at: 127.0.0.1:43667 5986s 2024-11-23 21:59:31,629 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38705 5986s 2024-11-23 21:59:31,629 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:59:31,629 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 21:59:31,629 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:59:31,629 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-chul4_wi 5986s 2024-11-23 21:59:31,629 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:59:31,630 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34291. Reason: failure-to-start- 5986s 2024-11-23 21:59:31,630 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:59:31,631 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37711. Reason: failure-to-start- 5986s 2024-11-23 21:59:31,631 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:59:31,632 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38705': TLS handshake failed with remote 'tls://127.0.0.1:46780': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:59:31,632 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38705': TLS handshake failed with remote 'tls://127.0.0.1:46792': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:59:31,633 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 21:59:32,638 - distributed.scheduler - INFO - State start 5986s 2024-11-23 21:59:32,644 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:32931 5986s 2024-11-23 21:59:32,644 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39311/status 5986s 2024-11-23 21:59:32,645 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 21:59:32,661 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36505 5986s 2024-11-23 21:59:32,661 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36505 5986s 2024-11-23 21:59:32,661 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 21:59:32,662 - distributed.worker - INFO - dashboard at: 127.0.0.1:41369 5986s 2024-11-23 21:59:32,662 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:32931 5986s 2024-11-23 21:59:32,662 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:59:32,662 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 21:59:32,662 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:59:32,662 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-eqvm5nxq 5986s 2024-11-23 21:59:32,662 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:59:32,664 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33459 5986s 2024-11-23 21:59:32,664 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33459 5986s 2024-11-23 21:59:32,664 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 21:59:32,664 - distributed.worker - INFO - dashboard at: 127.0.0.1:45267 5986s 2024-11-23 21:59:32,664 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:32931 5986s 2024-11-23 21:59:32,664 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:59:32,664 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 21:59:32,664 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:59:32,664 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-fip0bdw1 5986s 2024-11-23 21:59:32,665 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:59:32,666 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36505. Reason: failure-to-start- 5986s 2024-11-23 21:59:32,666 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:59:32,666 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33459. Reason: failure-to-start- 5986s 2024-11-23 21:59:32,666 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:59:32,667 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:32931': TLS handshake failed with remote 'tls://127.0.0.1:46926': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:59:32,668 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:32931': TLS handshake failed with remote 'tls://127.0.0.1:46930': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:59:32,669 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 21:59:33,676 - distributed.scheduler - INFO - State start 5986s 2024-11-23 21:59:33,682 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43045 5986s 2024-11-23 21:59:33,683 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40079/status 5986s 2024-11-23 21:59:33,683 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 21:59:33,697 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38761 5986s 2024-11-23 21:59:33,697 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38761 5986s 2024-11-23 21:59:33,698 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 21:59:33,698 - distributed.worker - INFO - dashboard at: 127.0.0.1:39069 5986s 2024-11-23 21:59:33,698 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43045 5986s 2024-11-23 21:59:33,698 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:59:33,698 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 21:59:33,698 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:59:33,698 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-pdnu4lw8 5986s 2024-11-23 21:59:33,698 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:59:33,700 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44753 5986s 2024-11-23 21:59:33,700 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44753 5986s 2024-11-23 21:59:33,700 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 21:59:33,700 - distributed.worker - INFO - dashboard at: 127.0.0.1:37767 5986s 2024-11-23 21:59:33,700 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43045 5986s 2024-11-23 21:59:33,700 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:59:33,700 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 21:59:33,700 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:59:33,700 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-4a_n8dds 5986s 2024-11-23 21:59:33,700 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:59:33,701 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38761. Reason: failure-to-start- 5986s 2024-11-23 21:59:33,701 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:59:33,702 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44753. Reason: failure-to-start- 5986s 2024-11-23 21:59:33,702 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:59:33,705 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43045': TLS handshake failed with remote 'tls://127.0.0.1:34446': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:59:33,705 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43045': TLS handshake failed with remote 'tls://127.0.0.1:34448': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:59:33,706 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 21:59:34,712 - distributed.scheduler - INFO - State start 5986s 2024-11-23 21:59:34,718 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44367 5986s 2024-11-23 21:59:34,718 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36169/status 5986s 2024-11-23 21:59:34,719 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 21:59:34,731 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41957 5986s 2024-11-23 21:59:34,731 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41957 5986s 2024-11-23 21:59:34,731 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 21:59:34,731 - distributed.worker - INFO - dashboard at: 127.0.0.1:38455 5986s 2024-11-23 21:59:34,731 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44367 5986s 2024-11-23 21:59:34,731 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:59:34,731 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 21:59:34,731 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:59:34,731 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-w5r0rgyp 5986s 2024-11-23 21:59:34,731 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:59:34,733 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41867 5986s 2024-11-23 21:59:34,733 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41867 5986s 2024-11-23 21:59:34,733 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 21:59:34,733 - distributed.worker - INFO - dashboard at: 127.0.0.1:46463 5986s 2024-11-23 21:59:34,733 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44367 5986s 2024-11-23 21:59:34,733 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:59:34,733 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 21:59:34,733 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:59:34,733 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-uobcsbev 5986s 2024-11-23 21:59:34,733 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:59:34,734 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41957. Reason: failure-to-start- 5986s 2024-11-23 21:59:34,735 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:59:34,735 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41867. Reason: failure-to-start- 5986s 2024-11-23 21:59:34,735 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:59:34,738 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44367': TLS handshake failed with remote 'tls://127.0.0.1:32782': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:59:34,738 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44367': TLS handshake failed with remote 'tls://127.0.0.1:32788': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:59:34,739 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 21:59:35,745 - distributed.scheduler - INFO - State start 5986s 2024-11-23 21:59:35,752 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45487 5986s 2024-11-23 21:59:35,752 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39727/status 5986s 2024-11-23 21:59:35,752 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 21:59:35,765 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:32949 5986s 2024-11-23 21:59:35,765 - distributed.worker - INFO - Listening to: tls://127.0.0.1:32949 5986s 2024-11-23 21:59:35,765 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 21:59:35,765 - distributed.worker - INFO - dashboard at: 127.0.0.1:37153 5986s 2024-11-23 21:59:35,765 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45487 5986s 2024-11-23 21:59:35,765 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:59:35,765 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 21:59:35,765 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:59:35,766 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-282_qnwj 5986s 2024-11-23 21:59:35,766 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:59:35,767 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39183 5986s 2024-11-23 21:59:35,768 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39183 5986s 2024-11-23 21:59:35,768 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 21:59:35,768 - distributed.worker - INFO - dashboard at: 127.0.0.1:36389 5986s 2024-11-23 21:59:35,768 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45487 5986s 2024-11-23 21:59:35,768 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:59:35,768 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 21:59:35,768 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:59:35,768 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-3tp_ck8a 5986s 2024-11-23 21:59:35,768 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:59:35,769 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:32949. Reason: failure-to-start- 5986s 2024-11-23 21:59:35,769 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:59:35,769 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39183. Reason: failure-to-start- 5986s 2024-11-23 21:59:35,770 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:59:35,773 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45487': TLS handshake failed with remote 'tls://127.0.0.1:37828': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:59:35,773 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45487': TLS handshake failed with remote 'tls://127.0.0.1:37842': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:59:35,774 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 21:59:36,779 - distributed.scheduler - INFO - State start 5986s 2024-11-23 21:59:36,785 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34099 5986s 2024-11-23 21:59:36,786 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44473/status 5986s 2024-11-23 21:59:36,786 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 21:59:36,800 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33219 5986s 2024-11-23 21:59:36,800 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33219 5986s 2024-11-23 21:59:36,800 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 21:59:36,800 - distributed.worker - INFO - dashboard at: 127.0.0.1:43603 5986s 2024-11-23 21:59:36,800 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34099 5986s 2024-11-23 21:59:36,800 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:59:36,801 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 21:59:36,801 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:59:36,801 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-fc1jbg3l 5986s 2024-11-23 21:59:36,801 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:59:36,802 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37049 5986s 2024-11-23 21:59:36,802 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37049 5986s 2024-11-23 21:59:36,802 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 21:59:36,803 - distributed.worker - INFO - dashboard at: 127.0.0.1:32781 5986s 2024-11-23 21:59:36,803 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34099 5986s 2024-11-23 21:59:36,803 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:59:36,803 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 21:59:36,803 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:59:36,803 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-_320tik9 5986s 2024-11-23 21:59:36,803 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:59:36,806 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33219. Reason: failure-to-start- 5986s 2024-11-23 21:59:36,806 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:59:36,807 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37049. Reason: failure-to-start- 5986s 2024-11-23 21:59:36,807 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:59:36,810 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34099': TLS handshake failed with remote 'tls://127.0.0.1:34676': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:59:36,810 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34099': TLS handshake failed with remote 'tls://127.0.0.1:34678': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 21:59:36,811 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s ______________________________ test_client_submit ______________________________ 5986s 5986s fut = , timeout = 0 5986s 5986s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 5986s async with asyncio.timeout(timeout): 5986s > return await fut 5986s 5986s /usr/lib/python3/dist-packages/distributed/utils.py:1960: 5986s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5986s /usr/lib/python3/dist-packages/distributed/worker.py:1480: in start_unsafe 5986s await self._register_with_scheduler() 5986s /usr/lib/python3/dist-packages/distributed/worker.py:1179: in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s /usr/lib/python3/dist-packages/distributed/comm/core.py:342: in connect 5986s comm = await wait_for( 5986s /usr/lib/python3/dist-packages/distributed/utils.py:1960: in wait_for 5986s return await fut 5986s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:546: in connect 5986s stream = await self.client.connect( 5986s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5986s 5986s self = , host = '127.0.0.1' 5986s port = 35915, af = 5986s ssl_options = 5986s max_buffer_size = 8364507136.0, source_ip = None, source_port = None 5986s timeout = None 5986s 5986s async def connect( 5986s self, 5986s host: str, 5986s port: int, 5986s af: socket.AddressFamily = socket.AF_UNSPEC, 5986s ssl_options: Optional[Union[Dict[str, Any], ssl.SSLContext]] = None, 5986s max_buffer_size: Optional[int] = None, 5986s source_ip: Optional[str] = None, 5986s source_port: Optional[int] = None, 5986s timeout: Optional[Union[float, datetime.timedelta]] = None, 5986s ) -> IOStream: 5986s """Connect to the given host and port. 5986s 5986s Asynchronously returns an `.IOStream` (or `.SSLIOStream` if 5986s ``ssl_options`` is not None). 5986s 5986s Using the ``source_ip`` kwarg, one can specify the source 5986s IP address to use when establishing the connection. 5986s In case the user needs to resolve and 5986s use a specific interface, it has to be handled outside 5986s of Tornado as this depends very much on the platform. 5986s 5986s Raises `TimeoutError` if the input future does not complete before 5986s ``timeout``, which may be specified in any form allowed by 5986s `.IOLoop.add_timeout` (i.e. a `datetime.timedelta` or an absolute time 5986s relative to `.IOLoop.time`) 5986s 5986s Similarly, when the user requires a certain source port, it can 5986s be specified using the ``source_port`` arg. 5986s 5986s .. versionchanged:: 4.5 5986s Added the ``source_ip`` and ``source_port`` arguments. 5986s 5986s .. versionchanged:: 5.0 5986s Added the ``timeout`` argument. 5986s """ 5986s if timeout is not None: 5986s if isinstance(timeout, numbers.Real): 5986s timeout = IOLoop.current().time() + timeout 5986s elif isinstance(timeout, datetime.timedelta): 5986s timeout = IOLoop.current().time() + timeout.total_seconds() 5986s else: 5986s raise TypeError("Unsupported timeout %r" % timeout) 5986s if timeout is not None: 5986s addrinfo = await gen.with_timeout( 5986s timeout, self.resolver.resolve(host, port, af) 5986s ) 5986s else: 5986s addrinfo = await self.resolver.resolve(host, port, af) 5986s connector = _Connector( 5986s addrinfo, 5986s functools.partial( 5986s self._create_stream, 5986s max_buffer_size, 5986s source_ip=source_ip, 5986s source_port=source_port, 5986s ), 5986s ) 5986s > af, addr, stream = await connector.start(connect_timeout=timeout) 5986s E asyncio.exceptions.CancelledError 5986s 5986s /usr/lib/python3/dist-packages/tornado/tcpclient.py:279: CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s self = 5986s 5986s @final 5986s async def start(self): 5986s async with self._startup_lock: 5986s if self.status == Status.failed: 5986s assert self.__startup_exc is not None 5986s raise self.__startup_exc 5986s elif self.status != Status.init: 5986s return self 5986s timeout = getattr(self, "death_timeout", None) 5986s 5986s async def _close_on_failure(exc: Exception) -> None: 5986s await self.close(reason=f"failure-to-start-{str(type(exc))}") 5986s self.status = Status.failed 5986s self.__startup_exc = exc 5986s 5986s try: 5986s > await wait_for(self.start_unsafe(), timeout=timeout) 5986s 5986s /usr/lib/python3/dist-packages/distributed/core.py:664: 5986s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5986s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 5986s async with asyncio.timeout(timeout): 5986s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5986s 5986s self = 5986s exc_type = 5986s exc_val = CancelledError(), exc_tb = 5986s 5986s async def __aexit__( 5986s self, 5986s exc_type: Optional[Type[BaseException]], 5986s exc_val: Optional[BaseException], 5986s exc_tb: Optional[TracebackType], 5986s ) -> Optional[bool]: 5986s assert self._state in (_State.ENTERED, _State.EXPIRING) 5986s 5986s if self._timeout_handler is not None: 5986s self._timeout_handler.cancel() 5986s self._timeout_handler = None 5986s 5986s if self._state is _State.EXPIRING: 5986s self._state = _State.EXPIRED 5986s 5986s if self._task.uncancel() <= self._cancelling and exc_type is not None: 5986s # Since there are no new cancel requests, we're 5986s # handling this. 5986s if issubclass(exc_type, exceptions.CancelledError): 5986s > raise TimeoutError from exc_val 5986s E TimeoutError 5986s 5986s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s @contextlib.asynccontextmanager 5986s async def _cluster_factory(): 5986s workers = [] 5986s s = None 5986s try: 5986s for _ in range(60): 5986s try: 5986s > s, ws = await start_cluster( 5986s nthreads, 5986s scheduler, 5986s security=security, 5986s Worker=Worker, 5986s scheduler_kwargs=scheduler_kwargs, 5986s worker_kwargs=merge( 5986s {"death_timeout": min(15, int(deadline.remaining))}, 5986s worker_kwargs, 5986s ), 5986s ) 5986s 5986s /usr/lib/python3/dist-packages/distributed/utils_test.py:966: 5986s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5986s /usr/lib/python3/dist-packages/distributed/utils_test.py:789: in start_cluster 5986s await asyncio.gather(*workers) 5986s /usr/lib/python3.13/asyncio/tasks.py:737: in _wrap_awaitable 5986s return await awaitable 5986s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5986s 5986s self = 5986s 5986s @final 5986s async def start(self): 5986s async with self._startup_lock: 5986s if self.status == Status.failed: 5986s assert self.__startup_exc is not None 5986s raise self.__startup_exc 5986s elif self.status != Status.init: 5986s return self 5986s timeout = getattr(self, "death_timeout", None) 5986s 5986s async def _close_on_failure(exc: Exception) -> None: 5986s await self.close(reason=f"failure-to-start-{str(type(exc))}") 5986s self.status = Status.failed 5986s self.__startup_exc = exc 5986s 5986s try: 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s except asyncio.TimeoutError as exc: 5986s await _close_on_failure(exc) 5986s > raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s E TimeoutError: Worker start timed out after 0s. 5986s 5986s /usr/lib/python3/dist-packages/distributed/core.py:667: TimeoutError 5986s 5986s During handling of the above exception, another exception occurred: 5986s 5986s fut = ._..test_func..async_fn at 0xde81adc0> 5986s timeout = 60 5986s 5986s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 5986s async with asyncio.timeout(timeout): 5986s > return await fut 5986s 5986s /usr/lib/python3/dist-packages/distributed/utils.py:1960: 5986s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5986s /usr/lib/python3/dist-packages/distributed/utils_test.py:999: in async_fn 5986s _cluster_factory() as (s, workers), 5986s /usr/lib/python3.13/contextlib.py:214: in __aenter__ 5986s return await anext(self.gen) 5986s /usr/lib/python3/dist-packages/distributed/utils_test.py:983: in _cluster_factory 5986s await asyncio.sleep(1) 5986s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5986s 5986s delay = 1, result = None 5986s 5986s async def sleep(delay, result=None): 5986s """Coroutine that completes after a given time (in seconds).""" 5986s if delay <= 0: 5986s await __sleep0() 5986s return result 5986s 5986s if math.isnan(delay): 5986s raise ValueError("Invalid delay: NaN (not a number)") 5986s 5986s loop = events.get_running_loop() 5986s future = loop.create_future() 5986s h = loop.call_later(delay, 5986s futures._set_result_unless_cancelled, 5986s future, result) 5986s try: 5986s > return await future 5986s E asyncio.exceptions.CancelledError 5986s 5986s /usr/lib/python3.13/asyncio/tasks.py:718: CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s args = (), kwds = {} 5986s 5986s @wraps(func) 5986s def inner(*args, **kwds): 5986s with self._recreate_cm(): 5986s > return func(*args, **kwds) 5986s 5986s /usr/lib/python3.13/contextlib.py:85: 5986s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5986s /usr/lib/python3.13/contextlib.py:85: in inner 5986s return func(*args, **kwds) 5986s /usr/lib/python3/dist-packages/distributed/utils_test.py:1102: in test_func 5986s return _run_and_close_tornado(async_fn_outer) 5986s /usr/lib/python3/dist-packages/distributed/utils_test.py:378: in _run_and_close_tornado 5986s return asyncio_run(inner_fn(), loop_factory=get_loop_factory()) 5986s /usr/lib/python3.13/asyncio/runners.py:194: in run 5986s return runner.run(main) 5986s /usr/lib/python3.13/asyncio/runners.py:118: in run 5986s return self._loop.run_until_complete(task) 5986s /usr/lib/python3.13/asyncio/base_events.py:720: in run_until_complete 5986s return future.result() 5986s /usr/lib/python3/dist-packages/distributed/utils_test.py:375: in inner_fn 5986s return await async_fn(*args, **kwargs) 5986s /usr/lib/python3/dist-packages/distributed/utils_test.py:1099: in async_fn_outer 5986s return await utils_wait_for(async_fn(), timeout=timeout * 2) 5986s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 5986s async with asyncio.timeout(timeout): 5986s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5986s 5986s self = 5986s exc_type = 5986s exc_val = CancelledError(), exc_tb = 5986s 5986s async def __aexit__( 5986s self, 5986s exc_type: Optional[Type[BaseException]], 5986s exc_val: Optional[BaseException], 5986s exc_tb: Optional[TracebackType], 5986s ) -> Optional[bool]: 5986s assert self._state in (_State.ENTERED, _State.EXPIRING) 5986s 5986s if self._timeout_handler is not None: 5986s self._timeout_handler.cancel() 5986s self._timeout_handler = None 5986s 5986s if self._state is _State.EXPIRING: 5986s self._state = _State.EXPIRED 5986s 5986s if self._task.uncancel() <= self._cancelling and exc_type is not None: 5986s # Since there are no new cancel requests, we're 5986s # handling this. 5986s if issubclass(exc_type, exceptions.CancelledError): 5986s > raise TimeoutError from exc_val 5986s E TimeoutError 5986s 5986s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 5986s ----------------------------- Captured stderr call ----------------------------- 5986s 2024-11-23 21:59:38,292 - distributed.scheduler - INFO - State start 5986s 2024-11-23 21:59:38,300 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:38,300 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33705/status 5986s 2024-11-23 21:59:38,300 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 21:59:38,313 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35565 5986s 2024-11-23 21:59:38,314 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35565 5986s 2024-11-23 21:59:38,314 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 21:59:38,314 - distributed.worker - INFO - dashboard at: 127.0.0.1:37403 5986s 2024-11-23 21:59:38,314 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:38,314 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:59:38,314 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 21:59:38,314 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:59:38,314 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-zenby81n 5986s 2024-11-23 21:59:38,314 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:59:38,316 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41717 5986s 2024-11-23 21:59:38,316 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41717 5986s 2024-11-23 21:59:38,316 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 21:59:38,316 - distributed.worker - INFO - dashboard at: 127.0.0.1:42299 5986s 2024-11-23 21:59:38,316 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:38,316 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:59:38,316 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 21:59:38,316 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:59:38,316 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-r1fiibci 5986s 2024-11-23 21:59:38,316 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:59:38,328 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:38,329 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:38,329 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:33198': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:38,329 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:33214': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:38,441 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:38,441 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:38,441 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:33224': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:38,442 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:33236': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:38,554 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:38,554 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:38,555 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:33238': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:38,555 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:33250': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:38,668 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:38,668 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:38,668 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:33252': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:38,669 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:33254': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:38,781 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:38,781 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:38,781 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:33268': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:38,781 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:33282': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:38,894 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:38,894 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:38,894 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:33288': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:38,894 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:33304': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:39,007 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:39,007 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:39,007 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:33306': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:39,007 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:33314': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:39,119 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:39,119 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:39,119 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:33316': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:39,120 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:33330': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:39,232 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:39,232 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:39,232 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:33338': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:39,233 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:33342': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:39,345 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:39,345 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:39,345 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:33348': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:39,345 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:33358': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:39,457 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:39,457 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:39,458 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:33372': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:39,458 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:33380': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:39,569 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:39,570 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:39,570 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:33382': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:39,570 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:33396': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:39,682 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:39,682 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:39,682 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:33408': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:39,682 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:33418': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:39,795 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:39,795 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:39,795 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:33432': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:39,795 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:33448': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:39,907 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:39,908 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:39,908 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:33458': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:39,908 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:33472': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:40,020 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:40,020 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:40,020 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:33474': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:40,020 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:33480': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:40,133 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:40,133 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:40,133 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:33482': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:40,133 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:33494': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:40,245 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:40,246 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:40,246 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:33504': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:40,246 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:33514': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:40,359 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:40,360 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:40,360 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:33518': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:40,360 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:33532': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:40,474 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:40,474 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:40,474 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:33548': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:40,474 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:33564': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:40,586 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:40,586 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:40,587 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:33572': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:40,587 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:33588': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:40,699 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:40,699 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:40,699 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:33598': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:40,700 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:33610': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:40,815 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:40,816 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:40,816 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:33626': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:40,816 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:33638': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:40,928 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:40,928 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:40,928 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:33646': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:40,928 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:33658': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:41,040 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:41,041 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:41,041 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:33672': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:41,041 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:33684': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:41,152 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:41,152 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:41,153 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:33694': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:41,153 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:33706': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:41,266 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:41,266 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:41,267 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:33708': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:41,267 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:33712': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:41,379 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:41,379 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:41,379 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:33728': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:41,379 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:33740': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:41,492 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:41,492 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:41,492 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:33748': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:41,492 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:33758': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:41,604 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:41,604 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:41,604 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:42974': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:41,604 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:42980': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:41,716 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:41,716 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:41,716 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:42990': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:41,716 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:43002': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:41,828 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:41,828 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:41,829 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:43016': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:41,829 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:43028': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:41,942 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:41,942 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:41,942 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:43032': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:41,943 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:43040': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:42,055 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:42,055 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:42,055 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:43050': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:42,055 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:43058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:42,168 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:42,168 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:42,169 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:43062': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:42,169 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:43074': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:42,281 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:42,281 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:42,281 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:43078': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:42,282 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:43092': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:42,393 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:42,393 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:42,394 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:43106': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:42,394 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:43114': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:42,506 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:42,506 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:42,506 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:43128': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:42,506 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:43136': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:42,618 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:42,618 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:42,618 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:43150': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:42,618 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:43152': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:42,730 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:42,730 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:42,731 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:43164': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:42,731 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:43172': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:42,843 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:42,843 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:42,843 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:43188': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:42,843 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:43190': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:42,955 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:42,956 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:42,956 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:43192': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:42,956 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:43196': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:43,066 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:43,068 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:43,068 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:43202': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:43,068 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:43212': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:43,174 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:43,179 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:43214': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:43,180 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:43,180 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:43230': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:43,282 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:43,282 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:43234': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:43,288 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:43,288 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:43246': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:43,389 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:43,389 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:43260': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:43,395 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:43,395 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:43276': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:43,496 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:43,496 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:43288': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:43,502 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:43,502 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:43294': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:43,603 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:43,605 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:43304': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:43,610 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:43,610 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:43310': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:43,711 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:43,712 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:43326': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:43,718 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:43,718 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:43340': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:43,818 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:43,819 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:43348': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:43,825 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:43,825 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:43356': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:43,925 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:43,925 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:43370': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:43,931 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:43,932 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:43384': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:44,033 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:44,033 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:43398': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:44,039 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:44,040 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:43414': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:44,140 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:44,140 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:43416': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:44,146 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:44,146 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:43420': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:44,247 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:44,247 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:43426': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:44,253 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:44,253 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:43438': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:44,353 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:44,354 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:43450': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:44,360 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:44,360 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:43458': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:44,461 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:44,461 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:43470': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:44,467 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:44,467 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:43476': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:44,568 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:44,569 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:43484': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:44,574 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:44,575 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:43492': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:44,676 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:44,677 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:43502': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:44,683 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:44,683 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:43514': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:44,784 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:44,784 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:43522': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:44,790 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:44,790 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:43526': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:44,891 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:44,892 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:43540': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:44,897 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:44,898 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:43542': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:44,998 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:44,999 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:43546': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:45,005 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:45,005 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:43558': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:45,106 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:45,107 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:43560': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:45,112 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:45,113 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:43564': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:45,214 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:45,214 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:43574': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:45,220 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:45,220 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:43582': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:45,321 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:45,321 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:43598': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:45,327 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:45,327 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:43606': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:45,429 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:45,430 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:43612': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:45,435 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:45,435 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:43616': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:45,537 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:45,538 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:43618': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:45,543 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:45,543 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:43632': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:45,644 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:45,645 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:43648': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:45,650 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:45,651 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:43654': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:45,752 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:45,753 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:43668': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:45,759 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:45,759 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:43670': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:45,860 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:45,860 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:43680': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:45,866 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:45,866 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:43688': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:45,968 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:45,968 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:43692': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:45,974 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:45,974 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:43700': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:46,074 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:46,075 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:43716': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:46,081 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:46,081 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:43730': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:46,182 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:46,183 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:43734': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:46,188 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:46,188 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:43742': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:46,289 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:46,289 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:43752': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:46,295 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:46,296 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:43758': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:46,396 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:46,397 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:43760': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:46,403 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:46,403 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:43770': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:46,504 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:46,504 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:43776': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:46,510 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:46,510 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:43782': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:46,611 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:46,612 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:43796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:46,617 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:46,618 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:43810': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:46,718 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:46,719 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:43816': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:46,725 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:46,725 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:43832': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:46,826 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:46,826 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:43842': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:46,832 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:46,832 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:43846': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:46,933 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:46,933 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:43854': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:46,939 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:46,939 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:43866': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:47,040 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:47,040 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:43876': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:47,046 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:47,046 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:43892': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:47,148 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:47,150 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:43908': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:47,155 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:47,156 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:43918': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:47,256 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:47,256 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:43934': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:47,262 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:47,262 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:43946': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:47,364 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:47,365 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:43954': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:47,370 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:47,371 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:43962': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:47,471 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:47,472 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:43972': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:47,478 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:47,478 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:43986': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:47,579 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:47,579 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:43988': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:47,585 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:47,585 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:43992': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:47,686 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:47,686 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:43998': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:47,692 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:47,692 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:44004': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:47,793 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:47,794 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:44016': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:47,799 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:47,800 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:44030': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:47,900 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:47,901 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:44038': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:47,907 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:47,907 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:44040': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:48,008 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:48,008 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:44048': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:48,014 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:48,014 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:44060': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:48,114 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:48,114 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:44072': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:48,120 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:48,121 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:44082': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:48,221 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:48,222 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:44088': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:48,228 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:48,228 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:44094': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:48,328 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:48,328 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:44100': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:48,334 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:48,335 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:44106': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:48,435 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:48,436 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:44114': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:48,442 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:48,442 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:44120': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:48,543 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:48,543 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:44128': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:48,549 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:48,549 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:44132': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:48,650 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:48,651 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:44142': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:48,656 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:48,657 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:44148': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:48,757 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:48,758 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:44154': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:48,763 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:48,764 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:44162': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:48,866 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:48,866 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:44178': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:48,872 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:48,872 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:44182': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:48,973 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:48,974 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:44196': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:48,979 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:48,980 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:44202': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:49,080 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:49,080 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:44214': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:49,086 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:49,086 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:44218': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:49,187 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:49,187 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:44230': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:49,193 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:49,193 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:44238': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:49,295 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:49,296 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:44254': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:49,302 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:49,305 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:44266': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:49,402 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:49,403 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:44272': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:49,409 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:49,409 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:44276': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:49,509 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:49,509 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:44284': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:49,515 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:49,516 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:44294': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:49,616 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:49,616 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:44302': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:49,622 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:49,622 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:44304': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:49,723 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:49,723 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:44312': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:49,729 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:49,730 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:44320': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:49,830 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:49,831 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:44326': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:49,836 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:49,837 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:44338': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:49,937 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:49,938 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:44344': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:49,944 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:49,944 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:44358': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:50,045 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:50,045 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:44374': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:50,051 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:50,051 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:44386': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:50,152 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:50,153 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:44394': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:50,158 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:50,159 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:44406': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:50,260 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:50,261 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:44410': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:50,267 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:50,267 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:44416': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:50,367 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:50,368 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:44432': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:50,373 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:50,374 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:44434': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:50,477 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:50,477 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:44438': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:50,483 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:50,483 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:44450': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:50,584 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:50,585 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:44464': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:50,591 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:50,591 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:44468': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:50,692 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:50,693 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:44484': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:50,699 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:50,699 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:44490': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:50,800 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:50,801 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:44500': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:50,810 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:50,811 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:44508': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:50,907 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:50,908 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:44524': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:50,917 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:50,917 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:44540': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:51,014 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:51,014 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:44548': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:51,023 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:51,024 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:44558': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:51,122 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:51,122 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:44560': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:51,131 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:51,131 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:44564': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:51,229 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:51,230 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:44570': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:51,238 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:51,238 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:44576': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:51,337 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:51,337 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:44582': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:51,345 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:51,346 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:44586': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:51,444 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:51,445 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:44590': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:51,452 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:51,452 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:44592': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:51,552 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:51,552 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:46352': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:51,558 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:51,559 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:46360': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:51,658 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:51,659 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:46374': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:51,665 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:51,665 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:46376': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:51,766 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:51,767 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:46380': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:51,772 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:51,773 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:46386': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:51,873 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:51,873 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:46396': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:51,879 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:51,879 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:46410': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:51,980 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:51,981 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:46418': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:51,987 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:51,987 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:46434': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:52,087 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:52,088 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:46446': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:52,095 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:52,095 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:46460': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:52,194 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:52,194 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:46470': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:52,202 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:52,202 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:46476': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:52,303 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:52,306 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:46482': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:52,312 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:52,312 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:46484': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:52,410 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:52,410 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:46494': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:52,419 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:52,419 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:46506': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:52,518 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:52,518 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:46508': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:52,526 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:52,526 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:46510': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:52,625 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:52,625 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:46524': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:52,633 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:52,633 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:46538': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:52,732 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:52,732 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:46552': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:52,740 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:52,740 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:46562': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:52,839 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:52,839 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:46570': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:52,847 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:52,847 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:46576': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:52,946 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:52,947 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:46584': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:52,954 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:52,954 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:46596': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:53,053 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:53,053 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:46602': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:53,061 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:53,061 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:46606': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:53,161 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:53,161 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:46616': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:53,167 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:53,167 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:46628': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:53,268 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:53,269 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:46640': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:53,275 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36903 5986s 2024-11-23 21:59:53,275 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36903': TLS handshake failed with remote 'tls://127.0.0.1:46650': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:53,312 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35565. Reason: failure-to-start- 5986s 2024-11-23 21:59:53,312 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:59:53,314 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 15s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 5986s stream = await stream.start_tls( 5986s ^^^^^^^^^^^^^^^^^^^^^^^ 5986s False, ssl_options=ssl_options, server_hostname=host 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 5986s self.socket.do_handshake() 5986s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 5986s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 5986s self._sslobj.do_handshake() 5986s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 5986s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 5986s raise FatalCommClosedError( 5986s ...<2 lines>... 5986s ) from err 5986s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 5986s 5986s During handling of the above exception, another exception occurred: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1218, in _register_with_scheduler 5986s await asyncio.sleep(0.1) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 718, in sleep 5986s return await future 5986s ^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 15s. 5986s 2024-11-23 21:59:53,318 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41717. Reason: failure-to-start- 5986s 2024-11-23 21:59:53,318 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 21:59:54,321 - distributed.scheduler - INFO - State start 5986s 2024-11-23 21:59:54,327 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43063 5986s 2024-11-23 21:59:54,328 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36673/status 5986s 2024-11-23 21:59:54,328 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 21:59:54,345 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35607 5986s 2024-11-23 21:59:54,345 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35607 5986s 2024-11-23 21:59:54,345 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 21:59:54,345 - distributed.worker - INFO - dashboard at: 127.0.0.1:39051 5986s 2024-11-23 21:59:54,345 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 21:59:54,345 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:59:54,345 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 21:59:54,345 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:59:54,345 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-aos5ge57 5986s 2024-11-23 21:59:54,345 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:59:54,347 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37895 5986s 2024-11-23 21:59:54,347 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37895 5986s 2024-11-23 21:59:54,347 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 21:59:54,347 - distributed.worker - INFO - dashboard at: 127.0.0.1:41933 5986s 2024-11-23 21:59:54,348 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 21:59:54,348 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:59:54,348 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 21:59:54,348 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 21:59:54,348 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-8c8vd4x1 5986s 2024-11-23 21:59:54,348 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 21:59:54,360 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 21:59:54,360 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 21:59:54,360 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:38980': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:54,361 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:38988': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:54,472 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 21:59:54,473 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 21:59:54,473 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:39004': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:54,473 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:39008': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:54,584 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 21:59:54,584 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 21:59:54,585 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:39016': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:54,585 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:39024': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:54,696 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 21:59:54,696 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 21:59:54,696 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:39040': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:54,697 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:39050': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:54,808 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 21:59:54,809 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 21:59:54,812 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:39052': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:54,812 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:39056': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:54,921 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 21:59:54,921 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 21:59:54,921 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:39058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:54,922 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:39068': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:55,034 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 21:59:55,034 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 21:59:55,034 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:39074': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:55,035 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:39086': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:55,146 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 21:59:55,146 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 21:59:55,147 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:39090': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:55,147 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:39100': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:55,258 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 21:59:55,258 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 21:59:55,258 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:39102': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:55,260 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:39104': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:55,371 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 21:59:55,371 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 21:59:55,371 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:39112': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:55,372 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:39118': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:55,483 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 21:59:55,484 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 21:59:55,484 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:39132': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:55,484 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:39148': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:55,596 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 21:59:55,596 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 21:59:55,596 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:39154': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:55,596 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:39166': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:55,708 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 21:59:55,709 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 21:59:55,709 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:39170': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:55,709 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:39180': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:55,820 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 21:59:55,820 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 21:59:55,821 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:39182': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:55,821 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:39192': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:55,932 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 21:59:55,932 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 21:59:55,933 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:39194': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:55,933 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:39202': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:56,044 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 21:59:56,044 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 21:59:56,044 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:39218': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:56,045 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:39220': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:56,157 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 21:59:56,157 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 21:59:56,157 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:39224': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:56,158 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:39234': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:56,270 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 21:59:56,270 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 21:59:56,270 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:39248': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:56,270 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:39258': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:56,382 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 21:59:56,382 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 21:59:56,383 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:39266': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:56,383 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:39282': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:56,495 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 21:59:56,495 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 21:59:56,495 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:39284': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:56,495 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:39298': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:56,607 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 21:59:56,607 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 21:59:56,607 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:39308': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:56,607 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:39318': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:56,718 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 21:59:56,719 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 21:59:56,719 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:39332': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:56,719 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:39346': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:56,831 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 21:59:56,831 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 21:59:56,834 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:39362': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:56,834 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:39374': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:56,943 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 21:59:56,943 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 21:59:56,943 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:39380': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:56,943 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:39388': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:57,056 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 21:59:57,057 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 21:59:57,057 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:39396': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:57,057 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:39410': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:57,168 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 21:59:57,168 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 21:59:57,169 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:39416': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:57,169 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:39420': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:57,280 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 21:59:57,281 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 21:59:57,281 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:39424': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:57,281 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:39438': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:57,392 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 21:59:57,393 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 21:59:57,393 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:39452': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:57,393 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:39462': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:57,505 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 21:59:57,505 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 21:59:57,505 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:39478': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:57,506 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:39486': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:57,617 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 21:59:57,617 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 21:59:57,617 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:39496': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:57,617 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:39506': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:57,729 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 21:59:57,730 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 21:59:57,730 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:39514': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:57,730 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:39528': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:57,843 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 21:59:57,843 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 21:59:57,843 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:39532': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:57,844 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:39542': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:57,956 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 21:59:57,957 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 21:59:57,957 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:39548': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:57,957 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:39552': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:58,068 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 21:59:58,069 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 21:59:58,069 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:39568': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:58,069 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:39578': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:58,180 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 21:59:58,180 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 21:59:58,181 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:39582': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:58,181 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:39586': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:58,294 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 21:59:58,294 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 21:59:58,294 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:39592': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:58,294 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:39600': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:58,406 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 21:59:58,406 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 21:59:58,406 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:39614': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:58,406 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:39616': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:58,517 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 21:59:58,518 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 21:59:58,518 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:39630': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:58,518 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:39634': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:58,630 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 21:59:58,630 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 21:59:58,630 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:39636': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:58,630 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:39646': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:58,741 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 21:59:58,742 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 21:59:58,743 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:39648': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:58,743 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:39652': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:58,853 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 21:59:58,854 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 21:59:58,854 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:39666': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:58,854 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:39674': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:58,965 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 21:59:58,965 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 21:59:58,966 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:39684': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:58,966 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:39688': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:59,077 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 21:59:59,077 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 21:59:59,077 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:39692': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:59,077 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:39706': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:59,189 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 21:59:59,189 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 21:59:59,189 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:39720': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:59,189 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:39726': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:59,302 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 21:59:59,302 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 21:59:59,302 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:39738': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:59,302 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:39742': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:59,414 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 21:59:59,414 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 21:59:59,415 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:39752': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:59,415 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:39760': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:59,526 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 21:59:59,526 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 21:59:59,526 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:39768': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:59,526 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:39772': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:59,638 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 21:59:59,638 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 21:59:59,639 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:39778': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:59,639 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:39788': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:59,751 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 21:59:59,752 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 21:59:59,752 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:39794': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:59,752 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:39804': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:59,864 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 21:59:59,864 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 21:59:59,864 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:39808': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:59,864 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:39812': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:59,975 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 21:59:59,975 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 21:59:59,976 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:39814': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 21:59:59,976 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:39826': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:00,087 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 22:00:00,087 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 22:00:00,087 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:39842': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:00,087 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:39848': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:00,200 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 22:00:00,201 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 22:00:00,201 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:39862': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:00,201 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:39870': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:00,314 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 22:00:00,315 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 22:00:00,315 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:39874': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:00,315 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:39886': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:00,427 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 22:00:00,427 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 22:00:00,428 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:39900': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:00,428 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:39916': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:00,542 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 22:00:00,542 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 22:00:00,542 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:39928': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:00,543 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:39936': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:00,654 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 22:00:00,654 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 22:00:00,654 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:39948': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:00,654 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:39960': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:00,767 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 22:00:00,768 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 22:00:00,768 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:39970': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:00,768 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:39984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:00,881 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 22:00:00,881 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 22:00:00,881 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:39992': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:00,881 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:39994': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:00,993 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 22:00:00,993 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 22:00:00,994 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:40002': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:00,994 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:40018': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:01,105 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 22:00:01,106 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 22:00:01,106 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:40030': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:01,106 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:40044': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:01,217 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 22:00:01,217 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 22:00:01,218 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:40046': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:01,218 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:40048': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:01,329 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 22:00:01,329 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 22:00:01,330 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:40054': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:01,330 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:40058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:01,441 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 22:00:01,441 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 22:00:01,442 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:40070': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:01,442 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:40086': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:01,554 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 22:00:01,554 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 22:00:01,554 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:55704': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:01,554 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:55714': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:01,666 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 22:00:01,666 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 22:00:01,666 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:55720': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:01,666 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:55728': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:01,778 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 22:00:01,778 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 22:00:01,779 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:55740': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:01,779 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:55756': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:01,890 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 22:00:01,891 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 22:00:01,891 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:55762': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:01,891 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:55764': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:02,013 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 22:00:02,013 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 22:00:02,014 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:55778': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:02,014 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:55780': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:02,127 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 22:00:02,127 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 22:00:02,127 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:55784': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:02,128 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:55798': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:02,239 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 22:00:02,239 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 22:00:02,239 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:55804': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:02,239 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:55816': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:02,351 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 22:00:02,351 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 22:00:02,351 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:55828': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:02,351 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:55842': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:02,463 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 22:00:02,463 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 22:00:02,463 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:55850': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:02,463 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:55852': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:02,575 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 22:00:02,575 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 22:00:02,575 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:55862': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:02,576 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:55864': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:02,687 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 22:00:02,687 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 22:00:02,687 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:55872': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:02,687 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:55888': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:02,798 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 22:00:02,799 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 22:00:02,799 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:55904': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:02,799 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:55920': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:02,911 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 22:00:02,911 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 22:00:02,912 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:55930': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:02,912 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:55934': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:03,024 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 22:00:03,024 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 22:00:03,024 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:55946': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:03,025 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:55962': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:03,136 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 22:00:03,136 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 22:00:03,136 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:55964': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:03,137 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:55978': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:03,248 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 22:00:03,249 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 22:00:03,249 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:55982': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:03,249 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:55992': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:03,361 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 22:00:03,362 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 22:00:03,362 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:55994': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:03,362 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:56010': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:03,473 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 22:00:03,474 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 22:00:03,474 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:56022': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:03,474 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:56026': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:03,586 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 22:00:03,586 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 22:00:03,587 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:56036': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:03,587 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:56048': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:03,698 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 22:00:03,698 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 22:00:03,698 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:56060': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:03,698 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:56072': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:03,810 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 22:00:03,810 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 22:00:03,813 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:56080': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:03,813 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:56094': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:03,922 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 22:00:03,923 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 22:00:03,923 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:56096': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:03,923 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:56102': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:04,035 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 22:00:04,035 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 22:00:04,036 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:56118': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:04,036 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:56130': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:04,147 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 22:00:04,148 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 22:00:04,148 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:56134': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:04,148 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:56144': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:04,259 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 22:00:04,260 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 22:00:04,260 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:56150': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:04,260 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:56162': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:04,372 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 22:00:04,372 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 22:00:04,372 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:56164': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:04,372 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:56180': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:04,484 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 22:00:04,484 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 22:00:04,484 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:56184': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:04,484 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:56200': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:04,596 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 22:00:04,596 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 22:00:04,597 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:56206': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:04,597 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:56222': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:04,709 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 22:00:04,709 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 22:00:04,709 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:56228': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:04,710 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:56238': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:04,821 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 22:00:04,821 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 22:00:04,821 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:56254': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:04,821 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:56266': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:04,933 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 22:00:04,933 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 22:00:04,934 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:56282': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:04,934 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:56290': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:05,046 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 22:00:05,046 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 22:00:05,046 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:56302': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:05,047 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:56314': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:05,160 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 22:00:05,160 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 22:00:05,160 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:56324': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:05,160 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:56334': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:05,272 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 22:00:05,272 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 22:00:05,273 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:56338': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:05,273 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:56340': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:05,384 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 22:00:05,384 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 22:00:05,385 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:56354': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:05,385 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:56366': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:05,496 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 22:00:05,496 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 22:00:05,497 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:56368': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:05,497 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:56384': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:05,609 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 22:00:05,609 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 22:00:05,610 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:56398': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:05,610 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:56414': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:05,721 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 22:00:05,721 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 22:00:05,722 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:56424': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:05,722 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:56438': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:05,833 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 22:00:05,834 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 22:00:05,836 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:56444': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:05,836 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:56456': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:05,946 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 22:00:05,946 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 22:00:05,946 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:56458': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:05,946 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:56466': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:06,058 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 22:00:06,058 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 22:00:06,058 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:56472': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:06,059 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:56488': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:06,170 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 22:00:06,170 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 22:00:06,170 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:56494': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:06,170 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:56498': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:06,282 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 22:00:06,282 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 22:00:06,282 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:56502': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:06,282 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:56508': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:06,394 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 22:00:06,394 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 22:00:06,394 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:56510': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:06,394 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:56522': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:06,506 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 22:00:06,506 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 22:00:06,506 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:56530': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:06,506 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:56546': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:06,617 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 22:00:06,618 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 22:00:06,618 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:56552': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:06,618 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:56560': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:06,729 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 22:00:06,730 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 22:00:06,730 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:56564': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:06,730 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:56574': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:06,843 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 22:00:06,843 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 22:00:06,843 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:56588': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:06,843 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:56598': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:06,955 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 22:00:06,956 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 22:00:06,956 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:56608': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:06,956 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:56622': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:07,068 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 22:00:07,068 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 22:00:07,068 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:56626': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:07,068 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:56638': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:07,180 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 22:00:07,180 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 22:00:07,180 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:56650': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:07,180 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:56662': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:07,291 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 22:00:07,292 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43063 5986s 2024-11-23 22:00:07,292 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:56670': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:07,292 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43063': TLS handshake failed with remote 'tls://127.0.0.1:56678': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:07,343 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35607. Reason: failure-to-start- 5986s 2024-11-23 22:00:07,344 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:00:07,345 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 13s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 5986s stream = await stream.start_tls( 5986s ^^^^^^^^^^^^^^^^^^^^^^^ 5986s False, ssl_options=ssl_options, server_hostname=host 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 5986s self.socket.do_handshake() 5986s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 5986s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 5986s self._sslobj.do_handshake() 5986s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 5986s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 5986s raise FatalCommClosedError( 5986s ...<2 lines>... 5986s ) from err 5986s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 5986s 5986s During handling of the above exception, another exception occurred: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1218, in _register_with_scheduler 5986s await asyncio.sleep(0.1) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 718, in sleep 5986s return await future 5986s ^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 13s. 5986s 2024-11-23 22:00:07,349 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37895. Reason: failure-to-start- 5986s 2024-11-23 22:00:07,349 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:00:08,351 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:00:08,359 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37965 5986s 2024-11-23 22:00:08,359 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40607/status 5986s 2024-11-23 22:00:08,359 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:00:08,372 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37173 5986s 2024-11-23 22:00:08,372 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37173 5986s 2024-11-23 22:00:08,372 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:00:08,372 - distributed.worker - INFO - dashboard at: 127.0.0.1:38213 5986s 2024-11-23 22:00:08,372 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37965 5986s 2024-11-23 22:00:08,372 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:00:08,372 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:00:08,373 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:00:08,373 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-dt95kqb9 5986s 2024-11-23 22:00:08,373 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:00:08,375 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45345 5986s 2024-11-23 22:00:08,375 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45345 5986s 2024-11-23 22:00:08,375 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:00:08,375 - distributed.worker - INFO - dashboard at: 127.0.0.1:44275 5986s 2024-11-23 22:00:08,375 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37965 5986s 2024-11-23 22:00:08,375 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:00:08,375 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:00:08,375 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:00:08,375 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-cqa4md1d 5986s 2024-11-23 22:00:08,375 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:00:08,376 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37173. Reason: failure-to-start- 5986s 2024-11-23 22:00:08,376 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:00:08,377 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45345. Reason: failure-to-start- 5986s 2024-11-23 22:00:08,377 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:00:08,377 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37965': TLS handshake failed with remote 'tls://127.0.0.1:37366': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:00:08,378 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37965': TLS handshake failed with remote 'tls://127.0.0.1:37372': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:00:08,379 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:00:09,384 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:00:09,390 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34707 5986s 2024-11-23 22:00:09,390 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36835/status 5986s 2024-11-23 22:00:09,391 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:00:09,405 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37371 5986s 2024-11-23 22:00:09,406 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37371 5986s 2024-11-23 22:00:09,406 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:00:09,406 - distributed.worker - INFO - dashboard at: 127.0.0.1:36135 5986s 2024-11-23 22:00:09,406 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34707 5986s 2024-11-23 22:00:09,406 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:00:09,406 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:00:09,406 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:00:09,406 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-t_b_0tfc 5986s 2024-11-23 22:00:09,406 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:00:09,408 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42695 5986s 2024-11-23 22:00:09,408 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42695 5986s 2024-11-23 22:00:09,408 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:00:09,408 - distributed.worker - INFO - dashboard at: 127.0.0.1:38849 5986s 2024-11-23 22:00:09,408 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34707 5986s 2024-11-23 22:00:09,408 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:00:09,408 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:00:09,408 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:00:09,408 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-twlba3vo 5986s 2024-11-23 22:00:09,409 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:00:09,409 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37371. Reason: failure-to-start- 5986s 2024-11-23 22:00:09,410 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:00:09,410 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42695. Reason: failure-to-start- 5986s 2024-11-23 22:00:09,410 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:00:09,411 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34707': TLS handshake failed with remote 'tls://127.0.0.1:60022': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:00:09,411 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34707': TLS handshake failed with remote 'tls://127.0.0.1:60032': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:00:09,412 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:00:10,420 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:00:10,432 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39463 5986s 2024-11-23 22:00:10,433 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34319/status 5986s 2024-11-23 22:00:10,433 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:00:10,459 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34571 5986s 2024-11-23 22:00:10,460 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34571 5986s 2024-11-23 22:00:10,460 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:00:10,460 - distributed.worker - INFO - dashboard at: 127.0.0.1:38831 5986s 2024-11-23 22:00:10,460 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39463 5986s 2024-11-23 22:00:10,460 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:00:10,460 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:00:10,460 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:00:10,460 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-0bd19613 5986s 2024-11-23 22:00:10,460 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:00:10,466 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34635 5986s 2024-11-23 22:00:10,467 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34635 5986s 2024-11-23 22:00:10,467 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:00:10,467 - distributed.worker - INFO - dashboard at: 127.0.0.1:41417 5986s 2024-11-23 22:00:10,467 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39463 5986s 2024-11-23 22:00:10,467 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:00:10,467 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:00:10,467 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:00:10,467 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-3r91yvo6 5986s 2024-11-23 22:00:10,467 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:00:10,469 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34571. Reason: failure-to-start- 5986s 2024-11-23 22:00:10,470 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:00:10,471 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34635. Reason: failure-to-start- 5986s 2024-11-23 22:00:10,471 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:00:10,474 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39463': TLS handshake failed with remote 'tls://127.0.0.1:50718': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:00:10,499 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39463': TLS handshake failed with remote 'tls://127.0.0.1:50732': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:00:10,507 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:00:11,521 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:00:11,534 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42153 5986s 2024-11-23 22:00:11,535 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44681/status 5986s 2024-11-23 22:00:11,536 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:00:11,563 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44853 5986s 2024-11-23 22:00:11,563 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44853 5986s 2024-11-23 22:00:11,563 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:00:11,564 - distributed.worker - INFO - dashboard at: 127.0.0.1:34361 5986s 2024-11-23 22:00:11,564 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42153 5986s 2024-11-23 22:00:11,564 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:00:11,564 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:00:11,564 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:00:11,564 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-43jl5t8z 5986s 2024-11-23 22:00:11,564 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:00:11,568 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42315 5986s 2024-11-23 22:00:11,569 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42315 5986s 2024-11-23 22:00:11,569 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:00:11,569 - distributed.worker - INFO - dashboard at: 127.0.0.1:35759 5986s 2024-11-23 22:00:11,569 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42153 5986s 2024-11-23 22:00:11,569 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:00:11,569 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:00:11,569 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:00:11,569 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-q0om6dpr 5986s 2024-11-23 22:00:11,569 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:00:11,572 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44853. Reason: failure-to-start- 5986s 2024-11-23 22:00:11,573 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:00:11,573 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42315. Reason: failure-to-start- 5986s 2024-11-23 22:00:11,574 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:00:11,576 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42153': TLS handshake failed with remote 'tls://127.0.0.1:50820': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:00:11,576 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42153': TLS handshake failed with remote 'tls://127.0.0.1:50836': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:00:11,579 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:00:12,587 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:00:12,601 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38137 5986s 2024-11-23 22:00:12,602 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38573/status 5986s 2024-11-23 22:00:12,603 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:00:12,627 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45669 5986s 2024-11-23 22:00:12,627 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45669 5986s 2024-11-23 22:00:12,627 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:00:12,627 - distributed.worker - INFO - dashboard at: 127.0.0.1:34495 5986s 2024-11-23 22:00:12,628 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38137 5986s 2024-11-23 22:00:12,628 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:00:12,628 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:00:12,628 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:00:12,628 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-hwrhobx5 5986s 2024-11-23 22:00:12,628 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:00:12,632 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34215 5986s 2024-11-23 22:00:12,632 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34215 5986s 2024-11-23 22:00:12,632 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:00:12,632 - distributed.worker - INFO - dashboard at: 127.0.0.1:42297 5986s 2024-11-23 22:00:12,632 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38137 5986s 2024-11-23 22:00:12,632 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:00:12,632 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:00:12,633 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:00:12,633 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-cttt1rqk 5986s 2024-11-23 22:00:12,633 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:00:12,635 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45669. Reason: failure-to-start- 5986s 2024-11-23 22:00:12,635 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:00:12,636 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34215. Reason: failure-to-start- 5986s 2024-11-23 22:00:12,637 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:00:12,639 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38137': TLS handshake failed with remote 'tls://127.0.0.1:46286': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:00:12,639 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38137': TLS handshake failed with remote 'tls://127.0.0.1:46298': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:00:12,641 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:00:13,649 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:00:13,662 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45337 5986s 2024-11-23 22:00:13,663 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36197/status 5986s 2024-11-23 22:00:13,664 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:00:13,703 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44447 5986s 2024-11-23 22:00:13,704 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44447 5986s 2024-11-23 22:00:13,704 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:00:13,704 - distributed.worker - INFO - dashboard at: 127.0.0.1:45745 5986s 2024-11-23 22:00:13,704 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45337 5986s 2024-11-23 22:00:13,704 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:00:13,704 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:00:13,704 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:00:13,704 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-2_uv330e 5986s 2024-11-23 22:00:13,704 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:00:13,709 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34135 5986s 2024-11-23 22:00:13,709 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34135 5986s 2024-11-23 22:00:13,709 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:00:13,709 - distributed.worker - INFO - dashboard at: 127.0.0.1:38383 5986s 2024-11-23 22:00:13,709 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45337 5986s 2024-11-23 22:00:13,709 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:00:13,709 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:00:13,710 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:00:13,710 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-7es16n27 5986s 2024-11-23 22:00:13,710 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:00:13,712 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44447. Reason: failure-to-start- 5986s 2024-11-23 22:00:13,713 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:00:13,713 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34135. Reason: failure-to-start- 5986s 2024-11-23 22:00:13,714 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:00:13,716 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45337': TLS handshake failed with remote 'tls://127.0.0.1:49576': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:00:13,717 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45337': TLS handshake failed with remote 'tls://127.0.0.1:49584': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:00:13,719 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:00:14,728 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:00:14,741 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33369 5986s 2024-11-23 22:00:14,742 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37503/status 5986s 2024-11-23 22:00:14,743 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:00:14,771 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44959 5986s 2024-11-23 22:00:14,772 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44959 5986s 2024-11-23 22:00:14,772 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:00:14,772 - distributed.worker - INFO - dashboard at: 127.0.0.1:46823 5986s 2024-11-23 22:00:14,772 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33369 5986s 2024-11-23 22:00:14,772 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:00:14,772 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:00:14,772 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:00:14,772 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-t3u9jbsl 5986s 2024-11-23 22:00:14,772 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:00:14,776 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34901 5986s 2024-11-23 22:00:14,777 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34901 5986s 2024-11-23 22:00:14,777 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:00:14,777 - distributed.worker - INFO - dashboard at: 127.0.0.1:41287 5986s 2024-11-23 22:00:14,777 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33369 5986s 2024-11-23 22:00:14,777 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:00:14,777 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:00:14,777 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:00:14,778 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-0s51fbhx 5986s 2024-11-23 22:00:14,778 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:00:14,782 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44959. Reason: failure-to-start- 5986s 2024-11-23 22:00:14,783 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:00:14,783 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34901. Reason: failure-to-start- 5986s 2024-11-23 22:00:14,784 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:00:14,786 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33369': TLS handshake failed with remote 'tls://127.0.0.1:58192': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:00:14,786 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33369': TLS handshake failed with remote 'tls://127.0.0.1:58198': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:00:14,789 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:00:15,797 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:00:15,811 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46757 5986s 2024-11-23 22:00:15,812 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35143/status 5986s 2024-11-23 22:00:15,812 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:00:15,842 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43441 5986s 2024-11-23 22:00:15,842 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43441 5986s 2024-11-23 22:00:15,842 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:00:15,842 - distributed.worker - INFO - dashboard at: 127.0.0.1:35497 5986s 2024-11-23 22:00:15,842 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46757 5986s 2024-11-23 22:00:15,842 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:00:15,842 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:00:15,843 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:00:15,843 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-gitrwijt 5986s 2024-11-23 22:00:15,843 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:00:15,847 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41239 5986s 2024-11-23 22:00:15,848 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41239 5986s 2024-11-23 22:00:15,848 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:00:15,848 - distributed.worker - INFO - dashboard at: 127.0.0.1:37209 5986s 2024-11-23 22:00:15,848 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46757 5986s 2024-11-23 22:00:15,848 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:00:15,848 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:00:15,848 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:00:15,848 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-up0cimss 5986s 2024-11-23 22:00:15,848 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:00:15,855 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43441. Reason: failure-to-start- 5986s 2024-11-23 22:00:15,855 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:00:15,856 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41239. Reason: failure-to-start- 5986s 2024-11-23 22:00:15,857 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:00:15,859 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46757': TLS handshake failed with remote 'tls://127.0.0.1:39692': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:00:15,859 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46757': TLS handshake failed with remote 'tls://127.0.0.1:39694': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:00:15,867 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:00:16,875 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:00:16,890 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38761 5986s 2024-11-23 22:00:16,891 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42567/status 5986s 2024-11-23 22:00:16,891 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:00:16,921 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36559 5986s 2024-11-23 22:00:16,922 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36559 5986s 2024-11-23 22:00:16,922 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:00:16,922 - distributed.worker - INFO - dashboard at: 127.0.0.1:37443 5986s 2024-11-23 22:00:16,922 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38761 5986s 2024-11-23 22:00:16,922 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:00:16,922 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:00:16,922 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:00:16,922 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-3f43z2jm 5986s 2024-11-23 22:00:16,922 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:00:16,927 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37661 5986s 2024-11-23 22:00:16,927 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37661 5986s 2024-11-23 22:00:16,927 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:00:16,927 - distributed.worker - INFO - dashboard at: 127.0.0.1:35431 5986s 2024-11-23 22:00:16,927 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38761 5986s 2024-11-23 22:00:16,927 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:00:16,928 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:00:16,928 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:00:16,928 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-grk2bnc9 5986s 2024-11-23 22:00:16,928 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:00:16,930 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36559. Reason: failure-to-start- 5986s 2024-11-23 22:00:16,931 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:00:16,932 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37661. Reason: failure-to-start- 5986s 2024-11-23 22:00:16,932 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:00:16,935 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38761': TLS handshake failed with remote 'tls://127.0.0.1:54996': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:00:16,935 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38761': TLS handshake failed with remote 'tls://127.0.0.1:55002': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:00:16,942 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:00:17,950 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:00:17,962 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46447 5986s 2024-11-23 22:00:17,963 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44585/status 5986s 2024-11-23 22:00:17,963 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:00:17,991 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39879 5986s 2024-11-23 22:00:17,991 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39879 5986s 2024-11-23 22:00:17,991 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:00:17,992 - distributed.worker - INFO - dashboard at: 127.0.0.1:38073 5986s 2024-11-23 22:00:17,992 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46447 5986s 2024-11-23 22:00:17,992 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:00:17,992 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:00:17,992 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:00:17,992 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-5q__p8qh 5986s 2024-11-23 22:00:17,992 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:00:17,996 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37907 5986s 2024-11-23 22:00:17,996 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37907 5986s 2024-11-23 22:00:17,996 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:00:17,997 - distributed.worker - INFO - dashboard at: 127.0.0.1:46759 5986s 2024-11-23 22:00:17,997 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46447 5986s 2024-11-23 22:00:17,997 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:00:17,997 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:00:17,997 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:00:17,997 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-6grwrjjc 5986s 2024-11-23 22:00:17,997 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:00:17,999 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39879. Reason: failure-to-start- 5986s 2024-11-23 22:00:18,000 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:00:18,001 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37907. Reason: failure-to-start- 5986s 2024-11-23 22:00:18,001 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:00:18,003 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46447': TLS handshake failed with remote 'tls://127.0.0.1:47074': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:00:18,004 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46447': TLS handshake failed with remote 'tls://127.0.0.1:47088': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:00:18,006 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:00:19,014 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:00:19,026 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36425 5986s 2024-11-23 22:00:19,027 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46871/status 5986s 2024-11-23 22:00:19,028 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:00:19,054 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:32913 5986s 2024-11-23 22:00:19,054 - distributed.worker - INFO - Listening to: tls://127.0.0.1:32913 5986s 2024-11-23 22:00:19,054 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:00:19,054 - distributed.worker - INFO - dashboard at: 127.0.0.1:39809 5986s 2024-11-23 22:00:19,054 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36425 5986s 2024-11-23 22:00:19,055 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:00:19,055 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:00:19,055 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:00:19,055 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-gv308zqu 5986s 2024-11-23 22:00:19,055 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:00:19,059 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33953 5986s 2024-11-23 22:00:19,060 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33953 5986s 2024-11-23 22:00:19,060 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:00:19,060 - distributed.worker - INFO - dashboard at: 127.0.0.1:43213 5986s 2024-11-23 22:00:19,060 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36425 5986s 2024-11-23 22:00:19,060 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:00:19,060 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:00:19,060 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:00:19,060 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-76p5hxqr 5986s 2024-11-23 22:00:19,060 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:00:19,069 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:32913. Reason: failure-to-start- 5986s 2024-11-23 22:00:19,069 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:00:19,070 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33953. Reason: failure-to-start- 5986s 2024-11-23 22:00:19,070 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:00:19,073 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36425': TLS handshake failed with remote 'tls://127.0.0.1:56258': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:00:19,073 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36425': TLS handshake failed with remote 'tls://127.0.0.1:56264': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:00:19,076 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:00:20,090 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:00:20,104 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43325 5986s 2024-11-23 22:00:20,105 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40481/status 5986s 2024-11-23 22:00:20,106 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:00:20,136 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37403 5986s 2024-11-23 22:00:20,136 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37403 5986s 2024-11-23 22:00:20,137 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:00:20,137 - distributed.worker - INFO - dashboard at: 127.0.0.1:40859 5986s 2024-11-23 22:00:20,137 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43325 5986s 2024-11-23 22:00:20,137 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:00:20,137 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:00:20,137 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:00:20,137 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ygjpbcdz 5986s 2024-11-23 22:00:20,138 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:00:20,143 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35851 5986s 2024-11-23 22:00:20,143 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35851 5986s 2024-11-23 22:00:20,143 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:00:20,143 - distributed.worker - INFO - dashboard at: 127.0.0.1:35371 5986s 2024-11-23 22:00:20,144 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43325 5986s 2024-11-23 22:00:20,144 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:00:20,144 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:00:20,144 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:00:20,144 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ki5qn94o 5986s 2024-11-23 22:00:20,144 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:00:20,147 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37403. Reason: failure-to-start- 5986s 2024-11-23 22:00:20,147 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:00:20,148 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35851. Reason: failure-to-start- 5986s 2024-11-23 22:00:20,149 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:00:20,151 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43325': TLS handshake failed with remote 'tls://127.0.0.1:43970': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:00:20,151 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43325': TLS handshake failed with remote 'tls://127.0.0.1:43986': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:00:20,154 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:00:21,162 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:00:21,177 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37927 5986s 2024-11-23 22:00:21,178 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46649/status 5986s 2024-11-23 22:00:21,179 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:00:21,208 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42499 5986s 2024-11-23 22:00:21,209 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42499 5986s 2024-11-23 22:00:21,209 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:00:21,209 - distributed.worker - INFO - dashboard at: 127.0.0.1:39785 5986s 2024-11-23 22:00:21,209 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37927 5986s 2024-11-23 22:00:21,209 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:00:21,209 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:00:21,209 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:00:21,209 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-j8ivjhlf 5986s 2024-11-23 22:00:21,209 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:00:21,214 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44607 5986s 2024-11-23 22:00:21,214 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44607 5986s 2024-11-23 22:00:21,214 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:00:21,214 - distributed.worker - INFO - dashboard at: 127.0.0.1:36059 5986s 2024-11-23 22:00:21,214 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37927 5986s 2024-11-23 22:00:21,214 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:00:21,214 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:00:21,215 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:00:21,215 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-rugm7zdg 5986s 2024-11-23 22:00:21,215 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:00:21,217 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42499. Reason: failure-to-start- 5986s 2024-11-23 22:00:21,218 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:00:21,219 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44607. Reason: failure-to-start- 5986s 2024-11-23 22:00:21,219 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:00:21,222 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37927': TLS handshake failed with remote 'tls://127.0.0.1:42622': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:00:21,222 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37927': TLS handshake failed with remote 'tls://127.0.0.1:42630': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:00:21,224 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:00:22,234 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:00:22,246 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45529 5986s 2024-11-23 22:00:22,247 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36657/status 5986s 2024-11-23 22:00:22,248 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:00:22,280 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44587 5986s 2024-11-23 22:00:22,280 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44587 5986s 2024-11-23 22:00:22,280 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:00:22,281 - distributed.worker - INFO - dashboard at: 127.0.0.1:39433 5986s 2024-11-23 22:00:22,281 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45529 5986s 2024-11-23 22:00:22,281 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:00:22,281 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:00:22,281 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:00:22,281 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-oxc26eh3 5986s 2024-11-23 22:00:22,281 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:00:22,285 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41049 5986s 2024-11-23 22:00:22,286 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41049 5986s 2024-11-23 22:00:22,286 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:00:22,286 - distributed.worker - INFO - dashboard at: 127.0.0.1:38645 5986s 2024-11-23 22:00:22,286 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45529 5986s 2024-11-23 22:00:22,286 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:00:22,286 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:00:22,286 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:00:22,286 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-t0zq7kbe 5986s 2024-11-23 22:00:22,286 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:00:22,289 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44587. Reason: failure-to-start- 5986s 2024-11-23 22:00:22,289 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:00:22,290 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41049. Reason: failure-to-start- 5986s 2024-11-23 22:00:22,291 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:00:22,293 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45529': TLS handshake failed with remote 'tls://127.0.0.1:48474': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:00:22,293 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45529': TLS handshake failed with remote 'tls://127.0.0.1:48486': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:00:22,296 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:00:23,304 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:00:23,318 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36227 5986s 2024-11-23 22:00:23,319 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40601/status 5986s 2024-11-23 22:00:23,319 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:00:23,354 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45057 5986s 2024-11-23 22:00:23,354 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45057 5986s 2024-11-23 22:00:23,354 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:00:23,354 - distributed.worker - INFO - dashboard at: 127.0.0.1:34043 5986s 2024-11-23 22:00:23,355 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36227 5986s 2024-11-23 22:00:23,355 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:00:23,355 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:00:23,355 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:00:23,355 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-8yguntks 5986s 2024-11-23 22:00:23,355 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:00:23,361 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40151 5986s 2024-11-23 22:00:23,362 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40151 5986s 2024-11-23 22:00:23,362 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:00:23,362 - distributed.worker - INFO - dashboard at: 127.0.0.1:36637 5986s 2024-11-23 22:00:23,362 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36227 5986s 2024-11-23 22:00:23,362 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:00:23,362 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:00:23,362 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:00:23,362 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ukbh0wk_ 5986s 2024-11-23 22:00:23,362 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:00:23,369 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45057. Reason: failure-to-start- 5986s 2024-11-23 22:00:23,370 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:00:23,371 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40151. Reason: failure-to-start- 5986s 2024-11-23 22:00:23,371 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:00:23,378 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36227': TLS handshake failed with remote 'tls://127.0.0.1:57788': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:00:23,378 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36227': TLS handshake failed with remote 'tls://127.0.0.1:57800': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:00:23,381 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:00:24,390 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:00:24,403 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42589 5986s 2024-11-23 22:00:24,404 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41883/status 5986s 2024-11-23 22:00:24,405 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:00:24,440 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37651 5986s 2024-11-23 22:00:24,440 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37651 5986s 2024-11-23 22:00:24,440 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:00:24,440 - distributed.worker - INFO - dashboard at: 127.0.0.1:42891 5986s 2024-11-23 22:00:24,441 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42589 5986s 2024-11-23 22:00:24,441 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:00:24,441 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:00:24,441 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:00:24,441 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-9rmwp7p3 5986s 2024-11-23 22:00:24,441 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:00:24,445 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39177 5986s 2024-11-23 22:00:24,446 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39177 5986s 2024-11-23 22:00:24,446 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:00:24,446 - distributed.worker - INFO - dashboard at: 127.0.0.1:40623 5986s 2024-11-23 22:00:24,446 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42589 5986s 2024-11-23 22:00:24,446 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:00:24,446 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:00:24,446 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:00:24,446 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-gg871mve 5986s 2024-11-23 22:00:24,447 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:00:24,456 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37651. Reason: failure-to-start- 5986s 2024-11-23 22:00:24,457 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:00:24,457 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39177. Reason: failure-to-start- 5986s 2024-11-23 22:00:24,458 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:00:24,461 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42589': TLS handshake failed with remote 'tls://127.0.0.1:33614': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:00:24,461 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42589': TLS handshake failed with remote 'tls://127.0.0.1:33622': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:00:24,464 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:00:25,474 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:00:25,487 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44165 5986s 2024-11-23 22:00:25,488 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40849/status 5986s 2024-11-23 22:00:25,488 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:00:25,545 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34341 5986s 2024-11-23 22:00:25,546 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34341 5986s 2024-11-23 22:00:25,546 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:00:25,546 - distributed.worker - INFO - dashboard at: 127.0.0.1:34139 5986s 2024-11-23 22:00:25,546 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44165 5986s 2024-11-23 22:00:25,546 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:00:25,546 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:00:25,547 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:00:25,547 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-s4m0bi03 5986s 2024-11-23 22:00:25,547 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:00:25,552 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34413 5986s 2024-11-23 22:00:25,552 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34413 5986s 2024-11-23 22:00:25,552 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:00:25,553 - distributed.worker - INFO - dashboard at: 127.0.0.1:43655 5986s 2024-11-23 22:00:25,553 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44165 5986s 2024-11-23 22:00:25,553 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:00:25,553 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:00:25,553 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:00:25,553 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-m119hr_t 5986s 2024-11-23 22:00:25,553 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:00:25,565 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34341. Reason: failure-to-start- 5986s 2024-11-23 22:00:25,565 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:00:25,566 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34413. Reason: failure-to-start- 5986s 2024-11-23 22:00:25,567 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:00:25,574 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44165': TLS handshake failed with remote 'tls://127.0.0.1:60980': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:00:25,574 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44165': TLS handshake failed with remote 'tls://127.0.0.1:60992': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:00:25,577 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:00:26,588 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:00:26,602 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33329 5986s 2024-11-23 22:00:26,603 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39753/status 5986s 2024-11-23 22:00:26,604 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:00:26,635 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40391 5986s 2024-11-23 22:00:26,635 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40391 5986s 2024-11-23 22:00:26,636 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:00:26,636 - distributed.worker - INFO - dashboard at: 127.0.0.1:41193 5986s 2024-11-23 22:00:26,636 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33329 5986s 2024-11-23 22:00:26,636 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:00:26,636 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:00:26,636 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:00:26,636 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-jkas8y4n 5986s 2024-11-23 22:00:26,636 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:00:26,641 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45243 5986s 2024-11-23 22:00:26,641 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45243 5986s 2024-11-23 22:00:26,642 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:00:26,642 - distributed.worker - INFO - dashboard at: 127.0.0.1:35403 5986s 2024-11-23 22:00:26,642 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33329 5986s 2024-11-23 22:00:26,642 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:00:26,642 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:00:26,642 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:00:26,642 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-otrqyg_s 5986s 2024-11-23 22:00:26,642 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:00:26,650 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40391. Reason: failure-to-start- 5986s 2024-11-23 22:00:26,650 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:00:26,651 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45243. Reason: failure-to-start- 5986s 2024-11-23 22:00:26,652 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:00:26,654 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33329': TLS handshake failed with remote 'tls://127.0.0.1:39936': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:00:26,655 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33329': TLS handshake failed with remote 'tls://127.0.0.1:39948': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:00:26,657 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:00:27,665 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:00:27,681 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35913 5986s 2024-11-23 22:00:27,682 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34679/status 5986s 2024-11-23 22:00:27,683 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:00:27,717 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42147 5986s 2024-11-23 22:00:27,717 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42147 5986s 2024-11-23 22:00:27,717 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:00:27,717 - distributed.worker - INFO - dashboard at: 127.0.0.1:35291 5986s 2024-11-23 22:00:27,717 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35913 5986s 2024-11-23 22:00:27,718 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:00:27,718 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:00:27,718 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:00:27,718 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-2wxm3or3 5986s 2024-11-23 22:00:27,718 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:00:27,722 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34769 5986s 2024-11-23 22:00:27,723 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34769 5986s 2024-11-23 22:00:27,723 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:00:27,723 - distributed.worker - INFO - dashboard at: 127.0.0.1:40495 5986s 2024-11-23 22:00:27,723 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35913 5986s 2024-11-23 22:00:27,723 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:00:27,723 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:00:27,723 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:00:27,723 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-p_jn5qsz 5986s 2024-11-23 22:00:27,724 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:00:27,727 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42147. Reason: failure-to-start- 5986s 2024-11-23 22:00:27,727 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:00:27,728 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34769. Reason: failure-to-start- 5986s 2024-11-23 22:00:27,728 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:00:27,731 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35913': TLS handshake failed with remote 'tls://127.0.0.1:42944': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:00:27,732 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35913': TLS handshake failed with remote 'tls://127.0.0.1:42950': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:00:27,735 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:00:28,743 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:00:28,756 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40503 5986s 2024-11-23 22:00:28,757 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41155/status 5986s 2024-11-23 22:00:28,758 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:00:28,796 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38631 5986s 2024-11-23 22:00:28,796 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38631 5986s 2024-11-23 22:00:28,796 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:00:28,796 - distributed.worker - INFO - dashboard at: 127.0.0.1:41095 5986s 2024-11-23 22:00:28,797 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40503 5986s 2024-11-23 22:00:28,797 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:00:28,797 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:00:28,797 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:00:28,797 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-rx79u_zo 5986s 2024-11-23 22:00:28,797 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:00:28,801 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42049 5986s 2024-11-23 22:00:28,802 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42049 5986s 2024-11-23 22:00:28,802 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:00:28,802 - distributed.worker - INFO - dashboard at: 127.0.0.1:43047 5986s 2024-11-23 22:00:28,802 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40503 5986s 2024-11-23 22:00:28,802 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:00:28,802 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:00:28,803 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:00:28,803 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-rvlugbcv 5986s 2024-11-23 22:00:28,803 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:00:28,806 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38631. Reason: failure-to-start- 5986s 2024-11-23 22:00:28,806 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:00:28,807 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42049. Reason: failure-to-start- 5986s 2024-11-23 22:00:28,808 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:00:28,814 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40503': TLS handshake failed with remote 'tls://127.0.0.1:59256': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:00:28,814 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40503': TLS handshake failed with remote 'tls://127.0.0.1:59258': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:00:28,817 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:00:29,826 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:00:29,838 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35061 5986s 2024-11-23 22:00:29,839 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41649/status 5986s 2024-11-23 22:00:29,840 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:00:29,873 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42007 5986s 2024-11-23 22:00:29,874 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42007 5986s 2024-11-23 22:00:29,874 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:00:29,874 - distributed.worker - INFO - dashboard at: 127.0.0.1:38841 5986s 2024-11-23 22:00:29,874 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35061 5986s 2024-11-23 22:00:29,874 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:00:29,874 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:00:29,875 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:00:29,875 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-14dq3722 5986s 2024-11-23 22:00:29,875 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:00:29,879 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45945 5986s 2024-11-23 22:00:29,880 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45945 5986s 2024-11-23 22:00:29,880 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:00:29,880 - distributed.worker - INFO - dashboard at: 127.0.0.1:42907 5986s 2024-11-23 22:00:29,880 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35061 5986s 2024-11-23 22:00:29,880 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:00:29,880 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:00:29,880 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:00:29,880 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-6nvt3j24 5986s 2024-11-23 22:00:29,880 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:00:29,919 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42007. Reason: failure-to-start- 5986s 2024-11-23 22:00:29,920 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:00:29,920 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45945. Reason: failure-to-start- 5986s 2024-11-23 22:00:29,921 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:00:29,935 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35061': TLS handshake failed with remote 'tls://127.0.0.1:50012': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:00:29,935 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35061': TLS handshake failed with remote 'tls://127.0.0.1:50028': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:00:29,943 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:00:30,957 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:00:30,974 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35561 5986s 2024-11-23 22:00:30,975 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43319/status 5986s 2024-11-23 22:00:30,976 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:00:31,010 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42991 5986s 2024-11-23 22:00:31,011 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42991 5986s 2024-11-23 22:00:31,011 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:00:31,011 - distributed.worker - INFO - dashboard at: 127.0.0.1:35301 5986s 2024-11-23 22:00:31,011 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35561 5986s 2024-11-23 22:00:31,011 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:00:31,011 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:00:31,011 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:00:31,011 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-iea72149 5986s 2024-11-23 22:00:31,012 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:00:31,016 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44973 5986s 2024-11-23 22:00:31,017 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44973 5986s 2024-11-23 22:00:31,017 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:00:31,017 - distributed.worker - INFO - dashboard at: 127.0.0.1:37185 5986s 2024-11-23 22:00:31,017 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35561 5986s 2024-11-23 22:00:31,017 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:00:31,017 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:00:31,017 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:00:31,017 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-g4mgo4_z 5986s 2024-11-23 22:00:31,017 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:00:31,025 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42991. Reason: failure-to-start- 5986s 2024-11-23 22:00:31,025 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:00:31,026 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44973. Reason: failure-to-start- 5986s 2024-11-23 22:00:31,026 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:00:31,030 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35561': TLS handshake failed with remote 'tls://127.0.0.1:38230': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:00:31,030 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35561': TLS handshake failed with remote 'tls://127.0.0.1:38238': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:00:31,038 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:00:32,047 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:00:32,060 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37283 5986s 2024-11-23 22:00:32,061 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40027/status 5986s 2024-11-23 22:00:32,061 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:00:32,750 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46361 5986s 2024-11-23 22:00:32,750 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46361 5986s 2024-11-23 22:00:32,750 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:00:32,750 - distributed.worker - INFO - dashboard at: 127.0.0.1:35203 5986s 2024-11-23 22:00:32,750 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37283 5986s 2024-11-23 22:00:32,750 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:00:32,750 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:00:32,750 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:00:32,750 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-sy5coxae 5986s 2024-11-23 22:00:32,750 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:00:32,754 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34509 5986s 2024-11-23 22:00:32,755 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34509 5986s 2024-11-23 22:00:32,755 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:00:32,755 - distributed.worker - INFO - dashboard at: 127.0.0.1:42919 5986s 2024-11-23 22:00:32,755 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37283 5986s 2024-11-23 22:00:32,755 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:00:32,755 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:00:32,755 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:00:32,755 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-7boh201_ 5986s 2024-11-23 22:00:32,755 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:00:32,764 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46361. Reason: failure-to-start- 5986s 2024-11-23 22:00:32,765 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:00:32,766 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34509. Reason: failure-to-start- 5986s 2024-11-23 22:00:32,766 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:00:32,773 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37283': TLS handshake failed with remote 'tls://127.0.0.1:40362': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:00:32,773 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37283': TLS handshake failed with remote 'tls://127.0.0.1:40368': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:00:32,781 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:00:33,792 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:00:33,804 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:32851 5986s 2024-11-23 22:00:33,805 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38615/status 5986s 2024-11-23 22:00:33,805 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:00:33,837 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46793 5986s 2024-11-23 22:00:33,837 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46793 5986s 2024-11-23 22:00:33,837 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:00:33,837 - distributed.worker - INFO - dashboard at: 127.0.0.1:43883 5986s 2024-11-23 22:00:33,837 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:32851 5986s 2024-11-23 22:00:33,837 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:00:33,837 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:00:33,837 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:00:33,837 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-4waf_zbc 5986s 2024-11-23 22:00:33,838 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:00:33,842 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34221 5986s 2024-11-23 22:00:33,842 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34221 5986s 2024-11-23 22:00:33,842 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:00:33,842 - distributed.worker - INFO - dashboard at: 127.0.0.1:38433 5986s 2024-11-23 22:00:33,842 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:32851 5986s 2024-11-23 22:00:33,842 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:00:33,842 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:00:33,842 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:00:33,843 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-032hlww1 5986s 2024-11-23 22:00:33,843 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:00:33,861 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46793. Reason: failure-to-start- 5986s 2024-11-23 22:00:33,862 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:00:33,863 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34221. Reason: failure-to-start- 5986s 2024-11-23 22:00:33,863 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:00:33,867 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:32851': TLS handshake failed with remote 'tls://127.0.0.1:55608': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:00:33,867 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:32851': TLS handshake failed with remote 'tls://127.0.0.1:55610': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:00:33,879 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:00:34,888 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:00:34,900 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45749 5986s 2024-11-23 22:00:34,900 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36089/status 5986s 2024-11-23 22:00:34,901 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:00:34,933 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41571 5986s 2024-11-23 22:00:34,933 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41571 5986s 2024-11-23 22:00:34,933 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:00:34,934 - distributed.worker - INFO - dashboard at: 127.0.0.1:38861 5986s 2024-11-23 22:00:34,934 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45749 5986s 2024-11-23 22:00:34,934 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:00:34,934 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:00:34,934 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:00:34,934 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-1wuqez0d 5986s 2024-11-23 22:00:34,934 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:00:34,938 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46367 5986s 2024-11-23 22:00:34,938 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46367 5986s 2024-11-23 22:00:34,938 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:00:34,938 - distributed.worker - INFO - dashboard at: 127.0.0.1:41573 5986s 2024-11-23 22:00:34,938 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45749 5986s 2024-11-23 22:00:34,938 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:00:34,938 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:00:34,938 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:00:34,938 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-e9sr2j97 5986s 2024-11-23 22:00:34,939 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:00:34,945 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41571. Reason: failure-to-start- 5986s 2024-11-23 22:00:34,945 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:00:34,946 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46367. Reason: failure-to-start- 5986s 2024-11-23 22:00:34,946 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:00:34,953 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45749': TLS handshake failed with remote 'tls://127.0.0.1:51036': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:00:34,953 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45749': TLS handshake failed with remote 'tls://127.0.0.1:51046': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:00:34,956 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:00:35,967 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:00:35,983 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37583 5986s 2024-11-23 22:00:35,984 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37415/status 5986s 2024-11-23 22:00:35,984 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:00:36,018 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43365 5986s 2024-11-23 22:00:36,019 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43365 5986s 2024-11-23 22:00:36,019 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:00:36,019 - distributed.worker - INFO - dashboard at: 127.0.0.1:35321 5986s 2024-11-23 22:00:36,019 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37583 5986s 2024-11-23 22:00:36,019 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:00:36,019 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:00:36,019 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:00:36,019 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-art8d8ba 5986s 2024-11-23 22:00:36,019 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:00:36,024 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44561 5986s 2024-11-23 22:00:36,024 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44561 5986s 2024-11-23 22:00:36,024 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:00:36,025 - distributed.worker - INFO - dashboard at: 127.0.0.1:44715 5986s 2024-11-23 22:00:36,025 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37583 5986s 2024-11-23 22:00:36,025 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:00:36,025 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:00:36,025 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:00:36,025 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-yonw8gbl 5986s 2024-11-23 22:00:36,025 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:00:36,032 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43365. Reason: failure-to-start- 5986s 2024-11-23 22:00:36,033 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:00:36,033 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44561. Reason: failure-to-start- 5986s 2024-11-23 22:00:36,034 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:00:36,040 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37583': TLS handshake failed with remote 'tls://127.0.0.1:41736': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:00:36,041 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37583': TLS handshake failed with remote 'tls://127.0.0.1:41750': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:00:36,047 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:00:37,056 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:00:37,068 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46715 5986s 2024-11-23 22:00:37,069 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45541/status 5986s 2024-11-23 22:00:37,070 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:00:37,142 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41779 5986s 2024-11-23 22:00:37,142 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41779 5986s 2024-11-23 22:00:37,143 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:00:37,143 - distributed.worker - INFO - dashboard at: 127.0.0.1:33073 5986s 2024-11-23 22:00:37,143 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46715 5986s 2024-11-23 22:00:37,143 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:00:37,143 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:00:37,143 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:00:37,143 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-omrfy4e7 5986s 2024-11-23 22:00:37,143 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:00:37,147 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45871 5986s 2024-11-23 22:00:37,148 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45871 5986s 2024-11-23 22:00:37,148 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:00:37,148 - distributed.worker - INFO - dashboard at: 127.0.0.1:34113 5986s 2024-11-23 22:00:37,148 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46715 5986s 2024-11-23 22:00:37,148 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:00:37,148 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:00:37,148 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:00:37,148 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-3sgn7w91 5986s 2024-11-23 22:00:37,148 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:00:37,161 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41779. Reason: failure-to-start- 5986s 2024-11-23 22:00:37,162 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:00:37,163 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45871. Reason: failure-to-start- 5986s 2024-11-23 22:00:37,163 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:00:37,170 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46715': TLS handshake failed with remote 'tls://127.0.0.1:58734': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:00:37,170 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46715': TLS handshake failed with remote 'tls://127.0.0.1:58738': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:00:37,177 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:00:38,186 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:00:38,198 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35915 5986s 2024-11-23 22:00:38,198 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46207/status 5986s 2024-11-23 22:00:38,199 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:00:38,229 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42543 5986s 2024-11-23 22:00:38,229 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42543 5986s 2024-11-23 22:00:38,230 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:00:38,230 - distributed.worker - INFO - dashboard at: 127.0.0.1:41717 5986s 2024-11-23 22:00:38,230 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35915 5986s 2024-11-23 22:00:38,230 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:00:38,230 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:00:38,230 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:00:38,230 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-i8fp8meq 5986s 2024-11-23 22:00:38,230 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:00:38,234 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41389 5986s 2024-11-23 22:00:38,237 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41389 5986s 2024-11-23 22:00:38,237 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:00:38,237 - distributed.worker - INFO - dashboard at: 127.0.0.1:37029 5986s 2024-11-23 22:00:38,237 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35915 5986s 2024-11-23 22:00:38,238 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:00:38,238 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:00:38,238 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:00:38,238 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-_ovfbwep 5986s 2024-11-23 22:00:38,238 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:00:38,241 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42543. Reason: failure-to-start- 5986s 2024-11-23 22:00:38,241 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:00:38,242 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41389. Reason: failure-to-start- 5986s 2024-11-23 22:00:38,242 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:00:38,245 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35915': TLS handshake failed with remote 'tls://127.0.0.1:56746': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:00:38,246 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35915': TLS handshake failed with remote 'tls://127.0.0.1:56762': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:00:38,252 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s _________________________________ test_gather __________________________________ 5986s 5986s fut = , timeout = 0 5986s 5986s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 5986s async with asyncio.timeout(timeout): 5986s > return await fut 5986s 5986s /usr/lib/python3/dist-packages/distributed/utils.py:1960: 5986s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5986s /usr/lib/python3/dist-packages/distributed/worker.py:1480: in start_unsafe 5986s await self._register_with_scheduler() 5986s /usr/lib/python3/dist-packages/distributed/worker.py:1179: in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s /usr/lib/python3/dist-packages/distributed/comm/core.py:342: in connect 5986s comm = await wait_for( 5986s /usr/lib/python3/dist-packages/distributed/utils.py:1960: in wait_for 5986s return await fut 5986s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:546: in connect 5986s stream = await self.client.connect( 5986s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5986s 5986s self = , host = '127.0.0.1' 5986s port = 39925, af = 5986s ssl_options = 5986s max_buffer_size = 8364507136.0, source_ip = None, source_port = None 5986s timeout = None 5986s 5986s async def connect( 5986s self, 5986s host: str, 5986s port: int, 5986s af: socket.AddressFamily = socket.AF_UNSPEC, 5986s ssl_options: Optional[Union[Dict[str, Any], ssl.SSLContext]] = None, 5986s max_buffer_size: Optional[int] = None, 5986s source_ip: Optional[str] = None, 5986s source_port: Optional[int] = None, 5986s timeout: Optional[Union[float, datetime.timedelta]] = None, 5986s ) -> IOStream: 5986s """Connect to the given host and port. 5986s 5986s Asynchronously returns an `.IOStream` (or `.SSLIOStream` if 5986s ``ssl_options`` is not None). 5986s 5986s Using the ``source_ip`` kwarg, one can specify the source 5986s IP address to use when establishing the connection. 5986s In case the user needs to resolve and 5986s use a specific interface, it has to be handled outside 5986s of Tornado as this depends very much on the platform. 5986s 5986s Raises `TimeoutError` if the input future does not complete before 5986s ``timeout``, which may be specified in any form allowed by 5986s `.IOLoop.add_timeout` (i.e. a `datetime.timedelta` or an absolute time 5986s relative to `.IOLoop.time`) 5986s 5986s Similarly, when the user requires a certain source port, it can 5986s be specified using the ``source_port`` arg. 5986s 5986s .. versionchanged:: 4.5 5986s Added the ``source_ip`` and ``source_port`` arguments. 5986s 5986s .. versionchanged:: 5.0 5986s Added the ``timeout`` argument. 5986s """ 5986s if timeout is not None: 5986s if isinstance(timeout, numbers.Real): 5986s timeout = IOLoop.current().time() + timeout 5986s elif isinstance(timeout, datetime.timedelta): 5986s timeout = IOLoop.current().time() + timeout.total_seconds() 5986s else: 5986s raise TypeError("Unsupported timeout %r" % timeout) 5986s if timeout is not None: 5986s addrinfo = await gen.with_timeout( 5986s timeout, self.resolver.resolve(host, port, af) 5986s ) 5986s else: 5986s addrinfo = await self.resolver.resolve(host, port, af) 5986s connector = _Connector( 5986s addrinfo, 5986s functools.partial( 5986s self._create_stream, 5986s max_buffer_size, 5986s source_ip=source_ip, 5986s source_port=source_port, 5986s ), 5986s ) 5986s > af, addr, stream = await connector.start(connect_timeout=timeout) 5986s E asyncio.exceptions.CancelledError 5986s 5986s /usr/lib/python3/dist-packages/tornado/tcpclient.py:279: CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s self = 5986s 5986s @final 5986s async def start(self): 5986s async with self._startup_lock: 5986s if self.status == Status.failed: 5986s assert self.__startup_exc is not None 5986s raise self.__startup_exc 5986s elif self.status != Status.init: 5986s return self 5986s timeout = getattr(self, "death_timeout", None) 5986s 5986s async def _close_on_failure(exc: Exception) -> None: 5986s await self.close(reason=f"failure-to-start-{str(type(exc))}") 5986s self.status = Status.failed 5986s self.__startup_exc = exc 5986s 5986s try: 5986s > await wait_for(self.start_unsafe(), timeout=timeout) 5986s 5986s /usr/lib/python3/dist-packages/distributed/core.py:664: 5986s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5986s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 5986s async with asyncio.timeout(timeout): 5986s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5986s 5986s self = 5986s exc_type = 5986s exc_val = CancelledError(), exc_tb = 5986s 5986s async def __aexit__( 5986s self, 5986s exc_type: Optional[Type[BaseException]], 5986s exc_val: Optional[BaseException], 5986s exc_tb: Optional[TracebackType], 5986s ) -> Optional[bool]: 5986s assert self._state in (_State.ENTERED, _State.EXPIRING) 5986s 5986s if self._timeout_handler is not None: 5986s self._timeout_handler.cancel() 5986s self._timeout_handler = None 5986s 5986s if self._state is _State.EXPIRING: 5986s self._state = _State.EXPIRED 5986s 5986s if self._task.uncancel() <= self._cancelling and exc_type is not None: 5986s # Since there are no new cancel requests, we're 5986s # handling this. 5986s if issubclass(exc_type, exceptions.CancelledError): 5986s > raise TimeoutError from exc_val 5986s E TimeoutError 5986s 5986s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s @contextlib.asynccontextmanager 5986s async def _cluster_factory(): 5986s workers = [] 5986s s = None 5986s try: 5986s for _ in range(60): 5986s try: 5986s > s, ws = await start_cluster( 5986s nthreads, 5986s scheduler, 5986s security=security, 5986s Worker=Worker, 5986s scheduler_kwargs=scheduler_kwargs, 5986s worker_kwargs=merge( 5986s {"death_timeout": min(15, int(deadline.remaining))}, 5986s worker_kwargs, 5986s ), 5986s ) 5986s 5986s /usr/lib/python3/dist-packages/distributed/utils_test.py:966: 5986s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5986s /usr/lib/python3/dist-packages/distributed/utils_test.py:789: in start_cluster 5986s await asyncio.gather(*workers) 5986s /usr/lib/python3.13/asyncio/tasks.py:737: in _wrap_awaitable 5986s return await awaitable 5986s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5986s 5986s self = 5986s 5986s @final 5986s async def start(self): 5986s async with self._startup_lock: 5986s if self.status == Status.failed: 5986s assert self.__startup_exc is not None 5986s raise self.__startup_exc 5986s elif self.status != Status.init: 5986s return self 5986s timeout = getattr(self, "death_timeout", None) 5986s 5986s async def _close_on_failure(exc: Exception) -> None: 5986s await self.close(reason=f"failure-to-start-{str(type(exc))}") 5986s self.status = Status.failed 5986s self.__startup_exc = exc 5986s 5986s try: 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s except asyncio.TimeoutError as exc: 5986s await _close_on_failure(exc) 5986s > raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s E TimeoutError: Worker start timed out after 0s. 5986s 5986s /usr/lib/python3/dist-packages/distributed/core.py:667: TimeoutError 5986s 5986s During handling of the above exception, another exception occurred: 5986s 5986s fut = ._..test_func..async_fn at 0xde81abf0> 5986s timeout = 60 5986s 5986s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 5986s async with asyncio.timeout(timeout): 5986s > return await fut 5986s 5986s /usr/lib/python3/dist-packages/distributed/utils.py:1960: 5986s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5986s /usr/lib/python3/dist-packages/distributed/utils_test.py:999: in async_fn 5986s _cluster_factory() as (s, workers), 5986s /usr/lib/python3.13/contextlib.py:214: in __aenter__ 5986s return await anext(self.gen) 5986s /usr/lib/python3/dist-packages/distributed/utils_test.py:983: in _cluster_factory 5986s await asyncio.sleep(1) 5986s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5986s 5986s delay = 1, result = None 5986s 5986s async def sleep(delay, result=None): 5986s """Coroutine that completes after a given time (in seconds).""" 5986s if delay <= 0: 5986s await __sleep0() 5986s return result 5986s 5986s if math.isnan(delay): 5986s raise ValueError("Invalid delay: NaN (not a number)") 5986s 5986s loop = events.get_running_loop() 5986s future = loop.create_future() 5986s h = loop.call_later(delay, 5986s futures._set_result_unless_cancelled, 5986s future, result) 5986s try: 5986s > return await future 5986s E asyncio.exceptions.CancelledError 5986s 5986s /usr/lib/python3.13/asyncio/tasks.py:718: CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s args = (), kwds = {} 5986s 5986s @wraps(func) 5986s def inner(*args, **kwds): 5986s with self._recreate_cm(): 5986s > return func(*args, **kwds) 5986s 5986s /usr/lib/python3.13/contextlib.py:85: 5986s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5986s /usr/lib/python3.13/contextlib.py:85: in inner 5986s return func(*args, **kwds) 5986s /usr/lib/python3/dist-packages/distributed/utils_test.py:1102: in test_func 5986s return _run_and_close_tornado(async_fn_outer) 5986s /usr/lib/python3/dist-packages/distributed/utils_test.py:378: in _run_and_close_tornado 5986s return asyncio_run(inner_fn(), loop_factory=get_loop_factory()) 5986s /usr/lib/python3.13/asyncio/runners.py:194: in run 5986s return runner.run(main) 5986s /usr/lib/python3.13/asyncio/runners.py:118: in run 5986s return self._loop.run_until_complete(task) 5986s /usr/lib/python3.13/asyncio/base_events.py:720: in run_until_complete 5986s return future.result() 5986s /usr/lib/python3/dist-packages/distributed/utils_test.py:375: in inner_fn 5986s return await async_fn(*args, **kwargs) 5986s /usr/lib/python3/dist-packages/distributed/utils_test.py:1099: in async_fn_outer 5986s return await utils_wait_for(async_fn(), timeout=timeout * 2) 5986s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 5986s async with asyncio.timeout(timeout): 5986s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5986s 5986s self = 5986s exc_type = 5986s exc_val = CancelledError(), exc_tb = 5986s 5986s async def __aexit__( 5986s self, 5986s exc_type: Optional[Type[BaseException]], 5986s exc_val: Optional[BaseException], 5986s exc_tb: Optional[TracebackType], 5986s ) -> Optional[bool]: 5986s assert self._state in (_State.ENTERED, _State.EXPIRING) 5986s 5986s if self._timeout_handler is not None: 5986s self._timeout_handler.cancel() 5986s self._timeout_handler = None 5986s 5986s if self._state is _State.EXPIRING: 5986s self._state = _State.EXPIRED 5986s 5986s if self._task.uncancel() <= self._cancelling and exc_type is not None: 5986s # Since there are no new cancel requests, we're 5986s # handling this. 5986s if issubclass(exc_type, exceptions.CancelledError): 5986s > raise TimeoutError from exc_val 5986s E TimeoutError 5986s 5986s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 5986s ----------------------------- Captured stderr call ----------------------------- 5986s 2024-11-23 22:00:39,114 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:00:39,125 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:39,126 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38349/status 5986s 2024-11-23 22:00:39,127 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:00:39,151 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35355 5986s 2024-11-23 22:00:39,151 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35355 5986s 2024-11-23 22:00:39,152 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:00:39,152 - distributed.worker - INFO - dashboard at: 127.0.0.1:42103 5986s 2024-11-23 22:00:39,152 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:39,152 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:00:39,152 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:00:39,152 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:00:39,152 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-hvfhu2bc 5986s 2024-11-23 22:00:39,152 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:00:39,156 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43743 5986s 2024-11-23 22:00:39,156 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43743 5986s 2024-11-23 22:00:39,157 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:00:39,157 - distributed.worker - INFO - dashboard at: 127.0.0.1:36353 5986s 2024-11-23 22:00:39,157 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:39,157 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:00:39,157 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:00:39,157 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:00:39,157 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-96wd66o0 5986s 2024-11-23 22:00:39,157 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:00:39,175 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:39,175 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:39,176 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:43990': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:39,176 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:43996': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:39,293 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:39,293 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:39,294 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:43998': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:39,294 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:44006': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:39,445 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:39,446 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:39,447 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:44008': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:39,449 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:44014': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:39,564 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:39,565 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:39,566 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:44030': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:39,566 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:44034': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:39,682 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:39,683 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:39,683 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:44036': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:39,684 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:44050': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:39,800 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:39,800 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:39,801 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:44060': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:39,801 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:44062': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:39,912 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:39,918 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:44066': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:39,920 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:39,920 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:44082': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:40,023 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:40,025 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:44086': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:40,033 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:40,034 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:44094': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:40,134 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:40,139 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:44100': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:40,148 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:40,149 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:44112': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:40,244 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:40,244 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:44126': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:40,259 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:40,260 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:44136': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:40,354 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:40,355 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:44152': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:40,369 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:40,370 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:44164': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:40,465 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:40,466 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:44174': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:40,479 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:40,480 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:44182': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:40,576 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:40,577 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:44190': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:40,589 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:40,590 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:44206': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:40,686 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:40,687 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:44210': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:40,699 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:40,700 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:44224': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:40,797 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:40,798 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:44240': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:40,809 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:40,810 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:44250': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:40,908 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:40,909 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:44260': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:40,918 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:40,919 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:44262': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:41,020 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:41,021 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:44270': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:41,033 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:41,034 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:44280': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:41,132 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:41,138 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:44292': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:41,147 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:41,148 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:44300': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:41,243 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:41,243 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:44304': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:41,257 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:41,258 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:44310': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:41,353 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:41,354 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:44324': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:41,368 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:41,369 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:44336': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:41,464 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:41,465 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:44342': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:41,478 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:41,479 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:44358': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:41,575 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:41,575 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:36646': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:41,588 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:41,589 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:36656': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:41,685 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:41,686 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:36666': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:41,697 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:41,698 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:36674': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:41,796 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:41,797 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:36676': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:41,808 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:41,809 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:36690': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:41,907 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:41,908 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:36702': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:41,918 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:41,919 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:36714': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:42,018 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:42,019 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:36724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:42,028 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:42,030 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:36726': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:42,129 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:42,135 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:36728': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:42,145 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:42,146 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:36738': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:42,240 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:42,241 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:36746': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:42,256 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:42,257 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:36748': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:42,352 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:42,353 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:36764': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:42,366 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:42,367 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:36776': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:42,463 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:42,464 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:36790': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:42,477 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:42,478 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:36804': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:42,574 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:42,575 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:36810': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:42,590 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:42,591 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:36818': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:42,686 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:42,686 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:36820': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:42,700 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:42,701 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:36834': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:42,796 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:42,798 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:36850': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:42,810 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:42,811 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:36858': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:42,907 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:42,908 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:36874': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:42,921 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:42,921 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:36882': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:43,014 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:43,015 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:36884': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:43,028 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:43,029 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:36888': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:43,121 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:43,122 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:36890': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:43,135 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:43,136 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:36892': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:43,229 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:43,229 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:36900': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:43,243 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:43,243 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:36912': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:43,336 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:43,336 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:36918': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:43,349 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:43,350 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:36928': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:43,444 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:43,444 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:36938': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:43,456 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:43,457 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:36954': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:43,551 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:43,551 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:36960': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:43,563 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:43,564 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:36972': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:43,658 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:43,658 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:36984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:43,670 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:43,671 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:36986': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:43,764 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:43,765 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:36992': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:43,777 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:43,777 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:36998': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:43,871 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:43,871 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:37004': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:43,884 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:43,884 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:37006': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:43,978 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:43,978 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:37022': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:43,990 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:43,991 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:37026': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:44,085 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:44,085 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:37040': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:44,097 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:44,098 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:37054': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:44,192 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:44,192 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:37066': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:44,204 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:44,205 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:37072': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:44,298 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:44,299 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:37076': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:44,311 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:44,312 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:37078': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:44,406 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:44,406 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:37082': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:44,418 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:44,419 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:37096': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:44,513 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:44,514 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:37098': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:44,525 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:44,525 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:37100': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:44,620 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:44,620 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:37110': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:44,632 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:44,635 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:37112': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:44,727 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:44,728 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:37128': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:44,739 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:44,739 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:37136': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:44,834 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:44,834 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:37152': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:44,845 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:44,846 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:37166': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:44,941 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:44,941 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:37172': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:44,952 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:44,952 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:37178': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:45,048 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:45,048 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:37182': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:45,059 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:45,059 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:37186': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:45,155 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:45,155 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:37202': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:45,165 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:45,166 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:37206': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:45,261 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:45,262 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:37220': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:45,272 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:45,272 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:37232': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:45,369 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:45,369 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:37246': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:45,378 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:45,379 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:37248': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:45,475 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:45,476 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:37258': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:45,485 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:45,485 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:37264': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:45,582 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:45,582 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:37274': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:45,591 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:45,591 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:37282': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:45,689 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:45,689 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:37292': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:45,698 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:45,698 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:37302': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:45,796 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:45,796 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:37312': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:45,805 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:45,805 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:37326': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:45,903 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:45,903 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:37336': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:45,911 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:45,912 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:37348': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:46,010 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:46,010 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:37362': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:46,018 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:46,018 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:37370': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:46,116 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:46,116 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:37372': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:46,124 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:46,125 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:37388': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:46,225 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:46,226 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:37390': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:46,232 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:46,232 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:37400': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:46,333 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:46,333 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:37402': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:46,339 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:46,339 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:37410': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:46,439 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:46,440 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:37426': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:46,446 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:46,446 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:37434': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:46,546 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:46,546 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:37450': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:46,552 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:46,552 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:37456': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:46,653 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:46,653 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:37472': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:46,659 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:46,659 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:37478': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:46,761 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:46,761 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:37486': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:46,767 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:46,767 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:37500': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:46,868 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:46,868 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:37510': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:46,874 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:46,874 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:37526': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:46,975 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:46,976 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:37538': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:46,981 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:46,981 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:37548': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:47,082 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:47,082 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:37562': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:47,088 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:47,088 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:37566': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:47,189 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:47,189 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:37574': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:47,195 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:47,195 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:37582': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:47,296 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:47,296 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:37584': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:47,302 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:47,302 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:37598': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:47,404 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:47,404 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:37600': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:47,410 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:47,410 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:37606': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:47,519 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:47,521 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:37608': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:47,526 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:47,527 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:37610': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:47,627 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:47,627 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:37624': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:47,637 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:47,637 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:37640': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:47,734 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:47,734 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:37648': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:47,743 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:47,743 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:37654': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:47,840 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:47,840 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:37658': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:47,850 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:47,850 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:37670': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:47,950 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:47,950 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:37672': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:47,956 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:47,956 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:37678': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:48,057 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:48,058 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:37680': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:48,063 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:48,063 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:37686': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:48,164 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:48,164 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:37700': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:48,170 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:48,170 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:37708': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:48,271 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:48,272 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:37718': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:48,278 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:48,278 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:37722': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:48,379 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:48,380 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:37726': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:48,385 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:48,385 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:37732': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:48,487 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:48,488 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:37734': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:48,494 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:48,494 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:37748': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:48,595 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:48,595 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:37764': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:48,601 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:48,601 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:37778': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:48,702 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:48,702 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:37782': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:48,708 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:48,708 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:37788': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:48,809 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:48,810 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:37796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:48,815 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:48,816 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:37810': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:48,917 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:48,917 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:37822': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:48,923 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:48,923 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:37834': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:49,024 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:49,025 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:37836': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:49,030 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:49,030 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:37840': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:49,131 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:49,134 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:37848': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:49,140 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:49,140 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:37864': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:49,237 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:49,237 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:37878': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:49,247 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:49,247 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:37888': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:49,345 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:49,345 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:37892': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:49,353 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:49,354 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:37894': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:49,453 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:49,453 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:37896': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:49,460 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:49,460 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:37900': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:49,560 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:49,561 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:37914': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:49,566 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:49,567 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:37926': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:49,668 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:49,669 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:37940': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:49,674 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:49,674 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:37950': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:49,774 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:49,775 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:37964': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:49,781 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:49,781 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:37974': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:49,882 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:49,883 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:37976': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:49,888 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:49,889 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:37980': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:49,990 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:49,990 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:37986': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:49,996 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:49,996 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:38000': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:50,098 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:50,099 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:38012': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:50,104 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:50,104 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:38024': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:50,206 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:50,207 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:38032': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:50,212 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:50,212 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:38040': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:50,314 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:50,314 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:38042': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:50,320 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:50,320 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:38052': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:50,422 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:50,422 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:38066': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:50,428 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:50,428 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:38070': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:50,529 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:50,529 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:38086': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:50,535 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:50,535 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:38098': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:50,636 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:50,637 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:38104': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:50,642 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:50,643 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:38108': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:50,743 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:50,743 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:38124': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:50,749 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:50,749 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:38134': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:50,850 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:50,851 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:38144': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:50,856 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:50,856 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:38158': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:50,957 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:50,957 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:38170': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:50,963 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:50,963 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:38176': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:51,064 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:51,065 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:38180': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:51,070 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:51,070 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:38190': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:51,171 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:51,172 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:38204': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:51,177 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:51,177 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:38216': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:51,278 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:51,279 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:38230': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:51,284 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:51,285 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:38232': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:51,385 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:51,386 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:38238': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:51,391 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:51,392 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:38246': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:51,494 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:51,494 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:38258': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:51,500 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:51,500 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:38266': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:51,602 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:51,602 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:49586': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:51,608 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:51,608 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:49594': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:51,709 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:51,710 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:49610': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:51,715 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:51,716 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:49612': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:51,816 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:51,817 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:49614': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:51,822 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:51,823 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:49620': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:51,924 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:51,925 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:49632': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:51,930 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:51,931 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:49640': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:52,031 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:52,032 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:49652': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:52,037 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:52,038 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:49654': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:52,138 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:52,138 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:49668': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:52,144 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:52,144 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:49674': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:52,244 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:52,245 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:49690': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:52,251 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:52,251 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:49698': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:52,353 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:52,353 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:49714': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:52,359 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:52,359 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:49724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:52,461 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:52,462 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:49740': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:52,467 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:52,467 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:49744': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:52,568 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:52,568 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:49756': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:52,574 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:52,574 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:49762': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:52,675 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:52,675 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:49776': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:52,681 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:52,681 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:49786': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:52,782 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:52,782 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:49792': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:52,788 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:52,788 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:49798': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:52,889 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:52,890 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:49810': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:52,895 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:52,895 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:49818': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:52,996 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:52,996 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:49834': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:53,002 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:53,002 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:49842': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:53,104 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:53,104 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:49858': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:53,110 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:53,110 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:49866': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:53,211 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:53,211 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:49878': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:53,217 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:53,217 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:49886': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:53,318 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:53,318 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:49898': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:53,324 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:53,324 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:49914': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:53,425 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:53,426 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:49924': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:53,431 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:53,431 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:49926': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:53,532 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:53,532 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:49932': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:53,538 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:53,538 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:49936': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:53,638 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:53,639 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:49938': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:53,644 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:53,645 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:49940': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:53,745 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:53,746 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:49950': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:53,751 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:53,752 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:49954': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:53,853 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:53,853 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:49956': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:53,859 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:53,859 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:49958': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:53,959 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:53,960 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:49974': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:53,966 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:53,966 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:49982': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:54,066 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:54,067 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:49992': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:54,072 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36447 5986s 2024-11-23 22:00:54,073 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36447': TLS handshake failed with remote 'tls://127.0.0.1:50008': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:54,148 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35355. Reason: failure-to-start- 5986s 2024-11-23 22:00:54,149 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:00:54,151 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 15s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 5986s stream = await stream.start_tls( 5986s ^^^^^^^^^^^^^^^^^^^^^^^ 5986s False, ssl_options=ssl_options, server_hostname=host 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 5986s self.socket.do_handshake() 5986s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 5986s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 5986s self._sslobj.do_handshake() 5986s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 5986s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 5986s raise FatalCommClosedError( 5986s ...<2 lines>... 5986s ) from err 5986s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 5986s 5986s During handling of the above exception, another exception occurred: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1218, in _register_with_scheduler 5986s await asyncio.sleep(0.1) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 718, in sleep 5986s return await future 5986s ^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 15s. 5986s 2024-11-23 22:00:54,154 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43743. Reason: failure-to-start- 5986s 2024-11-23 22:00:54,154 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:00:55,158 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:00:55,165 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37941 5986s 2024-11-23 22:00:55,165 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37735/status 5986s 2024-11-23 22:00:55,165 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:00:55,178 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39201 5986s 2024-11-23 22:00:55,178 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39201 5986s 2024-11-23 22:00:55,178 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:00:55,178 - distributed.worker - INFO - dashboard at: 127.0.0.1:34823 5986s 2024-11-23 22:00:55,178 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:00:55,178 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:00:55,178 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:00:55,178 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:00:55,178 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-07o_rzqo 5986s 2024-11-23 22:00:55,178 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:00:55,180 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37847 5986s 2024-11-23 22:00:55,180 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37847 5986s 2024-11-23 22:00:55,180 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:00:55,180 - distributed.worker - INFO - dashboard at: 127.0.0.1:44149 5986s 2024-11-23 22:00:55,180 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:00:55,180 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:00:55,180 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:00:55,180 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:00:55,180 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-9kji68gp 5986s 2024-11-23 22:00:55,180 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:00:55,193 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:00:55,193 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:00:55,193 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:34796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:55,193 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:34808': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:55,304 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:00:55,304 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:00:55,305 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:34818': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:55,305 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:34828': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:55,416 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:00:55,416 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:00:55,416 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:34838': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:55,417 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:34840': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:55,528 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:00:55,528 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:00:55,528 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:34854': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:55,528 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:34866': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:55,642 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:00:55,642 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:00:55,642 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:34882': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:55,642 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:34894': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:55,754 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:00:55,754 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:00:55,754 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:34908': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:55,754 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:34918': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:55,866 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:00:55,866 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:00:55,867 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:34922': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:55,867 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:34930': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:55,978 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:00:55,979 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:00:55,979 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:34938': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:55,979 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:34948': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:56,091 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:00:56,091 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:00:56,091 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:34958': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:56,091 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:34960': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:56,203 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:00:56,203 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:00:56,203 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:34964': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:56,204 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:34974': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:56,315 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:00:56,315 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:00:56,315 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:34978': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:56,315 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:34988': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:56,427 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:00:56,427 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:00:56,427 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:34990': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:56,427 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:35006': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:56,534 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:00:56,538 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:35010': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:56,539 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:00:56,540 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:35016': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:56,641 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:00:56,642 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:35024': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:56,647 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:00:56,647 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:35040': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:56,748 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:00:56,749 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:35044': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:56,755 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:00:56,755 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:35056': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:56,856 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:00:56,856 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:35068': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:56,862 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:00:56,862 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:35076': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:56,963 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:00:56,964 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:35086': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:56,970 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:00:56,970 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:35102': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:57,071 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:00:57,071 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:35112': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:57,077 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:00:57,077 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:35118': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:57,177 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:00:57,178 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:35130': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:57,183 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:00:57,184 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:35140': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:57,284 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:00:57,285 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:35152': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:57,290 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:00:57,291 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:35160': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:57,392 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:00:57,392 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:35172': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:57,398 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:00:57,398 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:35174': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:57,498 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:00:57,499 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:35176': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:57,504 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:00:57,505 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:35184': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:57,605 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:00:57,605 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:35188': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:57,612 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:00:57,613 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:35194': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:57,712 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:00:57,713 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:35196': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:57,719 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:00:57,719 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:35206': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:57,820 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:00:57,821 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:35214': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:57,826 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:00:57,826 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:35216': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:57,927 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:00:57,927 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:35226': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:57,933 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:00:57,933 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:35232': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:58,034 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:00:58,035 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:35242': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:58,040 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:00:58,041 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:35248': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:58,141 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:00:58,141 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:35254': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:58,147 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:00:58,147 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:35258': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:58,248 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:00:58,248 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:35270': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:58,254 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:00:58,254 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:35276': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:58,355 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:00:58,356 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:35288': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:58,361 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:00:58,362 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:35300': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:58,462 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:00:58,462 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:35314': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:58,468 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:00:58,469 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:35324': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:58,571 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:00:58,571 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:35340': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:58,577 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:00:58,577 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:35356': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:58,679 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:00:58,680 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:35360': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:58,685 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:00:58,685 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:35370': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:58,786 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:00:58,787 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:35380': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:58,792 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:00:58,793 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:35394': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:58,895 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:00:58,895 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:35410': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:58,901 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:00:58,901 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:35424': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:59,001 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:00:59,002 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:35434': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:59,007 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:00:59,008 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:35448': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:59,110 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:00:59,110 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:35464': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:59,116 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:00:59,116 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:35470': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:59,217 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:00:59,217 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:35482': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:59,224 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:00:59,225 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:35488': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:59,324 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:00:59,324 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:35498': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:59,331 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:00:59,332 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:35504': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:59,431 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:00:59,431 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:35506': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:59,438 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:00:59,439 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:35516': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:59,537 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:00:59,538 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:35518': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:59,545 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:00:59,545 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:35524': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:59,645 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:00:59,645 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:35534': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:59,651 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:00:59,651 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:35550': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:59,752 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:00:59,752 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:35554': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:59,758 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:00:59,759 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:35556': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:59,861 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:00:59,861 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:35566': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:59,867 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:00:59,868 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:35578': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:59,968 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:00:59,968 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:35582': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:00:59,974 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:00:59,975 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:35596': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:00,075 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:01:00,075 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:35602': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:00,081 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:01:00,081 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:35610': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:00,181 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:01:00,182 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:35616': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:00,188 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:01:00,188 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:35618': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:00,288 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:01:00,289 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:35630': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:00,295 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:01:00,295 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:35634': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:00,400 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:01:00,401 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:35642': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:00,410 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:01:00,411 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:35648': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:00,510 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:01:00,511 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:35660': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:00,520 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:01:00,521 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:35666': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:00,621 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:01:00,622 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:35670': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:00,631 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:01:00,638 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:35674': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:00,732 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:01:00,734 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:35686': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:00,743 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:01:00,744 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:35688': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:00,842 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:01:00,843 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:35698': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:00,853 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:01:00,854 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:35706': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:00,973 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:01:00,974 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:35714': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:00,981 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:01:00,981 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:35730': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:01,081 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:01:01,081 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:35736': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:01,087 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:01:01,088 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:35748': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:01,189 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:01:01,190 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:35756': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:01,196 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:01:01,196 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:35758': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:01,296 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:01:01,297 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:35774': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:01,303 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:01:01,303 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:35790': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:01,403 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:01:01,404 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:35800': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:01,410 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:01:01,410 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:35806': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:01,510 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:01:01,511 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:35814': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:01,517 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:01:01,517 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:35826': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:01,618 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:01:01,619 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:43632': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:01,624 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:01:01,624 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:43640': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:01,725 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:01:01,725 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:43650': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:01,731 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:01:01,731 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:43666': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:01,832 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:01:01,833 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:43678': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:01,839 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:01:01,839 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:43684': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:01,940 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:01:01,940 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:43690': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:01,946 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:01:01,946 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:43698': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:02,047 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:01:02,047 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:43710': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:02,053 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:01:02,053 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:43720': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:02,157 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:01:02,158 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:43732': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:02,163 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:01:02,164 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:43738': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:02,264 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:01:02,264 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:43748': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:02,270 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:01:02,271 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:43758': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:02,372 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:01:02,372 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:43774': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:02,378 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:01:02,379 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:43780': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:02,479 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:01:02,479 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:43788': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:02,485 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:01:02,486 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:43798': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:02,588 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:01:02,588 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:43802': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:02,594 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:01:02,594 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:43804': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:02,695 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:01:02,695 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:43808': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:02,701 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:01:02,702 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:43824': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:02,802 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:01:02,802 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:43834': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:02,808 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:01:02,808 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:43848': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:02,909 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:01:02,909 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:43858': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:02,915 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:01:02,916 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:43874': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:03,016 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:01:03,017 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:43884': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:03,023 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:01:03,023 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:43886': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:03,123 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:01:03,124 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:43900': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:03,130 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:01:03,133 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:43908': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:03,230 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:01:03,231 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:43910': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:03,237 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:01:03,237 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:43926': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:03,337 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:01:03,337 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:43932': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:03,343 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:01:03,343 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:43940': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:03,444 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:01:03,444 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:43954': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:03,450 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:01:03,450 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:43958': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:03,550 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:01:03,551 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:43974': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:03,557 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:01:03,557 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:43976': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:03,658 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:01:03,658 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:43980': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:03,664 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:01:03,664 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:43982': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:03,765 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:01:03,765 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:43998': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:03,771 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:01:03,771 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:44008': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:03,873 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:01:03,874 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:44012': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:03,879 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:01:03,880 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:44014': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:03,980 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:01:03,980 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:44020': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:03,986 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:01:03,986 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:44030': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:04,087 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:01:04,088 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:44042': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:04,094 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:01:04,094 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:44054': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:04,195 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:01:04,196 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:44068': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:04,201 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:01:04,201 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:44076': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:04,302 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:01:04,303 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:44082': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:04,308 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:01:04,309 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:44088': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:04,411 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:01:04,411 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:44094': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:04,417 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:01:04,417 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:44102': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:04,517 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:01:04,518 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:44106': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:04,524 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:01:04,524 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:44112': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:04,625 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:01:04,626 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:44114': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:04,631 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:01:04,634 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:44120': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:04,732 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:01:04,732 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:44130': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:04,738 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:01:04,738 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:44142': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:04,839 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:01:04,840 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:44144': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:04,845 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:01:04,846 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:44146': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:04,946 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:01:04,946 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:44162': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:04,952 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:01:04,953 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:44170': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:05,054 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:01:05,054 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:44186': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:05,060 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:01:05,060 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:44190': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:05,167 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:01:05,171 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:44206': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:05,177 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:01:05,177 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:44208': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:05,274 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:01:05,274 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:44210': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:05,283 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:01:05,283 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:44220': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:05,381 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:01:05,381 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:44236': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:05,390 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:01:05,391 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:44248': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:05,488 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:01:05,488 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:44256': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:05,496 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:01:05,497 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:44258': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:05,595 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:01:05,596 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:44262': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:05,603 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:01:05,603 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:44266': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:05,703 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:01:05,703 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:44278': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:05,709 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:01:05,709 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:44280': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:05,810 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:01:05,811 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:44294': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:05,817 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:01:05,817 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:44298': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:05,917 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:01:05,918 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:44304': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:05,923 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:01:05,924 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:44314': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:06,026 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:01:06,027 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:44322': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:06,032 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:01:06,033 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:44330': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:06,136 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:01:06,137 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:44346': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:06,142 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:01:06,143 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:44362': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:06,243 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:01:06,243 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:44370': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:06,249 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:01:06,249 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:44378': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:06,350 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:01:06,351 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:44388': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:06,356 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:01:06,357 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:44392': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:06,457 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:01:06,457 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:44408': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:06,463 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:01:06,463 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:44420': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:06,564 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:01:06,565 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:44432': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:06,570 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:01:06,571 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:44442': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:06,673 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:01:06,674 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:44456': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:06,680 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:01:06,680 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:44470': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:06,780 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:01:06,780 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:44484': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:06,786 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:01:06,786 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:44496': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:06,887 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:01:06,887 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:44500': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:06,893 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:01:06,893 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:44516': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:06,993 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:01:06,994 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:44518': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:07,000 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:01:07,000 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:44522': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:07,100 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:01:07,100 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:44536': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:07,106 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:01:07,106 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:44542': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:07,207 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:01:07,207 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:44554': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:07,213 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:01:07,213 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:44562': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:07,314 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:01:07,315 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:44570': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:07,321 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:01:07,321 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:44584': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:07,422 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:01:07,422 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:44588': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:07,429 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:01:07,430 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:44594': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:07,529 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:01:07,529 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:44608': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:07,537 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:01:07,537 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:44620': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:07,636 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:01:07,636 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:44626': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:07,644 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:01:07,644 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:44636': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:07,743 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:01:07,743 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:44652': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:07,751 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:01:07,751 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:44654': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:07,850 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:01:07,850 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:44666': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:07,857 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:01:07,858 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:44672': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:07,957 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:01:07,957 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:44688': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:07,963 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:01:07,964 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:44692': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:08,065 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:01:08,065 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:44706': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:08,071 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:01:08,071 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:44718': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:08,174 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37941 5986s 2024-11-23 22:01:08,175 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:44730': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:08,181 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37847. Reason: failure-to-start- 5986s 2024-11-23 22:01:08,181 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:01:08,181 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39201. Reason: failure-to-start- 5986s 2024-11-23 22:01:08,181 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:01:08,182 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37941': TLS handshake failed with remote 'tls://127.0.0.1:44744': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:08,184 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 13s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 5986s stream = await stream.start_tls( 5986s ^^^^^^^^^^^^^^^^^^^^^^^ 5986s False, ssl_options=ssl_options, server_hostname=host 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 13s. 5986s 2024-11-23 22:01:09,190 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:01:09,196 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39651 5986s 2024-11-23 22:01:09,197 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35173/status 5986s 2024-11-23 22:01:09,197 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:01:09,209 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45723 5986s 2024-11-23 22:01:09,209 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45723 5986s 2024-11-23 22:01:09,209 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:01:09,210 - distributed.worker - INFO - dashboard at: 127.0.0.1:38715 5986s 2024-11-23 22:01:09,210 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39651 5986s 2024-11-23 22:01:09,210 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:01:09,210 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:01:09,210 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:01:09,210 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-7pas_8cf 5986s 2024-11-23 22:01:09,210 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:01:09,211 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37137 5986s 2024-11-23 22:01:09,212 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37137 5986s 2024-11-23 22:01:09,212 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:01:09,212 - distributed.worker - INFO - dashboard at: 127.0.0.1:39429 5986s 2024-11-23 22:01:09,212 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39651 5986s 2024-11-23 22:01:09,212 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:01:09,212 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:01:09,212 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:01:09,212 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-jtlwewvs 5986s 2024-11-23 22:01:09,212 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:01:09,213 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45723. Reason: failure-to-start- 5986s 2024-11-23 22:01:09,213 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:01:09,213 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37137. Reason: failure-to-start- 5986s 2024-11-23 22:01:09,213 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:01:09,214 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39651': TLS handshake failed with remote 'tls://127.0.0.1:50674': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:01:09,214 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39651': TLS handshake failed with remote 'tls://127.0.0.1:50688': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:01:09,215 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:01:10,220 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:01:10,226 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42281 5986s 2024-11-23 22:01:10,226 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33495/status 5986s 2024-11-23 22:01:10,226 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:01:10,238 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39583 5986s 2024-11-23 22:01:10,238 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39583 5986s 2024-11-23 22:01:10,238 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:01:10,238 - distributed.worker - INFO - dashboard at: 127.0.0.1:34195 5986s 2024-11-23 22:01:10,238 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42281 5986s 2024-11-23 22:01:10,238 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:01:10,238 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:01:10,238 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:01:10,238 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-44mo9muu 5986s 2024-11-23 22:01:10,239 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:01:10,240 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39163 5986s 2024-11-23 22:01:10,240 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39163 5986s 2024-11-23 22:01:10,240 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:01:10,240 - distributed.worker - INFO - dashboard at: 127.0.0.1:37945 5986s 2024-11-23 22:01:10,241 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42281 5986s 2024-11-23 22:01:10,241 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:01:10,241 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:01:10,241 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:01:10,241 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-zgutpscd 5986s 2024-11-23 22:01:10,241 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:01:10,242 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39583. Reason: failure-to-start- 5986s 2024-11-23 22:01:10,242 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:01:10,242 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39163. Reason: failure-to-start- 5986s 2024-11-23 22:01:10,242 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:01:10,243 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42281': TLS handshake failed with remote 'tls://127.0.0.1:33562': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:01:10,243 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42281': TLS handshake failed with remote 'tls://127.0.0.1:33568': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:01:10,244 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:01:11,255 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:01:11,262 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38101 5986s 2024-11-23 22:01:11,262 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42875/status 5986s 2024-11-23 22:01:11,262 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:01:11,274 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35731 5986s 2024-11-23 22:01:11,274 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35731 5986s 2024-11-23 22:01:11,275 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:01:11,275 - distributed.worker - INFO - dashboard at: 127.0.0.1:39145 5986s 2024-11-23 22:01:11,275 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38101 5986s 2024-11-23 22:01:11,275 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:01:11,275 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:01:11,275 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:01:11,275 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-o651mq_8 5986s 2024-11-23 22:01:11,275 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:01:11,277 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37623 5986s 2024-11-23 22:01:11,277 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37623 5986s 2024-11-23 22:01:11,277 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:01:11,277 - distributed.worker - INFO - dashboard at: 127.0.0.1:33949 5986s 2024-11-23 22:01:11,277 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38101 5986s 2024-11-23 22:01:11,277 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:01:11,277 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:01:11,277 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:01:11,277 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-e0gw504l 5986s 2024-11-23 22:01:11,277 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:01:11,278 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35731. Reason: failure-to-start- 5986s 2024-11-23 22:01:11,278 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:01:11,279 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37623. Reason: failure-to-start- 5986s 2024-11-23 22:01:11,279 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:01:11,280 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38101': TLS handshake failed with remote 'tls://127.0.0.1:49274': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:01:11,280 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38101': TLS handshake failed with remote 'tls://127.0.0.1:49286': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:01:11,281 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:01:12,286 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:01:12,292 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46491 5986s 2024-11-23 22:01:12,292 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34191/status 5986s 2024-11-23 22:01:12,293 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:01:12,306 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46175 5986s 2024-11-23 22:01:12,306 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46175 5986s 2024-11-23 22:01:12,306 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:01:12,306 - distributed.worker - INFO - dashboard at: 127.0.0.1:34151 5986s 2024-11-23 22:01:12,306 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46491 5986s 2024-11-23 22:01:12,306 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:01:12,306 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:01:12,306 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:01:12,306 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-t2xmjkq7 5986s 2024-11-23 22:01:12,306 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:01:12,308 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41735 5986s 2024-11-23 22:01:12,308 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41735 5986s 2024-11-23 22:01:12,308 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:01:12,308 - distributed.worker - INFO - dashboard at: 127.0.0.1:41165 5986s 2024-11-23 22:01:12,308 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46491 5986s 2024-11-23 22:01:12,308 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:01:12,308 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:01:12,308 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:01:12,308 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-hrac4e9f 5986s 2024-11-23 22:01:12,309 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:01:12,309 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46175. Reason: failure-to-start- 5986s 2024-11-23 22:01:12,310 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:01:12,310 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41735. Reason: failure-to-start- 5986s 2024-11-23 22:01:12,310 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:01:12,311 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46491': TLS handshake failed with remote 'tls://127.0.0.1:36638': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:01:12,311 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46491': TLS handshake failed with remote 'tls://127.0.0.1:36642': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:01:12,312 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:01:13,318 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:01:13,324 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45105 5986s 2024-11-23 22:01:13,325 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40833/status 5986s 2024-11-23 22:01:13,325 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:01:13,337 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34363 5986s 2024-11-23 22:01:13,337 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34363 5986s 2024-11-23 22:01:13,337 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:01:13,337 - distributed.worker - INFO - dashboard at: 127.0.0.1:40787 5986s 2024-11-23 22:01:13,337 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45105 5986s 2024-11-23 22:01:13,337 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:01:13,337 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:01:13,337 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:01:13,337 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-nk8vfye8 5986s 2024-11-23 22:01:13,338 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:01:13,340 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46367 5986s 2024-11-23 22:01:13,341 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46367 5986s 2024-11-23 22:01:13,341 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:01:13,341 - distributed.worker - INFO - dashboard at: 127.0.0.1:42531 5986s 2024-11-23 22:01:13,341 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45105 5986s 2024-11-23 22:01:13,341 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:01:13,341 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:01:13,341 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:01:13,341 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-8ndfdb58 5986s 2024-11-23 22:01:13,341 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:01:13,342 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34363. Reason: failure-to-start- 5986s 2024-11-23 22:01:13,342 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:01:13,342 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46367. Reason: failure-to-start- 5986s 2024-11-23 22:01:13,342 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:01:13,344 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45105': TLS handshake failed with remote 'tls://127.0.0.1:51612': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:01:13,344 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45105': TLS handshake failed with remote 'tls://127.0.0.1:51622': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:01:13,345 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:01:14,350 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:01:14,356 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36627 5986s 2024-11-23 22:01:14,356 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34017/status 5986s 2024-11-23 22:01:14,357 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:01:14,369 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36143 5986s 2024-11-23 22:01:14,369 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36143 5986s 2024-11-23 22:01:14,369 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:01:14,369 - distributed.worker - INFO - dashboard at: 127.0.0.1:44247 5986s 2024-11-23 22:01:14,369 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36627 5986s 2024-11-23 22:01:14,369 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:01:14,369 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:01:14,369 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:01:14,369 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-q_15_yfa 5986s 2024-11-23 22:01:14,369 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:01:14,371 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38385 5986s 2024-11-23 22:01:14,371 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38385 5986s 2024-11-23 22:01:14,371 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:01:14,371 - distributed.worker - INFO - dashboard at: 127.0.0.1:35029 5986s 2024-11-23 22:01:14,372 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36627 5986s 2024-11-23 22:01:14,372 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:01:14,372 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:01:14,372 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:01:14,372 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-_qw49tlt 5986s 2024-11-23 22:01:14,372 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:01:14,373 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36143. Reason: failure-to-start- 5986s 2024-11-23 22:01:14,373 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:01:14,373 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38385. Reason: failure-to-start- 5986s 2024-11-23 22:01:14,373 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:01:14,374 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36627': TLS handshake failed with remote 'tls://127.0.0.1:49540': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:01:14,374 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36627': TLS handshake failed with remote 'tls://127.0.0.1:49546': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:01:14,375 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:01:15,382 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:01:15,388 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36643 5986s 2024-11-23 22:01:15,388 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38655/status 5986s 2024-11-23 22:01:15,388 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:01:15,400 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44987 5986s 2024-11-23 22:01:15,400 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44987 5986s 2024-11-23 22:01:15,400 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:01:15,400 - distributed.worker - INFO - dashboard at: 127.0.0.1:44669 5986s 2024-11-23 22:01:15,400 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36643 5986s 2024-11-23 22:01:15,400 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:01:15,400 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:01:15,400 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:01:15,400 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-vuar180a 5986s 2024-11-23 22:01:15,400 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:01:15,402 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38695 5986s 2024-11-23 22:01:15,402 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38695 5986s 2024-11-23 22:01:15,402 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:01:15,403 - distributed.worker - INFO - dashboard at: 127.0.0.1:36807 5986s 2024-11-23 22:01:15,403 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36643 5986s 2024-11-23 22:01:15,403 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:01:15,403 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:01:15,403 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:01:15,403 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-2nq8epja 5986s 2024-11-23 22:01:15,403 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:01:15,404 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44987. Reason: failure-to-start- 5986s 2024-11-23 22:01:15,404 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:01:15,404 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38695. Reason: failure-to-start- 5986s 2024-11-23 22:01:15,404 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:01:15,405 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36643': TLS handshake failed with remote 'tls://127.0.0.1:46706': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:01:15,405 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36643': TLS handshake failed with remote 'tls://127.0.0.1:46722': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:01:15,406 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:01:16,411 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:01:16,417 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35473 5986s 2024-11-23 22:01:16,418 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46143/status 5986s 2024-11-23 22:01:16,418 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:01:16,431 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42521 5986s 2024-11-23 22:01:16,431 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42521 5986s 2024-11-23 22:01:16,431 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:01:16,431 - distributed.worker - INFO - dashboard at: 127.0.0.1:42527 5986s 2024-11-23 22:01:16,431 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35473 5986s 2024-11-23 22:01:16,431 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:01:16,431 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:01:16,431 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:01:16,431 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-tuyacn6n 5986s 2024-11-23 22:01:16,432 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:01:16,433 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39971 5986s 2024-11-23 22:01:16,433 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39971 5986s 2024-11-23 22:01:16,433 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:01:16,433 - distributed.worker - INFO - dashboard at: 127.0.0.1:39605 5986s 2024-11-23 22:01:16,434 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35473 5986s 2024-11-23 22:01:16,434 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:01:16,434 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:01:16,434 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:01:16,434 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-voxvlai5 5986s 2024-11-23 22:01:16,434 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:01:16,435 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42521. Reason: failure-to-start- 5986s 2024-11-23 22:01:16,435 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:01:16,435 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39971. Reason: failure-to-start- 5986s 2024-11-23 22:01:16,435 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:01:16,436 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35473': TLS handshake failed with remote 'tls://127.0.0.1:48944': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:01:16,436 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35473': TLS handshake failed with remote 'tls://127.0.0.1:48956': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:01:16,437 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:01:17,444 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:01:17,451 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39041 5986s 2024-11-23 22:01:17,451 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38627/status 5986s 2024-11-23 22:01:17,451 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:01:17,463 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39335 5986s 2024-11-23 22:01:17,464 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39335 5986s 2024-11-23 22:01:17,464 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:01:17,464 - distributed.worker - INFO - dashboard at: 127.0.0.1:45197 5986s 2024-11-23 22:01:17,464 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39041 5986s 2024-11-23 22:01:17,464 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:01:17,464 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:01:17,464 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:01:17,464 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-_8c09dqg 5986s 2024-11-23 22:01:17,464 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:01:17,466 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35311 5986s 2024-11-23 22:01:17,467 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35311 5986s 2024-11-23 22:01:17,467 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:01:17,467 - distributed.worker - INFO - dashboard at: 127.0.0.1:34173 5986s 2024-11-23 22:01:17,467 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39041 5986s 2024-11-23 22:01:17,467 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:01:17,467 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:01:17,467 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:01:17,467 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-uyobvnsy 5986s 2024-11-23 22:01:17,467 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:01:17,468 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39335. Reason: failure-to-start- 5986s 2024-11-23 22:01:17,468 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:01:17,469 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35311. Reason: failure-to-start- 5986s 2024-11-23 22:01:17,469 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:01:17,470 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39041': TLS handshake failed with remote 'tls://127.0.0.1:49726': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:01:17,470 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39041': TLS handshake failed with remote 'tls://127.0.0.1:49734': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:01:17,471 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:01:18,478 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:01:18,483 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43471 5986s 2024-11-23 22:01:18,484 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43861/status 5986s 2024-11-23 22:01:18,484 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:01:18,496 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39599 5986s 2024-11-23 22:01:18,496 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39599 5986s 2024-11-23 22:01:18,496 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:01:18,497 - distributed.worker - INFO - dashboard at: 127.0.0.1:35577 5986s 2024-11-23 22:01:18,497 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43471 5986s 2024-11-23 22:01:18,497 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:01:18,497 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:01:18,497 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:01:18,497 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-0c9qr_8e 5986s 2024-11-23 22:01:18,497 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:01:18,499 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46187 5986s 2024-11-23 22:01:18,499 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46187 5986s 2024-11-23 22:01:18,499 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:01:18,499 - distributed.worker - INFO - dashboard at: 127.0.0.1:33029 5986s 2024-11-23 22:01:18,499 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43471 5986s 2024-11-23 22:01:18,499 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:01:18,499 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:01:18,499 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:01:18,499 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-_igtwm01 5986s 2024-11-23 22:01:18,499 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:01:18,500 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39599. Reason: failure-to-start- 5986s 2024-11-23 22:01:18,500 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:01:18,501 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46187. Reason: failure-to-start- 5986s 2024-11-23 22:01:18,501 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:01:18,502 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43471': TLS handshake failed with remote 'tls://127.0.0.1:58854': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:01:18,502 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43471': TLS handshake failed with remote 'tls://127.0.0.1:58866': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:01:18,503 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:01:19,509 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:01:19,515 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34449 5986s 2024-11-23 22:01:19,515 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37389/status 5986s 2024-11-23 22:01:19,515 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:01:19,527 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40929 5986s 2024-11-23 22:01:19,527 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40929 5986s 2024-11-23 22:01:19,527 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:01:19,527 - distributed.worker - INFO - dashboard at: 127.0.0.1:34065 5986s 2024-11-23 22:01:19,527 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34449 5986s 2024-11-23 22:01:19,528 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:01:19,528 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:01:19,528 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:01:19,528 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-w6ryl01m 5986s 2024-11-23 22:01:19,528 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:01:19,530 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36533 5986s 2024-11-23 22:01:19,530 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36533 5986s 2024-11-23 22:01:19,530 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:01:19,530 - distributed.worker - INFO - dashboard at: 127.0.0.1:37509 5986s 2024-11-23 22:01:19,530 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34449 5986s 2024-11-23 22:01:19,530 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:01:19,530 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:01:19,530 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:01:19,530 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-l6h6ch0c 5986s 2024-11-23 22:01:19,530 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:01:19,531 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40929. Reason: failure-to-start- 5986s 2024-11-23 22:01:19,531 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:01:19,532 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36533. Reason: failure-to-start- 5986s 2024-11-23 22:01:19,532 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:01:19,533 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34449': TLS handshake failed with remote 'tls://127.0.0.1:43086': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:01:19,533 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34449': TLS handshake failed with remote 'tls://127.0.0.1:43098': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:01:19,534 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:01:20,540 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:01:20,546 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35235 5986s 2024-11-23 22:01:20,546 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43585/status 5986s 2024-11-23 22:01:20,547 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:01:20,560 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35621 5986s 2024-11-23 22:01:20,560 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35621 5986s 2024-11-23 22:01:20,560 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:01:20,560 - distributed.worker - INFO - dashboard at: 127.0.0.1:34041 5986s 2024-11-23 22:01:20,560 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35235 5986s 2024-11-23 22:01:20,560 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:01:20,560 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:01:20,560 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:01:20,560 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-dmyig4cu 5986s 2024-11-23 22:01:20,560 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:01:20,562 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40703 5986s 2024-11-23 22:01:20,562 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40703 5986s 2024-11-23 22:01:20,562 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:01:20,562 - distributed.worker - INFO - dashboard at: 127.0.0.1:38537 5986s 2024-11-23 22:01:20,562 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35235 5986s 2024-11-23 22:01:20,562 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:01:20,562 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:01:20,562 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:01:20,562 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-yx6jk0e5 5986s 2024-11-23 22:01:20,563 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:01:20,564 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35621. Reason: failure-to-start- 5986s 2024-11-23 22:01:20,564 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:01:20,564 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40703. Reason: failure-to-start- 5986s 2024-11-23 22:01:20,564 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:01:20,565 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35235': TLS handshake failed with remote 'tls://127.0.0.1:51880': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:01:20,565 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35235': TLS handshake failed with remote 'tls://127.0.0.1:51892': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:01:20,566 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:01:21,571 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:01:21,577 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38913 5986s 2024-11-23 22:01:21,578 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34671/status 5986s 2024-11-23 22:01:21,578 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:01:21,590 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35207 5986s 2024-11-23 22:01:21,590 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35207 5986s 2024-11-23 22:01:21,590 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:01:21,590 - distributed.worker - INFO - dashboard at: 127.0.0.1:42373 5986s 2024-11-23 22:01:21,590 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38913 5986s 2024-11-23 22:01:21,590 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:01:21,590 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:01:21,590 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:01:21,590 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-uuhylmsh 5986s 2024-11-23 22:01:21,590 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:01:21,593 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37687 5986s 2024-11-23 22:01:21,593 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37687 5986s 2024-11-23 22:01:21,593 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:01:21,593 - distributed.worker - INFO - dashboard at: 127.0.0.1:38665 5986s 2024-11-23 22:01:21,593 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38913 5986s 2024-11-23 22:01:21,593 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:01:21,593 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:01:21,593 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:01:21,593 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ku3uiru9 5986s 2024-11-23 22:01:21,593 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:01:21,594 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35207. Reason: failure-to-start- 5986s 2024-11-23 22:01:21,594 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:01:21,595 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37687. Reason: failure-to-start- 5986s 2024-11-23 22:01:21,595 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:01:21,596 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38913': TLS handshake failed with remote 'tls://127.0.0.1:60266': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:01:21,596 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38913': TLS handshake failed with remote 'tls://127.0.0.1:60280': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:01:21,597 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:01:22,603 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:01:22,609 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37193 5986s 2024-11-23 22:01:22,609 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44525/status 5986s 2024-11-23 22:01:22,610 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:01:22,622 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42341 5986s 2024-11-23 22:01:22,622 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42341 5986s 2024-11-23 22:01:22,622 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:01:22,622 - distributed.worker - INFO - dashboard at: 127.0.0.1:42149 5986s 2024-11-23 22:01:22,622 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37193 5986s 2024-11-23 22:01:22,622 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:01:22,622 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:01:22,622 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:01:22,622 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-r3l1btka 5986s 2024-11-23 22:01:22,622 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:01:22,624 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44081 5986s 2024-11-23 22:01:22,624 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44081 5986s 2024-11-23 22:01:22,624 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:01:22,624 - distributed.worker - INFO - dashboard at: 127.0.0.1:33351 5986s 2024-11-23 22:01:22,624 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37193 5986s 2024-11-23 22:01:22,624 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:01:22,624 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:01:22,624 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:01:22,624 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-48bjshg8 5986s 2024-11-23 22:01:22,624 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:01:22,625 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42341. Reason: failure-to-start- 5986s 2024-11-23 22:01:22,625 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:01:22,627 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44081. Reason: failure-to-start- 5986s 2024-11-23 22:01:22,627 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:01:22,628 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37193': TLS handshake failed with remote 'tls://127.0.0.1:37642': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:01:22,628 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37193': TLS handshake failed with remote 'tls://127.0.0.1:37648': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:01:22,631 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:01:23,636 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:01:23,641 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40353 5986s 2024-11-23 22:01:23,642 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36147/status 5986s 2024-11-23 22:01:23,642 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:01:23,653 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33349 5986s 2024-11-23 22:01:23,653 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33349 5986s 2024-11-23 22:01:23,653 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:01:23,653 - distributed.worker - INFO - dashboard at: 127.0.0.1:35557 5986s 2024-11-23 22:01:23,653 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40353 5986s 2024-11-23 22:01:23,653 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:01:23,653 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:01:23,653 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:01:23,653 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-9znv8tzm 5986s 2024-11-23 22:01:23,653 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:01:23,655 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34163 5986s 2024-11-23 22:01:23,655 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34163 5986s 2024-11-23 22:01:23,655 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:01:23,655 - distributed.worker - INFO - dashboard at: 127.0.0.1:44915 5986s 2024-11-23 22:01:23,655 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40353 5986s 2024-11-23 22:01:23,655 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:01:23,655 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:01:23,655 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:01:23,655 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-rwx6it76 5986s 2024-11-23 22:01:23,655 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:01:23,656 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33349. Reason: failure-to-start- 5986s 2024-11-23 22:01:23,656 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:01:23,657 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34163. Reason: failure-to-start- 5986s 2024-11-23 22:01:23,657 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:01:23,658 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40353': TLS handshake failed with remote 'tls://127.0.0.1:37908': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:01:23,658 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40353': TLS handshake failed with remote 'tls://127.0.0.1:37922': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:01:23,659 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:01:24,663 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:01:24,670 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42509 5986s 2024-11-23 22:01:24,670 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36629/status 5986s 2024-11-23 22:01:24,670 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:01:24,683 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41223 5986s 2024-11-23 22:01:24,683 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41223 5986s 2024-11-23 22:01:24,683 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:01:24,683 - distributed.worker - INFO - dashboard at: 127.0.0.1:45307 5986s 2024-11-23 22:01:24,683 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42509 5986s 2024-11-23 22:01:24,683 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:01:24,683 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:01:24,683 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:01:24,683 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-2qv_dwvv 5986s 2024-11-23 22:01:24,683 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:01:24,685 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41737 5986s 2024-11-23 22:01:24,685 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41737 5986s 2024-11-23 22:01:24,685 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:01:24,685 - distributed.worker - INFO - dashboard at: 127.0.0.1:36091 5986s 2024-11-23 22:01:24,685 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42509 5986s 2024-11-23 22:01:24,685 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:01:24,685 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:01:24,685 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:01:24,685 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-v3hfidnp 5986s 2024-11-23 22:01:24,685 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:01:24,686 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41223. Reason: failure-to-start- 5986s 2024-11-23 22:01:24,686 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:01:24,687 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41737. Reason: failure-to-start- 5986s 2024-11-23 22:01:24,687 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:01:24,688 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42509': TLS handshake failed with remote 'tls://127.0.0.1:43790': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:01:24,688 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42509': TLS handshake failed with remote 'tls://127.0.0.1:43802': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:01:24,689 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:01:25,694 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:01:25,699 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44065 5986s 2024-11-23 22:01:25,700 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33349/status 5986s 2024-11-23 22:01:25,700 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:01:25,713 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42581 5986s 2024-11-23 22:01:25,713 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42581 5986s 2024-11-23 22:01:25,713 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:01:25,713 - distributed.worker - INFO - dashboard at: 127.0.0.1:45947 5986s 2024-11-23 22:01:25,713 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44065 5986s 2024-11-23 22:01:25,713 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:01:25,713 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:01:25,713 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:01:25,713 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-d87zugyn 5986s 2024-11-23 22:01:25,713 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:01:25,715 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43113 5986s 2024-11-23 22:01:25,715 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43113 5986s 2024-11-23 22:01:25,715 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:01:25,715 - distributed.worker - INFO - dashboard at: 127.0.0.1:42583 5986s 2024-11-23 22:01:25,715 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44065 5986s 2024-11-23 22:01:25,715 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:01:25,715 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:01:25,715 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:01:25,716 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-lzl87y0t 5986s 2024-11-23 22:01:25,716 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:01:25,716 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42581. Reason: failure-to-start- 5986s 2024-11-23 22:01:25,717 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:01:25,717 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43113. Reason: failure-to-start- 5986s 2024-11-23 22:01:25,717 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:01:25,718 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44065': TLS handshake failed with remote 'tls://127.0.0.1:53420': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:01:25,718 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44065': TLS handshake failed with remote 'tls://127.0.0.1:53432': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:01:25,719 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:01:26,726 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:01:26,732 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33857 5986s 2024-11-23 22:01:26,732 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42505/status 5986s 2024-11-23 22:01:26,733 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:01:26,756 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42993 5986s 2024-11-23 22:01:26,756 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42993 5986s 2024-11-23 22:01:26,756 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:01:26,756 - distributed.worker - INFO - dashboard at: 127.0.0.1:45409 5986s 2024-11-23 22:01:26,756 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33857 5986s 2024-11-23 22:01:26,756 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:01:26,756 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:01:26,757 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:01:26,757 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-yn42592j 5986s 2024-11-23 22:01:26,757 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:01:26,758 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36957 5986s 2024-11-23 22:01:26,758 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36957 5986s 2024-11-23 22:01:26,759 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:01:26,759 - distributed.worker - INFO - dashboard at: 127.0.0.1:40899 5986s 2024-11-23 22:01:26,759 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33857 5986s 2024-11-23 22:01:26,759 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:01:26,759 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:01:26,759 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:01:26,759 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-nuwzyy7c 5986s 2024-11-23 22:01:26,759 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:01:26,760 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42993. Reason: failure-to-start- 5986s 2024-11-23 22:01:26,760 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:01:26,760 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36957. Reason: failure-to-start- 5986s 2024-11-23 22:01:26,760 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:01:26,761 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33857': TLS handshake failed with remote 'tls://127.0.0.1:39018': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:01:26,762 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33857': TLS handshake failed with remote 'tls://127.0.0.1:39030': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:01:26,763 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:01:27,768 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:01:27,774 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41537 5986s 2024-11-23 22:01:27,774 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:32969/status 5986s 2024-11-23 22:01:27,775 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:01:27,786 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38389 5986s 2024-11-23 22:01:27,786 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38389 5986s 2024-11-23 22:01:27,786 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:01:27,786 - distributed.worker - INFO - dashboard at: 127.0.0.1:43485 5986s 2024-11-23 22:01:27,786 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41537 5986s 2024-11-23 22:01:27,786 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:01:27,786 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:01:27,786 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:01:27,786 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-1h0sl6n2 5986s 2024-11-23 22:01:27,786 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:01:27,788 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40317 5986s 2024-11-23 22:01:27,788 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40317 5986s 2024-11-23 22:01:27,788 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:01:27,788 - distributed.worker - INFO - dashboard at: 127.0.0.1:37487 5986s 2024-11-23 22:01:27,788 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41537 5986s 2024-11-23 22:01:27,788 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:01:27,788 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:01:27,789 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:01:27,789 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-myv2poi1 5986s 2024-11-23 22:01:27,789 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:01:27,790 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38389. Reason: failure-to-start- 5986s 2024-11-23 22:01:27,790 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:01:27,790 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40317. Reason: failure-to-start- 5986s 2024-11-23 22:01:27,790 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:01:27,791 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41537': TLS handshake failed with remote 'tls://127.0.0.1:42578': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:01:27,791 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41537': TLS handshake failed with remote 'tls://127.0.0.1:42584': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:01:27,792 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:01:28,800 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:01:28,807 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37483 5986s 2024-11-23 22:01:28,807 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38829/status 5986s 2024-11-23 22:01:28,807 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:01:28,819 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46723 5986s 2024-11-23 22:01:28,819 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46723 5986s 2024-11-23 22:01:28,819 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:01:28,819 - distributed.worker - INFO - dashboard at: 127.0.0.1:35387 5986s 2024-11-23 22:01:28,819 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37483 5986s 2024-11-23 22:01:28,819 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:01:28,819 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:01:28,819 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:01:28,820 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-kpbllzg9 5986s 2024-11-23 22:01:28,820 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:01:28,821 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46345 5986s 2024-11-23 22:01:28,821 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46345 5986s 2024-11-23 22:01:28,821 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:01:28,821 - distributed.worker - INFO - dashboard at: 127.0.0.1:39191 5986s 2024-11-23 22:01:28,821 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37483 5986s 2024-11-23 22:01:28,821 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:01:28,821 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:01:28,821 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:01:28,822 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-dzy8mxh9 5986s 2024-11-23 22:01:28,822 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:01:28,822 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46723. Reason: failure-to-start- 5986s 2024-11-23 22:01:28,823 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:01:28,823 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46345. Reason: failure-to-start- 5986s 2024-11-23 22:01:28,823 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:01:28,824 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37483': TLS handshake failed with remote 'tls://127.0.0.1:48838': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:01:28,824 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37483': TLS handshake failed with remote 'tls://127.0.0.1:48852': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:01:28,825 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:01:29,831 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:01:29,836 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38745 5986s 2024-11-23 22:01:29,837 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46543/status 5986s 2024-11-23 22:01:29,837 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:01:29,850 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45341 5986s 2024-11-23 22:01:29,850 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45341 5986s 2024-11-23 22:01:29,851 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:01:29,851 - distributed.worker - INFO - dashboard at: 127.0.0.1:46471 5986s 2024-11-23 22:01:29,851 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38745 5986s 2024-11-23 22:01:29,851 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:01:29,851 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:01:29,851 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:01:29,851 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-89g73y74 5986s 2024-11-23 22:01:29,851 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:01:29,853 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46435 5986s 2024-11-23 22:01:29,853 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46435 5986s 2024-11-23 22:01:29,853 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:01:29,853 - distributed.worker - INFO - dashboard at: 127.0.0.1:41425 5986s 2024-11-23 22:01:29,853 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38745 5986s 2024-11-23 22:01:29,853 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:01:29,853 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:01:29,853 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:01:29,853 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-necupvha 5986s 2024-11-23 22:01:29,853 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:01:29,854 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45341. Reason: failure-to-start- 5986s 2024-11-23 22:01:29,854 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:01:29,855 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46435. Reason: failure-to-start- 5986s 2024-11-23 22:01:29,855 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:01:29,856 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38745': TLS handshake failed with remote 'tls://127.0.0.1:51474': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:01:29,856 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38745': TLS handshake failed with remote 'tls://127.0.0.1:51476': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:01:29,857 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:01:30,862 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:01:30,868 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35617 5986s 2024-11-23 22:01:30,868 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42289/status 5986s 2024-11-23 22:01:30,868 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:01:30,881 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46733 5986s 2024-11-23 22:01:30,881 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46733 5986s 2024-11-23 22:01:30,881 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:01:30,882 - distributed.worker - INFO - dashboard at: 127.0.0.1:36235 5986s 2024-11-23 22:01:30,882 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35617 5986s 2024-11-23 22:01:30,882 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:01:30,882 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:01:30,882 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:01:30,882 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-civaeyuz 5986s 2024-11-23 22:01:30,882 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:01:30,885 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33733 5986s 2024-11-23 22:01:30,885 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33733 5986s 2024-11-23 22:01:30,885 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:01:30,885 - distributed.worker - INFO - dashboard at: 127.0.0.1:36455 5986s 2024-11-23 22:01:30,885 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35617 5986s 2024-11-23 22:01:30,885 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:01:30,885 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:01:30,885 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:01:30,885 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-59x5skof 5986s 2024-11-23 22:01:30,885 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:01:30,887 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46733. Reason: failure-to-start- 5986s 2024-11-23 22:01:30,887 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:01:30,887 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33733. Reason: failure-to-start- 5986s 2024-11-23 22:01:30,887 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:01:30,888 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35617': TLS handshake failed with remote 'tls://127.0.0.1:48798': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:01:30,888 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35617': TLS handshake failed with remote 'tls://127.0.0.1:48808': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:01:30,892 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:01:31,897 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:01:31,905 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43487 5986s 2024-11-23 22:01:31,906 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36507/status 5986s 2024-11-23 22:01:31,906 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:01:31,920 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46697 5986s 2024-11-23 22:01:31,921 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46697 5986s 2024-11-23 22:01:31,921 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:01:31,921 - distributed.worker - INFO - dashboard at: 127.0.0.1:37839 5986s 2024-11-23 22:01:31,921 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43487 5986s 2024-11-23 22:01:31,921 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:01:31,921 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:01:31,921 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:01:31,921 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-3lyblnvf 5986s 2024-11-23 22:01:31,921 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:01:31,923 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41737 5986s 2024-11-23 22:01:31,923 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41737 5986s 2024-11-23 22:01:31,923 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:01:31,923 - distributed.worker - INFO - dashboard at: 127.0.0.1:34115 5986s 2024-11-23 22:01:31,923 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43487 5986s 2024-11-23 22:01:31,923 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:01:31,923 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:01:31,924 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:01:31,924 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-o9fl8qdz 5986s 2024-11-23 22:01:31,924 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:01:31,929 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46697. Reason: failure-to-start- 5986s 2024-11-23 22:01:31,929 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:01:31,929 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41737. Reason: failure-to-start- 5986s 2024-11-23 22:01:31,929 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:01:31,931 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43487': TLS handshake failed with remote 'tls://127.0.0.1:36816': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:01:31,931 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43487': TLS handshake failed with remote 'tls://127.0.0.1:36824': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:01:31,932 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:01:32,937 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:01:32,944 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46119 5986s 2024-11-23 22:01:32,945 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39973/status 5986s 2024-11-23 22:01:32,945 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:01:32,959 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45367 5986s 2024-11-23 22:01:32,960 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45367 5986s 2024-11-23 22:01:32,960 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:01:32,960 - distributed.worker - INFO - dashboard at: 127.0.0.1:44397 5986s 2024-11-23 22:01:32,960 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46119 5986s 2024-11-23 22:01:32,960 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:01:32,960 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:01:32,960 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:01:32,960 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-7yddlbjg 5986s 2024-11-23 22:01:32,960 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:01:32,962 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42583 5986s 2024-11-23 22:01:32,962 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42583 5986s 2024-11-23 22:01:32,962 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:01:32,962 - distributed.worker - INFO - dashboard at: 127.0.0.1:33715 5986s 2024-11-23 22:01:32,962 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46119 5986s 2024-11-23 22:01:32,962 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:01:32,962 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:01:32,962 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:01:32,962 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-xduz66lm 5986s 2024-11-23 22:01:32,962 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:01:32,966 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45367. Reason: failure-to-start- 5986s 2024-11-23 22:01:32,966 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:01:32,966 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42583. Reason: failure-to-start- 5986s 2024-11-23 22:01:32,967 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:01:32,968 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46119': TLS handshake failed with remote 'tls://127.0.0.1:49836': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:01:32,968 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46119': TLS handshake failed with remote 'tls://127.0.0.1:49850': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:01:32,969 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:01:33,976 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:01:33,983 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33049 5986s 2024-11-23 22:01:33,983 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46129/status 5986s 2024-11-23 22:01:33,983 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:01:33,996 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46167 5986s 2024-11-23 22:01:33,996 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46167 5986s 2024-11-23 22:01:33,997 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:01:33,997 - distributed.worker - INFO - dashboard at: 127.0.0.1:41505 5986s 2024-11-23 22:01:33,997 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33049 5986s 2024-11-23 22:01:33,997 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:01:33,997 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:01:33,997 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:01:33,997 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-tpvvhgbg 5986s 2024-11-23 22:01:33,997 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:01:33,999 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44733 5986s 2024-11-23 22:01:33,999 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44733 5986s 2024-11-23 22:01:33,999 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:01:33,999 - distributed.worker - INFO - dashboard at: 127.0.0.1:33829 5986s 2024-11-23 22:01:33,999 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33049 5986s 2024-11-23 22:01:33,999 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:01:33,999 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:01:33,999 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:01:33,999 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-r98aoyaa 5986s 2024-11-23 22:01:33,999 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:01:34,002 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46167. Reason: failure-to-start- 5986s 2024-11-23 22:01:34,002 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:01:34,003 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44733. Reason: failure-to-start- 5986s 2024-11-23 22:01:34,003 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:01:34,004 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33049': TLS handshake failed with remote 'tls://127.0.0.1:38742': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:01:34,004 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33049': TLS handshake failed with remote 'tls://127.0.0.1:38746': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:01:34,006 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:01:35,011 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:01:35,017 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42381 5986s 2024-11-23 22:01:35,017 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38975/status 5986s 2024-11-23 22:01:35,017 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:01:35,044 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45349 5986s 2024-11-23 22:01:35,044 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45349 5986s 2024-11-23 22:01:35,044 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:01:35,044 - distributed.worker - INFO - dashboard at: 127.0.0.1:36947 5986s 2024-11-23 22:01:35,044 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42381 5986s 2024-11-23 22:01:35,044 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:01:35,044 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:01:35,044 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:01:35,044 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-4_gdojkj 5986s 2024-11-23 22:01:35,044 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:01:35,046 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45649 5986s 2024-11-23 22:01:35,046 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45649 5986s 2024-11-23 22:01:35,046 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:01:35,046 - distributed.worker - INFO - dashboard at: 127.0.0.1:32847 5986s 2024-11-23 22:01:35,046 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42381 5986s 2024-11-23 22:01:35,047 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:01:35,047 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:01:35,047 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:01:35,047 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-77eybfjx 5986s 2024-11-23 22:01:35,047 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:01:35,048 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45349. Reason: failure-to-start- 5986s 2024-11-23 22:01:35,048 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:01:35,049 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45649. Reason: failure-to-start- 5986s 2024-11-23 22:01:35,049 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:01:35,052 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42381': TLS handshake failed with remote 'tls://127.0.0.1:59174': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:01:35,052 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42381': TLS handshake failed with remote 'tls://127.0.0.1:59188': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:01:35,053 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:01:36,058 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:01:36,065 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37163 5986s 2024-11-23 22:01:36,065 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33061/status 5986s 2024-11-23 22:01:36,065 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:01:36,078 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42879 5986s 2024-11-23 22:01:36,078 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42879 5986s 2024-11-23 22:01:36,079 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:01:36,079 - distributed.worker - INFO - dashboard at: 127.0.0.1:38949 5986s 2024-11-23 22:01:36,079 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37163 5986s 2024-11-23 22:01:36,079 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:01:36,079 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:01:36,079 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:01:36,079 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-8mjhr44v 5986s 2024-11-23 22:01:36,079 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:01:36,081 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44753 5986s 2024-11-23 22:01:36,081 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44753 5986s 2024-11-23 22:01:36,081 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:01:36,081 - distributed.worker - INFO - dashboard at: 127.0.0.1:34391 5986s 2024-11-23 22:01:36,081 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37163 5986s 2024-11-23 22:01:36,081 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:01:36,081 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:01:36,081 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:01:36,081 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-x23_u76p 5986s 2024-11-23 22:01:36,081 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:01:36,082 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42879. Reason: failure-to-start- 5986s 2024-11-23 22:01:36,083 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:01:36,083 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44753. Reason: failure-to-start- 5986s 2024-11-23 22:01:36,083 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:01:36,086 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37163': TLS handshake failed with remote 'tls://127.0.0.1:45014': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:01:36,086 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37163': TLS handshake failed with remote 'tls://127.0.0.1:45026': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:01:36,088 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:01:37,093 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:01:37,098 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35301 5986s 2024-11-23 22:01:37,099 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39813/status 5986s 2024-11-23 22:01:37,099 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:01:37,111 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34981 5986s 2024-11-23 22:01:37,111 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34981 5986s 2024-11-23 22:01:37,111 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:01:37,111 - distributed.worker - INFO - dashboard at: 127.0.0.1:35979 5986s 2024-11-23 22:01:37,111 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35301 5986s 2024-11-23 22:01:37,111 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:01:37,111 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:01:37,111 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:01:37,111 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-qxo11i5n 5986s 2024-11-23 22:01:37,111 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:01:37,113 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35639 5986s 2024-11-23 22:01:37,113 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35639 5986s 2024-11-23 22:01:37,113 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:01:37,113 - distributed.worker - INFO - dashboard at: 127.0.0.1:44535 5986s 2024-11-23 22:01:37,113 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35301 5986s 2024-11-23 22:01:37,113 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:01:37,114 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:01:37,114 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:01:37,114 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-bn764lys 5986s 2024-11-23 22:01:37,114 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:01:37,116 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34981. Reason: failure-to-start- 5986s 2024-11-23 22:01:37,116 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:01:37,116 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35639. Reason: failure-to-start- 5986s 2024-11-23 22:01:37,116 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:01:37,119 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35301': TLS handshake failed with remote 'tls://127.0.0.1:41274': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:01:37,120 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35301': TLS handshake failed with remote 'tls://127.0.0.1:41284': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:01:37,121 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:01:38,127 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:01:38,133 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39925 5986s 2024-11-23 22:01:38,133 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42333/status 5986s 2024-11-23 22:01:38,134 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:01:38,148 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33429 5986s 2024-11-23 22:01:38,148 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33429 5986s 2024-11-23 22:01:38,148 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:01:38,149 - distributed.worker - INFO - dashboard at: 127.0.0.1:46197 5986s 2024-11-23 22:01:38,149 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39925 5986s 2024-11-23 22:01:38,149 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:01:38,149 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:01:38,149 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:01:38,149 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-52x3zwm_ 5986s 2024-11-23 22:01:38,149 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:01:38,151 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42971 5986s 2024-11-23 22:01:38,151 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42971 5986s 2024-11-23 22:01:38,151 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:01:38,151 - distributed.worker - INFO - dashboard at: 127.0.0.1:34933 5986s 2024-11-23 22:01:38,151 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39925 5986s 2024-11-23 22:01:38,151 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:01:38,151 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:01:38,151 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:01:38,151 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-0pl5y6mm 5986s 2024-11-23 22:01:38,151 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:01:38,154 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33429. Reason: failure-to-start- 5986s 2024-11-23 22:01:38,155 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:01:38,156 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42971. Reason: failure-to-start- 5986s 2024-11-23 22:01:38,156 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:01:38,157 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39925': TLS handshake failed with remote 'tls://127.0.0.1:60354': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:01:38,157 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39925': TLS handshake failed with remote 'tls://127.0.0.1:60368': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:01:38,159 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s _________________________________ test_scatter _________________________________ 5986s 5986s fut = , timeout = 0 5986s 5986s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 5986s async with asyncio.timeout(timeout): 5986s > return await fut 5986s 5986s /usr/lib/python3/dist-packages/distributed/utils.py:1960: 5986s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5986s /usr/lib/python3/dist-packages/distributed/worker.py:1480: in start_unsafe 5986s await self._register_with_scheduler() 5986s /usr/lib/python3/dist-packages/distributed/worker.py:1179: in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s /usr/lib/python3/dist-packages/distributed/comm/core.py:342: in connect 5986s comm = await wait_for( 5986s /usr/lib/python3/dist-packages/distributed/utils.py:1960: in wait_for 5986s return await fut 5986s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:546: in connect 5986s stream = await self.client.connect( 5986s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5986s 5986s self = , host = '127.0.0.1' 5986s port = 36441, af = 5986s ssl_options = 5986s max_buffer_size = 8364507136.0, source_ip = None, source_port = None 5986s timeout = None 5986s 5986s async def connect( 5986s self, 5986s host: str, 5986s port: int, 5986s af: socket.AddressFamily = socket.AF_UNSPEC, 5986s ssl_options: Optional[Union[Dict[str, Any], ssl.SSLContext]] = None, 5986s max_buffer_size: Optional[int] = None, 5986s source_ip: Optional[str] = None, 5986s source_port: Optional[int] = None, 5986s timeout: Optional[Union[float, datetime.timedelta]] = None, 5986s ) -> IOStream: 5986s """Connect to the given host and port. 5986s 5986s Asynchronously returns an `.IOStream` (or `.SSLIOStream` if 5986s ``ssl_options`` is not None). 5986s 5986s Using the ``source_ip`` kwarg, one can specify the source 5986s IP address to use when establishing the connection. 5986s In case the user needs to resolve and 5986s use a specific interface, it has to be handled outside 5986s of Tornado as this depends very much on the platform. 5986s 5986s Raises `TimeoutError` if the input future does not complete before 5986s ``timeout``, which may be specified in any form allowed by 5986s `.IOLoop.add_timeout` (i.e. a `datetime.timedelta` or an absolute time 5986s relative to `.IOLoop.time`) 5986s 5986s Similarly, when the user requires a certain source port, it can 5986s be specified using the ``source_port`` arg. 5986s 5986s .. versionchanged:: 4.5 5986s Added the ``source_ip`` and ``source_port`` arguments. 5986s 5986s .. versionchanged:: 5.0 5986s Added the ``timeout`` argument. 5986s """ 5986s if timeout is not None: 5986s if isinstance(timeout, numbers.Real): 5986s timeout = IOLoop.current().time() + timeout 5986s elif isinstance(timeout, datetime.timedelta): 5986s timeout = IOLoop.current().time() + timeout.total_seconds() 5986s else: 5986s raise TypeError("Unsupported timeout %r" % timeout) 5986s if timeout is not None: 5986s addrinfo = await gen.with_timeout( 5986s timeout, self.resolver.resolve(host, port, af) 5986s ) 5986s else: 5986s addrinfo = await self.resolver.resolve(host, port, af) 5986s connector = _Connector( 5986s addrinfo, 5986s functools.partial( 5986s self._create_stream, 5986s max_buffer_size, 5986s source_ip=source_ip, 5986s source_port=source_port, 5986s ), 5986s ) 5986s > af, addr, stream = await connector.start(connect_timeout=timeout) 5986s E asyncio.exceptions.CancelledError 5986s 5986s /usr/lib/python3/dist-packages/tornado/tcpclient.py:279: CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s self = 5986s 5986s @final 5986s async def start(self): 5986s async with self._startup_lock: 5986s if self.status == Status.failed: 5986s assert self.__startup_exc is not None 5986s raise self.__startup_exc 5986s elif self.status != Status.init: 5986s return self 5986s timeout = getattr(self, "death_timeout", None) 5986s 5986s async def _close_on_failure(exc: Exception) -> None: 5986s await self.close(reason=f"failure-to-start-{str(type(exc))}") 5986s self.status = Status.failed 5986s self.__startup_exc = exc 5986s 5986s try: 5986s > await wait_for(self.start_unsafe(), timeout=timeout) 5986s 5986s /usr/lib/python3/dist-packages/distributed/core.py:664: 5986s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5986s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 5986s async with asyncio.timeout(timeout): 5986s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5986s 5986s self = 5986s exc_type = 5986s exc_val = CancelledError(), exc_tb = 5986s 5986s async def __aexit__( 5986s self, 5986s exc_type: Optional[Type[BaseException]], 5986s exc_val: Optional[BaseException], 5986s exc_tb: Optional[TracebackType], 5986s ) -> Optional[bool]: 5986s assert self._state in (_State.ENTERED, _State.EXPIRING) 5986s 5986s if self._timeout_handler is not None: 5986s self._timeout_handler.cancel() 5986s self._timeout_handler = None 5986s 5986s if self._state is _State.EXPIRING: 5986s self._state = _State.EXPIRED 5986s 5986s if self._task.uncancel() <= self._cancelling and exc_type is not None: 5986s # Since there are no new cancel requests, we're 5986s # handling this. 5986s if issubclass(exc_type, exceptions.CancelledError): 5986s > raise TimeoutError from exc_val 5986s E TimeoutError 5986s 5986s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s @contextlib.asynccontextmanager 5986s async def _cluster_factory(): 5986s workers = [] 5986s s = None 5986s try: 5986s for _ in range(60): 5986s try: 5986s > s, ws = await start_cluster( 5986s nthreads, 5986s scheduler, 5986s security=security, 5986s Worker=Worker, 5986s scheduler_kwargs=scheduler_kwargs, 5986s worker_kwargs=merge( 5986s {"death_timeout": min(15, int(deadline.remaining))}, 5986s worker_kwargs, 5986s ), 5986s ) 5986s 5986s /usr/lib/python3/dist-packages/distributed/utils_test.py:966: 5986s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5986s /usr/lib/python3/dist-packages/distributed/utils_test.py:789: in start_cluster 5986s await asyncio.gather(*workers) 5986s /usr/lib/python3.13/asyncio/tasks.py:737: in _wrap_awaitable 5986s return await awaitable 5986s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5986s 5986s self = 5986s 5986s @final 5986s async def start(self): 5986s async with self._startup_lock: 5986s if self.status == Status.failed: 5986s assert self.__startup_exc is not None 5986s raise self.__startup_exc 5986s elif self.status != Status.init: 5986s return self 5986s timeout = getattr(self, "death_timeout", None) 5986s 5986s async def _close_on_failure(exc: Exception) -> None: 5986s await self.close(reason=f"failure-to-start-{str(type(exc))}") 5986s self.status = Status.failed 5986s self.__startup_exc = exc 5986s 5986s try: 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s except asyncio.TimeoutError as exc: 5986s await _close_on_failure(exc) 5986s > raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s E TimeoutError: Worker start timed out after 0s. 5986s 5986s /usr/lib/python3/dist-packages/distributed/core.py:667: TimeoutError 5986s 5986s During handling of the above exception, another exception occurred: 5986s 5986s fut = ._..test_func..async_fn at 0xde81a110> 5986s timeout = 60 5986s 5986s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 5986s async with asyncio.timeout(timeout): 5986s > return await fut 5986s 5986s /usr/lib/python3/dist-packages/distributed/utils.py:1960: 5986s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5986s /usr/lib/python3/dist-packages/distributed/utils_test.py:999: in async_fn 5986s _cluster_factory() as (s, workers), 5986s /usr/lib/python3.13/contextlib.py:214: in __aenter__ 5986s return await anext(self.gen) 5986s /usr/lib/python3/dist-packages/distributed/utils_test.py:983: in _cluster_factory 5986s await asyncio.sleep(1) 5986s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5986s 5986s delay = 1, result = None 5986s 5986s async def sleep(delay, result=None): 5986s """Coroutine that completes after a given time (in seconds).""" 5986s if delay <= 0: 5986s await __sleep0() 5986s return result 5986s 5986s if math.isnan(delay): 5986s raise ValueError("Invalid delay: NaN (not a number)") 5986s 5986s loop = events.get_running_loop() 5986s future = loop.create_future() 5986s h = loop.call_later(delay, 5986s futures._set_result_unless_cancelled, 5986s future, result) 5986s try: 5986s > return await future 5986s E asyncio.exceptions.CancelledError 5986s 5986s /usr/lib/python3.13/asyncio/tasks.py:718: CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s args = (), kwds = {} 5986s 5986s @wraps(func) 5986s def inner(*args, **kwds): 5986s with self._recreate_cm(): 5986s > return func(*args, **kwds) 5986s 5986s /usr/lib/python3.13/contextlib.py:85: 5986s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5986s /usr/lib/python3.13/contextlib.py:85: in inner 5986s return func(*args, **kwds) 5986s /usr/lib/python3/dist-packages/distributed/utils_test.py:1102: in test_func 5986s return _run_and_close_tornado(async_fn_outer) 5986s /usr/lib/python3/dist-packages/distributed/utils_test.py:378: in _run_and_close_tornado 5986s return asyncio_run(inner_fn(), loop_factory=get_loop_factory()) 5986s /usr/lib/python3.13/asyncio/runners.py:194: in run 5986s return runner.run(main) 5986s /usr/lib/python3.13/asyncio/runners.py:118: in run 5986s return self._loop.run_until_complete(task) 5986s /usr/lib/python3.13/asyncio/base_events.py:720: in run_until_complete 5986s return future.result() 5986s /usr/lib/python3/dist-packages/distributed/utils_test.py:375: in inner_fn 5986s return await async_fn(*args, **kwargs) 5986s /usr/lib/python3/dist-packages/distributed/utils_test.py:1099: in async_fn_outer 5986s return await utils_wait_for(async_fn(), timeout=timeout * 2) 5986s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 5986s async with asyncio.timeout(timeout): 5986s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5986s 5986s self = 5986s exc_type = 5986s exc_val = CancelledError(), exc_tb = 5986s 5986s async def __aexit__( 5986s self, 5986s exc_type: Optional[Type[BaseException]], 5986s exc_val: Optional[BaseException], 5986s exc_tb: Optional[TracebackType], 5986s ) -> Optional[bool]: 5986s assert self._state in (_State.ENTERED, _State.EXPIRING) 5986s 5986s if self._timeout_handler is not None: 5986s self._timeout_handler.cancel() 5986s self._timeout_handler = None 5986s 5986s if self._state is _State.EXPIRING: 5986s self._state = _State.EXPIRED 5986s 5986s if self._task.uncancel() <= self._cancelling and exc_type is not None: 5986s # Since there are no new cancel requests, we're 5986s # handling this. 5986s if issubclass(exc_type, exceptions.CancelledError): 5986s > raise TimeoutError from exc_val 5986s E TimeoutError 5986s 5986s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 5986s ----------------------------- Captured stderr call ----------------------------- 5986s 2024-11-23 22:01:39,595 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:01:39,601 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:39,601 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46557/status 5986s 2024-11-23 22:01:39,602 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:01:39,613 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:32819 5986s 2024-11-23 22:01:39,613 - distributed.worker - INFO - Listening to: tls://127.0.0.1:32819 5986s 2024-11-23 22:01:39,613 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:01:39,614 - distributed.worker - INFO - dashboard at: 127.0.0.1:35781 5986s 2024-11-23 22:01:39,614 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:39,614 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:01:39,614 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:01:39,614 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:01:39,614 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-d50urjgn 5986s 2024-11-23 22:01:39,614 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:01:39,616 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:32851 5986s 2024-11-23 22:01:39,616 - distributed.worker - INFO - Listening to: tls://127.0.0.1:32851 5986s 2024-11-23 22:01:39,616 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:01:39,616 - distributed.worker - INFO - dashboard at: 127.0.0.1:33111 5986s 2024-11-23 22:01:39,616 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:39,616 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:01:39,616 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:01:39,616 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:01:39,616 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-k5wqylyj 5986s 2024-11-23 22:01:39,616 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:01:39,637 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:39,637 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:39,637 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:34536': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:39,637 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:34552': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:39,749 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:39,749 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:39,750 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:34562': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:39,750 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:34568': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:39,862 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:39,862 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:39,863 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:34582': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:39,863 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:34590': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:39,976 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:39,976 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:39,976 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:34596': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:39,977 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:34610': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:40,089 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:40,089 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:40,089 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:34614': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:40,089 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:34616': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:40,201 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:40,202 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:40,202 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:34618': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:40,202 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:34626': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:40,314 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:40,314 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:40,315 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:34628': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:40,315 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:34642': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:40,426 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:40,426 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:40,426 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:34656': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:40,427 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:34670': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:40,539 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:40,539 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:40,539 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:34672': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:40,539 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:34686': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:40,651 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:40,651 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:40,652 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:34696': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:40,652 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:34702': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:40,764 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:40,764 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:40,764 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:34708': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:40,764 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:34720': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:40,875 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:40,875 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:40,876 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:34730': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:40,876 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:34740': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:40,987 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:40,988 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:40,988 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:34746': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:40,988 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:34760': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:41,100 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:41,100 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:41,100 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:34768': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:41,100 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:34776': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:41,212 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:41,212 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:41,213 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:34792': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:41,213 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:34796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:41,324 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:41,325 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:41,325 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:34802': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:41,325 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:34818': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:41,437 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:41,437 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:41,437 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:34824': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:41,438 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:34828': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:41,549 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:41,550 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:41,550 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:34114': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:41,550 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:34126': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:41,661 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:41,662 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:41,662 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:34142': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:41,662 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:34150': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:41,774 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:41,774 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:41,775 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:34166': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:41,775 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:34176': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:41,887 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:41,887 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:41,887 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:34180': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:41,887 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:34196': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:41,999 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:41,999 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:42,000 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:34210': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:42,000 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:34218': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:42,115 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:42,115 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:42,115 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:34232': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:42,115 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:34236': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:42,227 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:42,227 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:42,228 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:34248': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:42,228 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:34258': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:42,341 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:42,341 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:42,341 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:34270': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:42,342 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:34280': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:42,454 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:42,454 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:42,455 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:34286': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:42,455 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:34300': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:42,567 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:42,567 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:42,568 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:34316': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:42,568 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:34324': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:42,679 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:42,680 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:42,680 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:34340': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:42,680 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:34342': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:42,792 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:42,792 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:42,792 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:34352': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:42,792 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:34366': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:42,905 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:42,905 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:42,905 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:34368': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:42,905 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:34382': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:43,016 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:43,017 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:43,017 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:34396': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:43,017 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:34404': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:43,128 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:43,129 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:43,129 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:34410': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:43,129 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:34424': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:43,242 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:43,242 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:43,242 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:34432': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:43,242 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:34446': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:43,356 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:43,356 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:43,356 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:34460': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:43,356 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:34474': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:43,468 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:43,468 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:43,469 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:34486': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:43,469 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:34492': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:43,580 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:43,581 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:43,581 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:34506': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:43,581 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:34510': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:43,693 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:43,693 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:43,693 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:34518': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:43,693 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:34532': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:43,805 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:43,805 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:43,806 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:34542': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:43,806 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:34550': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:43,917 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:43,918 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:43,918 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:34558': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:43,918 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:34564': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:44,030 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:44,030 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:44,030 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:34566': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:44,030 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:34578': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:44,142 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:44,142 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:44,142 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:34582': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:44,142 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:34598': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:44,254 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:44,255 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:44,255 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:34610': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:44,255 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:34624': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:44,366 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:44,366 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:44,367 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:34626': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:44,367 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:34632': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:44,479 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:44,479 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:44,479 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:34642': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:44,479 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:34658': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:44,592 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:44,592 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:44,592 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:34666': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:44,592 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:34678': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:44,705 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:44,705 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:44,705 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:34684': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:44,705 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:34700': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:44,817 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:44,817 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:44,818 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:34708': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:44,818 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:34722': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:44,929 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:44,929 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:44,929 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:34728': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:44,929 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:34738': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:45,042 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:45,043 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:45,043 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:34740': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:45,043 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:34756': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:45,156 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:45,156 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:45,156 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:34762': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:45,156 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:34770': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:45,268 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:45,268 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:45,269 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:34776': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:45,269 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:34784': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:45,381 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:45,381 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:45,381 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:34792': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:45,381 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:34804': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:45,493 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:45,494 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:45,494 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:34806': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:45,494 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:34814': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:45,606 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:45,606 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:45,609 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:34828': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:45,609 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:34838': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:45,718 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:45,718 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:45,718 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:34840': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:45,719 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:34844': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:45,831 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:45,831 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:45,831 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:34846': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:45,831 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:34860': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:45,942 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:45,942 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:45,943 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:34864': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:45,943 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:34874': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:46,055 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:46,055 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:46,055 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:34878': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:46,055 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:34888': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:46,168 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:46,168 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:46,168 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:34894': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:46,168 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:34904': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:46,280 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:46,281 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:46,281 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:34908': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:46,281 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:34910': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:46,392 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:46,392 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:46,392 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:34926': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:46,392 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:34938': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:46,504 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:46,505 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:46,505 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:34950': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:46,505 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:34962': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:46,617 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:46,617 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:46,617 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:34970': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:46,617 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:34978': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:46,729 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:46,729 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:46,730 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:34984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:46,730 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:34998': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:46,850 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:46,850 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:46,851 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:35014': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:46,851 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:35022': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:46,965 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:46,966 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:46,966 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:35032': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:46,966 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:35038': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:47,078 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:47,078 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:47,078 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:35052': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:47,078 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:35060': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:47,190 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:47,191 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:47,191 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:35074': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:47,191 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:35090': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:47,303 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:47,303 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:47,304 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:35104': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:47,304 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:35106': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:47,414 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:47,415 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:47,415 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:35118': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:47,415 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:35124': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:47,522 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:47,526 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:35134': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:47,527 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:47,527 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:35144': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:47,630 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:47,631 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:35150': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:47,637 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:47,637 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:35160': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:47,738 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:47,738 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:35168': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:47,745 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:47,745 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:35172': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:47,846 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:47,847 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:35180': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:47,852 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:47,853 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:35186': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:47,953 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:47,953 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:35192': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:47,959 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:47,959 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:35198': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:48,060 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:48,060 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:35200': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:48,066 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:48,066 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:35212': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:48,167 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:48,167 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:35228': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:48,173 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:48,173 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:35230': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:48,274 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:48,275 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:35238': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:48,280 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:48,280 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:35252': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:48,381 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:48,382 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:35254': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:48,387 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:48,388 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:35268': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:48,488 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:48,488 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:35272': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:48,494 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:48,494 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:35276': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:48,596 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:48,597 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:35284': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:48,602 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:48,604 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:35288': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:48,704 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:48,704 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:35296': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:48,710 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:48,710 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:35304': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:48,811 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:48,811 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:35308': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:48,817 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:48,817 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:35316': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:48,919 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:48,920 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:35328': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:48,925 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:48,925 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:35334': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:49,026 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:49,027 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:35348': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:49,032 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:49,032 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:35354': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:49,133 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:49,133 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:35364': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:49,139 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:49,139 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:35374': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:49,240 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:49,240 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:35390': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:49,246 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:49,246 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:35404': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:49,347 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:49,348 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:35408': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:49,353 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:49,353 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:35420': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:49,454 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:49,455 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:35426': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:49,460 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:49,461 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:35430': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:49,565 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:49,567 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:35442': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:49,576 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:49,577 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:35452': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:49,675 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:49,675 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:35464': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:49,683 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:49,684 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:35478': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:49,783 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:49,783 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:35482': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:49,791 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:49,791 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:35494': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:49,890 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:49,890 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:35498': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:49,897 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:49,898 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:35514': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:49,998 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:49,998 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:35524': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:50,004 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:50,004 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:35530': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:50,105 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:50,109 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:35544': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:50,114 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:50,115 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:35550': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:50,212 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:50,213 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:35558': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:50,221 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:50,221 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:35564': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:50,323 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:50,325 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:35568': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:50,331 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:50,331 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:35576': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:50,430 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:50,430 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:35590': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:50,437 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:50,438 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:35592': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:50,537 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:50,538 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:35602': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:50,543 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:50,544 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:35618': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:50,644 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:50,644 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:35626': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:50,650 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:50,650 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:35636': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:50,751 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:50,752 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:35638': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:50,758 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:50,758 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:35642': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:50,858 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:50,859 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:35648': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:50,865 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:50,865 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:35654': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:50,966 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:50,966 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:35668': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:50,972 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:50,972 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:35682': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:51,073 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:51,073 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:35688': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:51,079 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:51,079 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:35690': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:51,180 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:51,180 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:35702': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:51,186 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:51,186 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:35716': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:51,287 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:51,287 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:35730': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:51,293 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:51,294 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:35736': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:51,395 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:51,396 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:35738': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:51,402 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:51,402 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:35750': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:51,502 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:51,503 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:35760': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:51,509 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:51,509 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:35776': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:51,611 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:51,612 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:42174': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:51,617 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:51,618 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:42176': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:51,719 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:51,720 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:42180': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:51,725 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:51,726 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:42182': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:51,828 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:51,828 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:42188': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:51,834 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:51,834 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:42200': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:51,936 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:51,936 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:42208': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:51,942 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:51,942 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:42216': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:52,044 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:52,044 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:42218': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:52,050 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:52,050 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:42232': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:52,150 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:52,151 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:42246': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:52,156 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:52,157 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:42248': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:52,257 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:52,258 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:42264': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:52,264 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:52,264 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:42270': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:52,364 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:52,364 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:42274': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:52,370 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:52,370 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:42280': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:52,471 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:52,472 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:42288': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:52,477 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:52,477 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:42294': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:52,578 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:52,579 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:42298': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:52,584 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:52,585 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:42304': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:52,686 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:52,686 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:42308': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:52,692 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:52,692 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:42318': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:52,793 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:52,793 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:42320': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:52,799 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:52,799 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:42336': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:52,900 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:52,901 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:42350': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:52,907 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:52,907 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:42364': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:53,008 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:53,009 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:42368': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:53,014 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:53,014 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:42384': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:53,115 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:53,115 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:42386': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:53,121 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:53,121 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:42390': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:53,223 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:53,223 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:42392': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:53,229 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:53,229 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:42396': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:53,330 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:53,330 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:42408': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:53,344 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:53,344 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:42424': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:53,437 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:53,438 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:42440': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:53,451 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:53,451 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:42450': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:53,544 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:53,545 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:42460': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:53,558 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:53,558 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:42474': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:53,651 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:53,651 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:42482': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:53,664 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:53,665 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:42484': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:53,759 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:53,760 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:42492': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:53,771 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:53,771 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:42508': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:53,866 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:53,866 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:42510': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:53,877 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:53,877 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:42522': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:53,973 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:53,974 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:42536': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:53,984 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:53,984 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:42552': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:54,080 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:54,080 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:42558': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:54,090 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:54,090 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:42566': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:54,187 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:54,188 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:42580': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:54,197 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:54,197 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:42588': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:54,295 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:54,295 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:42594': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:54,303 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:54,304 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:42610': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:54,402 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:54,402 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:42624': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:54,410 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:54,411 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:42636': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:54,509 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:54,509 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:42642': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:54,517 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44193 5986s 2024-11-23 22:01:54,517 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:42652': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:54,617 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:32819. Reason: failure-to-start- 5986s 2024-11-23 22:01:54,617 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:01:54,618 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:32851. Reason: failure-to-start- 5986s 2024-11-23 22:01:54,618 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:01:54,619 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44193': TLS handshake failed with remote 'tls://127.0.0.1:42654': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:54,621 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 15s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 5986s stream = await stream.start_tls( 5986s ^^^^^^^^^^^^^^^^^^^^^^^ 5986s False, ssl_options=ssl_options, server_hostname=host 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 15s. 5986s 2024-11-23 22:01:55,627 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:01:55,633 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38921 5986s 2024-11-23 22:01:55,634 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34839/status 5986s 2024-11-23 22:01:55,634 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:01:55,647 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44669 5986s 2024-11-23 22:01:55,647 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44669 5986s 2024-11-23 22:01:55,647 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:01:55,647 - distributed.worker - INFO - dashboard at: 127.0.0.1:45299 5986s 2024-11-23 22:01:55,647 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:01:55,648 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:01:55,648 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:01:55,648 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:01:55,648 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-igv5lrsb 5986s 2024-11-23 22:01:55,648 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:01:55,649 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36287 5986s 2024-11-23 22:01:55,650 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36287 5986s 2024-11-23 22:01:55,650 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:01:55,650 - distributed.worker - INFO - dashboard at: 127.0.0.1:36667 5986s 2024-11-23 22:01:55,650 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:01:55,650 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:01:55,650 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:01:55,650 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:01:55,650 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-zhynop1o 5986s 2024-11-23 22:01:55,650 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:01:55,662 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:01:55,662 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:01:55,662 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:48016': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:55,663 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:48032': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:55,774 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:01:55,774 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:01:55,774 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:48038': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:55,774 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:48042': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:55,886 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:01:55,886 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:01:55,886 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:48048': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:55,886 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:48058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:55,999 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:01:55,999 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:01:56,000 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:48062': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:56,000 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:48076': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:56,111 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:01:56,112 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:01:56,114 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:48088': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:56,114 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:48090': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:56,224 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:01:56,224 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:01:56,224 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:48096': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:56,224 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:48110': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:56,336 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:01:56,336 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:01:56,336 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:48114': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:56,336 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:48122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:56,448 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:01:56,448 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:01:56,448 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:48130': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:56,448 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:48146': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:56,561 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:01:56,561 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:01:56,561 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:48162': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:56,561 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:48174': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:56,673 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:01:56,674 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:01:56,674 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:48190': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:56,674 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:48198': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:56,786 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:01:56,787 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:01:56,787 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:48206': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:56,787 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:48220': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:56,899 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:01:56,899 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:01:56,899 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:48234': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:56,899 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:48246': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:57,011 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:01:57,011 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:01:57,012 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:48258': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:57,012 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:48260': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:57,123 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:01:57,123 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:01:57,123 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:48266': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:57,124 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:48270': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:57,235 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:01:57,235 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:01:57,235 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:48280': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:57,236 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:48282': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:57,347 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:01:57,347 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:01:57,348 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:48288': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:57,348 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:48302': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:57,461 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:01:57,461 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:01:57,462 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:48308': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:57,462 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:48312': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:57,573 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:01:57,573 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:01:57,573 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:48326': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:57,573 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:48330': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:57,685 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:01:57,685 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:01:57,685 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:48332': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:57,685 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:48342': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:57,797 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:01:57,797 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:01:57,798 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:48344': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:57,798 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:48346': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:57,911 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:01:57,911 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:01:57,911 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:48356': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:57,911 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:48364': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:58,022 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:01:58,023 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:01:58,023 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:48374': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:58,023 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:48384': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:58,136 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:01:58,136 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:01:58,139 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:48396': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:58,139 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:48408': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:58,247 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:01:58,248 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:01:58,248 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:48414': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:58,248 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:48416': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:58,360 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:01:58,361 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:01:58,361 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:48418': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:58,361 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:48422': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:58,475 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:01:58,475 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:01:58,475 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:48430': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:58,476 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:48446': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:58,587 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:01:58,588 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:01:58,588 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:48462': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:58,588 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:48466': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:58,699 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:01:58,700 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:01:58,700 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:48480': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:58,700 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:48488': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:58,812 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:01:58,812 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:01:58,812 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:48496': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:58,812 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:48500': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:58,925 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:01:58,925 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:01:58,925 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:48508': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:58,926 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:48522': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:59,038 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:01:59,038 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:01:59,038 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:48526': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:59,038 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:48530': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:59,150 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:01:59,150 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:01:59,150 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:48536': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:59,150 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:48546': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:59,262 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:01:59,263 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:01:59,263 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:48556': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:59,263 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:48566': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:59,376 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:01:59,376 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:01:59,376 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:48572': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:59,376 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:48586': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:59,488 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:01:59,488 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:01:59,488 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:48596': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:59,488 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:48610': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:59,600 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:01:59,601 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:01:59,601 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:48614': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:59,601 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:48620': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:59,712 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:01:59,712 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:01:59,713 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:48634': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:59,713 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:48636': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:59,826 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:01:59,826 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:01:59,826 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:48638': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:59,826 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:48652': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:59,938 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:01:59,938 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:01:59,938 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:48658': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:01:59,938 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:48662': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:00,050 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:02:00,050 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:02:00,050 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:48676': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:00,050 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:48682': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:00,163 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:02:00,163 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:02:00,163 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:48694': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:00,163 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:48706': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:00,276 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:02:00,276 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:02:00,277 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:48720': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:00,277 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:48730': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:00,388 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:02:00,388 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:02:00,389 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:48744': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:00,389 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:48760': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:00,500 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:02:00,500 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:02:00,501 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:48776': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:00,501 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:48784': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:00,617 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:02:00,617 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:02:00,618 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:48798': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:00,618 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:48808': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:00,730 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:02:00,730 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:02:00,730 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:48818': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:00,730 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:48828': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:00,841 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:02:00,842 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:02:00,842 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:48842': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:00,842 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:48846': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:00,958 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:02:00,958 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:02:00,959 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:48860': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:00,959 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:48876': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:01,072 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:02:01,072 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:02:01,072 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:48882': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:01,072 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:48890': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:01,185 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:02:01,186 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:02:01,186 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:48902': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:01,186 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:48916': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:01,297 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:02:01,297 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:02:01,298 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:48924': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:01,298 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:48926': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:01,411 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:02:01,411 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:02:01,411 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:48942': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:01,411 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:48956': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:01,522 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:02:01,523 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:02:01,523 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:48972': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:01,523 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:48986': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:01,634 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:02:01,634 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:02:01,635 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:45922': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:01,635 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:45932': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:01,746 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:02:01,746 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:02:01,747 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:45948': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:01,747 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:45950': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:01,858 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:02:01,858 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:02:01,859 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:45952': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:01,859 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:45958': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:01,970 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:02:01,970 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:02:01,972 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:45968': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:01,972 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:45980': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:02,083 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:02:02,083 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:02:02,084 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:45994': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:02,084 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:46008': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:02,196 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:02:02,196 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:02:02,196 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:46010': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:02,196 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:46026': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:02,308 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:02:02,308 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:02:02,309 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:46040': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:02,309 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:46050': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:02,420 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:02:02,420 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:02:02,420 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:46058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:02,421 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:46068': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:02,533 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:02:02,534 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:02:02,534 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:46082': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:02,534 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:46084': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:02,648 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:02:02,648 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:02:02,649 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:46096': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:02,649 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:46108': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:02,760 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:02:02,760 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:02:02,760 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:46112': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:02,760 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:46120': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:02,872 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:02:02,873 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:02:02,873 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:46126': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:02,873 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:46130': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:02,984 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:02:02,984 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:02:02,985 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:46142': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:02,985 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:46144': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:03,096 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:02:03,096 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:02:03,096 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:46154': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:03,096 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:46158': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:03,208 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:02:03,208 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:02:03,208 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:46164': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:03,208 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:46166': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:03,319 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:02:03,320 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:02:03,320 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:46176': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:03,320 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:46192': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:03,432 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:02:03,432 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:02:03,433 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:46198': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:03,433 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:46204': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:03,545 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:02:03,545 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:02:03,545 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:46214': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:03,545 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:46226': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:03,655 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:02:03,656 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:02:03,657 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:46234': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:03,657 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:46248': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:03,765 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:02:03,769 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:46256': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:03,770 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:02:03,770 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:46268': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:03,871 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:02:03,872 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:46274': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:03,878 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:02:03,878 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:46276': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:03,978 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:02:03,979 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:46286': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:03,984 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:02:03,985 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:46292': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:04,086 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:02:04,086 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:46304': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:04,092 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:02:04,092 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:46312': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:04,192 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:02:04,193 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:46320': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:04,198 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:02:04,199 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:46336': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:04,300 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:02:04,301 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:46344': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:04,307 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:02:04,307 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:46346': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:04,407 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:02:04,407 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:46348': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:04,413 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:02:04,414 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:46356': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:04,514 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:02:04,515 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:46360': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:04,520 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:02:04,521 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:46374': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:04,623 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:02:04,624 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:46380': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:04,629 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:02:04,629 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:46390': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:04,730 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:02:04,731 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:46406': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:04,737 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:02:04,737 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:46420': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:04,838 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:02:04,838 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:46426': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:04,844 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:02:04,844 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:46440': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:04,944 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:02:04,945 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:46452': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:04,951 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:02:04,951 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:46466': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:05,052 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:02:05,053 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:46480': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:05,058 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:02:05,059 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:46488': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:05,159 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:02:05,159 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:46504': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:05,165 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:02:05,165 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:46518': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:05,266 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:02:05,267 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:46524': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:05,272 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:02:05,273 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:46538': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:05,374 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:02:05,375 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:46540': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:05,381 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:02:05,382 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:46548': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:05,481 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:02:05,481 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:46558': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:05,488 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:02:05,488 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:46564': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:05,587 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:02:05,588 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:46576': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:05,595 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:02:05,595 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:46584': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:05,694 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:02:05,694 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:46592': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:05,701 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:02:05,702 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:46600': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:05,800 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:02:05,801 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:46602': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:05,808 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:02:05,808 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:46608': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:05,907 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:02:05,908 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:46618': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:05,915 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:02:05,915 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:46624': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:06,014 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:02:06,014 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:46638': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:06,021 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:02:06,022 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:46640': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:06,121 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:02:06,121 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:46654': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:06,127 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:02:06,128 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:46666': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:06,228 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:02:06,228 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:46678': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:06,234 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:02:06,234 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:46682': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:06,337 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:02:06,338 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:46698': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:06,343 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:02:06,343 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:46712': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:06,444 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:02:06,444 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:46722': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:06,450 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:02:06,450 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:46736': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:06,551 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:02:06,552 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:46748': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:06,557 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:02:06,558 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:46762': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:06,659 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:02:06,659 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:46764': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:06,665 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:02:06,665 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:46776': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:06,765 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:02:06,765 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:46788': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:06,771 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:02:06,772 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:46800': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:06,872 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:02:06,872 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:46802': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:06,878 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:02:06,878 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:46808': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:06,979 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:02:06,979 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:46816': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:06,985 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:02:06,985 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:46820': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:07,098 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:02:07,102 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:46828': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:07,103 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:02:07,106 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:46832': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:07,204 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:02:07,205 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:46838': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:07,211 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:02:07,211 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:46852': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:07,311 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:02:07,311 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:46868': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:07,317 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:02:07,317 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:46878': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:07,419 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:02:07,419 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:46882': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:07,425 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:02:07,425 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:46888': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:07,526 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:02:07,527 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:46896': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:07,532 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:02:07,532 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:46912': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:07,633 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:02:07,634 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:46924': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:07,642 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:02:07,643 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:46932': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:07,741 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:02:07,741 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:46942': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:07,749 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:02:07,749 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:46956': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:07,847 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:02:07,848 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:46962': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:07,856 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:02:07,857 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:46966': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:07,955 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:02:07,955 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:46968': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:07,963 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:02:07,964 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:46980': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:08,063 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:02:08,063 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:46996': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:08,070 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:02:08,070 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:47004': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:08,171 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:02:08,171 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:47006': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:08,177 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:02:08,177 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:47016': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:08,278 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:02:08,279 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:47030': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:08,284 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:02:08,285 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:47032': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:08,385 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:02:08,386 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:47048': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:08,392 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:02:08,392 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:47056': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:08,492 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:02:08,492 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:47072': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:08,498 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:02:08,498 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:47084': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:08,599 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:02:08,599 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:47088': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:08,605 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38921 5986s 2024-11-23 22:02:08,609 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38921': TLS handshake failed with remote 'tls://127.0.0.1:47096': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:08,647 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44669. Reason: failure-to-start- 5986s 2024-11-23 22:02:08,647 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:02:08,648 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36287. Reason: failure-to-start- 5986s 2024-11-23 22:02:08,648 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:02:08,650 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 13s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 5986s stream = await stream.start_tls( 5986s ^^^^^^^^^^^^^^^^^^^^^^^ 5986s False, ssl_options=ssl_options, server_hostname=host 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 5986s self.socket.do_handshake() 5986s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 5986s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 5986s self._sslobj.do_handshake() 5986s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 5986s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 5986s raise FatalCommClosedError( 5986s ...<2 lines>... 5986s ) from err 5986s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 5986s 5986s During handling of the above exception, another exception occurred: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1218, in _register_with_scheduler 5986s await asyncio.sleep(0.1) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 718, in sleep 5986s return await future 5986s ^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 13s. 5986s 2024-11-23 22:02:09,656 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:02:09,662 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:32853 5986s 2024-11-23 22:02:09,663 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33341/status 5986s 2024-11-23 22:02:09,663 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:02:09,675 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37275 5986s 2024-11-23 22:02:09,676 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37275 5986s 2024-11-23 22:02:09,676 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:02:09,676 - distributed.worker - INFO - dashboard at: 127.0.0.1:33397 5986s 2024-11-23 22:02:09,676 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:32853 5986s 2024-11-23 22:02:09,676 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:02:09,676 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:02:09,676 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:02:09,676 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ny92h8it 5986s 2024-11-23 22:02:09,676 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:02:09,678 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40271 5986s 2024-11-23 22:02:09,678 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40271 5986s 2024-11-23 22:02:09,678 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:02:09,678 - distributed.worker - INFO - dashboard at: 127.0.0.1:46517 5986s 2024-11-23 22:02:09,678 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:32853 5986s 2024-11-23 22:02:09,678 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:02:09,678 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:02:09,678 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:02:09,678 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-59ndngdw 5986s 2024-11-23 22:02:09,678 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:02:09,679 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37275. Reason: failure-to-start- 5986s 2024-11-23 22:02:09,679 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:02:09,680 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40271. Reason: failure-to-start- 5986s 2024-11-23 22:02:09,680 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:02:09,681 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:32853': TLS handshake failed with remote 'tls://127.0.0.1:33530': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:02:09,681 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:32853': TLS handshake failed with remote 'tls://127.0.0.1:33546': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:02:09,682 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:02:10,687 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:02:10,694 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37865 5986s 2024-11-23 22:02:10,694 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42893/status 5986s 2024-11-23 22:02:10,694 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:02:10,708 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40275 5986s 2024-11-23 22:02:10,708 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40275 5986s 2024-11-23 22:02:10,708 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:02:10,708 - distributed.worker - INFO - dashboard at: 127.0.0.1:34841 5986s 2024-11-23 22:02:10,708 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37865 5986s 2024-11-23 22:02:10,708 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:02:10,708 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:02:10,708 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:02:10,708 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-0i2ggkf9 5986s 2024-11-23 22:02:10,708 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:02:10,710 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38595 5986s 2024-11-23 22:02:10,710 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38595 5986s 2024-11-23 22:02:10,710 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:02:10,710 - distributed.worker - INFO - dashboard at: 127.0.0.1:38427 5986s 2024-11-23 22:02:10,710 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37865 5986s 2024-11-23 22:02:10,710 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:02:10,710 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:02:10,711 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:02:10,711 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-j1oc43s5 5986s 2024-11-23 22:02:10,711 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:02:10,712 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40275. Reason: failure-to-start- 5986s 2024-11-23 22:02:10,712 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:02:10,712 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38595. Reason: failure-to-start- 5986s 2024-11-23 22:02:10,712 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:02:10,713 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37865': TLS handshake failed with remote 'tls://127.0.0.1:40026': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:02:10,713 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37865': TLS handshake failed with remote 'tls://127.0.0.1:40032': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:02:10,714 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:02:11,719 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:02:11,725 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36415 5986s 2024-11-23 22:02:11,726 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46119/status 5986s 2024-11-23 22:02:11,726 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:02:11,739 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39553 5986s 2024-11-23 22:02:11,739 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39553 5986s 2024-11-23 22:02:11,739 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:02:11,739 - distributed.worker - INFO - dashboard at: 127.0.0.1:41579 5986s 2024-11-23 22:02:11,739 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36415 5986s 2024-11-23 22:02:11,739 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:02:11,739 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:02:11,739 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:02:11,739 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-qkxhv_p8 5986s 2024-11-23 22:02:11,739 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:02:11,741 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41293 5986s 2024-11-23 22:02:11,741 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41293 5986s 2024-11-23 22:02:11,741 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:02:11,741 - distributed.worker - INFO - dashboard at: 127.0.0.1:45919 5986s 2024-11-23 22:02:11,741 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36415 5986s 2024-11-23 22:02:11,741 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:02:11,741 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:02:11,741 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:02:11,741 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-q9epicly 5986s 2024-11-23 22:02:11,741 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:02:11,742 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39553. Reason: failure-to-start- 5986s 2024-11-23 22:02:11,742 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:02:11,743 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41293. Reason: failure-to-start- 5986s 2024-11-23 22:02:11,743 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:02:11,744 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36415': TLS handshake failed with remote 'tls://127.0.0.1:44206': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:02:11,744 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36415': TLS handshake failed with remote 'tls://127.0.0.1:44212': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:02:11,745 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:02:12,751 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:02:12,757 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39617 5986s 2024-11-23 22:02:12,757 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33189/status 5986s 2024-11-23 22:02:12,757 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:02:12,769 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43593 5986s 2024-11-23 22:02:12,769 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43593 5986s 2024-11-23 22:02:12,769 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:02:12,769 - distributed.worker - INFO - dashboard at: 127.0.0.1:45127 5986s 2024-11-23 22:02:12,769 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39617 5986s 2024-11-23 22:02:12,770 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:02:12,770 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:02:12,770 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:02:12,770 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-b6uzs9w0 5986s 2024-11-23 22:02:12,770 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:02:12,771 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35019 5986s 2024-11-23 22:02:12,772 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35019 5986s 2024-11-23 22:02:12,772 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:02:12,772 - distributed.worker - INFO - dashboard at: 127.0.0.1:33551 5986s 2024-11-23 22:02:12,772 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39617 5986s 2024-11-23 22:02:12,772 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:02:12,772 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:02:12,772 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:02:12,772 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-v5kyiywj 5986s 2024-11-23 22:02:12,772 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:02:12,773 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43593. Reason: failure-to-start- 5986s 2024-11-23 22:02:12,773 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:02:12,773 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35019. Reason: failure-to-start- 5986s 2024-11-23 22:02:12,773 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:02:12,774 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39617': TLS handshake failed with remote 'tls://127.0.0.1:54380': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:02:12,774 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39617': TLS handshake failed with remote 'tls://127.0.0.1:54384': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:02:12,775 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:02:13,782 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:02:13,788 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35923 5986s 2024-11-23 22:02:13,789 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41427/status 5986s 2024-11-23 22:02:13,789 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:02:13,801 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40191 5986s 2024-11-23 22:02:13,801 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40191 5986s 2024-11-23 22:02:13,801 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:02:13,801 - distributed.worker - INFO - dashboard at: 127.0.0.1:35853 5986s 2024-11-23 22:02:13,801 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35923 5986s 2024-11-23 22:02:13,801 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:02:13,801 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:02:13,801 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:02:13,801 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-1sbcfrol 5986s 2024-11-23 22:02:13,801 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:02:13,803 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35897 5986s 2024-11-23 22:02:13,803 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35897 5986s 2024-11-23 22:02:13,803 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:02:13,803 - distributed.worker - INFO - dashboard at: 127.0.0.1:46101 5986s 2024-11-23 22:02:13,803 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35923 5986s 2024-11-23 22:02:13,803 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:02:13,803 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:02:13,803 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:02:13,803 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-tahik5rl 5986s 2024-11-23 22:02:13,803 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:02:13,805 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40191. Reason: failure-to-start- 5986s 2024-11-23 22:02:13,805 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:02:13,805 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35897. Reason: failure-to-start- 5986s 2024-11-23 22:02:13,805 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:02:13,806 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35923': TLS handshake failed with remote 'tls://127.0.0.1:41192': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:02:13,806 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35923': TLS handshake failed with remote 'tls://127.0.0.1:41196': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:02:13,807 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:02:14,813 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:02:14,820 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41713 5986s 2024-11-23 22:02:14,820 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33329/status 5986s 2024-11-23 22:02:14,820 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:02:14,834 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33625 5986s 2024-11-23 22:02:14,834 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33625 5986s 2024-11-23 22:02:14,834 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:02:14,834 - distributed.worker - INFO - dashboard at: 127.0.0.1:37237 5986s 2024-11-23 22:02:14,834 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 5986s 2024-11-23 22:02:14,834 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:02:14,834 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:02:14,835 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:02:14,835 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-yoyj0d4y 5986s 2024-11-23 22:02:14,835 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:02:14,837 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38359 5986s 2024-11-23 22:02:14,837 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38359 5986s 2024-11-23 22:02:14,837 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:02:14,837 - distributed.worker - INFO - dashboard at: 127.0.0.1:44697 5986s 2024-11-23 22:02:14,837 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41713 5986s 2024-11-23 22:02:14,837 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:02:14,837 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:02:14,837 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:02:14,837 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-mrjjwtnc 5986s 2024-11-23 22:02:14,837 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:02:14,838 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33625. Reason: failure-to-start- 5986s 2024-11-23 22:02:14,838 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:02:14,839 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38359. Reason: failure-to-start- 5986s 2024-11-23 22:02:14,839 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:02:14,840 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:43662': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:02:14,840 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41713': TLS handshake failed with remote 'tls://127.0.0.1:43666': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:02:14,842 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:02:15,848 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:02:15,855 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38659 5986s 2024-11-23 22:02:15,855 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44991/status 5986s 2024-11-23 22:02:15,855 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:02:15,869 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46821 5986s 2024-11-23 22:02:15,869 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46821 5986s 2024-11-23 22:02:15,869 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:02:15,869 - distributed.worker - INFO - dashboard at: 127.0.0.1:46199 5986s 2024-11-23 22:02:15,869 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38659 5986s 2024-11-23 22:02:15,869 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:02:15,869 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:02:15,869 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:02:15,869 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-2o42irww 5986s 2024-11-23 22:02:15,869 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:02:15,871 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35451 5986s 2024-11-23 22:02:15,872 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35451 5986s 2024-11-23 22:02:15,872 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:02:15,872 - distributed.worker - INFO - dashboard at: 127.0.0.1:43937 5986s 2024-11-23 22:02:15,872 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38659 5986s 2024-11-23 22:02:15,872 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:02:15,872 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:02:15,872 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:02:15,872 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-b0_j8uzh 5986s 2024-11-23 22:02:15,872 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:02:15,873 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46821. Reason: failure-to-start- 5986s 2024-11-23 22:02:15,873 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:02:15,874 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35451. Reason: failure-to-start- 5986s 2024-11-23 22:02:15,874 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:02:15,875 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38659': TLS handshake failed with remote 'tls://127.0.0.1:53168': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:02:15,875 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38659': TLS handshake failed with remote 'tls://127.0.0.1:53176': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:02:15,876 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:02:16,882 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:02:16,889 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33147 5986s 2024-11-23 22:02:16,889 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46573/status 5986s 2024-11-23 22:02:16,889 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:02:16,902 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44921 5986s 2024-11-23 22:02:16,902 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44921 5986s 2024-11-23 22:02:16,902 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:02:16,902 - distributed.worker - INFO - dashboard at: 127.0.0.1:43871 5986s 2024-11-23 22:02:16,902 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33147 5986s 2024-11-23 22:02:16,902 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:02:16,903 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:02:16,903 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:02:16,903 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-a53_bvh8 5986s 2024-11-23 22:02:16,903 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:02:16,905 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46159 5986s 2024-11-23 22:02:16,905 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46159 5986s 2024-11-23 22:02:16,905 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:02:16,905 - distributed.worker - INFO - dashboard at: 127.0.0.1:35649 5986s 2024-11-23 22:02:16,905 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33147 5986s 2024-11-23 22:02:16,905 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:02:16,905 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:02:16,905 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:02:16,905 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-1yjkqchy 5986s 2024-11-23 22:02:16,905 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:02:16,906 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44921. Reason: failure-to-start- 5986s 2024-11-23 22:02:16,906 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:02:16,908 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46159. Reason: failure-to-start- 5986s 2024-11-23 22:02:16,908 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:02:16,909 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33147': TLS handshake failed with remote 'tls://127.0.0.1:37822': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:02:16,909 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33147': TLS handshake failed with remote 'tls://127.0.0.1:37838': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:02:16,910 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:02:17,916 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:02:17,923 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39813 5986s 2024-11-23 22:02:17,924 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36597/status 5986s 2024-11-23 22:02:17,924 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:02:17,936 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44415 5986s 2024-11-23 22:02:17,936 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44415 5986s 2024-11-23 22:02:17,936 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:02:17,936 - distributed.worker - INFO - dashboard at: 127.0.0.1:46165 5986s 2024-11-23 22:02:17,936 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39813 5986s 2024-11-23 22:02:17,936 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:02:17,936 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:02:17,936 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:02:17,936 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ug4m7j3o 5986s 2024-11-23 22:02:17,936 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:02:17,938 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45493 5986s 2024-11-23 22:02:17,938 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45493 5986s 2024-11-23 22:02:17,938 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:02:17,938 - distributed.worker - INFO - dashboard at: 127.0.0.1:43897 5986s 2024-11-23 22:02:17,938 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39813 5986s 2024-11-23 22:02:17,938 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:02:17,939 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:02:17,939 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:02:17,939 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-fy7vyv8k 5986s 2024-11-23 22:02:17,939 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:02:17,940 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44415. Reason: failure-to-start- 5986s 2024-11-23 22:02:17,940 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:02:17,940 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45493. Reason: failure-to-start- 5986s 2024-11-23 22:02:17,940 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:02:17,941 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39813': TLS handshake failed with remote 'tls://127.0.0.1:50898': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:02:17,941 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39813': TLS handshake failed with remote 'tls://127.0.0.1:50906': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:02:17,942 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:02:18,948 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:02:18,955 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43683 5986s 2024-11-23 22:02:18,955 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37713/status 5986s 2024-11-23 22:02:18,956 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:02:18,969 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44499 5986s 2024-11-23 22:02:18,969 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44499 5986s 2024-11-23 22:02:18,969 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:02:18,969 - distributed.worker - INFO - dashboard at: 127.0.0.1:45631 5986s 2024-11-23 22:02:18,969 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43683 5986s 2024-11-23 22:02:18,969 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:02:18,969 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:02:18,969 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:02:18,969 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-6x942ke4 5986s 2024-11-23 22:02:18,969 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:02:18,971 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45067 5986s 2024-11-23 22:02:18,971 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45067 5986s 2024-11-23 22:02:18,971 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:02:18,972 - distributed.worker - INFO - dashboard at: 127.0.0.1:39507 5986s 2024-11-23 22:02:18,972 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43683 5986s 2024-11-23 22:02:18,972 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:02:18,972 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:02:18,972 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:02:18,972 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-9boqpwdm 5986s 2024-11-23 22:02:18,972 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:02:18,973 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44499. Reason: failure-to-start- 5986s 2024-11-23 22:02:18,973 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:02:18,973 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45067. Reason: failure-to-start- 5986s 2024-11-23 22:02:18,974 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:02:18,974 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43683': TLS handshake failed with remote 'tls://127.0.0.1:49802': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:02:18,975 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43683': TLS handshake failed with remote 'tls://127.0.0.1:49810': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:02:18,976 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:02:19,980 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:02:19,986 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38675 5986s 2024-11-23 22:02:19,987 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35371/status 5986s 2024-11-23 22:02:19,987 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:02:20,000 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35291 5986s 2024-11-23 22:02:20,000 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35291 5986s 2024-11-23 22:02:20,000 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:02:20,000 - distributed.worker - INFO - dashboard at: 127.0.0.1:34497 5986s 2024-11-23 22:02:20,000 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38675 5986s 2024-11-23 22:02:20,000 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:02:20,000 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:02:20,000 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:02:20,000 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-g2yemub8 5986s 2024-11-23 22:02:20,000 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:02:20,002 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41845 5986s 2024-11-23 22:02:20,002 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41845 5986s 2024-11-23 22:02:20,002 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:02:20,002 - distributed.worker - INFO - dashboard at: 127.0.0.1:43209 5986s 2024-11-23 22:02:20,002 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38675 5986s 2024-11-23 22:02:20,002 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:02:20,002 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:02:20,002 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:02:20,002 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-4h0ffq_t 5986s 2024-11-23 22:02:20,003 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:02:20,003 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35291. Reason: failure-to-start- 5986s 2024-11-23 22:02:20,004 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:02:20,004 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41845. Reason: failure-to-start- 5986s 2024-11-23 22:02:20,004 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:02:20,005 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38675': TLS handshake failed with remote 'tls://127.0.0.1:34230': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:02:20,005 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38675': TLS handshake failed with remote 'tls://127.0.0.1:34246': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:02:20,007 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:02:21,012 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:02:21,018 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43353 5986s 2024-11-23 22:02:21,019 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:32891/status 5986s 2024-11-23 22:02:21,019 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:02:21,032 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34315 5986s 2024-11-23 22:02:21,032 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34315 5986s 2024-11-23 22:02:21,032 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:02:21,032 - distributed.worker - INFO - dashboard at: 127.0.0.1:35067 5986s 2024-11-23 22:02:21,032 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43353 5986s 2024-11-23 22:02:21,032 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:02:21,032 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:02:21,032 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:02:21,032 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-m7q9ue9_ 5986s 2024-11-23 22:02:21,032 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:02:21,035 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44053 5986s 2024-11-23 22:02:21,035 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44053 5986s 2024-11-23 22:02:21,035 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:02:21,035 - distributed.worker - INFO - dashboard at: 127.0.0.1:36149 5986s 2024-11-23 22:02:21,035 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43353 5986s 2024-11-23 22:02:21,035 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:02:21,035 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:02:21,035 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:02:21,035 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-hrtymsai 5986s 2024-11-23 22:02:21,035 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:02:21,036 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34315. Reason: failure-to-start- 5986s 2024-11-23 22:02:21,036 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:02:21,037 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44053. Reason: failure-to-start- 5986s 2024-11-23 22:02:21,037 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:02:21,038 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43353': TLS handshake failed with remote 'tls://127.0.0.1:53694': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:02:21,038 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43353': TLS handshake failed with remote 'tls://127.0.0.1:53704': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:02:21,039 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:02:22,044 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:02:22,051 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44713 5986s 2024-11-23 22:02:22,051 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35035/status 5986s 2024-11-23 22:02:22,051 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:02:22,064 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34299 5986s 2024-11-23 22:02:22,064 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34299 5986s 2024-11-23 22:02:22,064 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:02:22,065 - distributed.worker - INFO - dashboard at: 127.0.0.1:43657 5986s 2024-11-23 22:02:22,065 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44713 5986s 2024-11-23 22:02:22,065 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:02:22,065 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:02:22,065 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:02:22,065 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-pyg0_53f 5986s 2024-11-23 22:02:22,065 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:02:22,067 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40447 5986s 2024-11-23 22:02:22,067 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40447 5986s 2024-11-23 22:02:22,067 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:02:22,067 - distributed.worker - INFO - dashboard at: 127.0.0.1:39521 5986s 2024-11-23 22:02:22,067 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44713 5986s 2024-11-23 22:02:22,067 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:02:22,067 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:02:22,067 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:02:22,067 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-wpw97m33 5986s 2024-11-23 22:02:22,067 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:02:22,068 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34299. Reason: failure-to-start- 5986s 2024-11-23 22:02:22,069 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:02:22,069 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40447. Reason: failure-to-start- 5986s 2024-11-23 22:02:22,069 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:02:22,070 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44713': TLS handshake failed with remote 'tls://127.0.0.1:53238': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:02:22,070 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44713': TLS handshake failed with remote 'tls://127.0.0.1:53244': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:02:22,072 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:02:23,077 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:02:23,085 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43389 5986s 2024-11-23 22:02:23,085 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45019/status 5986s 2024-11-23 22:02:23,085 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:02:23,097 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44805 5986s 2024-11-23 22:02:23,097 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44805 5986s 2024-11-23 22:02:23,097 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:02:23,097 - distributed.worker - INFO - dashboard at: 127.0.0.1:33297 5986s 2024-11-23 22:02:23,097 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43389 5986s 2024-11-23 22:02:23,098 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:02:23,098 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:02:23,098 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:02:23,098 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-kluuu2v8 5986s 2024-11-23 22:02:23,098 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:02:23,100 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36567 5986s 2024-11-23 22:02:23,100 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36567 5986s 2024-11-23 22:02:23,100 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:02:23,100 - distributed.worker - INFO - dashboard at: 127.0.0.1:41627 5986s 2024-11-23 22:02:23,100 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43389 5986s 2024-11-23 22:02:23,100 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:02:23,100 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:02:23,100 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:02:23,100 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-w7xhvml6 5986s 2024-11-23 22:02:23,100 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:02:23,101 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44805. Reason: failure-to-start- 5986s 2024-11-23 22:02:23,101 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:02:23,102 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36567. Reason: failure-to-start- 5986s 2024-11-23 22:02:23,102 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:02:23,103 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43389': TLS handshake failed with remote 'tls://127.0.0.1:53112': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:02:23,103 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43389': TLS handshake failed with remote 'tls://127.0.0.1:53128': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:02:23,106 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:02:24,111 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:02:24,117 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35339 5986s 2024-11-23 22:02:24,118 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36325/status 5986s 2024-11-23 22:02:24,118 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:02:24,138 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39553 5986s 2024-11-23 22:02:24,138 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39553 5986s 2024-11-23 22:02:24,138 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:02:24,138 - distributed.worker - INFO - dashboard at: 127.0.0.1:36137 5986s 2024-11-23 22:02:24,138 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35339 5986s 2024-11-23 22:02:24,138 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:02:24,138 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:02:24,138 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:02:24,139 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-i0uurf0k 5986s 2024-11-23 22:02:24,139 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:02:24,141 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45977 5986s 2024-11-23 22:02:24,141 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45977 5986s 2024-11-23 22:02:24,141 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:02:24,141 - distributed.worker - INFO - dashboard at: 127.0.0.1:45575 5986s 2024-11-23 22:02:24,141 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35339 5986s 2024-11-23 22:02:24,141 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:02:24,141 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:02:24,141 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:02:24,141 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-gw7jh3xl 5986s 2024-11-23 22:02:24,141 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:02:24,144 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39553. Reason: failure-to-start- 5986s 2024-11-23 22:02:24,144 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:02:24,144 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45977. Reason: failure-to-start- 5986s 2024-11-23 22:02:24,144 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:02:24,145 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35339': TLS handshake failed with remote 'tls://127.0.0.1:46558': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:02:24,145 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35339': TLS handshake failed with remote 'tls://127.0.0.1:46564': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:02:24,147 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:02:25,153 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:02:25,159 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41905 5986s 2024-11-23 22:02:25,159 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43297/status 5986s 2024-11-23 22:02:25,159 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:02:25,171 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45985 5986s 2024-11-23 22:02:25,172 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45985 5986s 2024-11-23 22:02:25,172 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:02:25,172 - distributed.worker - INFO - dashboard at: 127.0.0.1:37027 5986s 2024-11-23 22:02:25,177 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41905 5986s 2024-11-23 22:02:25,178 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:02:25,178 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:02:25,178 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:02:25,178 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-27t33uih 5986s 2024-11-23 22:02:25,178 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:02:25,181 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38541 5986s 2024-11-23 22:02:25,181 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38541 5986s 2024-11-23 22:02:25,181 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:02:25,181 - distributed.worker - INFO - dashboard at: 127.0.0.1:35643 5986s 2024-11-23 22:02:25,181 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41905 5986s 2024-11-23 22:02:25,181 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:02:25,181 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:02:25,181 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:02:25,181 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-gsonf6gn 5986s 2024-11-23 22:02:25,181 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:02:25,186 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45985. Reason: failure-to-start- 5986s 2024-11-23 22:02:25,186 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:02:25,186 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38541. Reason: failure-to-start- 5986s 2024-11-23 22:02:25,186 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:02:25,187 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41905': TLS handshake failed with remote 'tls://127.0.0.1:42876': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:02:25,188 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41905': TLS handshake failed with remote 'tls://127.0.0.1:42892': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:02:25,189 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:02:26,195 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:02:26,201 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45273 5986s 2024-11-23 22:02:26,201 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36079/status 5986s 2024-11-23 22:02:26,201 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:02:26,215 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37583 5986s 2024-11-23 22:02:26,215 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37583 5986s 2024-11-23 22:02:26,215 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:02:26,215 - distributed.worker - INFO - dashboard at: 127.0.0.1:43733 5986s 2024-11-23 22:02:26,215 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45273 5986s 2024-11-23 22:02:26,215 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:02:26,215 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:02:26,215 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:02:26,215 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-xlx6_chq 5986s 2024-11-23 22:02:26,215 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:02:26,217 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40127 5986s 2024-11-23 22:02:26,217 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40127 5986s 2024-11-23 22:02:26,217 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:02:26,217 - distributed.worker - INFO - dashboard at: 127.0.0.1:40983 5986s 2024-11-23 22:02:26,217 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45273 5986s 2024-11-23 22:02:26,217 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:02:26,217 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:02:26,217 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:02:26,217 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-f9zcdvsx 5986s 2024-11-23 22:02:26,218 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:02:26,219 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37583. Reason: failure-to-start- 5986s 2024-11-23 22:02:26,219 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:02:26,219 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40127. Reason: failure-to-start- 5986s 2024-11-23 22:02:26,219 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:02:26,220 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45273': TLS handshake failed with remote 'tls://127.0.0.1:38430': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:02:26,220 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45273': TLS handshake failed with remote 'tls://127.0.0.1:38440': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:02:26,222 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:02:27,226 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:02:27,233 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36611 5986s 2024-11-23 22:02:27,234 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44483/status 5986s 2024-11-23 22:02:27,234 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:02:27,247 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36563 5986s 2024-11-23 22:02:27,247 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36563 5986s 2024-11-23 22:02:27,247 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:02:27,247 - distributed.worker - INFO - dashboard at: 127.0.0.1:40561 5986s 2024-11-23 22:02:27,247 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36611 5986s 2024-11-23 22:02:27,247 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:02:27,247 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:02:27,247 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:02:27,247 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-uso2yc4o 5986s 2024-11-23 22:02:27,248 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:02:27,249 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40943 5986s 2024-11-23 22:02:27,249 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40943 5986s 2024-11-23 22:02:27,249 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:02:27,249 - distributed.worker - INFO - dashboard at: 127.0.0.1:36495 5986s 2024-11-23 22:02:27,249 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36611 5986s 2024-11-23 22:02:27,249 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:02:27,250 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:02:27,250 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:02:27,250 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-gcqux53j 5986s 2024-11-23 22:02:27,250 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:02:27,251 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36563. Reason: failure-to-start- 5986s 2024-11-23 22:02:27,251 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:02:27,251 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40943. Reason: failure-to-start- 5986s 2024-11-23 22:02:27,251 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:02:27,252 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36611': TLS handshake failed with remote 'tls://127.0.0.1:54598': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:02:27,252 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36611': TLS handshake failed with remote 'tls://127.0.0.1:54600': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:02:27,253 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:02:28,258 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:02:28,264 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45393 5986s 2024-11-23 22:02:28,264 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45879/status 5986s 2024-11-23 22:02:28,264 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:02:28,279 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38545 5986s 2024-11-23 22:02:28,279 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38545 5986s 2024-11-23 22:02:28,279 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:02:28,279 - distributed.worker - INFO - dashboard at: 127.0.0.1:39213 5986s 2024-11-23 22:02:28,279 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45393 5986s 2024-11-23 22:02:28,280 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:02:28,280 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:02:28,280 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:02:28,280 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-4mgd3r7b 5986s 2024-11-23 22:02:28,280 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:02:28,281 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37689 5986s 2024-11-23 22:02:28,282 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37689 5986s 2024-11-23 22:02:28,282 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:02:28,282 - distributed.worker - INFO - dashboard at: 127.0.0.1:41309 5986s 2024-11-23 22:02:28,282 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45393 5986s 2024-11-23 22:02:28,282 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:02:28,282 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:02:28,282 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:02:28,282 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-6x_j6our 5986s 2024-11-23 22:02:28,282 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:02:28,283 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38545. Reason: failure-to-start- 5986s 2024-11-23 22:02:28,283 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:02:28,284 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37689. Reason: failure-to-start- 5986s 2024-11-23 22:02:28,284 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:02:28,285 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45393': TLS handshake failed with remote 'tls://127.0.0.1:59396': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:02:28,285 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45393': TLS handshake failed with remote 'tls://127.0.0.1:59402': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:02:28,286 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:02:29,291 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:02:29,298 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44305 5986s 2024-11-23 22:02:29,298 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36905/status 5986s 2024-11-23 22:02:29,298 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:02:29,313 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42201 5986s 2024-11-23 22:02:29,313 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42201 5986s 2024-11-23 22:02:29,313 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:02:29,313 - distributed.worker - INFO - dashboard at: 127.0.0.1:45175 5986s 2024-11-23 22:02:29,313 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44305 5986s 2024-11-23 22:02:29,313 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:02:29,313 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:02:29,313 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:02:29,313 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-37yfa_r_ 5986s 2024-11-23 22:02:29,313 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:02:29,315 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45721 5986s 2024-11-23 22:02:29,315 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45721 5986s 2024-11-23 22:02:29,316 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:02:29,316 - distributed.worker - INFO - dashboard at: 127.0.0.1:45743 5986s 2024-11-23 22:02:29,316 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44305 5986s 2024-11-23 22:02:29,316 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:02:29,316 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:02:29,316 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:02:29,316 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-s9n53w61 5986s 2024-11-23 22:02:29,316 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:02:29,318 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42201. Reason: failure-to-start- 5986s 2024-11-23 22:02:29,318 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:02:29,319 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45721. Reason: failure-to-start- 5986s 2024-11-23 22:02:29,319 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:02:29,320 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44305': TLS handshake failed with remote 'tls://127.0.0.1:42636': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:02:29,320 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44305': TLS handshake failed with remote 'tls://127.0.0.1:42646': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:02:29,323 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:02:30,329 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:02:30,334 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34457 5986s 2024-11-23 22:02:30,335 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44947/status 5986s 2024-11-23 22:02:30,335 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:02:30,347 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45375 5986s 2024-11-23 22:02:30,347 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45375 5986s 2024-11-23 22:02:30,347 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:02:30,347 - distributed.worker - INFO - dashboard at: 127.0.0.1:37105 5986s 2024-11-23 22:02:30,347 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34457 5986s 2024-11-23 22:02:30,348 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:02:30,348 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:02:30,348 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:02:30,348 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-xcf6h2qy 5986s 2024-11-23 22:02:30,348 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:02:30,350 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33777 5986s 2024-11-23 22:02:30,350 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33777 5986s 2024-11-23 22:02:30,350 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:02:30,350 - distributed.worker - INFO - dashboard at: 127.0.0.1:43687 5986s 2024-11-23 22:02:30,350 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34457 5986s 2024-11-23 22:02:30,350 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:02:30,350 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:02:30,350 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:02:30,350 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-owp2mvzf 5986s 2024-11-23 22:02:30,350 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:02:30,351 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45375. Reason: failure-to-start- 5986s 2024-11-23 22:02:30,351 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:02:30,352 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33777. Reason: failure-to-start- 5986s 2024-11-23 22:02:30,352 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:02:30,352 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34457': TLS handshake failed with remote 'tls://127.0.0.1:47424': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:02:30,353 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34457': TLS handshake failed with remote 'tls://127.0.0.1:47436': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:02:30,354 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:02:31,361 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:02:31,369 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33643 5986s 2024-11-23 22:02:31,369 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45557/status 5986s 2024-11-23 22:02:31,370 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:02:31,382 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34075 5986s 2024-11-23 22:02:31,382 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34075 5986s 2024-11-23 22:02:31,382 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:02:31,382 - distributed.worker - INFO - dashboard at: 127.0.0.1:38413 5986s 2024-11-23 22:02:31,382 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33643 5986s 2024-11-23 22:02:31,382 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:02:31,382 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:02:31,382 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:02:31,383 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-kblnxlos 5986s 2024-11-23 22:02:31,383 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:02:31,384 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34669 5986s 2024-11-23 22:02:31,384 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34669 5986s 2024-11-23 22:02:31,384 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:02:31,384 - distributed.worker - INFO - dashboard at: 127.0.0.1:35511 5986s 2024-11-23 22:02:31,385 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33643 5986s 2024-11-23 22:02:31,385 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:02:31,385 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:02:31,385 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:02:31,385 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-pl5cdcr_ 5986s 2024-11-23 22:02:31,385 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:02:31,386 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34075. Reason: failure-to-start- 5986s 2024-11-23 22:02:31,386 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:02:31,386 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34669. Reason: failure-to-start- 5986s 2024-11-23 22:02:31,386 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:02:31,387 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33643': TLS handshake failed with remote 'tls://127.0.0.1:51016': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:02:31,387 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33643': TLS handshake failed with remote 'tls://127.0.0.1:51030': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:02:31,389 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:02:32,394 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:02:32,400 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34439 5986s 2024-11-23 22:02:32,401 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33693/status 5986s 2024-11-23 22:02:32,401 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:02:32,415 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44319 5986s 2024-11-23 22:02:32,415 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44319 5986s 2024-11-23 22:02:32,415 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:02:32,415 - distributed.worker - INFO - dashboard at: 127.0.0.1:45687 5986s 2024-11-23 22:02:32,415 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34439 5986s 2024-11-23 22:02:32,415 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:02:32,415 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:02:32,416 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:02:32,416 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-qe15aqr3 5986s 2024-11-23 22:02:32,416 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:02:32,418 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40897 5986s 2024-11-23 22:02:32,418 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40897 5986s 2024-11-23 22:02:32,418 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:02:32,418 - distributed.worker - INFO - dashboard at: 127.0.0.1:42731 5986s 2024-11-23 22:02:32,418 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34439 5986s 2024-11-23 22:02:32,418 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:02:32,418 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:02:32,418 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:02:32,418 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-i6dtlwfe 5986s 2024-11-23 22:02:32,418 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:02:32,419 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44319. Reason: failure-to-start- 5986s 2024-11-23 22:02:32,419 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:02:32,420 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40897. Reason: failure-to-start- 5986s 2024-11-23 22:02:32,420 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:02:32,421 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34439': TLS handshake failed with remote 'tls://127.0.0.1:44006': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:02:32,421 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34439': TLS handshake failed with remote 'tls://127.0.0.1:44020': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:02:32,422 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:02:33,429 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:02:33,435 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33327 5986s 2024-11-23 22:02:33,435 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35573/status 5986s 2024-11-23 22:02:33,435 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:02:33,448 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43843 5986s 2024-11-23 22:02:33,448 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43843 5986s 2024-11-23 22:02:33,448 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:02:33,448 - distributed.worker - INFO - dashboard at: 127.0.0.1:43399 5986s 2024-11-23 22:02:33,448 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33327 5986s 2024-11-23 22:02:33,448 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:02:33,448 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:02:33,448 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:02:33,448 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-_rt73y2j 5986s 2024-11-23 22:02:33,448 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:02:33,451 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41065 5986s 2024-11-23 22:02:33,451 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41065 5986s 2024-11-23 22:02:33,451 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:02:33,451 - distributed.worker - INFO - dashboard at: 127.0.0.1:40233 5986s 2024-11-23 22:02:33,451 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33327 5986s 2024-11-23 22:02:33,451 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:02:33,451 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:02:33,452 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:02:33,452 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-pmy916g9 5986s 2024-11-23 22:02:33,452 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:02:33,453 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43843. Reason: failure-to-start- 5986s 2024-11-23 22:02:33,453 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:02:33,453 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41065. Reason: failure-to-start- 5986s 2024-11-23 22:02:33,453 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:02:33,454 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33327': TLS handshake failed with remote 'tls://127.0.0.1:42366': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:02:33,454 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33327': TLS handshake failed with remote 'tls://127.0.0.1:42368': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:02:33,456 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:02:34,461 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:02:34,467 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40699 5986s 2024-11-23 22:02:34,467 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34557/status 5986s 2024-11-23 22:02:34,467 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:02:34,479 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40567 5986s 2024-11-23 22:02:34,480 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40567 5986s 2024-11-23 22:02:34,480 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:02:34,480 - distributed.worker - INFO - dashboard at: 127.0.0.1:41517 5986s 2024-11-23 22:02:34,480 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40699 5986s 2024-11-23 22:02:34,480 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:02:34,480 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:02:34,480 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:02:34,480 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-4ir2rnhp 5986s 2024-11-23 22:02:34,480 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:02:34,482 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42325 5986s 2024-11-23 22:02:34,482 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42325 5986s 2024-11-23 22:02:34,482 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:02:34,482 - distributed.worker - INFO - dashboard at: 127.0.0.1:35189 5986s 2024-11-23 22:02:34,482 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40699 5986s 2024-11-23 22:02:34,482 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:02:34,482 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:02:34,482 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:02:34,482 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-92fxg51d 5986s 2024-11-23 22:02:34,483 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:02:34,484 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40567. Reason: failure-to-start- 5986s 2024-11-23 22:02:34,484 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:02:34,484 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42325. Reason: failure-to-start- 5986s 2024-11-23 22:02:34,484 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:02:34,485 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40699': TLS handshake failed with remote 'tls://127.0.0.1:45482': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:02:34,485 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40699': TLS handshake failed with remote 'tls://127.0.0.1:45494': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:02:34,487 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:02:35,493 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:02:35,500 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46857 5986s 2024-11-23 22:02:35,500 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34175/status 5986s 2024-11-23 22:02:35,500 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:02:35,513 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34479 5986s 2024-11-23 22:02:35,514 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34479 5986s 2024-11-23 22:02:35,514 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:02:35,514 - distributed.worker - INFO - dashboard at: 127.0.0.1:36037 5986s 2024-11-23 22:02:35,514 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46857 5986s 2024-11-23 22:02:35,514 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:02:35,514 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:02:35,514 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:02:35,514 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-lqredh__ 5986s 2024-11-23 22:02:35,514 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:02:35,516 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:32907 5986s 2024-11-23 22:02:35,516 - distributed.worker - INFO - Listening to: tls://127.0.0.1:32907 5986s 2024-11-23 22:02:35,516 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:02:35,516 - distributed.worker - INFO - dashboard at: 127.0.0.1:36841 5986s 2024-11-23 22:02:35,516 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46857 5986s 2024-11-23 22:02:35,516 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:02:35,516 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:02:35,516 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:02:35,517 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-jsfjeklq 5986s 2024-11-23 22:02:35,517 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:02:35,518 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34479. Reason: failure-to-start- 5986s 2024-11-23 22:02:35,518 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:02:35,518 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:32907. Reason: failure-to-start- 5986s 2024-11-23 22:02:35,519 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:02:35,520 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46857': TLS handshake failed with remote 'tls://127.0.0.1:44318': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:02:35,520 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46857': TLS handshake failed with remote 'tls://127.0.0.1:44328': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:02:35,523 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:02:36,530 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:02:36,538 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35143 5986s 2024-11-23 22:02:36,539 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37613/status 5986s 2024-11-23 22:02:36,539 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:02:36,552 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42925 5986s 2024-11-23 22:02:36,553 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42925 5986s 2024-11-23 22:02:36,553 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:02:36,553 - distributed.worker - INFO - dashboard at: 127.0.0.1:36027 5986s 2024-11-23 22:02:36,553 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35143 5986s 2024-11-23 22:02:36,553 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:02:36,553 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:02:36,553 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:02:36,553 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-3sopwz3c 5986s 2024-11-23 22:02:36,553 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:02:36,555 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43387 5986s 2024-11-23 22:02:36,555 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43387 5986s 2024-11-23 22:02:36,555 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:02:36,555 - distributed.worker - INFO - dashboard at: 127.0.0.1:40381 5986s 2024-11-23 22:02:36,555 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35143 5986s 2024-11-23 22:02:36,555 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:02:36,555 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:02:36,555 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:02:36,555 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-hwdeezz1 5986s 2024-11-23 22:02:36,555 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:02:36,556 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42925. Reason: failure-to-start- 5986s 2024-11-23 22:02:36,557 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:02:36,557 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43387. Reason: failure-to-start- 5986s 2024-11-23 22:02:36,557 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:02:36,560 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35143': TLS handshake failed with remote 'tls://127.0.0.1:44088': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:02:36,560 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35143': TLS handshake failed with remote 'tls://127.0.0.1:44098': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:02:36,562 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:02:37,567 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:02:37,573 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33163 5986s 2024-11-23 22:02:37,573 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38095/status 5986s 2024-11-23 22:02:37,573 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:02:37,587 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41543 5986s 2024-11-23 22:02:37,588 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41543 5986s 2024-11-23 22:02:37,588 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:02:37,588 - distributed.worker - INFO - dashboard at: 127.0.0.1:44817 5986s 2024-11-23 22:02:37,588 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33163 5986s 2024-11-23 22:02:37,588 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:02:37,588 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:02:37,588 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:02:37,588 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-bskmg0ma 5986s 2024-11-23 22:02:37,588 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:02:37,590 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45357 5986s 2024-11-23 22:02:37,591 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45357 5986s 2024-11-23 22:02:37,591 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:02:37,591 - distributed.worker - INFO - dashboard at: 127.0.0.1:46809 5986s 2024-11-23 22:02:37,591 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33163 5986s 2024-11-23 22:02:37,591 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:02:37,591 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:02:37,591 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:02:37,591 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-u8n6mw_2 5986s 2024-11-23 22:02:37,591 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:02:37,596 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41543. Reason: failure-to-start- 5986s 2024-11-23 22:02:37,596 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:02:37,596 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45357. Reason: failure-to-start- 5986s 2024-11-23 22:02:37,597 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:02:37,598 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33163': TLS handshake failed with remote 'tls://127.0.0.1:46512': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:02:37,598 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33163': TLS handshake failed with remote 'tls://127.0.0.1:46514': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:02:37,599 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:02:38,606 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:02:38,613 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36441 5986s 2024-11-23 22:02:38,614 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34755/status 5986s 2024-11-23 22:02:38,614 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:02:38,628 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37917 5986s 2024-11-23 22:02:38,628 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37917 5986s 2024-11-23 22:02:38,628 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:02:38,628 - distributed.worker - INFO - dashboard at: 127.0.0.1:34423 5986s 2024-11-23 22:02:38,628 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36441 5986s 2024-11-23 22:02:38,628 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:02:38,628 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:02:38,628 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:02:38,628 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-8j54ciki 5986s 2024-11-23 22:02:38,628 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:02:38,630 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35167 5986s 2024-11-23 22:02:38,630 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35167 5986s 2024-11-23 22:02:38,630 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:02:38,631 - distributed.worker - INFO - dashboard at: 127.0.0.1:35525 5986s 2024-11-23 22:02:38,632 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36441 5986s 2024-11-23 22:02:38,632 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:02:38,632 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:02:38,632 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:02:38,632 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-2651hfcp 5986s 2024-11-23 22:02:38,632 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:02:38,635 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37917. Reason: failure-to-start- 5986s 2024-11-23 22:02:38,636 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:02:38,636 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35167. Reason: failure-to-start- 5986s 2024-11-23 22:02:38,636 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:02:38,637 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36441': TLS handshake failed with remote 'tls://127.0.0.1:50406': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:02:38,637 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36441': TLS handshake failed with remote 'tls://127.0.0.1:50420': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:02:38,641 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s __________________________________ test_nanny __________________________________ 5986s 5986s fut = , timeout = 0 5986s 5986s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 5986s async with asyncio.timeout(timeout): 5986s > return await fut 5986s 5986s /usr/lib/python3/dist-packages/distributed/utils.py:1960: 5986s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5986s /usr/lib/python3/dist-packages/distributed/nanny.py:358: in start_unsafe 5986s comm = await self.rpc.connect(saddr) 5986s /usr/lib/python3/dist-packages/distributed/core.py:1620: in connect 5986s return await self._connect(addr=addr, timeout=timeout) 5986s /usr/lib/python3/dist-packages/distributed/core.py:1564: in _connect 5986s comm = await connect( 5986s /usr/lib/python3/dist-packages/distributed/comm/core.py:342: in connect 5986s comm = await wait_for( 5986s /usr/lib/python3/dist-packages/distributed/utils.py:1960: in wait_for 5986s return await fut 5986s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:546: in connect 5986s stream = await self.client.connect( 5986s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5986s 5986s self = , host = '127.0.0.1' 5986s port = 39181, af = 5986s ssl_options = 5986s max_buffer_size = 8364507136.0, source_ip = None, source_port = None 5986s timeout = None 5986s 5986s async def connect( 5986s self, 5986s host: str, 5986s port: int, 5986s af: socket.AddressFamily = socket.AF_UNSPEC, 5986s ssl_options: Optional[Union[Dict[str, Any], ssl.SSLContext]] = None, 5986s max_buffer_size: Optional[int] = None, 5986s source_ip: Optional[str] = None, 5986s source_port: Optional[int] = None, 5986s timeout: Optional[Union[float, datetime.timedelta]] = None, 5986s ) -> IOStream: 5986s """Connect to the given host and port. 5986s 5986s Asynchronously returns an `.IOStream` (or `.SSLIOStream` if 5986s ``ssl_options`` is not None). 5986s 5986s Using the ``source_ip`` kwarg, one can specify the source 5986s IP address to use when establishing the connection. 5986s In case the user needs to resolve and 5986s use a specific interface, it has to be handled outside 5986s of Tornado as this depends very much on the platform. 5986s 5986s Raises `TimeoutError` if the input future does not complete before 5986s ``timeout``, which may be specified in any form allowed by 5986s `.IOLoop.add_timeout` (i.e. a `datetime.timedelta` or an absolute time 5986s relative to `.IOLoop.time`) 5986s 5986s Similarly, when the user requires a certain source port, it can 5986s be specified using the ``source_port`` arg. 5986s 5986s .. versionchanged:: 4.5 5986s Added the ``source_ip`` and ``source_port`` arguments. 5986s 5986s .. versionchanged:: 5.0 5986s Added the ``timeout`` argument. 5986s """ 5986s if timeout is not None: 5986s if isinstance(timeout, numbers.Real): 5986s timeout = IOLoop.current().time() + timeout 5986s elif isinstance(timeout, datetime.timedelta): 5986s timeout = IOLoop.current().time() + timeout.total_seconds() 5986s else: 5986s raise TypeError("Unsupported timeout %r" % timeout) 5986s if timeout is not None: 5986s addrinfo = await gen.with_timeout( 5986s timeout, self.resolver.resolve(host, port, af) 5986s ) 5986s else: 5986s addrinfo = await self.resolver.resolve(host, port, af) 5986s connector = _Connector( 5986s addrinfo, 5986s functools.partial( 5986s self._create_stream, 5986s max_buffer_size, 5986s source_ip=source_ip, 5986s source_port=source_port, 5986s ), 5986s ) 5986s > af, addr, stream = await connector.start(connect_timeout=timeout) 5986s E asyncio.exceptions.CancelledError 5986s 5986s /usr/lib/python3/dist-packages/tornado/tcpclient.py:279: CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s self = 5986s 5986s @final 5986s async def start(self): 5986s async with self._startup_lock: 5986s if self.status == Status.failed: 5986s assert self.__startup_exc is not None 5986s raise self.__startup_exc 5986s elif self.status != Status.init: 5986s return self 5986s timeout = getattr(self, "death_timeout", None) 5986s 5986s async def _close_on_failure(exc: Exception) -> None: 5986s await self.close(reason=f"failure-to-start-{str(type(exc))}") 5986s self.status = Status.failed 5986s self.__startup_exc = exc 5986s 5986s try: 5986s > await wait_for(self.start_unsafe(), timeout=timeout) 5986s 5986s /usr/lib/python3/dist-packages/distributed/core.py:664: 5986s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5986s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 5986s async with asyncio.timeout(timeout): 5986s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5986s 5986s self = 5986s exc_type = 5986s exc_val = CancelledError(), exc_tb = 5986s 5986s async def __aexit__( 5986s self, 5986s exc_type: Optional[Type[BaseException]], 5986s exc_val: Optional[BaseException], 5986s exc_tb: Optional[TracebackType], 5986s ) -> Optional[bool]: 5986s assert self._state in (_State.ENTERED, _State.EXPIRING) 5986s 5986s if self._timeout_handler is not None: 5986s self._timeout_handler.cancel() 5986s self._timeout_handler = None 5986s 5986s if self._state is _State.EXPIRING: 5986s self._state = _State.EXPIRED 5986s 5986s if self._task.uncancel() <= self._cancelling and exc_type is not None: 5986s # Since there are no new cancel requests, we're 5986s # handling this. 5986s if issubclass(exc_type, exceptions.CancelledError): 5986s > raise TimeoutError from exc_val 5986s E TimeoutError 5986s 5986s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s @contextlib.asynccontextmanager 5986s async def _cluster_factory(): 5986s workers = [] 5986s s = None 5986s try: 5986s for _ in range(60): 5986s try: 5986s > s, ws = await start_cluster( 5986s nthreads, 5986s scheduler, 5986s security=security, 5986s Worker=Worker, 5986s scheduler_kwargs=scheduler_kwargs, 5986s worker_kwargs=merge( 5986s {"death_timeout": min(15, int(deadline.remaining))}, 5986s worker_kwargs, 5986s ), 5986s ) 5986s 5986s /usr/lib/python3/dist-packages/distributed/utils_test.py:966: 5986s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5986s /usr/lib/python3/dist-packages/distributed/utils_test.py:789: in start_cluster 5986s await asyncio.gather(*workers) 5986s /usr/lib/python3.13/asyncio/tasks.py:737: in _wrap_awaitable 5986s return await awaitable 5986s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5986s 5986s self = 5986s 5986s @final 5986s async def start(self): 5986s async with self._startup_lock: 5986s if self.status == Status.failed: 5986s assert self.__startup_exc is not None 5986s raise self.__startup_exc 5986s elif self.status != Status.init: 5986s return self 5986s timeout = getattr(self, "death_timeout", None) 5986s 5986s async def _close_on_failure(exc: Exception) -> None: 5986s await self.close(reason=f"failure-to-start-{str(type(exc))}") 5986s self.status = Status.failed 5986s self.__startup_exc = exc 5986s 5986s try: 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s except asyncio.TimeoutError as exc: 5986s await _close_on_failure(exc) 5986s > raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s E TimeoutError: Nanny start timed out after 0s. 5986s 5986s /usr/lib/python3/dist-packages/distributed/core.py:667: TimeoutError 5986s 5986s During handling of the above exception, another exception occurred: 5986s 5986s fut = ._..test_func..async_fn at 0xde6cc028> 5986s timeout = 60 5986s 5986s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 5986s async with asyncio.timeout(timeout): 5986s > return await fut 5986s 5986s /usr/lib/python3/dist-packages/distributed/utils.py:1960: 5986s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5986s /usr/lib/python3/dist-packages/distributed/utils_test.py:999: in async_fn 5986s _cluster_factory() as (s, workers), 5986s /usr/lib/python3.13/contextlib.py:214: in __aenter__ 5986s return await anext(self.gen) 5986s /usr/lib/python3/dist-packages/distributed/utils_test.py:983: in _cluster_factory 5986s await asyncio.sleep(1) 5986s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5986s 5986s delay = 1, result = None 5986s 5986s async def sleep(delay, result=None): 5986s """Coroutine that completes after a given time (in seconds).""" 5986s if delay <= 0: 5986s await __sleep0() 5986s return result 5986s 5986s if math.isnan(delay): 5986s raise ValueError("Invalid delay: NaN (not a number)") 5986s 5986s loop = events.get_running_loop() 5986s future = loop.create_future() 5986s h = loop.call_later(delay, 5986s futures._set_result_unless_cancelled, 5986s future, result) 5986s try: 5986s > return await future 5986s E asyncio.exceptions.CancelledError 5986s 5986s /usr/lib/python3.13/asyncio/tasks.py:718: CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s args = (), kwds = {} 5986s 5986s @wraps(func) 5986s def inner(*args, **kwds): 5986s with self._recreate_cm(): 5986s > return func(*args, **kwds) 5986s 5986s /usr/lib/python3.13/contextlib.py:85: 5986s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5986s /usr/lib/python3.13/contextlib.py:85: in inner 5986s return func(*args, **kwds) 5986s /usr/lib/python3/dist-packages/distributed/utils_test.py:1102: in test_func 5986s return _run_and_close_tornado(async_fn_outer) 5986s /usr/lib/python3/dist-packages/distributed/utils_test.py:378: in _run_and_close_tornado 5986s return asyncio_run(inner_fn(), loop_factory=get_loop_factory()) 5986s /usr/lib/python3.13/asyncio/runners.py:194: in run 5986s return runner.run(main) 5986s /usr/lib/python3.13/asyncio/runners.py:118: in run 5986s return self._loop.run_until_complete(task) 5986s /usr/lib/python3.13/asyncio/base_events.py:720: in run_until_complete 5986s return future.result() 5986s /usr/lib/python3/dist-packages/distributed/utils_test.py:375: in inner_fn 5986s return await async_fn(*args, **kwargs) 5986s /usr/lib/python3/dist-packages/distributed/utils_test.py:1099: in async_fn_outer 5986s return await utils_wait_for(async_fn(), timeout=timeout * 2) 5986s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 5986s async with asyncio.timeout(timeout): 5986s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5986s 5986s self = 5986s exc_type = 5986s exc_val = CancelledError(), exc_tb = 5986s 5986s async def __aexit__( 5986s self, 5986s exc_type: Optional[Type[BaseException]], 5986s exc_val: Optional[BaseException], 5986s exc_tb: Optional[TracebackType], 5986s ) -> Optional[bool]: 5986s assert self._state in (_State.ENTERED, _State.EXPIRING) 5986s 5986s if self._timeout_handler is not None: 5986s self._timeout_handler.cancel() 5986s self._timeout_handler = None 5986s 5986s if self._state is _State.EXPIRING: 5986s self._state = _State.EXPIRED 5986s 5986s if self._task.uncancel() <= self._cancelling and exc_type is not None: 5986s # Since there are no new cancel requests, we're 5986s # handling this. 5986s if issubclass(exc_type, exceptions.CancelledError): 5986s > raise TimeoutError from exc_val 5986s E TimeoutError 5986s 5986s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 5986s ----------------------------- Captured stderr call ----------------------------- 5986s 2024-11-23 22:02:40,052 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:02:40,059 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40671 5986s 2024-11-23 22:02:40,059 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37825/status 5986s 2024-11-23 22:02:40,059 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:02:40,082 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:33283'. Reason: failure-to-start- 5986s 2024-11-23 22:02:40,082 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:44913'. Reason: failure-to-start- 5986s 2024-11-23 22:02:40,082 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40671': TLS handshake failed with remote 'tls://127.0.0.1:54888': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:40,082 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40671': TLS handshake failed with remote 'tls://127.0.0.1:54890': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:40,082 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 5986s stream = await stream.start_tls( 5986s ^^^^^^^^^^^^^^^^^^^^^^^ 5986s False, ssl_options=ssl_options, server_hostname=host 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 5986s self.socket.do_handshake() 5986s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 5986s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 5986s self._sslobj.do_handshake() 5986s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 5986s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5986s comm = await self.rpc.connect(saddr) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 5986s return await self._connect(addr=addr, timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 5986s comm = await connect( 5986s ^^^^^^^^^^^^^^ 5986s ...<4 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 5986s raise FatalCommClosedError( 5986s ...<2 lines>... 5986s ) from err 5986s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 5986s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 5986s RuntimeError: Nanny failed to start. 5986s 2024-11-23 22:02:41,088 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:02:41,094 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44363 5986s 2024-11-23 22:02:41,095 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41903/status 5986s 2024-11-23 22:02:41,095 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:02:41,118 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:33327'. Reason: failure-to-start- 5986s 2024-11-23 22:02:41,118 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:45025'. Reason: failure-to-start- 5986s 2024-11-23 22:02:41,119 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44363': TLS handshake failed with remote 'tls://127.0.0.1:47178': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:41,119 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44363': TLS handshake failed with remote 'tls://127.0.0.1:47190': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:41,119 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 5986s stream = await stream.start_tls( 5986s ^^^^^^^^^^^^^^^^^^^^^^^ 5986s False, ssl_options=ssl_options, server_hostname=host 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 5986s self.socket.do_handshake() 5986s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 5986s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 5986s self._sslobj.do_handshake() 5986s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 5986s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5986s comm = await self.rpc.connect(saddr) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 5986s return await self._connect(addr=addr, timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 5986s comm = await connect( 5986s ^^^^^^^^^^^^^^ 5986s ...<4 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 5986s raise FatalCommClosedError( 5986s ...<2 lines>... 5986s ) from err 5986s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 5986s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 5986s RuntimeError: Nanny failed to start. 5986s 2024-11-23 22:02:42,124 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:02:42,130 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39239 5986s 2024-11-23 22:02:42,130 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33851/status 5986s 2024-11-23 22:02:42,131 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:02:42,152 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:33201'. Reason: failure-to-start- 5986s 2024-11-23 22:02:42,152 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:46797'. Reason: failure-to-start- 5986s 2024-11-23 22:02:42,152 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39239': TLS handshake failed with remote 'tls://127.0.0.1:51748': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:42,152 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39239': TLS handshake failed with remote 'tls://127.0.0.1:51752': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:42,152 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 5986s stream = await stream.start_tls( 5986s ^^^^^^^^^^^^^^^^^^^^^^^ 5986s False, ssl_options=ssl_options, server_hostname=host 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 5986s self.socket.do_handshake() 5986s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 5986s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 5986s self._sslobj.do_handshake() 5986s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 5986s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5986s comm = await self.rpc.connect(saddr) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 5986s return await self._connect(addr=addr, timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 5986s comm = await connect( 5986s ^^^^^^^^^^^^^^ 5986s ...<4 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 5986s raise FatalCommClosedError( 5986s ...<2 lines>... 5986s ) from err 5986s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 5986s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 5986s RuntimeError: Nanny failed to start. 5986s 2024-11-23 22:02:43,157 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:02:43,164 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41521 5986s 2024-11-23 22:02:43,164 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41673/status 5986s 2024-11-23 22:02:43,164 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:02:43,187 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:40309'. Reason: failure-to-start- 5986s 2024-11-23 22:02:43,187 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:37713'. Reason: failure-to-start- 5986s 2024-11-23 22:02:43,188 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41521': TLS handshake failed with remote 'tls://127.0.0.1:34304': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:43,188 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41521': TLS handshake failed with remote 'tls://127.0.0.1:34306': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:43,188 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 5986s stream = await stream.start_tls( 5986s ^^^^^^^^^^^^^^^^^^^^^^^ 5986s False, ssl_options=ssl_options, server_hostname=host 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 5986s self.socket.do_handshake() 5986s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 5986s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 5986s self._sslobj.do_handshake() 5986s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 5986s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5986s comm = await self.rpc.connect(saddr) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 5986s return await self._connect(addr=addr, timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 5986s comm = await connect( 5986s ^^^^^^^^^^^^^^ 5986s ...<4 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 5986s raise FatalCommClosedError( 5986s ...<2 lines>... 5986s ) from err 5986s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 5986s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 5986s RuntimeError: Nanny failed to start. 5986s 2024-11-23 22:02:44,193 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:02:44,200 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39529 5986s 2024-11-23 22:02:44,200 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41981/status 5986s 2024-11-23 22:02:44,200 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:02:44,221 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:33057'. Reason: failure-to-start- 5986s 2024-11-23 22:02:44,222 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:43199'. Reason: failure-to-start- 5986s 2024-11-23 22:02:44,222 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39529': TLS handshake failed with remote 'tls://127.0.0.1:42182': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:44,222 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39529': TLS handshake failed with remote 'tls://127.0.0.1:42184': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:44,222 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 5986s stream = await stream.start_tls( 5986s ^^^^^^^^^^^^^^^^^^^^^^^ 5986s False, ssl_options=ssl_options, server_hostname=host 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 5986s self.socket.do_handshake() 5986s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 5986s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 5986s self._sslobj.do_handshake() 5986s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 5986s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5986s comm = await self.rpc.connect(saddr) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 5986s return await self._connect(addr=addr, timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 5986s comm = await connect( 5986s ^^^^^^^^^^^^^^ 5986s ...<4 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 5986s raise FatalCommClosedError( 5986s ...<2 lines>... 5986s ) from err 5986s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 5986s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 5986s RuntimeError: Nanny failed to start. 5986s 2024-11-23 22:02:45,227 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:02:45,233 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37023 5986s 2024-11-23 22:02:45,234 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34345/status 5986s 2024-11-23 22:02:45,234 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:02:45,259 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:39305'. Reason: failure-to-start- 5986s 2024-11-23 22:02:45,260 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:33889'. Reason: failure-to-start- 5986s 2024-11-23 22:02:45,260 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37023': TLS handshake failed with remote 'tls://127.0.0.1:36962': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:45,260 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37023': TLS handshake failed with remote 'tls://127.0.0.1:36964': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:45,260 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 5986s stream = await stream.start_tls( 5986s ^^^^^^^^^^^^^^^^^^^^^^^ 5986s False, ssl_options=ssl_options, server_hostname=host 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 5986s self.socket.do_handshake() 5986s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 5986s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 5986s self._sslobj.do_handshake() 5986s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 5986s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5986s comm = await self.rpc.connect(saddr) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 5986s return await self._connect(addr=addr, timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 5986s comm = await connect( 5986s ^^^^^^^^^^^^^^ 5986s ...<4 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 5986s raise FatalCommClosedError( 5986s ...<2 lines>... 5986s ) from err 5986s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 5986s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 5986s RuntimeError: Nanny failed to start. 5986s 2024-11-23 22:02:46,266 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:02:46,273 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44961 5986s 2024-11-23 22:02:46,273 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38009/status 5986s 2024-11-23 22:02:46,273 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:02:46,295 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:34261'. Reason: failure-to-start- 5986s 2024-11-23 22:02:46,296 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:36453'. Reason: failure-to-start- 5986s 2024-11-23 22:02:46,296 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44961': TLS handshake failed with remote 'tls://127.0.0.1:47018': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:46,296 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44961': TLS handshake failed with remote 'tls://127.0.0.1:47024': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:46,296 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 5986s stream = await stream.start_tls( 5986s ^^^^^^^^^^^^^^^^^^^^^^^ 5986s False, ssl_options=ssl_options, server_hostname=host 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 5986s self.socket.do_handshake() 5986s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 5986s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 5986s self._sslobj.do_handshake() 5986s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 5986s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5986s comm = await self.rpc.connect(saddr) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 5986s return await self._connect(addr=addr, timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 5986s comm = await connect( 5986s ^^^^^^^^^^^^^^ 5986s ...<4 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 5986s raise FatalCommClosedError( 5986s ...<2 lines>... 5986s ) from err 5986s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 5986s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 5986s RuntimeError: Nanny failed to start. 5986s 2024-11-23 22:02:47,302 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:02:47,308 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41619 5986s 2024-11-23 22:02:47,308 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43599/status 5986s 2024-11-23 22:02:47,309 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:02:47,330 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:37935'. Reason: failure-to-start- 5986s 2024-11-23 22:02:47,330 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:40435'. Reason: failure-to-start- 5986s 2024-11-23 22:02:47,331 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41619': TLS handshake failed with remote 'tls://127.0.0.1:52230': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:47,331 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41619': TLS handshake failed with remote 'tls://127.0.0.1:52242': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:47,331 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 5986s stream = await stream.start_tls( 5986s ^^^^^^^^^^^^^^^^^^^^^^^ 5986s False, ssl_options=ssl_options, server_hostname=host 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 5986s self.socket.do_handshake() 5986s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 5986s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 5986s self._sslobj.do_handshake() 5986s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 5986s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5986s comm = await self.rpc.connect(saddr) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 5986s return await self._connect(addr=addr, timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 5986s comm = await connect( 5986s ^^^^^^^^^^^^^^ 5986s ...<4 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 5986s raise FatalCommClosedError( 5986s ...<2 lines>... 5986s ) from err 5986s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 5986s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 5986s RuntimeError: Nanny failed to start. 5986s 2024-11-23 22:02:48,337 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:02:48,343 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39717 5986s 2024-11-23 22:02:48,343 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34415/status 5986s 2024-11-23 22:02:48,343 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:02:48,365 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:40835'. Reason: failure-to-start- 5986s 2024-11-23 22:02:48,365 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:41431'. Reason: failure-to-start- 5986s 2024-11-23 22:02:48,365 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39717': TLS handshake failed with remote 'tls://127.0.0.1:47782': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:48,366 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39717': TLS handshake failed with remote 'tls://127.0.0.1:47786': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:48,366 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 5986s stream = await stream.start_tls( 5986s ^^^^^^^^^^^^^^^^^^^^^^^ 5986s False, ssl_options=ssl_options, server_hostname=host 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 5986s self.socket.do_handshake() 5986s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 5986s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 5986s self._sslobj.do_handshake() 5986s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 5986s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5986s comm = await self.rpc.connect(saddr) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 5986s return await self._connect(addr=addr, timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 5986s comm = await connect( 5986s ^^^^^^^^^^^^^^ 5986s ...<4 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 5986s raise FatalCommClosedError( 5986s ...<2 lines>... 5986s ) from err 5986s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 5986s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 5986s RuntimeError: Nanny failed to start. 5986s 2024-11-23 22:02:49,371 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:02:49,378 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45989 5986s 2024-11-23 22:02:49,378 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36945/status 5986s 2024-11-23 22:02:49,378 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:02:49,400 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:40589'. Reason: failure-to-start- 5986s 2024-11-23 22:02:49,400 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:41753'. Reason: failure-to-start- 5986s 2024-11-23 22:02:49,401 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45989': TLS handshake failed with remote 'tls://127.0.0.1:41476': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:49,401 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45989': TLS handshake failed with remote 'tls://127.0.0.1:41488': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:49,401 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 5986s stream = await stream.start_tls( 5986s ^^^^^^^^^^^^^^^^^^^^^^^ 5986s False, ssl_options=ssl_options, server_hostname=host 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 5986s self.socket.do_handshake() 5986s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 5986s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 5986s self._sslobj.do_handshake() 5986s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 5986s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5986s comm = await self.rpc.connect(saddr) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 5986s return await self._connect(addr=addr, timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 5986s comm = await connect( 5986s ^^^^^^^^^^^^^^ 5986s ...<4 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 5986s raise FatalCommClosedError( 5986s ...<2 lines>... 5986s ) from err 5986s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 5986s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 5986s RuntimeError: Nanny failed to start. 5986s 2024-11-23 22:02:50,408 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:02:50,414 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46777 5986s 2024-11-23 22:02:50,415 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46577/status 5986s 2024-11-23 22:02:50,415 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:02:50,437 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:39749'. Reason: failure-to-start- 5986s 2024-11-23 22:02:50,437 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:46051'. Reason: failure-to-start- 5986s 2024-11-23 22:02:50,438 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46777': TLS handshake failed with remote 'tls://127.0.0.1:34822': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:50,438 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46777': TLS handshake failed with remote 'tls://127.0.0.1:34834': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:50,438 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 5986s stream = await stream.start_tls( 5986s ^^^^^^^^^^^^^^^^^^^^^^^ 5986s False, ssl_options=ssl_options, server_hostname=host 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 5986s self.socket.do_handshake() 5986s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 5986s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 5986s self._sslobj.do_handshake() 5986s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 5986s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5986s comm = await self.rpc.connect(saddr) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 5986s return await self._connect(addr=addr, timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 5986s comm = await connect( 5986s ^^^^^^^^^^^^^^ 5986s ...<4 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 5986s raise FatalCommClosedError( 5986s ...<2 lines>... 5986s ) from err 5986s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 5986s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 5986s RuntimeError: Nanny failed to start. 5986s 2024-11-23 22:02:51,444 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:02:51,450 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35955 5986s 2024-11-23 22:02:51,450 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43579/status 5986s 2024-11-23 22:02:51,451 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:02:51,473 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:46139'. Reason: failure-to-start- 5986s 2024-11-23 22:02:51,474 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:44667'. Reason: failure-to-start- 5986s 2024-11-23 22:02:51,475 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35955': TLS handshake failed with remote 'tls://127.0.0.1:38094': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:51,475 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35955': TLS handshake failed with remote 'tls://127.0.0.1:38102': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:51,475 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 5986s stream = await stream.start_tls( 5986s ^^^^^^^^^^^^^^^^^^^^^^^ 5986s False, ssl_options=ssl_options, server_hostname=host 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 5986s self.socket.do_handshake() 5986s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 5986s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 5986s self._sslobj.do_handshake() 5986s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 5986s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5986s comm = await self.rpc.connect(saddr) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 5986s return await self._connect(addr=addr, timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 5986s comm = await connect( 5986s ^^^^^^^^^^^^^^ 5986s ...<4 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 5986s raise FatalCommClosedError( 5986s ...<2 lines>... 5986s ) from err 5986s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 5986s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 5986s RuntimeError: Nanny failed to start. 5986s 2024-11-23 22:02:52,481 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:02:52,487 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34941 5986s 2024-11-23 22:02:52,488 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38257/status 5986s 2024-11-23 22:02:52,488 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:02:52,510 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:36169'. Reason: failure-to-start- 5986s 2024-11-23 22:02:52,510 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:35181'. Reason: failure-to-start- 5986s 2024-11-23 22:02:52,511 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34941': TLS handshake failed with remote 'tls://127.0.0.1:34056': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:52,511 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34941': TLS handshake failed with remote 'tls://127.0.0.1:34058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:52,511 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 5986s stream = await stream.start_tls( 5986s ^^^^^^^^^^^^^^^^^^^^^^^ 5986s False, ssl_options=ssl_options, server_hostname=host 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 5986s self.socket.do_handshake() 5986s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 5986s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 5986s self._sslobj.do_handshake() 5986s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 5986s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5986s comm = await self.rpc.connect(saddr) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 5986s return await self._connect(addr=addr, timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 5986s comm = await connect( 5986s ^^^^^^^^^^^^^^ 5986s ...<4 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 5986s raise FatalCommClosedError( 5986s ...<2 lines>... 5986s ) from err 5986s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 5986s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 5986s RuntimeError: Nanny failed to start. 5986s 2024-11-23 22:02:53,517 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:02:53,525 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44847 5986s 2024-11-23 22:02:53,525 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44073/status 5986s 2024-11-23 22:02:53,525 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:02:53,550 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:37771'. Reason: failure-to-start- 5986s 2024-11-23 22:02:53,551 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:43503'. Reason: failure-to-start- 5986s 2024-11-23 22:02:53,551 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44847': TLS handshake failed with remote 'tls://127.0.0.1:35224': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:53,551 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44847': TLS handshake failed with remote 'tls://127.0.0.1:35236': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:53,552 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 5986s stream = await stream.start_tls( 5986s ^^^^^^^^^^^^^^^^^^^^^^^ 5986s False, ssl_options=ssl_options, server_hostname=host 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 5986s self.socket.do_handshake() 5986s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 5986s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 5986s self._sslobj.do_handshake() 5986s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 5986s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5986s comm = await self.rpc.connect(saddr) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 5986s return await self._connect(addr=addr, timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 5986s comm = await connect( 5986s ^^^^^^^^^^^^^^ 5986s ...<4 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 5986s raise FatalCommClosedError( 5986s ...<2 lines>... 5986s ) from err 5986s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 5986s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 5986s RuntimeError: Nanny failed to start. 5986s 2024-11-23 22:02:54,557 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:02:54,564 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46313 5986s 2024-11-23 22:02:54,564 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37883/status 5986s 2024-11-23 22:02:54,564 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:02:54,589 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:43631'. Reason: failure-to-start- 5986s 2024-11-23 22:02:54,590 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:44249'. Reason: failure-to-start- 5986s 2024-11-23 22:02:54,590 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46313': TLS handshake failed with remote 'tls://127.0.0.1:45518': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:54,590 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46313': TLS handshake failed with remote 'tls://127.0.0.1:45526': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:54,590 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 5986s stream = await stream.start_tls( 5986s ^^^^^^^^^^^^^^^^^^^^^^^ 5986s False, ssl_options=ssl_options, server_hostname=host 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 5986s self.socket.do_handshake() 5986s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 5986s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 5986s self._sslobj.do_handshake() 5986s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 5986s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5986s comm = await self.rpc.connect(saddr) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 5986s return await self._connect(addr=addr, timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 5986s comm = await connect( 5986s ^^^^^^^^^^^^^^ 5986s ...<4 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 5986s raise FatalCommClosedError( 5986s ...<2 lines>... 5986s ) from err 5986s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 5986s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 5986s RuntimeError: Nanny failed to start. 5986s 2024-11-23 22:02:55,597 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:02:55,604 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46863 5986s 2024-11-23 22:02:55,604 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33467/status 5986s 2024-11-23 22:02:55,605 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:02:55,633 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:33991'. Reason: failure-to-start- 5986s 2024-11-23 22:02:55,633 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:43447'. Reason: failure-to-start- 5986s 2024-11-23 22:02:55,636 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46863': TLS handshake failed with remote 'tls://127.0.0.1:52410': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:55,636 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46863': TLS handshake failed with remote 'tls://127.0.0.1:52420': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:55,636 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 5986s stream = await stream.start_tls( 5986s ^^^^^^^^^^^^^^^^^^^^^^^ 5986s False, ssl_options=ssl_options, server_hostname=host 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 5986s self.socket.do_handshake() 5986s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 5986s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 5986s self._sslobj.do_handshake() 5986s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 5986s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5986s comm = await self.rpc.connect(saddr) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 5986s return await self._connect(addr=addr, timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 5986s comm = await connect( 5986s ^^^^^^^^^^^^^^ 5986s ...<4 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 5986s raise FatalCommClosedError( 5986s ...<2 lines>... 5986s ) from err 5986s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 5986s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 5986s RuntimeError: Nanny failed to start. 5986s 2024-11-23 22:02:56,641 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:02:56,652 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38981 5986s 2024-11-23 22:02:56,653 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42205/status 5986s 2024-11-23 22:02:56,653 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:02:56,681 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:35063'. Reason: failure-to-start- 5986s 2024-11-23 22:02:56,681 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:34651'. Reason: failure-to-start- 5986s 2024-11-23 22:02:56,681 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38981': TLS handshake failed with remote 'tls://127.0.0.1:51962': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:56,681 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38981': TLS handshake failed with remote 'tls://127.0.0.1:51976': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:56,681 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 5986s stream = await stream.start_tls( 5986s ^^^^^^^^^^^^^^^^^^^^^^^ 5986s False, ssl_options=ssl_options, server_hostname=host 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 5986s self.socket.do_handshake() 5986s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 5986s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 5986s self._sslobj.do_handshake() 5986s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 5986s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5986s comm = await self.rpc.connect(saddr) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 5986s return await self._connect(addr=addr, timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 5986s comm = await connect( 5986s ^^^^^^^^^^^^^^ 5986s ...<4 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 5986s raise FatalCommClosedError( 5986s ...<2 lines>... 5986s ) from err 5986s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 5986s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 5986s RuntimeError: Nanny failed to start. 5986s 2024-11-23 22:02:57,688 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:02:57,696 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43929 5986s 2024-11-23 22:02:57,696 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41367/status 5986s 2024-11-23 22:02:57,697 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:02:57,727 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:37489'. Reason: failure-to-start- 5986s 2024-11-23 22:02:57,727 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:43529'. Reason: failure-to-start- 5986s 2024-11-23 22:02:57,728 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43929': TLS handshake failed with remote 'tls://127.0.0.1:38428': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:57,728 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43929': TLS handshake failed with remote 'tls://127.0.0.1:38444': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:57,728 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 5986s stream = await stream.start_tls( 5986s ^^^^^^^^^^^^^^^^^^^^^^^ 5986s False, ssl_options=ssl_options, server_hostname=host 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 5986s self.socket.do_handshake() 5986s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 5986s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 5986s self._sslobj.do_handshake() 5986s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 5986s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5986s comm = await self.rpc.connect(saddr) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 5986s return await self._connect(addr=addr, timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 5986s comm = await connect( 5986s ^^^^^^^^^^^^^^ 5986s ...<4 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 5986s raise FatalCommClosedError( 5986s ...<2 lines>... 5986s ) from err 5986s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 5986s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 5986s RuntimeError: Nanny failed to start. 5986s 2024-11-23 22:02:58,739 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:02:58,749 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45773 5986s 2024-11-23 22:02:58,749 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39345/status 5986s 2024-11-23 22:02:58,750 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:02:58,774 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:34677'. Reason: failure-to-start- 5986s 2024-11-23 22:02:58,775 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:45089'. Reason: failure-to-start- 5986s 2024-11-23 22:02:58,775 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45773': TLS handshake failed with remote 'tls://127.0.0.1:42874': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:58,775 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45773': TLS handshake failed with remote 'tls://127.0.0.1:42882': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:58,777 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 5986s stream = await stream.start_tls( 5986s ^^^^^^^^^^^^^^^^^^^^^^^ 5986s False, ssl_options=ssl_options, server_hostname=host 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 5986s self.socket.do_handshake() 5986s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 5986s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 5986s self._sslobj.do_handshake() 5986s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 5986s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5986s comm = await self.rpc.connect(saddr) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 5986s return await self._connect(addr=addr, timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 5986s comm = await connect( 5986s ^^^^^^^^^^^^^^ 5986s ...<4 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 5986s raise FatalCommClosedError( 5986s ...<2 lines>... 5986s ) from err 5986s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 5986s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 5986s RuntimeError: Nanny failed to start. 5986s 2024-11-23 22:02:59,782 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:02:59,788 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44383 5986s 2024-11-23 22:02:59,789 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41029/status 5986s 2024-11-23 22:02:59,789 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:02:59,813 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:33875'. Reason: failure-to-start- 5986s 2024-11-23 22:02:59,813 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:46521'. Reason: failure-to-start- 5986s 2024-11-23 22:02:59,815 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44383': TLS handshake failed with remote 'tls://127.0.0.1:33506': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:59,815 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44383': TLS handshake failed with remote 'tls://127.0.0.1:33510': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:02:59,815 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 5986s stream = await stream.start_tls( 5986s ^^^^^^^^^^^^^^^^^^^^^^^ 5986s False, ssl_options=ssl_options, server_hostname=host 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 5986s self.socket.do_handshake() 5986s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 5986s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 5986s self._sslobj.do_handshake() 5986s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 5986s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5986s comm = await self.rpc.connect(saddr) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 5986s return await self._connect(addr=addr, timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 5986s comm = await connect( 5986s ^^^^^^^^^^^^^^ 5986s ...<4 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 5986s raise FatalCommClosedError( 5986s ...<2 lines>... 5986s ) from err 5986s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 5986s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 5986s RuntimeError: Nanny failed to start. 5986s 2024-11-23 22:03:00,821 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:03:00,826 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:32923 5986s 2024-11-23 22:03:00,827 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34167/status 5986s 2024-11-23 22:03:00,827 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:03:00,849 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:45643'. Reason: failure-to-start- 5986s 2024-11-23 22:03:00,850 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:38329'. Reason: failure-to-start- 5986s 2024-11-23 22:03:00,852 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:32923': TLS handshake failed with remote 'tls://127.0.0.1:41732': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:00,852 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:32923': TLS handshake failed with remote 'tls://127.0.0.1:41744': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:00,852 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 5986s stream = await stream.start_tls( 5986s ^^^^^^^^^^^^^^^^^^^^^^^ 5986s False, ssl_options=ssl_options, server_hostname=host 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 5986s self.socket.do_handshake() 5986s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 5986s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 5986s self._sslobj.do_handshake() 5986s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 5986s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5986s comm = await self.rpc.connect(saddr) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 5986s return await self._connect(addr=addr, timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 5986s comm = await connect( 5986s ^^^^^^^^^^^^^^ 5986s ...<4 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 5986s raise FatalCommClosedError( 5986s ...<2 lines>... 5986s ) from err 5986s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 5986s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 5986s RuntimeError: Nanny failed to start. 5986s 2024-11-23 22:03:01,857 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:03:01,863 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33649 5986s 2024-11-23 22:03:01,864 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46725/status 5986s 2024-11-23 22:03:01,864 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:03:01,887 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:38399'. Reason: failure-to-start- 5986s 2024-11-23 22:03:01,887 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:39539'. Reason: failure-to-start- 5986s 2024-11-23 22:03:01,890 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33649': TLS handshake failed with remote 'tls://127.0.0.1:36386': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:01,890 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33649': TLS handshake failed with remote 'tls://127.0.0.1:36394': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:01,890 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 5986s stream = await stream.start_tls( 5986s ^^^^^^^^^^^^^^^^^^^^^^^ 5986s False, ssl_options=ssl_options, server_hostname=host 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 5986s self.socket.do_handshake() 5986s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 5986s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 5986s self._sslobj.do_handshake() 5986s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 5986s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5986s comm = await self.rpc.connect(saddr) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 5986s return await self._connect(addr=addr, timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 5986s comm = await connect( 5986s ^^^^^^^^^^^^^^ 5986s ...<4 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 5986s raise FatalCommClosedError( 5986s ...<2 lines>... 5986s ) from err 5986s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 5986s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 5986s RuntimeError: Nanny failed to start. 5986s 2024-11-23 22:03:02,895 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:03:02,901 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41383 5986s 2024-11-23 22:03:02,902 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42115/status 5986s 2024-11-23 22:03:02,902 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:03:02,924 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:44231'. Reason: failure-to-start- 5986s 2024-11-23 22:03:02,924 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:40379'. Reason: failure-to-start- 5986s 2024-11-23 22:03:02,927 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41383': TLS handshake failed with remote 'tls://127.0.0.1:35350': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:02,927 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41383': TLS handshake failed with remote 'tls://127.0.0.1:35356': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:02,927 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 5986s stream = await stream.start_tls( 5986s ^^^^^^^^^^^^^^^^^^^^^^^ 5986s False, ssl_options=ssl_options, server_hostname=host 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 5986s self.socket.do_handshake() 5986s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 5986s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 5986s self._sslobj.do_handshake() 5986s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 5986s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5986s comm = await self.rpc.connect(saddr) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 5986s return await self._connect(addr=addr, timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 5986s comm = await connect( 5986s ^^^^^^^^^^^^^^ 5986s ...<4 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 5986s raise FatalCommClosedError( 5986s ...<2 lines>... 5986s ) from err 5986s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 5986s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 5986s RuntimeError: Nanny failed to start. 5986s 2024-11-23 22:03:03,932 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:03:03,939 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43555 5986s 2024-11-23 22:03:03,939 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36611/status 5986s 2024-11-23 22:03:03,940 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:03:03,973 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:45635'. Reason: failure-to-start- 5986s 2024-11-23 22:03:03,974 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:43867'. Reason: failure-to-start- 5986s 2024-11-23 22:03:03,974 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43555': TLS handshake failed with remote 'tls://127.0.0.1:56886': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:03,974 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43555': TLS handshake failed with remote 'tls://127.0.0.1:56888': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:03,974 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 5986s stream = await stream.start_tls( 5986s ^^^^^^^^^^^^^^^^^^^^^^^ 5986s False, ssl_options=ssl_options, server_hostname=host 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 5986s self.socket.do_handshake() 5986s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 5986s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 5986s self._sslobj.do_handshake() 5986s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 5986s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5986s comm = await self.rpc.connect(saddr) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 5986s return await self._connect(addr=addr, timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 5986s comm = await connect( 5986s ^^^^^^^^^^^^^^ 5986s ...<4 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 5986s raise FatalCommClosedError( 5986s ...<2 lines>... 5986s ) from err 5986s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 5986s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 5986s RuntimeError: Nanny failed to start. 5986s 2024-11-23 22:03:04,980 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:03:04,987 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41733 5986s 2024-11-23 22:03:04,987 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35367/status 5986s 2024-11-23 22:03:04,988 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:03:05,013 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:39987'. Reason: failure-to-start- 5986s 2024-11-23 22:03:05,013 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:38249'. Reason: failure-to-start- 5986s 2024-11-23 22:03:05,014 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41733': TLS handshake failed with remote 'tls://127.0.0.1:56358': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:05,014 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41733': TLS handshake failed with remote 'tls://127.0.0.1:56372': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:05,014 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 5986s stream = await stream.start_tls( 5986s ^^^^^^^^^^^^^^^^^^^^^^^ 5986s False, ssl_options=ssl_options, server_hostname=host 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 5986s self.socket.do_handshake() 5986s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 5986s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 5986s self._sslobj.do_handshake() 5986s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 5986s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5986s comm = await self.rpc.connect(saddr) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 5986s return await self._connect(addr=addr, timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 5986s comm = await connect( 5986s ^^^^^^^^^^^^^^ 5986s ...<4 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 5986s raise FatalCommClosedError( 5986s ...<2 lines>... 5986s ) from err 5986s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 5986s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 5986s RuntimeError: Nanny failed to start. 5986s 2024-11-23 22:03:06,019 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:03:06,026 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33149 5986s 2024-11-23 22:03:06,026 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40087/status 5986s 2024-11-23 22:03:06,026 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:03:06,052 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:32917'. Reason: failure-to-start- 5986s 2024-11-23 22:03:06,052 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:36085'. Reason: failure-to-start- 5986s 2024-11-23 22:03:06,053 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33149': TLS handshake failed with remote 'tls://127.0.0.1:58276': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:06,053 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33149': TLS handshake failed with remote 'tls://127.0.0.1:58284': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:06,053 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 5986s stream = await stream.start_tls( 5986s ^^^^^^^^^^^^^^^^^^^^^^^ 5986s False, ssl_options=ssl_options, server_hostname=host 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 5986s self.socket.do_handshake() 5986s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 5986s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 5986s self._sslobj.do_handshake() 5986s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 5986s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5986s comm = await self.rpc.connect(saddr) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 5986s return await self._connect(addr=addr, timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 5986s comm = await connect( 5986s ^^^^^^^^^^^^^^ 5986s ...<4 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 5986s raise FatalCommClosedError( 5986s ...<2 lines>... 5986s ) from err 5986s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 5986s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 5986s RuntimeError: Nanny failed to start. 5986s 2024-11-23 22:03:07,058 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:03:07,064 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40523 5986s 2024-11-23 22:03:07,065 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35731/status 5986s 2024-11-23 22:03:07,065 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:03:07,091 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:42827'. Reason: failure-to-start- 5986s 2024-11-23 22:03:07,092 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:36581'. Reason: failure-to-start- 5986s 2024-11-23 22:03:07,092 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40523': TLS handshake failed with remote 'tls://127.0.0.1:42432': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:07,092 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40523': TLS handshake failed with remote 'tls://127.0.0.1:42436': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:07,092 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 5986s stream = await stream.start_tls( 5986s ^^^^^^^^^^^^^^^^^^^^^^^ 5986s False, ssl_options=ssl_options, server_hostname=host 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 5986s self.socket.do_handshake() 5986s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 5986s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 5986s self._sslobj.do_handshake() 5986s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 5986s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5986s comm = await self.rpc.connect(saddr) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 5986s return await self._connect(addr=addr, timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 5986s comm = await connect( 5986s ^^^^^^^^^^^^^^ 5986s ...<4 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 5986s raise FatalCommClosedError( 5986s ...<2 lines>... 5986s ) from err 5986s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 5986s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 5986s RuntimeError: Nanny failed to start. 5986s 2024-11-23 22:03:08,098 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:03:08,108 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37223 5986s 2024-11-23 22:03:08,109 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37253/status 5986s 2024-11-23 22:03:08,111 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:03:08,138 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:37819'. Reason: failure-to-start- 5986s 2024-11-23 22:03:08,138 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:46309'. Reason: failure-to-start- 5986s 2024-11-23 22:03:08,141 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37223': TLS handshake failed with remote 'tls://127.0.0.1:55384': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:08,141 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37223': TLS handshake failed with remote 'tls://127.0.0.1:55400': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:08,141 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 5986s stream = await stream.start_tls( 5986s ^^^^^^^^^^^^^^^^^^^^^^^ 5986s False, ssl_options=ssl_options, server_hostname=host 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 5986s self.socket.do_handshake() 5986s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 5986s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 5986s self._sslobj.do_handshake() 5986s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 5986s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5986s comm = await self.rpc.connect(saddr) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 5986s return await self._connect(addr=addr, timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 5986s comm = await connect( 5986s ^^^^^^^^^^^^^^ 5986s ...<4 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 5986s raise FatalCommClosedError( 5986s ...<2 lines>... 5986s ) from err 5986s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 5986s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 5986s RuntimeError: Nanny failed to start. 5986s 2024-11-23 22:03:09,147 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:03:09,154 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:32941 5986s 2024-11-23 22:03:09,154 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37781/status 5986s 2024-11-23 22:03:09,154 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:03:09,171 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:35435'. Reason: failure-to-start- 5986s 2024-11-23 22:03:09,172 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:33041'. Reason: failure-to-start- 5986s 2024-11-23 22:03:09,172 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:32941': TLS handshake failed with remote 'tls://127.0.0.1:45576': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:03:09,173 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:32941': TLS handshake failed with remote 'tls://127.0.0.1:45584': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:03:09,173 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5986s comm = await self.rpc.connect(saddr) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 5986s return await self._connect(addr=addr, timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 5986s comm = await connect( 5986s ^^^^^^^^^^^^^^ 5986s ...<4 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Nanny start timed out after 0s. 5986s 2024-11-23 22:03:10,178 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:03:10,185 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:32889 5986s 2024-11-23 22:03:10,185 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40731/status 5986s 2024-11-23 22:03:10,186 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:03:10,215 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:40085'. Reason: failure-to-start- 5986s 2024-11-23 22:03:10,216 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:43797'. Reason: failure-to-start- 5986s 2024-11-23 22:03:10,216 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:32889': TLS handshake failed with remote 'tls://127.0.0.1:51360': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:03:10,217 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:32889': TLS handshake failed with remote 'tls://127.0.0.1:51364': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:03:10,217 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5986s comm = await self.rpc.connect(saddr) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 5986s return await self._connect(addr=addr, timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 5986s comm = await connect( 5986s ^^^^^^^^^^^^^^ 5986s ...<4 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Nanny start timed out after 0s. 5986s 2024-11-23 22:03:11,221 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:03:11,228 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35233 5986s 2024-11-23 22:03:11,229 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45993/status 5986s 2024-11-23 22:03:11,229 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:03:11,245 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:42473'. Reason: failure-to-start- 5986s 2024-11-23 22:03:11,245 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:45711'. Reason: failure-to-start- 5986s 2024-11-23 22:03:11,246 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35233': TLS handshake failed with remote 'tls://127.0.0.1:43702': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:03:11,246 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35233': TLS handshake failed with remote 'tls://127.0.0.1:43712': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:03:11,246 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5986s comm = await self.rpc.connect(saddr) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 5986s return await self._connect(addr=addr, timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 5986s comm = await connect( 5986s ^^^^^^^^^^^^^^ 5986s ...<4 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Nanny start timed out after 0s. 5986s 2024-11-23 22:03:12,251 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:03:12,258 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37725 5986s 2024-11-23 22:03:12,259 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41329/status 5986s 2024-11-23 22:03:12,259 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:03:12,544 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:39927'. Reason: failure-to-start- 5986s 2024-11-23 22:03:12,544 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:46273'. Reason: failure-to-start- 5986s 2024-11-23 22:03:12,546 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37725': TLS handshake failed with remote 'tls://127.0.0.1:50178': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:03:12,546 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37725': TLS handshake failed with remote 'tls://127.0.0.1:50194': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:03:12,549 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5986s comm = await self.rpc.connect(saddr) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 5986s return await self._connect(addr=addr, timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 5986s comm = await connect( 5986s ^^^^^^^^^^^^^^ 5986s ...<4 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Nanny start timed out after 0s. 5986s 2024-11-23 22:03:13,554 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:03:13,561 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33899 5986s 2024-11-23 22:03:13,561 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36553/status 5986s 2024-11-23 22:03:13,561 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:03:13,580 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:45445'. Reason: failure-to-start- 5986s 2024-11-23 22:03:13,580 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:40801'. Reason: failure-to-start- 5986s 2024-11-23 22:03:13,581 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33899': TLS handshake failed with remote 'tls://127.0.0.1:58820': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:03:13,581 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33899': TLS handshake failed with remote 'tls://127.0.0.1:58830': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:03:13,581 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5986s comm = await self.rpc.connect(saddr) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 5986s return await self._connect(addr=addr, timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 5986s comm = await connect( 5986s ^^^^^^^^^^^^^^ 5986s ...<4 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Nanny start timed out after 0s. 5986s 2024-11-23 22:03:14,587 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:03:14,593 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33043 5986s 2024-11-23 22:03:14,593 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42607/status 5986s 2024-11-23 22:03:14,593 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:03:14,608 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:40709'. Reason: failure-to-start- 5986s 2024-11-23 22:03:14,608 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:44325'. Reason: failure-to-start- 5986s 2024-11-23 22:03:14,609 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33043': TLS handshake failed with remote 'tls://127.0.0.1:48616': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:03:14,609 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33043': TLS handshake failed with remote 'tls://127.0.0.1:48622': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:03:14,609 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5986s comm = await self.rpc.connect(saddr) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 5986s return await self._connect(addr=addr, timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 5986s comm = await connect( 5986s ^^^^^^^^^^^^^^ 5986s ...<4 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Nanny start timed out after 0s. 5986s 2024-11-23 22:03:15,616 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:03:15,622 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41585 5986s 2024-11-23 22:03:15,622 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:32925/status 5986s 2024-11-23 22:03:15,623 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:03:15,638 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:36617'. Reason: failure-to-start- 5986s 2024-11-23 22:03:15,638 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:46359'. Reason: failure-to-start- 5986s 2024-11-23 22:03:15,639 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41585': TLS handshake failed with remote 'tls://127.0.0.1:42716': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:03:15,639 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41585': TLS handshake failed with remote 'tls://127.0.0.1:42730': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:03:15,639 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5986s comm = await self.rpc.connect(saddr) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 5986s return await self._connect(addr=addr, timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 5986s comm = await connect( 5986s ^^^^^^^^^^^^^^ 5986s ...<4 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Nanny start timed out after 0s. 5986s 2024-11-23 22:03:16,644 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:03:16,650 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38623 5986s 2024-11-23 22:03:16,651 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40611/status 5986s 2024-11-23 22:03:16,651 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:03:16,668 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:43667'. Reason: failure-to-start- 5986s 2024-11-23 22:03:16,669 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:40025'. Reason: failure-to-start- 5986s 2024-11-23 22:03:16,669 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38623': TLS handshake failed with remote 'tls://127.0.0.1:51202': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:03:16,669 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38623': TLS handshake failed with remote 'tls://127.0.0.1:51218': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:03:16,672 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5986s comm = await self.rpc.connect(saddr) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 5986s return await self._connect(addr=addr, timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 5986s comm = await connect( 5986s ^^^^^^^^^^^^^^ 5986s ...<4 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Nanny start timed out after 0s. 5986s 2024-11-23 22:03:17,676 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:03:17,683 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46635 5986s 2024-11-23 22:03:17,683 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43927/status 5986s 2024-11-23 22:03:17,683 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:03:17,698 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:45583'. Reason: failure-to-start- 5986s 2024-11-23 22:03:17,698 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:35359'. Reason: failure-to-start- 5986s 2024-11-23 22:03:17,699 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46635': TLS handshake failed with remote 'tls://127.0.0.1:39486': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:03:17,699 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46635': TLS handshake failed with remote 'tls://127.0.0.1:39498': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:03:17,701 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5986s comm = await self.rpc.connect(saddr) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 5986s return await self._connect(addr=addr, timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 5986s comm = await connect( 5986s ^^^^^^^^^^^^^^ 5986s ...<4 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Nanny start timed out after 0s. 5986s 2024-11-23 22:03:18,706 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:03:18,712 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45035 5986s 2024-11-23 22:03:18,712 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45657/status 5986s 2024-11-23 22:03:18,713 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:03:18,727 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:34881'. Reason: failure-to-start- 5986s 2024-11-23 22:03:18,727 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:39863'. Reason: failure-to-start- 5986s 2024-11-23 22:03:18,728 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45035': TLS handshake failed with remote 'tls://127.0.0.1:57484': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:03:18,728 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45035': TLS handshake failed with remote 'tls://127.0.0.1:57494': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:03:18,728 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5986s comm = await self.rpc.connect(saddr) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 5986s return await self._connect(addr=addr, timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 5986s comm = await connect( 5986s ^^^^^^^^^^^^^^ 5986s ...<4 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Nanny start timed out after 0s. 5986s 2024-11-23 22:03:19,734 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:03:19,740 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39329 5986s 2024-11-23 22:03:19,741 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44711/status 5986s 2024-11-23 22:03:19,741 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:03:19,755 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:35013'. Reason: failure-to-start- 5986s 2024-11-23 22:03:19,755 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:38391'. Reason: failure-to-start- 5986s 2024-11-23 22:03:19,758 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39329': TLS handshake failed with remote 'tls://127.0.0.1:39520': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:03:19,758 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39329': TLS handshake failed with remote 'tls://127.0.0.1:39532': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:03:19,758 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5986s comm = await self.rpc.connect(saddr) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 5986s return await self._connect(addr=addr, timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 5986s comm = await connect( 5986s ^^^^^^^^^^^^^^ 5986s ...<4 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Nanny start timed out after 0s. 5986s 2024-11-23 22:03:20,766 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:03:20,782 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45239 5986s 2024-11-23 22:03:20,782 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:32835/status 5986s 2024-11-23 22:03:20,783 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:03:20,838 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:37241'. Reason: failure-to-start- 5986s 2024-11-23 22:03:20,839 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:36781'. Reason: failure-to-start- 5986s 2024-11-23 22:03:20,846 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45239': TLS handshake failed with remote 'tls://127.0.0.1:55902': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:03:20,846 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45239': TLS handshake failed with remote 'tls://127.0.0.1:55914': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:03:20,847 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5986s comm = await self.rpc.connect(saddr) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 5986s return await self._connect(addr=addr, timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 5986s comm = await connect( 5986s ^^^^^^^^^^^^^^ 5986s ...<4 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Nanny start timed out after 0s. 5986s 2024-11-23 22:03:21,858 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:03:21,873 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35373 5986s 2024-11-23 22:03:21,874 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46675/status 5986s 2024-11-23 22:03:21,875 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:03:21,915 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:46831'. Reason: failure-to-start- 5986s 2024-11-23 22:03:21,916 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:40599'. Reason: failure-to-start- 5986s 2024-11-23 22:03:21,923 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35373': TLS handshake failed with remote 'tls://127.0.0.1:52820': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:03:21,923 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35373': TLS handshake failed with remote 'tls://127.0.0.1:52828': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:03:21,924 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5986s comm = await self.rpc.connect(saddr) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 5986s return await self._connect(addr=addr, timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 5986s comm = await connect( 5986s ^^^^^^^^^^^^^^ 5986s ...<4 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Nanny start timed out after 0s. 5986s 2024-11-23 22:03:22,932 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:03:22,950 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33193 5986s 2024-11-23 22:03:22,950 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34091/status 5986s 2024-11-23 22:03:22,951 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:03:22,987 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:40701'. Reason: failure-to-start- 5986s 2024-11-23 22:03:22,988 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:40125'. Reason: failure-to-start- 5986s 2024-11-23 22:03:22,990 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33193': TLS handshake failed with remote 'tls://127.0.0.1:43162': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:03:22,991 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33193': TLS handshake failed with remote 'tls://127.0.0.1:43164': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:03:22,991 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5986s comm = await self.rpc.connect(saddr) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 5986s return await self._connect(addr=addr, timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 5986s comm = await connect( 5986s ^^^^^^^^^^^^^^ 5986s ...<4 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Nanny start timed out after 0s. 5986s 2024-11-23 22:03:24,002 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:03:24,016 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34603 5986s 2024-11-23 22:03:24,017 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43877/status 5986s 2024-11-23 22:03:24,018 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:03:24,054 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:33951'. Reason: failure-to-start- 5986s 2024-11-23 22:03:24,055 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:36503'. Reason: failure-to-start- 5986s 2024-11-23 22:03:24,058 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34603': TLS handshake failed with remote 'tls://127.0.0.1:37256': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:03:24,058 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34603': TLS handshake failed with remote 'tls://127.0.0.1:37260': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:03:24,059 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5986s comm = await self.rpc.connect(saddr) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 5986s return await self._connect(addr=addr, timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 5986s comm = await connect( 5986s ^^^^^^^^^^^^^^ 5986s ...<4 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Nanny start timed out after 0s. 5986s 2024-11-23 22:03:25,073 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:03:25,085 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38473 5986s 2024-11-23 22:03:25,086 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34713/status 5986s 2024-11-23 22:03:25,090 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:03:25,138 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:34009'. Reason: failure-to-start- 5986s 2024-11-23 22:03:25,139 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:35135'. Reason: failure-to-start- 5986s 2024-11-23 22:03:25,146 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38473': TLS handshake failed with remote 'tls://127.0.0.1:54698': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:03:25,146 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38473': TLS handshake failed with remote 'tls://127.0.0.1:54708': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:03:25,150 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5986s comm = await self.rpc.connect(saddr) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 5986s return await self._connect(addr=addr, timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 5986s comm = await connect( 5986s ^^^^^^^^^^^^^^ 5986s ...<4 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Nanny start timed out after 0s. 5986s 2024-11-23 22:03:26,164 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:03:26,175 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42969 5986s 2024-11-23 22:03:26,176 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45075/status 5986s 2024-11-23 22:03:26,181 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:03:26,230 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:45129'. Reason: failure-to-start- 5986s 2024-11-23 22:03:26,231 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:45221'. Reason: failure-to-start- 5986s 2024-11-23 22:03:26,238 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42969': TLS handshake failed with remote 'tls://127.0.0.1:33602': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:03:26,238 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42969': TLS handshake failed with remote 'tls://127.0.0.1:33618': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:03:26,242 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5986s comm = await self.rpc.connect(saddr) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 5986s return await self._connect(addr=addr, timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 5986s comm = await connect( 5986s ^^^^^^^^^^^^^^ 5986s ...<4 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Nanny start timed out after 0s. 5986s 2024-11-23 22:03:27,248 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:03:27,253 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36073 5986s 2024-11-23 22:03:27,254 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40183/status 5986s 2024-11-23 22:03:27,254 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:03:27,271 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:44527'. Reason: failure-to-start- 5986s 2024-11-23 22:03:27,271 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:37655'. Reason: failure-to-start- 5986s 2024-11-23 22:03:27,272 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36073': TLS handshake failed with remote 'tls://127.0.0.1:60422': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:03:27,272 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36073': TLS handshake failed with remote 'tls://127.0.0.1:60424': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:03:27,272 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5986s comm = await self.rpc.connect(saddr) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 5986s return await self._connect(addr=addr, timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 5986s comm = await connect( 5986s ^^^^^^^^^^^^^^ 5986s ...<4 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Nanny start timed out after 0s. 5986s 2024-11-23 22:03:28,278 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:03:28,284 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33943 5986s 2024-11-23 22:03:28,284 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42141/status 5986s 2024-11-23 22:03:28,285 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:03:28,300 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:38975'. Reason: failure-to-start- 5986s 2024-11-23 22:03:28,300 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:32903'. Reason: failure-to-start- 5986s 2024-11-23 22:03:28,301 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33943': TLS handshake failed with remote 'tls://127.0.0.1:34040': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:03:28,301 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33943': TLS handshake failed with remote 'tls://127.0.0.1:34056': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:03:28,303 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5986s comm = await self.rpc.connect(saddr) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 5986s return await self._connect(addr=addr, timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 5986s comm = await connect( 5986s ^^^^^^^^^^^^^^ 5986s ...<4 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Nanny start timed out after 0s. 5986s 2024-11-23 22:03:29,307 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:03:29,313 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45655 5986s 2024-11-23 22:03:29,314 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35275/status 5986s 2024-11-23 22:03:29,314 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:03:29,328 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:46053'. Reason: failure-to-start- 5986s 2024-11-23 22:03:29,328 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:45557'. Reason: failure-to-start- 5986s 2024-11-23 22:03:29,331 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45655': TLS handshake failed with remote 'tls://127.0.0.1:54454': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:03:29,331 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45655': TLS handshake failed with remote 'tls://127.0.0.1:54456': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:03:29,331 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5986s comm = await self.rpc.connect(saddr) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 5986s return await self._connect(addr=addr, timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 5986s comm = await connect( 5986s ^^^^^^^^^^^^^^ 5986s ...<4 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Nanny start timed out after 0s. 5986s 2024-11-23 22:03:30,339 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:03:30,346 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42405 5986s 2024-11-23 22:03:30,346 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33991/status 5986s 2024-11-23 22:03:30,346 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:03:30,363 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:34465'. Reason: failure-to-start- 5986s 2024-11-23 22:03:30,364 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:43527'. Reason: failure-to-start- 5986s 2024-11-23 22:03:30,364 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42405': TLS handshake failed with remote 'tls://127.0.0.1:37736': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:03:30,364 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42405': TLS handshake failed with remote 'tls://127.0.0.1:37750': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:03:30,365 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5986s comm = await self.rpc.connect(saddr) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 5986s return await self._connect(addr=addr, timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 5986s comm = await connect( 5986s ^^^^^^^^^^^^^^ 5986s ...<4 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Nanny start timed out after 0s. 5986s 2024-11-23 22:03:31,370 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:03:31,376 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33997 5986s 2024-11-23 22:03:31,377 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37423/status 5986s 2024-11-23 22:03:31,377 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:03:31,392 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:40813'. Reason: failure-to-start- 5986s 2024-11-23 22:03:31,392 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:40783'. Reason: failure-to-start- 5986s 2024-11-23 22:03:31,393 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33997': TLS handshake failed with remote 'tls://127.0.0.1:40736': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:03:31,393 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33997': TLS handshake failed with remote 'tls://127.0.0.1:40746': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:03:31,393 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5986s comm = await self.rpc.connect(saddr) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 5986s return await self._connect(addr=addr, timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 5986s comm = await connect( 5986s ^^^^^^^^^^^^^^ 5986s ...<4 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Nanny start timed out after 0s. 5986s 2024-11-23 22:03:32,398 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:03:32,406 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38011 5986s 2024-11-23 22:03:32,406 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42051/status 5986s 2024-11-23 22:03:32,407 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:03:32,427 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:45621'. Reason: failure-to-start- 5986s 2024-11-23 22:03:32,427 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:46485'. Reason: failure-to-start- 5986s 2024-11-23 22:03:32,428 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38011': TLS handshake failed with remote 'tls://127.0.0.1:45694': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:03:32,428 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38011': TLS handshake failed with remote 'tls://127.0.0.1:45698': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:03:32,428 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5986s comm = await self.rpc.connect(saddr) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 5986s return await self._connect(addr=addr, timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 5986s comm = await connect( 5986s ^^^^^^^^^^^^^^ 5986s ...<4 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Nanny start timed out after 0s. 5986s 2024-11-23 22:03:33,433 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:03:33,440 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43885 5986s 2024-11-23 22:03:33,440 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34457/status 5986s 2024-11-23 22:03:33,440 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:03:33,457 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:42149'. Reason: failure-to-start- 5986s 2024-11-23 22:03:33,458 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:41581'. Reason: failure-to-start- 5986s 2024-11-23 22:03:33,458 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43885': TLS handshake failed with remote 'tls://127.0.0.1:35640': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:03:33,458 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43885': TLS handshake failed with remote 'tls://127.0.0.1:35656': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:03:33,460 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5986s comm = await self.rpc.connect(saddr) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 5986s return await self._connect(addr=addr, timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 5986s comm = await connect( 5986s ^^^^^^^^^^^^^^ 5986s ...<4 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Nanny start timed out after 0s. 5986s 2024-11-23 22:03:34,465 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:03:34,472 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42469 5986s 2024-11-23 22:03:34,472 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34459/status 5986s 2024-11-23 22:03:34,472 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:03:34,485 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:41795'. Reason: failure-to-start- 5986s 2024-11-23 22:03:34,485 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:41163'. Reason: failure-to-start- 5986s 2024-11-23 22:03:34,486 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42469': TLS handshake failed with remote 'tls://127.0.0.1:47840': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:03:34,486 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42469': TLS handshake failed with remote 'tls://127.0.0.1:47846': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:03:34,486 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5986s comm = await self.rpc.connect(saddr) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 5986s return await self._connect(addr=addr, timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 5986s comm = await connect( 5986s ^^^^^^^^^^^^^^ 5986s ...<4 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Nanny start timed out after 0s. 5986s 2024-11-23 22:03:35,493 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:03:35,500 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37887 5986s 2024-11-23 22:03:35,501 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42537/status 5986s 2024-11-23 22:03:35,503 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:03:35,520 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:41393'. Reason: failure-to-start- 5986s 2024-11-23 22:03:35,520 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:37451'. Reason: failure-to-start- 5986s 2024-11-23 22:03:35,523 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37887': TLS handshake failed with remote 'tls://127.0.0.1:53052': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:03:35,523 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37887': TLS handshake failed with remote 'tls://127.0.0.1:53054': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:03:35,523 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5986s comm = await self.rpc.connect(saddr) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 5986s return await self._connect(addr=addr, timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 5986s comm = await connect( 5986s ^^^^^^^^^^^^^^ 5986s ...<4 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Nanny start timed out after 0s. 5986s 2024-11-23 22:03:36,531 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:03:36,538 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38135 5986s 2024-11-23 22:03:36,538 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35625/status 5986s 2024-11-23 22:03:36,538 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:03:36,555 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:44745'. Reason: failure-to-start- 5986s 2024-11-23 22:03:36,555 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:42893'. Reason: failure-to-start- 5986s 2024-11-23 22:03:36,556 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38135': TLS handshake failed with remote 'tls://127.0.0.1:39564': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:03:36,556 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38135': TLS handshake failed with remote 'tls://127.0.0.1:39576': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:03:36,556 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5986s comm = await self.rpc.connect(saddr) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 5986s return await self._connect(addr=addr, timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 5986s comm = await connect( 5986s ^^^^^^^^^^^^^^ 5986s ...<4 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Nanny start timed out after 0s. 5986s 2024-11-23 22:03:37,561 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:03:37,568 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38247 5986s 2024-11-23 22:03:37,568 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44243/status 5986s 2024-11-23 22:03:37,569 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:03:37,593 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:44893'. Reason: failure-to-start- 5986s 2024-11-23 22:03:37,593 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:35145'. Reason: failure-to-start- 5986s 2024-11-23 22:03:37,594 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38247': TLS handshake failed with remote 'tls://127.0.0.1:33842': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:03:37,594 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38247': TLS handshake failed with remote 'tls://127.0.0.1:33856': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:03:37,594 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5986s comm = await self.rpc.connect(saddr) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 5986s return await self._connect(addr=addr, timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 5986s comm = await connect( 5986s ^^^^^^^^^^^^^^ 5986s ...<4 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Nanny start timed out after 0s. 5986s 2024-11-23 22:03:38,601 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:03:38,608 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41621 5986s 2024-11-23 22:03:38,609 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34159/status 5986s 2024-11-23 22:03:38,609 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:03:38,633 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:45833'. Reason: failure-to-start- 5986s 2024-11-23 22:03:38,634 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:36541'. Reason: failure-to-start- 5986s 2024-11-23 22:03:38,635 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41621': TLS handshake failed with remote 'tls://127.0.0.1:50298': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:03:38,635 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41621': TLS handshake failed with remote 'tls://127.0.0.1:50310': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:03:38,637 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5986s comm = await self.rpc.connect(saddr) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 5986s return await self._connect(addr=addr, timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 5986s comm = await connect( 5986s ^^^^^^^^^^^^^^ 5986s ...<4 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Nanny start timed out after 0s. 5986s 2024-11-23 22:03:39,642 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:03:39,649 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39181 5986s 2024-11-23 22:03:39,649 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37635/status 5986s 2024-11-23 22:03:39,650 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:03:39,672 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:34927'. Reason: failure-to-start- 5986s 2024-11-23 22:03:39,673 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:41203'. Reason: failure-to-start- 5986s 2024-11-23 22:03:39,676 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:36284': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:03:39,676 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39181': TLS handshake failed with remote 'tls://127.0.0.1:36296': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:03:39,676 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5986s comm = await self.rpc.connect(saddr) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 5986s return await self._connect(addr=addr, timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 5986s comm = await connect( 5986s ^^^^^^^^^^^^^^ 5986s ...<4 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Nanny start timed out after 0s. 5986s ________________________________ test_rebalance ________________________________ 5986s 5986s fut = , timeout = 0 5986s 5986s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 5986s async with asyncio.timeout(timeout): 5986s > return await fut 5986s 5986s /usr/lib/python3/dist-packages/distributed/utils.py:1960: 5986s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5986s /usr/lib/python3/dist-packages/distributed/worker.py:1480: in start_unsafe 5986s await self._register_with_scheduler() 5986s /usr/lib/python3/dist-packages/distributed/worker.py:1179: in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s /usr/lib/python3/dist-packages/distributed/comm/core.py:342: in connect 5986s comm = await wait_for( 5986s /usr/lib/python3/dist-packages/distributed/utils.py:1960: in wait_for 5986s return await fut 5986s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:546: in connect 5986s stream = await self.client.connect( 5986s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5986s 5986s self = , host = '127.0.0.1' 5986s port = 36391, af = 5986s ssl_options = 5986s max_buffer_size = 8364507136.0, source_ip = None, source_port = None 5986s timeout = None 5986s 5986s async def connect( 5986s self, 5986s host: str, 5986s port: int, 5986s af: socket.AddressFamily = socket.AF_UNSPEC, 5986s ssl_options: Optional[Union[Dict[str, Any], ssl.SSLContext]] = None, 5986s max_buffer_size: Optional[int] = None, 5986s source_ip: Optional[str] = None, 5986s source_port: Optional[int] = None, 5986s timeout: Optional[Union[float, datetime.timedelta]] = None, 5986s ) -> IOStream: 5986s """Connect to the given host and port. 5986s 5986s Asynchronously returns an `.IOStream` (or `.SSLIOStream` if 5986s ``ssl_options`` is not None). 5986s 5986s Using the ``source_ip`` kwarg, one can specify the source 5986s IP address to use when establishing the connection. 5986s In case the user needs to resolve and 5986s use a specific interface, it has to be handled outside 5986s of Tornado as this depends very much on the platform. 5986s 5986s Raises `TimeoutError` if the input future does not complete before 5986s ``timeout``, which may be specified in any form allowed by 5986s `.IOLoop.add_timeout` (i.e. a `datetime.timedelta` or an absolute time 5986s relative to `.IOLoop.time`) 5986s 5986s Similarly, when the user requires a certain source port, it can 5986s be specified using the ``source_port`` arg. 5986s 5986s .. versionchanged:: 4.5 5986s Added the ``source_ip`` and ``source_port`` arguments. 5986s 5986s .. versionchanged:: 5.0 5986s Added the ``timeout`` argument. 5986s """ 5986s if timeout is not None: 5986s if isinstance(timeout, numbers.Real): 5986s timeout = IOLoop.current().time() + timeout 5986s elif isinstance(timeout, datetime.timedelta): 5986s timeout = IOLoop.current().time() + timeout.total_seconds() 5986s else: 5986s raise TypeError("Unsupported timeout %r" % timeout) 5986s if timeout is not None: 5986s addrinfo = await gen.with_timeout( 5986s timeout, self.resolver.resolve(host, port, af) 5986s ) 5986s else: 5986s addrinfo = await self.resolver.resolve(host, port, af) 5986s connector = _Connector( 5986s addrinfo, 5986s functools.partial( 5986s self._create_stream, 5986s max_buffer_size, 5986s source_ip=source_ip, 5986s source_port=source_port, 5986s ), 5986s ) 5986s > af, addr, stream = await connector.start(connect_timeout=timeout) 5986s E asyncio.exceptions.CancelledError 5986s 5986s /usr/lib/python3/dist-packages/tornado/tcpclient.py:279: CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s self = 5986s 5986s @final 5986s async def start(self): 5986s async with self._startup_lock: 5986s if self.status == Status.failed: 5986s assert self.__startup_exc is not None 5986s raise self.__startup_exc 5986s elif self.status != Status.init: 5986s return self 5986s timeout = getattr(self, "death_timeout", None) 5986s 5986s async def _close_on_failure(exc: Exception) -> None: 5986s await self.close(reason=f"failure-to-start-{str(type(exc))}") 5986s self.status = Status.failed 5986s self.__startup_exc = exc 5986s 5986s try: 5986s > await wait_for(self.start_unsafe(), timeout=timeout) 5986s 5986s /usr/lib/python3/dist-packages/distributed/core.py:664: 5986s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5986s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 5986s async with asyncio.timeout(timeout): 5986s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5986s 5986s self = 5986s exc_type = 5986s exc_val = CancelledError(), exc_tb = 5986s 5986s async def __aexit__( 5986s self, 5986s exc_type: Optional[Type[BaseException]], 5986s exc_val: Optional[BaseException], 5986s exc_tb: Optional[TracebackType], 5986s ) -> Optional[bool]: 5986s assert self._state in (_State.ENTERED, _State.EXPIRING) 5986s 5986s if self._timeout_handler is not None: 5986s self._timeout_handler.cancel() 5986s self._timeout_handler = None 5986s 5986s if self._state is _State.EXPIRING: 5986s self._state = _State.EXPIRED 5986s 5986s if self._task.uncancel() <= self._cancelling and exc_type is not None: 5986s # Since there are no new cancel requests, we're 5986s # handling this. 5986s if issubclass(exc_type, exceptions.CancelledError): 5986s > raise TimeoutError from exc_val 5986s E TimeoutError 5986s 5986s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s @contextlib.asynccontextmanager 5986s async def _cluster_factory(): 5986s workers = [] 5986s s = None 5986s try: 5986s for _ in range(60): 5986s try: 5986s > s, ws = await start_cluster( 5986s nthreads, 5986s scheduler, 5986s security=security, 5986s Worker=Worker, 5986s scheduler_kwargs=scheduler_kwargs, 5986s worker_kwargs=merge( 5986s {"death_timeout": min(15, int(deadline.remaining))}, 5986s worker_kwargs, 5986s ), 5986s ) 5986s 5986s /usr/lib/python3/dist-packages/distributed/utils_test.py:966: 5986s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5986s /usr/lib/python3/dist-packages/distributed/utils_test.py:789: in start_cluster 5986s await asyncio.gather(*workers) 5986s /usr/lib/python3.13/asyncio/tasks.py:737: in _wrap_awaitable 5986s return await awaitable 5986s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5986s 5986s self = 5986s 5986s @final 5986s async def start(self): 5986s async with self._startup_lock: 5986s if self.status == Status.failed: 5986s assert self.__startup_exc is not None 5986s raise self.__startup_exc 5986s elif self.status != Status.init: 5986s return self 5986s timeout = getattr(self, "death_timeout", None) 5986s 5986s async def _close_on_failure(exc: Exception) -> None: 5986s await self.close(reason=f"failure-to-start-{str(type(exc))}") 5986s self.status = Status.failed 5986s self.__startup_exc = exc 5986s 5986s try: 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s except asyncio.TimeoutError as exc: 5986s await _close_on_failure(exc) 5986s > raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s E TimeoutError: Worker start timed out after 0s. 5986s 5986s /usr/lib/python3/dist-packages/distributed/core.py:667: TimeoutError 5986s 5986s During handling of the above exception, another exception occurred: 5986s 5986s fut = ._..test_func..async_fn at 0xde81adc0> 5986s timeout = 60 5986s 5986s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 5986s async with asyncio.timeout(timeout): 5986s > return await fut 5986s 5986s /usr/lib/python3/dist-packages/distributed/utils.py:1960: 5986s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5986s /usr/lib/python3/dist-packages/distributed/utils_test.py:999: in async_fn 5986s _cluster_factory() as (s, workers), 5986s /usr/lib/python3.13/contextlib.py:214: in __aenter__ 5986s return await anext(self.gen) 5986s /usr/lib/python3/dist-packages/distributed/utils_test.py:983: in _cluster_factory 5986s await asyncio.sleep(1) 5986s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5986s 5986s delay = 1, result = None 5986s 5986s async def sleep(delay, result=None): 5986s """Coroutine that completes after a given time (in seconds).""" 5986s if delay <= 0: 5986s await __sleep0() 5986s return result 5986s 5986s if math.isnan(delay): 5986s raise ValueError("Invalid delay: NaN (not a number)") 5986s 5986s loop = events.get_running_loop() 5986s future = loop.create_future() 5986s h = loop.call_later(delay, 5986s futures._set_result_unless_cancelled, 5986s future, result) 5986s try: 5986s > return await future 5986s E asyncio.exceptions.CancelledError 5986s 5986s /usr/lib/python3.13/asyncio/tasks.py:718: CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s args = (), kwds = {} 5986s 5986s @wraps(func) 5986s def inner(*args, **kwds): 5986s with self._recreate_cm(): 5986s > return func(*args, **kwds) 5986s 5986s /usr/lib/python3.13/contextlib.py:85: 5986s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5986s /usr/lib/python3.13/contextlib.py:85: in inner 5986s return func(*args, **kwds) 5986s /usr/lib/python3/dist-packages/distributed/utils_test.py:1102: in test_func 5986s return _run_and_close_tornado(async_fn_outer) 5986s /usr/lib/python3/dist-packages/distributed/utils_test.py:378: in _run_and_close_tornado 5986s return asyncio_run(inner_fn(), loop_factory=get_loop_factory()) 5986s /usr/lib/python3.13/asyncio/runners.py:194: in run 5986s return runner.run(main) 5986s /usr/lib/python3.13/asyncio/runners.py:118: in run 5986s return self._loop.run_until_complete(task) 5986s /usr/lib/python3.13/asyncio/base_events.py:720: in run_until_complete 5986s return future.result() 5986s /usr/lib/python3/dist-packages/distributed/utils_test.py:375: in inner_fn 5986s return await async_fn(*args, **kwargs) 5986s /usr/lib/python3/dist-packages/distributed/utils_test.py:1099: in async_fn_outer 5986s return await utils_wait_for(async_fn(), timeout=timeout * 2) 5986s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 5986s async with asyncio.timeout(timeout): 5986s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5986s 5986s self = 5986s exc_type = 5986s exc_val = CancelledError(), exc_tb = 5986s 5986s async def __aexit__( 5986s self, 5986s exc_type: Optional[Type[BaseException]], 5986s exc_val: Optional[BaseException], 5986s exc_tb: Optional[TracebackType], 5986s ) -> Optional[bool]: 5986s assert self._state in (_State.ENTERED, _State.EXPIRING) 5986s 5986s if self._timeout_handler is not None: 5986s self._timeout_handler.cancel() 5986s self._timeout_handler = None 5986s 5986s if self._state is _State.EXPIRING: 5986s self._state = _State.EXPIRED 5986s 5986s if self._task.uncancel() <= self._cancelling and exc_type is not None: 5986s # Since there are no new cancel requests, we're 5986s # handling this. 5986s if issubclass(exc_type, exceptions.CancelledError): 5986s > raise TimeoutError from exc_val 5986s E TimeoutError 5986s 5986s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 5986s ----------------------------- Captured stderr call ----------------------------- 5986s 2024-11-23 22:03:40,504 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:03:40,512 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:40,512 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42997/status 5986s 2024-11-23 22:03:40,512 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:03:40,528 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40745 5986s 2024-11-23 22:03:40,528 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40745 5986s 2024-11-23 22:03:40,528 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:03:40,528 - distributed.worker - INFO - dashboard at: 127.0.0.1:33649 5986s 2024-11-23 22:03:40,528 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:40,528 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:03:40,528 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:03:40,528 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:03:40,528 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-l4u0qkhe 5986s 2024-11-23 22:03:40,528 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:03:40,530 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37275 5986s 2024-11-23 22:03:40,530 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37275 5986s 2024-11-23 22:03:40,530 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:03:40,530 - distributed.worker - INFO - dashboard at: 127.0.0.1:46725 5986s 2024-11-23 22:03:40,530 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:40,530 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:03:40,530 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:03:40,530 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:03:40,530 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-zmh5zv06 5986s 2024-11-23 22:03:40,530 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:03:40,543 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:40,543 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:40,543 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:33972': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:40,543 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:33986': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:40,654 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:40,654 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:40,655 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:33998': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:40,655 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:34000': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:40,768 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:40,768 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:40,768 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:34012': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:40,768 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:34024': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:40,880 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:40,880 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:40,881 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:34034': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:40,881 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:34040': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:40,993 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:40,993 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:40,993 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:34052': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:40,993 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:34062': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:41,105 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:41,106 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:41,106 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:34064': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:41,106 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:34068': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:41,218 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:41,218 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:41,219 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:34078': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:41,219 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:34080': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:41,331 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:41,331 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:41,331 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:34090': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:41,332 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:34106': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:41,444 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:41,444 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:41,444 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:34112': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:41,444 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:34120': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:41,556 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:41,557 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:41,557 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:35742': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:41,557 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:35758': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:41,669 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:41,670 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:41,670 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:35770': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:41,670 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:35780': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:41,781 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:41,781 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:41,781 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:35792': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:41,781 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:35800': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:41,894 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:41,894 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:41,894 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:35810': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:41,894 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:35820': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:42,007 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:42,007 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:42,007 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:35834': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:42,007 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:35836': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:42,120 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:42,120 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:42,120 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:35850': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:42,120 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:35856': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:42,233 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:42,233 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:42,233 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:35864': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:42,233 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:35880': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:42,347 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:42,347 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:42,347 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:35890': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:42,347 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:35896': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:42,463 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:42,463 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:42,463 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:35898': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:42,463 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:35904': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:42,575 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:42,575 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:42,575 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:35906': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:42,575 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:35920': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:42,688 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:42,688 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:42,688 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:35926': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:42,688 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:35932': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:42,799 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:42,800 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:42,800 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:35944': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:42,801 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:35948': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:42,913 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:42,913 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:42,914 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:35958': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:42,914 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:35970': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:43,029 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:43,030 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:43,030 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:35982': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:43,030 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:35998': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:43,137 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:43,142 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:36012': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:43,143 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:43,143 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:36022': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:43,244 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:43,245 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:36028': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:43,250 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:43,251 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:36040': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:43,352 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:43,352 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:36052': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:43,358 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:43,358 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:36066': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:43,459 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:43,459 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:36070': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:43,465 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:43,465 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:36072': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:43,566 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:43,567 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:36080': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:43,572 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:43,573 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:36096': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:43,673 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:43,674 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:36112': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:43,679 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:43,680 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:36116': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:43,780 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:43,780 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:36122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:43,786 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:43,786 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:36138': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:43,888 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:43,889 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:36152': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:43,895 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:43,895 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:36154': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:43,997 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:43,998 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:36166': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:44,003 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:44,004 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:36180': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:44,106 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:44,107 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:36182': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:44,112 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:44,113 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:36194': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:44,214 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:44,214 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:36208': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:44,220 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:44,220 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:36216': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:44,320 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:44,320 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:36222': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:44,326 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:44,327 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:36232': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:44,428 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:44,429 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:36242': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:44,434 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:44,435 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:36246': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:44,535 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:44,536 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:36258': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:44,541 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:44,542 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:36264': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:44,643 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:44,643 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:36266': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:44,649 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:44,649 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:36274': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:44,750 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:44,751 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:36278': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:44,756 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:44,756 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:36284': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:44,857 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:44,858 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:36294': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:44,864 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:44,864 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:36298': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:44,965 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:44,965 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:36302': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:44,971 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:44,971 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:36306': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:45,073 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:45,073 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:36308': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:45,080 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:45,080 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:36322': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:45,181 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:45,182 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:36338': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:45,189 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:45,189 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:36346': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:45,288 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:45,289 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:36360': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:45,296 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:45,296 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:36362': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:45,396 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:45,396 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:36376': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:45,402 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:45,402 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:36384': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:45,503 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:45,504 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:36392': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:45,510 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:45,510 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:36398': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:45,612 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:45,612 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:36400': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:45,618 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:45,618 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:36406': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:45,719 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:45,719 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:36414': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:45,725 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:45,725 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:36428': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:45,827 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:45,828 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:36434': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:45,833 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:45,833 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:36450': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:45,934 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:45,935 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:36458': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:45,940 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:45,940 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:36474': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:46,041 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:46,042 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:36482': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:46,048 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:46,048 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:36498': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:46,149 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:46,149 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:36502': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:46,155 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:46,155 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:36514': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:46,257 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:46,257 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:36518': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:46,263 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:46,263 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:36534': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:46,364 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:46,365 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:36540': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:46,370 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:46,370 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:36546': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:46,471 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:46,471 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:36558': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:46,477 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:46,477 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:36560': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:46,578 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:46,578 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:36576': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:46,584 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:46,584 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:36580': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:46,685 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:46,685 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:36592': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:46,691 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:46,691 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:36596': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:46,791 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:46,792 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:36608': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:46,798 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:46,798 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:36622': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:46,899 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:46,899 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:36634': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:46,905 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:46,905 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:36650': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:47,006 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:47,008 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:36656': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:47,014 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:47,018 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:36664': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:47,114 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:47,114 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:36668': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:47,120 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:47,120 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:36670': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:47,221 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:47,221 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:36676': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:47,227 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:47,227 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:36692': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:47,328 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:47,328 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:36700': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:47,334 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:47,334 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:36708': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:47,435 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:47,436 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:36712': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:47,441 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:47,441 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:36726': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:47,542 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:47,543 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:36738': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:47,549 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:47,549 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:36752': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:47,650 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:47,651 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:36768': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:47,656 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:47,657 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:36782': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:47,758 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:47,758 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:36786': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:47,764 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:47,764 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:36790': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:47,865 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:47,865 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:36802': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:47,871 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:47,871 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:36808': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:47,974 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:47,974 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:36816': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:47,980 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:47,980 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:36818': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:48,081 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:48,081 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:36822': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:48,087 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:48,087 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:36834': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:48,188 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:48,189 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:36838': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:48,195 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:48,195 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:36840': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:48,297 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:48,298 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:36850': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:48,304 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:48,304 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:36858': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:48,405 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:48,406 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:36864': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:48,411 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:48,411 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:36874': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:48,512 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:48,513 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:36876': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:48,524 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:48,525 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:36886': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:48,619 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:48,620 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:36900': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:48,631 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:48,632 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:36902': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:48,727 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:48,727 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:36912': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:48,738 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:48,739 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:36922': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:48,834 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:48,834 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:36934': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:48,846 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:48,846 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:36942': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:48,941 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:48,941 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:36956': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:48,953 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:48,953 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:36960': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:49,048 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:49,048 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:36972': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:49,060 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:49,060 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:36984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:49,155 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:49,155 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:37000': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:49,166 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:49,167 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:37002': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:49,263 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:49,263 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:37008': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:49,273 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:49,274 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:37016': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:49,370 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:49,370 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:37030': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:49,380 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:49,381 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:37046': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:49,476 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:49,477 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:37054': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:49,487 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:49,487 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:37070': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:49,583 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:49,583 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:37074': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:49,594 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:49,594 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:37082': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:49,690 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:49,690 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:37098': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:49,700 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:49,700 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:37110': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:49,796 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:49,797 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:37124': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:49,807 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:49,807 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:37126': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:49,904 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:49,904 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:37140': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:49,913 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:49,914 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:37144': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:50,011 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:50,011 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:37158': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:50,025 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:50,025 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:37164': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:50,118 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:50,118 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:37178': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:50,131 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:50,132 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:37186': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:50,225 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:50,225 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:37196': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:50,238 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:50,239 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:37210': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:50,332 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:50,332 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:37220': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:50,346 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:50,346 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:37236': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:50,440 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:50,440 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:37240': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:50,452 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:50,453 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:37256': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:50,547 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:50,547 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:37270': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:50,559 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:50,560 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:37284': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:50,654 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:50,654 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:37296': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:50,666 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:50,666 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:37306': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:50,760 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:50,761 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:37322': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:50,773 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:50,774 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:37336': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:50,868 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:50,868 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:37344': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:50,881 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:50,881 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:37350': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:50,976 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:50,976 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:37362': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:50,987 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:50,988 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:37364': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:51,084 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:51,084 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:37372': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:51,094 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:51,095 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:37378': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:51,191 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:51,191 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:37382': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:51,201 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:51,202 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:37388': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:51,298 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:51,298 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:37404': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:51,309 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:51,309 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:37406': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:51,405 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:51,405 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:37418': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:51,416 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:51,416 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:37422': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:51,513 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:51,514 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:37438': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:51,524 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:51,524 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:37442': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:51,620 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:51,621 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:40112': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:51,631 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:51,631 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:40128': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:51,727 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:51,728 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:40144': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:51,738 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:51,738 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:40150': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:51,834 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:51,835 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:40154': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:51,845 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:51,845 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:40156': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:51,941 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:51,941 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:40166': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:51,952 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:51,952 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:40178': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:52,049 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:52,049 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:40182': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:52,058 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:52,059 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:40188': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:52,157 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:52,157 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:40194': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:52,165 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:52,166 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:40210': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:52,264 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:52,264 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:40212': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:52,272 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:52,272 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:40214': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:52,370 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:52,371 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:40230': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:52,379 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:52,379 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:40238': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:52,477 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:52,478 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:40246': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:52,486 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:52,486 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:40250': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:52,584 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:52,584 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:40260': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:52,592 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:52,593 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:40270': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:52,694 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:52,694 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:40282': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:52,700 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:52,700 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:40288': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:52,800 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:52,801 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:40304': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:52,807 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:52,807 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:40316': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:52,908 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:52,908 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:40326': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:52,914 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:52,914 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:40336': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:53,016 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:53,021 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:40352': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:53,027 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:53,027 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:40356': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:53,124 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:53,124 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:40360': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:53,134 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:53,134 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:40366': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:53,232 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:53,232 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:40372': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:53,240 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:53,241 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:40384': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:53,339 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:53,340 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:40396': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:53,347 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:53,347 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:40402': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:53,447 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:53,448 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:40404': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:53,454 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:53,454 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:40410': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:53,555 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:53,555 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:40422': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:53,561 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:53,561 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:40426': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:53,661 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:53,662 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:40440': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:53,668 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:53,668 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:40450': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:53,769 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:53,770 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:40460': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:53,775 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:53,776 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:40472': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:53,876 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:53,877 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:40486': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:53,882 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:53,883 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:40492': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:53,984 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:53,985 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:40508': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:53,990 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:53,991 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:40520': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:54,091 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:54,091 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:40528': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:54,098 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:54,098 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:40534': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:54,198 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:54,198 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:40538': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:54,204 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:54,205 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:40548': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:54,305 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:54,305 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:40560': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:54,312 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:54,312 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:40570': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:54,413 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:54,414 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:40580': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:54,420 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:54,420 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:40596': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:54,524 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:54,525 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:40608': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:54,530 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:54,531 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:40618': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:54,632 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:54,632 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:40628': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:54,638 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:54,638 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:40632': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:54,739 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:54,740 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:40636': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:54,745 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:54,746 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:40646': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:54,847 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:54,847 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:40650': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:54,853 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:54,853 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:40652': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:54,954 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:54,955 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:40666': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:54,960 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:54,961 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:40674': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:55,061 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:55,061 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:40678': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:55,067 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:55,068 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:40680': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:55,169 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:55,169 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:40688': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:55,175 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:55,175 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:40692': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:55,275 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:55,276 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:40706': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:55,282 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:55,282 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:40714': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:55,383 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:55,384 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:40718': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:55,389 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:55,390 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:40730': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:55,490 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:55,490 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:40744': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:55,496 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38185 5986s 2024-11-23 22:03:55,496 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38185': TLS handshake failed with remote 'tls://127.0.0.1:40760': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:55,527 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40745. Reason: failure-to-start- 5986s 2024-11-23 22:03:55,527 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:03:55,529 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37275. Reason: failure-to-start- 5986s 2024-11-23 22:03:55,529 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:03:55,530 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 15s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 5986s stream = await stream.start_tls( 5986s ^^^^^^^^^^^^^^^^^^^^^^^ 5986s False, ssl_options=ssl_options, server_hostname=host 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 5986s self.socket.do_handshake() 5986s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 5986s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 5986s self._sslobj.do_handshake() 5986s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 5986s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 5986s raise FatalCommClosedError( 5986s ...<2 lines>... 5986s ) from err 5986s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 5986s 5986s During handling of the above exception, another exception occurred: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1218, in _register_with_scheduler 5986s await asyncio.sleep(0.1) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 718, in sleep 5986s return await future 5986s ^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 15s. 5986s 2024-11-23 22:03:56,538 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:03:56,545 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45811 5986s 2024-11-23 22:03:56,546 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43511/status 5986s 2024-11-23 22:03:56,546 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:03:56,563 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35199 5986s 2024-11-23 22:03:56,563 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35199 5986s 2024-11-23 22:03:56,563 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:03:56,563 - distributed.worker - INFO - dashboard at: 127.0.0.1:33879 5986s 2024-11-23 22:03:56,563 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:03:56,563 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:03:56,563 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:03:56,564 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:03:56,564 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-28ghteo1 5986s 2024-11-23 22:03:56,564 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:03:56,565 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45037 5986s 2024-11-23 22:03:56,566 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45037 5986s 2024-11-23 22:03:56,566 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:03:56,566 - distributed.worker - INFO - dashboard at: 127.0.0.1:41339 5986s 2024-11-23 22:03:56,566 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:03:56,566 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:03:56,566 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:03:56,566 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:03:56,566 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-jp3wn_e4 5986s 2024-11-23 22:03:56,566 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:03:56,578 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:03:56,578 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:03:56,579 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:55332': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:56,579 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:55344': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:56,690 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:03:56,690 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:03:56,691 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:55358': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:56,691 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:55366': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:56,802 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:03:56,803 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:03:56,803 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:55370': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:56,803 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:55386': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:56,915 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:03:56,915 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:03:56,915 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:55388': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:56,915 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:55402': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:57,028 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:03:57,028 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:03:57,028 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:55416': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:57,028 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:55430': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:57,139 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:03:57,140 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:03:57,140 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:55436': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:57,140 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:55442': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:57,253 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:03:57,253 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:03:57,253 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:55448': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:57,254 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:55458': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:57,365 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:03:57,365 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:03:57,366 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:55464': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:57,366 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:55470': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:57,478 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:03:57,478 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:03:57,479 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:55472': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:57,479 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:55478': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:57,591 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:03:57,591 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:03:57,591 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:55490': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:57,591 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:55502': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:57,703 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:03:57,703 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:03:57,703 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:55512': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:57,703 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:55526': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:57,815 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:03:57,815 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:03:57,816 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:55538': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:57,816 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:55552': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:57,927 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:03:57,927 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:03:57,928 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:55566': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:57,928 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:55578': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:58,040 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:03:58,040 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:03:58,040 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:55594': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:58,040 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:55606': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:58,153 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:03:58,153 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:03:58,153 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:55618': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:58,153 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:55626': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:58,265 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:03:58,265 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:03:58,266 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:55630': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:58,266 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:55636': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:58,379 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:03:58,379 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:03:58,379 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:55648': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:58,379 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:55664': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:58,491 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:03:58,491 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:03:58,492 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:55672': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:58,492 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:55680': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:58,604 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:03:58,604 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:03:58,605 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:55692': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:58,605 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:55700': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:58,718 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:03:58,718 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:03:58,718 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:55714': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:58,718 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:55722': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:58,831 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:03:58,831 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:03:58,831 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:55738': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:58,831 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:55740': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:58,943 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:03:58,943 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:03:58,943 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:55748': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:58,943 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:55750': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:59,057 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:03:59,057 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:03:59,061 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:55766': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:59,061 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:55774': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:59,169 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:03:59,169 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:03:59,170 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:55784': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:59,170 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:55796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:59,281 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:03:59,281 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:03:59,282 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:55798': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:59,282 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:55812': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:59,393 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:03:59,394 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:03:59,394 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:55818': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:59,394 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:55820': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:59,505 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:03:59,506 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:03:59,506 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:55836': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:59,506 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:55852': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:59,617 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:03:59,618 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:03:59,618 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:55866': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:59,618 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:55882': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:59,729 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:03:59,730 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:03:59,730 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:55888': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:59,730 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:55902': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:59,842 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:03:59,842 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:03:59,842 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:55918': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:59,842 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:55922': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:59,954 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:03:59,954 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:03:59,954 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:55934': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:03:59,954 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:55950': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:00,066 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:00,066 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:00,066 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:55960': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:00,067 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:55964': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:00,179 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:00,179 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:00,179 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:55980': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:00,179 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:55988': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:00,292 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:00,292 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:00,292 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:56000': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:00,292 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:56006': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:00,405 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:00,405 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:00,405 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:56016': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:00,405 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:56020': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:00,516 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:00,516 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:00,520 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:56024': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:00,520 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:56026': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:00,628 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:00,628 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:00,629 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:56028': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:00,629 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:56044': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:00,740 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:00,740 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:00,741 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:56060': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:00,741 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:56064': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:00,854 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:00,854 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:00,854 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:56070': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:00,854 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:56080': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:00,965 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:00,966 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:00,966 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:56086': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:00,966 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:56090': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:01,077 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:01,077 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:01,078 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:56100': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:01,078 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:56102': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:01,190 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:01,190 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:01,190 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:56112': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:01,190 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:56122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:01,302 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:01,302 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:01,303 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:56132': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:01,303 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:56138': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:01,414 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:01,414 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:01,415 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:56142': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:01,415 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:56148': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:01,529 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:01,529 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:01,529 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:56162': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:01,529 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:56178': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:01,641 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:01,641 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:01,641 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:50468': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:01,641 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:50474': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:01,753 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:01,753 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:01,753 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:50484': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:01,753 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:50496': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:01,865 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:01,865 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:01,865 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:50510': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:01,865 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:50512': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:01,979 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:01,979 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:01,979 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:50528': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:01,979 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:50540': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:02,091 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:02,091 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:02,091 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:50550': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:02,091 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:50556': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:02,203 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:02,203 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:02,203 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:50562': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:02,203 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:50568': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:02,316 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:02,316 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:02,316 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:50570': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:02,316 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:50572': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:02,428 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:02,428 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:02,428 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:50574': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:02,428 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:50584': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:02,540 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:02,540 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:02,540 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:50596': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:02,541 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:50602': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:02,653 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:02,653 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:02,654 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:50608': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:02,654 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:50620': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:02,765 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:02,766 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:02,766 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:50622': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:02,766 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:50624': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:02,877 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:02,878 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:02,878 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:50638': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:02,878 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:50640': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:02,989 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:02,990 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:02,990 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:50644': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:02,990 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:50648': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:03,102 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:03,102 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:03,103 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:50656': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:03,103 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:50658': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:03,215 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:03,215 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:03,215 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:50666': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:03,215 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:50668': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:03,326 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:03,327 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:03,327 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:50678': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:03,327 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:50688': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:03,439 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:03,439 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:03,439 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:50698': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:03,439 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:50712': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:03,551 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:03,551 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:03,555 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:50728': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:03,555 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:50736': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:03,663 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:03,663 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:03,663 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:50750': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:03,663 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:50766': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:03,776 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:03,776 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:03,776 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:50780': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:03,777 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:50794': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:03,888 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:03,888 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:03,889 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:50804': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:03,889 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:50806': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:04,001 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:04,001 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:04,001 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:50814': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:04,001 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:50822': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:04,113 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:04,113 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:04,114 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:50826': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:04,114 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:50836': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:04,224 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:04,226 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:04,226 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:50840': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:04,226 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:50852': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:04,334 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:04,338 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:50862': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:04,339 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:04,339 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:50874': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:04,441 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:04,441 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:50882': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:04,447 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:04,448 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:50892': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:04,548 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:04,552 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:50908': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:04,558 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:04,559 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:50916': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:04,655 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:04,655 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:50926': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:04,665 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:04,666 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:50934': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:04,765 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:04,767 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:50944': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:04,776 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:04,777 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:50958': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:04,876 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:04,877 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:50972': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:04,887 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:04,888 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:50982': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:04,987 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:04,987 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:50998': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:04,997 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:04,998 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:51000': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:05,097 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:05,098 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:51016': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:05,107 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:05,108 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:51028': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:05,208 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:05,209 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:51040': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:05,219 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:05,220 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:51044': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:05,319 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:05,320 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:51060': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:05,329 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:05,330 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:51068': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:05,429 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:05,430 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:51070': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:05,439 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:05,440 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:51086': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:05,541 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:05,542 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:51094': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:05,551 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:05,558 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:51108': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:05,652 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:05,653 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:51112': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:05,662 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:05,663 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:51126': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:05,762 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:05,763 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:51130': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:05,773 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:05,774 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:51142': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:05,873 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:05,874 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:51154': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:05,883 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:05,884 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:51168': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:05,984 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:05,985 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:51172': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:05,994 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:05,995 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:51174': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:06,094 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:06,095 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:51176': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:06,105 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:06,106 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:51184': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:06,206 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:06,207 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:51188': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:06,217 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:06,218 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:51194': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:06,317 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:06,318 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:51196': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:06,327 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:06,328 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:51212': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:06,427 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:06,428 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:51220': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:06,437 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:06,438 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:51234': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:06,539 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:06,539 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:51248': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:06,549 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:06,555 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:51254': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:06,650 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:06,651 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:51262': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:06,661 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:06,661 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:51266': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:06,761 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:06,761 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:51272': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:06,771 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:06,772 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:51274': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:06,871 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:06,872 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:51282': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:06,882 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:06,883 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:51284': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:06,982 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:06,982 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:51298': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:06,993 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:06,994 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:51308': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:07,093 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:07,093 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:51310': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:07,103 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:07,104 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:51320': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:07,203 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:07,204 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:51326': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:07,214 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:07,215 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:51328': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:07,315 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:07,317 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:51336': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:07,326 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:07,327 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:51344': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:07,426 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:07,427 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:51348': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:07,436 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:07,437 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:51362': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:07,536 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:07,537 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:51368': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:07,546 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:07,548 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:51384': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:07,647 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:07,648 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:51398': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:07,657 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:07,658 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:51406': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:07,759 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:07,761 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:51410': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:07,770 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:07,771 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:51416': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:07,871 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:07,872 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:51430': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:07,881 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:07,881 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:51434': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:07,979 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:07,979 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:51438': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:07,988 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:07,988 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:51452': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:08,086 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:08,087 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:51456': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:08,095 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:08,095 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:51468': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:08,194 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:08,194 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:51482': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:08,202 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:08,203 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:51488': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:08,301 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:08,302 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:51496': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:08,309 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:08,309 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:51498': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:08,408 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:08,409 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:51504': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:08,416 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:08,416 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:51510': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:08,515 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:08,519 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:51524': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:08,525 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:08,526 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:51540': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:08,622 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:08,623 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:51544': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:08,632 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:08,632 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:51550': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:08,729 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:08,730 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:51566': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:08,739 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:08,739 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:51570': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:08,837 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:08,837 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:51576': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:08,846 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:08,847 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:51580': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:08,944 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:08,944 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:51592': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:08,953 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:08,953 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:51606': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:09,052 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:09,055 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:51622': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:09,061 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:09,062 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:51636': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:09,159 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:09,159 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:51648': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:09,168 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:09,168 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:51654': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:09,266 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:09,266 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:51666': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:09,275 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:09,276 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:51680': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:09,373 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:09,373 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:51692': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:09,384 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:09,384 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:51704': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:09,481 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:09,481 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:51720': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:09,490 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45811 5986s 2024-11-23 22:04:09,491 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45811': TLS handshake failed with remote 'tls://127.0.0.1:51722': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:09,563 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35199. Reason: failure-to-start- 5986s 2024-11-23 22:04:09,563 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:04:09,564 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 13s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 5986s stream = await stream.start_tls( 5986s ^^^^^^^^^^^^^^^^^^^^^^^ 5986s False, ssl_options=ssl_options, server_hostname=host 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 5986s self.socket.do_handshake() 5986s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 5986s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 5986s self._sslobj.do_handshake() 5986s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 5986s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 5986s raise FatalCommClosedError( 5986s ...<2 lines>... 5986s ) from err 5986s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 5986s 5986s During handling of the above exception, another exception occurred: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1218, in _register_with_scheduler 5986s await asyncio.sleep(0.1) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 718, in sleep 5986s return await future 5986s ^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 13s. 5986s 2024-11-23 22:04:09,568 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45037. Reason: failure-to-start- 5986s 2024-11-23 22:04:09,568 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:04:10,571 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:04:10,579 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43275 5986s 2024-11-23 22:04:10,579 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44575/status 5986s 2024-11-23 22:04:10,579 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:04:10,593 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46113 5986s 2024-11-23 22:04:10,593 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46113 5986s 2024-11-23 22:04:10,593 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:04:10,594 - distributed.worker - INFO - dashboard at: 127.0.0.1:36883 5986s 2024-11-23 22:04:10,594 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43275 5986s 2024-11-23 22:04:10,594 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:04:10,594 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:04:10,594 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:04:10,594 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-qe2vezy1 5986s 2024-11-23 22:04:10,594 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:04:10,596 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43789 5986s 2024-11-23 22:04:10,596 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43789 5986s 2024-11-23 22:04:10,596 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:04:10,596 - distributed.worker - INFO - dashboard at: 127.0.0.1:44835 5986s 2024-11-23 22:04:10,596 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43275 5986s 2024-11-23 22:04:10,596 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:04:10,596 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:04:10,596 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:04:10,596 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-i952dhew 5986s 2024-11-23 22:04:10,596 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:04:10,597 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46113. Reason: failure-to-start- 5986s 2024-11-23 22:04:10,597 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:04:10,597 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43789. Reason: failure-to-start- 5986s 2024-11-23 22:04:10,598 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:04:10,598 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43275': TLS handshake failed with remote 'tls://127.0.0.1:44710': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:04:10,598 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43275': TLS handshake failed with remote 'tls://127.0.0.1:44718': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:04:10,600 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:04:11,605 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:04:11,613 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42473 5986s 2024-11-23 22:04:11,613 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35899/status 5986s 2024-11-23 22:04:11,614 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:04:11,627 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38975 5986s 2024-11-23 22:04:11,627 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38975 5986s 2024-11-23 22:04:11,627 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:04:11,628 - distributed.worker - INFO - dashboard at: 127.0.0.1:41173 5986s 2024-11-23 22:04:11,628 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42473 5986s 2024-11-23 22:04:11,628 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:04:11,628 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:04:11,628 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:04:11,628 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-7eh5zzu3 5986s 2024-11-23 22:04:11,628 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:04:11,630 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44255 5986s 2024-11-23 22:04:11,630 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44255 5986s 2024-11-23 22:04:11,630 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:04:11,630 - distributed.worker - INFO - dashboard at: 127.0.0.1:39697 5986s 2024-11-23 22:04:11,630 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42473 5986s 2024-11-23 22:04:11,630 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:04:11,630 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:04:11,630 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:04:11,630 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-h2wbp0wo 5986s 2024-11-23 22:04:11,630 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:04:11,631 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38975. Reason: failure-to-start- 5986s 2024-11-23 22:04:11,631 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:04:11,631 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44255. Reason: failure-to-start- 5986s 2024-11-23 22:04:11,631 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:04:11,632 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42473': TLS handshake failed with remote 'tls://127.0.0.1:50672': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:04:11,632 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42473': TLS handshake failed with remote 'tls://127.0.0.1:50680': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:04:11,634 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:04:12,639 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:04:12,645 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37913 5986s 2024-11-23 22:04:12,645 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33127/status 5986s 2024-11-23 22:04:12,646 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:04:12,660 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38037 5986s 2024-11-23 22:04:12,660 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38037 5986s 2024-11-23 22:04:12,660 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:04:12,660 - distributed.worker - INFO - dashboard at: 127.0.0.1:32983 5986s 2024-11-23 22:04:12,660 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37913 5986s 2024-11-23 22:04:12,660 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:04:12,660 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:04:12,660 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:04:12,660 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-r0f60x5x 5986s 2024-11-23 22:04:12,660 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:04:12,662 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45839 5986s 2024-11-23 22:04:12,662 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45839 5986s 2024-11-23 22:04:12,662 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:04:12,662 - distributed.worker - INFO - dashboard at: 127.0.0.1:43109 5986s 2024-11-23 22:04:12,662 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37913 5986s 2024-11-23 22:04:12,662 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:04:12,662 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:04:12,662 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:04:12,662 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-zk5ivcu2 5986s 2024-11-23 22:04:12,662 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:04:12,663 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38037. Reason: failure-to-start- 5986s 2024-11-23 22:04:12,663 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:04:12,664 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45839. Reason: failure-to-start- 5986s 2024-11-23 22:04:12,664 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:04:12,665 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37913': TLS handshake failed with remote 'tls://127.0.0.1:49708': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:04:12,665 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37913': TLS handshake failed with remote 'tls://127.0.0.1:49722': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:04:12,666 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:04:13,671 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:04:13,678 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39109 5986s 2024-11-23 22:04:13,678 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46603/status 5986s 2024-11-23 22:04:13,678 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:04:13,692 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40013 5986s 2024-11-23 22:04:13,692 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40013 5986s 2024-11-23 22:04:13,692 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:04:13,692 - distributed.worker - INFO - dashboard at: 127.0.0.1:44701 5986s 2024-11-23 22:04:13,692 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39109 5986s 2024-11-23 22:04:13,692 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:04:13,692 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:04:13,692 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:04:13,692 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-_rczglz4 5986s 2024-11-23 22:04:13,692 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:04:13,694 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39939 5986s 2024-11-23 22:04:13,694 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39939 5986s 2024-11-23 22:04:13,694 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:04:13,694 - distributed.worker - INFO - dashboard at: 127.0.0.1:41421 5986s 2024-11-23 22:04:13,694 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39109 5986s 2024-11-23 22:04:13,694 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:04:13,694 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:04:13,694 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:04:13,694 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-g49lz9uy 5986s 2024-11-23 22:04:13,694 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:04:13,695 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40013. Reason: failure-to-start- 5986s 2024-11-23 22:04:13,695 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:04:13,696 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39939. Reason: failure-to-start- 5986s 2024-11-23 22:04:13,696 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:04:13,697 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39109': TLS handshake failed with remote 'tls://127.0.0.1:40618': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:04:13,697 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39109': TLS handshake failed with remote 'tls://127.0.0.1:40626': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:04:13,698 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:04:14,703 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:04:14,709 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42893 5986s 2024-11-23 22:04:14,709 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43965/status 5986s 2024-11-23 22:04:14,709 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:04:14,722 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37931 5986s 2024-11-23 22:04:14,722 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37931 5986s 2024-11-23 22:04:14,722 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:04:14,722 - distributed.worker - INFO - dashboard at: 127.0.0.1:36435 5986s 2024-11-23 22:04:14,722 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42893 5986s 2024-11-23 22:04:14,722 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:04:14,722 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:04:14,722 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:04:14,722 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-wfdape25 5986s 2024-11-23 22:04:14,722 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:04:14,724 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34435 5986s 2024-11-23 22:04:14,724 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34435 5986s 2024-11-23 22:04:14,724 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:04:14,724 - distributed.worker - INFO - dashboard at: 127.0.0.1:35949 5986s 2024-11-23 22:04:14,724 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42893 5986s 2024-11-23 22:04:14,724 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:04:14,724 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:04:14,724 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:04:14,724 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-x4ntkb61 5986s 2024-11-23 22:04:14,724 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:04:14,725 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37931. Reason: failure-to-start- 5986s 2024-11-23 22:04:14,725 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:04:14,726 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34435. Reason: failure-to-start- 5986s 2024-11-23 22:04:14,726 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:04:14,727 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42893': TLS handshake failed with remote 'tls://127.0.0.1:55760': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:04:14,727 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42893': TLS handshake failed with remote 'tls://127.0.0.1:55776': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:04:14,728 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:04:15,732 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:04:15,743 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43199 5986s 2024-11-23 22:04:15,744 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36505/status 5986s 2024-11-23 22:04:15,744 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:04:15,757 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44961 5986s 2024-11-23 22:04:15,757 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44961 5986s 2024-11-23 22:04:15,757 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:04:15,757 - distributed.worker - INFO - dashboard at: 127.0.0.1:33633 5986s 2024-11-23 22:04:15,758 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43199 5986s 2024-11-23 22:04:15,758 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:04:15,758 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:04:15,758 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:04:15,758 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-dknnj2cm 5986s 2024-11-23 22:04:15,758 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:04:15,760 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40683 5986s 2024-11-23 22:04:15,760 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40683 5986s 2024-11-23 22:04:15,760 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:04:15,760 - distributed.worker - INFO - dashboard at: 127.0.0.1:42781 5986s 2024-11-23 22:04:15,760 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43199 5986s 2024-11-23 22:04:15,760 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:04:15,760 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:04:15,760 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:04:15,760 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-byw590ho 5986s 2024-11-23 22:04:15,760 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:04:15,761 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44961. Reason: failure-to-start- 5986s 2024-11-23 22:04:15,761 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:04:15,761 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40683. Reason: failure-to-start- 5986s 2024-11-23 22:04:15,762 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:04:15,763 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43199': TLS handshake failed with remote 'tls://127.0.0.1:43056': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:04:15,763 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43199': TLS handshake failed with remote 'tls://127.0.0.1:43058': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:04:15,764 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:04:16,769 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:04:16,775 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44149 5986s 2024-11-23 22:04:16,776 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44989/status 5986s 2024-11-23 22:04:16,776 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:04:16,790 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36759 5986s 2024-11-23 22:04:16,790 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36759 5986s 2024-11-23 22:04:16,790 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:04:16,791 - distributed.worker - INFO - dashboard at: 127.0.0.1:38919 5986s 2024-11-23 22:04:16,791 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44149 5986s 2024-11-23 22:04:16,791 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:04:16,791 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:04:16,791 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:04:16,791 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-kljzbrhf 5986s 2024-11-23 22:04:16,791 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:04:16,792 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42681 5986s 2024-11-23 22:04:16,793 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42681 5986s 2024-11-23 22:04:16,793 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:04:16,793 - distributed.worker - INFO - dashboard at: 127.0.0.1:33017 5986s 2024-11-23 22:04:16,793 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44149 5986s 2024-11-23 22:04:16,793 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:04:16,793 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:04:16,793 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:04:16,793 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-y1bywb_p 5986s 2024-11-23 22:04:16,793 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:04:16,794 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36759. Reason: failure-to-start- 5986s 2024-11-23 22:04:16,794 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:04:16,794 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42681. Reason: failure-to-start- 5986s 2024-11-23 22:04:16,794 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:04:16,795 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44149': TLS handshake failed with remote 'tls://127.0.0.1:60012': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:04:16,795 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44149': TLS handshake failed with remote 'tls://127.0.0.1:60016': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:04:16,796 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:04:17,801 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:04:17,808 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44145 5986s 2024-11-23 22:04:17,808 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38411/status 5986s 2024-11-23 22:04:17,808 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:04:17,820 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37973 5986s 2024-11-23 22:04:17,820 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37973 5986s 2024-11-23 22:04:17,820 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:04:17,820 - distributed.worker - INFO - dashboard at: 127.0.0.1:39001 5986s 2024-11-23 22:04:17,820 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44145 5986s 2024-11-23 22:04:17,820 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:04:17,820 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:04:17,820 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:04:17,820 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-msfrcaye 5986s 2024-11-23 22:04:17,821 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:04:17,822 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40079 5986s 2024-11-23 22:04:17,822 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40079 5986s 2024-11-23 22:04:17,822 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:04:17,822 - distributed.worker - INFO - dashboard at: 127.0.0.1:41647 5986s 2024-11-23 22:04:17,822 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44145 5986s 2024-11-23 22:04:17,822 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:04:17,822 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:04:17,822 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:04:17,822 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-gevaldru 5986s 2024-11-23 22:04:17,823 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:04:17,823 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37973. Reason: failure-to-start- 5986s 2024-11-23 22:04:17,824 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:04:17,824 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40079. Reason: failure-to-start- 5986s 2024-11-23 22:04:17,824 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:04:17,825 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44145': TLS handshake failed with remote 'tls://127.0.0.1:47714': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:04:17,825 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44145': TLS handshake failed with remote 'tls://127.0.0.1:47720': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:04:17,826 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:04:18,835 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:04:18,848 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44081 5986s 2024-11-23 22:04:18,849 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45557/status 5986s 2024-11-23 22:04:18,850 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:04:18,874 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36245 5986s 2024-11-23 22:04:18,874 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36245 5986s 2024-11-23 22:04:18,874 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:04:18,875 - distributed.worker - INFO - dashboard at: 127.0.0.1:32985 5986s 2024-11-23 22:04:18,875 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44081 5986s 2024-11-23 22:04:18,875 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:04:18,875 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:04:18,875 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:04:18,875 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-8bpdp7qd 5986s 2024-11-23 22:04:18,875 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:04:18,879 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39485 5986s 2024-11-23 22:04:18,879 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39485 5986s 2024-11-23 22:04:18,879 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:04:18,879 - distributed.worker - INFO - dashboard at: 127.0.0.1:36383 5986s 2024-11-23 22:04:18,879 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44081 5986s 2024-11-23 22:04:18,879 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:04:18,879 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:04:18,879 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:04:18,879 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-h18aw3xr 5986s 2024-11-23 22:04:18,879 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:04:18,882 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36245. Reason: failure-to-start- 5986s 2024-11-23 22:04:18,882 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:04:18,883 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39485. Reason: failure-to-start- 5986s 2024-11-23 22:04:18,883 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:04:18,884 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44081': TLS handshake failed with remote 'tls://127.0.0.1:37222': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:04:18,884 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44081': TLS handshake failed with remote 'tls://127.0.0.1:37234': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:04:18,886 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:04:19,892 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:04:19,898 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35033 5986s 2024-11-23 22:04:19,899 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37013/status 5986s 2024-11-23 22:04:19,899 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:04:19,913 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39473 5986s 2024-11-23 22:04:19,913 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39473 5986s 2024-11-23 22:04:19,913 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:04:19,913 - distributed.worker - INFO - dashboard at: 127.0.0.1:34849 5986s 2024-11-23 22:04:19,913 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35033 5986s 2024-11-23 22:04:19,913 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:04:19,913 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:04:19,913 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:04:19,913 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-5pfsmlw8 5986s 2024-11-23 22:04:19,913 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:04:19,915 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42167 5986s 2024-11-23 22:04:19,915 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42167 5986s 2024-11-23 22:04:19,915 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:04:19,915 - distributed.worker - INFO - dashboard at: 127.0.0.1:37899 5986s 2024-11-23 22:04:19,915 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35033 5986s 2024-11-23 22:04:19,915 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:04:19,915 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:04:19,915 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:04:19,916 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-pm9c7wf1 5986s 2024-11-23 22:04:19,916 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:04:19,916 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39473. Reason: failure-to-start- 5986s 2024-11-23 22:04:19,917 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:04:19,917 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42167. Reason: failure-to-start- 5986s 2024-11-23 22:04:19,917 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:04:19,918 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35033': TLS handshake failed with remote 'tls://127.0.0.1:50100': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:04:19,918 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35033': TLS handshake failed with remote 'tls://127.0.0.1:50102': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:04:19,919 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:04:20,924 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:04:20,931 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40211 5986s 2024-11-23 22:04:20,932 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45877/status 5986s 2024-11-23 22:04:20,932 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:04:20,945 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43461 5986s 2024-11-23 22:04:20,945 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43461 5986s 2024-11-23 22:04:20,945 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:04:20,945 - distributed.worker - INFO - dashboard at: 127.0.0.1:37483 5986s 2024-11-23 22:04:20,945 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40211 5986s 2024-11-23 22:04:20,945 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:04:20,945 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:04:20,946 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:04:20,946 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-uc_ne7d4 5986s 2024-11-23 22:04:20,946 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:04:20,948 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42617 5986s 2024-11-23 22:04:20,948 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42617 5986s 2024-11-23 22:04:20,948 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:04:20,948 - distributed.worker - INFO - dashboard at: 127.0.0.1:46141 5986s 2024-11-23 22:04:20,949 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40211 5986s 2024-11-23 22:04:20,949 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:04:20,949 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:04:20,949 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:04:20,949 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-nu1l67fy 5986s 2024-11-23 22:04:20,949 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:04:20,950 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43461. Reason: failure-to-start- 5986s 2024-11-23 22:04:20,950 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:04:20,950 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42617. Reason: failure-to-start- 5986s 2024-11-23 22:04:20,950 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:04:20,951 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40211': TLS handshake failed with remote 'tls://127.0.0.1:39202': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:04:20,951 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40211': TLS handshake failed with remote 'tls://127.0.0.1:39206': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:04:20,953 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:04:21,958 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:04:21,965 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43833 5986s 2024-11-23 22:04:21,965 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36713/status 5986s 2024-11-23 22:04:21,965 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:04:21,979 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45071 5986s 2024-11-23 22:04:21,979 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45071 5986s 2024-11-23 22:04:21,979 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:04:21,979 - distributed.worker - INFO - dashboard at: 127.0.0.1:38603 5986s 2024-11-23 22:04:21,979 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43833 5986s 2024-11-23 22:04:21,979 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:04:21,979 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:04:21,979 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:04:21,979 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-at1cvfe3 5986s 2024-11-23 22:04:21,979 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:04:21,981 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35831 5986s 2024-11-23 22:04:21,981 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35831 5986s 2024-11-23 22:04:21,981 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:04:21,981 - distributed.worker - INFO - dashboard at: 127.0.0.1:43157 5986s 2024-11-23 22:04:21,981 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43833 5986s 2024-11-23 22:04:21,981 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:04:21,982 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:04:21,982 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:04:21,982 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-u1gvp5wl 5986s 2024-11-23 22:04:21,982 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:04:21,983 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45071. Reason: failure-to-start- 5986s 2024-11-23 22:04:21,983 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:04:21,983 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35831. Reason: failure-to-start- 5986s 2024-11-23 22:04:21,983 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:04:21,984 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43833': TLS handshake failed with remote 'tls://127.0.0.1:42108': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:04:21,984 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43833': TLS handshake failed with remote 'tls://127.0.0.1:42110': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:04:21,985 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:04:22,990 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:04:22,999 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33593 5986s 2024-11-23 22:04:22,999 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34283/status 5986s 2024-11-23 22:04:22,999 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:04:23,013 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41861 5986s 2024-11-23 22:04:23,014 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41861 5986s 2024-11-23 22:04:23,014 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:04:23,014 - distributed.worker - INFO - dashboard at: 127.0.0.1:43057 5986s 2024-11-23 22:04:23,014 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33593 5986s 2024-11-23 22:04:23,014 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:04:23,014 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:04:23,014 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:04:23,014 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-lhfgvue7 5986s 2024-11-23 22:04:23,014 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:04:23,016 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35321 5986s 2024-11-23 22:04:23,016 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35321 5986s 2024-11-23 22:04:23,016 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:04:23,016 - distributed.worker - INFO - dashboard at: 127.0.0.1:46375 5986s 2024-11-23 22:04:23,016 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33593 5986s 2024-11-23 22:04:23,016 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:04:23,016 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:04:23,016 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:04:23,016 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-v0rr_qgm 5986s 2024-11-23 22:04:23,016 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:04:23,017 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41861. Reason: failure-to-start- 5986s 2024-11-23 22:04:23,017 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:04:23,018 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35321. Reason: failure-to-start- 5986s 2024-11-23 22:04:23,018 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:04:23,021 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33593': TLS handshake failed with remote 'tls://127.0.0.1:43646': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:04:23,021 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33593': TLS handshake failed with remote 'tls://127.0.0.1:43656': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:04:23,022 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:04:24,028 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:04:24,037 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45667 5986s 2024-11-23 22:04:24,038 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44703/status 5986s 2024-11-23 22:04:24,038 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:04:24,055 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40719 5986s 2024-11-23 22:04:24,055 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40719 5986s 2024-11-23 22:04:24,055 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:04:24,055 - distributed.worker - INFO - dashboard at: 127.0.0.1:37273 5986s 2024-11-23 22:04:24,055 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45667 5986s 2024-11-23 22:04:24,055 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:04:24,055 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:04:24,055 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:04:24,055 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-fzbtozpp 5986s 2024-11-23 22:04:24,055 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:04:24,057 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35937 5986s 2024-11-23 22:04:24,057 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35937 5986s 2024-11-23 22:04:24,057 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:04:24,057 - distributed.worker - INFO - dashboard at: 127.0.0.1:35567 5986s 2024-11-23 22:04:24,058 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45667 5986s 2024-11-23 22:04:24,058 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:04:24,058 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:04:24,058 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:04:24,058 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-k55lcqap 5986s 2024-11-23 22:04:24,058 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:04:24,062 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40719. Reason: failure-to-start- 5986s 2024-11-23 22:04:24,062 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:04:24,062 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35937. Reason: failure-to-start- 5986s 2024-11-23 22:04:24,062 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:04:24,063 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45667': TLS handshake failed with remote 'tls://127.0.0.1:44258': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:04:24,064 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45667': TLS handshake failed with remote 'tls://127.0.0.1:44262': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:04:24,065 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:04:25,069 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:04:25,077 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44545 5986s 2024-11-23 22:04:25,077 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37247/status 5986s 2024-11-23 22:04:25,077 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:04:25,092 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41691 5986s 2024-11-23 22:04:25,092 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41691 5986s 2024-11-23 22:04:25,092 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:04:25,092 - distributed.worker - INFO - dashboard at: 127.0.0.1:39977 5986s 2024-11-23 22:04:25,092 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44545 5986s 2024-11-23 22:04:25,092 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:04:25,092 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:04:25,092 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:04:25,092 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-i8yxv3w8 5986s 2024-11-23 22:04:25,092 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:04:25,094 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45109 5986s 2024-11-23 22:04:25,094 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45109 5986s 2024-11-23 22:04:25,094 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:04:25,094 - distributed.worker - INFO - dashboard at: 127.0.0.1:40685 5986s 2024-11-23 22:04:25,094 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44545 5986s 2024-11-23 22:04:25,095 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:04:25,095 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:04:25,095 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:04:25,095 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-s92qks7u 5986s 2024-11-23 22:04:25,095 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:04:25,099 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41691. Reason: failure-to-start- 5986s 2024-11-23 22:04:25,099 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:04:25,099 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45109. Reason: failure-to-start- 5986s 2024-11-23 22:04:25,099 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:04:25,100 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44545': TLS handshake failed with remote 'tls://127.0.0.1:33562': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:04:25,100 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44545': TLS handshake failed with remote 'tls://127.0.0.1:33566': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:04:25,102 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:04:26,106 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:04:26,114 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33251 5986s 2024-11-23 22:04:26,115 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34791/status 5986s 2024-11-23 22:04:26,115 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:04:26,133 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34235 5986s 2024-11-23 22:04:26,133 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34235 5986s 2024-11-23 22:04:26,133 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:04:26,133 - distributed.worker - INFO - dashboard at: 127.0.0.1:44147 5986s 2024-11-23 22:04:26,133 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33251 5986s 2024-11-23 22:04:26,133 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:04:26,133 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:04:26,133 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:04:26,133 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-1o_of66f 5986s 2024-11-23 22:04:26,133 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:04:26,135 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43109 5986s 2024-11-23 22:04:26,135 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43109 5986s 2024-11-23 22:04:26,135 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:04:26,135 - distributed.worker - INFO - dashboard at: 127.0.0.1:37845 5986s 2024-11-23 22:04:26,135 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33251 5986s 2024-11-23 22:04:26,135 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:04:26,135 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:04:26,135 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:04:26,135 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-760vy1pj 5986s 2024-11-23 22:04:26,135 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:04:26,136 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34235. Reason: failure-to-start- 5986s 2024-11-23 22:04:26,136 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:04:26,137 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43109. Reason: failure-to-start- 5986s 2024-11-23 22:04:26,137 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:04:26,138 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33251': TLS handshake failed with remote 'tls://127.0.0.1:46142': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:04:26,138 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33251': TLS handshake failed with remote 'tls://127.0.0.1:46148': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:04:26,139 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:04:27,144 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:04:27,152 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45431 5986s 2024-11-23 22:04:27,152 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33915/status 5986s 2024-11-23 22:04:27,152 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:04:27,169 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46065 5986s 2024-11-23 22:04:27,169 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46065 5986s 2024-11-23 22:04:27,169 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:04:27,169 - distributed.worker - INFO - dashboard at: 127.0.0.1:35375 5986s 2024-11-23 22:04:27,169 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45431 5986s 2024-11-23 22:04:27,169 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:04:27,170 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:04:27,170 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:04:27,170 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-n2sv3vs8 5986s 2024-11-23 22:04:27,170 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:04:27,171 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33847 5986s 2024-11-23 22:04:27,171 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33847 5986s 2024-11-23 22:04:27,172 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:04:27,172 - distributed.worker - INFO - dashboard at: 127.0.0.1:37333 5986s 2024-11-23 22:04:27,172 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45431 5986s 2024-11-23 22:04:27,172 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:04:27,172 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:04:27,172 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:04:27,172 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-p6zhczdx 5986s 2024-11-23 22:04:27,172 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:04:27,173 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46065. Reason: failure-to-start- 5986s 2024-11-23 22:04:27,173 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:04:27,173 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33847. Reason: failure-to-start- 5986s 2024-11-23 22:04:27,173 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:04:27,174 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45431': TLS handshake failed with remote 'tls://127.0.0.1:56882': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:04:27,174 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45431': TLS handshake failed with remote 'tls://127.0.0.1:56884': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:04:27,175 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:04:28,180 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:04:28,188 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36073 5986s 2024-11-23 22:04:28,189 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43457/status 5986s 2024-11-23 22:04:28,189 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:04:28,209 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38821 5986s 2024-11-23 22:04:28,209 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38821 5986s 2024-11-23 22:04:28,209 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:04:28,209 - distributed.worker - INFO - dashboard at: 127.0.0.1:33161 5986s 2024-11-23 22:04:28,209 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36073 5986s 2024-11-23 22:04:28,209 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:04:28,209 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:04:28,209 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:04:28,209 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-vwbdm_av 5986s 2024-11-23 22:04:28,209 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:04:28,211 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36845 5986s 2024-11-23 22:04:28,211 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36845 5986s 2024-11-23 22:04:28,211 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:04:28,211 - distributed.worker - INFO - dashboard at: 127.0.0.1:39989 5986s 2024-11-23 22:04:28,211 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36073 5986s 2024-11-23 22:04:28,211 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:04:28,211 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:04:28,212 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:04:28,212 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-4pmsa48h 5986s 2024-11-23 22:04:28,212 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:04:28,213 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38821. Reason: failure-to-start- 5986s 2024-11-23 22:04:28,213 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:04:28,213 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36845. Reason: failure-to-start- 5986s 2024-11-23 22:04:28,213 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:04:28,217 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36073': TLS handshake failed with remote 'tls://127.0.0.1:50392': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:04:28,217 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36073': TLS handshake failed with remote 'tls://127.0.0.1:50408': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:04:28,218 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:04:29,225 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:04:29,240 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37611 5986s 2024-11-23 22:04:29,241 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33257/status 5986s 2024-11-23 22:04:29,241 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:04:29,270 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33141 5986s 2024-11-23 22:04:29,271 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33141 5986s 2024-11-23 22:04:29,271 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:04:29,271 - distributed.worker - INFO - dashboard at: 127.0.0.1:34899 5986s 2024-11-23 22:04:29,271 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37611 5986s 2024-11-23 22:04:29,271 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:04:29,271 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:04:29,271 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:04:29,271 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-cbg8ts46 5986s 2024-11-23 22:04:29,271 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:04:29,275 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34267 5986s 2024-11-23 22:04:29,275 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34267 5986s 2024-11-23 22:04:29,276 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:04:29,276 - distributed.worker - INFO - dashboard at: 127.0.0.1:46825 5986s 2024-11-23 22:04:29,276 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37611 5986s 2024-11-23 22:04:29,276 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:04:29,276 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:04:29,276 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:04:29,276 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-vaw_vgs8 5986s 2024-11-23 22:04:29,276 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:04:29,286 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33141. Reason: failure-to-start- 5986s 2024-11-23 22:04:29,287 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:04:29,288 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34267. Reason: failure-to-start- 5986s 2024-11-23 22:04:29,288 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:04:29,295 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37611': TLS handshake failed with remote 'tls://127.0.0.1:44302': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:04:29,296 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37611': TLS handshake failed with remote 'tls://127.0.0.1:44318': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:04:29,299 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:04:30,304 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:04:30,312 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40393 5986s 2024-11-23 22:04:30,313 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34331/status 5986s 2024-11-23 22:04:30,313 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:04:30,330 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33587 5986s 2024-11-23 22:04:30,330 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33587 5986s 2024-11-23 22:04:30,330 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:04:30,330 - distributed.worker - INFO - dashboard at: 127.0.0.1:38083 5986s 2024-11-23 22:04:30,330 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40393 5986s 2024-11-23 22:04:30,330 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:04:30,330 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:04:30,330 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:04:30,330 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-lrbsc46y 5986s 2024-11-23 22:04:30,330 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:04:30,332 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40711 5986s 2024-11-23 22:04:30,332 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40711 5986s 2024-11-23 22:04:30,332 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:04:30,332 - distributed.worker - INFO - dashboard at: 127.0.0.1:44723 5986s 2024-11-23 22:04:30,332 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40393 5986s 2024-11-23 22:04:30,332 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:04:30,333 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:04:30,333 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:04:30,333 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-2au9s9l1 5986s 2024-11-23 22:04:30,333 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:04:30,334 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33587. Reason: failure-to-start- 5986s 2024-11-23 22:04:30,334 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:04:30,334 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40711. Reason: failure-to-start- 5986s 2024-11-23 22:04:30,334 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:04:30,335 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40393': TLS handshake failed with remote 'tls://127.0.0.1:34348': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:04:30,335 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40393': TLS handshake failed with remote 'tls://127.0.0.1:34362': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:04:30,336 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:04:31,341 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:04:31,349 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45353 5986s 2024-11-23 22:04:31,349 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46049/status 5986s 2024-11-23 22:04:31,350 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:04:31,364 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37613 5986s 2024-11-23 22:04:31,364 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37613 5986s 2024-11-23 22:04:31,364 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:04:31,364 - distributed.worker - INFO - dashboard at: 127.0.0.1:41029 5986s 2024-11-23 22:04:31,364 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45353 5986s 2024-11-23 22:04:31,364 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:04:31,364 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:04:31,364 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:04:31,364 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-bq274pqn 5986s 2024-11-23 22:04:31,364 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:04:31,366 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46193 5986s 2024-11-23 22:04:31,366 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46193 5986s 2024-11-23 22:04:31,366 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:04:31,366 - distributed.worker - INFO - dashboard at: 127.0.0.1:35715 5986s 2024-11-23 22:04:31,366 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45353 5986s 2024-11-23 22:04:31,367 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:04:31,367 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:04:31,367 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:04:31,367 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-fnzr7koi 5986s 2024-11-23 22:04:31,367 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:04:31,370 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37613. Reason: failure-to-start- 5986s 2024-11-23 22:04:31,370 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:04:31,371 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46193. Reason: failure-to-start- 5986s 2024-11-23 22:04:31,371 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:04:31,372 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45353': TLS handshake failed with remote 'tls://127.0.0.1:58158': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:04:31,372 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45353': TLS handshake failed with remote 'tls://127.0.0.1:58164': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:04:31,373 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:04:32,377 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:04:32,385 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40101 5986s 2024-11-23 22:04:32,386 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38923/status 5986s 2024-11-23 22:04:32,386 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:04:32,411 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38583 5986s 2024-11-23 22:04:32,411 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38583 5986s 2024-11-23 22:04:32,411 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:04:32,411 - distributed.worker - INFO - dashboard at: 127.0.0.1:39425 5986s 2024-11-23 22:04:32,411 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40101 5986s 2024-11-23 22:04:32,411 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:04:32,411 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:04:32,411 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:04:32,411 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-3ybpgjty 5986s 2024-11-23 22:04:32,411 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:04:32,413 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36667 5986s 2024-11-23 22:04:32,413 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36667 5986s 2024-11-23 22:04:32,413 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:04:32,413 - distributed.worker - INFO - dashboard at: 127.0.0.1:41831 5986s 2024-11-23 22:04:32,413 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40101 5986s 2024-11-23 22:04:32,413 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:04:32,413 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:04:32,413 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:04:32,413 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ioustcg1 5986s 2024-11-23 22:04:32,413 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:04:32,417 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38583. Reason: failure-to-start- 5986s 2024-11-23 22:04:32,418 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:04:32,418 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36667. Reason: failure-to-start- 5986s 2024-11-23 22:04:32,418 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:04:32,419 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40101': TLS handshake failed with remote 'tls://127.0.0.1:37768': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:04:32,419 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40101': TLS handshake failed with remote 'tls://127.0.0.1:37774': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:04:32,420 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:04:33,426 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:04:33,433 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44353 5986s 2024-11-23 22:04:33,434 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41505/status 5986s 2024-11-23 22:04:33,434 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:04:33,452 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42697 5986s 2024-11-23 22:04:33,452 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42697 5986s 2024-11-23 22:04:33,452 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:04:33,453 - distributed.worker - INFO - dashboard at: 127.0.0.1:42369 5986s 2024-11-23 22:04:33,453 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44353 5986s 2024-11-23 22:04:33,453 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:04:33,453 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:04:33,453 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:04:33,453 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ghih1eha 5986s 2024-11-23 22:04:33,453 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:04:33,455 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36537 5986s 2024-11-23 22:04:33,455 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36537 5986s 2024-11-23 22:04:33,455 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:04:33,455 - distributed.worker - INFO - dashboard at: 127.0.0.1:42427 5986s 2024-11-23 22:04:33,455 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44353 5986s 2024-11-23 22:04:33,455 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:04:33,455 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:04:33,455 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:04:33,455 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-hnb_mxc7 5986s 2024-11-23 22:04:33,455 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:04:33,457 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42697. Reason: failure-to-start- 5986s 2024-11-23 22:04:33,457 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:04:33,458 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36537. Reason: failure-to-start- 5986s 2024-11-23 22:04:33,458 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:04:33,459 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44353': TLS handshake failed with remote 'tls://127.0.0.1:37668': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:04:33,459 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44353': TLS handshake failed with remote 'tls://127.0.0.1:37676': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:04:33,460 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:04:34,465 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:04:34,472 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40911 5986s 2024-11-23 22:04:34,473 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41329/status 5986s 2024-11-23 22:04:34,473 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:04:34,490 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42139 5986s 2024-11-23 22:04:34,490 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42139 5986s 2024-11-23 22:04:34,491 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:04:34,491 - distributed.worker - INFO - dashboard at: 127.0.0.1:36085 5986s 2024-11-23 22:04:34,491 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40911 5986s 2024-11-23 22:04:34,491 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:04:34,491 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:04:34,491 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:04:34,491 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-2ux6o7v3 5986s 2024-11-23 22:04:34,491 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:04:34,493 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46879 5986s 2024-11-23 22:04:34,493 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46879 5986s 2024-11-23 22:04:34,493 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:04:34,493 - distributed.worker - INFO - dashboard at: 127.0.0.1:33213 5986s 2024-11-23 22:04:34,493 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40911 5986s 2024-11-23 22:04:34,493 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:04:34,493 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:04:34,493 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:04:34,493 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-_q3bdpqi 5986s 2024-11-23 22:04:34,493 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:04:34,494 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42139. Reason: failure-to-start- 5986s 2024-11-23 22:04:34,494 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:04:34,495 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46879. Reason: failure-to-start- 5986s 2024-11-23 22:04:34,495 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:04:34,496 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40911': TLS handshake failed with remote 'tls://127.0.0.1:46302': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:04:34,496 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40911': TLS handshake failed with remote 'tls://127.0.0.1:46306': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:04:34,497 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:04:35,502 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:04:35,512 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43283 5986s 2024-11-23 22:04:35,512 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33269/status 5986s 2024-11-23 22:04:35,515 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:04:35,534 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34149 5986s 2024-11-23 22:04:35,534 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34149 5986s 2024-11-23 22:04:35,534 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:04:35,534 - distributed.worker - INFO - dashboard at: 127.0.0.1:40083 5986s 2024-11-23 22:04:35,534 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43283 5986s 2024-11-23 22:04:35,535 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:04:35,535 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:04:35,535 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:04:35,535 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-2614t9f_ 5986s 2024-11-23 22:04:35,535 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:04:35,536 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:32795 5986s 2024-11-23 22:04:35,537 - distributed.worker - INFO - Listening to: tls://127.0.0.1:32795 5986s 2024-11-23 22:04:35,537 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:04:35,537 - distributed.worker - INFO - dashboard at: 127.0.0.1:43669 5986s 2024-11-23 22:04:35,537 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43283 5986s 2024-11-23 22:04:35,537 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:04:35,537 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:04:35,537 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:04:35,537 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-udefuovd 5986s 2024-11-23 22:04:35,537 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:04:35,538 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34149. Reason: failure-to-start- 5986s 2024-11-23 22:04:35,538 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:04:35,538 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:32795. Reason: failure-to-start- 5986s 2024-11-23 22:04:35,539 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:04:35,540 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43283': TLS handshake failed with remote 'tls://127.0.0.1:57190': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:04:35,540 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43283': TLS handshake failed with remote 'tls://127.0.0.1:57200': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:04:35,544 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:04:36,552 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:04:36,559 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42531 5986s 2024-11-23 22:04:36,559 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41205/status 5986s 2024-11-23 22:04:36,560 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:04:36,576 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45071 5986s 2024-11-23 22:04:36,577 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45071 5986s 2024-11-23 22:04:36,577 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:04:36,577 - distributed.worker - INFO - dashboard at: 127.0.0.1:38595 5986s 2024-11-23 22:04:36,577 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42531 5986s 2024-11-23 22:04:36,577 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:04:36,577 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:04:36,577 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:04:36,577 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-alvs7_gv 5986s 2024-11-23 22:04:36,577 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:04:36,579 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39819 5986s 2024-11-23 22:04:36,579 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39819 5986s 2024-11-23 22:04:36,579 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:04:36,579 - distributed.worker - INFO - dashboard at: 127.0.0.1:37067 5986s 2024-11-23 22:04:36,579 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42531 5986s 2024-11-23 22:04:36,579 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:04:36,579 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:04:36,579 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:04:36,579 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-swztzo7q 5986s 2024-11-23 22:04:36,579 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:04:36,580 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45071. Reason: failure-to-start- 5986s 2024-11-23 22:04:36,581 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:04:36,581 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39819. Reason: failure-to-start- 5986s 2024-11-23 22:04:36,581 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:04:36,587 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42531': TLS handshake failed with remote 'tls://127.0.0.1:44248': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:04:36,587 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42531': TLS handshake failed with remote 'tls://127.0.0.1:44250': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:04:36,589 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:04:37,594 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:04:37,601 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46375 5986s 2024-11-23 22:04:37,601 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33213/status 5986s 2024-11-23 22:04:37,601 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:04:37,617 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38041 5986s 2024-11-23 22:04:37,617 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38041 5986s 2024-11-23 22:04:37,617 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:04:37,617 - distributed.worker - INFO - dashboard at: 127.0.0.1:35289 5986s 2024-11-23 22:04:37,617 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46375 5986s 2024-11-23 22:04:37,617 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:04:37,617 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:04:37,617 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:04:37,617 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-7q0j_zo3 5986s 2024-11-23 22:04:37,617 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:04:37,619 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38145 5986s 2024-11-23 22:04:37,619 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38145 5986s 2024-11-23 22:04:37,619 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:04:37,619 - distributed.worker - INFO - dashboard at: 127.0.0.1:37567 5986s 2024-11-23 22:04:37,620 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46375 5986s 2024-11-23 22:04:37,620 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:04:37,620 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:04:37,620 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:04:37,620 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ufu3t6fo 5986s 2024-11-23 22:04:37,620 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:04:37,625 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38041. Reason: failure-to-start- 5986s 2024-11-23 22:04:37,625 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:04:37,625 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38145. Reason: failure-to-start- 5986s 2024-11-23 22:04:37,626 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:04:37,629 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46375': TLS handshake failed with remote 'tls://127.0.0.1:46982': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:04:37,629 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46375': TLS handshake failed with remote 'tls://127.0.0.1:46996': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:04:37,631 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:04:38,636 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:04:38,643 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37663 5986s 2024-11-23 22:04:38,644 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33499/status 5986s 2024-11-23 22:04:38,644 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:04:38,659 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45589 5986s 2024-11-23 22:04:38,659 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45589 5986s 2024-11-23 22:04:38,659 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:04:38,659 - distributed.worker - INFO - dashboard at: 127.0.0.1:41051 5986s 2024-11-23 22:04:38,659 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37663 5986s 2024-11-23 22:04:38,659 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:04:38,659 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:04:38,659 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:04:38,659 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-j5pfk3ly 5986s 2024-11-23 22:04:38,660 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:04:38,661 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43107 5986s 2024-11-23 22:04:38,661 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43107 5986s 2024-11-23 22:04:38,662 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:04:38,662 - distributed.worker - INFO - dashboard at: 127.0.0.1:40697 5986s 2024-11-23 22:04:38,662 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37663 5986s 2024-11-23 22:04:38,662 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:04:38,662 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:04:38,662 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:04:38,662 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-z5icv_0y 5986s 2024-11-23 22:04:38,662 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:04:38,669 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45589. Reason: failure-to-start- 5986s 2024-11-23 22:04:38,669 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:04:38,669 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43107. Reason: failure-to-start- 5986s 2024-11-23 22:04:38,669 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:04:38,670 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37663': TLS handshake failed with remote 'tls://127.0.0.1:58548': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:04:38,671 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37663': TLS handshake failed with remote 'tls://127.0.0.1:58562': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:04:38,672 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:04:39,677 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:04:39,687 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36391 5986s 2024-11-23 22:04:39,688 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44825/status 5986s 2024-11-23 22:04:39,688 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:04:39,707 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46879 5986s 2024-11-23 22:04:39,707 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46879 5986s 2024-11-23 22:04:39,707 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:04:39,707 - distributed.worker - INFO - dashboard at: 127.0.0.1:43343 5986s 2024-11-23 22:04:39,707 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36391 5986s 2024-11-23 22:04:39,707 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:04:39,708 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:04:39,708 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:04:39,708 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-0vtg1wbi 5986s 2024-11-23 22:04:39,708 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:04:39,709 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46429 5986s 2024-11-23 22:04:39,710 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46429 5986s 2024-11-23 22:04:39,710 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:04:39,710 - distributed.worker - INFO - dashboard at: 127.0.0.1:32885 5986s 2024-11-23 22:04:39,710 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36391 5986s 2024-11-23 22:04:39,710 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:04:39,710 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:04:39,710 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:04:39,710 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-7i36n0bz 5986s 2024-11-23 22:04:39,710 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:04:39,714 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46879. Reason: failure-to-start- 5986s 2024-11-23 22:04:39,714 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:04:39,714 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46429. Reason: failure-to-start- 5986s 2024-11-23 22:04:39,714 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:04:39,718 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36391': TLS handshake failed with remote 'tls://127.0.0.1:41608': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:04:39,718 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36391': TLS handshake failed with remote 'tls://127.0.0.1:41618': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:04:39,720 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s ______________________________ test_work_stealing ______________________________ 5986s 5986s fut = , timeout = 0 5986s 5986s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 5986s async with asyncio.timeout(timeout): 5986s > return await fut 5986s 5986s /usr/lib/python3/dist-packages/distributed/utils.py:1960: 5986s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5986s /usr/lib/python3/dist-packages/distributed/worker.py:1480: in start_unsafe 5986s await self._register_with_scheduler() 5986s /usr/lib/python3/dist-packages/distributed/worker.py:1179: in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s /usr/lib/python3/dist-packages/distributed/comm/core.py:342: in connect 5986s comm = await wait_for( 5986s /usr/lib/python3/dist-packages/distributed/utils.py:1960: in wait_for 5986s return await fut 5986s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:546: in connect 5986s stream = await self.client.connect( 5986s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5986s 5986s self = , host = '127.0.0.1' 5986s port = 42951, af = 5986s ssl_options = 5986s max_buffer_size = 8364507136.0, source_ip = None, source_port = None 5986s timeout = None 5986s 5986s async def connect( 5986s self, 5986s host: str, 5986s port: int, 5986s af: socket.AddressFamily = socket.AF_UNSPEC, 5986s ssl_options: Optional[Union[Dict[str, Any], ssl.SSLContext]] = None, 5986s max_buffer_size: Optional[int] = None, 5986s source_ip: Optional[str] = None, 5986s source_port: Optional[int] = None, 5986s timeout: Optional[Union[float, datetime.timedelta]] = None, 5986s ) -> IOStream: 5986s """Connect to the given host and port. 5986s 5986s Asynchronously returns an `.IOStream` (or `.SSLIOStream` if 5986s ``ssl_options`` is not None). 5986s 5986s Using the ``source_ip`` kwarg, one can specify the source 5986s IP address to use when establishing the connection. 5986s In case the user needs to resolve and 5986s use a specific interface, it has to be handled outside 5986s of Tornado as this depends very much on the platform. 5986s 5986s Raises `TimeoutError` if the input future does not complete before 5986s ``timeout``, which may be specified in any form allowed by 5986s `.IOLoop.add_timeout` (i.e. a `datetime.timedelta` or an absolute time 5986s relative to `.IOLoop.time`) 5986s 5986s Similarly, when the user requires a certain source port, it can 5986s be specified using the ``source_port`` arg. 5986s 5986s .. versionchanged:: 4.5 5986s Added the ``source_ip`` and ``source_port`` arguments. 5986s 5986s .. versionchanged:: 5.0 5986s Added the ``timeout`` argument. 5986s """ 5986s if timeout is not None: 5986s if isinstance(timeout, numbers.Real): 5986s timeout = IOLoop.current().time() + timeout 5986s elif isinstance(timeout, datetime.timedelta): 5986s timeout = IOLoop.current().time() + timeout.total_seconds() 5986s else: 5986s raise TypeError("Unsupported timeout %r" % timeout) 5986s if timeout is not None: 5986s addrinfo = await gen.with_timeout( 5986s timeout, self.resolver.resolve(host, port, af) 5986s ) 5986s else: 5986s addrinfo = await self.resolver.resolve(host, port, af) 5986s connector = _Connector( 5986s addrinfo, 5986s functools.partial( 5986s self._create_stream, 5986s max_buffer_size, 5986s source_ip=source_ip, 5986s source_port=source_port, 5986s ), 5986s ) 5986s > af, addr, stream = await connector.start(connect_timeout=timeout) 5986s E asyncio.exceptions.CancelledError 5986s 5986s /usr/lib/python3/dist-packages/tornado/tcpclient.py:279: CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s self = 5986s 5986s @final 5986s async def start(self): 5986s async with self._startup_lock: 5986s if self.status == Status.failed: 5986s assert self.__startup_exc is not None 5986s raise self.__startup_exc 5986s elif self.status != Status.init: 5986s return self 5986s timeout = getattr(self, "death_timeout", None) 5986s 5986s async def _close_on_failure(exc: Exception) -> None: 5986s await self.close(reason=f"failure-to-start-{str(type(exc))}") 5986s self.status = Status.failed 5986s self.__startup_exc = exc 5986s 5986s try: 5986s > await wait_for(self.start_unsafe(), timeout=timeout) 5986s 5986s /usr/lib/python3/dist-packages/distributed/core.py:664: 5986s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5986s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 5986s async with asyncio.timeout(timeout): 5986s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5986s 5986s self = 5986s exc_type = 5986s exc_val = CancelledError(), exc_tb = 5986s 5986s async def __aexit__( 5986s self, 5986s exc_type: Optional[Type[BaseException]], 5986s exc_val: Optional[BaseException], 5986s exc_tb: Optional[TracebackType], 5986s ) -> Optional[bool]: 5986s assert self._state in (_State.ENTERED, _State.EXPIRING) 5986s 5986s if self._timeout_handler is not None: 5986s self._timeout_handler.cancel() 5986s self._timeout_handler = None 5986s 5986s if self._state is _State.EXPIRING: 5986s self._state = _State.EXPIRED 5986s 5986s if self._task.uncancel() <= self._cancelling and exc_type is not None: 5986s # Since there are no new cancel requests, we're 5986s # handling this. 5986s if issubclass(exc_type, exceptions.CancelledError): 5986s > raise TimeoutError from exc_val 5986s E TimeoutError 5986s 5986s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s @contextlib.asynccontextmanager 5986s async def _cluster_factory(): 5986s workers = [] 5986s s = None 5986s try: 5986s for _ in range(60): 5986s try: 5986s > s, ws = await start_cluster( 5986s nthreads, 5986s scheduler, 5986s security=security, 5986s Worker=Worker, 5986s scheduler_kwargs=scheduler_kwargs, 5986s worker_kwargs=merge( 5986s {"death_timeout": min(15, int(deadline.remaining))}, 5986s worker_kwargs, 5986s ), 5986s ) 5986s 5986s /usr/lib/python3/dist-packages/distributed/utils_test.py:966: 5986s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5986s /usr/lib/python3/dist-packages/distributed/utils_test.py:789: in start_cluster 5986s await asyncio.gather(*workers) 5986s /usr/lib/python3.13/asyncio/tasks.py:737: in _wrap_awaitable 5986s return await awaitable 5986s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5986s 5986s self = 5986s 5986s @final 5986s async def start(self): 5986s async with self._startup_lock: 5986s if self.status == Status.failed: 5986s assert self.__startup_exc is not None 5986s raise self.__startup_exc 5986s elif self.status != Status.init: 5986s return self 5986s timeout = getattr(self, "death_timeout", None) 5986s 5986s async def _close_on_failure(exc: Exception) -> None: 5986s await self.close(reason=f"failure-to-start-{str(type(exc))}") 5986s self.status = Status.failed 5986s self.__startup_exc = exc 5986s 5986s try: 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s except asyncio.TimeoutError as exc: 5986s await _close_on_failure(exc) 5986s > raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s E TimeoutError: Worker start timed out after 0s. 5986s 5986s /usr/lib/python3/dist-packages/distributed/core.py:667: TimeoutError 5986s 5986s During handling of the above exception, another exception occurred: 5986s 5986s fut = ._..test_func..async_fn at 0xde81ab08> 5986s timeout = 60 5986s 5986s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 5986s async with asyncio.timeout(timeout): 5986s > return await fut 5986s 5986s /usr/lib/python3/dist-packages/distributed/utils.py:1960: 5986s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5986s /usr/lib/python3/dist-packages/distributed/utils_test.py:999: in async_fn 5986s _cluster_factory() as (s, workers), 5986s /usr/lib/python3.13/contextlib.py:214: in __aenter__ 5986s return await anext(self.gen) 5986s /usr/lib/python3/dist-packages/distributed/utils_test.py:983: in _cluster_factory 5986s await asyncio.sleep(1) 5986s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5986s 5986s delay = 1, result = None 5986s 5986s async def sleep(delay, result=None): 5986s """Coroutine that completes after a given time (in seconds).""" 5986s if delay <= 0: 5986s await __sleep0() 5986s return result 5986s 5986s if math.isnan(delay): 5986s raise ValueError("Invalid delay: NaN (not a number)") 5986s 5986s loop = events.get_running_loop() 5986s future = loop.create_future() 5986s h = loop.call_later(delay, 5986s futures._set_result_unless_cancelled, 5986s future, result) 5986s try: 5986s > return await future 5986s E asyncio.exceptions.CancelledError 5986s 5986s /usr/lib/python3.13/asyncio/tasks.py:718: CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s args = (), kwds = {} 5986s 5986s @wraps(func) 5986s def inner(*args, **kwds): 5986s with self._recreate_cm(): 5986s > return func(*args, **kwds) 5986s 5986s /usr/lib/python3.13/contextlib.py:85: 5986s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5986s /usr/lib/python3.13/contextlib.py:85: in inner 5986s return func(*args, **kwds) 5986s /usr/lib/python3/dist-packages/distributed/utils_test.py:1102: in test_func 5986s return _run_and_close_tornado(async_fn_outer) 5986s /usr/lib/python3/dist-packages/distributed/utils_test.py:378: in _run_and_close_tornado 5986s return asyncio_run(inner_fn(), loop_factory=get_loop_factory()) 5986s /usr/lib/python3.13/asyncio/runners.py:194: in run 5986s return runner.run(main) 5986s /usr/lib/python3.13/asyncio/runners.py:118: in run 5986s return self._loop.run_until_complete(task) 5986s /usr/lib/python3.13/asyncio/base_events.py:720: in run_until_complete 5986s return future.result() 5986s /usr/lib/python3/dist-packages/distributed/utils_test.py:375: in inner_fn 5986s return await async_fn(*args, **kwargs) 5986s /usr/lib/python3/dist-packages/distributed/utils_test.py:1099: in async_fn_outer 5986s return await utils_wait_for(async_fn(), timeout=timeout * 2) 5986s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 5986s async with asyncio.timeout(timeout): 5986s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5986s 5986s self = 5986s exc_type = 5986s exc_val = CancelledError(), exc_tb = 5986s 5986s async def __aexit__( 5986s self, 5986s exc_type: Optional[Type[BaseException]], 5986s exc_val: Optional[BaseException], 5986s exc_tb: Optional[TracebackType], 5986s ) -> Optional[bool]: 5986s assert self._state in (_State.ENTERED, _State.EXPIRING) 5986s 5986s if self._timeout_handler is not None: 5986s self._timeout_handler.cancel() 5986s self._timeout_handler = None 5986s 5986s if self._state is _State.EXPIRING: 5986s self._state = _State.EXPIRED 5986s 5986s if self._task.uncancel() <= self._cancelling and exc_type is not None: 5986s # Since there are no new cancel requests, we're 5986s # handling this. 5986s if issubclass(exc_type, exceptions.CancelledError): 5986s > raise TimeoutError from exc_val 5986s E TimeoutError 5986s 5986s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 5986s ----------------------------- Captured stderr call ----------------------------- 5986s 2024-11-23 22:04:40,972 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:04:40,980 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:40,980 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40481/status 5986s 2024-11-23 22:04:40,981 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:04:40,996 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43941 5986s 2024-11-23 22:04:40,996 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43941 5986s 2024-11-23 22:04:40,996 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:04:40,996 - distributed.worker - INFO - dashboard at: 127.0.0.1:34545 5986s 2024-11-23 22:04:40,996 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:40,996 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:04:40,996 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:04:40,996 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:04:40,996 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-pyed08y5 5986s 2024-11-23 22:04:40,996 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:04:40,998 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44559 5986s 2024-11-23 22:04:40,998 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44559 5986s 2024-11-23 22:04:40,998 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:04:40,998 - distributed.worker - INFO - dashboard at: 127.0.0.1:40533 5986s 2024-11-23 22:04:40,998 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:40,998 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:04:40,998 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:04:40,999 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:04:40,999 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-1jzq6xwi 5986s 2024-11-23 22:04:40,999 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:04:41,011 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:41,011 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:41,011 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:51870': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:41,011 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:51876': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:41,123 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:41,123 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:41,123 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:51880': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:41,123 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:51892': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:41,235 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:41,236 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:41,236 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:51908': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:41,236 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:51918': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:41,349 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:41,349 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:41,350 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:51922': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:41,350 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:51932': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:41,462 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:41,462 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:41,462 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:51940': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:41,462 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:51944': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:41,574 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:41,575 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:41,575 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:41258': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:41,575 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:41260': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:41,687 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:41,687 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:41,688 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:41272': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:41,688 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:41274': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:41,799 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:41,799 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:41,799 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:41290': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:41,799 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:41294': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:41,912 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:41,912 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:41,913 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:41306': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:41,913 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:41312': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:42,025 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:42,025 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:42,025 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:41326': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:42,025 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:41336': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:42,137 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:42,137 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:42,138 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:41346': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:42,138 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:41348': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:42,249 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:42,249 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:42,250 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:41360': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:42,250 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:41372': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:42,362 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:42,362 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:42,362 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:41388': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:42,362 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:41392': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:42,474 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:42,475 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:42,475 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:41400': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:42,475 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:41404': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:42,587 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:42,587 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:42,587 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:41416': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:42,587 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:41432': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:42,698 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:42,698 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:42,699 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:41442': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:42,699 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:41450': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:42,813 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:42,813 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:42,813 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:41466': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:42,813 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:41472': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:42,926 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:42,926 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:42,926 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:41478': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:42,926 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:41488': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:43,040 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:43,040 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:43,040 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:41500': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:43,040 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:41504': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:43,153 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:43,154 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:43,154 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:41516': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:43,154 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:41518': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:43,266 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:43,266 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:43,266 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:41534': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:43,266 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:41548': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:43,379 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:43,379 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:43,379 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:41550': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:43,379 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:41558': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:43,496 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:43,496 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:43,497 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:41566': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:43,497 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:41582': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:43,609 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:43,609 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:43,610 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:41594': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:43,610 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:41596': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:43,722 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:43,722 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:43,723 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:41598': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:43,723 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:41612': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:43,834 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:43,835 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:43,835 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:41628': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:43,835 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:41630': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:43,948 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:43,948 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:43,948 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:41640': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:43,948 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:41646': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:44,062 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:44,062 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:44,062 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:41662': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:44,063 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:41668': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:44,175 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:44,175 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:44,175 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:41682': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:44,175 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:41692': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:44,288 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:44,288 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:44,288 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:41700': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:44,289 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:41708': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:44,400 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:44,400 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:44,401 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:41720': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:44,401 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:41734': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:44,513 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:44,513 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:44,513 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:41744': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:44,513 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:41758': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:44,626 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:44,626 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:44,626 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:41766': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:44,626 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:41772': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:44,739 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:44,739 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:44,739 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:41784': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:44,739 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:41794': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:44,853 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:44,853 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:44,854 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:41806': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:44,854 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:41810': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:44,967 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:44,967 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:44,968 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:41824': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:44,968 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:41838': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:45,080 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:45,080 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:45,080 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:41854': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:45,080 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:41856': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:45,193 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:45,193 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:45,193 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:41858': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:45,193 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:41874': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:45,305 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:45,305 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:45,305 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:41878': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:45,305 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:41884': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:45,417 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:45,418 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:45,418 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:41888': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:45,418 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:41900': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:45,529 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:45,529 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:45,530 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:41902': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:45,530 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:41904': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:45,642 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:45,642 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:45,643 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:41906': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:45,643 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:41912': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:45,754 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:45,754 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:45,755 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:41918': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:45,755 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:41934': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:45,867 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:45,867 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:45,867 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:41946': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:45,867 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:41948': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:45,981 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:45,981 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:45,981 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:41950': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:45,981 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:41956': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:46,093 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:46,093 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:46,093 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:41964': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:46,094 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:41974': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:46,205 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:46,205 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:46,205 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:41984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:46,205 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:41988': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:46,316 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:46,317 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:46,317 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:41994': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:46,317 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:42004': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:46,431 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:46,431 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:46,431 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:42012': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:46,431 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:42014': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:46,544 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:46,544 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:46,544 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:42028': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:46,544 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:42044': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:46,657 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:46,658 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:46,658 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:42050': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:46,658 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:42062': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:46,770 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:46,771 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:46,771 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:42074': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:46,771 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:42082': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:46,883 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:46,884 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:46,884 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:42092': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:46,884 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:42098': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:46,998 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:46,999 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:46,999 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:42112': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:46,999 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:42126': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:47,112 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:47,112 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:47,112 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:42134': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:47,112 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:42148': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:47,224 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:47,225 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:47,225 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:42156': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:47,225 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:42162': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:47,336 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:47,337 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:47,337 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:42172': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:47,337 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:42182': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:47,449 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:47,449 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:47,449 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:42198': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:47,449 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:42202': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:47,561 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:47,561 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:47,561 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:42216': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:47,561 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:42230': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:47,674 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:47,674 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:47,674 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:42246': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:47,674 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:42258': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:47,786 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:47,786 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:47,787 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:42260': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:47,787 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:42262': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:47,899 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:47,899 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:47,900 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:42264': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:47,900 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:42276': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:48,013 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:48,013 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:48,014 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:42282': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:48,014 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:42288': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:48,126 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:48,126 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:48,126 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:42304': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:48,126 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:42308': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:48,239 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:48,239 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:48,240 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:42322': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:48,240 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:42328': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:48,353 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:48,353 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:48,353 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:42338': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:48,353 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:42344': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:48,468 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:48,468 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:48,469 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:42350': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:48,469 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:42362': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:48,581 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:48,581 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:48,581 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:42374': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:48,581 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:42388': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:48,694 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:48,694 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:48,694 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:42398': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:48,694 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:42402': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:48,806 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:48,806 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:48,806 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:42418': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:48,806 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:42434': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:48,918 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:48,919 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:48,919 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:42444': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:48,919 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:42448': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:49,031 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:49,032 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:49,032 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:42456': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:49,032 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:42472': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:49,144 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:49,144 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:49,145 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:42486': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:49,145 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:42494': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:49,257 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:49,257 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:49,258 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:42508': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:49,258 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:42522': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:49,370 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:49,370 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:49,371 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:42526': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:49,371 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:42538': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:49,483 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:49,483 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:49,488 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:42552': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:49,488 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:42556': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:49,596 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:49,596 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:49,596 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:42572': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:49,596 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:42580': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:49,708 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:49,709 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:49,709 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:42592': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:49,709 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:42598': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:49,820 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:49,820 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:49,821 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:42602': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:49,821 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:42604': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:49,933 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:49,933 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:49,933 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:42616': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:49,933 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:42622': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:50,046 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:50,046 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:50,047 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:42638': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:50,047 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:42646': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:50,159 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:50,159 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:50,160 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:42654': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:50,160 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:42666': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:50,271 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:50,271 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:50,271 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:42674': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:50,271 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:42676': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:50,383 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:50,383 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:50,384 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:42680': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:50,384 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:42690': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:50,497 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:50,497 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:50,497 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:42694': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:50,498 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:42700': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:50,609 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:50,609 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:50,609 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:42710': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:50,609 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:42714': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:50,722 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:50,722 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:50,723 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:42718': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:50,723 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:42722': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:50,835 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:50,835 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:50,836 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:42736': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:50,836 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:42744': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:50,949 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:50,949 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:50,950 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:42752': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:50,950 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:42758': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:51,061 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:51,062 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:51,062 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:42760': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:51,062 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:42766': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:51,174 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:51,174 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:51,174 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:42770': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:51,175 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:42772': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:51,286 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:51,286 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:51,287 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:42786': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:51,287 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:42802': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:51,399 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:51,399 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:51,399 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:42816': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:51,399 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:42832': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:51,512 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:51,512 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:51,512 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:42842': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:51,513 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:42858': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:51,625 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:51,625 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:51,625 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:60970': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:51,625 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:60984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:51,737 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:51,737 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:51,738 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:60988': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:51,738 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:60998': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:51,850 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:51,851 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:51,851 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:32776': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:51,851 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:32782': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:51,964 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:51,965 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:51,965 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:32788': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:51,965 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:32804': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:52,077 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:52,077 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:52,077 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:32820': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:52,077 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:32830': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:52,189 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:52,190 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:52,190 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:32838': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:52,190 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:32848': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:52,301 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:52,301 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:52,302 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:32850': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:52,302 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:32864': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:52,414 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:52,414 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:52,414 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:32880': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:52,414 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:32894': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:52,526 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:52,527 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:52,527 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:32904': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:52,527 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:32910': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:52,639 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:52,639 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:52,640 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:32918': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:52,640 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:32926': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:52,751 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:52,751 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:52,751 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:32932': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:52,752 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:32944': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:52,863 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:52,864 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:52,864 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:32954': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:52,864 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:32960': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:52,976 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:52,976 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:52,977 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:32966': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:52,977 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:32978': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:53,089 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:53,089 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:53,090 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:32986': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:53,090 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:32994': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:53,202 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:53,202 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:53,202 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:33008': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:53,202 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:33012': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:53,314 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:53,314 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:53,314 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:33024': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:53,314 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:33032': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:53,427 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:53,427 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:53,427 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:33048': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:53,427 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:33060': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:53,539 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:53,539 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:53,539 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:33072': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:53,539 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:33084': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:53,652 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:53,652 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:53,653 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:33090': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:53,653 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:33098': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:53,765 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:53,765 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:53,766 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:33104': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:53,766 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:33114': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:53,878 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:53,878 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:53,879 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:33120': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:53,879 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:33134': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:53,995 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:53,995 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:53,995 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:33144': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:53,996 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:33148': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:54,108 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:54,108 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:54,109 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:33164': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:54,109 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:33170': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:54,221 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:54,221 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:54,221 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:33186': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:54,221 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:33196': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:54,333 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:54,333 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:54,334 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:33212': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:54,334 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:33216': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:54,447 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:54,447 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:54,448 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:33230': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:54,448 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:33240': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:54,560 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:54,560 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:54,561 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:33252': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:54,561 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:33268': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:54,673 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:54,673 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:54,674 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:33270': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:54,674 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:33272': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:54,785 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:54,785 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:54,786 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:33286': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:54,786 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:33296': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:54,896 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:54,897 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:54,897 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:33304': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:54,897 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:33310': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:55,008 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:55,009 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:55,009 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:33324': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:55,009 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:33330': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:55,121 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:55,121 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:55,122 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:33334': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:55,122 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:33342': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:55,234 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:55,234 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:55,234 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:33350': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:55,234 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:33360': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:55,346 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:55,347 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:55,347 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:33370': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:55,347 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:33372': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:55,460 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:55,460 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:55,461 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:33374': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:55,461 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:33390': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:55,573 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:55,574 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:55,574 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:33398': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:55,574 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:33404': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:55,686 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:55,686 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:55,687 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:33408': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:55,687 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:33410': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:55,798 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:55,798 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:55,799 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:33420': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:55,799 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:33428': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:55,911 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:55,911 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46411 5986s 2024-11-23 22:04:55,911 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:33438': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:55,911 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46411': TLS handshake failed with remote 'tls://127.0.0.1:33452': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:55,996 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43941. Reason: failure-to-start- 5986s 2024-11-23 22:04:55,996 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:04:55,997 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44559. Reason: failure-to-start- 5986s 2024-11-23 22:04:55,997 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:04:55,999 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 15s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 5986s stream = await stream.start_tls( 5986s ^^^^^^^^^^^^^^^^^^^^^^^ 5986s False, ssl_options=ssl_options, server_hostname=host 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 5986s self.socket.do_handshake() 5986s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 5986s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 5986s self._sslobj.do_handshake() 5986s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 5986s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 5986s raise FatalCommClosedError( 5986s ...<2 lines>... 5986s ) from err 5986s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 5986s 5986s During handling of the above exception, another exception occurred: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1218, in _register_with_scheduler 5986s await asyncio.sleep(0.1) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 718, in sleep 5986s return await future 5986s ^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 15s. 5986s 2024-11-23 22:04:57,006 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:04:57,016 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46237 5986s 2024-11-23 22:04:57,016 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34441/status 5986s 2024-11-23 22:04:57,017 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:04:57,033 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:32943 5986s 2024-11-23 22:04:57,033 - distributed.worker - INFO - Listening to: tls://127.0.0.1:32943 5986s 2024-11-23 22:04:57,033 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:04:57,033 - distributed.worker - INFO - dashboard at: 127.0.0.1:36007 5986s 2024-11-23 22:04:57,033 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:04:57,033 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:04:57,033 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:04:57,033 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:04:57,033 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-l9g3fok5 5986s 2024-11-23 22:04:57,033 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:04:57,035 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34983 5986s 2024-11-23 22:04:57,035 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34983 5986s 2024-11-23 22:04:57,035 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:04:57,035 - distributed.worker - INFO - dashboard at: 127.0.0.1:37673 5986s 2024-11-23 22:04:57,035 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:04:57,035 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:04:57,035 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:04:57,035 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:04:57,035 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-y7d2habt 5986s 2024-11-23 22:04:57,035 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:04:57,049 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:04:57,049 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:04:57,049 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:40556': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:57,049 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:40572': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:57,161 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:04:57,161 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:04:57,162 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:40576': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:57,162 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:40582': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:57,273 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:04:57,273 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:04:57,274 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:40588': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:57,274 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:40602': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:57,386 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:04:57,386 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:04:57,386 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:40608': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:57,386 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:40614': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:57,497 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:04:57,498 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:04:57,498 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:40622': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:57,498 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:40626': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:57,609 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:04:57,609 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:04:57,610 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:40630': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:57,610 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:40640': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:57,722 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:04:57,722 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:04:57,722 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:40654': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:57,722 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:40666': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:57,834 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:04:57,834 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:04:57,835 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:40672': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:57,835 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:40686': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:57,947 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:04:57,947 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:04:57,947 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:40700': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:57,948 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:40714': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:58,060 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:04:58,060 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:04:58,060 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:40728': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:58,060 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:40738': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:58,172 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:04:58,172 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:04:58,172 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:40748': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:58,172 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:40758': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:58,284 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:04:58,284 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:04:58,285 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:40764': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:58,285 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:40772': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:58,396 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:04:58,397 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:04:58,397 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:40774': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:58,397 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:40782': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:58,509 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:04:58,509 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:04:58,509 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:40790': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:58,509 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:40802': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:58,622 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:04:58,622 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:04:58,623 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:40818': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:58,623 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:40834': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:58,735 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:04:58,735 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:04:58,736 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:40846': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:58,736 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:40852': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:58,849 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:04:58,849 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:04:58,849 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:40856': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:58,849 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:40872': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:58,962 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:04:58,962 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:04:58,962 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:40880': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:58,963 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:40882': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:59,074 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:04:59,074 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:04:59,074 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:40890': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:59,074 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:40900': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:59,186 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:04:59,187 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:04:59,187 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:40904': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:59,187 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:40910': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:59,299 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:04:59,299 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:04:59,299 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:40922': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:59,299 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:40930': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:59,410 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:04:59,411 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:04:59,411 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:40940': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:59,411 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:40948': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:59,518 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:04:59,528 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:40958': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:59,529 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:04:59,530 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:40970': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:59,625 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:04:59,626 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:40974': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:59,636 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:04:59,636 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:40986': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:59,734 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:04:59,734 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:40994': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:59,743 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:04:59,743 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:41008': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:59,841 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:04:59,842 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:41020': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:59,849 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:04:59,849 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:41022': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:59,949 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:04:59,949 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:41032': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:04:59,955 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:04:59,956 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:41038': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:00,056 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:00,056 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:41052': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:00,062 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:00,063 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:41064': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:00,163 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:00,163 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:41070': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:00,169 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:00,170 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:41078': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:00,271 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:00,271 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:41088': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:00,277 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:00,278 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:41090': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:00,378 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:00,378 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:41106': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:00,385 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:00,385 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:41112': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:00,492 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:00,493 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:41124': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:00,499 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:00,499 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:41132': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:00,600 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:00,601 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:41136': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:00,607 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:00,607 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:41138': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:00,707 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:00,708 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:41140': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:00,714 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:00,714 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:41142': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:00,815 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:00,815 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:41144': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:00,821 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:00,822 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:41154': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:00,922 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:00,922 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:41160': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:00,929 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:00,929 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:41162': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:01,029 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:01,029 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:41168': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:01,035 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:01,035 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:41170': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:01,136 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:01,136 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:41176': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:01,142 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:01,143 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:41178': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:01,243 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:01,243 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:41182': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:01,249 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:01,250 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:41194': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:01,350 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:01,350 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:41206': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:01,356 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:01,357 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:41212': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:01,457 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:01,457 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:41216': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:01,463 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:01,463 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:41226': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:01,564 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:01,564 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:46664': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:01,570 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:01,570 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:46672': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:01,671 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:01,672 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:46688': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:01,678 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:01,678 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:46700': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:01,779 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:01,779 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:46710': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:01,785 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:01,786 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:46724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:01,886 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:01,886 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:46740': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:01,892 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:01,893 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:46746': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:01,993 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:01,993 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:46758': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:01,999 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:02,000 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:46772': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:02,100 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:02,100 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:46780': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:02,106 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:02,107 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:46786': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:02,207 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:02,207 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:46794': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:02,213 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:02,214 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:46796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:02,316 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:02,317 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:46802': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:02,322 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:02,323 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:46816': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:02,423 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:02,423 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:46824': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:02,429 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:02,430 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:46828': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:02,529 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:02,530 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:46836': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:02,536 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:02,536 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:46842': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:02,636 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:02,637 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:46846': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:02,642 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:02,643 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:46860': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:02,743 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:02,743 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:46874': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:02,749 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:02,749 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:46880': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:02,850 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:02,850 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:46888': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:02,856 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:02,856 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:46896': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:02,957 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:02,958 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:46908': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:02,963 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:02,964 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:46924': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:03,064 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:03,065 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:46926': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:03,071 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:03,071 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:46928': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:03,171 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:03,171 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:46936': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:03,177 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:03,178 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:46940': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:03,278 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:03,279 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:46946': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:03,284 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:03,285 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:46950': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:03,386 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:03,387 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:46966': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:03,392 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:03,392 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:46970': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:03,493 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:03,493 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:46976': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:03,499 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:03,500 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:46978': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:03,599 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:03,600 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:46982': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:03,606 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:03,606 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:46996': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:03,709 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:03,710 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:47002': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:03,715 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:03,716 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:47010': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:03,817 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:03,818 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:47012': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:03,823 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:03,824 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:47022': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:03,924 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:03,924 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:47034': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:03,930 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:03,930 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:47050': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:04,031 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:04,032 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:47054': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:04,038 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:04,038 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:47068': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:04,139 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:04,140 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:47084': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:04,145 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:04,146 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:47100': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:04,246 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:04,246 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:47104': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:04,252 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:04,253 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:47114': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:04,354 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:04,354 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:47116': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:04,360 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:04,360 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:47128': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:04,461 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:04,461 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:47130': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:04,467 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:04,467 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:47142': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:04,568 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:04,568 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:47148': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:04,574 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:04,574 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:47162': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:04,676 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:04,677 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:47170': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:04,683 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:04,683 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:47178': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:04,784 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:04,784 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:47180': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:04,790 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:04,790 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:47196': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:04,891 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:04,891 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:47200': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:04,897 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:04,897 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:47216': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:04,998 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:04,998 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:47230': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:05,004 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:05,004 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:47242': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:05,105 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:05,105 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:47256': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:05,111 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:05,111 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:47258': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:05,212 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:05,212 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:47260': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:05,218 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:05,218 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:47276': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:05,319 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:05,320 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:47286': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:05,327 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:05,327 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:47294': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:05,426 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:05,427 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:47306': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:05,433 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:05,433 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:47310': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:05,534 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:05,534 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:47324': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:05,540 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:05,541 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:47336': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:05,641 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:05,641 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:47346': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:05,647 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:05,647 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:47348': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:05,749 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:05,750 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:47352': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:05,756 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:05,756 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:47354': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:05,857 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:05,857 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:47360': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:05,863 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:05,863 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:47372': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:05,963 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:05,964 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:47384': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:05,970 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:05,970 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:47392': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:06,071 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:06,072 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:47394': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:06,077 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:06,077 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:47396': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:06,178 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:06,179 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:47410': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:06,185 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:06,185 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:47422': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:06,286 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:06,286 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:47432': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:06,292 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:06,292 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:47444': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:06,392 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:06,393 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:47446': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:06,398 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:06,399 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:47454': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:06,500 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:06,500 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:47462': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:06,506 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:06,506 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:47478': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:06,607 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:06,607 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:47490': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:06,613 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:06,613 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:47506': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:06,715 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:06,716 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:47520': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:06,722 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:06,722 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:47522': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:06,823 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:06,823 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:47538': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:06,829 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:06,829 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:47552': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:06,930 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:06,930 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:47568': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:06,936 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:06,936 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:47578': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:07,037 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:07,038 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:47588': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:07,044 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:07,044 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:47590': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:07,145 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:07,145 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:47592': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:07,151 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:07,151 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:47604': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:07,251 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:07,252 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:47608': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:07,258 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:07,258 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:47618': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:07,359 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:07,359 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:47626': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:07,365 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:07,365 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:47630': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:07,466 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:07,467 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:47646': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:07,472 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:07,472 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:47650': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:07,573 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:07,574 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:47658': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:07,579 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:07,580 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:47666': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:07,681 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:07,681 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:47680': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:07,687 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:07,687 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:47682': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:07,787 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:07,788 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:47696': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:07,793 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:07,794 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:47702': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:07,895 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:07,895 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:47708': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:07,901 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:07,901 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:47718': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:08,002 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:08,002 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:47726': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:08,008 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:08,008 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:47734': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:08,108 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:08,109 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:47750': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:08,115 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:08,115 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:47760': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:08,216 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:08,216 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:47766': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:08,222 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:08,222 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:47782': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:08,323 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:08,324 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:47784': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:08,329 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:08,329 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:47798': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:08,430 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:08,431 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:47810': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:08,436 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:08,437 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:47822': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:08,537 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:08,538 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:47832': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:08,543 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:08,544 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:47848': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:08,645 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:08,645 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:47854': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:08,651 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:08,651 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:47856': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:08,751 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:08,752 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:47866': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:08,758 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:08,758 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:47878': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:08,859 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:08,859 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:47892': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:08,865 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:08,865 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:47904': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:08,966 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:08,967 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:47918': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:08,972 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:08,973 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:47926': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:09,073 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:09,074 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:47934': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:09,080 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:09,080 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:47936': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:09,181 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:09,182 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:47946': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:09,187 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:09,187 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:47962': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:09,288 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:09,289 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:47970': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:09,294 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:09,295 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:47982': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:09,395 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:09,395 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:47986': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:09,401 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:09,401 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:47990': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:09,501 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:09,502 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:48002': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:09,507 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:09,508 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:48012': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:09,609 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:09,609 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:48016': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:09,615 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:09,615 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:48028': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:09,715 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:09,716 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:48042': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:09,722 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:09,722 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:48048': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:09,822 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:09,823 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:48064': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:09,828 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:09,829 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:48072': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:09,929 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:09,929 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:48076': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:09,935 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46237 5986s 2024-11-23 22:05:09,935 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46237': TLS handshake failed with remote 'tls://127.0.0.1:48084': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:10,031 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:32943. Reason: failure-to-start- 5986s 2024-11-23 22:05:10,032 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:05:10,033 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 13s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 13s. 5986s 2024-11-23 22:05:10,035 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34983. Reason: failure-to-start- 5986s 2024-11-23 22:05:10,035 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:05:11,038 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:05:11,047 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39811 5986s 2024-11-23 22:05:11,047 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41085/status 5986s 2024-11-23 22:05:11,047 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:05:11,063 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40333 5986s 2024-11-23 22:05:11,063 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40333 5986s 2024-11-23 22:05:11,063 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:05:11,063 - distributed.worker - INFO - dashboard at: 127.0.0.1:34471 5986s 2024-11-23 22:05:11,063 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39811 5986s 2024-11-23 22:05:11,063 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:05:11,063 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:05:11,063 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:05:11,063 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-lu4z1k0t 5986s 2024-11-23 22:05:11,064 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:05:11,065 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34991 5986s 2024-11-23 22:05:11,065 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34991 5986s 2024-11-23 22:05:11,065 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:05:11,066 - distributed.worker - INFO - dashboard at: 127.0.0.1:34315 5986s 2024-11-23 22:05:11,066 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39811 5986s 2024-11-23 22:05:11,066 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:05:11,066 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:05:11,066 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:05:11,066 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-0noqp4v0 5986s 2024-11-23 22:05:11,066 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:05:11,067 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40333. Reason: failure-to-start- 5986s 2024-11-23 22:05:11,067 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:05:11,067 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34991. Reason: failure-to-start- 5986s 2024-11-23 22:05:11,067 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:05:11,068 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39811': TLS handshake failed with remote 'tls://127.0.0.1:49062': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:05:11,068 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39811': TLS handshake failed with remote 'tls://127.0.0.1:49076': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:05:11,069 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:05:12,075 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:05:12,084 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44205 5986s 2024-11-23 22:05:12,084 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:32871/status 5986s 2024-11-23 22:05:12,084 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:05:12,101 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35581 5986s 2024-11-23 22:05:12,101 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35581 5986s 2024-11-23 22:05:12,101 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:05:12,101 - distributed.worker - INFO - dashboard at: 127.0.0.1:36245 5986s 2024-11-23 22:05:12,102 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44205 5986s 2024-11-23 22:05:12,102 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:05:12,102 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:05:12,102 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:05:12,102 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-yhxgyt5f 5986s 2024-11-23 22:05:12,102 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:05:12,104 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44101 5986s 2024-11-23 22:05:12,104 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44101 5986s 2024-11-23 22:05:12,104 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:05:12,104 - distributed.worker - INFO - dashboard at: 127.0.0.1:35643 5986s 2024-11-23 22:05:12,104 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44205 5986s 2024-11-23 22:05:12,104 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:05:12,104 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:05:12,104 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:05:12,104 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-b4zdcxta 5986s 2024-11-23 22:05:12,104 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:05:12,105 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35581. Reason: failure-to-start- 5986s 2024-11-23 22:05:12,105 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:05:12,105 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44101. Reason: failure-to-start- 5986s 2024-11-23 22:05:12,106 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:05:12,107 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44205': TLS handshake failed with remote 'tls://127.0.0.1:44586': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:05:12,107 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44205': TLS handshake failed with remote 'tls://127.0.0.1:44602': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:05:12,108 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:05:13,113 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:05:13,121 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:32785 5986s 2024-11-23 22:05:13,122 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46659/status 5986s 2024-11-23 22:05:13,122 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:05:13,137 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35689 5986s 2024-11-23 22:05:13,137 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35689 5986s 2024-11-23 22:05:13,138 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:05:13,138 - distributed.worker - INFO - dashboard at: 127.0.0.1:32877 5986s 2024-11-23 22:05:13,138 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:32785 5986s 2024-11-23 22:05:13,138 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:05:13,138 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:05:13,138 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:05:13,138 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-fyklo6df 5986s 2024-11-23 22:05:13,138 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:05:13,140 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36259 5986s 2024-11-23 22:05:13,140 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36259 5986s 2024-11-23 22:05:13,140 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:05:13,140 - distributed.worker - INFO - dashboard at: 127.0.0.1:33353 5986s 2024-11-23 22:05:13,140 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:32785 5986s 2024-11-23 22:05:13,140 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:05:13,140 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:05:13,140 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:05:13,140 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-l5a4bxw5 5986s 2024-11-23 22:05:13,140 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:05:13,142 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35689. Reason: failure-to-start- 5986s 2024-11-23 22:05:13,142 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:05:13,142 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36259. Reason: failure-to-start- 5986s 2024-11-23 22:05:13,142 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:05:13,143 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:32785': TLS handshake failed with remote 'tls://127.0.0.1:51120': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:05:13,143 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:32785': TLS handshake failed with remote 'tls://127.0.0.1:51134': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:05:13,144 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:05:14,150 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:05:14,159 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45079 5986s 2024-11-23 22:05:14,159 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39931/status 5986s 2024-11-23 22:05:14,159 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:05:14,175 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45639 5986s 2024-11-23 22:05:14,175 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45639 5986s 2024-11-23 22:05:14,175 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:05:14,175 - distributed.worker - INFO - dashboard at: 127.0.0.1:42491 5986s 2024-11-23 22:05:14,175 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45079 5986s 2024-11-23 22:05:14,175 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:05:14,175 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:05:14,175 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:05:14,175 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-v60efthw 5986s 2024-11-23 22:05:14,175 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:05:14,177 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42619 5986s 2024-11-23 22:05:14,177 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42619 5986s 2024-11-23 22:05:14,178 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:05:14,178 - distributed.worker - INFO - dashboard at: 127.0.0.1:43571 5986s 2024-11-23 22:05:14,178 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45079 5986s 2024-11-23 22:05:14,178 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:05:14,178 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:05:14,178 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:05:14,178 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-lnjfa719 5986s 2024-11-23 22:05:14,178 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:05:14,179 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45639. Reason: failure-to-start- 5986s 2024-11-23 22:05:14,179 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:05:14,179 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42619. Reason: failure-to-start- 5986s 2024-11-23 22:05:14,179 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:05:14,180 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45079': TLS handshake failed with remote 'tls://127.0.0.1:35786': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:05:14,180 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45079': TLS handshake failed with remote 'tls://127.0.0.1:35796': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:05:14,182 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:05:15,186 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:05:15,199 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38503 5986s 2024-11-23 22:05:15,199 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36237/status 5986s 2024-11-23 22:05:15,199 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:05:15,215 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40489 5986s 2024-11-23 22:05:15,215 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40489 5986s 2024-11-23 22:05:15,215 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:05:15,215 - distributed.worker - INFO - dashboard at: 127.0.0.1:39455 5986s 2024-11-23 22:05:15,215 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38503 5986s 2024-11-23 22:05:15,215 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:05:15,215 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:05:15,215 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:05:15,215 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-b9vaq0en 5986s 2024-11-23 22:05:15,216 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:05:15,217 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46759 5986s 2024-11-23 22:05:15,217 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46759 5986s 2024-11-23 22:05:15,217 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:05:15,217 - distributed.worker - INFO - dashboard at: 127.0.0.1:38865 5986s 2024-11-23 22:05:15,217 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38503 5986s 2024-11-23 22:05:15,218 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:05:15,218 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:05:15,218 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:05:15,218 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-5satkrm_ 5986s 2024-11-23 22:05:15,218 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:05:15,219 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40489. Reason: failure-to-start- 5986s 2024-11-23 22:05:15,219 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:05:15,219 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46759. Reason: failure-to-start- 5986s 2024-11-23 22:05:15,219 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:05:15,220 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38503': TLS handshake failed with remote 'tls://127.0.0.1:53688': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:05:15,220 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38503': TLS handshake failed with remote 'tls://127.0.0.1:53702': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:05:15,221 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:05:16,226 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:05:16,234 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43205 5986s 2024-11-23 22:05:16,235 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38367/status 5986s 2024-11-23 22:05:16,235 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:05:16,251 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37469 5986s 2024-11-23 22:05:16,252 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37469 5986s 2024-11-23 22:05:16,252 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:05:16,252 - distributed.worker - INFO - dashboard at: 127.0.0.1:40789 5986s 2024-11-23 22:05:16,252 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43205 5986s 2024-11-23 22:05:16,252 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:05:16,252 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:05:16,252 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:05:16,252 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-0g0l9sj2 5986s 2024-11-23 22:05:16,252 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:05:16,253 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33465 5986s 2024-11-23 22:05:16,254 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33465 5986s 2024-11-23 22:05:16,254 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:05:16,254 - distributed.worker - INFO - dashboard at: 127.0.0.1:35509 5986s 2024-11-23 22:05:16,254 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43205 5986s 2024-11-23 22:05:16,254 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:05:16,254 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:05:16,254 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:05:16,254 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-w9vdnn03 5986s 2024-11-23 22:05:16,254 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:05:16,255 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37469. Reason: failure-to-start- 5986s 2024-11-23 22:05:16,255 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:05:16,255 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33465. Reason: failure-to-start- 5986s 2024-11-23 22:05:16,255 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:05:16,256 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43205': TLS handshake failed with remote 'tls://127.0.0.1:55934': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:05:16,256 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43205': TLS handshake failed with remote 'tls://127.0.0.1:55936': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:05:16,257 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:05:17,262 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:05:17,270 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35689 5986s 2024-11-23 22:05:17,270 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34267/status 5986s 2024-11-23 22:05:17,270 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:05:17,285 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43689 5986s 2024-11-23 22:05:17,285 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43689 5986s 2024-11-23 22:05:17,285 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:05:17,285 - distributed.worker - INFO - dashboard at: 127.0.0.1:36251 5986s 2024-11-23 22:05:17,285 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35689 5986s 2024-11-23 22:05:17,285 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:05:17,285 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:05:17,286 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:05:17,286 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-k9kuc54x 5986s 2024-11-23 22:05:17,286 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:05:17,287 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40305 5986s 2024-11-23 22:05:17,288 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40305 5986s 2024-11-23 22:05:17,288 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:05:17,288 - distributed.worker - INFO - dashboard at: 127.0.0.1:43271 5986s 2024-11-23 22:05:17,288 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35689 5986s 2024-11-23 22:05:17,288 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:05:17,288 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:05:17,288 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:05:17,288 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-7_yy_58g 5986s 2024-11-23 22:05:17,288 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:05:17,289 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43689. Reason: failure-to-start- 5986s 2024-11-23 22:05:17,289 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:05:17,289 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40305. Reason: failure-to-start- 5986s 2024-11-23 22:05:17,289 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:05:17,290 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35689': TLS handshake failed with remote 'tls://127.0.0.1:35884': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:05:17,291 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35689': TLS handshake failed with remote 'tls://127.0.0.1:35888': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:05:17,292 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:05:18,298 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:05:18,307 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38253 5986s 2024-11-23 22:05:18,307 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40795/status 5986s 2024-11-23 22:05:18,307 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:05:18,323 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35929 5986s 2024-11-23 22:05:18,323 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35929 5986s 2024-11-23 22:05:18,323 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:05:18,323 - distributed.worker - INFO - dashboard at: 127.0.0.1:35829 5986s 2024-11-23 22:05:18,323 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38253 5986s 2024-11-23 22:05:18,323 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:05:18,323 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:05:18,323 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:05:18,323 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-vd38eikq 5986s 2024-11-23 22:05:18,323 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:05:18,325 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42163 5986s 2024-11-23 22:05:18,325 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42163 5986s 2024-11-23 22:05:18,325 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:05:18,325 - distributed.worker - INFO - dashboard at: 127.0.0.1:38981 5986s 2024-11-23 22:05:18,325 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38253 5986s 2024-11-23 22:05:18,325 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:05:18,325 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:05:18,326 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:05:18,326 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-hi7hbq09 5986s 2024-11-23 22:05:18,326 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:05:18,327 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35929. Reason: failure-to-start- 5986s 2024-11-23 22:05:18,327 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:05:18,327 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42163. Reason: failure-to-start- 5986s 2024-11-23 22:05:18,327 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:05:18,328 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38253': TLS handshake failed with remote 'tls://127.0.0.1:50022': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:05:18,328 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38253': TLS handshake failed with remote 'tls://127.0.0.1:50034': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:05:18,329 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:05:19,335 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:05:19,343 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45879 5986s 2024-11-23 22:05:19,344 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34793/status 5986s 2024-11-23 22:05:19,344 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:05:19,361 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37983 5986s 2024-11-23 22:05:19,361 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37983 5986s 2024-11-23 22:05:19,361 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:05:19,361 - distributed.worker - INFO - dashboard at: 127.0.0.1:38807 5986s 2024-11-23 22:05:19,361 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45879 5986s 2024-11-23 22:05:19,361 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:05:19,361 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:05:19,361 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:05:19,361 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-whgd69ey 5986s 2024-11-23 22:05:19,362 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:05:19,363 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37037 5986s 2024-11-23 22:05:19,363 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37037 5986s 2024-11-23 22:05:19,363 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:05:19,363 - distributed.worker - INFO - dashboard at: 127.0.0.1:41611 5986s 2024-11-23 22:05:19,364 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45879 5986s 2024-11-23 22:05:19,364 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:05:19,364 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:05:19,364 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:05:19,364 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-lycp8g1n 5986s 2024-11-23 22:05:19,364 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:05:19,365 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37983. Reason: failure-to-start- 5986s 2024-11-23 22:05:19,365 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:05:19,365 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37037. Reason: failure-to-start- 5986s 2024-11-23 22:05:19,365 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:05:19,366 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45879': TLS handshake failed with remote 'tls://127.0.0.1:52470': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:05:19,366 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45879': TLS handshake failed with remote 'tls://127.0.0.1:52482': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:05:19,367 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:05:20,373 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:05:20,381 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45873 5986s 2024-11-23 22:05:20,382 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33683/status 5986s 2024-11-23 22:05:20,382 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:05:20,399 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39813 5986s 2024-11-23 22:05:20,399 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39813 5986s 2024-11-23 22:05:20,399 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:05:20,399 - distributed.worker - INFO - dashboard at: 127.0.0.1:35929 5986s 2024-11-23 22:05:20,399 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45873 5986s 2024-11-23 22:05:20,399 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:05:20,399 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:05:20,399 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:05:20,399 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-kunpjp9y 5986s 2024-11-23 22:05:20,399 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:05:20,402 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46793 5986s 2024-11-23 22:05:20,402 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46793 5986s 2024-11-23 22:05:20,402 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:05:20,402 - distributed.worker - INFO - dashboard at: 127.0.0.1:45849 5986s 2024-11-23 22:05:20,402 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45873 5986s 2024-11-23 22:05:20,402 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:05:20,402 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:05:20,402 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:05:20,402 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-5c5umhfo 5986s 2024-11-23 22:05:20,403 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:05:20,403 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39813. Reason: failure-to-start- 5986s 2024-11-23 22:05:20,404 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:05:20,404 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46793. Reason: failure-to-start- 5986s 2024-11-23 22:05:20,404 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:05:20,405 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45873': TLS handshake failed with remote 'tls://127.0.0.1:50584': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:05:20,405 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45873': TLS handshake failed with remote 'tls://127.0.0.1:50588': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:05:20,406 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:05:21,411 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:05:21,420 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34611 5986s 2024-11-23 22:05:21,421 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39859/status 5986s 2024-11-23 22:05:21,421 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:05:21,438 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45249 5986s 2024-11-23 22:05:21,438 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45249 5986s 2024-11-23 22:05:21,438 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:05:21,438 - distributed.worker - INFO - dashboard at: 127.0.0.1:39459 5986s 2024-11-23 22:05:21,438 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34611 5986s 2024-11-23 22:05:21,438 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:05:21,438 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:05:21,438 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:05:21,438 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-usv14h34 5986s 2024-11-23 22:05:21,438 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:05:21,440 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38979 5986s 2024-11-23 22:05:21,440 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38979 5986s 2024-11-23 22:05:21,441 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:05:21,441 - distributed.worker - INFO - dashboard at: 127.0.0.1:36981 5986s 2024-11-23 22:05:21,441 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34611 5986s 2024-11-23 22:05:21,441 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:05:21,441 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:05:21,441 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:05:21,441 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-e5ljcgpp 5986s 2024-11-23 22:05:21,441 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:05:21,442 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45249. Reason: failure-to-start- 5986s 2024-11-23 22:05:21,442 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:05:21,442 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38979. Reason: failure-to-start- 5986s 2024-11-23 22:05:21,442 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:05:21,443 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34611': TLS handshake failed with remote 'tls://127.0.0.1:49164': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:05:21,444 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34611': TLS handshake failed with remote 'tls://127.0.0.1:49168': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:05:21,445 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:05:22,452 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:05:22,462 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39573 5986s 2024-11-23 22:05:22,463 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45339/status 5986s 2024-11-23 22:05:22,463 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:05:22,485 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40441 5986s 2024-11-23 22:05:22,485 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40441 5986s 2024-11-23 22:05:22,485 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:05:22,485 - distributed.worker - INFO - dashboard at: 127.0.0.1:45555 5986s 2024-11-23 22:05:22,485 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39573 5986s 2024-11-23 22:05:22,485 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:05:22,485 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:05:22,485 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:05:22,485 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-c1v8_fgs 5986s 2024-11-23 22:05:22,485 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:05:22,487 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41287 5986s 2024-11-23 22:05:22,487 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41287 5986s 2024-11-23 22:05:22,487 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:05:22,487 - distributed.worker - INFO - dashboard at: 127.0.0.1:34597 5986s 2024-11-23 22:05:22,487 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39573 5986s 2024-11-23 22:05:22,487 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:05:22,487 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:05:22,487 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:05:22,488 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-5i1of387 5986s 2024-11-23 22:05:22,488 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:05:22,491 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40441. Reason: failure-to-start- 5986s 2024-11-23 22:05:22,491 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:05:22,492 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41287. Reason: failure-to-start- 5986s 2024-11-23 22:05:22,492 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:05:22,493 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39573': TLS handshake failed with remote 'tls://127.0.0.1:55794': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:05:22,493 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39573': TLS handshake failed with remote 'tls://127.0.0.1:55810': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:05:22,494 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:05:23,499 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:05:23,507 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33207 5986s 2024-11-23 22:05:23,508 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45441/status 5986s 2024-11-23 22:05:23,508 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:05:23,525 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46055 5986s 2024-11-23 22:05:23,525 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46055 5986s 2024-11-23 22:05:23,525 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:05:23,525 - distributed.worker - INFO - dashboard at: 127.0.0.1:38635 5986s 2024-11-23 22:05:23,525 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33207 5986s 2024-11-23 22:05:23,525 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:05:23,525 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:05:23,525 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:05:23,525 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-rbvgfol6 5986s 2024-11-23 22:05:23,525 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:05:23,527 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37125 5986s 2024-11-23 22:05:23,527 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37125 5986s 2024-11-23 22:05:23,527 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:05:23,527 - distributed.worker - INFO - dashboard at: 127.0.0.1:38343 5986s 2024-11-23 22:05:23,527 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33207 5986s 2024-11-23 22:05:23,527 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:05:23,527 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:05:23,527 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:05:23,527 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-tao1m7af 5986s 2024-11-23 22:05:23,528 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:05:23,531 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46055. Reason: failure-to-start- 5986s 2024-11-23 22:05:23,531 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:05:23,532 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37125. Reason: failure-to-start- 5986s 2024-11-23 22:05:23,532 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:05:23,533 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33207': TLS handshake failed with remote 'tls://127.0.0.1:44896': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:05:23,533 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33207': TLS handshake failed with remote 'tls://127.0.0.1:44912': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:05:23,534 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:05:24,539 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:05:24,549 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37693 5986s 2024-11-23 22:05:24,549 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46033/status 5986s 2024-11-23 22:05:24,549 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:05:24,567 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34417 5986s 2024-11-23 22:05:24,567 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34417 5986s 2024-11-23 22:05:24,567 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:05:24,567 - distributed.worker - INFO - dashboard at: 127.0.0.1:40049 5986s 2024-11-23 22:05:24,567 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37693 5986s 2024-11-23 22:05:24,567 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:05:24,567 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:05:24,567 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:05:24,567 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-bsoxp5az 5986s 2024-11-23 22:05:24,568 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:05:24,570 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46075 5986s 2024-11-23 22:05:24,570 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46075 5986s 2024-11-23 22:05:24,570 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:05:24,570 - distributed.worker - INFO - dashboard at: 127.0.0.1:37363 5986s 2024-11-23 22:05:24,570 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37693 5986s 2024-11-23 22:05:24,570 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:05:24,570 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:05:24,570 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:05:24,571 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ka004ntx 5986s 2024-11-23 22:05:24,571 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:05:24,572 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34417. Reason: failure-to-start- 5986s 2024-11-23 22:05:24,572 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:05:24,572 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46075. Reason: failure-to-start- 5986s 2024-11-23 22:05:24,572 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:05:24,574 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37693': TLS handshake failed with remote 'tls://127.0.0.1:53630': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:05:24,574 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37693': TLS handshake failed with remote 'tls://127.0.0.1:53644': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:05:24,575 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:05:25,580 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:05:25,589 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45203 5986s 2024-11-23 22:05:25,589 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45337/status 5986s 2024-11-23 22:05:25,589 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:05:25,609 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44229 5986s 2024-11-23 22:05:25,610 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44229 5986s 2024-11-23 22:05:25,610 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:05:25,610 - distributed.worker - INFO - dashboard at: 127.0.0.1:38787 5986s 2024-11-23 22:05:25,610 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45203 5986s 2024-11-23 22:05:25,610 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:05:25,610 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:05:25,610 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:05:25,610 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-jizt6nvq 5986s 2024-11-23 22:05:25,610 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:05:25,612 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42695 5986s 2024-11-23 22:05:25,612 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42695 5986s 2024-11-23 22:05:25,612 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:05:25,612 - distributed.worker - INFO - dashboard at: 127.0.0.1:41435 5986s 2024-11-23 22:05:25,612 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45203 5986s 2024-11-23 22:05:25,612 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:05:25,612 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:05:25,612 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:05:25,612 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-m7ujj8iv 5986s 2024-11-23 22:05:25,612 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:05:25,613 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44229. Reason: failure-to-start- 5986s 2024-11-23 22:05:25,613 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:05:25,615 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42695. Reason: failure-to-start- 5986s 2024-11-23 22:05:25,615 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:05:25,616 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45203': TLS handshake failed with remote 'tls://127.0.0.1:39522': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:05:25,616 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45203': TLS handshake failed with remote 'tls://127.0.0.1:39530': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:05:25,617 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:05:26,622 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:05:26,630 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38211 5986s 2024-11-23 22:05:26,631 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34457/status 5986s 2024-11-23 22:05:26,631 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:05:26,649 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45297 5986s 2024-11-23 22:05:26,649 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45297 5986s 2024-11-23 22:05:26,649 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:05:26,649 - distributed.worker - INFO - dashboard at: 127.0.0.1:37987 5986s 2024-11-23 22:05:26,649 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 5986s 2024-11-23 22:05:26,649 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:05:26,649 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:05:26,649 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:05:26,650 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-b7x93lr7 5986s 2024-11-23 22:05:26,650 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:05:26,651 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36433 5986s 2024-11-23 22:05:26,651 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36433 5986s 2024-11-23 22:05:26,652 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:05:26,652 - distributed.worker - INFO - dashboard at: 127.0.0.1:39155 5986s 2024-11-23 22:05:26,652 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 5986s 2024-11-23 22:05:26,652 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:05:26,652 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:05:26,652 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:05:26,652 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-3j_ja80c 5986s 2024-11-23 22:05:26,652 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:05:26,653 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45297. Reason: failure-to-start- 5986s 2024-11-23 22:05:26,653 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:05:26,653 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36433. Reason: failure-to-start- 5986s 2024-11-23 22:05:26,653 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:05:26,654 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:53540': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:05:26,655 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:53552': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:05:26,656 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:05:27,660 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:05:27,669 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39697 5986s 2024-11-23 22:05:27,669 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39553/status 5986s 2024-11-23 22:05:27,670 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:05:27,686 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34449 5986s 2024-11-23 22:05:27,686 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34449 5986s 2024-11-23 22:05:27,686 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:05:27,686 - distributed.worker - INFO - dashboard at: 127.0.0.1:32979 5986s 2024-11-23 22:05:27,686 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39697 5986s 2024-11-23 22:05:27,687 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:05:27,687 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:05:27,687 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:05:27,687 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-1h7ccbwc 5986s 2024-11-23 22:05:27,687 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:05:27,688 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45681 5986s 2024-11-23 22:05:27,689 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45681 5986s 2024-11-23 22:05:27,689 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:05:27,689 - distributed.worker - INFO - dashboard at: 127.0.0.1:35481 5986s 2024-11-23 22:05:27,689 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39697 5986s 2024-11-23 22:05:27,689 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:05:27,689 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:05:27,689 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:05:27,689 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-b49j2e_j 5986s 2024-11-23 22:05:27,689 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:05:27,690 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34449. Reason: failure-to-start- 5986s 2024-11-23 22:05:27,690 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:05:27,690 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45681. Reason: failure-to-start- 5986s 2024-11-23 22:05:27,691 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:05:27,692 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39697': TLS handshake failed with remote 'tls://127.0.0.1:45684': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:05:27,692 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39697': TLS handshake failed with remote 'tls://127.0.0.1:45698': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:05:27,693 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:05:28,697 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:05:28,706 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35267 5986s 2024-11-23 22:05:28,706 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46191/status 5986s 2024-11-23 22:05:28,707 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:05:28,725 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45351 5986s 2024-11-23 22:05:28,725 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45351 5986s 2024-11-23 22:05:28,725 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:05:28,726 - distributed.worker - INFO - dashboard at: 127.0.0.1:34527 5986s 2024-11-23 22:05:28,726 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35267 5986s 2024-11-23 22:05:28,726 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:05:28,726 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:05:28,726 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:05:28,726 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-oc4h4q_x 5986s 2024-11-23 22:05:28,726 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:05:28,727 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38573 5986s 2024-11-23 22:05:28,728 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38573 5986s 2024-11-23 22:05:28,728 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:05:28,728 - distributed.worker - INFO - dashboard at: 127.0.0.1:42187 5986s 2024-11-23 22:05:28,728 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35267 5986s 2024-11-23 22:05:28,728 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:05:28,728 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:05:28,728 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:05:28,728 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-72rb0m5z 5986s 2024-11-23 22:05:28,728 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:05:28,729 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45351. Reason: failure-to-start- 5986s 2024-11-23 22:05:28,729 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:05:28,729 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38573. Reason: failure-to-start- 5986s 2024-11-23 22:05:28,730 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:05:28,730 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35267': TLS handshake failed with remote 'tls://127.0.0.1:58842': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:05:28,731 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35267': TLS handshake failed with remote 'tls://127.0.0.1:58852': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:05:28,732 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:05:29,737 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:05:29,746 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43151 5986s 2024-11-23 22:05:29,746 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35581/status 5986s 2024-11-23 22:05:29,746 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:05:29,765 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40575 5986s 2024-11-23 22:05:29,765 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40575 5986s 2024-11-23 22:05:29,765 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:05:29,765 - distributed.worker - INFO - dashboard at: 127.0.0.1:36643 5986s 2024-11-23 22:05:29,765 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43151 5986s 2024-11-23 22:05:29,765 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:05:29,766 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:05:29,766 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:05:29,766 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-lvm1btf7 5986s 2024-11-23 22:05:29,766 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:05:29,768 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34133 5986s 2024-11-23 22:05:29,768 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34133 5986s 2024-11-23 22:05:29,768 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:05:29,769 - distributed.worker - INFO - dashboard at: 127.0.0.1:32949 5986s 2024-11-23 22:05:29,769 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43151 5986s 2024-11-23 22:05:29,769 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:05:29,769 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:05:29,769 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:05:29,769 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-s1bb9dzr 5986s 2024-11-23 22:05:29,769 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:05:29,770 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40575. Reason: failure-to-start- 5986s 2024-11-23 22:05:29,770 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:05:29,770 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34133. Reason: failure-to-start- 5986s 2024-11-23 22:05:29,771 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:05:29,772 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43151': TLS handshake failed with remote 'tls://127.0.0.1:33882': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:05:29,772 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43151': TLS handshake failed with remote 'tls://127.0.0.1:33884': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:05:29,776 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:05:30,781 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:05:30,789 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37089 5986s 2024-11-23 22:05:30,790 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41579/status 5986s 2024-11-23 22:05:30,790 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:05:30,805 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42549 5986s 2024-11-23 22:05:30,805 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42549 5986s 2024-11-23 22:05:30,805 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:05:30,805 - distributed.worker - INFO - dashboard at: 127.0.0.1:40891 5986s 2024-11-23 22:05:30,805 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37089 5986s 2024-11-23 22:05:30,805 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:05:30,805 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:05:30,806 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:05:30,806 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ufrq__5v 5986s 2024-11-23 22:05:30,806 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:05:30,807 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45205 5986s 2024-11-23 22:05:30,808 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45205 5986s 2024-11-23 22:05:30,808 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:05:30,808 - distributed.worker - INFO - dashboard at: 127.0.0.1:45271 5986s 2024-11-23 22:05:30,808 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37089 5986s 2024-11-23 22:05:30,808 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:05:30,808 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:05:30,808 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:05:30,808 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-yopujn9u 5986s 2024-11-23 22:05:30,808 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:05:30,819 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42549. Reason: failure-to-start- 5986s 2024-11-23 22:05:30,820 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:05:30,820 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45205. Reason: failure-to-start- 5986s 2024-11-23 22:05:30,820 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:05:30,824 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37089': TLS handshake failed with remote 'tls://127.0.0.1:38496': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:05:30,824 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37089': TLS handshake failed with remote 'tls://127.0.0.1:38504': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:05:30,826 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:05:31,830 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:05:31,839 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40075 5986s 2024-11-23 22:05:31,840 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36491/status 5986s 2024-11-23 22:05:31,840 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:05:31,857 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41551 5986s 2024-11-23 22:05:31,857 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41551 5986s 2024-11-23 22:05:31,857 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:05:31,857 - distributed.worker - INFO - dashboard at: 127.0.0.1:42625 5986s 2024-11-23 22:05:31,857 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40075 5986s 2024-11-23 22:05:31,857 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:05:31,857 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:05:31,857 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:05:31,857 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-zxkviif8 5986s 2024-11-23 22:05:31,857 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:05:31,859 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45035 5986s 2024-11-23 22:05:31,859 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45035 5986s 2024-11-23 22:05:31,859 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:05:31,859 - distributed.worker - INFO - dashboard at: 127.0.0.1:34123 5986s 2024-11-23 22:05:31,859 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40075 5986s 2024-11-23 22:05:31,859 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:05:31,860 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:05:31,860 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:05:31,860 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-hhnaz6g7 5986s 2024-11-23 22:05:31,860 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:05:31,863 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41551. Reason: failure-to-start- 5986s 2024-11-23 22:05:31,864 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:05:31,864 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45035. Reason: failure-to-start- 5986s 2024-11-23 22:05:31,864 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:05:31,865 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40075': TLS handshake failed with remote 'tls://127.0.0.1:55554': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:05:31,865 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40075': TLS handshake failed with remote 'tls://127.0.0.1:55558': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:05:31,867 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:05:32,872 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:05:32,881 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36387 5986s 2024-11-23 22:05:32,882 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36621/status 5986s 2024-11-23 22:05:32,882 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:05:32,903 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39925 5986s 2024-11-23 22:05:32,903 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39925 5986s 2024-11-23 22:05:32,903 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:05:32,903 - distributed.worker - INFO - dashboard at: 127.0.0.1:36903 5986s 2024-11-23 22:05:32,903 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36387 5986s 2024-11-23 22:05:32,903 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:05:32,903 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:05:32,903 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:05:32,903 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-18h5z924 5986s 2024-11-23 22:05:32,903 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:05:32,905 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35299 5986s 2024-11-23 22:05:32,905 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35299 5986s 2024-11-23 22:05:32,905 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:05:32,905 - distributed.worker - INFO - dashboard at: 127.0.0.1:44149 5986s 2024-11-23 22:05:32,905 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36387 5986s 2024-11-23 22:05:32,905 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:05:32,905 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:05:32,905 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:05:32,905 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-jhrd__vw 5986s 2024-11-23 22:05:32,906 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:05:32,907 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39925. Reason: failure-to-start- 5986s 2024-11-23 22:05:32,907 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:05:32,907 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35299. Reason: failure-to-start- 5986s 2024-11-23 22:05:32,907 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:05:32,908 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36387': TLS handshake failed with remote 'tls://127.0.0.1:49152': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:05:32,908 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36387': TLS handshake failed with remote 'tls://127.0.0.1:49162': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:05:32,910 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:05:33,915 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:05:33,922 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37719 5986s 2024-11-23 22:05:33,923 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:32889/status 5986s 2024-11-23 22:05:33,923 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:05:33,941 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35447 5986s 2024-11-23 22:05:33,941 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35447 5986s 2024-11-23 22:05:33,941 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:05:33,941 - distributed.worker - INFO - dashboard at: 127.0.0.1:46429 5986s 2024-11-23 22:05:33,941 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37719 5986s 2024-11-23 22:05:33,941 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:05:33,942 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:05:33,942 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:05:33,942 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-_urr_xs6 5986s 2024-11-23 22:05:33,942 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:05:33,943 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43281 5986s 2024-11-23 22:05:33,943 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43281 5986s 2024-11-23 22:05:33,944 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:05:33,944 - distributed.worker - INFO - dashboard at: 127.0.0.1:33503 5986s 2024-11-23 22:05:33,944 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37719 5986s 2024-11-23 22:05:33,944 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:05:33,944 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:05:33,944 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:05:33,944 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-pv5b6jky 5986s 2024-11-23 22:05:33,944 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:05:33,945 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35447. Reason: failure-to-start- 5986s 2024-11-23 22:05:33,945 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:05:33,945 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43281. Reason: failure-to-start- 5986s 2024-11-23 22:05:33,945 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:05:33,946 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37719': TLS handshake failed with remote 'tls://127.0.0.1:53104': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:05:33,947 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37719': TLS handshake failed with remote 'tls://127.0.0.1:53110': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:05:33,948 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:05:34,952 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:05:34,961 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40633 5986s 2024-11-23 22:05:34,961 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42751/status 5986s 2024-11-23 22:05:34,962 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:05:34,978 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45965 5986s 2024-11-23 22:05:34,978 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45965 5986s 2024-11-23 22:05:34,978 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:05:34,978 - distributed.worker - INFO - dashboard at: 127.0.0.1:44147 5986s 2024-11-23 22:05:34,978 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40633 5986s 2024-11-23 22:05:34,978 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:05:34,978 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:05:34,978 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:05:34,978 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-cz0h0tlq 5986s 2024-11-23 22:05:34,978 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:05:34,980 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46661 5986s 2024-11-23 22:05:34,980 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46661 5986s 2024-11-23 22:05:34,980 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:05:34,980 - distributed.worker - INFO - dashboard at: 127.0.0.1:38759 5986s 2024-11-23 22:05:34,980 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40633 5986s 2024-11-23 22:05:34,980 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:05:34,981 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:05:34,981 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:05:34,981 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-5mljftyr 5986s 2024-11-23 22:05:34,981 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:05:34,985 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45965. Reason: failure-to-start- 5986s 2024-11-23 22:05:34,985 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:05:34,985 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46661. Reason: failure-to-start- 5986s 2024-11-23 22:05:34,986 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:05:34,990 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40633': TLS handshake failed with remote 'tls://127.0.0.1:55986': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:05:34,990 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40633': TLS handshake failed with remote 'tls://127.0.0.1:55994': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:05:34,992 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:05:35,997 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:05:36,006 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35757 5986s 2024-11-23 22:05:36,006 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38097/status 5986s 2024-11-23 22:05:36,007 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:05:36,022 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36821 5986s 2024-11-23 22:05:36,022 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36821 5986s 2024-11-23 22:05:36,022 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:05:36,022 - distributed.worker - INFO - dashboard at: 127.0.0.1:42951 5986s 2024-11-23 22:05:36,022 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35757 5986s 2024-11-23 22:05:36,022 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:05:36,023 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:05:36,023 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:05:36,023 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-jtef3qwj 5986s 2024-11-23 22:05:36,023 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:05:36,025 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33729 5986s 2024-11-23 22:05:36,025 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33729 5986s 2024-11-23 22:05:36,025 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:05:36,025 - distributed.worker - INFO - dashboard at: 127.0.0.1:42883 5986s 2024-11-23 22:05:36,025 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35757 5986s 2024-11-23 22:05:36,025 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:05:36,025 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:05:36,025 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:05:36,025 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-o1g027q_ 5986s 2024-11-23 22:05:36,025 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:05:36,031 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36821. Reason: failure-to-start- 5986s 2024-11-23 22:05:36,031 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:05:36,031 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33729. Reason: failure-to-start- 5986s 2024-11-23 22:05:36,032 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:05:36,033 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35757': TLS handshake failed with remote 'tls://127.0.0.1:58622': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:05:36,033 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35757': TLS handshake failed with remote 'tls://127.0.0.1:58626': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:05:36,034 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:05:37,040 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:05:37,048 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44131 5986s 2024-11-23 22:05:37,049 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43295/status 5986s 2024-11-23 22:05:37,049 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:05:37,066 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37299 5986s 2024-11-23 22:05:37,066 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37299 5986s 2024-11-23 22:05:37,066 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:05:37,066 - distributed.worker - INFO - dashboard at: 127.0.0.1:43423 5986s 2024-11-23 22:05:37,067 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44131 5986s 2024-11-23 22:05:37,067 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:05:37,067 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:05:37,067 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:05:37,067 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-qm6jw_fp 5986s 2024-11-23 22:05:37,067 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:05:37,068 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39127 5986s 2024-11-23 22:05:37,069 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39127 5986s 2024-11-23 22:05:37,069 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:05:37,069 - distributed.worker - INFO - dashboard at: 127.0.0.1:34555 5986s 2024-11-23 22:05:37,069 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44131 5986s 2024-11-23 22:05:37,069 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:05:37,069 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:05:37,069 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:05:37,069 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-v9iros0w 5986s 2024-11-23 22:05:37,069 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:05:37,073 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37299. Reason: failure-to-start- 5986s 2024-11-23 22:05:37,073 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:05:37,073 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39127. Reason: failure-to-start- 5986s 2024-11-23 22:05:37,073 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:05:37,074 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44131': TLS handshake failed with remote 'tls://127.0.0.1:55538': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:05:37,074 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44131': TLS handshake failed with remote 'tls://127.0.0.1:55550': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:05:37,075 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:05:38,081 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:05:38,090 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41515 5986s 2024-11-23 22:05:38,091 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39673/status 5986s 2024-11-23 22:05:38,091 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:05:38,110 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37351 5986s 2024-11-23 22:05:38,110 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37351 5986s 2024-11-23 22:05:38,110 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:05:38,111 - distributed.worker - INFO - dashboard at: 127.0.0.1:38411 5986s 2024-11-23 22:05:38,111 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41515 5986s 2024-11-23 22:05:38,111 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:05:38,111 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:05:38,111 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:05:38,111 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-w58wi5uz 5986s 2024-11-23 22:05:38,111 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:05:38,113 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37443 5986s 2024-11-23 22:05:38,113 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37443 5986s 2024-11-23 22:05:38,113 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:05:38,113 - distributed.worker - INFO - dashboard at: 127.0.0.1:42607 5986s 2024-11-23 22:05:38,113 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41515 5986s 2024-11-23 22:05:38,113 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:05:38,113 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:05:38,113 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:05:38,113 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-946clvtg 5986s 2024-11-23 22:05:38,113 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:05:38,117 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37351. Reason: failure-to-start- 5986s 2024-11-23 22:05:38,117 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:05:38,118 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37443. Reason: failure-to-start- 5986s 2024-11-23 22:05:38,118 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:05:38,119 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41515': TLS handshake failed with remote 'tls://127.0.0.1:36096': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:05:38,119 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41515': TLS handshake failed with remote 'tls://127.0.0.1:36112': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:05:38,120 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:05:39,127 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:05:39,135 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43017 5986s 2024-11-23 22:05:39,136 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33487/status 5986s 2024-11-23 22:05:39,136 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:05:39,154 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34999 5986s 2024-11-23 22:05:39,154 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34999 5986s 2024-11-23 22:05:39,154 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:05:39,154 - distributed.worker - INFO - dashboard at: 127.0.0.1:39911 5986s 2024-11-23 22:05:39,154 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43017 5986s 2024-11-23 22:05:39,154 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:05:39,154 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:05:39,154 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:05:39,154 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-3s7oy5tk 5986s 2024-11-23 22:05:39,155 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:05:39,156 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:32913 5986s 2024-11-23 22:05:39,156 - distributed.worker - INFO - Listening to: tls://127.0.0.1:32913 5986s 2024-11-23 22:05:39,157 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:05:39,157 - distributed.worker - INFO - dashboard at: 127.0.0.1:34443 5986s 2024-11-23 22:05:39,157 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43017 5986s 2024-11-23 22:05:39,157 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:05:39,157 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:05:39,157 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:05:39,157 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-2lzmguh6 5986s 2024-11-23 22:05:39,157 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:05:39,159 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34999. Reason: failure-to-start- 5986s 2024-11-23 22:05:39,159 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:05:39,160 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:32913. Reason: failure-to-start- 5986s 2024-11-23 22:05:39,160 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:05:39,161 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43017': TLS handshake failed with remote 'tls://127.0.0.1:38970': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:05:39,161 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43017': TLS handshake failed with remote 'tls://127.0.0.1:38986': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:05:39,165 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:05:40,170 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:05:40,178 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42951 5986s 2024-11-23 22:05:40,178 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44281/status 5986s 2024-11-23 22:05:40,179 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:05:40,199 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46417 5986s 2024-11-23 22:05:40,200 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46417 5986s 2024-11-23 22:05:40,200 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:05:40,200 - distributed.worker - INFO - dashboard at: 127.0.0.1:36629 5986s 2024-11-23 22:05:40,200 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42951 5986s 2024-11-23 22:05:40,200 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:05:40,200 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:05:40,200 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:05:40,200 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-8lqpillp 5986s 2024-11-23 22:05:40,200 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:05:40,202 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35331 5986s 2024-11-23 22:05:40,202 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35331 5986s 2024-11-23 22:05:40,202 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:05:40,202 - distributed.worker - INFO - dashboard at: 127.0.0.1:32999 5986s 2024-11-23 22:05:40,202 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42951 5986s 2024-11-23 22:05:40,202 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:05:40,202 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:05:40,202 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:05:40,202 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-4l6ws_it 5986s 2024-11-23 22:05:40,202 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:05:40,204 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46417. Reason: failure-to-start- 5986s 2024-11-23 22:05:40,204 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:05:40,204 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35331. Reason: failure-to-start- 5986s 2024-11-23 22:05:40,204 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:05:40,209 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42951': TLS handshake failed with remote 'tls://127.0.0.1:51952': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:05:40,209 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42951': TLS handshake failed with remote 'tls://127.0.0.1:51968': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:05:40,211 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s ______________________________ test_worker_client ______________________________ 5986s 5986s fut = , timeout = 0 5986s 5986s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 5986s async with asyncio.timeout(timeout): 5986s > return await fut 5986s 5986s /usr/lib/python3/dist-packages/distributed/utils.py:1960: 5986s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5986s /usr/lib/python3/dist-packages/distributed/worker.py:1480: in start_unsafe 5986s await self._register_with_scheduler() 5986s /usr/lib/python3/dist-packages/distributed/worker.py:1179: in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s /usr/lib/python3/dist-packages/distributed/comm/core.py:342: in connect 5986s comm = await wait_for( 5986s /usr/lib/python3/dist-packages/distributed/utils.py:1960: in wait_for 5986s return await fut 5986s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:546: in connect 5986s stream = await self.client.connect( 5986s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5986s 5986s self = , host = '127.0.0.1' 5986s port = 35813, af = 5986s ssl_options = 5986s max_buffer_size = 8364507136.0, source_ip = None, source_port = None 5986s timeout = None 5986s 5986s async def connect( 5986s self, 5986s host: str, 5986s port: int, 5986s af: socket.AddressFamily = socket.AF_UNSPEC, 5986s ssl_options: Optional[Union[Dict[str, Any], ssl.SSLContext]] = None, 5986s max_buffer_size: Optional[int] = None, 5986s source_ip: Optional[str] = None, 5986s source_port: Optional[int] = None, 5986s timeout: Optional[Union[float, datetime.timedelta]] = None, 5986s ) -> IOStream: 5986s """Connect to the given host and port. 5986s 5986s Asynchronously returns an `.IOStream` (or `.SSLIOStream` if 5986s ``ssl_options`` is not None). 5986s 5986s Using the ``source_ip`` kwarg, one can specify the source 5986s IP address to use when establishing the connection. 5986s In case the user needs to resolve and 5986s use a specific interface, it has to be handled outside 5986s of Tornado as this depends very much on the platform. 5986s 5986s Raises `TimeoutError` if the input future does not complete before 5986s ``timeout``, which may be specified in any form allowed by 5986s `.IOLoop.add_timeout` (i.e. a `datetime.timedelta` or an absolute time 5986s relative to `.IOLoop.time`) 5986s 5986s Similarly, when the user requires a certain source port, it can 5986s be specified using the ``source_port`` arg. 5986s 5986s .. versionchanged:: 4.5 5986s Added the ``source_ip`` and ``source_port`` arguments. 5986s 5986s .. versionchanged:: 5.0 5986s Added the ``timeout`` argument. 5986s """ 5986s if timeout is not None: 5986s if isinstance(timeout, numbers.Real): 5986s timeout = IOLoop.current().time() + timeout 5986s elif isinstance(timeout, datetime.timedelta): 5986s timeout = IOLoop.current().time() + timeout.total_seconds() 5986s else: 5986s raise TypeError("Unsupported timeout %r" % timeout) 5986s if timeout is not None: 5986s addrinfo = await gen.with_timeout( 5986s timeout, self.resolver.resolve(host, port, af) 5986s ) 5986s else: 5986s addrinfo = await self.resolver.resolve(host, port, af) 5986s connector = _Connector( 5986s addrinfo, 5986s functools.partial( 5986s self._create_stream, 5986s max_buffer_size, 5986s source_ip=source_ip, 5986s source_port=source_port, 5986s ), 5986s ) 5986s > af, addr, stream = await connector.start(connect_timeout=timeout) 5986s E asyncio.exceptions.CancelledError 5986s 5986s /usr/lib/python3/dist-packages/tornado/tcpclient.py:279: CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s self = 5986s 5986s @final 5986s async def start(self): 5986s async with self._startup_lock: 5986s if self.status == Status.failed: 5986s assert self.__startup_exc is not None 5986s raise self.__startup_exc 5986s elif self.status != Status.init: 5986s return self 5986s timeout = getattr(self, "death_timeout", None) 5986s 5986s async def _close_on_failure(exc: Exception) -> None: 5986s await self.close(reason=f"failure-to-start-{str(type(exc))}") 5986s self.status = Status.failed 5986s self.__startup_exc = exc 5986s 5986s try: 5986s > await wait_for(self.start_unsafe(), timeout=timeout) 5986s 5986s /usr/lib/python3/dist-packages/distributed/core.py:664: 5986s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5986s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 5986s async with asyncio.timeout(timeout): 5986s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5986s 5986s self = 5986s exc_type = 5986s exc_val = CancelledError(), exc_tb = 5986s 5986s async def __aexit__( 5986s self, 5986s exc_type: Optional[Type[BaseException]], 5986s exc_val: Optional[BaseException], 5986s exc_tb: Optional[TracebackType], 5986s ) -> Optional[bool]: 5986s assert self._state in (_State.ENTERED, _State.EXPIRING) 5986s 5986s if self._timeout_handler is not None: 5986s self._timeout_handler.cancel() 5986s self._timeout_handler = None 5986s 5986s if self._state is _State.EXPIRING: 5986s self._state = _State.EXPIRED 5986s 5986s if self._task.uncancel() <= self._cancelling and exc_type is not None: 5986s # Since there are no new cancel requests, we're 5986s # handling this. 5986s if issubclass(exc_type, exceptions.CancelledError): 5986s > raise TimeoutError from exc_val 5986s E TimeoutError 5986s 5986s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s @contextlib.asynccontextmanager 5986s async def _cluster_factory(): 5986s workers = [] 5986s s = None 5986s try: 5986s for _ in range(60): 5986s try: 5986s > s, ws = await start_cluster( 5986s nthreads, 5986s scheduler, 5986s security=security, 5986s Worker=Worker, 5986s scheduler_kwargs=scheduler_kwargs, 5986s worker_kwargs=merge( 5986s {"death_timeout": min(15, int(deadline.remaining))}, 5986s worker_kwargs, 5986s ), 5986s ) 5986s 5986s /usr/lib/python3/dist-packages/distributed/utils_test.py:966: 5986s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5986s /usr/lib/python3/dist-packages/distributed/utils_test.py:789: in start_cluster 5986s await asyncio.gather(*workers) 5986s /usr/lib/python3.13/asyncio/tasks.py:737: in _wrap_awaitable 5986s return await awaitable 5986s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5986s 5986s self = 5986s 5986s @final 5986s async def start(self): 5986s async with self._startup_lock: 5986s if self.status == Status.failed: 5986s assert self.__startup_exc is not None 5986s raise self.__startup_exc 5986s elif self.status != Status.init: 5986s return self 5986s timeout = getattr(self, "death_timeout", None) 5986s 5986s async def _close_on_failure(exc: Exception) -> None: 5986s await self.close(reason=f"failure-to-start-{str(type(exc))}") 5986s self.status = Status.failed 5986s self.__startup_exc = exc 5986s 5986s try: 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s except asyncio.TimeoutError as exc: 5986s await _close_on_failure(exc) 5986s > raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s E TimeoutError: Worker start timed out after 0s. 5986s 5986s /usr/lib/python3/dist-packages/distributed/core.py:667: TimeoutError 5986s 5986s During handling of the above exception, another exception occurred: 5986s 5986s fut = ._..test_func..async_fn at 0xde81abf0> 5986s timeout = 60 5986s 5986s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 5986s async with asyncio.timeout(timeout): 5986s > return await fut 5986s 5986s /usr/lib/python3/dist-packages/distributed/utils.py:1960: 5986s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5986s /usr/lib/python3/dist-packages/distributed/utils_test.py:999: in async_fn 5986s _cluster_factory() as (s, workers), 5986s /usr/lib/python3.13/contextlib.py:214: in __aenter__ 5986s return await anext(self.gen) 5986s /usr/lib/python3/dist-packages/distributed/utils_test.py:983: in _cluster_factory 5986s await asyncio.sleep(1) 5986s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5986s 5986s delay = 1, result = None 5986s 5986s async def sleep(delay, result=None): 5986s """Coroutine that completes after a given time (in seconds).""" 5986s if delay <= 0: 5986s await __sleep0() 5986s return result 5986s 5986s if math.isnan(delay): 5986s raise ValueError("Invalid delay: NaN (not a number)") 5986s 5986s loop = events.get_running_loop() 5986s future = loop.create_future() 5986s h = loop.call_later(delay, 5986s futures._set_result_unless_cancelled, 5986s future, result) 5986s try: 5986s > return await future 5986s E asyncio.exceptions.CancelledError 5986s 5986s /usr/lib/python3.13/asyncio/tasks.py:718: CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s args = (), kwds = {} 5986s 5986s @wraps(func) 5986s def inner(*args, **kwds): 5986s with self._recreate_cm(): 5986s > return func(*args, **kwds) 5986s 5986s /usr/lib/python3.13/contextlib.py:85: 5986s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5986s /usr/lib/python3.13/contextlib.py:85: in inner 5986s return func(*args, **kwds) 5986s /usr/lib/python3/dist-packages/distributed/utils_test.py:1102: in test_func 5986s return _run_and_close_tornado(async_fn_outer) 5986s /usr/lib/python3/dist-packages/distributed/utils_test.py:378: in _run_and_close_tornado 5986s return asyncio_run(inner_fn(), loop_factory=get_loop_factory()) 5986s /usr/lib/python3.13/asyncio/runners.py:194: in run 5986s return runner.run(main) 5986s /usr/lib/python3.13/asyncio/runners.py:118: in run 5986s return self._loop.run_until_complete(task) 5986s /usr/lib/python3.13/asyncio/base_events.py:720: in run_until_complete 5986s return future.result() 5986s /usr/lib/python3/dist-packages/distributed/utils_test.py:375: in inner_fn 5986s return await async_fn(*args, **kwargs) 5986s /usr/lib/python3/dist-packages/distributed/utils_test.py:1099: in async_fn_outer 5986s return await utils_wait_for(async_fn(), timeout=timeout * 2) 5986s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 5986s async with asyncio.timeout(timeout): 5986s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5986s 5986s self = 5986s exc_type = 5986s exc_val = CancelledError(), exc_tb = 5986s 5986s async def __aexit__( 5986s self, 5986s exc_type: Optional[Type[BaseException]], 5986s exc_val: Optional[BaseException], 5986s exc_tb: Optional[TracebackType], 5986s ) -> Optional[bool]: 5986s assert self._state in (_State.ENTERED, _State.EXPIRING) 5986s 5986s if self._timeout_handler is not None: 5986s self._timeout_handler.cancel() 5986s self._timeout_handler = None 5986s 5986s if self._state is _State.EXPIRING: 5986s self._state = _State.EXPIRED 5986s 5986s if self._task.uncancel() <= self._cancelling and exc_type is not None: 5986s # Since there are no new cancel requests, we're 5986s # handling this. 5986s if issubclass(exc_type, exceptions.CancelledError): 5986s > raise TimeoutError from exc_val 5986s E TimeoutError 5986s 5986s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 5986s ----------------------------- Captured stderr call ----------------------------- 5986s 2024-11-23 22:05:41,428 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:05:41,437 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:41,438 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39191/status 5986s 2024-11-23 22:05:41,438 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:05:41,453 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37271 5986s 2024-11-23 22:05:41,453 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37271 5986s 2024-11-23 22:05:41,453 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:05:41,453 - distributed.worker - INFO - dashboard at: 127.0.0.1:46861 5986s 2024-11-23 22:05:41,454 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:41,454 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:05:41,454 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:05:41,454 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:05:41,454 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-tmcd2s81 5986s 2024-11-23 22:05:41,454 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:05:41,455 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45837 5986s 2024-11-23 22:05:41,456 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45837 5986s 2024-11-23 22:05:41,456 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:05:41,456 - distributed.worker - INFO - dashboard at: 127.0.0.1:44965 5986s 2024-11-23 22:05:41,456 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:41,456 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:05:41,456 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:05:41,456 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:05:41,456 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-2kmqz_7g 5986s 2024-11-23 22:05:41,456 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:05:41,468 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:41,468 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:41,468 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:57420': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:41,468 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:57424': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:41,580 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:41,580 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:41,581 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:58944': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:41,581 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:58952': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:41,692 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:41,693 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:41,693 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:58954': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:41,693 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:58956': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:41,806 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:41,806 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:41,806 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:58972': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:41,807 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:58988': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:41,918 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:41,919 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:41,919 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:58998': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:41,919 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:59012': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:42,031 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:42,031 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:42,032 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:59028': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:42,032 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:59042': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:42,143 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:42,144 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:42,144 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:59054': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:42,144 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:59070': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:42,255 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:42,255 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:42,256 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:59086': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:42,256 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:59094': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:42,367 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:42,368 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:42,368 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:59106': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:42,368 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:59118': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:42,479 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:42,479 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:42,479 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:59126': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:42,479 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:59132': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:42,591 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:42,591 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:42,591 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:59140': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:42,592 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:59146': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:42,703 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:42,704 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:42,704 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:59148': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:42,704 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:59162': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:42,816 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:42,816 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:42,816 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:59172': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:42,816 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:59174': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:42,928 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:42,928 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:42,929 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:59190': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:42,929 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:59196': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:43,041 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:43,041 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:43,041 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:59202': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:43,041 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:59216': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:43,152 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:43,152 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:43,153 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:59220': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:43,153 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:59226': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:43,266 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:43,266 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:43,266 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:59236': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:43,266 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:59238': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:43,378 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:43,378 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:43,378 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:59242': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:43,378 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:59250': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:43,492 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:43,492 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:43,492 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:59258': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:43,492 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:59268': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:43,605 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:43,605 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:43,605 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:59274': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:43,605 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:59282': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:43,717 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:43,717 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:43,717 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:59284': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:43,717 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:59290': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:43,829 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:43,829 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:43,830 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:59292': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:43,830 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:59294': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:43,942 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:43,942 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:43,947 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:59298': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:43,947 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:59310': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:44,054 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:44,054 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:44,054 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:59312': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:44,055 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:59318': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:44,167 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:44,167 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:44,167 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:59322': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:44,167 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:59326': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:44,278 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:44,279 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:44,279 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:59332': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:44,279 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:59338': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:44,391 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:44,391 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:44,391 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:59354': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:44,391 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:59360': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:44,503 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:44,503 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:44,503 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:59364': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:44,503 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:59368': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:44,615 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:44,615 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:44,615 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:59378': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:44,616 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:59388': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:44,727 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:44,728 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:44,728 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:59390': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:44,728 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:59392': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:44,840 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:44,840 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:44,840 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:59408': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:44,840 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:59416': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:44,953 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:44,954 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:44,954 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:59428': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:44,954 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:59432': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:45,066 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:45,067 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:45,067 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:59442': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:45,067 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:59458': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:45,179 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:45,179 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:45,179 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:59472': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:45,179 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:59488': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:45,292 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:45,292 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:45,292 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:59504': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:45,293 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:59510': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:45,404 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:45,404 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:45,405 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:59522': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:45,405 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:59532': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:45,516 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:45,516 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:45,516 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:59538': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:45,516 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:59540': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:45,628 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:45,628 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:45,628 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:59546': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:45,629 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:59560': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:45,739 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:45,740 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:45,740 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:59562': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:45,740 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:59574': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:45,852 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:45,852 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:45,852 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:59576': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:45,852 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:59592': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:45,963 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:45,963 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:45,964 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:59594': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:45,964 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:59598': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:46,075 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:46,076 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:46,076 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:59608': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:46,076 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:59614': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:46,188 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:46,188 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:46,188 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:59630': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:46,188 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:59636': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:46,299 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:46,299 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:46,300 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:59648': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:46,300 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:59662': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:46,411 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:46,412 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:46,412 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:59666': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:46,412 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:59674': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:46,524 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:46,524 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:46,524 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:59688': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:46,524 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:59704': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:46,636 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:46,636 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:46,637 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:59706': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:46,637 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:59712': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:46,749 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:46,749 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:46,749 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:59714': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:46,749 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:59716': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:46,862 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:46,862 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:46,862 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:59730': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:46,862 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:59734': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:46,974 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:46,974 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:46,974 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:59740': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:46,974 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:59756': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:47,088 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:47,088 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:47,089 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:59758': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:47,089 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:59772': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:47,200 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:47,201 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:47,201 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:59782': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:47,201 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:59796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:47,313 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:47,313 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:47,313 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:59802': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:47,313 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:59804': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:47,425 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:47,425 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:47,426 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:59810': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:47,426 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:59826': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:47,537 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:47,538 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:47,538 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:59838': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:47,538 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:59842': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:47,650 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:47,650 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:47,650 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:59846': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:47,650 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:59862': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:47,761 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:47,762 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:47,762 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:59872': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:47,762 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:59884': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:47,873 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:47,874 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:47,874 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:59886': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:47,874 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:59894': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:47,986 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:47,986 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:47,986 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:59900': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:47,986 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:59908': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:48,098 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:48,098 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:48,099 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:59916': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:48,099 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:59930': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:48,211 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:48,211 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:48,211 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:59944': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:48,211 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:59946': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:48,323 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:48,323 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:48,323 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:59950': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:48,323 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:59960': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:48,435 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:48,435 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:48,436 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:59972': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:48,436 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:59978': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:48,548 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:48,548 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:48,548 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:59980': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:48,548 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:59984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:48,662 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:48,662 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:48,662 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:59990': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:48,662 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:59994': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:48,773 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:48,773 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:48,773 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:59996': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:48,773 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:60006': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:48,886 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:48,886 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:48,887 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:60022': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:48,887 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:60026': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:48,998 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:48,998 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:48,998 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:60034': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:48,999 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:60046': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:49,110 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:49,110 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:49,111 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:60050': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:49,111 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:60064': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:49,222 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:49,222 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:49,222 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:60070': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:49,222 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:60082': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:49,334 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:49,334 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:49,335 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:60092': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:49,335 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:60104': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:49,446 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:49,447 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:49,450 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:60114': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:49,450 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:60116': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:49,558 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:49,558 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:49,558 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:60118': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:49,558 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:60134': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:49,670 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:49,670 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:49,670 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:60140': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:49,670 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:60142': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:49,781 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:49,781 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:49,782 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:60158': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:49,782 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:60172': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:49,893 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:49,893 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:49,894 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:60188': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:49,894 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:60204': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:50,005 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:50,005 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:50,006 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:60214': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:50,006 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:60228': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:50,118 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:50,119 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:50,119 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:60234': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:50,119 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:60248': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:50,231 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:50,231 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:50,231 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:60258': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:50,231 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:60260': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:50,343 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:50,343 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:50,344 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:60262': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:50,344 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:60264': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:50,455 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:50,456 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:50,456 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:60276': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:50,456 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:60288': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:50,568 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:50,568 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:50,568 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:60290': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:50,568 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:60302': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:50,681 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:50,681 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:50,681 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:60310': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:50,682 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:60324': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:50,792 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:50,792 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:50,793 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:60334': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:50,793 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:60344': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:50,904 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:50,905 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:50,905 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:60354': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:50,905 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:60360': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:51,017 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:51,017 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:51,017 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:60366': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:51,017 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:60368': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:51,129 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:51,129 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:51,130 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:60372': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:51,130 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:60384': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:51,241 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:51,241 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:51,242 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:60396': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:51,242 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:60404': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:51,352 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:51,353 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:51,353 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:60410': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:51,353 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:60412': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:51,465 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:51,465 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:51,465 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:60428': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:51,465 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:60436': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:51,577 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:51,577 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:51,578 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:59900': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:51,578 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:59914': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:51,689 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:51,690 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:51,690 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:59920': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:51,690 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:59928': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:51,802 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:51,802 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:51,802 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:59938': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:51,802 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:59954': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:51,914 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:51,914 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:51,914 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:59966': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:51,914 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:59968': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:52,026 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:52,026 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:52,027 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:59984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:52,027 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:59998': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:52,139 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:52,139 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:52,139 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:60004': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:52,139 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:60018': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:52,251 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:52,251 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:52,251 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:60030': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:52,251 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:60038': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:52,363 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:52,363 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:52,364 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:60048': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:52,364 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:60060': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:52,475 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:52,476 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:52,476 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:60064': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:52,476 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:60066': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:52,588 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:52,588 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:52,588 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:60078': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:52,588 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:60084': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:52,700 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:52,700 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:52,701 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:60098': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:52,701 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:60112': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:52,812 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:52,813 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:52,813 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:60118': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:52,813 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:60124': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:52,925 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:52,925 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:52,925 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:60128': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:52,925 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:60136': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:53,036 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:53,037 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:53,037 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:60142': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:53,037 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:60146': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:53,149 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:53,149 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:53,149 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:60156': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:53,149 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:60170': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:53,261 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:53,261 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:53,262 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:60172': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:53,262 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:60182': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:53,374 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:53,374 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:53,374 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:60188': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:53,374 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:60196': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:53,486 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:53,486 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:53,486 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:60212': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:53,487 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:60228': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:53,598 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:53,599 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:53,599 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:60234': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:53,599 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:60238': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:53,711 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:53,711 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:53,711 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:60240': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:53,711 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:60256': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:53,824 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:53,824 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:53,824 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:60264': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:53,824 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:60280': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:53,936 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:53,936 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:53,937 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:60282': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:53,937 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:60284': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:54,050 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:54,050 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:54,050 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:60298': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:54,050 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:60304': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:54,164 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:54,165 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:54,165 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:60318': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:54,165 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:60326': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:54,277 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:54,278 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:54,278 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:60340': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:54,278 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:60346': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:54,390 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:54,390 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:54,391 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:60348': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:54,391 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:60350': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:54,502 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:54,503 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:54,503 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:60362': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:54,503 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:60366': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:54,615 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:54,615 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:54,616 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:60374': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:54,616 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:60378': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:54,728 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:54,728 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:54,729 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:60386': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:54,729 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:60388': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:54,841 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:54,841 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:54,841 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:60392': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:54,842 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:60394': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:54,954 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:54,954 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:54,954 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:60410': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:54,954 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:60412': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:55,066 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:55,066 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:55,066 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:60426': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:55,066 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:60430': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:55,179 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:55,179 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:55,179 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:60440': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:55,179 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:60448': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:55,290 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:55,291 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:55,291 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:60454': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:55,291 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:60466': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:55,404 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:55,404 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:55,404 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:60472': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:55,405 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:60478': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:55,516 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:55,516 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:55,517 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:60490': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:55,517 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:60494': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:55,629 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:55,629 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:55,629 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:60508': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:55,629 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:60514': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:55,740 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:55,741 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:55,742 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:60516': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:55,742 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:60520': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:55,850 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:55,854 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:60534': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:55,855 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:55,855 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:60538': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:56,214 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:56,214 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:56,214 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:60548': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:56,214 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:60552': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:56,326 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:56,326 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:56,327 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:60558': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:56,327 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:60574': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:56,439 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:56,439 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43911 5986s 2024-11-23 22:05:56,440 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:60590': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:56,440 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43911': TLS handshake failed with remote 'tls://127.0.0.1:60592': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:56,453 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37271. Reason: failure-to-start- 5986s 2024-11-23 22:05:56,453 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:05:56,454 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45837. Reason: failure-to-start- 5986s 2024-11-23 22:05:56,454 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:05:56,456 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 15s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 5986s stream = await stream.start_tls( 5986s ^^^^^^^^^^^^^^^^^^^^^^^ 5986s False, ssl_options=ssl_options, server_hostname=host 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 5986s self.socket.do_handshake() 5986s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 5986s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 5986s self._sslobj.do_handshake() 5986s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 5986s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 5986s raise FatalCommClosedError( 5986s ...<2 lines>... 5986s ) from err 5986s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 5986s 5986s During handling of the above exception, another exception occurred: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1218, in _register_with_scheduler 5986s await asyncio.sleep(0.1) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 718, in sleep 5986s return await future 5986s ^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 15s. 5986s 2024-11-23 22:05:57,461 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:05:57,468 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33233 5986s 2024-11-23 22:05:57,469 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36913/status 5986s 2024-11-23 22:05:57,469 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:05:57,482 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42431 5986s 2024-11-23 22:05:57,482 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42431 5986s 2024-11-23 22:05:57,482 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:05:57,482 - distributed.worker - INFO - dashboard at: 127.0.0.1:34877 5986s 2024-11-23 22:05:57,482 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:05:57,482 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:05:57,482 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:05:57,482 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:05:57,482 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-sk4d91q4 5986s 2024-11-23 22:05:57,482 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:05:57,485 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34301 5986s 2024-11-23 22:05:57,485 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34301 5986s 2024-11-23 22:05:57,485 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:05:57,485 - distributed.worker - INFO - dashboard at: 127.0.0.1:44995 5986s 2024-11-23 22:05:57,485 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:05:57,485 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:05:57,485 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:05:57,485 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:05:57,485 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-r_z4_wfb 5986s 2024-11-23 22:05:57,485 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:05:57,497 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:05:57,498 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:05:57,498 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:38518': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:57,498 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:38520': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:57,609 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:05:57,609 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:05:57,610 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:38532': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:57,610 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:38546': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:57,721 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:05:57,721 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:05:57,722 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:38556': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:57,722 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:38560': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:57,834 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:05:57,834 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:05:57,835 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:38576': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:57,835 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:38592': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:57,946 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:05:57,946 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:05:57,950 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:38608': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:57,950 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:38624': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:58,059 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:05:58,059 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:05:58,060 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:38636': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:58,060 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:38642': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:58,171 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:05:58,171 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:05:58,172 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:38652': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:58,172 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:38668': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:58,283 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:05:58,283 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:05:58,284 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:38680': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:58,284 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:38682': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:58,396 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:05:58,396 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:05:58,396 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:38690': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:58,396 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:38706': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:58,508 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:05:58,508 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:05:58,508 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:38714': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:58,508 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:38730': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:58,620 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:05:58,620 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:05:58,620 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:38742': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:58,620 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:38754': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:58,732 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:05:58,732 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:05:58,733 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:38762': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:58,733 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:38772': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:58,845 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:05:58,846 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:05:58,846 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:38780': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:58,846 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:38790': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:58,958 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:05:58,958 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:05:58,958 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:38806': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:58,958 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:38808': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:59,070 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:05:59,070 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:05:59,071 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:38814': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:59,071 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:38826': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:59,182 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:05:59,182 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:05:59,182 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:38832': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:59,182 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:38836': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:59,296 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:05:59,296 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:05:59,296 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:38846': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:59,296 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:38858': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:59,408 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:05:59,409 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:05:59,409 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:38864': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:59,409 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:38868': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:59,521 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:05:59,521 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:05:59,521 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:38876': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:59,522 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:38878': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:59,634 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:05:59,634 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:05:59,634 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:38882': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:59,634 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:38884': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:59,746 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:05:59,747 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:05:59,747 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:38900': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:59,747 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:38908': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:59,858 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:05:59,858 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:05:59,859 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:38924': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:59,859 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:38926': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:59,971 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:05:59,971 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:05:59,974 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:38942': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:05:59,974 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:38946': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:00,083 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:00,084 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:00,084 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:38962': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:00,084 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:38978': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:00,195 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:00,196 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:00,196 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:38994': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:00,196 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:39008': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:00,309 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:00,309 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:00,310 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:39022': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:00,310 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:39024': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:00,422 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:00,422 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:00,422 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:39040': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:00,422 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:39054': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:00,533 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:00,534 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:00,534 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:39058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:00,534 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:39074': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:00,646 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:00,646 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:00,646 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:39090': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:00,646 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:39098': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:00,758 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:00,758 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:00,759 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:39106': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:00,759 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:39120': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:00,870 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:00,870 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:00,870 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:39134': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:00,871 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:39144': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:00,984 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:00,984 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:00,985 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:39148': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:00,985 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:39156': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:01,097 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:01,097 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:01,097 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:39158': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:01,097 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:39160': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:01,209 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:01,209 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:01,209 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:39162': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:01,209 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:39170': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:01,321 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:01,321 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:01,321 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:39184': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:01,321 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:39200': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:01,435 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:01,435 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:01,435 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:39202': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:01,435 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:39212': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:01,547 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:01,547 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:01,548 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:60122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:01,548 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:60126': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:01,659 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:01,659 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:01,660 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:60142': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:01,660 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:60158': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:01,772 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:01,772 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:01,773 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:60160': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:01,773 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:60172': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:01,884 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:01,884 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:01,885 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:60184': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:01,886 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:60190': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:01,998 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:01,998 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:01,998 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:60198': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:01,998 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:60214': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:02,110 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:02,110 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:02,110 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:60216': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:02,110 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:60228': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:02,222 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:02,222 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:02,223 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:60230': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:02,223 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:60234': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:02,334 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:02,334 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:02,335 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:60248': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:02,335 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:60262': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:02,446 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:02,446 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:02,450 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:60266': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:02,450 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:60278': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:02,559 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:02,559 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:02,559 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:60282': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:02,559 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:60284': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:02,671 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:02,672 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:02,672 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:60290': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:02,672 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:60306': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:02,784 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:02,784 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:02,784 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:60320': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:02,784 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:60330': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:02,897 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:02,897 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:02,898 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:60344': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:02,898 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:60354': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:03,009 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:03,010 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:03,010 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:60362': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:03,010 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:60378': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:03,122 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:03,122 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:03,122 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:60384': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:03,123 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:60398': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:03,234 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:03,235 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:03,235 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:60402': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:03,235 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:60412': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:03,347 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:03,347 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:03,348 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:60424': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:03,348 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:60440': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:03,459 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:03,459 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:03,460 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:60448': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:03,460 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:60462': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:03,571 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:03,571 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:03,572 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:60470': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:03,572 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:60480': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:03,683 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:03,683 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:03,683 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:60488': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:03,684 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:60496': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:03,796 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:03,796 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:03,796 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:60510': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:03,796 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:60524': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:03,908 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:03,908 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:03,909 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:60530': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:03,909 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:60546': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:04,020 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:04,020 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:04,021 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:60554': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:04,021 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:60564': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:04,132 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:04,132 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:04,133 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:60572': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:04,133 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:60588': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:04,245 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:04,245 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:04,246 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:60592': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:04,246 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:60600': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:04,357 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:04,357 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:04,358 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:60610': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:04,358 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:60618': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:04,470 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:04,470 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:04,470 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:60632': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:04,470 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:60634': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:04,581 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:04,582 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:04,582 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:60646': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:04,582 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:60652': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:04,694 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:04,694 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:04,694 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:60656': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:04,694 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:60658': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:04,806 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:04,806 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:04,806 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:60668': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:04,806 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:60678': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:04,919 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:04,919 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:04,919 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:60682': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:04,919 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:60690': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:05,030 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:05,030 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:05,031 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:60696': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:05,031 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:60710': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:05,143 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:05,143 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:05,144 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:60722': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:05,144 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:60738': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:05,255 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:05,255 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:05,256 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:60742': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:05,256 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:60748': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:05,367 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:05,367 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:05,367 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:60750': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:05,368 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:60760': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:05,481 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:05,481 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:05,482 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:60762': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:05,482 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:60776': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:05,599 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:05,600 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:05,601 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:60786': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:05,601 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:60798': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:05,718 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:05,718 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:05,719 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:60804': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:05,719 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:60818': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:05,835 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:05,836 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:05,837 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:60822': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:05,837 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:60836': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:05,953 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:05,958 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:60840': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:05,960 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:05,961 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:60850': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:06,063 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:06,065 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:60858': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:06,074 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:06,075 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:60862': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:06,176 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:06,177 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:60872': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:06,186 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:06,187 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:60880': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:06,287 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:06,288 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:60888': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:06,297 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:06,297 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:60894': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:06,397 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:06,398 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:60904': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:06,407 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:06,408 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:60906': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:06,508 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:06,509 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:60912': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:06,518 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:06,518 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:60914': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:06,619 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:06,619 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:60928': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:06,628 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:06,629 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:60936': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:06,730 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:06,733 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:60944': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:06,743 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:06,744 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:60946': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:06,841 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:06,842 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:60960': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:06,853 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:06,854 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:60970': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:06,954 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:06,955 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:60972': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:06,964 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:06,965 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:60980': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:07,066 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:07,067 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:60982': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:07,076 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:07,076 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:60996': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:07,174 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:07,175 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:32772': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:07,183 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:07,184 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:32788': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:07,281 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:07,282 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:32796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:07,290 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:07,290 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:32810': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:07,388 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:07,388 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:32818': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:07,397 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:07,397 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:32824': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:07,495 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:07,496 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:32836': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:07,504 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:07,504 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:32848': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:07,603 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:07,603 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:32862': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:07,610 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:07,610 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:32874': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:07,710 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:07,710 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:32882': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:07,716 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:07,716 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:32898': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:07,821 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:07,822 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:32914': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:07,831 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:07,831 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:32928': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:07,932 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:07,933 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:32944': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:07,943 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:07,948 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:32948': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:08,043 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:08,044 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:32952': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:08,053 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:08,054 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:32962': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:08,153 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:08,154 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:32964': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:08,163 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:08,164 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:32974': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:08,265 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:08,265 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:32990': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:08,277 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:08,278 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:32992': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:08,376 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:08,377 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:33002': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:08,386 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:08,387 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:33006': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:08,486 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:08,487 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:33010': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:08,496 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:08,497 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:33022': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:08,598 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:08,599 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:33032': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:08,608 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:08,608 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:33040': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:08,709 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:08,710 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:33042': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:08,719 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:08,720 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:33052': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:08,820 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:08,821 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:33062': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:08,830 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:08,831 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:33072': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:08,931 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:08,932 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:33074': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:08,941 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:08,946 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:33086': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:09,041 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:09,042 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:33098': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:09,051 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:09,052 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:33110': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:09,151 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:09,152 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:33120': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:09,160 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:09,161 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:33126': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:09,262 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:09,264 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:33134': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:09,272 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:09,273 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:33148': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:09,373 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:09,374 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:33152': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:09,383 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:09,384 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:33154': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:09,483 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:09,483 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:33166': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:09,492 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:09,493 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:33182': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:09,593 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:09,594 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:33194': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:09,603 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:09,604 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:33198': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:09,704 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:09,704 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:33206': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:09,713 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:09,714 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:33216': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:09,815 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:09,815 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:33224': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:09,827 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:09,828 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:33234': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:09,924 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:09,924 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:33240': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:09,934 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:09,935 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:33252': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:10,032 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:10,032 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:33258': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:10,041 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:10,042 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:33260': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:10,140 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:10,140 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:33276': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:10,148 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:10,148 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:33290': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:10,247 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:10,247 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:33304': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:10,254 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:10,254 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:33314': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:10,355 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:10,356 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:33326': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:10,361 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:10,362 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:33330': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:10,463 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:10,464 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:33340': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:10,469 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33233 5986s 2024-11-23 22:06:10,470 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33233': TLS handshake failed with remote 'tls://127.0.0.1:33352': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:10,481 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42431. Reason: failure-to-start- 5986s 2024-11-23 22:06:10,481 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:06:10,484 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34301. Reason: failure-to-start- 5986s 2024-11-23 22:06:10,484 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:06:10,485 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 13s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 5986s stream = await stream.start_tls( 5986s ^^^^^^^^^^^^^^^^^^^^^^^ 5986s False, ssl_options=ssl_options, server_hostname=host 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 5986s self.socket.do_handshake() 5986s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 5986s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 5986s self._sslobj.do_handshake() 5986s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 5986s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 5986s raise FatalCommClosedError( 5986s ...<2 lines>... 5986s ) from err 5986s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 5986s 5986s During handling of the above exception, another exception occurred: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1218, in _register_with_scheduler 5986s await asyncio.sleep(0.1) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 718, in sleep 5986s return await future 5986s ^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 13s. 5986s 2024-11-23 22:06:11,496 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:06:11,511 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43173 5986s 2024-11-23 22:06:11,512 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37961/status 5986s 2024-11-23 22:06:11,512 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:06:11,548 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33617 5986s 2024-11-23 22:06:11,548 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33617 5986s 2024-11-23 22:06:11,549 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:06:11,549 - distributed.worker - INFO - dashboard at: 127.0.0.1:34187 5986s 2024-11-23 22:06:11,549 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43173 5986s 2024-11-23 22:06:11,549 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:06:11,549 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:06:11,549 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:06:11,549 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-d6o925ty 5986s 2024-11-23 22:06:11,549 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:06:11,555 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46439 5986s 2024-11-23 22:06:11,556 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46439 5986s 2024-11-23 22:06:11,556 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:06:11,556 - distributed.worker - INFO - dashboard at: 127.0.0.1:34439 5986s 2024-11-23 22:06:11,556 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43173 5986s 2024-11-23 22:06:11,556 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:06:11,556 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:06:11,557 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:06:11,557 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-3zl_zu64 5986s 2024-11-23 22:06:11,557 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:06:11,560 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33617. Reason: failure-to-start- 5986s 2024-11-23 22:06:11,560 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:06:11,562 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46439. Reason: failure-to-start- 5986s 2024-11-23 22:06:11,563 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:06:11,566 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43173': TLS handshake failed with remote 'tls://127.0.0.1:49736': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:06:11,566 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43173': TLS handshake failed with remote 'tls://127.0.0.1:49738': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:06:11,571 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:06:12,582 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:06:12,594 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35667 5986s 2024-11-23 22:06:12,594 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41545/status 5986s 2024-11-23 22:06:12,595 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:06:12,620 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44667 5986s 2024-11-23 22:06:12,620 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44667 5986s 2024-11-23 22:06:12,620 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:06:12,620 - distributed.worker - INFO - dashboard at: 127.0.0.1:39585 5986s 2024-11-23 22:06:12,620 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35667 5986s 2024-11-23 22:06:12,620 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:06:12,620 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:06:12,620 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:06:12,621 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-d2o4gil7 5986s 2024-11-23 22:06:12,621 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:06:12,625 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45579 5986s 2024-11-23 22:06:12,625 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45579 5986s 2024-11-23 22:06:12,625 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:06:12,625 - distributed.worker - INFO - dashboard at: 127.0.0.1:45639 5986s 2024-11-23 22:06:12,625 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35667 5986s 2024-11-23 22:06:12,626 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:06:12,626 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:06:12,626 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:06:12,626 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-nx95f5_2 5986s 2024-11-23 22:06:12,626 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:06:12,628 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44667. Reason: failure-to-start- 5986s 2024-11-23 22:06:12,628 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:06:12,629 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45579. Reason: failure-to-start- 5986s 2024-11-23 22:06:12,630 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:06:12,632 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35667': TLS handshake failed with remote 'tls://127.0.0.1:55440': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:06:12,632 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35667': TLS handshake failed with remote 'tls://127.0.0.1:55444': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:06:12,634 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:06:13,645 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:06:13,658 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46693 5986s 2024-11-23 22:06:13,659 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37289/status 5986s 2024-11-23 22:06:13,659 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:06:13,684 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44025 5986s 2024-11-23 22:06:13,685 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44025 5986s 2024-11-23 22:06:13,685 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:06:13,685 - distributed.worker - INFO - dashboard at: 127.0.0.1:44715 5986s 2024-11-23 22:06:13,685 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46693 5986s 2024-11-23 22:06:13,685 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:06:13,685 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:06:13,685 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:06:13,685 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-d4is9joc 5986s 2024-11-23 22:06:13,685 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:06:13,689 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45587 5986s 2024-11-23 22:06:13,690 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45587 5986s 2024-11-23 22:06:13,690 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:06:13,690 - distributed.worker - INFO - dashboard at: 127.0.0.1:33115 5986s 2024-11-23 22:06:13,690 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46693 5986s 2024-11-23 22:06:13,690 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:06:13,690 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:06:13,690 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:06:13,690 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-l5y3lhee 5986s 2024-11-23 22:06:13,690 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:06:13,693 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44025. Reason: failure-to-start- 5986s 2024-11-23 22:06:13,693 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:06:13,694 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45587. Reason: failure-to-start- 5986s 2024-11-23 22:06:13,694 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:06:13,697 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46693': TLS handshake failed with remote 'tls://127.0.0.1:41828': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:06:13,697 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46693': TLS handshake failed with remote 'tls://127.0.0.1:41838': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:06:13,700 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:06:14,710 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:06:14,722 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38589 5986s 2024-11-23 22:06:14,723 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39525/status 5986s 2024-11-23 22:06:14,723 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:06:14,760 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37395 5986s 2024-11-23 22:06:14,760 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37395 5986s 2024-11-23 22:06:14,760 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:06:14,760 - distributed.worker - INFO - dashboard at: 127.0.0.1:38883 5986s 2024-11-23 22:06:14,760 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38589 5986s 2024-11-23 22:06:14,760 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:06:14,760 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:06:14,760 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:06:14,760 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-nw5eklrg 5986s 2024-11-23 22:06:14,760 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:06:14,765 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42647 5986s 2024-11-23 22:06:14,765 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42647 5986s 2024-11-23 22:06:14,765 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:06:14,765 - distributed.worker - INFO - dashboard at: 127.0.0.1:46547 5986s 2024-11-23 22:06:14,765 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38589 5986s 2024-11-23 22:06:14,765 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:06:14,765 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:06:14,765 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:06:14,765 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-b62tx25t 5986s 2024-11-23 22:06:14,765 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:06:14,768 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37395. Reason: failure-to-start- 5986s 2024-11-23 22:06:14,768 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:06:14,769 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42647. Reason: failure-to-start- 5986s 2024-11-23 22:06:14,769 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:06:14,772 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38589': TLS handshake failed with remote 'tls://127.0.0.1:40006': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:06:14,772 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38589': TLS handshake failed with remote 'tls://127.0.0.1:40018': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:06:14,775 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:06:15,785 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:06:15,798 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33507 5986s 2024-11-23 22:06:15,798 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44445/status 5986s 2024-11-23 22:06:15,799 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:06:15,823 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:32887 5986s 2024-11-23 22:06:15,823 - distributed.worker - INFO - Listening to: tls://127.0.0.1:32887 5986s 2024-11-23 22:06:15,823 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:06:15,823 - distributed.worker - INFO - dashboard at: 127.0.0.1:38323 5986s 2024-11-23 22:06:15,823 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33507 5986s 2024-11-23 22:06:15,823 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:06:15,823 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:06:15,823 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:06:15,823 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ijqkfrpz 5986s 2024-11-23 22:06:15,824 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:06:15,830 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36321 5986s 2024-11-23 22:06:15,830 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36321 5986s 2024-11-23 22:06:15,830 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:06:15,830 - distributed.worker - INFO - dashboard at: 127.0.0.1:42341 5986s 2024-11-23 22:06:15,830 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33507 5986s 2024-11-23 22:06:15,830 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:06:15,830 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:06:15,830 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:06:15,831 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-vuvsmo4z 5986s 2024-11-23 22:06:15,831 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:06:15,833 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:32887. Reason: failure-to-start- 5986s 2024-11-23 22:06:15,833 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:06:15,834 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36321. Reason: failure-to-start- 5986s 2024-11-23 22:06:15,834 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:06:15,837 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33507': TLS handshake failed with remote 'tls://127.0.0.1:53492': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:06:15,837 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33507': TLS handshake failed with remote 'tls://127.0.0.1:53498': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:06:15,839 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:06:16,848 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:06:16,860 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36571 5986s 2024-11-23 22:06:16,860 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35649/status 5986s 2024-11-23 22:06:16,861 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:06:16,885 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45387 5986s 2024-11-23 22:06:16,886 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45387 5986s 2024-11-23 22:06:16,886 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:06:16,886 - distributed.worker - INFO - dashboard at: 127.0.0.1:43129 5986s 2024-11-23 22:06:16,886 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36571 5986s 2024-11-23 22:06:16,886 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:06:16,886 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:06:16,886 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:06:16,886 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-1kn4v0i1 5986s 2024-11-23 22:06:16,886 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:06:16,890 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38471 5986s 2024-11-23 22:06:16,891 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38471 5986s 2024-11-23 22:06:16,891 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:06:16,891 - distributed.worker - INFO - dashboard at: 127.0.0.1:42819 5986s 2024-11-23 22:06:16,891 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36571 5986s 2024-11-23 22:06:16,891 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:06:16,891 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:06:16,891 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:06:16,891 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-qz3t7oex 5986s 2024-11-23 22:06:16,891 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:06:16,894 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45387. Reason: failure-to-start- 5986s 2024-11-23 22:06:16,894 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:06:16,895 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38471. Reason: failure-to-start- 5986s 2024-11-23 22:06:16,895 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:06:16,897 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36571': TLS handshake failed with remote 'tls://127.0.0.1:51110': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:06:16,898 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36571': TLS handshake failed with remote 'tls://127.0.0.1:51126': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:06:16,900 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:06:17,908 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:06:17,914 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35401 5986s 2024-11-23 22:06:17,914 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:32867/status 5986s 2024-11-23 22:06:17,914 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:06:17,925 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35759 5986s 2024-11-23 22:06:17,925 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35759 5986s 2024-11-23 22:06:17,925 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:06:17,925 - distributed.worker - INFO - dashboard at: 127.0.0.1:39477 5986s 2024-11-23 22:06:17,925 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35401 5986s 2024-11-23 22:06:17,926 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:06:17,926 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:06:17,926 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:06:17,926 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-tv84rc17 5986s 2024-11-23 22:06:17,926 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:06:17,927 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41089 5986s 2024-11-23 22:06:17,927 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41089 5986s 2024-11-23 22:06:17,927 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:06:17,928 - distributed.worker - INFO - dashboard at: 127.0.0.1:33383 5986s 2024-11-23 22:06:17,928 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35401 5986s 2024-11-23 22:06:17,928 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:06:17,928 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:06:17,928 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:06:17,928 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-y2z2a5dc 5986s 2024-11-23 22:06:17,928 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:06:17,929 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35759. Reason: failure-to-start- 5986s 2024-11-23 22:06:17,929 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:06:17,929 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41089. Reason: failure-to-start- 5986s 2024-11-23 22:06:17,929 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:06:17,930 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35401': TLS handshake failed with remote 'tls://127.0.0.1:51492': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:06:17,930 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35401': TLS handshake failed with remote 'tls://127.0.0.1:51502': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:06:17,931 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:06:18,936 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:06:18,942 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40597 5986s 2024-11-23 22:06:18,942 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46489/status 5986s 2024-11-23 22:06:18,942 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:06:18,956 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46671 5986s 2024-11-23 22:06:18,956 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46671 5986s 2024-11-23 22:06:18,956 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:06:18,956 - distributed.worker - INFO - dashboard at: 127.0.0.1:44005 5986s 2024-11-23 22:06:18,956 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40597 5986s 2024-11-23 22:06:18,956 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:06:18,956 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:06:18,956 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:06:18,956 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-tsks82tv 5986s 2024-11-23 22:06:18,956 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:06:18,958 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41123 5986s 2024-11-23 22:06:18,958 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41123 5986s 2024-11-23 22:06:18,958 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:06:18,958 - distributed.worker - INFO - dashboard at: 127.0.0.1:44065 5986s 2024-11-23 22:06:18,958 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40597 5986s 2024-11-23 22:06:18,958 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:06:18,958 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:06:18,958 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:06:18,958 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-o0b5xwm8 5986s 2024-11-23 22:06:18,958 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:06:18,959 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46671. Reason: failure-to-start- 5986s 2024-11-23 22:06:18,959 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:06:18,960 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41123. Reason: failure-to-start- 5986s 2024-11-23 22:06:18,960 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:06:18,960 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40597': TLS handshake failed with remote 'tls://127.0.0.1:44104': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:06:18,961 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40597': TLS handshake failed with remote 'tls://127.0.0.1:44106': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:06:18,962 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:06:19,966 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:06:19,972 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:32927 5986s 2024-11-23 22:06:19,972 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34419/status 5986s 2024-11-23 22:06:19,973 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:06:19,985 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38425 5986s 2024-11-23 22:06:19,986 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38425 5986s 2024-11-23 22:06:19,986 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:06:19,986 - distributed.worker - INFO - dashboard at: 127.0.0.1:43357 5986s 2024-11-23 22:06:19,986 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:32927 5986s 2024-11-23 22:06:19,986 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:06:19,986 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:06:19,986 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:06:19,986 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-zi5ro00q 5986s 2024-11-23 22:06:19,986 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:06:19,988 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35479 5986s 2024-11-23 22:06:19,988 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35479 5986s 2024-11-23 22:06:19,988 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:06:19,988 - distributed.worker - INFO - dashboard at: 127.0.0.1:40827 5986s 2024-11-23 22:06:19,988 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:32927 5986s 2024-11-23 22:06:19,988 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:06:19,988 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:06:19,988 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:06:19,988 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ijvgs8p7 5986s 2024-11-23 22:06:19,988 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:06:19,989 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38425. Reason: failure-to-start- 5986s 2024-11-23 22:06:19,989 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:06:19,989 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35479. Reason: failure-to-start- 5986s 2024-11-23 22:06:19,990 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:06:19,990 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:32927': TLS handshake failed with remote 'tls://127.0.0.1:41326': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:06:19,991 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:32927': TLS handshake failed with remote 'tls://127.0.0.1:41336': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:06:19,992 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:06:20,998 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:06:21,005 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42783 5986s 2024-11-23 22:06:21,005 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37461/status 5986s 2024-11-23 22:06:21,005 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:06:21,019 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36647 5986s 2024-11-23 22:06:21,019 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36647 5986s 2024-11-23 22:06:21,019 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:06:21,019 - distributed.worker - INFO - dashboard at: 127.0.0.1:44073 5986s 2024-11-23 22:06:21,019 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42783 5986s 2024-11-23 22:06:21,019 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:06:21,020 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:06:21,020 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:06:21,020 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-pezw35j8 5986s 2024-11-23 22:06:21,020 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:06:21,022 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35887 5986s 2024-11-23 22:06:21,022 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35887 5986s 2024-11-23 22:06:21,022 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:06:21,022 - distributed.worker - INFO - dashboard at: 127.0.0.1:36231 5986s 2024-11-23 22:06:21,022 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42783 5986s 2024-11-23 22:06:21,022 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:06:21,022 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:06:21,023 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:06:21,023 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-cdmw691e 5986s 2024-11-23 22:06:21,023 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:06:21,027 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36647. Reason: failure-to-start- 5986s 2024-11-23 22:06:21,027 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:06:21,028 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35887. Reason: failure-to-start- 5986s 2024-11-23 22:06:21,028 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:06:21,029 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42783': TLS handshake failed with remote 'tls://127.0.0.1:57774': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:06:21,030 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42783': TLS handshake failed with remote 'tls://127.0.0.1:57778': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:06:21,031 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:06:22,036 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:06:22,042 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39651 5986s 2024-11-23 22:06:22,042 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40275/status 5986s 2024-11-23 22:06:22,042 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:06:22,053 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34295 5986s 2024-11-23 22:06:22,053 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34295 5986s 2024-11-23 22:06:22,053 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:06:22,054 - distributed.worker - INFO - dashboard at: 127.0.0.1:40157 5986s 2024-11-23 22:06:22,054 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39651 5986s 2024-11-23 22:06:22,054 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:06:22,054 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:06:22,054 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:06:22,054 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-cu77gsmz 5986s 2024-11-23 22:06:22,054 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:06:22,055 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42985 5986s 2024-11-23 22:06:22,055 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42985 5986s 2024-11-23 22:06:22,056 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:06:22,056 - distributed.worker - INFO - dashboard at: 127.0.0.1:46551 5986s 2024-11-23 22:06:22,056 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39651 5986s 2024-11-23 22:06:22,056 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:06:22,056 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:06:22,056 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:06:22,056 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-wsobtqkq 5986s 2024-11-23 22:06:22,056 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:06:22,057 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34295. Reason: failure-to-start- 5986s 2024-11-23 22:06:22,057 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:06:22,057 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42985. Reason: failure-to-start- 5986s 2024-11-23 22:06:22,057 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:06:22,058 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39651': TLS handshake failed with remote 'tls://127.0.0.1:36466': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:06:22,058 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39651': TLS handshake failed with remote 'tls://127.0.0.1:36480': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:06:22,059 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:06:23,064 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:06:23,071 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33711 5986s 2024-11-23 22:06:23,071 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42247/status 5986s 2024-11-23 22:06:23,071 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:06:23,082 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45259 5986s 2024-11-23 22:06:23,082 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45259 5986s 2024-11-23 22:06:23,082 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:06:23,082 - distributed.worker - INFO - dashboard at: 127.0.0.1:34629 5986s 2024-11-23 22:06:23,083 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33711 5986s 2024-11-23 22:06:23,083 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:06:23,083 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:06:23,083 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:06:23,083 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ct6_q3zo 5986s 2024-11-23 22:06:23,083 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:06:23,084 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44457 5986s 2024-11-23 22:06:23,085 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44457 5986s 2024-11-23 22:06:23,085 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:06:23,085 - distributed.worker - INFO - dashboard at: 127.0.0.1:40925 5986s 2024-11-23 22:06:23,085 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33711 5986s 2024-11-23 22:06:23,085 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:06:23,085 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:06:23,085 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:06:23,085 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-m36cap89 5986s 2024-11-23 22:06:23,085 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:06:23,086 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45259. Reason: failure-to-start- 5986s 2024-11-23 22:06:23,086 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:06:23,086 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44457. Reason: failure-to-start- 5986s 2024-11-23 22:06:23,086 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:06:23,087 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33711': TLS handshake failed with remote 'tls://127.0.0.1:36064': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:06:23,087 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33711': TLS handshake failed with remote 'tls://127.0.0.1:36068': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:06:23,088 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:06:24,094 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:06:24,100 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39383 5986s 2024-11-23 22:06:24,100 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44927/status 5986s 2024-11-23 22:06:24,100 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:06:24,116 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39339 5986s 2024-11-23 22:06:24,116 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39339 5986s 2024-11-23 22:06:24,116 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:06:24,116 - distributed.worker - INFO - dashboard at: 127.0.0.1:38259 5986s 2024-11-23 22:06:24,116 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39383 5986s 2024-11-23 22:06:24,116 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:06:24,116 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:06:24,116 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:06:24,116 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-t8rk6wu8 5986s 2024-11-23 22:06:24,116 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:06:24,118 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39217 5986s 2024-11-23 22:06:24,118 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39217 5986s 2024-11-23 22:06:24,118 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:06:24,118 - distributed.worker - INFO - dashboard at: 127.0.0.1:46445 5986s 2024-11-23 22:06:24,118 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39383 5986s 2024-11-23 22:06:24,118 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:06:24,118 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:06:24,118 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:06:24,118 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-630_7izm 5986s 2024-11-23 22:06:24,118 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:06:24,119 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39339. Reason: failure-to-start- 5986s 2024-11-23 22:06:24,120 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:06:24,120 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39217. Reason: failure-to-start- 5986s 2024-11-23 22:06:24,120 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:06:24,121 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39383': TLS handshake failed with remote 'tls://127.0.0.1:56166': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:06:24,121 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39383': TLS handshake failed with remote 'tls://127.0.0.1:56180': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:06:24,122 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:06:25,127 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:06:25,133 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33469 5986s 2024-11-23 22:06:25,133 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39663/status 5986s 2024-11-23 22:06:25,133 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:06:25,145 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43383 5986s 2024-11-23 22:06:25,145 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43383 5986s 2024-11-23 22:06:25,145 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:06:25,145 - distributed.worker - INFO - dashboard at: 127.0.0.1:44037 5986s 2024-11-23 22:06:25,145 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33469 5986s 2024-11-23 22:06:25,145 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:06:25,145 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:06:25,145 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:06:25,145 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-4d51u5t_ 5986s 2024-11-23 22:06:25,145 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:06:25,147 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38773 5986s 2024-11-23 22:06:25,147 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38773 5986s 2024-11-23 22:06:25,147 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:06:25,147 - distributed.worker - INFO - dashboard at: 127.0.0.1:45001 5986s 2024-11-23 22:06:25,147 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33469 5986s 2024-11-23 22:06:25,147 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:06:25,147 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:06:25,147 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:06:25,148 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-3k331_1_ 5986s 2024-11-23 22:06:25,148 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:06:25,149 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43383. Reason: failure-to-start- 5986s 2024-11-23 22:06:25,149 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:06:25,149 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38773. Reason: failure-to-start- 5986s 2024-11-23 22:06:25,149 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:06:25,150 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33469': TLS handshake failed with remote 'tls://127.0.0.1:38328': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:06:25,150 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33469': TLS handshake failed with remote 'tls://127.0.0.1:38340': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:06:25,151 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:06:26,156 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:06:26,162 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43211 5986s 2024-11-23 22:06:26,162 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41605/status 5986s 2024-11-23 22:06:26,162 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:06:26,175 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33007 5986s 2024-11-23 22:06:26,175 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33007 5986s 2024-11-23 22:06:26,175 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:06:26,175 - distributed.worker - INFO - dashboard at: 127.0.0.1:37107 5986s 2024-11-23 22:06:26,175 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43211 5986s 2024-11-23 22:06:26,175 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:06:26,175 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:06:26,175 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:06:26,175 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-6d2p8bfz 5986s 2024-11-23 22:06:26,175 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:06:26,177 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33203 5986s 2024-11-23 22:06:26,177 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33203 5986s 2024-11-23 22:06:26,177 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:06:26,177 - distributed.worker - INFO - dashboard at: 127.0.0.1:37061 5986s 2024-11-23 22:06:26,177 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43211 5986s 2024-11-23 22:06:26,177 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:06:26,177 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:06:26,178 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:06:26,178 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-67qfktrq 5986s 2024-11-23 22:06:26,178 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:06:26,179 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33007. Reason: failure-to-start- 5986s 2024-11-23 22:06:26,179 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:06:26,180 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33203. Reason: failure-to-start- 5986s 2024-11-23 22:06:26,180 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:06:26,181 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43211': TLS handshake failed with remote 'tls://127.0.0.1:39810': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:06:26,181 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43211': TLS handshake failed with remote 'tls://127.0.0.1:39824': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:06:26,182 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:06:27,187 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:06:27,193 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36311 5986s 2024-11-23 22:06:27,193 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43035/status 5986s 2024-11-23 22:06:27,193 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:06:27,204 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36553 5986s 2024-11-23 22:06:27,204 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36553 5986s 2024-11-23 22:06:27,205 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:06:27,205 - distributed.worker - INFO - dashboard at: 127.0.0.1:45191 5986s 2024-11-23 22:06:27,205 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36311 5986s 2024-11-23 22:06:27,205 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:06:27,205 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:06:27,205 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:06:27,205 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-c78kn_0o 5986s 2024-11-23 22:06:27,205 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:06:27,206 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41279 5986s 2024-11-23 22:06:27,207 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41279 5986s 2024-11-23 22:06:27,207 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:06:27,207 - distributed.worker - INFO - dashboard at: 127.0.0.1:35791 5986s 2024-11-23 22:06:27,207 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36311 5986s 2024-11-23 22:06:27,207 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:06:27,207 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:06:27,207 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:06:27,207 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-u2c3tdh5 5986s 2024-11-23 22:06:27,207 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:06:27,208 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36553. Reason: failure-to-start- 5986s 2024-11-23 22:06:27,208 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:06:27,209 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41279. Reason: failure-to-start- 5986s 2024-11-23 22:06:27,209 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:06:27,210 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36311': TLS handshake failed with remote 'tls://127.0.0.1:60888': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:06:27,210 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36311': TLS handshake failed with remote 'tls://127.0.0.1:60896': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:06:27,211 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:06:28,217 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:06:28,223 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46245 5986s 2024-11-23 22:06:28,224 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43175/status 5986s 2024-11-23 22:06:28,224 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:06:28,238 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34557 5986s 2024-11-23 22:06:28,238 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34557 5986s 2024-11-23 22:06:28,238 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:06:28,238 - distributed.worker - INFO - dashboard at: 127.0.0.1:44623 5986s 2024-11-23 22:06:28,238 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46245 5986s 2024-11-23 22:06:28,239 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:06:28,239 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:06:28,239 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:06:28,239 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-6f7g3qus 5986s 2024-11-23 22:06:28,239 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:06:28,241 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37233 5986s 2024-11-23 22:06:28,241 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37233 5986s 2024-11-23 22:06:28,241 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:06:28,241 - distributed.worker - INFO - dashboard at: 127.0.0.1:43757 5986s 2024-11-23 22:06:28,241 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46245 5986s 2024-11-23 22:06:28,241 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:06:28,241 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:06:28,241 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:06:28,241 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-d3uhqn9w 5986s 2024-11-23 22:06:28,241 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:06:28,242 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34557. Reason: failure-to-start- 5986s 2024-11-23 22:06:28,242 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:06:28,243 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37233. Reason: failure-to-start- 5986s 2024-11-23 22:06:28,243 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:06:28,244 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46245': TLS handshake failed with remote 'tls://127.0.0.1:60978': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:06:28,244 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46245': TLS handshake failed with remote 'tls://127.0.0.1:60988': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:06:28,245 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:06:29,250 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:06:29,256 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45401 5986s 2024-11-23 22:06:29,256 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33225/status 5986s 2024-11-23 22:06:29,257 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:06:29,269 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43223 5986s 2024-11-23 22:06:29,269 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43223 5986s 2024-11-23 22:06:29,269 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:06:29,269 - distributed.worker - INFO - dashboard at: 127.0.0.1:34549 5986s 2024-11-23 22:06:29,269 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45401 5986s 2024-11-23 22:06:29,269 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:06:29,269 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:06:29,269 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:06:29,269 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-k3t64wz8 5986s 2024-11-23 22:06:29,269 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:06:29,271 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41391 5986s 2024-11-23 22:06:29,271 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41391 5986s 2024-11-23 22:06:29,271 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:06:29,271 - distributed.worker - INFO - dashboard at: 127.0.0.1:42855 5986s 2024-11-23 22:06:29,271 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45401 5986s 2024-11-23 22:06:29,271 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:06:29,271 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:06:29,271 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:06:29,271 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-cf9zmsak 5986s 2024-11-23 22:06:29,272 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:06:29,273 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43223. Reason: failure-to-start- 5986s 2024-11-23 22:06:29,273 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:06:29,273 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41391. Reason: failure-to-start- 5986s 2024-11-23 22:06:29,273 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:06:29,274 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45401': TLS handshake failed with remote 'tls://127.0.0.1:55100': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:06:29,274 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45401': TLS handshake failed with remote 'tls://127.0.0.1:55110': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:06:29,276 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:06:30,281 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:06:30,287 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43779 5986s 2024-11-23 22:06:30,287 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41425/status 5986s 2024-11-23 22:06:30,287 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:06:30,307 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42713 5986s 2024-11-23 22:06:30,307 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42713 5986s 2024-11-23 22:06:30,307 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:06:30,307 - distributed.worker - INFO - dashboard at: 127.0.0.1:35145 5986s 2024-11-23 22:06:30,307 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43779 5986s 2024-11-23 22:06:30,307 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:06:30,307 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:06:30,307 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:06:30,307 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-e8pq61cw 5986s 2024-11-23 22:06:30,307 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:06:30,309 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35433 5986s 2024-11-23 22:06:30,309 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35433 5986s 2024-11-23 22:06:30,309 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:06:30,309 - distributed.worker - INFO - dashboard at: 127.0.0.1:33111 5986s 2024-11-23 22:06:30,309 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43779 5986s 2024-11-23 22:06:30,309 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:06:30,309 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:06:30,309 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:06:30,309 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-unyko6h_ 5986s 2024-11-23 22:06:30,309 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:06:30,310 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42713. Reason: failure-to-start- 5986s 2024-11-23 22:06:30,310 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:06:30,310 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35433. Reason: failure-to-start- 5986s 2024-11-23 22:06:30,310 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:06:30,314 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43779': TLS handshake failed with remote 'tls://127.0.0.1:35888': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:06:30,314 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43779': TLS handshake failed with remote 'tls://127.0.0.1:35902': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:06:30,315 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:06:31,320 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:06:31,326 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45843 5986s 2024-11-23 22:06:31,326 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39535/status 5986s 2024-11-23 22:06:31,326 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:06:31,338 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33877 5986s 2024-11-23 22:06:31,338 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33877 5986s 2024-11-23 22:06:31,338 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:06:31,338 - distributed.worker - INFO - dashboard at: 127.0.0.1:36193 5986s 2024-11-23 22:06:31,338 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45843 5986s 2024-11-23 22:06:31,338 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:06:31,338 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:06:31,338 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:06:31,338 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-kksihys3 5986s 2024-11-23 22:06:31,338 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:06:31,340 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39429 5986s 2024-11-23 22:06:31,340 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39429 5986s 2024-11-23 22:06:31,340 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:06:31,340 - distributed.worker - INFO - dashboard at: 127.0.0.1:44343 5986s 2024-11-23 22:06:31,340 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45843 5986s 2024-11-23 22:06:31,340 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:06:31,340 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:06:31,340 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:06:31,340 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-9m22r6uy 5986s 2024-11-23 22:06:31,340 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:06:31,341 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33877. Reason: failure-to-start- 5986s 2024-11-23 22:06:31,341 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:06:31,342 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39429. Reason: failure-to-start- 5986s 2024-11-23 22:06:31,342 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:06:31,343 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45843': TLS handshake failed with remote 'tls://127.0.0.1:47760': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:06:31,343 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45843': TLS handshake failed with remote 'tls://127.0.0.1:47770': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:06:31,344 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:06:32,350 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:06:32,357 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36559 5986s 2024-11-23 22:06:32,357 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43571/status 5986s 2024-11-23 22:06:32,357 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:06:32,371 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34659 5986s 2024-11-23 22:06:32,371 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34659 5986s 2024-11-23 22:06:32,371 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:06:32,371 - distributed.worker - INFO - dashboard at: 127.0.0.1:41363 5986s 2024-11-23 22:06:32,371 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36559 5986s 2024-11-23 22:06:32,371 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:06:32,371 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:06:32,371 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:06:32,372 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-inxpenk7 5986s 2024-11-23 22:06:32,372 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:06:32,373 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38353 5986s 2024-11-23 22:06:32,373 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38353 5986s 2024-11-23 22:06:32,373 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:06:32,373 - distributed.worker - INFO - dashboard at: 127.0.0.1:39967 5986s 2024-11-23 22:06:32,373 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36559 5986s 2024-11-23 22:06:32,373 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:06:32,373 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:06:32,373 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:06:32,373 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-a9e82cl_ 5986s 2024-11-23 22:06:32,374 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:06:32,377 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34659. Reason: failure-to-start- 5986s 2024-11-23 22:06:32,377 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:06:32,377 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38353. Reason: failure-to-start- 5986s 2024-11-23 22:06:32,377 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:06:32,378 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36559': TLS handshake failed with remote 'tls://127.0.0.1:55724': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:06:32,378 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36559': TLS handshake failed with remote 'tls://127.0.0.1:55726': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:06:32,379 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:06:33,386 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:06:33,391 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39289 5986s 2024-11-23 22:06:33,392 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33033/status 5986s 2024-11-23 22:06:33,392 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:06:33,405 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36631 5986s 2024-11-23 22:06:33,405 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36631 5986s 2024-11-23 22:06:33,405 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:06:33,405 - distributed.worker - INFO - dashboard at: 127.0.0.1:37659 5986s 2024-11-23 22:06:33,405 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39289 5986s 2024-11-23 22:06:33,405 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:06:33,405 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:06:33,405 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:06:33,405 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-gotlm3mx 5986s 2024-11-23 22:06:33,405 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:06:33,407 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41903 5986s 2024-11-23 22:06:33,407 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41903 5986s 2024-11-23 22:06:33,407 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:06:33,407 - distributed.worker - INFO - dashboard at: 127.0.0.1:41227 5986s 2024-11-23 22:06:33,407 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39289 5986s 2024-11-23 22:06:33,407 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:06:33,408 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:06:33,408 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:06:33,408 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-co7vohn6 5986s 2024-11-23 22:06:33,408 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:06:33,409 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36631. Reason: failure-to-start- 5986s 2024-11-23 22:06:33,409 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:06:33,409 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41903. Reason: failure-to-start- 5986s 2024-11-23 22:06:33,409 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:06:33,410 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39289': TLS handshake failed with remote 'tls://127.0.0.1:55038': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:06:33,410 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39289': TLS handshake failed with remote 'tls://127.0.0.1:55050': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:06:33,411 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:06:34,416 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:06:34,424 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43603 5986s 2024-11-23 22:06:34,424 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38821/status 5986s 2024-11-23 22:06:34,424 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:06:34,438 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33703 5986s 2024-11-23 22:06:34,438 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33703 5986s 2024-11-23 22:06:34,438 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:06:34,439 - distributed.worker - INFO - dashboard at: 127.0.0.1:39725 5986s 2024-11-23 22:06:34,439 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43603 5986s 2024-11-23 22:06:34,439 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:06:34,439 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:06:34,439 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:06:34,439 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-h1sajqbx 5986s 2024-11-23 22:06:34,439 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:06:34,441 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39759 5986s 2024-11-23 22:06:34,442 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39759 5986s 2024-11-23 22:06:34,442 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:06:34,442 - distributed.worker - INFO - dashboard at: 127.0.0.1:35577 5986s 2024-11-23 22:06:34,442 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43603 5986s 2024-11-23 22:06:34,442 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:06:34,442 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:06:34,442 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:06:34,442 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-0pblaf22 5986s 2024-11-23 22:06:34,442 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:06:34,443 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33703. Reason: failure-to-start- 5986s 2024-11-23 22:06:34,443 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:06:34,443 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39759. Reason: failure-to-start- 5986s 2024-11-23 22:06:34,444 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:06:34,446 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43603': TLS handshake failed with remote 'tls://127.0.0.1:51662': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:06:34,446 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43603': TLS handshake failed with remote 'tls://127.0.0.1:51666': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:06:34,449 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:06:35,455 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:06:35,461 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34085 5986s 2024-11-23 22:06:35,461 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43723/status 5986s 2024-11-23 22:06:35,461 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:06:35,474 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41447 5986s 2024-11-23 22:06:35,474 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41447 5986s 2024-11-23 22:06:35,474 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:06:35,474 - distributed.worker - INFO - dashboard at: 127.0.0.1:42483 5986s 2024-11-23 22:06:35,474 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34085 5986s 2024-11-23 22:06:35,474 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:06:35,474 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:06:35,474 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:06:35,474 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-61l0buwt 5986s 2024-11-23 22:06:35,474 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:06:35,476 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37093 5986s 2024-11-23 22:06:35,476 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37093 5986s 2024-11-23 22:06:35,476 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:06:35,476 - distributed.worker - INFO - dashboard at: 127.0.0.1:39129 5986s 2024-11-23 22:06:35,476 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34085 5986s 2024-11-23 22:06:35,476 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:06:35,476 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:06:35,476 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:06:35,476 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-0clz40re 5986s 2024-11-23 22:06:35,476 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:06:35,480 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41447. Reason: failure-to-start- 5986s 2024-11-23 22:06:35,480 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:06:35,481 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37093. Reason: failure-to-start- 5986s 2024-11-23 22:06:35,481 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:06:35,484 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34085': TLS handshake failed with remote 'tls://127.0.0.1:37516': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:06:35,484 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34085': TLS handshake failed with remote 'tls://127.0.0.1:37522': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:06:35,485 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:06:36,490 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:06:36,496 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41895 5986s 2024-11-23 22:06:36,497 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41033/status 5986s 2024-11-23 22:06:36,497 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:06:36,509 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37643 5986s 2024-11-23 22:06:36,509 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37643 5986s 2024-11-23 22:06:36,509 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:06:36,509 - distributed.worker - INFO - dashboard at: 127.0.0.1:41031 5986s 2024-11-23 22:06:36,509 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41895 5986s 2024-11-23 22:06:36,509 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:06:36,509 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:06:36,509 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:06:36,509 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-np38y_uq 5986s 2024-11-23 22:06:36,509 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:06:36,511 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38403 5986s 2024-11-23 22:06:36,511 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38403 5986s 2024-11-23 22:06:36,511 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:06:36,511 - distributed.worker - INFO - dashboard at: 127.0.0.1:35789 5986s 2024-11-23 22:06:36,511 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41895 5986s 2024-11-23 22:06:36,511 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:06:36,511 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:06:36,511 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:06:36,511 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-m2_ggd8d 5986s 2024-11-23 22:06:36,511 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:06:36,514 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37643. Reason: failure-to-start- 5986s 2024-11-23 22:06:36,514 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:06:36,515 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38403. Reason: failure-to-start- 5986s 2024-11-23 22:06:36,515 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:06:36,516 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41895': TLS handshake failed with remote 'tls://127.0.0.1:55416': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:06:36,516 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41895': TLS handshake failed with remote 'tls://127.0.0.1:55432': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:06:36,519 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:06:37,525 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:06:37,532 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40915 5986s 2024-11-23 22:06:37,532 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45945/status 5986s 2024-11-23 22:06:37,532 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:06:37,545 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42177 5986s 2024-11-23 22:06:37,546 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42177 5986s 2024-11-23 22:06:37,546 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:06:37,546 - distributed.worker - INFO - dashboard at: 127.0.0.1:45779 5986s 2024-11-23 22:06:37,546 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40915 5986s 2024-11-23 22:06:37,546 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:06:37,546 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:06:37,546 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:06:37,546 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-283vo76b 5986s 2024-11-23 22:06:37,546 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:06:37,548 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46765 5986s 2024-11-23 22:06:37,548 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46765 5986s 2024-11-23 22:06:37,548 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:06:37,548 - distributed.worker - INFO - dashboard at: 127.0.0.1:34463 5986s 2024-11-23 22:06:37,548 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40915 5986s 2024-11-23 22:06:37,548 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:06:37,548 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:06:37,548 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:06:37,548 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-zwedq5ew 5986s 2024-11-23 22:06:37,548 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:06:37,551 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42177. Reason: failure-to-start- 5986s 2024-11-23 22:06:37,551 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:06:37,552 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46765. Reason: failure-to-start- 5986s 2024-11-23 22:06:37,552 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:06:37,553 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40915': TLS handshake failed with remote 'tls://127.0.0.1:43478': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:06:37,553 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40915': TLS handshake failed with remote 'tls://127.0.0.1:43488': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:06:37,554 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:06:38,559 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:06:38,566 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37561 5986s 2024-11-23 22:06:38,566 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42583/status 5986s 2024-11-23 22:06:38,566 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:06:38,580 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45861 5986s 2024-11-23 22:06:38,580 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45861 5986s 2024-11-23 22:06:38,580 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:06:38,580 - distributed.worker - INFO - dashboard at: 127.0.0.1:39861 5986s 2024-11-23 22:06:38,580 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37561 5986s 2024-11-23 22:06:38,580 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:06:38,580 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:06:38,580 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:06:38,580 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-6dadgj_t 5986s 2024-11-23 22:06:38,580 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:06:38,582 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43981 5986s 2024-11-23 22:06:38,582 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43981 5986s 2024-11-23 22:06:38,582 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:06:38,582 - distributed.worker - INFO - dashboard at: 127.0.0.1:45027 5986s 2024-11-23 22:06:38,582 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37561 5986s 2024-11-23 22:06:38,582 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:06:38,582 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:06:38,582 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:06:38,582 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-796f7oyv 5986s 2024-11-23 22:06:38,582 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:06:38,585 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45861. Reason: failure-to-start- 5986s 2024-11-23 22:06:38,585 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:06:38,586 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43981. Reason: failure-to-start- 5986s 2024-11-23 22:06:38,586 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:06:38,587 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37561': TLS handshake failed with remote 'tls://127.0.0.1:38068': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:06:38,587 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37561': TLS handshake failed with remote 'tls://127.0.0.1:38070': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:06:38,589 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:06:39,594 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:06:39,600 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45997 5986s 2024-11-23 22:06:39,601 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33755/status 5986s 2024-11-23 22:06:39,601 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:06:39,616 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43925 5986s 2024-11-23 22:06:39,616 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43925 5986s 2024-11-23 22:06:39,616 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:06:39,616 - distributed.worker - INFO - dashboard at: 127.0.0.1:37193 5986s 2024-11-23 22:06:39,616 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45997 5986s 2024-11-23 22:06:39,616 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:06:39,616 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:06:39,617 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:06:39,617 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-748ge0dy 5986s 2024-11-23 22:06:39,617 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:06:39,618 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42603 5986s 2024-11-23 22:06:39,618 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42603 5986s 2024-11-23 22:06:39,618 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:06:39,619 - distributed.worker - INFO - dashboard at: 127.0.0.1:39605 5986s 2024-11-23 22:06:39,619 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45997 5986s 2024-11-23 22:06:39,619 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:06:39,619 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:06:39,619 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:06:39,619 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-dffjo5r_ 5986s 2024-11-23 22:06:39,619 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:06:39,622 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43925. Reason: failure-to-start- 5986s 2024-11-23 22:06:39,622 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:06:39,622 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42603. Reason: failure-to-start- 5986s 2024-11-23 22:06:39,623 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:06:39,624 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45997': TLS handshake failed with remote 'tls://127.0.0.1:33030': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:06:39,624 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45997': TLS handshake failed with remote 'tls://127.0.0.1:33040': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:06:39,625 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:06:40,631 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:06:40,645 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35813 5986s 2024-11-23 22:06:40,646 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33449/status 5986s 2024-11-23 22:06:40,646 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:06:40,676 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41123 5986s 2024-11-23 22:06:40,676 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41123 5986s 2024-11-23 22:06:40,676 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:06:40,676 - distributed.worker - INFO - dashboard at: 127.0.0.1:44175 5986s 2024-11-23 22:06:40,676 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35813 5986s 2024-11-23 22:06:40,676 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:06:40,676 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:06:40,676 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:06:40,677 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-jyeishru 5986s 2024-11-23 22:06:40,677 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:06:40,681 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44375 5986s 2024-11-23 22:06:40,681 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44375 5986s 2024-11-23 22:06:40,681 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:06:40,681 - distributed.worker - INFO - dashboard at: 127.0.0.1:39067 5986s 2024-11-23 22:06:40,681 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35813 5986s 2024-11-23 22:06:40,681 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:06:40,681 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:06:40,682 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:06:40,684 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-70udy783 5986s 2024-11-23 22:06:40,685 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:06:40,695 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41123. Reason: failure-to-start- 5986s 2024-11-23 22:06:40,695 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:06:40,696 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44375. Reason: failure-to-start- 5986s 2024-11-23 22:06:40,697 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:06:40,700 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35813': TLS handshake failed with remote 'tls://127.0.0.1:36180': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:06:40,700 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35813': TLS handshake failed with remote 'tls://127.0.0.1:36182': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:06:40,707 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s __________________________ test_worker_client_gather ___________________________ 5986s 5986s fut = , timeout = 0 5986s 5986s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 5986s async with asyncio.timeout(timeout): 5986s > return await fut 5986s 5986s /usr/lib/python3/dist-packages/distributed/utils.py:1960: 5986s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5986s /usr/lib/python3/dist-packages/distributed/worker.py:1480: in start_unsafe 5986s await self._register_with_scheduler() 5986s /usr/lib/python3/dist-packages/distributed/worker.py:1179: in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s /usr/lib/python3/dist-packages/distributed/comm/core.py:342: in connect 5986s comm = await wait_for( 5986s /usr/lib/python3/dist-packages/distributed/utils.py:1960: in wait_for 5986s return await fut 5986s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:546: in connect 5986s stream = await self.client.connect( 5986s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5986s 5986s self = , host = '127.0.0.1' 5986s port = 46425, af = 5986s ssl_options = 5986s max_buffer_size = 8364507136.0, source_ip = None, source_port = None 5986s timeout = None 5986s 5986s async def connect( 5986s self, 5986s host: str, 5986s port: int, 5986s af: socket.AddressFamily = socket.AF_UNSPEC, 5986s ssl_options: Optional[Union[Dict[str, Any], ssl.SSLContext]] = None, 5986s max_buffer_size: Optional[int] = None, 5986s source_ip: Optional[str] = None, 5986s source_port: Optional[int] = None, 5986s timeout: Optional[Union[float, datetime.timedelta]] = None, 5986s ) -> IOStream: 5986s """Connect to the given host and port. 5986s 5986s Asynchronously returns an `.IOStream` (or `.SSLIOStream` if 5986s ``ssl_options`` is not None). 5986s 5986s Using the ``source_ip`` kwarg, one can specify the source 5986s IP address to use when establishing the connection. 5986s In case the user needs to resolve and 5986s use a specific interface, it has to be handled outside 5986s of Tornado as this depends very much on the platform. 5986s 5986s Raises `TimeoutError` if the input future does not complete before 5986s ``timeout``, which may be specified in any form allowed by 5986s `.IOLoop.add_timeout` (i.e. a `datetime.timedelta` or an absolute time 5986s relative to `.IOLoop.time`) 5986s 5986s Similarly, when the user requires a certain source port, it can 5986s be specified using the ``source_port`` arg. 5986s 5986s .. versionchanged:: 4.5 5986s Added the ``source_ip`` and ``source_port`` arguments. 5986s 5986s .. versionchanged:: 5.0 5986s Added the ``timeout`` argument. 5986s """ 5986s if timeout is not None: 5986s if isinstance(timeout, numbers.Real): 5986s timeout = IOLoop.current().time() + timeout 5986s elif isinstance(timeout, datetime.timedelta): 5986s timeout = IOLoop.current().time() + timeout.total_seconds() 5986s else: 5986s raise TypeError("Unsupported timeout %r" % timeout) 5986s if timeout is not None: 5986s addrinfo = await gen.with_timeout( 5986s timeout, self.resolver.resolve(host, port, af) 5986s ) 5986s else: 5986s addrinfo = await self.resolver.resolve(host, port, af) 5986s connector = _Connector( 5986s addrinfo, 5986s functools.partial( 5986s self._create_stream, 5986s max_buffer_size, 5986s source_ip=source_ip, 5986s source_port=source_port, 5986s ), 5986s ) 5986s > af, addr, stream = await connector.start(connect_timeout=timeout) 5986s E asyncio.exceptions.CancelledError 5986s 5986s /usr/lib/python3/dist-packages/tornado/tcpclient.py:279: CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s self = 5986s 5986s @final 5986s async def start(self): 5986s async with self._startup_lock: 5986s if self.status == Status.failed: 5986s assert self.__startup_exc is not None 5986s raise self.__startup_exc 5986s elif self.status != Status.init: 5986s return self 5986s timeout = getattr(self, "death_timeout", None) 5986s 5986s async def _close_on_failure(exc: Exception) -> None: 5986s await self.close(reason=f"failure-to-start-{str(type(exc))}") 5986s self.status = Status.failed 5986s self.__startup_exc = exc 5986s 5986s try: 5986s > await wait_for(self.start_unsafe(), timeout=timeout) 5986s 5986s /usr/lib/python3/dist-packages/distributed/core.py:664: 5986s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5986s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 5986s async with asyncio.timeout(timeout): 5986s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5986s 5986s self = 5986s exc_type = 5986s exc_val = CancelledError(), exc_tb = 5986s 5986s async def __aexit__( 5986s self, 5986s exc_type: Optional[Type[BaseException]], 5986s exc_val: Optional[BaseException], 5986s exc_tb: Optional[TracebackType], 5986s ) -> Optional[bool]: 5986s assert self._state in (_State.ENTERED, _State.EXPIRING) 5986s 5986s if self._timeout_handler is not None: 5986s self._timeout_handler.cancel() 5986s self._timeout_handler = None 5986s 5986s if self._state is _State.EXPIRING: 5986s self._state = _State.EXPIRED 5986s 5986s if self._task.uncancel() <= self._cancelling and exc_type is not None: 5986s # Since there are no new cancel requests, we're 5986s # handling this. 5986s if issubclass(exc_type, exceptions.CancelledError): 5986s > raise TimeoutError from exc_val 5986s E TimeoutError 5986s 5986s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s @contextlib.asynccontextmanager 5986s async def _cluster_factory(): 5986s workers = [] 5986s s = None 5986s try: 5986s for _ in range(60): 5986s try: 5986s > s, ws = await start_cluster( 5986s nthreads, 5986s scheduler, 5986s security=security, 5986s Worker=Worker, 5986s scheduler_kwargs=scheduler_kwargs, 5986s worker_kwargs=merge( 5986s {"death_timeout": min(15, int(deadline.remaining))}, 5986s worker_kwargs, 5986s ), 5986s ) 5986s 5986s /usr/lib/python3/dist-packages/distributed/utils_test.py:966: 5986s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5986s /usr/lib/python3/dist-packages/distributed/utils_test.py:789: in start_cluster 5986s await asyncio.gather(*workers) 5986s /usr/lib/python3.13/asyncio/tasks.py:737: in _wrap_awaitable 5986s return await awaitable 5986s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5986s 5986s self = 5986s 5986s @final 5986s async def start(self): 5986s async with self._startup_lock: 5986s if self.status == Status.failed: 5986s assert self.__startup_exc is not None 5986s raise self.__startup_exc 5986s elif self.status != Status.init: 5986s return self 5986s timeout = getattr(self, "death_timeout", None) 5986s 5986s async def _close_on_failure(exc: Exception) -> None: 5986s await self.close(reason=f"failure-to-start-{str(type(exc))}") 5986s self.status = Status.failed 5986s self.__startup_exc = exc 5986s 5986s try: 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s except asyncio.TimeoutError as exc: 5986s await _close_on_failure(exc) 5986s > raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s E TimeoutError: Worker start timed out after 0s. 5986s 5986s /usr/lib/python3/dist-packages/distributed/core.py:667: TimeoutError 5986s 5986s During handling of the above exception, another exception occurred: 5986s 5986s fut = ._..test_func..async_fn at 0xde81a110> 5986s timeout = 60 5986s 5986s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 5986s async with asyncio.timeout(timeout): 5986s > return await fut 5986s 5986s /usr/lib/python3/dist-packages/distributed/utils.py:1960: 5986s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5986s /usr/lib/python3/dist-packages/distributed/utils_test.py:999: in async_fn 5986s _cluster_factory() as (s, workers), 5986s /usr/lib/python3.13/contextlib.py:214: in __aenter__ 5986s return await anext(self.gen) 5986s /usr/lib/python3/dist-packages/distributed/utils_test.py:983: in _cluster_factory 5986s await asyncio.sleep(1) 5986s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5986s 5986s delay = 1, result = None 5986s 5986s async def sleep(delay, result=None): 5986s """Coroutine that completes after a given time (in seconds).""" 5986s if delay <= 0: 5986s await __sleep0() 5986s return result 5986s 5986s if math.isnan(delay): 5986s raise ValueError("Invalid delay: NaN (not a number)") 5986s 5986s loop = events.get_running_loop() 5986s future = loop.create_future() 5986s h = loop.call_later(delay, 5986s futures._set_result_unless_cancelled, 5986s future, result) 5986s try: 5986s > return await future 5986s E asyncio.exceptions.CancelledError 5986s 5986s /usr/lib/python3.13/asyncio/tasks.py:718: CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s args = (), kwds = {} 5986s 5986s @wraps(func) 5986s def inner(*args, **kwds): 5986s with self._recreate_cm(): 5986s > return func(*args, **kwds) 5986s 5986s /usr/lib/python3.13/contextlib.py:85: 5986s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5986s /usr/lib/python3.13/contextlib.py:85: in inner 5986s return func(*args, **kwds) 5986s /usr/lib/python3/dist-packages/distributed/utils_test.py:1102: in test_func 5986s return _run_and_close_tornado(async_fn_outer) 5986s /usr/lib/python3/dist-packages/distributed/utils_test.py:378: in _run_and_close_tornado 5986s return asyncio_run(inner_fn(), loop_factory=get_loop_factory()) 5986s /usr/lib/python3.13/asyncio/runners.py:194: in run 5986s return runner.run(main) 5986s /usr/lib/python3.13/asyncio/runners.py:118: in run 5986s return self._loop.run_until_complete(task) 5986s /usr/lib/python3.13/asyncio/base_events.py:720: in run_until_complete 5986s return future.result() 5986s /usr/lib/python3/dist-packages/distributed/utils_test.py:375: in inner_fn 5986s return await async_fn(*args, **kwargs) 5986s /usr/lib/python3/dist-packages/distributed/utils_test.py:1099: in async_fn_outer 5986s return await utils_wait_for(async_fn(), timeout=timeout * 2) 5986s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 5986s async with asyncio.timeout(timeout): 5986s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5986s 5986s self = 5986s exc_type = 5986s exc_val = CancelledError(), exc_tb = 5986s 5986s async def __aexit__( 5986s self, 5986s exc_type: Optional[Type[BaseException]], 5986s exc_val: Optional[BaseException], 5986s exc_tb: Optional[TracebackType], 5986s ) -> Optional[bool]: 5986s assert self._state in (_State.ENTERED, _State.EXPIRING) 5986s 5986s if self._timeout_handler is not None: 5986s self._timeout_handler.cancel() 5986s self._timeout_handler = None 5986s 5986s if self._state is _State.EXPIRING: 5986s self._state = _State.EXPIRED 5986s 5986s if self._task.uncancel() <= self._cancelling and exc_type is not None: 5986s # Since there are no new cancel requests, we're 5986s # handling this. 5986s if issubclass(exc_type, exceptions.CancelledError): 5986s > raise TimeoutError from exc_val 5986s E TimeoutError 5986s 5986s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 5986s ----------------------------- Captured stderr call ----------------------------- 5986s 2024-11-23 22:06:41,908 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:06:41,916 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:41,916 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39941/status 5986s 2024-11-23 22:06:41,916 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:06:41,929 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35665 5986s 2024-11-23 22:06:41,930 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35665 5986s 2024-11-23 22:06:41,930 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:06:41,930 - distributed.worker - INFO - dashboard at: 127.0.0.1:46509 5986s 2024-11-23 22:06:41,930 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:41,930 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:06:41,930 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:06:41,930 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:06:41,930 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-cwkvttfa 5986s 2024-11-23 22:06:41,930 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:06:41,932 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42025 5986s 2024-11-23 22:06:41,932 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42025 5986s 2024-11-23 22:06:41,932 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:06:41,932 - distributed.worker - INFO - dashboard at: 127.0.0.1:34985 5986s 2024-11-23 22:06:41,932 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:41,932 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:06:41,932 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:06:41,932 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:06:41,932 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-jrd2drqy 5986s 2024-11-23 22:06:41,932 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:06:41,945 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:41,945 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:41,945 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:60808': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:41,945 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:60822': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:42,058 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:42,058 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:42,058 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:60834': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:42,058 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:60850': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:42,171 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:42,172 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:42,172 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:60856': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:42,172 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:60860': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:42,284 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:42,284 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:42,285 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:60866': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:42,285 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:60878': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:42,397 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:42,397 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:42,398 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:60880': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:42,398 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:60890': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:42,509 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:42,509 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:42,509 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:60904': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:42,509 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:60912': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:42,622 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:42,622 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:42,622 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:60924': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:42,622 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:60940': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:42,733 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:42,734 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:42,734 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:60956': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:42,734 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:60962': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:42,846 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:42,847 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:42,847 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:60966': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:42,847 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:60980': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:42,960 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:42,960 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:42,960 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:60982': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:42,960 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:60990': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:43,072 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:43,072 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:43,072 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:32774': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:43,073 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:32790': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:43,184 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:43,185 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:43,185 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:32800': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:43,185 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:32816': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:43,297 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:43,297 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:43,297 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:32828': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:43,297 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:32830': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:43,409 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:43,409 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:43,410 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:32840': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:43,410 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:32850': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:43,521 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:43,521 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:43,522 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:32864': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:43,522 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:32876': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:43,634 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:43,634 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:43,634 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:32878': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:43,634 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:32894': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:43,747 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:43,747 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:43,747 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:32902': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:43,747 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:32906': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:43,859 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:43,859 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:43,860 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:32916': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:43,860 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:32924': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:43,971 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:43,971 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:43,972 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:32936': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:43,972 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:32946': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:44,084 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:44,084 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:44,084 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:32962': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:44,084 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:32974': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:44,196 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:44,196 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:44,196 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:32990': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:44,196 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:33006': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:44,308 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:44,309 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:44,309 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:33014': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:44,309 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:33018': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:44,421 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:44,421 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:44,425 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:33020': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:44,425 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:33036': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:44,533 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:44,533 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:44,534 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:33046': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:44,534 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:33058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:44,646 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:44,646 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:44,646 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:33070': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:44,646 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:33076': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:44,757 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:44,758 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:44,758 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:33078': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:44,758 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:33080': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:44,870 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:44,870 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:44,870 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:33092': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:44,870 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:33104': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:44,982 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:44,982 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:44,983 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:33120': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:44,983 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:33122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:45,095 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:45,095 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:45,095 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:33124': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:45,095 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:33138': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:45,206 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:45,206 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:45,207 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:33146': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:45,207 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:33156': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:45,318 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:45,319 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:45,319 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:33168': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:45,319 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:33178': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:45,433 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:45,433 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:45,433 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:33180': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:45,433 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:33188': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:45,546 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:45,546 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:45,546 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:33190': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:45,546 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:33198': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:45,658 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:45,658 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:45,658 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:33212': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:45,659 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:33226': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:45,770 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:45,771 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:45,771 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:33242': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:45,771 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:33252': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:45,883 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:45,883 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:45,883 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:33262': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:45,883 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:33268': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:45,995 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:45,995 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:45,995 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:33278': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:45,995 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:33286': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:46,107 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:46,108 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:46,108 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:33290': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:46,108 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:33302': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:46,220 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:46,220 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:46,220 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:33316': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:46,220 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:33326': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:46,332 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:46,332 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:46,333 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:33336': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:46,333 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:33344': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:46,444 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:46,444 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:46,445 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:33360': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:46,445 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:33370': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:46,557 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:46,557 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:46,557 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:33376': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:46,557 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:33392': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:46,669 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:46,670 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:46,670 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:33396': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:46,670 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:33400': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:46,782 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:46,782 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:46,782 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:33404': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:46,783 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:33414': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:46,895 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:46,895 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:46,895 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:33420': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:46,895 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:33432': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:47,006 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:47,007 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:47,007 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:33436': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:47,007 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:33448': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:47,119 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:47,120 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:47,120 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:33450': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:47,120 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:33462': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:47,231 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:47,232 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:47,232 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:33470': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:47,232 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:33484': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:47,345 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:47,345 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:47,345 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:33488': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:47,345 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:33498': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:47,457 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:47,457 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:47,457 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:33512': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:47,457 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:33518': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:47,569 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:47,569 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:47,570 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:33532': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:47,570 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:33538': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:47,682 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:47,682 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:47,682 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:33552': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:47,682 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:33554': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:47,794 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:47,795 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:47,795 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:33568': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:47,795 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:33580': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:47,907 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:47,907 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:47,907 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:33592': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:47,908 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:33594': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:48,020 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:48,021 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:48,021 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:33602': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:48,021 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:33608': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:48,133 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:48,133 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:48,134 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:33616': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:48,134 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:33622': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:48,245 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:48,245 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:48,245 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:33634': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:48,245 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:33642': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:48,358 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:48,358 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:48,358 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:33646': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:48,358 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:33656': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:48,470 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:48,471 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:48,471 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:33660': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:48,471 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:33666': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:48,583 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:48,583 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:48,584 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:33676': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:48,584 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:33684': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:48,695 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:48,695 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:48,696 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:33696': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:48,696 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:33710': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:48,809 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:48,809 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:48,809 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:33726': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:48,809 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:33738': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:48,921 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:48,922 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:48,925 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:33752': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:48,926 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:33762': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:49,033 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:49,034 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:49,034 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:33768': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:49,034 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:33774': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:49,147 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:49,147 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:49,147 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:33784': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:49,147 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:33800': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:49,259 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:49,259 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:49,260 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:33808': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:49,260 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:33820': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:49,372 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:49,372 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:49,372 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:33834': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:49,372 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:33850': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:49,484 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:49,484 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:49,484 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:33864': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:49,484 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:33878': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:49,596 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:49,597 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:49,597 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:33888': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:49,597 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:33902': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:49,708 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:49,708 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:49,709 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:33906': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:49,709 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:33920': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:49,820 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:49,821 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:49,821 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:33932': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:49,821 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:33938': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:49,933 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:49,933 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:49,934 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:33954': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:49,934 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:33962': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:50,045 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:50,045 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:50,046 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:33968': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:50,046 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:33982': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:50,157 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:50,157 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:50,158 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:33990': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:50,158 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:34006': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:50,269 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:50,269 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:50,270 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:34010': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:50,270 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:34022': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:50,382 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:50,382 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:50,382 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:34026': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:50,382 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:34038': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:50,494 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:50,495 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:50,495 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:34042': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:50,495 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:34046': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:50,610 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:50,610 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:50,611 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:34052': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:50,611 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:34062': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:50,723 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:50,723 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:50,724 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:34064': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:50,724 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:34068': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:50,836 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:50,836 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:50,836 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:34076': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:50,836 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:34084': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:50,949 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:50,949 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:50,950 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:34094': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:50,950 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:34110': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:51,062 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:51,063 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:51,063 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:34116': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:51,063 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:34128': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:51,175 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:51,175 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:51,176 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:34130': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:51,176 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:34134': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:51,289 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:51,289 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:51,289 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:34142': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:51,289 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:34152': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:51,402 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:51,402 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:51,403 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:34158': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:51,403 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:34166': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:51,514 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:51,515 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:51,515 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:34178': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:51,515 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:34186': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:51,627 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:51,628 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:51,628 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:48984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:51,628 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:48994': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:51,740 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:51,740 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:51,740 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:49000': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:51,740 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:49014': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:51,852 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:51,852 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:51,853 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:49024': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:51,853 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:49028': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:51,966 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:51,966 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:51,966 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:49040': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:51,966 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:49044': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:52,079 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:52,079 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:52,080 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:49050': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:52,080 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:49056': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:52,192 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:52,192 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:52,193 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:49066': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:52,193 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:49078': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:52,305 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:52,305 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:52,306 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:49088': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:52,306 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:49092': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:52,419 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:52,420 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:52,423 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:49098': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:52,423 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:49108': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:52,532 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:52,532 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:52,532 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:49116': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:52,532 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:49128': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:52,644 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:52,645 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:52,645 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:49134': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:52,645 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:49148': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:52,757 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:52,758 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:52,758 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:49164': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:52,758 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:49168': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:52,870 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:52,870 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:52,871 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:49182': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:52,871 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:49186': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:52,983 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:52,983 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:52,983 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:49194': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:52,983 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:49210': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:53,095 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:53,096 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:53,096 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:49216': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:53,096 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:49228': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:53,214 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:53,214 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:53,215 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:49242': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:53,215 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:49252': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:53,327 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:53,327 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:53,328 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:49266': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:53,328 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:49276': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:53,442 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:53,443 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:53,443 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:49288': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:53,443 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:49296': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:53,555 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:53,555 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:53,556 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:49306': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:53,556 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:49322': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:53,669 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:53,669 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:53,670 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:49326': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:53,670 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:49330': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:53,782 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:53,783 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:53,783 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:49334': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:53,783 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:49346': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:53,895 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:53,895 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:53,896 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:49358': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:53,896 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:49366': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:54,007 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:54,008 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:54,008 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:49370': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:54,008 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:49376': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:54,121 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:54,121 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:54,121 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:49382': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:54,121 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:49384': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:54,235 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:54,235 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:54,235 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:49396': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:54,235 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:49408': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:54,348 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:54,348 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:54,349 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:49416': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:54,349 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:49428': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:54,460 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:54,461 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:54,461 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:49440': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:54,461 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:49452': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:54,574 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:54,574 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:54,575 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:49458': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:54,575 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:49464': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:54,686 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:54,687 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:54,687 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:49480': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:54,687 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:49496': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:54,799 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:54,799 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:54,800 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:49510': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:54,800 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:49524': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:54,912 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:54,912 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:54,912 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:49526': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:54,912 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:49536': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:55,025 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:55,025 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:55,025 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:49552': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:55,025 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:49556': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:55,137 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:55,138 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:55,138 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:49558': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:55,138 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:49566': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:55,249 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:55,249 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:55,249 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:49580': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:55,250 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:49584': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:55,362 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:55,362 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:55,362 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:49588': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:55,362 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:49600': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:55,475 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:55,475 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:55,475 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:49614': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:55,475 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:49630': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:55,588 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:55,588 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:55,588 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:49644': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:55,588 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:49650': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:55,699 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:55,700 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:55,700 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:49662': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:55,700 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:49672': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:55,812 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:55,813 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:55,813 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:49686': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:55,813 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:49688': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:55,926 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:55,927 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:55,931 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:49698': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:55,931 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:49708': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:56,039 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:56,039 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:56,039 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:49714': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:56,040 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:49728': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:56,152 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:56,152 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:56,153 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:49732': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:56,153 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:49748': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:56,264 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:56,264 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:56,264 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:49752': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:56,265 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:49754': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:56,377 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:56,378 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:56,378 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:49760': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:56,378 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:49776': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:56,490 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:56,490 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:56,490 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:49790': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:56,490 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:49802': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:56,603 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:56,603 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:56,603 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:49814': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:56,604 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:49820': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:56,716 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:56,717 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:56,717 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:49832': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:56,717 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:49834': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:56,829 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:56,830 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37901 5986s 2024-11-23 22:06:56,830 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:49840': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:56,830 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:49844': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:56,928 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35665. Reason: failure-to-start- 5986s 2024-11-23 22:06:56,929 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:06:56,931 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 15s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 5986s stream = await stream.start_tls( 5986s ^^^^^^^^^^^^^^^^^^^^^^^ 5986s False, ssl_options=ssl_options, server_hostname=host 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 5986s self.socket.do_handshake() 5986s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 5986s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 5986s self._sslobj.do_handshake() 5986s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 5986s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 5986s raise FatalCommClosedError( 5986s ...<2 lines>... 5986s ) from err 5986s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 5986s 5986s During handling of the above exception, another exception occurred: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1218, in _register_with_scheduler 5986s await asyncio.sleep(0.1) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 718, in sleep 5986s return await future 5986s ^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 15s. 5986s 2024-11-23 22:06:56,934 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42025. Reason: failure-to-start- 5986s 2024-11-23 22:06:56,934 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:06:56,935 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37901': TLS handshake failed with remote 'tls://127.0.0.1:49854': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:06:57,937 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:06:57,944 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44563 5986s 2024-11-23 22:06:57,944 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34533/status 5986s 2024-11-23 22:06:57,944 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:06:57,957 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34203 5986s 2024-11-23 22:06:57,958 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34203 5986s 2024-11-23 22:06:57,958 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:06:57,958 - distributed.worker - INFO - dashboard at: 127.0.0.1:38045 5986s 2024-11-23 22:06:57,958 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:06:57,958 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:06:57,958 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:06:57,958 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:06:57,958 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-72g93v8g 5986s 2024-11-23 22:06:57,958 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:06:57,959 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37273 5986s 2024-11-23 22:06:57,960 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37273 5986s 2024-11-23 22:06:57,960 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:06:57,960 - distributed.worker - INFO - dashboard at: 127.0.0.1:38493 5986s 2024-11-23 22:06:57,960 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:06:57,960 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:06:57,960 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:06:57,960 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:06:57,960 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-1r_vw59u 5986s 2024-11-23 22:06:57,960 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:06:57,972 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:06:57,972 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:06:57,972 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:41404': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:57,972 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:41416': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:58,084 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:06:58,084 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:06:58,084 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:41432': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:58,084 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:41446': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:58,196 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:06:58,196 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:06:58,196 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:41460': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:58,196 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:41464': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:58,308 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:06:58,308 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:06:58,308 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:41478': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:58,308 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:41482': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:58,421 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:06:58,421 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:06:58,425 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:41496': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:58,425 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:41504': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:58,533 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:06:58,533 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:06:58,533 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:41510': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:58,533 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:41516': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:58,645 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:06:58,645 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:06:58,645 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:41520': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:58,645 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:41536': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:58,757 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:06:58,758 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:06:58,758 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:41546': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:58,758 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:41556': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:58,868 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:06:58,870 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:06:58,870 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:41564': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:58,870 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:41580': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:58,976 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:06:58,977 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:41592': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:58,981 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:06:58,982 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:41598': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:59,084 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:06:59,085 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:41600': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:59,090 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:06:59,091 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:41612': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:59,191 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:06:59,191 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:41620': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:59,198 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:06:59,199 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:41622': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:59,298 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:06:59,299 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:41630': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:59,304 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:06:59,305 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:41636': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:59,405 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:06:59,405 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:41650': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:59,411 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:06:59,412 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:41654': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:59,513 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:06:59,514 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:41666': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:59,519 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:06:59,519 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:41668': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:59,620 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:06:59,621 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:41674': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:59,626 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:06:59,627 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:41688': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:59,729 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:06:59,729 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:41690': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:59,735 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:06:59,735 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:41704': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:59,836 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:06:59,836 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:41710': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:59,842 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:06:59,842 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:41724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:59,943 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:06:59,943 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:41726': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:06:59,952 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:06:59,952 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:41738': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:00,051 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:00,051 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:41744': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:00,058 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:00,059 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:41746': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:00,158 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:00,158 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:41760': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:00,165 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:00,166 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:41766': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:00,265 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:00,266 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:41768': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:00,272 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:00,272 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:41784': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:00,372 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:00,372 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:41794': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:00,378 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:00,378 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:41796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:00,479 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:00,480 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:41798': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:00,485 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:00,485 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:41806': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:00,586 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:00,586 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:41816': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:00,592 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:00,592 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:41830': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:00,693 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:00,693 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:41844': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:00,699 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:00,699 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:41846': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:00,800 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:00,801 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:41848': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:00,808 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:00,808 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:41862': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:00,907 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:00,908 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:41876': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:00,915 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:00,915 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:41886': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:01,014 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:01,015 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:41900': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:01,022 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:01,022 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:41906': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:01,122 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:01,122 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:41918': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:01,128 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:01,128 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:41932': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:01,229 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:01,229 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:41946': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:01,235 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:01,235 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:41962': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:01,336 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:01,337 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:41974': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:01,342 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:01,343 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:41988': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:01,444 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:01,445 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:41990': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:01,453 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:01,453 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:41992': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:01,551 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:01,552 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:44706': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:01,560 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:01,560 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:44716': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:01,658 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:01,659 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:44726': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:01,667 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:01,667 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:44734': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:01,766 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:01,766 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:44744': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:01,773 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:01,773 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:44756': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:01,872 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:01,873 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:44768': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:01,880 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:01,880 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:44778': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:01,979 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:01,980 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:44786': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:01,987 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:01,988 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:44792': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:02,087 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:02,087 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:44796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:02,094 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:02,094 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:44806': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:02,193 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:02,194 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:44822': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:02,201 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:02,201 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:44836': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:02,300 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:02,300 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:44844': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:02,307 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:02,308 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:44846': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:02,407 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:02,407 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:44862': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:02,414 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:02,414 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:44874': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:02,514 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:02,514 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:44882': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:02,520 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:02,521 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:44894': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:02,622 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:02,622 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:44906': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:02,628 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:02,628 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:44920': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:02,729 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:02,729 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:44922': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:02,735 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:02,735 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:44936': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:02,836 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:02,836 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:44950': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:02,842 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:02,842 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:44964': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:02,943 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:02,944 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:44966': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:02,953 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:02,953 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:44980': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:03,051 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:03,051 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:44984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:03,060 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:03,060 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:44998': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:03,159 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:03,159 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:45012': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:03,166 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:03,166 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:45016': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:03,265 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:03,266 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:45030': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:03,273 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:03,273 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:45046': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:03,372 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:03,372 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:45048': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:03,379 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:03,379 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:45062': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:03,479 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:03,480 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:45066': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:03,486 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:03,486 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:45068': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:03,588 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:03,589 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:45084': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:03,594 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:03,595 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:45100': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:03,695 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:03,696 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:45108': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:03,702 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:03,702 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:45124': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:03,802 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:03,802 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:45140': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:03,808 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:03,808 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:45148': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:03,909 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:03,910 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:45162': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:03,915 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:03,915 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:45164': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:04,017 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:04,017 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:45180': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:04,023 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:04,023 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:45192': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:04,126 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:04,127 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:45204': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:04,134 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:04,134 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:45218': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:04,235 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:04,235 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:45226': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:04,241 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:04,242 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:45242': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:04,343 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:04,344 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:45246': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:04,350 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:04,350 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:45262': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:04,453 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:04,454 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:45272': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:04,460 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:04,460 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:45284': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:04,561 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:04,562 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:45294': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:04,568 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:04,568 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:45304': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:04,668 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:04,669 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:45320': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:04,675 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:04,675 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:45324': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:04,775 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:04,775 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:45330': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:04,781 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:04,781 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:45338': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:04,883 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:04,883 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:45352': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:04,889 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:04,889 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:45358': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:04,990 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:04,991 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:45366': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:04,996 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:04,996 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:45380': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:05,098 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:05,098 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:45388': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:05,104 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:05,104 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:45396': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:05,205 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:05,206 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:45408': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:05,211 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:05,212 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:45416': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:05,313 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:05,313 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:45422': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:05,319 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:05,320 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:45434': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:05,420 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:05,423 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:45442': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:05,429 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:05,429 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:45458': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:05,530 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:05,530 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:45474': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:05,536 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:05,537 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:45488': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:05,637 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:05,637 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:45500': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:05,643 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:05,643 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:45514': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:05,744 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:05,744 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:45516': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:05,751 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:05,752 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:45532': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:05,851 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:05,851 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:45544': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:05,858 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:05,859 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:45560': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:05,958 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:05,958 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:45566': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:05,965 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:05,965 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:45580': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:06,066 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:06,066 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:45582': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:06,072 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:06,072 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:45598': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:06,173 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:06,174 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:45612': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:06,179 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:06,179 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:45626': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:06,280 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:06,280 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:45630': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:06,286 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:06,286 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:45636': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:06,386 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:06,387 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:45642': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:06,392 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:06,393 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:45654': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:06,493 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:06,493 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:45656': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:06,499 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:06,499 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:45668': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:06,601 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:06,602 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:45682': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:06,607 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:06,607 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:45694': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:06,708 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:06,708 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:45698': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:06,714 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:06,714 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:45704': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:06,815 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:06,816 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:45720': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:06,821 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:06,822 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:45730': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:06,927 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:06,927 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:45740': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:06,933 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:06,933 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:45744': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:07,034 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:07,035 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:45752': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:07,040 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:07,041 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:45768': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:07,141 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:07,141 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:45774': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:07,147 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:07,148 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:45782': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:07,248 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:07,249 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:45788': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:07,255 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:07,255 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:45792': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:07,355 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:07,355 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:45800': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:07,362 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:07,363 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:45808': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:07,462 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:07,462 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:45814': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:07,470 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:07,470 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:45828': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:07,570 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:07,570 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:45836': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:07,576 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:07,576 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:45842': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:07,677 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:07,678 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:45852': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:07,684 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:07,684 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:45860': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:07,784 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:07,785 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:45866': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:07,790 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:07,791 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:45868': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:07,892 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:07,892 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:45882': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:07,898 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:07,898 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:45890': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:07,998 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:07,999 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:45906': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:08,005 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:08,005 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:45912': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:08,105 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:08,106 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:45920': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:08,111 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:08,112 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:45924': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:08,212 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:08,212 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:45930': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:08,218 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:08,219 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:45934': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:08,321 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:08,322 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:45944': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:08,328 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:08,328 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:45948': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:08,428 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:08,429 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:45962': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:08,434 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:08,435 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:45974': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:08,536 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:08,536 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:45976': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:08,542 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:08,542 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:45988': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:08,643 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:08,644 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:46000': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:08,649 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:08,650 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:46012': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:08,751 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:08,752 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:46024': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:08,757 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:08,757 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:46036': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:08,857 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:08,858 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:46048': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:08,863 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:08,864 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:46050': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:08,965 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:08,965 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:46052': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:08,971 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:08,971 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:46066': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:09,073 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:09,074 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:46072': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:09,080 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:09,080 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:46076': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:09,180 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:09,180 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:46092': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:09,186 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:09,186 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:46098': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:09,287 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:09,287 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:46100': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:09,293 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:09,293 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:46106': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:09,394 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:09,395 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:46114': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:09,400 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:09,401 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:46118': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:09,501 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:09,501 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:46120': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:09,507 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:09,507 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:46128': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:09,608 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:09,608 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:46134': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:09,614 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:09,614 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:46148': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:09,716 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:09,717 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:46156': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:09,722 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:09,723 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:46168': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:09,825 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:09,826 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:46176': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:09,831 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:09,832 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:46180': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:09,931 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:09,932 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:46194': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:09,938 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:09,938 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:46208': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:10,040 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:10,040 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:46222': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:10,046 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:10,047 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:46226': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:10,147 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:10,147 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:46236': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:10,153 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:10,153 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:46242': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:10,254 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:10,254 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:46248': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:10,260 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:10,261 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:46260': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:10,362 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:10,363 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:46272': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:10,368 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:10,368 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:46284': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:10,469 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:10,470 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:46290': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:10,476 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:10,476 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:46304': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:10,576 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:10,577 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:46310': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:10,582 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:10,583 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:46312': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:10,684 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:10,687 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:46322': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:10,693 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:10,693 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:46334': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:10,791 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:10,792 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:46348': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:10,800 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:10,800 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:46360': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:10,898 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:10,899 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:46362': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:10,907 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44563 5986s 2024-11-23 22:07:10,907 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44563': TLS handshake failed with remote 'tls://127.0.0.1:46366': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:10,957 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34203. Reason: failure-to-start- 5986s 2024-11-23 22:07:10,957 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:07:10,958 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 13s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 5986s stream = await stream.start_tls( 5986s ^^^^^^^^^^^^^^^^^^^^^^^ 5986s False, ssl_options=ssl_options, server_hostname=host 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 5986s self.socket.do_handshake() 5986s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 5986s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 5986s self._sslobj.do_handshake() 5986s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 5986s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 5986s raise FatalCommClosedError( 5986s ...<2 lines>... 5986s ) from err 5986s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 5986s 5986s During handling of the above exception, another exception occurred: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1218, in _register_with_scheduler 5986s await asyncio.sleep(0.1) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 718, in sleep 5986s return await future 5986s ^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 13s. 5986s 2024-11-23 22:07:10,962 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37273. Reason: failure-to-start- 5986s 2024-11-23 22:07:10,962 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:07:11,965 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:07:11,971 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33177 5986s 2024-11-23 22:07:11,971 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40069/status 5986s 2024-11-23 22:07:11,971 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:07:11,983 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37275 5986s 2024-11-23 22:07:11,983 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37275 5986s 2024-11-23 22:07:11,983 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:07:11,984 - distributed.worker - INFO - dashboard at: 127.0.0.1:33259 5986s 2024-11-23 22:07:11,984 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33177 5986s 2024-11-23 22:07:11,984 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:07:11,984 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:07:11,984 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:07:11,984 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-w9il3tgb 5986s 2024-11-23 22:07:11,984 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:07:11,986 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34411 5986s 2024-11-23 22:07:11,986 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34411 5986s 2024-11-23 22:07:11,986 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:07:11,986 - distributed.worker - INFO - dashboard at: 127.0.0.1:42733 5986s 2024-11-23 22:07:11,986 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33177 5986s 2024-11-23 22:07:11,986 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:07:11,986 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:07:11,986 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:07:11,986 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-q2rxxnf6 5986s 2024-11-23 22:07:11,986 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:07:11,987 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37275. Reason: failure-to-start- 5986s 2024-11-23 22:07:11,987 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:07:11,987 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34411. Reason: failure-to-start- 5986s 2024-11-23 22:07:11,988 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:07:11,988 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33177': TLS handshake failed with remote 'tls://127.0.0.1:53016': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:07:11,989 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33177': TLS handshake failed with remote 'tls://127.0.0.1:53018': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:07:11,990 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:07:12,995 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:07:13,004 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43067 5986s 2024-11-23 22:07:13,004 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43401/status 5986s 2024-11-23 22:07:13,004 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:07:13,017 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44219 5986s 2024-11-23 22:07:13,018 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44219 5986s 2024-11-23 22:07:13,018 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:07:13,018 - distributed.worker - INFO - dashboard at: 127.0.0.1:35927 5986s 2024-11-23 22:07:13,018 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43067 5986s 2024-11-23 22:07:13,018 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:07:13,018 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:07:13,018 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:07:13,018 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-fr8o23sp 5986s 2024-11-23 22:07:13,018 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:07:13,020 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35785 5986s 2024-11-23 22:07:13,020 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35785 5986s 2024-11-23 22:07:13,020 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:07:13,020 - distributed.worker - INFO - dashboard at: 127.0.0.1:37519 5986s 2024-11-23 22:07:13,020 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43067 5986s 2024-11-23 22:07:13,020 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:07:13,020 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:07:13,020 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:07:13,020 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-r9evqgok 5986s 2024-11-23 22:07:13,020 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:07:13,021 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44219. Reason: failure-to-start- 5986s 2024-11-23 22:07:13,021 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:07:13,022 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35785. Reason: failure-to-start- 5986s 2024-11-23 22:07:13,022 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:07:13,023 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43067': TLS handshake failed with remote 'tls://127.0.0.1:57352': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:07:13,023 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43067': TLS handshake failed with remote 'tls://127.0.0.1:57358': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:07:13,024 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:07:14,030 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:07:14,038 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35055 5986s 2024-11-23 22:07:14,038 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43133/status 5986s 2024-11-23 22:07:14,038 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:07:14,052 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37397 5986s 2024-11-23 22:07:14,052 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37397 5986s 2024-11-23 22:07:14,052 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:07:14,052 - distributed.worker - INFO - dashboard at: 127.0.0.1:37247 5986s 2024-11-23 22:07:14,053 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35055 5986s 2024-11-23 22:07:14,053 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:07:14,053 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:07:14,053 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:07:14,053 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-gekh3rbk 5986s 2024-11-23 22:07:14,053 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:07:14,054 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41007 5986s 2024-11-23 22:07:14,055 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41007 5986s 2024-11-23 22:07:14,055 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:07:14,055 - distributed.worker - INFO - dashboard at: 127.0.0.1:38117 5986s 2024-11-23 22:07:14,055 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35055 5986s 2024-11-23 22:07:14,055 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:07:14,055 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:07:14,055 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:07:14,055 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-1bjme1m8 5986s 2024-11-23 22:07:14,055 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:07:14,056 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37397. Reason: failure-to-start- 5986s 2024-11-23 22:07:14,056 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:07:14,056 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41007. Reason: failure-to-start- 5986s 2024-11-23 22:07:14,056 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:07:14,057 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35055': TLS handshake failed with remote 'tls://127.0.0.1:56684': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:07:14,057 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35055': TLS handshake failed with remote 'tls://127.0.0.1:56698': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:07:14,058 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:07:15,064 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:07:15,072 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35161 5986s 2024-11-23 22:07:15,072 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40493/status 5986s 2024-11-23 22:07:15,072 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:07:15,086 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36871 5986s 2024-11-23 22:07:15,086 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36871 5986s 2024-11-23 22:07:15,086 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:07:15,086 - distributed.worker - INFO - dashboard at: 127.0.0.1:44825 5986s 2024-11-23 22:07:15,086 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35161 5986s 2024-11-23 22:07:15,086 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:07:15,086 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:07:15,086 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:07:15,086 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-z07r176y 5986s 2024-11-23 22:07:15,086 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:07:15,089 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43011 5986s 2024-11-23 22:07:15,089 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43011 5986s 2024-11-23 22:07:15,089 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:07:15,089 - distributed.worker - INFO - dashboard at: 127.0.0.1:40571 5986s 2024-11-23 22:07:15,089 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35161 5986s 2024-11-23 22:07:15,089 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:07:15,089 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:07:15,089 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:07:15,089 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-rudaq9ww 5986s 2024-11-23 22:07:15,090 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:07:15,090 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36871. Reason: failure-to-start- 5986s 2024-11-23 22:07:15,090 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:07:15,091 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43011. Reason: failure-to-start- 5986s 2024-11-23 22:07:15,091 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:07:15,092 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35161': TLS handshake failed with remote 'tls://127.0.0.1:46646': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:07:15,092 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35161': TLS handshake failed with remote 'tls://127.0.0.1:46648': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:07:15,093 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:07:16,099 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:07:16,106 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45997 5986s 2024-11-23 22:07:16,106 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36371/status 5986s 2024-11-23 22:07:16,107 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:07:16,119 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35761 5986s 2024-11-23 22:07:16,120 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35761 5986s 2024-11-23 22:07:16,120 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:07:16,120 - distributed.worker - INFO - dashboard at: 127.0.0.1:46077 5986s 2024-11-23 22:07:16,120 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45997 5986s 2024-11-23 22:07:16,120 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:07:16,120 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:07:16,120 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:07:16,120 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-mp1wx6dv 5986s 2024-11-23 22:07:16,120 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:07:16,122 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40647 5986s 2024-11-23 22:07:16,122 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40647 5986s 2024-11-23 22:07:16,122 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:07:16,122 - distributed.worker - INFO - dashboard at: 127.0.0.1:37993 5986s 2024-11-23 22:07:16,122 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45997 5986s 2024-11-23 22:07:16,122 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:07:16,122 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:07:16,122 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:07:16,122 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-rdvc5tfn 5986s 2024-11-23 22:07:16,122 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:07:16,123 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35761. Reason: failure-to-start- 5986s 2024-11-23 22:07:16,123 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:07:16,124 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40647. Reason: failure-to-start- 5986s 2024-11-23 22:07:16,124 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:07:16,125 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45997': TLS handshake failed with remote 'tls://127.0.0.1:45260': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:07:16,125 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45997': TLS handshake failed with remote 'tls://127.0.0.1:45274': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:07:16,126 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:07:17,131 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:07:17,138 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38483 5986s 2024-11-23 22:07:17,139 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43269/status 5986s 2024-11-23 22:07:17,139 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:07:17,151 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37653 5986s 2024-11-23 22:07:17,151 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37653 5986s 2024-11-23 22:07:17,151 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:07:17,151 - distributed.worker - INFO - dashboard at: 127.0.0.1:33569 5986s 2024-11-23 22:07:17,151 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38483 5986s 2024-11-23 22:07:17,151 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:07:17,152 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:07:17,152 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:07:17,152 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-_0bwq9n4 5986s 2024-11-23 22:07:17,152 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:07:17,153 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46017 5986s 2024-11-23 22:07:17,153 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46017 5986s 2024-11-23 22:07:17,153 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:07:17,154 - distributed.worker - INFO - dashboard at: 127.0.0.1:38927 5986s 2024-11-23 22:07:17,154 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38483 5986s 2024-11-23 22:07:17,154 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:07:17,154 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:07:17,154 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:07:17,154 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-8k7_c7b2 5986s 2024-11-23 22:07:17,154 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:07:17,155 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37653. Reason: failure-to-start- 5986s 2024-11-23 22:07:17,155 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:07:17,155 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46017. Reason: failure-to-start- 5986s 2024-11-23 22:07:17,155 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:07:17,156 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38483': TLS handshake failed with remote 'tls://127.0.0.1:54498': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:07:17,156 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38483': TLS handshake failed with remote 'tls://127.0.0.1:54506': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:07:17,157 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:07:18,163 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:07:18,169 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34071 5986s 2024-11-23 22:07:18,170 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35295/status 5986s 2024-11-23 22:07:18,170 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:07:18,183 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33677 5986s 2024-11-23 22:07:18,183 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33677 5986s 2024-11-23 22:07:18,183 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:07:18,183 - distributed.worker - INFO - dashboard at: 127.0.0.1:36257 5986s 2024-11-23 22:07:18,183 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34071 5986s 2024-11-23 22:07:18,183 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:07:18,183 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:07:18,183 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:07:18,183 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-0xm7sn0k 5986s 2024-11-23 22:07:18,183 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:07:18,185 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44363 5986s 2024-11-23 22:07:18,185 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44363 5986s 2024-11-23 22:07:18,185 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:07:18,185 - distributed.worker - INFO - dashboard at: 127.0.0.1:45113 5986s 2024-11-23 22:07:18,185 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34071 5986s 2024-11-23 22:07:18,185 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:07:18,185 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:07:18,185 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:07:18,185 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-qpnpoel3 5986s 2024-11-23 22:07:18,185 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:07:18,186 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33677. Reason: failure-to-start- 5986s 2024-11-23 22:07:18,186 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:07:18,186 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44363. Reason: failure-to-start- 5986s 2024-11-23 22:07:18,187 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:07:18,187 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34071': TLS handshake failed with remote 'tls://127.0.0.1:42712': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:07:18,188 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34071': TLS handshake failed with remote 'tls://127.0.0.1:42726': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:07:18,188 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:07:19,193 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:07:19,201 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42207 5986s 2024-11-23 22:07:19,201 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46547/status 5986s 2024-11-23 22:07:19,201 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:07:19,214 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40385 5986s 2024-11-23 22:07:19,214 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40385 5986s 2024-11-23 22:07:19,214 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:07:19,214 - distributed.worker - INFO - dashboard at: 127.0.0.1:45867 5986s 2024-11-23 22:07:19,214 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 5986s 2024-11-23 22:07:19,214 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:07:19,214 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:07:19,214 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:07:19,214 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-0ywmie6f 5986s 2024-11-23 22:07:19,214 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:07:19,217 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43173 5986s 2024-11-23 22:07:19,217 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43173 5986s 2024-11-23 22:07:19,217 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:07:19,217 - distributed.worker - INFO - dashboard at: 127.0.0.1:41015 5986s 2024-11-23 22:07:19,217 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42207 5986s 2024-11-23 22:07:19,217 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:07:19,217 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:07:19,217 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:07:19,217 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-unrg94f_ 5986s 2024-11-23 22:07:19,218 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:07:19,219 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40385. Reason: failure-to-start- 5986s 2024-11-23 22:07:19,219 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:07:19,219 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43173. Reason: failure-to-start- 5986s 2024-11-23 22:07:19,219 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:07:19,220 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:55970': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:07:19,220 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42207': TLS handshake failed with remote 'tls://127.0.0.1:55982': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:07:19,221 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:07:20,227 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:07:20,233 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37723 5986s 2024-11-23 22:07:20,233 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43097/status 5986s 2024-11-23 22:07:20,233 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:07:20,245 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46037 5986s 2024-11-23 22:07:20,245 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46037 5986s 2024-11-23 22:07:20,245 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:07:20,245 - distributed.worker - INFO - dashboard at: 127.0.0.1:34363 5986s 2024-11-23 22:07:20,245 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37723 5986s 2024-11-23 22:07:20,245 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:07:20,245 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:07:20,245 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:07:20,245 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-4anrlctx 5986s 2024-11-23 22:07:20,245 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:07:20,247 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37977 5986s 2024-11-23 22:07:20,247 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37977 5986s 2024-11-23 22:07:20,247 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:07:20,247 - distributed.worker - INFO - dashboard at: 127.0.0.1:41619 5986s 2024-11-23 22:07:20,247 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37723 5986s 2024-11-23 22:07:20,247 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:07:20,247 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:07:20,247 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:07:20,247 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-7o7hcka5 5986s 2024-11-23 22:07:20,247 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:07:20,248 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46037. Reason: failure-to-start- 5986s 2024-11-23 22:07:20,248 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:07:20,249 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37977. Reason: failure-to-start- 5986s 2024-11-23 22:07:20,249 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:07:20,250 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37723': TLS handshake failed with remote 'tls://127.0.0.1:44836': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:07:20,250 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37723': TLS handshake failed with remote 'tls://127.0.0.1:44852': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:07:20,251 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:07:21,257 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:07:21,265 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45847 5986s 2024-11-23 22:07:21,265 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36589/status 5986s 2024-11-23 22:07:21,265 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:07:21,279 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34133 5986s 2024-11-23 22:07:21,279 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34133 5986s 2024-11-23 22:07:21,279 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:07:21,280 - distributed.worker - INFO - dashboard at: 127.0.0.1:39997 5986s 2024-11-23 22:07:21,280 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45847 5986s 2024-11-23 22:07:21,280 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:07:21,280 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:07:21,280 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:07:21,280 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-2a6huwak 5986s 2024-11-23 22:07:21,280 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:07:21,283 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41493 5986s 2024-11-23 22:07:21,283 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41493 5986s 2024-11-23 22:07:21,283 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:07:21,283 - distributed.worker - INFO - dashboard at: 127.0.0.1:38297 5986s 2024-11-23 22:07:21,283 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45847 5986s 2024-11-23 22:07:21,283 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:07:21,283 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:07:21,283 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:07:21,283 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-m2zyjpcb 5986s 2024-11-23 22:07:21,283 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:07:21,284 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34133. Reason: failure-to-start- 5986s 2024-11-23 22:07:21,284 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:07:21,285 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41493. Reason: failure-to-start- 5986s 2024-11-23 22:07:21,285 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:07:21,286 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45847': TLS handshake failed with remote 'tls://127.0.0.1:49552': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:07:21,286 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45847': TLS handshake failed with remote 'tls://127.0.0.1:49562': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:07:21,287 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:07:22,292 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:07:22,299 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42899 5986s 2024-11-23 22:07:22,299 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38753/status 5986s 2024-11-23 22:07:22,299 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:07:22,313 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38435 5986s 2024-11-23 22:07:22,314 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38435 5986s 2024-11-23 22:07:22,314 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:07:22,314 - distributed.worker - INFO - dashboard at: 127.0.0.1:38531 5986s 2024-11-23 22:07:22,314 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42899 5986s 2024-11-23 22:07:22,314 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:07:22,314 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:07:22,314 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:07:22,314 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-j3hijzaf 5986s 2024-11-23 22:07:22,314 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:07:22,316 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46855 5986s 2024-11-23 22:07:22,316 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46855 5986s 2024-11-23 22:07:22,316 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:07:22,316 - distributed.worker - INFO - dashboard at: 127.0.0.1:46049 5986s 2024-11-23 22:07:22,316 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42899 5986s 2024-11-23 22:07:22,316 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:07:22,316 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:07:22,316 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:07:22,316 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-gxrec2ia 5986s 2024-11-23 22:07:22,316 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:07:22,317 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38435. Reason: failure-to-start- 5986s 2024-11-23 22:07:22,318 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:07:22,318 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46855. Reason: failure-to-start- 5986s 2024-11-23 22:07:22,318 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:07:22,319 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42899': TLS handshake failed with remote 'tls://127.0.0.1:41078': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:07:22,319 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42899': TLS handshake failed with remote 'tls://127.0.0.1:41084': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:07:22,320 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:07:23,325 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:07:23,333 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39351 5986s 2024-11-23 22:07:23,333 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35079/status 5986s 2024-11-23 22:07:23,334 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:07:23,347 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35297 5986s 2024-11-23 22:07:23,347 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35297 5986s 2024-11-23 22:07:23,347 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:07:23,347 - distributed.worker - INFO - dashboard at: 127.0.0.1:36449 5986s 2024-11-23 22:07:23,347 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39351 5986s 2024-11-23 22:07:23,347 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:07:23,347 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:07:23,347 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:07:23,347 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-iak41e2a 5986s 2024-11-23 22:07:23,347 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:07:23,350 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36173 5986s 2024-11-23 22:07:23,350 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36173 5986s 2024-11-23 22:07:23,350 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:07:23,350 - distributed.worker - INFO - dashboard at: 127.0.0.1:35151 5986s 2024-11-23 22:07:23,350 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39351 5986s 2024-11-23 22:07:23,350 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:07:23,350 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:07:23,350 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:07:23,350 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ps9kmfeg 5986s 2024-11-23 22:07:23,350 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:07:23,351 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35297. Reason: failure-to-start- 5986s 2024-11-23 22:07:23,351 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:07:23,352 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36173. Reason: failure-to-start- 5986s 2024-11-23 22:07:23,352 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:07:23,353 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39351': TLS handshake failed with remote 'tls://127.0.0.1:43702': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:07:23,353 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39351': TLS handshake failed with remote 'tls://127.0.0.1:43704': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:07:23,354 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:07:24,359 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:07:24,366 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:32967 5986s 2024-11-23 22:07:24,366 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41725/status 5986s 2024-11-23 22:07:24,367 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:07:24,379 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46511 5986s 2024-11-23 22:07:24,380 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46511 5986s 2024-11-23 22:07:24,380 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:07:24,380 - distributed.worker - INFO - dashboard at: 127.0.0.1:34225 5986s 2024-11-23 22:07:24,380 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:32967 5986s 2024-11-23 22:07:24,380 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:07:24,380 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:07:24,380 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:07:24,380 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-obcod_v_ 5986s 2024-11-23 22:07:24,380 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:07:24,382 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43399 5986s 2024-11-23 22:07:24,382 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43399 5986s 2024-11-23 22:07:24,382 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:07:24,382 - distributed.worker - INFO - dashboard at: 127.0.0.1:46665 5986s 2024-11-23 22:07:24,382 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:32967 5986s 2024-11-23 22:07:24,382 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:07:24,382 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:07:24,382 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:07:24,383 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-pzxuwwv1 5986s 2024-11-23 22:07:24,383 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:07:24,384 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46511. Reason: failure-to-start- 5986s 2024-11-23 22:07:24,384 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:07:24,384 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43399. Reason: failure-to-start- 5986s 2024-11-23 22:07:24,384 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:07:24,385 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:32967': TLS handshake failed with remote 'tls://127.0.0.1:37616': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:07:24,385 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:32967': TLS handshake failed with remote 'tls://127.0.0.1:37632': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:07:24,386 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:07:25,393 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:07:25,401 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46837 5986s 2024-11-23 22:07:25,401 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38621/status 5986s 2024-11-23 22:07:25,401 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:07:25,414 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41877 5986s 2024-11-23 22:07:25,414 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41877 5986s 2024-11-23 22:07:25,415 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:07:25,415 - distributed.worker - INFO - dashboard at: 127.0.0.1:44209 5986s 2024-11-23 22:07:25,415 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46837 5986s 2024-11-23 22:07:25,415 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:07:25,415 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:07:25,415 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:07:25,415 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-7iww293i 5986s 2024-11-23 22:07:25,415 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:07:25,417 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36909 5986s 2024-11-23 22:07:25,417 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36909 5986s 2024-11-23 22:07:25,417 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:07:25,417 - distributed.worker - INFO - dashboard at: 127.0.0.1:46655 5986s 2024-11-23 22:07:25,417 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46837 5986s 2024-11-23 22:07:25,417 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:07:25,417 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:07:25,417 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:07:25,417 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-_g5rq44u 5986s 2024-11-23 22:07:25,417 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:07:25,418 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41877. Reason: failure-to-start- 5986s 2024-11-23 22:07:25,418 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:07:25,419 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36909. Reason: failure-to-start- 5986s 2024-11-23 22:07:25,419 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:07:25,422 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46837': TLS handshake failed with remote 'tls://127.0.0.1:52426': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:07:25,422 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46837': TLS handshake failed with remote 'tls://127.0.0.1:52428': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:07:25,423 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:07:26,428 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:07:26,434 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42171 5986s 2024-11-23 22:07:26,434 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42217/status 5986s 2024-11-23 22:07:26,434 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:07:26,446 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46521 5986s 2024-11-23 22:07:26,447 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46521 5986s 2024-11-23 22:07:26,447 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:07:26,447 - distributed.worker - INFO - dashboard at: 127.0.0.1:38427 5986s 2024-11-23 22:07:26,447 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42171 5986s 2024-11-23 22:07:26,447 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:07:26,447 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:07:26,447 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:07:26,447 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-f7ah2mgr 5986s 2024-11-23 22:07:26,447 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:07:26,449 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41669 5986s 2024-11-23 22:07:26,449 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41669 5986s 2024-11-23 22:07:26,449 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:07:26,449 - distributed.worker - INFO - dashboard at: 127.0.0.1:38001 5986s 2024-11-23 22:07:26,449 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42171 5986s 2024-11-23 22:07:26,449 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:07:26,449 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:07:26,449 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:07:26,449 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-db9bf8e8 5986s 2024-11-23 22:07:26,449 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:07:26,452 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46521. Reason: failure-to-start- 5986s 2024-11-23 22:07:26,452 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:07:26,452 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41669. Reason: failure-to-start- 5986s 2024-11-23 22:07:26,452 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:07:26,453 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42171': TLS handshake failed with remote 'tls://127.0.0.1:46674': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:07:26,453 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42171': TLS handshake failed with remote 'tls://127.0.0.1:46684': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:07:26,454 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:07:27,460 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:07:27,466 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39673 5986s 2024-11-23 22:07:27,466 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34177/status 5986s 2024-11-23 22:07:27,466 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:07:27,486 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42647 5986s 2024-11-23 22:07:27,486 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42647 5986s 2024-11-23 22:07:27,486 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:07:27,486 - distributed.worker - INFO - dashboard at: 127.0.0.1:46379 5986s 2024-11-23 22:07:27,486 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39673 5986s 2024-11-23 22:07:27,486 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:07:27,486 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:07:27,486 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:07:27,486 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-w71_if72 5986s 2024-11-23 22:07:27,486 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:07:27,488 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40011 5986s 2024-11-23 22:07:27,488 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40011 5986s 2024-11-23 22:07:27,488 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:07:27,488 - distributed.worker - INFO - dashboard at: 127.0.0.1:45887 5986s 2024-11-23 22:07:27,488 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39673 5986s 2024-11-23 22:07:27,488 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:07:27,489 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:07:27,489 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:07:27,489 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-gmn0byv1 5986s 2024-11-23 22:07:27,489 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:07:27,492 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42647. Reason: failure-to-start- 5986s 2024-11-23 22:07:27,492 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:07:27,492 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40011. Reason: failure-to-start- 5986s 2024-11-23 22:07:27,492 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:07:27,493 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39673': TLS handshake failed with remote 'tls://127.0.0.1:33518': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:07:27,493 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39673': TLS handshake failed with remote 'tls://127.0.0.1:33530': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:07:27,494 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:07:28,501 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:07:28,507 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44873 5986s 2024-11-23 22:07:28,507 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41707/status 5986s 2024-11-23 22:07:28,507 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:07:28,522 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41483 5986s 2024-11-23 22:07:28,522 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41483 5986s 2024-11-23 22:07:28,522 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:07:28,522 - distributed.worker - INFO - dashboard at: 127.0.0.1:38937 5986s 2024-11-23 22:07:28,522 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44873 5986s 2024-11-23 22:07:28,522 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:07:28,522 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:07:28,522 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:07:28,522 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-gd3aau81 5986s 2024-11-23 22:07:28,522 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:07:28,524 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42591 5986s 2024-11-23 22:07:28,524 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42591 5986s 2024-11-23 22:07:28,524 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:07:28,524 - distributed.worker - INFO - dashboard at: 127.0.0.1:44999 5986s 2024-11-23 22:07:28,524 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44873 5986s 2024-11-23 22:07:28,524 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:07:28,524 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:07:28,524 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:07:28,524 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-7rtwsu7l 5986s 2024-11-23 22:07:28,524 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:07:28,525 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41483. Reason: failure-to-start- 5986s 2024-11-23 22:07:28,525 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:07:28,526 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42591. Reason: failure-to-start- 5986s 2024-11-23 22:07:28,526 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:07:28,527 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44873': TLS handshake failed with remote 'tls://127.0.0.1:58458': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:07:28,527 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44873': TLS handshake failed with remote 'tls://127.0.0.1:58472': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:07:28,528 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:07:29,534 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:07:29,540 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38715 5986s 2024-11-23 22:07:29,540 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46821/status 5986s 2024-11-23 22:07:29,540 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:07:29,555 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42707 5986s 2024-11-23 22:07:29,555 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42707 5986s 2024-11-23 22:07:29,555 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:07:29,555 - distributed.worker - INFO - dashboard at: 127.0.0.1:40171 5986s 2024-11-23 22:07:29,555 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38715 5986s 2024-11-23 22:07:29,555 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:07:29,555 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:07:29,555 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:07:29,555 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-74x0y7rt 5986s 2024-11-23 22:07:29,555 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:07:29,557 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39239 5986s 2024-11-23 22:07:29,557 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39239 5986s 2024-11-23 22:07:29,557 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:07:29,557 - distributed.worker - INFO - dashboard at: 127.0.0.1:41737 5986s 2024-11-23 22:07:29,557 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38715 5986s 2024-11-23 22:07:29,557 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:07:29,557 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:07:29,557 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:07:29,557 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-hygo83fe 5986s 2024-11-23 22:07:29,557 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:07:29,558 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42707. Reason: failure-to-start- 5986s 2024-11-23 22:07:29,558 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:07:29,559 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39239. Reason: failure-to-start- 5986s 2024-11-23 22:07:29,559 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:07:29,560 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38715': TLS handshake failed with remote 'tls://127.0.0.1:33832': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:07:29,560 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38715': TLS handshake failed with remote 'tls://127.0.0.1:33844': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:07:29,561 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:07:30,567 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:07:30,573 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33067 5986s 2024-11-23 22:07:30,573 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43475/status 5986s 2024-11-23 22:07:30,573 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:07:30,589 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41431 5986s 2024-11-23 22:07:30,589 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41431 5986s 2024-11-23 22:07:30,589 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:07:30,589 - distributed.worker - INFO - dashboard at: 127.0.0.1:45683 5986s 2024-11-23 22:07:30,590 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33067 5986s 2024-11-23 22:07:30,590 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:07:30,590 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:07:30,590 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:07:30,590 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-06aow5zo 5986s 2024-11-23 22:07:30,590 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:07:30,591 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43891 5986s 2024-11-23 22:07:30,592 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43891 5986s 2024-11-23 22:07:30,592 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:07:30,592 - distributed.worker - INFO - dashboard at: 127.0.0.1:33745 5986s 2024-11-23 22:07:30,592 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33067 5986s 2024-11-23 22:07:30,592 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:07:30,592 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:07:30,592 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:07:30,592 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-0scx2h53 5986s 2024-11-23 22:07:30,592 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:07:30,593 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41431. Reason: failure-to-start- 5986s 2024-11-23 22:07:30,593 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:07:30,593 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43891. Reason: failure-to-start- 5986s 2024-11-23 22:07:30,593 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:07:30,594 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33067': TLS handshake failed with remote 'tls://127.0.0.1:38984': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:07:30,594 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33067': TLS handshake failed with remote 'tls://127.0.0.1:38992': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:07:30,595 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:07:31,601 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:07:31,607 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35277 5986s 2024-11-23 22:07:31,607 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35717/status 5986s 2024-11-23 22:07:31,607 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:07:31,622 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36455 5986s 2024-11-23 22:07:31,622 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36455 5986s 2024-11-23 22:07:31,622 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:07:31,622 - distributed.worker - INFO - dashboard at: 127.0.0.1:42915 5986s 2024-11-23 22:07:31,622 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35277 5986s 2024-11-23 22:07:31,622 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:07:31,622 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:07:31,622 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:07:31,622 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-f785m0z0 5986s 2024-11-23 22:07:31,622 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:07:31,625 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33365 5986s 2024-11-23 22:07:31,625 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33365 5986s 2024-11-23 22:07:31,625 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:07:31,626 - distributed.worker - INFO - dashboard at: 127.0.0.1:35897 5986s 2024-11-23 22:07:31,626 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35277 5986s 2024-11-23 22:07:31,626 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:07:31,626 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:07:31,626 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:07:31,626 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-qya7rjxm 5986s 2024-11-23 22:07:31,626 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:07:31,627 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36455. Reason: failure-to-start- 5986s 2024-11-23 22:07:31,627 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:07:31,627 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33365. Reason: failure-to-start- 5986s 2024-11-23 22:07:31,627 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:07:31,628 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35277': TLS handshake failed with remote 'tls://127.0.0.1:42256': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:07:31,628 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35277': TLS handshake failed with remote 'tls://127.0.0.1:42266': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:07:31,629 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:07:32,635 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:07:32,641 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46669 5986s 2024-11-23 22:07:32,641 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39071/status 5986s 2024-11-23 22:07:32,641 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:07:32,655 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33313 5986s 2024-11-23 22:07:32,655 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33313 5986s 2024-11-23 22:07:32,655 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:07:32,656 - distributed.worker - INFO - dashboard at: 127.0.0.1:45075 5986s 2024-11-23 22:07:32,656 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46669 5986s 2024-11-23 22:07:32,656 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:07:32,656 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:07:32,656 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:07:32,656 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-oy09wkwf 5986s 2024-11-23 22:07:32,656 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:07:32,658 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39627 5986s 2024-11-23 22:07:32,658 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39627 5986s 2024-11-23 22:07:32,658 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:07:32,658 - distributed.worker - INFO - dashboard at: 127.0.0.1:44507 5986s 2024-11-23 22:07:32,658 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46669 5986s 2024-11-23 22:07:32,658 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:07:32,658 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:07:32,658 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:07:32,658 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-2ywoapj4 5986s 2024-11-23 22:07:32,658 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:07:32,659 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33313. Reason: failure-to-start- 5986s 2024-11-23 22:07:32,659 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:07:32,660 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39627. Reason: failure-to-start- 5986s 2024-11-23 22:07:32,660 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:07:32,661 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46669': TLS handshake failed with remote 'tls://127.0.0.1:50160': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:07:32,661 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46669': TLS handshake failed with remote 'tls://127.0.0.1:50170': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:07:32,662 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:07:33,669 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:07:33,675 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37581 5986s 2024-11-23 22:07:33,675 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44567/status 5986s 2024-11-23 22:07:33,676 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:07:33,690 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37043 5986s 2024-11-23 22:07:33,690 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37043 5986s 2024-11-23 22:07:33,690 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:07:33,690 - distributed.worker - INFO - dashboard at: 127.0.0.1:38949 5986s 2024-11-23 22:07:33,690 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37581 5986s 2024-11-23 22:07:33,690 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:07:33,690 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:07:33,690 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:07:33,690 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-26upzdsk 5986s 2024-11-23 22:07:33,690 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:07:33,692 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34617 5986s 2024-11-23 22:07:33,692 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34617 5986s 2024-11-23 22:07:33,692 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:07:33,692 - distributed.worker - INFO - dashboard at: 127.0.0.1:38895 5986s 2024-11-23 22:07:33,692 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37581 5986s 2024-11-23 22:07:33,692 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:07:33,692 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:07:33,692 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:07:33,692 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-y6drtj6u 5986s 2024-11-23 22:07:33,692 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:07:33,693 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37043. Reason: failure-to-start- 5986s 2024-11-23 22:07:33,693 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:07:33,694 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34617. Reason: failure-to-start- 5986s 2024-11-23 22:07:33,694 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:07:33,694 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37581': TLS handshake failed with remote 'tls://127.0.0.1:48076': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:07:33,695 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37581': TLS handshake failed with remote 'tls://127.0.0.1:48092': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:07:33,696 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:07:34,701 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:07:34,707 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33197 5986s 2024-11-23 22:07:34,707 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39103/status 5986s 2024-11-23 22:07:34,707 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:07:34,724 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44971 5986s 2024-11-23 22:07:34,724 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44971 5986s 2024-11-23 22:07:34,724 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:07:34,724 - distributed.worker - INFO - dashboard at: 127.0.0.1:37867 5986s 2024-11-23 22:07:34,724 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33197 5986s 2024-11-23 22:07:34,724 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:07:34,724 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:07:34,724 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:07:34,724 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-d78gd8iq 5986s 2024-11-23 22:07:34,724 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:07:34,726 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46531 5986s 2024-11-23 22:07:34,726 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46531 5986s 2024-11-23 22:07:34,726 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:07:34,726 - distributed.worker - INFO - dashboard at: 127.0.0.1:39905 5986s 2024-11-23 22:07:34,726 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33197 5986s 2024-11-23 22:07:34,726 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:07:34,726 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:07:34,726 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:07:34,726 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-6sxhuzjb 5986s 2024-11-23 22:07:34,727 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:07:34,727 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44971. Reason: failure-to-start- 5986s 2024-11-23 22:07:34,728 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:07:34,728 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46531. Reason: failure-to-start- 5986s 2024-11-23 22:07:34,728 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:07:34,729 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33197': TLS handshake failed with remote 'tls://127.0.0.1:51912': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:07:34,729 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33197': TLS handshake failed with remote 'tls://127.0.0.1:51916': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:07:34,730 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:07:35,735 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:07:35,741 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34097 5986s 2024-11-23 22:07:35,742 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37565/status 5986s 2024-11-23 22:07:35,742 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:07:35,758 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46537 5986s 2024-11-23 22:07:35,759 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46537 5986s 2024-11-23 22:07:35,759 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:07:35,759 - distributed.worker - INFO - dashboard at: 127.0.0.1:36917 5986s 2024-11-23 22:07:35,759 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34097 5986s 2024-11-23 22:07:35,759 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:07:35,759 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:07:35,759 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:07:35,759 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-1nf58nbz 5986s 2024-11-23 22:07:35,759 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:07:35,761 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38349 5986s 2024-11-23 22:07:35,761 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38349 5986s 2024-11-23 22:07:35,761 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:07:35,761 - distributed.worker - INFO - dashboard at: 127.0.0.1:38569 5986s 2024-11-23 22:07:35,761 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34097 5986s 2024-11-23 22:07:35,761 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:07:35,761 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:07:35,761 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:07:35,761 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-fh6vm_72 5986s 2024-11-23 22:07:35,761 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:07:35,762 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46537. Reason: failure-to-start- 5986s 2024-11-23 22:07:35,763 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:07:35,763 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38349. Reason: failure-to-start- 5986s 2024-11-23 22:07:35,763 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:07:35,764 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34097': TLS handshake failed with remote 'tls://127.0.0.1:34762': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:07:35,764 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34097': TLS handshake failed with remote 'tls://127.0.0.1:34776': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:07:35,765 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:07:36,771 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:07:36,776 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37309 5986s 2024-11-23 22:07:36,776 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45897/status 5986s 2024-11-23 22:07:36,777 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:07:36,789 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38759 5986s 2024-11-23 22:07:36,789 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38759 5986s 2024-11-23 22:07:36,789 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:07:36,789 - distributed.worker - INFO - dashboard at: 127.0.0.1:35743 5986s 2024-11-23 22:07:36,789 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37309 5986s 2024-11-23 22:07:36,789 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:07:36,789 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:07:36,789 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:07:36,789 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-dfzi7gs_ 5986s 2024-11-23 22:07:36,789 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:07:36,791 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37025 5986s 2024-11-23 22:07:36,791 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37025 5986s 2024-11-23 22:07:36,791 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:07:36,791 - distributed.worker - INFO - dashboard at: 127.0.0.1:41095 5986s 2024-11-23 22:07:36,791 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37309 5986s 2024-11-23 22:07:36,791 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:07:36,791 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:07:36,791 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:07:36,791 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-jownafsy 5986s 2024-11-23 22:07:36,792 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:07:36,792 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38759. Reason: failure-to-start- 5986s 2024-11-23 22:07:36,793 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:07:36,793 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37025. Reason: failure-to-start- 5986s 2024-11-23 22:07:36,793 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:07:36,794 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37309': TLS handshake failed with remote 'tls://127.0.0.1:56940': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:07:36,794 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37309': TLS handshake failed with remote 'tls://127.0.0.1:56946': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:07:36,795 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:07:37,801 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:07:37,806 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38881 5986s 2024-11-23 22:07:37,807 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34091/status 5986s 2024-11-23 22:07:37,807 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:07:37,820 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34439 5986s 2024-11-23 22:07:37,820 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34439 5986s 2024-11-23 22:07:37,821 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:07:37,821 - distributed.worker - INFO - dashboard at: 127.0.0.1:35181 5986s 2024-11-23 22:07:37,821 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38881 5986s 2024-11-23 22:07:37,821 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:07:37,821 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:07:37,821 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:07:37,821 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-1vogeiz5 5986s 2024-11-23 22:07:37,821 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:07:37,822 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44559 5986s 2024-11-23 22:07:37,823 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44559 5986s 2024-11-23 22:07:37,823 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:07:37,823 - distributed.worker - INFO - dashboard at: 127.0.0.1:43741 5986s 2024-11-23 22:07:37,823 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38881 5986s 2024-11-23 22:07:37,823 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:07:37,823 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:07:37,823 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:07:37,823 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-9bf8lnsc 5986s 2024-11-23 22:07:37,823 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:07:37,824 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34439. Reason: failure-to-start- 5986s 2024-11-23 22:07:37,824 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:07:37,824 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44559. Reason: failure-to-start- 5986s 2024-11-23 22:07:37,825 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:07:37,826 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38881': TLS handshake failed with remote 'tls://127.0.0.1:56186': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:07:37,826 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38881': TLS handshake failed with remote 'tls://127.0.0.1:56196': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:07:37,827 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:07:38,831 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:07:38,838 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35873 5986s 2024-11-23 22:07:38,838 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38175/status 5986s 2024-11-23 22:07:38,839 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:07:38,852 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33215 5986s 2024-11-23 22:07:38,852 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33215 5986s 2024-11-23 22:07:38,852 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:07:38,852 - distributed.worker - INFO - dashboard at: 127.0.0.1:38253 5986s 2024-11-23 22:07:38,852 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35873 5986s 2024-11-23 22:07:38,852 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:07:38,852 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:07:38,852 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:07:38,852 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-lsyu9dvq 5986s 2024-11-23 22:07:38,852 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:07:38,854 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43569 5986s 2024-11-23 22:07:38,854 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43569 5986s 2024-11-23 22:07:38,854 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:07:38,854 - distributed.worker - INFO - dashboard at: 127.0.0.1:38589 5986s 2024-11-23 22:07:38,854 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35873 5986s 2024-11-23 22:07:38,854 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:07:38,854 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:07:38,854 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:07:38,854 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-8dym8cal 5986s 2024-11-23 22:07:38,854 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:07:38,855 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33215. Reason: failure-to-start- 5986s 2024-11-23 22:07:38,856 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:07:38,856 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43569. Reason: failure-to-start- 5986s 2024-11-23 22:07:38,856 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:07:38,857 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35873': TLS handshake failed with remote 'tls://127.0.0.1:46946': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:07:38,857 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35873': TLS handshake failed with remote 'tls://127.0.0.1:46952': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:07:38,858 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:07:39,863 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:07:39,868 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35647 5986s 2024-11-23 22:07:39,869 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45569/status 5986s 2024-11-23 22:07:39,869 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:07:39,884 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37201 5986s 2024-11-23 22:07:39,884 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37201 5986s 2024-11-23 22:07:39,884 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:07:39,884 - distributed.worker - INFO - dashboard at: 127.0.0.1:33955 5986s 2024-11-23 22:07:39,884 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35647 5986s 2024-11-23 22:07:39,884 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:07:39,885 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:07:39,885 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:07:39,885 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-t8z3xb8e 5986s 2024-11-23 22:07:39,885 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:07:39,886 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37291 5986s 2024-11-23 22:07:39,886 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37291 5986s 2024-11-23 22:07:39,887 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:07:39,887 - distributed.worker - INFO - dashboard at: 127.0.0.1:43375 5986s 2024-11-23 22:07:39,887 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35647 5986s 2024-11-23 22:07:39,887 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:07:39,887 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:07:39,887 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:07:39,887 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-e5ebdiui 5986s 2024-11-23 22:07:39,887 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:07:39,888 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37201. Reason: failure-to-start- 5986s 2024-11-23 22:07:39,888 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:07:39,888 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37291. Reason: failure-to-start- 5986s 2024-11-23 22:07:39,889 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:07:39,889 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35647': TLS handshake failed with remote 'tls://127.0.0.1:57782': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:07:39,889 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35647': TLS handshake failed with remote 'tls://127.0.0.1:57794': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:07:39,891 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:07:40,895 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:07:40,901 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46425 5986s 2024-11-23 22:07:40,901 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35591/status 5986s 2024-11-23 22:07:40,902 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:07:40,916 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45065 5986s 2024-11-23 22:07:40,916 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45065 5986s 2024-11-23 22:07:40,916 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:07:40,916 - distributed.worker - INFO - dashboard at: 127.0.0.1:44999 5986s 2024-11-23 22:07:40,916 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46425 5986s 2024-11-23 22:07:40,916 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:07:40,916 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:07:40,916 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:07:40,917 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-37mf39wm 5986s 2024-11-23 22:07:40,917 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:07:40,919 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:32957 5986s 2024-11-23 22:07:40,920 - distributed.worker - INFO - Listening to: tls://127.0.0.1:32957 5986s 2024-11-23 22:07:40,920 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:07:40,920 - distributed.worker - INFO - dashboard at: 127.0.0.1:38149 5986s 2024-11-23 22:07:40,920 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46425 5986s 2024-11-23 22:07:40,920 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:07:40,920 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:07:40,920 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:07:40,920 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-dcswtj4c 5986s 2024-11-23 22:07:40,920 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:07:40,921 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45065. Reason: failure-to-start- 5986s 2024-11-23 22:07:40,921 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:07:40,922 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:32957. Reason: failure-to-start- 5986s 2024-11-23 22:07:40,922 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:07:40,925 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46425': TLS handshake failed with remote 'tls://127.0.0.1:47200': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:07:40,925 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46425': TLS handshake failed with remote 'tls://127.0.0.1:47206': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:07:40,926 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s _________________________ test_worker_client_executor __________________________ 5986s 5986s fut = ._..test_func..async_fn at 0xdde2b2e0> 5986s timeout = 60 5986s 5986s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 5986s async with asyncio.timeout(timeout): 5986s > return await fut 5986s 5986s /usr/lib/python3/dist-packages/distributed/utils.py:1960: 5986s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5986s /usr/lib/python3/dist-packages/distributed/utils_test.py:999: in async_fn 5986s _cluster_factory() as (s, workers), 5986s /usr/lib/python3.13/contextlib.py:214: in __aenter__ 5986s return await anext(self.gen) 5986s /usr/lib/python3/dist-packages/distributed/utils_test.py:966: in _cluster_factory 5986s s, ws = await start_cluster( 5986s /usr/lib/python3/dist-packages/distributed/utils_test.py:766: in start_cluster 5986s s = await Scheduler( 5986s /usr/lib/python3/dist-packages/distributed/core.py:664: in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s /usr/lib/python3/dist-packages/distributed/utils.py:1960: in wait_for 5986s return await fut 5986s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5986s 5986s self = 5986s 5986s async def start_unsafe(self) -> Self: 5986s """Clear out old state and restart all running coroutines""" 5986s await super().start_unsafe() 5986s 5986s enable_gc_diagnosis() 5986s 5986s self._clear_task_state() 5986s 5986s for addr in self._start_address: 5986s await self.listen( 5986s addr, 5986s allow_offload=False, 5986s handshake_overrides={"pickle-protocol": 4, "compression": None}, 5986s **self.security.get_listen_args("scheduler"), 5986s ) 5986s self.ip = get_address_host(self.listen_address) 5986s listen_ip = self.ip 5986s 5986s if listen_ip == "0.0.0.0": 5986s listen_ip = "" 5986s 5986s if self.address.startswith("inproc://"): 5986s listen_ip = "localhost" 5986s 5986s # Services listen on all addresses 5986s self.start_services(listen_ip) 5986s 5986s for listener in self.listeners: 5986s logger.info(" Scheduler at: %25s", listener.contact_address) 5986s for name, server in self.services.items(): 5986s if name == "dashboard": 5986s addr = get_address_host(listener.contact_address) 5986s try: 5986s link = format_dashboard_link(addr, server.port) 5986s # formatting dashboard link can fail if distributed.dashboard.link 5986s # refers to non-existant env vars. 5986s except KeyError as e: 5986s logger.warning( 5986s f"Failed to format dashboard link, unknown value: {e}" 5986s ) 5986s link = f":{server.port}" 5986s else: 5986s link = f"{listen_ip}:{server.port}" 5986s logger.info("%11s at: %25s", name, link) 5986s 5986s if self.scheduler_file: 5986s with open(self.scheduler_file, "w") as f: 5986s json.dump(self.identity(), f, indent=2) 5986s 5986s fn = self.scheduler_file # remove file when we close the process 5986s 5986s def del_scheduler_file() -> None: 5986s if os.path.exists(fn): 5986s os.remove(fn) 5986s 5986s weakref.finalize(self, del_scheduler_file) 5986s 5986s await self.preloads.start() 5986s 5986s if self.jupyter: 5986s # Allow insecure communications from local users 5986s if self.address.startswith("tls://"): 5986s await self.listen("tcp://localhost:0") 5986s os.environ["DASK_SCHEDULER_ADDRESS"] = self.listeners[-1].contact_address 5986s 5986s > await asyncio.gather( 5986s *[plugin.start(self) for plugin in list(self.plugins.values())] 5986s ) 5986s E asyncio.exceptions.CancelledError 5986s 5986s /usr/lib/python3/dist-packages/distributed/scheduler.py:4109: CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s args = (), kwds = {} 5986s 5986s @wraps(func) 5986s def inner(*args, **kwds): 5986s with self._recreate_cm(): 5986s > return func(*args, **kwds) 5986s 5986s /usr/lib/python3.13/contextlib.py:85: 5986s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5986s /usr/lib/python3.13/contextlib.py:85: in inner 5986s return func(*args, **kwds) 5986s /usr/lib/python3/dist-packages/distributed/utils_test.py:1102: in test_func 5986s return _run_and_close_tornado(async_fn_outer) 5986s /usr/lib/python3/dist-packages/distributed/utils_test.py:378: in _run_and_close_tornado 5986s return asyncio_run(inner_fn(), loop_factory=get_loop_factory()) 5986s /usr/lib/python3.13/asyncio/runners.py:194: in run 5986s return runner.run(main) 5986s /usr/lib/python3.13/asyncio/runners.py:118: in run 5986s return self._loop.run_until_complete(task) 5986s /usr/lib/python3.13/asyncio/base_events.py:720: in run_until_complete 5986s return future.result() 5986s /usr/lib/python3/dist-packages/distributed/utils_test.py:375: in inner_fn 5986s return await async_fn(*args, **kwargs) 5986s /usr/lib/python3/dist-packages/distributed/utils_test.py:1099: in async_fn_outer 5986s return await utils_wait_for(async_fn(), timeout=timeout * 2) 5986s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 5986s async with asyncio.timeout(timeout): 5986s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5986s 5986s self = 5986s exc_type = 5986s exc_val = CancelledError(), exc_tb = 5986s 5986s async def __aexit__( 5986s self, 5986s exc_type: Optional[Type[BaseException]], 5986s exc_val: Optional[BaseException], 5986s exc_tb: Optional[TracebackType], 5986s ) -> Optional[bool]: 5986s assert self._state in (_State.ENTERED, _State.EXPIRING) 5986s 5986s if self._timeout_handler is not None: 5986s self._timeout_handler.cancel() 5986s self._timeout_handler = None 5986s 5986s if self._state is _State.EXPIRING: 5986s self._state = _State.EXPIRED 5986s 5986s if self._task.uncancel() <= self._cancelling and exc_type is not None: 5986s # Since there are no new cancel requests, we're 5986s # handling this. 5986s if issubclass(exc_type, exceptions.CancelledError): 5986s > raise TimeoutError from exc_val 5986s E TimeoutError 5986s 5986s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 5986s ----------------------------- Captured stderr call ----------------------------- 5986s 2024-11-23 22:07:42,374 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:07:42,380 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:42,381 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42357/status 5986s 2024-11-23 22:07:42,381 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:07:42,392 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33973 5986s 2024-11-23 22:07:42,393 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33973 5986s 2024-11-23 22:07:42,393 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:07:42,393 - distributed.worker - INFO - dashboard at: 127.0.0.1:41249 5986s 2024-11-23 22:07:42,393 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:42,393 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:07:42,393 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:07:42,393 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:07:42,393 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ixjd8664 5986s 2024-11-23 22:07:42,393 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:07:42,395 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41265 5986s 2024-11-23 22:07:42,395 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41265 5986s 2024-11-23 22:07:42,395 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:07:42,395 - distributed.worker - INFO - dashboard at: 127.0.0.1:42759 5986s 2024-11-23 22:07:42,395 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:42,395 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:07:42,395 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:07:42,395 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:07:42,395 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-gxctp4xh 5986s 2024-11-23 22:07:42,395 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:07:42,407 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:42,407 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:42,408 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:39554': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:42,408 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:39560': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:42,521 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:42,521 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:42,521 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:39564': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:42,522 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:39580': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:42,634 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:42,634 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:42,635 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:39590': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:42,635 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:39602': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:42,746 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:42,746 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:42,746 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:39610': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:42,747 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:39626': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:42,858 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:42,859 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:42,859 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:39628': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:42,859 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:39640': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:42,970 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:42,971 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:42,971 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:39644': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:42,971 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:39646': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:43,083 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:43,083 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:43,084 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:39662': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:43,084 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:39672': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:43,196 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:43,196 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:43,196 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:39686': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:43,196 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:39694': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:43,308 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:43,308 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:43,309 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:39704': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:43,309 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:39714': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:43,420 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:43,420 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:43,420 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:39726': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:43,420 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:39738': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:43,532 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:43,533 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:43,533 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:39746': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:43,533 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:39756': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:43,644 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:43,644 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:43,645 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:39762': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:43,645 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:39774': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:43,757 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:43,757 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:43,757 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:39784': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:43,757 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:39798': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:43,869 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:43,869 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:43,869 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:39800': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:43,870 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:39810': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:43,981 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:43,981 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:43,982 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:39820': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:43,982 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:39824': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:44,094 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:44,094 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:44,094 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:39836': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:44,095 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:39840': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:44,207 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:44,207 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:44,207 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:39850': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:44,207 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:39866': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:44,320 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:44,320 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:44,321 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:39880': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:44,322 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:39884': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:44,433 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:44,433 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:44,433 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:39886': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:44,433 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:39902': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:44,546 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:44,546 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:44,547 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:39908': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:44,547 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:39924': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:44,658 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:44,658 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:44,658 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:39926': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:44,658 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:39942': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:44,770 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:44,771 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:44,771 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:39956': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:44,771 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:39970': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:44,883 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:44,883 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:44,883 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:39978': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:44,883 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:39982': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:44,995 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:44,995 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:44,995 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:39984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:44,995 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:39998': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:45,107 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:45,107 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:45,108 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:40012': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:45,108 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:40028': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:45,221 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:45,221 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:45,221 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:40034': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:45,221 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:40040': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:45,333 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:45,333 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:45,334 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:40052': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:45,334 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:40054': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:45,445 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:45,445 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:45,446 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:40056': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:45,446 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:40060': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:45,558 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:45,558 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:45,559 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:40062': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:45,559 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:40076': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:45,671 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:45,671 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:45,671 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:40090': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:45,671 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:40102': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:45,783 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:45,783 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:45,784 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:40118': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:45,784 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:40128': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:45,896 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:45,896 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:45,896 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:40138': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:45,896 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:40154': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:46,008 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:46,009 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:46,009 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:40164': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:46,009 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:40174': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:46,122 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:46,123 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:46,123 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:40184': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:46,123 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:40192': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:46,235 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:46,235 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:46,235 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:40204': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:46,235 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:40212': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:46,348 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:46,348 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:46,348 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:40214': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:46,348 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:40228': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:46,460 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:46,461 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:46,461 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:40236': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:46,461 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:40250': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:46,573 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:46,573 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:46,573 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:40258': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:46,573 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:40270': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:46,685 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:46,685 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:46,686 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:40286': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:46,686 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:40292': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:46,798 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:46,798 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:46,798 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:40298': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:46,799 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:40304': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:46,910 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:46,910 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:46,910 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:40312': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:46,910 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:40322': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:47,022 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:47,022 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:47,023 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:40336': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:47,023 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:40352': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:47,135 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:47,135 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:47,135 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:40358': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:47,136 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:40364': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:47,247 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:47,248 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:47,248 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:40378': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:47,248 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:40382': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:47,360 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:47,360 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:47,360 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:40392': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:47,360 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:40400': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:47,472 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:47,472 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:47,472 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:40406': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:47,472 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:40414': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:47,585 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:47,585 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:47,585 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:40430': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:47,585 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:40446': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:47,697 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:47,697 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:47,697 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:40460': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:47,697 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:40462': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:47,810 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:47,811 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:47,811 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:40476': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:47,811 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:40488': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:47,924 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:47,925 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:47,925 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:40504': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:47,925 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:40506': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:48,037 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:48,037 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:48,038 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:40518': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:48,038 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:40524': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:48,149 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:48,149 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:48,149 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:40528': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:48,150 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:40534': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:48,261 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:48,261 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:48,262 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:40544': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:48,262 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:40558': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:48,373 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:48,374 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:48,374 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:40570': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:48,374 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:40584': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:48,485 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:48,486 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:48,486 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:40596': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:48,486 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:40598': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:48,598 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:48,598 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:48,598 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:40610': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:48,598 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:40618': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:48,709 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:48,709 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:48,710 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:40632': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:48,710 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:40648': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:48,821 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:48,822 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:48,822 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:40654': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:48,822 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:40658': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:48,933 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:48,933 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:48,934 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:40674': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:48,934 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:40688': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:49,047 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:49,047 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:49,047 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:40704': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:49,047 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:40716': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:49,159 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:49,159 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:49,159 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:40726': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:49,159 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:40738': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:49,271 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:49,271 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:49,272 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:40752': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:49,272 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:40768': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:49,383 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:49,384 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:49,386 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:40772': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:49,386 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:40782': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:49,495 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:49,495 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:49,495 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:40784': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:49,496 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:40794': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:49,608 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:49,608 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:49,609 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:40800': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:49,609 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:40808': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:49,722 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:49,722 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:49,722 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:40814': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:49,722 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:40826': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:49,834 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:49,834 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:49,834 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:40838': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:49,834 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:40848': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:49,945 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:49,946 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:49,946 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:40858': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:49,946 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:40866': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:50,058 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:50,058 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:50,058 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:40872': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:50,058 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:40884': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:50,171 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:50,171 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:50,171 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:40886': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:50,171 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:40898': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:50,283 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:50,283 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:50,284 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:40914': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:50,284 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:40920': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:50,396 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:50,396 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:50,396 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:40924': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:50,396 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:40936': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:50,508 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:50,508 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:50,508 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:40946': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:50,508 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:40962': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:50,620 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:50,620 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:50,621 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:40976': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:50,621 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:40982': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:50,732 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:50,732 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:50,732 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:40992': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:50,733 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:41000': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:50,844 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:50,845 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:50,845 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:41002': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:50,845 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:41006': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:50,957 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:50,957 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:50,957 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:41020': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:50,957 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:41034': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:51,069 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:51,070 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:51,070 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:41038': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:51,070 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:41054': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:51,181 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:51,181 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:51,181 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:41066': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:51,182 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:41082': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:51,293 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:51,294 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:51,294 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:41094': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:51,294 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:41108': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:51,407 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:51,408 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:51,408 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:41110': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:51,408 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:41126': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:51,522 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:51,522 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:51,523 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:41134': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:51,523 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:41150': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:51,634 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:51,635 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:51,635 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:47254': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:51,635 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:47264': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:51,747 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:51,747 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:51,747 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:47278': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:51,747 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:47288': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:51,859 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:51,859 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:51,860 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:47298': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:51,860 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:47312': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:51,971 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:51,971 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:51,971 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:47320': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:51,971 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:47322': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:52,083 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:52,084 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:52,084 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:47334': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:52,084 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:47346': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:52,195 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:52,195 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:52,195 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:47362': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:52,195 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:47364': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:52,307 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:52,308 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:52,308 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:47376': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:52,308 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:47386': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:52,420 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:52,420 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:52,420 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:47400': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:52,420 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:47412': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:52,532 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:52,532 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:52,532 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:47414': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:52,532 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:47426': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:52,639 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:52,643 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:47434': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:52,644 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:52,644 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:47438': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:52,746 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:52,746 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:47440': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:52,752 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:52,752 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:47448': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:52,853 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:52,853 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:47452': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:52,859 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:52,859 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:47468': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:52,959 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:52,960 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:47480': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:52,965 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:52,966 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:47488': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:53,067 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:53,067 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:47502': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:53,073 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:53,073 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:47504': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:53,174 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:53,175 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:47506': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:53,180 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:53,180 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:47522': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:53,282 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:53,283 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:47526': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:53,288 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:53,289 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:47538': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:53,391 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:53,391 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:47540': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:53,397 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:53,397 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:47544': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:53,498 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:53,499 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:47558': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:53,504 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:53,505 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:47566': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:53,605 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:53,606 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:47574': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:53,611 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:53,612 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:47584': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:53,712 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:53,712 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:47598': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:53,718 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:53,718 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:47610': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:53,819 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:53,819 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:47618': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:53,825 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:53,825 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:47622': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:53,926 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:53,926 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:47636': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:53,932 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:53,932 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:47652': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:54,033 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:54,034 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:47664': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:54,039 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:54,039 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:47670': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:54,140 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:54,140 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:47680': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:54,146 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:54,146 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:47694': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:54,247 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:54,247 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:47706': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:54,253 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:54,254 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:47720': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:54,357 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:54,358 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:47736': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:54,364 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:54,365 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:47740': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:54,466 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:54,467 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:47744': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:54,474 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:54,474 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:47760': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:54,574 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:54,574 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:47762': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:54,581 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:54,581 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:47774': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:54,682 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:54,682 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:47780': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:54,688 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:54,689 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:47788': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:54,791 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:54,792 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:47802': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:54,799 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:54,799 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:47818': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:54,899 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:54,899 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:47826': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:54,907 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:54,908 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:47830': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:55,006 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:55,006 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:47838': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:55,014 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:55,014 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:47844': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:55,112 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:55,112 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:47852': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:55,120 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:55,121 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:47868': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:55,219 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:55,219 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:47878': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:55,227 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:55,227 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:47894': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:55,325 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:55,325 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:47910': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:55,334 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:55,334 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:47914': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:55,432 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:55,433 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:47924': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:55,440 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:55,440 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:47940': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:55,539 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:55,539 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:47944': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:55,546 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:55,547 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:47952': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:55,645 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:55,646 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:47964': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:55,653 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:55,653 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:47976': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:55,753 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:55,753 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:47980': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:55,759 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:55,759 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:47996': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:55,861 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:55,862 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:48012': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:55,867 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:55,867 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:48024': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:55,969 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:55,969 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:48028': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:55,975 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:55,975 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:48038': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:56,076 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:56,077 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:48052': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:56,082 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:56,083 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:48056': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:56,183 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:56,184 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:48062': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:56,190 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:56,190 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:48074': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:56,290 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:56,291 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:48088': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:56,296 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:56,297 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:48094': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:56,398 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:56,398 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:48096': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:56,404 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:56,404 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:48106': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:56,505 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:56,506 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:48116': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:56,511 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:56,511 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:48122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:56,614 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:56,615 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:48124': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:56,621 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:56,621 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:48138': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:56,721 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:56,721 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:48150': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:56,727 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:56,727 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:48162': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:56,828 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:56,829 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:48172': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:56,834 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:56,834 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:48178': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:56,935 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:56,936 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:48188': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:56,941 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:56,942 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:48202': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:57,042 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:57,043 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:48214': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:57,048 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:57,049 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:48228': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:57,150 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:57,150 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:48242': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:57,156 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:57,156 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:48248': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:57,257 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:57,258 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:48262': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:57,263 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:57,263 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:48266': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:57,364 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:57,364 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:48268': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:57,370 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37417 5986s 2024-11-23 22:07:57,370 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37417': TLS handshake failed with remote 'tls://127.0.0.1:48270': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:57,392 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33973. Reason: failure-to-start- 5986s 2024-11-23 22:07:57,392 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:07:57,394 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 15s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 5986s stream = await stream.start_tls( 5986s ^^^^^^^^^^^^^^^^^^^^^^^ 5986s False, ssl_options=ssl_options, server_hostname=host 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 5986s self.socket.do_handshake() 5986s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 5986s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 5986s self._sslobj.do_handshake() 5986s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 5986s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 5986s raise FatalCommClosedError( 5986s ...<2 lines>... 5986s ) from err 5986s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 5986s 5986s During handling of the above exception, another exception occurred: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1218, in _register_with_scheduler 5986s await asyncio.sleep(0.1) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 718, in sleep 5986s return await future 5986s ^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 15s. 5986s 2024-11-23 22:07:57,397 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41265. Reason: failure-to-start- 5986s 2024-11-23 22:07:57,397 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:07:58,401 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:07:58,407 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45853 5986s 2024-11-23 22:07:58,407 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46695/status 5986s 2024-11-23 22:07:58,407 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:07:58,419 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34689 5986s 2024-11-23 22:07:58,419 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34689 5986s 2024-11-23 22:07:58,419 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:07:58,420 - distributed.worker - INFO - dashboard at: 127.0.0.1:34939 5986s 2024-11-23 22:07:58,420 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:07:58,420 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:07:58,420 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:07:58,420 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:07:58,420 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-pl7xk441 5986s 2024-11-23 22:07:58,420 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:07:58,422 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46507 5986s 2024-11-23 22:07:58,422 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46507 5986s 2024-11-23 22:07:58,422 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:07:58,422 - distributed.worker - INFO - dashboard at: 127.0.0.1:37319 5986s 2024-11-23 22:07:58,422 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:07:58,422 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:07:58,422 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:07:58,422 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:07:58,422 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-r6hvffh7 5986s 2024-11-23 22:07:58,422 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:07:58,434 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:07:58,434 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:07:58,435 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:50538': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:58,435 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:50548': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:58,545 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:07:58,546 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:07:58,546 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:50564': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:58,546 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:50568': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:58,657 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:07:58,658 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:07:58,658 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:50578': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:58,658 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:50586': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:58,769 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:07:58,769 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:07:58,769 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:50598': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:58,769 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:50600': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:58,881 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:07:58,881 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:07:58,882 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:50602': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:58,882 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:50608': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:58,995 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:07:58,995 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:07:58,995 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:50610': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:58,995 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:50616': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:59,107 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:07:59,107 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:07:59,108 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:50630': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:59,108 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:50632': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:59,220 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:07:59,220 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:07:59,220 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:50648': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:59,220 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:50650': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:59,331 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:07:59,332 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:07:59,332 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:50656': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:59,332 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:50668': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:59,443 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:07:59,444 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:07:59,444 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:50682': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:59,444 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:50684': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:59,556 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:07:59,556 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:07:59,556 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:50686': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:59,556 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:50690': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:59,668 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:07:59,668 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:07:59,668 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:50704': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:59,668 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:50706': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:59,781 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:07:59,781 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:07:59,782 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:50718': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:59,782 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:50728': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:59,896 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:07:59,897 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:07:59,897 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:50730': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:07:59,897 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:50736': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:00,008 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:00,008 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:00,009 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:50738': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:00,009 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:50742': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:00,120 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:00,120 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:00,120 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:50756': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:00,120 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:50772': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:00,233 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:00,233 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:00,233 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:50788': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:00,233 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:50800': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:00,345 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:00,345 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:00,345 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:50812': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:00,346 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:50822': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:00,457 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:00,457 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:00,457 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:50832': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:00,457 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:50838': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:00,569 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:00,569 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:00,569 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:50842': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:00,569 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:50854': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:00,681 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:00,681 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:00,681 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:50856': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:00,681 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:50864': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:00,793 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:00,793 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:00,794 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:50872': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:00,794 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:50880': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:00,906 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:00,906 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:00,907 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:50884': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:00,907 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:50894': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:01,018 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:01,018 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:01,019 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:50910': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:01,019 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:50920': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:01,130 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:01,130 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:01,130 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:50922': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:01,130 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:50932': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:01,242 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:01,242 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:01,242 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:50942': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:01,242 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:50958': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:01,353 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:01,353 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:01,354 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:50966': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:01,354 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:50968': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:01,466 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:01,466 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:01,467 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:50972': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:01,467 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:50986': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:01,578 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:01,579 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:01,579 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:54724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:01,579 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:54736': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:01,690 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:01,690 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:01,691 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:54748': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:01,691 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:54760': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:01,803 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:01,804 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:01,804 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:54774': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:01,804 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:54776': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:01,916 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:01,916 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:01,919 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:54782': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:01,919 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:54788': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:02,028 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:02,029 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:02,029 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:54802': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:02,029 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:54814': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:02,141 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:02,141 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:02,141 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:54828': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:02,142 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:54842': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:02,252 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:02,253 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:02,253 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:54858': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:02,253 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:54866': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:02,364 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:02,364 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:02,364 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:54868': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:02,364 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:54882': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:02,476 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:02,476 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:02,477 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:54884': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:02,477 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:54890': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:02,589 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:02,590 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:02,590 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:54896': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:02,590 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:54908': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:02,702 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:02,702 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:02,702 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:54920': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:02,702 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:54924': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:02,813 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:02,814 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:02,814 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:54938': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:02,814 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:54946': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:02,925 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:02,926 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:02,926 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:54958': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:02,926 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:54962': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:03,037 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:03,037 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:03,038 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:54968': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:03,038 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:54974': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:03,149 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:03,149 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:03,150 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:54980': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:03,150 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:54994': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:03,262 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:03,262 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:03,263 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:55010': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:03,263 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:55022': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:03,375 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:03,375 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:03,376 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:55026': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:03,376 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:55034': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:03,488 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:03,488 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:03,488 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:55036': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:03,489 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:55048': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:03,600 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:03,600 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:03,600 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:55054': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:03,601 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:55064': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:03,712 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:03,712 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:03,713 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:55070': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:03,713 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:55084': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:03,825 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:03,825 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:03,826 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:55086': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:03,826 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:55094': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:03,937 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:03,938 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:03,938 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:55100': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:03,938 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:55114': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:04,049 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:04,050 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:04,050 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:55116': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:04,050 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:55118': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:04,163 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:04,163 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:04,163 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:55120': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:04,163 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:55126': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:04,275 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:04,275 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:04,275 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:55132': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:04,275 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:55144': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:04,387 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:04,387 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:04,390 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:55150': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:04,390 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:55160': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:04,498 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:04,499 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:04,499 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:55174': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:04,499 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:55176': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:04,610 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:04,610 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:04,611 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:55192': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:04,611 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:55204': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:04,722 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:04,722 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:04,722 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:55214': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:04,722 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:55230': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:04,834 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:04,834 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:04,834 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:55234': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:04,834 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:55238': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:04,945 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:04,946 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:04,946 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:55250': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:04,946 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:55266': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:05,058 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:05,058 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:05,059 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:55274': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:05,059 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:55286': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:05,171 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:05,171 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:05,171 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:55292': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:05,171 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:55308': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:05,282 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:05,282 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:05,282 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:55322': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:05,283 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:55326': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:05,395 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:05,396 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:05,396 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:55340': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:05,397 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:55344': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:05,509 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:05,509 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:05,509 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:55354': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:05,509 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:55358': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:05,621 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:05,622 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:05,622 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:55368': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:05,622 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:55374': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:05,735 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:05,735 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:05,735 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:55376': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:05,735 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:55386': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:05,847 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:05,847 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:05,847 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:55400': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:05,848 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:55402': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:05,959 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:05,959 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:05,959 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:55418': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:05,959 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:55432': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:06,070 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:06,071 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:06,071 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:55442': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:06,071 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:55450': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:06,183 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:06,183 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:06,183 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:55464': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:06,183 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:55474': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:06,294 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:06,295 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:06,295 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:55482': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:06,295 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:55486': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:06,407 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:06,407 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:06,407 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:55490': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:06,407 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:55494': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:06,519 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:06,519 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:06,519 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:55510': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:06,519 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:55514': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:06,631 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:06,631 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:06,631 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:55528': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:06,631 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:55534': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:06,743 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:06,743 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:06,744 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:55542': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:06,744 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:55548': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:06,850 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:06,850 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:55560': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:06,856 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:06,856 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:55564': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:06,958 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:06,958 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:55572': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:06,964 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:06,964 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:55576': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:07,065 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:07,066 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:55578': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:07,071 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:07,071 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:55588': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:07,172 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:07,172 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:55598': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:07,178 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:07,178 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:55600': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:07,279 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:07,279 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:55614': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:07,285 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:07,285 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:55616': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:07,392 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:07,392 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:55632': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:07,397 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:07,398 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:55638': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:07,499 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:07,500 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:55650': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:07,506 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:07,506 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:55664': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:07,607 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:07,608 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:55678': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:07,614 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:07,614 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:55688': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:07,714 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:07,716 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:55692': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:07,728 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:07,728 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:55700': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:07,822 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:07,822 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:55704': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:07,835 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:07,835 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:55706': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:07,929 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:07,930 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:55714': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:07,942 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:07,942 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:55718': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:08,036 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:08,037 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:55722': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:08,049 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:08,049 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:55726': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:08,144 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:08,144 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:55728': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:08,155 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:08,156 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:55734': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:08,251 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:08,251 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:55736': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:08,261 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:08,262 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:55750': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:08,358 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:08,358 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:55766': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:08,368 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:08,369 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:55782': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:08,464 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:08,465 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:55796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:08,475 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:08,475 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:55806': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:08,571 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:08,571 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:55812': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:08,581 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:08,582 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:55822': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:08,678 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:08,678 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:55830': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:08,688 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:08,688 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:55840': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:08,785 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:08,785 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:55852': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:08,794 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:08,794 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:55860': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:08,891 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:08,891 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:55876': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:08,900 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:08,900 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:55882': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:08,998 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:08,998 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:55896': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:09,007 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:09,007 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:55900': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:09,106 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:09,107 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:55916': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:09,113 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:09,114 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:55922': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:09,213 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:09,213 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:55936': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:09,220 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:09,221 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:55944': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:09,320 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:09,320 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:55954': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:09,327 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:09,327 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:55956': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:09,427 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:09,427 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:55962': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:09,434 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:09,434 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:55976': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:09,534 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:09,535 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:55990': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:09,540 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:09,541 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:56000': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:09,641 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:09,641 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:56014': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:09,647 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:09,647 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:56018': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:09,748 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:09,749 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:56030': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:09,754 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:09,755 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:56046': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:09,856 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:09,856 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:56062': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:09,862 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:09,862 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:56068': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:09,963 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:09,964 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:56076': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:09,969 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:09,969 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:56092': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:10,072 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:10,072 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:56096': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:10,078 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:10,078 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:56100': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:10,180 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:10,180 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:56116': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:10,186 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:10,186 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:56118': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:10,287 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:10,288 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:56130': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:10,293 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:10,294 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:56138': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:10,394 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:10,394 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:56144': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:10,400 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:10,400 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:56146': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:10,500 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:10,501 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:56152': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:10,506 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:10,507 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:56162': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:10,608 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:10,608 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:56178': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:10,614 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:10,614 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:56180': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:10,715 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:10,716 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:56188': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:10,722 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:10,722 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:56190': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:10,825 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:10,825 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:56200': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:10,831 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:10,831 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:56202': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:10,932 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:10,932 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:56210': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:10,938 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:10,938 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:56222': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:11,039 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:11,040 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:56226': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:11,045 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:11,045 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:56230': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:11,146 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:11,146 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:56238': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:11,152 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:11,152 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:56250': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:11,253 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:11,254 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:56260': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:11,259 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:11,259 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:56268': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:11,360 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:11,361 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:56270': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:11,366 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45853 5986s 2024-11-23 22:08:11,367 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45853': TLS handshake failed with remote 'tls://127.0.0.1:56278': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:11,418 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34689. Reason: failure-to-start- 5986s 2024-11-23 22:08:11,419 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:08:11,420 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 13s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 5986s stream = await stream.start_tls( 5986s ^^^^^^^^^^^^^^^^^^^^^^^ 5986s False, ssl_options=ssl_options, server_hostname=host 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 5986s self.socket.do_handshake() 5986s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 5986s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 5986s self._sslobj.do_handshake() 5986s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 5986s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 5986s raise FatalCommClosedError( 5986s ...<2 lines>... 5986s ) from err 5986s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 5986s 5986s During handling of the above exception, another exception occurred: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1218, in _register_with_scheduler 5986s await asyncio.sleep(0.1) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 718, in sleep 5986s return await future 5986s ^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 13s. 5986s 2024-11-23 22:08:11,424 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46507. Reason: failure-to-start- 5986s 2024-11-23 22:08:11,424 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:08:12,427 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:08:12,435 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38845 5986s 2024-11-23 22:08:12,436 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46319/status 5986s 2024-11-23 22:08:12,436 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:08:12,448 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44231 5986s 2024-11-23 22:08:12,448 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44231 5986s 2024-11-23 22:08:12,448 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:08:12,448 - distributed.worker - INFO - dashboard at: 127.0.0.1:46091 5986s 2024-11-23 22:08:12,448 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38845 5986s 2024-11-23 22:08:12,448 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:08:12,448 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:08:12,448 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:08:12,448 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-7dqakjo4 5986s 2024-11-23 22:08:12,448 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:08:12,450 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41517 5986s 2024-11-23 22:08:12,450 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41517 5986s 2024-11-23 22:08:12,450 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:08:12,450 - distributed.worker - INFO - dashboard at: 127.0.0.1:39803 5986s 2024-11-23 22:08:12,450 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38845 5986s 2024-11-23 22:08:12,451 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:08:12,451 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:08:12,451 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:08:12,451 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-zn7szpe4 5986s 2024-11-23 22:08:12,451 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:08:12,452 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44231. Reason: failure-to-start- 5986s 2024-11-23 22:08:12,452 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:08:12,452 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41517. Reason: failure-to-start- 5986s 2024-11-23 22:08:12,452 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:08:12,453 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38845': TLS handshake failed with remote 'tls://127.0.0.1:50574': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:08:12,453 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38845': TLS handshake failed with remote 'tls://127.0.0.1:50584': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:08:12,455 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:08:13,460 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:08:13,467 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44027 5986s 2024-11-23 22:08:13,467 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34235/status 5986s 2024-11-23 22:08:13,467 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:08:13,480 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39219 5986s 2024-11-23 22:08:13,480 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39219 5986s 2024-11-23 22:08:13,480 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:08:13,480 - distributed.worker - INFO - dashboard at: 127.0.0.1:39671 5986s 2024-11-23 22:08:13,481 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44027 5986s 2024-11-23 22:08:13,481 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:08:13,481 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:08:13,481 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:08:13,481 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-589vsnck 5986s 2024-11-23 22:08:13,481 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:08:13,483 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40253 5986s 2024-11-23 22:08:13,483 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40253 5986s 2024-11-23 22:08:13,483 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:08:13,483 - distributed.worker - INFO - dashboard at: 127.0.0.1:33461 5986s 2024-11-23 22:08:13,483 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44027 5986s 2024-11-23 22:08:13,483 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:08:13,483 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:08:13,483 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:08:13,483 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ptpveuup 5986s 2024-11-23 22:08:13,483 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:08:13,484 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39219. Reason: failure-to-start- 5986s 2024-11-23 22:08:13,484 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:08:13,485 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40253. Reason: failure-to-start- 5986s 2024-11-23 22:08:13,485 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:08:13,486 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44027': TLS handshake failed with remote 'tls://127.0.0.1:45336': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:08:13,486 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44027': TLS handshake failed with remote 'tls://127.0.0.1:45352': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:08:13,488 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:08:14,494 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:08:14,501 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42699 5986s 2024-11-23 22:08:14,501 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46065/status 5986s 2024-11-23 22:08:14,501 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:08:14,513 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46423 5986s 2024-11-23 22:08:14,513 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46423 5986s 2024-11-23 22:08:14,513 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:08:14,513 - distributed.worker - INFO - dashboard at: 127.0.0.1:36465 5986s 2024-11-23 22:08:14,513 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42699 5986s 2024-11-23 22:08:14,513 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:08:14,513 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:08:14,513 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:08:14,513 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-p19tkf9p 5986s 2024-11-23 22:08:14,513 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:08:14,515 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37341 5986s 2024-11-23 22:08:14,515 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37341 5986s 2024-11-23 22:08:14,515 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:08:14,515 - distributed.worker - INFO - dashboard at: 127.0.0.1:32927 5986s 2024-11-23 22:08:14,515 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42699 5986s 2024-11-23 22:08:14,515 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:08:14,515 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:08:14,516 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:08:14,516 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-fw1nt8hx 5986s 2024-11-23 22:08:14,516 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:08:14,517 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46423. Reason: failure-to-start- 5986s 2024-11-23 22:08:14,517 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:08:14,518 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37341. Reason: failure-to-start- 5986s 2024-11-23 22:08:14,518 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:08:14,519 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42699': TLS handshake failed with remote 'tls://127.0.0.1:43090': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:08:14,519 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42699': TLS handshake failed with remote 'tls://127.0.0.1:43102': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:08:14,521 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:08:15,526 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:08:15,531 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35553 5986s 2024-11-23 22:08:15,532 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39239/status 5986s 2024-11-23 22:08:15,532 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:08:15,543 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44713 5986s 2024-11-23 22:08:15,543 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44713 5986s 2024-11-23 22:08:15,543 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:08:15,543 - distributed.worker - INFO - dashboard at: 127.0.0.1:44107 5986s 2024-11-23 22:08:15,543 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35553 5986s 2024-11-23 22:08:15,543 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:08:15,543 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:08:15,543 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:08:15,543 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-9g303vwk 5986s 2024-11-23 22:08:15,544 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:08:15,545 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34541 5986s 2024-11-23 22:08:15,545 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34541 5986s 2024-11-23 22:08:15,545 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:08:15,545 - distributed.worker - INFO - dashboard at: 127.0.0.1:32849 5986s 2024-11-23 22:08:15,546 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35553 5986s 2024-11-23 22:08:15,546 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:08:15,546 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:08:15,546 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:08:15,546 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-n05ive7w 5986s 2024-11-23 22:08:15,546 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:08:15,547 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44713. Reason: failure-to-start- 5986s 2024-11-23 22:08:15,547 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:08:15,547 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34541. Reason: failure-to-start- 5986s 2024-11-23 22:08:15,547 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:08:15,548 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35553': TLS handshake failed with remote 'tls://127.0.0.1:53500': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:08:15,549 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35553': TLS handshake failed with remote 'tls://127.0.0.1:53502': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:08:15,550 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:08:16,555 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:08:16,562 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36437 5986s 2024-11-23 22:08:16,562 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36333/status 5986s 2024-11-23 22:08:16,562 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:08:16,574 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34665 5986s 2024-11-23 22:08:16,574 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34665 5986s 2024-11-23 22:08:16,574 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:08:16,574 - distributed.worker - INFO - dashboard at: 127.0.0.1:38489 5986s 2024-11-23 22:08:16,574 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36437 5986s 2024-11-23 22:08:16,574 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:08:16,574 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:08:16,574 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:08:16,574 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-679uygms 5986s 2024-11-23 22:08:16,574 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:08:16,576 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42151 5986s 2024-11-23 22:08:16,576 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42151 5986s 2024-11-23 22:08:16,576 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:08:16,576 - distributed.worker - INFO - dashboard at: 127.0.0.1:35463 5986s 2024-11-23 22:08:16,576 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36437 5986s 2024-11-23 22:08:16,576 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:08:16,576 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:08:16,576 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:08:16,576 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-xmr87xmk 5986s 2024-11-23 22:08:16,577 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:08:16,577 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34665. Reason: failure-to-start- 5986s 2024-11-23 22:08:16,578 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:08:16,578 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42151. Reason: failure-to-start- 5986s 2024-11-23 22:08:16,578 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:08:16,579 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36437': TLS handshake failed with remote 'tls://127.0.0.1:33150': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:08:16,579 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36437': TLS handshake failed with remote 'tls://127.0.0.1:33162': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:08:16,581 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:08:17,585 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:08:17,591 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40453 5986s 2024-11-23 22:08:17,591 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36229/status 5986s 2024-11-23 22:08:17,592 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:08:17,604 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33799 5986s 2024-11-23 22:08:17,604 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33799 5986s 2024-11-23 22:08:17,604 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:08:17,604 - distributed.worker - INFO - dashboard at: 127.0.0.1:37563 5986s 2024-11-23 22:08:17,604 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40453 5986s 2024-11-23 22:08:17,604 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:08:17,604 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:08:17,604 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:08:17,604 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-8lthmqcf 5986s 2024-11-23 22:08:17,605 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:08:17,606 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39337 5986s 2024-11-23 22:08:17,606 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39337 5986s 2024-11-23 22:08:17,606 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:08:17,606 - distributed.worker - INFO - dashboard at: 127.0.0.1:45441 5986s 2024-11-23 22:08:17,606 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40453 5986s 2024-11-23 22:08:17,606 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:08:17,607 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:08:17,607 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:08:17,607 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-hvnjkqlt 5986s 2024-11-23 22:08:17,607 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:08:17,608 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33799. Reason: failure-to-start- 5986s 2024-11-23 22:08:17,608 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:08:17,608 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39337. Reason: failure-to-start- 5986s 2024-11-23 22:08:17,608 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:08:17,609 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40453': TLS handshake failed with remote 'tls://127.0.0.1:58766': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:08:17,609 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40453': TLS handshake failed with remote 'tls://127.0.0.1:58774': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:08:17,611 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:08:18,616 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:08:18,621 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35113 5986s 2024-11-23 22:08:18,622 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45625/status 5986s 2024-11-23 22:08:18,622 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:08:18,633 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39333 5986s 2024-11-23 22:08:18,633 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39333 5986s 2024-11-23 22:08:18,633 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:08:18,633 - distributed.worker - INFO - dashboard at: 127.0.0.1:39969 5986s 2024-11-23 22:08:18,633 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 5986s 2024-11-23 22:08:18,633 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:08:18,633 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:08:18,633 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:08:18,633 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-we5sh38q 5986s 2024-11-23 22:08:18,633 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:08:18,635 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45319 5986s 2024-11-23 22:08:18,635 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45319 5986s 2024-11-23 22:08:18,635 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:08:18,635 - distributed.worker - INFO - dashboard at: 127.0.0.1:38865 5986s 2024-11-23 22:08:18,635 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 5986s 2024-11-23 22:08:18,635 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:08:18,635 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:08:18,635 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:08:18,635 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-g5_30xyq 5986s 2024-11-23 22:08:18,636 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:08:18,637 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39333. Reason: failure-to-start- 5986s 2024-11-23 22:08:18,637 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:08:18,637 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45319. Reason: failure-to-start- 5986s 2024-11-23 22:08:18,638 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:08:18,639 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:55834': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:08:18,639 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:55842': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:08:18,640 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:08:19,645 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:08:19,651 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41877 5986s 2024-11-23 22:08:19,652 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41611/status 5986s 2024-11-23 22:08:19,652 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:08:19,663 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38081 5986s 2024-11-23 22:08:19,664 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38081 5986s 2024-11-23 22:08:19,664 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:08:19,664 - distributed.worker - INFO - dashboard at: 127.0.0.1:38313 5986s 2024-11-23 22:08:19,664 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41877 5986s 2024-11-23 22:08:19,664 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:08:19,664 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:08:19,664 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:08:19,664 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-7mmy5s5i 5986s 2024-11-23 22:08:19,664 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:08:19,666 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44603 5986s 2024-11-23 22:08:19,666 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44603 5986s 2024-11-23 22:08:19,666 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:08:19,666 - distributed.worker - INFO - dashboard at: 127.0.0.1:42827 5986s 2024-11-23 22:08:19,666 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41877 5986s 2024-11-23 22:08:19,666 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:08:19,666 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:08:19,666 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:08:19,666 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-84c6qtzy 5986s 2024-11-23 22:08:19,666 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:08:19,667 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38081. Reason: failure-to-start- 5986s 2024-11-23 22:08:19,667 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:08:19,668 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44603. Reason: failure-to-start- 5986s 2024-11-23 22:08:19,668 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:08:19,669 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41877': TLS handshake failed with remote 'tls://127.0.0.1:52242': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:08:19,669 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41877': TLS handshake failed with remote 'tls://127.0.0.1:52244': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:08:19,671 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:08:20,676 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:08:20,683 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41481 5986s 2024-11-23 22:08:20,683 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33427/status 5986s 2024-11-23 22:08:20,683 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:08:20,695 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44597 5986s 2024-11-23 22:08:20,695 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44597 5986s 2024-11-23 22:08:20,695 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:08:20,695 - distributed.worker - INFO - dashboard at: 127.0.0.1:40069 5986s 2024-11-23 22:08:20,695 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41481 5986s 2024-11-23 22:08:20,695 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:08:20,695 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:08:20,696 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:08:20,696 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-63yuhkbm 5986s 2024-11-23 22:08:20,696 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:08:20,697 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43383 5986s 2024-11-23 22:08:20,697 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43383 5986s 2024-11-23 22:08:20,698 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:08:20,698 - distributed.worker - INFO - dashboard at: 127.0.0.1:44075 5986s 2024-11-23 22:08:20,698 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41481 5986s 2024-11-23 22:08:20,698 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:08:20,698 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:08:20,698 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:08:20,698 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-m89ld69r 5986s 2024-11-23 22:08:20,698 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:08:20,699 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44597. Reason: failure-to-start- 5986s 2024-11-23 22:08:20,699 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:08:20,699 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43383. Reason: failure-to-start- 5986s 2024-11-23 22:08:20,700 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:08:20,701 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41481': TLS handshake failed with remote 'tls://127.0.0.1:35886': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:08:20,701 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41481': TLS handshake failed with remote 'tls://127.0.0.1:35898': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:08:20,702 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:08:21,708 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:08:21,714 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36655 5986s 2024-11-23 22:08:21,714 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39569/status 5986s 2024-11-23 22:08:21,715 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:08:21,729 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38345 5986s 2024-11-23 22:08:21,730 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38345 5986s 2024-11-23 22:08:21,730 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:08:21,730 - distributed.worker - INFO - dashboard at: 127.0.0.1:33539 5986s 2024-11-23 22:08:21,730 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36655 5986s 2024-11-23 22:08:21,730 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:08:21,730 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:08:21,730 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:08:21,730 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-t7vrf9ls 5986s 2024-11-23 22:08:21,730 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:08:21,732 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33487 5986s 2024-11-23 22:08:21,732 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33487 5986s 2024-11-23 22:08:21,732 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:08:21,732 - distributed.worker - INFO - dashboard at: 127.0.0.1:42269 5986s 2024-11-23 22:08:21,732 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36655 5986s 2024-11-23 22:08:21,732 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:08:21,732 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:08:21,733 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:08:21,733 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-mvtjflcx 5986s 2024-11-23 22:08:21,733 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:08:21,734 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38345. Reason: failure-to-start- 5986s 2024-11-23 22:08:21,734 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:08:21,734 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33487. Reason: failure-to-start- 5986s 2024-11-23 22:08:21,734 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:08:21,736 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36655': TLS handshake failed with remote 'tls://127.0.0.1:41572': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:08:21,736 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36655': TLS handshake failed with remote 'tls://127.0.0.1:41576': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:08:21,737 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:08:22,743 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:08:22,749 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41655 5986s 2024-11-23 22:08:22,749 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33147/status 5986s 2024-11-23 22:08:22,750 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:08:22,761 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42189 5986s 2024-11-23 22:08:22,761 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42189 5986s 2024-11-23 22:08:22,761 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:08:22,761 - distributed.worker - INFO - dashboard at: 127.0.0.1:34281 5986s 2024-11-23 22:08:22,761 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41655 5986s 2024-11-23 22:08:22,762 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:08:22,762 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:08:22,762 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:08:22,762 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-82lnake_ 5986s 2024-11-23 22:08:22,762 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:08:22,763 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44567 5986s 2024-11-23 22:08:22,763 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44567 5986s 2024-11-23 22:08:22,764 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:08:22,764 - distributed.worker - INFO - dashboard at: 127.0.0.1:34009 5986s 2024-11-23 22:08:22,764 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41655 5986s 2024-11-23 22:08:22,764 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:08:22,764 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:08:22,764 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:08:22,764 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-vr3k21iq 5986s 2024-11-23 22:08:22,764 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:08:22,766 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42189. Reason: failure-to-start- 5986s 2024-11-23 22:08:22,766 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:08:22,766 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44567. Reason: failure-to-start- 5986s 2024-11-23 22:08:22,766 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:08:22,768 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41655': TLS handshake failed with remote 'tls://127.0.0.1:35634': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:08:22,768 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41655': TLS handshake failed with remote 'tls://127.0.0.1:35644': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:08:22,769 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:08:23,774 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:08:23,780 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40559 5986s 2024-11-23 22:08:23,780 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41711/status 5986s 2024-11-23 22:08:23,780 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:08:23,792 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37517 5986s 2024-11-23 22:08:23,792 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37517 5986s 2024-11-23 22:08:23,792 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:08:23,792 - distributed.worker - INFO - dashboard at: 127.0.0.1:44393 5986s 2024-11-23 22:08:23,792 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40559 5986s 2024-11-23 22:08:23,792 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:08:23,792 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:08:23,792 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:08:23,792 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-zlglj8ri 5986s 2024-11-23 22:08:23,792 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:08:23,794 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45009 5986s 2024-11-23 22:08:23,794 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45009 5986s 2024-11-23 22:08:23,794 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:08:23,794 - distributed.worker - INFO - dashboard at: 127.0.0.1:36179 5986s 2024-11-23 22:08:23,794 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40559 5986s 2024-11-23 22:08:23,794 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:08:23,794 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:08:23,794 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:08:23,795 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-45cs5bmg 5986s 2024-11-23 22:08:23,795 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:08:23,796 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37517. Reason: failure-to-start- 5986s 2024-11-23 22:08:23,796 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:08:23,796 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45009. Reason: failure-to-start- 5986s 2024-11-23 22:08:23,796 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:08:23,798 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40559': TLS handshake failed with remote 'tls://127.0.0.1:49988': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:08:23,798 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40559': TLS handshake failed with remote 'tls://127.0.0.1:49998': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:08:23,799 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:08:24,805 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:08:24,812 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38629 5986s 2024-11-23 22:08:24,813 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46851/status 5986s 2024-11-23 22:08:24,813 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:08:24,825 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34985 5986s 2024-11-23 22:08:24,825 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34985 5986s 2024-11-23 22:08:24,825 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:08:24,825 - distributed.worker - INFO - dashboard at: 127.0.0.1:39395 5986s 2024-11-23 22:08:24,825 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38629 5986s 2024-11-23 22:08:24,826 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:08:24,826 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:08:24,826 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:08:24,826 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-p9fgl4bn 5986s 2024-11-23 22:08:24,826 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:08:24,828 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34651 5986s 2024-11-23 22:08:24,828 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34651 5986s 2024-11-23 22:08:24,828 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:08:24,828 - distributed.worker - INFO - dashboard at: 127.0.0.1:34579 5986s 2024-11-23 22:08:24,828 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38629 5986s 2024-11-23 22:08:24,828 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:08:24,828 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:08:24,828 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:08:24,828 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-0wukg5h6 5986s 2024-11-23 22:08:24,828 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:08:24,829 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34985. Reason: failure-to-start- 5986s 2024-11-23 22:08:24,829 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:08:24,830 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34651. Reason: failure-to-start- 5986s 2024-11-23 22:08:24,830 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:08:24,831 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38629': TLS handshake failed with remote 'tls://127.0.0.1:41286': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:08:24,831 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38629': TLS handshake failed with remote 'tls://127.0.0.1:41288': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:08:24,832 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:08:25,838 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:08:25,844 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43591 5986s 2024-11-23 22:08:25,844 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41249/status 5986s 2024-11-23 22:08:25,844 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:08:25,866 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39363 5986s 2024-11-23 22:08:25,866 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39363 5986s 2024-11-23 22:08:25,866 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:08:25,866 - distributed.worker - INFO - dashboard at: 127.0.0.1:35761 5986s 2024-11-23 22:08:25,866 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43591 5986s 2024-11-23 22:08:25,866 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:08:25,866 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:08:25,866 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:08:25,866 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-6jkzl0b4 5986s 2024-11-23 22:08:25,866 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:08:25,868 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37795 5986s 2024-11-23 22:08:25,868 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37795 5986s 2024-11-23 22:08:25,868 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:08:25,868 - distributed.worker - INFO - dashboard at: 127.0.0.1:42769 5986s 2024-11-23 22:08:25,869 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43591 5986s 2024-11-23 22:08:25,869 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:08:25,869 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:08:25,869 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:08:25,869 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-k5keqdf6 5986s 2024-11-23 22:08:25,869 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:08:25,870 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39363. Reason: failure-to-start- 5986s 2024-11-23 22:08:25,870 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:08:25,870 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37795. Reason: failure-to-start- 5986s 2024-11-23 22:08:25,871 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:08:25,872 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43591': TLS handshake failed with remote 'tls://127.0.0.1:40368': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:08:25,872 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43591': TLS handshake failed with remote 'tls://127.0.0.1:40372': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:08:25,874 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:08:26,879 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:08:26,885 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46827 5986s 2024-11-23 22:08:26,886 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46131/status 5986s 2024-11-23 22:08:26,886 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:08:26,899 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35883 5986s 2024-11-23 22:08:26,900 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35883 5986s 2024-11-23 22:08:26,900 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:08:26,900 - distributed.worker - INFO - dashboard at: 127.0.0.1:37625 5986s 2024-11-23 22:08:26,900 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46827 5986s 2024-11-23 22:08:26,900 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:08:26,900 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:08:26,900 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:08:26,900 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-m8xd5u5_ 5986s 2024-11-23 22:08:26,900 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:08:26,902 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45785 5986s 2024-11-23 22:08:26,902 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45785 5986s 2024-11-23 22:08:26,902 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:08:26,902 - distributed.worker - INFO - dashboard at: 127.0.0.1:44443 5986s 2024-11-23 22:08:26,902 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46827 5986s 2024-11-23 22:08:26,902 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:08:26,902 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:08:26,902 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:08:26,902 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-wzleb8sc 5986s 2024-11-23 22:08:26,902 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:08:26,904 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35883. Reason: failure-to-start- 5986s 2024-11-23 22:08:26,904 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:08:26,905 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45785. Reason: failure-to-start- 5986s 2024-11-23 22:08:26,905 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:08:26,906 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46827': TLS handshake failed with remote 'tls://127.0.0.1:59024': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:08:26,906 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46827': TLS handshake failed with remote 'tls://127.0.0.1:59030': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:08:26,907 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:08:27,912 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:08:27,917 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34237 5986s 2024-11-23 22:08:27,917 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35669/status 5986s 2024-11-23 22:08:27,917 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:08:27,928 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41431 5986s 2024-11-23 22:08:27,928 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41431 5986s 2024-11-23 22:08:27,928 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:08:27,928 - distributed.worker - INFO - dashboard at: 127.0.0.1:38361 5986s 2024-11-23 22:08:27,928 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 5986s 2024-11-23 22:08:27,928 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:08:27,928 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:08:27,928 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:08:27,928 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-uvbi6ie3 5986s 2024-11-23 22:08:27,928 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:08:27,930 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33847 5986s 2024-11-23 22:08:27,930 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33847 5986s 2024-11-23 22:08:27,930 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:08:27,930 - distributed.worker - INFO - dashboard at: 127.0.0.1:37871 5986s 2024-11-23 22:08:27,930 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 5986s 2024-11-23 22:08:27,930 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:08:27,930 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:08:27,930 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:08:27,930 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-f2b1b44b 5986s 2024-11-23 22:08:27,930 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:08:27,931 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41431. Reason: failure-to-start- 5986s 2024-11-23 22:08:27,931 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:08:27,932 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33847. Reason: failure-to-start- 5986s 2024-11-23 22:08:27,932 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:08:27,933 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:54432': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:08:27,933 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:54444': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:08:27,934 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:08:28,941 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:08:28,948 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43737 5986s 2024-11-23 22:08:28,948 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:32921/status 5986s 2024-11-23 22:08:28,948 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:08:28,959 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42161 5986s 2024-11-23 22:08:28,959 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42161 5986s 2024-11-23 22:08:28,959 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:08:28,959 - distributed.worker - INFO - dashboard at: 127.0.0.1:39421 5986s 2024-11-23 22:08:28,959 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43737 5986s 2024-11-23 22:08:28,959 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:08:28,959 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:08:28,959 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:08:28,959 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-8armq3ub 5986s 2024-11-23 22:08:28,959 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:08:28,961 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40131 5986s 2024-11-23 22:08:28,961 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40131 5986s 2024-11-23 22:08:28,961 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:08:28,961 - distributed.worker - INFO - dashboard at: 127.0.0.1:37349 5986s 2024-11-23 22:08:28,961 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43737 5986s 2024-11-23 22:08:28,961 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:08:28,961 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:08:28,961 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:08:28,961 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-oxqobozr 5986s 2024-11-23 22:08:28,961 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:08:28,962 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42161. Reason: failure-to-start- 5986s 2024-11-23 22:08:28,962 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:08:28,963 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40131. Reason: failure-to-start- 5986s 2024-11-23 22:08:28,963 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:08:28,963 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43737': TLS handshake failed with remote 'tls://127.0.0.1:34086': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:08:28,964 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43737': TLS handshake failed with remote 'tls://127.0.0.1:34102': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:08:28,965 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:08:29,970 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:08:29,976 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45707 5986s 2024-11-23 22:08:29,976 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39215/status 5986s 2024-11-23 22:08:29,978 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:08:29,991 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39637 5986s 2024-11-23 22:08:29,991 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39637 5986s 2024-11-23 22:08:29,991 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:08:29,991 - distributed.worker - INFO - dashboard at: 127.0.0.1:34113 5986s 2024-11-23 22:08:29,991 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45707 5986s 2024-11-23 22:08:29,991 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:08:29,992 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:08:29,992 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:08:29,992 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-r5el6p29 5986s 2024-11-23 22:08:29,992 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:08:29,993 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44089 5986s 2024-11-23 22:08:29,993 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44089 5986s 2024-11-23 22:08:29,994 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:08:29,994 - distributed.worker - INFO - dashboard at: 127.0.0.1:46523 5986s 2024-11-23 22:08:29,994 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45707 5986s 2024-11-23 22:08:29,994 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:08:29,994 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:08:29,994 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:08:29,994 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-i9ig4rlt 5986s 2024-11-23 22:08:29,994 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:08:29,995 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39637. Reason: failure-to-start- 5986s 2024-11-23 22:08:29,995 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:08:29,995 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44089. Reason: failure-to-start- 5986s 2024-11-23 22:08:29,996 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:08:29,996 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45707': TLS handshake failed with remote 'tls://127.0.0.1:57726': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:08:29,997 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45707': TLS handshake failed with remote 'tls://127.0.0.1:57736': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:08:29,997 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:08:31,002 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:08:31,008 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44235 5986s 2024-11-23 22:08:31,008 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36451/status 5986s 2024-11-23 22:08:31,009 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:08:31,021 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36217 5986s 2024-11-23 22:08:31,021 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36217 5986s 2024-11-23 22:08:31,021 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:08:31,021 - distributed.worker - INFO - dashboard at: 127.0.0.1:34049 5986s 2024-11-23 22:08:31,021 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44235 5986s 2024-11-23 22:08:31,021 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:08:31,022 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:08:31,022 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:08:31,022 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-d5ddveyg 5986s 2024-11-23 22:08:31,022 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:08:31,023 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44885 5986s 2024-11-23 22:08:31,023 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44885 5986s 2024-11-23 22:08:31,023 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:08:31,024 - distributed.worker - INFO - dashboard at: 127.0.0.1:46579 5986s 2024-11-23 22:08:31,024 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44235 5986s 2024-11-23 22:08:31,024 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:08:31,024 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:08:31,024 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:08:31,024 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-innn1b84 5986s 2024-11-23 22:08:31,024 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:08:31,026 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36217. Reason: failure-to-start- 5986s 2024-11-23 22:08:31,026 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:08:31,026 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44885. Reason: failure-to-start- 5986s 2024-11-23 22:08:31,026 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:08:31,027 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44235': TLS handshake failed with remote 'tls://127.0.0.1:36654': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:08:31,027 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44235': TLS handshake failed with remote 'tls://127.0.0.1:36662': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:08:31,028 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:08:32,033 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:08:32,039 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43527 5986s 2024-11-23 22:08:32,039 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41389/status 5986s 2024-11-23 22:08:32,039 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:08:32,052 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45229 5986s 2024-11-23 22:08:32,052 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45229 5986s 2024-11-23 22:08:32,053 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:08:32,053 - distributed.worker - INFO - dashboard at: 127.0.0.1:45207 5986s 2024-11-23 22:08:32,053 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43527 5986s 2024-11-23 22:08:32,053 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:08:32,053 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:08:32,053 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:08:32,053 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-dgmt9dpk 5986s 2024-11-23 22:08:32,053 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:08:32,055 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36239 5986s 2024-11-23 22:08:32,055 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36239 5986s 2024-11-23 22:08:32,055 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:08:32,055 - distributed.worker - INFO - dashboard at: 127.0.0.1:46523 5986s 2024-11-23 22:08:32,055 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43527 5986s 2024-11-23 22:08:32,055 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:08:32,055 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:08:32,055 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:08:32,055 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-635izj_d 5986s 2024-11-23 22:08:32,055 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:08:32,056 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45229. Reason: failure-to-start- 5986s 2024-11-23 22:08:32,057 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:08:32,057 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36239. Reason: failure-to-start- 5986s 2024-11-23 22:08:32,057 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:08:32,058 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43527': TLS handshake failed with remote 'tls://127.0.0.1:52658': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:08:32,058 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43527': TLS handshake failed with remote 'tls://127.0.0.1:52660': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:08:32,059 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:08:33,064 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:08:33,072 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37837 5986s 2024-11-23 22:08:33,072 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39281/status 5986s 2024-11-23 22:08:33,073 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:08:33,087 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46363 5986s 2024-11-23 22:08:33,087 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46363 5986s 2024-11-23 22:08:33,087 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:08:33,087 - distributed.worker - INFO - dashboard at: 127.0.0.1:37331 5986s 2024-11-23 22:08:33,087 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37837 5986s 2024-11-23 22:08:33,087 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:08:33,087 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:08:33,087 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:08:33,088 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-vw7rfv9z 5986s 2024-11-23 22:08:33,088 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:08:33,089 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40185 5986s 2024-11-23 22:08:33,089 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40185 5986s 2024-11-23 22:08:33,090 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:08:33,090 - distributed.worker - INFO - dashboard at: 127.0.0.1:45251 5986s 2024-11-23 22:08:33,090 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37837 5986s 2024-11-23 22:08:33,090 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:08:33,090 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:08:33,090 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:08:33,090 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-yrpame4k 5986s 2024-11-23 22:08:33,090 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:08:33,091 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46363. Reason: failure-to-start- 5986s 2024-11-23 22:08:33,091 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:08:33,092 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40185. Reason: failure-to-start- 5986s 2024-11-23 22:08:33,092 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:08:33,093 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37837': TLS handshake failed with remote 'tls://127.0.0.1:44126': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:08:33,093 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37837': TLS handshake failed with remote 'tls://127.0.0.1:44142': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:08:33,096 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:08:34,101 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:08:34,107 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46155 5986s 2024-11-23 22:08:34,107 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34431/status 5986s 2024-11-23 22:08:34,107 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:08:34,119 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46745 5986s 2024-11-23 22:08:34,120 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46745 5986s 2024-11-23 22:08:34,120 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:08:34,120 - distributed.worker - INFO - dashboard at: 127.0.0.1:38657 5986s 2024-11-23 22:08:34,120 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46155 5986s 2024-11-23 22:08:34,120 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:08:34,120 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:08:34,120 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:08:34,120 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-lyv_4m7d 5986s 2024-11-23 22:08:34,120 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:08:34,122 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42133 5986s 2024-11-23 22:08:34,122 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42133 5986s 2024-11-23 22:08:34,122 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:08:34,122 - distributed.worker - INFO - dashboard at: 127.0.0.1:43589 5986s 2024-11-23 22:08:34,122 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46155 5986s 2024-11-23 22:08:34,122 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:08:34,122 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:08:34,122 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:08:34,122 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-5mxa5z_w 5986s 2024-11-23 22:08:34,122 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:08:34,123 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46745. Reason: failure-to-start- 5986s 2024-11-23 22:08:34,123 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:08:34,124 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42133. Reason: failure-to-start- 5986s 2024-11-23 22:08:34,124 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:08:34,127 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46155': TLS handshake failed with remote 'tls://127.0.0.1:40520': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:08:34,127 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46155': TLS handshake failed with remote 'tls://127.0.0.1:40522': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:08:34,128 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:08:35,133 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:08:35,139 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33793 5986s 2024-11-23 22:08:35,139 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39797/status 5986s 2024-11-23 22:08:35,139 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:08:35,152 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43823 5986s 2024-11-23 22:08:35,153 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43823 5986s 2024-11-23 22:08:35,153 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:08:35,153 - distributed.worker - INFO - dashboard at: 127.0.0.1:35501 5986s 2024-11-23 22:08:35,153 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33793 5986s 2024-11-23 22:08:35,153 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:08:35,153 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:08:35,153 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:08:35,153 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-c1mu8i6s 5986s 2024-11-23 22:08:35,153 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:08:35,156 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38555 5986s 2024-11-23 22:08:35,156 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38555 5986s 2024-11-23 22:08:35,156 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:08:35,156 - distributed.worker - INFO - dashboard at: 127.0.0.1:37273 5986s 2024-11-23 22:08:35,156 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33793 5986s 2024-11-23 22:08:35,156 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:08:35,156 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:08:35,156 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:08:35,156 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-qjrhvbku 5986s 2024-11-23 22:08:35,157 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:08:35,158 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43823. Reason: failure-to-start- 5986s 2024-11-23 22:08:35,158 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:08:35,158 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38555. Reason: failure-to-start- 5986s 2024-11-23 22:08:35,158 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:08:35,161 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33793': TLS handshake failed with remote 'tls://127.0.0.1:41086': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:08:35,161 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33793': TLS handshake failed with remote 'tls://127.0.0.1:41098': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:08:35,163 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:08:36,168 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:08:36,174 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40145 5986s 2024-11-23 22:08:36,175 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46849/status 5986s 2024-11-23 22:08:36,175 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:08:36,187 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44549 5986s 2024-11-23 22:08:36,187 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44549 5986s 2024-11-23 22:08:36,187 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:08:36,187 - distributed.worker - INFO - dashboard at: 127.0.0.1:39567 5986s 2024-11-23 22:08:36,188 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40145 5986s 2024-11-23 22:08:36,188 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:08:36,188 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:08:36,188 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:08:36,188 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-9r306zq6 5986s 2024-11-23 22:08:36,188 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:08:36,190 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37939 5986s 2024-11-23 22:08:36,190 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37939 5986s 2024-11-23 22:08:36,190 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:08:36,190 - distributed.worker - INFO - dashboard at: 127.0.0.1:34697 5986s 2024-11-23 22:08:36,190 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40145 5986s 2024-11-23 22:08:36,190 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:08:36,190 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:08:36,190 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:08:36,190 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-lm1x1708 5986s 2024-11-23 22:08:36,190 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:08:36,194 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44549. Reason: failure-to-start- 5986s 2024-11-23 22:08:36,195 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:08:36,195 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37939. Reason: failure-to-start- 5986s 2024-11-23 22:08:36,195 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:08:36,196 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40145': TLS handshake failed with remote 'tls://127.0.0.1:40258': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:08:36,196 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40145': TLS handshake failed with remote 'tls://127.0.0.1:40274': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:08:36,197 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:08:37,202 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:08:37,209 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34671 5986s 2024-11-23 22:08:37,209 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35109/status 5986s 2024-11-23 22:08:37,210 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:08:37,222 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40021 5986s 2024-11-23 22:08:37,223 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40021 5986s 2024-11-23 22:08:37,223 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:08:37,223 - distributed.worker - INFO - dashboard at: 127.0.0.1:33963 5986s 2024-11-23 22:08:37,223 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34671 5986s 2024-11-23 22:08:37,223 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:08:37,223 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:08:37,223 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:08:37,223 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-5yurpg6d 5986s 2024-11-23 22:08:37,223 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:08:37,225 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43453 5986s 2024-11-23 22:08:37,225 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43453 5986s 2024-11-23 22:08:37,225 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:08:37,225 - distributed.worker - INFO - dashboard at: 127.0.0.1:43813 5986s 2024-11-23 22:08:37,225 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34671 5986s 2024-11-23 22:08:37,225 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:08:37,225 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:08:37,225 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:08:37,226 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-urcx9e6v 5986s 2024-11-23 22:08:37,226 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:08:37,229 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40021. Reason: failure-to-start- 5986s 2024-11-23 22:08:37,229 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:08:37,229 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43453. Reason: failure-to-start- 5986s 2024-11-23 22:08:37,229 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:08:37,230 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34671': TLS handshake failed with remote 'tls://127.0.0.1:53232': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:08:37,230 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34671': TLS handshake failed with remote 'tls://127.0.0.1:53246': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:08:37,231 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:08:38,236 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:08:38,244 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36689 5986s 2024-11-23 22:08:38,244 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44321/status 5986s 2024-11-23 22:08:38,245 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:08:38,257 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41777 5986s 2024-11-23 22:08:38,258 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41777 5986s 2024-11-23 22:08:38,258 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:08:38,258 - distributed.worker - INFO - dashboard at: 127.0.0.1:45591 5986s 2024-11-23 22:08:38,258 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36689 5986s 2024-11-23 22:08:38,258 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:08:38,258 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:08:38,258 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:08:38,258 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-4uj9wz2f 5986s 2024-11-23 22:08:38,258 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:08:38,260 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43613 5986s 2024-11-23 22:08:38,260 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43613 5986s 2024-11-23 22:08:38,260 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:08:38,260 - distributed.worker - INFO - dashboard at: 127.0.0.1:35841 5986s 2024-11-23 22:08:38,261 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36689 5986s 2024-11-23 22:08:38,261 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:08:38,261 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:08:38,261 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:08:38,261 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-kk6p0oul 5986s 2024-11-23 22:08:38,261 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:08:38,264 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41777. Reason: failure-to-start- 5986s 2024-11-23 22:08:38,264 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:08:38,265 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43613. Reason: failure-to-start- 5986s 2024-11-23 22:08:38,265 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:08:38,266 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36689': TLS handshake failed with remote 'tls://127.0.0.1:38970': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:08:38,266 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36689': TLS handshake failed with remote 'tls://127.0.0.1:38976': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:08:38,267 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:08:39,272 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:08:39,278 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37707 5986s 2024-11-23 22:08:39,278 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39355/status 5986s 2024-11-23 22:08:39,278 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:08:39,292 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35571 5986s 2024-11-23 22:08:39,292 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35571 5986s 2024-11-23 22:08:39,292 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:08:39,292 - distributed.worker - INFO - dashboard at: 127.0.0.1:36215 5986s 2024-11-23 22:08:39,292 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37707 5986s 2024-11-23 22:08:39,292 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:08:39,292 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:08:39,292 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:08:39,292 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-sdgfyg7c 5986s 2024-11-23 22:08:39,292 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:08:39,294 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42323 5986s 2024-11-23 22:08:39,294 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42323 5986s 2024-11-23 22:08:39,294 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:08:39,294 - distributed.worker - INFO - dashboard at: 127.0.0.1:42229 5986s 2024-11-23 22:08:39,294 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37707 5986s 2024-11-23 22:08:39,294 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:08:39,294 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:08:39,294 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:08:39,295 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-wu53faty 5986s 2024-11-23 22:08:39,295 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:08:39,297 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35571. Reason: failure-to-start- 5986s 2024-11-23 22:08:39,298 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:08:39,298 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42323. Reason: failure-to-start- 5986s 2024-11-23 22:08:39,298 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:08:39,299 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37707': TLS handshake failed with remote 'tls://127.0.0.1:49438': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:08:39,299 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37707': TLS handshake failed with remote 'tls://127.0.0.1:49446': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:08:39,300 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:08:40,305 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:08:40,312 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35373 5986s 2024-11-23 22:08:40,312 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38555/status 5986s 2024-11-23 22:08:40,312 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:08:40,325 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38961 5986s 2024-11-23 22:08:40,325 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38961 5986s 2024-11-23 22:08:40,325 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:08:40,325 - distributed.worker - INFO - dashboard at: 127.0.0.1:41131 5986s 2024-11-23 22:08:40,325 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35373 5986s 2024-11-23 22:08:40,325 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:08:40,325 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:08:40,325 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:08:40,326 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-gemv5c95 5986s 2024-11-23 22:08:40,326 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:08:40,328 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33387 5986s 2024-11-23 22:08:40,328 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33387 5986s 2024-11-23 22:08:40,328 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:08:40,328 - distributed.worker - INFO - dashboard at: 127.0.0.1:41841 5986s 2024-11-23 22:08:40,328 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35373 5986s 2024-11-23 22:08:40,329 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:08:40,329 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:08:40,329 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:08:40,329 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-5y8x4wut 5986s 2024-11-23 22:08:40,329 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:08:40,332 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38961. Reason: failure-to-start- 5986s 2024-11-23 22:08:40,332 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:08:40,332 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33387. Reason: failure-to-start- 5986s 2024-11-23 22:08:40,333 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:08:40,333 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35373': TLS handshake failed with remote 'tls://127.0.0.1:35850': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:08:40,334 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35373': TLS handshake failed with remote 'tls://127.0.0.1:35854': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:08:40,335 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:08:41,339 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:08:41,345 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37741 5986s 2024-11-23 22:08:41,346 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41025/status 5986s 2024-11-23 22:08:41,346 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:08:41,360 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33873 5986s 2024-11-23 22:08:41,360 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33873 5986s 2024-11-23 22:08:41,360 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:08:41,360 - distributed.worker - INFO - dashboard at: 127.0.0.1:42175 5986s 2024-11-23 22:08:41,360 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37741 5986s 2024-11-23 22:08:41,360 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:08:41,360 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:08:41,361 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:08:41,361 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-u5m4qzro 5986s 2024-11-23 22:08:41,361 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:08:41,362 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41373 5986s 2024-11-23 22:08:41,362 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41373 5986s 2024-11-23 22:08:41,363 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:08:41,363 - distributed.worker - INFO - dashboard at: 127.0.0.1:45623 5986s 2024-11-23 22:08:41,363 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37741 5986s 2024-11-23 22:08:41,363 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:08:41,363 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:08:41,363 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:08:41,363 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-5wnxkw3q 5986s 2024-11-23 22:08:41,363 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:08:41,364 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33873. Reason: failure-to-start- 5986s 2024-11-23 22:08:41,364 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:08:41,365 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41373. Reason: failure-to-start- 5986s 2024-11-23 22:08:41,365 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:08:41,366 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37741': TLS handshake failed with remote 'tls://127.0.0.1:60962': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:08:41,366 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37741': TLS handshake failed with remote 'tls://127.0.0.1:60972': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:08:41,367 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:08:42,372 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:08:42,378 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36429 5986s 2024-11-23 22:08:42,379 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38493/status 5986s 2024-11-23 22:08:42,379 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s _____________________________ test_retire_workers ______________________________ 5986s 5986s fut = , timeout = 0 5986s 5986s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 5986s async with asyncio.timeout(timeout): 5986s > return await fut 5986s 5986s /usr/lib/python3/dist-packages/distributed/utils.py:1960: 5986s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5986s /usr/lib/python3/dist-packages/distributed/nanny.py:358: in start_unsafe 5986s comm = await self.rpc.connect(saddr) 5986s /usr/lib/python3/dist-packages/distributed/core.py:1620: in connect 5986s return await self._connect(addr=addr, timeout=timeout) 5986s /usr/lib/python3/dist-packages/distributed/core.py:1564: in _connect 5986s comm = await connect( 5986s /usr/lib/python3/dist-packages/distributed/comm/core.py:342: in connect 5986s comm = await wait_for( 5986s /usr/lib/python3/dist-packages/distributed/utils.py:1960: in wait_for 5986s return await fut 5986s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:546: in connect 5986s stream = await self.client.connect( 5986s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5986s 5986s self = , host = '127.0.0.1' 5986s port = 42031, af = 5986s ssl_options = 5986s max_buffer_size = 8364507136.0, source_ip = None, source_port = None 5986s timeout = None 5986s 5986s async def connect( 5986s self, 5986s host: str, 5986s port: int, 5986s af: socket.AddressFamily = socket.AF_UNSPEC, 5986s ssl_options: Optional[Union[Dict[str, Any], ssl.SSLContext]] = None, 5986s max_buffer_size: Optional[int] = None, 5986s source_ip: Optional[str] = None, 5986s source_port: Optional[int] = None, 5986s timeout: Optional[Union[float, datetime.timedelta]] = None, 5986s ) -> IOStream: 5986s """Connect to the given host and port. 5986s 5986s Asynchronously returns an `.IOStream` (or `.SSLIOStream` if 5986s ``ssl_options`` is not None). 5986s 5986s Using the ``source_ip`` kwarg, one can specify the source 5986s IP address to use when establishing the connection. 5986s In case the user needs to resolve and 5986s use a specific interface, it has to be handled outside 5986s of Tornado as this depends very much on the platform. 5986s 5986s Raises `TimeoutError` if the input future does not complete before 5986s ``timeout``, which may be specified in any form allowed by 5986s `.IOLoop.add_timeout` (i.e. a `datetime.timedelta` or an absolute time 5986s relative to `.IOLoop.time`) 5986s 5986s Similarly, when the user requires a certain source port, it can 5986s be specified using the ``source_port`` arg. 5986s 5986s .. versionchanged:: 4.5 5986s Added the ``source_ip`` and ``source_port`` arguments. 5986s 5986s .. versionchanged:: 5.0 5986s Added the ``timeout`` argument. 5986s """ 5986s if timeout is not None: 5986s if isinstance(timeout, numbers.Real): 5986s timeout = IOLoop.current().time() + timeout 5986s elif isinstance(timeout, datetime.timedelta): 5986s timeout = IOLoop.current().time() + timeout.total_seconds() 5986s else: 5986s raise TypeError("Unsupported timeout %r" % timeout) 5986s if timeout is not None: 5986s addrinfo = await gen.with_timeout( 5986s timeout, self.resolver.resolve(host, port, af) 5986s ) 5986s else: 5986s addrinfo = await self.resolver.resolve(host, port, af) 5986s connector = _Connector( 5986s addrinfo, 5986s functools.partial( 5986s self._create_stream, 5986s max_buffer_size, 5986s source_ip=source_ip, 5986s source_port=source_port, 5986s ), 5986s ) 5986s > af, addr, stream = await connector.start(connect_timeout=timeout) 5986s E asyncio.exceptions.CancelledError 5986s 5986s /usr/lib/python3/dist-packages/tornado/tcpclient.py:279: CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s self = 5986s 5986s @final 5986s async def start(self): 5986s async with self._startup_lock: 5986s if self.status == Status.failed: 5986s assert self.__startup_exc is not None 5986s raise self.__startup_exc 5986s elif self.status != Status.init: 5986s return self 5986s timeout = getattr(self, "death_timeout", None) 5986s 5986s async def _close_on_failure(exc: Exception) -> None: 5986s await self.close(reason=f"failure-to-start-{str(type(exc))}") 5986s self.status = Status.failed 5986s self.__startup_exc = exc 5986s 5986s try: 5986s > await wait_for(self.start_unsafe(), timeout=timeout) 5986s 5986s /usr/lib/python3/dist-packages/distributed/core.py:664: 5986s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5986s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 5986s async with asyncio.timeout(timeout): 5986s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5986s 5986s self = 5986s exc_type = 5986s exc_val = CancelledError(), exc_tb = 5986s 5986s async def __aexit__( 5986s self, 5986s exc_type: Optional[Type[BaseException]], 5986s exc_val: Optional[BaseException], 5986s exc_tb: Optional[TracebackType], 5986s ) -> Optional[bool]: 5986s assert self._state in (_State.ENTERED, _State.EXPIRING) 5986s 5986s if self._timeout_handler is not None: 5986s self._timeout_handler.cancel() 5986s self._timeout_handler = None 5986s 5986s if self._state is _State.EXPIRING: 5986s self._state = _State.EXPIRED 5986s 5986s if self._task.uncancel() <= self._cancelling and exc_type is not None: 5986s # Since there are no new cancel requests, we're 5986s # handling this. 5986s if issubclass(exc_type, exceptions.CancelledError): 5986s > raise TimeoutError from exc_val 5986s E TimeoutError 5986s 5986s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s @contextlib.asynccontextmanager 5986s async def _cluster_factory(): 5986s workers = [] 5986s s = None 5986s try: 5986s for _ in range(60): 5986s try: 5986s > s, ws = await start_cluster( 5986s nthreads, 5986s scheduler, 5986s security=security, 5986s Worker=Worker, 5986s scheduler_kwargs=scheduler_kwargs, 5986s worker_kwargs=merge( 5986s {"death_timeout": min(15, int(deadline.remaining))}, 5986s worker_kwargs, 5986s ), 5986s ) 5986s 5986s /usr/lib/python3/dist-packages/distributed/utils_test.py:966: 5986s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5986s /usr/lib/python3/dist-packages/distributed/utils_test.py:789: in start_cluster 5986s await asyncio.gather(*workers) 5986s /usr/lib/python3.13/asyncio/tasks.py:737: in _wrap_awaitable 5986s return await awaitable 5986s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5986s 5986s self = 5986s 5986s @final 5986s async def start(self): 5986s async with self._startup_lock: 5986s if self.status == Status.failed: 5986s assert self.__startup_exc is not None 5986s raise self.__startup_exc 5986s elif self.status != Status.init: 5986s return self 5986s timeout = getattr(self, "death_timeout", None) 5986s 5986s async def _close_on_failure(exc: Exception) -> None: 5986s await self.close(reason=f"failure-to-start-{str(type(exc))}") 5986s self.status = Status.failed 5986s self.__startup_exc = exc 5986s 5986s try: 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s except asyncio.TimeoutError as exc: 5986s await _close_on_failure(exc) 5986s > raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s E TimeoutError: Nanny start timed out after 0s. 5986s 5986s /usr/lib/python3/dist-packages/distributed/core.py:667: TimeoutError 5986s 5986s During handling of the above exception, another exception occurred: 5986s 5986s fut = ._..test_func..async_fn at 0xde81abf0> 5986s timeout = 60 5986s 5986s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 5986s async with asyncio.timeout(timeout): 5986s > return await fut 5986s 5986s /usr/lib/python3/dist-packages/distributed/utils.py:1960: 5986s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5986s /usr/lib/python3/dist-packages/distributed/utils_test.py:999: in async_fn 5986s _cluster_factory() as (s, workers), 5986s /usr/lib/python3.13/contextlib.py:214: in __aenter__ 5986s return await anext(self.gen) 5986s /usr/lib/python3/dist-packages/distributed/utils_test.py:983: in _cluster_factory 5986s await asyncio.sleep(1) 5986s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5986s 5986s delay = 1, result = None 5986s 5986s async def sleep(delay, result=None): 5986s """Coroutine that completes after a given time (in seconds).""" 5986s if delay <= 0: 5986s await __sleep0() 5986s return result 5986s 5986s if math.isnan(delay): 5986s raise ValueError("Invalid delay: NaN (not a number)") 5986s 5986s loop = events.get_running_loop() 5986s future = loop.create_future() 5986s h = loop.call_later(delay, 5986s futures._set_result_unless_cancelled, 5986s future, result) 5986s try: 5986s > return await future 5986s E asyncio.exceptions.CancelledError 5986s 5986s /usr/lib/python3.13/asyncio/tasks.py:718: CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s args = (), kwds = {} 5986s 5986s @wraps(func) 5986s def inner(*args, **kwds): 5986s with self._recreate_cm(): 5986s > return func(*args, **kwds) 5986s 5986s /usr/lib/python3.13/contextlib.py:85: 5986s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5986s /usr/lib/python3.13/contextlib.py:85: in inner 5986s return func(*args, **kwds) 5986s /usr/lib/python3/dist-packages/distributed/utils_test.py:1102: in test_func 5986s return _run_and_close_tornado(async_fn_outer) 5986s /usr/lib/python3/dist-packages/distributed/utils_test.py:378: in _run_and_close_tornado 5986s return asyncio_run(inner_fn(), loop_factory=get_loop_factory()) 5986s /usr/lib/python3.13/asyncio/runners.py:194: in run 5986s return runner.run(main) 5986s /usr/lib/python3.13/asyncio/runners.py:118: in run 5986s return self._loop.run_until_complete(task) 5986s /usr/lib/python3.13/asyncio/base_events.py:720: in run_until_complete 5986s return future.result() 5986s /usr/lib/python3/dist-packages/distributed/utils_test.py:375: in inner_fn 5986s return await async_fn(*args, **kwargs) 5986s /usr/lib/python3/dist-packages/distributed/utils_test.py:1099: in async_fn_outer 5986s return await utils_wait_for(async_fn(), timeout=timeout * 2) 5986s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 5986s async with asyncio.timeout(timeout): 5986s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5986s 5986s self = 5986s exc_type = 5986s exc_val = CancelledError(), exc_tb = 5986s 5986s async def __aexit__( 5986s self, 5986s exc_type: Optional[Type[BaseException]], 5986s exc_val: Optional[BaseException], 5986s exc_tb: Optional[TracebackType], 5986s ) -> Optional[bool]: 5986s assert self._state in (_State.ENTERED, _State.EXPIRING) 5986s 5986s if self._timeout_handler is not None: 5986s self._timeout_handler.cancel() 5986s self._timeout_handler = None 5986s 5986s if self._state is _State.EXPIRING: 5986s self._state = _State.EXPIRED 5986s 5986s if self._task.uncancel() <= self._cancelling and exc_type is not None: 5986s # Since there are no new cancel requests, we're 5986s # handling this. 5986s if issubclass(exc_type, exceptions.CancelledError): 5986s > raise TimeoutError from exc_val 5986s E TimeoutError 5986s 5986s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 5986s ----------------------------- Captured stderr call ----------------------------- 5986s 2024-11-23 22:08:43,021 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:08:43,026 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42599 5986s 2024-11-23 22:08:43,026 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42679/status 5986s 2024-11-23 22:08:43,026 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:08:43,046 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:46281'. Reason: failure-to-start- 5986s 2024-11-23 22:08:43,047 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:41493'. Reason: failure-to-start- 5986s 2024-11-23 22:08:43,047 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42599': TLS handshake failed with remote 'tls://127.0.0.1:35474': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:43,047 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42599': TLS handshake failed with remote 'tls://127.0.0.1:35482': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:43,047 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 5986s stream = await stream.start_tls( 5986s ^^^^^^^^^^^^^^^^^^^^^^^ 5986s False, ssl_options=ssl_options, server_hostname=host 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 5986s self.socket.do_handshake() 5986s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 5986s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 5986s self._sslobj.do_handshake() 5986s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 5986s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5986s comm = await self.rpc.connect(saddr) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 5986s return await self._connect(addr=addr, timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 5986s comm = await connect( 5986s ^^^^^^^^^^^^^^ 5986s ...<4 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 5986s raise FatalCommClosedError( 5986s ...<2 lines>... 5986s ) from err 5986s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 5986s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 5986s RuntimeError: Nanny failed to start. 5986s 2024-11-23 22:08:44,052 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:08:44,058 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35801 5986s 2024-11-23 22:08:44,058 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36269/status 5986s 2024-11-23 22:08:44,058 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:08:44,080 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:42029'. Reason: failure-to-start- 5986s 2024-11-23 22:08:44,080 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:45665'. Reason: failure-to-start- 5986s 2024-11-23 22:08:44,080 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35801': TLS handshake failed with remote 'tls://127.0.0.1:44134': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:44,081 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35801': TLS handshake failed with remote 'tls://127.0.0.1:44150': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:44,081 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 5986s stream = await stream.start_tls( 5986s ^^^^^^^^^^^^^^^^^^^^^^^ 5986s False, ssl_options=ssl_options, server_hostname=host 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 5986s self.socket.do_handshake() 5986s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 5986s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 5986s self._sslobj.do_handshake() 5986s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 5986s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5986s comm = await self.rpc.connect(saddr) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 5986s return await self._connect(addr=addr, timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 5986s comm = await connect( 5986s ^^^^^^^^^^^^^^ 5986s ...<4 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 5986s raise FatalCommClosedError( 5986s ...<2 lines>... 5986s ) from err 5986s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 5986s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 5986s RuntimeError: Nanny failed to start. 5986s 2024-11-23 22:08:45,085 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:08:45,091 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38901 5986s 2024-11-23 22:08:45,091 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36805/status 5986s 2024-11-23 22:08:45,091 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:08:45,112 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:44903'. Reason: failure-to-start- 5986s 2024-11-23 22:08:45,112 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:41269'. Reason: failure-to-start- 5986s 2024-11-23 22:08:45,112 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38901': TLS handshake failed with remote 'tls://127.0.0.1:49062': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:45,113 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38901': TLS handshake failed with remote 'tls://127.0.0.1:49076': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:45,113 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 5986s stream = await stream.start_tls( 5986s ^^^^^^^^^^^^^^^^^^^^^^^ 5986s False, ssl_options=ssl_options, server_hostname=host 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 5986s self.socket.do_handshake() 5986s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 5986s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 5986s self._sslobj.do_handshake() 5986s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 5986s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5986s comm = await self.rpc.connect(saddr) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 5986s return await self._connect(addr=addr, timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 5986s comm = await connect( 5986s ^^^^^^^^^^^^^^ 5986s ...<4 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 5986s raise FatalCommClosedError( 5986s ...<2 lines>... 5986s ) from err 5986s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 5986s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 5986s RuntimeError: Nanny failed to start. 5986s 2024-11-23 22:08:46,117 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:08:46,123 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45869 5986s 2024-11-23 22:08:46,123 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39243/status 5986s 2024-11-23 22:08:46,123 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:08:46,144 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:42795'. Reason: failure-to-start- 5986s 2024-11-23 22:08:46,145 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:45801'. Reason: failure-to-start- 5986s 2024-11-23 22:08:46,145 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45869': TLS handshake failed with remote 'tls://127.0.0.1:48026': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:46,145 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45869': TLS handshake failed with remote 'tls://127.0.0.1:48036': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:46,145 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 5986s stream = await stream.start_tls( 5986s ^^^^^^^^^^^^^^^^^^^^^^^ 5986s False, ssl_options=ssl_options, server_hostname=host 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 5986s self.socket.do_handshake() 5986s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 5986s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 5986s self._sslobj.do_handshake() 5986s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 5986s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5986s comm = await self.rpc.connect(saddr) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 5986s return await self._connect(addr=addr, timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 5986s comm = await connect( 5986s ^^^^^^^^^^^^^^ 5986s ...<4 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 5986s raise FatalCommClosedError( 5986s ...<2 lines>... 5986s ) from err 5986s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 5986s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 5986s RuntimeError: Nanny failed to start. 5986s 2024-11-23 22:08:47,151 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:08:47,156 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44663 5986s 2024-11-23 22:08:47,157 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37599/status 5986s 2024-11-23 22:08:47,157 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:08:47,177 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:43659'. Reason: failure-to-start- 5986s 2024-11-23 22:08:47,177 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:46669'. Reason: failure-to-start- 5986s 2024-11-23 22:08:47,177 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44663': TLS handshake failed with remote 'tls://127.0.0.1:37566': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:47,177 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44663': TLS handshake failed with remote 'tls://127.0.0.1:37580': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:47,177 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 5986s stream = await stream.start_tls( 5986s ^^^^^^^^^^^^^^^^^^^^^^^ 5986s False, ssl_options=ssl_options, server_hostname=host 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 5986s self.socket.do_handshake() 5986s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 5986s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 5986s self._sslobj.do_handshake() 5986s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 5986s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5986s comm = await self.rpc.connect(saddr) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 5986s return await self._connect(addr=addr, timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 5986s comm = await connect( 5986s ^^^^^^^^^^^^^^ 5986s ...<4 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 5986s raise FatalCommClosedError( 5986s ...<2 lines>... 5986s ) from err 5986s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 5986s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 5986s RuntimeError: Nanny failed to start. 5986s 2024-11-23 22:08:48,182 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:08:48,188 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38825 5986s 2024-11-23 22:08:48,189 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37823/status 5986s 2024-11-23 22:08:48,189 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:08:48,209 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:45931'. Reason: failure-to-start- 5986s 2024-11-23 22:08:48,209 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:43689'. Reason: failure-to-start- 5986s 2024-11-23 22:08:48,210 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38825': TLS handshake failed with remote 'tls://127.0.0.1:58102': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:48,210 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38825': TLS handshake failed with remote 'tls://127.0.0.1:58108': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:48,210 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 5986s stream = await stream.start_tls( 5986s ^^^^^^^^^^^^^^^^^^^^^^^ 5986s False, ssl_options=ssl_options, server_hostname=host 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 5986s self.socket.do_handshake() 5986s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 5986s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 5986s self._sslobj.do_handshake() 5986s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 5986s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5986s comm = await self.rpc.connect(saddr) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 5986s return await self._connect(addr=addr, timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 5986s comm = await connect( 5986s ^^^^^^^^^^^^^^ 5986s ...<4 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 5986s raise FatalCommClosedError( 5986s ...<2 lines>... 5986s ) from err 5986s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 5986s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 5986s RuntimeError: Nanny failed to start. 5986s 2024-11-23 22:08:49,214 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:08:49,220 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43623 5986s 2024-11-23 22:08:49,220 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35485/status 5986s 2024-11-23 22:08:49,220 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:08:49,241 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:35197'. Reason: failure-to-start- 5986s 2024-11-23 22:08:49,242 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:46775'. Reason: failure-to-start- 5986s 2024-11-23 22:08:49,242 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:55712': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:49,242 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43623': TLS handshake failed with remote 'tls://127.0.0.1:55718': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:49,242 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 5986s stream = await stream.start_tls( 5986s ^^^^^^^^^^^^^^^^^^^^^^^ 5986s False, ssl_options=ssl_options, server_hostname=host 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 5986s self.socket.do_handshake() 5986s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 5986s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 5986s self._sslobj.do_handshake() 5986s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 5986s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5986s comm = await self.rpc.connect(saddr) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 5986s return await self._connect(addr=addr, timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 5986s comm = await connect( 5986s ^^^^^^^^^^^^^^ 5986s ...<4 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 5986s raise FatalCommClosedError( 5986s ...<2 lines>... 5986s ) from err 5986s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 5986s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 5986s RuntimeError: Nanny failed to start. 5986s 2024-11-23 22:08:50,249 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:08:50,255 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44593 5986s 2024-11-23 22:08:50,255 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41839/status 5986s 2024-11-23 22:08:50,255 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:08:50,276 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:42305'. Reason: failure-to-start- 5986s 2024-11-23 22:08:50,276 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:42047'. Reason: failure-to-start- 5986s 2024-11-23 22:08:50,276 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44593': TLS handshake failed with remote 'tls://127.0.0.1:48210': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:50,276 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44593': TLS handshake failed with remote 'tls://127.0.0.1:48218': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:50,276 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 5986s stream = await stream.start_tls( 5986s ^^^^^^^^^^^^^^^^^^^^^^^ 5986s False, ssl_options=ssl_options, server_hostname=host 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 5986s self.socket.do_handshake() 5986s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 5986s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 5986s self._sslobj.do_handshake() 5986s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 5986s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5986s comm = await self.rpc.connect(saddr) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 5986s return await self._connect(addr=addr, timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 5986s comm = await connect( 5986s ^^^^^^^^^^^^^^ 5986s ...<4 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 5986s raise FatalCommClosedError( 5986s ...<2 lines>... 5986s ) from err 5986s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 5986s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 5986s RuntimeError: Nanny failed to start. 5986s 2024-11-23 22:08:51,282 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:08:51,287 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38283 5986s 2024-11-23 22:08:51,287 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33371/status 5986s 2024-11-23 22:08:51,288 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:08:51,309 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:40085'. Reason: failure-to-start- 5986s 2024-11-23 22:08:51,309 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:35237'. Reason: failure-to-start- 5986s 2024-11-23 22:08:51,309 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38283': TLS handshake failed with remote 'tls://127.0.0.1:42566': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:51,309 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38283': TLS handshake failed with remote 'tls://127.0.0.1:42574': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:51,309 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 5986s stream = await stream.start_tls( 5986s ^^^^^^^^^^^^^^^^^^^^^^^ 5986s False, ssl_options=ssl_options, server_hostname=host 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 5986s self.socket.do_handshake() 5986s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 5986s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 5986s self._sslobj.do_handshake() 5986s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 5986s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5986s comm = await self.rpc.connect(saddr) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 5986s return await self._connect(addr=addr, timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 5986s comm = await connect( 5986s ^^^^^^^^^^^^^^ 5986s ...<4 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 5986s raise FatalCommClosedError( 5986s ...<2 lines>... 5986s ) from err 5986s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 5986s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 5986s RuntimeError: Nanny failed to start. 5986s 2024-11-23 22:08:52,315 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:08:52,321 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37155 5986s 2024-11-23 22:08:52,321 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45797/status 5986s 2024-11-23 22:08:52,321 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:08:52,344 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:46425'. Reason: failure-to-start- 5986s 2024-11-23 22:08:52,344 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:34549'. Reason: failure-to-start- 5986s 2024-11-23 22:08:52,344 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37155': TLS handshake failed with remote 'tls://127.0.0.1:53856': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:52,345 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37155': TLS handshake failed with remote 'tls://127.0.0.1:53858': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:52,345 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 5986s stream = await stream.start_tls( 5986s ^^^^^^^^^^^^^^^^^^^^^^^ 5986s False, ssl_options=ssl_options, server_hostname=host 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 5986s self.socket.do_handshake() 5986s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 5986s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 5986s self._sslobj.do_handshake() 5986s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 5986s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5986s comm = await self.rpc.connect(saddr) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 5986s return await self._connect(addr=addr, timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 5986s comm = await connect( 5986s ^^^^^^^^^^^^^^ 5986s ...<4 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 5986s raise FatalCommClosedError( 5986s ...<2 lines>... 5986s ) from err 5986s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 5986s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 5986s RuntimeError: Nanny failed to start. 5986s 2024-11-23 22:08:53,350 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:08:53,356 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42523 5986s 2024-11-23 22:08:53,356 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34045/status 5986s 2024-11-23 22:08:53,356 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:08:53,379 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:46799'. Reason: failure-to-start- 5986s 2024-11-23 22:08:53,380 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:45763'. Reason: failure-to-start- 5986s 2024-11-23 22:08:53,380 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42523': TLS handshake failed with remote 'tls://127.0.0.1:40310': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:53,380 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42523': TLS handshake failed with remote 'tls://127.0.0.1:40314': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:53,380 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 5986s stream = await stream.start_tls( 5986s ^^^^^^^^^^^^^^^^^^^^^^^ 5986s False, ssl_options=ssl_options, server_hostname=host 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 5986s self.socket.do_handshake() 5986s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 5986s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 5986s self._sslobj.do_handshake() 5986s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 5986s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5986s comm = await self.rpc.connect(saddr) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 5986s return await self._connect(addr=addr, timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 5986s comm = await connect( 5986s ^^^^^^^^^^^^^^ 5986s ...<4 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 5986s raise FatalCommClosedError( 5986s ...<2 lines>... 5986s ) from err 5986s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 5986s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 5986s RuntimeError: Nanny failed to start. 5986s 2024-11-23 22:08:54,386 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:08:54,392 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36781 5986s 2024-11-23 22:08:54,392 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40001/status 5986s 2024-11-23 22:08:54,392 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:08:54,412 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:37613'. Reason: failure-to-start- 5986s 2024-11-23 22:08:54,412 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:43047'. Reason: failure-to-start- 5986s 2024-11-23 22:08:54,413 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36781': TLS handshake failed with remote 'tls://127.0.0.1:52708': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:54,413 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36781': TLS handshake failed with remote 'tls://127.0.0.1:52712': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:54,413 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 5986s stream = await stream.start_tls( 5986s ^^^^^^^^^^^^^^^^^^^^^^^ 5986s False, ssl_options=ssl_options, server_hostname=host 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 5986s self.socket.do_handshake() 5986s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 5986s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 5986s self._sslobj.do_handshake() 5986s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 5986s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5986s comm = await self.rpc.connect(saddr) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 5986s return await self._connect(addr=addr, timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 5986s comm = await connect( 5986s ^^^^^^^^^^^^^^ 5986s ...<4 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 5986s raise FatalCommClosedError( 5986s ...<2 lines>... 5986s ) from err 5986s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 5986s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 5986s RuntimeError: Nanny failed to start. 5986s 2024-11-23 22:08:55,419 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:08:55,424 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33205 5986s 2024-11-23 22:08:55,425 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37713/status 5986s 2024-11-23 22:08:55,425 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:08:55,450 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:39061'. Reason: failure-to-start- 5986s 2024-11-23 22:08:55,450 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:44759'. Reason: failure-to-start- 5986s 2024-11-23 22:08:55,450 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33205': TLS handshake failed with remote 'tls://127.0.0.1:40186': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:55,450 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33205': TLS handshake failed with remote 'tls://127.0.0.1:40200': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:55,451 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 5986s stream = await stream.start_tls( 5986s ^^^^^^^^^^^^^^^^^^^^^^^ 5986s False, ssl_options=ssl_options, server_hostname=host 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 5986s self.socket.do_handshake() 5986s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 5986s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 5986s self._sslobj.do_handshake() 5986s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 5986s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5986s comm = await self.rpc.connect(saddr) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 5986s return await self._connect(addr=addr, timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 5986s comm = await connect( 5986s ^^^^^^^^^^^^^^ 5986s ...<4 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 5986s raise FatalCommClosedError( 5986s ...<2 lines>... 5986s ) from err 5986s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 5986s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 5986s RuntimeError: Nanny failed to start. 5986s 2024-11-23 22:08:56,456 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:08:56,461 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34479 5986s 2024-11-23 22:08:56,461 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46257/status 5986s 2024-11-23 22:08:56,462 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:08:56,483 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:43967'. Reason: failure-to-start- 5986s 2024-11-23 22:08:56,483 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:34897'. Reason: failure-to-start- 5986s 2024-11-23 22:08:56,483 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34479': TLS handshake failed with remote 'tls://127.0.0.1:47748': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:56,483 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34479': TLS handshake failed with remote 'tls://127.0.0.1:47754': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:56,483 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 5986s stream = await stream.start_tls( 5986s ^^^^^^^^^^^^^^^^^^^^^^^ 5986s False, ssl_options=ssl_options, server_hostname=host 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 5986s self.socket.do_handshake() 5986s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 5986s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 5986s self._sslobj.do_handshake() 5986s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 5986s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5986s comm = await self.rpc.connect(saddr) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 5986s return await self._connect(addr=addr, timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 5986s comm = await connect( 5986s ^^^^^^^^^^^^^^ 5986s ...<4 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 5986s raise FatalCommClosedError( 5986s ...<2 lines>... 5986s ) from err 5986s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 5986s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 5986s RuntimeError: Nanny failed to start. 5986s 2024-11-23 22:08:57,489 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:08:57,495 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39297 5986s 2024-11-23 22:08:57,495 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39705/status 5986s 2024-11-23 22:08:57,495 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:08:57,520 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:44693'. Reason: failure-to-start- 5986s 2024-11-23 22:08:57,520 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:36949'. Reason: failure-to-start- 5986s 2024-11-23 22:08:57,521 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39297': TLS handshake failed with remote 'tls://127.0.0.1:53614': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:57,521 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39297': TLS handshake failed with remote 'tls://127.0.0.1:53620': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:57,521 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 5986s stream = await stream.start_tls( 5986s ^^^^^^^^^^^^^^^^^^^^^^^ 5986s False, ssl_options=ssl_options, server_hostname=host 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 5986s self.socket.do_handshake() 5986s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 5986s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 5986s self._sslobj.do_handshake() 5986s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 5986s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5986s comm = await self.rpc.connect(saddr) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 5986s return await self._connect(addr=addr, timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 5986s comm = await connect( 5986s ^^^^^^^^^^^^^^ 5986s ...<4 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 5986s raise FatalCommClosedError( 5986s ...<2 lines>... 5986s ) from err 5986s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 5986s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 5986s RuntimeError: Nanny failed to start. 5986s 2024-11-23 22:08:58,526 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:08:58,532 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:32833 5986s 2024-11-23 22:08:58,532 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36503/status 5986s 2024-11-23 22:08:58,532 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:08:58,555 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:34603'. Reason: failure-to-start- 5986s 2024-11-23 22:08:58,556 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:42723'. Reason: failure-to-start- 5986s 2024-11-23 22:08:58,556 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:32833': TLS handshake failed with remote 'tls://127.0.0.1:45934': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:58,556 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:32833': TLS handshake failed with remote 'tls://127.0.0.1:45942': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:58,556 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 5986s stream = await stream.start_tls( 5986s ^^^^^^^^^^^^^^^^^^^^^^^ 5986s False, ssl_options=ssl_options, server_hostname=host 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 5986s self.socket.do_handshake() 5986s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 5986s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 5986s self._sslobj.do_handshake() 5986s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 5986s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5986s comm = await self.rpc.connect(saddr) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 5986s return await self._connect(addr=addr, timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 5986s comm = await connect( 5986s ^^^^^^^^^^^^^^ 5986s ...<4 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 5986s raise FatalCommClosedError( 5986s ...<2 lines>... 5986s ) from err 5986s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 5986s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 5986s RuntimeError: Nanny failed to start. 5986s 2024-11-23 22:08:59,563 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:08:59,568 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42667 5986s 2024-11-23 22:08:59,568 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33437/status 5986s 2024-11-23 22:08:59,569 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:08:59,610 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:32883'. Reason: failure-to-start- 5986s 2024-11-23 22:08:59,611 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:44183'. Reason: failure-to-start- 5986s 2024-11-23 22:08:59,612 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42667': TLS handshake failed with remote 'tls://127.0.0.1:40670': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:59,613 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42667': TLS handshake failed with remote 'tls://127.0.0.1:40684': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:08:59,613 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 5986s stream = await stream.start_tls( 5986s ^^^^^^^^^^^^^^^^^^^^^^^ 5986s False, ssl_options=ssl_options, server_hostname=host 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 5986s self.socket.do_handshake() 5986s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 5986s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 5986s self._sslobj.do_handshake() 5986s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 5986s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5986s comm = await self.rpc.connect(saddr) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 5986s return await self._connect(addr=addr, timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 5986s comm = await connect( 5986s ^^^^^^^^^^^^^^ 5986s ...<4 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 5986s raise FatalCommClosedError( 5986s ...<2 lines>... 5986s ) from err 5986s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 5986s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 5986s RuntimeError: Nanny failed to start. 5986s 2024-11-23 22:09:00,621 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:09:00,632 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35009 5986s 2024-11-23 22:09:00,632 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33961/status 5986s 2024-11-23 22:09:00,633 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:09:00,676 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:39887'. Reason: failure-to-start- 5986s 2024-11-23 22:09:00,677 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:43151'. Reason: failure-to-start- 5986s 2024-11-23 22:09:00,678 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35009': TLS handshake failed with remote 'tls://127.0.0.1:46308': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:00,678 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35009': TLS handshake failed with remote 'tls://127.0.0.1:46314': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:00,679 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 5986s stream = await stream.start_tls( 5986s ^^^^^^^^^^^^^^^^^^^^^^^ 5986s False, ssl_options=ssl_options, server_hostname=host 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 5986s self.socket.do_handshake() 5986s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 5986s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 5986s self._sslobj.do_handshake() 5986s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 5986s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5986s comm = await self.rpc.connect(saddr) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 5986s return await self._connect(addr=addr, timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 5986s comm = await connect( 5986s ^^^^^^^^^^^^^^ 5986s ...<4 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 5986s raise FatalCommClosedError( 5986s ...<2 lines>... 5986s ) from err 5986s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 5986s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 5986s RuntimeError: Nanny failed to start. 5986s 2024-11-23 22:09:01,687 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:09:01,701 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35673 5986s 2024-11-23 22:09:01,701 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35251/status 5986s 2024-11-23 22:09:01,702 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:09:01,745 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:35213'. Reason: failure-to-start- 5986s 2024-11-23 22:09:01,746 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:38167'. Reason: failure-to-start- 5986s 2024-11-23 22:09:01,747 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35673': TLS handshake failed with remote 'tls://127.0.0.1:56188': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:01,748 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35673': TLS handshake failed with remote 'tls://127.0.0.1:56198': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:01,748 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 5986s stream = await stream.start_tls( 5986s ^^^^^^^^^^^^^^^^^^^^^^^ 5986s False, ssl_options=ssl_options, server_hostname=host 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 5986s self.socket.do_handshake() 5986s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 5986s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 5986s self._sslobj.do_handshake() 5986s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 5986s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5986s comm = await self.rpc.connect(saddr) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 5986s return await self._connect(addr=addr, timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 5986s comm = await connect( 5986s ^^^^^^^^^^^^^^ 5986s ...<4 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 5986s raise FatalCommClosedError( 5986s ...<2 lines>... 5986s ) from err 5986s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 5986s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 5986s RuntimeError: Nanny failed to start. 5986s 2024-11-23 22:09:02,756 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:09:02,767 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38057 5986s 2024-11-23 22:09:02,767 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43649/status 5986s 2024-11-23 22:09:02,768 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:09:02,810 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:43573'. Reason: failure-to-start- 5986s 2024-11-23 22:09:02,811 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:46591'. Reason: failure-to-start- 5986s 2024-11-23 22:09:02,812 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38057': TLS handshake failed with remote 'tls://127.0.0.1:56076': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:02,812 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38057': TLS handshake failed with remote 'tls://127.0.0.1:56082': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:02,813 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 5986s stream = await stream.start_tls( 5986s ^^^^^^^^^^^^^^^^^^^^^^^ 5986s False, ssl_options=ssl_options, server_hostname=host 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 5986s self.socket.do_handshake() 5986s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 5986s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 5986s self._sslobj.do_handshake() 5986s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 5986s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5986s comm = await self.rpc.connect(saddr) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 5986s return await self._connect(addr=addr, timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 5986s comm = await connect( 5986s ^^^^^^^^^^^^^^ 5986s ...<4 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 5986s raise FatalCommClosedError( 5986s ...<2 lines>... 5986s ) from err 5986s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 5986s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 5986s RuntimeError: Nanny failed to start. 5986s 2024-11-23 22:09:03,823 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:09:03,834 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45781 5986s 2024-11-23 22:09:03,835 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39697/status 5986s 2024-11-23 22:09:03,835 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:09:03,880 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:33285'. Reason: failure-to-start- 5986s 2024-11-23 22:09:03,880 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:34071'. Reason: failure-to-start- 5986s 2024-11-23 22:09:03,882 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45781': TLS handshake failed with remote 'tls://127.0.0.1:37122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:03,882 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45781': TLS handshake failed with remote 'tls://127.0.0.1:37128': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:03,882 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 5986s stream = await stream.start_tls( 5986s ^^^^^^^^^^^^^^^^^^^^^^^ 5986s False, ssl_options=ssl_options, server_hostname=host 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 5986s self.socket.do_handshake() 5986s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 5986s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 5986s self._sslobj.do_handshake() 5986s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 5986s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5986s comm = await self.rpc.connect(saddr) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 5986s return await self._connect(addr=addr, timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 5986s comm = await connect( 5986s ^^^^^^^^^^^^^^ 5986s ...<4 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 5986s raise FatalCommClosedError( 5986s ...<2 lines>... 5986s ) from err 5986s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 5986s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 5986s RuntimeError: Nanny failed to start. 5986s 2024-11-23 22:09:04,891 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:09:04,901 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39975 5986s 2024-11-23 22:09:04,902 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43513/status 5986s 2024-11-23 22:09:04,902 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:09:04,948 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:46363'. Reason: failure-to-start- 5986s 2024-11-23 22:09:04,949 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:36383'. Reason: failure-to-start- 5986s 2024-11-23 22:09:04,950 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39975': TLS handshake failed with remote 'tls://127.0.0.1:59576': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:04,951 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39975': TLS handshake failed with remote 'tls://127.0.0.1:59588': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:04,951 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 5986s stream = await stream.start_tls( 5986s ^^^^^^^^^^^^^^^^^^^^^^^ 5986s False, ssl_options=ssl_options, server_hostname=host 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 5986s self.socket.do_handshake() 5986s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 5986s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 5986s self._sslobj.do_handshake() 5986s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 5986s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5986s comm = await self.rpc.connect(saddr) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 5986s return await self._connect(addr=addr, timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 5986s comm = await connect( 5986s ^^^^^^^^^^^^^^ 5986s ...<4 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 5986s raise FatalCommClosedError( 5986s ...<2 lines>... 5986s ) from err 5986s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 5986s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 5986s RuntimeError: Nanny failed to start. 5986s 2024-11-23 22:09:05,959 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:09:05,970 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36401 5986s 2024-11-23 22:09:05,971 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38673/status 5986s 2024-11-23 22:09:05,971 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:09:06,014 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:45677'. Reason: failure-to-start- 5986s 2024-11-23 22:09:06,015 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:41621'. Reason: failure-to-start- 5986s 2024-11-23 22:09:06,016 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36401': TLS handshake failed with remote 'tls://127.0.0.1:52724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:06,016 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36401': TLS handshake failed with remote 'tls://127.0.0.1:52738': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:06,016 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 5986s stream = await stream.start_tls( 5986s ^^^^^^^^^^^^^^^^^^^^^^^ 5986s False, ssl_options=ssl_options, server_hostname=host 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 5986s self.socket.do_handshake() 5986s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 5986s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 5986s self._sslobj.do_handshake() 5986s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 5986s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5986s comm = await self.rpc.connect(saddr) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 5986s return await self._connect(addr=addr, timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 5986s comm = await connect( 5986s ^^^^^^^^^^^^^^ 5986s ...<4 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 5986s raise FatalCommClosedError( 5986s ...<2 lines>... 5986s ) from err 5986s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 5986s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 5986s RuntimeError: Nanny failed to start. 5986s 2024-11-23 22:09:07,025 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:09:07,036 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44957 5986s 2024-11-23 22:09:07,037 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33101/status 5986s 2024-11-23 22:09:07,038 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:09:07,092 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:41753'. Reason: failure-to-start- 5986s 2024-11-23 22:09:07,092 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:32857'. Reason: failure-to-start- 5986s 2024-11-23 22:09:07,093 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44957': TLS handshake failed with remote 'tls://127.0.0.1:58470': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:07,093 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44957': TLS handshake failed with remote 'tls://127.0.0.1:58472': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:07,095 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 5986s stream = await stream.start_tls( 5986s ^^^^^^^^^^^^^^^^^^^^^^^ 5986s False, ssl_options=ssl_options, server_hostname=host 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 5986s self.socket.do_handshake() 5986s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 5986s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 5986s self._sslobj.do_handshake() 5986s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 5986s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5986s comm = await self.rpc.connect(saddr) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 5986s return await self._connect(addr=addr, timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 5986s comm = await connect( 5986s ^^^^^^^^^^^^^^ 5986s ...<4 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 5986s raise FatalCommClosedError( 5986s ...<2 lines>... 5986s ) from err 5986s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 5986s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 5986s RuntimeError: Nanny failed to start. 5986s 2024-11-23 22:09:08,100 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:09:08,106 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41987 5986s 2024-11-23 22:09:08,106 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38223/status 5986s 2024-11-23 22:09:08,106 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:09:08,128 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:39105'. Reason: failure-to-start- 5986s 2024-11-23 22:09:08,129 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:34419'. Reason: failure-to-start- 5986s 2024-11-23 22:09:08,131 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41987': TLS handshake failed with remote 'tls://127.0.0.1:45642': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:08,131 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41987': TLS handshake failed with remote 'tls://127.0.0.1:45658': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:08,131 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 5986s stream = await stream.start_tls( 5986s ^^^^^^^^^^^^^^^^^^^^^^^ 5986s False, ssl_options=ssl_options, server_hostname=host 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 5986s self.socket.do_handshake() 5986s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 5986s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 5986s self._sslobj.do_handshake() 5986s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 5986s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5986s comm = await self.rpc.connect(saddr) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 5986s return await self._connect(addr=addr, timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 5986s comm = await connect( 5986s ^^^^^^^^^^^^^^ 5986s ...<4 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 5986s raise FatalCommClosedError( 5986s ...<2 lines>... 5986s ) from err 5986s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 5986s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 5986s RuntimeError: Nanny failed to start. 5986s 2024-11-23 22:09:09,137 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:09:09,142 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33737 5986s 2024-11-23 22:09:09,142 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37923/status 5986s 2024-11-23 22:09:09,143 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:09:09,170 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:34019'. Reason: failure-to-start- 5986s 2024-11-23 22:09:09,170 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:44931'. Reason: failure-to-start- 5986s 2024-11-23 22:09:09,170 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33737': TLS handshake failed with remote 'tls://127.0.0.1:37660': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:09,171 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33737': TLS handshake failed with remote 'tls://127.0.0.1:37676': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:09,171 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 5986s stream = await stream.start_tls( 5986s ^^^^^^^^^^^^^^^^^^^^^^^ 5986s False, ssl_options=ssl_options, server_hostname=host 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 5986s self.socket.do_handshake() 5986s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 5986s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 5986s self._sslobj.do_handshake() 5986s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 5986s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5986s comm = await self.rpc.connect(saddr) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 5986s return await self._connect(addr=addr, timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 5986s comm = await connect( 5986s ^^^^^^^^^^^^^^ 5986s ...<4 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 5986s raise FatalCommClosedError( 5986s ...<2 lines>... 5986s ) from err 5986s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 5986s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 5986s RuntimeError: Nanny failed to start. 5986s 2024-11-23 22:09:10,176 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:09:10,182 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42051 5986s 2024-11-23 22:09:10,182 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44723/status 5986s 2024-11-23 22:09:10,183 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:09:10,206 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:36337'. Reason: failure-to-start- 5986s 2024-11-23 22:09:10,206 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:42291'. Reason: failure-to-start- 5986s 2024-11-23 22:09:10,206 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42051': TLS handshake failed with remote 'tls://127.0.0.1:46042': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:10,207 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42051': TLS handshake failed with remote 'tls://127.0.0.1:46058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:10,208 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 5986s stream = await stream.start_tls( 5986s ^^^^^^^^^^^^^^^^^^^^^^^ 5986s False, ssl_options=ssl_options, server_hostname=host 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 5986s self.socket.do_handshake() 5986s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 5986s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 5986s self._sslobj.do_handshake() 5986s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 5986s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5986s comm = await self.rpc.connect(saddr) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 5986s return await self._connect(addr=addr, timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 5986s comm = await connect( 5986s ^^^^^^^^^^^^^^ 5986s ...<4 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 5986s raise FatalCommClosedError( 5986s ...<2 lines>... 5986s ) from err 5986s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 5986s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 5986s RuntimeError: Nanny failed to start. 5986s 2024-11-23 22:09:11,213 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:09:11,220 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44841 5986s 2024-11-23 22:09:11,220 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36847/status 5986s 2024-11-23 22:09:11,220 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:09:11,245 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:42053'. Reason: failure-to-start- 5986s 2024-11-23 22:09:11,245 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:45095'. Reason: failure-to-start- 5986s 2024-11-23 22:09:11,245 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:52380': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:11,246 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:52382': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:11,246 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 5986s stream = await stream.start_tls( 5986s ^^^^^^^^^^^^^^^^^^^^^^^ 5986s False, ssl_options=ssl_options, server_hostname=host 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 5986s self.socket.do_handshake() 5986s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 5986s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 5986s self._sslobj.do_handshake() 5986s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 5986s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5986s comm = await self.rpc.connect(saddr) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 5986s return await self._connect(addr=addr, timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 5986s comm = await connect( 5986s ^^^^^^^^^^^^^^ 5986s ...<4 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 5986s raise FatalCommClosedError( 5986s ...<2 lines>... 5986s ) from err 5986s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 5986s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 5986s RuntimeError: Nanny failed to start. 5986s 2024-11-23 22:09:12,250 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:09:12,256 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33685 5986s 2024-11-23 22:09:12,256 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45543/status 5986s 2024-11-23 22:09:12,256 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:09:12,268 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:37723'. Reason: failure-to-start- 5986s 2024-11-23 22:09:12,268 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:40925'. Reason: failure-to-start- 5986s 2024-11-23 22:09:12,269 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33685': TLS handshake failed with remote 'tls://127.0.0.1:45014': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:09:12,269 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33685': TLS handshake failed with remote 'tls://127.0.0.1:45022': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:09:12,269 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5986s comm = await self.rpc.connect(saddr) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 5986s return await self._connect(addr=addr, timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 5986s comm = await connect( 5986s ^^^^^^^^^^^^^^ 5986s ...<4 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Nanny start timed out after 0s. 5986s 2024-11-23 22:09:13,275 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:09:13,281 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44365 5986s 2024-11-23 22:09:13,281 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35629/status 5986s 2024-11-23 22:09:13,283 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:09:13,296 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:36271'. Reason: failure-to-start- 5986s 2024-11-23 22:09:13,297 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:43421'. Reason: failure-to-start- 5986s 2024-11-23 22:09:13,297 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44365': TLS handshake failed with remote 'tls://127.0.0.1:46406': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:09:13,297 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44365': TLS handshake failed with remote 'tls://127.0.0.1:46416': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:09:13,298 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5986s comm = await self.rpc.connect(saddr) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 5986s return await self._connect(addr=addr, timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 5986s comm = await connect( 5986s ^^^^^^^^^^^^^^ 5986s ...<4 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Nanny start timed out after 0s. 5986s 2024-11-23 22:09:14,303 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:09:14,308 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39513 5986s 2024-11-23 22:09:14,308 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37119/status 5986s 2024-11-23 22:09:14,309 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:09:14,319 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:36935'. Reason: failure-to-start- 5986s 2024-11-23 22:09:14,319 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:45757'. Reason: failure-to-start- 5986s 2024-11-23 22:09:14,320 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39513': TLS handshake failed with remote 'tls://127.0.0.1:50020': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:09:14,320 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39513': TLS handshake failed with remote 'tls://127.0.0.1:50034': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:09:14,320 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5986s comm = await self.rpc.connect(saddr) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 5986s return await self._connect(addr=addr, timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 5986s comm = await connect( 5986s ^^^^^^^^^^^^^^ 5986s ...<4 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Nanny start timed out after 0s. 5986s 2024-11-23 22:09:15,327 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:09:15,332 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40611 5986s 2024-11-23 22:09:15,333 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46377/status 5986s 2024-11-23 22:09:15,333 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:09:15,346 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:42081'. Reason: failure-to-start- 5986s 2024-11-23 22:09:15,346 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:40157'. Reason: failure-to-start- 5986s 2024-11-23 22:09:15,347 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40611': TLS handshake failed with remote 'tls://127.0.0.1:50052': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:09:15,347 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40611': TLS handshake failed with remote 'tls://127.0.0.1:50056': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:09:15,347 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5986s comm = await self.rpc.connect(saddr) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 5986s return await self._connect(addr=addr, timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 5986s comm = await connect( 5986s ^^^^^^^^^^^^^^ 5986s ...<4 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Nanny start timed out after 0s. 5986s 2024-11-23 22:09:16,352 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:09:16,358 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43877 5986s 2024-11-23 22:09:16,358 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43621/status 5986s 2024-11-23 22:09:16,358 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:09:16,371 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:45111'. Reason: failure-to-start- 5986s 2024-11-23 22:09:16,371 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:40515'. Reason: failure-to-start- 5986s 2024-11-23 22:09:16,372 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43877': TLS handshake failed with remote 'tls://127.0.0.1:36810': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:09:16,372 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43877': TLS handshake failed with remote 'tls://127.0.0.1:36812': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:09:16,372 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5986s comm = await self.rpc.connect(saddr) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 5986s return await self._connect(addr=addr, timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 5986s comm = await connect( 5986s ^^^^^^^^^^^^^^ 5986s ...<4 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Nanny start timed out after 0s. 5986s 2024-11-23 22:09:17,376 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:09:17,382 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40177 5986s 2024-11-23 22:09:17,382 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45943/status 5986s 2024-11-23 22:09:17,382 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:09:17,393 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:39983'. Reason: failure-to-start- 5986s 2024-11-23 22:09:17,393 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:33573'. Reason: failure-to-start- 5986s 2024-11-23 22:09:17,394 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40177': TLS handshake failed with remote 'tls://127.0.0.1:59902': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:09:17,394 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40177': TLS handshake failed with remote 'tls://127.0.0.1:59916': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:09:17,395 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5986s comm = await self.rpc.connect(saddr) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 5986s return await self._connect(addr=addr, timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 5986s comm = await connect( 5986s ^^^^^^^^^^^^^^ 5986s ...<4 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Nanny start timed out after 0s. 5986s 2024-11-23 22:09:18,400 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:09:18,405 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:32985 5986s 2024-11-23 22:09:18,406 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41377/status 5986s 2024-11-23 22:09:18,406 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:09:18,425 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:34171'. Reason: failure-to-start- 5986s 2024-11-23 22:09:18,425 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:38305'. Reason: failure-to-start- 5986s 2024-11-23 22:09:18,426 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:32985': TLS handshake failed with remote 'tls://127.0.0.1:57972': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:09:18,426 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:32985': TLS handshake failed with remote 'tls://127.0.0.1:57986': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:09:18,426 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5986s comm = await self.rpc.connect(saddr) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 5986s return await self._connect(addr=addr, timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 5986s comm = await connect( 5986s ^^^^^^^^^^^^^^ 5986s ...<4 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Nanny start timed out after 0s. 5986s 2024-11-23 22:09:19,431 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:09:19,437 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45703 5986s 2024-11-23 22:09:19,437 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46745/status 5986s 2024-11-23 22:09:19,437 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:09:19,448 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:37981'. Reason: failure-to-start- 5986s 2024-11-23 22:09:19,448 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:38315'. Reason: failure-to-start- 5986s 2024-11-23 22:09:19,448 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45703': TLS handshake failed with remote 'tls://127.0.0.1:48448': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:09:19,449 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45703': TLS handshake failed with remote 'tls://127.0.0.1:48464': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:09:19,449 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5986s comm = await self.rpc.connect(saddr) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 5986s return await self._connect(addr=addr, timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 5986s comm = await connect( 5986s ^^^^^^^^^^^^^^ 5986s ...<4 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Nanny start timed out after 0s. 5986s 2024-11-23 22:09:20,453 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:09:20,459 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34803 5986s 2024-11-23 22:09:20,459 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44503/status 5986s 2024-11-23 22:09:20,460 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:09:20,474 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:33419'. Reason: failure-to-start- 5986s 2024-11-23 22:09:20,475 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:44951'. Reason: failure-to-start- 5986s 2024-11-23 22:09:20,475 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34803': TLS handshake failed with remote 'tls://127.0.0.1:53954': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:09:20,475 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34803': TLS handshake failed with remote 'tls://127.0.0.1:53960': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:09:20,476 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5986s comm = await self.rpc.connect(saddr) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 5986s return await self._connect(addr=addr, timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 5986s comm = await connect( 5986s ^^^^^^^^^^^^^^ 5986s ...<4 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Nanny start timed out after 0s. 5986s 2024-11-23 22:09:21,481 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:09:21,486 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33803 5986s 2024-11-23 22:09:21,487 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34921/status 5986s 2024-11-23 22:09:21,487 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:09:21,497 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:42645'. Reason: failure-to-start- 5986s 2024-11-23 22:09:21,497 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:45585'. Reason: failure-to-start- 5986s 2024-11-23 22:09:21,499 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33803': TLS handshake failed with remote 'tls://127.0.0.1:42784': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:09:21,499 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33803': TLS handshake failed with remote 'tls://127.0.0.1:42800': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:09:21,500 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5986s comm = await self.rpc.connect(saddr) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 5986s return await self._connect(addr=addr, timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 5986s comm = await connect( 5986s ^^^^^^^^^^^^^^ 5986s ...<4 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Nanny start timed out after 0s. 5986s 2024-11-23 22:09:22,505 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:09:22,510 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40289 5986s 2024-11-23 22:09:22,510 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37191/status 5986s 2024-11-23 22:09:22,511 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:09:22,523 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:39547'. Reason: failure-to-start- 5986s 2024-11-23 22:09:22,524 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:42601'. Reason: failure-to-start- 5986s 2024-11-23 22:09:22,524 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:44476': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:09:22,524 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40289': TLS handshake failed with remote 'tls://127.0.0.1:44490': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:09:22,524 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5986s comm = await self.rpc.connect(saddr) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 5986s return await self._connect(addr=addr, timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 5986s comm = await connect( 5986s ^^^^^^^^^^^^^^ 5986s ...<4 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Nanny start timed out after 0s. 5986s 2024-11-23 22:09:23,531 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:09:23,536 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44225 5986s 2024-11-23 22:09:23,537 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39133/status 5986s 2024-11-23 22:09:23,537 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:09:23,549 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:44217'. Reason: failure-to-start- 5986s 2024-11-23 22:09:23,550 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:37521'. Reason: failure-to-start- 5986s 2024-11-23 22:09:23,550 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44225': TLS handshake failed with remote 'tls://127.0.0.1:49382': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:09:23,550 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44225': TLS handshake failed with remote 'tls://127.0.0.1:49384': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:09:23,550 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5986s comm = await self.rpc.connect(saddr) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 5986s return await self._connect(addr=addr, timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 5986s comm = await connect( 5986s ^^^^^^^^^^^^^^ 5986s ...<4 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Nanny start timed out after 0s. 5986s 2024-11-23 22:09:24,556 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:09:24,563 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43885 5986s 2024-11-23 22:09:24,563 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40297/status 5986s 2024-11-23 22:09:24,563 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:09:24,578 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:35013'. Reason: failure-to-start- 5986s 2024-11-23 22:09:24,578 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:40931'. Reason: failure-to-start- 5986s 2024-11-23 22:09:24,579 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43885': TLS handshake failed with remote 'tls://127.0.0.1:50284': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:09:24,579 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43885': TLS handshake failed with remote 'tls://127.0.0.1:50286': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:09:24,579 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5986s comm = await self.rpc.connect(saddr) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 5986s return await self._connect(addr=addr, timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 5986s comm = await connect( 5986s ^^^^^^^^^^^^^^ 5986s ...<4 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Nanny start timed out after 0s. 5986s 2024-11-23 22:09:25,585 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:09:25,590 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39967 5986s 2024-11-23 22:09:25,590 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45945/status 5986s 2024-11-23 22:09:25,591 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:09:25,602 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:37183'. Reason: failure-to-start- 5986s 2024-11-23 22:09:25,602 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:41689'. Reason: failure-to-start- 5986s 2024-11-23 22:09:25,603 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39967': TLS handshake failed with remote 'tls://127.0.0.1:44104': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:09:25,603 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39967': TLS handshake failed with remote 'tls://127.0.0.1:44118': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:09:25,603 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5986s comm = await self.rpc.connect(saddr) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 5986s return await self._connect(addr=addr, timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 5986s comm = await connect( 5986s ^^^^^^^^^^^^^^ 5986s ...<4 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Nanny start timed out after 0s. 5986s 2024-11-23 22:09:26,607 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:09:26,614 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37203 5986s 2024-11-23 22:09:26,614 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41017/status 5986s 2024-11-23 22:09:26,615 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:09:26,628 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:43741'. Reason: failure-to-start- 5986s 2024-11-23 22:09:26,629 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:32879'. Reason: failure-to-start- 5986s 2024-11-23 22:09:26,629 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37203': TLS handshake failed with remote 'tls://127.0.0.1:53162': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:09:26,629 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37203': TLS handshake failed with remote 'tls://127.0.0.1:53170': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:09:26,629 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5986s comm = await self.rpc.connect(saddr) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 5986s return await self._connect(addr=addr, timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 5986s comm = await connect( 5986s ^^^^^^^^^^^^^^ 5986s ...<4 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Nanny start timed out after 0s. 5986s 2024-11-23 22:09:27,635 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:09:27,640 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43353 5986s 2024-11-23 22:09:27,641 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39695/status 5986s 2024-11-23 22:09:27,641 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:09:27,655 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:46509'. Reason: failure-to-start- 5986s 2024-11-23 22:09:27,656 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:38225'. Reason: failure-to-start- 5986s 2024-11-23 22:09:27,656 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43353': TLS handshake failed with remote 'tls://127.0.0.1:45532': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:09:27,656 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43353': TLS handshake failed with remote 'tls://127.0.0.1:45540': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:09:27,657 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5986s comm = await self.rpc.connect(saddr) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 5986s return await self._connect(addr=addr, timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 5986s comm = await connect( 5986s ^^^^^^^^^^^^^^ 5986s ...<4 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Nanny start timed out after 0s. 5986s 2024-11-23 22:09:28,663 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:09:28,668 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37825 5986s 2024-11-23 22:09:28,668 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43487/status 5986s 2024-11-23 22:09:28,668 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:09:28,679 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:37339'. Reason: failure-to-start- 5986s 2024-11-23 22:09:28,679 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:45677'. Reason: failure-to-start- 5986s 2024-11-23 22:09:28,680 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37825': TLS handshake failed with remote 'tls://127.0.0.1:48154': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:09:28,680 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37825': TLS handshake failed with remote 'tls://127.0.0.1:48156': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:09:28,680 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5986s comm = await self.rpc.connect(saddr) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 5986s return await self._connect(addr=addr, timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 5986s comm = await connect( 5986s ^^^^^^^^^^^^^^ 5986s ...<4 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Nanny start timed out after 0s. 5986s 2024-11-23 22:09:29,685 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:09:29,691 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38261 5986s 2024-11-23 22:09:29,691 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45291/status 5986s 2024-11-23 22:09:29,693 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:09:29,706 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:39147'. Reason: failure-to-start- 5986s 2024-11-23 22:09:29,706 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:41525'. Reason: failure-to-start- 5986s 2024-11-23 22:09:29,706 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:48414': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:09:29,707 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:48424': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:09:29,708 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5986s comm = await self.rpc.connect(saddr) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 5986s return await self._connect(addr=addr, timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 5986s comm = await connect( 5986s ^^^^^^^^^^^^^^ 5986s ...<4 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Nanny start timed out after 0s. 5986s 2024-11-23 22:09:30,715 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:09:30,721 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44805 5986s 2024-11-23 22:09:30,721 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41479/status 5986s 2024-11-23 22:09:30,721 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:09:30,736 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:37499'. Reason: failure-to-start- 5986s 2024-11-23 22:09:30,736 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:46085'. Reason: failure-to-start- 5986s 2024-11-23 22:09:30,736 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44805': TLS handshake failed with remote 'tls://127.0.0.1:49458': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:09:30,737 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44805': TLS handshake failed with remote 'tls://127.0.0.1:49462': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:09:30,737 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5986s comm = await self.rpc.connect(saddr) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 5986s return await self._connect(addr=addr, timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 5986s comm = await connect( 5986s ^^^^^^^^^^^^^^ 5986s ...<4 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Nanny start timed out after 0s. 5986s 2024-11-23 22:09:31,741 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:09:31,747 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44143 5986s 2024-11-23 22:09:31,748 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39883/status 5986s 2024-11-23 22:09:31,748 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:09:31,761 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:42093'. Reason: failure-to-start- 5986s 2024-11-23 22:09:31,762 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:37339'. Reason: failure-to-start- 5986s 2024-11-23 22:09:31,764 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44143': TLS handshake failed with remote 'tls://127.0.0.1:58668': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:09:31,764 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44143': TLS handshake failed with remote 'tls://127.0.0.1:58678': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:09:31,764 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5986s comm = await self.rpc.connect(saddr) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 5986s return await self._connect(addr=addr, timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 5986s comm = await connect( 5986s ^^^^^^^^^^^^^^ 5986s ...<4 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Nanny start timed out after 0s. 5986s 2024-11-23 22:09:32,771 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:09:32,777 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38775 5986s 2024-11-23 22:09:32,777 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39261/status 5986s 2024-11-23 22:09:32,778 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:09:32,795 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:38181'. Reason: failure-to-start- 5986s 2024-11-23 22:09:32,795 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:40273'. Reason: failure-to-start- 5986s 2024-11-23 22:09:32,796 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38775': TLS handshake failed with remote 'tls://127.0.0.1:39714': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:09:32,796 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38775': TLS handshake failed with remote 'tls://127.0.0.1:39720': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:09:32,796 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5986s comm = await self.rpc.connect(saddr) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 5986s return await self._connect(addr=addr, timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 5986s comm = await connect( 5986s ^^^^^^^^^^^^^^ 5986s ...<4 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Nanny start timed out after 0s. 5986s 2024-11-23 22:09:33,802 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:09:33,808 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33977 5986s 2024-11-23 22:09:33,809 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35761/status 5986s 2024-11-23 22:09:33,809 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:09:33,822 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:34683'. Reason: failure-to-start- 5986s 2024-11-23 22:09:33,823 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:38063'. Reason: failure-to-start- 5986s 2024-11-23 22:09:33,823 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33977': TLS handshake failed with remote 'tls://127.0.0.1:53118': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:09:33,823 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33977': TLS handshake failed with remote 'tls://127.0.0.1:53126': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:09:33,826 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5986s comm = await self.rpc.connect(saddr) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 5986s return await self._connect(addr=addr, timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 5986s comm = await connect( 5986s ^^^^^^^^^^^^^^ 5986s ...<4 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Nanny start timed out after 0s. 5986s 2024-11-23 22:09:34,833 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:09:34,839 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35505 5986s 2024-11-23 22:09:34,839 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37445/status 5986s 2024-11-23 22:09:34,839 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:09:34,855 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:34221'. Reason: failure-to-start- 5986s 2024-11-23 22:09:34,855 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:44171'. Reason: failure-to-start- 5986s 2024-11-23 22:09:34,856 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35505': TLS handshake failed with remote 'tls://127.0.0.1:52590': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:09:34,856 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35505': TLS handshake failed with remote 'tls://127.0.0.1:52602': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:09:34,856 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5986s comm = await self.rpc.connect(saddr) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 5986s return await self._connect(addr=addr, timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 5986s comm = await connect( 5986s ^^^^^^^^^^^^^^ 5986s ...<4 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Nanny start timed out after 0s. 5986s 2024-11-23 22:09:35,861 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:09:35,867 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41401 5986s 2024-11-23 22:09:35,867 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34541/status 5986s 2024-11-23 22:09:35,867 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:09:35,880 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:40365'. Reason: failure-to-start- 5986s 2024-11-23 22:09:35,881 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:35971'. Reason: failure-to-start- 5986s 2024-11-23 22:09:35,881 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41401': TLS handshake failed with remote 'tls://127.0.0.1:57322': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:09:35,881 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41401': TLS handshake failed with remote 'tls://127.0.0.1:57338': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:09:35,881 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5986s comm = await self.rpc.connect(saddr) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 5986s return await self._connect(addr=addr, timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 5986s comm = await connect( 5986s ^^^^^^^^^^^^^^ 5986s ...<4 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Nanny start timed out after 0s. 5986s 2024-11-23 22:09:36,889 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:09:36,895 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39759 5986s 2024-11-23 22:09:36,895 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42883/status 5986s 2024-11-23 22:09:36,895 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:09:36,908 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:35829'. Reason: failure-to-start- 5986s 2024-11-23 22:09:36,908 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:40269'. Reason: failure-to-start- 5986s 2024-11-23 22:09:36,912 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39759': TLS handshake failed with remote 'tls://127.0.0.1:45244': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:09:36,912 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39759': TLS handshake failed with remote 'tls://127.0.0.1:45256': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:09:36,912 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5986s comm = await self.rpc.connect(saddr) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 5986s return await self._connect(addr=addr, timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 5986s comm = await connect( 5986s ^^^^^^^^^^^^^^ 5986s ...<4 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Nanny start timed out after 0s. 5986s 2024-11-23 22:09:37,918 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:09:37,924 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36011 5986s 2024-11-23 22:09:37,924 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34549/status 5986s 2024-11-23 22:09:37,924 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:09:37,937 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:34813'. Reason: failure-to-start- 5986s 2024-11-23 22:09:37,938 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:33649'. Reason: failure-to-start- 5986s 2024-11-23 22:09:37,939 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36011': TLS handshake failed with remote 'tls://127.0.0.1:38514': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:09:37,939 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36011': TLS handshake failed with remote 'tls://127.0.0.1:38520': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:09:37,939 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5986s comm = await self.rpc.connect(saddr) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 5986s return await self._connect(addr=addr, timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 5986s comm = await connect( 5986s ^^^^^^^^^^^^^^ 5986s ...<4 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Nanny start timed out after 0s. 5986s 2024-11-23 22:09:38,946 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:09:38,951 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40945 5986s 2024-11-23 22:09:38,952 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33571/status 5986s 2024-11-23 22:09:38,952 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:09:38,963 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:35191'. Reason: failure-to-start- 5986s 2024-11-23 22:09:38,963 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:45737'. Reason: failure-to-start- 5986s 2024-11-23 22:09:38,967 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40945': TLS handshake failed with remote 'tls://127.0.0.1:50780': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:09:38,967 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40945': TLS handshake failed with remote 'tls://127.0.0.1:50796': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:09:38,967 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5986s comm = await self.rpc.connect(saddr) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 5986s return await self._connect(addr=addr, timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 5986s comm = await connect( 5986s ^^^^^^^^^^^^^^ 5986s ...<4 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Nanny start timed out after 0s. 5986s 2024-11-23 22:09:39,972 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:09:39,978 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41581 5986s 2024-11-23 22:09:39,979 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46141/status 5986s 2024-11-23 22:09:39,979 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:09:39,993 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:39439'. Reason: failure-to-start- 5986s 2024-11-23 22:09:39,993 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:42899'. Reason: failure-to-start- 5986s 2024-11-23 22:09:39,994 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41581': TLS handshake failed with remote 'tls://127.0.0.1:59586': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:09:39,994 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41581': TLS handshake failed with remote 'tls://127.0.0.1:59588': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:09:39,994 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5986s comm = await self.rpc.connect(saddr) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 5986s return await self._connect(addr=addr, timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 5986s comm = await connect( 5986s ^^^^^^^^^^^^^^ 5986s ...<4 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Nanny start timed out after 0s. 5986s 2024-11-23 22:09:41,002 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:09:41,007 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44581 5986s 2024-11-23 22:09:41,008 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33009/status 5986s 2024-11-23 22:09:41,008 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:09:41,020 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:34857'. Reason: failure-to-start- 5986s 2024-11-23 22:09:41,020 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:42463'. Reason: failure-to-start- 5986s 2024-11-23 22:09:41,021 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44581': TLS handshake failed with remote 'tls://127.0.0.1:35204': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:09:41,021 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44581': TLS handshake failed with remote 'tls://127.0.0.1:35220': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:09:41,021 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5986s comm = await self.rpc.connect(saddr) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 5986s return await self._connect(addr=addr, timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 5986s comm = await connect( 5986s ^^^^^^^^^^^^^^ 5986s ...<4 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Nanny start timed out after 0s. 5986s 2024-11-23 22:09:42,026 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:09:42,032 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42031 5986s 2024-11-23 22:09:42,032 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38831/status 5986s 2024-11-23 22:09:42,033 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:09:42,059 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:41725'. Reason: failure-to-start- 5986s 2024-11-23 22:09:42,060 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:33743'. Reason: failure-to-start- 5986s 2024-11-23 22:09:42,069 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42031': TLS handshake failed with remote 'tls://127.0.0.1:34918': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:09:42,069 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42031': TLS handshake failed with remote 'tls://127.0.0.1:34934': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:09:42,073 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5986s comm = await self.rpc.connect(saddr) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 5986s return await self._connect(addr=addr, timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 5986s comm = await connect( 5986s ^^^^^^^^^^^^^^ 5986s ...<4 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Nanny start timed out after 0s. 5986s ___________________________ test_security_dict_input ___________________________ 5986s 5986s self = 5986s address = '127.0.0.1:37127', deserialize = True 5986s connection_args = {'extra_conn_args': {}, 'require_encryption': True, 'ssl_context': } 5986s ip = '127.0.0.1', port = 37127 5986s kwargs = {'ssl_options': } 5986s 5986s async def connect(self, address, deserialize=True, **connection_args): 5986s self._check_encryption(address, connection_args) 5986s ip, port = parse_host_port(address) 5986s kwargs = self._get_connect_args(**connection_args) 5986s 5986s try: 5986s # server_hostname option (for SNI) only works with tornado.iostream.IOStream 5986s if "server_hostname" in kwargs: 5986s stream = await self.client.connect( 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE 5986s ) 5986s stream = await stream.start_tls(False, **kwargs) 5986s else: 5986s > stream = await self.client.connect( 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ) 5986s 5986s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:546: 5986s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5986s /usr/lib/python3/dist-packages/tornado/tcpclient.py:292: in connect 5986s stream = await stream.start_tls( 5986s /usr/lib/python3/dist-packages/tornado/iostream.py:1367: in _do_ssl_handshake 5986s self.socket.do_handshake() 5986s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5986s 5986s self = , block = False 5986s 5986s @_sslcopydoc 5986s def do_handshake(self, block=False): 5986s self._check_connected() 5986s timeout = self.gettimeout() 5986s try: 5986s if timeout == 0.0 and block: 5986s self.settimeout(None) 5986s > self._sslobj.do_handshake() 5986s E ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 5986s 5986s /usr/lib/python3.13/ssl.py:1372: SSLCertVerificationError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s self = 5986s 5986s async def _register_with_scheduler(self) -> None: 5986s self.periodic_callbacks["keep-alive"].stop() 5986s self.periodic_callbacks["heartbeat"].stop() 5986s start = time() 5986s if self.contact_address is None: 5986s self.contact_address = self.address 5986s logger.info("-" * 49) 5986s 5986s # Worker reconnection is not supported 5986s assert not self.data 5986s assert not self.state.tasks 5986s 5986s while True: 5986s try: 5986s _start = time() 5986s > comm = await connect(self.scheduler.address, **self.connection_args) 5986s 5986s /usr/lib/python3/dist-packages/distributed/worker.py:1179: 5986s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5986s /usr/lib/python3/dist-packages/distributed/comm/core.py:342: in connect 5986s comm = await wait_for( 5986s /usr/lib/python3/dist-packages/distributed/utils.py:1960: in wait_for 5986s return await fut 5986s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5986s 5986s self = 5986s address = '127.0.0.1:37127', deserialize = True 5986s connection_args = {'extra_conn_args': {}, 'require_encryption': True, 'ssl_context': } 5986s ip = '127.0.0.1', port = 37127 5986s kwargs = {'ssl_options': } 5986s 5986s async def connect(self, address, deserialize=True, **connection_args): 5986s self._check_encryption(address, connection_args) 5986s ip, port = parse_host_port(address) 5986s kwargs = self._get_connect_args(**connection_args) 5986s 5986s try: 5986s # server_hostname option (for SNI) only works with tornado.iostream.IOStream 5986s if "server_hostname" in kwargs: 5986s stream = await self.client.connect( 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE 5986s ) 5986s stream = await stream.start_tls(False, **kwargs) 5986s else: 5986s stream = await self.client.connect( 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ) 5986s 5986s # Under certain circumstances tornado will have a closed connection with an 5986s # error and not raise a StreamClosedError. 5986s # 5986s # This occurs with tornado 5.x and openssl 1.1+ 5986s if stream.closed() and stream.error: 5986s raise StreamClosedError(stream.error) 5986s 5986s except StreamClosedError as e: 5986s # The socket connect() call failed 5986s convert_stream_closed_error(self, e) 5986s except SSLCertVerificationError as err: 5986s > raise FatalCommClosedError( 5986s "TLS certificate does not match. Check your security settings. " 5986s "More info at https://distributed.dask.org/en/latest/tls.html" 5986s ) from err 5986s E distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 5986s 5986s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:561: FatalCommClosedError 5986s 5986s During handling of the above exception, another exception occurred: 5986s 5986s @gen_test() 5986s async def test_security_dict_input(): 5986s conf = tls_config() 5986s ca_file = conf["distributed"]["comm"]["tls"]["ca-file"] 5986s client = conf["distributed"]["comm"]["tls"]["client"]["cert"] 5986s worker = conf["distributed"]["comm"]["tls"]["worker"]["cert"] 5986s scheduler = conf["distributed"]["comm"]["tls"]["scheduler"]["cert"] 5986s 5986s async with Scheduler( 5986s host="localhost", 5986s dashboard_address=":0", 5986s security={"tls_ca_file": ca_file, "tls_scheduler_cert": scheduler}, 5986s ) as s: 5986s assert s.address.startswith("tls://") 5986s > async with Worker( 5986s s.address, security={"tls_ca_file": ca_file, "tls_worker_cert": worker} 5986s ) as w: 5986s 5986s /usr/lib/python3/dist-packages/distributed/tests/test_tls_functional.py:225: 5986s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5986s /usr/lib/python3/dist-packages/distributed/core.py:678: in __aenter__ 5986s await self 5986s /usr/lib/python3/dist-packages/distributed/core.py:664: in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s /usr/lib/python3/dist-packages/distributed/utils.py:1960: in wait_for 5986s return await fut 5986s /usr/lib/python3/dist-packages/distributed/worker.py:1480: in start_unsafe 5986s await self._register_with_scheduler() 5986s /usr/lib/python3/dist-packages/distributed/worker.py:1218: in _register_with_scheduler 5986s await asyncio.sleep(0.1) 5986s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5986s 5986s delay = 0.1, result = None 5986s 5986s async def sleep(delay, result=None): 5986s """Coroutine that completes after a given time (in seconds).""" 5986s if delay <= 0: 5986s await __sleep0() 5986s return result 5986s 5986s if math.isnan(delay): 5986s raise ValueError("Invalid delay: NaN (not a number)") 5986s 5986s loop = events.get_running_loop() 5986s future = loop.create_future() 5986s h = loop.call_later(delay, 5986s futures._set_result_unless_cancelled, 5986s future, result) 5986s try: 5986s > return await future 5986s E asyncio.exceptions.CancelledError 5986s 5986s /usr/lib/python3.13/asyncio/tasks.py:718: CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s args = (), kwds = {} 5986s 5986s @wraps(func) 5986s def inner(*args, **kwds): 5986s with self._recreate_cm(): 5986s > return func(*args, **kwds) 5986s 5986s /usr/lib/python3.13/contextlib.py:85: 5986s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5986s /usr/lib/python3.13/contextlib.py:85: in inner 5986s return func(*args, **kwds) 5986s /usr/lib/python3/dist-packages/distributed/utils_test.py:746: in test_func 5986s return _run_and_close_tornado(async_fn_outer, func, *args, **kwargs) 5986s /usr/lib/python3/dist-packages/distributed/utils_test.py:378: in _run_and_close_tornado 5986s return asyncio_run(inner_fn(), loop_factory=get_loop_factory()) 5986s /usr/lib/python3.13/asyncio/runners.py:194: in run 5986s return runner.run(main) 5986s /usr/lib/python3.13/asyncio/runners.py:118: in run 5986s return self._loop.run_until_complete(task) 5986s /usr/lib/python3.13/asyncio/base_events.py:720: in run_until_complete 5986s return future.result() 5986s /usr/lib/python3/dist-packages/distributed/utils_test.py:375: in inner_fn 5986s return await async_fn(*args, **kwargs) 5986s /usr/lib/python3/dist-packages/distributed/utils_test.py:736: in async_fn_outer 5986s return await utils_wait_for(async_fn(*args, **kwargs), timeout) 5986s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 5986s async with asyncio.timeout(timeout): 5986s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5986s 5986s self = 5986s exc_type = 5986s exc_val = CancelledError(), exc_tb = 5986s 5986s async def __aexit__( 5986s self, 5986s exc_type: Optional[Type[BaseException]], 5986s exc_val: Optional[BaseException], 5986s exc_tb: Optional[TracebackType], 5986s ) -> Optional[bool]: 5986s assert self._state in (_State.ENTERED, _State.EXPIRING) 5986s 5986s if self._timeout_handler is not None: 5986s self._timeout_handler.cancel() 5986s self._timeout_handler = None 5986s 5986s if self._state is _State.EXPIRING: 5986s self._state = _State.EXPIRED 5986s 5986s if self._task.uncancel() <= self._cancelling and exc_type is not None: 5986s # Since there are no new cancel requests, we're 5986s # handling this. 5986s if issubclass(exc_type, exceptions.CancelledError): 5986s > raise TimeoutError from exc_val 5986s E TimeoutError 5986s 5986s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 5986s ----------------------------- Captured stderr call ----------------------------- 5986s 2024-11-23 22:09:43,441 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:09:43,448 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37127 5986s 2024-11-23 22:09:43,449 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41775/status 5986s 2024-11-23 22:09:43,449 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:09:43,456 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35839 5986s 2024-11-23 22:09:43,456 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35839 5986s 2024-11-23 22:09:43,456 - distributed.worker - INFO - dashboard at: 127.0.0.1:33679 5986s 2024-11-23 22:09:43,456 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:09:43,456 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:09:43,456 - distributed.worker - INFO - Threads: 8 5986s 2024-11-23 22:09:43,456 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:09:43,456 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-b1ed2nmp 5986s 2024-11-23 22:09:43,456 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:09:43,463 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:09:43,463 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:55928': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:43,570 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:09:43,570 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:55942': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:43,677 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:09:43,677 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:55954': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:43,784 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:09:43,784 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:55960': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:43,891 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:09:43,892 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:55974': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:43,998 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:09:43,999 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:55980': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:44,105 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:09:44,106 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:55984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:44,213 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:09:44,213 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:55992': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:44,320 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:09:44,320 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:56008': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:44,428 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:09:44,429 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:56018': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:44,535 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:09:44,536 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:56022': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:44,642 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:09:44,643 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:56024': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:44,750 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:09:44,750 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:56036': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:44,857 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:09:44,857 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:56050': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:44,964 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:09:44,964 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:56054': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:45,071 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:09:45,071 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:56070': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:45,178 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:09:45,178 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:56072': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:45,285 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:09:45,286 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:56086': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:45,394 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:09:45,394 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:56094': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:45,501 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:09:45,501 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:56104': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:45,609 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:09:45,609 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:56120': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:45,715 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:09:45,716 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:56128': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:45,822 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:09:45,823 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:56136': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:45,929 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:09:45,929 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:56150': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:46,036 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:09:46,037 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:56152': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:46,143 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:09:46,144 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:56160': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:46,250 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:09:46,251 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:56172': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:46,357 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:09:46,357 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:56176': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:46,464 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:09:46,464 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:56178': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:46,571 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:09:46,571 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:56186': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:46,678 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:09:46,678 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:56192': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:46,785 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:09:46,785 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:56194': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:46,893 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:09:46,894 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:56208': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:47,001 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:09:47,001 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:56222': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:47,110 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:09:47,111 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:56226': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:47,217 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:09:47,218 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:56238': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:47,324 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:09:47,324 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:56254': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:47,430 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:09:47,431 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:56260': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:47,538 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:09:47,538 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:56262': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:47,645 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:09:47,645 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:56266': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:47,752 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:09:47,752 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:56280': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:47,859 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:09:47,859 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:56288': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:47,966 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:09:47,966 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:56292': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:48,073 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:09:48,073 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:56296': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:48,180 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:09:48,180 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:56304': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:48,287 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:09:48,287 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:56310': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:48,394 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:09:48,394 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:56314': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:48,501 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:09:48,501 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:56324': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:48,609 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:09:48,609 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:56340': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:48,717 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:09:48,717 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:56354': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:48,824 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:09:48,824 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:56370': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:48,931 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:09:48,931 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:56380': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:49,038 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:09:49,038 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:56388': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:49,145 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:09:49,145 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:56392': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:49,252 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:09:49,252 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:56400': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:49,359 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:09:49,359 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:56416': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:49,465 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:09:49,466 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:56420': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:49,573 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:09:49,573 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:56436': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:49,680 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:09:49,680 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:56448': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:49,787 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:09:49,787 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:56454': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:49,894 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:09:49,894 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:56456': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:50,001 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:09:50,001 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:56460': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:50,109 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:09:50,109 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:56472': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:50,216 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:09:50,216 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:56476': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:50,325 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:09:50,325 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:56486': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:50,432 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:09:50,432 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:56488': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:50,539 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:09:50,539 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:56494': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:50,646 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:09:50,646 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:56506': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:50,753 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:09:50,753 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:56512': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:50,860 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:09:50,860 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:56522': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:50,967 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:09:50,967 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:56528': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:51,075 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:09:51,075 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:56534': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:51,183 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:09:51,183 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:56540': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:51,290 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:09:51,291 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:56550': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:51,397 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:09:51,398 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:56560': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:51,504 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:09:51,505 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:56566': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:51,611 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:09:51,612 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:48970': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:51,718 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:09:51,719 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:48972': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:51,825 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:09:51,826 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:48986': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:51,932 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:09:51,933 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:48994': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:52,040 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:09:52,040 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:49000': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:52,147 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:09:52,147 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:49002': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:52,254 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:09:52,255 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:49014': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:52,362 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:09:52,362 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:49018': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:52,469 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:09:52,469 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:49024': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:52,576 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:09:52,576 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:49034': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:52,683 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:09:52,684 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:49046': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:52,790 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:09:52,790 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:49052': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:52,897 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:09:52,897 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:49062': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:53,004 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:09:53,004 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:49068': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:53,112 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:09:53,112 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:49082': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:53,220 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:09:53,220 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:49084': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:53,328 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:09:53,329 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:49098': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:53,436 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:09:53,436 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:49110': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:53,543 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:09:53,543 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:49118': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:53,650 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:09:53,650 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:49128': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:53,757 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:09:53,757 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:49130': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:53,864 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:09:53,864 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:49138': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:53,971 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:09:53,971 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:49148': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:54,078 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:09:54,078 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:49164': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:54,185 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:09:54,185 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:49166': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:54,293 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:09:54,293 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:49168': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:54,400 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:09:54,400 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:49170': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:54,507 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:09:54,508 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:49176': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:54,614 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:09:54,615 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:49188': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:54,722 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:09:54,722 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:49192': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:54,829 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:09:54,829 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:49198': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:54,936 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:09:54,936 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:49210': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:55,043 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:09:55,044 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:49212': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:55,150 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:09:55,151 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:49218': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:55,257 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:09:55,257 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:49224': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:55,364 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:09:55,364 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:49238': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:55,472 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:09:55,472 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:49252': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:55,579 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:09:55,579 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:49256': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:55,686 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:09:55,686 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:49268': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:55,793 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:09:55,794 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:49276': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:55,900 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:09:55,900 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:49292': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:56,006 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:09:56,006 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:49308': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:56,113 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:09:56,113 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:49316': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:56,220 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:09:56,220 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:49318': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:56,328 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:09:56,328 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:49324': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:56,435 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:09:56,435 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:49338': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:56,542 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:09:56,542 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:49344': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:56,649 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:09:56,649 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:49354': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:56,756 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:09:56,756 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:49358': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:56,863 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:09:56,863 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:49364': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:56,969 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:09:56,970 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:49378': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:57,076 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:09:57,077 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:49384': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:57,184 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:09:57,184 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:49396': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:57,291 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:09:57,292 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:49406': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:57,399 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:09:57,399 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:49416': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:57,505 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:09:57,506 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:49426': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:57,613 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:09:57,613 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:49436': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:57,720 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:09:57,720 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:49438': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:57,828 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:09:57,828 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:49442': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:57,935 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:09:57,936 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:49444': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:58,042 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:09:58,043 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:49450': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:58,149 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:09:58,150 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:49466': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:58,256 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:09:58,256 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:49470': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:58,363 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:09:58,363 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:49484': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:58,470 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:09:58,470 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:49490': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:58,577 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:09:58,577 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:49498': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:58,684 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:09:58,684 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:49502': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:58,792 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:09:58,792 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:49504': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:58,899 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:09:58,899 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:49510': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:59,006 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:09:59,006 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:49516': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:59,113 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:09:59,114 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:49526': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:59,220 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:09:59,221 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:49530': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:59,329 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:09:59,329 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:49534': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:59,436 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:09:59,436 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:49546': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:59,543 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:09:59,543 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:49560': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:59,650 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:09:59,650 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:49564': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:59,756 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:09:59,757 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:49570': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:59,863 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:09:59,864 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:49576': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:09:59,970 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:09:59,970 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:49580': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:00,077 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:10:00,077 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:49584': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:00,184 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:10:00,184 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:49590': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:00,292 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:10:00,292 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:49592': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:00,399 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:10:00,399 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:49602': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:00,505 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:10:00,506 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:49614': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:00,613 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:10:00,614 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:49616': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:00,720 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:10:00,720 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:49632': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:00,828 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:10:00,828 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:49634': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:00,935 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:10:00,936 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:49640': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:01,042 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:10:01,042 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:49646': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:01,149 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:10:01,149 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:49652': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:01,256 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:10:01,256 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:49668': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:01,363 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:10:01,363 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:49672': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:01,470 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:10:01,470 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:49676': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:01,577 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:10:01,577 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:40394': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:01,684 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:10:01,684 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:40410': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:01,792 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:10:01,792 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:40414': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:01,899 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:10:01,899 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:40426': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:02,005 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:10:02,006 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:40442': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:02,112 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:10:02,114 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:40458': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:02,220 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:10:02,220 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:40472': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:02,328 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:10:02,328 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:40478': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:02,435 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:10:02,435 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:40480': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:02,542 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:10:02,542 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:40494': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:02,649 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:10:02,649 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:40510': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:02,756 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:10:02,756 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:40524': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:02,863 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:10:02,863 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:40540': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:02,970 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:10:02,970 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:40546': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:03,077 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:10:03,077 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:40554': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:03,184 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:10:03,184 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:40556': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:03,292 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:10:03,292 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:40570': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:03,399 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:10:03,399 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:40586': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:03,505 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:10:03,506 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:40600': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:03,613 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:10:03,613 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:40604': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:03,720 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:10:03,720 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:40608': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:03,828 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:10:03,828 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:40612': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:03,935 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:10:03,935 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:40628': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:04,043 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:10:04,044 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:40642': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:04,150 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:10:04,151 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:40652': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:04,258 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:10:04,258 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:40660': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:04,364 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:10:04,365 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:40672': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:04,471 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:10:04,471 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:40680': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:04,578 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:10:04,578 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:40692': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:04,685 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:10:04,686 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:40702': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:04,793 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:10:04,793 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:40704': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:04,900 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:10:04,900 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:40708': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:05,006 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:10:05,006 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:40714': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:05,113 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:10:05,114 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:40716': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:05,221 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:10:05,221 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:40726': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:05,329 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:10:05,329 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:40742': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:05,436 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:10:05,436 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:40746': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:05,543 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:10:05,543 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:40762': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:05,650 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:10:05,650 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:40764': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:05,756 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:10:05,757 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:40766': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:05,864 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:10:05,864 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:40778': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:05,970 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:10:05,971 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:40784': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:06,077 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:10:06,078 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:40798': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:06,184 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:10:06,185 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:40814': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:06,293 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:10:06,293 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:40816': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:06,400 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:10:06,400 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:40822': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:06,506 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:10:06,507 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:40838': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:06,614 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:10:06,614 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:40854': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:06,721 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:10:06,721 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:40862': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:06,829 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:10:06,829 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:40874': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:06,936 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:10:06,936 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:40884': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:07,043 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:10:07,043 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:40892': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:07,150 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:10:07,150 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:40908': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:07,257 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:10:07,258 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:40918': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:07,364 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:10:07,365 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:40928': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:07,473 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:10:07,473 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:40934': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:07,580 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:10:07,581 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:40946': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:07,688 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:10:07,688 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:40960': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:07,795 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:10:07,795 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:40968': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:07,903 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:10:07,903 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:40980': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:08,009 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:10:08,010 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:40990': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:08,116 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:10:08,117 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:40992': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:08,223 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:10:08,223 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:41000': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:08,330 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:10:08,330 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:41004': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:08,437 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:10:08,437 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:41020': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:08,544 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:10:08,544 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:41026': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:08,651 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:10:08,651 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:41038': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:08,758 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:10:08,759 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:41046': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:08,865 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:10:08,866 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:41052': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:08,973 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:10:08,973 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:41062': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:09,080 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:10:09,080 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:41076': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:09,186 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:10:09,186 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:41078': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:09,293 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:10:09,293 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:41080': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:09,400 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:10:09,400 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:41086': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:09,506 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:10:09,506 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:41088': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:09,613 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:10:09,613 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:41092': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:09,720 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:10:09,720 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:41098': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:09,828 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:10:09,828 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:41102': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:09,935 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:10:09,935 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:41112': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:10,042 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:10:10,042 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:41126': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:10,149 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:10:10,149 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:41138': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:10,256 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:10:10,256 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:41146': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:10,362 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:10:10,363 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:41160': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:10,470 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:10:10,470 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:41174': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:10,576 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:10:10,577 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:41182': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:10,683 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:10:10,683 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:41188': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:10,789 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:10:10,790 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:41204': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:10,897 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:10:10,897 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:41216': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:11,004 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:10:11,005 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:41224': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:11,111 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:10:11,112 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:41236': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:11,218 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:10:11,219 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:41250': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:11,325 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:10:11,325 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:41254': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:11,432 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:10:11,432 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:41262': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:11,538 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:10:11,539 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:34124': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:11,645 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:10:11,646 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:34140': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:11,753 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:10:11,753 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:34152': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:11,860 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:10:11,860 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:34154': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:11,966 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:10:11,967 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:34160': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:12,073 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:10:12,074 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:34174': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:12,180 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:10:12,181 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:34188': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:12,288 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:10:12,288 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:34204': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:12,395 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:10:12,395 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:34216': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:12,501 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:10:12,502 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:34220': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:12,610 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:10:12,610 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:34232': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:12,717 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:10:12,717 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:34248': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:12,824 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:10:12,824 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:34258': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:12,931 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:10:12,931 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:34272': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:13,037 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:10:13,038 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:34286': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:13,144 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:10:13,145 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:34292': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:13,251 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:10:13,251 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:34304': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:13,358 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37127 5986s 2024-11-23 22:10:13,358 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37127': TLS handshake failed with remote 'tls://127.0.0.1:34310': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:13,429 - distributed.scheduler - INFO - Scheduler closing due to unknown reason... 5986s 2024-11-23 22:10:13,429 - distributed.scheduler - INFO - Scheduler closing all comms 5986s _____________________________ test_gen_cluster_tls _____________________________ 5986s 5986s fut = , timeout = 0 5986s 5986s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 5986s async with asyncio.timeout(timeout): 5986s > return await fut 5986s 5986s /usr/lib/python3/dist-packages/distributed/utils.py:1960: 5986s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5986s /usr/lib/python3/dist-packages/distributed/worker.py:1480: in start_unsafe 5986s await self._register_with_scheduler() 5986s /usr/lib/python3/dist-packages/distributed/worker.py:1179: in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s /usr/lib/python3/dist-packages/distributed/comm/core.py:342: in connect 5986s comm = await wait_for( 5986s /usr/lib/python3/dist-packages/distributed/utils.py:1960: in wait_for 5986s return await fut 5986s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:546: in connect 5986s stream = await self.client.connect( 5986s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5986s 5986s self = , host = '127.0.0.1' 5986s port = 33063, af = 5986s ssl_options = 5986s max_buffer_size = 8364507136.0, source_ip = None, source_port = None 5986s timeout = None 5986s 5986s async def connect( 5986s self, 5986s host: str, 5986s port: int, 5986s af: socket.AddressFamily = socket.AF_UNSPEC, 5986s ssl_options: Optional[Union[Dict[str, Any], ssl.SSLContext]] = None, 5986s max_buffer_size: Optional[int] = None, 5986s source_ip: Optional[str] = None, 5986s source_port: Optional[int] = None, 5986s timeout: Optional[Union[float, datetime.timedelta]] = None, 5986s ) -> IOStream: 5986s """Connect to the given host and port. 5986s 5986s Asynchronously returns an `.IOStream` (or `.SSLIOStream` if 5986s ``ssl_options`` is not None). 5986s 5986s Using the ``source_ip`` kwarg, one can specify the source 5986s IP address to use when establishing the connection. 5986s In case the user needs to resolve and 5986s use a specific interface, it has to be handled outside 5986s of Tornado as this depends very much on the platform. 5986s 5986s Raises `TimeoutError` if the input future does not complete before 5986s ``timeout``, which may be specified in any form allowed by 5986s `.IOLoop.add_timeout` (i.e. a `datetime.timedelta` or an absolute time 5986s relative to `.IOLoop.time`) 5986s 5986s Similarly, when the user requires a certain source port, it can 5986s be specified using the ``source_port`` arg. 5986s 5986s .. versionchanged:: 4.5 5986s Added the ``source_ip`` and ``source_port`` arguments. 5986s 5986s .. versionchanged:: 5.0 5986s Added the ``timeout`` argument. 5986s """ 5986s if timeout is not None: 5986s if isinstance(timeout, numbers.Real): 5986s timeout = IOLoop.current().time() + timeout 5986s elif isinstance(timeout, datetime.timedelta): 5986s timeout = IOLoop.current().time() + timeout.total_seconds() 5986s else: 5986s raise TypeError("Unsupported timeout %r" % timeout) 5986s if timeout is not None: 5986s addrinfo = await gen.with_timeout( 5986s timeout, self.resolver.resolve(host, port, af) 5986s ) 5986s else: 5986s addrinfo = await self.resolver.resolve(host, port, af) 5986s connector = _Connector( 5986s addrinfo, 5986s functools.partial( 5986s self._create_stream, 5986s max_buffer_size, 5986s source_ip=source_ip, 5986s source_port=source_port, 5986s ), 5986s ) 5986s > af, addr, stream = await connector.start(connect_timeout=timeout) 5986s E asyncio.exceptions.CancelledError 5986s 5986s /usr/lib/python3/dist-packages/tornado/tcpclient.py:279: CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s self = 5986s 5986s @final 5986s async def start(self): 5986s async with self._startup_lock: 5986s if self.status == Status.failed: 5986s assert self.__startup_exc is not None 5986s raise self.__startup_exc 5986s elif self.status != Status.init: 5986s return self 5986s timeout = getattr(self, "death_timeout", None) 5986s 5986s async def _close_on_failure(exc: Exception) -> None: 5986s await self.close(reason=f"failure-to-start-{str(type(exc))}") 5986s self.status = Status.failed 5986s self.__startup_exc = exc 5986s 5986s try: 5986s > await wait_for(self.start_unsafe(), timeout=timeout) 5986s 5986s /usr/lib/python3/dist-packages/distributed/core.py:664: 5986s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5986s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 5986s async with asyncio.timeout(timeout): 5986s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5986s 5986s self = 5986s exc_type = 5986s exc_val = CancelledError(), exc_tb = 5986s 5986s async def __aexit__( 5986s self, 5986s exc_type: Optional[Type[BaseException]], 5986s exc_val: Optional[BaseException], 5986s exc_tb: Optional[TracebackType], 5986s ) -> Optional[bool]: 5986s assert self._state in (_State.ENTERED, _State.EXPIRING) 5986s 5986s if self._timeout_handler is not None: 5986s self._timeout_handler.cancel() 5986s self._timeout_handler = None 5986s 5986s if self._state is _State.EXPIRING: 5986s self._state = _State.EXPIRED 5986s 5986s if self._task.uncancel() <= self._cancelling and exc_type is not None: 5986s # Since there are no new cancel requests, we're 5986s # handling this. 5986s if issubclass(exc_type, exceptions.CancelledError): 5986s > raise TimeoutError from exc_val 5986s E TimeoutError 5986s 5986s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s @contextlib.asynccontextmanager 5986s async def _cluster_factory(): 5986s workers = [] 5986s s = None 5986s try: 5986s for _ in range(60): 5986s try: 5986s > s, ws = await start_cluster( 5986s nthreads, 5986s scheduler, 5986s security=security, 5986s Worker=Worker, 5986s scheduler_kwargs=scheduler_kwargs, 5986s worker_kwargs=merge( 5986s {"death_timeout": min(15, int(deadline.remaining))}, 5986s worker_kwargs, 5986s ), 5986s ) 5986s 5986s /usr/lib/python3/dist-packages/distributed/utils_test.py:966: 5986s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5986s /usr/lib/python3/dist-packages/distributed/utils_test.py:789: in start_cluster 5986s await asyncio.gather(*workers) 5986s /usr/lib/python3.13/asyncio/tasks.py:737: in _wrap_awaitable 5986s return await awaitable 5986s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5986s 5986s self = 5986s 5986s @final 5986s async def start(self): 5986s async with self._startup_lock: 5986s if self.status == Status.failed: 5986s assert self.__startup_exc is not None 5986s raise self.__startup_exc 5986s elif self.status != Status.init: 5986s return self 5986s timeout = getattr(self, "death_timeout", None) 5986s 5986s async def _close_on_failure(exc: Exception) -> None: 5986s await self.close(reason=f"failure-to-start-{str(type(exc))}") 5986s self.status = Status.failed 5986s self.__startup_exc = exc 5986s 5986s try: 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s except asyncio.TimeoutError as exc: 5986s await _close_on_failure(exc) 5986s > raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s E TimeoutError: Worker start timed out after 0s. 5986s 5986s /usr/lib/python3/dist-packages/distributed/core.py:667: TimeoutError 5986s 5986s During handling of the above exception, another exception occurred: 5986s 5986s fut = ._..test_func..async_fn at 0xde81ab08> 5986s timeout = 60 5986s 5986s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 5986s async with asyncio.timeout(timeout): 5986s > return await fut 5986s 5986s /usr/lib/python3/dist-packages/distributed/utils.py:1960: 5986s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5986s /usr/lib/python3/dist-packages/distributed/utils_test.py:999: in async_fn 5986s _cluster_factory() as (s, workers), 5986s /usr/lib/python3.13/contextlib.py:214: in __aenter__ 5986s return await anext(self.gen) 5986s /usr/lib/python3/dist-packages/distributed/utils_test.py:983: in _cluster_factory 5986s await asyncio.sleep(1) 5986s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5986s 5986s delay = 1, result = None 5986s 5986s async def sleep(delay, result=None): 5986s """Coroutine that completes after a given time (in seconds).""" 5986s if delay <= 0: 5986s await __sleep0() 5986s return result 5986s 5986s if math.isnan(delay): 5986s raise ValueError("Invalid delay: NaN (not a number)") 5986s 5986s loop = events.get_running_loop() 5986s future = loop.create_future() 5986s h = loop.call_later(delay, 5986s futures._set_result_unless_cancelled, 5986s future, result) 5986s try: 5986s > return await future 5986s E asyncio.exceptions.CancelledError 5986s 5986s /usr/lib/python3.13/asyncio/tasks.py:718: CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s args = (), kwds = {} 5986s 5986s @wraps(func) 5986s def inner(*args, **kwds): 5986s with self._recreate_cm(): 5986s > return func(*args, **kwds) 5986s 5986s /usr/lib/python3.13/contextlib.py:85: 5986s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5986s /usr/lib/python3.13/contextlib.py:85: in inner 5986s return func(*args, **kwds) 5986s /usr/lib/python3/dist-packages/distributed/utils_test.py:1102: in test_func 5986s return _run_and_close_tornado(async_fn_outer) 5986s /usr/lib/python3/dist-packages/distributed/utils_test.py:378: in _run_and_close_tornado 5986s return asyncio_run(inner_fn(), loop_factory=get_loop_factory()) 5986s /usr/lib/python3.13/asyncio/runners.py:194: in run 5986s return runner.run(main) 5986s /usr/lib/python3.13/asyncio/runners.py:118: in run 5986s return self._loop.run_until_complete(task) 5986s /usr/lib/python3.13/asyncio/base_events.py:720: in run_until_complete 5986s return future.result() 5986s /usr/lib/python3/dist-packages/distributed/utils_test.py:375: in inner_fn 5986s return await async_fn(*args, **kwargs) 5986s /usr/lib/python3/dist-packages/distributed/utils_test.py:1099: in async_fn_outer 5986s return await utils_wait_for(async_fn(), timeout=timeout * 2) 5986s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 5986s async with asyncio.timeout(timeout): 5986s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5986s 5986s self = 5986s exc_type = 5986s exc_val = CancelledError(), exc_tb = 5986s 5986s async def __aexit__( 5986s self, 5986s exc_type: Optional[Type[BaseException]], 5986s exc_val: Optional[BaseException], 5986s exc_tb: Optional[TracebackType], 5986s ) -> Optional[bool]: 5986s assert self._state in (_State.ENTERED, _State.EXPIRING) 5986s 5986s if self._timeout_handler is not None: 5986s self._timeout_handler.cancel() 5986s self._timeout_handler = None 5986s 5986s if self._state is _State.EXPIRING: 5986s self._state = _State.EXPIRED 5986s 5986s if self._task.uncancel() <= self._cancelling and exc_type is not None: 5986s # Since there are no new cancel requests, we're 5986s # handling this. 5986s if issubclass(exc_type, exceptions.CancelledError): 5986s > raise TimeoutError from exc_val 5986s E TimeoutError 5986s 5986s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 5986s ----------------------------- Captured stderr call ----------------------------- 5986s 2024-11-23 22:10:13,821 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:10:13,827 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:13,827 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:32889/status 5986s 2024-11-23 22:10:13,828 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:10:13,838 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46589 5986s 2024-11-23 22:10:13,838 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46589 5986s 2024-11-23 22:10:13,838 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:10:13,838 - distributed.worker - INFO - dashboard at: 127.0.0.1:44311 5986s 2024-11-23 22:10:13,838 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:13,838 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:10:13,838 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:10:13,838 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:10:13,838 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-hx9mj73n 5986s 2024-11-23 22:10:13,838 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:10:13,840 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34999 5986s 2024-11-23 22:10:13,840 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34999 5986s 2024-11-23 22:10:13,840 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:10:13,840 - distributed.worker - INFO - dashboard at: 127.0.0.1:43977 5986s 2024-11-23 22:10:13,840 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:13,840 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:10:13,840 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:10:13,840 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:10:13,840 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-tymyvojp 5986s 2024-11-23 22:10:13,840 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:10:13,851 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:13,852 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:13,852 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:39568': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:13,852 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:39580': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:13,964 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:13,964 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:13,964 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:39594': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:13,964 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:39604': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:14,077 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:14,078 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:14,078 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:39610': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:14,078 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:39616': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:14,189 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:14,190 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:14,190 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:39622': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:14,190 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:39632': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:14,301 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:14,302 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:14,302 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:39648': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:14,302 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:39662': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:14,413 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:14,413 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:14,414 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:39674': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:14,414 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:39688': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:14,525 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:14,525 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:14,525 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:39700': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:14,525 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:39710': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:14,636 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:14,637 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:14,637 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:39720': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:14,637 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:39736': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:14,750 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:14,750 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:14,750 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:39744': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:14,750 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:39750': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:14,862 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:14,862 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:14,862 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:39752': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:14,862 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:39760': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:14,974 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:14,974 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:14,974 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:39772': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:14,974 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:39778': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:15,086 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:15,086 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:15,086 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:39786': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:15,086 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:39792': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:15,198 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:15,198 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:15,198 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:39808': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:15,198 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:39816': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:15,309 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:15,310 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:15,310 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:39818': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:15,310 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:39832': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:15,421 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:15,421 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:15,421 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:39838': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:15,421 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:39852': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:15,533 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:15,533 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:15,533 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:39868': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:15,533 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:39874': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:15,645 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:15,645 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:15,645 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:39880': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:15,645 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:39886': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:15,758 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:15,758 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:15,758 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:39892': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:15,758 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:39896': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:15,870 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:15,870 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:15,870 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:39912': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:15,870 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:39926': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:15,982 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:15,982 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:15,982 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:39932': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:15,982 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:39936': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:16,093 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:16,093 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:16,094 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:39940': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:16,094 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:39948': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:16,205 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:16,206 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:16,206 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:39960': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:16,206 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:39976': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:16,317 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:16,317 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:16,318 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:39980': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:16,318 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:39988': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:16,430 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:16,430 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:16,430 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:40002': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:16,430 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:40018': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:16,541 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:16,541 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:16,541 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:40034': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:16,541 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:40040': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:16,653 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:16,653 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:16,653 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:40044': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:16,653 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:40046': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:16,765 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:16,765 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:16,765 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:40062': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:16,765 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:40070': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:16,877 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:16,877 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:16,877 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:40078': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:16,877 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:40094': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:16,989 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:16,989 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:16,989 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:40096': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:16,989 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:40110': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:17,100 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:17,100 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:17,101 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:40112': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:17,101 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:40128': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:17,212 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:17,212 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:17,213 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:40132': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:17,213 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:40140': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:17,324 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:17,324 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:17,325 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:40146': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:17,325 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:40158': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:17,439 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:17,439 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:17,440 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:40162': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:17,440 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:40176': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:17,551 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:17,551 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:17,552 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:40188': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:17,552 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:40200': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:17,663 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:17,663 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:17,663 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:40210': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:17,663 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:40222': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:17,775 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:17,775 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:17,775 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:40232': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:17,775 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:40234': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:17,886 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:17,886 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:17,887 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:40238': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:17,887 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:40250': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:17,999 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:17,999 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:18,000 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:40262': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:18,000 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:40264': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:18,111 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:18,112 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:18,112 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:40280': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:18,112 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:40290': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:18,223 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:18,224 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:18,224 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:40298': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:18,224 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:40304': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:18,335 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:18,336 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:18,338 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:40310': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:18,338 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:40312': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:18,447 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:18,447 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:18,447 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:40324': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:18,447 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:40330': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:18,559 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:18,559 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:18,559 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:40346': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:18,559 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:40358': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:18,670 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:18,670 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:18,670 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:40366': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:18,670 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:40376': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:18,782 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:18,782 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:18,782 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:40384': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:18,782 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:40388': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:18,893 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:18,893 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:18,894 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:40402': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:18,894 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:40412': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:19,005 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:19,006 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:19,006 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:40420': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:19,006 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:40428': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:19,117 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:19,117 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:19,117 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:40438': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:19,117 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:40448': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:19,231 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:19,231 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:19,231 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:40452': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:19,231 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:40464': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:19,342 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:19,342 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:19,342 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:40476': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:19,342 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:40478': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:19,454 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:19,454 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:19,455 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:40492': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:19,455 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:40496': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:19,567 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:19,567 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:19,568 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:40506': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:19,568 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:40520': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:19,679 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:19,680 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:19,680 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:40522': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:19,680 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:40526': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:19,792 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:19,792 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:19,793 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:40530': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:19,793 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:40544': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:19,904 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:19,904 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:19,904 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:40546': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:19,904 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:40560': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:20,016 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:20,016 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:20,016 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:40566': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:20,016 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:40570': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:20,128 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:20,128 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:20,128 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:40586': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:20,128 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:40602': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:20,240 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:20,240 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:20,240 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:40612': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:20,240 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:40628': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:20,352 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:20,353 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:20,353 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:40630': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:20,353 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:40638': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:20,465 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:20,465 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:20,465 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:40650': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:20,465 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:40652': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:20,577 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:20,577 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:20,577 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:40668': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:20,577 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:40682': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:20,688 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:20,688 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:20,688 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:40696': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:20,689 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:40712': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:20,800 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:20,801 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:20,801 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:40722': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:20,801 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:40734': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:20,914 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:20,914 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:20,914 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:40736': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:20,914 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:40748': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:21,028 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:21,028 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:21,028 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:40762': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:21,028 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:40770': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:21,139 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:21,139 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:21,139 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:40780': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:21,140 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:40784': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:21,251 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:21,251 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:21,251 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:40796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:21,252 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:40798': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:21,363 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:21,363 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:21,363 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:40806': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:21,363 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:40820': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:21,475 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:21,475 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:21,475 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:40822': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:21,475 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:40826': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:21,587 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:21,587 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:21,588 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:53504': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:21,588 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:53508': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:21,700 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:21,700 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:21,700 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:53522': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:21,700 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:53532': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:21,813 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:21,813 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:21,814 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:53548': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:21,814 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:53558': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:21,925 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:21,925 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:21,925 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:53566': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:21,925 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:53574': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:22,037 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:22,037 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:22,037 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:53580': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:22,038 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:53586': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:22,149 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:22,149 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:22,150 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:53602': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:22,150 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:53612': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:22,261 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:22,262 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:22,262 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:53620': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:22,262 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:53636': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:22,373 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:22,373 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:22,373 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:53646': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:22,373 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:53658': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:22,485 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:22,485 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:22,485 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:53660': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:22,485 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:53662': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:22,597 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:22,597 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:22,597 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:53670': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:22,597 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:53678': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:22,708 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:22,709 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:22,710 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:53684': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:22,710 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:53686': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:22,822 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:22,822 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:22,822 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:53700': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:22,822 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:53706': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:22,934 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:22,934 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:22,934 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:53720': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:22,935 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:53734': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:23,045 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:23,045 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:23,046 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:53744': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:23,046 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:53754': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:23,158 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:23,159 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:23,159 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:53768': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:23,159 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:53784': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:23,270 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:23,271 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:23,271 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:53796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:23,271 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:53800': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:23,382 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:23,382 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:23,382 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:53808': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:23,382 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:53824': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:23,494 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:23,494 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:23,494 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:53836': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:23,494 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:53838': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:23,605 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:23,605 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:23,606 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:53846': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:23,606 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:53860': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:23,718 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:23,718 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:23,718 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:53870': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:23,718 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:53882': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:23,830 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:23,830 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:23,833 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:53886': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:23,833 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:53890': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:23,941 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:23,942 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:23,942 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:53900': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:23,942 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:53902': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:24,053 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:24,054 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:24,054 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:53906': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:24,054 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:53920': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:24,165 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:24,165 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:24,165 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:53922': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:24,165 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:53932': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:24,276 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:24,277 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:24,277 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:53944': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:24,277 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:53954': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:24,389 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:24,389 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:24,389 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:53960': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:24,389 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:53968': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:24,502 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:24,502 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:24,502 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:53984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:24,502 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:53986': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:24,615 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:24,615 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:24,615 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:53990': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:24,616 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:53992': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:24,727 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:24,727 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:24,727 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:54000': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:24,728 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:54016': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:24,841 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:24,841 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:24,842 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:54028': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:24,842 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:54034': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:24,953 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:24,953 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:24,953 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:54038': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:24,953 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:54044': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:25,065 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:25,065 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:25,065 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:54058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:25,065 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:54070': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:25,177 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:25,178 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:25,178 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:54078': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:25,178 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:54082': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:25,290 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:25,290 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:25,290 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:54088': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:25,290 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:54104': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:25,402 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:25,402 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:25,402 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:54112': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:25,403 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:54116': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:25,514 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:25,514 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:25,514 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:54122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:25,514 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:54124': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:25,627 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:25,627 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:25,627 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:54134': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:25,627 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:54142': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:25,739 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:25,739 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:25,739 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:54150': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:25,739 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:54162': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:25,851 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:25,852 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:25,852 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:54168': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:25,852 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:54182': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:25,963 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:25,964 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:25,964 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:54186': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:25,964 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:54190': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:26,077 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:26,077 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:26,077 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:54204': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:26,077 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:54212': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:26,188 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:26,188 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:26,188 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:54222': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:26,189 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:54238': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:26,301 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:26,301 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:26,301 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:54252': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:26,302 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:54260': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:26,413 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:26,413 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:26,414 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:54266': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:26,414 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:54268': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:26,525 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:26,525 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:26,525 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:54272': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:26,525 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:54286': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:26,637 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:26,637 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:26,637 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:54288': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:26,637 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:54294': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:26,749 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:26,750 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:26,750 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:54298': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:26,750 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:54300': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:26,861 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:26,861 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:26,861 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:54306': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:26,861 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:54318': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:26,972 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:26,972 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:26,973 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:54320': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:26,973 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:54334': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:27,084 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:27,084 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:27,085 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:54342': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:27,085 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:54344': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:27,196 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:27,196 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:27,197 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:54360': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:27,197 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:54368': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:27,308 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:27,308 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:27,309 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:54376': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:27,309 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:54390': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:27,419 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:27,420 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:27,420 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:54400': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:27,420 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:54406': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:27,531 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:27,532 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:27,532 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:54412': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:27,532 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:54414': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:27,643 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:27,643 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:27,643 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:54424': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:27,643 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:54426': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:27,755 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:27,755 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:27,755 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:54440': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:27,755 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:54450': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:27,866 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:27,866 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:27,867 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:54466': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:27,867 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:54472': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:27,979 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:27,979 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:27,980 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:54482': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:27,980 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:54492': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:28,092 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:28,092 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:28,092 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:54508': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:28,092 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:54514': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:28,204 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:28,204 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:28,204 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:54530': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:28,204 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:54536': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:28,316 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:28,316 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:28,316 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:54548': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:28,316 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:54564': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:28,427 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:28,427 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:28,427 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:54568': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:28,427 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:54570': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:28,539 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:28,539 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:28,539 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:54586': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:28,539 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:54588': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:28,650 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:28,650 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:28,651 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:54598': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:28,651 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:54604': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:28,762 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:28,762 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38309 5986s 2024-11-23 22:10:28,763 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:54606': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:28,763 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38309': TLS handshake failed with remote 'tls://127.0.0.1:54608': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:28,838 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46589. Reason: failure-to-start- 5986s 2024-11-23 22:10:28,838 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:10:28,839 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34999. Reason: failure-to-start- 5986s 2024-11-23 22:10:28,839 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:10:28,840 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 15s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 5986s stream = await stream.start_tls( 5986s ^^^^^^^^^^^^^^^^^^^^^^^ 5986s False, ssl_options=ssl_options, server_hostname=host 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 5986s self.socket.do_handshake() 5986s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 5986s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 5986s self._sslobj.do_handshake() 5986s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 5986s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 5986s raise FatalCommClosedError( 5986s ...<2 lines>... 5986s ) from err 5986s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 5986s 5986s During handling of the above exception, another exception occurred: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1218, in _register_with_scheduler 5986s await asyncio.sleep(0.1) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 718, in sleep 5986s return await future 5986s ^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 15s. 5986s 2024-11-23 22:10:29,845 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:10:29,851 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:29,851 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43261/status 5986s 2024-11-23 22:10:29,852 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:10:29,864 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:32807 5986s 2024-11-23 22:10:29,864 - distributed.worker - INFO - Listening to: tls://127.0.0.1:32807 5986s 2024-11-23 22:10:29,864 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:10:29,864 - distributed.worker - INFO - dashboard at: 127.0.0.1:40221 5986s 2024-11-23 22:10:29,864 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:29,864 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:10:29,864 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:10:29,864 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:10:29,864 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-lck105xp 5986s 2024-11-23 22:10:29,864 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:10:29,866 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46167 5986s 2024-11-23 22:10:29,866 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46167 5986s 2024-11-23 22:10:29,866 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:10:29,866 - distributed.worker - INFO - dashboard at: 127.0.0.1:40015 5986s 2024-11-23 22:10:29,866 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:29,866 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:10:29,866 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:10:29,866 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:10:29,866 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-90axz8_o 5986s 2024-11-23 22:10:29,866 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:10:29,878 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:29,878 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:29,878 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:60680': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:29,878 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:60686': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:29,991 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:29,991 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:29,991 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:60688': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:29,991 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:60696': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:30,103 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:30,103 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:30,104 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:60708': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:30,104 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:60718': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:30,215 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:30,215 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:30,215 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:60724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:30,215 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:60734': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:30,326 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:30,326 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:30,326 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:60748': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:30,326 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:60750': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:30,438 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:30,438 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:30,439 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:60754': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:30,439 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:60760': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:30,550 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:30,550 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:30,550 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:60770': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:30,550 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:60778': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:30,661 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:30,661 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:30,662 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:60780': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:30,662 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:60790': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:30,773 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:30,773 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:30,774 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:60792': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:30,774 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:60806': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:30,884 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:30,885 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:30,885 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:60810': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:30,885 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:60812': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:30,996 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:30,997 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:30,997 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:60814': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:30,997 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:60830': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:31,109 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:31,110 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:31,110 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:60840': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:31,110 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:60848': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:31,222 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:31,223 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:31,223 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:60864': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:31,223 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:60872': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:31,334 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:31,334 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:31,337 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:60888': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:31,337 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:60894': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:31,446 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:31,446 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:31,446 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:60900': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:31,446 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:60916': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:31,558 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:31,559 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:31,559 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:40630': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:31,559 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:40632': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:31,671 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:31,671 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:31,672 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:40638': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:31,672 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:40642': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:31,782 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:31,782 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:31,783 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:40654': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:31,783 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:40664': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:31,894 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:31,894 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:31,894 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:40678': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:31,895 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:40688': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:32,005 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:32,005 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:32,005 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:40698': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:32,005 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:40710': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:32,116 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:32,116 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:32,117 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:40720': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:32,117 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:40724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:32,228 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:32,228 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:32,229 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:40738': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:32,229 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:40742': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:32,341 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:32,341 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:32,341 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:40746': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:32,341 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:40750': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:32,454 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:32,454 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:32,454 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:40762': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:32,454 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:40768': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:32,565 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:32,565 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:32,566 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:40774': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:32,566 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:40778': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:32,677 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:32,678 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:32,678 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:40784': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:32,678 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:40794': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:32,789 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:32,789 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:32,789 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:40802': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:32,789 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:40810': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:32,900 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:32,900 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:32,902 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:40814': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:32,902 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:40820': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:33,012 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:33,012 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:33,012 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:40824': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:33,013 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:40840': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:33,124 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:33,124 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:33,124 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:40846': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:33,124 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:40848': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:33,237 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:33,237 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:33,237 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:40862': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:33,237 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:40864': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:33,348 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:33,348 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:33,349 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:40870': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:33,349 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:40882': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:33,460 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:33,461 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:33,461 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:40892': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:33,461 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:40902': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:33,573 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:33,573 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:33,574 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:40910': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:33,574 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:40914': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:33,685 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:33,685 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:33,686 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:40926': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:33,686 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:40942': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:33,797 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:33,797 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:33,798 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:40946': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:33,798 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:40948': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:33,909 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:33,909 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:33,909 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:40956': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:33,909 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:40958': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:34,020 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:34,020 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:34,020 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:40974': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:34,020 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:40978': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:34,132 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:34,133 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:34,133 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:40988': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:34,133 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:41002': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:34,244 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:34,244 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:34,244 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:41016': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:34,244 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:41028': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:34,356 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:34,357 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:34,359 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:41040': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:34,359 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:41056': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:34,469 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:34,469 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:34,469 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:41068': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:34,469 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:41084': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:34,580 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:34,580 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:34,581 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:41086': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:34,581 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:41094': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:34,693 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:34,693 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:34,693 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:41110': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:34,693 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:41120': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:34,804 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:34,805 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:34,805 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:41128': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:34,805 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:41144': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:34,916 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:34,916 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:34,916 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:41146': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:34,916 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:41152': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:35,028 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:35,028 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:35,028 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:41162': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:35,028 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:41172': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:35,135 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:35,139 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:41182': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:35,140 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:35,140 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:41190': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:35,242 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:35,243 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:41200': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:35,248 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:35,248 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:41206': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:35,350 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:35,351 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:41214': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:35,356 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:35,358 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:41230': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:35,457 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:35,457 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:41246': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:35,463 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:35,463 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:41254': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:35,564 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:35,564 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:41256': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:35,569 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:35,570 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:41270': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:35,670 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:35,670 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:41284': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:35,676 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:35,676 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:41296': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:35,778 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:35,779 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:41310': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:35,784 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:35,784 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:41318': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:35,885 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:35,886 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:41330': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:35,891 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:35,891 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:41342': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:35,992 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:35,993 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:41356': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:35,998 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:35,999 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:41358': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:36,100 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:36,100 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:41370': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:36,106 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:36,106 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:41382': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:36,207 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:36,207 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:41398': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:36,213 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:36,213 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:41406': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:36,314 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:36,314 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:41420': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:36,320 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:36,321 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:41428': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:36,421 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:36,421 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:41432': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:36,427 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:36,427 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:41436': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:36,528 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:36,528 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:41442': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:36,534 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:36,534 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:41452': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:36,634 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:36,634 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:41460': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:36,640 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:36,640 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:41472': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:36,741 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:36,742 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:41476': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:36,747 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:36,747 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:41484': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:36,848 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:36,848 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:41486': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:36,853 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:36,856 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:41496': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:36,955 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:36,956 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:41504': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:36,961 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:36,961 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:41516': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:37,062 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:37,063 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:41520': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:37,068 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:37,068 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:41534': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:37,169 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:37,169 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:41542': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:37,175 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:37,175 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:41554': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:37,275 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:37,276 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:41564': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:37,281 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:37,281 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:41566': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:37,382 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:37,383 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:41582': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:37,388 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:37,388 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:41584': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:37,489 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:37,489 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:41598': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:37,495 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:37,495 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:41608': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:37,596 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:37,597 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:41616': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:37,602 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:37,602 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:41622': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:37,703 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:37,704 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:41638': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:37,709 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:37,710 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:41648': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:37,811 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:37,812 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:41650': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:37,817 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:37,817 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:41664': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:37,918 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:37,919 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:41668': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:37,924 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:37,924 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:41676': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:38,027 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:38,028 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:41688': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:38,033 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:38,033 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:41698': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:38,134 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:38,134 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:41702': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:38,139 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:38,140 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:41710': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:38,241 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:38,241 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:41714': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:38,247 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:38,247 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:41720': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:38,347 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:38,347 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:41724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:38,353 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:38,355 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:41738': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:38,454 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:38,455 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:41750': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:38,460 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:38,460 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:41752': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:38,561 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:38,561 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:41762': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:38,567 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:38,567 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:41766': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:38,668 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:38,669 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:41778': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:38,674 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:38,674 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:41786': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:38,775 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:38,776 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:41792': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:38,781 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:38,781 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:41800': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:38,882 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:38,883 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:41814': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:38,888 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:38,888 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:41824': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:38,989 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:38,989 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:41838': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:38,994 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:38,995 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:41852': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:39,095 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:39,096 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:41858': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:39,101 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:39,102 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:41868': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:39,203 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:39,203 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:41884': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:39,208 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:39,209 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:41898': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:39,309 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:39,310 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:41914': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:39,315 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:39,315 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:41922': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:39,416 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:39,417 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:41938': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:39,422 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:39,422 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:41942': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:39,523 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:39,524 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:41952': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:39,529 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:39,530 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:41954': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:39,630 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:39,630 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:41956': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:39,637 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:39,637 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:41972': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:39,737 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:39,737 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:41988': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:39,743 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:39,743 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:41992': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:39,843 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:39,844 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:41998': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:39,849 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:39,849 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:42006': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:39,950 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:39,950 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:42016': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:39,956 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:39,956 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:42028': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:40,057 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:40,057 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:42034': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:40,062 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:40,063 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:42042': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:40,163 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:40,163 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:42056': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:40,169 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:40,169 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:42068': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:40,270 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:40,271 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:42078': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:40,276 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:40,276 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:42090': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:40,378 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:40,379 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:42102': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:40,384 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:40,384 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:42112': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:40,486 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:40,487 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:42124': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:40,492 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:40,492 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:42138': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:40,594 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:40,595 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:42154': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:40,600 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:40,601 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:42160': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:40,702 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:40,702 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:42170': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:40,709 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:40,710 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:42182': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:40,809 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:40,809 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:42190': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:40,816 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:40,816 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:42206': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:40,916 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:40,916 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:42218': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:40,921 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:40,922 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:42226': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:41,023 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:41,023 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:42234': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:41,028 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:41,029 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:42248': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:41,129 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:41,130 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:42252': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:41,135 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:41,135 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:42262': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:41,236 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:41,237 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:42266': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:41,242 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:41,242 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:42278': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:41,343 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:41,343 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:42286': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:41,349 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:41,349 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:42288': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:41,450 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:41,450 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:42294': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:41,456 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:41,456 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:42300': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:41,556 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:41,557 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:38792': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:41,562 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:41,563 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:38800': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:41,663 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:41,664 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:38804': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:41,669 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:41,669 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:38818': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:41,770 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:41,771 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:38826': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:41,776 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:41,777 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:38832': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:41,877 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:41,878 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:38834': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:41,883 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:41,884 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:38846': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:41,985 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:41,986 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:38852': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:41,991 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:41,992 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:38858': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:42,093 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:42,094 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:38866': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:42,099 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:42,099 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:38872': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:42,200 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:42,200 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:38886': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:42,206 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:42,206 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:38896': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:42,307 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:42,307 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:38906': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:42,313 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:42,313 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:38916': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:42,414 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:42,415 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:38920': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:42,420 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:42,421 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:38930': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:42,522 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:42,522 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:38940': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:42,528 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:42,528 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:38954': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:42,628 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:42,629 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:38970': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:42,634 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:42,635 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:38980': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:42,735 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:42,735 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:38992': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:42,741 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:42,741 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:38994': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:42,842 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:42,842 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:39008': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:42,848 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34067 5986s 2024-11-23 22:10:42,848 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34067': TLS handshake failed with remote 'tls://127.0.0.1:39012': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 5986s 2024-11-23 22:10:42,864 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:32807. Reason: failure-to-start- 5986s 2024-11-23 22:10:42,864 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:10:42,865 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46167. Reason: failure-to-start- 5986s 2024-11-23 22:10:42,866 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:10:42,866 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 13s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 5986s stream = await stream.start_tls( 5986s ^^^^^^^^^^^^^^^^^^^^^^^ 5986s False, ssl_options=ssl_options, server_hostname=host 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 5986s self.socket.do_handshake() 5986s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 5986s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 5986s self._sslobj.do_handshake() 5986s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 5986s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 5986s raise FatalCommClosedError( 5986s ...<2 lines>... 5986s ) from err 5986s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 5986s 5986s During handling of the above exception, another exception occurred: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1218, in _register_with_scheduler 5986s await asyncio.sleep(0.1) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 718, in sleep 5986s return await future 5986s ^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 13s. 5986s 2024-11-23 22:10:43,871 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:10:43,877 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45113 5986s 2024-11-23 22:10:43,877 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33077/status 5986s 2024-11-23 22:10:43,878 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:10:43,889 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37437 5986s 2024-11-23 22:10:43,889 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37437 5986s 2024-11-23 22:10:43,889 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:10:43,889 - distributed.worker - INFO - dashboard at: 127.0.0.1:37549 5986s 2024-11-23 22:10:43,890 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45113 5986s 2024-11-23 22:10:43,890 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:10:43,890 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:10:43,890 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:10:43,890 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-wbge79ix 5986s 2024-11-23 22:10:43,890 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:10:43,891 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38949 5986s 2024-11-23 22:10:43,891 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38949 5986s 2024-11-23 22:10:43,891 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:10:43,891 - distributed.worker - INFO - dashboard at: 127.0.0.1:41393 5986s 2024-11-23 22:10:43,892 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45113 5986s 2024-11-23 22:10:43,892 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:10:43,892 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:10:43,892 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:10:43,892 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-r1add2wq 5986s 2024-11-23 22:10:43,892 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:10:43,893 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37437. Reason: failure-to-start- 5986s 2024-11-23 22:10:43,893 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:10:43,893 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38949. Reason: failure-to-start- 5986s 2024-11-23 22:10:43,893 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:10:43,894 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45113': TLS handshake failed with remote 'tls://127.0.0.1:44128': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:10:43,894 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45113': TLS handshake failed with remote 'tls://127.0.0.1:44134': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:10:43,895 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:10:44,900 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:10:44,906 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37575 5986s 2024-11-23 22:10:44,906 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43883/status 5986s 2024-11-23 22:10:44,906 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:10:44,919 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38795 5986s 2024-11-23 22:10:44,919 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38795 5986s 2024-11-23 22:10:44,919 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:10:44,919 - distributed.worker - INFO - dashboard at: 127.0.0.1:43113 5986s 2024-11-23 22:10:44,919 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37575 5986s 2024-11-23 22:10:44,919 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:10:44,919 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:10:44,919 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:10:44,919 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-hgpbuz15 5986s 2024-11-23 22:10:44,919 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:10:44,921 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36207 5986s 2024-11-23 22:10:44,921 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36207 5986s 2024-11-23 22:10:44,921 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:10:44,921 - distributed.worker - INFO - dashboard at: 127.0.0.1:36941 5986s 2024-11-23 22:10:44,921 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37575 5986s 2024-11-23 22:10:44,921 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:10:44,921 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:10:44,921 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:10:44,921 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-h3o7mcex 5986s 2024-11-23 22:10:44,921 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:10:44,922 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38795. Reason: failure-to-start- 5986s 2024-11-23 22:10:44,922 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:10:44,922 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36207. Reason: failure-to-start- 5986s 2024-11-23 22:10:44,922 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:10:44,923 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37575': TLS handshake failed with remote 'tls://127.0.0.1:51412': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:10:44,923 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37575': TLS handshake failed with remote 'tls://127.0.0.1:51422': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:10:44,924 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:10:45,929 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:10:45,935 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34859 5986s 2024-11-23 22:10:45,936 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45457/status 5986s 2024-11-23 22:10:45,936 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:10:45,948 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44927 5986s 2024-11-23 22:10:45,948 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44927 5986s 2024-11-23 22:10:45,948 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:10:45,948 - distributed.worker - INFO - dashboard at: 127.0.0.1:40851 5986s 2024-11-23 22:10:45,948 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34859 5986s 2024-11-23 22:10:45,948 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:10:45,948 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:10:45,948 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:10:45,948 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-fusb2kni 5986s 2024-11-23 22:10:45,948 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:10:45,950 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40323 5986s 2024-11-23 22:10:45,950 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40323 5986s 2024-11-23 22:10:45,950 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:10:45,950 - distributed.worker - INFO - dashboard at: 127.0.0.1:45323 5986s 2024-11-23 22:10:45,950 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34859 5986s 2024-11-23 22:10:45,950 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:10:45,950 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:10:45,950 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:10:45,950 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-hn38c1i7 5986s 2024-11-23 22:10:45,950 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:10:45,951 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44927. Reason: failure-to-start- 5986s 2024-11-23 22:10:45,951 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:10:45,952 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40323. Reason: failure-to-start- 5986s 2024-11-23 22:10:45,952 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:10:45,953 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34859': TLS handshake failed with remote 'tls://127.0.0.1:41704': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:10:45,953 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34859': TLS handshake failed with remote 'tls://127.0.0.1:41706': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:10:45,954 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:10:46,958 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:10:46,964 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37051 5986s 2024-11-23 22:10:46,965 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45269/status 5986s 2024-11-23 22:10:46,965 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:10:46,976 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45463 5986s 2024-11-23 22:10:46,976 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45463 5986s 2024-11-23 22:10:46,976 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:10:46,976 - distributed.worker - INFO - dashboard at: 127.0.0.1:38293 5986s 2024-11-23 22:10:46,976 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37051 5986s 2024-11-23 22:10:46,976 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:10:46,976 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:10:46,976 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:10:46,976 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-x9i511mg 5986s 2024-11-23 22:10:46,976 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:10:46,978 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:32963 5986s 2024-11-23 22:10:46,978 - distributed.worker - INFO - Listening to: tls://127.0.0.1:32963 5986s 2024-11-23 22:10:46,978 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:10:46,978 - distributed.worker - INFO - dashboard at: 127.0.0.1:45993 5986s 2024-11-23 22:10:46,978 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37051 5986s 2024-11-23 22:10:46,978 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:10:46,978 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:10:46,978 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:10:46,978 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-rv1jikwx 5986s 2024-11-23 22:10:46,978 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:10:46,979 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45463. Reason: failure-to-start- 5986s 2024-11-23 22:10:46,979 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:10:46,979 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:32963. Reason: failure-to-start- 5986s 2024-11-23 22:10:46,979 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:10:46,980 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37051': TLS handshake failed with remote 'tls://127.0.0.1:56254': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:10:46,980 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37051': TLS handshake failed with remote 'tls://127.0.0.1:56266': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:10:46,981 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:10:47,987 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:10:47,993 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36219 5986s 2024-11-23 22:10:47,993 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46705/status 5986s 2024-11-23 22:10:47,994 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:10:48,005 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37149 5986s 2024-11-23 22:10:48,005 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37149 5986s 2024-11-23 22:10:48,005 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:10:48,005 - distributed.worker - INFO - dashboard at: 127.0.0.1:43397 5986s 2024-11-23 22:10:48,005 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36219 5986s 2024-11-23 22:10:48,005 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:10:48,005 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:10:48,005 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:10:48,005 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-39jblit5 5986s 2024-11-23 22:10:48,005 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:10:48,007 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42563 5986s 2024-11-23 22:10:48,007 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42563 5986s 2024-11-23 22:10:48,007 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:10:48,007 - distributed.worker - INFO - dashboard at: 127.0.0.1:45789 5986s 2024-11-23 22:10:48,007 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36219 5986s 2024-11-23 22:10:48,007 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:10:48,007 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:10:48,007 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:10:48,007 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-d5xq96rx 5986s 2024-11-23 22:10:48,007 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:10:48,008 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37149. Reason: failure-to-start- 5986s 2024-11-23 22:10:48,008 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:10:48,008 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42563. Reason: failure-to-start- 5986s 2024-11-23 22:10:48,008 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:10:48,009 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36219': TLS handshake failed with remote 'tls://127.0.0.1:33524': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:10:48,009 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36219': TLS handshake failed with remote 'tls://127.0.0.1:33538': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:10:48,010 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:10:49,015 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:10:49,022 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45239 5986s 2024-11-23 22:10:49,022 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41871/status 5986s 2024-11-23 22:10:49,022 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:10:49,035 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36587 5986s 2024-11-23 22:10:49,035 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36587 5986s 2024-11-23 22:10:49,035 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:10:49,035 - distributed.worker - INFO - dashboard at: 127.0.0.1:40457 5986s 2024-11-23 22:10:49,035 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45239 5986s 2024-11-23 22:10:49,035 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:10:49,035 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:10:49,035 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:10:49,035 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-bk59jwgd 5986s 2024-11-23 22:10:49,035 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:10:49,037 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40247 5986s 2024-11-23 22:10:49,037 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40247 5986s 2024-11-23 22:10:49,037 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:10:49,037 - distributed.worker - INFO - dashboard at: 127.0.0.1:39177 5986s 2024-11-23 22:10:49,037 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45239 5986s 2024-11-23 22:10:49,037 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:10:49,037 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:10:49,037 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:10:49,037 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-7gv885bz 5986s 2024-11-23 22:10:49,037 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:10:49,038 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36587. Reason: failure-to-start- 5986s 2024-11-23 22:10:49,038 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:10:49,039 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40247. Reason: failure-to-start- 5986s 2024-11-23 22:10:49,039 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:10:49,040 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45239': TLS handshake failed with remote 'tls://127.0.0.1:48484': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:10:49,040 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45239': TLS handshake failed with remote 'tls://127.0.0.1:48486': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:10:49,041 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:10:50,046 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:10:50,052 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39485 5986s 2024-11-23 22:10:50,052 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38403/status 5986s 2024-11-23 22:10:50,052 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:10:50,063 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39929 5986s 2024-11-23 22:10:50,063 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39929 5986s 2024-11-23 22:10:50,063 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:10:50,063 - distributed.worker - INFO - dashboard at: 127.0.0.1:43395 5986s 2024-11-23 22:10:50,064 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39485 5986s 2024-11-23 22:10:50,064 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:10:50,064 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:10:50,064 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:10:50,064 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-een4zp50 5986s 2024-11-23 22:10:50,064 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:10:50,066 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35955 5986s 2024-11-23 22:10:50,066 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35955 5986s 2024-11-23 22:10:50,066 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:10:50,066 - distributed.worker - INFO - dashboard at: 127.0.0.1:36813 5986s 2024-11-23 22:10:50,066 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39485 5986s 2024-11-23 22:10:50,066 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:10:50,066 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:10:50,066 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:10:50,066 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-m0xy6xdi 5986s 2024-11-23 22:10:50,066 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:10:50,067 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39929. Reason: failure-to-start- 5986s 2024-11-23 22:10:50,067 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:10:50,068 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35955. Reason: failure-to-start- 5986s 2024-11-23 22:10:50,068 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:10:50,069 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39485': TLS handshake failed with remote 'tls://127.0.0.1:35362': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:10:50,069 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39485': TLS handshake failed with remote 'tls://127.0.0.1:35364': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:10:50,070 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:10:51,075 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:10:51,081 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36359 5986s 2024-11-23 22:10:51,082 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33047/status 5986s 2024-11-23 22:10:51,082 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:10:51,093 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42733 5986s 2024-11-23 22:10:51,093 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42733 5986s 2024-11-23 22:10:51,093 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:10:51,093 - distributed.worker - INFO - dashboard at: 127.0.0.1:38845 5986s 2024-11-23 22:10:51,093 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36359 5986s 2024-11-23 22:10:51,093 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:10:51,093 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:10:51,093 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:10:51,093 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-sclsmrnl 5986s 2024-11-23 22:10:51,093 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:10:51,095 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45313 5986s 2024-11-23 22:10:51,095 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45313 5986s 2024-11-23 22:10:51,095 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:10:51,095 - distributed.worker - INFO - dashboard at: 127.0.0.1:45363 5986s 2024-11-23 22:10:51,095 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36359 5986s 2024-11-23 22:10:51,095 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:10:51,095 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:10:51,095 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:10:51,095 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-9_g0ouox 5986s 2024-11-23 22:10:51,095 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:10:51,096 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42733. Reason: failure-to-start- 5986s 2024-11-23 22:10:51,096 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:10:51,096 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45313. Reason: failure-to-start- 5986s 2024-11-23 22:10:51,096 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:10:51,097 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36359': TLS handshake failed with remote 'tls://127.0.0.1:56796': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:10:51,097 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36359': TLS handshake failed with remote 'tls://127.0.0.1:56800': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:10:51,098 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:10:52,104 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:10:52,111 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40047 5986s 2024-11-23 22:10:52,111 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34781/status 5986s 2024-11-23 22:10:52,111 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:10:52,125 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45793 5986s 2024-11-23 22:10:52,126 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45793 5986s 2024-11-23 22:10:52,126 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:10:52,126 - distributed.worker - INFO - dashboard at: 127.0.0.1:46767 5986s 2024-11-23 22:10:52,126 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40047 5986s 2024-11-23 22:10:52,126 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:10:52,126 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:10:52,126 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:10:52,126 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-amfcblwz 5986s 2024-11-23 22:10:52,126 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:10:52,128 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:32807 5986s 2024-11-23 22:10:52,128 - distributed.worker - INFO - Listening to: tls://127.0.0.1:32807 5986s 2024-11-23 22:10:52,128 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:10:52,128 - distributed.worker - INFO - dashboard at: 127.0.0.1:39639 5986s 2024-11-23 22:10:52,128 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40047 5986s 2024-11-23 22:10:52,128 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:10:52,128 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:10:52,128 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:10:52,128 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-4p39vt42 5986s 2024-11-23 22:10:52,128 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:10:52,129 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45793. Reason: failure-to-start- 5986s 2024-11-23 22:10:52,129 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:10:52,130 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:32807. Reason: failure-to-start- 5986s 2024-11-23 22:10:52,130 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:10:52,131 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40047': TLS handshake failed with remote 'tls://127.0.0.1:54648': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:10:52,131 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40047': TLS handshake failed with remote 'tls://127.0.0.1:54656': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:10:52,132 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:10:53,137 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:10:53,144 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33939 5986s 2024-11-23 22:10:53,144 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44801/status 5986s 2024-11-23 22:10:53,144 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:10:53,156 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40313 5986s 2024-11-23 22:10:53,156 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40313 5986s 2024-11-23 22:10:53,156 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:10:53,156 - distributed.worker - INFO - dashboard at: 127.0.0.1:39719 5986s 2024-11-23 22:10:53,156 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33939 5986s 2024-11-23 22:10:53,156 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:10:53,157 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:10:53,157 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:10:53,157 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ihmy6lb3 5986s 2024-11-23 22:10:53,157 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:10:53,158 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37923 5986s 2024-11-23 22:10:53,158 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37923 5986s 2024-11-23 22:10:53,158 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:10:53,158 - distributed.worker - INFO - dashboard at: 127.0.0.1:38979 5986s 2024-11-23 22:10:53,159 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33939 5986s 2024-11-23 22:10:53,159 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:10:53,159 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:10:53,159 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:10:53,159 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-5gvvh79j 5986s 2024-11-23 22:10:53,159 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:10:53,160 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40313. Reason: failure-to-start- 5986s 2024-11-23 22:10:53,160 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:10:53,160 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37923. Reason: failure-to-start- 5986s 2024-11-23 22:10:53,160 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:10:53,161 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33939': TLS handshake failed with remote 'tls://127.0.0.1:52658': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:10:53,161 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33939': TLS handshake failed with remote 'tls://127.0.0.1:52674': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:10:53,162 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:10:54,167 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:10:54,173 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33285 5986s 2024-11-23 22:10:54,174 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39671/status 5986s 2024-11-23 22:10:54,174 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:10:54,186 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34927 5986s 2024-11-23 22:10:54,186 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34927 5986s 2024-11-23 22:10:54,186 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:10:54,186 - distributed.worker - INFO - dashboard at: 127.0.0.1:37531 5986s 2024-11-23 22:10:54,186 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33285 5986s 2024-11-23 22:10:54,186 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:10:54,186 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:10:54,186 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:10:54,186 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-9b5vvltp 5986s 2024-11-23 22:10:54,186 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:10:54,189 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38083 5986s 2024-11-23 22:10:54,189 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38083 5986s 2024-11-23 22:10:54,189 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:10:54,189 - distributed.worker - INFO - dashboard at: 127.0.0.1:34223 5986s 2024-11-23 22:10:54,189 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33285 5986s 2024-11-23 22:10:54,189 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:10:54,189 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:10:54,189 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:10:54,189 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-msgwyqwo 5986s 2024-11-23 22:10:54,189 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:10:54,190 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34927. Reason: failure-to-start- 5986s 2024-11-23 22:10:54,190 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:10:54,190 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38083. Reason: failure-to-start- 5986s 2024-11-23 22:10:54,190 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:10:54,191 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33285': TLS handshake failed with remote 'tls://127.0.0.1:50264': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:10:54,191 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33285': TLS handshake failed with remote 'tls://127.0.0.1:50276': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:10:54,192 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:10:55,196 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:10:55,203 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38715 5986s 2024-11-23 22:10:55,203 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46041/status 5986s 2024-11-23 22:10:55,203 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:10:55,214 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44737 5986s 2024-11-23 22:10:55,214 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44737 5986s 2024-11-23 22:10:55,214 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:10:55,214 - distributed.worker - INFO - dashboard at: 127.0.0.1:40115 5986s 2024-11-23 22:10:55,214 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38715 5986s 2024-11-23 22:10:55,214 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:10:55,214 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:10:55,214 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:10:55,214 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-94rl5vh8 5986s 2024-11-23 22:10:55,214 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:10:55,216 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38407 5986s 2024-11-23 22:10:55,216 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38407 5986s 2024-11-23 22:10:55,216 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:10:55,216 - distributed.worker - INFO - dashboard at: 127.0.0.1:41329 5986s 2024-11-23 22:10:55,216 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38715 5986s 2024-11-23 22:10:55,216 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:10:55,216 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:10:55,216 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:10:55,216 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-uqhosyk3 5986s 2024-11-23 22:10:55,216 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:10:55,217 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44737. Reason: failure-to-start- 5986s 2024-11-23 22:10:55,217 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:10:55,217 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38407. Reason: failure-to-start- 5986s 2024-11-23 22:10:55,217 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:10:55,218 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38715': TLS handshake failed with remote 'tls://127.0.0.1:44718': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:10:55,218 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38715': TLS handshake failed with remote 'tls://127.0.0.1:44734': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:10:55,219 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:10:56,230 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:10:56,236 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46703 5986s 2024-11-23 22:10:56,237 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43665/status 5986s 2024-11-23 22:10:56,237 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:10:56,249 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34943 5986s 2024-11-23 22:10:56,249 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34943 5986s 2024-11-23 22:10:56,249 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:10:56,249 - distributed.worker - INFO - dashboard at: 127.0.0.1:38883 5986s 2024-11-23 22:10:56,249 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46703 5986s 2024-11-23 22:10:56,249 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:10:56,249 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:10:56,249 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:10:56,249 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-z3lb671d 5986s 2024-11-23 22:10:56,249 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:10:56,251 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37687 5986s 2024-11-23 22:10:56,251 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37687 5986s 2024-11-23 22:10:56,251 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:10:56,251 - distributed.worker - INFO - dashboard at: 127.0.0.1:32937 5986s 2024-11-23 22:10:56,251 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46703 5986s 2024-11-23 22:10:56,251 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:10:56,251 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:10:56,251 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:10:56,251 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-w66i3_9x 5986s 2024-11-23 22:10:56,251 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:10:56,252 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34943. Reason: failure-to-start- 5986s 2024-11-23 22:10:56,252 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:10:56,253 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37687. Reason: failure-to-start- 5986s 2024-11-23 22:10:56,253 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:10:56,254 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46703': TLS handshake failed with remote 'tls://127.0.0.1:36930': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:10:56,254 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46703': TLS handshake failed with remote 'tls://127.0.0.1:36934': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:10:56,255 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:10:57,259 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:10:57,265 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45833 5986s 2024-11-23 22:10:57,265 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36149/status 5986s 2024-11-23 22:10:57,266 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:10:57,278 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36609 5986s 2024-11-23 22:10:57,278 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36609 5986s 2024-11-23 22:10:57,278 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:10:57,278 - distributed.worker - INFO - dashboard at: 127.0.0.1:34023 5986s 2024-11-23 22:10:57,278 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45833 5986s 2024-11-23 22:10:57,278 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:10:57,278 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:10:57,278 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:10:57,278 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-v2rjg0my 5986s 2024-11-23 22:10:57,278 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:10:57,279 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46193 5986s 2024-11-23 22:10:57,279 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46193 5986s 2024-11-23 22:10:57,280 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:10:57,280 - distributed.worker - INFO - dashboard at: 127.0.0.1:39121 5986s 2024-11-23 22:10:57,280 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45833 5986s 2024-11-23 22:10:57,280 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:10:57,280 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:10:57,280 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:10:57,280 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-s56d2058 5986s 2024-11-23 22:10:57,280 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:10:57,281 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36609. Reason: failure-to-start- 5986s 2024-11-23 22:10:57,281 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:10:57,281 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46193. Reason: failure-to-start- 5986s 2024-11-23 22:10:57,281 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:10:57,282 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45833': TLS handshake failed with remote 'tls://127.0.0.1:57480': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:10:57,282 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45833': TLS handshake failed with remote 'tls://127.0.0.1:57488': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:10:57,283 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:10:58,288 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:10:58,293 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41561 5986s 2024-11-23 22:10:58,294 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38043/status 5986s 2024-11-23 22:10:58,294 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:10:58,305 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35319 5986s 2024-11-23 22:10:58,305 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35319 5986s 2024-11-23 22:10:58,305 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:10:58,305 - distributed.worker - INFO - dashboard at: 127.0.0.1:40259 5986s 2024-11-23 22:10:58,305 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41561 5986s 2024-11-23 22:10:58,305 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:10:58,305 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:10:58,305 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:10:58,305 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-lkavqu36 5986s 2024-11-23 22:10:58,305 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:10:58,308 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44335 5986s 2024-11-23 22:10:58,308 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44335 5986s 2024-11-23 22:10:58,308 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:10:58,308 - distributed.worker - INFO - dashboard at: 127.0.0.1:34441 5986s 2024-11-23 22:10:58,308 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41561 5986s 2024-11-23 22:10:58,308 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:10:58,308 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:10:58,308 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:10:58,308 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ollvk6um 5986s 2024-11-23 22:10:58,308 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:10:58,309 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35319. Reason: failure-to-start- 5986s 2024-11-23 22:10:58,309 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:10:58,309 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44335. Reason: failure-to-start- 5986s 2024-11-23 22:10:58,310 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:10:58,310 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41561': TLS handshake failed with remote 'tls://127.0.0.1:49806': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:10:58,311 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41561': TLS handshake failed with remote 'tls://127.0.0.1:49812': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:10:58,312 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:10:59,317 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:10:59,323 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46603 5986s 2024-11-23 22:10:59,323 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37481/status 5986s 2024-11-23 22:10:59,324 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:10:59,335 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40467 5986s 2024-11-23 22:10:59,335 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40467 5986s 2024-11-23 22:10:59,335 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:10:59,335 - distributed.worker - INFO - dashboard at: 127.0.0.1:46399 5986s 2024-11-23 22:10:59,335 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46603 5986s 2024-11-23 22:10:59,335 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:10:59,335 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:10:59,335 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:10:59,335 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-5rc9ccj3 5986s 2024-11-23 22:10:59,335 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:10:59,336 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40499 5986s 2024-11-23 22:10:59,337 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40499 5986s 2024-11-23 22:10:59,337 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:10:59,337 - distributed.worker - INFO - dashboard at: 127.0.0.1:44331 5986s 2024-11-23 22:10:59,337 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46603 5986s 2024-11-23 22:10:59,337 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:10:59,337 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:10:59,337 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:10:59,337 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-_xrni8hu 5986s 2024-11-23 22:10:59,337 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:10:59,339 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40467. Reason: failure-to-start- 5986s 2024-11-23 22:10:59,340 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:10:59,340 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40499. Reason: failure-to-start- 5986s 2024-11-23 22:10:59,340 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:10:59,341 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46603': TLS handshake failed with remote 'tls://127.0.0.1:53712': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:10:59,341 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46603': TLS handshake failed with remote 'tls://127.0.0.1:53720': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:10:59,342 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:11:00,346 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:11:00,353 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39809 5986s 2024-11-23 22:11:00,354 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33723/status 5986s 2024-11-23 22:11:00,354 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:11:00,367 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44039 5986s 2024-11-23 22:11:00,367 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44039 5986s 2024-11-23 22:11:00,367 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:11:00,367 - distributed.worker - INFO - dashboard at: 127.0.0.1:37157 5986s 2024-11-23 22:11:00,367 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39809 5986s 2024-11-23 22:11:00,367 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:11:00,367 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:11:00,367 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:11:00,367 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-pc3bzma2 5986s 2024-11-23 22:11:00,367 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:11:00,369 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45945 5986s 2024-11-23 22:11:00,369 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45945 5986s 2024-11-23 22:11:00,369 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:11:00,369 - distributed.worker - INFO - dashboard at: 127.0.0.1:40469 5986s 2024-11-23 22:11:00,369 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39809 5986s 2024-11-23 22:11:00,369 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:11:00,369 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:11:00,369 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:11:00,369 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-mv67grz9 5986s 2024-11-23 22:11:00,369 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:11:00,370 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44039. Reason: failure-to-start- 5986s 2024-11-23 22:11:00,370 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:11:00,370 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45945. Reason: failure-to-start- 5986s 2024-11-23 22:11:00,371 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:11:00,371 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39809': TLS handshake failed with remote 'tls://127.0.0.1:34610': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:11:00,371 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39809': TLS handshake failed with remote 'tls://127.0.0.1:34616': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:11:00,372 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:11:01,378 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:11:01,384 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46513 5986s 2024-11-23 22:11:01,384 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44443/status 5986s 2024-11-23 22:11:01,384 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:11:01,398 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39701 5986s 2024-11-23 22:11:01,398 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39701 5986s 2024-11-23 22:11:01,398 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:11:01,398 - distributed.worker - INFO - dashboard at: 127.0.0.1:43873 5986s 2024-11-23 22:11:01,398 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46513 5986s 2024-11-23 22:11:01,398 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:11:01,398 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:11:01,398 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:11:01,398 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-fxlbt1sh 5986s 2024-11-23 22:11:01,398 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:11:01,400 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42983 5986s 2024-11-23 22:11:01,400 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42983 5986s 2024-11-23 22:11:01,400 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:11:01,400 - distributed.worker - INFO - dashboard at: 127.0.0.1:44575 5986s 2024-11-23 22:11:01,400 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46513 5986s 2024-11-23 22:11:01,400 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:11:01,400 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:11:01,400 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:11:01,400 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-vmehys7v 5986s 2024-11-23 22:11:01,400 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:11:01,401 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39701. Reason: failure-to-start- 5986s 2024-11-23 22:11:01,401 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:11:01,402 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42983. Reason: failure-to-start- 5986s 2024-11-23 22:11:01,402 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:11:01,402 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46513': TLS handshake failed with remote 'tls://127.0.0.1:54568': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:11:01,402 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46513': TLS handshake failed with remote 'tls://127.0.0.1:54570': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:11:01,403 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:11:02,408 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:11:02,414 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33451 5986s 2024-11-23 22:11:02,414 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43041/status 5986s 2024-11-23 22:11:02,415 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:11:02,429 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36689 5986s 2024-11-23 22:11:02,429 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36689 5986s 2024-11-23 22:11:02,429 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:11:02,429 - distributed.worker - INFO - dashboard at: 127.0.0.1:40111 5986s 2024-11-23 22:11:02,429 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33451 5986s 2024-11-23 22:11:02,429 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:11:02,429 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:11:02,429 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:11:02,429 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ieshg4ej 5986s 2024-11-23 22:11:02,429 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:11:02,432 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40969 5986s 2024-11-23 22:11:02,432 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40969 5986s 2024-11-23 22:11:02,432 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:11:02,432 - distributed.worker - INFO - dashboard at: 127.0.0.1:33057 5986s 2024-11-23 22:11:02,432 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33451 5986s 2024-11-23 22:11:02,432 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:11:02,432 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:11:02,432 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:11:02,432 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-532mvoc5 5986s 2024-11-23 22:11:02,432 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:11:02,433 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36689. Reason: failure-to-start- 5986s 2024-11-23 22:11:02,433 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:11:02,434 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40969. Reason: failure-to-start- 5986s 2024-11-23 22:11:02,434 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:11:02,435 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33451': TLS handshake failed with remote 'tls://127.0.0.1:50478': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:11:02,435 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33451': TLS handshake failed with remote 'tls://127.0.0.1:50488': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:11:02,436 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:11:03,441 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:11:03,447 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33547 5986s 2024-11-23 22:11:03,447 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41593/status 5986s 2024-11-23 22:11:03,448 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:11:03,459 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44565 5986s 2024-11-23 22:11:03,459 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44565 5986s 2024-11-23 22:11:03,459 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:11:03,460 - distributed.worker - INFO - dashboard at: 127.0.0.1:41305 5986s 2024-11-23 22:11:03,460 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33547 5986s 2024-11-23 22:11:03,460 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:11:03,460 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:11:03,460 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:11:03,460 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-inemcngk 5986s 2024-11-23 22:11:03,460 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:11:03,461 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45407 5986s 2024-11-23 22:11:03,461 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45407 5986s 2024-11-23 22:11:03,462 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:11:03,462 - distributed.worker - INFO - dashboard at: 127.0.0.1:34309 5986s 2024-11-23 22:11:03,462 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33547 5986s 2024-11-23 22:11:03,462 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:11:03,462 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:11:03,462 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:11:03,462 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-y6ku7_y4 5986s 2024-11-23 22:11:03,462 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:11:03,463 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44565. Reason: failure-to-start- 5986s 2024-11-23 22:11:03,463 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:11:03,463 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45407. Reason: failure-to-start- 5986s 2024-11-23 22:11:03,463 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:11:03,464 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33547': TLS handshake failed with remote 'tls://127.0.0.1:57038': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:11:03,464 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33547': TLS handshake failed with remote 'tls://127.0.0.1:57046': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:11:03,465 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:11:04,472 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:11:04,477 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35845 5986s 2024-11-23 22:11:04,478 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44325/status 5986s 2024-11-23 22:11:04,478 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:11:04,490 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:32877 5986s 2024-11-23 22:11:04,490 - distributed.worker - INFO - Listening to: tls://127.0.0.1:32877 5986s 2024-11-23 22:11:04,490 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:11:04,490 - distributed.worker - INFO - dashboard at: 127.0.0.1:37889 5986s 2024-11-23 22:11:04,490 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35845 5986s 2024-11-23 22:11:04,490 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:11:04,490 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:11:04,491 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:11:04,491 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-wptukovg 5986s 2024-11-23 22:11:04,491 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:11:04,492 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40545 5986s 2024-11-23 22:11:04,492 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40545 5986s 2024-11-23 22:11:04,492 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:11:04,492 - distributed.worker - INFO - dashboard at: 127.0.0.1:37271 5986s 2024-11-23 22:11:04,492 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35845 5986s 2024-11-23 22:11:04,493 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:11:04,493 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:11:04,493 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:11:04,493 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-re4fixyv 5986s 2024-11-23 22:11:04,493 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:11:04,494 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:32877. Reason: failure-to-start- 5986s 2024-11-23 22:11:04,494 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:11:04,494 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40545. Reason: failure-to-start- 5986s 2024-11-23 22:11:04,494 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:11:04,495 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35845': TLS handshake failed with remote 'tls://127.0.0.1:51468': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:11:04,495 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35845': TLS handshake failed with remote 'tls://127.0.0.1:51478': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:11:04,498 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:11:05,503 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:11:05,508 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41925 5986s 2024-11-23 22:11:05,509 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46677/status 5986s 2024-11-23 22:11:05,509 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:11:05,522 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41227 5986s 2024-11-23 22:11:05,522 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41227 5986s 2024-11-23 22:11:05,522 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:11:05,522 - distributed.worker - INFO - dashboard at: 127.0.0.1:42423 5986s 2024-11-23 22:11:05,522 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41925 5986s 2024-11-23 22:11:05,522 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:11:05,522 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:11:05,522 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:11:05,522 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-0in62lw2 5986s 2024-11-23 22:11:05,522 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:11:05,524 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44585 5986s 2024-11-23 22:11:05,524 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44585 5986s 2024-11-23 22:11:05,524 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:11:05,524 - distributed.worker - INFO - dashboard at: 127.0.0.1:35473 5986s 2024-11-23 22:11:05,524 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41925 5986s 2024-11-23 22:11:05,524 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:11:05,524 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:11:05,524 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:11:05,524 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-5_ek346h 5986s 2024-11-23 22:11:05,524 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:11:05,525 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41227. Reason: failure-to-start- 5986s 2024-11-23 22:11:05,525 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:11:05,526 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44585. Reason: failure-to-start- 5986s 2024-11-23 22:11:05,526 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:11:05,529 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41925': TLS handshake failed with remote 'tls://127.0.0.1:37630': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:11:05,529 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41925': TLS handshake failed with remote 'tls://127.0.0.1:37636': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:11:05,530 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:11:06,534 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:11:06,540 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36803 5986s 2024-11-23 22:11:06,540 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37487/status 5986s 2024-11-23 22:11:06,541 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:11:06,552 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41743 5986s 2024-11-23 22:11:06,552 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41743 5986s 2024-11-23 22:11:06,552 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:11:06,552 - distributed.worker - INFO - dashboard at: 127.0.0.1:43007 5986s 2024-11-23 22:11:06,553 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36803 5986s 2024-11-23 22:11:06,553 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:11:06,553 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:11:06,553 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:11:06,553 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-x7ai8k6z 5986s 2024-11-23 22:11:06,553 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:11:06,554 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33725 5986s 2024-11-23 22:11:06,554 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33725 5986s 2024-11-23 22:11:06,554 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:11:06,554 - distributed.worker - INFO - dashboard at: 127.0.0.1:34581 5986s 2024-11-23 22:11:06,554 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36803 5986s 2024-11-23 22:11:06,554 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:11:06,555 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:11:06,555 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:11:06,555 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-kw3g8ub8 5986s 2024-11-23 22:11:06,555 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:11:06,556 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41743. Reason: failure-to-start- 5986s 2024-11-23 22:11:06,556 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:11:06,556 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33725. Reason: failure-to-start- 5986s 2024-11-23 22:11:06,556 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:11:06,559 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36803': TLS handshake failed with remote 'tls://127.0.0.1:38346': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:11:06,559 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36803': TLS handshake failed with remote 'tls://127.0.0.1:38354': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:11:06,560 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:11:07,564 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:11:07,570 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42831 5986s 2024-11-23 22:11:07,571 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45619/status 5986s 2024-11-23 22:11:07,571 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:11:07,582 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34759 5986s 2024-11-23 22:11:07,583 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34759 5986s 2024-11-23 22:11:07,583 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:11:07,583 - distributed.worker - INFO - dashboard at: 127.0.0.1:44113 5986s 2024-11-23 22:11:07,583 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42831 5986s 2024-11-23 22:11:07,583 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:11:07,583 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:11:07,583 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:11:07,583 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-5c5tzwql 5986s 2024-11-23 22:11:07,583 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:11:07,585 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43671 5986s 2024-11-23 22:11:07,585 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43671 5986s 2024-11-23 22:11:07,585 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:11:07,585 - distributed.worker - INFO - dashboard at: 127.0.0.1:44429 5986s 2024-11-23 22:11:07,585 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42831 5986s 2024-11-23 22:11:07,585 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:11:07,585 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:11:07,585 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:11:07,585 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-6a9gwa75 5986s 2024-11-23 22:11:07,585 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:11:07,587 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34759. Reason: failure-to-start- 5986s 2024-11-23 22:11:07,587 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:11:07,587 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43671. Reason: failure-to-start- 5986s 2024-11-23 22:11:07,587 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:11:07,590 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42831': TLS handshake failed with remote 'tls://127.0.0.1:51058': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:11:07,590 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42831': TLS handshake failed with remote 'tls://127.0.0.1:51064': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:11:07,591 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:11:08,597 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:11:08,603 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39773 5986s 2024-11-23 22:11:08,603 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33335/status 5986s 2024-11-23 22:11:08,603 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:11:08,615 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37501 5986s 2024-11-23 22:11:08,615 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37501 5986s 2024-11-23 22:11:08,615 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:11:08,615 - distributed.worker - INFO - dashboard at: 127.0.0.1:41313 5986s 2024-11-23 22:11:08,615 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39773 5986s 2024-11-23 22:11:08,615 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:11:08,615 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:11:08,615 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:11:08,615 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-_cdthhg2 5986s 2024-11-23 22:11:08,615 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:11:08,617 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44561 5986s 2024-11-23 22:11:08,617 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44561 5986s 2024-11-23 22:11:08,617 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:11:08,617 - distributed.worker - INFO - dashboard at: 127.0.0.1:46265 5986s 2024-11-23 22:11:08,617 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39773 5986s 2024-11-23 22:11:08,617 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:11:08,617 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:11:08,617 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:11:08,617 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-vuwwc44u 5986s 2024-11-23 22:11:08,617 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:11:08,620 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37501. Reason: failure-to-start- 5986s 2024-11-23 22:11:08,620 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:11:08,620 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44561. Reason: failure-to-start- 5986s 2024-11-23 22:11:08,621 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:11:08,621 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39773': TLS handshake failed with remote 'tls://127.0.0.1:47026': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:11:08,621 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39773': TLS handshake failed with remote 'tls://127.0.0.1:47028': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:11:08,622 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:11:09,628 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:11:09,635 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42513 5986s 2024-11-23 22:11:09,635 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45817/status 5986s 2024-11-23 22:11:09,635 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:11:09,647 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33175 5986s 2024-11-23 22:11:09,647 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33175 5986s 2024-11-23 22:11:09,647 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:11:09,647 - distributed.worker - INFO - dashboard at: 127.0.0.1:32837 5986s 2024-11-23 22:11:09,647 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42513 5986s 2024-11-23 22:11:09,648 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:11:09,648 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:11:09,648 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:11:09,648 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-xv6moh5f 5986s 2024-11-23 22:11:09,648 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:11:09,649 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44895 5986s 2024-11-23 22:11:09,649 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44895 5986s 2024-11-23 22:11:09,649 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:11:09,650 - distributed.worker - INFO - dashboard at: 127.0.0.1:37637 5986s 2024-11-23 22:11:09,650 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42513 5986s 2024-11-23 22:11:09,650 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:11:09,650 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:11:09,650 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:11:09,650 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-zx4hlwm1 5986s 2024-11-23 22:11:09,650 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:11:09,653 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33175. Reason: failure-to-start- 5986s 2024-11-23 22:11:09,653 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:11:09,653 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44895. Reason: failure-to-start- 5986s 2024-11-23 22:11:09,653 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:11:09,654 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42513': TLS handshake failed with remote 'tls://127.0.0.1:47030': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:11:09,654 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42513': TLS handshake failed with remote 'tls://127.0.0.1:47046': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:11:09,655 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:11:10,660 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:11:10,666 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43689 5986s 2024-11-23 22:11:10,667 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37939/status 5986s 2024-11-23 22:11:10,667 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:11:10,680 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41563 5986s 2024-11-23 22:11:10,680 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41563 5986s 2024-11-23 22:11:10,680 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:11:10,680 - distributed.worker - INFO - dashboard at: 127.0.0.1:43891 5986s 2024-11-23 22:11:10,680 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43689 5986s 2024-11-23 22:11:10,680 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:11:10,680 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:11:10,680 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:11:10,680 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-vifn0v33 5986s 2024-11-23 22:11:10,680 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:11:10,682 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42139 5986s 2024-11-23 22:11:10,682 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42139 5986s 2024-11-23 22:11:10,682 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:11:10,682 - distributed.worker - INFO - dashboard at: 127.0.0.1:41063 5986s 2024-11-23 22:11:10,682 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43689 5986s 2024-11-23 22:11:10,682 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:11:10,682 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:11:10,682 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:11:10,682 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-xg1wch88 5986s 2024-11-23 22:11:10,682 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:11:10,685 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41563. Reason: failure-to-start- 5986s 2024-11-23 22:11:10,685 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:11:10,685 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42139. Reason: failure-to-start- 5986s 2024-11-23 22:11:10,686 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:11:10,686 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43689': TLS handshake failed with remote 'tls://127.0.0.1:52494': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:11:10,686 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43689': TLS handshake failed with remote 'tls://127.0.0.1:52496': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:11:10,687 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:11:11,693 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:11:11,699 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46787 5986s 2024-11-23 22:11:11,699 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34803/status 5986s 2024-11-23 22:11:11,700 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:11:11,712 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40569 5986s 2024-11-23 22:11:11,712 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40569 5986s 2024-11-23 22:11:11,712 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:11:11,712 - distributed.worker - INFO - dashboard at: 127.0.0.1:35817 5986s 2024-11-23 22:11:11,713 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46787 5986s 2024-11-23 22:11:11,713 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:11:11,713 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:11:11,713 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:11:11,713 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-4f_068a5 5986s 2024-11-23 22:11:11,713 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:11:11,723 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43721 5986s 2024-11-23 22:11:11,723 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43721 5986s 2024-11-23 22:11:11,723 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:11:11,723 - distributed.worker - INFO - dashboard at: 127.0.0.1:39649 5986s 2024-11-23 22:11:11,724 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46787 5986s 2024-11-23 22:11:11,724 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:11:11,724 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:11:11,724 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:11:11,724 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-0srfgkos 5986s 2024-11-23 22:11:11,724 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:11:11,727 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40569. Reason: failure-to-start- 5986s 2024-11-23 22:11:11,727 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:11:11,727 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43721. Reason: failure-to-start- 5986s 2024-11-23 22:11:11,727 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:11:11,728 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46787': TLS handshake failed with remote 'tls://127.0.0.1:40078': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:11:11,728 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46787': TLS handshake failed with remote 'tls://127.0.0.1:40092': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:11:11,730 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:11:12,735 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:11:12,741 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38391 5986s 2024-11-23 22:11:12,741 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39651/status 5986s 2024-11-23 22:11:12,742 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:11:12,756 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43447 5986s 2024-11-23 22:11:12,756 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43447 5986s 2024-11-23 22:11:12,756 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:11:12,756 - distributed.worker - INFO - dashboard at: 127.0.0.1:42245 5986s 2024-11-23 22:11:12,756 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38391 5986s 2024-11-23 22:11:12,756 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:11:12,756 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:11:12,756 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:11:12,756 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-0pmdo_ut 5986s 2024-11-23 22:11:12,756 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:11:12,758 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43901 5986s 2024-11-23 22:11:12,758 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43901 5986s 2024-11-23 22:11:12,758 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:11:12,758 - distributed.worker - INFO - dashboard at: 127.0.0.1:34669 5986s 2024-11-23 22:11:12,758 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38391 5986s 2024-11-23 22:11:12,758 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:11:12,758 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:11:12,758 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:11:12,758 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-91zr24fu 5986s 2024-11-23 22:11:12,758 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:11:12,759 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43447. Reason: failure-to-start- 5986s 2024-11-23 22:11:12,759 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:11:12,760 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43901. Reason: failure-to-start- 5986s 2024-11-23 22:11:12,760 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:11:12,761 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38391': TLS handshake failed with remote 'tls://127.0.0.1:48446': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:11:12,761 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38391': TLS handshake failed with remote 'tls://127.0.0.1:48462': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:11:12,762 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s 2024-11-23 22:11:13,767 - distributed.scheduler - INFO - State start 5986s 2024-11-23 22:11:13,775 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33063 5986s 2024-11-23 22:11:13,775 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40545/status 5986s 2024-11-23 22:11:13,775 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5986s 2024-11-23 22:11:13,789 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43903 5986s 2024-11-23 22:11:13,790 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43903 5986s 2024-11-23 22:11:13,790 - distributed.worker - INFO - Worker name: 0 5986s 2024-11-23 22:11:13,790 - distributed.worker - INFO - dashboard at: 127.0.0.1:43591 5986s 2024-11-23 22:11:13,790 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33063 5986s 2024-11-23 22:11:13,790 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:11:13,790 - distributed.worker - INFO - Threads: 1 5986s 2024-11-23 22:11:13,790 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:11:13,790 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-zs66t2d7 5986s 2024-11-23 22:11:13,790 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:11:13,792 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45555 5986s 2024-11-23 22:11:13,792 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45555 5986s 2024-11-23 22:11:13,792 - distributed.worker - INFO - Worker name: 1 5986s 2024-11-23 22:11:13,792 - distributed.worker - INFO - dashboard at: 127.0.0.1:45335 5986s 2024-11-23 22:11:13,792 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33063 5986s 2024-11-23 22:11:13,792 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:11:13,792 - distributed.worker - INFO - Threads: 2 5986s 2024-11-23 22:11:13,792 - distributed.worker - INFO - Memory: 15.58 GiB 5986s 2024-11-23 22:11:13,792 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-hk50w0yp 5986s 2024-11-23 22:11:13,792 - distributed.worker - INFO - ------------------------------------------------- 5986s 2024-11-23 22:11:13,793 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43903. Reason: failure-to-start- 5986s 2024-11-23 22:11:13,793 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:11:13,794 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45555. Reason: failure-to-start- 5986s 2024-11-23 22:11:13,794 - distributed.worker - INFO - Closed worker has not yet started: Status.init 5986s 2024-11-23 22:11:13,795 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33063': TLS handshake failed with remote 'tls://127.0.0.1:43892': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:11:13,795 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33063': TLS handshake failed with remote 'tls://127.0.0.1:43900': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 5986s 2024-11-23 22:11:13,798 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 5986s await self._register_with_scheduler() 5986s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 5986s comm = await connect(self.scheduler.address, **self.connection_args) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5986s comm = await wait_for( 5986s ^^^^^^^^^^^^^^^ 5986s ...<2 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 5986s return await fut 5986s ^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5986s stream = await self.client.connect( 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5986s af, addr, stream = await connector.start(connect_timeout=timeout) 5986s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5986s asyncio.exceptions.CancelledError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 5986s await wait_for(self.start_unsafe(), timeout=timeout) 5986s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 5986s async with asyncio.timeout(timeout): 5986s ~~~~~~~~~~~~~~~^^^^^^^^^ 5986s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 5986s raise TimeoutError from exc_val 5986s TimeoutError 5986s 5986s The above exception was the direct cause of the following exception: 5986s 5986s Traceback (most recent call last): 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 5986s s, ws = await start_cluster( 5986s ^^^^^^^^^^^^^^^^^^^^ 5986s ...<9 lines>... 5986s ) 5986s ^ 5986s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 5986s await asyncio.gather(*workers) 5986s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 5986s return await awaitable 5986s ^^^^^^^^^^^^^^^ 5986s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 5986s raise asyncio.TimeoutError( 5986s f"{type(self).__name__} start timed out after {timeout}s." 5986s ) from exc 5986s TimeoutError: Worker start timed out after 0s. 5986s ============================= slowest 20 durations ============================= 5986s 300.02s setup tests/test_utils_test.py::test_tls_cluster 5986s 61.02s call tests/test_scheduler.py::test_broadcast_tls 5986s 60.01s call tests/test_tls_functional.py::test_client_submit 5986s 60.01s call tests/test_tls_functional.py::test_worker_client_executor 5986s 60.01s call tests/test_tls_functional.py::test_gather 5986s 60.01s call tests/test_tls_functional.py::test_basic 5986s 60.01s call tests/test_tls_functional.py::test_worker_client 5986s 60.01s call tests/test_tls_functional.py::test_scatter 5986s 60.01s call tests/test_tls_functional.py::test_nanny 5986s 60.01s call tests/test_utils_test.py::test_gen_cluster_tls 5986s 60.01s call tests/test_tls_functional.py::test_work_stealing 5986s 60.01s call tests/test_tls_functional.py::test_rebalance 5986s 60.01s call tests/test_tls_functional.py::test_worker_client_gather 5986s 60.01s call tests/test_tls_functional.py::test_retire_workers 5986s 60.01s call tests/test_tls_functional.py::test_Queue 5986s 30.01s call tests/test_tls_functional.py::test_security_dict_input 5986s 2.26s call cli/tests/test_tls_cli.py::test_nanny 5986s 2.26s call cli/tests/test_tls_cli.py::test_use_config_file 5986s 2.18s call cli/tests/test_tls_cli.py::test_separate_key_cert 5986s 2.16s call cli/tests/test_tls_cli.py::test_sni 5986s =========================== short test summary info ============================ 5986s FAILED cli/tests/test_dask_scheduler.py::test_preload_file - distributed.comm.core.CommClosedError: in : Stream is closed 5986s FAILED cli/tests/test_dask_scheduler.py::test_preload_module - distributed.comm.core.CommClosedError: in : Stream is closed 5986s FAILED cli/tests/test_dask_scheduler.py::test_preload_remote_module - distributed.comm.core.CommClosedError: in : Stream is closed 5986s FAILED cli/tests/test_dask_scheduler.py::test_preload_config - SystemError: no locals found when setting up annotations 5986s FAILED cli/tests/test_dask_scheduler.py::test_preload_command - distributed.comm.core.CommClosedError: in : Stream is closed 5986s FAILED cli/tests/test_dask_scheduler.py::test_preload_command_default - distributed.comm.core.CommClosedError: in : Stream is closed 5986s FAILED cli/tests/test_dask_scheduler.py::test_multiple_workers_2 - SystemError: no locals found when setting up annotations 5986s FAILED cli/tests/test_tls_cli.py::test_basic - distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 5986s FAILED cli/tests/test_tls_cli.py::test_sni - distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 5986s FAILED cli/tests/test_tls_cli.py::test_nanny - distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 5986s FAILED cli/tests/test_tls_cli.py::test_separate_key_cert - distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 5986s FAILED cli/tests/test_tls_cli.py::test_use_config_file - distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 5986s FAILED deploy/tests/test_subprocess.py::test_basic - SystemError: no locals found when setting up annotations 5986s FAILED deploy/tests/test_subprocess.py::test_n_workers - SystemError: no locals found when setting up annotations 5986s FAILED tests/test_client.py::test_upload_file_zip - KeyError: '/tmp/dask-scratch-space/scheduler-u2xnb8z2/myfile.zip' 5986s FAILED tests/test_profile.py::test_info_frame_f_lineno[22-4] - TypeError: '<=' not supported between instances of 'int' and 'NoneType' 5986s FAILED tests/test_profile.py::test_info_frame_f_lineno[23-4] - TypeError: '<=' not supported between instances of 'int' and 'NoneType' 5986s FAILED tests/test_profile.py::test_call_stack_f_lineno[22-4] - TypeError: '<=' not supported between instances of 'int' and 'NoneType' 5986s FAILED tests/test_profile.py::test_call_stack_f_lineno[23-4] - TypeError: '<=' not supported between instances of 'int' and 'NoneType' 5986s FAILED tests/test_scheduler.py::test_broadcast_tls - TimeoutError 5986s FAILED tests/test_security.py::test_repr_temp_keys - ImportError: Using `Security.temporary` requires `cryptography`, please install it using either pip or conda 5986s FAILED tests/test_security.py::test_temporary_credentials - ImportError: Using `Security.temporary` requires `cryptography`, please install it using either pip or conda 5986s FAILED tests/test_security.py::test_extra_conn_args_in_temporary_credentials - ImportError: Using `Security.temporary` requires `cryptography`, please install it using either pip or conda 5986s FAILED tests/test_tls_functional.py::test_basic - TimeoutError 5986s FAILED tests/test_tls_functional.py::test_Queue - TimeoutError 5986s FAILED tests/test_tls_functional.py::test_client_submit - TimeoutError 5986s FAILED tests/test_tls_functional.py::test_gather - TimeoutError 5986s FAILED tests/test_tls_functional.py::test_scatter - TimeoutError 5986s FAILED tests/test_tls_functional.py::test_nanny - TimeoutError 5986s FAILED tests/test_tls_functional.py::test_rebalance - TimeoutError 5986s FAILED tests/test_tls_functional.py::test_work_stealing - TimeoutError 5986s FAILED tests/test_tls_functional.py::test_worker_client - TimeoutError 5986s FAILED tests/test_tls_functional.py::test_worker_client_gather - TimeoutError 5986s FAILED tests/test_tls_functional.py::test_worker_client_executor - TimeoutError 5986s FAILED tests/test_tls_functional.py::test_retire_workers - TimeoutError 5986s FAILED tests/test_tls_functional.py::test_security_dict_input - TimeoutError 5986s FAILED tests/test_utils_test.py::test_gen_cluster_tls - TimeoutError 5986s ERROR tests/test_utils_test.py::test_tls_cluster - Failed: Timeout >300.0s 5986s ==== 37 failed, 30 skipped, 3311 deselected, 1 error in 1215.97s (0:20:15) ===== 5987s *** END OF RUN 3: NOT ALL TESTS HAVE YET PASSED/XFAILED *** 5987s *** STARTING RUN 4: python3.13 -m pytest --pyargs distributed --verbose --color=no --timeout-method=signal --timeout=300 -m not avoid_ci -rfE --last-failed --last-failed-no-failures none --ignore=../../../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_comms.py --ignore=../../../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_ws.py --ignore=../../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_adaptive.py --ignore=../../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py --ignore=../../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_slow_adaptive.py --ignore=../../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_spec_cluster.py --deselect=cli/tests/test_dask_scheduler.py::test_no_dashboard --deselect=deploy/tests/test_local.py::test_localcluster_get_client --deselect=deploy/tests/test_old_ssh.py::test_cluster --deselect=deploy/tests/test_old_ssh.py::test_old_ssh_nprocs_renamed_to_n_workers --deselect=deploy/tests/test_old_ssh.py::test_nprocs_attribute_is_deprecated --deselect=deploy/tests/test_ssh.py::test_nprocs_attribute_is_deprecated --deselect=http/tests/test_core.py::test_prometheus_api_doc --deselect=tests/test_init.py::test_git_revision --deselect=tests/test_jupyter.py::test_jupyter_idle_timeout --deselect=tests/test_jupyter.py::test_jupyter_idle_timeout_returned --deselect=tests/test_jupyter.py::test_jupyter_server --deselect=tests/test_jupyter.py::test_shutsdown_cleanly --deselect=tests/test_profile.py::test_stack_overflow --deselect=tests/test_pubsub.py::test_client_worker --deselect=tests/test_queues.py::test_queue_in_task --deselect=tests/test_spill.py::test_spillbuffer_oserror --deselect=tests/test_steal.py::test_steal_twice --deselect=tests/test_utils_test.py::test_cluster --deselect=tests/test_variable.py::test_variable_in_task --deselect=tests/test_worker.py::test_process_executor_kills_process --deselect=tests/test_worker_memory.py::test_fail_to_pickle_execute_1 --deselect=tests/test_worker_state_machine.py::test_task_state_instance_are_garbage_collected --deselect=protocol/tests/test_protocol.py::test_deeply_nested_structures --deselect=protocol/tests/test_serialize.py::test_deeply_nested_structures --deselect=deploy/tests/test_local.py::test_local_cluster_redundant_kwarg --deselect=deploy/tests/test_slow_adaptive.py::test_adaptive --deselect=tests/test_client.py::test_futures_in_subgraphs --deselect=tests/test_dask_collections.py::test_dataframe_groupby_tasks --deselect=tests/test_dask_collections.py::test_dataframes --deselect=tests/test_dask_collections.py::test_rolling_sync --deselect=tests/test_scheduler.py::test_balance_many_workers_2 --deselect=tests/test_scheduler.py::test_default_task_duration_splits --deselect=tests/test_steal.py::test_blocklist_shuffle_split --deselect=cli/tests/test_dask_scheduler.py::test_defaults --deselect=cli/tests/test_dask_scheduler.py::test_hostport --deselect=cli/tests/test_dask_spec.py::test_errors --deselect=cli/tests/test_dask_worker.py::test_scheduler_file --deselect=cli/tests/test_dask_worker.py::test_scheduler_file --deselect=cli/tests/test_dask_worker.py::test_scheduler_file --deselect=dashboard/tests/test_scheduler_bokeh.py::test_counters --deselect=dashboard/tests/test_worker_bokeh.py::test_counters --deselect=deploy/tests/test_local.py::test_adapt_then_manual --deselect=deploy/tests/test_local.py::test_async_with --deselect=deploy/tests/test_local.py::test_close_twice --deselect=deploy/tests/test_local.py::test_cluster_info_sync --deselect=deploy/tests/test_local.py::test_local_tls --deselect=deploy/tests/test_local.py::test_no_dangling_asyncio_tasks --deselect=deploy/tests/test_local.py::test_only_local_access --deselect=deploy/tests/test_local.py::test_remote_access --deselect=diagnostics/tests/test_progress_widgets.py::test_serializers --deselect=diagnostics/tests/test_scheduler_plugin.py::test_lifecycle --deselect=http/scheduler/tests/test_missing_bokeh.py::test_missing_bokeh --deselect=http/scheduler/tests/test_scheduler_http.py::test_metrics_when_prometheus_client_not_installed --deselect=protocol/tests/test_serialize.py::test_errors --deselect=tests/test_batched.py::test_BatchedSend --deselect=tests/test_batched.py::test_close_closed --deselect=tests/test_batched.py::test_close_twice --deselect=tests/test_batched.py::test_send_after_stream_start --deselect=tests/test_batched.py::test_send_before_close --deselect=tests/test_batched.py::test_send_before_start --deselect=tests/test_batched.py::test_sending_traffic_jam --deselect=tests/test_batched.py::test_serializers --deselect=tests/test_client.py::TestClientSecurityLoader::test_security_loader --deselect=tests/test_client.py::TestClientSecurityLoader::test_security_loader_ignored_if_explicit_security_provided --deselect=tests/test_client.py::TestClientSecurityLoader::test_security_loader_ignored_if_returns_none --deselect=tests/test_client.py::test_async_with --deselect=tests/test_client.py::test_client_is_quiet_cluster_close --deselect=tests/test_client.py::test_dashboard_link_cluster --deselect=tests/test_client.py::test_dashboard_link_inproc --deselect=tests/test_client.py::test_file_descriptors_dont_leak --deselect=tests/test_client.py::test_mixing_clients_different_scheduler --deselect=tests/test_client.py::test_quiet_client_close --deselect=tests/test_client.py::test_rebalance_sync --deselect=tests/test_client.py::test_repr_localcluster --deselect=tests/test_client.py::test_security_loader --deselect=tests/test_client.py::test_security_loader_ignored_if_explicit_security_provided --deselect=tests/test_client.py::test_security_loader_ignored_if_returns_none --deselect=tests/test_client.py::test_shutdown --deselect=tests/test_client.py::test_shutdown_is_quiet_with_cluster --deselect=tests/test_client.py::test_shutdown_localcluster --deselect=tests/test_client.py::test_shutdown_stops_callbacks --deselect=tests/test_client_loop.py::test_close_loop_sync_start_new_loop --deselect=tests/test_client_loop.py::test_close_loop_sync_use_running_loop --deselect=tests/test_core.py::test_close_fast_without_active_handlers --deselect=tests/test_core.py::test_close_grace_period_for_handlers --deselect=tests/test_core.py::test_close_properly --deselect=tests/test_core.py::test_compression --deselect=tests/test_core.py::test_connection_pool --deselect=tests/test_core.py::test_connection_pool_close_while_connecting --deselect=tests/test_core.py::test_connection_pool_detects_remote_close --deselect=tests/test_core.py::test_connection_pool_outside_cancellation --deselect=tests/test_core.py::test_connection_pool_remove --deselect=tests/test_core.py::test_connection_pool_respects_limit --deselect=tests/test_core.py::test_connection_pool_tls --deselect=tests/test_core.py::test_counters --deselect=tests/test_core.py::test_deserialize_error --deselect=tests/test_core.py::test_errors --deselect=tests/test_core.py::test_identity_inproc --deselect=tests/test_core.py::test_identity_tcp --deselect=tests/test_core.py::test_large_packets_inproc --deselect=tests/test_core.py::test_messages_are_ordered_bsend --deselect=tests/test_core.py::test_messages_are_ordered_raw --deselect=tests/test_core.py::test_ports --deselect=tests/test_core.py::test_rpc_default --deselect=tests/test_core.py::test_rpc_inproc --deselect=tests/test_core.py::test_rpc_message_lifetime_default --deselect=tests/test_core.py::test_rpc_message_lifetime_inproc --deselect=tests/test_core.py::test_rpc_message_lifetime_tcp --deselect=tests/test_core.py::test_rpc_serialization --deselect=tests/test_core.py::test_rpc_tcp --deselect=tests/test_core.py::test_rpc_tls --deselect=tests/test_core.py::test_rpc_with_many_connections_inproc --deselect=tests/test_core.py::test_rpc_with_many_connections_tcp --deselect=tests/test_core.py::test_send_recv_args --deselect=tests/test_core.py::test_send_recv_cancelled --deselect=tests/test_core.py::test_server --deselect=tests/test_core.py::test_server_comms_mark_active_handlers --deselect=tests/test_core.py::test_server_raises_on_blocked_handlers --deselect=tests/test_jupyter.py::test_jupyter_idle_timeout --deselect=tests/test_jupyter.py::test_jupyter_server --deselect=tests/test_locks.py::test_errors --deselect=tests/test_nanny.py::test_scheduler_file --deselect=tests/test_nanny.py::test_scheduler_file --deselect=tests/test_nanny.py::test_scheduler_file --deselect=tests/test_nanny.py::test_worker_uses_same_host_as_nanny --deselect=tests/test_preload.py::test_failure_doesnt_crash_scheduler --deselect=tests/test_preload.py::test_preload_import_time --deselect=tests/test_preload.py::test_preload_manager_sequence --deselect=tests/test_preload.py::test_worker_preload_text --deselect=tests/test_scheduler.py::test_allowed_failures_config --deselect=tests/test_scheduler.py::test_async_context_manager --deselect=tests/test_scheduler.py::test_dashboard_host --deselect=tests/test_scheduler.py::test_file_descriptors_dont_leak --deselect=tests/test_scheduler.py::test_finished --deselect=tests/test_scheduler.py::test_multiple_listeners --deselect=tests/test_scheduler.py::test_no_dangling_asyncio_tasks --deselect=tests/test_scheduler.py::test_scheduler_file --deselect=tests/test_scheduler.py::test_scheduler_file --deselect=tests/test_scheduler.py::test_scheduler_file --deselect=tests/test_security.py::test_require_encryption --deselect=tests/test_security.py::test_tls_listen_connect --deselect=tests/test_security.py::test_tls_temporary_credentials_functional --deselect=tests/test_semaphore.py::test_threadpoolworkers_pick_correct_ioloop --deselect=tests/test_tls_functional.py::test_security_dict_input_no_security --deselect=tests/test_utils_test.py::test_ensure_no_new_clients --deselect=tests/test_utils_test.py::test_freeze_batched_send --deselect=tests/test_utils_test.py::test_locked_comm_drop_in_replacement --deselect=tests/test_utils_test.py::test_locked_comm_intercept_read --deselect=tests/test_utils_test.py::test_locked_comm_intercept_write --deselect=tests/test_worker.py::test_host_uses_scheduler_protocol --deselect=tests/test_worker.py::test_plugin_exception --deselect=tests/test_worker.py::test_plugin_internal_exception --deselect=tests/test_worker.py::test_plugin_multiple_exceptions --deselect=tests/test_worker.py::test_scheduler_file --deselect=tests/test_worker.py::test_scheduler_file --deselect=tests/test_worker.py::test_scheduler_file --deselect=tests/test_worker_client.py::test_dont_override_default_get 5988s ============================= test session starts ============================== 5988s platform linux -- Python 3.13.0, pytest-8.3.3, pluggy-1.5.0 -- /usr/bin/python3.13 5988s cachedir: .pytest_cache 5988s rootdir: /tmp/autopkgtest.1vd31g/autopkgtest_tmp/build 5988s configfile: pyproject.toml 5988s plugins: typeguard-4.4.1, anyio-4.6.2, rerunfailures-14.0, timeout-2.3.1 5988s timeout: 300.0s 5988s timeout method: signal 5988s timeout func_only: False 6000s collecting ... collected 3349 items / 3311 deselected / 30 skipped / 38 selected 6000s run-last-failure: rerun previous 38 failures 6000s 6002s cli/tests/test_dask_scheduler.py::test_preload_file <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py FAILED [ 2%] 6004s cli/tests/test_dask_scheduler.py::test_preload_module <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py FAILED [ 5%] 6006s cli/tests/test_dask_scheduler.py::test_preload_remote_module <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py FAILED [ 7%] 6007s cli/tests/test_dask_scheduler.py::test_preload_config <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py FAILED [ 10%] 6009s cli/tests/test_dask_scheduler.py::test_preload_command <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py FAILED [ 13%] 6011s cli/tests/test_dask_scheduler.py::test_preload_command_default <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py FAILED [ 15%] 6015s cli/tests/test_dask_scheduler.py::test_multiple_workers_2 <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py FAILED [ 18%] 6018s cli/tests/test_tls_cli.py::test_basic <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_tls_cli.py FAILED [ 21%] 6022s cli/tests/test_tls_cli.py::test_sni <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_tls_cli.py FAILED [ 23%] 6027s cli/tests/test_tls_cli.py::test_nanny <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_tls_cli.py FAILED [ 26%] 6031s cli/tests/test_tls_cli.py::test_separate_key_cert <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_tls_cli.py FAILED [ 28%] 6035s cli/tests/test_tls_cli.py::test_use_config_file <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_tls_cli.py FAILED [ 31%] 6038s deploy/tests/test_subprocess.py::test_basic <- ../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_subprocess.py FAILED [ 34%] 6040s deploy/tests/test_subprocess.py::test_n_workers <- ../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_subprocess.py FAILED [ 36%] 6042s tests/test_client.py::test_upload_file_zip <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py FAILED [ 39%] 6042s tests/test_profile.py::test_info_frame_f_lineno[22-4] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py FAILED [ 42%] 6042s tests/test_profile.py::test_info_frame_f_lineno[23-4] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py FAILED [ 44%] 6042s tests/test_profile.py::test_call_stack_f_lineno[22-4] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py FAILED [ 47%] 6042s tests/test_profile.py::test_call_stack_f_lineno[23-4] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py FAILED [ 50%] 6102s tests/test_scheduler.py::test_broadcast_tls <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py FAILED [ 52%] 6103s tests/test_security.py::test_repr_temp_keys <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py FAILED [ 55%] 6103s tests/test_security.py::test_temporary_credentials <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py FAILED [ 57%] 6103s tests/test_security.py::test_extra_conn_args_in_temporary_credentials <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py FAILED [ 60%] 6163s tests/test_tls_functional.py::test_basic <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_tls_functional.py FAILED [ 63%] 6224s tests/test_tls_functional.py::test_Queue <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_tls_functional.py FAILED [ 65%] 6285s tests/test_tls_functional.py::test_client_submit <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_tls_functional.py FAILED [ 68%] 6345s tests/test_tls_functional.py::test_gather <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_tls_functional.py FAILED [ 71%] 6406s tests/test_tls_functional.py::test_scatter <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_tls_functional.py FAILED [ 73%] 6466s tests/test_tls_functional.py::test_nanny <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_tls_functional.py FAILED [ 76%] 6527s tests/test_tls_functional.py::test_rebalance <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_tls_functional.py FAILED [ 78%] 6587s tests/test_tls_functional.py::test_work_stealing <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_tls_functional.py FAILED [ 81%] 6648s tests/test_tls_functional.py::test_worker_client <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_tls_functional.py FAILED [ 84%] 6708s tests/test_tls_functional.py::test_worker_client_gather <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_tls_functional.py FAILED [ 86%] 6769s tests/test_tls_functional.py::test_worker_client_executor <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_tls_functional.py FAILED [ 89%] 6829s tests/test_tls_functional.py::test_retire_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_tls_functional.py FAILED [ 92%] 6860s tests/test_tls_functional.py::test_security_dict_input <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_tls_functional.py FAILED [ 94%] 6920s tests/test_utils_test.py::test_gen_cluster_tls <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py FAILED [ 97%] 7221s tests/test_utils_test.py::test_tls_cluster <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py +++++++++++++++++++++++++++++++++++ Timeout ++++++++++++++++++++++++++++++++++++ 7221s ~~~~~~~~~~~~~~~~~~~~~ Stack of test IOLoop_0 (3892245504) ~~~~~~~~~~~~~~~~~~~~~~ 7221s File "/usr/lib/python3.13/threading.py", line 1012, in _bootstrap 7221s self._bootstrap_inner() 7221s File "/usr/lib/python3.13/threading.py", line 1041, in _bootstrap_inner 7221s self.run() 7221s File "/usr/lib/python3.13/threading.py", line 992, in run 7221s self._target(*self._args, **self._kwargs) 7221s File "/usr/lib/python3.13/concurrent/futures/thread.py", line 92, in _worker 7221s work_item.run() 7221s File "/usr/lib/python3.13/concurrent/futures/thread.py", line 58, in run 7221s result = self.fn(*self.args, **self.kwargs) 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 378, in _run_and_close_tornado 7221s return asyncio_run(inner_fn(), loop_factory=get_loop_factory()) 7221s File "/usr/lib/python3.13/asyncio/runners.py", line 194, in run 7221s return runner.run(main) 7221s File "/usr/lib/python3.13/asyncio/runners.py", line 118, in run 7221s return self._loop.run_until_complete(task) 7221s File "/usr/lib/python3.13/asyncio/base_events.py", line 707, in run_until_complete 7221s self.run_forever() 7221s File "/usr/lib/python3.13/asyncio/base_events.py", line 678, in run_forever 7221s self._run_once() 7221s File "/usr/lib/python3.13/asyncio/base_events.py", line 1995, in _run_once 7221s event_list = self._selector.select(timeout) 7221s File "/usr/lib/python3.13/selectors.py", line 452, in select 7221s fd_event_list = self._selector.poll(timeout, max_ev) 7221s ~~~~~~~~~~~~~~~~~~~~~ Stack of Dask-Offload_0 (4033016832) ~~~~~~~~~~~~~~~~~~~~~ 7221s File "/usr/lib/python3.13/threading.py", line 1012, in _bootstrap 7221s self._bootstrap_inner() 7221s File "/usr/lib/python3.13/threading.py", line 1041, in _bootstrap_inner 7221s self.run() 7221s File "/usr/lib/python3.13/threading.py", line 992, in run 7221s self._target(*self._args, **self._kwargs) 7221s File "/usr/lib/python3.13/concurrent/futures/thread.py", line 89, in _worker 7221s work_item = work_queue.get(block=True) 7221s +++++++++++++++++++++++++++++++++++ Timeout ++++++++++++++++++++++++++++++++++++ 7221s ERROR [100%] 7221s 7221s ==================================== ERRORS ==================================== 7221s ______________________ ERROR at setup of test_tls_cluster ______________________ 7221s 7221s loop = 7221s security = Security(require_encryption=True, tls_ca_file=Local (/usr/lib/python3/dist-packages/distributed/tests/tls-ca-cert.pem)...ted/tests/tls-key-cert.pem), tls_worker_cert=Local (/usr/lib/python3/dist-packages/distributed/tests/tls-key-cert.pem)) 7221s 7221s @pytest.fixture 7221s def tls_cluster(loop, security): 7221s > with tls_cluster_context(security=security) as (scheduler, workers): 7221s 7221s /usr/lib/python3/dist-packages/distributed/utils_test.py:573: 7221s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7221s /usr/lib/python3.13/contextlib.py:141: in __enter__ 7221s return next(self.gen) 7221s /usr/lib/python3/dist-packages/distributed/utils_test.py:565: in tls_cluster_context 7221s with cluster( 7221s /usr/lib/python3.13/contextlib.py:141: in __enter__ 7221s return next(self.gen) 7221s /usr/lib/python3/dist-packages/distributed/utils_test.py:672: in cluster 7221s pid, addr_or_exception = q.get() 7221s /usr/lib/python3.13/multiprocessing/queues.py:101: in get 7221s res = self._recv_bytes() 7221s /usr/lib/python3.13/multiprocessing/connection.py:216: in recv_bytes 7221s buf = self._recv_bytes(maxlength) 7221s /usr/lib/python3.13/multiprocessing/connection.py:430: in _recv_bytes 7221s buf = self._recv(4) 7221s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7221s 7221s self = , size = 4 7221s read = 7221s 7221s def _recv(self, size, read=_read): 7221s buf = io.BytesIO() 7221s handle = self._handle 7221s remaining = size 7221s while remaining > 0: 7221s > chunk = read(handle, remaining) 7221s E Failed: Timeout >300.0s 7221s 7221s /usr/lib/python3.13/multiprocessing/connection.py:395: Failed 7221s ---------------------------- Captured stderr setup ----------------------------- 7221s 2024-11-23 22:31:51,577 - distributed.http.proxy - INFO - To route to workers diagnostics web server please install jupyter-server-proxy: python -m pip install jupyter-server-proxy 7221s 2024-11-23 22:31:51,582 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:31:51,605 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39457 7221s 2024-11-23 22:31:51,606 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:8787/status 7221s 2024-11-23 22:31:51,606 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:31:51,648 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:32893 7221s 2024-11-23 22:31:51,648 - distributed.worker - INFO - Listening to: tls://127.0.0.1:32893 7221s 2024-11-23 22:31:51,648 - distributed.worker - INFO - dashboard at: 127.0.0.1:39929 7221s 2024-11-23 22:31:51,649 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:31:51,649 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:31:51,649 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:31:51,649 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:31:51,649 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-0hgap_hi 7221s 2024-11-23 22:31:51,649 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:31:51,650 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35425 7221s 2024-11-23 22:31:51,650 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35425 7221s 2024-11-23 22:31:51,650 - distributed.worker - INFO - dashboard at: 127.0.0.1:37035 7221s 2024-11-23 22:31:51,650 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:31:51,650 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:31:51,650 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:31:51,651 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:31:51,651 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-m4ngi458 7221s 2024-11-23 22:31:51,651 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:31:51,659 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:31:51,663 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40082': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:31:51,663 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:31:51,663 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40090': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:31:51,767 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:31:51,771 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40098': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:31:51,772 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40106': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:31:51,772 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:31:51,874 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:31:51,879 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40112': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:31:51,879 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:31:51,879 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:31:51,982 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:31:51,986 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40128': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:31:51,987 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:31:51,987 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40132': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:31:52,089 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:31:52,094 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40138': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:31:52,094 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40142': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:31:52,094 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:31:52,197 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:31:52,201 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40144': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:31:52,202 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40160': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:31:52,202 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:31:52,304 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:31:52,309 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40172': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:31:52,309 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:31:52,310 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40180': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:31:52,412 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:31:52,417 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40192': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:31:52,418 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:31:52,418 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40206': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:31:52,520 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:31:52,520 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40212': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:31:52,525 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:31:52,526 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40216': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:31:52,628 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:31:52,628 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40228': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:31:52,633 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:31:52,633 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40232': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:31:52,735 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:31:52,740 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40234': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:31:52,740 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:31:52,741 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40246': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:31:52,842 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:31:52,847 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40256': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:31:52,848 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:31:52,848 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40266': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:31:52,950 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:31:52,954 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40280': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:31:52,955 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40286': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:31:52,955 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:31:53,057 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:31:53,062 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40302': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:31:53,062 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40310': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:31:53,062 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:31:53,165 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:31:53,169 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40322': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:31:53,170 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:31:53,170 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40330': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:31:53,272 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:31:53,277 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40332': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:31:53,277 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:31:53,277 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40338': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:31:53,381 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:31:53,385 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40346': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:31:53,386 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:31:53,386 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40350': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:31:53,488 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:31:53,492 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40366': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:31:53,493 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40370': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:31:53,493 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:31:53,596 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:31:53,600 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40372': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:31:53,600 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:31:53,601 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40382': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:31:53,703 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:31:53,708 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40386': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:31:53,708 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:31:53,709 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40388': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:31:53,811 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:31:53,815 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40400': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:31:53,816 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:31:53,816 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40416': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:31:53,918 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:31:53,922 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40428': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:31:53,923 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:31:53,923 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40430': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:31:54,025 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:31:54,030 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40432': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:31:54,030 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40442': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:31:54,030 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:31:54,133 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:31:54,137 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40452': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:31:54,138 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:31:54,138 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40462': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:31:54,240 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:31:54,245 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40466': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:31:54,245 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:31:54,245 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40480': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:31:54,348 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:31:54,352 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40488': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:31:54,353 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:31:54,353 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40502': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:31:54,455 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:31:54,459 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40504': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:31:54,460 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40518': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:31:54,460 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:31:54,562 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:31:54,563 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40524': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:31:54,569 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:31:54,569 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40540': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:31:54,670 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:31:54,670 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40548': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:31:54,676 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:31:54,676 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40562': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:31:54,777 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:31:54,778 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40566': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:31:54,784 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:31:54,784 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40576': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:31:54,884 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:31:54,885 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40588': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:31:54,891 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:31:54,891 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40592': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:31:54,992 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:31:54,997 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40602': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:31:54,998 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:31:54,998 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40604': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:31:55,100 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:31:55,105 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40620': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:31:55,105 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40624': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:31:55,105 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:31:55,208 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:31:55,213 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40638': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:31:55,213 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40640': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:31:55,213 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:31:55,315 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:31:55,320 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40642': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:31:55,320 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:31:55,320 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40648': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:31:55,423 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:31:55,427 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40664': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:31:55,428 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:31:55,428 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40668': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:31:55,531 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:31:55,535 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40672': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:31:55,535 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:31:55,536 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40688': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:31:55,638 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:31:55,642 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40704': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:31:55,643 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:31:55,643 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40716': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:31:55,746 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:31:55,750 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40718': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:31:55,750 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:31:55,751 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:31:55,853 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:31:55,858 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40732': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:31:55,858 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:31:55,858 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40738': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:31:55,961 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:31:55,965 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40748': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:31:55,966 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:31:55,966 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40760': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:31:56,069 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:31:56,073 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40772': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:31:56,073 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40786': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:31:56,073 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:31:56,176 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:31:56,180 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40788': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:31:56,181 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40804': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:31:56,181 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:31:56,283 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:31:56,288 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40810': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:31:56,289 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40824': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:31:56,289 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:31:56,391 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:31:56,395 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40830': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:31:56,396 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:31:56,396 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40842': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:31:56,499 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:31:56,503 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40852': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:31:56,503 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:31:56,504 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40866': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:31:56,606 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:31:56,611 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40872': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:31:56,611 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:31:56,616 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40888': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:31:56,713 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:31:56,718 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40894': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:31:56,718 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:31:56,718 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40908': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:31:56,822 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:31:56,826 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40912': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:31:56,827 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40928': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:31:56,827 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:31:56,930 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:31:56,934 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40938': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:31:56,934 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:31:56,935 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40940': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:31:57,037 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:31:57,041 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40942': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:31:57,042 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:31:57,042 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40948': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:31:57,145 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:31:57,149 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40960': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:31:57,149 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:31:57,150 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40974': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:31:57,252 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:31:57,256 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40976': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:31:57,257 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:31:57,257 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:31:57,360 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:31:57,364 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40996': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:31:57,365 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:31:57,365 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41012': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:31:57,467 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:31:57,472 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41016': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:31:57,472 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:31:57,472 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41030': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:31:57,574 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:31:57,579 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41042': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:31:57,579 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:31:57,580 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41056': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:31:57,682 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:31:57,686 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41068': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:31:57,687 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:31:57,687 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41070': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:31:57,792 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:31:57,796 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41078': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:31:57,797 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:31:57,797 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41084': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:31:57,900 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:31:57,904 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41100': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:31:57,904 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:31:57,905 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41114': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:31:58,007 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:31:58,012 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41118': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:31:58,012 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:31:58,012 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41124': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:31:58,117 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:31:58,122 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41140': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:31:58,123 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:31:58,123 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41154': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:31:58,225 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:31:58,229 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41162': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:31:58,230 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:31:58,230 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41172': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:31:58,332 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:31:58,337 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41178': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:31:58,337 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:31:58,337 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41186': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:31:58,440 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:31:58,444 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41188': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:31:58,445 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:31:58,445 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41198': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:31:58,548 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:31:58,552 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41204': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:31:58,553 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:31:58,553 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41218': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:31:58,655 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:31:58,660 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41232': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:31:58,660 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:31:58,661 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41246': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:31:58,763 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:31:58,767 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41252': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:31:58,768 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41254': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:31:58,768 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:31:58,870 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:31:58,875 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41256': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:31:58,875 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:31:58,875 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41258': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:31:58,978 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:31:58,982 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41262': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:31:58,983 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41274': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:31:58,983 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:31:59,087 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:31:59,091 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41290': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:31:59,092 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41302': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:31:59,092 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:31:59,195 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:31:59,199 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41308': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:31:59,200 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:31:59,200 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41318': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:31:59,302 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:31:59,307 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41324': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:31:59,307 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:31:59,307 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41332': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:31:59,410 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:31:59,414 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41348': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:31:59,415 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:31:59,415 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41362': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:31:59,518 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:31:59,522 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41378': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:31:59,523 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:31:59,523 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41386': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:31:59,625 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:31:59,630 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41392': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:31:59,630 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:31:59,630 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41406': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:31:59,733 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:31:59,737 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41418': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:31:59,737 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:31:59,737 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41432': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:31:59,840 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:31:59,844 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41444': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:31:59,845 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41450': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:31:59,845 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:31:59,947 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:31:59,952 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41464': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:31:59,952 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41478': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:31:59,952 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:00,054 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:00,059 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41488': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:00,060 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41500': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:00,060 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:00,162 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:00,166 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41510': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:00,167 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41526': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:00,167 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:00,270 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:00,274 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41538': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:00,275 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:00,275 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41546': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:00,377 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:00,382 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41562': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:00,382 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:00,383 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41578': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:00,485 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:00,489 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41588': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:00,490 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:00,490 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41598': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:00,592 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:00,597 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41608': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:00,597 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:00,597 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41624': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:00,699 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:00,704 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41632': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:00,704 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41634': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:00,705 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:00,807 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:00,811 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41648': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:00,812 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:00,812 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41654': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:00,914 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:00,918 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41658': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:00,919 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41672': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:00,919 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:01,022 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:01,026 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41680': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:01,026 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:01,026 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41688': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:01,129 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:01,133 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41694': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:01,134 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:01,134 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41710': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:01,236 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:01,240 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41718': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:01,241 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41730': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:01,241 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:01,343 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:01,348 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41746': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:01,348 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41760': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:01,348 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:01,451 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:01,455 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41768': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:01,456 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:01,456 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41774': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:01,558 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:01,563 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56440': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:01,563 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56442': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:01,563 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:01,666 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:01,670 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56448': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:01,671 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:01,671 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56462': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:01,773 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:01,778 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56470': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:01,778 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:01,778 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56484': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:01,880 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:01,885 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56486': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:01,885 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:01,885 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56502': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:01,988 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:01,993 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56506': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:01,993 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:01,993 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56518': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:02,096 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:02,100 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56522': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:02,101 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:02,101 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56528': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:02,203 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:02,207 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56542': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:02,208 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:02,208 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56554': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:02,310 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:02,315 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56570': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:02,316 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:02,316 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56574': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:02,418 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:02,422 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56588': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:02,423 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:02,423 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56600': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:02,526 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:02,530 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56604': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:02,531 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:02,531 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56606': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:02,633 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:02,638 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56612': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:02,638 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:02,638 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56620': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:02,741 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:02,745 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56624': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:02,746 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:02,746 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56636': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:02,848 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:02,852 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56650': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:02,853 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56660': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:02,853 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:02,956 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:02,960 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56672': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:02,960 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56674': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:02,960 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:03,063 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:03,067 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56678': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:03,068 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:03,068 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56692': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:03,170 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:03,175 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56698': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:03,175 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:03,175 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56714': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:03,278 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:03,282 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56722': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:03,283 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:03,283 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56732': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:03,385 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:03,389 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56736': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:03,390 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:03,390 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56750': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:03,492 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:03,497 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56764': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:03,497 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:03,497 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56780': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:03,600 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:03,605 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:03,605 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56784': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:03,606 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56794': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:03,708 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:03,713 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56800': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:03,713 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56802': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:03,713 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:03,815 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:03,820 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56816': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:03,820 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:03,820 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56822': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:03,924 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:03,928 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56826': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:03,929 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:03,929 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56836': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:04,031 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:04,035 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56848': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:04,036 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:04,036 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56854': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:04,138 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:04,143 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56866': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:04,143 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:04,143 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56872': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:04,246 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:04,250 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56874': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:04,251 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:04,251 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56878': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:04,353 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:04,358 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56884': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:04,358 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:04,358 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56896': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:04,460 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:04,465 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56898': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:04,465 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:04,465 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56912': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:04,568 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:04,572 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56926': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:04,573 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56932': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:04,573 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:04,675 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:04,680 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56942': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:04,681 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56954': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:04,681 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:04,783 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:04,788 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56956': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:04,788 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56964': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:04,788 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:04,891 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:04,895 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56972': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:04,896 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56978': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:04,896 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:04,998 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:05,002 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56992': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:05,003 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:05,003 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57008': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:05,105 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:05,110 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57024': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:05,110 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:05,115 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57026': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:05,213 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:05,217 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57038': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:05,218 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:05,218 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57054': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:05,320 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:05,325 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57070': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:05,325 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57080': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:05,325 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:05,429 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:05,433 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57090': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:05,434 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57102': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:05,434 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:05,536 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:05,541 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57112': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:05,541 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57126': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:05,541 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:05,643 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:05,648 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57142': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:05,648 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:05,648 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57144': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:05,751 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:05,755 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57150': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:05,756 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57166': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:05,756 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:05,858 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:05,863 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57174': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:05,863 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:05,863 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57186': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:05,966 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:05,970 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57192': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:05,971 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:05,971 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57208': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:06,073 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:06,078 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57218': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:06,078 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:06,078 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57226': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:06,181 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:06,185 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57232': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:06,186 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57234': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:06,186 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:06,288 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:06,292 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57240': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:06,293 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57246': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:06,293 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:06,396 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:06,400 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57256': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:06,400 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57264': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:06,400 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:06,503 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:06,507 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57274': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:06,508 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:06,508 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57278': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:06,611 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:06,620 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57280': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:06,620 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:06,620 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57282': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:06,718 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:06,718 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57288': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:06,727 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:06,727 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57298': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:06,825 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:06,826 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57308': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:06,835 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:06,835 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57310': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:06,933 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:06,933 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57320': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:06,942 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:06,942 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57322': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:07,040 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:07,041 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57326': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:07,050 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:07,050 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57328': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:07,149 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:07,149 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57340': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:07,157 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:07,157 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57342': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:07,257 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:07,257 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57344': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:07,265 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:07,265 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57350': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:07,364 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:07,364 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57352': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:07,372 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:07,372 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57358': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:07,472 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:07,472 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57364': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:07,480 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:07,480 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57372': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:07,579 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:07,579 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57374': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:07,587 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:07,587 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57386': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:07,687 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:07,687 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57392': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:07,694 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:07,694 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57398': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:07,795 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:07,795 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57400': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:07,801 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:07,801 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57408': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:07,902 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:07,902 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57414': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:07,908 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:07,909 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57416': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:08,010 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:08,010 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57426': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:08,016 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:08,016 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57432': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:08,118 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:08,122 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57448': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:08,123 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57456': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:08,123 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:08,226 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:08,231 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57462': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:08,231 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:08,231 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57464': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:08,334 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:08,338 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57468': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:08,339 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:08,339 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57470': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:08,441 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:08,445 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57478': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:08,446 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57488': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:08,446 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:08,549 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:08,553 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57502': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:08,554 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:08,554 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57514': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:08,656 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:08,660 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57522': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:08,661 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57536': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:08,661 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:08,763 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:08,767 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57544': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:08,768 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:08,768 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57556': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:08,871 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:08,875 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57558': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:08,876 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:08,876 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57570': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:08,978 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:08,983 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57574': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:08,983 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57584': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:08,983 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:09,085 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:09,090 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57586': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:09,091 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:09,091 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57602': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:09,193 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:09,197 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57608': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:09,198 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:09,198 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57616': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:09,300 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:09,304 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57626': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:09,305 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:09,305 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57632': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:09,407 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:09,412 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57646': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:09,412 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:09,412 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57654': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:09,514 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:09,519 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57668': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:09,519 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57680': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:09,519 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:09,622 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:09,626 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57696': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:09,626 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:09,627 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57708': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:09,729 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:09,733 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57710': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:09,734 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:09,734 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57718': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:09,836 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:09,840 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57726': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:09,841 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57730': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:09,841 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:09,943 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:09,948 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57744': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:09,948 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:09,948 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57750': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:10,051 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:10,055 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57762': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:10,056 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57764': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:10,056 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:10,158 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:10,162 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57772': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:10,163 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57780': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:10,163 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:10,265 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:10,270 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:10,270 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:10,270 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57808': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:10,373 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:10,377 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57810': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:10,378 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:10,378 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57812': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:10,480 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:10,485 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57822': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:10,485 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57836': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:10,485 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:10,588 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:10,593 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57844': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:10,593 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57852': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:10,593 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:10,696 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:10,700 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57856': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:10,700 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:10,701 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57858': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:10,803 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:10,808 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57864': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:10,808 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:10,808 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57868': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:10,911 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:10,915 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57878': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:10,916 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:10,916 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57888': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:11,018 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:11,022 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57900': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:11,023 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:11,023 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57904': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:11,125 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:11,129 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57918': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:11,130 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57920': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:11,130 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:11,233 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:11,237 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57936': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:11,238 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57938': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:11,238 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:11,340 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:11,344 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57946': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:11,345 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:11,345 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57962': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:11,447 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:11,452 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57964': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:11,453 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:11,453 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57974': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:11,555 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:11,560 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41018': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:11,560 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41028': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:11,560 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:11,663 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:11,667 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41036': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:11,668 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:11,668 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41042': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:11,770 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:11,774 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41044': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:11,775 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41050': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:11,775 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:11,877 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:11,882 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41064': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:11,882 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41076': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:11,883 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:11,985 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:11,989 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41090': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:11,990 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:11,990 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41092': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:12,092 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:12,097 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41098': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:12,097 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41114': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:12,097 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:12,200 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:12,204 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41124': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:12,205 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:12,205 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41130': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:12,308 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:12,312 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41136': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:12,313 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41148': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:12,313 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:12,415 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:12,420 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41162': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:12,421 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:12,421 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41174': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:12,522 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:12,527 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41184': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:12,528 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:12,528 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41196': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:12,630 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:12,635 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41206': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:12,636 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:12,636 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41216': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:12,738 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:12,738 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41228': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:12,743 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:12,744 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41234': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:12,847 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:12,852 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41240': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:12,852 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:12,852 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41246': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:12,955 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:12,959 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41262': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:12,959 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:12,960 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41276': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:13,062 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:13,066 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41286': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:13,067 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41294': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:13,067 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:13,169 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:13,174 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41296': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:13,174 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41300': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:13,174 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:13,277 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:13,281 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41310': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:13,282 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:13,282 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41314': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:13,384 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:13,389 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41330': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:13,389 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41338': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:13,389 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:13,491 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:13,496 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41342': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:13,496 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:13,496 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41348': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:13,599 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:13,603 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41356': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:13,604 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:13,604 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41358': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:13,706 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:13,711 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41366': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:13,711 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:13,712 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41376': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:13,813 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:13,818 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41380': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:13,819 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41382': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:13,819 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:13,921 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:13,925 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41396': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:13,925 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:13,925 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41402': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:14,029 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:14,033 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41418': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:14,034 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41428': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:14,034 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:14,136 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:14,140 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41436': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:14,141 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:14,141 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41448': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:14,243 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:14,248 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41450': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:14,248 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:14,248 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41460': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:14,351 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:14,355 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41474': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:14,356 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41478': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:14,356 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:14,458 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:14,462 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41488': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:14,463 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:14,463 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41490': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:14,566 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:14,570 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41502': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:14,571 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41514': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:14,571 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:14,673 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:14,677 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41520': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:14,678 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41526': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:14,678 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:14,780 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:14,784 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41540': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:14,785 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:14,785 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41556': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:14,888 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:14,892 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41572': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:14,892 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41580': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:14,892 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:14,999 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:15,004 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41592': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:15,005 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:15,006 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41608': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:15,107 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:15,108 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41612': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:15,119 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41620': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:15,120 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:15,214 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:15,215 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41628': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:15,228 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41642': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:15,228 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:15,322 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:15,322 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41652': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:15,337 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41654': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:15,337 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:15,430 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:15,430 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41660': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:15,445 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41672': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:15,445 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:15,538 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:15,538 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41684': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:15,553 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41692': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:15,553 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:15,646 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:15,646 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41702': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:15,662 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41714': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:15,662 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:15,754 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:15,754 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41718': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:15,770 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41726': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:15,770 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:15,862 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:15,862 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41734': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:15,878 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41738': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:15,878 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:15,969 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:15,969 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41754': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:15,986 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41768': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:15,986 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:16,077 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:16,077 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41782': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:16,094 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41784': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:16,094 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:16,185 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:16,185 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41794': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:16,202 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41806': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:16,202 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:16,292 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:16,292 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41822': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:16,310 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41832': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:16,310 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:16,400 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:16,400 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41838': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:16,418 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41842': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:16,419 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:16,508 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:16,508 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41858': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:16,526 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41874': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:16,526 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:16,619 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:16,619 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41884': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:16,634 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41896': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:16,634 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:16,727 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:16,727 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41906': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:16,742 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41916': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:16,742 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:16,834 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:16,834 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41924': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:16,850 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41928': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:16,850 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:16,942 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:16,942 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41932': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:16,959 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41936': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:16,959 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:17,050 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:17,050 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41942': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:17,067 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41956': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:17,067 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:17,158 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41966': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:17,158 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:17,175 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41976': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:17,175 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:17,267 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:17,267 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41988': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:17,284 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42004': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:17,284 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:17,374 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:17,374 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42014': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:17,392 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:17,394 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42022': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:17,483 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:17,483 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42028': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:17,500 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42030': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:17,500 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:17,590 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:17,590 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42038': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:17,608 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:17,612 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42042': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:17,698 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:17,698 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42054': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:17,716 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42070': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:17,716 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:17,805 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:17,805 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42072': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:17,824 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42074': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:17,824 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:17,913 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:17,913 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42088': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:17,932 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42090': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:17,932 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:18,021 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:18,021 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42100': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:18,040 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42116': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:18,040 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:18,128 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:18,128 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:18,148 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42130': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:18,148 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:18,236 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:18,236 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42146': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:18,256 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42152': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:18,256 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:18,343 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:18,343 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42164': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:18,364 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42178': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:18,364 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:18,451 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:18,451 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42188': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:18,472 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42204': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:18,472 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:18,559 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:18,559 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42208': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:18,580 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42222': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:18,581 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:18,667 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:18,667 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42232': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:18,688 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42238': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:18,688 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:18,774 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:18,774 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42244': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:18,796 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42260': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:18,796 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:18,882 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:18,882 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42264': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:18,904 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42268': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:18,904 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:18,990 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:18,990 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42270': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:19,012 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:19,012 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42280': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:19,098 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:19,098 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42296': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:19,119 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:19,119 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42304': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:19,206 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:19,206 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42314': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:19,227 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:19,227 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42322': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:19,314 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:19,314 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42328': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:19,334 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:19,334 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42332': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:19,421 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:19,421 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42342': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:19,442 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:19,442 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42350': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:19,529 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:19,529 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42354': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:19,549 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:19,549 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42362': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:19,636 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:19,636 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42366': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:19,656 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:19,657 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42368': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:19,744 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:19,744 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42372': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:19,764 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:19,764 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42386': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:19,851 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:19,851 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42390': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:19,872 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:19,872 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42392': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:19,959 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:19,959 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42394': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:19,980 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:19,980 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42404': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:20,066 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:20,067 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42418': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:20,088 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:20,088 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42420': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:20,174 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:20,174 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42422': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:20,195 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:20,195 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42434': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:20,282 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:20,282 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42438': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:20,302 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:20,303 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42446': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:20,390 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:20,390 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42452': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:20,410 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:20,410 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42456': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:20,498 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:20,498 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42458': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:20,517 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:20,517 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42460': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:20,605 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:20,605 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42470': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:20,625 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:20,625 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42482': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:20,713 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:20,713 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42498': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:20,732 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:20,732 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42508': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:20,820 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:20,820 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42524': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:20,840 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:20,840 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42532': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:20,929 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:20,929 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42536': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:20,947 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:20,947 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42548': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:21,037 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:21,037 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42556': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:21,055 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:21,055 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42568': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:21,144 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:21,144 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42580': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:21,162 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:21,162 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42584': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:21,252 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:21,252 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42598': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:21,270 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:21,270 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42610': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:21,360 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:21,360 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42626': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:21,377 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:21,377 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42628': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:21,467 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:21,468 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42642': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:21,485 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:21,485 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42644': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:21,575 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:21,575 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44090': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:21,592 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:21,592 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44100': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:21,684 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:21,684 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44106': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:21,701 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:21,701 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44110': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:21,792 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:21,792 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44124': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:21,808 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:21,808 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44140': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:21,899 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:21,899 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44148': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:21,916 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:21,916 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44160': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:22,007 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:22,008 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44166': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:22,023 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:22,023 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44176': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:22,118 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:22,118 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44186': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:22,131 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:22,131 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44198': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:22,226 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:22,226 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44202': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:22,239 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:22,239 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44208': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:22,333 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:22,333 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44224': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:22,346 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:22,347 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44226': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:22,441 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:22,441 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44238': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:22,454 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:22,454 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44254': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:22,548 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:22,548 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44266': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:22,561 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:22,561 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44274': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:22,657 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:22,657 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44288': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:22,669 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:22,669 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44300': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:22,765 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:22,765 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44314': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:22,776 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:22,777 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44326': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:22,872 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:22,872 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44340': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:22,884 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:22,885 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44352': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:22,980 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:22,980 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44356': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:22,992 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:22,992 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44362': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:23,087 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:23,087 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44374': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:23,100 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:23,100 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44378': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:23,194 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:23,194 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44392': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:23,207 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:23,207 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44406': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:23,302 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:23,302 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44420': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:23,314 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:23,315 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44428': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:23,410 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:23,410 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44440': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:23,422 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:23,422 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44446': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:23,517 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:23,517 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44462': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:23,529 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:23,529 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44474': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:23,625 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:23,625 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44490': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:23,636 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:23,636 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44492': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:23,732 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:23,732 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44494': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:23,744 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:23,744 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44498': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:23,840 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:23,840 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44502': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:23,851 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:23,851 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44516': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:23,948 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:23,948 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44532': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:23,959 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:23,959 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44548': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:24,055 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:24,055 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44556': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:24,066 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:24,066 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44568': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:24,163 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:24,163 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44570': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:24,174 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:24,174 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44580': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:24,270 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:24,270 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44586': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:24,281 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:24,281 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44600': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:24,379 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44606': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:24,379 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:24,389 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:24,389 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44614': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:24,487 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:24,487 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44620': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:24,496 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:24,496 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44626': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:24,594 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:24,594 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44628': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:24,604 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:24,604 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44644': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:24,702 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:24,702 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44648': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:24,711 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:24,711 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44656': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:24,809 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44666': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:24,809 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:24,818 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:24,818 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44676': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:24,917 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:24,917 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44680': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:24,926 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:24,926 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44682': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:25,025 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:25,025 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44692': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:25,033 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:25,033 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44702': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:25,132 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:25,132 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44714': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:25,140 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:25,140 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44718': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:25,240 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:25,240 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44722': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:25,248 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:25,248 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44734': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:25,348 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:25,348 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44740': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:25,355 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:25,355 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44742': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:25,455 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:25,455 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44758': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:25,462 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:25,462 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44772': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:25,563 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:25,563 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44774': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:25,569 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:25,569 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44788': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:25,670 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:25,671 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44798': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:25,676 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44802': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:25,676 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:25,778 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:25,778 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44814': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:25,784 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44830': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:25,784 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:25,886 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:25,886 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44840': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:25,892 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:25,892 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44844': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:25,993 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44854': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:25,994 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:25,999 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:25,999 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44858': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:26,102 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:26,106 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44870': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:26,107 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:26,107 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44884': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:26,210 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:26,214 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44890': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:26,215 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44904': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:26,215 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:26,317 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:26,321 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44912': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:26,322 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:26,322 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44916': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:26,425 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:26,429 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44918': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:26,430 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44932': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:26,430 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:26,532 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:26,537 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:26,543 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44944': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:26,544 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44958': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:26,639 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:26,644 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44974': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:26,644 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:26,645 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44988': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:26,747 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:26,751 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44998': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:26,752 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45008': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:26,752 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:26,854 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:26,859 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45020': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:26,859 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:26,860 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45032': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:26,961 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:26,966 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45036': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:26,966 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45040': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:26,966 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:27,069 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:27,073 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45048': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:27,074 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:27,074 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45056': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:27,176 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:27,181 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45062': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:27,181 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45076': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:27,181 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:27,284 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:27,288 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45078': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:27,289 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45080': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:27,289 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:27,391 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:27,396 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45088': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:27,396 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45098': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:27,396 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:27,499 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:27,503 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45100': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:27,504 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45114': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:27,504 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:27,606 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:27,611 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45118': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:27,612 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:27,616 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:27,714 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:27,718 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45134': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:27,719 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45144': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:27,719 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:27,822 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:27,827 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45154': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:27,827 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:27,827 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45164': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:27,930 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:27,934 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45168': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:27,935 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45180': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:27,935 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:28,038 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:28,042 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45186': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:28,043 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45190': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:28,043 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:28,145 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:28,149 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45206': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:28,150 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45210': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:28,150 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:28,253 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:28,257 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45222': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:28,258 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:28,258 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45234': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:28,360 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:28,365 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45240': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:28,365 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:28,365 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45254': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:28,468 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:28,472 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45256': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:28,473 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45266': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:28,473 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:28,575 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:28,579 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45268': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:28,580 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:28,580 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45276': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:28,682 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:28,687 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45278': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:28,687 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:28,687 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45288': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:28,790 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:28,794 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45304': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:28,795 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:28,795 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45306': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:28,897 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:28,902 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45314': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:28,902 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45330': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:28,902 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:29,005 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:29,009 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45344': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:29,010 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:29,010 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45358': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:29,112 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:29,121 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45374': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:29,122 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:29,122 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45390': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:29,220 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:29,220 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45394': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:29,229 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:29,229 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45406': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:29,327 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:29,327 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45420': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:29,337 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:29,337 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45428': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:29,435 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:29,435 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45438': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:29,444 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:29,444 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45452': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:29,543 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:29,544 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45466': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:29,551 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:29,551 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45470': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:29,651 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:29,651 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45480': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:29,658 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:29,658 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45484': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:29,758 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:29,759 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45494': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:29,765 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:29,765 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45510': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:29,866 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:29,866 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45526': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:29,872 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:29,872 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45540': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:29,974 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:29,979 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45550': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:29,980 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:29,980 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45556': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:30,081 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:30,086 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45572': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:30,087 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:30,087 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45588': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:30,189 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:30,193 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45600': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:30,194 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:30,194 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45608': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:30,296 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:30,296 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45610': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:30,302 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:30,302 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45626': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:30,404 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:30,409 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45628': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:30,410 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:30,410 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45638': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:30,512 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:30,516 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45654': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:30,517 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:30,517 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45662': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:30,620 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:30,625 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45664': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:30,625 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:30,625 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45674': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:30,727 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:30,732 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45680': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:30,733 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45684': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:30,733 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:30,835 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:30,839 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45700': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:30,840 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45702': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:30,840 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:30,943 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:30,947 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45716': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:30,948 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:30,948 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:31,050 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:31,054 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45730': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:31,055 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:31,055 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45738': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:31,157 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:31,162 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45742': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:31,162 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:31,163 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45752': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:31,266 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:31,270 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45766': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:31,271 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:31,271 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45778': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:31,373 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:31,378 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45784': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:31,378 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:31,378 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45788': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:31,481 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:31,485 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45794': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:31,486 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:31,486 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45804': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:31,588 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:31,593 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45608': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:31,593 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:31,593 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45612': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:31,695 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:31,700 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45628': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:31,701 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:31,701 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45640': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:31,803 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:31,808 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45656': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:31,808 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:31,808 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45672': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:31,910 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:31,915 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45682': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:31,916 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:31,916 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45692': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:32,018 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:32,023 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45698': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:32,024 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:32,024 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45704': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:32,125 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:32,130 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45720': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:32,131 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45726': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:32,131 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:32,233 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:32,237 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45742': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:32,238 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:32,238 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45748': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:32,340 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:32,344 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45752': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:32,345 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:32,345 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45756': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:32,447 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:32,452 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45770': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:32,452 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:32,452 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45780': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:32,555 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:32,559 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45784': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:32,560 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:32,560 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45798': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:32,662 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:32,667 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45806': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:32,667 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:32,667 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45816': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:32,769 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:32,774 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45832': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:32,774 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:32,775 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45842': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:32,877 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:32,881 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45856': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:32,882 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:32,882 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45872': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:32,985 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:32,989 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45878': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:32,990 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:32,990 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45892': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:33,092 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:33,092 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45908': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:33,098 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:33,098 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45920': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:33,200 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:33,204 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45922': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:33,205 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:33,205 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45930': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:33,307 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:33,312 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45940': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:33,313 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:33,313 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45956': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:33,415 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:33,420 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45970': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:33,420 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:33,421 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45974': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:33,522 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:33,527 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45982': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:33,528 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:33,528 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45990': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:33,630 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:33,635 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45992': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:33,635 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:33,635 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46006': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:33,737 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:33,742 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46012': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:33,742 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46022': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:33,742 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:33,845 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:33,849 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46026': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:33,850 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:33,850 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46034': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:33,952 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:33,957 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46042': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:33,958 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:33,958 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46050': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:34,060 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:34,064 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46052': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:34,065 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:34,065 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46066': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:34,168 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:34,172 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46072': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:34,173 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46074': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:34,173 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:34,275 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:34,279 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46088': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:34,280 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:34,280 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46102': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:34,383 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:34,387 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46114': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:34,388 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46116': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:34,388 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:34,490 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:34,495 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46124': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:34,495 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46138': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:34,495 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:34,598 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:34,602 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46144': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:34,603 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46152': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:34,603 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:34,706 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:34,711 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46156': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:34,711 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:34,711 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46164': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:34,814 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:34,818 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46170': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:34,819 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:34,819 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46172': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:34,921 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:34,925 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46184': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:34,926 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46192': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:34,926 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:35,030 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:35,034 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46204': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:35,034 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:35,035 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46210': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:35,137 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:35,142 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46226': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:35,142 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:35,142 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46238': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:35,244 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:35,249 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46250': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:35,249 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:35,249 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46258': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:35,352 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:35,356 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46274': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:35,357 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:35,357 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46286': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:35,459 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:35,464 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46290': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:35,465 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46298': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:35,465 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:35,567 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:35,572 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46308': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:35,572 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:35,572 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46324': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:35,675 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:35,679 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46328': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:35,680 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:35,680 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46330': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:35,782 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:35,786 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46346': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:35,787 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:35,787 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46352': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:35,889 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:35,894 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46362': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:35,894 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46366': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:35,894 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:35,997 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:36,001 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46376': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:36,002 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46378': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:36,002 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:36,105 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:36,109 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46380': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:36,110 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:36,114 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46396': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:36,212 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:36,217 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46402': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:36,218 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:36,218 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46408': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:36,319 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:36,324 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46422': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:36,325 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:36,325 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46432': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:36,428 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:36,432 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46434': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:36,433 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46448': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:36,433 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:36,535 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:36,540 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46456': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:36,541 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46462': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:36,541 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:36,643 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:36,647 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46466': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:36,648 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46476': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:36,648 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:36,750 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:36,755 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46490': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:36,755 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:36,755 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46506': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:36,858 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:36,863 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46512': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:36,864 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:36,864 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46516': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:36,966 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:36,971 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46526': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:36,971 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46530': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:36,971 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:37,074 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:37,078 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46538': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:37,079 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:37,079 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46554': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:37,182 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:37,186 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46558': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:37,186 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46564': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:37,187 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:37,289 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:37,293 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46570': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:37,294 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46582': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:37,294 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:37,397 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:37,401 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46590': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:37,401 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46594': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:37,401 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:37,504 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:37,508 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46608': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:37,509 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:37,509 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46616': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:37,617 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:37,622 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46624': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:37,622 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46630': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:37,622 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:37,725 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:37,729 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46646': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:37,730 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46660': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:37,730 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:37,831 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:37,832 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46662': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:37,837 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:37,838 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46666': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:37,939 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:37,939 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46680': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:37,945 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:37,945 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46688': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:38,046 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:38,046 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46690': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:38,053 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:38,053 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46696': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:38,154 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:38,159 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46708': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:38,160 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:38,160 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46720': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:38,262 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:38,267 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46730': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:38,267 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:38,268 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46732': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:38,369 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:38,369 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46734': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:38,375 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:38,375 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46746': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:38,476 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:38,477 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46756': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:38,483 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:38,483 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46762': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:38,584 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:38,584 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46768': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:38,590 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:38,591 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46780': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:38,692 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:38,692 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46790': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:38,698 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:38,698 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46794': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:38,799 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:38,805 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46806': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:38,806 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:38,806 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46808': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:38,907 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:38,912 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46810': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:38,913 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:38,913 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46826': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:39,015 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:39,015 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46840': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:39,021 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:39,021 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46854': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:39,122 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:39,122 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46870': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:39,128 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:39,128 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46880': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:39,229 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:39,229 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46882': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:39,236 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:39,236 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46896': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:39,336 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:39,336 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46908': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:39,343 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:39,343 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46912': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:39,444 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:39,444 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46920': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:39,450 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:39,450 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46924': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:39,551 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:39,551 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46938': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:39,558 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:39,558 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46942': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:39,658 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:39,659 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46944': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:39,665 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:39,665 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46956': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:39,766 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:39,767 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46962': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:39,772 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:39,772 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46964': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:39,874 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:39,874 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46976': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:39,880 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:39,880 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46990': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:39,982 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:39,986 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47006': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:39,987 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:39,988 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47012': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:40,089 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:40,094 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47028': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:40,095 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47034': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:40,095 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:40,197 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:40,202 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47046': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:40,202 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47050': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:40,202 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:40,305 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:40,310 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47062': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:40,310 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:40,310 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47076': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:40,413 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:40,417 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47092': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:40,418 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:40,418 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47098': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:40,520 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:40,524 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47114': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:40,525 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:40,525 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47118': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:40,628 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:40,632 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47124': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:40,633 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:40,633 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47128': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:40,736 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:40,740 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47130': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:40,741 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47134': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:40,741 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:40,844 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:40,848 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47150': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:40,849 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:40,849 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47160': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:40,952 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:40,956 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47164': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:40,957 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:40,957 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47180': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:41,059 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:41,064 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47182': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:41,064 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:41,064 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47196': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:41,167 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:41,171 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47210': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:41,172 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:41,172 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47214': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:41,274 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:41,278 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47220': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:41,279 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:41,279 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47228': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:41,382 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:41,386 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47230': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:41,387 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:41,387 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47244': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:41,489 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:41,493 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47250': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:41,494 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47252': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:41,494 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:41,597 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:41,602 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42912': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:41,602 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:41,603 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42920': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:41,705 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:41,709 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42936': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:41,710 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42946': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:41,710 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:41,812 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:41,817 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42960': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:41,817 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42968': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:41,817 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:41,920 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:41,924 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42976': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:41,925 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42990': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:41,925 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:42,028 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:42,032 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43004': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:42,033 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:42,033 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43016': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:42,135 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:42,140 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43032': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:42,140 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43042': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:42,140 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:42,243 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:42,247 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43044': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:42,248 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43048': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:42,248 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:42,350 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:42,355 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43054': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:42,356 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:42,356 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43060': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:42,458 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:42,462 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43070': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:42,463 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43076': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:42,463 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:42,566 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:42,570 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43080': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:42,571 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:42,571 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43094': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:42,673 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:42,678 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43108': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:42,678 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:42,678 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43118': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:42,781 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:42,785 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43134': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:42,786 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:42,786 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43144': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:42,889 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:42,893 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43158': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:42,894 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:42,894 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43170': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:42,996 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:43,001 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43178': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:43,001 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:43,001 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43194': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:43,104 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:43,109 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43208': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:43,109 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:43,114 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43214': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:43,212 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:43,217 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43216': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:43,217 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:43,218 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43220': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:43,320 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:43,325 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43232': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:43,325 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:43,325 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43244': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:43,428 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:43,432 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43258': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:43,433 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43268': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:43,433 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:43,536 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:43,540 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43284': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:43,541 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43300': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:43,541 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:43,643 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43302': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:43,643 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:43,649 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:43,649 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43318': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:43,751 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:43,755 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43334': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:43,756 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:43,756 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43346': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:43,858 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:43,863 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43354': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:43,864 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43366': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:43,864 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:43,967 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:43,971 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43374': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:43,972 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:43,972 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43386': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:44,075 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:44,079 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43396': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:44,079 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43408': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:44,079 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:44,182 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:44,186 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43412': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:44,187 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43420': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:44,187 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:44,289 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:44,294 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43424': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:44,294 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:44,294 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43432': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:44,397 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:44,401 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43434': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:44,402 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43436': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:44,402 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:44,504 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:44,508 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43448': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:44,509 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:44,509 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43460': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:44,611 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:44,621 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43468': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:44,621 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43472': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:44,621 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:44,720 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:44,720 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43488': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:44,729 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:44,729 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43490': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:44,828 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:44,828 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43504': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:44,836 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:44,836 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43516': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:44,935 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:44,935 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43526': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:44,943 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:44,943 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43538': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:45,043 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:45,044 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43546': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:45,050 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:45,050 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43556': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:45,151 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:45,151 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43558': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:45,157 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:45,157 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43572': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:45,259 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:45,263 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43580': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:45,264 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:45,264 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43596': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:45,366 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:45,371 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43608': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:45,371 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:45,372 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43614': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:45,473 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:45,478 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43630': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:45,479 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:45,479 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43644': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:45,580 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:45,585 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43646': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:45,586 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43658': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:45,586 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:45,687 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:45,688 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43660': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:45,693 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:45,693 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43662': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:45,795 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:45,800 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43676': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:45,800 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:45,801 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43690': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:45,902 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:45,902 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43704': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:45,908 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:45,908 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43720': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:46,010 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:46,014 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43728': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:46,015 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:46,015 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43744': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:46,117 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:46,117 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43750': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:46,123 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:46,123 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43754': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:46,224 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:46,229 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43766': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:46,230 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:46,230 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43768': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:46,332 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:46,332 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43774': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:46,337 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:46,338 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43780': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:46,439 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:46,444 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43788': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:46,445 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:46,445 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:46,546 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:46,551 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43812': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:46,551 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43826': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:46,552 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:46,654 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:46,658 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43830': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:46,659 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:46,659 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43842': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:46,762 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:46,767 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43854': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:46,767 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:46,767 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43866': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:46,870 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:46,874 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43880': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:46,874 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:46,875 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43896': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:46,977 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:46,981 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43900': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:46,982 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43906': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:46,982 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:47,084 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:47,089 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43918': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:47,089 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43934': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:47,089 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:47,192 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:47,196 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43948': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:47,197 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:47,197 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43962': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:47,299 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:47,304 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43978': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:47,304 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:47,305 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:47,407 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:47,411 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43990': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:47,412 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:47,412 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44006': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:47,514 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:47,519 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44016': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:47,519 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:47,519 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44020': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:47,622 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:47,626 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44036': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:47,627 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:47,627 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44048': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:47,729 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:47,734 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:47,734 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:47,734 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44064': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:47,837 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:47,841 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44072': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:47,842 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:47,842 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44082': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:47,944 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:47,949 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44086': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:47,949 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:47,949 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44092': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:48,052 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:48,056 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44100': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:48,057 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:48,057 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44108': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:48,159 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:48,164 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44110': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:48,164 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:48,164 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44114': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:48,267 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:48,271 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44130': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:48,272 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44140': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:48,272 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:48,374 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:48,379 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44146': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:48,379 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44152': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:48,379 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:48,483 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:48,487 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44160': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:48,488 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44162': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:48,488 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:48,591 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:48,596 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44170': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:48,596 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:48,596 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44180': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:48,699 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:48,703 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44186': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:48,704 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:48,704 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44190': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:48,806 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:48,811 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44204': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:48,811 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:48,812 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44212': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:48,914 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:48,918 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44220': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:48,919 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44236': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:48,919 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:49,021 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:49,026 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44242': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:49,026 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:49,026 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44250': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:49,129 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:49,133 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44256': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:49,134 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44262': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:49,134 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:49,236 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:49,241 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44270': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:49,242 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:49,242 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44284': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:49,344 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:49,348 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44290': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:49,349 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44306': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:49,349 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:49,452 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:49,456 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44322': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:49,457 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:49,457 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44334': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:49,559 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:49,564 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:49,565 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44348': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:49,566 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44350': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:49,666 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:49,671 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44366': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:49,672 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:49,672 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44372': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:49,774 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:49,778 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44380': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:49,779 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44388': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:49,779 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:49,881 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:49,886 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44398': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:49,886 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44400': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:49,886 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:49,989 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:49,993 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44404': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:49,993 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:49,994 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44412': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:50,096 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:50,100 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44414': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:50,101 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:50,101 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44424': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:50,204 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:50,209 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44428': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:50,209 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:50,210 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44440': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:50,312 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:50,316 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44452': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:50,317 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:50,317 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44462': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:50,419 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:50,423 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44468': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:50,424 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:50,424 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44480': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:50,526 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:50,531 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44492': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:50,531 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44506': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:50,531 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:50,633 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:50,638 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44520': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:50,639 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:50,639 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44522': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:50,741 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:50,745 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44536': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:50,746 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44548': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:50,746 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:50,849 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:50,853 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44550': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:50,854 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44558': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:50,854 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:50,956 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:50,960 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44570': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:50,961 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44574': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:50,961 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:51,063 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:51,068 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44586': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:51,069 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44592': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:51,069 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:51,171 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:51,175 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44600': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:51,176 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44614': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:51,176 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:51,279 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:51,284 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44620': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:51,284 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:51,284 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44628': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:51,387 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:51,391 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44638': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:51,392 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44648': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:51,392 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:51,494 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:51,498 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44656': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:51,499 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:51,499 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44672': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:51,602 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:51,606 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47910': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:51,607 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:51,607 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47922': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:51,709 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:51,714 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47932': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:51,714 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47944': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:51,714 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:51,816 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:51,817 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47956': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:51,822 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:51,822 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47958': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:51,924 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:51,929 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47968': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:51,929 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:51,929 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47980': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:52,032 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:52,036 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:52,037 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:52,037 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47986': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:52,139 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:52,143 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47992': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:52,144 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:52,144 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47998': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:52,246 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:52,251 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48010': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:52,251 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48022': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:52,251 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:52,354 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:52,358 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48036': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:52,359 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:52,359 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48038': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:52,461 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:52,466 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48044': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:52,466 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48048': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:52,466 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:52,569 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:52,573 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48054': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:52,574 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:52,574 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48062': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:52,677 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:52,681 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48076': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:52,682 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48080': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:52,682 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:52,784 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:52,788 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48096': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:52,789 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48098': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:52,789 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:52,891 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:52,896 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48110': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:52,896 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:52,896 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48118': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:52,999 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:53,003 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:53,003 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:53,004 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48138': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:53,106 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:53,111 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48150': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:53,111 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:53,115 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48158': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:53,213 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:53,218 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48166': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:53,218 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:53,219 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48176': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:53,321 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:53,325 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48180': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:53,326 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48184': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:53,325 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:53,429 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:53,433 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48186': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:53,434 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48188': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:53,434 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:53,537 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:53,541 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48192': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:53,541 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:53,542 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48208': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:53,645 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:53,649 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48212': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:53,650 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48228': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:53,650 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:53,752 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:53,756 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48232': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:53,757 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48244': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:53,757 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:53,859 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:53,864 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48260': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:53,864 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:53,865 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48264': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:53,967 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:53,971 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48278': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:53,971 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:53,972 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48292': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:54,074 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:54,079 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48308': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:54,079 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:54,079 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48322': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:54,181 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:54,186 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48336': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:54,186 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48352': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:54,186 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:54,289 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:54,293 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48366': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:54,294 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:54,294 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48380': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:54,396 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:54,401 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48392': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:54,401 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48402': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:54,401 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:54,504 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:54,508 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48410': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:54,509 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:54,509 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48418': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:54,611 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:54,621 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48432': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:54,622 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48448': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:54,622 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:54,718 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:54,718 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48462': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:54,730 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:54,730 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48472': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:54,826 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:54,826 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48478': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:54,837 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:54,837 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48482': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:54,933 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:54,934 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48492': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:54,944 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:54,945 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48496': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:55,041 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:55,041 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48510': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:55,052 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:55,052 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48524': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:55,148 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:55,148 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48536': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:55,159 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:55,159 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48546': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:55,256 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:55,256 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48548': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:55,266 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:55,267 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48558': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:55,364 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:55,365 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48560': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:55,374 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:55,374 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48568': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:55,472 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:55,472 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48570': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:55,481 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:55,481 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48572': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:55,580 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:55,580 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48582': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:55,588 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:55,588 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48592': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:55,688 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:55,688 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48596': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:55,695 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:55,696 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48602': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:55,795 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:55,796 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48612': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:55,804 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:55,804 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48622': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:55,905 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:55,905 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48628': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:55,911 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:55,911 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48636': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:56,012 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:56,013 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48640': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:56,018 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:56,018 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48656': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:56,119 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:56,120 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48670': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:56,126 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:56,126 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48682': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:56,227 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:56,227 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48686': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:56,233 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:56,233 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48696': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:56,334 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:56,334 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48706': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:56,341 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:56,341 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48716': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:56,442 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:56,442 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48720': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:56,448 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:56,448 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48728': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:56,549 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:56,549 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48738': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:56,555 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:56,556 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48754': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:56,657 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:56,662 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48762': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:56,663 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:56,663 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48770': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:56,764 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:56,769 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48786': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:56,770 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:56,770 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:56,871 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:56,876 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48800': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:56,877 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:56,877 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48810': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:56,979 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:56,979 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48814': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:56,984 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:56,985 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48822': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:57,087 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:57,092 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48830': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:57,092 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:57,092 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48846': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:57,194 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:57,199 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48848': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:57,200 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48852': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:57,200 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:57,302 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:57,306 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48862': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:57,307 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:57,307 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48874': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:57,409 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:57,414 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48886': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:57,414 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48892': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:57,414 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:57,517 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:57,521 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48908': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:57,521 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:57,521 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48914': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:57,624 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:57,628 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48926': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:57,629 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:57,629 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48942': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:57,731 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:57,735 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48946': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:57,736 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48948': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:57,736 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:57,838 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:57,843 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48962': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:57,843 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48970': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:57,843 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:57,946 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:57,950 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48972': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:57,951 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48982': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:57,951 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:58,053 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:58,057 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48996': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:58,058 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:58,058 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:49002': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:58,161 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:58,166 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:49010': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:58,166 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:58,166 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:49012': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:58,268 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:58,273 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:49020': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:58,274 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:49030': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:58,273 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:58,376 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:58,380 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:49046': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:58,381 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:58,381 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:49050': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:58,484 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:58,488 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:49058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:58,489 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:58,489 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:49070': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:58,591 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:58,595 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:49084': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:58,596 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:58,596 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:49094': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:58,698 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:58,703 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:49106': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:58,703 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:58,704 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:49114': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:58,806 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:58,811 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:49126': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:58,812 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:58,812 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:49132': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:58,914 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:58,918 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:49148': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:58,919 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:49152': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:58,919 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:59,021 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:59,025 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:49162': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:59,026 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:59,026 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:49170': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:59,128 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:59,132 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:49184': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:59,133 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:49198': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:59,133 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:59,235 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:59,240 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:49202': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:59,240 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:49214': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:59,240 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:59,343 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:59,347 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:49218': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:59,348 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:59,348 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:49226': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:59,450 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:59,454 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:49240': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:59,455 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:59,455 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:49250': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:59,557 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:59,562 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:49254': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:59,562 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:49256': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:59,562 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:59,665 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:59,665 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:49260': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:59,670 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:59,670 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:49274': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:59,772 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:59,777 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:49286': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:59,778 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:59,778 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:49298': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:59,879 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:59,880 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:49312': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:59,885 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:59,885 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:49320': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:59,987 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:59,992 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:49336': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:32:59,992 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:32:59,993 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:49350': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:00,094 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:00,099 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:49366': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:00,100 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:00,100 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:49370': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:00,201 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:00,202 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:49386': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:00,207 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:00,207 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:49388': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:00,309 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:00,314 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:49404': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:00,314 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:00,315 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:49420': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:00,416 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:00,421 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:49424': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:00,422 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:00,422 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:49434': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:00,524 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:00,528 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:49444': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:00,529 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:00,529 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:49456': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:00,631 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:00,636 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:49466': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:00,636 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:00,636 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:49480': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:00,739 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:00,743 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:49482': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:00,744 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:00,744 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:49488': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:00,846 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:00,846 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:49498': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:00,851 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:00,852 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:49512': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:00,953 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:00,954 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:49520': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:00,960 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:00,960 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:49534': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:01,061 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:01,066 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:49542': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:01,067 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:01,067 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:49546': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:01,168 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:01,173 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:49562': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:01,174 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:01,174 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:49568': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:01,275 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:01,280 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:49578': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:01,281 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:01,281 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:49586': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:01,383 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:01,383 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:49594': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:01,389 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:01,389 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:49600': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:01,490 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:01,490 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:49606': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:01,496 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:01,496 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:49612': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:01,598 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:01,602 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55328': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:01,603 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:01,603 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55344': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:01,705 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:01,705 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55354': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:01,711 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:01,711 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55370': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:01,813 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:01,813 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55376': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:01,818 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:01,818 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55380': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:01,920 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:01,925 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55396': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:01,925 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:01,925 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55402': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:02,027 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:02,032 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55406': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:02,032 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:02,033 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55414': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:02,135 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:02,139 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55418': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:02,140 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55430': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:02,140 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:02,243 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:02,247 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55440': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:02,248 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:02,248 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55454': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:02,350 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:02,355 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55458': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:02,355 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:02,355 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55462': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:02,458 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:02,462 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55466': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:02,463 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:02,463 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55470': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:02,565 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:02,570 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55484': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:02,570 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55498': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:02,571 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:02,673 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:02,677 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55506': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:02,678 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:02,678 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55520': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:02,780 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:02,785 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55530': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:02,785 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:02,786 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55538': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:02,888 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:02,892 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55546': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:02,893 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55556': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:02,893 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:02,996 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:03,001 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55558': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:03,001 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55566': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:03,001 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:03,105 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:03,110 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55578': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:03,110 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:03,115 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55582': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:03,212 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:03,217 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55584': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:03,218 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:03,218 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55590': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:03,319 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:03,324 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55606': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:03,325 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:03,326 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55610': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:03,427 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:03,432 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55614': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:03,433 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:03,433 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55626': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:03,534 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:03,535 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55632': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:03,540 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:03,540 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55646': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:03,642 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:03,647 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55652': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:03,648 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:03,648 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55658': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:03,750 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:03,754 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55660': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:03,755 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55676': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:03,755 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:03,857 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:03,862 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55686': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:03,862 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:03,862 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55700': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:03,965 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:03,970 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55716': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:03,970 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:03,970 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55730': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:04,073 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:04,077 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55746': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:04,078 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55748': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:04,078 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:04,180 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:04,185 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55764': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:04,185 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:04,186 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55780': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:04,288 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:04,292 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55792': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:04,293 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55800': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:04,293 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:04,395 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:04,400 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55808': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:04,400 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:04,400 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55818': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:04,503 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:04,507 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55834': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:04,508 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:04,508 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55848': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:04,610 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:04,621 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55850': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:04,622 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:04,622 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55860': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:04,718 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:04,718 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55864': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:04,729 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:04,729 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55874': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:04,825 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:04,825 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55884': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:04,836 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:04,837 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55886': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:04,933 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:04,933 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55894': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:04,944 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:04,944 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55898': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:05,040 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:05,041 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55900': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:05,051 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:05,051 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55908': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:05,148 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:05,148 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55918': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:05,158 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:05,159 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55932': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:05,256 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:05,256 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55934': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:05,266 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:05,266 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55946': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:05,364 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:05,364 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55948': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:05,373 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:05,374 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55952': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:05,471 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:05,472 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55964': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:05,481 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:05,481 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55974': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:05,579 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:05,579 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55986': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:05,588 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:05,588 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55994': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:05,688 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:05,688 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55996': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:05,696 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:05,696 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56002': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:05,795 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:05,795 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56004': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:05,803 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:05,803 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56014': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:05,903 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:05,903 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56016': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:05,910 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:05,910 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56026': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:06,011 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:06,011 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56028': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:06,017 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:06,017 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56034': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:06,118 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:06,118 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56036': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:06,124 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:06,125 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56044': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:06,226 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:06,226 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56060': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:06,232 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:06,232 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56066': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:06,333 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:06,334 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56080': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:06,339 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:06,339 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56086': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:06,440 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:06,441 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56094': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:06,447 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:06,447 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56098': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:06,548 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:06,548 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56106': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:06,554 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:06,554 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56118': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:06,656 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:06,656 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56126': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:06,662 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:06,662 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56128': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:06,763 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:06,763 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56134': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:06,770 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:06,770 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56150': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:06,871 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:06,871 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56158': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:06,877 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:06,877 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56166': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:06,978 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:06,979 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56174': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:06,984 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:06,984 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56178': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:07,086 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:07,086 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56192': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:07,092 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:07,092 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56194': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:07,193 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:07,194 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56200': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:07,199 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:07,200 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56204': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:07,301 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:07,301 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56216': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:07,307 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:07,307 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56228': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:07,409 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:07,413 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56244': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:07,414 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56254': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:07,414 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:07,516 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:07,521 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56264': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:07,521 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56278': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:07,521 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:07,623 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:07,628 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56290': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:07,629 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:07,629 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56302': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:07,731 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:07,736 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56314': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:07,736 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:07,736 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56328': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:07,840 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:07,844 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56342': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:07,845 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:07,845 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56352': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:07,947 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:07,951 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56366': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:07,952 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:07,952 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56372': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:08,054 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:08,059 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56384': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:08,059 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:08,060 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56390': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:08,162 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:08,166 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56396': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:08,167 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:08,167 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56410': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:08,270 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:08,274 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56420': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:08,275 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:08,275 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56424': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:08,377 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:08,382 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56440': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:08,382 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:08,383 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56456': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:08,485 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:08,489 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56470': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:08,490 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56482': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:08,490 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:08,592 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:08,597 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56484': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:08,597 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56500': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:08,597 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:08,700 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:08,704 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56504': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:08,705 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:08,705 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56520': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:08,808 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:08,812 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56528': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:08,813 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56542': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:08,813 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:08,915 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:08,919 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56556': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:08,920 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:08,920 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56566': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:09,022 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:09,027 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56576': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:09,027 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:09,027 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56590': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:09,130 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:09,135 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56598': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:09,135 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:09,135 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56610': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:09,238 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:09,242 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56624': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:09,243 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:09,243 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56626': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:09,345 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:09,350 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56632': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:09,350 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56640': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:09,350 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:09,453 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:09,458 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56642': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:09,458 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:09,459 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56658': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:09,561 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:09,565 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56668': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:09,566 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:09,566 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56684': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:09,668 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:09,673 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56688': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:09,673 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:09,673 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56702': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:09,776 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:09,780 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56706': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:09,781 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56710': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:09,781 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:09,884 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:09,888 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56716': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:09,889 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56722': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:09,888 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:09,991 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:09,995 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56726': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:09,996 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:09,996 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56736': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:10,099 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:10,103 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56750': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:10,103 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:10,104 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56754': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:10,206 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:10,211 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56760': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:10,211 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:10,212 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56762': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:10,314 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:10,318 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56766': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:10,319 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:10,319 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56780': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:10,421 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:10,425 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56792': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:10,426 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:10,426 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56806': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:10,529 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:10,533 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56822': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:10,534 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56830': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:10,534 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:10,636 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:10,640 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56834': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:10,641 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:10,641 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56838': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:10,743 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:10,748 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56844': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:10,748 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56846': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:10,748 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:10,851 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:10,856 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56856': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:10,857 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56864': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:10,857 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:10,959 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:10,964 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56880': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:10,964 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56882': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:10,964 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:11,067 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:11,071 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56884': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:11,071 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:11,072 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56890': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:11,174 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:11,179 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56892': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:11,179 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:11,180 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56902': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:11,282 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:11,286 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56910': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:11,287 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56918': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:11,287 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:11,389 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:11,393 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56932': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:11,394 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:11,394 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56938': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:11,496 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:11,501 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56952': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:11,501 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:11,501 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56964': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:11,604 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:11,609 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:35704': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:11,609 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:11,614 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:35716': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:11,711 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:11,716 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:35720': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:11,717 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:11,717 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:35722': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:11,819 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:11,823 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:35736': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:11,824 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:35744': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:11,824 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:11,926 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:11,931 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:35746': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:11,931 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:11,931 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:35758': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:12,034 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:12,038 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:35764': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:12,039 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:12,039 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:35772': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:12,141 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:12,146 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:35782': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:12,146 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:35792': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:12,146 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:12,249 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:12,253 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:35808': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:12,254 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:35820': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:12,254 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:12,357 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:12,361 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:35832': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:12,362 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:12,363 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:35848': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:12,464 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:12,469 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:35860': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:12,469 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:12,470 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:35864': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:12,573 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:12,577 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:35876': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:12,578 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:35882': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:12,577 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:12,681 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:12,686 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:35894': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:12,686 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:12,686 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:35900': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:12,789 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:12,793 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:35904': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:12,794 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:12,794 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:35908': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:12,896 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:12,901 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:35912': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:12,901 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:35926': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:12,901 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:13,004 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:13,008 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:35930': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:13,009 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:13,009 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:35936': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:13,111 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:13,120 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:35944': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:13,121 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:35950': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:13,121 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:13,219 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:13,219 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:35966': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:13,228 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:13,228 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:35974': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:13,327 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:13,327 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:35988': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:13,335 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:13,336 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:35996': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:13,434 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:13,434 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36000': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:13,443 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:13,443 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36010': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:13,542 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:13,542 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36012': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:13,550 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:13,550 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36022': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:13,649 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:13,650 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36036': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:13,657 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:13,657 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36052': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:13,757 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:13,757 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:13,765 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:13,765 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36070': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:13,864 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:13,864 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36072': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:13,872 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:13,872 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36078': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:13,972 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:13,972 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36084': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:13,978 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:13,979 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36086': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:14,080 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:14,080 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36088': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:14,086 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:14,086 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36104': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:14,187 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:14,188 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36118': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:14,194 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:14,194 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36124': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:14,296 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:14,296 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36132': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:14,302 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:14,302 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36136': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:14,404 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:14,404 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36142': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:14,409 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:14,410 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36150': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:14,511 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:14,511 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36156': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:14,517 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:14,517 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36166': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:14,620 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:14,624 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36172': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:14,625 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:14,625 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36186': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:14,727 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:14,732 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36190': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:14,732 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:14,732 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36194': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:14,835 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:14,839 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36210': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:14,840 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36216': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:14,840 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:14,943 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:14,947 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36218': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:14,947 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:14,948 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36226': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:15,050 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:15,055 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36238': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:15,055 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36250': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:15,055 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:15,158 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:15,162 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36256': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:15,163 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:15,163 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36268': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:15,265 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:15,269 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36284': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:15,270 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:15,270 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36294': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:15,372 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:15,376 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36304': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:15,377 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36318': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:15,377 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:15,480 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:15,484 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36326': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:15,485 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:15,485 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36334': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:15,587 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:15,592 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36342': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:15,592 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:15,592 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36358': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:15,695 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:15,699 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36362': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:15,700 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:15,700 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36370': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:15,802 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:15,807 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36386': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:15,807 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:15,808 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36398': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:15,910 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:15,915 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36400': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:15,915 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36414': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:15,915 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:16,018 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:16,023 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36422': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:16,023 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:16,023 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36424': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:16,126 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:16,130 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36426': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:16,131 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:16,131 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36438': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:16,233 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:16,238 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36450': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:16,238 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:16,238 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36458': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:16,340 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:16,345 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36470': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:16,345 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36478': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:16,345 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:16,448 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:16,452 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36480': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:16,453 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:16,453 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36488': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:16,555 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:16,560 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36500': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:16,560 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:16,560 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36502': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:16,662 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:16,667 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36516': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:16,668 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36524': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:16,667 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:16,770 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:16,775 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36540': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:16,775 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:16,776 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36548': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:16,878 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:16,882 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36560': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:16,883 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36572': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:16,883 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:16,985 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:16,990 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36574': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:16,990 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:16,991 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36588': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:17,093 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:17,097 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36594': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:17,098 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:17,098 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36606': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:17,200 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:17,200 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36612': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:17,205 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:17,205 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36628': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:17,307 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:17,307 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36642': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:17,313 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:17,313 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36658': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:17,415 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:17,415 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36662': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:17,421 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:17,421 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36672': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:17,523 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:17,523 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36678': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:17,529 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:17,530 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36690': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:17,631 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:17,631 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36698': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:17,637 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:17,637 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36710': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:17,739 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:17,744 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36720': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:17,745 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:17,745 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36730': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:17,846 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:17,851 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36738': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:17,852 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:17,852 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36750': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:17,954 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:17,958 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36752': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:17,959 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:17,959 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36760': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:18,061 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:18,066 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36772': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:18,066 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:18,066 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36774': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:18,168 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:18,173 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36778': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:18,174 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:18,174 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36780': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:18,275 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:18,280 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36782': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:18,281 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:18,281 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36798': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:18,383 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:18,388 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36802': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:18,388 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:18,389 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36818': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:18,491 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:18,495 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36822': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:18,496 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:18,496 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36834': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:18,598 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:18,603 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36850': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:18,603 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:18,603 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36858': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:18,706 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:18,711 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36860': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:18,711 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:18,711 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36862': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:18,814 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:18,818 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36864': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:18,819 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:18,819 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36880': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:18,921 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:18,926 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36888': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:18,926 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:18,926 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36900': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:19,029 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:19,033 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36916': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:19,034 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36928': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:19,034 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:19,136 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:19,141 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36938': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:19,141 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:19,141 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36940': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:19,244 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:19,248 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36942': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:19,249 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36954': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:19,249 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:19,352 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:19,356 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36960': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:19,357 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:19,357 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36976': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:19,460 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:19,464 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36978': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:19,465 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36990': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:19,465 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:19,568 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:19,573 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36992': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:19,574 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:37004': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:19,574 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:19,675 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:19,676 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:37016': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:19,682 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:19,682 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:37032': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:19,783 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:19,784 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:37034': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:19,789 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:19,789 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:37036': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:19,891 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:19,896 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:37050': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:19,896 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:19,897 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:37052': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:19,998 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:20,003 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:37058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:20,004 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:20,004 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:37072': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:20,105 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:20,110 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:37078': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:20,111 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:20,115 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:37088': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:20,213 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:20,213 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:37104': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:20,219 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:20,219 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:37118': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:20,321 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:20,321 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:37120': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:20,327 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:20,327 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:37132': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:20,428 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:20,428 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:37138': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:20,434 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:20,434 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:37150': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:20,536 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:20,536 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:37156': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:20,542 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:20,542 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:37166': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:20,643 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:20,643 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:37174': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:20,649 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:20,649 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:37176': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:20,751 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:20,751 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:37190': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:20,757 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:20,757 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:37204': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:20,858 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:20,858 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:37206': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:20,865 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:20,865 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:37218': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:20,966 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:20,966 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:37230': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:20,972 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:20,972 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:37246': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:21,074 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:21,074 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:37254': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:21,080 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:21,080 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:37268': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:21,182 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:21,182 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:37272': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:21,188 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:21,188 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:37278': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:21,290 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:21,290 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:37290': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:21,295 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:21,296 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:37300': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:21,397 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:21,402 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:37306': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:21,403 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:21,403 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:37316': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:21,505 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:21,510 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:37318': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:21,510 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:21,510 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:37320': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:21,612 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:21,621 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47720': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:21,623 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:21,623 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47736': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:21,720 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:21,720 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47744': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:21,730 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:21,730 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47760': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:21,828 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:21,828 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47764': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:21,837 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:21,837 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47772': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:21,935 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:21,935 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47784': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:21,944 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:21,945 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47800': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:22,043 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:22,043 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47806': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:22,052 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:22,052 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47816': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:22,151 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:22,151 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47824': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:22,159 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:22,159 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47838': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:22,259 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:22,259 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47842': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:22,266 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:22,266 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47844': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:22,368 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:22,368 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47846': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:22,375 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:22,375 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47862': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:22,475 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:22,476 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47870': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:22,482 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:22,483 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47878': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:22,583 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:22,583 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47882': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:22,590 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:22,590 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47890': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:22,691 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:22,696 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47894': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:22,697 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:22,697 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47910': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:22,799 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:22,803 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47922': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:22,804 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:22,804 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47924': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:22,907 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:22,912 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47930': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:22,912 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:22,912 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47934': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:23,014 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:23,019 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47942': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:23,019 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:23,019 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47944': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:23,122 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:23,126 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47958': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:23,127 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47964': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:23,127 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:23,229 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:23,234 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47974': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:23,234 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:23,235 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:23,337 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:23,341 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47998': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:23,342 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48006': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:23,342 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:23,444 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48010': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:23,444 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:23,451 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48026': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:23,451 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:23,552 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:23,552 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48034': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:23,559 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48038': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:23,559 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:23,660 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:23,660 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48044': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:23,668 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48046': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:23,668 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:23,768 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:23,768 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48052': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:23,777 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48064': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:23,777 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:23,875 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:23,876 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48070': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:23,886 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48078': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:23,886 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:23,983 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:23,983 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48092': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:23,994 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:23,994 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48098': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:24,091 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:24,091 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48102': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:24,100 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:24,101 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48118': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:24,198 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:24,199 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:24,208 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:24,208 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48126': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:24,306 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:24,306 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48138': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:24,315 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:24,315 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48142': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:24,414 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:24,414 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48144': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:24,422 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:24,422 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48152': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:24,521 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:24,521 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48158': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:24,529 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:24,529 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48170': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:24,630 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:24,630 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48178': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:24,636 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:24,636 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48186': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:24,737 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:24,737 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48188': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:24,743 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:24,744 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48190': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:24,845 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:24,845 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48202': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:24,851 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:24,851 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48208': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:24,952 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:24,953 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48218': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:24,959 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:24,959 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48224': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:25,060 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:25,060 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48232': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:25,066 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:25,066 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48238': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:25,167 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:25,168 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48248': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:25,174 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:25,174 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48262': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:25,275 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:25,275 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48266': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:25,281 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:25,281 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48276': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:25,383 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:25,383 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48292': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:25,389 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:25,389 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48296': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:25,490 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:25,495 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48300': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:25,496 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:25,496 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48314': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:25,598 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:25,603 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48318': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:25,603 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:25,603 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48326': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:25,705 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:25,705 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48336': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:25,711 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:25,711 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48346': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:25,813 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:25,813 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48354': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:25,818 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:25,819 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48360': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:25,920 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:25,925 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48370': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:25,925 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:25,926 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48384': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:26,027 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:26,032 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48388': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:26,032 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:26,032 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48390': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:26,134 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:26,139 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48402': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:26,139 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:26,140 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48410': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:26,242 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:26,246 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48426': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:26,247 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:26,247 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48428': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:26,350 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:26,354 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48432': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:26,355 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48438': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:26,355 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:26,457 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:26,462 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48442': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:26,462 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:26,462 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48452': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:26,565 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:26,569 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48468': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:26,570 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:26,570 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48474': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:26,672 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:26,677 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48490': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:26,677 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:26,677 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48500': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:26,780 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:26,784 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48516': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:26,785 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:26,785 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48526': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:26,887 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:26,892 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48542': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:26,892 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48554': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:26,892 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:26,995 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:26,999 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48570': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:27,000 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48580': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:27,000 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:27,102 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:27,107 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48596': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:27,107 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:27,111 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48606': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:27,211 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:27,215 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48614': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:27,216 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:27,216 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48630': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:27,318 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:27,323 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48642': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:27,323 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48658': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:27,323 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:27,426 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:27,430 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48660': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:27,431 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:27,431 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48676': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:27,533 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:27,538 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48678': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:27,538 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:27,539 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48692': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:27,641 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:27,646 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48698': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:27,646 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:27,646 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48702': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:27,748 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:27,753 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48718': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:27,754 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:27,754 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48726': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:27,856 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:27,860 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48730': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:27,861 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:27,861 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48734': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:27,963 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:27,968 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48746': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:27,968 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48758': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:27,968 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:28,072 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:28,076 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48762': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:28,077 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48774': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:28,077 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:28,179 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:28,184 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48782': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:28,184 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:28,184 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48792': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:28,287 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:28,291 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48802': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:28,292 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:28,292 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48818': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:28,394 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:28,399 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48828': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:28,399 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:28,399 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48832': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:28,502 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:28,506 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48840': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:28,507 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:28,507 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48846': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:28,609 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:28,618 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48856': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:28,619 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48862': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:28,619 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:28,717 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:28,717 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48874': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:28,726 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:28,726 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48878': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:28,824 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:28,824 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48894': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:28,833 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:28,833 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48904': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:28,932 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:28,932 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48908': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:28,940 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:28,941 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48914': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:29,039 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:29,039 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48924': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:29,048 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:29,048 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48926': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:29,146 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:29,147 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48928': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:29,155 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:29,155 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48940': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:29,254 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:29,254 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48954': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:29,262 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:29,262 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48970': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:29,362 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:29,362 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48980': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:29,369 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:29,369 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48996': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:29,469 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:29,469 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:49004': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:29,476 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:29,476 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:49008': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:29,577 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:29,577 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:49010': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:29,585 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:29,585 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:49026': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:29,685 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:29,685 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:49028': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:29,692 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:29,692 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:49044': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:29,793 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:29,793 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:49056': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:29,800 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:29,800 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:49060': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:29,901 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:29,901 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:49064': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:29,907 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:29,907 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:49066': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:30,008 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:30,009 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:49068': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:30,014 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:30,014 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:49084': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:30,117 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:30,122 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:49088': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:30,122 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:30,122 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:49098': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:30,224 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:30,229 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:49114': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:30,229 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:30,229 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:49128': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:30,332 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:30,336 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:49132': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:30,337 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:49134': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:30,337 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:30,439 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:30,444 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:49142': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:30,444 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:30,444 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:49148': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:30,546 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:30,551 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:49150': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:30,551 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:49164': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:30,551 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:30,654 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:30,658 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:49172': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:30,659 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:30,659 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:49186': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:30,762 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:30,766 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:49190': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:30,766 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:30,767 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:49198': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:30,869 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:30,874 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:49202': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:30,874 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:30,874 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:49204': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:30,977 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:30,981 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:49206': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:30,981 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:49222': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:30,981 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:31,084 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:31,088 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:49230': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:31,089 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:31,089 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:49242': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:31,191 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:31,196 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:49246': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:31,196 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:31,196 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:49256': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:31,299 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:31,303 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:49270': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:31,304 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:31,304 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:49276': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:31,406 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:31,411 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:49286': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:31,411 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:31,411 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:49296': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:31,514 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:31,519 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:49310': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:31,519 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:49316': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:31,519 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:31,621 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:31,626 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56896': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:31,626 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56900': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:31,626 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:31,729 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:31,733 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56910': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:31,734 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56918': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:31,734 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:31,836 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:31,840 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56920': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:31,841 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:31,841 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56936': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:31,943 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:31,948 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56946': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:31,948 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56962': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:31,948 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:32,052 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:32,056 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56974': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:32,057 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56976': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:32,057 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:32,159 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:32,164 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56988': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:32,164 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:32,165 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56994': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:32,267 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:32,271 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57010': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:32,271 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:32,271 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57012': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:32,374 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:32,379 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57022': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:32,379 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:32,379 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57030': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:32,481 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:32,486 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57040': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:32,486 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57052': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:32,486 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:32,589 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:32,593 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57062': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:32,594 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:32,594 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57068': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:32,696 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:32,701 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57078': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:32,701 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:32,701 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57088': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:32,804 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:32,808 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57104': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:32,808 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:32,809 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57114': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:32,911 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:32,916 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57126': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:32,916 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:32,916 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57130': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:33,019 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:33,023 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57138': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:33,024 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57146': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:33,024 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:33,127 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:33,131 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57148': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:33,131 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57152': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:33,132 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:33,235 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:33,239 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57162': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:33,240 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:33,240 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57168': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:33,342 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:33,347 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57182': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:33,347 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57186': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:33,347 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:33,449 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:33,454 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57200': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:33,454 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:33,454 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57214': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:33,557 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:33,561 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57218': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:33,562 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:33,562 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57228': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:33,664 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:33,669 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57230': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:33,669 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:33,669 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57240': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:33,771 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:33,776 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57252': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:33,777 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57264': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:33,777 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:33,879 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:33,883 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57278': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:33,884 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:33,884 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57286': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:33,986 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:33,990 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57300': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:33,991 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:33,991 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57306': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:34,093 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:34,098 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57316': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:34,098 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:34,098 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57330': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:34,201 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:34,205 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57332': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:34,206 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:34,206 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57336': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:34,308 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:34,312 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57340': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:34,313 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:34,313 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57346': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:34,415 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:34,420 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57352': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:34,420 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:34,420 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57366': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:34,523 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:34,527 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57370': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:34,528 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:34,528 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57380': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:34,630 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:34,634 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57382': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:34,635 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57388': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:34,635 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:34,738 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:34,742 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57404': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:34,742 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:34,742 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57406': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:34,845 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:34,849 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57420': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:34,850 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57424': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:34,850 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:34,953 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:34,958 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57438': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:34,958 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:34,958 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57452': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:35,061 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:35,065 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57458': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:35,066 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57464': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:35,066 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:35,168 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:35,172 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57476': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:35,173 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:35,173 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57492': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:35,275 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:35,280 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57496': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:35,280 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:35,280 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57502': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:35,383 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:35,387 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57514': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:35,387 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:35,388 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57528': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:35,490 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:35,495 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57538': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:35,495 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:35,495 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57552': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:35,598 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:35,602 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57554': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:35,603 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:35,603 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57564': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:35,705 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:35,710 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57568': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:35,710 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:35,711 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57582': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:35,813 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:35,818 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57594': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:35,818 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:35,818 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57606': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:35,920 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:35,925 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57618': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:35,926 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:35,926 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57626': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:36,028 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:36,033 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57638': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:36,033 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57654': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:36,033 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:36,136 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:36,140 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57668': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:36,141 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:36,141 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57670': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:36,243 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:36,248 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57678': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:36,248 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57692': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:36,248 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:36,351 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:36,355 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57702': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:36,356 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:36,356 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57712': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:36,458 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:36,463 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57728': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:36,463 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:36,463 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57734': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:36,565 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:36,570 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57744': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:36,570 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:36,570 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57754': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:36,674 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:36,678 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57764': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:36,679 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57780': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:36,679 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:36,781 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:36,786 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57788': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:36,786 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:36,786 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57792': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:36,890 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:36,895 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57804': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:36,895 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:36,895 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57816': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:36,998 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:37,002 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57824': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:37,003 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:37,003 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57828': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:37,106 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:37,110 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57844': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:37,111 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:37,116 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57860': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:37,213 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:37,218 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57864': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:37,218 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:37,218 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57872': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:37,321 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:37,325 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57886': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:37,326 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57892': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:37,326 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:37,428 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:37,433 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57904': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:37,433 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:37,433 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57920': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:37,536 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:37,540 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57932': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:37,541 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57936': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:37,541 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:37,643 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:37,648 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57944': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:37,648 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:37,648 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57950': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:37,750 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:37,755 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57952': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:37,755 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:37,756 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57962': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:37,858 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:37,863 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57972': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:37,863 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:37,864 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57974': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:37,966 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:37,966 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57986': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:37,972 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:37,972 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57998': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:38,073 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:38,078 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58008': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:38,079 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:38,079 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58020': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:38,181 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:38,186 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58034': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:38,186 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58046': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:38,186 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:38,289 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:38,293 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58056': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:38,294 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:38,294 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58066': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:38,397 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:38,402 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58070': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:38,402 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:38,402 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58084': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:38,505 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:38,509 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58092': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:38,509 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:38,510 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58100': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:38,612 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:38,621 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58108': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:38,622 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:38,622 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58120': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:38,720 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:38,720 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58134': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:38,729 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:38,729 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58140': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:38,827 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:38,828 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58156': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:38,837 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:38,837 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58170': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:38,935 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:38,935 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58182': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:38,944 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:38,945 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58186': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:39,043 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:39,043 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58196': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:39,052 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:39,052 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58210': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:39,150 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:39,150 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58218': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:39,159 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:39,159 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58220': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:39,258 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:39,258 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58236': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:39,267 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:39,267 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58250': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:39,366 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:39,366 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58254': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:39,374 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:39,374 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58262': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:39,473 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:39,474 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58264': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:39,481 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:39,481 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58280': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:39,581 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:39,581 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58296': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:39,590 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:39,590 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58300': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:39,689 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:39,689 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58316': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:39,697 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:39,697 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58320': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:39,796 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:39,796 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58336': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:39,804 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:39,804 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58338': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:39,904 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:39,904 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58342': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:39,912 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:39,912 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58354': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:40,011 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:40,012 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58364': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:40,019 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:40,019 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58376': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:40,119 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:40,119 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58382': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:40,126 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:40,126 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58394': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:40,227 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:40,227 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58402': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:40,234 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:40,234 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58418': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:40,335 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:40,335 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58434': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:40,341 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:40,341 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58440': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:40,443 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:40,448 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58442': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:40,449 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:40,449 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58446': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:40,550 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:40,555 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58462': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:40,556 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:40,556 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58464': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:40,658 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:40,662 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58476': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:40,663 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58492': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:40,663 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:40,766 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:40,770 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58506': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:40,770 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58514': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:40,770 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:40,873 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:40,877 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58516': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:40,878 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58530': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:40,878 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:40,981 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:40,985 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58532': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:40,986 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58548': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:40,986 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:41,088 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:41,093 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58550': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:41,093 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:41,093 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58566': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:41,196 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:41,200 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58582': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:41,201 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:41,201 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58584': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:41,303 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:41,308 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58590': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:41,308 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:41,309 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58592': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:41,411 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:41,415 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58606': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:41,416 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:41,416 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58608': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:41,519 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:41,523 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58616': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:41,524 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58622': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:41,524 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:41,626 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:41,630 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:37696': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:41,631 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:41,631 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:37712': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:41,735 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:41,739 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:37720': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:41,740 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:37728': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:41,740 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:41,843 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:41,847 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:37738': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:41,848 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:41,848 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:37748': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:41,950 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:41,955 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:37762': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:41,955 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:37764': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:41,955 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:42,058 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:42,062 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:37772': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:42,063 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:42,063 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:37786': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:42,166 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:42,170 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:37794': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:42,170 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:42,171 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:37804': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:42,273 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:42,277 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:37814': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:42,278 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:37818': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:42,278 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:42,381 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:42,385 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:37832': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:42,385 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:42,386 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:37842': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:42,488 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:42,492 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:37856': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:42,493 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:42,493 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:37860': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:42,596 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:42,600 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:37862': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:42,600 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:42,600 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:37868': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:42,703 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:42,707 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:37880': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:42,708 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:42,708 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:37888': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:42,810 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:42,815 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:37896': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:42,815 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:42,815 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:37904': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:42,918 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:42,922 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:37910': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:42,923 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:37924': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:42,923 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:43,025 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:43,030 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:37938': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:43,030 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:43,030 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:37944': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:43,133 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:43,137 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:37960': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:43,138 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:43,138 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:37968': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:43,241 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:43,245 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:37974': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:43,245 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:43,246 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:37976': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:43,348 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:43,352 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:37982': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:43,353 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:43,353 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:37984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:43,455 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:43,460 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:37990': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:43,461 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:43,461 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:37994': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:43,564 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:43,568 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:38002': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:43,569 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:43,569 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:38008': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:43,672 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:43,676 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:38010': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:43,677 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:43,677 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:38016': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:43,779 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:43,783 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:38030': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:43,784 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:38032': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:43,784 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:43,886 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:43,891 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:38042': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:43,891 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:43,892 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:38056': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:43,994 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:43,998 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:38072': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:43,999 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:43,999 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:38086': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:44,102 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:44,107 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:38098': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:44,107 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:44,108 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:38108': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:44,209 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:44,214 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:38116': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:44,214 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:44,215 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:38122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:44,316 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:44,321 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:38134': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:44,322 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:44,322 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:38140': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:44,423 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:44,428 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:38152': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:44,429 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:44,429 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:38168': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:44,531 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:44,531 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:38172': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:44,537 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:44,537 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:38176': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:44,638 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:44,643 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:38180': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:44,644 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:44,644 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:38184': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:44,746 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:44,746 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:38186': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:44,752 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:44,752 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:38190': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:44,853 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:44,858 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:38200': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:44,859 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:44,859 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:38214': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:44,961 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:44,965 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:38226': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:44,966 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:44,966 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:38238': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:45,068 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:45,068 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:38254': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:45,074 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:45,074 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:38260': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:45,175 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:45,180 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:38264': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:45,181 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:45,181 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:38268': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:45,284 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:45,288 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:38276': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:45,289 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:45,289 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:38278': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:45,391 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:45,396 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:38290': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:45,396 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:45,396 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:38292': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:45,498 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:45,503 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:38296': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:45,503 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:38306': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:45,503 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:45,606 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:45,610 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:38314': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:45,611 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:45,615 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:38320': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:45,713 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:45,718 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:38328': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:45,718 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:38336': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:45,718 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:45,820 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:45,825 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:38352': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:45,825 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:45,826 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:38368': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:45,928 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:45,932 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:38374': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:45,933 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:45,933 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:38378': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:46,035 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:46,039 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:38388': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:46,040 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:38404': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:46,040 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:46,142 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:46,147 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:38414': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:46,147 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:46,147 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:38426': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:46,249 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:46,254 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:38432': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:46,255 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:38442': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:46,255 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:46,357 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:46,362 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:38454': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:46,362 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:46,362 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:38456': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:46,464 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:46,469 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:38462': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:46,469 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:38470': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:46,469 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:46,573 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:46,577 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:38486': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:46,578 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:46,578 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:38494': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:46,680 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:46,685 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:38510': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:46,686 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:38524': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:46,686 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:46,788 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:46,792 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:38528': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:46,793 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:46,793 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:38536': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:46,895 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:46,900 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:38546': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:46,900 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:38560': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:46,900 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:47,004 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:47,008 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:38572': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:47,009 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:47,009 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:38582': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:47,111 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:47,120 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:38596': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:47,121 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:38606': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:47,121 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:47,218 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:47,219 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:38608': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:47,228 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:47,228 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:38614': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:47,326 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:47,326 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:38616': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:47,335 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:47,335 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:38630': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:47,433 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:47,433 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:38640': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:47,443 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:47,443 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:38648': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:47,541 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:47,542 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:38656': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:47,550 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:47,550 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:38660': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:47,649 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:47,649 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:38674': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:47,658 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:47,658 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:38680': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:47,756 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:47,757 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:38690': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:47,765 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:47,765 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:38696': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:47,864 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:47,864 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:38710': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:47,872 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:47,872 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:38716': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:47,971 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:47,971 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:38720': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:47,979 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:47,980 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:38726': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:48,078 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:48,079 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:38740': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:48,087 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:48,087 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:38744': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:48,186 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:48,186 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:38746': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:48,194 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:48,194 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:38760': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:48,293 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:48,293 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:38766': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:48,301 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:48,301 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:38774': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:48,401 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:48,401 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:38782': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:48,408 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:48,408 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:38788': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:48,508 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:48,508 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:38792': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:48,516 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:48,516 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:38796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:48,617 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:48,622 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:38808': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:48,623 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:48,623 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:38820': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:48,725 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:48,729 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:38832': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:48,730 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:38840': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:48,730 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:48,833 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:48,837 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:38844': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:48,838 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:38858': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:48,838 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:48,940 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:48,945 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:38866': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:48,945 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:48,946 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:38878': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:49,048 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:49,052 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:38888': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:49,053 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:49,053 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:38890': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:49,155 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:49,159 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:38904': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:49,160 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:38914': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:49,160 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:49,262 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:49,266 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:38922': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:49,267 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:38924': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:49,267 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:49,370 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:49,374 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:38930': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:49,375 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:38936': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:49,375 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:49,477 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:49,481 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:38946': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:49,482 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:38954': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:49,482 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:49,584 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:49,590 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:38956': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:49,591 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:38970': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:49,591 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:49,691 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:49,691 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:38976': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:49,698 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:49,698 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:38992': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:49,798 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:49,798 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:39008': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:49,805 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:39012': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:49,805 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:49,905 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:39016': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:49,905 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:49,912 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:39020': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:49,912 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:50,013 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:39034': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:50,013 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:50,019 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:39050': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:50,019 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:50,120 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:39054': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:50,120 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:50,125 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:39070': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:50,125 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:50,227 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:50,227 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:39076': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:50,232 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:39088': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:50,232 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:50,334 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:39094': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:50,334 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:50,340 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:39096': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:50,340 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:50,442 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:50,446 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:39102': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:50,447 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:39110': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:50,447 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:50,549 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:50,553 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:39120': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:50,554 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:39122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:50,554 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:50,656 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:50,660 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:39124': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:50,661 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:39138': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:50,661 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:50,763 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:50,767 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:39150': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:50,768 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:39162': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:50,768 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:50,870 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:50,874 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:39174': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:50,875 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:39186': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:50,875 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:50,977 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:50,981 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:39190': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:50,981 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:39196': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:50,981 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:51,084 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:51,088 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:39208': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:51,089 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:39218': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:51,089 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:51,191 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:51,195 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:39224': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:51,196 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:39240': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:51,196 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:51,299 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:51,302 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:39248': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:51,303 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:39262': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:51,303 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:51,407 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:51,410 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:39278': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:51,411 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:39282': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:51,411 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:51,514 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:51,518 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:39284': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:51,519 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:39300': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:51,519 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:51,621 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:51,625 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44764': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:51,625 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44778': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:51,625 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:51,728 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:51,732 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44790': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:51,732 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44798': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:51,732 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:51,835 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:51,839 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44808': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:51,840 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44822': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:51,840 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:51,942 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:51,942 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44830': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:51,947 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:51,948 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44838': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:52,049 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44854': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:52,049 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:52,054 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44866': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:52,054 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:52,157 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:52,161 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44876': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:52,162 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44888': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:52,162 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:52,265 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:52,268 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44894': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:52,269 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44904': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:52,269 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:52,372 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:52,376 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44914': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:52,376 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44930': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:52,376 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:52,479 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:52,483 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44942': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:52,484 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44950': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:52,484 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:52,586 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:52,590 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44958': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:52,591 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:52,591 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44972': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:52,694 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:52,697 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44978': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:52,698 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44986': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:52,698 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:52,801 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:52,805 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44994': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:52,805 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44998': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:52,805 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:52,908 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:52,912 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45004': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:52,913 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45006': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:52,913 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:53,015 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:53,019 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45016': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:53,020 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45020': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:53,020 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:53,123 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:53,127 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45032': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:53,129 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:53,129 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45034': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:53,230 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45044': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:53,230 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:53,236 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45046': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:53,236 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:53,337 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45056': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:53,337 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:53,343 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45062': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:53,343 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:53,445 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45066': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:53,445 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:53,450 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45068': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:53,450 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:53,552 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:53,552 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45074': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:53,557 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45082': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:53,557 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:53,659 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:53,659 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45084': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:53,664 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45100': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:53,664 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:53,766 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45112': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:53,766 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:53,771 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45120': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:53,771 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:53,874 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:53,877 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45126': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:53,878 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45140': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:53,878 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:53,981 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:53,984 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45144': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:53,985 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45160': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:53,985 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:54,088 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:54,091 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45170': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:54,092 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45184': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:54,092 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:54,195 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:54,199 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45186': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:54,199 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45192': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:54,199 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:54,302 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:54,306 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45196': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:54,306 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45200': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:54,306 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:54,409 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:54,413 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45204': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:54,414 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45214': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:54,414 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:54,516 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:54,520 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45216': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:54,520 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45220': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:54,520 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:54,623 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:54,627 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45222': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:54,628 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45236': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:54,628 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:54,730 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:54,734 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45242': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:54,735 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45250': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:54,735 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:54,838 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:54,841 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45266': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:54,842 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45278': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:54,842 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:54,945 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:54,948 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45284': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:54,949 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45286': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:54,949 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:55,052 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:55,056 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45300': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:55,056 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45304': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:55,056 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:55,159 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:55,163 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45308': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:55,163 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45310': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:55,163 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:55,266 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:55,270 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45316': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:55,270 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45326': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:55,270 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:55,373 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:55,377 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45334': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:55,377 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45342': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:55,377 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:55,480 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:55,484 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45346': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:55,485 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45354': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:55,485 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:55,588 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:55,592 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45358': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:55,593 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45364': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:55,593 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:55,695 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:55,699 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45378': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:55,700 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45386': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:55,700 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:55,803 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:55,806 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45402': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:55,807 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45410': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:55,807 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:55,910 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:55,914 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45424': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:55,914 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45440': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:55,914 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:56,017 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:56,021 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45452': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:56,021 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45462': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:56,022 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:56,124 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:56,128 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45478': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:56,128 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45488': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:56,128 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:56,232 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:56,236 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45492': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:56,236 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45494': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:56,237 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:56,339 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:56,343 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45510': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:56,343 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45526': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:56,343 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:56,446 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:56,450 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45538': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:56,451 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45544': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:56,451 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:56,553 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:56,557 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45558': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:56,557 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45564': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:56,557 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:56,660 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:56,664 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45578': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:56,664 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45592': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:56,664 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:56,767 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:56,771 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45598': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:56,771 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45602': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:56,771 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:56,874 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:56,878 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45606': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:56,878 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45616': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:56,878 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:56,981 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:56,985 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45620': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:56,985 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45622': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:56,985 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:57,088 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:57,092 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45636': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:57,093 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45640': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:57,093 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:57,195 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:57,199 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45654': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:57,200 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45662': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:57,200 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:57,303 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:57,307 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45664': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:57,308 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45674': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:57,308 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:57,410 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:57,414 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45690': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:57,415 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45706': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:57,415 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:57,517 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:57,521 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45708': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:57,522 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45714': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:57,522 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:57,624 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:57,628 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45716': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:57,629 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45732': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:57,629 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:57,731 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:57,735 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45748': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:57,736 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45756': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:57,736 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:57,838 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:57,842 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45766': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:57,842 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45770': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:57,843 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:57,945 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:57,949 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45776': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:57,950 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45790': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:57,950 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:58,052 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:58,056 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45800': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:58,057 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45804': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:58,057 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:58,159 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:58,163 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45818': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:58,164 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45820': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:58,164 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:58,267 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:58,270 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45824': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:58,271 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45830': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:58,271 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:58,374 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:58,377 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45842': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:58,378 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45846': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:58,378 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:58,481 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:58,484 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45860': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:58,485 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45864': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:58,485 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:58,588 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:58,592 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45872': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:58,592 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45886': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:58,592 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:58,695 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:58,699 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45888': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:58,699 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45900': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:58,699 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:58,802 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:58,806 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45908': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:58,807 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45922': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:58,807 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:58,909 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:58,913 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45930': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:58,914 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45934': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:58,914 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:59,018 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:59,022 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45944': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:59,023 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45950': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:59,023 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:59,125 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45952': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:59,125 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:59,130 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45960': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:59,130 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:59,232 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:59,232 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45970': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:59,238 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45986': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:59,238 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:59,339 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:59,339 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45990': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:59,345 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46006': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:59,345 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:59,446 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46008': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:59,446 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:59,452 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46012': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:59,452 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:59,553 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46024': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:59,553 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:59,560 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46028': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:59,560 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:59,660 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:59,660 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46030': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:59,667 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46046': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:59,667 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:59,767 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:59,767 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:59,774 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46070': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:59,774 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:59,875 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46084': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:59,875 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:59,880 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46096': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:59,880 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:59,982 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:33:59,982 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46104': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:59,988 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46108': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:33:59,988 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:00,089 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:00,089 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46118': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:00,095 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46124': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:00,095 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:00,197 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46128': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:00,197 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:00,202 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46142': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:00,202 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:00,304 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46146': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:00,304 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:00,309 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46150': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:00,309 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:00,411 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:00,415 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46166': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:00,416 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46174': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:00,416 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:00,518 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:00,522 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46178': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:00,523 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46182': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:00,523 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:00,626 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:00,629 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46184': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:00,630 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46188': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:00,630 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:00,734 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:00,737 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46204': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:00,738 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46220': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:00,738 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:00,841 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:00,845 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46228': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:00,846 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46230': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:00,846 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:00,948 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:00,952 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46244': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:00,953 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46246': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:00,953 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:01,057 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:01,060 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46258': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:01,061 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46266': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:01,061 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:01,164 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:01,168 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46276': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:01,168 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46292': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:01,168 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:01,271 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:01,275 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46296': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:01,275 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46300': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:01,275 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:01,378 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:01,382 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46312': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:01,383 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46328': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:01,383 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:01,485 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:01,489 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46330': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:01,490 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46338': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:01,490 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:01,593 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:01,596 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42246': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:01,597 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42262': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:01,597 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:01,700 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:01,704 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42266': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:01,704 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42274': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:01,704 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:01,807 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:01,811 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42276': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:01,812 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42286': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:01,812 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:01,914 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:01,918 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42294': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:01,919 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42304': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:01,919 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:02,021 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:02,025 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42318': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:02,026 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42326': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:02,026 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:02,128 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:02,132 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42330': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:02,133 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42338': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:02,133 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:02,236 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:02,239 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42352': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:02,240 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42358': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:02,240 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:02,343 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:02,347 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42364': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:02,347 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42370': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:02,347 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:02,451 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:02,454 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42386': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:02,455 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42392': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:02,455 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:02,558 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:02,562 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42394': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:02,562 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42410': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:02,562 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:02,665 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:02,669 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42418': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:02,669 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42426': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:02,670 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:02,772 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:02,776 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42438': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:02,777 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42450': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:02,777 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:02,879 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:02,883 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42456': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:02,884 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42466': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:02,884 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:02,987 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:02,990 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42468': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:02,991 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42476': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:02,991 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:03,094 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:03,098 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42488': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:03,098 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42492': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:03,098 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:03,201 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:03,205 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42496': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:03,205 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42506': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:03,206 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:03,308 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:03,312 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42520': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:03,313 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42534': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:03,313 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:03,415 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:03,419 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42536': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:03,420 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42538': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:03,420 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:03,522 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:03,526 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42554': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:03,527 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42562': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:03,527 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:03,630 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:03,633 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42570': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:03,634 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42586': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:03,634 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:03,737 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:03,740 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42590': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:03,741 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42604': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:03,741 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:03,844 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:03,848 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42618': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:03,848 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42634': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:03,848 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:03,951 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:03,955 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42642': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:03,956 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42654': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:03,956 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:04,058 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:04,062 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42666': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:04,063 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42678': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:04,063 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:04,166 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:04,170 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42680': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:04,170 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42694': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:04,171 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:04,273 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:04,277 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42708': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:04,277 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42718': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:04,278 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:04,380 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:04,384 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42722': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:04,384 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42728': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:04,384 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:04,487 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:04,491 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42744': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:04,492 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42752': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:04,492 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:04,594 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:04,599 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42756': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:04,599 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42764': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:04,599 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:04,701 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42776': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:04,701 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:04,707 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42780': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:04,707 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:04,809 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42794': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:04,809 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:04,814 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:04,814 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:04,916 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42800': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:04,916 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:04,921 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42810': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:04,921 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:05,023 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42814': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:05,023 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:05,029 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42822': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:05,029 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:05,130 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42826': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:05,130 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:05,136 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42838': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:05,136 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:05,238 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:05,238 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42848': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:05,243 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42850': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:05,243 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:05,345 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:05,345 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42864': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:05,350 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42872': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:05,350 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:05,452 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42874': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:05,452 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:05,457 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42880': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:05,457 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:05,560 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:05,565 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42888': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:05,565 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:05,565 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42896': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:05,668 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:05,672 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42910': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:05,673 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42924': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:05,673 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:05,775 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:05,780 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42934': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:05,780 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42946': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:05,780 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:05,885 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:05,889 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42962': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:05,890 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:05,890 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42968': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:05,992 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:05,997 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42974': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:05,997 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:05,997 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:06,100 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:06,104 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43000': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:06,105 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43004': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:06,105 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:06,207 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:06,212 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43016': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:06,212 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43032': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:06,213 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:06,314 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:06,319 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43046': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:06,319 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:06,320 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43048': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:06,422 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:06,427 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43050': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:06,427 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:06,427 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43060': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:06,529 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:06,534 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43068': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:06,534 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:06,534 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43080': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:06,637 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:06,641 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43086': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:06,642 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:06,642 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43090': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:06,744 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:06,749 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43096': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:06,749 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43110': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:06,749 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:06,852 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:06,857 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43120': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:06,857 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:06,858 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43128': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:06,960 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:06,965 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43142': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:06,965 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43146': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:06,965 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:07,068 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:07,072 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43148': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:07,073 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:07,073 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43158': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:07,175 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:07,180 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43166': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:07,180 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43168': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:07,180 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:07,283 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:07,287 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43170': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:07,288 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:07,288 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43182': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:07,391 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:07,395 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43196': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:07,396 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:07,396 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43206': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:07,499 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:07,503 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43218': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:07,504 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43234': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:07,504 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:07,607 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:07,612 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43248': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:07,612 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:07,616 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43254': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:07,715 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:07,719 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43266': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:07,720 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:07,720 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43268': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:07,822 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:07,827 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43272': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:07,827 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:07,827 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43286': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:07,930 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:07,934 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43290': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:07,935 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:07,935 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43306': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:08,038 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:08,042 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43316': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:08,043 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:08,043 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43320': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:08,145 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:08,150 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43332': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:08,150 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43336': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:08,150 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:08,253 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:08,258 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43340': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:08,258 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:08,258 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43344': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:08,361 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:08,366 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43350': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:08,366 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:08,366 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43354': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:08,469 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:08,473 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43360': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:08,474 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43376': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:08,474 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:08,576 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:08,581 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43392': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:08,581 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43404': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:08,581 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:08,684 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:08,688 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43408': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:08,689 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:08,689 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43420': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:08,792 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:08,796 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43432': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:08,797 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43446': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:08,797 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:08,899 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:08,903 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43456': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:08,904 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:08,904 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43464': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:09,007 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:09,012 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43474': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:09,012 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:09,012 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43476': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:09,117 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:09,121 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43488': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:09,122 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43502': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:09,122 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:09,224 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:09,229 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43518': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:09,229 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43526': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:09,229 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:09,333 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:09,337 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43532': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:09,338 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:09,338 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43548': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:09,440 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:09,445 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43550': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:09,445 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:09,445 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43560': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:09,548 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:09,552 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43564': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:09,553 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:09,553 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43570': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:09,656 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:09,660 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43572': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:09,661 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:09,661 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43576': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:09,763 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:09,768 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43580': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:09,768 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43582': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:09,768 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:09,871 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:09,875 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43586': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:09,876 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43596': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:09,876 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:09,978 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:09,983 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43608': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:09,984 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43614': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:09,984 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:10,086 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:10,090 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43616': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:10,091 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:10,091 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43622': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:10,194 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:10,198 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43626': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:10,199 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:10,199 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43642': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:10,301 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:10,306 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43652': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:10,306 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43662': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:10,306 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:10,409 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:10,413 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43676': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:10,414 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43686': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:10,414 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:10,516 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:10,521 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43696': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:10,521 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43698': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:10,521 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:10,624 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:10,629 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43712': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:10,629 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:10,629 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43716': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:10,733 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:10,737 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43732': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:10,738 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43738': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:10,738 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:10,840 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:10,845 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43746': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:10,845 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43748': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:10,845 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:10,948 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:10,952 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43754': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:10,953 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:10,953 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43766': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:11,056 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:11,061 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43780': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:11,061 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:11,061 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43782': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:11,164 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:11,169 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43792': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:11,169 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:11,169 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:11,272 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:11,276 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43808': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:11,277 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:11,277 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43816': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:11,379 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:11,384 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43820': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:11,384 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:11,384 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43830': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:11,487 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:11,491 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43846': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:11,492 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43856': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:11,492 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:11,595 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:11,599 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54166': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:11,599 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:11,600 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54182': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:11,702 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:11,707 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54184': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:11,707 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:11,708 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54198': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:11,810 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:11,814 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54210': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:11,815 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:11,815 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54212': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:11,918 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:11,922 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54222': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:11,922 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:11,923 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54234': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:12,025 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:12,030 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54250': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:12,030 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54264': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:12,030 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:12,133 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:12,137 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54266': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:12,138 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54270': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:12,138 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:12,240 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:12,245 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54284': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:12,245 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54286': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:12,245 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:12,348 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:12,352 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54290': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:12,353 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:12,353 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54298': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:12,455 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:12,460 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54312': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:12,460 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:12,460 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54320': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:12,563 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:12,568 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54330': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:12,568 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:12,568 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54334': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:12,671 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:12,675 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54346': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:12,675 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:12,676 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54356': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:12,779 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:12,784 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54362': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:12,784 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54364': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:12,784 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:12,886 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:12,891 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54376': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:12,891 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:12,892 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54390': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:12,994 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:12,999 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54392': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:12,999 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:12,999 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54408': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:13,102 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:13,106 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54418': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:13,107 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:13,107 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54430': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:13,209 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:13,214 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54436': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:13,215 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:13,215 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54446': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:13,317 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:13,317 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54450': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:13,323 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:13,323 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54456': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:13,424 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:13,429 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54466': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:13,430 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:13,430 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54478': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:13,532 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:13,537 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54486': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:13,537 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:13,537 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54488': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:13,640 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:13,644 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54496': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:13,645 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:13,645 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54504': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:13,747 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:13,752 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54520': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:13,752 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54528': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:13,752 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:13,855 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:13,859 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54540': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:13,860 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:13,860 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54552': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:13,962 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:13,967 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54568': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:13,967 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:13,967 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54576': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:14,070 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:14,074 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54586': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:14,075 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54588': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:14,075 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:14,177 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:14,182 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54592': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:14,182 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54598': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:14,182 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:14,285 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:14,289 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54612': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:14,290 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:14,290 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54614': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:14,392 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:14,397 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54616': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:14,397 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:14,397 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54632': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:14,501 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:14,505 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54644': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:14,506 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:14,506 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54648': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:14,608 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:14,618 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54652': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:14,619 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:14,619 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54654': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:14,715 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:14,715 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54662': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:14,727 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:14,727 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54676': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:14,823 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:14,823 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54688': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:14,834 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:14,834 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54698': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:14,930 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:14,930 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54700': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:14,942 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:14,942 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54704': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:15,038 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:15,038 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54720': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:15,049 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:15,049 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:15,145 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:15,145 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54738': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:15,157 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:15,157 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54742': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:15,253 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:15,253 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54758': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:15,264 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:15,264 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54768': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:15,360 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:15,360 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54774': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:15,372 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:15,372 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54780': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:15,468 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:15,468 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54782': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:15,479 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:15,479 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54792': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:15,576 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:15,577 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54800': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:15,588 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:15,588 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54808': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:15,684 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:15,684 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54820': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:15,696 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:15,696 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54832': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:15,791 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:15,792 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54844': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:15,803 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:15,804 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54848': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:15,899 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:15,899 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54856': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:15,911 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:15,911 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54870': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:16,006 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:16,006 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54884': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:16,018 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:16,019 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54894': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:16,117 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:16,117 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54910': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:16,126 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:16,126 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54926': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:16,225 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:16,226 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54932': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:16,233 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:16,234 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54946': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:16,333 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:16,333 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54962': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:16,341 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:16,341 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54964': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:16,440 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:16,441 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54972': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:16,448 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:16,448 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54976': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:16,548 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:16,548 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54982': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:16,555 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:16,555 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54986': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:16,656 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:16,656 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54992': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:16,663 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:16,663 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55004': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:16,763 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:16,763 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55016': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:16,770 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:16,770 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55032': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:16,871 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:16,871 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55046': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:16,877 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:16,877 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55052': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:16,978 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:16,978 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55064': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:16,985 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:16,985 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55066': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:17,085 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:17,085 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55068': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:17,092 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:17,092 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55072': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:17,193 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:17,193 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55076': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:17,200 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:17,200 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55084': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:17,301 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:17,301 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55094': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:17,307 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:17,307 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55096': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:17,408 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:17,408 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55106': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:17,415 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:17,415 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55110': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:17,516 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:17,516 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55120': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:17,522 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:17,522 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:17,623 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:17,623 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55130': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:17,630 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:17,630 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55138': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:17,730 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:17,730 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55146': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:17,737 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:17,737 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55162': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:17,837 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:17,838 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55170': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:17,845 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:17,845 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55172': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:17,946 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:17,946 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55180': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:17,953 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:17,953 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55186': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:18,053 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:18,053 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55194': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:18,060 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:18,060 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55196': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:18,161 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:18,161 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55210': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:18,167 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:18,167 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55218': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:18,268 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:18,268 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55228': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:18,275 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:18,275 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55242': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:18,376 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:18,376 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55258': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:18,382 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:18,382 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55268': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:18,483 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:18,483 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55272': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:18,490 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:18,490 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55288': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:18,591 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:18,596 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55292': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:18,597 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:18,597 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55304': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:18,698 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:18,703 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55318': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:18,704 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:18,704 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55334': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:18,806 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:18,810 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55346': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:18,811 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:18,811 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55360': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:18,913 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:18,918 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55368': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:18,918 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:18,918 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55384': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:19,021 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:19,025 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55386': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:19,025 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:19,026 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55398': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:19,128 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:19,132 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55402': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:19,133 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:19,133 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55404': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:19,235 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:19,240 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55410': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:19,240 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:19,240 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55420': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:19,342 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:19,347 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55424': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:19,348 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55432': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:19,348 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:19,450 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:19,450 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55434': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:19,455 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:19,456 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55450': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:19,557 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:19,562 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55464': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:19,563 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:19,563 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55468': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:19,665 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:19,669 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55472': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:19,670 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:19,670 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55478': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:19,772 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:19,777 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55488': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:19,777 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:19,777 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55490': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:19,879 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:19,884 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55506': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:19,884 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:19,884 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55512': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:19,986 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:19,991 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55516': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:19,991 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55518': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:19,991 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:20,093 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:20,094 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55524': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:20,099 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:20,099 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55538': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:20,201 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:20,205 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55542': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:20,206 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:20,207 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55550': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:20,308 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:20,313 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55566': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:20,314 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:20,314 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55580': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:20,417 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:20,422 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55584': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:20,422 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:20,422 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55596': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:20,525 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:20,529 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55600': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:20,530 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55614': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:20,530 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:20,632 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:20,636 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55630': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:20,637 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55644': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:20,637 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:20,739 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:20,744 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55646': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:20,744 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:20,744 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55652': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:20,846 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:20,851 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55662': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:20,851 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:20,851 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55664': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:20,954 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:20,954 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55680': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:20,959 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:20,959 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55688': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:21,061 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:21,066 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55698': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:21,067 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:21,067 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55706': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:21,169 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:21,174 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55718': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:21,175 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:21,175 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55732': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:21,276 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:21,277 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55736': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:21,283 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:21,283 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55744': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:21,384 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:21,389 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55760': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:21,390 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:21,390 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55768': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:21,492 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:21,497 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55778': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:21,497 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:21,498 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55794': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:21,600 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:21,604 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41346': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:21,605 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:21,605 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41360': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:21,707 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:21,712 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41370': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:21,713 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:21,713 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41382': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:21,814 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:21,819 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41392': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:21,820 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:21,820 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41402': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:21,922 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:21,922 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41408': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:21,928 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:21,928 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41424': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:22,029 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:22,034 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41432': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:22,035 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:22,035 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41444': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:22,137 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:22,142 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41450': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:22,143 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:22,143 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41456': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:22,244 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:22,249 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41470': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:22,250 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:22,250 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41480': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:22,352 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:22,356 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41494': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:22,357 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:22,357 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41500': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:22,459 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:22,464 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41510': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:22,465 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:22,465 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41520': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:22,566 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:22,571 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41532': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:22,572 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:22,572 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41536': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:22,674 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:22,678 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41544': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:22,679 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:22,679 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41560': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:22,781 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:22,786 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41564': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:22,786 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:22,787 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41574': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:22,889 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:22,894 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41580': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:22,894 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:22,894 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41590': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:22,997 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:23,001 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41594': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:23,002 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:23,002 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41596': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:23,105 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:23,110 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41606': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:23,110 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:23,115 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41616': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:23,212 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:23,217 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41618': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:23,218 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:23,218 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41622': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:23,320 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:23,324 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41632': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:23,325 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:23,325 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41638': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:23,427 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:23,432 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41642': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:23,432 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:23,433 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41656': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:23,535 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:23,539 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41672': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:23,540 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41686': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:23,540 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:23,642 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:23,647 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41698': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:23,647 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41704': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:23,647 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:23,750 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:23,754 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41716': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:23,755 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:23,755 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41732': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:23,857 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:23,862 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41740': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:23,862 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:23,863 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41742': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:23,965 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:23,969 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41746': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:23,970 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:23,970 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41756': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:24,072 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:24,077 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41770': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:24,077 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:24,077 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41784': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:24,180 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:24,184 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:24,185 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:24,185 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41804': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:24,288 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:24,292 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41810': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:24,293 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41814': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:24,293 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:24,395 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:24,400 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41824': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:24,400 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:24,400 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41828': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:24,503 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:24,507 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41830': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:24,508 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:24,508 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41840': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:24,610 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:24,621 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41848': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:24,622 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41850': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:24,622 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:24,717 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:24,717 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41856': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:24,730 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:24,730 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41864': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:24,826 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:24,826 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41878': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:24,837 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:24,837 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41886': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:24,934 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:24,934 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41900': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:24,944 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:24,945 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41916': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:25,041 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:25,041 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41922': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:25,052 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:25,052 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41934': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:25,149 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:25,149 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41940': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:25,159 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:25,159 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41948': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:25,258 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:25,258 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41954': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:25,267 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:25,267 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41964': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:25,365 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:25,366 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41970': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:25,374 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:25,374 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41986': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:25,473 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:25,473 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42000': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:25,482 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:25,482 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42008': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:25,580 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:25,581 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42014': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:25,588 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:25,589 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42024': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:25,688 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:25,688 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42032': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:25,696 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:25,696 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42048': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:25,796 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:25,796 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42056': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:25,803 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:25,803 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42066': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:25,904 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:25,909 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42072': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:25,910 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:25,910 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42074': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:26,011 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:26,012 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42090': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:26,018 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:26,018 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42096': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:26,119 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:26,119 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42100': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:26,125 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:26,125 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42104': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:26,226 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:26,231 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42114': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:26,232 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:26,232 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42116': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:26,334 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:26,334 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42128': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:26,340 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:26,340 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42132': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:26,441 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:26,446 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42142': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:26,447 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:26,447 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42152': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:26,550 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:26,554 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42164': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:26,555 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:26,555 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42180': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:26,657 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:26,662 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42182': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:26,662 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42190': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:26,662 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:26,765 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:26,769 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42192': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:26,769 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:26,770 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42200': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:26,872 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:26,876 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42206': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:26,877 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:26,877 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42214': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:26,980 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:26,984 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42230': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:26,985 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:26,985 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42244': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:27,087 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:27,091 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42256': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:27,092 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:27,092 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42260': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:27,195 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:27,199 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42266': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:27,200 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42276': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:27,200 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:27,302 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:27,307 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42280': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:27,307 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:27,308 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42284': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:27,410 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:27,414 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42298': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:27,415 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42306': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:27,415 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:27,517 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:27,521 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42316': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:27,522 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:27,522 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42326': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:27,624 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:27,629 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42340': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:27,629 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:27,629 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42348': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:27,731 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:27,736 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42364': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:27,737 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42368': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:27,737 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:27,839 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:27,843 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42384': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:27,844 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42390': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:27,844 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:27,947 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:27,951 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42404': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:27,952 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:27,952 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42412': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:28,055 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:28,059 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42414': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:28,059 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:28,059 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42420': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:28,162 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:28,167 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42434': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:28,167 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42450': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:28,167 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:28,271 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:28,275 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42460': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:28,276 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:28,276 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42474': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:28,379 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:28,383 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42490': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:28,383 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:28,384 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42502': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:28,486 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:28,491 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42510': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:28,491 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:28,491 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42512': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:28,594 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:28,598 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42520': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:28,599 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:28,599 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42534': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:28,702 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:28,707 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42548': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:28,708 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:28,708 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42562': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:28,810 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:28,815 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42566': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:28,815 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:28,815 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42572': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:28,917 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:28,922 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42574': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:28,922 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:28,923 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42590': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:29,025 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:29,029 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42600': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:29,030 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:29,030 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42616': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:29,132 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:29,137 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42632': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:29,137 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:29,137 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42646': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:29,240 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:29,244 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42658': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:29,245 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42674': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:29,245 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:29,347 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:29,352 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42690': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:29,352 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42706': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:29,352 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:29,455 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:29,459 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42716': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:29,460 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:29,460 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42726': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:29,562 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:29,567 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42730': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:29,567 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:29,567 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42744': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:29,670 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:29,674 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42760': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:29,675 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:29,675 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42762': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:29,778 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:29,782 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42776': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:29,783 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:29,783 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42786': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:29,885 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:29,889 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42788': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:29,890 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42792': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:29,890 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:29,994 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:29,998 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42808': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:29,998 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:29,998 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42824': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:30,102 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:30,107 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42836': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:30,107 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:30,107 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42840': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:30,210 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:30,214 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42856': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:30,215 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:30,215 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42858': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:30,317 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:30,322 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42872': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:30,322 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42874': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:30,322 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:30,425 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:30,429 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42880': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:30,430 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42892': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:30,430 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:30,533 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:30,537 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42908': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:30,538 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:30,538 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42920': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:30,641 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:30,645 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42934': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:30,645 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:30,645 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42938': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:30,748 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:30,752 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42944': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:30,753 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:30,753 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42960': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:30,856 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:30,860 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42962': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:30,861 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:30,861 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42968': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:30,963 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:30,968 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42976': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:30,968 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:30,968 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42988': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:31,071 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:31,075 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43002': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:31,076 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:31,076 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43014': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:31,179 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:31,183 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43022': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:31,184 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:31,184 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43030': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:31,286 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:31,291 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43042': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:31,291 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:31,291 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43056': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:31,394 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:31,399 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43064': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:31,399 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:31,399 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43074': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:31,502 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:31,506 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43076': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:31,507 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:31,507 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43088': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:31,609 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:31,617 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55896': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:31,618 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:31,618 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55910': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:31,717 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:31,718 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55920': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:31,725 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:31,725 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55930': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:31,825 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:31,825 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55946': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:31,832 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:31,832 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55950': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:31,933 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:31,933 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55958': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:31,939 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:31,939 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55968': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:32,040 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:32,045 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55970': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:32,046 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:32,046 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55986': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:32,148 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:32,152 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55992': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:32,153 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:32,153 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56000': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:32,255 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:32,260 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56014': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:32,260 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56030': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:32,260 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:32,363 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:32,367 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56040': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:32,368 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:32,368 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56050': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:32,471 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:32,475 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56066': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:32,475 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56074': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:32,475 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:32,578 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:32,582 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56080': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:32,583 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56092': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:32,583 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:32,686 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:32,690 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56098': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:32,691 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:32,691 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56100': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:32,794 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:32,798 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56102': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:32,798 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:32,798 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56112': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:32,901 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:32,906 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56120': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:32,906 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56130': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:32,906 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:33,009 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:33,013 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56144': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:33,014 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56154': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:33,014 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:33,118 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:33,122 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56168': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:33,122 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:33,123 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56182': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:33,225 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:33,229 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56184': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:33,230 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56194': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:33,230 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:33,333 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:33,337 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56202': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:33,338 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:33,338 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56206': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:33,441 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:33,446 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56218': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:33,446 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:33,446 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56220': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:33,549 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:33,553 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56228': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:33,554 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:33,554 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56232': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:33,657 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:33,661 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56242': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:33,661 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:33,662 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56250': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:33,765 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:33,768 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56264': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:33,769 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56268': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:33,769 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:33,872 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:33,876 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56276': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:33,877 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:33,877 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56280': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:33,980 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:33,984 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56286': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:33,984 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:33,985 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56298': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:34,087 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:34,091 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56314': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:34,092 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56318': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:34,092 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:34,195 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:34,199 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56322': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:34,199 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56332': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:34,199 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:34,302 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:34,306 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56338': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:34,307 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:34,307 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56340': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:34,409 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:34,414 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56342': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:34,414 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56352': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:34,414 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:34,516 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:34,521 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56360': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:34,521 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:34,521 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56366': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:34,624 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:34,628 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56370': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:34,628 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:34,629 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56374': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:34,731 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:34,735 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56378': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:34,736 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:34,736 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56380': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:34,838 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:34,843 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56396': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:34,843 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:34,843 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56410': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:34,947 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:34,951 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56424': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:34,951 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56426': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:34,951 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:35,054 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:35,058 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56430': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:35,059 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:35,059 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56438': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:35,162 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:35,166 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56452': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:35,167 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56454': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:35,167 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:35,269 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:35,273 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56466': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:35,274 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:35,274 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56476': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:35,377 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:35,381 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56484': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:35,381 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:35,382 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56498': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:35,484 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:35,489 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56502': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:35,489 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:35,489 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56510': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:35,592 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:35,596 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56512': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:35,597 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:35,597 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56518': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:35,699 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:35,704 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56526': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:35,704 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:35,704 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56540': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:35,807 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:35,811 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56552': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:35,812 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:35,812 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56558': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:35,914 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:35,918 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56564': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:35,919 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:35,919 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56576': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:36,021 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:36,025 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56586': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:36,026 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56588': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:36,026 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:36,128 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:36,132 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56602': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:36,133 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56612': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:36,133 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:36,235 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56620': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:36,235 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:36,241 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:36,241 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56622': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:36,343 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:36,347 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56628': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:36,348 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:36,348 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56630': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:36,450 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:36,450 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56646': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:36,456 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:36,456 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56654': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:36,557 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:36,562 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56668': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:36,563 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:36,563 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56684': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:36,665 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:36,670 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56700': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:36,670 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:36,671 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56716': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:36,772 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:36,777 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56726': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:36,778 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:36,778 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56730': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:36,880 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:36,885 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56738': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:36,885 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56750': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:36,885 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:36,988 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:36,992 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56760': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:36,992 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56776': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:36,992 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:37,095 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:37,099 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56782': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:37,100 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:37,100 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56798': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:37,202 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:37,202 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56800': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:37,208 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:37,208 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56812': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:37,309 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:37,314 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56822': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:37,315 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:37,315 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56834': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:37,417 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:37,422 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56842': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:37,422 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:37,422 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56846': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:37,524 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:37,524 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56856': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:37,530 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:37,530 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56866': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:37,631 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:37,631 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56876': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:37,638 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:37,638 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56882': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:37,738 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:37,739 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56886': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:37,745 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:37,745 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56894': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:37,846 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:37,846 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56908': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:37,852 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:37,852 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56914': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:37,953 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:37,953 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56924': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:37,960 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:37,960 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56938': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:38,061 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:38,061 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56942': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:38,067 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:38,067 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56944': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:38,168 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:38,169 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56950': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:38,175 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:38,175 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56956': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:38,276 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:38,276 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56968': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:38,282 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:38,282 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56974': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:38,383 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:38,388 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56982': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:38,389 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:38,389 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:56984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:38,490 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:38,490 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57000': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:38,496 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:38,496 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57012': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:38,599 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:38,603 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57020': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:38,604 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57030': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:38,604 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:38,706 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:38,711 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57040': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:38,711 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:38,711 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57054': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:38,813 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:38,817 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57060': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:38,818 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57070': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:38,818 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:38,920 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:38,920 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57074': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:38,926 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:38,926 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57078': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:39,027 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:39,032 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57084': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:39,033 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:39,033 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57086': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:39,135 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:39,140 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57096': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:39,140 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:39,140 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57108': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:39,242 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:39,247 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57114': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:39,248 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:39,248 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57128': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:39,349 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:39,354 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57132': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:39,355 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:39,355 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57144': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:39,457 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:39,461 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57154': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:39,462 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:39,462 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57170': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:39,564 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:39,570 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57176': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:39,571 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57184': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:39,571 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:39,671 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:39,671 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57188': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:39,678 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:39,678 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57194': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:39,780 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:39,780 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57198': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:39,786 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:39,786 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57204': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:39,887 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:39,887 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57218': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:39,893 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:39,893 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57226': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:39,994 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:39,994 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57242': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:40,001 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:40,001 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57258': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:40,101 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:40,102 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57272': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:40,108 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:40,111 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57286': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:40,209 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:40,209 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57294': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:40,215 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:40,215 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57308': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:40,317 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:40,317 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57318': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:40,323 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:40,323 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57320': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:40,425 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:40,425 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57324': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:40,431 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:40,431 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57334': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:40,532 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:40,537 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57344': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:40,538 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:40,538 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57348': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:40,639 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:40,644 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57352': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:40,645 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:40,645 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57362': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:40,747 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:40,751 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57364': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:40,752 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:40,752 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57376': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:40,854 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57386': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:40,854 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:40,860 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:40,860 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57402': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:40,962 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57418': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:40,962 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:40,967 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:40,967 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57426': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:41,069 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:41,074 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57430': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:41,075 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:41,075 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57436': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:41,177 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:41,177 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57444': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:41,183 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:41,183 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57452': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:41,284 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:41,285 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57462': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:41,290 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:41,290 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57466': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:41,391 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:41,391 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57482': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:41,397 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:41,397 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57484': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:41,498 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:41,499 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57496': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:41,505 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:41,505 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57512': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:41,606 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:41,607 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46988': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:41,612 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:41,616 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46992': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:41,714 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:41,714 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46996': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:41,720 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:41,720 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47010': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:41,821 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:41,821 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47012': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:41,828 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:41,828 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47020': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:41,928 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:41,929 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47032': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:41,935 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:41,935 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47036': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:42,037 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:42,041 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47048': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:42,042 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:42,042 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:42,144 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:42,149 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47072': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:42,149 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47076': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:42,149 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:42,252 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:42,256 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47086': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:42,257 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:42,257 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47096': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:42,360 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:42,364 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47098': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:42,365 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:42,365 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47106': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:42,467 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:42,471 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47110': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:42,472 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:42,472 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47114': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:42,574 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:42,574 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:42,580 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:42,580 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47138': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:42,682 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:42,686 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47146': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:42,687 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47158': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:42,687 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:42,789 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:42,793 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47174': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:42,794 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:42,794 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47186': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:42,896 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:42,901 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47198': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:42,902 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47210': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:42,901 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:43,004 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:43,008 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47218': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:43,009 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:43,009 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47228': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:43,112 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:43,120 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47236': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:43,121 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47246': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:43,121 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:43,219 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:43,219 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47252': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:43,228 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:43,228 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47266': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:43,327 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:43,327 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47278': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:43,336 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:43,336 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47292': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:43,434 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:43,434 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47308': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:43,443 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:43,443 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47314': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:43,542 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:43,542 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47320': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:43,551 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:43,551 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47330': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:43,649 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:43,650 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47344': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:43,658 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:43,658 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47348': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:43,758 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:43,758 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47354': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:43,766 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:43,766 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47358': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:43,865 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:43,865 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47362': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:43,873 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:43,873 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47374': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:43,973 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:43,973 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47376': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:43,980 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:43,980 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47390': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:44,080 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:44,081 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47406': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:44,088 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:44,088 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47412': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:44,188 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47418': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:44,188 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:44,195 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:44,195 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47434': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:44,296 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:44,296 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47436': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:44,302 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:44,302 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47446': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:44,404 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:44,409 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47460': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:44,410 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47476': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:44,410 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:44,512 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:44,516 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47486': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:44,517 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:44,517 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47498': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:44,620 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:44,625 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47504': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:44,625 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:44,625 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47516': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:44,728 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:44,733 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47528': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:44,733 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47544': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:44,733 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:44,836 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:44,840 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47558': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:44,841 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47570': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:44,841 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:44,943 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:44,947 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47576': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:44,948 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:44,948 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47582': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:45,050 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:45,055 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47596': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:45,055 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:45,055 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47610': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:45,158 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:45,162 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47612': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:45,163 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47622': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:45,162 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:45,265 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:45,270 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47634': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:45,270 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47644': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:45,270 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:45,372 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:45,377 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47650': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:45,377 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:45,377 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47656': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:45,480 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:45,485 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47670': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:45,486 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:45,486 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47674': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:45,588 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:45,592 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47684': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:45,593 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:45,593 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47692': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:45,695 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:45,700 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47704': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:45,700 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:45,700 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47712': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:45,803 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:45,807 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47722': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:45,808 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:45,808 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:45,910 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:45,915 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47726': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:45,915 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:45,916 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47742': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:46,017 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:46,022 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47756': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:46,023 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47770': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:46,023 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:46,125 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:46,129 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47782': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:46,130 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:46,130 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47784': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:46,232 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:46,237 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47786': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:46,237 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47794': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:46,237 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:46,340 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:46,344 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47810': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:46,345 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47812': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:46,345 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:46,447 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:46,451 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47818': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:46,452 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47830': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:46,452 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:46,555 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:46,559 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47842': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:46,560 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:46,560 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47850': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:46,662 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:46,666 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47860': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:46,667 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47862': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:46,667 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:46,770 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:46,774 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47878': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:46,775 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47890': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:46,775 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:46,877 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:46,882 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47900': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:46,882 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:46,882 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47910': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:46,984 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:46,989 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47916': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:46,989 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:46,990 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47922': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:47,092 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:47,096 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47924': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:47,097 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:47,097 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47926': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:47,200 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:47,205 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47928': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:47,205 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:47,205 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47940': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:47,308 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:47,312 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47952': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:47,313 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:47,313 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47960': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:47,415 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:47,419 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47962': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:47,420 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:47,420 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47968': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:47,523 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:47,527 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47970': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:47,528 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:47,528 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47972': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:47,630 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:47,634 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47982': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:47,635 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:47,635 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47990': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:47,737 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:47,742 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47996': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:47,742 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47998': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:47,742 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:47,845 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:47,849 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48004': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:47,850 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:47,850 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48020': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:47,952 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:47,956 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48024': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:47,957 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:47,957 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48026': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:48,059 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:48,063 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48034': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:48,064 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:48,064 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48048': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:48,166 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:48,171 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48050': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:48,171 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:48,171 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48060': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:48,273 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:48,278 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48072': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:48,278 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48074': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:48,278 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:48,381 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:48,385 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48080': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:48,386 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:48,386 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48086': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:48,488 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:48,493 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48096': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:48,493 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:48,493 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48112': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:48,595 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:48,600 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:48,600 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:48,600 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48138': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:48,703 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:48,707 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48146': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:48,708 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:48,708 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48158': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:48,810 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:48,815 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48168': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:48,815 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:48,815 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48182': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:48,918 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:48,922 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48188': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:48,923 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48192': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:48,923 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:49,025 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:49,030 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48198': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:49,031 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48212': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:49,031 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:49,133 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:49,133 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48216': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:49,138 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:49,138 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48222': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:49,240 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:49,245 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48232': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:49,246 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:49,246 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48248': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:49,347 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:49,352 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48258': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:49,353 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:49,353 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48270': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:49,456 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:49,460 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48272': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:49,461 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:49,461 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48278': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:49,563 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:49,569 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48284': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:49,570 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:49,570 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48298': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:49,671 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:49,671 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48300': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:49,677 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:49,678 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48304': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:49,778 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:49,778 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48314': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:49,784 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:49,784 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48328': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:49,885 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:49,885 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48344': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:49,892 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:49,892 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48356': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:49,993 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:49,994 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48364': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:49,999 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:49,999 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48380': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:50,100 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:50,100 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48386': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:50,107 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:50,107 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48396': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:50,208 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:50,209 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48412': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:50,214 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:50,214 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48424': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:50,315 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:50,315 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48436': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:50,322 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:50,322 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48442': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:50,423 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:50,424 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48446': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:50,429 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:50,429 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48452': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:50,530 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:50,530 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48458': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:50,537 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:50,537 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48468': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:50,639 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:50,639 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48470': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:50,644 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:50,645 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48478': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:50,746 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:50,751 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48484': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:50,752 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:50,752 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48498': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:50,854 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:50,858 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48506': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:50,859 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:50,859 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48520': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:50,961 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:50,966 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48528': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:50,966 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48530': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:50,966 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:51,069 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:51,073 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48534': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:51,073 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:51,074 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48544': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:51,176 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:51,180 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48554': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:51,181 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:51,181 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48560': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:51,283 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:51,288 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48576': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:51,288 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:51,289 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48584': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:51,391 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:51,395 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48592': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:51,396 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:51,396 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48600': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:51,499 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:51,503 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48608': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:51,503 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:48610': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:51,503 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:51,606 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:51,611 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42702': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:51,611 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:51,615 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42714': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:51,713 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:51,718 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42728': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:51,718 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:51,718 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42732': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:51,821 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:51,825 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42740': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:51,825 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42756': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:51,826 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:51,928 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:51,932 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42764': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:51,933 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:51,933 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42770': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:52,035 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:52,040 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42772': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:52,040 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42786': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:52,040 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:52,143 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:52,147 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42792': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:52,148 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42804': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:52,147 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:52,250 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:52,254 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42808': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:52,255 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42816': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:52,255 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:52,358 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:52,363 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42828': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:52,363 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:52,363 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42830': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:52,466 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:52,470 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42834': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:52,470 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42848': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:52,470 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:52,573 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:52,578 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42850': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:52,578 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42864': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:52,578 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:52,681 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:52,685 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42874': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:52,686 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42878': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:52,686 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:52,788 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:52,792 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42880': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:52,793 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42896': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:52,793 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:52,895 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:52,900 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42900': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:52,900 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:52,900 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42912': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:53,003 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:53,007 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42914': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:53,008 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:53,008 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42926': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:53,110 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:53,119 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42942': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:53,120 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42952': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:53,120 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:53,218 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:53,218 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42962': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:53,227 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:53,227 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42966': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:53,326 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:53,326 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42980': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:53,334 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:53,334 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:42992': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:53,434 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:53,434 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43006': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:53,441 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:53,442 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43008': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:53,541 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:53,541 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43022': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:53,549 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:53,549 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43038': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:53,649 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:53,649 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43046': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:53,656 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:53,656 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43050': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:53,757 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:53,757 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43054': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:53,764 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:53,764 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43064': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:53,864 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:53,865 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43078': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:53,871 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:53,871 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43088': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:53,972 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:53,972 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43094': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:53,978 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:53,978 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43104': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:54,080 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:54,085 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43118': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:54,085 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:54,085 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43128': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:54,188 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:54,192 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43132': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:54,193 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:54,193 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43146': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:54,296 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:54,300 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43154': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:54,301 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43156': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:54,301 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:54,404 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:54,408 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43168': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:54,408 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:54,409 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43180': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:54,511 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:54,516 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43188': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:54,516 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43202': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:54,516 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:54,620 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:54,624 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43214': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:54,624 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:54,625 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43230': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:54,727 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:54,731 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43234': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:54,732 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43244': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:54,732 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:54,834 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:54,839 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43254': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:54,839 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:54,839 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43260': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:54,942 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:54,946 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43264': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:54,947 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:54,947 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43268': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:55,049 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:55,053 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43272': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:55,054 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43286': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:55,054 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:55,156 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:55,161 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43302': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:55,161 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:55,161 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43306': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:55,264 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:55,268 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43308': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:55,269 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:55,269 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43324': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:55,371 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:55,376 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43336': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:55,376 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:55,376 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43344': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:55,479 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:55,483 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43358': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:55,484 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:55,484 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43372': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:55,586 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:55,591 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43378': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:55,591 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43384': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:55,591 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:55,693 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:55,698 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43386': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:55,699 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43402': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:55,698 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:55,802 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:55,806 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43404': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:55,807 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:55,807 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43408': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:55,909 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:55,914 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43418': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:55,914 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43426': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:55,914 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:56,016 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:56,021 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43442': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:56,021 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43454': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:56,021 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:56,123 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:56,128 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43456': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:56,128 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:56,129 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43470': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:56,231 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:56,235 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43482': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:56,236 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43498': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:56,236 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:56,338 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:56,343 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43502': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:56,343 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:56,343 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43516': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:56,445 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:56,450 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43518': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:56,450 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:56,450 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43522': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:56,553 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:56,557 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43536': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:56,558 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43552': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:56,558 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:56,660 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:56,665 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43568': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:56,665 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:56,665 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43576': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:56,768 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:56,772 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43584': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:56,773 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43598': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:56,773 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:56,875 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:56,879 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43612': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:56,879 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:56,880 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43628': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:56,982 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:56,986 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43634': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:56,987 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43644': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:56,987 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:57,090 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:57,094 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43654': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:57,094 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:57,094 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43670': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:57,197 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:57,201 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43676': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:57,202 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:57,202 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43680': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:57,304 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:57,309 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43696': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:57,309 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:57,310 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43702': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:57,412 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:57,416 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43718': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:57,416 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:57,417 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43734': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:57,520 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:57,524 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43746': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:57,524 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:57,525 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43748': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:57,627 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:57,631 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43756': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:57,632 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:57,632 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43762': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:57,734 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:57,738 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43768': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:57,739 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:57,739 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43772': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:57,841 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:57,846 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43774': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:57,846 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:57,846 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43778': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:57,949 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:57,953 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43786': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:57,953 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:57,954 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43802': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:58,056 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:58,060 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43818': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:58,061 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:58,061 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43832': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:58,163 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:58,168 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43848': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:58,168 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:58,169 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43850': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:58,270 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:58,275 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43852': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:58,276 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:58,276 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43866': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:58,377 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:58,382 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43868': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:58,382 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43874': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:58,382 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:58,484 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:58,489 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43886': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:58,489 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:58,489 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43898': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:58,592 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:58,596 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43904': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:58,596 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:58,597 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43914': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:58,699 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:58,703 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43918': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:58,704 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43924': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:58,704 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:58,806 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:58,811 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43928': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:58,811 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:58,811 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43930': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:58,913 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:58,918 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43934': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:58,918 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:58,918 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43942': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:59,020 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:59,025 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43952': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:59,025 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:59,025 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43966': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:59,129 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:59,133 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43980': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:59,134 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:59,134 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:43996': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:59,237 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:59,241 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44012': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:59,242 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44014': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:59,242 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:59,344 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:59,348 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44016': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:59,349 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:59,349 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44032': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:59,451 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:59,451 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44048': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:59,456 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:59,456 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44054': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:59,558 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:59,564 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44062': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:59,565 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:59,565 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44074': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:59,665 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:59,665 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44086': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:59,672 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:59,672 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44098': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:59,773 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:59,773 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44110': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:59,779 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:59,779 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:59,880 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:59,880 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44136': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:59,886 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:59,886 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44152': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:59,987 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:59,987 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44154': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:34:59,993 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:34:59,993 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44170': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:00,095 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:00,095 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44174': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:00,101 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:00,101 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44176': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:00,202 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:00,207 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44192': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:00,208 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:00,208 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44200': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:00,310 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:00,310 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44216': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:00,316 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:00,316 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44230': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:00,418 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:00,422 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44244': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:00,422 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:00,422 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44256': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:00,525 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:00,529 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44270': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:00,530 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44284': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:00,530 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:00,632 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:00,637 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44286': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:00,637 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:00,637 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44290': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:00,740 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:00,744 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44306': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:00,745 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:00,745 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44318': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:00,847 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:00,852 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44332': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:00,852 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:00,852 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44348': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:00,955 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:00,960 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44358': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:00,960 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:00,960 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44362': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:01,063 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:01,067 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44364': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:01,068 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:01,068 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44372': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:01,170 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:01,175 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44376': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:01,175 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44392': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:01,175 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:01,278 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:01,282 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44402': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:01,283 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:01,283 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44416': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:01,385 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:01,390 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44418': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:01,390 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:01,390 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44426': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:01,493 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:01,497 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44430': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:01,497 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:01,498 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:44432': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:01,600 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:01,604 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50368': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:01,605 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:01,605 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50374': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:01,707 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:01,712 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50380': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:01,712 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:01,712 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50390': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:01,814 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:01,818 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50398': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:01,819 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:01,819 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50404': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:01,921 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:01,926 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50412': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:01,926 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50414': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:01,926 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:02,029 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:02,033 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50420': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:02,034 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:02,034 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50430': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:02,136 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:02,140 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50442': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:02,141 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:02,141 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50444': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:02,243 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:02,248 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50448': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:02,248 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:02,249 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50458': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:02,351 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:02,355 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50460': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:02,356 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:02,356 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50470': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:02,458 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:02,463 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50476': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:02,464 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50492': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:02,464 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:02,566 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:02,570 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50494': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:02,571 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:02,571 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50496': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:02,674 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:02,678 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50500': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:02,679 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:02,679 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50508': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:02,781 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:02,786 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50510': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:02,786 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:02,786 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50516': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:02,888 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:02,893 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50524': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:02,893 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:02,893 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50528': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:02,996 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:03,000 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50542': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:03,001 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:03,001 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50544': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:03,103 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:03,107 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50552': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:03,108 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:03,112 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50558': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:03,210 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:03,215 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50560': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:03,215 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50568': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:03,215 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:03,317 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:03,322 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50582': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:03,322 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50596': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:03,322 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:03,425 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:03,429 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50606': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:03,430 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:03,430 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50616': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:03,532 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:03,537 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50624': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:03,537 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:03,537 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50626': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:03,640 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:03,644 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50640': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:03,645 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:03,645 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50652': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:03,748 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:03,752 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50668': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:03,752 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50674': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:03,752 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:03,855 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:03,859 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50690': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:03,860 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:03,860 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50702': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:03,963 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:03,968 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50716': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:03,968 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:03,968 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50718': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:04,071 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:04,075 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50720': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:04,076 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:04,076 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50736': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:04,178 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:04,182 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50750': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:04,183 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:04,183 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50760': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:04,285 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:04,290 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50770': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:04,290 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:04,290 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50780': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:04,394 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:04,398 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50784': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:04,399 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:04,399 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:04,501 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:04,505 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50800': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:04,506 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:04,506 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50802': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:04,608 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:04,618 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50812': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:04,619 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:04,619 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50820': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:04,716 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:04,716 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50824': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:04,726 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:04,726 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50830': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:04,823 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:04,823 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50842': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:04,834 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:04,834 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50848': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:04,931 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:04,931 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50864': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:04,941 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:04,941 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50866': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:05,038 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:05,038 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50882': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:05,048 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:05,048 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50894': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:05,146 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:05,146 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50906': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:05,155 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:05,156 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50916': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:05,253 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:05,253 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50932': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:05,263 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:05,263 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50938': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:05,361 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:05,361 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50950': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:05,369 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:05,370 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50964': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:05,468 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:05,468 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50976': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:05,477 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:05,477 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50982': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:05,575 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:05,575 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50996': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:05,583 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:05,584 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51012': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:05,683 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:05,683 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51014': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:05,691 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:05,691 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51030': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:05,790 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:05,790 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51034': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:05,797 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:05,798 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51036': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:05,898 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:05,898 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51050': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:05,904 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:05,904 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51052': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:06,005 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:06,005 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51054': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:06,011 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:06,012 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51064': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:06,113 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:06,122 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51070': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:06,123 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51086': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:06,123 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:06,221 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:06,221 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51088': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:06,230 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:06,230 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51092': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:06,328 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:06,328 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51096': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:06,337 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:06,337 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51110': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:06,436 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:06,436 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51118': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:06,444 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:06,444 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51128': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:06,543 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:06,543 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51142': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:06,551 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:06,551 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51146': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:06,651 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:06,651 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51152': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:06,657 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:06,658 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51156': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:06,758 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:06,758 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51160': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:06,764 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:06,764 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51172': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:06,866 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:06,866 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51184': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:06,872 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:06,872 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51186': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:06,973 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:06,974 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51202': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:06,979 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:06,979 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51216': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:07,080 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:07,081 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51226': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:07,087 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:07,087 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51234': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:07,188 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:07,193 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51242': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:07,194 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:07,194 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51252': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:07,296 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:07,300 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51254': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:07,301 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51258': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:07,301 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:07,403 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:07,408 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51268': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:07,408 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:07,408 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51280': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:07,511 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:07,515 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51294': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:07,516 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:07,516 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51304': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:07,618 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:07,622 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51312': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:07,623 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51324': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:07,623 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:07,725 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:07,730 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51332': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:07,730 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:07,730 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51346': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:07,834 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:07,838 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51348': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:07,839 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:07,839 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51364': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:07,942 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:07,946 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51372': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:07,946 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:07,947 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51386': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:08,049 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:08,054 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51388': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:08,055 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:08,055 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51400': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:08,157 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:08,161 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51406': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:08,162 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:08,162 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51418': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:08,265 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:08,269 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51428': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:08,269 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:08,270 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51442': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:08,372 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:08,376 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51450': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:08,377 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51464': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:08,377 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:08,479 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:08,484 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51472': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:08,484 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:08,484 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51488': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:08,587 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:08,591 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51504': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:08,592 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:08,592 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51516': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:08,694 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:08,698 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51522': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:08,699 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51530': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:08,699 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:08,802 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:08,807 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51532': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:08,807 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:08,808 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51542': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:08,910 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:08,914 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51544': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:08,915 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:08,915 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51560': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:09,017 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:09,021 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51574': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:09,022 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51588': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:09,022 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:09,124 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:09,129 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51596': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:09,129 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51604': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:09,129 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:09,232 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:09,236 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51616': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:09,236 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:09,237 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51624': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:09,339 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:09,343 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51634': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:09,344 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:09,344 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51636': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:09,446 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:09,451 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51648': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:09,451 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:09,451 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51654': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:09,554 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:09,559 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51656': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:09,559 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:09,560 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51660': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:09,662 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:09,666 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51676': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:09,667 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:09,667 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51682': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:09,769 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:09,773 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51688': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:09,774 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:09,774 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51690': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:09,876 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:09,881 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51702': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:09,881 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:09,882 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51714': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:09,984 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:09,988 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51726': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:09,989 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:09,989 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51728': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:10,091 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:10,096 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51740': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:10,096 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:10,097 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51754': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:10,199 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:10,203 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51766': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:10,204 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:10,204 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51780': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:10,306 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:10,311 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51786': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:10,311 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:10,311 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51800': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:10,413 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:10,418 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51812': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:10,418 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:10,418 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51816': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:10,521 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:10,525 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51820': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:10,526 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:10,526 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51832': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:10,628 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:10,632 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51848': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:10,633 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:10,633 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51858': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:10,736 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:10,740 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51860': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:10,741 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:10,741 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51870': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:10,843 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:10,847 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51886': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:10,848 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51900': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:10,848 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:10,951 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:10,955 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51914': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:10,955 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51924': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:10,955 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:11,058 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:11,062 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51934': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:11,063 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:11,063 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51936': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:11,166 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:11,170 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51948': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:11,170 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:11,171 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51956': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:11,274 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:11,278 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51970': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:11,279 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:11,279 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51978': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:11,381 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:11,386 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51988': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:11,386 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:52002': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:11,386 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:11,489 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:11,493 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:52014': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:11,494 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:52018': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:11,494 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:11,596 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:11,601 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:35640': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:11,601 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:35654': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:11,601 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:11,704 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:11,708 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:35660': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:11,709 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:11,709 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:35672': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:11,811 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:11,816 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:35686': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:11,816 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:11,817 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:35688': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:11,919 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:11,923 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:35702': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:11,924 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:35708': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:11,924 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:12,026 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:12,030 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:35716': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:12,031 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:12,031 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:35728': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:12,134 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:12,138 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:35732': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:12,139 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:12,139 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:35736': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:12,241 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:12,246 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:35740': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:12,246 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:35742': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:12,246 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:12,349 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:12,353 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:35758': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:12,354 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:12,354 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:35768': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:12,457 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:12,461 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:35784': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:12,462 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:12,462 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:35798': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:12,564 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:12,569 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:35804': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:12,569 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:12,569 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:35808': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:12,672 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:12,676 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:35820': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:12,677 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:12,677 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:35830': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:12,779 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:12,783 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:35846': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:12,784 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:35848': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:12,784 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:12,886 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:12,891 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:35864': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:12,891 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:12,891 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:35866': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:12,995 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:12,999 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:35876': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:13,000 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:35888': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:13,000 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:13,102 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:13,107 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:35892': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:13,107 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:13,111 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:35908': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:13,210 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:13,214 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:35918': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:13,215 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:35928': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:13,215 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:13,317 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:13,321 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:35940': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:13,322 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:35944': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:13,322 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:13,425 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:13,429 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:35956': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:13,429 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:13,430 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:35962': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:13,532 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:13,536 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:35974': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:13,537 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:13,537 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:35978': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:13,640 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:13,645 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:35992': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:13,645 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:13,645 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:35996': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:13,748 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:13,752 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36008': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:13,752 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:13,753 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36014': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:13,855 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:13,860 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36026': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:13,860 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:13,860 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36034': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:13,962 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:13,967 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36036': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:13,967 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36040': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:13,967 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:14,070 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:14,074 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36054': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:14,075 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36068': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:14,075 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:14,177 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:14,182 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36070': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:14,182 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:14,182 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36086': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:14,285 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:14,289 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36102': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:14,290 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:14,290 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36112': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:14,392 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:14,397 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36118': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:14,397 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36134': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:14,397 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:14,500 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:14,504 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36144': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:14,505 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36156': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:14,505 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:14,608 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:14,618 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36158': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:14,619 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36168': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:14,619 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:14,716 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:14,716 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36170': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:14,726 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:14,727 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36172': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:14,824 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:14,824 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36188': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:14,834 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:14,834 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36192': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:14,931 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:14,931 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36206': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:14,941 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:14,941 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36212': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:15,039 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:15,039 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36216': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:15,048 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:15,048 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36226': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:15,146 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:15,147 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36240': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:15,155 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:15,155 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36254': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:15,254 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:15,254 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36258': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:15,262 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:15,262 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36262': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:15,362 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:15,362 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36278': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:15,369 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:15,369 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36286': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:15,469 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:15,469 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36298': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:15,476 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:15,476 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36302': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:15,577 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:15,577 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36312': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:15,583 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:15,584 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36314': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:15,685 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:15,690 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36322': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:15,691 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:15,691 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36334': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:15,793 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:15,793 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36350': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:15,798 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:15,799 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36364': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:15,900 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:15,901 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36380': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:15,906 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:15,906 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36390': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:16,008 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:16,013 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36406': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:16,013 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:16,013 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36414': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:16,117 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:16,121 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36426': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:16,122 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36428': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:16,122 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:16,224 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:16,229 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36444': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:16,229 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:16,229 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36446': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:16,332 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:16,336 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36454': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:16,337 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:16,337 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36470': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:16,440 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:16,444 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36478': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:16,445 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36484': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:16,445 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:16,547 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:16,552 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36496': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:16,552 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:16,552 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36506': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:16,655 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:16,659 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36512': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:16,660 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:16,660 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36528': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:16,763 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:16,767 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36542': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:16,767 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:16,767 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36554': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:16,870 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:16,874 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36570': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:16,875 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36580': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:16,875 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:16,977 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:16,982 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36588': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:16,982 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:16,983 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36600': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:17,085 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:17,089 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36602': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:17,090 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:17,090 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36604': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:17,193 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:17,197 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36614': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:17,197 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:17,198 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36628': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:17,300 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:17,304 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36640': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:17,305 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:17,305 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36654': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:17,407 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:17,412 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36660': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:17,412 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:17,412 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36666': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:17,515 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:17,519 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36682': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:17,520 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36686': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:17,520 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:17,622 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:17,626 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36694': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:17,627 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:17,627 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36710': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:17,730 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:17,734 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:17,735 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:17,735 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36728': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:17,837 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:17,841 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36732': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:17,842 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:17,842 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36736': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:17,945 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:17,949 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36742': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:17,950 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:17,950 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36758': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:18,052 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:18,057 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36766': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:18,057 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:18,057 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36772': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:18,161 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:18,165 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36782': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:18,166 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:18,166 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36792': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:18,268 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:18,273 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36802': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:18,273 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36808': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:18,273 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:18,376 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:18,380 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36814': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:18,381 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36820': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:18,381 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:18,485 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:18,490 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36824': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:18,490 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:18,490 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36828': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:18,593 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:18,597 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36834': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:18,598 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:18,598 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36848': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:18,700 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:18,705 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36856': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:18,705 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:18,705 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36866': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:18,808 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:18,813 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36882': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:18,813 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:18,813 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36898': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:18,915 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:18,920 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36910': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:18,920 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:18,921 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36918': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:19,023 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:19,028 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36926': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:19,028 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:19,028 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36938': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:19,131 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:19,136 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36954': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:19,136 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:19,136 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36964': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:19,239 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:19,243 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36974': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:19,244 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:19,244 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36980': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:19,346 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:19,351 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:36988': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:19,351 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:19,352 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:37004': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:19,454 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:19,459 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:37008': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:19,459 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:19,459 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:37010': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:19,562 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:19,567 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:37024': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:19,567 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:19,567 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:37040': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:19,670 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:19,674 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:37046': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:19,675 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:37056': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:19,675 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:19,777 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:19,782 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:37058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:19,782 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:19,782 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:37068': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:19,886 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:19,890 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:37070': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:19,891 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:19,891 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:37082': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:19,993 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:19,998 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:37088': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:19,998 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:19,998 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:37098': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:20,101 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:20,105 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:37112': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:20,106 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:20,106 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:37126': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:20,208 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:20,213 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:37130': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:20,213 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:20,213 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:37146': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:20,315 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:20,320 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:37148': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:20,320 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:20,320 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:37160': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:20,423 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:20,427 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:37168': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:20,428 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:20,428 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:37172': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:20,530 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:20,535 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:37182': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:20,535 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:20,535 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:37198': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:20,637 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:20,642 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:37200': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:20,642 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:20,643 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:37216': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:20,745 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:20,749 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:37218': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:20,750 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:20,750 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:37230': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:20,853 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:20,857 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:37246': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:20,857 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:20,858 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:37258': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:20,960 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:20,964 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:37268': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:20,965 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:37270': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:20,965 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:21,067 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:21,072 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:37280': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:21,072 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:21,072 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:37290': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:21,175 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:21,179 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:37300': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:21,180 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:21,180 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:37314': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:21,283 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:21,287 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:37318': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:21,288 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:21,288 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:37324': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:21,390 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:21,394 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:37332': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:21,395 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:37348': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:21,395 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:21,498 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:21,502 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:37352': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:21,502 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:21,502 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:37354': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:21,606 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:21,611 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45514': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:21,611 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:21,615 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45526': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:21,713 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:21,718 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45542': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:21,718 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:21,719 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45554': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:21,821 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:21,825 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45560': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:21,825 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:21,826 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45572': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:21,928 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:21,932 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45574': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:21,933 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:21,933 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45582': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:22,035 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:22,039 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45588': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:22,040 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:22,040 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45604': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:22,142 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:22,147 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45610': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:22,147 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:22,148 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45612': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:22,250 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:22,254 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45622': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:22,255 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:22,255 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45626': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:22,357 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:22,362 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45642': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:22,362 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:22,363 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45652': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:22,465 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:22,469 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45662': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:22,470 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45670': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:22,470 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:22,572 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:22,577 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45676': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:22,578 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:22,578 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45688': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:22,680 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:22,684 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45704': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:22,685 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:22,685 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45708': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:22,788 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:22,792 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45722': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:22,793 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:22,793 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:22,895 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:22,899 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45730': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:22,900 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:22,900 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45734': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:23,003 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:23,007 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45740': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:23,008 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:23,008 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45746': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:23,110 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:23,119 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45762': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:23,120 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45774': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:23,120 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:23,217 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:23,218 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45780': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:23,227 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:23,227 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45788': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:23,327 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:23,327 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45794': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:23,335 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:23,336 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45810': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:23,435 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:23,435 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45818': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:23,443 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:23,443 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45832': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:23,542 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:23,542 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45842': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:23,550 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:23,550 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45850': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:23,650 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:23,650 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45854': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:23,657 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:23,657 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45864': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:23,757 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:23,758 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45866': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:23,764 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:23,765 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45872': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:23,865 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:23,865 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45884': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:23,871 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:23,872 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45894': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:23,973 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:23,973 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45904': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:23,979 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:23,979 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45914': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:24,080 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:24,080 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45924': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:24,087 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:24,087 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45930': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:24,188 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:24,193 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45944': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:24,194 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:24,194 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45960': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:24,296 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:24,300 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45962': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:24,301 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45970': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:24,301 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:24,403 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:24,408 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45978': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:24,408 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:24,409 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:45992': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:24,511 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:24,516 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46006': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:24,516 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:24,517 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46020': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:24,619 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:24,624 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46034': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:24,624 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:24,624 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46042': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:24,727 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:24,731 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46056': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:24,732 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:24,732 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46072': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:24,835 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:24,839 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46088': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:24,840 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:24,840 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46090': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:24,942 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:24,946 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46100': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:24,947 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:24,947 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46102': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:25,050 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:25,055 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46108': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:25,056 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:25,056 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46110': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:25,158 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:25,162 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46120': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:25,163 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:25,163 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46130': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:25,266 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:25,270 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46140': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:25,271 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:25,271 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46154': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:25,373 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:25,377 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46166': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:25,377 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46168': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:25,377 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:25,480 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:25,485 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46176': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:25,486 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46184': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:25,485 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:25,588 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:25,592 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46196': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:25,593 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:25,593 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46204': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:25,695 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:25,699 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46206': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:25,700 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46208': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:25,700 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:25,803 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:25,807 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46212': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:25,808 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:25,808 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46214': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:25,910 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:25,915 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46228': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:25,916 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46242': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:25,916 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:26,018 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:26,022 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46252': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:26,023 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:26,023 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46262': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:26,125 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:26,129 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46266': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:26,130 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:26,130 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46274': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:26,232 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:26,237 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46288': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:26,238 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:26,238 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46298': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:26,340 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:26,344 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46306': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:26,345 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:26,345 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46322': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:26,447 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:26,452 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46334': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:26,452 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:26,452 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46340': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:26,555 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:26,559 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46344': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:26,560 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:26,560 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46350': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:26,663 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:26,667 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46356': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:26,667 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:26,667 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46358': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:26,771 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:26,775 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46362': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:26,776 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:26,776 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46370': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:26,878 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:26,883 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46380': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:26,883 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:26,883 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46388': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:26,986 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:26,990 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46396': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:26,991 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:26,991 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46408': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:27,094 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:27,098 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46424': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:27,099 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46440': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:27,099 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:27,201 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:27,205 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46454': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:27,206 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46456': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:27,206 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:27,309 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:27,313 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46462': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:27,314 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:27,314 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46478': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:27,416 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:27,420 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46484': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:27,421 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:27,421 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46492': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:27,523 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:27,528 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46502': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:27,529 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46516': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:27,529 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:27,631 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:27,635 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46520': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:27,636 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46530': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:27,636 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:27,738 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:27,742 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46534': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:27,743 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:27,743 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46540': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:27,846 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:27,850 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46546': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:27,851 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:27,851 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46554': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:27,953 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:27,958 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46568': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:27,958 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46580': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:27,958 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:28,061 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:28,065 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46594': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:28,066 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46600': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:28,066 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:28,170 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:28,174 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46606': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:28,175 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46618': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:28,175 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:28,277 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:28,281 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46622': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:28,282 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:28,282 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46636': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:28,385 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:28,389 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46650': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:28,389 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46656': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:28,389 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:28,493 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:28,497 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46670': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:28,498 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46686': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:28,498 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:28,600 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:28,605 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46698': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:28,605 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:28,605 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46704': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:28,708 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:28,712 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46710': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:28,713 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:28,713 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46722': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:28,815 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:28,820 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46738': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:28,820 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:28,820 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46746': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:28,923 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:28,927 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46762': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:28,928 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46764': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:28,928 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:29,030 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:29,034 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46780': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:29,035 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46786': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:29,035 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:29,138 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:29,142 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46790': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:29,142 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:29,142 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46804': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:29,245 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:29,249 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46812': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:29,250 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:29,250 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46814': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:29,353 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:29,357 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46818': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:29,357 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:29,358 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46820': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:29,460 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:29,464 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46822': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:29,465 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46828': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:29,465 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:29,567 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:29,573 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46832': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:29,574 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46844': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:29,574 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:29,675 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:29,675 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46848': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:29,681 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:29,681 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46860': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:29,782 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:29,782 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46874': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:29,788 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:29,788 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46890': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:29,890 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:29,895 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46904': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:29,896 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:29,896 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46914': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:29,997 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:30,002 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46916': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:30,003 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:30,003 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46928': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:30,105 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46944': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:30,105 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:30,110 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:30,114 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46946': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:30,213 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:30,217 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46952': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:30,218 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:30,218 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46960': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:30,320 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:30,325 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46968': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:30,325 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46982': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:30,325 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:30,428 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:30,432 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:46990': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:30,433 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47006': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:30,433 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:30,536 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:30,540 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47020': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:30,541 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:30,541 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47030': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:30,643 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:30,648 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47044': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:30,648 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:30,648 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47054': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:30,751 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:30,755 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47062': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:30,756 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47064': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:30,756 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:30,858 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:30,863 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47074': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:30,863 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:30,864 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47078': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:30,966 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:30,970 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47090': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:30,971 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47102': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:30,971 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:31,074 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:31,078 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47116': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:31,078 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:31,079 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47132': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:31,181 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:31,185 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47142': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:31,186 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47158': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:31,186 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:31,289 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:31,293 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47160': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:31,293 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:31,294 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47174': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:31,396 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:31,400 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47186': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:31,401 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:31,401 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47202': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:31,503 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:31,508 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47206': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:31,508 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:31,509 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:47216': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:31,611 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:31,619 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:39640': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:31,620 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:39646': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:31,620 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:31,718 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:31,719 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:39660': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:31,727 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:31,727 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:39668': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:31,826 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:31,826 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:39678': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:31,834 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:31,835 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:39682': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:31,934 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:31,934 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:39686': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:31,942 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:31,942 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:39688': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:32,042 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:32,042 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:39700': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:32,049 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:32,049 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:39702': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:32,150 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:32,150 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:39712': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:32,156 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:32,156 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:39722': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:32,257 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:32,257 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:39732': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:32,263 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:32,264 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:39748': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:32,365 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:32,370 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:39762': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:32,370 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:32,370 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:39770': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:32,473 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:32,477 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:39778': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:32,477 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:39786': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:32,477 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:32,580 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:32,584 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:39794': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:32,585 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:39798': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:32,585 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:32,687 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:32,691 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:39800': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:32,692 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:32,692 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:39816': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:32,795 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:32,799 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:39824': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:32,800 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:32,800 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:39834': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:32,902 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:32,907 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:39840': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:32,907 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:32,907 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:39844': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:33,011 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:33,015 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:39860': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:33,016 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:39862': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:33,016 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:33,118 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:33,122 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:39874': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:33,123 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:33,123 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:39890': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:33,226 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:33,230 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:39892': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:33,231 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:33,231 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:39906': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:33,333 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:33,338 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:39912': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:33,338 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:39916': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:33,338 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:33,441 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:33,445 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:39920': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:33,446 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:39924': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:33,446 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:33,548 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:33,552 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:39934': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:33,553 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:33,553 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:39942': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:33,656 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:33,661 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:39948': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:33,661 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:39964': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:33,661 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:33,764 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:33,768 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:39972': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:33,769 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:33,769 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:39978': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:33,871 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:33,876 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:39988': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:33,876 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:33,876 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:39990': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:33,979 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:33,983 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40002': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:33,983 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:33,984 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40014': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:34,086 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:34,091 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40030': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:34,091 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:34,091 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40032': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:34,194 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:34,198 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40040': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:34,199 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40054': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:34,199 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:34,301 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:34,305 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40060': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:34,306 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:34,306 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40074': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:34,409 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:34,413 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40090': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:34,414 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:34,414 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40096': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:34,516 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:34,520 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40104': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:34,521 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40112': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:34,521 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:34,623 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:34,627 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40116': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:34,628 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:34,628 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40132': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:34,730 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:34,734 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40138': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:34,735 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:34,735 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40152': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:34,838 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:34,842 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40162': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:34,843 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40164': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:34,843 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:34,945 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:34,949 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40176': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:34,950 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40188': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:34,950 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:35,053 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:35,057 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40192': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:35,057 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40202': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:35,057 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:35,160 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:35,164 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40216': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:35,165 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40226': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:35,165 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:35,267 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:35,272 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40242': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:35,272 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40254': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:35,272 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:35,376 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:35,380 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40268': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:35,381 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40284': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:35,381 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:35,483 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:35,487 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40294': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:35,488 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:35,488 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40304': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:35,591 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:35,595 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40314': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:35,596 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40318': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:35,595 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:35,698 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:35,702 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40334': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:35,703 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40342': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:35,703 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:35,805 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:35,810 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40352': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:35,810 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:35,810 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40360': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:35,913 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:35,917 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40362': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:35,918 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40368': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:35,918 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:36,020 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:36,025 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40372': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:36,025 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40388': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:36,025 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:36,128 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:36,132 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40402': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:36,133 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40418': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:36,133 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:36,235 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:36,239 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40426': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:36,240 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40436': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:36,240 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:36,342 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:36,346 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40440': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:36,347 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40448': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:36,347 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:36,450 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:36,454 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40464': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:36,454 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40470': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:36,455 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:36,557 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:36,561 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40472': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:36,562 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:36,562 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40484': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:36,664 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:36,664 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40488': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:36,670 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:36,670 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40496': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:36,771 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:36,776 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40504': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:36,777 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:36,777 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40514': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:36,879 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:36,883 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40520': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:36,884 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40534': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:36,884 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:36,986 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:36,991 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40536': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:36,991 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:36,991 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40538': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:37,095 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:37,099 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40548': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:37,100 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40552': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:37,100 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:37,202 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:37,207 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40558': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:37,207 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:37,207 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40568': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:37,310 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:37,314 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40580': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:37,315 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:37,315 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40588': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:37,418 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:37,422 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40602': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:37,422 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40618': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:37,422 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:37,525 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:37,529 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40634': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:37,530 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:37,530 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40646': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:37,632 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:37,637 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40654': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:37,637 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:37,637 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40658': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:37,740 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:37,744 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40664': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:37,745 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:37,745 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40668': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:37,848 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:37,852 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40674': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:37,853 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40682': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:37,853 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:37,956 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:37,960 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40698': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:37,961 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40706': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:37,961 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:38,063 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:38,067 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40716': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:38,068 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:38,068 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40730': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:38,171 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:38,175 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40734': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:38,175 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40736': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:38,175 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:38,278 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:38,282 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40738': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:38,283 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:38,283 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40744': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:38,385 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:38,390 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40746': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:38,390 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:38,390 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40756': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:38,493 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:38,497 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40760': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:38,498 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40770': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:38,498 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:38,600 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:38,604 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40782': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:38,605 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40784': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:38,605 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:38,708 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:38,712 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40790': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:38,713 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40792': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:38,713 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:38,816 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:38,820 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40798': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:38,821 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40812': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:38,821 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:38,924 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:38,928 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40828': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:38,928 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:38,928 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40844': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:39,031 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:39,035 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40858': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:39,036 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40864': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:39,036 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:39,138 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:39,143 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40880': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:39,143 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:39,143 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40896': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:39,246 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:39,250 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40904': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:39,251 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40906': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:39,251 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:39,353 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:39,358 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40922': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:39,358 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:39,359 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40934': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:39,461 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:39,465 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40940': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:39,465 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:39,465 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40944': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:39,568 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:39,574 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40954': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:39,574 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40968': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:39,574 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:39,675 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:39,675 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40978': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:39,682 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:39,682 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:40992': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:39,783 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:39,788 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41004': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:39,789 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:39,789 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41014': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:39,891 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:39,895 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41028': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:39,896 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41044': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:39,896 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:39,998 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:39,998 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41060': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:40,004 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:40,004 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41068': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:40,106 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:40,110 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41078': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:40,110 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:40,114 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41080': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:40,214 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:40,218 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41082': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:40,219 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:40,219 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41086': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:40,321 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:40,325 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41102': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:40,326 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:40,326 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41106': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:40,429 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:40,433 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41114': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:40,433 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:40,434 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41120': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:40,537 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:40,541 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:40,542 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:40,542 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41134': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:40,645 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:40,649 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41142': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:40,650 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:40,650 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41154': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:40,752 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:40,756 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41162': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:40,757 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:40,757 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41176': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:40,860 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:40,864 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41184': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:40,865 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:40,865 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41196': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:40,967 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:40,972 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41210': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:40,972 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:40,972 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41222': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:41,075 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:41,080 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41226': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:41,080 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:41,080 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41242': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:41,183 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:41,187 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41250': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:41,188 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:41,188 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41256': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:41,291 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:41,295 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41268': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:41,295 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:41,296 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41276': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:41,398 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:41,403 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41292': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:41,403 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:41,403 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41302': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:41,506 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:41,510 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41312': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:41,511 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:41,511 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:41324': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:41,617 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:41,621 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:49400': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:41,622 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:41,622 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:49402': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:41,725 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:41,729 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:49410': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:41,729 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:41,730 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:49422': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:41,832 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:41,836 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:49424': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:41,837 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:41,837 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:49430': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:41,939 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:41,944 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:49438': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:41,944 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:41,944 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:49450': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:42,047 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:42,051 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:49452': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:42,052 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:42,052 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:49456': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:42,155 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:42,159 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:49462': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:42,160 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:49470': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:42,160 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:42,263 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:42,267 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:49474': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:42,268 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:42,268 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:49490': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:42,370 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:42,375 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:49506': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:42,375 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:42,376 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:49514': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:42,479 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:42,483 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:49520': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:42,483 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:42,484 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:49526': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:42,588 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:42,592 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:49536': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:42,592 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:49546': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:42,592 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:42,698 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:42,702 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:49560': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:42,703 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:49566': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:42,703 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:42,807 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:42,812 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:49572': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:42,812 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:42,812 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:49584': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:42,916 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:42,920 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:49600': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:42,921 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:42,921 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:49602': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:43,025 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:43,029 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:49612': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:43,030 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:43,030 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:49628': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:43,134 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:43,138 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:49644': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:43,139 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:43,139 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:49658': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:43,243 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:43,247 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:49666': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:43,248 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:49682': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:43,248 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:43,352 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:43,356 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:49684': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:43,356 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:43,357 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:49696': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:43,461 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:43,465 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:49706': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:43,465 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:43,466 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:49718': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:43,570 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:43,574 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:49728': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:43,575 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:43,575 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:49736': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:43,679 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:43,683 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:49750': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:43,684 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:43,684 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:49756': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:43,788 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:43,792 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:49760': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:43,793 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:43,793 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:49764': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:43,897 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:43,901 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:49780': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:43,902 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:43,902 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:49784': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:44,007 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:44,011 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:49796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:44,011 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:44,012 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:49812': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:44,119 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:44,122 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:49824': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:44,123 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:44,123 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:49840': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:44,228 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:44,232 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:49846': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:44,232 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:44,233 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:49848': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:44,337 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:44,341 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:49852': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:44,342 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:44,342 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:49866': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:44,446 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:44,450 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:49882': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:44,450 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:44,451 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:49898': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:44,555 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:44,559 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:49902': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:44,560 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:44,560 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:49910': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:44,664 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:44,668 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:49926': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:44,668 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:49940': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:44,668 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:44,773 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:44,777 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:49956': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:44,777 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:49962': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:44,777 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:44,882 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:44,885 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:49970': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:44,886 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:49974': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:44,886 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:44,991 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:44,994 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:49984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:44,995 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:44,995 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:49998': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:45,100 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:45,104 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50012': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:45,104 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:45,104 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50028': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:45,209 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:45,213 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50044': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:45,214 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50046': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:45,214 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:45,318 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:45,322 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50050': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:45,322 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:45,322 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50062': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:45,427 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:45,431 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50076': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:45,431 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:45,432 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50086': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:45,536 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:45,540 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50100': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:45,540 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:45,541 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50112': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:45,645 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:45,649 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50120': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:45,650 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:45,650 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:45,755 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:45,759 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50136': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:45,760 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:45,760 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50152': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:45,864 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:45,868 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50156': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:45,869 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:45,869 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50164': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:45,973 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:45,977 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50180': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:45,978 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:45,978 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50184': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:46,082 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:46,086 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50192': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:46,087 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:46,087 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50204': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:46,191 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:46,195 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50206': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:46,196 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:46,196 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50212': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:46,300 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:46,304 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50222': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:46,304 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:46,305 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50226': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:46,409 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:46,413 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50236': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:46,414 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:46,414 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50242': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:46,518 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:46,522 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50258': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:46,523 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50268': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:46,522 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:46,627 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:46,630 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50276': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:46,631 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:46,631 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50292': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:46,736 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:46,740 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50302': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:46,740 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50306': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:46,740 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:46,845 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:46,849 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50320': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:46,849 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50336': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:46,849 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:46,954 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:46,958 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50350': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:46,958 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50356': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:46,958 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:47,063 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:47,067 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50368': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:47,067 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:47,067 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50378': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:47,172 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:47,175 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50380': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:47,176 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50392': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:47,176 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:47,280 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:47,284 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50396': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:47,285 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50412': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:47,285 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:47,390 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:47,394 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50424': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:47,394 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:47,394 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50436': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:47,499 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:47,503 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50446': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:47,504 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:47,504 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50450': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:47,610 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:47,619 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50462': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:47,619 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:47,619 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50470': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:47,719 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50484': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:47,719 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:47,726 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:47,726 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50490': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:47,828 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50506': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:47,828 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:47,834 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:47,834 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50520': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:47,936 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:47,940 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50524': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:47,941 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50530': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:47,941 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:48,045 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:48,049 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50542': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:48,050 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:48,050 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50548': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:48,153 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:48,157 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50556': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:48,158 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50568': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:48,158 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:48,261 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:48,265 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50584': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:48,266 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50590': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:48,266 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:48,370 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:48,374 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50596': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:48,375 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:48,375 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50604': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:48,479 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:48,483 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50616': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:48,484 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50620': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:48,484 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:48,588 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:48,592 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50626': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:48,593 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50632': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:48,593 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:48,697 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:48,701 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50638': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:48,701 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50652': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:48,701 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:48,806 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:48,810 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50666': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:48,810 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:48,811 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50676': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:48,915 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:48,919 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50688': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:48,919 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50694': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:48,919 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:49,023 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:49,027 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50704': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:49,028 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:49,028 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50708': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:49,132 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:49,136 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50712': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:49,137 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:49,137 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50714': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:49,242 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:49,246 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50716': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:49,246 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:49,246 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50730': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:49,351 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:49,354 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50744': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:49,355 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:49,355 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50760': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:49,459 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:49,463 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50770': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:49,464 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50782': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:49,464 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:49,568 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:49,572 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50798': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:49,573 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:49,573 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50800': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:49,677 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:49,681 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50806': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:49,681 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:49,681 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50814': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:49,786 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:49,790 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50824': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:49,790 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:49,790 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50830': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:49,895 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:49,899 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50844': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:49,899 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:49,899 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50846': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:50,004 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:50,008 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50852': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:50,008 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:50,008 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50854': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:50,116 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:50,120 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50868': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:50,121 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50878': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:50,121 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:50,224 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:50,228 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50890': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:50,229 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:50,229 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50896': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:50,331 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:50,335 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50898': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:50,336 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:50,336 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50914': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:50,438 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:50,443 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50928': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:50,443 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:50,443 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50942': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:50,546 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:50,550 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50948': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:50,551 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50960': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:50,551 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:50,653 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:50,658 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50974': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:50,658 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50980': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:50,658 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:50,761 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:50,765 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:50,765 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:50,766 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50988': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:50,868 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:50,872 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51000': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:50,873 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:50,873 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51004': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:50,977 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:50,981 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51008': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:50,981 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:50,981 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51010': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:51,084 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:51,088 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51018': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:51,089 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51024': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:51,089 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:51,191 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:51,196 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51026': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:51,196 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51040': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:51,196 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:51,299 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:51,303 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51046': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:51,304 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:51,304 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51050': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:51,406 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:51,411 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51056': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:51,411 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:51,411 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51072': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:51,514 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:51,518 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51078': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:51,519 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51090': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:51,519 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:51,621 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:51,625 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50376': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:51,626 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:51,626 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50386': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:51,729 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:51,733 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50400': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:51,733 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:51,734 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50416': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:51,836 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:51,840 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50418': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:51,841 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50420': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:51,841 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:51,943 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:51,947 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50434': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:51,948 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50442': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:51,948 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:52,050 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:52,054 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50456': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:52,054 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50464': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:52,054 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:52,157 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:52,161 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50472': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:52,161 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50476': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:52,161 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:52,264 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:52,268 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50484': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:52,269 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50492': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:52,269 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:52,371 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50506': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:52,371 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:52,376 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50510': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:52,376 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:52,479 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:52,479 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50512': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:52,484 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50514': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:52,484 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:52,585 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50522': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:52,585 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:52,591 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50524': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:52,591 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:52,693 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:52,698 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50536': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:52,698 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50544': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:52,698 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:52,801 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:52,805 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50556': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:52,805 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50558': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:52,805 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:52,908 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:52,912 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50562': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:52,913 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50576': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:52,913 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:53,016 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:53,019 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50584': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:53,020 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50588': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:53,020 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:53,127 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:53,131 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50594': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:53,131 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50596': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:53,131 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:53,235 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:53,238 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50612': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:53,239 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50618': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:53,239 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:53,342 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:53,346 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50628': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:53,346 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50632': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:53,346 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:53,449 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:53,453 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50648': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:53,454 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50658': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:53,454 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:53,556 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:53,560 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50666': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:53,561 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50682': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:53,561 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:53,663 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:53,667 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50696': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:53,667 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50706': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:53,667 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:53,770 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:53,774 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50720': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:53,775 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50736': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:53,775 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:53,877 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:53,881 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50740': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:53,882 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50756': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:53,882 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:53,985 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:53,988 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50758': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:53,989 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50760': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:53,989 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:54,092 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:54,096 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50772': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:54,097 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50778': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:54,097 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:54,200 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:54,203 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50782': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:54,204 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50784': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:54,204 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:54,307 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:54,311 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50800': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:54,311 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50810': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:54,311 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:54,415 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:54,419 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50822': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:54,419 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50830': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:54,419 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:54,522 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:54,526 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50844': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:54,526 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50848': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:54,526 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:54,629 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:54,633 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50854': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:54,634 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50858': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:54,634 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:54,736 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:54,740 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50872': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:54,741 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50880': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:54,741 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:54,844 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:54,847 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50882': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:54,848 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50892': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:54,848 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:54,951 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:54,955 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50898': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:54,955 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50914': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:54,955 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:55,058 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:55,062 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50930': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:55,063 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50932': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:55,063 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:55,165 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:55,169 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50944': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:55,170 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50946': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:55,170 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:55,272 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:55,276 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50958': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:55,277 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50966': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:55,277 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:55,379 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:55,383 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50980': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:55,384 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:50994': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:55,384 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:55,486 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:55,490 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51002': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:55,491 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51016': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:55,491 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:55,593 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:55,597 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51032': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:55,598 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51044': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:55,598 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:55,700 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:55,704 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51054': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:55,705 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51060': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:55,705 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:55,807 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:55,811 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51068': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:55,812 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51070': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:55,812 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:55,914 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:55,918 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51080': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:55,919 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51094': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:55,919 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:56,022 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:56,025 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51108': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:56,026 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51124': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:56,026 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:56,129 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:56,133 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51130': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:56,134 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51140': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:56,134 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:56,236 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:56,240 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51150': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:56,241 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51162': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:56,241 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:56,343 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:56,347 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51172': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:56,348 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51186': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:56,348 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:56,451 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:56,454 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51192': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:56,455 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51194': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:56,455 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:56,558 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:56,562 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51210': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:56,563 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:56,563 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51218': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:56,665 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:56,670 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51222': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:56,670 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:56,670 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51236': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:56,773 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:56,777 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51248': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:56,778 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:56,778 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51256': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:56,880 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:56,885 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51260': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:56,885 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:56,885 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51268': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:56,988 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:56,992 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51272': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:56,992 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:56,992 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51286': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:57,095 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:57,100 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51294': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:57,100 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:57,100 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51304': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:57,203 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:57,207 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51316': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:57,208 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:57,208 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51328': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:57,311 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:57,316 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51332': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:57,316 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51348': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:57,316 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:57,418 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:57,423 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51358': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:57,423 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:57,424 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51362': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:57,526 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:57,530 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51370': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:57,530 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:57,531 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51382': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:57,633 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:57,637 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51388': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:57,638 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:57,638 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51402': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:57,740 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:57,745 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51404': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:57,745 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51408': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:57,745 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:57,848 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:57,853 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51410': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:57,853 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51416': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:57,853 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:57,956 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:57,960 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51430': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:57,961 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:57,961 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51432': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:58,063 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:58,068 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51438': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:58,068 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51442': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:58,068 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:58,171 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:58,175 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51454': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:58,175 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:58,176 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51456': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:58,278 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:58,282 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51458': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:58,283 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51470': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:58,283 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:58,385 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:58,390 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51474': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:58,390 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:58,390 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51478': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:58,493 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:58,497 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51480': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:58,497 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:58,498 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51486': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:58,600 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:58,605 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51488': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:58,605 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51496': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:58,605 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:58,708 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:58,713 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51512': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:58,713 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51520': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:58,713 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:58,816 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:58,820 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51526': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:58,820 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:58,821 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51542': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:58,923 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:58,927 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51546': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:58,928 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:58,928 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51562': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:59,030 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:59,035 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51564': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:59,035 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:59,036 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51570': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:59,138 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:59,142 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51576': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:59,143 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51580': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:59,143 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:59,245 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:59,250 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51596': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:59,250 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51610': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:59,250 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:59,353 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:59,357 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51612': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:59,358 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:59,358 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51618': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:59,460 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:59,465 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51632': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:59,465 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51648': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:59,465 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:59,569 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:59,575 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51656': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:59,575 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:59,575 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51658': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:59,676 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:59,676 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51660': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:59,682 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:59,682 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51664': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:59,783 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:59,784 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51668': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:59,790 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:59,790 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51670': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:59,891 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:59,891 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51672': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:59,897 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:35:59,897 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51684': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:35:59,998 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:00,003 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51692': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:00,004 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:00,004 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51696': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:00,106 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:00,111 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51706': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:00,111 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:00,116 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51722': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:00,213 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:00,218 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51732': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:00,218 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:00,218 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51748': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:00,321 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:00,325 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51756': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:00,326 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51764': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:00,326 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:00,429 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:00,433 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51780': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:00,433 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51782': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:00,433 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:00,536 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:00,540 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51790': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:00,541 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51794': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:00,541 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:00,643 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:00,648 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51806': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:00,648 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51808': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:00,648 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:00,751 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:00,755 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51816': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:00,756 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51822': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:00,756 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:00,858 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:00,863 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51836': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:00,863 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:00,863 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51840': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:00,966 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:00,970 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51850': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:00,971 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51864': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:00,971 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:01,073 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:01,077 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51880': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:01,078 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:01,078 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51890': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:01,180 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:01,185 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51906': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:01,185 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:01,185 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51912': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:01,289 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:01,293 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51926': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:01,294 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51928': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:01,294 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:01,396 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:01,401 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51930': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:01,401 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:01,401 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51946': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:01,504 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:01,508 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51956': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:01,509 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:01,509 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:51962': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:01,611 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:01,620 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57820': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:01,620 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:01,621 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57822': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:01,719 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:01,719 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57836': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:01,728 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:01,728 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57842': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:01,826 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:01,826 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57848': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:01,835 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:01,835 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57850': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:01,934 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:01,934 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57858': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:01,943 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:01,943 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57872': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:02,041 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:02,042 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57886': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:02,050 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:02,050 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57900': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:02,150 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:02,150 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57916': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:02,158 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:02,158 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57922': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:02,258 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:02,258 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57936': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:02,265 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:02,265 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57950': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:02,365 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:02,366 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57956': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:02,372 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:02,372 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57968': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:02,473 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:02,473 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57978': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:02,479 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:02,479 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:02,581 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:02,586 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:57996': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:02,586 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:02,587 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58012': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:02,688 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:02,693 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58024': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:02,693 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:02,693 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58036': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:02,796 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:02,800 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58048': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:02,800 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:02,800 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58054': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:02,903 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:02,908 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58060': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:02,908 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:02,908 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58072': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:03,012 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:03,016 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58084': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:03,017 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58088': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:03,017 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:03,119 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:03,123 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58096': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:03,124 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:03,124 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58098': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:03,226 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:03,231 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58106': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:03,231 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:03,231 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58120': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:03,334 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:03,338 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58134': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:03,339 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:03,339 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58148': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:03,441 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:03,446 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58158': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:03,446 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:03,446 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58162': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:03,549 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:03,553 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58178': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:03,554 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:03,554 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58182': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:03,656 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:03,661 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58188': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:03,661 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:03,661 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58190': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:03,764 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:03,768 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58192': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:03,769 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:03,769 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58202': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:03,871 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:03,875 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58206': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:03,876 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:03,876 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58216': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:03,978 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:03,983 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58226': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:03,983 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:03,983 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58236': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:04,085 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:04,090 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58244': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:04,090 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:04,090 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58252': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:04,193 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:04,197 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58266': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:04,197 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:04,198 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58272': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:04,300 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:04,304 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58286': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:04,305 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:04,305 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58296': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:04,407 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:04,412 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58298': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:04,412 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:04,413 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58302': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:04,514 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:04,519 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58316': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:04,520 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:04,520 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58320': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:04,622 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:04,626 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58326': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:04,627 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:04,627 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58338': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:04,730 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:04,734 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58340': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:04,734 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:04,734 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58342': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:04,837 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:04,841 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58350': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:04,842 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58362': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:04,842 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:04,944 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:04,948 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58370': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:04,949 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:04,949 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58378': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:05,051 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:05,056 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58388': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:05,056 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:05,056 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58390': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:05,159 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:05,163 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58394': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:05,164 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:05,164 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58402': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:05,266 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:05,270 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58418': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:05,271 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:05,271 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58430': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:05,373 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:05,378 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58434': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:05,378 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:05,378 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58446': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:05,481 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:05,485 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58456': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:05,486 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:05,486 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58462': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:05,588 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:05,592 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58472': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:05,593 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58488': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:05,593 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:05,695 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:05,700 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58502': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:05,700 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:05,700 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58508': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:05,803 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:05,807 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58516': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:05,808 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:05,808 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58520': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:05,910 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:05,915 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58528': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:05,915 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:05,915 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58542': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:06,017 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:06,021 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58544': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:06,022 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:06,022 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58546': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:06,124 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:06,128 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58558': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:06,129 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:06,129 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58572': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:06,231 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:06,235 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58586': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:06,236 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58602': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:06,236 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:06,338 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:06,342 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58606': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:06,343 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:06,343 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58618': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:06,446 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:06,450 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58626': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:06,451 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58632': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:06,451 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:06,553 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:06,558 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58644': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:06,558 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:06,558 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58650': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:06,661 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:06,665 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58656': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:06,666 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58660': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:06,666 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:06,768 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:06,772 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58670': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:06,773 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:06,773 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58686': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:06,875 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:06,879 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58692': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:06,880 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58700': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:06,880 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:06,983 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:06,988 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58708': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:06,988 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:06,988 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58712': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:07,091 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:07,095 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58718': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:07,096 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:07,096 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58722': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:07,198 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:07,202 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58734': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:07,203 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:07,203 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58744': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:07,305 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:07,310 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58756': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:07,310 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:07,310 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58760': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:07,412 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:07,417 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58774': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:07,418 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:07,418 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58788': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:07,519 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:07,524 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58792': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:07,525 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:07,525 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58794': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:07,626 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:07,631 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58798': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:07,631 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:07,631 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58808': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:07,733 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:07,738 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58816': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:07,738 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58828': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:07,738 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:07,840 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:07,845 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58844': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:07,845 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:07,845 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58850': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:07,947 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:07,952 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58862': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:07,952 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:07,953 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58866': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:08,054 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:08,059 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58870': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:08,059 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:08,060 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58880': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:08,162 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:08,167 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58882': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:08,167 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:08,168 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58898': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:08,269 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:08,274 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58914': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:08,274 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:08,274 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58920': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:08,376 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:08,381 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58928': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:08,381 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:08,382 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58934': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:08,484 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:08,488 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58940': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:08,489 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:08,489 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58954': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:08,591 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:08,595 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58970': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:08,596 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:08,596 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58982': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:08,698 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:08,702 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:08,703 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58988': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:08,703 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:08,804 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:08,809 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58992': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:08,809 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:08,810 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59004': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:08,911 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:08,916 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59006': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:08,917 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:08,917 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59012': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:09,018 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:09,023 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59014': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:09,024 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:09,024 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59028': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:09,125 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:09,130 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59040': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:09,131 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:09,131 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59054': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:09,232 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:09,237 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59062': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:09,238 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:09,238 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59078': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:09,339 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:09,344 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59080': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:09,344 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:09,344 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59088': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:09,446 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:09,451 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59100': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:09,451 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:09,451 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59110': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:09,553 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:09,559 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:09,560 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:09,560 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59126': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:09,661 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:09,661 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59140': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:09,667 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:09,667 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59142': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:09,768 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:09,768 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59144': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:09,774 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:09,774 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59152': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:09,876 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:09,880 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59158': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:09,881 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:09,881 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59174': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:09,983 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:09,987 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59176': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:09,988 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:09,988 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59182': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:10,090 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:10,094 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59196': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:10,095 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:10,095 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59204': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:10,197 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:10,201 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59214': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:10,202 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:10,202 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59226': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:10,304 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:10,308 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59238': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:10,308 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:10,309 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59254': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:10,411 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:10,416 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59264': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:10,416 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:10,416 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59268': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:10,518 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:10,523 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59278': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:10,523 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:10,523 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59284': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:10,625 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:10,630 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59286': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:10,630 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:10,630 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59300': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:10,732 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:10,737 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59314': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:10,737 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:10,738 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59322': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:10,839 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:10,844 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59326': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:10,844 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:10,845 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59330': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:10,947 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:10,951 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59338': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:10,952 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:10,952 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59344': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:11,054 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:11,059 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59354': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:11,059 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:11,059 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59362': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:11,161 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:11,166 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59366': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:11,167 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:11,167 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59380': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:11,269 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:11,273 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59384': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:11,274 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:11,274 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59392': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:11,376 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:11,381 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59402': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:11,381 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:11,381 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59412': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:11,484 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:11,488 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59420': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:11,489 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59434': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:11,489 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:11,592 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:11,597 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58718': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:11,597 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:11,597 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58728': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:11,700 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:11,704 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58734': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:11,705 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:11,705 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58748': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:11,808 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:11,813 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58760': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:11,813 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:11,813 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58776': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:11,915 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:11,920 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58790': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:11,920 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:11,921 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:12,023 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:12,027 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58812': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:12,028 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58822': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:12,028 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:12,130 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:12,135 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58836': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:12,135 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:12,135 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58842': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:12,237 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:12,242 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58850': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:12,242 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:12,242 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58852': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:12,345 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:12,349 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58866': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:12,350 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:12,350 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58870': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:12,452 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:12,457 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58878': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:12,457 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:12,457 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58884': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:12,559 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:12,564 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58892': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:12,564 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:12,564 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58902': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:12,667 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:12,671 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58908': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:12,672 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:12,672 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58914': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:12,774 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:12,778 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58924': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:12,779 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:12,779 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58926': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:12,881 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:12,885 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58932': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:12,886 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:12,886 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58946': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:12,988 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:12,993 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58960': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:12,993 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:12,994 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58976': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:13,096 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:13,100 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58978': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:13,101 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:13,101 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:58990': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:13,203 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:13,208 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59002': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:13,208 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:13,208 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59006': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:13,311 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:13,316 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59018': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:13,316 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:13,316 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59030': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:13,418 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:13,423 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59042': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:13,423 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:13,423 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59048': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:13,526 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:13,530 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59064': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:13,531 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:13,531 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59068': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:13,633 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:13,637 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59074': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:13,638 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:13,638 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59080': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:13,741 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:13,745 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59094': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:13,746 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:13,746 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59106': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:13,848 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:13,852 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59110': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:13,853 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:13,853 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59124': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:13,955 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:13,960 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59132': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:13,960 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59148': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:13,960 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:14,063 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:14,067 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59156': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:14,068 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:14,068 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59170': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:14,170 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:14,175 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59180': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:14,175 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:14,175 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59182': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:14,277 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:14,282 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59192': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:14,282 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:14,282 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59198': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:14,384 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:14,389 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59212': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:14,389 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:14,390 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59228': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:14,492 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:14,496 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59236': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:14,497 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:14,497 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59238': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:14,600 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:14,606 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59252': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:14,607 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:14,607 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59254': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:14,707 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:14,707 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59260': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:14,714 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:14,714 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59268': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:14,815 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:14,815 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59276': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:14,821 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:14,821 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59282': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:14,922 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:14,923 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59296': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:14,929 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:14,929 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59302': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:15,031 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:15,035 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59306': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:15,036 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:15,036 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59312': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:15,138 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:15,143 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59324': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:15,143 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:15,143 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59330': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:15,246 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:15,250 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59332': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:15,251 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:15,251 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59348': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:15,353 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:15,358 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59356': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:15,358 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:15,358 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59360': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:15,461 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:15,465 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59374': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:15,466 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59376': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:15,466 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:15,569 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:15,573 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59392': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:15,573 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:15,574 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59400': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:15,676 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:15,681 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59412': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:15,681 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:15,681 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59422': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:15,784 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:15,788 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59430': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:15,789 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:15,789 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59440': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:15,891 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:15,895 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59456': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:15,896 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59460': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:15,896 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:15,998 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:16,003 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59464': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:16,003 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59466': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:16,003 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:16,106 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:16,110 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59470': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:16,111 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:16,115 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59478': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:16,213 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:16,217 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59488': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:16,218 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59504': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:16,218 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:16,320 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:16,325 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59508': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:16,325 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59510': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:16,325 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:16,428 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:16,432 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59520': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:16,433 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59534': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:16,433 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:16,535 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:16,540 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59550': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:16,540 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:16,540 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59562': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:16,644 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:16,649 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59574': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:16,649 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59590': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:16,649 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:16,752 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:16,757 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59600': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:16,757 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:16,757 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59602': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:16,860 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:16,864 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59608': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:16,865 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59620': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:16,865 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:16,967 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:16,971 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59636': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:16,972 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:16,972 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59642': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:17,075 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:17,079 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59648': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:17,080 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59658': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:17,080 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:17,182 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:17,187 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59666': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:17,187 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59676': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:17,187 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:17,290 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:17,294 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59686': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:17,294 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:17,295 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59690': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:17,397 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:17,402 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59702': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:17,402 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59714': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:17,402 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:17,505 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:17,509 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:17,510 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:17,510 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59726': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:17,612 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:17,621 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59728': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:17,622 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:17,622 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59734': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:17,720 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:17,720 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59742': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:17,729 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:17,729 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59754': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:17,827 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:17,827 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59758': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:17,836 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:17,837 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59764': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:17,935 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:17,935 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59770': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:17,944 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:17,944 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59784': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:18,043 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:18,043 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59792': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:18,051 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:18,051 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59804': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:18,150 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:18,150 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59820': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:18,158 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:18,159 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59832': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:18,258 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:18,258 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59834': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:18,266 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:18,266 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59844': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:18,365 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:18,366 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59854': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:18,373 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:18,373 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59866': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:18,474 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:18,474 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59882': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:18,480 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:18,480 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59898': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:18,582 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:18,587 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59900': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:18,588 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:18,588 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59916': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:18,689 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:18,694 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59928': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:18,695 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59932': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:18,695 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:18,797 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:18,801 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59938': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:18,802 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:18,802 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59948': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:18,904 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:18,909 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59952': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:18,909 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:18,909 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59966': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:19,012 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:19,016 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59980': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:19,017 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:19,017 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59986': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:19,119 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:19,123 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59996': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:19,124 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59998': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:19,124 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:19,227 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:19,231 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:60002': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:19,232 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:19,232 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:60016': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:19,334 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:19,338 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:60022': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:19,339 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:60036': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:19,339 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:19,442 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:19,446 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:60042': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:19,446 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:19,446 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:60054': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:19,549 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:19,554 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:60066': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:19,554 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:60068': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:19,554 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:19,657 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:19,661 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:60082': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:19,661 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:19,661 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:60084': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:19,764 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:19,769 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:60094': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:19,769 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:60106': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:19,769 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:19,872 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:19,876 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:60110': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:19,877 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:60116': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:19,877 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:19,980 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:19,984 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:60130': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:19,985 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:60134': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:19,985 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:20,087 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:20,092 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:60138': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:20,092 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:20,092 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:60146': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:20,196 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:20,200 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:60148': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:20,201 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:60150': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:20,201 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:20,303 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:20,308 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:60156': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:20,308 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:20,308 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:60166': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:20,411 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:20,415 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:60174': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:20,416 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:20,416 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:60182': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:20,518 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:20,523 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:60186': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:20,523 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:60190': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:20,523 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:20,626 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:20,630 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:60196': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:20,631 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:60212': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:20,631 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:20,733 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:20,738 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:60216': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:20,738 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:60224': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:20,738 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:20,841 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:20,845 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:60234': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:20,845 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:60250': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:20,845 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:20,948 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:20,953 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:60256': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:20,953 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:20,954 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:60266': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:21,056 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:21,060 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:60282': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:21,061 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:60296': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:21,061 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:21,163 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:21,168 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:60308': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:21,168 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:21,168 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:60310': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:21,271 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:21,275 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:60324': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:21,276 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:60338': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:21,276 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:21,378 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:21,383 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:60354': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:21,383 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:21,383 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:60370': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:21,547 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:21,552 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:33752': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:21,552 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:33760': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:21,552 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:21,655 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:21,659 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:33768': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:21,660 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:33782': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:21,660 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:21,762 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:21,767 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:33788': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:21,767 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:21,767 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:33796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:21,870 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:21,874 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:33808': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:21,875 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:33824': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:21,875 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:21,978 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:21,982 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:33840': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:21,983 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:21,983 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:33856': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:22,086 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:22,090 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:33866': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:22,091 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:22,091 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:33874': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:22,193 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:22,198 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:33880': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:22,198 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:22,198 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:33896': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:22,301 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:22,305 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:33898': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:22,306 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:22,306 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:33904': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:22,408 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:22,413 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:33918': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:22,413 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:33930': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:22,413 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:22,516 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:22,520 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:33932': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:22,521 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:22,521 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:33948': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:22,623 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:22,623 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:33964': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:22,629 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:22,629 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:33970': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:22,731 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:22,731 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:33980': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:22,737 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:22,737 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:33984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:22,838 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:22,839 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:33986': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:22,844 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:22,844 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:33992': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:22,946 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:22,951 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:34008': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:22,952 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:22,952 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:34024': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:23,053 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:23,058 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:34028': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:23,059 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:23,059 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:34030': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:23,161 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:23,161 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:34046': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:23,167 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:23,167 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:34058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:23,269 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:23,269 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:34070': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:23,275 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:23,275 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:34082': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:23,376 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:23,377 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:34096': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:23,383 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:23,383 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:34110': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:23,484 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:23,484 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:34112': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:23,490 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:23,490 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:34122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:23,591 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:23,596 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:34124': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:23,597 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:23,597 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:34136': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:23,700 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:23,704 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:34148': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:23,705 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:34154': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:23,705 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:23,807 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:23,812 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:34160': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:23,813 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:34166': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:23,813 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:23,915 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:23,919 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:34182': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:23,920 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:34198': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:23,920 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:24,022 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:24,027 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:34212': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:24,027 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:24,027 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:34226': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:24,129 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:24,134 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:34242': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:24,134 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:24,134 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:34246': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:24,237 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:24,242 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:34256': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:24,242 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:34264': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:24,242 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:24,345 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:24,349 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:34280': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:24,350 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:24,350 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:34284': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:24,452 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:24,457 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:34296': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:24,457 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:34306': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:24,457 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:24,560 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:24,564 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:34312': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:24,565 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:34322': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:24,565 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:24,667 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:24,672 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:34336': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:24,672 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:24,672 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:34344': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:24,775 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:24,779 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:34346': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:24,780 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:24,780 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:34358': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:24,882 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:24,887 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:34366': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:24,887 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:24,887 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:34378': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:24,990 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:24,994 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:34384': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:24,994 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:34398': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:24,995 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:25,097 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:25,097 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:34402': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:25,102 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:25,102 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:34410': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:25,204 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:25,204 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:34418': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:25,210 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:25,210 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:34422': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:25,312 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:25,312 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:34426': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:25,318 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:25,318 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:34432': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:25,420 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:25,424 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:34448': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:25,425 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:25,425 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:34464': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:25,527 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:25,532 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:34476': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:25,532 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:25,532 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:34486': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:25,635 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:25,639 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:34502': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:25,640 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:25,640 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:34510': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:25,742 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:25,747 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:34514': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:25,747 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:25,747 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:34516': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:25,850 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:25,854 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:34526': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:25,855 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:25,855 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:34536': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:25,958 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:25,962 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:34544': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:25,962 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:34550': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:25,962 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:26,065 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:26,070 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:34564': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:26,070 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:34576': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:26,070 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:26,172 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:26,177 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:34588': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:26,177 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:34592': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:26,177 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:26,280 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:26,284 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:34608': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:26,285 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:34618': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:26,285 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:26,387 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:26,391 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:34624': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:26,392 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:34634': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:26,392 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:26,495 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:26,499 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:34640': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:26,500 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:26,500 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:34650': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:26,603 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:26,607 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:34666': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:26,607 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:26,611 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:34674': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:26,710 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:26,715 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:34676': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:26,715 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:34684': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:26,715 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:26,818 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:26,822 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:34698': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:26,823 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:26,823 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:34710': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:26,926 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:26,930 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:34724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:26,930 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:26,930 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:34734': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:27,033 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:27,038 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:34742': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:27,038 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:27,038 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:34754': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:27,142 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:27,146 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:34758': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:27,146 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:34760': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:27,146 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:27,249 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:27,253 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:34776': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:27,254 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:34790': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:27,254 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:27,357 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:27,361 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:34792': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:27,362 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:27,362 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:34798': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:27,464 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:27,469 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:34800': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:27,469 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:27,469 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:34810': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:27,572 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:27,576 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:34818': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:27,577 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:27,577 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:34820': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:27,680 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:27,684 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:34836': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:27,684 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:27,685 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:34846': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:27,787 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:27,791 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:34860': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:27,792 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:27,792 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:34874': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:27,895 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:27,899 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:34888': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:27,900 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:27,900 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:34898': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:28,002 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:28,007 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:34902': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:28,007 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:28,008 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:34916': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:28,110 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:28,119 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:34920': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:28,119 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:34932': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:28,119 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:28,218 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:28,218 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:34948': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:28,226 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:28,227 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:34954': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:28,325 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:28,326 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:34956': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:28,334 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:28,334 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:34972': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:28,433 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:28,433 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:34976': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:28,441 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:28,441 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:34982': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:28,541 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:28,541 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:34990': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:28,548 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:28,548 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:34992': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:28,648 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:28,648 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:34998': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:28,655 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:28,655 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:35002': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:28,756 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:28,756 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:35008': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:28,762 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:28,762 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:35016': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:28,864 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:28,864 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:35028': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:28,870 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:28,870 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:35032': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:28,971 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:28,972 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:35036': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:28,977 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:28,977 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:35040': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:29,078 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:29,079 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:35048': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:29,084 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:29,085 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:35056': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:29,186 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:29,191 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:35068': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:29,192 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:29,192 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:35076': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:29,294 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:29,298 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:35092': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:29,299 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:35100': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:29,300 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:29,402 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:29,407 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:35104': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:29,407 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:29,407 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:35116': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:29,509 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:29,514 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:35118': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:29,514 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:29,514 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:35122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:29,707 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:29,710 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:35134': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:29,711 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:29,711 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:35138': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:29,814 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:29,818 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:35152': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:29,819 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:29,819 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:35162': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:29,921 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:29,926 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:35170': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:29,926 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:29,926 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:35176': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:30,028 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:30,033 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:35178': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:30,033 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:30,034 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:35190': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:30,136 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:30,140 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:35194': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:30,141 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:30,141 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:35196': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:30,243 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:30,248 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:35206': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:30,248 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:30,249 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:35218': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:30,350 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:30,355 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:35220': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:30,355 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:30,355 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:35222': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:30,458 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:30,462 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:35234': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:30,463 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:30,463 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:35240': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:30,565 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:30,569 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:35246': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:30,570 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:30,570 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:35250': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:30,673 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:30,678 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:35254': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:30,678 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:30,678 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:35268': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:30,781 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:30,785 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:35276': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:30,786 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:30,786 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:35286': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:30,888 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:30,892 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:35300': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:30,893 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:30,893 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:35306': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:30,996 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:31,000 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:35314': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:31,000 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:31,001 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:35326': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:31,103 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:31,108 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:35334': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:31,108 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:31,112 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:35340': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:31,211 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:31,215 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:35356': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:31,216 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:35360': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:31,216 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:31,318 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:31,322 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:35374': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:31,323 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:35384': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:31,323 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:31,425 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:31,430 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:35392': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:31,430 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:35398': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:31,430 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:31,533 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:31,537 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:53904': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:31,538 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:31,538 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:53908': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:31,640 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:31,645 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:53924': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:31,645 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:31,645 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:53930': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:31,747 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:31,752 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:53946': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:31,752 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:53958': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:31,752 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:31,855 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:31,859 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:53974': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:31,860 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:31,860 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:53976': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:31,962 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:31,967 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:53990': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:31,967 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:53994': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:31,967 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:32,070 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:32,074 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54008': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:32,075 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:32,075 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54014': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:32,177 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:32,182 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54026': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:32,182 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54042': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:32,182 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:32,284 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:32,289 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54048': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:32,289 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54052': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:32,289 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:32,393 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:32,397 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54060': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:32,398 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54072': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:32,398 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:32,500 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:32,505 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54086': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:32,505 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54090': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:32,505 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:32,608 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:32,617 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54100': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:32,617 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:32,617 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54114': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:32,715 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:32,715 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54120': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:32,724 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:32,724 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54124': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:32,823 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:32,823 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54138': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:32,831 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:32,831 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54146': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:32,930 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:32,930 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54154': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:32,938 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:32,938 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54166': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:33,038 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:33,038 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54182': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:33,045 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:33,045 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54184': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:33,146 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:33,146 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54192': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:33,152 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:33,153 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54196': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:33,253 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:33,254 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54208': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:33,260 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:33,260 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54216': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:33,361 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:33,361 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54232': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:33,367 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:33,367 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54236': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:33,469 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:33,474 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54238': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:33,475 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:33,475 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54250': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:33,577 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:33,581 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54258': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:33,582 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:33,582 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54260': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:33,684 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:33,689 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54266': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:33,689 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:33,690 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54280': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:33,793 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:33,796 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54286': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:33,797 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54294': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:33,798 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:33,901 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:33,905 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54300': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:33,906 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:33,906 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54310': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:34,008 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:34,013 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54326': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:34,013 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54334': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:34,013 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:34,118 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:34,123 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54344': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:34,123 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54350': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:34,123 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:34,226 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:34,230 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54356': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:34,231 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54364': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:34,231 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:34,333 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:34,338 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54380': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:34,338 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:34,338 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54384': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:34,441 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:34,445 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54398': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:34,446 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54406': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:34,446 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:34,549 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:34,553 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54420': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:34,554 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54422': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:34,554 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:34,656 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:34,660 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54438': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:34,661 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54440': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:34,661 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:34,763 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:34,768 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54450': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:34,768 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:34,768 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54458': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:34,871 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:34,875 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54470': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:34,875 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54476': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:34,876 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:34,978 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:34,982 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54486': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:34,983 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54494': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:34,983 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:35,086 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:35,090 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54496': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:35,090 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54500': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:35,091 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:35,193 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:35,198 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54514': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:35,198 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54518': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:35,198 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:35,301 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:35,305 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54526': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:35,305 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54538': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:35,306 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:35,408 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:35,413 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54548': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:35,413 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54558': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:35,413 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:35,515 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:35,520 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54560': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:35,520 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54570': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:35,521 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:35,623 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:35,628 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54572': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:35,628 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:35,628 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54582': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:35,730 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:35,735 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54586': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:35,736 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:35,736 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54594': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:35,839 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:35,843 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54598': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:35,844 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:35,844 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54606': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:35,947 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:35,951 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54622': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:35,952 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54624': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:35,952 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:36,054 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:36,059 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54632': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:36,059 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54642': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:36,059 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:36,162 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:36,166 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54654': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:36,167 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54658': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:36,167 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:36,269 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:36,274 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54664': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:36,274 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54668': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:36,274 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:36,377 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:36,381 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54682': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:36,382 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:36,382 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54694': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:36,484 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:36,489 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54696': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:36,489 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:36,489 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54706': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:36,592 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:36,596 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54720': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:36,597 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54722': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:36,597 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:36,699 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:36,704 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54738': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:36,705 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:36,705 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54750': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:36,807 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:36,811 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54762': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:36,812 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:36,812 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54770': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:36,914 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:36,919 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54774': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:36,919 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54776': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:36,919 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:37,021 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:37,026 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54790': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:37,027 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:37,027 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:37,129 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:37,133 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54808': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:37,134 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54812': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:37,134 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:37,236 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:37,241 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54822': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:37,241 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:37,241 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54836': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:37,344 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:37,348 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54840': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:37,349 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:37,349 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54854': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:37,452 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:37,456 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54856': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:37,457 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:37,457 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54868': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:37,560 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:37,565 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54884': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:37,565 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54898': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:37,565 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:37,668 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:37,672 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54900': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:37,673 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:37,673 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54914': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:37,775 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:37,780 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54918': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:37,780 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:37,781 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54926': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:37,883 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:37,887 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54930': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:37,888 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:37,888 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54938': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:37,991 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:37,995 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54940': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:37,996 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54950': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:37,996 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:38,098 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:38,103 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54952': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:38,103 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:38,103 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54954': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:38,206 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:38,210 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54960': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:38,211 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:38,211 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54966': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:38,314 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:38,314 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54968': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:38,320 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:38,320 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54974': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:38,421 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:38,426 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54980': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:38,427 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:38,427 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:54988': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:38,529 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:38,533 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55000': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:38,534 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:38,534 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55010': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:38,636 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:38,641 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55016': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:38,642 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:38,642 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55030': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:38,744 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:38,748 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55044': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:38,749 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:38,750 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:38,851 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:38,856 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55062': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:38,857 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:38,857 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55068': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:38,958 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:38,963 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55072': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:38,964 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:38,964 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55076': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:39,066 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:39,071 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55090': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:39,072 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:39,072 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55098': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:39,174 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:39,178 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55114': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:39,179 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:39,179 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55124': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:39,282 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:39,286 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55130': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:39,287 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55144': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:39,287 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:39,389 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:39,389 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55152': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:39,395 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:39,395 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55166': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:39,497 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:39,502 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55182': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:39,503 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:39,503 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55186': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:39,604 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:39,609 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55188': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:39,610 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:39,615 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55198': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:39,712 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:39,717 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55214': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:39,718 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:39,718 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55224': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:39,819 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:39,820 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55236': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:39,826 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:39,826 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55252': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:39,927 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:39,927 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55268': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:39,934 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:39,934 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55272': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:40,035 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:40,035 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55280': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:40,041 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:40,041 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55290': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:40,142 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:40,142 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55298': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:40,149 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:40,149 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55310': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:40,250 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:40,250 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55324': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:40,257 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:40,257 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55326': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:40,357 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:40,358 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55330': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:40,364 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:40,364 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55342': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:40,465 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:40,465 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55344': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:40,471 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:40,471 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55352': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:40,572 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:40,572 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55356': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:40,579 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:40,579 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55366': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:40,680 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:40,680 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55378': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:40,686 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:40,686 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55384': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:40,787 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:40,787 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55396': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:40,794 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:40,794 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55404': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:40,895 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:40,895 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55408': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:40,901 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:40,901 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55418': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:41,003 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:41,003 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55420': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:41,009 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:41,010 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55432': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:41,111 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:41,115 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55442': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:41,121 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:41,121 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55444': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:41,219 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:41,219 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55454': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:41,229 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:41,229 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55456': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:41,326 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:41,326 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55462': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:41,336 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:41,336 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55472': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:41,434 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:41,434 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55474': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:41,443 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:41,444 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:55490': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:41,541 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:41,541 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59202': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:41,551 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:41,551 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59210': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:41,649 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:41,649 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59226': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:41,658 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:41,658 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59232': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:41,756 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:41,756 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59246': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:41,765 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:41,765 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59254': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:41,864 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:41,864 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59270': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:41,872 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:41,873 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59280': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:41,971 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:41,971 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59288': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:41,980 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:41,980 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59292': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:42,079 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:42,079 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59294': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:42,087 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:42,087 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59300': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:42,187 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:42,187 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59304': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:42,194 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:42,194 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59312': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:42,294 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:42,295 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59314': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:42,301 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:42,301 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59324': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:42,402 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:42,402 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59336': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:42,408 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:42,408 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59350': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:42,509 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:42,510 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59366': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:42,516 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:42,516 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59368': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:42,619 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:42,624 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59378': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:42,624 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:42,624 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59390': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:42,728 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:42,733 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59394': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:42,733 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59404': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:42,733 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:42,835 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:42,840 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59418': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:42,840 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:42,841 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59426': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:42,943 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:42,947 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59428': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:42,948 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:42,948 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59432': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:43,051 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:43,055 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59438': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:43,056 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:43,056 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59442': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:43,158 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:43,163 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59450': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:43,163 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:43,163 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59456': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:43,266 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:43,270 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59470': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:43,271 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:43,271 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59478': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:43,373 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:43,377 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59480': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:43,378 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:43,378 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59488': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:43,481 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:43,485 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59504': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:43,486 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:43,486 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59510': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:43,588 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:43,593 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59520': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:43,593 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59524': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:43,593 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:43,696 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:43,700 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59528': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:43,701 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:43,701 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59540': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:43,803 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:43,808 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59552': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:43,808 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:43,809 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59566': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:43,911 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:43,915 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59582': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:43,916 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:43,916 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59586': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:44,018 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:44,023 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59598': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:44,023 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:44,024 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59614': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:44,126 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:44,126 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59628': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:44,131 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:44,131 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59636': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:44,233 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:44,238 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59638': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:44,239 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:44,239 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59652': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:44,340 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:44,345 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59662': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:44,346 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:44,346 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59670': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:44,449 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:44,453 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59682': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:44,454 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59690': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:44,454 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:44,556 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:44,561 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59698': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:44,561 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59700': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:44,561 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:44,664 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:44,668 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59708': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:44,669 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59712': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:44,669 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:44,771 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:44,776 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59716': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:44,776 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59730': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:44,776 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:44,879 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:44,879 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59742': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:44,885 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:44,885 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59754': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:44,986 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:44,991 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59760': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:44,992 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:44,992 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59774': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:45,094 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:45,098 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59778': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:45,099 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:45,099 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59790': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:45,202 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:45,206 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59804': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:45,206 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:45,207 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59808': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:45,309 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:45,314 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59816': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:45,314 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:45,314 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59832': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:45,416 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:45,420 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59844': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:45,421 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:45,421 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59850': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:45,524 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:45,528 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59854': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:45,529 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59858': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:45,529 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:45,631 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:45,635 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59866': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:45,636 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59880': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:45,636 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:45,738 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:45,743 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59892': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:45,743 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:45,744 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59906': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:45,846 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:45,850 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59922': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:45,851 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:45,851 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59928': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:45,953 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:45,958 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59930': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:45,958 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59934': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:45,958 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:46,061 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:46,065 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59940': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:46,066 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59946': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:46,066 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:46,169 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:46,174 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59956': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:46,174 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:46,174 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59970': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:46,276 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:46,276 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59976': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:46,282 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:46,282 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59978': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:46,384 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:46,384 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59986': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:46,390 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:46,390 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:59998': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:46,491 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:46,492 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:60012': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:46,497 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:46,497 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:60022': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:46,599 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:46,603 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:60034': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:46,604 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:60050': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:46,604 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:46,706 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:46,711 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:60060': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:46,711 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:46,712 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:60074': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:46,814 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:46,818 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:60090': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:46,819 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:60096': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:46,819 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:46,921 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:46,926 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:60112': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:46,926 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:46,926 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:60118': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:47,029 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:47,033 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:60134': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:47,034 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:60144': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:47,034 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:47,137 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:47,142 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:60152': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:47,142 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:47,142 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:60156': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:47,245 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:47,250 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:60160': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:47,250 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:47,250 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:60162': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:47,352 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:47,352 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:60174': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:47,358 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:47,358 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:60188': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:47,460 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:47,464 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:60202': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:47,465 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:47,465 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:60218': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:47,567 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:47,572 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:60226': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:47,573 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:47,573 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:60234': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:47,675 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:47,679 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:60236': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:47,680 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:60238': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:47,680 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:47,782 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:47,786 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:60250': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:47,787 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:47,787 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:60254': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:47,890 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:47,895 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:60268': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:47,895 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:60278': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:47,895 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:47,998 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:48,002 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:60292': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:48,003 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:48,003 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:60302': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:48,106 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:48,110 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:60312': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:48,110 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:48,115 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:60314': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:48,213 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:48,217 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:60316': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:48,218 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:48,218 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:60318': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:48,320 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:48,320 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:60328': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:48,326 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:48,326 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:60342': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:48,427 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:48,428 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:60344': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:48,433 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:48,434 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:60352': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:48,534 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:48,535 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:60354': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:48,541 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:48,541 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:60358': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:48,642 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:48,643 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:60366': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:48,648 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:48,648 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:60372': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:48,749 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:48,749 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:60384': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:48,756 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:48,756 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:60386': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:48,857 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:48,857 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:60394': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:48,863 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:48,863 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:60406': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:48,964 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:48,964 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:60420': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:48,970 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:48,971 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:60432': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:49,072 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:49,072 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:60436': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:49,078 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:49,078 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:60442': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:49,179 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:49,179 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:60458': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:49,185 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:49,186 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:60464': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:49,287 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:49,287 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:60468': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:49,293 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:49,293 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:60472': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:49,394 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:49,395 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:60484': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:49,401 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:49,401 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:60492': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:49,502 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:49,507 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:60506': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:49,508 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:49,508 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:60518': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:49,610 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:49,619 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:60528': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:49,620 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:49,620 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:60536': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:49,718 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:49,718 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:60540': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:49,727 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:49,727 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:60554': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:49,825 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:49,825 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:60568': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:36:49,834 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39457 7221s 2024-11-23 22:36:49,835 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39457': TLS handshake failed with remote 'tls://127.0.0.1:60572': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s =================================== FAILURES =================================== 7221s ______________________________ test_preload_file _______________________________ 7221s 7221s self = 7221s deserializers = None 7221s 7221s async def read(self, deserializers=None): 7221s stream = self.stream 7221s if stream is None: 7221s raise CommClosedError() 7221s 7221s fmt = "Q" 7221s fmt_size = struct.calcsize(fmt) 7221s 7221s try: 7221s # Don't store multiple numpy or parquet buffers into the same buffer, or 7221s # none will be released until all are released. 7221s > frames_nosplit_nbytes_bin = await stream.read_bytes(fmt_size) 7221s E tornado.iostream.StreamClosedError: Stream is closed 7221s 7221s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:225: StreamClosedError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s loop = 7221s tmp_path = PosixPath('/tmp/pytest-of-ubuntu/pytest-3/test_preload_file0') 7221s 7221s def test_preload_file(loop, tmp_path): 7221s def check_scheduler(): 7221s import scheduler_info 7221s 7221s return scheduler_info.get_scheduler_address() 7221s 7221s path = tmp_path / "scheduler_info.py" 7221s with open(path, "w") as f: 7221s f.write(PRELOAD_TEXT) 7221s with tmpfile() as fn: 7221s with popen( 7221s [ 7221s "dask", 7221s "scheduler", 7221s "--scheduler-file", 7221s fn, 7221s "--preload", 7221s path, 7221s f"--port={open_port()}", 7221s ] 7221s ): 7221s with Client(scheduler_file=fn, loop=loop) as c: 7221s > assert c.run_on_scheduler(check_scheduler) == c.scheduler.address 7221s 7221s /usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py:342: 7221s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7221s /usr/lib/python3/dist-packages/distributed/client.py:2858: in run_on_scheduler 7221s return self.sync(self._run_on_scheduler, function, *args, **kwargs) 7221s /usr/lib/python3/dist-packages/distributed/utils.py:362: in sync 7221s return sync( 7221s /usr/lib/python3/dist-packages/distributed/utils.py:438: in sync 7221s raise error 7221s /usr/lib/python3/dist-packages/distributed/utils.py:412: in f 7221s result = yield future 7221s /usr/lib/python3/dist-packages/tornado/gen.py:766: in run 7221s value = future.result() 7221s /usr/lib/python3/dist-packages/distributed/client.py:2809: in _run_on_scheduler 7221s response = await self.scheduler.run_function( 7221s /usr/lib/python3/dist-packages/distributed/core.py:1395: in send_recv_from_rpc 7221s return await send_recv(comm=comm, op=key, **kwargs) 7221s /usr/lib/python3/dist-packages/distributed/core.py:1154: in send_recv 7221s response = await comm.read(deserializers=deserializers) 7221s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:236: in read 7221s convert_stream_closed_error(self, e) 7221s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7221s 7221s obj = 7221s exc = StreamClosedError('Stream is closed') 7221s 7221s def convert_stream_closed_error(obj, exc): 7221s """ 7221s Re-raise StreamClosedError as CommClosedError. 7221s """ 7221s if exc.real_error is not None: 7221s # The stream was closed because of an underlying OS error 7221s exc = exc.real_error 7221s if isinstance(exc, ssl.SSLError): 7221s if exc.reason and "UNKNOWN_CA" in exc.reason: 7221s raise FatalCommClosedError(f"in {obj}: {exc.__class__.__name__}: {exc}") 7221s raise CommClosedError(f"in {obj}: {exc.__class__.__name__}: {exc}") from exc 7221s else: 7221s > raise CommClosedError(f"in {obj}: {exc}") from exc 7221s E distributed.comm.core.CommClosedError: in : Stream is closed 7221s 7221s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:142: CommClosedError 7221s ----------------------------- Captured stderr call ----------------------------- 7221s 2024-11-23 22:16:30,373 - distributed.utils - INFO - Reload module scheduler_info from .py file 7221s 2024-11-23 22:16:30,374 - distributed.preloading - INFO - Import preload module: /tmp/pytest-of-ubuntu/pytest-3/test_preload_file0/scheduler_info.py 7221s 2024-11-23 22:16:30,375 - distributed.scheduler - INFO - ----------------------------------------------- 7221s 2024-11-23 22:16:30,377 - distributed.preloading - INFO - Creating preload: /tmp/pytest-of-ubuntu/pytest-3/test_preload_file0/scheduler_info.py 7221s 2024-11-23 22:16:30,377 - distributed.utils - INFO - Reload module scheduler_info from .py file 7221s 2024-11-23 22:16:30,378 - distributed.preloading - INFO - Import preload module: /tmp/pytest-of-ubuntu/pytest-3/test_preload_file0/scheduler_info.py 7221s 2024-11-23 22:16:30,400 - distributed.http.proxy - INFO - To route to workers diagnostics web server please install jupyter-server-proxy: python -m pip install jupyter-server-proxy 7221s 2024-11-23 22:16:30,403 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:16:30,405 - distributed.diskutils - INFO - Found stale lock file and directory '/tmp/dask-scratch-space/scheduler-amjgw0_v', purging 7221s 2024-11-23 22:16:30,405 - distributed.diskutils - INFO - Found stale lock file and directory '/tmp/dask-scratch-space/worker-hi7uzv51', purging 7221s 2024-11-23 22:16:30,406 - distributed.diskutils - INFO - Found stale lock file and directory '/tmp/dask-scratch-space/worker-fkd100hr', purging 7221s 2024-11-23 22:16:30,413 - distributed.scheduler - INFO - ----------------------------------------------- 7221s 2024-11-23 22:16:30,414 - distributed.scheduler - INFO - Scheduler at: tcp://10.0.4.73:47791 7221s 2024-11-23 22:16:30,414 - distributed.scheduler - INFO - dashboard at: http://10.0.4.73:8787/status 7221s 2024-11-23 22:16:30,414 - distributed.preloading - INFO - Run preload setup: /tmp/pytest-of-ubuntu/pytest-3/test_preload_file0/scheduler_info.py 7221s 2024-11-23 22:16:30,415 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:16:30,428 - distributed.scheduler - INFO - Receive client connection: Client-96b72298-a9e8-11ef-bdd0-00163e4db70f 7221s 2024-11-23 22:16:30,726 - distributed.core - INFO - Starting established connection to tcp://10.0.4.73:35318 7221s 2024-11-23 22:16:30,732 - distributed.worker - INFO - Run out-of-band function 'check_scheduler' 7221s 2024-11-23 22:16:31,180 - distributed.client - ERROR - 7221s ConnectionRefusedError: [Errno 111] Connection refused 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 559, in connect 7221s convert_stream_closed_error(self, e) 7221s ~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 140, in convert_stream_closed_error 7221s raise CommClosedError(f"in {obj}: {exc.__class__.__name__}: {exc}") from exc 7221s distributed.comm.core.CommClosedError: in : ConnectionRefusedError: [Errno 111] Connection refused 7221s 7221s During handling of the above exception, another exception occurred: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 836, in wrapper 7221s return await func(*args, **kwargs) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/client.py", line 1331, in _reconnect 7221s await self._ensure_connected(timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/client.py", line 1361, in _ensure_connected 7221s comm = await connect( 7221s ^^^^^^^^^^^^^^ 7221s self.scheduler.address, timeout=timeout, **self.connection_args 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 366, in connect 7221s await asyncio.sleep(backoff) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 718, in sleep 7221s return await future 7221s ^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s _____________________________ test_preload_module ______________________________ 7221s 7221s self = 7221s deserializers = None 7221s 7221s async def read(self, deserializers=None): 7221s stream = self.stream 7221s if stream is None: 7221s raise CommClosedError() 7221s 7221s fmt = "Q" 7221s fmt_size = struct.calcsize(fmt) 7221s 7221s try: 7221s # Don't store multiple numpy or parquet buffers into the same buffer, or 7221s # none will be released until all are released. 7221s > frames_nosplit_nbytes_bin = await stream.read_bytes(fmt_size) 7221s E tornado.iostream.StreamClosedError: Stream is closed 7221s 7221s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:225: StreamClosedError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s loop = 7221s tmp_path = PosixPath('/tmp/pytest-of-ubuntu/pytest-3/test_preload_module0') 7221s 7221s def test_preload_module(loop, tmp_path): 7221s def check_scheduler(): 7221s import scheduler_info 7221s 7221s return scheduler_info.get_scheduler_address() 7221s 7221s path = tmp_path / "scheduler_info.py" 7221s with open(path, "w") as f: 7221s f.write(PRELOAD_TEXT) 7221s env = os.environ.copy() 7221s if "PYTHONPATH" in env: 7221s env["PYTHONPATH"] = str(tmp_path) + ":" + env["PYTHONPATH"] 7221s else: 7221s env["PYTHONPATH"] = str(tmp_path) 7221s with tmpfile() as fn: 7221s with popen( 7221s [ 7221s "dask", 7221s "scheduler", 7221s "--scheduler-file", 7221s fn, 7221s "--preload", 7221s "scheduler_info", 7221s f"--port={open_port()}", 7221s ], 7221s env=env, 7221s ): 7221s with Client(scheduler_file=fn, loop=loop) as c: 7221s > assert c.run_on_scheduler(check_scheduler) == c.scheduler.address 7221s 7221s /usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py:373: 7221s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7221s /usr/lib/python3/dist-packages/distributed/client.py:2858: in run_on_scheduler 7221s return self.sync(self._run_on_scheduler, function, *args, **kwargs) 7221s /usr/lib/python3/dist-packages/distributed/utils.py:362: in sync 7221s return sync( 7221s /usr/lib/python3/dist-packages/distributed/utils.py:438: in sync 7221s raise error 7221s /usr/lib/python3/dist-packages/distributed/utils.py:412: in f 7221s result = yield future 7221s /usr/lib/python3/dist-packages/tornado/gen.py:766: in run 7221s value = future.result() 7221s /usr/lib/python3/dist-packages/distributed/client.py:2809: in _run_on_scheduler 7221s response = await self.scheduler.run_function( 7221s /usr/lib/python3/dist-packages/distributed/core.py:1395: in send_recv_from_rpc 7221s return await send_recv(comm=comm, op=key, **kwargs) 7221s /usr/lib/python3/dist-packages/distributed/core.py:1154: in send_recv 7221s response = await comm.read(deserializers=deserializers) 7221s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:236: in read 7221s convert_stream_closed_error(self, e) 7221s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7221s 7221s obj = 7221s exc = StreamClosedError('Stream is closed') 7221s 7221s def convert_stream_closed_error(obj, exc): 7221s """ 7221s Re-raise StreamClosedError as CommClosedError. 7221s """ 7221s if exc.real_error is not None: 7221s # The stream was closed because of an underlying OS error 7221s exc = exc.real_error 7221s if isinstance(exc, ssl.SSLError): 7221s if exc.reason and "UNKNOWN_CA" in exc.reason: 7221s raise FatalCommClosedError(f"in {obj}: {exc.__class__.__name__}: {exc}") 7221s raise CommClosedError(f"in {obj}: {exc.__class__.__name__}: {exc}") from exc 7221s else: 7221s > raise CommClosedError(f"in {obj}: {exc}") from exc 7221s E distributed.comm.core.CommClosedError: in : Stream is closed 7221s 7221s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:142: CommClosedError 7221s ----------------------------- Captured stderr call ----------------------------- 7221s 2024-11-23 22:16:32,215 - distributed.preloading - INFO - Import preload module: scheduler_info 7221s 2024-11-23 22:16:32,216 - distributed.scheduler - INFO - ----------------------------------------------- 7221s 2024-11-23 22:16:32,217 - distributed.preloading - INFO - Creating preload: scheduler_info 7221s 2024-11-23 22:16:32,217 - distributed.preloading - INFO - Import preload module: scheduler_info 7221s 2024-11-23 22:16:32,238 - distributed.http.proxy - INFO - To route to workers diagnostics web server please install jupyter-server-proxy: python -m pip install jupyter-server-proxy 7221s 2024-11-23 22:16:32,241 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:16:32,243 - distributed.diskutils - INFO - Found stale lock file and directory '/tmp/dask-scratch-space/scheduler-ayi_zeym', purging 7221s 2024-11-23 22:16:32,250 - distributed.scheduler - INFO - ----------------------------------------------- 7221s 2024-11-23 22:16:32,251 - distributed.scheduler - INFO - Scheduler at: tcp://10.0.4.73:57969 7221s 2024-11-23 22:16:32,252 - distributed.scheduler - INFO - dashboard at: http://10.0.4.73:8787/status 7221s 2024-11-23 22:16:32,252 - distributed.preloading - INFO - Run preload setup: scheduler_info 7221s 2024-11-23 22:16:32,252 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:16:32,257 - distributed.scheduler - INFO - Receive client connection: Client-97ceeeab-a9e8-11ef-bdd0-00163e4db70f 7221s 2024-11-23 22:16:32,557 - distributed.core - INFO - Starting established connection to tcp://10.0.4.73:47962 7221s 2024-11-23 22:16:32,561 - distributed.worker - INFO - Run out-of-band function 'check_scheduler' 7221s 2024-11-23 22:16:33,118 - distributed.client - ERROR - 7221s ConnectionRefusedError: [Errno 111] Connection refused 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 559, in connect 7221s convert_stream_closed_error(self, e) 7221s ~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 140, in convert_stream_closed_error 7221s raise CommClosedError(f"in {obj}: {exc.__class__.__name__}: {exc}") from exc 7221s distributed.comm.core.CommClosedError: in : ConnectionRefusedError: [Errno 111] Connection refused 7221s 7221s During handling of the above exception, another exception occurred: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 836, in wrapper 7221s return await func(*args, **kwargs) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/client.py", line 1331, in _reconnect 7221s await self._ensure_connected(timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/client.py", line 1361, in _ensure_connected 7221s comm = await connect( 7221s ^^^^^^^^^^^^^^ 7221s self.scheduler.address, timeout=timeout, **self.connection_args 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 366, in connect 7221s await asyncio.sleep(backoff) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 718, in sleep 7221s return await future 7221s ^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s __________________________ test_preload_remote_module __________________________ 7221s 7221s loop = 7221s tmp_path = PosixPath('/tmp/pytest-of-ubuntu/pytest-3/test_preload_remote_module0') 7221s 7221s def test_preload_remote_module(loop, tmp_path): 7221s with open(tmp_path / "scheduler_info.py", "w") as f: 7221s f.write(PRELOAD_TEXT) 7221s http_server_port = open_port() 7221s with popen( 7221s [sys.executable, "-m", "http.server", str(http_server_port)], cwd=tmp_path 7221s ): 7221s with popen( 7221s [ 7221s "dask", 7221s "scheduler", 7221s "--scheduler-file", 7221s str(tmp_path / "scheduler-file.json"), 7221s "--preload", 7221s f"http://localhost:{http_server_port}/scheduler_info.py", 7221s f"--port={open_port()}", 7221s ] 7221s ) as proc: 7221s with Client( 7221s scheduler_file=tmp_path / "scheduler-file.json", loop=loop 7221s ) as c: 7221s > assert ( 7221s c.run_on_scheduler( 7221s lambda dask_scheduler: getattr(dask_scheduler, "foo", None) 7221s ) 7221s == "bar" 7221s ) 7221s 7221s /usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py:397: 7221s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7221s /usr/lib/python3/dist-packages/distributed/client.py:2858: in run_on_scheduler 7221s return self.sync(self._run_on_scheduler, function, *args, **kwargs) 7221s /usr/lib/python3/dist-packages/distributed/utils.py:362: in sync 7221s return sync( 7221s /usr/lib/python3/dist-packages/distributed/utils.py:438: in sync 7221s raise error 7221s /usr/lib/python3/dist-packages/distributed/utils.py:412: in f 7221s result = yield future 7221s /usr/lib/python3/dist-packages/tornado/gen.py:766: in run 7221s value = future.result() 7221s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7221s 7221s self = 7221s function = . at 0xe93af488> 7221s wait = True, args = (), kwargs = {} 7221s response = {'exception': b'\x80\x05\x95&\x02\x00\x00\x00\x00\x00\x00\x8c\x16tblib.pickling_support\x94\x8c\x12unpickle_exception\... 'exception_text': "SystemError('no locals when deleting ')", 'status': 'error', 'traceback': b'\x80\x05N.', ...} 7221s typ = , exc = SystemError('no locals when deleting ') 7221s tb = None 7221s 7221s async def _run_on_scheduler(self, function, *args, wait=True, **kwargs): 7221s response = await self.scheduler.run_function( 7221s function=dumps(function), 7221s args=dumps(args), 7221s kwargs=dumps(kwargs), 7221s wait=wait, 7221s ) 7221s if response["status"] == "error": 7221s typ, exc, tb = clean_exception(**response) 7221s > raise exc.with_traceback(tb) 7221s E SystemError: no locals when deleting 7221s 7221s /usr/lib/python3/dist-packages/distributed/client.py:2817: SystemError 7221s ----------------------------- Captured stdout call ----------------------------- 7221s Serving HTTP on 0.0.0.0 port 58773 (http://0.0.0.0:58773/) ... 7221s 7221s Keyboard interrupt received, exiting. 7221s ----------------------------- Captured stderr call ----------------------------- 7221s 2024-11-23 22:16:34,047 - distributed.scheduler - INFO - ----------------------------------------------- 7221s 2024-11-23 22:16:34,049 - distributed.preloading - INFO - Creating preload: http://localhost:58773/scheduler_info.py 7221s 2024-11-23 22:16:34,049 - distributed.preloading - INFO - Downloading preload at http://localhost:58773/scheduler_info.py 7221s 127.0.0.1 - - [23/Nov/2024 22:16:34] "GET /scheduler_info.py HTTP/1.1" 200 - 7221s 2024-11-23 22:16:34,101 - distributed.http.proxy - INFO - To route to workers diagnostics web server please install jupyter-server-proxy: python -m pip install jupyter-server-proxy 7221s 2024-11-23 22:16:34,103 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:16:34,105 - distributed.diskutils - INFO - Found stale lock file and directory '/tmp/dask-scratch-space/scheduler-fu6a901n', purging 7221s 2024-11-23 22:16:34,112 - distributed.scheduler - INFO - ----------------------------------------------- 7221s 2024-11-23 22:16:34,113 - distributed.scheduler - INFO - Scheduler at: tcp://10.0.4.73:58475 7221s 2024-11-23 22:16:34,113 - distributed.scheduler - INFO - dashboard at: http://10.0.4.73:8787/status 7221s 2024-11-23 22:16:34,113 - distributed.preloading - INFO - Run preload setup: http://localhost:58773/scheduler_info.py 7221s 2024-11-23 22:16:34,114 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:16:34,122 - distributed.scheduler - INFO - Receive client connection: Client-98e5f9c6-a9e8-11ef-bdd0-00163e4db70f 7221s 2024-11-23 22:16:34,430 - distributed.core - INFO - Starting established connection to tcp://10.0.4.73:35014 7221s 2024-11-23 22:16:34,436 - distributed.worker - INFO - Run out-of-band function 'lambda' 7221s 2024-11-23 22:16:34,436 - distributed.worker - WARNING - Run Failed 7221s Function: lambda 7221s args: () 7221s kwargs: {'dask_scheduler': } 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 3182, in run 7221s result = function(*args, **kwargs) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s SystemError: no locals when deleting 7221s 2024-11-23 22:16:34,444 - distributed.scheduler - INFO - Remove client Client-98e5f9c6-a9e8-11ef-bdd0-00163e4db70f 7221s 2024-11-23 22:16:34,445 - distributed.core - INFO - Received 'close-stream' from tcp://10.0.4.73:35014; closing. 7221s 2024-11-23 22:16:34,445 - distributed.scheduler - INFO - Remove client Client-98e5f9c6-a9e8-11ef-bdd0-00163e4db70f 7221s 2024-11-23 22:16:34,445 - distributed.scheduler - INFO - Close client connection: Client-98e5f9c6-a9e8-11ef-bdd0-00163e4db70f 7221s 2024-11-23 22:16:34,446 - distributed._signals - INFO - Received signal SIGINT (2) 7221s 2024-11-23 22:16:34,446 - distributed.scheduler - INFO - Scheduler closing due to signal-2... 7221s 2024-11-23 22:16:34,447 - distributed.scheduler - INFO - Scheduler closing all comms 7221s 2024-11-23 22:16:34,448 - distributed.scheduler - INFO - Stopped scheduler at 'tcp://10.0.4.73:58475' 7221s 2024-11-23 22:16:34,448 - distributed.scheduler - INFO - End scheduler 7221s _____________________________ test_preload_config ______________________________ 7221s 7221s loop = 7221s 7221s def test_preload_config(loop): 7221s # Ensure dask scheduler pulls the preload from the Dask config if 7221s # not specified via a command line option 7221s with tmpfile() as fn: 7221s env = os.environ.copy() 7221s env["DASK_DISTRIBUTED__SCHEDULER__PRELOAD"] = PRELOAD_TEXT 7221s with popen(["dask", "scheduler", "--scheduler-file", fn], env=env): 7221s with Client(scheduler_file=fn, loop=loop) as c: 7221s > assert ( 7221s c.run_on_scheduler(lambda dask_scheduler: dask_scheduler.foo) 7221s == "bar" 7221s ) 7221s 7221s /usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py:413: 7221s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7221s /usr/lib/python3/dist-packages/distributed/client.py:2858: in run_on_scheduler 7221s return self.sync(self._run_on_scheduler, function, *args, **kwargs) 7221s /usr/lib/python3/dist-packages/distributed/utils.py:362: in sync 7221s return sync( 7221s /usr/lib/python3/dist-packages/distributed/utils.py:438: in sync 7221s raise error 7221s /usr/lib/python3/dist-packages/distributed/utils.py:412: in f 7221s result = yield future 7221s /usr/lib/python3/dist-packages/tornado/gen.py:766: in run 7221s value = future.result() 7221s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7221s 7221s self = 7221s function = . at 0xe9b31848> 7221s wait = True, args = (), kwargs = {} 7221s response = {'exception': b'\x80\x05\x953\x02\x00\x00\x00\x00\x00\x00\x8c\x16tblib.pickling_support\x94\x8c\x12unpickle_exception\...ext': "SystemError('no locals found when setting up annotations')", 'status': 'error', 'traceback': b'\x80\x05N.', ...} 7221s typ = 7221s exc = SystemError('no locals found when setting up annotations'), tb = None 7221s 7221s async def _run_on_scheduler(self, function, *args, wait=True, **kwargs): 7221s response = await self.scheduler.run_function( 7221s function=dumps(function), 7221s args=dumps(args), 7221s kwargs=dumps(kwargs), 7221s wait=wait, 7221s ) 7221s if response["status"] == "error": 7221s typ, exc, tb = clean_exception(**response) 7221s > raise exc.with_traceback(tb) 7221s E SystemError: no locals found when setting up annotations 7221s 7221s /usr/lib/python3/dist-packages/distributed/client.py:2817: SystemError 7221s ----------------------------- Captured stderr call ----------------------------- 7221s 2024-11-23 22:16:35,640 - distributed.scheduler - INFO - ----------------------------------------------- 7221s 2024-11-23 22:16:35,642 - distributed.preloading - INFO - Creating preload: 7221s _scheduler_info = {} 7221s 7221s def dask_setup(scheduler): 7221s _scheduler_info['address'] = scheduler.address 7221s scheduler.foo = "bar" 7221s 7221s def get_scheduler_address(): 7221s return _scheduler_info['address'] 7221s 7221s 2024-11-23 22:16:35,643 - distributed.utils - INFO - Reload module tmpalc517fv from .py file 7221s 2024-11-23 22:16:35,644 - distributed.preloading - INFO - Import preload module: /tmp/tmpalc517fv.py 7221s 2024-11-23 22:16:35,666 - distributed.http.proxy - INFO - To route to workers diagnostics web server please install jupyter-server-proxy: python -m pip install jupyter-server-proxy 7221s 2024-11-23 22:16:35,670 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:16:35,678 - distributed.scheduler - INFO - ----------------------------------------------- 7221s 2024-11-23 22:16:35,679 - distributed.scheduler - INFO - Scheduler at: tcp://10.0.4.73:8786 7221s 2024-11-23 22:16:35,679 - distributed.scheduler - INFO - dashboard at: http://10.0.4.73:8787/status 7221s 2024-11-23 22:16:35,679 - distributed.preloading - INFO - Run preload setup: 7221s _scheduler_info = {} 7221s 7221s def dask_setup(scheduler): 7221s _scheduler_info['address'] = scheduler.address 7221s scheduler.foo = "bar" 7221s 7221s def get_scheduler_address(): 7221s return _scheduler_info['address'] 7221s 7221s 2024-11-23 22:16:35,680 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:16:35,691 - distributed.scheduler - INFO - Receive client connection: Client-99d8c8c1-a9e8-11ef-bdd0-00163e4db70f 7221s 2024-11-23 22:16:35,988 - distributed.core - INFO - Starting established connection to tcp://10.0.4.73:39066 7221s 2024-11-23 22:16:35,994 - distributed.worker - INFO - Run out-of-band function 'lambda' 7221s 2024-11-23 22:16:35,994 - distributed.worker - WARNING - Run Failed 7221s Function: lambda 7221s args: () 7221s kwargs: {'dask_scheduler': } 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 3182, in run 7221s result = function(*args, **kwargs) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s SystemError: no locals found when setting up annotations 7221s 2024-11-23 22:16:36,003 - distributed.scheduler - INFO - Remove client Client-99d8c8c1-a9e8-11ef-bdd0-00163e4db70f 7221s 2024-11-23 22:16:36,003 - distributed.core - INFO - Received 'close-stream' from tcp://10.0.4.73:39066; closing. 7221s 2024-11-23 22:16:36,004 - distributed.scheduler - INFO - Remove client Client-99d8c8c1-a9e8-11ef-bdd0-00163e4db70f 7221s 2024-11-23 22:16:36,004 - distributed.scheduler - INFO - Close client connection: Client-99d8c8c1-a9e8-11ef-bdd0-00163e4db70f 7221s 2024-11-23 22:16:36,005 - distributed._signals - INFO - Received signal SIGINT (2) 7221s 2024-11-23 22:16:36,005 - distributed.scheduler - INFO - Scheduler closing due to signal-2... 7221s 2024-11-23 22:16:36,006 - distributed.scheduler - INFO - Scheduler closing all comms 7221s 2024-11-23 22:16:36,006 - distributed.scheduler - INFO - Stopped scheduler at 'tcp://10.0.4.73:8786' 7221s 2024-11-23 22:16:36,007 - distributed.scheduler - INFO - End scheduler 7221s _____________________________ test_preload_command _____________________________ 7221s 7221s self = 7221s deserializers = None 7221s 7221s async def read(self, deserializers=None): 7221s stream = self.stream 7221s if stream is None: 7221s raise CommClosedError() 7221s 7221s fmt = "Q" 7221s fmt_size = struct.calcsize(fmt) 7221s 7221s try: 7221s # Don't store multiple numpy or parquet buffers into the same buffer, or 7221s # none will be released until all are released. 7221s > frames_nosplit_nbytes_bin = await stream.read_bytes(fmt_size) 7221s E tornado.iostream.StreamClosedError: Stream is closed 7221s 7221s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:225: StreamClosedError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s loop = 7221s 7221s def test_preload_command(loop): 7221s def check_passthrough(): 7221s import passthrough_info 7221s 7221s return passthrough_info.get_passthrough() 7221s 7221s tmpdir = tempfile.mkdtemp() 7221s try: 7221s path = os.path.join(tmpdir, "passthrough_info.py") 7221s with open(path, "w") as f: 7221s f.write(PRELOAD_COMMAND_TEXT) 7221s 7221s with tmpfile() as fn: 7221s print(fn) 7221s with popen( 7221s [ 7221s "dask", 7221s "scheduler", 7221s "--scheduler-file", 7221s fn, 7221s "--preload", 7221s path, 7221s "--passthrough", 7221s "foobar", 7221s ] 7221s ): 7221s with Client(scheduler_file=fn, loop=loop) as c: 7221s > assert c.run_on_scheduler(check_passthrough) == "foobar" 7221s 7221s /usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py:460: 7221s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7221s /usr/lib/python3/dist-packages/distributed/client.py:2858: in run_on_scheduler 7221s return self.sync(self._run_on_scheduler, function, *args, **kwargs) 7221s /usr/lib/python3/dist-packages/distributed/utils.py:362: in sync 7221s return sync( 7221s /usr/lib/python3/dist-packages/distributed/utils.py:438: in sync 7221s raise error 7221s /usr/lib/python3/dist-packages/distributed/utils.py:412: in f 7221s result = yield future 7221s /usr/lib/python3/dist-packages/tornado/gen.py:766: in run 7221s value = future.result() 7221s /usr/lib/python3/dist-packages/distributed/client.py:2809: in _run_on_scheduler 7221s response = await self.scheduler.run_function( 7221s /usr/lib/python3/dist-packages/distributed/core.py:1395: in send_recv_from_rpc 7221s return await send_recv(comm=comm, op=key, **kwargs) 7221s /usr/lib/python3/dist-packages/distributed/core.py:1154: in send_recv 7221s response = await comm.read(deserializers=deserializers) 7221s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:236: in read 7221s convert_stream_closed_error(self, e) 7221s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7221s 7221s obj = 7221s exc = StreamClosedError('Stream is closed') 7221s 7221s def convert_stream_closed_error(obj, exc): 7221s """ 7221s Re-raise StreamClosedError as CommClosedError. 7221s """ 7221s if exc.real_error is not None: 7221s # The stream was closed because of an underlying OS error 7221s exc = exc.real_error 7221s if isinstance(exc, ssl.SSLError): 7221s if exc.reason and "UNKNOWN_CA" in exc.reason: 7221s raise FatalCommClosedError(f"in {obj}: {exc.__class__.__name__}: {exc}") 7221s raise CommClosedError(f"in {obj}: {exc.__class__.__name__}: {exc}") from exc 7221s else: 7221s > raise CommClosedError(f"in {obj}: {exc}") from exc 7221s E distributed.comm.core.CommClosedError: in : Stream is closed 7221s 7221s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:142: CommClosedError 7221s ----------------------------- Captured stdout call ----------------------------- 7221s /tmp/tmpgh093ud4 7221s ----------------------------- Captured stderr call ----------------------------- 7221s 2024-11-23 22:16:37,117 - distributed.utils - INFO - Reload module passthrough_info from .py file 7221s 2024-11-23 22:16:37,118 - distributed.preloading - INFO - Import preload module: /tmp/tmp21n6m_ua/passthrough_info.py 7221s 2024-11-23 22:16:37,119 - distributed.scheduler - INFO - ----------------------------------------------- 7221s 2024-11-23 22:16:37,121 - distributed.preloading - INFO - Creating preload: /tmp/tmp21n6m_ua/passthrough_info.py 7221s 2024-11-23 22:16:37,122 - distributed.utils - INFO - Reload module passthrough_info from .py file 7221s 2024-11-23 22:16:37,122 - distributed.preloading - INFO - Import preload module: /tmp/tmp21n6m_ua/passthrough_info.py 7221s 2024-11-23 22:16:37,144 - distributed.http.proxy - INFO - To route to workers diagnostics web server please install jupyter-server-proxy: python -m pip install jupyter-server-proxy 7221s 2024-11-23 22:16:37,148 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:16:37,156 - distributed.scheduler - INFO - ----------------------------------------------- 7221s 2024-11-23 22:16:37,157 - distributed.scheduler - INFO - Scheduler at: tcp://10.0.4.73:8786 7221s 2024-11-23 22:16:37,157 - distributed.scheduler - INFO - dashboard at: http://10.0.4.73:8787/status 7221s 2024-11-23 22:16:37,158 - distributed.preloading - INFO - Run preload setup: /tmp/tmp21n6m_ua/passthrough_info.py 7221s 2024-11-23 22:16:37,158 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:16:37,165 - distributed.scheduler - INFO - Receive client connection: Client-9aba7115-a9e8-11ef-bdd0-00163e4db70f 7221s 2024-11-23 22:16:37,467 - distributed.core - INFO - Starting established connection to tcp://10.0.4.73:39082 7221s 2024-11-23 22:16:37,471 - distributed.worker - INFO - Run out-of-band function 'check_passthrough' 7221s 2024-11-23 22:16:38,024 - distributed.client - ERROR - 7221s ConnectionRefusedError: [Errno 111] Connection refused 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 559, in connect 7221s convert_stream_closed_error(self, e) 7221s ~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 140, in convert_stream_closed_error 7221s raise CommClosedError(f"in {obj}: {exc.__class__.__name__}: {exc}") from exc 7221s distributed.comm.core.CommClosedError: in : ConnectionRefusedError: [Errno 111] Connection refused 7221s 7221s During handling of the above exception, another exception occurred: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 836, in wrapper 7221s return await func(*args, **kwargs) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/client.py", line 1331, in _reconnect 7221s await self._ensure_connected(timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/client.py", line 1361, in _ensure_connected 7221s comm = await connect( 7221s ^^^^^^^^^^^^^^ 7221s self.scheduler.address, timeout=timeout, **self.connection_args 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 366, in connect 7221s await asyncio.sleep(backoff) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 718, in sleep 7221s return await future 7221s ^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s _________________________ test_preload_command_default _________________________ 7221s 7221s self = 7221s deserializers = None 7221s 7221s async def read(self, deserializers=None): 7221s stream = self.stream 7221s if stream is None: 7221s raise CommClosedError() 7221s 7221s fmt = "Q" 7221s fmt_size = struct.calcsize(fmt) 7221s 7221s try: 7221s # Don't store multiple numpy or parquet buffers into the same buffer, or 7221s # none will be released until all are released. 7221s > frames_nosplit_nbytes_bin = await stream.read_bytes(fmt_size) 7221s E tornado.iostream.StreamClosedError: Stream is closed 7221s 7221s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:225: StreamClosedError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s loop = 7221s 7221s def test_preload_command_default(loop): 7221s def check_passthrough(): 7221s import passthrough_info 7221s 7221s return passthrough_info.get_passthrough() 7221s 7221s tmpdir = tempfile.mkdtemp() 7221s try: 7221s path = os.path.join(tmpdir, "passthrough_info.py") 7221s with open(path, "w") as f: 7221s f.write(PRELOAD_COMMAND_TEXT) 7221s 7221s with tmpfile() as fn2: 7221s print(fn2) 7221s with popen( 7221s ["dask", "scheduler", "--scheduler-file", fn2, "--preload", path], 7221s stdout=sys.stdout, 7221s stderr=sys.stderr, 7221s ): 7221s with Client(scheduler_file=fn2, loop=loop) as c: 7221s > assert c.run_on_scheduler(check_passthrough) == "default" 7221s 7221s /usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py:485: 7221s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7221s /usr/lib/python3/dist-packages/distributed/client.py:2858: in run_on_scheduler 7221s return self.sync(self._run_on_scheduler, function, *args, **kwargs) 7221s /usr/lib/python3/dist-packages/distributed/utils.py:362: in sync 7221s return sync( 7221s /usr/lib/python3/dist-packages/distributed/utils.py:438: in sync 7221s raise error 7221s /usr/lib/python3/dist-packages/distributed/utils.py:412: in f 7221s result = yield future 7221s /usr/lib/python3/dist-packages/tornado/gen.py:766: in run 7221s value = future.result() 7221s /usr/lib/python3/dist-packages/distributed/client.py:2809: in _run_on_scheduler 7221s response = await self.scheduler.run_function( 7221s /usr/lib/python3/dist-packages/distributed/core.py:1395: in send_recv_from_rpc 7221s return await send_recv(comm=comm, op=key, **kwargs) 7221s /usr/lib/python3/dist-packages/distributed/core.py:1154: in send_recv 7221s response = await comm.read(deserializers=deserializers) 7221s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:236: in read 7221s convert_stream_closed_error(self, e) 7221s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7221s 7221s obj = 7221s exc = StreamClosedError('Stream is closed') 7221s 7221s def convert_stream_closed_error(obj, exc): 7221s """ 7221s Re-raise StreamClosedError as CommClosedError. 7221s """ 7221s if exc.real_error is not None: 7221s # The stream was closed because of an underlying OS error 7221s exc = exc.real_error 7221s if isinstance(exc, ssl.SSLError): 7221s if exc.reason and "UNKNOWN_CA" in exc.reason: 7221s raise FatalCommClosedError(f"in {obj}: {exc.__class__.__name__}: {exc}") 7221s raise CommClosedError(f"in {obj}: {exc.__class__.__name__}: {exc}") from exc 7221s else: 7221s > raise CommClosedError(f"in {obj}: {exc}") from exc 7221s E distributed.comm.core.CommClosedError: in : Stream is closed 7221s 7221s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:142: CommClosedError 7221s ----------------------------- Captured stdout call ----------------------------- 7221s /tmp/tmpjqt5y05g 7221s ----------------------------- Captured stderr call ----------------------------- 7221s 2024-11-23 22:16:38,945 - distributed.utils - INFO - Reload module passthrough_info from .py file 7221s 2024-11-23 22:16:38,947 - distributed.preloading - INFO - Import preload module: /tmp/tmpilw3qkpy/passthrough_info.py 7221s 2024-11-23 22:16:38,948 - distributed.scheduler - INFO - ----------------------------------------------- 7221s 2024-11-23 22:16:38,950 - distributed.preloading - INFO - Creating preload: /tmp/tmpilw3qkpy/passthrough_info.py 7221s 2024-11-23 22:16:38,950 - distributed.utils - INFO - Reload module passthrough_info from .py file 7221s 2024-11-23 22:16:38,951 - distributed.preloading - INFO - Import preload module: /tmp/tmpilw3qkpy/passthrough_info.py 7221s 2024-11-23 22:16:38,973 - distributed.http.proxy - INFO - To route to workers diagnostics web server please install jupyter-server-proxy: python -m pip install jupyter-server-proxy 7221s 2024-11-23 22:16:38,976 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:16:38,978 - distributed.diskutils - INFO - Found stale lock file and directory '/tmp/dask-scratch-space/scheduler-dy3jwhqq', purging 7221s 2024-11-23 22:16:38,984 - distributed.scheduler - INFO - ----------------------------------------------- 7221s 2024-11-23 22:16:38,985 - distributed.scheduler - INFO - Scheduler at: tcp://10.0.4.73:8786 7221s 2024-11-23 22:16:38,986 - distributed.scheduler - INFO - dashboard at: http://10.0.4.73:8787/status 7221s 2024-11-23 22:16:38,986 - distributed.preloading - INFO - Run preload setup: /tmp/tmpilw3qkpy/passthrough_info.py 7221s 2024-11-23 22:16:38,987 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:16:38,992 - distributed.scheduler - INFO - Receive client connection: Client-9bd201b6-a9e8-11ef-bdd0-00163e4db70f 7221s 2024-11-23 22:16:39,298 - distributed.core - INFO - Starting established connection to tcp://10.0.4.73:39150 7221s 2024-11-23 22:16:39,303 - distributed.worker - INFO - Run out-of-band function 'check_passthrough' 7221s 2024-11-23 22:16:39,843 - distributed.client - ERROR - 7221s ConnectionRefusedError: [Errno 111] Connection refused 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 559, in connect 7221s convert_stream_closed_error(self, e) 7221s ~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 140, in convert_stream_closed_error 7221s raise CommClosedError(f"in {obj}: {exc.__class__.__name__}: {exc}") from exc 7221s distributed.comm.core.CommClosedError: in : ConnectionRefusedError: [Errno 111] Connection refused 7221s 7221s During handling of the above exception, another exception occurred: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 836, in wrapper 7221s return await func(*args, **kwargs) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/client.py", line 1331, in _reconnect 7221s await self._ensure_connected(timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/client.py", line 1361, in _ensure_connected 7221s comm = await connect( 7221s ^^^^^^^^^^^^^^ 7221s self.scheduler.address, timeout=timeout, **self.connection_args 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 366, in connect 7221s await asyncio.sleep(backoff) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 718, in sleep 7221s return await future 7221s ^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s ___________________________ test_multiple_workers_2 ____________________________ 7221s 7221s loop = 7221s 7221s def test_multiple_workers_2(loop): 7221s text = """ 7221s def dask_setup(worker): 7221s worker.foo = 'setup' 7221s """ 7221s port = open_port() 7221s with popen( 7221s ["dask", "scheduler", "--no-dashboard", "--host", f"127.0.0.1:{port}"] 7221s ) as s: 7221s with popen( 7221s [ 7221s "dask", 7221s "worker", 7221s f"localhost:{port}", 7221s "--no-dashboard", 7221s "--preload", 7221s text, 7221s "--preload-nanny", 7221s text, 7221s ] 7221s ) as a: 7221s with Client(f"127.0.0.1:{port}", loop=loop) as c: 7221s c.wait_for_workers(1) 7221s > [foo] = c.run(lambda dask_worker: dask_worker.foo).values() 7221s 7221s /usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py:549: 7221s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7221s /usr/lib/python3/dist-packages/distributed/client.py:2993: in run 7221s return self.sync( 7221s /usr/lib/python3/dist-packages/distributed/utils.py:362: in sync 7221s return sync( 7221s /usr/lib/python3/dist-packages/distributed/utils.py:438: in sync 7221s raise error 7221s /usr/lib/python3/dist-packages/distributed/utils.py:412: in f 7221s result = yield future 7221s /usr/lib/python3/dist-packages/tornado/gen.py:766: in run 7221s value = future.result() 7221s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7221s 7221s self = 7221s function = . at 0xe9b31a78> 7221s nanny = False, workers = None, wait = True, on_error = 'raise', args = () 7221s kwargs = {} 7221s responses = {'tcp://127.0.0.1:39611': {'exception': b'\x80\x05\x953\x02\x00\x00\x00\x00\x00\x00\x8c\x16tblib.pickling_support\x94\...xt': "SystemError('no locals found when setting up annotations')", 'status': 'error', 'traceback': b'\x80\x05N.', ...}} 7221s results = {}, key = 'tcp://127.0.0.1:39611' 7221s resp = {'exception': b'\x80\x05\x953\x02\x00\x00\x00\x00\x00\x00\x8c\x16tblib.pickling_support\x94\x8c\x12unpickle_exception\...ext': "SystemError('no locals found when setting up annotations')", 'status': 'error', 'traceback': b'\x80\x05N.', ...} 7221s exc = SystemError('no locals found when setting up annotations') 7221s _ = 7221s 7221s async def _run( 7221s self, 7221s function, 7221s *args, 7221s nanny: bool = False, 7221s workers: list[str] | None = None, 7221s wait: bool = True, 7221s on_error: Literal["raise", "return", "ignore"] = "raise", 7221s **kwargs, 7221s ): 7221s responses = await self.scheduler.broadcast( 7221s msg=dict( 7221s op="run", 7221s function=dumps(function), 7221s args=dumps(args), 7221s wait=wait, 7221s kwargs=dumps(kwargs), 7221s ), 7221s workers=workers, 7221s nanny=nanny, 7221s on_error="return_pickle", 7221s ) 7221s results = {} 7221s for key, resp in responses.items(): 7221s if isinstance(resp, bytes): 7221s # Pickled RPC exception 7221s exc = loads(resp) 7221s assert isinstance(exc, Exception) 7221s elif resp["status"] == "error": 7221s # Exception raised by the remote function 7221s _, exc, tb = clean_exception(**resp) 7221s exc = exc.with_traceback(tb) 7221s else: 7221s assert resp["status"] == "OK" 7221s results[key] = resp["result"] 7221s continue 7221s 7221s if on_error == "raise": 7221s > raise exc 7221s E SystemError: no locals found when setting up annotations 7221s 7221s /usr/lib/python3/dist-packages/distributed/client.py:2898: SystemError 7221s ----------------------------- Captured stderr call ----------------------------- 7221s 2024-11-23 22:16:40,883 - distributed.scheduler - INFO - ----------------------------------------------- 7221s 2024-11-23 22:16:40,905 - distributed.http.proxy - INFO - To route to workers diagnostics web server please install jupyter-server-proxy: python -m pip install jupyter-server-proxy 7221s 2024-11-23 22:16:40,908 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:16:40,910 - distributed.diskutils - INFO - Found stale lock file and directory '/tmp/dask-scratch-space/scheduler-_wmccdfm', purging 7221s 2024-11-23 22:16:40,917 - distributed.scheduler - INFO - ----------------------------------------------- 7221s 2024-11-23 22:16:40,918 - distributed.scheduler - INFO - Scheduler at: tcp://127.0.0.1:46849 7221s 2024-11-23 22:16:40,918 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:8787/status 7221s 2024-11-23 22:16:40,919 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:16:41,166 - distributed.utils - INFO - Reload module tmp4pw87kl0 from .py file 7221s 2024-11-23 22:16:41,167 - distributed.scheduler - INFO - Receive client connection: Client-9cf65375-a9e8-11ef-bdd0-00163e4db70f 7221s 2024-11-23 22:16:41,168 - distributed.preloading - INFO - Import preload module: /tmp/tmp4pw87kl0.py 7221s 2024-11-23 22:16:41,184 - distributed.preloading - INFO - Creating preload: 7221s def dask_setup(worker): 7221s worker.foo = 'setup' 7221s 7221s 2024-11-23 22:16:41,186 - distributed.utils - INFO - Reload module tmpmo74oprr from .py file 7221s 2024-11-23 22:16:41,187 - distributed.preloading - INFO - Import preload module: /tmp/tmpmo74oprr.py 7221s 2024-11-23 22:16:41,190 - distributed.preloading - INFO - Run preload setup: 7221s def dask_setup(worker): 7221s worker.foo = 'setup' 7221s 7221s 2024-11-23 22:16:41,471 - distributed.core - INFO - Starting established connection to tcp://127.0.0.1:55296 7221s 2024-11-23 22:16:41,477 - distributed.nanny - INFO - Start Nanny at: 'tcp://127.0.0.1:42631' 7221s 2024-11-23 22:16:42,198 - distributed.preloading - INFO - Creating preload: 7221s def dask_setup(worker): 7221s worker.foo = 'setup' 7221s 7221s 2024-11-23 22:16:42,200 - distributed.utils - INFO - Reload module tmph6jvq335 from .py file 7221s 2024-11-23 22:16:42,202 - distributed.preloading - INFO - Import preload module: /tmp/tmph6jvq335.py 7221s 2024-11-23 22:16:42,242 - distributed.preloading - INFO - Run preload setup: 7221s def dask_setup(worker): 7221s worker.foo = 'setup' 7221s 7221s 2024-11-23 22:16:42,243 - distributed.worker - INFO - Start worker at: tcp://127.0.0.1:39611 7221s 2024-11-23 22:16:42,243 - distributed.worker - INFO - Listening to: tcp://127.0.0.1:39611 7221s 2024-11-23 22:16:42,243 - distributed.worker - INFO - dashboard at: 127.0.0.1:34005 7221s 2024-11-23 22:16:42,243 - distributed.worker - INFO - Waiting to connect to: tcp://localhost:46849 7221s 2024-11-23 22:16:42,243 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:16:42,243 - distributed.worker - INFO - Threads: 8 7221s 2024-11-23 22:16:42,243 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:16:42,244 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-e19f1fqz 7221s 2024-11-23 22:16:42,244 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:16:42,702 - distributed.scheduler - INFO - Register worker 7221s 2024-11-23 22:16:42,703 - distributed.scheduler - INFO - Starting worker compute stream, tcp://127.0.0.1:39611 7221s 2024-11-23 22:16:42,704 - distributed.core - INFO - Starting established connection to tcp://127.0.0.1:36896 7221s 2024-11-23 22:16:42,705 - distributed.worker - INFO - Starting Worker plugin shuffle 7221s 2024-11-23 22:16:42,706 - distributed.worker - INFO - Registered to: tcp://localhost:46849 7221s 2024-11-23 22:16:42,707 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:16:42,708 - distributed.core - INFO - Starting established connection to tcp://localhost:46849 7221s 2024-11-23 22:16:42,804 - distributed.worker - INFO - Run out-of-band function 'lambda' 7221s 2024-11-23 22:16:42,804 - distributed.worker - WARNING - Run Failed 7221s Function: lambda 7221s args: () 7221s kwargs: {'dask_worker': } 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 3182, in run 7221s result = function(*args, **kwargs) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s SystemError: no locals found when setting up annotations 7221s 2024-11-23 22:16:42,811 - distributed.scheduler - INFO - Remove client Client-9cf65375-a9e8-11ef-bdd0-00163e4db70f 7221s 2024-11-23 22:16:42,811 - distributed.core - INFO - Received 'close-stream' from tcp://127.0.0.1:55296; closing. 7221s 2024-11-23 22:16:42,812 - distributed.scheduler - INFO - Remove client Client-9cf65375-a9e8-11ef-bdd0-00163e4db70f 7221s 2024-11-23 22:16:42,812 - distributed.scheduler - INFO - Close client connection: Client-9cf65375-a9e8-11ef-bdd0-00163e4db70f 7221s 2024-11-23 22:16:42,813 - distributed._signals - INFO - Received signal SIGINT (2) 7221s 2024-11-23 22:16:42,813 - distributed.nanny - INFO - Closing Nanny at 'tcp://127.0.0.1:42631'. Reason: signal-2 7221s 2024-11-23 22:16:42,814 - distributed.nanny - INFO - Nanny asking worker to close. Reason: signal-2 7221s 2024-11-23 22:16:42,815 - distributed.worker - INFO - Stopping worker at tcp://127.0.0.1:39611. Reason: signal-2 7221s 2024-11-23 22:16:42,818 - distributed.core - INFO - Received 'close-stream' from tcp://127.0.0.1:36896; closing. 7221s 2024-11-23 22:16:42,818 - distributed.scheduler - INFO - Remove worker (stimulus_id='handle-worker-cleanup-1732400202.8188803') 7221s 2024-11-23 22:16:42,818 - distributed.core - INFO - Connection to tcp://localhost:46849 has been closed. 7221s 2024-11-23 22:16:42,819 - distributed.scheduler - INFO - Lost all workers 7221s 2024-11-23 22:16:42,821 - distributed.nanny - INFO - Worker closed 7221s 2024-11-23 22:16:43,277 - distributed.dask_worker - INFO - End worker 7221s 2024-11-23 22:16:43,630 - distributed._signals - INFO - Received signal SIGINT (2) 7221s 2024-11-23 22:16:43,630 - distributed.scheduler - INFO - Scheduler closing due to signal-2... 7221s 2024-11-23 22:16:43,630 - distributed.scheduler - INFO - Scheduler closing all comms 7221s 2024-11-23 22:16:43,631 - distributed.scheduler - INFO - Stopped scheduler at 'tcp://127.0.0.1:46849' 7221s 2024-11-23 22:16:43,631 - distributed.scheduler - INFO - End scheduler 7221s __________________________________ test_basic __________________________________ 7221s 7221s self = 7221s address = '127.0.0.1:8786', deserialize = True 7221s connection_args = {'extra_conn_args': {}, 'require_encryption': False, 'ssl_context': } 7221s ip = '127.0.0.1', port = 8786 7221s kwargs = {'ssl_options': } 7221s 7221s async def connect(self, address, deserialize=True, **connection_args): 7221s self._check_encryption(address, connection_args) 7221s ip, port = parse_host_port(address) 7221s kwargs = self._get_connect_args(**connection_args) 7221s 7221s try: 7221s # server_hostname option (for SNI) only works with tornado.iostream.IOStream 7221s if "server_hostname" in kwargs: 7221s stream = await self.client.connect( 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE 7221s ) 7221s stream = await stream.start_tls(False, **kwargs) 7221s else: 7221s > stream = await self.client.connect( 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ) 7221s 7221s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:546: 7221s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7221s /usr/lib/python3/dist-packages/tornado/tcpclient.py:292: in connect 7221s stream = await stream.start_tls( 7221s /usr/lib/python3/dist-packages/tornado/iostream.py:1367: in _do_ssl_handshake 7221s self.socket.do_handshake() 7221s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7221s 7221s self = , block = False 7221s 7221s @_sslcopydoc 7221s def do_handshake(self, block=False): 7221s self._check_connected() 7221s timeout = self.gettimeout() 7221s try: 7221s if timeout == 0.0 and block: 7221s self.settimeout(None) 7221s > self._sslobj.do_handshake() 7221s E ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 7221s 7221s /usr/lib/python3.13/ssl.py:1372: SSLCertVerificationError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s loop = 7221s requires_default_ports = None 7221s 7221s def test_basic(loop, requires_default_ports): 7221s with ( 7221s popen(["dask", "scheduler", "--no-dashboard"] + tls_args), 7221s popen(["dask", "worker", "--no-dashboard", "tls://127.0.0.1:8786"] + tls_args), 7221s > Client("tls://127.0.0.1:8786", loop=loop, security=tls_security()) as c, 7221s ): 7221s 7221s /usr/lib/python3/dist-packages/distributed/cli/tests/test_tls_cli.py:37: 7221s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7221s /usr/lib/python3/dist-packages/distributed/client.py:1018: in __init__ 7221s self.start(timeout=timeout) 7221s /usr/lib/python3/dist-packages/distributed/client.py:1220: in start 7221s sync(self.loop, self._start, **kwargs) 7221s /usr/lib/python3/dist-packages/distributed/utils.py:438: in sync 7221s raise error 7221s /usr/lib/python3/dist-packages/distributed/utils.py:412: in f 7221s result = yield future 7221s /usr/lib/python3/dist-packages/tornado/gen.py:766: in run 7221s value = future.result() 7221s /usr/lib/python3/dist-packages/distributed/client.py:1299: in _start 7221s await self._ensure_connected(timeout=timeout) 7221s /usr/lib/python3/dist-packages/distributed/client.py:1361: in _ensure_connected 7221s comm = await connect( 7221s /usr/lib/python3/dist-packages/distributed/comm/core.py:342: in connect 7221s comm = await wait_for( 7221s /usr/lib/python3/dist-packages/distributed/utils.py:1960: in wait_for 7221s return await fut 7221s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7221s 7221s self = 7221s address = '127.0.0.1:8786', deserialize = True 7221s connection_args = {'extra_conn_args': {}, 'require_encryption': False, 'ssl_context': } 7221s ip = '127.0.0.1', port = 8786 7221s kwargs = {'ssl_options': } 7221s 7221s async def connect(self, address, deserialize=True, **connection_args): 7221s self._check_encryption(address, connection_args) 7221s ip, port = parse_host_port(address) 7221s kwargs = self._get_connect_args(**connection_args) 7221s 7221s try: 7221s # server_hostname option (for SNI) only works with tornado.iostream.IOStream 7221s if "server_hostname" in kwargs: 7221s stream = await self.client.connect( 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE 7221s ) 7221s stream = await stream.start_tls(False, **kwargs) 7221s else: 7221s stream = await self.client.connect( 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ) 7221s 7221s # Under certain circumstances tornado will have a closed connection with an 7221s # error and not raise a StreamClosedError. 7221s # 7221s # This occurs with tornado 5.x and openssl 1.1+ 7221s if stream.closed() and stream.error: 7221s raise StreamClosedError(stream.error) 7221s 7221s except StreamClosedError as e: 7221s # The socket connect() call failed 7221s convert_stream_closed_error(self, e) 7221s except SSLCertVerificationError as err: 7221s > raise FatalCommClosedError( 7221s "TLS certificate does not match. Check your security settings. " 7221s "More info at https://distributed.dask.org/en/latest/tls.html" 7221s ) from err 7221s E distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 7221s 7221s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:561: FatalCommClosedError 7221s ----------------------------- Captured stderr call ----------------------------- 7221s 2024-11-23 22:16:44,993 - distributed.scheduler - INFO - ----------------------------------------------- 7221s 2024-11-23 22:16:45,030 - distributed.http.proxy - INFO - To route to workers diagnostics web server please install jupyter-server-proxy: python -m pip install jupyter-server-proxy 7221s 2024-11-23 22:16:45,035 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:16:45,048 - distributed.scheduler - INFO - ----------------------------------------------- 7221s 2024-11-23 22:16:45,052 - distributed.scheduler - INFO - Scheduler at: tls://10.0.4.73:8786 7221s 2024-11-23 22:16:45,052 - distributed.scheduler - INFO - dashboard at: http://10.0.4.73:8787/status 7221s 2024-11-23 22:16:45,053 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:16:45,120 - distributed.nanny - INFO - Start Nanny at: 'tls://127.0.0.1:41639' 7221s 2024-11-23 22:16:45,217 - distributed.comm.tcp - WARNING - Listener on 'tls://0.0.0.0:8786': TLS handshake failed with remote 'tls://127.0.0.1:49278': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1000) 7221s 2024-11-23 22:16:45,218 - distributed._signals - INFO - Received signal SIGINT (2) 7221s 2024-11-23 22:16:45,219 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:41639'. Reason: signal-2 7221s 2024-11-23 22:16:45,754 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37423 7221s 2024-11-23 22:16:45,755 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37423 7221s 2024-11-23 22:16:45,755 - distributed.worker - INFO - dashboard at: 127.0.0.1:40071 7221s 2024-11-23 22:16:45,755 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:8786 7221s 2024-11-23 22:16:45,755 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:16:45,755 - distributed.worker - INFO - Threads: 8 7221s 2024-11-23 22:16:45,755 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:16:45,755 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-shg9a4pv 7221s 2024-11-23 22:16:45,755 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:16:46,069 - distributed.scheduler - INFO - Register worker 7221s 2024-11-23 22:16:46,517 - distributed.scheduler - INFO - Starting worker compute stream, tls://127.0.0.1:37423 7221s 2024-11-23 22:16:46,518 - distributed.core - INFO - Starting established connection to tls://127.0.0.1:49294 7221s 2024-11-23 22:16:46,518 - distributed.worker - INFO - Starting Worker plugin shuffle 7221s 2024-11-23 22:16:46,519 - distributed.worker - INFO - Registered to: tls://127.0.0.1:8786 7221s 2024-11-23 22:16:46,519 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:16:46,520 - distributed.core - INFO - Starting established connection to tls://127.0.0.1:8786 7221s 2024-11-23 22:16:46,546 - distributed.nanny - INFO - Nanny asking worker to close. Reason: signal-2 7221s 2024-11-23 22:16:46,548 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37423. Reason: signal-2 7221s 2024-11-23 22:16:46,550 - distributed.core - INFO - Received 'close-stream' from tls://127.0.0.1:49294; closing. 7221s 2024-11-23 22:16:46,550 - distributed.core - INFO - Connection to tls://127.0.0.1:8786 has been closed. 7221s 2024-11-23 22:16:46,551 - distributed.scheduler - INFO - Remove worker (stimulus_id='handle-worker-cleanup-1732400206.551311') 7221s 2024-11-23 22:16:46,551 - distributed.scheduler - INFO - Lost all workers 7221s 2024-11-23 22:16:46,554 - distributed.nanny - INFO - Worker closed 7221s 2024-11-23 22:16:46,797 - distributed.dask_worker - INFO - End worker 7221s 2024-11-23 22:16:47,140 - distributed._signals - INFO - Received signal SIGINT (2) 7221s 2024-11-23 22:16:47,140 - distributed.scheduler - INFO - Scheduler closing due to signal-2... 7221s 2024-11-23 22:16:47,141 - distributed.scheduler - INFO - Scheduler closing all comms 7221s 2024-11-23 22:16:47,143 - distributed.scheduler - INFO - Stopped scheduler at 'tls://10.0.4.73:8786' 7221s 2024-11-23 22:16:47,143 - distributed.scheduler - INFO - End scheduler 7221s ___________________________________ test_sni ___________________________________ 7221s 7221s self = 7221s address = '127.0.0.1:55627', deserialize = True 7221s connection_args = {'extra_conn_args': {}, 'require_encryption': False, 'ssl_context': } 7221s ip = '127.0.0.1', port = 55627 7221s kwargs = {'ssl_options': } 7221s 7221s async def connect(self, address, deserialize=True, **connection_args): 7221s self._check_encryption(address, connection_args) 7221s ip, port = parse_host_port(address) 7221s kwargs = self._get_connect_args(**connection_args) 7221s 7221s try: 7221s # server_hostname option (for SNI) only works with tornado.iostream.IOStream 7221s if "server_hostname" in kwargs: 7221s stream = await self.client.connect( 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE 7221s ) 7221s stream = await stream.start_tls(False, **kwargs) 7221s else: 7221s > stream = await self.client.connect( 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ) 7221s 7221s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:546: 7221s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7221s /usr/lib/python3/dist-packages/tornado/tcpclient.py:292: in connect 7221s stream = await stream.start_tls( 7221s /usr/lib/python3/dist-packages/tornado/iostream.py:1367: in _do_ssl_handshake 7221s self.socket.do_handshake() 7221s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7221s 7221s self = , block = False 7221s 7221s @_sslcopydoc 7221s def do_handshake(self, block=False): 7221s self._check_connected() 7221s timeout = self.gettimeout() 7221s try: 7221s if timeout == 0.0 and block: 7221s self.settimeout(None) 7221s > self._sslobj.do_handshake() 7221s E ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 7221s 7221s /usr/lib/python3.13/ssl.py:1372: SSLCertVerificationError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s loop = 7221s 7221s def test_sni(loop): 7221s port = open_port() 7221s with popen( 7221s ["dask", "scheduler", "--no-dashboard", f"--port={port}"] + tls_args 7221s ) as s: 7221s with popen( 7221s [ 7221s "dask", 7221s "worker", 7221s "--no-dashboard", 7221s "--scheduler-sni", 7221s "localhost", 7221s f"tls://127.0.0.1:{port}", 7221s ] 7221s + tls_args 7221s ) as w: 7221s > with Client( 7221s f"tls://127.0.0.1:{port}", loop=loop, security=tls_security() 7221s ) as c: 7221s 7221s /usr/lib/python3/dist-packages/distributed/cli/tests/test_tls_cli.py:58: 7221s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7221s /usr/lib/python3/dist-packages/distributed/client.py:1018: in __init__ 7221s self.start(timeout=timeout) 7221s /usr/lib/python3/dist-packages/distributed/client.py:1220: in start 7221s sync(self.loop, self._start, **kwargs) 7221s /usr/lib/python3/dist-packages/distributed/utils.py:438: in sync 7221s raise error 7221s /usr/lib/python3/dist-packages/distributed/utils.py:412: in f 7221s result = yield future 7221s /usr/lib/python3/dist-packages/tornado/gen.py:766: in run 7221s value = future.result() 7221s /usr/lib/python3/dist-packages/distributed/client.py:1299: in _start 7221s await self._ensure_connected(timeout=timeout) 7221s /usr/lib/python3/dist-packages/distributed/client.py:1361: in _ensure_connected 7221s comm = await connect( 7221s /usr/lib/python3/dist-packages/distributed/comm/core.py:342: in connect 7221s comm = await wait_for( 7221s /usr/lib/python3/dist-packages/distributed/utils.py:1960: in wait_for 7221s return await fut 7221s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7221s 7221s self = 7221s address = '127.0.0.1:55627', deserialize = True 7221s connection_args = {'extra_conn_args': {}, 'require_encryption': False, 'ssl_context': } 7221s ip = '127.0.0.1', port = 55627 7221s kwargs = {'ssl_options': } 7221s 7221s async def connect(self, address, deserialize=True, **connection_args): 7221s self._check_encryption(address, connection_args) 7221s ip, port = parse_host_port(address) 7221s kwargs = self._get_connect_args(**connection_args) 7221s 7221s try: 7221s # server_hostname option (for SNI) only works with tornado.iostream.IOStream 7221s if "server_hostname" in kwargs: 7221s stream = await self.client.connect( 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE 7221s ) 7221s stream = await stream.start_tls(False, **kwargs) 7221s else: 7221s stream = await self.client.connect( 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ) 7221s 7221s # Under certain circumstances tornado will have a closed connection with an 7221s # error and not raise a StreamClosedError. 7221s # 7221s # This occurs with tornado 5.x and openssl 1.1+ 7221s if stream.closed() and stream.error: 7221s raise StreamClosedError(stream.error) 7221s 7221s except StreamClosedError as e: 7221s # The socket connect() call failed 7221s convert_stream_closed_error(self, e) 7221s except SSLCertVerificationError as err: 7221s > raise FatalCommClosedError( 7221s "TLS certificate does not match. Check your security settings. " 7221s "More info at https://distributed.dask.org/en/latest/tls.html" 7221s ) from err 7221s E distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 7221s 7221s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:561: FatalCommClosedError 7221s ----------------------------- Captured stderr call ----------------------------- 7221s 2024-11-23 22:16:48,832 - distributed.scheduler - INFO - ----------------------------------------------- 7221s 2024-11-23 22:16:48,867 - distributed.http.proxy - INFO - To route to workers diagnostics web server please install jupyter-server-proxy: python -m pip install jupyter-server-proxy 7221s 2024-11-23 22:16:48,872 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:16:48,884 - distributed.scheduler - INFO - ----------------------------------------------- 7221s 2024-11-23 22:16:48,887 - distributed.scheduler - INFO - Scheduler at: tls://10.0.4.73:55627 7221s 2024-11-23 22:16:48,888 - distributed.scheduler - INFO - dashboard at: http://10.0.4.73:8787/status 7221s 2024-11-23 22:16:48,888 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:16:48,936 - distributed.nanny - INFO - Start Nanny at: 'tls://127.0.0.1:42365' 7221s 2024-11-23 22:16:49,212 - distributed.comm.tcp - WARNING - Listener on 'tls://0.0.0.0:55627': TLS handshake failed with remote 'tls://127.0.0.1:46028': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1000) 7221s 2024-11-23 22:16:49,213 - distributed._signals - INFO - Received signal SIGINT (2) 7221s 2024-11-23 22:16:49,213 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:42365'. Reason: signal-2 7221s 2024-11-23 22:16:49,670 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41105 7221s 2024-11-23 22:16:49,670 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41105 7221s 2024-11-23 22:16:49,670 - distributed.worker - INFO - dashboard at: 127.0.0.1:39179 7221s 2024-11-23 22:16:49,670 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:55627 7221s 2024-11-23 22:16:49,670 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:16:49,670 - distributed.worker - INFO - Threads: 8 7221s 2024-11-23 22:16:49,670 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:16:49,670 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-opxg76_e 7221s 2024-11-23 22:16:49,670 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:16:49,982 - distributed.scheduler - INFO - Register worker 7221s 2024-11-23 22:16:50,429 - distributed.scheduler - INFO - Starting worker compute stream, tls://127.0.0.1:41105 7221s 2024-11-23 22:16:50,429 - distributed.core - INFO - Starting established connection to tls://127.0.0.1:46036 7221s 2024-11-23 22:16:50,430 - distributed.worker - INFO - Starting Worker plugin shuffle 7221s 2024-11-23 22:16:50,431 - distributed.worker - INFO - Registered to: tls://127.0.0.1:55627 7221s 2024-11-23 22:16:50,431 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:16:50,432 - distributed.core - INFO - Starting established connection to tls://127.0.0.1:55627 7221s 2024-11-23 22:16:50,461 - distributed.nanny - INFO - Nanny asking worker to close. Reason: signal-2 7221s 2024-11-23 22:16:50,463 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41105. Reason: signal-2 7221s 2024-11-23 22:16:50,465 - distributed.core - INFO - Received 'close-stream' from tls://127.0.0.1:46036; closing. 7221s 2024-11-23 22:16:50,465 - distributed.core - INFO - Connection to tls://127.0.0.1:55627 has been closed. 7221s 2024-11-23 22:16:50,465 - distributed.scheduler - INFO - Remove worker (stimulus_id='handle-worker-cleanup-1732400210.4658682') 7221s 2024-11-23 22:16:50,466 - distributed.scheduler - INFO - Lost all workers 7221s 2024-11-23 22:16:50,468 - distributed.nanny - INFO - Worker closed 7221s 2024-11-23 22:16:50,714 - distributed.dask_worker - INFO - End worker 7221s 2024-11-23 22:16:51,032 - distributed._signals - INFO - Received signal SIGINT (2) 7221s 2024-11-23 22:16:51,032 - distributed.scheduler - INFO - Scheduler closing due to signal-2... 7221s 2024-11-23 22:16:51,033 - distributed.scheduler - INFO - Scheduler closing all comms 7221s 2024-11-23 22:16:51,034 - distributed.scheduler - INFO - Stopped scheduler at 'tls://10.0.4.73:55627' 7221s 2024-11-23 22:16:51,034 - distributed.scheduler - INFO - End scheduler 7221s __________________________________ test_nanny __________________________________ 7221s 7221s self = 7221s address = '127.0.0.1:46405', deserialize = True 7221s connection_args = {'extra_conn_args': {}, 'require_encryption': False, 'ssl_context': } 7221s ip = '127.0.0.1', port = 46405 7221s kwargs = {'ssl_options': } 7221s 7221s async def connect(self, address, deserialize=True, **connection_args): 7221s self._check_encryption(address, connection_args) 7221s ip, port = parse_host_port(address) 7221s kwargs = self._get_connect_args(**connection_args) 7221s 7221s try: 7221s # server_hostname option (for SNI) only works with tornado.iostream.IOStream 7221s if "server_hostname" in kwargs: 7221s stream = await self.client.connect( 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE 7221s ) 7221s stream = await stream.start_tls(False, **kwargs) 7221s else: 7221s > stream = await self.client.connect( 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ) 7221s 7221s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:546: 7221s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7221s /usr/lib/python3/dist-packages/tornado/tcpclient.py:292: in connect 7221s stream = await stream.start_tls( 7221s /usr/lib/python3/dist-packages/tornado/iostream.py:1367: in _do_ssl_handshake 7221s self.socket.do_handshake() 7221s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7221s 7221s self = , block = False 7221s 7221s @_sslcopydoc 7221s def do_handshake(self, block=False): 7221s self._check_connected() 7221s timeout = self.gettimeout() 7221s try: 7221s if timeout == 0.0 and block: 7221s self.settimeout(None) 7221s > self._sslobj.do_handshake() 7221s E ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 7221s 7221s /usr/lib/python3.13/ssl.py:1372: SSLCertVerificationError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s loop = 7221s 7221s def test_nanny(loop): 7221s port = open_port() 7221s with popen( 7221s [ 7221s "dask", 7221s "scheduler", 7221s "--no-dashboard", 7221s f"--port={port}", 7221s ] 7221s + tls_args 7221s ) as s: 7221s with popen( 7221s ["dask", "worker", "--no-dashboard", "--nanny", f"tls://127.0.0.1:{port}"] 7221s + tls_args 7221s ) as w: 7221s > with Client( 7221s f"tls://127.0.0.1:{port}", loop=loop, security=tls_security() 7221s ) as c: 7221s 7221s /usr/lib/python3/dist-packages/distributed/cli/tests/test_tls_cli.py:79: 7221s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7221s /usr/lib/python3/dist-packages/distributed/client.py:1018: in __init__ 7221s self.start(timeout=timeout) 7221s /usr/lib/python3/dist-packages/distributed/client.py:1220: in start 7221s sync(self.loop, self._start, **kwargs) 7221s /usr/lib/python3/dist-packages/distributed/utils.py:438: in sync 7221s raise error 7221s /usr/lib/python3/dist-packages/distributed/utils.py:412: in f 7221s result = yield future 7221s /usr/lib/python3/dist-packages/tornado/gen.py:766: in run 7221s value = future.result() 7221s /usr/lib/python3/dist-packages/distributed/client.py:1299: in _start 7221s await self._ensure_connected(timeout=timeout) 7221s /usr/lib/python3/dist-packages/distributed/client.py:1361: in _ensure_connected 7221s comm = await connect( 7221s /usr/lib/python3/dist-packages/distributed/comm/core.py:342: in connect 7221s comm = await wait_for( 7221s /usr/lib/python3/dist-packages/distributed/utils.py:1960: in wait_for 7221s return await fut 7221s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7221s 7221s self = 7221s address = '127.0.0.1:46405', deserialize = True 7221s connection_args = {'extra_conn_args': {}, 'require_encryption': False, 'ssl_context': } 7221s ip = '127.0.0.1', port = 46405 7221s kwargs = {'ssl_options': } 7221s 7221s async def connect(self, address, deserialize=True, **connection_args): 7221s self._check_encryption(address, connection_args) 7221s ip, port = parse_host_port(address) 7221s kwargs = self._get_connect_args(**connection_args) 7221s 7221s try: 7221s # server_hostname option (for SNI) only works with tornado.iostream.IOStream 7221s if "server_hostname" in kwargs: 7221s stream = await self.client.connect( 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE 7221s ) 7221s stream = await stream.start_tls(False, **kwargs) 7221s else: 7221s stream = await self.client.connect( 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ) 7221s 7221s # Under certain circumstances tornado will have a closed connection with an 7221s # error and not raise a StreamClosedError. 7221s # 7221s # This occurs with tornado 5.x and openssl 1.1+ 7221s if stream.closed() and stream.error: 7221s raise StreamClosedError(stream.error) 7221s 7221s except StreamClosedError as e: 7221s # The socket connect() call failed 7221s convert_stream_closed_error(self, e) 7221s except SSLCertVerificationError as err: 7221s > raise FatalCommClosedError( 7221s "TLS certificate does not match. Check your security settings. " 7221s "More info at https://distributed.dask.org/en/latest/tls.html" 7221s ) from err 7221s E distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 7221s 7221s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:561: FatalCommClosedError 7221s ----------------------------- Captured stderr call ----------------------------- 7221s 2024-11-23 22:16:52,555 - distributed.scheduler - INFO - ----------------------------------------------- 7221s 2024-11-23 22:16:52,590 - distributed.http.proxy - INFO - To route to workers diagnostics web server please install jupyter-server-proxy: python -m pip install jupyter-server-proxy 7221s 2024-11-23 22:16:52,595 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:16:52,608 - distributed.scheduler - INFO - ----------------------------------------------- 7221s 2024-11-23 22:16:52,611 - distributed.scheduler - INFO - Scheduler at: tls://10.0.4.73:46405 7221s 2024-11-23 22:16:52,612 - distributed.scheduler - INFO - dashboard at: http://10.0.4.73:8787/status 7221s 2024-11-23 22:16:52,612 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:16:52,642 - distributed.nanny - INFO - Start Nanny at: 'tls://127.0.0.1:36923' 7221s 2024-11-23 22:16:53,305 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43663 7221s 2024-11-23 22:16:53,305 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43663 7221s 2024-11-23 22:16:53,305 - distributed.worker - INFO - dashboard at: 127.0.0.1:37291 7221s 2024-11-23 22:16:53,305 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46405 7221s 2024-11-23 22:16:53,305 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:16:53,305 - distributed.worker - INFO - Threads: 8 7221s 2024-11-23 22:16:53,305 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:16:53,305 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-x4lcpogk 7221s 2024-11-23 22:16:53,305 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:16:53,634 - distributed.scheduler - INFO - Register worker 7221s 2024-11-23 22:16:54,112 - distributed.scheduler - INFO - Starting worker compute stream, tls://127.0.0.1:43663 7221s 2024-11-23 22:16:54,113 - distributed.core - INFO - Starting established connection to tls://127.0.0.1:35638 7221s 2024-11-23 22:16:54,113 - distributed.worker - INFO - Starting Worker plugin shuffle 7221s 2024-11-23 22:16:54,114 - distributed.worker - INFO - Registered to: tls://127.0.0.1:46405 7221s 2024-11-23 22:16:54,114 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:16:54,115 - distributed.core - INFO - Starting established connection to tls://127.0.0.1:46405 7221s 2024-11-23 22:16:55,682 - distributed.comm.tcp - WARNING - Listener on 'tls://0.0.0.0:46405': TLS handshake failed with remote 'tls://127.0.0.1:35664': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1000) 7221s 2024-11-23 22:16:55,682 - distributed._signals - INFO - Received signal SIGINT (2) 7221s 2024-11-23 22:16:55,683 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:36923'. Reason: signal-2 7221s 2024-11-23 22:16:55,683 - distributed.nanny - INFO - Nanny asking worker to close. Reason: signal-2 7221s 2024-11-23 22:16:55,684 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43663. Reason: signal-2 7221s 2024-11-23 22:16:55,686 - distributed.core - INFO - Connection to tls://127.0.0.1:46405 has been closed. 7221s 2024-11-23 22:16:55,687 - distributed.core - INFO - Received 'close-stream' from tls://127.0.0.1:35638; closing. 7221s 2024-11-23 22:16:55,688 - distributed.scheduler - INFO - Remove worker (stimulus_id='handle-worker-cleanup-1732400215.6882968') 7221s 2024-11-23 22:16:55,689 - distributed.scheduler - INFO - Lost all workers 7221s 2024-11-23 22:16:55,689 - distributed.nanny - INFO - Worker closed 7221s 2024-11-23 22:16:55,946 - distributed.dask_worker - INFO - End worker 7221s 2024-11-23 22:16:56,148 - distributed._signals - INFO - Received signal SIGINT (2) 7221s 2024-11-23 22:16:56,148 - distributed.scheduler - INFO - Scheduler closing due to signal-2... 7221s 2024-11-23 22:16:56,149 - distributed.scheduler - INFO - Scheduler closing all comms 7221s 2024-11-23 22:16:56,150 - distributed.scheduler - INFO - Stopped scheduler at 'tls://10.0.4.73:46405' 7221s 2024-11-23 22:16:56,151 - distributed.scheduler - INFO - End scheduler 7221s ____________________________ test_separate_key_cert ____________________________ 7221s 7221s self = 7221s address = '127.0.0.1:59799', deserialize = True 7221s connection_args = {'extra_conn_args': {}, 'require_encryption': False, 'ssl_context': } 7221s ip = '127.0.0.1', port = 59799 7221s kwargs = {'ssl_options': } 7221s 7221s async def connect(self, address, deserialize=True, **connection_args): 7221s self._check_encryption(address, connection_args) 7221s ip, port = parse_host_port(address) 7221s kwargs = self._get_connect_args(**connection_args) 7221s 7221s try: 7221s # server_hostname option (for SNI) only works with tornado.iostream.IOStream 7221s if "server_hostname" in kwargs: 7221s stream = await self.client.connect( 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE 7221s ) 7221s stream = await stream.start_tls(False, **kwargs) 7221s else: 7221s > stream = await self.client.connect( 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ) 7221s 7221s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:546: 7221s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7221s /usr/lib/python3/dist-packages/tornado/tcpclient.py:292: in connect 7221s stream = await stream.start_tls( 7221s /usr/lib/python3/dist-packages/tornado/iostream.py:1367: in _do_ssl_handshake 7221s self.socket.do_handshake() 7221s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7221s 7221s self = , block = False 7221s 7221s @_sslcopydoc 7221s def do_handshake(self, block=False): 7221s self._check_connected() 7221s timeout = self.gettimeout() 7221s try: 7221s if timeout == 0.0 and block: 7221s self.settimeout(None) 7221s > self._sslobj.do_handshake() 7221s E ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 7221s 7221s /usr/lib/python3.13/ssl.py:1372: SSLCertVerificationError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s loop = 7221s 7221s def test_separate_key_cert(loop): 7221s port = open_port() 7221s with popen( 7221s [ 7221s "dask", 7221s "scheduler", 7221s "--no-dashboard", 7221s f"--port={port}", 7221s ] 7221s + tls_args_2 7221s ) as s: 7221s with popen( 7221s ["dask", "worker", "--no-dashboard", f"tls://127.0.0.1:{port}"] + tls_args_2 7221s ) as w: 7221s > with Client( 7221s f"tls://127.0.0.1:{port}", loop=loop, security=tls_security() 7221s ) as c: 7221s 7221s /usr/lib/python3/dist-packages/distributed/cli/tests/test_tls_cli.py:99: 7221s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7221s /usr/lib/python3/dist-packages/distributed/client.py:1018: in __init__ 7221s self.start(timeout=timeout) 7221s /usr/lib/python3/dist-packages/distributed/client.py:1220: in start 7221s sync(self.loop, self._start, **kwargs) 7221s /usr/lib/python3/dist-packages/distributed/utils.py:438: in sync 7221s raise error 7221s /usr/lib/python3/dist-packages/distributed/utils.py:412: in f 7221s result = yield future 7221s /usr/lib/python3/dist-packages/tornado/gen.py:766: in run 7221s value = future.result() 7221s /usr/lib/python3/dist-packages/distributed/client.py:1299: in _start 7221s await self._ensure_connected(timeout=timeout) 7221s /usr/lib/python3/dist-packages/distributed/client.py:1361: in _ensure_connected 7221s comm = await connect( 7221s /usr/lib/python3/dist-packages/distributed/comm/core.py:342: in connect 7221s comm = await wait_for( 7221s /usr/lib/python3/dist-packages/distributed/utils.py:1960: in wait_for 7221s return await fut 7221s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7221s 7221s self = 7221s address = '127.0.0.1:59799', deserialize = True 7221s connection_args = {'extra_conn_args': {}, 'require_encryption': False, 'ssl_context': } 7221s ip = '127.0.0.1', port = 59799 7221s kwargs = {'ssl_options': } 7221s 7221s async def connect(self, address, deserialize=True, **connection_args): 7221s self._check_encryption(address, connection_args) 7221s ip, port = parse_host_port(address) 7221s kwargs = self._get_connect_args(**connection_args) 7221s 7221s try: 7221s # server_hostname option (for SNI) only works with tornado.iostream.IOStream 7221s if "server_hostname" in kwargs: 7221s stream = await self.client.connect( 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE 7221s ) 7221s stream = await stream.start_tls(False, **kwargs) 7221s else: 7221s stream = await self.client.connect( 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ) 7221s 7221s # Under certain circumstances tornado will have a closed connection with an 7221s # error and not raise a StreamClosedError. 7221s # 7221s # This occurs with tornado 5.x and openssl 1.1+ 7221s if stream.closed() and stream.error: 7221s raise StreamClosedError(stream.error) 7221s 7221s except StreamClosedError as e: 7221s # The socket connect() call failed 7221s convert_stream_closed_error(self, e) 7221s except SSLCertVerificationError as err: 7221s > raise FatalCommClosedError( 7221s "TLS certificate does not match. Check your security settings. " 7221s "More info at https://distributed.dask.org/en/latest/tls.html" 7221s ) from err 7221s E distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 7221s 7221s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:561: FatalCommClosedError 7221s ----------------------------- Captured stderr call ----------------------------- 7221s 2024-11-23 22:16:57,570 - distributed.scheduler - INFO - ----------------------------------------------- 7221s 2024-11-23 22:16:57,593 - distributed.http.proxy - INFO - To route to workers diagnostics web server please install jupyter-server-proxy: python -m pip install jupyter-server-proxy 7221s 2024-11-23 22:16:57,596 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:16:57,604 - distributed.scheduler - INFO - ----------------------------------------------- 7221s 2024-11-23 22:16:57,606 - distributed.scheduler - INFO - Scheduler at: tls://10.0.4.73:59799 7221s 2024-11-23 22:16:57,607 - distributed.scheduler - INFO - dashboard at: http://10.0.4.73:8787/status 7221s 2024-11-23 22:16:57,607 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:16:57,894 - distributed.nanny - INFO - Start Nanny at: 'tls://127.0.0.1:36895' 7221s 2024-11-23 22:16:58,414 - distributed.comm.tcp - WARNING - Listener on 'tls://0.0.0.0:59799': TLS handshake failed with remote 'tls://127.0.0.1:34408': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1000) 7221s 2024-11-23 22:16:58,415 - distributed._signals - INFO - Received signal SIGINT (2) 7221s 2024-11-23 22:16:58,416 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:36895'. Reason: signal-2 7221s 2024-11-23 22:16:58,522 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39045 7221s 2024-11-23 22:16:58,523 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39045 7221s 2024-11-23 22:16:58,523 - distributed.worker - INFO - dashboard at: 127.0.0.1:46867 7221s 2024-11-23 22:16:58,523 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:59799 7221s 2024-11-23 22:16:58,523 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:16:58,523 - distributed.worker - INFO - Threads: 8 7221s 2024-11-23 22:16:58,523 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:16:58,523 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-cvnsaj1p 7221s 2024-11-23 22:16:58,523 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:16:58,829 - distributed.scheduler - INFO - Register worker 7221s 2024-11-23 22:16:59,138 - distributed.scheduler - INFO - Starting worker compute stream, tls://127.0.0.1:39045 7221s 2024-11-23 22:16:59,139 - distributed.core - INFO - Starting established connection to tls://127.0.0.1:34422 7221s 2024-11-23 22:16:59,139 - distributed.worker - INFO - Starting Worker plugin shuffle 7221s 2024-11-23 22:16:59,140 - distributed.worker - INFO - Registered to: tls://127.0.0.1:59799 7221s 2024-11-23 22:16:59,140 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:16:59,141 - distributed.core - INFO - Starting established connection to tls://127.0.0.1:59799 7221s 2024-11-23 22:16:59,170 - distributed.nanny - INFO - Nanny asking worker to close. Reason: signal-2 7221s 2024-11-23 22:16:59,171 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39045. Reason: signal-2 7221s 2024-11-23 22:16:59,173 - distributed.core - INFO - Received 'close-stream' from tls://127.0.0.1:34422; closing. 7221s 2024-11-23 22:16:59,173 - distributed.core - INFO - Connection to tls://127.0.0.1:59799 has been closed. 7221s 2024-11-23 22:16:59,174 - distributed.scheduler - INFO - Remove worker (stimulus_id='handle-worker-cleanup-1732400219.174478') 7221s 2024-11-23 22:16:59,174 - distributed.scheduler - INFO - Lost all workers 7221s 2024-11-23 22:16:59,176 - distributed.nanny - INFO - Worker closed 7221s 2024-11-23 22:16:59,420 - distributed.dask_worker - INFO - End worker 7221s 2024-11-23 22:16:59,736 - distributed._signals - INFO - Received signal SIGINT (2) 7221s 2024-11-23 22:16:59,736 - distributed.scheduler - INFO - Scheduler closing due to signal-2... 7221s 2024-11-23 22:16:59,736 - distributed.scheduler - INFO - Scheduler closing all comms 7221s 2024-11-23 22:16:59,737 - distributed.scheduler - INFO - Stopped scheduler at 'tls://10.0.4.73:59799' 7221s 2024-11-23 22:16:59,738 - distributed.scheduler - INFO - End scheduler 7221s _____________________________ test_use_config_file _____________________________ 7221s 7221s self = 7221s address = '127.0.0.1:41963', deserialize = True 7221s connection_args = {'extra_conn_args': {}, 'require_encryption': False, 'ssl_context': } 7221s ip = '127.0.0.1', port = 41963 7221s kwargs = {'ssl_options': } 7221s 7221s async def connect(self, address, deserialize=True, **connection_args): 7221s self._check_encryption(address, connection_args) 7221s ip, port = parse_host_port(address) 7221s kwargs = self._get_connect_args(**connection_args) 7221s 7221s try: 7221s # server_hostname option (for SNI) only works with tornado.iostream.IOStream 7221s if "server_hostname" in kwargs: 7221s stream = await self.client.connect( 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE 7221s ) 7221s stream = await stream.start_tls(False, **kwargs) 7221s else: 7221s > stream = await self.client.connect( 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ) 7221s 7221s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:546: 7221s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7221s /usr/lib/python3/dist-packages/tornado/tcpclient.py:292: in connect 7221s stream = await stream.start_tls( 7221s /usr/lib/python3/dist-packages/tornado/iostream.py:1367: in _do_ssl_handshake 7221s self.socket.do_handshake() 7221s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7221s 7221s self = , block = False 7221s 7221s @_sslcopydoc 7221s def do_handshake(self, block=False): 7221s self._check_connected() 7221s timeout = self.gettimeout() 7221s try: 7221s if timeout == 0.0 and block: 7221s self.settimeout(None) 7221s > self._sslobj.do_handshake() 7221s E ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 7221s 7221s /usr/lib/python3.13/ssl.py:1372: SSLCertVerificationError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s loop = 7221s 7221s def test_use_config_file(loop): 7221s port = open_port() 7221s with new_config_file(tls_only_config()): 7221s with popen( 7221s [ 7221s "dask", 7221s "scheduler", 7221s "--no-dashboard", 7221s "--host", 7221s "tls://", 7221s "--port", 7221s str(port), 7221s ] 7221s ) as s: 7221s with popen( 7221s ["dask", "worker", "--no-dashboard", f"tls://127.0.0.1:{port}"] 7221s ) as w: 7221s > with Client( 7221s f"tls://127.0.0.1:{port}", loop=loop, security=tls_security() 7221s ) as c: 7221s 7221s /usr/lib/python3/dist-packages/distributed/cli/tests/test_tls_cli.py:122: 7221s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7221s /usr/lib/python3/dist-packages/distributed/client.py:1018: in __init__ 7221s self.start(timeout=timeout) 7221s /usr/lib/python3/dist-packages/distributed/client.py:1220: in start 7221s sync(self.loop, self._start, **kwargs) 7221s /usr/lib/python3/dist-packages/distributed/utils.py:438: in sync 7221s raise error 7221s /usr/lib/python3/dist-packages/distributed/utils.py:412: in f 7221s result = yield future 7221s /usr/lib/python3/dist-packages/tornado/gen.py:766: in run 7221s value = future.result() 7221s /usr/lib/python3/dist-packages/distributed/client.py:1299: in _start 7221s await self._ensure_connected(timeout=timeout) 7221s /usr/lib/python3/dist-packages/distributed/client.py:1361: in _ensure_connected 7221s comm = await connect( 7221s /usr/lib/python3/dist-packages/distributed/comm/core.py:342: in connect 7221s comm = await wait_for( 7221s /usr/lib/python3/dist-packages/distributed/utils.py:1960: in wait_for 7221s return await fut 7221s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7221s 7221s self = 7221s address = '127.0.0.1:41963', deserialize = True 7221s connection_args = {'extra_conn_args': {}, 'require_encryption': False, 'ssl_context': } 7221s ip = '127.0.0.1', port = 41963 7221s kwargs = {'ssl_options': } 7221s 7221s async def connect(self, address, deserialize=True, **connection_args): 7221s self._check_encryption(address, connection_args) 7221s ip, port = parse_host_port(address) 7221s kwargs = self._get_connect_args(**connection_args) 7221s 7221s try: 7221s # server_hostname option (for SNI) only works with tornado.iostream.IOStream 7221s if "server_hostname" in kwargs: 7221s stream = await self.client.connect( 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE 7221s ) 7221s stream = await stream.start_tls(False, **kwargs) 7221s else: 7221s stream = await self.client.connect( 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ) 7221s 7221s # Under certain circumstances tornado will have a closed connection with an 7221s # error and not raise a StreamClosedError. 7221s # 7221s # This occurs with tornado 5.x and openssl 1.1+ 7221s if stream.closed() and stream.error: 7221s raise StreamClosedError(stream.error) 7221s 7221s except StreamClosedError as e: 7221s # The socket connect() call failed 7221s convert_stream_closed_error(self, e) 7221s except SSLCertVerificationError as err: 7221s > raise FatalCommClosedError( 7221s "TLS certificate does not match. Check your security settings. " 7221s "More info at https://distributed.dask.org/en/latest/tls.html" 7221s ) from err 7221s E distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 7221s 7221s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:561: FatalCommClosedError 7221s ----------------------------- Captured stderr call ----------------------------- 7221s 2024-11-23 22:17:01,392 - distributed.scheduler - INFO - ----------------------------------------------- 7221s 2024-11-23 22:17:01,428 - distributed.http.proxy - INFO - To route to workers diagnostics web server please install jupyter-server-proxy: python -m pip install jupyter-server-proxy 7221s 2024-11-23 22:17:01,434 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:17:01,446 - distributed.scheduler - INFO - ----------------------------------------------- 7221s 2024-11-23 22:17:01,450 - distributed.scheduler - INFO - Scheduler at: tls://10.0.4.73:41963 7221s 2024-11-23 22:17:01,450 - distributed.scheduler - INFO - dashboard at: http://10.0.4.73:8787/status 7221s 2024-11-23 22:17:01,451 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:17:01,479 - distributed.nanny - INFO - Start Nanny at: 'tls://127.0.0.1:44009' 7221s 2024-11-23 22:17:02,131 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40555 7221s 2024-11-23 22:17:02,131 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40555 7221s 2024-11-23 22:17:02,131 - distributed.worker - INFO - dashboard at: 127.0.0.1:46737 7221s 2024-11-23 22:17:02,131 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41963 7221s 2024-11-23 22:17:02,131 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:17:02,131 - distributed.worker - INFO - Threads: 8 7221s 2024-11-23 22:17:02,131 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:17:02,131 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-_uypfoa3 7221s 2024-11-23 22:17:02,131 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:17:02,594 - distributed.scheduler - INFO - Register worker 7221s 2024-11-23 22:17:03,060 - distributed.scheduler - INFO - Starting worker compute stream, tls://127.0.0.1:40555 7221s 2024-11-23 22:17:03,061 - distributed.core - INFO - Starting established connection to tls://127.0.0.1:46906 7221s 2024-11-23 22:17:03,062 - distributed.worker - INFO - Starting Worker plugin shuffle 7221s 2024-11-23 22:17:03,064 - distributed.worker - INFO - Registered to: tls://127.0.0.1:41963 7221s 2024-11-23 22:17:03,064 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:17:03,066 - distributed.core - INFO - Starting established connection to tls://127.0.0.1:41963 7221s 2024-11-23 22:17:03,074 - distributed._signals - INFO - Received signal SIGINT (2) 7221s 2024-11-23 22:17:03,074 - distributed.comm.tcp - WARNING - Listener on 'tls://0.0.0.0:41963': TLS handshake failed with remote 'tls://127.0.0.1:46916': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1000) 7221s 2024-11-23 22:17:03,074 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:44009'. Reason: signal-2 7221s 2024-11-23 22:17:03,098 - distributed.nanny - INFO - Nanny asking worker to close. Reason: signal-2 7221s 2024-11-23 22:17:03,099 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40555. Reason: signal-2 7221s 2024-11-23 22:17:03,102 - distributed.core - INFO - Received 'close-stream' from tls://127.0.0.1:46906; closing. 7221s 2024-11-23 22:17:03,103 - distributed.core - INFO - Connection to tls://127.0.0.1:41963 has been closed. 7221s 2024-11-23 22:17:03,104 - distributed.scheduler - INFO - Remove worker (stimulus_id='handle-worker-cleanup-1732400223.1038668') 7221s 2024-11-23 22:17:03,104 - distributed.scheduler - INFO - Lost all workers 7221s 2024-11-23 22:17:03,107 - distributed.nanny - INFO - Worker closed 7221s 2024-11-23 22:17:03,559 - distributed.dask_worker - INFO - End worker 7221s 2024-11-23 22:17:03,740 - distributed._signals - INFO - Received signal SIGINT (2) 7221s 2024-11-23 22:17:03,741 - distributed.scheduler - INFO - Scheduler closing due to signal-2... 7221s 2024-11-23 22:17:03,742 - distributed.scheduler - INFO - Scheduler closing all comms 7221s 2024-11-23 22:17:03,743 - distributed.scheduler - INFO - Stopped scheduler at 'tls://10.0.4.73:41963' 7221s 2024-11-23 22:17:03,744 - distributed.scheduler - INFO - End scheduler 7221s __________________________________ test_basic __________________________________ 7221s 7221s @pytest.mark.skipif(WINDOWS, reason="distributed#7434") 7221s @gen_test() 7221s async def test_basic(): 7221s async with SubprocessCluster( 7221s asynchronous=True, 7221s dashboard_address=":0", 7221s scheduler_kwargs={"idle_timeout": "5s"}, 7221s worker_kwargs={"death_timeout": "5s"}, 7221s ) as cluster: 7221s async with Client(cluster, asynchronous=True) as client: 7221s > result = await client.submit(lambda x: x + 1, 10) 7221s 7221s /usr/lib/python3/dist-packages/distributed/deploy/tests/test_subprocess.py:27: 7221s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7221s 7221s self = 7221s raiseit = True 7221s 7221s async def _result(self, raiseit=True): 7221s await self._state.wait() 7221s if self.status == "error": 7221s exc = clean_exception(self._state.exception, self._state.traceback) 7221s if raiseit: 7221s typ, exc, tb = exc 7221s > raise exc.with_traceback(tb) 7221s E SystemError: no locals found when setting up annotations 7221s 7221s /usr/lib/python3/dist-packages/distributed/client.py:337: SystemError 7221s ----------------------------- Captured stderr call ----------------------------- 7221s 2024-11-23 22:17:07,127 - distributed.worker - WARNING - Compute Failed 7221s Key: lambda-f3b41d234e8d3805a39c193d3564145c 7221s Function: lambda 7221s args: (10) 7221s kwargs: {} 7221s Exception: "SystemError('no locals found when setting up annotations')" 7221s 7221s ________________________________ test_n_workers ________________________________ 7221s 7221s @pytest.mark.skipif(WINDOWS, reason="distributed#7434") 7221s @gen_test() 7221s async def test_n_workers(): 7221s async with SubprocessCluster( 7221s asynchronous=True, dashboard_address=":0", n_workers=2 7221s ) as cluster: 7221s async with Client(cluster, asynchronous=True) as client: 7221s assert len(cluster.workers) == 2 7221s > result = await client.submit(lambda x: x + 1, 10) 7221s 7221s /usr/lib/python3/dist-packages/distributed/deploy/tests/test_subprocess.py:41: 7221s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7221s 7221s self = 7221s raiseit = True 7221s 7221s async def _result(self, raiseit=True): 7221s await self._state.wait() 7221s if self.status == "error": 7221s exc = clean_exception(self._state.exception, self._state.traceback) 7221s if raiseit: 7221s typ, exc, tb = exc 7221s > raise exc.with_traceback(tb) 7221s E SystemError: no locals found when setting up annotations 7221s 7221s /usr/lib/python3/dist-packages/distributed/client.py:337: SystemError 7221s ----------------------------- Captured stderr call ----------------------------- 7221s 2024-11-23 22:17:09,459 - distributed.worker - WARNING - Compute Failed 7221s Key: lambda-181b28c0c705f6e48fbf22b0c3a995c6 7221s Function: lambda 7221s args: (10) 7221s kwargs: {} 7221s Exception: "SystemError('no locals found when setting up annotations')" 7221s 7221s _____________________________ test_upload_file_zip _____________________________ 7221s 7221s c = 7221s s = 7221s a = 7221s b = 7221s 7221s @gen_cluster(client=True) 7221s async def test_upload_file_zip(c, s, a, b): 7221s def g(): 7221s import myfile 7221s 7221s return myfile.f() 7221s 7221s with save_sys_modules(): 7221s try: 7221s for value in [123, 456]: 7221s with tmp_text( 7221s "myfile.py", f"def f():\n return {value}" 7221s ) as fn_my_file: 7221s with zipfile.ZipFile("myfile.zip", "w") as z: 7221s z.write(fn_my_file, arcname=os.path.basename(fn_my_file)) 7221s > await c.upload_file("myfile.zip") 7221s 7221s /usr/lib/python3/dist-packages/distributed/tests/test_client.py:1716: 7221s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7221s /usr/lib/python3/dist-packages/distributed/client.py:3824: in _ 7221s results = await asyncio.gather( 7221s /usr/lib/python3/dist-packages/distributed/client.py:4939: in _register_scheduler_plugin 7221s return await self.scheduler.register_scheduler_plugin( 7221s /usr/lib/python3/dist-packages/distributed/core.py:1395: in send_recv_from_rpc 7221s return await send_recv(comm=comm, op=key, **kwargs) 7221s /usr/lib/python3/dist-packages/distributed/core.py:1179: in send_recv 7221s raise exc.with_traceback(tb) 7221s /usr/lib/python3/dist-packages/distributed/core.py:970: in _handle_comm 7221s result = await result 7221s /usr/lib/python3/dist-packages/distributed/scheduler.py:6035: in register_scheduler_plugin 7221s await result 7221s /usr/lib/python3/dist-packages/distributed/diagnostics/plugin.py:396: in start 7221s await scheduler.upload_file(self.filename, self.data, load=self.load) 7221s /usr/lib/python3/dist-packages/distributed/core.py:563: in upload_file 7221s raise e 7221s /usr/lib/python3/dist-packages/distributed/core.py:560: in upload_file 7221s import_file(out_filename) 7221s /usr/lib/python3/dist-packages/distributed/utils.py:1162: in import_file 7221s names_to_import.extend(names) 7221s /usr/lib/python3/dist-packages/distributed/utils.py:1161: in 7221s names = (mod_info.name for mod_info in pkgutil.iter_modules([path])) 7221s /usr/lib/python3.13/pkgutil.py:116: in iter_modules 7221s for name, ispkg in iter_importer_modules(i, prefix): 7221s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7221s 7221s """Utilities to support packages.""" 7221s 7221s from collections import namedtuple 7221s from functools import singledispatch as simplegeneric 7221s import importlib 7221s import importlib.util 7221s import importlib.machinery 7221s import os 7221s import os.path 7221s import sys 7221s from types import ModuleType 7221s import warnings 7221s 7221s __all__ = [ 7221s 'get_importer', 'iter_importers', 'get_loader', 'find_loader', 7221s 'walk_packages', 'iter_modules', 'get_data', 7221s 'read_code', 'extend_path', 7221s 'ModuleInfo', 7221s ] 7221s 7221s 7221s ModuleInfo = namedtuple('ModuleInfo', 'module_finder name ispkg') 7221s ModuleInfo.__doc__ = 'A namedtuple with minimal info about a module.' 7221s 7221s 7221s def read_code(stream): 7221s # This helper is needed in order for the PEP 302 emulation to 7221s # correctly handle compiled files 7221s import marshal 7221s 7221s magic = stream.read(4) 7221s if magic != importlib.util.MAGIC_NUMBER: 7221s return None 7221s 7221s stream.read(12) # Skip rest of the header 7221s return marshal.load(stream) 7221s 7221s 7221s def walk_packages(path=None, prefix='', onerror=None): 7221s """Yields ModuleInfo for all modules recursively 7221s on path, or, if path is None, all accessible modules. 7221s 7221s 'path' should be either None or a list of paths to look for 7221s modules in. 7221s 7221s 'prefix' is a string to output on the front of every module name 7221s on output. 7221s 7221s Note that this function must import all *packages* (NOT all 7221s modules!) on the given path, in order to access the __path__ 7221s attribute to find submodules. 7221s 7221s 'onerror' is a function which gets called with one argument (the 7221s name of the package which was being imported) if any exception 7221s occurs while trying to import a package. If no onerror function is 7221s supplied, ImportErrors are caught and ignored, while all other 7221s exceptions are propagated, terminating the search. 7221s 7221s Examples: 7221s 7221s # list all modules python can access 7221s walk_packages() 7221s 7221s # list all submodules of ctypes 7221s walk_packages(ctypes.__path__, ctypes.__name__+'.') 7221s """ 7221s 7221s def seen(p, m={}): 7221s if p in m: 7221s return True 7221s m[p] = True 7221s 7221s for info in iter_modules(path, prefix): 7221s yield info 7221s 7221s if info.ispkg: 7221s try: 7221s __import__(info.name) 7221s except ImportError: 7221s if onerror is not None: 7221s onerror(info.name) 7221s except Exception: 7221s if onerror is not None: 7221s onerror(info.name) 7221s else: 7221s raise 7221s else: 7221s path = getattr(sys.modules[info.name], '__path__', None) or [] 7221s 7221s # don't traverse path items we've seen before 7221s path = [p for p in path if not seen(p)] 7221s 7221s yield from walk_packages(path, info.name+'.', onerror) 7221s 7221s 7221s def iter_modules(path=None, prefix=''): 7221s """Yields ModuleInfo for all submodules on path, 7221s or, if path is None, all top-level modules on sys.path. 7221s 7221s 'path' should be either None or a list of paths to look for 7221s modules in. 7221s 7221s 'prefix' is a string to output on the front of every module name 7221s on output. 7221s """ 7221s if path is None: 7221s importers = iter_importers() 7221s elif isinstance(path, str): 7221s raise ValueError("path must be None or list of paths to look for " 7221s "modules in") 7221s else: 7221s importers = map(get_importer, path) 7221s 7221s yielded = {} 7221s for i in importers: 7221s for name, ispkg in iter_importer_modules(i, prefix): 7221s if name not in yielded: 7221s yielded[name] = 1 7221s yield ModuleInfo(i, name, ispkg) 7221s 7221s 7221s @simplegeneric 7221s def iter_importer_modules(importer, prefix=''): 7221s if not hasattr(importer, 'iter_modules'): 7221s return [] 7221s return importer.iter_modules(prefix) 7221s 7221s 7221s # Implement a file walker for the normal importlib path hook 7221s def _iter_file_finder_modules(importer, prefix=''): 7221s if importer.path is None or not os.path.isdir(importer.path): 7221s return 7221s 7221s yielded = {} 7221s import inspect 7221s try: 7221s filenames = os.listdir(importer.path) 7221s except OSError: 7221s # ignore unreadable directories like import does 7221s filenames = [] 7221s filenames.sort() # handle packages before same-named modules 7221s 7221s for fn in filenames: 7221s modname = inspect.getmodulename(fn) 7221s if modname=='__init__' or modname in yielded: 7221s continue 7221s 7221s path = os.path.join(importer.path, fn) 7221s ispkg = False 7221s 7221s if not modname and os.path.isdir(path) and '.' not in fn: 7221s modname = fn 7221s try: 7221s dircontents = os.listdir(path) 7221s except OSError: 7221s # ignore unreadable directories like import does 7221s dircontents = [] 7221s for fn in dircontents: 7221s subname = inspect.getmodulename(fn) 7221s if subname=='__init__': 7221s ispkg = True 7221s break 7221s else: 7221s continue # not a package 7221s 7221s if modname and '.' not in modname: 7221s yielded[modname] = 1 7221s yield prefix + modname, ispkg 7221s 7221s iter_importer_modules.register( 7221s importlib.machinery.FileFinder, _iter_file_finder_modules) 7221s 7221s 7221s try: 7221s import zipimport 7221s from zipimport import zipimporter 7221s 7221s def iter_zipimport_modules(importer, prefix=''): 7221s > dirlist = sorted(zipimport._zip_directory_cache[importer.archive]) 7221s E KeyError: '/tmp/dask-scratch-space/scheduler-0zwy0_n8/myfile.zip' 7221s 7221s /usr/lib/python3.13/pkgutil.py:179: KeyError 7221s ----------------------------- Captured stdout call ----------------------------- 7221s Dumped cluster state to test_cluster_dump/test_upload_file_zip.yaml 7221s ----------------------------- Captured stderr call ----------------------------- 7221s 2024-11-23 22:17:09,666 - distributed.http.proxy - INFO - To route to workers diagnostics web server please install jupyter-server-proxy: python -m pip install jupyter-server-proxy 7221s 2024-11-23 22:17:09,669 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:17:09,672 - distributed.diskutils - INFO - Found stale lock file and directory '/tmp/dask-scratch-space/worker-tygu9vb1', purging 7221s 2024-11-23 22:17:09,672 - distributed.diskutils - INFO - Found stale lock file and directory '/tmp/dask-scratch-space/worker-y_pdvzda', purging 7221s 2024-11-23 22:17:09,681 - distributed.scheduler - INFO - Scheduler at: tcp://127.0.0.1:43257 7221s 2024-11-23 22:17:09,682 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38723/status 7221s 2024-11-23 22:17:09,682 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:17:09,704 - distributed.worker - INFO - Start worker at: tcp://127.0.0.1:34333 7221s 2024-11-23 22:17:09,704 - distributed.worker - INFO - Listening to: tcp://127.0.0.1:34333 7221s 2024-11-23 22:17:09,704 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:17:09,704 - distributed.worker - INFO - dashboard at: 127.0.0.1:32945 7221s 2024-11-23 22:17:09,705 - distributed.worker - INFO - Waiting to connect to: tcp://127.0.0.1:43257 7221s 2024-11-23 22:17:09,705 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:17:09,705 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:17:09,705 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:17:09,705 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-exik6e4g 7221s 2024-11-23 22:17:09,705 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:17:09,707 - distributed.worker - INFO - Start worker at: tcp://127.0.0.1:39533 7221s 2024-11-23 22:17:09,707 - distributed.worker - INFO - Listening to: tcp://127.0.0.1:39533 7221s 2024-11-23 22:17:09,707 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:17:09,707 - distributed.worker - INFO - dashboard at: 127.0.0.1:41859 7221s 2024-11-23 22:17:09,707 - distributed.worker - INFO - Waiting to connect to: tcp://127.0.0.1:43257 7221s 2024-11-23 22:17:09,707 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:17:09,707 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:17:09,707 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:17:09,707 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-9oqwc3lj 7221s 2024-11-23 22:17:09,707 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:17:09,716 - distributed.scheduler - INFO - Register worker 7221s 2024-11-23 22:17:09,717 - distributed.scheduler - INFO - Starting worker compute stream, tcp://127.0.0.1:34333 7221s 2024-11-23 22:17:09,718 - distributed.core - INFO - Starting established connection to tcp://127.0.0.1:33176 7221s 2024-11-23 22:17:09,719 - distributed.scheduler - INFO - Register worker 7221s 2024-11-23 22:17:09,720 - distributed.scheduler - INFO - Starting worker compute stream, tcp://127.0.0.1:39533 7221s 2024-11-23 22:17:09,720 - distributed.core - INFO - Starting established connection to tcp://127.0.0.1:33186 7221s 2024-11-23 22:17:09,721 - distributed.worker - INFO - Starting Worker plugin shuffle 7221s 2024-11-23 22:17:09,722 - distributed.worker - INFO - Starting Worker plugin shuffle 7221s 2024-11-23 22:17:09,723 - distributed.worker - INFO - Registered to: tcp://127.0.0.1:43257 7221s 2024-11-23 22:17:09,723 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:17:09,723 - distributed.worker - INFO - Registered to: tcp://127.0.0.1:43257 7221s 2024-11-23 22:17:09,724 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:17:09,725 - distributed.core - INFO - Starting established connection to tcp://127.0.0.1:43257 7221s 2024-11-23 22:17:09,725 - distributed.core - INFO - Starting established connection to tcp://127.0.0.1:43257 7221s 2024-11-23 22:17:09,734 - distributed.scheduler - INFO - Receive client connection: Client-ae856367-a9e8-11ef-bdd0-00163e4db70f 7221s 2024-11-23 22:17:09,736 - distributed.core - INFO - Starting established connection to tcp://127.0.0.1:33200 7221s 2024-11-23 22:17:09,745 - distributed.utils - INFO - Reload module myfile from .zip file 7221s 2024-11-23 22:17:09,749 - distributed.scheduler - INFO - Registering Worker plugin myfile.zip7c10afcc-e7ca-4c9b-b63c-55611a17ba0e 7221s 2024-11-23 22:17:09,754 - distributed.worker - INFO - Starting Worker plugin myfile.zip7c10afcc-e7ca-4c9b-b63c-55611a17ba0e 7221s 2024-11-23 22:17:09,757 - distributed.utils - INFO - Reload module myfile from .zip file 7221s 2024-11-23 22:17:09,760 - distributed.worker - INFO - Starting Worker plugin myfile.zip7c10afcc-e7ca-4c9b-b63c-55611a17ba0e 7221s 2024-11-23 22:17:09,762 - distributed.utils - INFO - Reload module myfile from .zip file 7221s 2024-11-23 22:17:09,789 - distributed.core - ERROR - '/tmp/dask-scratch-space/scheduler-0zwy0_n8/myfile.zip' 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 560, in upload_file 7221s import_file(out_filename) 7221s ~~~~~~~~~~~^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1162, in import_file 7221s names_to_import.extend(names) 7221s ~~~~~~~~~~~~~~~~~~~~~~^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1161, in 7221s names = (mod_info.name for mod_info in pkgutil.iter_modules([path])) 7221s ~~~~~~~~~~~~~~~~~~~~^^^^^^^^ 7221s File "/usr/lib/python3.13/pkgutil.py", line 116, in iter_modules 7221s for name, ispkg in iter_importer_modules(i, prefix): 7221s ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^ 7221s File "/usr/lib/python3.13/pkgutil.py", line 179, in iter_zipimport_modules 7221s dirlist = sorted(zipimport._zip_directory_cache[importer.archive]) 7221s ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^ 7221s KeyError: '/tmp/dask-scratch-space/scheduler-0zwy0_n8/myfile.zip' 7221s 2024-11-23 22:17:09,791 - distributed.core - ERROR - Exception while handling op register_scheduler_plugin 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 970, in _handle_comm 7221s result = await result 7221s ^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/scheduler.py", line 6035, in register_scheduler_plugin 7221s await result 7221s File "/usr/lib/python3/dist-packages/distributed/diagnostics/plugin.py", line 396, in start 7221s await scheduler.upload_file(self.filename, self.data, load=self.load) 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 563, in upload_file 7221s raise e 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 560, in upload_file 7221s import_file(out_filename) 7221s ~~~~~~~~~~~^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1162, in import_file 7221s names_to_import.extend(names) 7221s ~~~~~~~~~~~~~~~~~~~~~~^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1161, in 7221s names = (mod_info.name for mod_info in pkgutil.iter_modules([path])) 7221s ~~~~~~~~~~~~~~~~~~~~^^^^^^^^ 7221s File "/usr/lib/python3.13/pkgutil.py", line 116, in iter_modules 7221s for name, ispkg in iter_importer_modules(i, prefix): 7221s ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^ 7221s File "/usr/lib/python3.13/pkgutil.py", line 179, in iter_zipimport_modules 7221s dirlist = sorted(zipimport._zip_directory_cache[importer.archive]) 7221s ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^ 7221s KeyError: '/tmp/dask-scratch-space/scheduler-0zwy0_n8/myfile.zip' 7221s 2024-11-23 22:17:09,801 - distributed.scheduler - INFO - Registering Worker plugin myfile.zip62e7d164-d8d5-4b41-a242-e62ba40b64d5 7221s 2024-11-23 22:17:09,806 - distributed.worker - INFO - Starting Worker plugin myfile.zip62e7d164-d8d5-4b41-a242-e62ba40b64d5 7221s 2024-11-23 22:17:09,808 - distributed.core - ERROR - '/tmp/dask-scratch-space/worker-exik6e4g/myfile.zip' 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 560, in upload_file 7221s import_file(out_filename) 7221s ~~~~~~~~~~~^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1162, in import_file 7221s names_to_import.extend(names) 7221s ~~~~~~~~~~~~~~~~~~~~~~^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1161, in 7221s names = (mod_info.name for mod_info in pkgutil.iter_modules([path])) 7221s ~~~~~~~~~~~~~~~~~~~~^^^^^^^^ 7221s File "/usr/lib/python3.13/pkgutil.py", line 116, in iter_modules 7221s for name, ispkg in iter_importer_modules(i, prefix): 7221s ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^ 7221s File "/usr/lib/python3.13/pkgutil.py", line 179, in iter_zipimport_modules 7221s dirlist = sorted(zipimport._zip_directory_cache[importer.archive]) 7221s ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^ 7221s KeyError: '/tmp/dask-scratch-space/worker-exik6e4g/myfile.zip' 7221s 2024-11-23 22:17:09,888 - distributed.worker - INFO - Starting Worker plugin myfile.zip62e7d164-d8d5-4b41-a242-e62ba40b64d5 7221s 2024-11-23 22:17:09,891 - distributed.utils - INFO - Reload module myfile from .zip file 7221s 2024-11-23 22:17:09,896 - distributed.scheduler - INFO - Remove client Client-ae856367-a9e8-11ef-bdd0-00163e4db70f 7221s 2024-11-23 22:17:09,896 - distributed.core - INFO - Received 'close-stream' from tcp://127.0.0.1:33200; closing. 7221s 2024-11-23 22:17:09,897 - distributed.scheduler - INFO - Remove client Client-ae856367-a9e8-11ef-bdd0-00163e4db70f 7221s 2024-11-23 22:17:09,900 - distributed.scheduler - INFO - Close client connection: Client-ae856367-a9e8-11ef-bdd0-00163e4db70f 7221s 2024-11-23 22:17:09,902 - distributed.worker - INFO - Stopping worker at tcp://127.0.0.1:34333. Reason: worker-close 7221s 2024-11-23 22:17:09,902 - distributed.worker - INFO - Stopping worker at tcp://127.0.0.1:39533. Reason: worker-close 7221s 2024-11-23 22:17:09,907 - distributed.core - INFO - Received 'close-stream' from tcp://127.0.0.1:33176; closing. 7221s 2024-11-23 22:17:09,908 - distributed.scheduler - INFO - Remove worker (stimulus_id='handle-worker-cleanup-1732400229.9085834') 7221s 2024-11-23 22:17:09,909 - distributed.core - INFO - Connection to tcp://127.0.0.1:43257 has been closed. 7221s 2024-11-23 22:17:09,913 - distributed.core - INFO - Received 'close-stream' from tcp://127.0.0.1:33186; closing. 7221s 2024-11-23 22:17:09,914 - distributed.scheduler - INFO - Remove worker (stimulus_id='handle-worker-cleanup-1732400229.9140663') 7221s 2024-11-23 22:17:09,914 - distributed.scheduler - INFO - Lost all workers 7221s 2024-11-23 22:17:09,915 - distributed.core - INFO - Connection to tcp://127.0.0.1:43257 has been closed. 7221s 2024-11-23 22:17:09,919 - distributed.scheduler - INFO - Scheduler closing due to unknown reason... 7221s 2024-11-23 22:17:09,920 - distributed.scheduler - INFO - Scheduler closing all comms 7221s ________________________ test_info_frame_f_lineno[22-4] ________________________ 7221s 7221s f_lasti = 22, f_lineno = 4 7221s 7221s @pytest.mark.parametrize( 7221s "f_lasti,f_lineno", 7221s [ 7221s (-1, 1), 7221s (0, 2), 7221s (1, 2), 7221s (11, 2), 7221s (12, 3), 7221s (21, 4), 7221s (22, 4), 7221s (23, 4), 7221s (24, 2), 7221s (25, 2), 7221s (26, 2), 7221s (27, 2), 7221s (100, 2), 7221s ], 7221s ) 7221s def test_info_frame_f_lineno(f_lasti: int, f_lineno: int) -> None: 7221s > assert info_frame(FakeFrame(f_lasti=f_lasti, f_code=FAKE_CODE)) == { # type: ignore 7221s "filename": "", 7221s "name": "example", 7221s "line_number": f_lineno, 7221s "line": "", 7221s } 7221s 7221s /usr/lib/python3/dist-packages/distributed/tests/test_profile.py:327: 7221s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7221s /usr/lib/python3/dist-packages/distributed/profile.py:115: in info_frame 7221s line = linecache.getline(co.co_filename, f_lineno, frame.f_globals).lstrip() 7221s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7221s 7221s filename = '', lineno = None, module_globals = {} 7221s 7221s def getline(filename, lineno, module_globals=None): 7221s """Get a line for a Python source file from the cache. 7221s Update the cache if it doesn't contain an entry for this file already.""" 7221s 7221s lines = getlines(filename, module_globals) 7221s > if 1 <= lineno <= len(lines): 7221s E TypeError: '<=' not supported between instances of 'int' and 'NoneType' 7221s 7221s /usr/lib/python3.13/linecache.py:26: TypeError 7221s ________________________ test_info_frame_f_lineno[23-4] ________________________ 7221s 7221s f_lasti = 23, f_lineno = 4 7221s 7221s @pytest.mark.parametrize( 7221s "f_lasti,f_lineno", 7221s [ 7221s (-1, 1), 7221s (0, 2), 7221s (1, 2), 7221s (11, 2), 7221s (12, 3), 7221s (21, 4), 7221s (22, 4), 7221s (23, 4), 7221s (24, 2), 7221s (25, 2), 7221s (26, 2), 7221s (27, 2), 7221s (100, 2), 7221s ], 7221s ) 7221s def test_info_frame_f_lineno(f_lasti: int, f_lineno: int) -> None: 7221s > assert info_frame(FakeFrame(f_lasti=f_lasti, f_code=FAKE_CODE)) == { # type: ignore 7221s "filename": "", 7221s "name": "example", 7221s "line_number": f_lineno, 7221s "line": "", 7221s } 7221s 7221s /usr/lib/python3/dist-packages/distributed/tests/test_profile.py:327: 7221s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7221s /usr/lib/python3/dist-packages/distributed/profile.py:115: in info_frame 7221s line = linecache.getline(co.co_filename, f_lineno, frame.f_globals).lstrip() 7221s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7221s 7221s filename = '', lineno = None, module_globals = {} 7221s 7221s def getline(filename, lineno, module_globals=None): 7221s """Get a line for a Python source file from the cache. 7221s Update the cache if it doesn't contain an entry for this file already.""" 7221s 7221s lines = getlines(filename, module_globals) 7221s > if 1 <= lineno <= len(lines): 7221s E TypeError: '<=' not supported between instances of 'int' and 'NoneType' 7221s 7221s /usr/lib/python3.13/linecache.py:26: TypeError 7221s ________________________ test_call_stack_f_lineno[22-4] ________________________ 7221s 7221s f_lasti = 22, f_lineno = 4 7221s 7221s @pytest.mark.parametrize( 7221s "f_lasti,f_lineno", 7221s [ 7221s (-1, 1), 7221s (0, 2), 7221s (1, 2), 7221s (11, 2), 7221s (12, 3), 7221s (21, 4), 7221s (22, 4), 7221s (23, 4), 7221s (24, 2), 7221s (25, 2), 7221s (26, 2), 7221s (27, 2), 7221s (100, 2), 7221s ], 7221s ) 7221s def test_call_stack_f_lineno(f_lasti: int, f_lineno: int) -> None: 7221s > assert call_stack(FakeFrame(f_lasti=f_lasti, f_code=FAKE_CODE)) == [ # type: ignore 7221s f' File "", line {f_lineno}, in example\n\t' 7221s ] 7221s 7221s /usr/lib/python3/dist-packages/distributed/tests/test_profile.py:354: 7221s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7221s /usr/lib/python3/dist-packages/distributed/profile.py:263: in call_stack 7221s L.append(repr_frame(cur_frame)) 7221s /usr/lib/python3/dist-packages/distributed/profile.py:105: in repr_frame 7221s line = linecache.getline(co.co_filename, f_lineno, frame.f_globals).lstrip() 7221s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7221s 7221s filename = '', lineno = None, module_globals = {} 7221s 7221s def getline(filename, lineno, module_globals=None): 7221s """Get a line for a Python source file from the cache. 7221s Update the cache if it doesn't contain an entry for this file already.""" 7221s 7221s lines = getlines(filename, module_globals) 7221s > if 1 <= lineno <= len(lines): 7221s E TypeError: '<=' not supported between instances of 'int' and 'NoneType' 7221s 7221s /usr/lib/python3.13/linecache.py:26: TypeError 7221s ________________________ test_call_stack_f_lineno[23-4] ________________________ 7221s 7221s f_lasti = 23, f_lineno = 4 7221s 7221s @pytest.mark.parametrize( 7221s "f_lasti,f_lineno", 7221s [ 7221s (-1, 1), 7221s (0, 2), 7221s (1, 2), 7221s (11, 2), 7221s (12, 3), 7221s (21, 4), 7221s (22, 4), 7221s (23, 4), 7221s (24, 2), 7221s (25, 2), 7221s (26, 2), 7221s (27, 2), 7221s (100, 2), 7221s ], 7221s ) 7221s def test_call_stack_f_lineno(f_lasti: int, f_lineno: int) -> None: 7221s > assert call_stack(FakeFrame(f_lasti=f_lasti, f_code=FAKE_CODE)) == [ # type: ignore 7221s f' File "", line {f_lineno}, in example\n\t' 7221s ] 7221s 7221s /usr/lib/python3/dist-packages/distributed/tests/test_profile.py:354: 7221s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7221s /usr/lib/python3/dist-packages/distributed/profile.py:263: in call_stack 7221s L.append(repr_frame(cur_frame)) 7221s /usr/lib/python3/dist-packages/distributed/profile.py:105: in repr_frame 7221s line = linecache.getline(co.co_filename, f_lineno, frame.f_globals).lstrip() 7221s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7221s 7221s filename = '', lineno = None, module_globals = {} 7221s 7221s def getline(filename, lineno, module_globals=None): 7221s """Get a line for a Python source file from the cache. 7221s Update the cache if it doesn't contain an entry for this file already.""" 7221s 7221s lines = getlines(filename, module_globals) 7221s > if 1 <= lineno <= len(lines): 7221s E TypeError: '<=' not supported between instances of 'int' and 'NoneType' 7221s 7221s /usr/lib/python3.13/linecache.py:26: TypeError 7221s ______________________________ test_broadcast_tls ______________________________ 7221s 7221s fut = , timeout = 0 7221s 7221s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 7221s async with asyncio.timeout(timeout): 7221s > return await fut 7221s 7221s /usr/lib/python3/dist-packages/distributed/utils.py:1960: 7221s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7221s /usr/lib/python3/dist-packages/distributed/worker.py:1480: in start_unsafe 7221s await self._register_with_scheduler() 7221s /usr/lib/python3/dist-packages/distributed/worker.py:1179: in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s /usr/lib/python3/dist-packages/distributed/comm/core.py:342: in connect 7221s comm = await wait_for( 7221s /usr/lib/python3/dist-packages/distributed/utils.py:1960: in wait_for 7221s return await fut 7221s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:546: in connect 7221s stream = await self.client.connect( 7221s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7221s 7221s self = , host = '127.0.0.1' 7221s port = 46709, af = 7221s ssl_options = 7221s max_buffer_size = 8364507136.0, source_ip = None, source_port = None 7221s timeout = None 7221s 7221s async def connect( 7221s self, 7221s host: str, 7221s port: int, 7221s af: socket.AddressFamily = socket.AF_UNSPEC, 7221s ssl_options: Optional[Union[Dict[str, Any], ssl.SSLContext]] = None, 7221s max_buffer_size: Optional[int] = None, 7221s source_ip: Optional[str] = None, 7221s source_port: Optional[int] = None, 7221s timeout: Optional[Union[float, datetime.timedelta]] = None, 7221s ) -> IOStream: 7221s """Connect to the given host and port. 7221s 7221s Asynchronously returns an `.IOStream` (or `.SSLIOStream` if 7221s ``ssl_options`` is not None). 7221s 7221s Using the ``source_ip`` kwarg, one can specify the source 7221s IP address to use when establishing the connection. 7221s In case the user needs to resolve and 7221s use a specific interface, it has to be handled outside 7221s of Tornado as this depends very much on the platform. 7221s 7221s Raises `TimeoutError` if the input future does not complete before 7221s ``timeout``, which may be specified in any form allowed by 7221s `.IOLoop.add_timeout` (i.e. a `datetime.timedelta` or an absolute time 7221s relative to `.IOLoop.time`) 7221s 7221s Similarly, when the user requires a certain source port, it can 7221s be specified using the ``source_port`` arg. 7221s 7221s .. versionchanged:: 4.5 7221s Added the ``source_ip`` and ``source_port`` arguments. 7221s 7221s .. versionchanged:: 5.0 7221s Added the ``timeout`` argument. 7221s """ 7221s if timeout is not None: 7221s if isinstance(timeout, numbers.Real): 7221s timeout = IOLoop.current().time() + timeout 7221s elif isinstance(timeout, datetime.timedelta): 7221s timeout = IOLoop.current().time() + timeout.total_seconds() 7221s else: 7221s raise TypeError("Unsupported timeout %r" % timeout) 7221s if timeout is not None: 7221s addrinfo = await gen.with_timeout( 7221s timeout, self.resolver.resolve(host, port, af) 7221s ) 7221s else: 7221s addrinfo = await self.resolver.resolve(host, port, af) 7221s connector = _Connector( 7221s addrinfo, 7221s functools.partial( 7221s self._create_stream, 7221s max_buffer_size, 7221s source_ip=source_ip, 7221s source_port=source_port, 7221s ), 7221s ) 7221s > af, addr, stream = await connector.start(connect_timeout=timeout) 7221s E asyncio.exceptions.CancelledError 7221s 7221s /usr/lib/python3/dist-packages/tornado/tcpclient.py:279: CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s self = 7221s 7221s @final 7221s async def start(self): 7221s async with self._startup_lock: 7221s if self.status == Status.failed: 7221s assert self.__startup_exc is not None 7221s raise self.__startup_exc 7221s elif self.status != Status.init: 7221s return self 7221s timeout = getattr(self, "death_timeout", None) 7221s 7221s async def _close_on_failure(exc: Exception) -> None: 7221s await self.close(reason=f"failure-to-start-{str(type(exc))}") 7221s self.status = Status.failed 7221s self.__startup_exc = exc 7221s 7221s try: 7221s > await wait_for(self.start_unsafe(), timeout=timeout) 7221s 7221s /usr/lib/python3/dist-packages/distributed/core.py:664: 7221s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7221s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 7221s async with asyncio.timeout(timeout): 7221s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7221s 7221s self = 7221s exc_type = 7221s exc_val = CancelledError(), exc_tb = 7221s 7221s async def __aexit__( 7221s self, 7221s exc_type: Optional[Type[BaseException]], 7221s exc_val: Optional[BaseException], 7221s exc_tb: Optional[TracebackType], 7221s ) -> Optional[bool]: 7221s assert self._state in (_State.ENTERED, _State.EXPIRING) 7221s 7221s if self._timeout_handler is not None: 7221s self._timeout_handler.cancel() 7221s self._timeout_handler = None 7221s 7221s if self._state is _State.EXPIRING: 7221s self._state = _State.EXPIRED 7221s 7221s if self._task.uncancel() <= self._cancelling and exc_type is not None: 7221s # Since there are no new cancel requests, we're 7221s # handling this. 7221s if issubclass(exc_type, exceptions.CancelledError): 7221s > raise TimeoutError from exc_val 7221s E TimeoutError 7221s 7221s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s @contextlib.asynccontextmanager 7221s async def _cluster_factory(): 7221s workers = [] 7221s s = None 7221s try: 7221s for _ in range(60): 7221s try: 7221s > s, ws = await start_cluster( 7221s nthreads, 7221s scheduler, 7221s security=security, 7221s Worker=Worker, 7221s scheduler_kwargs=scheduler_kwargs, 7221s worker_kwargs=merge( 7221s {"death_timeout": min(15, int(deadline.remaining))}, 7221s worker_kwargs, 7221s ), 7221s ) 7221s 7221s /usr/lib/python3/dist-packages/distributed/utils_test.py:966: 7221s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7221s /usr/lib/python3/dist-packages/distributed/utils_test.py:789: in start_cluster 7221s await asyncio.gather(*workers) 7221s /usr/lib/python3.13/asyncio/tasks.py:737: in _wrap_awaitable 7221s return await awaitable 7221s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7221s 7221s self = 7221s 7221s @final 7221s async def start(self): 7221s async with self._startup_lock: 7221s if self.status == Status.failed: 7221s assert self.__startup_exc is not None 7221s raise self.__startup_exc 7221s elif self.status != Status.init: 7221s return self 7221s timeout = getattr(self, "death_timeout", None) 7221s 7221s async def _close_on_failure(exc: Exception) -> None: 7221s await self.close(reason=f"failure-to-start-{str(type(exc))}") 7221s self.status = Status.failed 7221s self.__startup_exc = exc 7221s 7221s try: 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s except asyncio.TimeoutError as exc: 7221s await _close_on_failure(exc) 7221s > raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s E TimeoutError: Worker start timed out after 0s. 7221s 7221s /usr/lib/python3/dist-packages/distributed/core.py:667: TimeoutError 7221s 7221s During handling of the above exception, another exception occurred: 7221s 7221s fut = ._..test_func..async_fn at 0xe9b48a20> 7221s timeout = 60 7221s 7221s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 7221s async with asyncio.timeout(timeout): 7221s > return await fut 7221s 7221s /usr/lib/python3/dist-packages/distributed/utils.py:1960: 7221s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7221s /usr/lib/python3/dist-packages/distributed/utils_test.py:999: in async_fn 7221s _cluster_factory() as (s, workers), 7221s /usr/lib/python3.13/contextlib.py:214: in __aenter__ 7221s return await anext(self.gen) 7221s /usr/lib/python3/dist-packages/distributed/utils_test.py:983: in _cluster_factory 7221s await asyncio.sleep(1) 7221s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7221s 7221s delay = 1, result = None 7221s 7221s async def sleep(delay, result=None): 7221s """Coroutine that completes after a given time (in seconds).""" 7221s if delay <= 0: 7221s await __sleep0() 7221s return result 7221s 7221s if math.isnan(delay): 7221s raise ValueError("Invalid delay: NaN (not a number)") 7221s 7221s loop = events.get_running_loop() 7221s future = loop.create_future() 7221s h = loop.call_later(delay, 7221s futures._set_result_unless_cancelled, 7221s future, result) 7221s try: 7221s > return await future 7221s E asyncio.exceptions.CancelledError 7221s 7221s /usr/lib/python3.13/asyncio/tasks.py:718: CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s args = (), kwds = {} 7221s 7221s @wraps(func) 7221s def inner(*args, **kwds): 7221s with self._recreate_cm(): 7221s > return func(*args, **kwds) 7221s 7221s /usr/lib/python3.13/contextlib.py:85: 7221s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7221s /usr/lib/python3.13/contextlib.py:85: in inner 7221s return func(*args, **kwds) 7221s /usr/lib/python3/dist-packages/distributed/utils_test.py:1102: in test_func 7221s return _run_and_close_tornado(async_fn_outer) 7221s /usr/lib/python3/dist-packages/distributed/utils_test.py:378: in _run_and_close_tornado 7221s return asyncio_run(inner_fn(), loop_factory=get_loop_factory()) 7221s /usr/lib/python3.13/asyncio/runners.py:194: in run 7221s return runner.run(main) 7221s /usr/lib/python3.13/asyncio/runners.py:118: in run 7221s return self._loop.run_until_complete(task) 7221s /usr/lib/python3.13/asyncio/base_events.py:720: in run_until_complete 7221s return future.result() 7221s /usr/lib/python3/dist-packages/distributed/utils_test.py:375: in inner_fn 7221s return await async_fn(*args, **kwargs) 7221s /usr/lib/python3/dist-packages/distributed/utils_test.py:1099: in async_fn_outer 7221s return await utils_wait_for(async_fn(), timeout=timeout * 2) 7221s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 7221s async with asyncio.timeout(timeout): 7221s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7221s 7221s self = 7221s exc_type = 7221s exc_val = CancelledError(), exc_tb = 7221s 7221s async def __aexit__( 7221s self, 7221s exc_type: Optional[Type[BaseException]], 7221s exc_val: Optional[BaseException], 7221s exc_tb: Optional[TracebackType], 7221s ) -> Optional[bool]: 7221s assert self._state in (_State.ENTERED, _State.EXPIRING) 7221s 7221s if self._timeout_handler is not None: 7221s self._timeout_handler.cancel() 7221s self._timeout_handler = None 7221s 7221s if self._state is _State.EXPIRING: 7221s self._state = _State.EXPIRED 7221s 7221s if self._task.uncancel() <= self._cancelling and exc_type is not None: 7221s # Since there are no new cancel requests, we're 7221s # handling this. 7221s if issubclass(exc_type, exceptions.CancelledError): 7221s > raise TimeoutError from exc_val 7221s E TimeoutError 7221s 7221s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 7221s ----------------------------- Captured stderr call ----------------------------- 7221s 2024-11-23 22:17:11,172 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:17:11,184 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:11,185 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44543/status 7221s 2024-11-23 22:17:11,185 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:17:11,208 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38353 7221s 2024-11-23 22:17:11,208 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38353 7221s 2024-11-23 22:17:11,208 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:17:11,208 - distributed.worker - INFO - dashboard at: 127.0.0.1:45053 7221s 2024-11-23 22:17:11,208 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:11,209 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:17:11,209 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:17:11,209 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:17:11,209 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-126d_7zo 7221s 2024-11-23 22:17:11,209 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:17:11,212 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36925 7221s 2024-11-23 22:17:11,212 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36925 7221s 2024-11-23 22:17:11,212 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:17:11,213 - distributed.worker - INFO - dashboard at: 127.0.0.1:46691 7221s 2024-11-23 22:17:11,213 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:11,213 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:17:11,213 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:17:11,213 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:17:11,213 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-n7upv3q3 7221s 2024-11-23 22:17:11,213 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:17:11,228 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:11,229 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:11,229 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:40796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:11,230 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:40808': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:11,344 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:11,345 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:11,346 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:40818': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:11,346 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:40824': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:11,464 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:11,464 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:11,465 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:40830': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:11,465 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:40842': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:11,581 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:11,581 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:11,582 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:50502': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:11,582 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:50506': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:11,703 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:11,704 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:11,705 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:50520': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:11,705 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:50536': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:11,821 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:11,822 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:11,822 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:50538': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:11,822 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:50542': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:11,939 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:11,939 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:11,940 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:50556': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:11,940 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:50564': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:12,056 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:12,056 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:12,057 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:50576': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:12,057 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:50584': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:12,172 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:12,172 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:12,173 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:50596': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:12,173 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:50604': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:12,288 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:12,288 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:12,289 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:50608': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:12,289 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:50622': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:12,403 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:12,404 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:12,404 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:50636': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:12,404 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:50648': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:12,520 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:12,520 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:12,520 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:50650': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:12,520 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:50652': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:12,634 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:12,635 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:12,635 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:50656': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:12,635 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:50658': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:12,750 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:12,751 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:12,751 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:50666': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:12,751 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:50668': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:12,866 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:12,866 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:12,867 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:50682': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:12,867 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:50686': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:12,982 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:12,982 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:12,983 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:50688': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:12,983 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:50702': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:13,098 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:13,099 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:13,101 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:50710': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:13,101 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:50712': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:13,214 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:13,215 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:13,215 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:50728': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:13,216 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:50732': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:13,330 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:13,330 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:13,331 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:50738': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:13,331 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:50748': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:13,446 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:13,447 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:13,447 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:50764': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:13,448 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:50774': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:13,562 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:13,563 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:13,563 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:50786': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:13,564 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:50800': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:13,678 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:13,679 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:13,679 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:50806': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:13,679 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:50818': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:13,795 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:13,795 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:13,796 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:50830': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:13,796 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:50832': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:13,912 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:13,912 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:13,913 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:50842': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:13,913 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:50856': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:14,028 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:14,029 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:14,029 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:50868': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:14,029 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:50878': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:14,144 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:14,144 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:14,145 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:50888': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:14,145 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:50892': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:14,260 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:14,261 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:14,261 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:50902': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:14,261 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:50910': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:14,376 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:14,377 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:14,377 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:50922': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:14,377 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:50934': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:14,493 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:14,493 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:14,494 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:50950': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:14,494 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:50952': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:14,609 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:14,609 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:14,610 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:50954': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:14,610 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:50960': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:14,725 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:14,725 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:14,726 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:50972': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:14,726 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:50978': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:14,843 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:14,843 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:14,844 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:50992': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:14,844 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:50996': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:14,959 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:14,960 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:14,960 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:50998': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:14,960 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:51012': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:15,075 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:15,076 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:15,076 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:51014': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:15,076 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:51024': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:15,191 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:15,192 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:15,197 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:51028': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:15,198 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:51038': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:15,307 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:15,307 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:15,308 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:51044': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:15,308 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:51056': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:15,423 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:15,423 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:15,424 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:51070': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:15,424 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:51084': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:15,539 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:15,539 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:15,540 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:51090': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:15,540 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:51100': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:15,655 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:15,655 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:15,656 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:51106': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:15,656 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:51120': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:15,771 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:15,771 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:15,772 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:51134': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:15,772 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:51150': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:15,886 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:15,887 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:15,887 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:51160': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:15,888 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:51176': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:16,002 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:16,002 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:16,003 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:51190': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:16,003 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:51196': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:16,118 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:16,118 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:16,119 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:51200': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:16,119 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:51206': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:16,234 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:16,235 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:16,235 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:51208': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:16,235 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:51224': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:16,351 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:16,351 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:16,352 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:51226': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:16,352 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:51234': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:16,468 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:16,469 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:16,469 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:51244': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:16,470 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:51248': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:16,585 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:16,585 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:16,586 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:51262': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:16,586 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:51264': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:16,705 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:16,706 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:16,706 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:51278': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:16,707 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:51280': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:16,822 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:16,823 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:16,823 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:51290': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:16,824 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:51306': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:16,938 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:16,939 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:16,939 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:51322': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:16,939 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:51328': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:17,054 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:17,055 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:17,055 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:51344': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:17,055 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:51354': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:17,170 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:17,170 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:17,171 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:51366': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:17,171 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:51374': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:17,286 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:17,286 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:17,287 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:51386': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:17,287 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:51388': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:17,396 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:17,401 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:51394': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:17,402 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:17,403 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:51402': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:17,505 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:17,506 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:51414': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:17,513 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:17,514 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:51422': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:17,615 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:17,616 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:51424': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:17,623 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:17,624 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:51440': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:17,725 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:17,726 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:51444': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:17,733 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:17,734 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:51456': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:17,834 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:17,835 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:51458': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:17,843 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:17,843 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:51472': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:17,944 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:17,945 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:51478': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:17,952 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:17,953 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:51484': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:18,053 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:18,054 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:51488': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:18,061 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:18,062 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:51490': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:18,164 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:18,166 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:51506': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:18,173 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:18,173 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:51508': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:18,274 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:18,275 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:51522': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:18,283 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:18,284 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:51532': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:18,384 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:18,385 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:51546': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:18,393 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:18,394 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:51562': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:18,494 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:18,495 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:51568': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:18,503 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:18,504 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:51582': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:18,606 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:18,608 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:51592': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:18,615 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:18,615 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:51606': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:18,716 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:18,717 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:51608': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:18,725 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:18,725 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:51624': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:18,826 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:18,826 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:51626': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:18,834 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:18,835 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:51636': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:18,935 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:18,936 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:51638': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:18,944 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:18,945 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:51646': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:19,045 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:19,045 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:51652': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:19,053 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:19,054 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:51662': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:19,155 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:19,156 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:51664': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:19,164 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:19,164 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:51674': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:19,264 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:19,265 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:51680': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:19,273 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:19,274 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:51682': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:19,374 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:19,375 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:51692': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:19,382 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:19,383 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:51704': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:19,483 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:19,484 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:51718': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:19,492 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:19,493 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:51726': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:19,593 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:19,594 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:51732': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:19,601 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:19,602 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:51734': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:19,701 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:19,702 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:51740': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:19,709 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:19,710 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:51742': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:19,810 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:19,811 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:51748': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:19,819 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:19,819 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:51750': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:19,920 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:19,921 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:51758': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:19,928 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:19,929 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:51764': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:20,030 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:20,030 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:51772': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:20,038 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:20,039 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:51778': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:20,139 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:20,140 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:51790': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:20,147 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:20,148 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:51794': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:20,248 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:20,249 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:51798': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:20,256 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:20,257 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:51810': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:20,358 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:20,360 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:51814': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:20,367 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:20,368 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:51826': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:20,468 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:20,469 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:51836': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:20,477 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:20,477 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:51846': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:20,578 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:20,578 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:51862': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:20,586 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:20,587 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:51870': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:20,686 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:20,687 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:51876': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:20,699 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:20,700 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:51882': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:20,796 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:20,797 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:51890': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:20,808 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:20,808 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:51898': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:20,905 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:20,906 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:51902': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:20,917 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:20,918 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:51906': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:21,015 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:21,015 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:51908': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:21,026 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:21,026 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:51918': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:21,123 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:21,124 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:51932': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:21,134 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:21,135 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:51934': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:21,232 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:21,233 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:51938': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:21,243 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:21,244 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:51954': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:21,342 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:21,342 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:51962': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:21,351 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:21,352 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:51974': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:21,451 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:21,452 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:51982': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:21,460 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:21,460 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:51990': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:21,561 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:21,562 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:46378': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:21,569 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:21,570 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:46382': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:21,670 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:21,671 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:46392': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:21,679 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:21,679 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:46400': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:21,780 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:21,781 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:46402': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:21,789 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:21,790 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:46412': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:21,889 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:21,890 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:46420': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:21,898 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:21,899 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:46424': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:21,999 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:22,000 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:46430': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:22,008 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:22,008 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:46440': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:22,109 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:22,111 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:46448': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:22,118 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:22,119 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:46450': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:22,219 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:22,220 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:46458': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:22,228 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:22,229 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:46462': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:22,328 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:22,329 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:46470': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:22,337 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:22,338 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:46478': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:22,439 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:22,440 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:46486': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:22,448 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:22,449 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:46488': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:22,548 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:22,549 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:46490': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:22,557 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:22,557 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:46500': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:22,658 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:22,659 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:46508': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:22,667 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:22,667 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:46516': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:22,767 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:22,768 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:46522': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:22,776 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:22,776 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:46538': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:22,877 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:22,878 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:46540': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:22,886 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:22,886 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:46548': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:22,986 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:22,987 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:46550': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:22,995 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:22,996 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:46560': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:23,095 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:23,096 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:46562': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:23,104 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:23,105 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:46578': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:23,204 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:23,205 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:46592': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:23,213 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:23,214 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:46594': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:23,315 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:23,316 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:46600': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:23,324 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:23,324 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:46614': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:23,425 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:23,426 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:46616': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:23,433 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:23,434 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:46622': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:23,534 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:23,535 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:46628': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:23,543 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:23,543 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:46644': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:23,644 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:23,645 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:46648': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:23,653 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:23,654 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:46652': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:23,754 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:23,754 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:46666': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:23,762 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:23,763 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:46668': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:23,864 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:23,865 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:46674': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:23,873 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:23,873 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:46676': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:23,973 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:23,974 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:46684': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:23,982 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:23,982 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:46690': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:24,083 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:24,084 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:46696': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:24,092 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:24,093 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:46708': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:24,197 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:24,199 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:46716': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:24,208 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:24,209 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:46722': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:24,307 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:24,308 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:46726': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:24,317 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:24,318 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:46734': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:24,416 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:24,417 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:46740': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:24,426 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:24,427 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:46750': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:24,526 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:24,527 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:46758': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:24,535 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:24,536 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:46768': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:24,636 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:24,637 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:46770': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:24,644 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:24,645 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:46776': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:24,745 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:24,746 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:46778': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:24,754 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:24,754 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:46784': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:24,855 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:24,856 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:46788': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:24,864 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:24,864 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:46790': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:24,964 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:24,965 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:46794': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:24,973 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:24,974 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:46796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:25,074 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:25,075 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:46802': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:25,083 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:25,083 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:46810': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:25,184 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:25,185 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:46814': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:25,197 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:25,198 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:46822': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:25,293 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:25,294 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:46836': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:25,306 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:25,307 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:46848': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:25,401 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:25,402 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:46850': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:25,414 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:25,414 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:46852': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:25,509 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:25,510 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:46866': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:25,521 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:25,521 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:46878': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:25,618 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:25,618 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:46884': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:25,628 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:25,628 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:46900': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:25,726 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:25,726 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:46902': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:25,736 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:25,736 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:46904': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:25,833 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:25,833 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:46910': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:25,843 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:25,843 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:46918': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:25,941 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:25,941 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:46924': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:25,950 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:25,950 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:46934': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:26,049 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:26,049 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:46942': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:26,057 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:26,057 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:46944': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:26,157 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:26,157 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:46946': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:26,164 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46611 7221s 2024-11-23 22:17:26,164 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46611': TLS handshake failed with remote 'tls://127.0.0.1:46954': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:26,205 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38353. Reason: failure-to-start- 7221s 2024-11-23 22:17:26,206 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:17:26,208 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 15s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 7221s stream = await stream.start_tls( 7221s ^^^^^^^^^^^^^^^^^^^^^^^ 7221s False, ssl_options=ssl_options, server_hostname=host 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 7221s self.socket.do_handshake() 7221s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 7221s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 7221s self._sslobj.do_handshake() 7221s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 7221s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 7221s raise FatalCommClosedError( 7221s ...<2 lines>... 7221s ) from err 7221s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 7221s 7221s During handling of the above exception, another exception occurred: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1218, in _register_with_scheduler 7221s await asyncio.sleep(0.1) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 718, in sleep 7221s return await future 7221s ^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 15s. 7221s 2024-11-23 22:17:26,213 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36925. Reason: failure-to-start- 7221s 2024-11-23 22:17:26,213 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:17:27,216 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:17:27,224 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:27,224 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43901/status 7221s 2024-11-23 22:17:27,224 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:17:27,238 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45665 7221s 2024-11-23 22:17:27,238 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45665 7221s 2024-11-23 22:17:27,238 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:17:27,238 - distributed.worker - INFO - dashboard at: 127.0.0.1:33959 7221s 2024-11-23 22:17:27,238 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:27,238 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:17:27,238 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:17:27,239 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:17:27,239 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-dtytzhyc 7221s 2024-11-23 22:17:27,239 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:17:27,242 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43375 7221s 2024-11-23 22:17:27,242 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43375 7221s 2024-11-23 22:17:27,242 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:17:27,243 - distributed.worker - INFO - dashboard at: 127.0.0.1:44717 7221s 2024-11-23 22:17:27,243 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:27,243 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:17:27,243 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:17:27,243 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:17:27,243 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-u6e_0t8e 7221s 2024-11-23 22:17:27,243 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:17:27,256 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:27,256 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:27,256 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:47004': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:27,257 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:47006': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:27,369 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:27,369 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:27,369 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:47016': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:27,369 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:47020': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:27,482 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:27,482 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:27,483 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:47028': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:27,483 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:47044': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:27,595 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:27,596 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:27,596 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:47052': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:27,596 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:47056': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:27,708 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:27,708 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:27,709 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:47064': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:27,709 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:47076': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:27,821 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:27,822 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:27,822 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:47088': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:27,822 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:47090': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:27,936 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:27,936 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:27,936 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:47098': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:27,936 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:47114': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:28,049 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:28,050 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:28,050 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:47122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:28,050 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:47138': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:28,162 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:28,163 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:28,163 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:47140': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:28,163 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:47144': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:28,276 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:28,276 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:28,277 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:47154': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:28,277 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:47162': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:28,389 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:28,389 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:28,390 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:47176': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:28,390 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:47186': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:28,502 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:28,502 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:28,502 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:47202': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:28,503 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:47206': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:28,615 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:28,615 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:28,616 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:47218': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:28,616 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:47226': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:28,728 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:28,729 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:28,732 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:47236': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:28,732 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:47244': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:28,841 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:28,841 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:28,842 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:47256': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:28,842 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:47270': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:28,955 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:28,955 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:28,955 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:47276': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:28,955 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:47284': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:29,069 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:29,069 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:29,070 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:47298': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:29,070 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:47306': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:29,182 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:29,182 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:29,183 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:47314': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:29,183 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:47316': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:29,295 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:29,295 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:29,296 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:47318': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:29,296 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:47332': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:29,408 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:29,408 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:29,409 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:47342': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:29,409 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:47358': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:29,522 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:29,522 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:29,522 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:47372': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:29,522 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:47388': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:29,636 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:29,636 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:29,637 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:47404': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:29,637 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:47406': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:29,750 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:29,751 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:29,751 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:47422': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:29,751 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:47424': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:29,864 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:29,864 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:29,865 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:47434': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:29,865 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:47438': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:29,977 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:29,978 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:29,978 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:47444': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:29,978 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:47452': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:30,091 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:30,091 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:30,091 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:47468': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:30,091 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:47470': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:30,203 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:30,203 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:30,203 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:47480': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:30,204 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:47490': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:30,317 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:30,318 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:30,318 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:47506': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:30,318 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:47522': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:30,431 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:30,431 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:30,431 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:47538': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:30,432 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:47542': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:30,544 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:30,544 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:30,545 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:47544': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:30,545 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:47552': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:30,657 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:30,657 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:30,658 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:47556': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:30,658 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:47564': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:30,770 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:30,770 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:30,770 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:47574': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:30,771 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:47582': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:30,884 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:30,884 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:30,884 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:47584': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:30,884 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:47594': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:30,998 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:30,999 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:30,999 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:47610': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:30,999 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:47612': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:31,112 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:31,112 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:31,112 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:47616': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:31,112 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:47626': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:31,225 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:31,225 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:31,225 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:47628': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:31,225 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:47632': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:31,338 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:31,338 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:31,338 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:47644': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:31,338 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:47646': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:31,451 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:31,451 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:31,451 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:47652': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:31,451 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:47658': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:31,565 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:31,565 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:31,566 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:43570': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:31,566 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:43586': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:31,678 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:31,678 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:31,678 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:43596': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:31,678 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:43606': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:31,791 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:31,791 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:31,792 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:43616': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:31,792 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:43618': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:31,904 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:31,904 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:31,904 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:43622': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:31,904 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:43624': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:32,018 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:32,019 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:32,019 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:43636': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:32,019 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:43648': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:32,132 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:32,132 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:32,133 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:43650': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:32,133 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:43656': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:32,245 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:32,245 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:32,245 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:43668': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:32,245 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:43680': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:32,358 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:32,358 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:32,358 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:43690': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:32,359 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:43692': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:32,471 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:32,471 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:32,472 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:43702': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:32,472 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:43710': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:32,585 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:32,585 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:32,586 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:43718': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:32,586 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:43720': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:32,701 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:32,702 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:32,702 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:43728': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:32,702 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:43736': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:32,815 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:32,815 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:32,815 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:43750': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:32,815 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:43752': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:32,928 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:32,928 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:32,928 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:43758': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:32,929 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:43772': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:33,041 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:33,041 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:33,042 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:43788': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:33,042 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:43804': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:33,154 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:33,154 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:33,155 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:43812': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:33,155 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:43826': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:33,267 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:33,267 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:33,268 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:43838': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:33,268 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:43854': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:33,380 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:33,380 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:33,380 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:43860': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:33,380 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:43872': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:33,493 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:33,493 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:33,493 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:43888': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:33,494 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:43894': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:33,606 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:33,606 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:33,607 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:43902': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:33,607 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:43908': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:33,720 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:33,721 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:33,721 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:43914': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:33,721 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:43916': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:33,829 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:33,833 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:43932': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:33,834 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:33,834 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:43936': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:33,936 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:33,937 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:43948': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:33,943 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:33,944 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:43954': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:34,044 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:34,045 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:43956': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:34,051 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:34,052 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:43962': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:34,153 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:34,153 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:43972': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:34,159 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:34,160 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:43988': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:34,260 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:34,260 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:44000': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:34,267 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:34,267 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:44008': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:34,368 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:34,369 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:44012': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:34,375 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:34,375 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:44014': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:34,477 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:34,478 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:44026': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:34,484 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:34,484 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:44042': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:34,585 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:34,586 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:44044': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:34,592 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:34,592 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:44050': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:34,696 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:34,697 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:44062': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:34,703 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:34,703 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:44078': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:34,804 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:34,805 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:44088': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:34,811 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:34,811 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:44092': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:34,912 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:34,912 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:44108': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:34,918 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:34,919 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:44124': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:35,020 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:35,021 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:44140': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:35,027 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:35,027 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:44154': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:35,128 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:35,128 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:44164': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:35,135 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:35,135 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:44180': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:35,236 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:35,236 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:44196': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:35,242 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:35,243 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:44210': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:35,343 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:35,343 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:44216': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:35,350 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:35,350 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:44228': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:35,452 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:35,453 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:44234': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:35,459 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:35,459 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:44240': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:35,559 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:35,560 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:44242': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:35,566 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:35,566 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:44254': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:35,667 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:35,668 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:44268': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:35,674 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:35,675 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:44282': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:35,775 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:35,775 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:44286': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:35,781 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:35,782 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:44290': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:35,883 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:35,884 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:44296': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:35,890 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:35,890 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:44304': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:35,991 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:35,991 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:44320': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:35,997 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:35,998 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:44336': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:36,099 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:36,099 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:44352': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:36,106 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:36,106 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:44358': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:36,207 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:36,207 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:44360': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:36,213 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:36,214 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:44372': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:36,314 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:36,314 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:44388': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:36,321 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:36,321 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:44390': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:36,422 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:36,422 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:44404': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:36,429 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:36,429 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:44410': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:36,530 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:36,531 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:44420': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:36,537 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:36,537 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:44422': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:36,638 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:36,638 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:44424': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:36,644 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:36,645 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:44432': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:36,745 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:36,745 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:44442': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:36,752 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:36,752 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:44456': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:36,853 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:36,854 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:44464': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:36,859 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:36,860 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:44480': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:36,961 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:36,961 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:44490': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:36,967 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:36,968 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:44506': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:37,069 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:37,071 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:44514': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:37,077 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:37,077 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:44518': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:37,177 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:37,177 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:44534': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:37,183 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:37,184 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:44548': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:37,284 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:37,284 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:44564': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:37,291 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:37,291 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:44568': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:37,392 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:37,393 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:44570': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:37,399 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:37,399 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:44578': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:37,500 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:37,500 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:44586': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:37,506 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:37,507 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:44592': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:37,608 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:37,608 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:44598': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:37,614 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:37,614 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:44604': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:37,716 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:37,717 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:44620': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:37,723 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:37,723 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:44630': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:37,824 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:37,825 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:44632': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:37,831 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:37,832 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:44642': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:37,933 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:37,934 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:44650': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:37,940 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:37,940 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:44652': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:38,042 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:38,043 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:44658': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:38,049 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:38,049 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:44664': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:38,151 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:38,152 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:44670': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:38,158 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:38,159 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:44680': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:38,259 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:38,259 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:44696': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:38,266 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:38,266 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:44698': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:38,366 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:38,367 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:44708': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:38,373 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:38,373 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:44712': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:38,474 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:38,474 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:44724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:38,480 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:38,481 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:44728': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:38,581 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:38,582 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:44738': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:38,588 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:38,588 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:44748': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:38,689 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:38,694 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:44756': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:38,701 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:38,701 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:44764': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:38,797 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:38,797 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:44778': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:38,808 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:38,808 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:44780': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:38,904 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:38,905 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:44782': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:38,915 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:38,916 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:44786': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:39,012 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:39,013 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:44792': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:39,022 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:39,022 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:44808': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:39,120 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:39,120 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:44816': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:39,129 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:39,129 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:44820': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:39,228 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:39,232 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:44824': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:39,238 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:39,238 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:44828': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:39,335 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:39,336 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:44840': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:39,345 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:39,346 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:44844': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:39,443 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:39,444 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:44848': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:39,452 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:39,453 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:44858': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:39,551 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:39,551 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:44862': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:39,559 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:39,559 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:44876': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:39,660 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:39,660 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:44888': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:39,667 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:39,667 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:44890': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:39,767 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:39,768 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:44906': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:39,774 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:39,774 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:44920': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:39,875 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:39,875 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:44930': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:39,882 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:39,882 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:44946': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:39,982 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:39,982 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:44954': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:39,989 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:39,989 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:44970': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:40,090 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:40,090 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:44982': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:40,096 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:40,097 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:44984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:40,197 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:40,197 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:45000': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:40,204 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41281 7221s 2024-11-23 22:17:40,204 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41281': TLS handshake failed with remote 'tls://127.0.0.1:45004': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:17:40,237 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45665. Reason: failure-to-start- 7221s 2024-11-23 22:17:40,237 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:17:40,238 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 13s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 7221s stream = await stream.start_tls( 7221s ^^^^^^^^^^^^^^^^^^^^^^^ 7221s False, ssl_options=ssl_options, server_hostname=host 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 7221s self.socket.do_handshake() 7221s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 7221s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 7221s self._sslobj.do_handshake() 7221s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 7221s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 7221s raise FatalCommClosedError( 7221s ...<2 lines>... 7221s ) from err 7221s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 7221s 7221s During handling of the above exception, another exception occurred: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1218, in _register_with_scheduler 7221s await asyncio.sleep(0.1) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 718, in sleep 7221s return await future 7221s ^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 13s. 7221s 2024-11-23 22:17:40,242 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43375. Reason: failure-to-start- 7221s 2024-11-23 22:17:40,242 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:17:41,246 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:17:41,253 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46367 7221s 2024-11-23 22:17:41,253 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33801/status 7221s 2024-11-23 22:17:41,254 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:17:41,267 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44361 7221s 2024-11-23 22:17:41,267 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44361 7221s 2024-11-23 22:17:41,267 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:17:41,267 - distributed.worker - INFO - dashboard at: 127.0.0.1:37035 7221s 2024-11-23 22:17:41,267 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46367 7221s 2024-11-23 22:17:41,267 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:17:41,267 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:17:41,267 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:17:41,267 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-7xwkgwzt 7221s 2024-11-23 22:17:41,267 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:17:41,269 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43457 7221s 2024-11-23 22:17:41,269 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43457 7221s 2024-11-23 22:17:41,269 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:17:41,269 - distributed.worker - INFO - dashboard at: 127.0.0.1:38959 7221s 2024-11-23 22:17:41,270 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46367 7221s 2024-11-23 22:17:41,270 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:17:41,270 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:17:41,270 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:17:41,270 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-cb9qyz97 7221s 2024-11-23 22:17:41,270 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:17:41,271 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44361. Reason: failure-to-start- 7221s 2024-11-23 22:17:41,271 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:17:41,271 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43457. Reason: failure-to-start- 7221s 2024-11-23 22:17:41,271 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:17:41,272 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46367': TLS handshake failed with remote 'tls://127.0.0.1:41164': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:17:41,272 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46367': TLS handshake failed with remote 'tls://127.0.0.1:41170': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:17:41,274 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s 2024-11-23 22:17:42,281 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:17:42,291 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33013 7221s 2024-11-23 22:17:42,292 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43043/status 7221s 2024-11-23 22:17:42,292 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:17:42,314 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33231 7221s 2024-11-23 22:17:42,314 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33231 7221s 2024-11-23 22:17:42,314 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:17:42,315 - distributed.worker - INFO - dashboard at: 127.0.0.1:41285 7221s 2024-11-23 22:17:42,315 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33013 7221s 2024-11-23 22:17:42,315 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:17:42,315 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:17:42,315 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:17:42,315 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-aucjh6eh 7221s 2024-11-23 22:17:42,315 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:17:42,318 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42573 7221s 2024-11-23 22:17:42,318 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42573 7221s 2024-11-23 22:17:42,318 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:17:42,318 - distributed.worker - INFO - dashboard at: 127.0.0.1:43837 7221s 2024-11-23 22:17:42,318 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33013 7221s 2024-11-23 22:17:42,318 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:17:42,318 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:17:42,319 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:17:42,319 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-bws24gef 7221s 2024-11-23 22:17:42,319 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:17:42,320 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33231. Reason: failure-to-start- 7221s 2024-11-23 22:17:42,321 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:17:42,321 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42573. Reason: failure-to-start- 7221s 2024-11-23 22:17:42,322 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:17:42,323 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33013': TLS handshake failed with remote 'tls://127.0.0.1:50576': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:17:42,324 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33013': TLS handshake failed with remote 'tls://127.0.0.1:50592': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:17:42,326 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s 2024-11-23 22:17:43,334 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:17:43,344 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36269 7221s 2024-11-23 22:17:43,344 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41397/status 7221s 2024-11-23 22:17:43,344 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:17:43,366 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40849 7221s 2024-11-23 22:17:43,366 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40849 7221s 2024-11-23 22:17:43,366 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:17:43,366 - distributed.worker - INFO - dashboard at: 127.0.0.1:36617 7221s 2024-11-23 22:17:43,366 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36269 7221s 2024-11-23 22:17:43,366 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:17:43,366 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:17:43,367 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:17:43,367 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-vxzdtb6z 7221s 2024-11-23 22:17:43,367 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:17:43,370 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46299 7221s 2024-11-23 22:17:43,370 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46299 7221s 2024-11-23 22:17:43,370 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:17:43,370 - distributed.worker - INFO - dashboard at: 127.0.0.1:35333 7221s 2024-11-23 22:17:43,370 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36269 7221s 2024-11-23 22:17:43,370 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:17:43,370 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:17:43,370 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:17:43,370 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-8r6cmpwy 7221s 2024-11-23 22:17:43,371 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:17:43,372 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40849. Reason: failure-to-start- 7221s 2024-11-23 22:17:43,372 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:17:43,373 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46299. Reason: failure-to-start- 7221s 2024-11-23 22:17:43,374 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:17:43,375 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36269': TLS handshake failed with remote 'tls://127.0.0.1:57752': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:17:43,375 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36269': TLS handshake failed with remote 'tls://127.0.0.1:57766': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:17:43,377 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s 2024-11-23 22:17:44,386 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:17:44,396 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44841 7221s 2024-11-23 22:17:44,396 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45619/status 7221s 2024-11-23 22:17:44,396 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:17:44,416 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38139 7221s 2024-11-23 22:17:44,416 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38139 7221s 2024-11-23 22:17:44,416 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:17:44,416 - distributed.worker - INFO - dashboard at: 127.0.0.1:46599 7221s 2024-11-23 22:17:44,416 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 7221s 2024-11-23 22:17:44,416 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:17:44,416 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:17:44,416 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:17:44,416 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ex3z5hgc 7221s 2024-11-23 22:17:44,417 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:17:44,420 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40943 7221s 2024-11-23 22:17:44,420 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40943 7221s 2024-11-23 22:17:44,420 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:17:44,420 - distributed.worker - INFO - dashboard at: 127.0.0.1:33437 7221s 2024-11-23 22:17:44,420 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44841 7221s 2024-11-23 22:17:44,420 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:17:44,420 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:17:44,420 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:17:44,420 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-4pjpb3jz 7221s 2024-11-23 22:17:44,421 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:17:44,422 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38139. Reason: failure-to-start- 7221s 2024-11-23 22:17:44,422 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:17:44,423 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40943. Reason: failure-to-start- 7221s 2024-11-23 22:17:44,423 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:17:44,425 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:44664': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:17:44,425 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44841': TLS handshake failed with remote 'tls://127.0.0.1:44676': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:17:44,427 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s 2024-11-23 22:17:45,436 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:17:45,446 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36657 7221s 2024-11-23 22:17:45,446 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40749/status 7221s 2024-11-23 22:17:45,446 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:17:45,467 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34763 7221s 2024-11-23 22:17:45,467 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34763 7221s 2024-11-23 22:17:45,467 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:17:45,467 - distributed.worker - INFO - dashboard at: 127.0.0.1:40253 7221s 2024-11-23 22:17:45,467 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36657 7221s 2024-11-23 22:17:45,467 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:17:45,467 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:17:45,468 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:17:45,468 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-sgayqrap 7221s 2024-11-23 22:17:45,468 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:17:45,471 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42417 7221s 2024-11-23 22:17:45,471 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42417 7221s 2024-11-23 22:17:45,471 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:17:45,471 - distributed.worker - INFO - dashboard at: 127.0.0.1:46469 7221s 2024-11-23 22:17:45,471 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36657 7221s 2024-11-23 22:17:45,471 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:17:45,471 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:17:45,471 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:17:45,471 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-xnj9rve4 7221s 2024-11-23 22:17:45,471 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:17:45,473 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34763. Reason: failure-to-start- 7221s 2024-11-23 22:17:45,473 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:17:45,474 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42417. Reason: failure-to-start- 7221s 2024-11-23 22:17:45,474 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:17:45,476 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36657': TLS handshake failed with remote 'tls://127.0.0.1:50052': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:17:45,476 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36657': TLS handshake failed with remote 'tls://127.0.0.1:50064': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:17:45,478 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s 2024-11-23 22:17:46,486 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:17:46,496 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38931 7221s 2024-11-23 22:17:46,497 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41625/status 7221s 2024-11-23 22:17:46,497 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:17:46,519 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36929 7221s 2024-11-23 22:17:46,520 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36929 7221s 2024-11-23 22:17:46,520 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:17:46,520 - distributed.worker - INFO - dashboard at: 127.0.0.1:37317 7221s 2024-11-23 22:17:46,520 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38931 7221s 2024-11-23 22:17:46,520 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:17:46,520 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:17:46,520 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:17:46,520 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-njg89fzd 7221s 2024-11-23 22:17:46,520 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:17:46,523 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38035 7221s 2024-11-23 22:17:46,524 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38035 7221s 2024-11-23 22:17:46,524 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:17:46,524 - distributed.worker - INFO - dashboard at: 127.0.0.1:38235 7221s 2024-11-23 22:17:46,524 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38931 7221s 2024-11-23 22:17:46,524 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:17:46,524 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:17:46,524 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:17:46,524 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-wtsgnirb 7221s 2024-11-23 22:17:46,524 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:17:46,526 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36929. Reason: failure-to-start- 7221s 2024-11-23 22:17:46,526 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:17:46,527 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38035. Reason: failure-to-start- 7221s 2024-11-23 22:17:46,527 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:17:46,529 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38931': TLS handshake failed with remote 'tls://127.0.0.1:57028': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:17:46,529 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38931': TLS handshake failed with remote 'tls://127.0.0.1:57042': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:17:46,531 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s 2024-11-23 22:17:47,540 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:17:47,550 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35227 7221s 2024-11-23 22:17:47,551 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40391/status 7221s 2024-11-23 22:17:47,551 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:17:47,572 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:32771 7221s 2024-11-23 22:17:47,572 - distributed.worker - INFO - Listening to: tls://127.0.0.1:32771 7221s 2024-11-23 22:17:47,572 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:17:47,572 - distributed.worker - INFO - dashboard at: 127.0.0.1:46815 7221s 2024-11-23 22:17:47,572 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35227 7221s 2024-11-23 22:17:47,572 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:17:47,573 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:17:47,573 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:17:47,573 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-gzjcnfam 7221s 2024-11-23 22:17:47,573 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:17:47,576 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46877 7221s 2024-11-23 22:17:47,576 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46877 7221s 2024-11-23 22:17:47,576 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:17:47,576 - distributed.worker - INFO - dashboard at: 127.0.0.1:35971 7221s 2024-11-23 22:17:47,576 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35227 7221s 2024-11-23 22:17:47,576 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:17:47,576 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:17:47,576 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:17:47,576 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-6ytg9cwh 7221s 2024-11-23 22:17:47,577 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:17:47,578 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:32771. Reason: failure-to-start- 7221s 2024-11-23 22:17:47,578 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:17:47,579 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46877. Reason: failure-to-start- 7221s 2024-11-23 22:17:47,579 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:17:47,581 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35227': TLS handshake failed with remote 'tls://127.0.0.1:52316': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:17:47,581 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35227': TLS handshake failed with remote 'tls://127.0.0.1:52326': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:17:47,583 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s 2024-11-23 22:17:48,590 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:17:48,601 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45961 7221s 2024-11-23 22:17:48,601 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42485/status 7221s 2024-11-23 22:17:48,602 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:17:48,621 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37443 7221s 2024-11-23 22:17:48,621 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37443 7221s 2024-11-23 22:17:48,621 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:17:48,621 - distributed.worker - INFO - dashboard at: 127.0.0.1:40029 7221s 2024-11-23 22:17:48,621 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45961 7221s 2024-11-23 22:17:48,621 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:17:48,622 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:17:48,622 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:17:48,622 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-4z2t0z78 7221s 2024-11-23 22:17:48,622 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:17:48,625 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40575 7221s 2024-11-23 22:17:48,625 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40575 7221s 2024-11-23 22:17:48,625 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:17:48,625 - distributed.worker - INFO - dashboard at: 127.0.0.1:36219 7221s 2024-11-23 22:17:48,625 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45961 7221s 2024-11-23 22:17:48,625 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:17:48,625 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:17:48,625 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:17:48,626 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ey7n3n_6 7221s 2024-11-23 22:17:48,626 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:17:48,639 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37443. Reason: failure-to-start- 7221s 2024-11-23 22:17:48,639 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:17:48,639 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40575. Reason: failure-to-start- 7221s 2024-11-23 22:17:48,640 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:17:48,642 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45961': TLS handshake failed with remote 'tls://127.0.0.1:46284': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:17:48,642 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45961': TLS handshake failed with remote 'tls://127.0.0.1:46288': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:17:48,644 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s 2024-11-23 22:17:49,651 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:17:49,662 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45133 7221s 2024-11-23 22:17:49,663 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42455/status 7221s 2024-11-23 22:17:49,663 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:17:49,684 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39047 7221s 2024-11-23 22:17:49,684 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39047 7221s 2024-11-23 22:17:49,684 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:17:49,684 - distributed.worker - INFO - dashboard at: 127.0.0.1:35773 7221s 2024-11-23 22:17:49,684 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45133 7221s 2024-11-23 22:17:49,684 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:17:49,685 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:17:49,685 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:17:49,685 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ntu4f_01 7221s 2024-11-23 22:17:49,685 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:17:49,688 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35499 7221s 2024-11-23 22:17:49,688 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35499 7221s 2024-11-23 22:17:49,688 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:17:49,688 - distributed.worker - INFO - dashboard at: 127.0.0.1:43447 7221s 2024-11-23 22:17:49,688 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45133 7221s 2024-11-23 22:17:49,688 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:17:49,688 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:17:49,688 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:17:49,688 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-et8e0e5k 7221s 2024-11-23 22:17:49,689 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:17:49,690 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39047. Reason: failure-to-start- 7221s 2024-11-23 22:17:49,690 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:17:49,691 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35499. Reason: failure-to-start- 7221s 2024-11-23 22:17:49,691 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:17:49,697 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45133': TLS handshake failed with remote 'tls://127.0.0.1:35042': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:17:49,697 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45133': TLS handshake failed with remote 'tls://127.0.0.1:35056': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:17:49,699 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s 2024-11-23 22:17:50,707 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:17:50,716 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36039 7221s 2024-11-23 22:17:50,717 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35593/status 7221s 2024-11-23 22:17:50,719 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:17:50,739 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41707 7221s 2024-11-23 22:17:50,739 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41707 7221s 2024-11-23 22:17:50,739 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:17:50,739 - distributed.worker - INFO - dashboard at: 127.0.0.1:43387 7221s 2024-11-23 22:17:50,739 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36039 7221s 2024-11-23 22:17:50,739 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:17:50,739 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:17:50,740 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:17:50,740 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-f2pgt9d3 7221s 2024-11-23 22:17:50,740 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:17:50,743 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33921 7221s 2024-11-23 22:17:50,743 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33921 7221s 2024-11-23 22:17:50,743 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:17:50,743 - distributed.worker - INFO - dashboard at: 127.0.0.1:41605 7221s 2024-11-23 22:17:50,743 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36039 7221s 2024-11-23 22:17:50,743 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:17:50,743 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:17:50,743 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:17:50,743 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-k0fvkeh_ 7221s 2024-11-23 22:17:50,744 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:17:50,749 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41707. Reason: failure-to-start- 7221s 2024-11-23 22:17:50,749 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:17:50,750 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33921. Reason: failure-to-start- 7221s 2024-11-23 22:17:50,750 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:17:50,752 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36039': TLS handshake failed with remote 'tls://127.0.0.1:42788': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:17:50,752 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36039': TLS handshake failed with remote 'tls://127.0.0.1:42798': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:17:50,754 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s 2024-11-23 22:17:51,762 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:17:51,771 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37139 7221s 2024-11-23 22:17:51,772 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41995/status 7221s 2024-11-23 22:17:51,772 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:17:51,796 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46297 7221s 2024-11-23 22:17:51,796 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46297 7221s 2024-11-23 22:17:51,796 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:17:51,796 - distributed.worker - INFO - dashboard at: 127.0.0.1:36581 7221s 2024-11-23 22:17:51,796 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37139 7221s 2024-11-23 22:17:51,796 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:17:51,796 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:17:51,796 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:17:51,796 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-cmgqiuxw 7221s 2024-11-23 22:17:51,796 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:17:51,800 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44879 7221s 2024-11-23 22:17:51,800 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44879 7221s 2024-11-23 22:17:51,800 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:17:51,800 - distributed.worker - INFO - dashboard at: 127.0.0.1:43723 7221s 2024-11-23 22:17:51,800 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37139 7221s 2024-11-23 22:17:51,800 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:17:51,800 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:17:51,800 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:17:51,800 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-m9i44pha 7221s 2024-11-23 22:17:51,800 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:17:51,806 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46297. Reason: failure-to-start- 7221s 2024-11-23 22:17:51,806 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:17:51,807 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44879. Reason: failure-to-start- 7221s 2024-11-23 22:17:51,807 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:17:51,809 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37139': TLS handshake failed with remote 'tls://127.0.0.1:56428': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:17:51,810 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37139': TLS handshake failed with remote 'tls://127.0.0.1:56436': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:17:51,812 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s 2024-11-23 22:17:52,820 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:17:52,830 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44089 7221s 2024-11-23 22:17:52,831 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43521/status 7221s 2024-11-23 22:17:52,831 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:17:52,852 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40169 7221s 2024-11-23 22:17:52,852 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40169 7221s 2024-11-23 22:17:52,852 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:17:52,852 - distributed.worker - INFO - dashboard at: 127.0.0.1:38913 7221s 2024-11-23 22:17:52,852 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44089 7221s 2024-11-23 22:17:52,852 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:17:52,852 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:17:52,852 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:17:52,853 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-5sf60bxf 7221s 2024-11-23 22:17:52,853 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:17:52,856 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43135 7221s 2024-11-23 22:17:52,856 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43135 7221s 2024-11-23 22:17:52,856 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:17:52,856 - distributed.worker - INFO - dashboard at: 127.0.0.1:40639 7221s 2024-11-23 22:17:52,856 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44089 7221s 2024-11-23 22:17:52,856 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:17:52,856 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:17:52,856 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:17:52,856 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-wm87s8eb 7221s 2024-11-23 22:17:52,856 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:17:52,864 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40169. Reason: failure-to-start- 7221s 2024-11-23 22:17:52,864 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:17:52,865 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43135. Reason: failure-to-start- 7221s 2024-11-23 22:17:52,865 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:17:52,867 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44089': TLS handshake failed with remote 'tls://127.0.0.1:50382': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:17:52,868 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44089': TLS handshake failed with remote 'tls://127.0.0.1:50398': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:17:52,870 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s 2024-11-23 22:17:53,878 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:17:53,888 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39679 7221s 2024-11-23 22:17:53,888 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41615/status 7221s 2024-11-23 22:17:53,889 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:17:53,911 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41519 7221s 2024-11-23 22:17:53,911 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41519 7221s 2024-11-23 22:17:53,911 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:17:53,911 - distributed.worker - INFO - dashboard at: 127.0.0.1:37833 7221s 2024-11-23 22:17:53,911 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39679 7221s 2024-11-23 22:17:53,911 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:17:53,911 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:17:53,911 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:17:53,911 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-udbckq02 7221s 2024-11-23 22:17:53,911 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:17:53,915 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34465 7221s 2024-11-23 22:17:53,915 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34465 7221s 2024-11-23 22:17:53,915 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:17:53,915 - distributed.worker - INFO - dashboard at: 127.0.0.1:32801 7221s 2024-11-23 22:17:53,915 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39679 7221s 2024-11-23 22:17:53,915 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:17:53,915 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:17:53,915 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:17:53,915 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-v7zmswhp 7221s 2024-11-23 22:17:53,915 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:17:53,921 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41519. Reason: failure-to-start- 7221s 2024-11-23 22:17:53,921 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:17:53,922 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34465. Reason: failure-to-start- 7221s 2024-11-23 22:17:53,922 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:17:53,924 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39679': TLS handshake failed with remote 'tls://127.0.0.1:52142': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:17:53,925 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39679': TLS handshake failed with remote 'tls://127.0.0.1:52154': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:17:53,927 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s 2024-11-23 22:17:54,934 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:17:54,947 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45041 7221s 2024-11-23 22:17:54,948 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42423/status 7221s 2024-11-23 22:17:54,948 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:17:54,973 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40267 7221s 2024-11-23 22:17:54,974 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40267 7221s 2024-11-23 22:17:54,974 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:17:54,974 - distributed.worker - INFO - dashboard at: 127.0.0.1:37215 7221s 2024-11-23 22:17:54,974 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 7221s 2024-11-23 22:17:54,974 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:17:54,974 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:17:54,974 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:17:54,974 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-x0e3hjlu 7221s 2024-11-23 22:17:54,974 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:17:54,978 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33037 7221s 2024-11-23 22:17:54,978 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33037 7221s 2024-11-23 22:17:54,978 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:17:54,978 - distributed.worker - INFO - dashboard at: 127.0.0.1:40691 7221s 2024-11-23 22:17:54,978 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45041 7221s 2024-11-23 22:17:54,978 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:17:54,978 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:17:54,978 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:17:54,978 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-a7qvugmq 7221s 2024-11-23 22:17:54,978 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:17:54,980 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40267. Reason: failure-to-start- 7221s 2024-11-23 22:17:54,981 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:17:54,981 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33037. Reason: failure-to-start- 7221s 2024-11-23 22:17:54,982 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:17:54,984 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40912': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:17:54,984 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45041': TLS handshake failed with remote 'tls://127.0.0.1:40924': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:17:54,986 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s 2024-11-23 22:17:55,994 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:17:56,004 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36495 7221s 2024-11-23 22:17:56,005 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43353/status 7221s 2024-11-23 22:17:56,005 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:17:56,032 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34117 7221s 2024-11-23 22:17:56,032 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34117 7221s 2024-11-23 22:17:56,032 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:17:56,032 - distributed.worker - INFO - dashboard at: 127.0.0.1:42413 7221s 2024-11-23 22:17:56,032 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36495 7221s 2024-11-23 22:17:56,032 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:17:56,032 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:17:56,032 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:17:56,032 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-w2r8_dfu 7221s 2024-11-23 22:17:56,032 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:17:56,035 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43641 7221s 2024-11-23 22:17:56,036 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43641 7221s 2024-11-23 22:17:56,036 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:17:56,036 - distributed.worker - INFO - dashboard at: 127.0.0.1:38689 7221s 2024-11-23 22:17:56,036 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36495 7221s 2024-11-23 22:17:56,036 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:17:56,036 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:17:56,036 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:17:56,036 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ckohlusg 7221s 2024-11-23 22:17:56,036 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:17:56,038 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34117. Reason: failure-to-start- 7221s 2024-11-23 22:17:56,038 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:17:56,039 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43641. Reason: failure-to-start- 7221s 2024-11-23 22:17:56,039 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:17:56,041 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36495': TLS handshake failed with remote 'tls://127.0.0.1:45486': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:17:56,042 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36495': TLS handshake failed with remote 'tls://127.0.0.1:45494': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:17:56,044 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s 2024-11-23 22:17:57,051 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:17:57,062 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:32903 7221s 2024-11-23 22:17:57,062 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43773/status 7221s 2024-11-23 22:17:57,062 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:17:57,085 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46597 7221s 2024-11-23 22:17:57,085 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46597 7221s 2024-11-23 22:17:57,085 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:17:57,086 - distributed.worker - INFO - dashboard at: 127.0.0.1:41359 7221s 2024-11-23 22:17:57,086 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:32903 7221s 2024-11-23 22:17:57,086 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:17:57,086 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:17:57,086 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:17:57,086 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-x4gu63hy 7221s 2024-11-23 22:17:57,086 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:17:57,091 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42759 7221s 2024-11-23 22:17:57,091 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42759 7221s 2024-11-23 22:17:57,091 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:17:57,091 - distributed.worker - INFO - dashboard at: 127.0.0.1:33491 7221s 2024-11-23 22:17:57,091 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:32903 7221s 2024-11-23 22:17:57,091 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:17:57,091 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:17:57,091 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:17:57,091 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-9qyoy1bh 7221s 2024-11-23 22:17:57,092 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:17:57,094 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46597. Reason: failure-to-start- 7221s 2024-11-23 22:17:57,094 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:17:57,094 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42759. Reason: failure-to-start- 7221s 2024-11-23 22:17:57,095 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:17:57,097 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:32903': TLS handshake failed with remote 'tls://127.0.0.1:47518': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:17:57,097 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:32903': TLS handshake failed with remote 'tls://127.0.0.1:47528': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:17:57,100 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s 2024-11-23 22:17:58,110 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:17:58,119 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41759 7221s 2024-11-23 22:17:58,120 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38831/status 7221s 2024-11-23 22:17:58,120 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:17:58,140 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38173 7221s 2024-11-23 22:17:58,140 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38173 7221s 2024-11-23 22:17:58,140 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:17:58,140 - distributed.worker - INFO - dashboard at: 127.0.0.1:33045 7221s 2024-11-23 22:17:58,140 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41759 7221s 2024-11-23 22:17:58,141 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:17:58,141 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:17:58,141 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:17:58,141 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-k15z6hjh 7221s 2024-11-23 22:17:58,141 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:17:58,144 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35701 7221s 2024-11-23 22:17:58,144 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35701 7221s 2024-11-23 22:17:58,144 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:17:58,144 - distributed.worker - INFO - dashboard at: 127.0.0.1:40845 7221s 2024-11-23 22:17:58,144 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41759 7221s 2024-11-23 22:17:58,144 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:17:58,144 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:17:58,144 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:17:58,145 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-l5mvrj68 7221s 2024-11-23 22:17:58,145 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:17:58,146 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38173. Reason: failure-to-start- 7221s 2024-11-23 22:17:58,147 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:17:58,147 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35701. Reason: failure-to-start- 7221s 2024-11-23 22:17:58,148 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:17:58,150 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41759': TLS handshake failed with remote 'tls://127.0.0.1:50440': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:17:58,150 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41759': TLS handshake failed with remote 'tls://127.0.0.1:50442': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:17:58,153 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s 2024-11-23 22:17:59,159 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:17:59,169 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43187 7221s 2024-11-23 22:17:59,170 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41943/status 7221s 2024-11-23 22:17:59,170 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:17:59,193 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34183 7221s 2024-11-23 22:17:59,193 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34183 7221s 2024-11-23 22:17:59,193 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:17:59,193 - distributed.worker - INFO - dashboard at: 127.0.0.1:38787 7221s 2024-11-23 22:17:59,193 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43187 7221s 2024-11-23 22:17:59,193 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:17:59,193 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:17:59,194 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:17:59,194 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-g5vzfiic 7221s 2024-11-23 22:17:59,194 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:17:59,197 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42457 7221s 2024-11-23 22:17:59,197 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42457 7221s 2024-11-23 22:17:59,197 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:17:59,197 - distributed.worker - INFO - dashboard at: 127.0.0.1:34689 7221s 2024-11-23 22:17:59,197 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43187 7221s 2024-11-23 22:17:59,197 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:17:59,197 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:17:59,197 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:17:59,197 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-c31ap70k 7221s 2024-11-23 22:17:59,197 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:17:59,203 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34183. Reason: failure-to-start- 7221s 2024-11-23 22:17:59,203 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:17:59,204 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42457. Reason: failure-to-start- 7221s 2024-11-23 22:17:59,204 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:17:59,206 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43187': TLS handshake failed with remote 'tls://127.0.0.1:56930': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:17:59,207 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43187': TLS handshake failed with remote 'tls://127.0.0.1:56940': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:17:59,209 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s 2024-11-23 22:18:00,216 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:18:00,229 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33815 7221s 2024-11-23 22:18:00,229 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34977/status 7221s 2024-11-23 22:18:00,230 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:18:00,256 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36567 7221s 2024-11-23 22:18:00,256 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36567 7221s 2024-11-23 22:18:00,256 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:18:00,256 - distributed.worker - INFO - dashboard at: 127.0.0.1:43325 7221s 2024-11-23 22:18:00,257 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33815 7221s 2024-11-23 22:18:00,257 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:18:00,257 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:18:00,257 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:18:00,257 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-cqjqg7zv 7221s 2024-11-23 22:18:00,257 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:18:00,260 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35131 7221s 2024-11-23 22:18:00,260 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35131 7221s 2024-11-23 22:18:00,260 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:18:00,260 - distributed.worker - INFO - dashboard at: 127.0.0.1:39387 7221s 2024-11-23 22:18:00,260 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33815 7221s 2024-11-23 22:18:00,260 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:18:00,260 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:18:00,260 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:18:00,261 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-xu3ry4el 7221s 2024-11-23 22:18:00,261 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:18:00,263 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36567. Reason: failure-to-start- 7221s 2024-11-23 22:18:00,264 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:18:00,264 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35131. Reason: failure-to-start- 7221s 2024-11-23 22:18:00,264 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:18:00,270 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33815': TLS handshake failed with remote 'tls://127.0.0.1:47090': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:18:00,270 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33815': TLS handshake failed with remote 'tls://127.0.0.1:47094': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:18:00,273 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s 2024-11-23 22:18:01,280 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:18:01,289 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38769 7221s 2024-11-23 22:18:01,290 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34737/status 7221s 2024-11-23 22:18:01,290 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:18:01,312 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40893 7221s 2024-11-23 22:18:01,313 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40893 7221s 2024-11-23 22:18:01,313 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:18:01,313 - distributed.worker - INFO - dashboard at: 127.0.0.1:37447 7221s 2024-11-23 22:18:01,313 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38769 7221s 2024-11-23 22:18:01,313 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:18:01,313 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:18:01,313 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:18:01,313 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-8u82f452 7221s 2024-11-23 22:18:01,313 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:18:01,316 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42087 7221s 2024-11-23 22:18:01,317 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42087 7221s 2024-11-23 22:18:01,317 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:18:01,317 - distributed.worker - INFO - dashboard at: 127.0.0.1:34423 7221s 2024-11-23 22:18:01,317 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38769 7221s 2024-11-23 22:18:01,317 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:18:01,317 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:18:01,317 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:18:01,317 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-mrs0y8gs 7221s 2024-11-23 22:18:01,317 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:18:01,323 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40893. Reason: failure-to-start- 7221s 2024-11-23 22:18:01,323 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:18:01,324 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42087. Reason: failure-to-start- 7221s 2024-11-23 22:18:01,324 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:18:01,326 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38769': TLS handshake failed with remote 'tls://127.0.0.1:58220': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:18:01,327 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38769': TLS handshake failed with remote 'tls://127.0.0.1:58236': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:18:01,329 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s 2024-11-23 22:18:02,340 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:18:02,350 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45057 7221s 2024-11-23 22:18:02,350 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36465/status 7221s 2024-11-23 22:18:02,351 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:18:02,376 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38139 7221s 2024-11-23 22:18:02,376 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38139 7221s 2024-11-23 22:18:02,377 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:18:02,377 - distributed.worker - INFO - dashboard at: 127.0.0.1:35451 7221s 2024-11-23 22:18:02,377 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45057 7221s 2024-11-23 22:18:02,377 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:18:02,377 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:18:02,377 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:18:02,377 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-rauyg8cr 7221s 2024-11-23 22:18:02,377 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:18:02,382 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46013 7221s 2024-11-23 22:18:02,382 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46013 7221s 2024-11-23 22:18:02,382 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:18:02,382 - distributed.worker - INFO - dashboard at: 127.0.0.1:33159 7221s 2024-11-23 22:18:02,383 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45057 7221s 2024-11-23 22:18:02,383 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:18:02,383 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:18:02,383 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:18:02,383 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-gdbkybj_ 7221s 2024-11-23 22:18:02,383 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:18:02,385 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38139. Reason: failure-to-start- 7221s 2024-11-23 22:18:02,385 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:18:02,386 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46013. Reason: failure-to-start- 7221s 2024-11-23 22:18:02,386 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:18:02,388 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45057': TLS handshake failed with remote 'tls://127.0.0.1:57158': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:18:02,389 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45057': TLS handshake failed with remote 'tls://127.0.0.1:57166': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:18:02,395 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s 2024-11-23 22:18:03,405 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:18:03,415 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34841 7221s 2024-11-23 22:18:03,416 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42801/status 7221s 2024-11-23 22:18:03,416 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:18:03,439 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36475 7221s 2024-11-23 22:18:03,439 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36475 7221s 2024-11-23 22:18:03,439 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:18:03,439 - distributed.worker - INFO - dashboard at: 127.0.0.1:43805 7221s 2024-11-23 22:18:03,439 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34841 7221s 2024-11-23 22:18:03,439 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:18:03,440 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:18:03,440 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:18:03,440 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-pkw15fwc 7221s 2024-11-23 22:18:03,440 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:18:03,443 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39529 7221s 2024-11-23 22:18:03,443 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39529 7221s 2024-11-23 22:18:03,444 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:18:03,444 - distributed.worker - INFO - dashboard at: 127.0.0.1:44077 7221s 2024-11-23 22:18:03,444 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34841 7221s 2024-11-23 22:18:03,444 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:18:03,444 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:18:03,444 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:18:03,444 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-eztgk12h 7221s 2024-11-23 22:18:03,444 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:18:03,448 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36475. Reason: failure-to-start- 7221s 2024-11-23 22:18:03,448 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:18:03,449 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39529. Reason: failure-to-start- 7221s 2024-11-23 22:18:03,450 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:18:03,452 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34841': TLS handshake failed with remote 'tls://127.0.0.1:35666': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:18:03,452 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34841': TLS handshake failed with remote 'tls://127.0.0.1:35672': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:18:03,463 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s 2024-11-23 22:18:04,470 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:18:04,481 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44121 7221s 2024-11-23 22:18:04,482 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42011/status 7221s 2024-11-23 22:18:04,482 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:18:04,506 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44197 7221s 2024-11-23 22:18:04,506 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44197 7221s 2024-11-23 22:18:04,506 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:18:04,507 - distributed.worker - INFO - dashboard at: 127.0.0.1:37055 7221s 2024-11-23 22:18:04,507 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44121 7221s 2024-11-23 22:18:04,507 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:18:04,507 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:18:04,507 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:18:04,507 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-8ldq0rmq 7221s 2024-11-23 22:18:04,507 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:18:04,511 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36591 7221s 2024-11-23 22:18:04,511 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36591 7221s 2024-11-23 22:18:04,511 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:18:04,511 - distributed.worker - INFO - dashboard at: 127.0.0.1:36041 7221s 2024-11-23 22:18:04,511 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44121 7221s 2024-11-23 22:18:04,511 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:18:04,511 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:18:04,511 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:18:04,512 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-xddb7bky 7221s 2024-11-23 22:18:04,512 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:18:04,540 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44197. Reason: failure-to-start- 7221s 2024-11-23 22:18:04,541 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:18:04,542 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36591. Reason: failure-to-start- 7221s 2024-11-23 22:18:04,542 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:18:04,549 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44121': TLS handshake failed with remote 'tls://127.0.0.1:60492': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:18:04,549 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44121': TLS handshake failed with remote 'tls://127.0.0.1:60504': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:18:04,552 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s 2024-11-23 22:18:05,560 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:18:05,571 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34453 7221s 2024-11-23 22:18:05,572 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43859/status 7221s 2024-11-23 22:18:05,573 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:18:05,601 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34729 7221s 2024-11-23 22:18:05,601 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34729 7221s 2024-11-23 22:18:05,601 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:18:05,601 - distributed.worker - INFO - dashboard at: 127.0.0.1:38441 7221s 2024-11-23 22:18:05,601 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34453 7221s 2024-11-23 22:18:05,601 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:18:05,601 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:18:05,602 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:18:05,602 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ls86czb3 7221s 2024-11-23 22:18:05,602 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:18:05,605 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40071 7221s 2024-11-23 22:18:05,605 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40071 7221s 2024-11-23 22:18:05,605 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:18:05,605 - distributed.worker - INFO - dashboard at: 127.0.0.1:41819 7221s 2024-11-23 22:18:05,605 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34453 7221s 2024-11-23 22:18:05,606 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:18:05,606 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:18:05,606 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:18:05,606 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-dtevwfv7 7221s 2024-11-23 22:18:05,606 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:18:05,608 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34729. Reason: failure-to-start- 7221s 2024-11-23 22:18:05,609 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:18:05,609 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40071. Reason: failure-to-start- 7221s 2024-11-23 22:18:05,610 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:18:05,617 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34453': TLS handshake failed with remote 'tls://127.0.0.1:47224': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:18:05,617 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34453': TLS handshake failed with remote 'tls://127.0.0.1:47234': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:18:05,620 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s 2024-11-23 22:18:06,629 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:18:06,643 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45125 7221s 2024-11-23 22:18:06,643 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46271/status 7221s 2024-11-23 22:18:06,644 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:18:06,669 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45579 7221s 2024-11-23 22:18:06,669 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45579 7221s 2024-11-23 22:18:06,669 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:18:06,669 - distributed.worker - INFO - dashboard at: 127.0.0.1:43943 7221s 2024-11-23 22:18:06,669 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45125 7221s 2024-11-23 22:18:06,669 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:18:06,669 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:18:06,669 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:18:06,669 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-w761x8_9 7221s 2024-11-23 22:18:06,669 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:18:06,673 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37129 7221s 2024-11-23 22:18:06,673 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37129 7221s 2024-11-23 22:18:06,673 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:18:06,673 - distributed.worker - INFO - dashboard at: 127.0.0.1:35095 7221s 2024-11-23 22:18:06,673 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45125 7221s 2024-11-23 22:18:06,673 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:18:06,673 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:18:06,673 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:18:06,673 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-r9fikn0r 7221s 2024-11-23 22:18:06,674 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:18:06,680 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45579. Reason: failure-to-start- 7221s 2024-11-23 22:18:06,680 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:18:06,681 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37129. Reason: failure-to-start- 7221s 2024-11-23 22:18:06,681 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:18:06,687 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45125': TLS handshake failed with remote 'tls://127.0.0.1:56394': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:18:06,687 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45125': TLS handshake failed with remote 'tls://127.0.0.1:56400': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:18:06,693 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s 2024-11-23 22:18:07,701 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:18:07,712 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35307 7221s 2024-11-23 22:18:07,713 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43517/status 7221s 2024-11-23 22:18:07,713 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:18:07,740 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43071 7221s 2024-11-23 22:18:07,740 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43071 7221s 2024-11-23 22:18:07,740 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:18:07,741 - distributed.worker - INFO - dashboard at: 127.0.0.1:41355 7221s 2024-11-23 22:18:07,741 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35307 7221s 2024-11-23 22:18:07,741 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:18:07,741 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:18:07,741 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:18:07,741 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-8puoj8zj 7221s 2024-11-23 22:18:07,741 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:18:07,744 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46209 7221s 2024-11-23 22:18:07,745 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46209 7221s 2024-11-23 22:18:07,745 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:18:07,745 - distributed.worker - INFO - dashboard at: 127.0.0.1:33019 7221s 2024-11-23 22:18:07,745 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35307 7221s 2024-11-23 22:18:07,745 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:18:07,745 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:18:07,745 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:18:07,745 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-c8mwyodw 7221s 2024-11-23 22:18:07,745 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:18:07,758 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43071. Reason: failure-to-start- 7221s 2024-11-23 22:18:07,758 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:18:07,759 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46209. Reason: failure-to-start- 7221s 2024-11-23 22:18:07,760 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:18:07,762 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35307': TLS handshake failed with remote 'tls://127.0.0.1:40500': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:18:07,762 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35307': TLS handshake failed with remote 'tls://127.0.0.1:40506': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:18:07,769 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s 2024-11-23 22:18:08,777 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:18:08,788 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41845 7221s 2024-11-23 22:18:08,788 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37381/status 7221s 2024-11-23 22:18:08,792 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:18:08,818 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42761 7221s 2024-11-23 22:18:08,818 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42761 7221s 2024-11-23 22:18:08,818 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:18:08,818 - distributed.worker - INFO - dashboard at: 127.0.0.1:44545 7221s 2024-11-23 22:18:08,818 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41845 7221s 2024-11-23 22:18:08,818 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:18:08,818 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:18:08,818 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:18:08,818 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-yjj5huve 7221s 2024-11-23 22:18:08,819 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:18:08,822 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42695 7221s 2024-11-23 22:18:08,822 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42695 7221s 2024-11-23 22:18:08,822 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:18:08,822 - distributed.worker - INFO - dashboard at: 127.0.0.1:37897 7221s 2024-11-23 22:18:08,822 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41845 7221s 2024-11-23 22:18:08,822 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:18:08,822 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:18:08,822 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:18:08,822 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-l8auhfk4 7221s 2024-11-23 22:18:08,823 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:18:08,831 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42761. Reason: failure-to-start- 7221s 2024-11-23 22:18:08,831 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:18:08,832 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42695. Reason: failure-to-start- 7221s 2024-11-23 22:18:08,832 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:18:08,835 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41845': TLS handshake failed with remote 'tls://127.0.0.1:41402': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:18:08,835 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41845': TLS handshake failed with remote 'tls://127.0.0.1:41416': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:18:08,841 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s 2024-11-23 22:18:09,850 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:18:09,861 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44803 7221s 2024-11-23 22:18:09,862 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46791/status 7221s 2024-11-23 22:18:09,866 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:18:09,892 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43403 7221s 2024-11-23 22:18:09,893 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43403 7221s 2024-11-23 22:18:09,893 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:18:09,893 - distributed.worker - INFO - dashboard at: 127.0.0.1:40053 7221s 2024-11-23 22:18:09,893 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44803 7221s 2024-11-23 22:18:09,893 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:18:09,893 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:18:09,893 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:18:09,893 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-_op5j0d3 7221s 2024-11-23 22:18:09,893 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:18:09,896 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40693 7221s 2024-11-23 22:18:09,897 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40693 7221s 2024-11-23 22:18:09,897 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:18:09,897 - distributed.worker - INFO - dashboard at: 127.0.0.1:42573 7221s 2024-11-23 22:18:09,897 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44803 7221s 2024-11-23 22:18:09,897 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:18:09,897 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:18:09,897 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:18:09,897 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-dlw2gg74 7221s 2024-11-23 22:18:09,897 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:18:09,905 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43403. Reason: failure-to-start- 7221s 2024-11-23 22:18:09,906 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:18:09,906 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40693. Reason: failure-to-start- 7221s 2024-11-23 22:18:09,907 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:18:09,913 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44803': TLS handshake failed with remote 'tls://127.0.0.1:58698': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:18:09,913 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44803': TLS handshake failed with remote 'tls://127.0.0.1:58704': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:18:09,916 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s 2024-11-23 22:18:10,925 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:18:10,936 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46709 7221s 2024-11-23 22:18:10,937 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34481/status 7221s 2024-11-23 22:18:10,937 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:18:10,961 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38239 7221s 2024-11-23 22:18:10,962 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38239 7221s 2024-11-23 22:18:10,962 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:18:10,962 - distributed.worker - INFO - dashboard at: 127.0.0.1:37031 7221s 2024-11-23 22:18:10,962 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46709 7221s 2024-11-23 22:18:10,962 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:18:10,962 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:18:10,962 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:18:10,962 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-z6qy7t9a 7221s 2024-11-23 22:18:10,962 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:18:10,966 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36449 7221s 2024-11-23 22:18:10,966 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36449 7221s 2024-11-23 22:18:10,966 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:18:10,966 - distributed.worker - INFO - dashboard at: 127.0.0.1:46229 7221s 2024-11-23 22:18:10,966 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46709 7221s 2024-11-23 22:18:10,966 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:18:10,966 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:18:10,966 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:18:10,966 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-p5qfg4uu 7221s 2024-11-23 22:18:10,967 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:18:10,976 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38239. Reason: failure-to-start- 7221s 2024-11-23 22:18:10,976 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:18:10,979 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36449. Reason: failure-to-start- 7221s 2024-11-23 22:18:10,980 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:18:10,982 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46709': TLS handshake failed with remote 'tls://127.0.0.1:35846': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:18:10,982 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46709': TLS handshake failed with remote 'tls://127.0.0.1:35850': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:18:10,989 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s _____________________________ test_repr_temp_keys ______________________________ 7221s 7221s cls = , kwargs = {} 7221s 7221s @classmethod 7221s def temporary(cls, **kwargs): 7221s """Create a new temporary Security object. 7221s 7221s This creates a new self-signed key/cert pair suitable for securing 7221s communication for all roles in a Dask cluster. These keys/certs exist 7221s only in memory, and are stored in this object. 7221s 7221s This method requires the library ``cryptography`` be installed. 7221s """ 7221s try: 7221s > from cryptography import x509 7221s 7221s /usr/lib/python3/dist-packages/distributed/security.py:165: 7221s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7221s /usr/lib/python3/dist-packages/cryptography/x509/__init__.py:7: in 7221s from cryptography.x509 import certificate_transparency, verification 7221s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7221s 7221s # This file is dual licensed under the terms of the Apache License, Version 7221s # 2.0, and the BSD License. See the LICENSE file in the root of this repository 7221s # for complete details. 7221s 7221s from __future__ import annotations 7221s 7221s import abc 7221s import datetime 7221s 7221s from cryptography import utils 7221s > from cryptography.hazmat.bindings._rust import x509 as rust_x509 7221s E ImportError: cannot import name 'x509' from 'cryptography.hazmat.bindings._rust' (unknown location) 7221s 7221s /usr/lib/python3/dist-packages/cryptography/x509/certificate_transparency.py:11: ImportError 7221s 7221s During handling of the above exception, another exception occurred: 7221s 7221s def test_repr_temp_keys(): 7221s > xfail_ssl_issue5601() 7221s 7221s /usr/lib/python3/dist-packages/distributed/tests/test_security.py:155: 7221s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7221s /usr/lib/python3/dist-packages/distributed/utils_test.py:1945: in xfail_ssl_issue5601 7221s Security.temporary() 7221s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7221s 7221s cls = , kwargs = {} 7221s 7221s @classmethod 7221s def temporary(cls, **kwargs): 7221s """Create a new temporary Security object. 7221s 7221s This creates a new self-signed key/cert pair suitable for securing 7221s communication for all roles in a Dask cluster. These keys/certs exist 7221s only in memory, and are stored in this object. 7221s 7221s This method requires the library ``cryptography`` be installed. 7221s """ 7221s try: 7221s from cryptography import x509 7221s from cryptography.hazmat.backends import default_backend 7221s from cryptography.hazmat.primitives import hashes, serialization 7221s from cryptography.hazmat.primitives.asymmetric import rsa 7221s from cryptography.x509.oid import NameOID 7221s except ImportError: 7221s > raise ImportError( 7221s "Using `Security.temporary` requires `cryptography`, please " 7221s "install it using either pip or conda" 7221s ) 7221s E ImportError: Using `Security.temporary` requires `cryptography`, please install it using either pip or conda 7221s 7221s /usr/lib/python3/dist-packages/distributed/security.py:171: ImportError 7221s __________________________ test_temporary_credentials __________________________ 7221s 7221s cls = , kwargs = {} 7221s 7221s @classmethod 7221s def temporary(cls, **kwargs): 7221s """Create a new temporary Security object. 7221s 7221s This creates a new self-signed key/cert pair suitable for securing 7221s communication for all roles in a Dask cluster. These keys/certs exist 7221s only in memory, and are stored in this object. 7221s 7221s This method requires the library ``cryptography`` be installed. 7221s """ 7221s try: 7221s > from cryptography import x509 7221s 7221s /usr/lib/python3/dist-packages/distributed/security.py:165: 7221s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7221s /usr/lib/python3/dist-packages/cryptography/x509/__init__.py:7: in 7221s from cryptography.x509 import certificate_transparency, verification 7221s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7221s 7221s # This file is dual licensed under the terms of the Apache License, Version 7221s # 2.0, and the BSD License. See the LICENSE file in the root of this repository 7221s # for complete details. 7221s 7221s from __future__ import annotations 7221s 7221s import abc 7221s import datetime 7221s 7221s from cryptography import utils 7221s > from cryptography.hazmat.bindings._rust import x509 as rust_x509 7221s E ImportError: cannot import name 'x509' from 'cryptography.hazmat.bindings._rust' (unknown location) 7221s 7221s /usr/lib/python3/dist-packages/cryptography/x509/certificate_transparency.py:11: ImportError 7221s 7221s During handling of the above exception, another exception occurred: 7221s 7221s def test_temporary_credentials(): 7221s > xfail_ssl_issue5601() 7221s 7221s /usr/lib/python3/dist-packages/distributed/tests/test_security.py:448: 7221s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7221s /usr/lib/python3/dist-packages/distributed/utils_test.py:1945: in xfail_ssl_issue5601 7221s Security.temporary() 7221s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7221s 7221s cls = , kwargs = {} 7221s 7221s @classmethod 7221s def temporary(cls, **kwargs): 7221s """Create a new temporary Security object. 7221s 7221s This creates a new self-signed key/cert pair suitable for securing 7221s communication for all roles in a Dask cluster. These keys/certs exist 7221s only in memory, and are stored in this object. 7221s 7221s This method requires the library ``cryptography`` be installed. 7221s """ 7221s try: 7221s from cryptography import x509 7221s from cryptography.hazmat.backends import default_backend 7221s from cryptography.hazmat.primitives import hashes, serialization 7221s from cryptography.hazmat.primitives.asymmetric import rsa 7221s from cryptography.x509.oid import NameOID 7221s except ImportError: 7221s > raise ImportError( 7221s "Using `Security.temporary` requires `cryptography`, please " 7221s "install it using either pip or conda" 7221s ) 7221s E ImportError: Using `Security.temporary` requires `cryptography`, please install it using either pip or conda 7221s 7221s /usr/lib/python3/dist-packages/distributed/security.py:171: ImportError 7221s ________________ test_extra_conn_args_in_temporary_credentials _________________ 7221s 7221s cls = , kwargs = {} 7221s 7221s @classmethod 7221s def temporary(cls, **kwargs): 7221s """Create a new temporary Security object. 7221s 7221s This creates a new self-signed key/cert pair suitable for securing 7221s communication for all roles in a Dask cluster. These keys/certs exist 7221s only in memory, and are stored in this object. 7221s 7221s This method requires the library ``cryptography`` be installed. 7221s """ 7221s try: 7221s > from cryptography import x509 7221s 7221s /usr/lib/python3/dist-packages/distributed/security.py:165: 7221s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7221s /usr/lib/python3/dist-packages/cryptography/x509/__init__.py:7: in 7221s from cryptography.x509 import certificate_transparency, verification 7221s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7221s 7221s # This file is dual licensed under the terms of the Apache License, Version 7221s # 2.0, and the BSD License. See the LICENSE file in the root of this repository 7221s # for complete details. 7221s 7221s from __future__ import annotations 7221s 7221s import abc 7221s import datetime 7221s 7221s from cryptography import utils 7221s > from cryptography.hazmat.bindings._rust import x509 as rust_x509 7221s E ImportError: cannot import name 'x509' from 'cryptography.hazmat.bindings._rust' (unknown location) 7221s 7221s /usr/lib/python3/dist-packages/cryptography/x509/certificate_transparency.py:11: ImportError 7221s 7221s During handling of the above exception, another exception occurred: 7221s 7221s def test_extra_conn_args_in_temporary_credentials(): 7221s > xfail_ssl_issue5601() 7221s 7221s /usr/lib/python3/dist-packages/distributed/tests/test_security.py:466: 7221s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7221s /usr/lib/python3/dist-packages/distributed/utils_test.py:1945: in xfail_ssl_issue5601 7221s Security.temporary() 7221s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7221s 7221s cls = , kwargs = {} 7221s 7221s @classmethod 7221s def temporary(cls, **kwargs): 7221s """Create a new temporary Security object. 7221s 7221s This creates a new self-signed key/cert pair suitable for securing 7221s communication for all roles in a Dask cluster. These keys/certs exist 7221s only in memory, and are stored in this object. 7221s 7221s This method requires the library ``cryptography`` be installed. 7221s """ 7221s try: 7221s from cryptography import x509 7221s from cryptography.hazmat.backends import default_backend 7221s from cryptography.hazmat.primitives import hashes, serialization 7221s from cryptography.hazmat.primitives.asymmetric import rsa 7221s from cryptography.x509.oid import NameOID 7221s except ImportError: 7221s > raise ImportError( 7221s "Using `Security.temporary` requires `cryptography`, please " 7221s "install it using either pip or conda" 7221s ) 7221s E ImportError: Using `Security.temporary` requires `cryptography`, please install it using either pip or conda 7221s 7221s /usr/lib/python3/dist-packages/distributed/security.py:171: ImportError 7221s __________________________________ test_basic __________________________________ 7221s 7221s fut = , timeout = 0 7221s 7221s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 7221s async with asyncio.timeout(timeout): 7221s > return await fut 7221s 7221s /usr/lib/python3/dist-packages/distributed/utils.py:1960: 7221s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7221s /usr/lib/python3/dist-packages/distributed/worker.py:1480: in start_unsafe 7221s await self._register_with_scheduler() 7221s /usr/lib/python3/dist-packages/distributed/worker.py:1179: in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s /usr/lib/python3/dist-packages/distributed/comm/core.py:342: in connect 7221s comm = await wait_for( 7221s /usr/lib/python3/dist-packages/distributed/utils.py:1960: in wait_for 7221s return await fut 7221s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:546: in connect 7221s stream = await self.client.connect( 7221s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7221s 7221s self = , host = '127.0.0.1' 7221s port = 46017, af = 7221s ssl_options = 7221s max_buffer_size = 8364507136.0, source_ip = None, source_port = None 7221s timeout = None 7221s 7221s async def connect( 7221s self, 7221s host: str, 7221s port: int, 7221s af: socket.AddressFamily = socket.AF_UNSPEC, 7221s ssl_options: Optional[Union[Dict[str, Any], ssl.SSLContext]] = None, 7221s max_buffer_size: Optional[int] = None, 7221s source_ip: Optional[str] = None, 7221s source_port: Optional[int] = None, 7221s timeout: Optional[Union[float, datetime.timedelta]] = None, 7221s ) -> IOStream: 7221s """Connect to the given host and port. 7221s 7221s Asynchronously returns an `.IOStream` (or `.SSLIOStream` if 7221s ``ssl_options`` is not None). 7221s 7221s Using the ``source_ip`` kwarg, one can specify the source 7221s IP address to use when establishing the connection. 7221s In case the user needs to resolve and 7221s use a specific interface, it has to be handled outside 7221s of Tornado as this depends very much on the platform. 7221s 7221s Raises `TimeoutError` if the input future does not complete before 7221s ``timeout``, which may be specified in any form allowed by 7221s `.IOLoop.add_timeout` (i.e. a `datetime.timedelta` or an absolute time 7221s relative to `.IOLoop.time`) 7221s 7221s Similarly, when the user requires a certain source port, it can 7221s be specified using the ``source_port`` arg. 7221s 7221s .. versionchanged:: 4.5 7221s Added the ``source_ip`` and ``source_port`` arguments. 7221s 7221s .. versionchanged:: 5.0 7221s Added the ``timeout`` argument. 7221s """ 7221s if timeout is not None: 7221s if isinstance(timeout, numbers.Real): 7221s timeout = IOLoop.current().time() + timeout 7221s elif isinstance(timeout, datetime.timedelta): 7221s timeout = IOLoop.current().time() + timeout.total_seconds() 7221s else: 7221s raise TypeError("Unsupported timeout %r" % timeout) 7221s if timeout is not None: 7221s addrinfo = await gen.with_timeout( 7221s timeout, self.resolver.resolve(host, port, af) 7221s ) 7221s else: 7221s addrinfo = await self.resolver.resolve(host, port, af) 7221s connector = _Connector( 7221s addrinfo, 7221s functools.partial( 7221s self._create_stream, 7221s max_buffer_size, 7221s source_ip=source_ip, 7221s source_port=source_port, 7221s ), 7221s ) 7221s > af, addr, stream = await connector.start(connect_timeout=timeout) 7221s E asyncio.exceptions.CancelledError 7221s 7221s /usr/lib/python3/dist-packages/tornado/tcpclient.py:279: CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s self = 7221s 7221s @final 7221s async def start(self): 7221s async with self._startup_lock: 7221s if self.status == Status.failed: 7221s assert self.__startup_exc is not None 7221s raise self.__startup_exc 7221s elif self.status != Status.init: 7221s return self 7221s timeout = getattr(self, "death_timeout", None) 7221s 7221s async def _close_on_failure(exc: Exception) -> None: 7221s await self.close(reason=f"failure-to-start-{str(type(exc))}") 7221s self.status = Status.failed 7221s self.__startup_exc = exc 7221s 7221s try: 7221s > await wait_for(self.start_unsafe(), timeout=timeout) 7221s 7221s /usr/lib/python3/dist-packages/distributed/core.py:664: 7221s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7221s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 7221s async with asyncio.timeout(timeout): 7221s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7221s 7221s self = 7221s exc_type = 7221s exc_val = CancelledError(), exc_tb = 7221s 7221s async def __aexit__( 7221s self, 7221s exc_type: Optional[Type[BaseException]], 7221s exc_val: Optional[BaseException], 7221s exc_tb: Optional[TracebackType], 7221s ) -> Optional[bool]: 7221s assert self._state in (_State.ENTERED, _State.EXPIRING) 7221s 7221s if self._timeout_handler is not None: 7221s self._timeout_handler.cancel() 7221s self._timeout_handler = None 7221s 7221s if self._state is _State.EXPIRING: 7221s self._state = _State.EXPIRED 7221s 7221s if self._task.uncancel() <= self._cancelling and exc_type is not None: 7221s # Since there are no new cancel requests, we're 7221s # handling this. 7221s if issubclass(exc_type, exceptions.CancelledError): 7221s > raise TimeoutError from exc_val 7221s E TimeoutError 7221s 7221s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s @contextlib.asynccontextmanager 7221s async def _cluster_factory(): 7221s workers = [] 7221s s = None 7221s try: 7221s for _ in range(60): 7221s try: 7221s > s, ws = await start_cluster( 7221s nthreads, 7221s scheduler, 7221s security=security, 7221s Worker=Worker, 7221s scheduler_kwargs=scheduler_kwargs, 7221s worker_kwargs=merge( 7221s {"death_timeout": min(15, int(deadline.remaining))}, 7221s worker_kwargs, 7221s ), 7221s ) 7221s 7221s /usr/lib/python3/dist-packages/distributed/utils_test.py:966: 7221s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7221s /usr/lib/python3/dist-packages/distributed/utils_test.py:789: in start_cluster 7221s await asyncio.gather(*workers) 7221s /usr/lib/python3.13/asyncio/tasks.py:737: in _wrap_awaitable 7221s return await awaitable 7221s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7221s 7221s self = 7221s 7221s @final 7221s async def start(self): 7221s async with self._startup_lock: 7221s if self.status == Status.failed: 7221s assert self.__startup_exc is not None 7221s raise self.__startup_exc 7221s elif self.status != Status.init: 7221s return self 7221s timeout = getattr(self, "death_timeout", None) 7221s 7221s async def _close_on_failure(exc: Exception) -> None: 7221s await self.close(reason=f"failure-to-start-{str(type(exc))}") 7221s self.status = Status.failed 7221s self.__startup_exc = exc 7221s 7221s try: 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s except asyncio.TimeoutError as exc: 7221s await _close_on_failure(exc) 7221s > raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s E TimeoutError: Worker start timed out after 0s. 7221s 7221s /usr/lib/python3/dist-packages/distributed/core.py:667: TimeoutError 7221s 7221s During handling of the above exception, another exception occurred: 7221s 7221s fut = ._..test_func..async_fn at 0xe9b48938> 7221s timeout = 60 7221s 7221s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 7221s async with asyncio.timeout(timeout): 7221s > return await fut 7221s 7221s /usr/lib/python3/dist-packages/distributed/utils.py:1960: 7221s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7221s /usr/lib/python3/dist-packages/distributed/utils_test.py:999: in async_fn 7221s _cluster_factory() as (s, workers), 7221s /usr/lib/python3.13/contextlib.py:214: in __aenter__ 7221s return await anext(self.gen) 7221s /usr/lib/python3/dist-packages/distributed/utils_test.py:983: in _cluster_factory 7221s await asyncio.sleep(1) 7221s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7221s 7221s delay = 1, result = None 7221s 7221s async def sleep(delay, result=None): 7221s """Coroutine that completes after a given time (in seconds).""" 7221s if delay <= 0: 7221s await __sleep0() 7221s return result 7221s 7221s if math.isnan(delay): 7221s raise ValueError("Invalid delay: NaN (not a number)") 7221s 7221s loop = events.get_running_loop() 7221s future = loop.create_future() 7221s h = loop.call_later(delay, 7221s futures._set_result_unless_cancelled, 7221s future, result) 7221s try: 7221s > return await future 7221s E asyncio.exceptions.CancelledError 7221s 7221s /usr/lib/python3.13/asyncio/tasks.py:718: CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s args = (), kwds = {} 7221s 7221s @wraps(func) 7221s def inner(*args, **kwds): 7221s with self._recreate_cm(): 7221s > return func(*args, **kwds) 7221s 7221s /usr/lib/python3.13/contextlib.py:85: 7221s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7221s /usr/lib/python3.13/contextlib.py:85: in inner 7221s return func(*args, **kwds) 7221s /usr/lib/python3/dist-packages/distributed/utils_test.py:1102: in test_func 7221s return _run_and_close_tornado(async_fn_outer) 7221s /usr/lib/python3/dist-packages/distributed/utils_test.py:378: in _run_and_close_tornado 7221s return asyncio_run(inner_fn(), loop_factory=get_loop_factory()) 7221s /usr/lib/python3.13/asyncio/runners.py:194: in run 7221s return runner.run(main) 7221s /usr/lib/python3.13/asyncio/runners.py:118: in run 7221s return self._loop.run_until_complete(task) 7221s /usr/lib/python3.13/asyncio/base_events.py:720: in run_until_complete 7221s return future.result() 7221s /usr/lib/python3/dist-packages/distributed/utils_test.py:375: in inner_fn 7221s return await async_fn(*args, **kwargs) 7221s /usr/lib/python3/dist-packages/distributed/utils_test.py:1099: in async_fn_outer 7221s return await utils_wait_for(async_fn(), timeout=timeout * 2) 7221s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 7221s async with asyncio.timeout(timeout): 7221s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7221s 7221s self = 7221s exc_type = 7221s exc_val = CancelledError(), exc_tb = 7221s 7221s async def __aexit__( 7221s self, 7221s exc_type: Optional[Type[BaseException]], 7221s exc_val: Optional[BaseException], 7221s exc_tb: Optional[TracebackType], 7221s ) -> Optional[bool]: 7221s assert self._state in (_State.ENTERED, _State.EXPIRING) 7221s 7221s if self._timeout_handler is not None: 7221s self._timeout_handler.cancel() 7221s self._timeout_handler = None 7221s 7221s if self._state is _State.EXPIRING: 7221s self._state = _State.EXPIRED 7221s 7221s if self._task.uncancel() <= self._cancelling and exc_type is not None: 7221s # Since there are no new cancel requests, we're 7221s # handling this. 7221s if issubclass(exc_type, exceptions.CancelledError): 7221s > raise TimeoutError from exc_val 7221s E TimeoutError 7221s 7221s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 7221s ----------------------------- Captured stderr call ----------------------------- 7221s 2024-11-23 22:18:12,224 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:18:12,236 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:12,236 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38213/status 7221s 2024-11-23 22:18:12,237 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:18:12,259 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44195 7221s 2024-11-23 22:18:12,259 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44195 7221s 2024-11-23 22:18:12,259 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:18:12,259 - distributed.worker - INFO - dashboard at: 127.0.0.1:42401 7221s 2024-11-23 22:18:12,259 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:12,259 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:18:12,259 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:18:12,259 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:18:12,259 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-crlp3t6_ 7221s 2024-11-23 22:18:12,259 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:18:12,263 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39337 7221s 2024-11-23 22:18:12,263 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39337 7221s 2024-11-23 22:18:12,263 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:18:12,263 - distributed.worker - INFO - dashboard at: 127.0.0.1:44781 7221s 2024-11-23 22:18:12,263 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:12,263 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:18:12,263 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:18:12,263 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:18:12,263 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-jrm7ics3 7221s 2024-11-23 22:18:12,264 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:18:12,279 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:12,279 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:12,280 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:52286': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:12,280 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:52292': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:12,395 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:12,396 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:12,396 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:52306': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:12,397 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:52314': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:12,513 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:12,513 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:12,514 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:52330': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:12,899 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:52338': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:12,919 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:12,919 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:12,920 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:52348': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:12,920 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:52350': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:13,035 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:13,035 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:13,036 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:52366': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:13,036 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:52372': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:13,152 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:13,152 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:13,153 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:52378': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:13,153 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:52394': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:13,268 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:13,269 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:13,269 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:52408': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:13,269 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:52424': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:13,385 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:13,385 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:13,386 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:52436': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:13,386 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:52440': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:13,502 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:13,502 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:13,503 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:52446': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:13,503 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:52448': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:13,618 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:13,619 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:13,619 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:52450': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:13,619 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:52462': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:13,735 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:13,735 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:13,736 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:52476': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:13,736 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:52482': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:13,852 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:13,852 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:13,853 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:52496': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:13,853 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:52512': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:13,968 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:13,968 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:13,969 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:52520': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:13,969 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:52528': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:14,084 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:14,084 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:14,085 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:52544': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:14,085 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:52556': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:14,202 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:14,203 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:14,203 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:52568': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:14,204 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:52582': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:14,319 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:14,319 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:14,320 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:52592': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:14,320 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:52602': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:14,436 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:14,437 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:14,437 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:52610': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:14,438 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:52618': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:14,553 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:14,553 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:14,554 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:52620': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:14,554 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:52624': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:14,669 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:14,670 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:14,670 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:52634': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:14,670 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:52636': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:14,787 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:14,787 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:14,788 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:52648': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:14,788 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:52650': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:14,903 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:14,904 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:14,904 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:52654': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:14,905 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:52658': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:15,020 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:15,020 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:15,021 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:52668': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:15,021 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:52682': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:15,137 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:15,137 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:15,138 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:52686': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:15,138 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:52700': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:15,258 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:15,258 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:15,259 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:52704': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:15,259 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:52706': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:15,374 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:15,375 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:15,375 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:52708': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:15,376 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:52716': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:15,491 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:15,491 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:15,492 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:52720': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:15,492 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:52730': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:15,608 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:15,608 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:15,609 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:52736': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:15,609 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:52748': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:15,725 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:15,726 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:15,727 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:52756': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:15,727 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:52762': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:15,844 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:15,844 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:15,845 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:52774': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:15,845 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:52778': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:15,960 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:15,961 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:15,961 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:52790': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:15,962 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:52792': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:16,077 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:16,077 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:16,078 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:52798': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:16,078 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:52806': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:16,194 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:16,194 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:16,195 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:52816': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:16,195 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:52820': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:16,312 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:16,313 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:16,313 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:52828': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:16,314 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:52836': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:16,429 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:16,429 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:16,430 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:52850': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:16,430 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:52858': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:16,546 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:16,546 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:16,547 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:52860': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:16,547 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:52874': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:16,664 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:16,664 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:16,665 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:52884': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:16,665 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:52886': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:16,780 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:16,780 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:16,781 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:52902': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:16,781 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:52914': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:16,895 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:16,896 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:16,896 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:52928': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:16,896 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:52942': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:17,012 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:17,013 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:17,013 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:52946': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:17,014 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:52948': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:17,128 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:17,129 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:17,129 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:52950': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:17,129 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:52962': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:17,245 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:17,245 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:17,250 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:52964': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:17,251 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:52968': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:17,360 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:17,361 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:17,361 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:52976': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:17,362 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:52980': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:17,478 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:17,479 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:17,479 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:52984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:17,480 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:53000': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:17,595 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:17,595 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:17,596 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:53014': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:17,596 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:53016': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:17,711 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:17,711 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:17,712 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:53026': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:17,712 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:53042': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:17,827 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:17,828 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:17,828 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:53046': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:17,828 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:53048': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:17,943 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:17,944 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:17,944 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:53060': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:17,945 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:53064': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:18,059 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:18,060 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:18,060 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:53074': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:18,061 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:53090': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:18,176 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:18,177 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:18,177 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:53094': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:18,178 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:53100': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:18,293 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:18,293 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:18,294 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:53114': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:18,294 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:53128': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:18,409 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:18,409 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:18,410 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:53144': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:18,410 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:53154': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:18,526 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:18,526 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:18,527 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:53170': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:18,527 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:53172': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:18,642 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:18,642 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:18,643 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:53174': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:18,643 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:53176': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:18,756 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:18,758 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:18,758 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:53192': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:18,758 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:53198': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:18,868 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:18,873 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:53208': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:18,875 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:18,875 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:53216': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:18,978 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:18,979 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:53224': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:18,986 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:18,987 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:53234': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:19,087 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:19,088 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:53248': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:19,096 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:19,096 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:53254': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:19,199 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:19,200 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:53262': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:19,207 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:19,208 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:53268': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:19,308 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:19,309 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:53280': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:19,317 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:19,317 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:53288': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:19,419 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:19,420 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:53302': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:19,427 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:19,428 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:53306': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:19,528 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:19,529 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:53322': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:19,537 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:19,537 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:53324': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:19,637 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:19,638 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:53330': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:19,646 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:19,647 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:53344': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:19,750 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:19,752 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:53346': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:19,759 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:19,760 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:53356': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:19,860 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:19,861 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:53370': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:19,869 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:19,869 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:53384': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:19,971 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:19,972 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:53392': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:19,979 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:19,980 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:53402': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:20,080 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:20,081 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:53418': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:20,089 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:20,089 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:53426': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:20,190 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:20,190 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:53438': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:20,198 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:20,199 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:53450': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:20,299 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:20,300 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:53458': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:20,308 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:20,309 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:53468': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:20,409 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:20,409 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:53472': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:20,417 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:20,418 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:53484': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:20,519 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:20,519 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:53500': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:20,527 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:20,528 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:53508': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:20,628 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:20,629 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:53510': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:20,637 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:20,638 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:53524': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:20,740 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:20,746 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:53538': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:20,754 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:20,755 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:53548': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:20,849 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:20,850 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:53552': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:20,863 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:20,864 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:53554': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:20,959 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:20,959 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:53568': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:20,973 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:20,974 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:53582': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:21,068 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:21,069 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:53596': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:21,082 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:21,083 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:53598': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:21,179 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:21,179 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:53600': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:21,191 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:21,192 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:53616': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:21,289 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:21,290 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:53632': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:21,300 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:21,301 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:53646': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:21,399 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:21,400 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:53648': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:21,409 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:21,410 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:53658': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:21,509 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:21,510 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:53660': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:21,518 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:21,519 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:53666': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:21,620 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:21,620 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:38810': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:21,629 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:21,629 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:38812': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:21,730 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:21,731 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:38818': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:21,739 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:21,745 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:38822': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:21,840 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:21,841 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:38836': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:21,849 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:21,850 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:38840': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:21,950 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:21,950 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:38848': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:21,959 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:21,959 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:38854': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:22,060 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:22,062 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:38856': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:22,070 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:22,070 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:38858': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:22,170 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:22,171 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:38870': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:22,179 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:22,180 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:38878': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:22,280 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:22,281 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:38882': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:22,289 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:22,290 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:38894': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:22,390 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:22,391 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:38908': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:22,399 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:22,400 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:38912': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:22,501 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:22,502 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:38926': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:22,510 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:22,511 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:38938': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:22,611 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:22,612 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:38954': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:22,620 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:22,621 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:38966': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:22,721 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:22,722 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:38970': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:22,730 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:22,731 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:38972': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:22,831 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:22,832 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:38984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:22,840 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:22,841 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:38996': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:22,942 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:22,943 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:39002': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:22,951 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:22,951 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:39014': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:23,051 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:23,052 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:39026': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:23,060 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:23,061 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:39028': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:23,161 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:23,162 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:39036': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:23,170 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:23,171 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:39046': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:23,271 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:23,272 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:39052': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:23,280 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:23,280 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:39058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:23,381 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:23,382 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:39062': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:23,389 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:23,390 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:39078': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:23,491 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:23,493 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:39088': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:23,500 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:23,501 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:39104': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:23,601 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:23,602 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:39108': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:23,610 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:23,610 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:39120': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:23,711 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:23,711 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:39122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:23,719 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:23,722 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:39130': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:23,820 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:23,821 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:39142': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:23,829 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:23,829 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:39146': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:23,930 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:23,931 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:39160': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:23,939 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:23,940 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:39170': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:24,039 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:24,040 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:39184': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:24,048 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:24,049 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:39196': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:24,148 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:24,148 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:39208': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:24,156 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:24,157 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:39222': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:24,257 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:24,258 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:39224': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:24,266 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:24,267 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:39238': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:24,367 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:24,368 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:39252': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:24,376 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:24,377 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:39264': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:24,477 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:24,478 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:39276': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:24,486 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:24,487 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:39282': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:24,587 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:24,588 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:39288': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:24,596 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:24,596 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:39290': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:24,697 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:24,698 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:39296': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:24,706 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:24,706 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:39304': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:24,806 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:24,807 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:39316': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:24,815 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:24,816 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:39328': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:24,916 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:24,917 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:39340': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:24,925 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:24,926 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:39346': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:25,025 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:25,026 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:39358': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:25,034 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:25,035 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:39370': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:25,135 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:25,136 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:39386': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:25,144 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:25,145 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:39392': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:25,255 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:25,256 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:39406': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:25,262 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:25,263 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:39418': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:25,365 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:25,367 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:39428': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:25,374 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:25,375 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:39432': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:25,475 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:25,476 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:39442': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:25,484 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:25,485 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:39446': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:25,584 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:25,585 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:39452': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:25,593 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:25,594 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:39464': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:25,695 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:25,695 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:39478': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:25,703 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:25,704 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:39492': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:25,804 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:25,805 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:39500': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:25,813 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:25,814 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:39506': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:25,914 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:25,915 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:39508': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:25,922 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:25,923 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:39524': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:26,024 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:26,024 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:39526': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:26,033 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:26,033 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:39542': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:26,134 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:26,136 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:39544': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:26,144 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:26,144 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:39558': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:26,249 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:26,250 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:39568': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:26,258 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:26,258 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:39576': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:26,358 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:26,358 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:39582': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:26,366 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:26,367 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:39596': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:26,466 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:26,467 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:39612': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:26,475 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:26,475 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:39620': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:26,576 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:26,576 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:39626': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:26,584 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:26,584 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:39632': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:26,685 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:26,685 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:39634': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:26,693 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:26,694 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:39646': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:26,793 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:26,794 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:39656': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:26,802 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:26,803 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:39664': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:26,903 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:26,903 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:39672': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:26,911 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:26,912 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:39684': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:27,013 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:27,014 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:39686': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:27,021 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:27,022 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:39694': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:27,122 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:27,123 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:39710': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:27,131 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:27,132 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:39712': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:27,232 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:27,233 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:39718': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:27,241 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 7221s 2024-11-23 22:18:27,246 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:39730': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:27,257 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44195. Reason: failure-to-start- 7221s 2024-11-23 22:18:27,257 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:18:27,260 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 15s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 7221s stream = await stream.start_tls( 7221s ^^^^^^^^^^^^^^^^^^^^^^^ 7221s False, ssl_options=ssl_options, server_hostname=host 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 7221s self.socket.do_handshake() 7221s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 7221s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 7221s self._sslobj.do_handshake() 7221s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 7221s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 7221s raise FatalCommClosedError( 7221s ...<2 lines>... 7221s ) from err 7221s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 7221s 7221s During handling of the above exception, another exception occurred: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1218, in _register_with_scheduler 7221s await asyncio.sleep(0.1) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 718, in sleep 7221s return await future 7221s ^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 15s. 7221s 2024-11-23 22:18:27,265 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39337. Reason: failure-to-start- 7221s 2024-11-23 22:18:27,265 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:18:28,269 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:18:28,279 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:28,280 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33491/status 7221s 2024-11-23 22:18:28,280 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:18:28,300 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44675 7221s 2024-11-23 22:18:28,300 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44675 7221s 2024-11-23 22:18:28,300 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:18:28,301 - distributed.worker - INFO - dashboard at: 127.0.0.1:39949 7221s 2024-11-23 22:18:28,301 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:28,301 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:18:28,301 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:18:28,301 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:18:28,301 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-dakug8he 7221s 2024-11-23 22:18:28,301 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:18:28,306 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46479 7221s 2024-11-23 22:18:28,306 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46479 7221s 2024-11-23 22:18:28,306 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:18:28,306 - distributed.worker - INFO - dashboard at: 127.0.0.1:37723 7221s 2024-11-23 22:18:28,306 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:28,306 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:18:28,306 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:18:28,306 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:18:28,306 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-no_urkd3 7221s 2024-11-23 22:18:28,307 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:18:28,322 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:28,322 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:28,323 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:41648': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:28,323 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:41654': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:28,437 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:28,438 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:28,438 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:41662': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:28,439 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:41676': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:28,554 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:28,554 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:28,555 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:41680': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:28,555 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:41688': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:28,670 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:28,670 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:28,671 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:41690': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:28,671 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:41694': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:28,786 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:28,786 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:28,791 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:41700': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:28,792 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:41708': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:28,902 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:28,902 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:28,903 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:41716': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:28,903 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:41718': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:29,017 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:29,018 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:29,018 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:41734': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:29,018 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:41748': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:29,132 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:29,133 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:29,133 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:41760': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:29,133 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:41770': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:29,254 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:29,254 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:29,255 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:41782': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:29,255 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:41786': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:29,368 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:29,370 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:29,371 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:41798': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:29,371 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:41814': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:29,480 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:29,485 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:41822': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:29,487 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:29,487 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:41832': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:29,589 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:29,590 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:41838': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:29,597 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:29,598 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:41840': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:29,699 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:29,700 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:41842': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:29,709 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:29,710 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:41856': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:29,808 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:29,809 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:41858': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:29,818 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:29,818 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:41872': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:29,918 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:29,918 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:41876': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:29,926 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:29,927 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:41890': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:30,027 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:30,028 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:41902': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:30,036 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:30,037 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:41918': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:30,137 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:30,138 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:41934': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:30,146 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:30,146 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:41938': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:30,250 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:30,252 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:41946': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:30,259 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:30,260 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:41950': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:30,360 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:30,360 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:41954': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:30,368 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:30,369 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:41968': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:30,469 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:30,469 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:41974': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:30,477 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:30,478 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:41978': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:30,578 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:30,579 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:41982': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:30,587 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:30,588 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:41984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:30,688 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:30,689 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:41990': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:30,697 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:30,697 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:42000': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:30,797 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:30,797 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:42008': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:30,805 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:30,806 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:42012': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:30,906 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:30,907 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:42014': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:30,914 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:30,915 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:42020': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:31,015 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:31,016 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:42036': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:31,024 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:31,024 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:42050': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:31,124 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:31,125 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:42062': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:31,133 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:31,134 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:42064': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:31,234 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:31,235 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:42080': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:31,253 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:31,253 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:42090': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:31,344 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:31,345 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:42104': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:31,362 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:31,362 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:42114': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:31,454 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:31,455 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:42120': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:31,471 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:31,471 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:42130': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:31,565 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:31,566 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:45238': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:31,580 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:31,581 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:45246': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:31,674 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:31,675 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:45256': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:31,689 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:31,690 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:45262': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:31,784 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:31,789 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:45264': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:31,798 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:31,799 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:45274': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:31,894 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:31,895 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:45280': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:31,907 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:31,908 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:45294': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:32,003 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:32,004 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:45310': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:32,016 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:32,017 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:45314': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:32,113 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:32,114 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:45318': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:32,125 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:32,126 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:45322': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:32,222 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:32,223 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:45328': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:32,233 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:32,234 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:45342': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:32,332 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:32,332 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:45352': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:32,343 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:32,343 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:45366': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:32,441 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:32,442 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:45382': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:32,451 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:32,452 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:45396': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:32,551 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:32,551 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:45402': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:32,560 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:32,561 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:45404': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:32,660 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:32,661 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:45420': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:32,669 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:32,669 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:45424': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:32,770 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:32,771 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:45436': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:32,781 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:32,782 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:45450': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:32,880 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:32,881 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:45460': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:32,890 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:32,891 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:45470': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:32,989 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:32,990 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:45472': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:32,998 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:32,999 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:45478': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:33,100 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:33,101 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:45486': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:33,108 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:33,109 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:45488': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:33,210 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:33,210 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:45492': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:33,218 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:33,219 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:45496': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:33,319 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:33,320 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:45500': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:33,327 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:33,328 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:45514': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:33,429 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:33,429 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:45522': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:33,437 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:33,438 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:45528': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:33,538 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:33,539 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:45534': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:33,547 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:33,548 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:45536': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:33,648 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:33,648 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:45538': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:33,656 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:33,657 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:45552': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:33,756 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:33,757 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:45566': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:33,765 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:33,766 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:45582': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:33,866 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:33,867 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:45598': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:33,874 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:33,875 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:45606': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:33,975 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:33,976 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:45610': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:33,984 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:33,984 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:45622': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:34,085 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:34,086 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:45630': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:34,093 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:34,094 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:45642': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:34,194 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:34,194 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:45654': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:34,202 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:34,203 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:45668': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:34,303 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:34,303 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:45670': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:34,311 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:34,312 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:45672': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:34,412 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:34,412 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:45682': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:34,420 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:34,421 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:45694': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:34,521 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:34,522 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:45700': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:34,529 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:34,530 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:45708': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:34,630 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:34,631 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:45714': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:34,639 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:34,639 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:45720': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:34,739 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:34,745 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:45728': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:34,753 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:34,754 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:45736': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:34,848 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:34,849 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:45750': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:34,862 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:34,862 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:45766': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:34,958 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:34,959 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:45772': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:34,971 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:34,971 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:45776': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:35,067 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:35,068 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:45790': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:35,080 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:35,081 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:45800': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:35,176 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:35,177 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:45812': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:35,189 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:35,189 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:45816': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:35,286 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:35,291 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:45826': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:35,299 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:35,300 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:45834': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:35,396 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:35,397 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:45836': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:35,408 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:35,409 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:45844': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:35,506 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:35,507 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:45850': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:35,516 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:35,517 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:45856': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:35,617 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:35,617 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:45864': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:35,625 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:35,626 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:45876': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:35,727 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:35,727 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:45886': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:35,735 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:35,736 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:45896': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:35,836 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:35,836 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:45910': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:35,844 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:35,845 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:45918': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:35,945 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:35,946 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:45922': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:35,954 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:35,954 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:45930': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:36,056 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:36,057 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:45940': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:36,064 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:36,065 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:45952': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:36,168 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:36,169 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:45968': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:36,177 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:36,177 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:45974': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:36,277 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:36,278 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:45988': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:36,291 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:36,292 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:45998': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:36,387 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:36,388 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:46006': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:36,400 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:36,401 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:46008': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:36,496 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:36,497 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:46020': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:36,509 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:36,510 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:46030': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:36,606 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:36,607 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:46034': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:36,618 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:36,618 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:46038': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:36,716 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:36,717 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:46044': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:36,727 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:36,727 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:46058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:36,825 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:36,826 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:46070': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:36,836 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:36,836 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:46084': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:36,934 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:36,934 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:46096': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:36,945 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:36,945 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:46098': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:37,043 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:37,043 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:46100': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:37,054 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:37,054 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:46112': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:37,153 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:37,153 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:46118': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:37,162 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:37,163 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:46132': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:37,262 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:37,262 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:46136': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:37,270 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:37,271 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:46146': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:37,372 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:37,372 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:46160': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:37,381 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:37,381 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:46176': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:37,481 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:37,482 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:46192': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:37,491 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:37,491 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:46208': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:37,590 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:37,591 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:46222': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:37,599 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:37,599 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:46232': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:37,699 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:37,700 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:46236': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:37,707 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:37,708 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:46248': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:37,808 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:37,811 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:46256': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:37,818 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:37,819 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:46272': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:37,918 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:37,918 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:46276': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:37,927 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:37,927 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:46286': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:38,027 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:38,028 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:46290': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:38,035 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:38,036 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:46300': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:38,136 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:38,137 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:46304': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:38,145 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:38,146 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:46318': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:38,251 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:38,252 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:46328': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:38,260 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:38,260 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:46342': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:38,361 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:38,362 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:46354': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:38,370 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:38,370 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:46356': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:38,470 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:38,471 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:46364': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:38,479 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:38,480 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:46370': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:38,580 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:38,581 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:46382': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:38,589 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:38,590 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:46398': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:38,689 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:38,690 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:46412': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:38,698 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:38,699 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:46420': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:38,799 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:38,799 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:46432': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:38,807 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:38,808 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:46434': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:38,910 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:38,911 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:46446': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:38,919 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:38,919 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:46450': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:39,019 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:39,020 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:46462': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:39,028 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:39,029 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:46470': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:39,129 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:39,130 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:46476': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:39,138 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:39,139 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:46492': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:39,239 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:39,244 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:46508': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:39,253 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:39,253 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:46520': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:39,347 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:39,348 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:46528': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:39,361 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:39,362 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:46532': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:39,457 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:39,459 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:46548': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:39,473 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:39,473 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:46560': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:39,568 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:39,568 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:46574': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:39,582 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:39,583 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:46588': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:39,677 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:39,678 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:46596': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:39,692 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:39,692 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:46602': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:39,792 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:39,793 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:46604': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:39,801 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:39,802 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:46608': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:39,902 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:39,903 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:46618': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:39,911 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:39,911 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:46622': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:40,012 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:40,013 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:46630': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:40,021 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:40,022 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:46636': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:40,121 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:40,122 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:46650': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:40,130 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:40,131 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:46666': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:40,230 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:40,231 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:46680': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:40,240 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:40,245 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:46688': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:40,340 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:40,341 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:46700': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:40,349 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:40,350 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:46706': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:40,449 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:40,450 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:46720': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:40,458 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:40,459 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:46732': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:40,559 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:40,560 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:46744': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:40,568 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:40,568 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:46760': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:40,669 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:40,670 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:46776': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:40,678 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:40,678 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:46790': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:40,778 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:40,779 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:46792': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:40,792 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:40,792 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:46796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:40,888 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:40,889 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:46800': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:40,900 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:40,901 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:46814': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:40,998 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:40,998 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:46816': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:41,009 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:41,009 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:46822': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:41,107 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:41,107 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:46836': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:41,117 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:41,118 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:46852': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:41,218 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:41,219 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:46856': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:41,227 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36663 7221s 2024-11-23 22:18:41,227 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36663': TLS handshake failed with remote 'tls://127.0.0.1:46870': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:18:41,299 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44675. Reason: failure-to-start- 7221s 2024-11-23 22:18:41,299 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:18:41,302 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 13s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 7221s stream = await stream.start_tls( 7221s ^^^^^^^^^^^^^^^^^^^^^^^ 7221s False, ssl_options=ssl_options, server_hostname=host 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 7221s self.socket.do_handshake() 7221s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 7221s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 7221s self._sslobj.do_handshake() 7221s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 7221s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 7221s raise FatalCommClosedError( 7221s ...<2 lines>... 7221s ) from err 7221s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 7221s 7221s During handling of the above exception, another exception occurred: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1218, in _register_with_scheduler 7221s await asyncio.sleep(0.1) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 718, in sleep 7221s return await future 7221s ^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 13s. 7221s 2024-11-23 22:18:41,306 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46479. Reason: failure-to-start- 7221s 2024-11-23 22:18:41,306 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:18:42,310 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:18:42,321 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43951 7221s 2024-11-23 22:18:42,321 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36781/status 7221s 2024-11-23 22:18:42,322 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:18:42,343 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37979 7221s 2024-11-23 22:18:42,344 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37979 7221s 2024-11-23 22:18:42,344 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:18:42,344 - distributed.worker - INFO - dashboard at: 127.0.0.1:37159 7221s 2024-11-23 22:18:42,344 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43951 7221s 2024-11-23 22:18:42,344 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:18:42,344 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:18:42,344 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:18:42,344 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-iowv5rgq 7221s 2024-11-23 22:18:42,344 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:18:42,347 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33115 7221s 2024-11-23 22:18:42,348 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33115 7221s 2024-11-23 22:18:42,348 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:18:42,348 - distributed.worker - INFO - dashboard at: 127.0.0.1:44021 7221s 2024-11-23 22:18:42,348 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43951 7221s 2024-11-23 22:18:42,348 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:18:42,348 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:18:42,348 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:18:42,348 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-dk5aahtj 7221s 2024-11-23 22:18:42,348 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:18:42,350 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37979. Reason: failure-to-start- 7221s 2024-11-23 22:18:42,350 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:18:42,351 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33115. Reason: failure-to-start- 7221s 2024-11-23 22:18:42,351 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:18:42,353 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43951': TLS handshake failed with remote 'tls://127.0.0.1:42848': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:18:42,353 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43951': TLS handshake failed with remote 'tls://127.0.0.1:42854': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:18:42,356 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s 2024-11-23 22:18:43,363 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:18:43,376 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34185 7221s 2024-11-23 22:18:43,376 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39299/status 7221s 2024-11-23 22:18:43,377 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:18:43,399 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43151 7221s 2024-11-23 22:18:43,399 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43151 7221s 2024-11-23 22:18:43,399 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:18:43,399 - distributed.worker - INFO - dashboard at: 127.0.0.1:42081 7221s 2024-11-23 22:18:43,399 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34185 7221s 2024-11-23 22:18:43,399 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:18:43,399 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:18:43,400 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:18:43,400 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-5j781sxc 7221s 2024-11-23 22:18:43,400 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:18:43,403 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46205 7221s 2024-11-23 22:18:43,403 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46205 7221s 2024-11-23 22:18:43,403 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:18:43,404 - distributed.worker - INFO - dashboard at: 127.0.0.1:43971 7221s 2024-11-23 22:18:43,404 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34185 7221s 2024-11-23 22:18:43,404 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:18:43,404 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:18:43,404 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:18:43,404 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-0s3ljthh 7221s 2024-11-23 22:18:43,404 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:18:43,406 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43151. Reason: failure-to-start- 7221s 2024-11-23 22:18:43,406 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:18:43,407 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46205. Reason: failure-to-start- 7221s 2024-11-23 22:18:43,407 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:18:43,409 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34185': TLS handshake failed with remote 'tls://127.0.0.1:56208': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:18:43,409 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34185': TLS handshake failed with remote 'tls://127.0.0.1:56220': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:18:43,411 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s 2024-11-23 22:18:44,419 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:18:44,429 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34371 7221s 2024-11-23 22:18:44,430 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39487/status 7221s 2024-11-23 22:18:44,430 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:18:44,454 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40521 7221s 2024-11-23 22:18:44,454 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40521 7221s 2024-11-23 22:18:44,454 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:18:44,454 - distributed.worker - INFO - dashboard at: 127.0.0.1:33385 7221s 2024-11-23 22:18:44,454 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34371 7221s 2024-11-23 22:18:44,454 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:18:44,454 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:18:44,455 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:18:44,455 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-nvjqa1c3 7221s 2024-11-23 22:18:44,455 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:18:44,458 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39789 7221s 2024-11-23 22:18:44,458 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39789 7221s 2024-11-23 22:18:44,458 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:18:44,458 - distributed.worker - INFO - dashboard at: 127.0.0.1:35963 7221s 2024-11-23 22:18:44,458 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34371 7221s 2024-11-23 22:18:44,458 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:18:44,458 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:18:44,459 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:18:44,459 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-4t36wekk 7221s 2024-11-23 22:18:44,459 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:18:44,460 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40521. Reason: failure-to-start- 7221s 2024-11-23 22:18:44,461 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:18:44,461 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39789. Reason: failure-to-start- 7221s 2024-11-23 22:18:44,462 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:18:44,464 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34371': TLS handshake failed with remote 'tls://127.0.0.1:55476': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:18:44,464 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34371': TLS handshake failed with remote 'tls://127.0.0.1:55492': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:18:44,466 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s 2024-11-23 22:18:45,475 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:18:45,485 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36459 7221s 2024-11-23 22:18:45,486 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39033/status 7221s 2024-11-23 22:18:45,486 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:18:45,507 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33467 7221s 2024-11-23 22:18:45,508 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33467 7221s 2024-11-23 22:18:45,508 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:18:45,508 - distributed.worker - INFO - dashboard at: 127.0.0.1:35673 7221s 2024-11-23 22:18:45,508 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36459 7221s 2024-11-23 22:18:45,508 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:18:45,508 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:18:45,508 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:18:45,508 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-4h25ge5l 7221s 2024-11-23 22:18:45,508 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:18:45,512 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42161 7221s 2024-11-23 22:18:45,512 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42161 7221s 2024-11-23 22:18:45,512 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:18:45,512 - distributed.worker - INFO - dashboard at: 127.0.0.1:41939 7221s 2024-11-23 22:18:45,512 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36459 7221s 2024-11-23 22:18:45,512 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:18:45,512 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:18:45,512 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:18:45,512 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-lfwnnnz7 7221s 2024-11-23 22:18:45,512 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:18:45,516 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33467. Reason: failure-to-start- 7221s 2024-11-23 22:18:45,516 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:18:45,517 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42161. Reason: failure-to-start- 7221s 2024-11-23 22:18:45,517 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:18:45,519 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36459': TLS handshake failed with remote 'tls://127.0.0.1:57472': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:18:45,519 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36459': TLS handshake failed with remote 'tls://127.0.0.1:57482': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:18:45,521 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s 2024-11-23 22:18:46,529 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:18:46,540 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33227 7221s 2024-11-23 22:18:46,540 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45303/status 7221s 2024-11-23 22:18:46,541 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:18:46,560 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45543 7221s 2024-11-23 22:18:46,560 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45543 7221s 2024-11-23 22:18:46,561 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:18:46,561 - distributed.worker - INFO - dashboard at: 127.0.0.1:44533 7221s 2024-11-23 22:18:46,561 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33227 7221s 2024-11-23 22:18:46,561 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:18:46,561 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:18:46,561 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:18:46,561 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-iqnxitio 7221s 2024-11-23 22:18:46,561 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:18:46,564 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38689 7221s 2024-11-23 22:18:46,565 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38689 7221s 2024-11-23 22:18:46,565 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:18:46,565 - distributed.worker - INFO - dashboard at: 127.0.0.1:35969 7221s 2024-11-23 22:18:46,565 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33227 7221s 2024-11-23 22:18:46,565 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:18:46,565 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:18:46,565 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:18:46,565 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-tjkiksxu 7221s 2024-11-23 22:18:46,565 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:18:46,567 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45543. Reason: failure-to-start- 7221s 2024-11-23 22:18:46,567 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:18:46,568 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38689. Reason: failure-to-start- 7221s 2024-11-23 22:18:46,568 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:18:46,570 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33227': TLS handshake failed with remote 'tls://127.0.0.1:43958': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:18:46,570 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33227': TLS handshake failed with remote 'tls://127.0.0.1:43962': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:18:46,572 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s 2024-11-23 22:18:47,580 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:18:47,592 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34995 7221s 2024-11-23 22:18:47,593 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40789/status 7221s 2024-11-23 22:18:47,593 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:18:47,613 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39901 7221s 2024-11-23 22:18:47,613 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39901 7221s 2024-11-23 22:18:47,613 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:18:47,613 - distributed.worker - INFO - dashboard at: 127.0.0.1:43109 7221s 2024-11-23 22:18:47,613 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34995 7221s 2024-11-23 22:18:47,613 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:18:47,613 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:18:47,613 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:18:47,614 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-bk_xtbt_ 7221s 2024-11-23 22:18:47,614 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:18:47,617 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35017 7221s 2024-11-23 22:18:47,617 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35017 7221s 2024-11-23 22:18:47,617 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:18:47,617 - distributed.worker - INFO - dashboard at: 127.0.0.1:39301 7221s 2024-11-23 22:18:47,617 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34995 7221s 2024-11-23 22:18:47,617 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:18:47,617 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:18:47,617 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:18:47,617 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-0848wpbi 7221s 2024-11-23 22:18:47,617 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:18:47,619 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39901. Reason: failure-to-start- 7221s 2024-11-23 22:18:47,619 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:18:47,620 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35017. Reason: failure-to-start- 7221s 2024-11-23 22:18:47,620 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:18:47,622 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34995': TLS handshake failed with remote 'tls://127.0.0.1:43528': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:18:47,622 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34995': TLS handshake failed with remote 'tls://127.0.0.1:43540': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:18:47,625 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s 2024-11-23 22:18:48,632 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:18:48,643 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43767 7221s 2024-11-23 22:18:48,643 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36981/status 7221s 2024-11-23 22:18:48,644 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:18:48,666 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34131 7221s 2024-11-23 22:18:48,666 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34131 7221s 2024-11-23 22:18:48,666 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:18:48,666 - distributed.worker - INFO - dashboard at: 127.0.0.1:41161 7221s 2024-11-23 22:18:48,666 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43767 7221s 2024-11-23 22:18:48,666 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:18:48,666 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:18:48,666 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:18:48,666 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-exetrtvt 7221s 2024-11-23 22:18:48,666 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:18:48,670 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33213 7221s 2024-11-23 22:18:48,670 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33213 7221s 2024-11-23 22:18:48,670 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:18:48,670 - distributed.worker - INFO - dashboard at: 127.0.0.1:38267 7221s 2024-11-23 22:18:48,670 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43767 7221s 2024-11-23 22:18:48,670 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:18:48,670 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:18:48,670 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:18:48,670 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-2voxhvnn 7221s 2024-11-23 22:18:48,670 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:18:48,672 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34131. Reason: failure-to-start- 7221s 2024-11-23 22:18:48,672 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:18:48,673 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33213. Reason: failure-to-start- 7221s 2024-11-23 22:18:48,673 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:18:48,675 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43767': TLS handshake failed with remote 'tls://127.0.0.1:34222': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:18:48,675 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43767': TLS handshake failed with remote 'tls://127.0.0.1:34234': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:18:48,677 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s 2024-11-23 22:18:49,685 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:18:49,695 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44371 7221s 2024-11-23 22:18:49,695 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39865/status 7221s 2024-11-23 22:18:49,696 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:18:49,717 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34087 7221s 2024-11-23 22:18:49,717 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34087 7221s 2024-11-23 22:18:49,717 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:18:49,717 - distributed.worker - INFO - dashboard at: 127.0.0.1:35889 7221s 2024-11-23 22:18:49,717 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44371 7221s 2024-11-23 22:18:49,717 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:18:49,717 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:18:49,717 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:18:49,717 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-mg_q4znr 7221s 2024-11-23 22:18:49,717 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:18:49,731 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46743 7221s 2024-11-23 22:18:49,732 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46743 7221s 2024-11-23 22:18:49,732 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:18:49,732 - distributed.worker - INFO - dashboard at: 127.0.0.1:37425 7221s 2024-11-23 22:18:49,732 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44371 7221s 2024-11-23 22:18:49,732 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:18:49,732 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:18:49,732 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:18:49,732 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-i9efk0nu 7221s 2024-11-23 22:18:49,732 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:18:49,734 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34087. Reason: failure-to-start- 7221s 2024-11-23 22:18:49,734 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:18:49,735 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46743. Reason: failure-to-start- 7221s 2024-11-23 22:18:49,735 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:18:49,737 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44371': TLS handshake failed with remote 'tls://127.0.0.1:40264': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:18:49,738 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44371': TLS handshake failed with remote 'tls://127.0.0.1:40278': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:18:49,744 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s 2024-11-23 22:18:50,751 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:18:50,761 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33297 7221s 2024-11-23 22:18:50,762 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38161/status 7221s 2024-11-23 22:18:50,762 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:18:50,783 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35951 7221s 2024-11-23 22:18:50,783 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35951 7221s 2024-11-23 22:18:50,783 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:18:50,783 - distributed.worker - INFO - dashboard at: 127.0.0.1:44651 7221s 2024-11-23 22:18:50,783 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33297 7221s 2024-11-23 22:18:50,783 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:18:50,783 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:18:50,783 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:18:50,783 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-c15qr8cz 7221s 2024-11-23 22:18:50,783 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:18:50,787 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40889 7221s 2024-11-23 22:18:50,787 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40889 7221s 2024-11-23 22:18:50,787 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:18:50,787 - distributed.worker - INFO - dashboard at: 127.0.0.1:35295 7221s 2024-11-23 22:18:50,787 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33297 7221s 2024-11-23 22:18:50,787 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:18:50,787 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:18:50,787 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:18:50,787 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-31my6cj9 7221s 2024-11-23 22:18:50,787 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:18:50,789 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35951. Reason: failure-to-start- 7221s 2024-11-23 22:18:50,789 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:18:50,790 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40889. Reason: failure-to-start- 7221s 2024-11-23 22:18:50,790 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:18:50,796 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33297': TLS handshake failed with remote 'tls://127.0.0.1:53066': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:18:50,796 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33297': TLS handshake failed with remote 'tls://127.0.0.1:53076': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:18:50,799 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s 2024-11-23 22:18:51,807 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:18:51,821 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35065 7221s 2024-11-23 22:18:51,821 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40279/status 7221s 2024-11-23 22:18:51,821 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:18:51,842 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41769 7221s 2024-11-23 22:18:51,843 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41769 7221s 2024-11-23 22:18:51,843 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:18:51,843 - distributed.worker - INFO - dashboard at: 127.0.0.1:35181 7221s 2024-11-23 22:18:51,843 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35065 7221s 2024-11-23 22:18:51,843 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:18:51,843 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:18:51,843 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:18:51,843 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-nvaxzqlg 7221s 2024-11-23 22:18:51,843 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:18:51,846 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46031 7221s 2024-11-23 22:18:51,847 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46031 7221s 2024-11-23 22:18:51,847 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:18:51,847 - distributed.worker - INFO - dashboard at: 127.0.0.1:39277 7221s 2024-11-23 22:18:51,847 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35065 7221s 2024-11-23 22:18:51,847 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:18:51,847 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:18:51,847 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:18:51,847 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-kr5csowx 7221s 2024-11-23 22:18:51,847 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:18:51,853 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41769. Reason: failure-to-start- 7221s 2024-11-23 22:18:51,853 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:18:51,854 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46031. Reason: failure-to-start- 7221s 2024-11-23 22:18:51,854 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:18:51,856 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35065': TLS handshake failed with remote 'tls://127.0.0.1:49112': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:18:51,857 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35065': TLS handshake failed with remote 'tls://127.0.0.1:49122': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:18:51,859 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s 2024-11-23 22:18:52,868 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:18:52,877 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33515 7221s 2024-11-23 22:18:52,878 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35139/status 7221s 2024-11-23 22:18:52,878 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:18:52,905 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39657 7221s 2024-11-23 22:18:52,906 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39657 7221s 2024-11-23 22:18:52,906 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:18:52,906 - distributed.worker - INFO - dashboard at: 127.0.0.1:34433 7221s 2024-11-23 22:18:52,906 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33515 7221s 2024-11-23 22:18:52,906 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:18:52,906 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:18:52,906 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:18:52,906 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-sf8p3xi1 7221s 2024-11-23 22:18:52,906 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:18:52,910 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34445 7221s 2024-11-23 22:18:52,910 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34445 7221s 2024-11-23 22:18:52,910 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:18:52,910 - distributed.worker - INFO - dashboard at: 127.0.0.1:38513 7221s 2024-11-23 22:18:52,910 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33515 7221s 2024-11-23 22:18:52,910 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:18:52,910 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:18:52,910 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:18:52,910 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-vlf9t7my 7221s 2024-11-23 22:18:52,910 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:18:52,912 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39657. Reason: failure-to-start- 7221s 2024-11-23 22:18:52,912 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:18:52,913 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34445. Reason: failure-to-start- 7221s 2024-11-23 22:18:52,914 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:18:52,915 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33515': TLS handshake failed with remote 'tls://127.0.0.1:33478': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:18:52,916 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33515': TLS handshake failed with remote 'tls://127.0.0.1:33482': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:18:52,918 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s 2024-11-23 22:18:53,926 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:18:53,936 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:32905 7221s 2024-11-23 22:18:53,936 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45911/status 7221s 2024-11-23 22:18:53,937 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:18:53,961 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41251 7221s 2024-11-23 22:18:53,961 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41251 7221s 2024-11-23 22:18:53,961 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:18:53,961 - distributed.worker - INFO - dashboard at: 127.0.0.1:38541 7221s 2024-11-23 22:18:53,961 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:32905 7221s 2024-11-23 22:18:53,961 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:18:53,961 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:18:53,961 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:18:53,961 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-fb2sv24u 7221s 2024-11-23 22:18:53,961 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:18:53,965 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35245 7221s 2024-11-23 22:18:53,965 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35245 7221s 2024-11-23 22:18:53,965 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:18:53,965 - distributed.worker - INFO - dashboard at: 127.0.0.1:37331 7221s 2024-11-23 22:18:53,965 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:32905 7221s 2024-11-23 22:18:53,965 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:18:53,965 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:18:53,965 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:18:53,967 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-i3f9ryjo 7221s 2024-11-23 22:18:53,967 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:18:53,969 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41251. Reason: failure-to-start- 7221s 2024-11-23 22:18:53,970 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:18:53,970 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35245. Reason: failure-to-start- 7221s 2024-11-23 22:18:53,971 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:18:53,973 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:32905': TLS handshake failed with remote 'tls://127.0.0.1:43118': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:18:53,973 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:32905': TLS handshake failed with remote 'tls://127.0.0.1:43122': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:18:53,975 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s 2024-11-23 22:18:54,983 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:18:54,993 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46117 7221s 2024-11-23 22:18:54,993 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38871/status 7221s 2024-11-23 22:18:54,994 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:18:55,017 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43161 7221s 2024-11-23 22:18:55,017 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43161 7221s 2024-11-23 22:18:55,018 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:18:55,018 - distributed.worker - INFO - dashboard at: 127.0.0.1:40855 7221s 2024-11-23 22:18:55,018 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46117 7221s 2024-11-23 22:18:55,018 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:18:55,018 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:18:55,018 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:18:55,018 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-9l27qr_e 7221s 2024-11-23 22:18:55,018 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:18:55,021 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37717 7221s 2024-11-23 22:18:55,021 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37717 7221s 2024-11-23 22:18:55,021 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:18:55,021 - distributed.worker - INFO - dashboard at: 127.0.0.1:35191 7221s 2024-11-23 22:18:55,021 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46117 7221s 2024-11-23 22:18:55,021 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:18:55,021 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:18:55,022 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:18:55,022 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-kgx26krq 7221s 2024-11-23 22:18:55,022 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:18:55,024 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43161. Reason: failure-to-start- 7221s 2024-11-23 22:18:55,024 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:18:55,025 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37717. Reason: failure-to-start- 7221s 2024-11-23 22:18:55,025 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:18:55,027 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46117': TLS handshake failed with remote 'tls://127.0.0.1:45654': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:18:55,027 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46117': TLS handshake failed with remote 'tls://127.0.0.1:45662': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:18:55,029 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s 2024-11-23 22:18:56,039 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:18:56,050 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34921 7221s 2024-11-23 22:18:56,051 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46075/status 7221s 2024-11-23 22:18:56,051 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:18:56,075 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46295 7221s 2024-11-23 22:18:56,076 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46295 7221s 2024-11-23 22:18:56,076 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:18:56,076 - distributed.worker - INFO - dashboard at: 127.0.0.1:44263 7221s 2024-11-23 22:18:56,076 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34921 7221s 2024-11-23 22:18:56,076 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:18:56,076 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:18:56,076 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:18:56,076 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-pnx9eptl 7221s 2024-11-23 22:18:56,076 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:18:56,079 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34673 7221s 2024-11-23 22:18:56,080 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34673 7221s 2024-11-23 22:18:56,080 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:18:56,080 - distributed.worker - INFO - dashboard at: 127.0.0.1:39779 7221s 2024-11-23 22:18:56,080 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34921 7221s 2024-11-23 22:18:56,080 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:18:56,080 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:18:56,080 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:18:56,080 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-z3_ho3r3 7221s 2024-11-23 22:18:56,080 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:18:56,082 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46295. Reason: failure-to-start- 7221s 2024-11-23 22:18:56,082 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:18:56,083 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34673. Reason: failure-to-start- 7221s 2024-11-23 22:18:56,084 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:18:56,086 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34921': TLS handshake failed with remote 'tls://127.0.0.1:55326': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:18:56,086 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34921': TLS handshake failed with remote 'tls://127.0.0.1:55338': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:18:56,088 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s 2024-11-23 22:18:57,096 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:18:57,107 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35369 7221s 2024-11-23 22:18:57,108 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34147/status 7221s 2024-11-23 22:18:57,108 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:18:57,134 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44265 7221s 2024-11-23 22:18:57,135 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44265 7221s 2024-11-23 22:18:57,135 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:18:57,135 - distributed.worker - INFO - dashboard at: 127.0.0.1:43303 7221s 2024-11-23 22:18:57,135 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35369 7221s 2024-11-23 22:18:57,135 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:18:57,135 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:18:57,135 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:18:57,135 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-_9i4d0p6 7221s 2024-11-23 22:18:57,135 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:18:57,138 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41713 7221s 2024-11-23 22:18:57,139 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41713 7221s 2024-11-23 22:18:57,139 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:18:57,139 - distributed.worker - INFO - dashboard at: 127.0.0.1:36809 7221s 2024-11-23 22:18:57,139 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35369 7221s 2024-11-23 22:18:57,139 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:18:57,139 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:18:57,139 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:18:57,139 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-5wt3j3uf 7221s 2024-11-23 22:18:57,139 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:18:57,141 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44265. Reason: failure-to-start- 7221s 2024-11-23 22:18:57,141 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:18:57,142 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41713. Reason: failure-to-start- 7221s 2024-11-23 22:18:57,143 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:18:57,145 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35369': TLS handshake failed with remote 'tls://127.0.0.1:39720': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:18:57,145 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35369': TLS handshake failed with remote 'tls://127.0.0.1:39736': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:18:57,151 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s 2024-11-23 22:18:58,158 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:18:58,169 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36971 7221s 2024-11-23 22:18:58,169 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35333/status 7221s 2024-11-23 22:18:58,170 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:18:58,193 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45787 7221s 2024-11-23 22:18:58,194 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45787 7221s 2024-11-23 22:18:58,194 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:18:58,194 - distributed.worker - INFO - dashboard at: 127.0.0.1:38133 7221s 2024-11-23 22:18:58,194 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36971 7221s 2024-11-23 22:18:58,194 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:18:58,194 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:18:58,194 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:18:58,194 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-q0dtmcze 7221s 2024-11-23 22:18:58,194 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:18:58,198 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44839 7221s 2024-11-23 22:18:58,198 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44839 7221s 2024-11-23 22:18:58,198 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:18:58,198 - distributed.worker - INFO - dashboard at: 127.0.0.1:44901 7221s 2024-11-23 22:18:58,198 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36971 7221s 2024-11-23 22:18:58,198 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:18:58,198 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:18:58,198 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:18:58,198 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-rtb1au48 7221s 2024-11-23 22:18:58,199 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:18:58,201 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45787. Reason: failure-to-start- 7221s 2024-11-23 22:18:58,201 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:18:58,202 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44839. Reason: failure-to-start- 7221s 2024-11-23 22:18:58,202 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:18:58,209 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36971': TLS handshake failed with remote 'tls://127.0.0.1:54034': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:18:58,209 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36971': TLS handshake failed with remote 'tls://127.0.0.1:54042': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:18:58,211 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s 2024-11-23 22:18:59,219 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:18:59,229 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44505 7221s 2024-11-23 22:18:59,229 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43239/status 7221s 2024-11-23 22:18:59,229 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:18:59,251 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43823 7221s 2024-11-23 22:18:59,251 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43823 7221s 2024-11-23 22:18:59,251 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:18:59,251 - distributed.worker - INFO - dashboard at: 127.0.0.1:41377 7221s 2024-11-23 22:18:59,251 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7221s 2024-11-23 22:18:59,251 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:18:59,251 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:18:59,251 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:18:59,251 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-302f1u1v 7221s 2024-11-23 22:18:59,251 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:18:59,255 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42935 7221s 2024-11-23 22:18:59,255 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42935 7221s 2024-11-23 22:18:59,255 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:18:59,255 - distributed.worker - INFO - dashboard at: 127.0.0.1:45709 7221s 2024-11-23 22:18:59,255 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7221s 2024-11-23 22:18:59,255 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:18:59,255 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:18:59,255 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:18:59,255 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-u42igmbp 7221s 2024-11-23 22:18:59,255 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:18:59,263 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43823. Reason: failure-to-start- 7221s 2024-11-23 22:18:59,263 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:18:59,264 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42935. Reason: failure-to-start- 7221s 2024-11-23 22:18:59,264 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:18:59,266 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:48658': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:18:59,266 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:48660': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:18:59,272 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s 2024-11-23 22:19:00,280 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:19:00,290 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35287 7221s 2024-11-23 22:19:00,291 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45457/status 7221s 2024-11-23 22:19:00,291 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:19:00,316 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:32871 7221s 2024-11-23 22:19:00,316 - distributed.worker - INFO - Listening to: tls://127.0.0.1:32871 7221s 2024-11-23 22:19:00,316 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:19:00,316 - distributed.worker - INFO - dashboard at: 127.0.0.1:45337 7221s 2024-11-23 22:19:00,316 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35287 7221s 2024-11-23 22:19:00,317 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:19:00,317 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:19:00,317 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:19:00,317 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-91zxuuhg 7221s 2024-11-23 22:19:00,317 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:19:00,320 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37417 7221s 2024-11-23 22:19:00,320 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37417 7221s 2024-11-23 22:19:00,320 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:19:00,320 - distributed.worker - INFO - dashboard at: 127.0.0.1:32999 7221s 2024-11-23 22:19:00,321 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35287 7221s 2024-11-23 22:19:00,321 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:19:00,321 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:19:00,321 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:19:00,321 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-bl1fdwqq 7221s 2024-11-23 22:19:00,321 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:19:00,323 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:32871. Reason: failure-to-start- 7221s 2024-11-23 22:19:00,323 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:19:00,324 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37417. Reason: failure-to-start- 7221s 2024-11-23 22:19:00,325 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:19:00,331 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35287': TLS handshake failed with remote 'tls://127.0.0.1:46678': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:19:00,331 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35287': TLS handshake failed with remote 'tls://127.0.0.1:46690': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:19:00,337 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s 2024-11-23 22:19:01,347 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:19:01,357 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35609 7221s 2024-11-23 22:19:01,358 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33117/status 7221s 2024-11-23 22:19:01,358 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:19:01,379 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35421 7221s 2024-11-23 22:19:01,380 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35421 7221s 2024-11-23 22:19:01,380 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:19:01,380 - distributed.worker - INFO - dashboard at: 127.0.0.1:37933 7221s 2024-11-23 22:19:01,380 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35609 7221s 2024-11-23 22:19:01,380 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:19:01,380 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:19:01,380 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:19:01,380 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-0z0rhlgr 7221s 2024-11-23 22:19:01,380 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:19:01,383 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42307 7221s 2024-11-23 22:19:01,384 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42307 7221s 2024-11-23 22:19:01,384 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:19:01,384 - distributed.worker - INFO - dashboard at: 127.0.0.1:43573 7221s 2024-11-23 22:19:01,384 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35609 7221s 2024-11-23 22:19:01,384 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:19:01,384 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:19:01,384 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:19:01,384 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-xuzba66d 7221s 2024-11-23 22:19:01,384 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:19:01,386 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35421. Reason: failure-to-start- 7221s 2024-11-23 22:19:01,387 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:19:01,387 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42307. Reason: failure-to-start- 7221s 2024-11-23 22:19:01,388 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:19:01,397 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35609': TLS handshake failed with remote 'tls://127.0.0.1:52124': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:19:01,397 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35609': TLS handshake failed with remote 'tls://127.0.0.1:52126': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:19:01,400 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s 2024-11-23 22:19:02,407 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:19:02,418 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43069 7221s 2024-11-23 22:19:02,418 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36793/status 7221s 2024-11-23 22:19:02,418 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:19:02,442 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46661 7221s 2024-11-23 22:19:02,442 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46661 7221s 2024-11-23 22:19:02,442 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:19:02,442 - distributed.worker - INFO - dashboard at: 127.0.0.1:38603 7221s 2024-11-23 22:19:02,442 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43069 7221s 2024-11-23 22:19:02,442 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:19:02,443 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:19:02,443 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:19:02,443 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-c0ea1r4b 7221s 2024-11-23 22:19:02,443 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:19:02,446 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33303 7221s 2024-11-23 22:19:02,446 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33303 7221s 2024-11-23 22:19:02,446 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:19:02,446 - distributed.worker - INFO - dashboard at: 127.0.0.1:43137 7221s 2024-11-23 22:19:02,446 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43069 7221s 2024-11-23 22:19:02,446 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:19:02,446 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:19:02,447 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:19:02,447 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-habj6hzh 7221s 2024-11-23 22:19:02,447 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:19:02,452 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46661. Reason: failure-to-start- 7221s 2024-11-23 22:19:02,453 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:19:02,453 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33303. Reason: failure-to-start- 7221s 2024-11-23 22:19:02,454 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:19:02,460 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43069': TLS handshake failed with remote 'tls://127.0.0.1:59360': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:19:02,460 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43069': TLS handshake failed with remote 'tls://127.0.0.1:59366': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:19:02,463 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s 2024-11-23 22:19:03,470 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:19:03,481 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35427 7221s 2024-11-23 22:19:03,481 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:32809/status 7221s 2024-11-23 22:19:03,482 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:19:03,506 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43871 7221s 2024-11-23 22:19:03,506 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43871 7221s 2024-11-23 22:19:03,506 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:19:03,506 - distributed.worker - INFO - dashboard at: 127.0.0.1:38207 7221s 2024-11-23 22:19:03,507 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35427 7221s 2024-11-23 22:19:03,507 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:19:03,507 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:19:03,507 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:19:03,507 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-glcjyg4b 7221s 2024-11-23 22:19:03,507 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:19:03,510 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41177 7221s 2024-11-23 22:19:03,511 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41177 7221s 2024-11-23 22:19:03,511 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:19:03,511 - distributed.worker - INFO - dashboard at: 127.0.0.1:37599 7221s 2024-11-23 22:19:03,511 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35427 7221s 2024-11-23 22:19:03,511 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:19:03,511 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:19:03,511 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:19:03,511 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-760f822p 7221s 2024-11-23 22:19:03,511 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:19:03,521 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43871. Reason: failure-to-start- 7221s 2024-11-23 22:19:03,521 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:19:03,522 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41177. Reason: failure-to-start- 7221s 2024-11-23 22:19:03,522 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:19:03,525 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35427': TLS handshake failed with remote 'tls://127.0.0.1:54760': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:19:03,525 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35427': TLS handshake failed with remote 'tls://127.0.0.1:54766': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:19:03,528 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s 2024-11-23 22:19:04,535 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:19:04,546 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40507 7221s 2024-11-23 22:19:04,546 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39423/status 7221s 2024-11-23 22:19:04,547 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:19:04,574 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38685 7221s 2024-11-23 22:19:04,574 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38685 7221s 2024-11-23 22:19:04,574 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:19:04,574 - distributed.worker - INFO - dashboard at: 127.0.0.1:43909 7221s 2024-11-23 22:19:04,574 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40507 7221s 2024-11-23 22:19:04,574 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:19:04,575 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:19:04,575 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:19:04,575 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-c8g9wdxs 7221s 2024-11-23 22:19:04,575 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:19:04,578 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44055 7221s 2024-11-23 22:19:04,578 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44055 7221s 2024-11-23 22:19:04,578 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:19:04,578 - distributed.worker - INFO - dashboard at: 127.0.0.1:36603 7221s 2024-11-23 22:19:04,579 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40507 7221s 2024-11-23 22:19:04,579 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:19:04,579 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:19:04,579 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:19:04,579 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-02uzuxwx 7221s 2024-11-23 22:19:04,579 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:19:04,586 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38685. Reason: failure-to-start- 7221s 2024-11-23 22:19:04,586 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:19:04,587 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44055. Reason: failure-to-start- 7221s 2024-11-23 22:19:04,588 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:19:04,590 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40507': TLS handshake failed with remote 'tls://127.0.0.1:49016': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:19:04,590 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40507': TLS handshake failed with remote 'tls://127.0.0.1:49024': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:19:04,593 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s 2024-11-23 22:19:05,602 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:19:05,611 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38389 7221s 2024-11-23 22:19:05,612 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37197/status 7221s 2024-11-23 22:19:05,612 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:19:05,637 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35761 7221s 2024-11-23 22:19:05,637 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35761 7221s 2024-11-23 22:19:05,637 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:19:05,637 - distributed.worker - INFO - dashboard at: 127.0.0.1:45175 7221s 2024-11-23 22:19:05,637 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38389 7221s 2024-11-23 22:19:05,638 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:19:05,638 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:19:05,638 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:19:05,638 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-hu588ifl 7221s 2024-11-23 22:19:05,638 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:19:05,640 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43869 7221s 2024-11-23 22:19:05,640 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43869 7221s 2024-11-23 22:19:05,640 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:19:05,640 - distributed.worker - INFO - dashboard at: 127.0.0.1:43141 7221s 2024-11-23 22:19:05,640 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38389 7221s 2024-11-23 22:19:05,640 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:19:05,640 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:19:05,640 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:19:05,640 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-2h0iwbxv 7221s 2024-11-23 22:19:05,640 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:19:05,642 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35761. Reason: failure-to-start- 7221s 2024-11-23 22:19:05,642 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:19:05,642 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43869. Reason: failure-to-start- 7221s 2024-11-23 22:19:05,643 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:19:05,644 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38389': TLS handshake failed with remote 'tls://127.0.0.1:54474': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:19:05,644 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38389': TLS handshake failed with remote 'tls://127.0.0.1:54484': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:19:05,648 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s 2024-11-23 22:19:06,665 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:19:06,673 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37793 7221s 2024-11-23 22:19:06,673 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38407/status 7221s 2024-11-23 22:19:06,673 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:19:06,691 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:32779 7221s 2024-11-23 22:19:06,692 - distributed.worker - INFO - Listening to: tls://127.0.0.1:32779 7221s 2024-11-23 22:19:06,692 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:19:06,692 - distributed.worker - INFO - dashboard at: 127.0.0.1:35489 7221s 2024-11-23 22:19:06,692 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37793 7221s 2024-11-23 22:19:06,692 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:19:06,692 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:19:06,692 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:19:06,692 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-2o9ing33 7221s 2024-11-23 22:19:06,692 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:19:06,694 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42175 7221s 2024-11-23 22:19:06,694 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42175 7221s 2024-11-23 22:19:06,694 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:19:06,694 - distributed.worker - INFO - dashboard at: 127.0.0.1:33185 7221s 2024-11-23 22:19:06,694 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37793 7221s 2024-11-23 22:19:06,694 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:19:06,694 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:19:06,694 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:19:06,694 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-868jhuyd 7221s 2024-11-23 22:19:06,695 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:19:06,696 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:32779. Reason: failure-to-start- 7221s 2024-11-23 22:19:06,696 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:19:06,697 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42175. Reason: failure-to-start- 7221s 2024-11-23 22:19:06,697 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:19:06,698 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37793': TLS handshake failed with remote 'tls://127.0.0.1:50624': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:19:06,698 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37793': TLS handshake failed with remote 'tls://127.0.0.1:50628': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:19:06,702 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s 2024-11-23 22:19:07,708 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:19:07,716 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39805 7221s 2024-11-23 22:19:07,716 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38617/status 7221s 2024-11-23 22:19:07,716 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:19:07,733 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38727 7221s 2024-11-23 22:19:07,734 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38727 7221s 2024-11-23 22:19:07,734 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:19:07,734 - distributed.worker - INFO - dashboard at: 127.0.0.1:35857 7221s 2024-11-23 22:19:07,734 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39805 7221s 2024-11-23 22:19:07,734 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:19:07,734 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:19:07,734 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:19:07,734 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-9lwbv69b 7221s 2024-11-23 22:19:07,734 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:19:07,736 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36023 7221s 2024-11-23 22:19:07,736 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36023 7221s 2024-11-23 22:19:07,736 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:19:07,736 - distributed.worker - INFO - dashboard at: 127.0.0.1:42819 7221s 2024-11-23 22:19:07,736 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39805 7221s 2024-11-23 22:19:07,736 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:19:07,736 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:19:07,736 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:19:07,736 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-a_eqa1v1 7221s 2024-11-23 22:19:07,736 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:19:07,740 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38727. Reason: failure-to-start- 7221s 2024-11-23 22:19:07,740 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:19:07,741 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36023. Reason: failure-to-start- 7221s 2024-11-23 22:19:07,741 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:19:07,745 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39805': TLS handshake failed with remote 'tls://127.0.0.1:52644': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:19:07,745 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39805': TLS handshake failed with remote 'tls://127.0.0.1:52652': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:19:07,746 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s 2024-11-23 22:19:08,752 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:19:08,759 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42887 7221s 2024-11-23 22:19:08,759 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42679/status 7221s 2024-11-23 22:19:08,759 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:19:08,776 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35749 7221s 2024-11-23 22:19:08,776 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35749 7221s 2024-11-23 22:19:08,776 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:19:08,776 - distributed.worker - INFO - dashboard at: 127.0.0.1:35937 7221s 2024-11-23 22:19:08,776 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42887 7221s 2024-11-23 22:19:08,776 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:19:08,776 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:19:08,776 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:19:08,776 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ynrzrdzh 7221s 2024-11-23 22:19:08,776 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:19:08,778 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41527 7221s 2024-11-23 22:19:08,778 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41527 7221s 2024-11-23 22:19:08,778 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:19:08,778 - distributed.worker - INFO - dashboard at: 127.0.0.1:33339 7221s 2024-11-23 22:19:08,778 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42887 7221s 2024-11-23 22:19:08,779 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:19:08,779 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:19:08,779 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:19:08,779 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-72faukv8 7221s 2024-11-23 22:19:08,779 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:19:08,782 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35749. Reason: failure-to-start- 7221s 2024-11-23 22:19:08,783 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:19:08,783 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41527. Reason: failure-to-start- 7221s 2024-11-23 22:19:08,783 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:19:08,785 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42887': TLS handshake failed with remote 'tls://127.0.0.1:48182': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:19:08,785 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42887': TLS handshake failed with remote 'tls://127.0.0.1:48188': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:19:08,789 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s 2024-11-23 22:19:09,795 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:19:09,806 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45711 7221s 2024-11-23 22:19:09,806 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42843/status 7221s 2024-11-23 22:19:09,807 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:19:09,832 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35343 7221s 2024-11-23 22:19:09,832 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35343 7221s 2024-11-23 22:19:09,832 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:19:09,832 - distributed.worker - INFO - dashboard at: 127.0.0.1:45905 7221s 2024-11-23 22:19:09,832 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45711 7221s 2024-11-23 22:19:09,833 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:19:09,833 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:19:09,833 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:19:09,833 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-a2cgsp5_ 7221s 2024-11-23 22:19:09,833 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:19:09,836 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38363 7221s 2024-11-23 22:19:09,836 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38363 7221s 2024-11-23 22:19:09,836 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:19:09,836 - distributed.worker - INFO - dashboard at: 127.0.0.1:40861 7221s 2024-11-23 22:19:09,836 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45711 7221s 2024-11-23 22:19:09,836 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:19:09,836 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:19:09,837 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:19:09,837 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-f7nio5z_ 7221s 2024-11-23 22:19:09,837 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:19:09,847 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35343. Reason: failure-to-start- 7221s 2024-11-23 22:19:09,847 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:19:09,848 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38363. Reason: failure-to-start- 7221s 2024-11-23 22:19:09,848 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:19:09,851 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45711': TLS handshake failed with remote 'tls://127.0.0.1:48336': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:19:09,851 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45711': TLS handshake failed with remote 'tls://127.0.0.1:48340': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:19:09,854 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s 2024-11-23 22:19:10,861 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:19:10,871 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43569 7221s 2024-11-23 22:19:10,872 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37293/status 7221s 2024-11-23 22:19:10,872 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:19:10,899 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34933 7221s 2024-11-23 22:19:10,899 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34933 7221s 2024-11-23 22:19:10,899 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:19:10,899 - distributed.worker - INFO - dashboard at: 127.0.0.1:45907 7221s 2024-11-23 22:19:10,899 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43569 7221s 2024-11-23 22:19:10,899 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:19:10,899 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:19:10,899 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:19:10,899 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-a8vpd0q6 7221s 2024-11-23 22:19:10,899 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:19:10,903 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46787 7221s 2024-11-23 22:19:10,903 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46787 7221s 2024-11-23 22:19:10,903 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:19:10,903 - distributed.worker - INFO - dashboard at: 127.0.0.1:34607 7221s 2024-11-23 22:19:10,903 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43569 7221s 2024-11-23 22:19:10,903 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:19:10,903 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:19:10,903 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:19:10,903 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-0lc8pj80 7221s 2024-11-23 22:19:10,904 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:19:10,912 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34933. Reason: failure-to-start- 7221s 2024-11-23 22:19:10,912 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:19:10,913 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46787. Reason: failure-to-start- 7221s 2024-11-23 22:19:10,914 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:19:10,916 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43569': TLS handshake failed with remote 'tls://127.0.0.1:37114': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:19:10,916 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43569': TLS handshake failed with remote 'tls://127.0.0.1:37116': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:19:10,919 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s 2024-11-23 22:19:11,931 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:19:11,941 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46017 7221s 2024-11-23 22:19:11,942 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37203/status 7221s 2024-11-23 22:19:11,942 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:19:11,973 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38397 7221s 2024-11-23 22:19:11,973 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38397 7221s 2024-11-23 22:19:11,973 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:19:11,973 - distributed.worker - INFO - dashboard at: 127.0.0.1:41699 7221s 2024-11-23 22:19:11,973 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46017 7221s 2024-11-23 22:19:11,973 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:19:11,974 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:19:11,974 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:19:11,974 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-cmsl7bd2 7221s 2024-11-23 22:19:11,974 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:19:11,977 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42753 7221s 2024-11-23 22:19:11,977 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42753 7221s 2024-11-23 22:19:11,977 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:19:11,977 - distributed.worker - INFO - dashboard at: 127.0.0.1:45923 7221s 2024-11-23 22:19:11,977 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46017 7221s 2024-11-23 22:19:11,978 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:19:11,978 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:19:11,978 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:19:11,978 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-e7ghn7hp 7221s 2024-11-23 22:19:11,978 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:19:11,980 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38397. Reason: failure-to-start- 7221s 2024-11-23 22:19:11,980 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:19:11,981 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42753. Reason: failure-to-start- 7221s 2024-11-23 22:19:11,981 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:19:11,984 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46017': TLS handshake failed with remote 'tls://127.0.0.1:52544': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:19:11,984 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46017': TLS handshake failed with remote 'tls://127.0.0.1:52558': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:19:11,994 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s __________________________________ test_Queue __________________________________ 7221s 7221s fut = , timeout = 0 7221s 7221s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 7221s async with asyncio.timeout(timeout): 7221s > return await fut 7221s 7221s /usr/lib/python3/dist-packages/distributed/utils.py:1960: 7221s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7221s /usr/lib/python3/dist-packages/distributed/worker.py:1480: in start_unsafe 7221s await self._register_with_scheduler() 7221s /usr/lib/python3/dist-packages/distributed/worker.py:1179: in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s /usr/lib/python3/dist-packages/distributed/comm/core.py:342: in connect 7221s comm = await wait_for( 7221s /usr/lib/python3/dist-packages/distributed/utils.py:1960: in wait_for 7221s return await fut 7221s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:546: in connect 7221s stream = await self.client.connect( 7221s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7221s 7221s self = , host = '127.0.0.1' 7221s port = 40337, af = 7221s ssl_options = 7221s max_buffer_size = 8364507136.0, source_ip = None, source_port = None 7221s timeout = None 7221s 7221s async def connect( 7221s self, 7221s host: str, 7221s port: int, 7221s af: socket.AddressFamily = socket.AF_UNSPEC, 7221s ssl_options: Optional[Union[Dict[str, Any], ssl.SSLContext]] = None, 7221s max_buffer_size: Optional[int] = None, 7221s source_ip: Optional[str] = None, 7221s source_port: Optional[int] = None, 7221s timeout: Optional[Union[float, datetime.timedelta]] = None, 7221s ) -> IOStream: 7221s """Connect to the given host and port. 7221s 7221s Asynchronously returns an `.IOStream` (or `.SSLIOStream` if 7221s ``ssl_options`` is not None). 7221s 7221s Using the ``source_ip`` kwarg, one can specify the source 7221s IP address to use when establishing the connection. 7221s In case the user needs to resolve and 7221s use a specific interface, it has to be handled outside 7221s of Tornado as this depends very much on the platform. 7221s 7221s Raises `TimeoutError` if the input future does not complete before 7221s ``timeout``, which may be specified in any form allowed by 7221s `.IOLoop.add_timeout` (i.e. a `datetime.timedelta` or an absolute time 7221s relative to `.IOLoop.time`) 7221s 7221s Similarly, when the user requires a certain source port, it can 7221s be specified using the ``source_port`` arg. 7221s 7221s .. versionchanged:: 4.5 7221s Added the ``source_ip`` and ``source_port`` arguments. 7221s 7221s .. versionchanged:: 5.0 7221s Added the ``timeout`` argument. 7221s """ 7221s if timeout is not None: 7221s if isinstance(timeout, numbers.Real): 7221s timeout = IOLoop.current().time() + timeout 7221s elif isinstance(timeout, datetime.timedelta): 7221s timeout = IOLoop.current().time() + timeout.total_seconds() 7221s else: 7221s raise TypeError("Unsupported timeout %r" % timeout) 7221s if timeout is not None: 7221s addrinfo = await gen.with_timeout( 7221s timeout, self.resolver.resolve(host, port, af) 7221s ) 7221s else: 7221s addrinfo = await self.resolver.resolve(host, port, af) 7221s connector = _Connector( 7221s addrinfo, 7221s functools.partial( 7221s self._create_stream, 7221s max_buffer_size, 7221s source_ip=source_ip, 7221s source_port=source_port, 7221s ), 7221s ) 7221s > af, addr, stream = await connector.start(connect_timeout=timeout) 7221s E asyncio.exceptions.CancelledError 7221s 7221s /usr/lib/python3/dist-packages/tornado/tcpclient.py:279: CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s self = 7221s 7221s @final 7221s async def start(self): 7221s async with self._startup_lock: 7221s if self.status == Status.failed: 7221s assert self.__startup_exc is not None 7221s raise self.__startup_exc 7221s elif self.status != Status.init: 7221s return self 7221s timeout = getattr(self, "death_timeout", None) 7221s 7221s async def _close_on_failure(exc: Exception) -> None: 7221s await self.close(reason=f"failure-to-start-{str(type(exc))}") 7221s self.status = Status.failed 7221s self.__startup_exc = exc 7221s 7221s try: 7221s > await wait_for(self.start_unsafe(), timeout=timeout) 7221s 7221s /usr/lib/python3/dist-packages/distributed/core.py:664: 7221s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7221s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 7221s async with asyncio.timeout(timeout): 7221s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7221s 7221s self = 7221s exc_type = 7221s exc_val = CancelledError(), exc_tb = 7221s 7221s async def __aexit__( 7221s self, 7221s exc_type: Optional[Type[BaseException]], 7221s exc_val: Optional[BaseException], 7221s exc_tb: Optional[TracebackType], 7221s ) -> Optional[bool]: 7221s assert self._state in (_State.ENTERED, _State.EXPIRING) 7221s 7221s if self._timeout_handler is not None: 7221s self._timeout_handler.cancel() 7221s self._timeout_handler = None 7221s 7221s if self._state is _State.EXPIRING: 7221s self._state = _State.EXPIRED 7221s 7221s if self._task.uncancel() <= self._cancelling and exc_type is not None: 7221s # Since there are no new cancel requests, we're 7221s # handling this. 7221s if issubclass(exc_type, exceptions.CancelledError): 7221s > raise TimeoutError from exc_val 7221s E TimeoutError 7221s 7221s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s @contextlib.asynccontextmanager 7221s async def _cluster_factory(): 7221s workers = [] 7221s s = None 7221s try: 7221s for _ in range(60): 7221s try: 7221s > s, ws = await start_cluster( 7221s nthreads, 7221s scheduler, 7221s security=security, 7221s Worker=Worker, 7221s scheduler_kwargs=scheduler_kwargs, 7221s worker_kwargs=merge( 7221s {"death_timeout": min(15, int(deadline.remaining))}, 7221s worker_kwargs, 7221s ), 7221s ) 7221s 7221s /usr/lib/python3/dist-packages/distributed/utils_test.py:966: 7221s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7221s /usr/lib/python3/dist-packages/distributed/utils_test.py:789: in start_cluster 7221s await asyncio.gather(*workers) 7221s /usr/lib/python3.13/asyncio/tasks.py:737: in _wrap_awaitable 7221s return await awaitable 7221s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7221s 7221s self = 7221s 7221s @final 7221s async def start(self): 7221s async with self._startup_lock: 7221s if self.status == Status.failed: 7221s assert self.__startup_exc is not None 7221s raise self.__startup_exc 7221s elif self.status != Status.init: 7221s return self 7221s timeout = getattr(self, "death_timeout", None) 7221s 7221s async def _close_on_failure(exc: Exception) -> None: 7221s await self.close(reason=f"failure-to-start-{str(type(exc))}") 7221s self.status = Status.failed 7221s self.__startup_exc = exc 7221s 7221s try: 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s except asyncio.TimeoutError as exc: 7221s await _close_on_failure(exc) 7221s > raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s E TimeoutError: Worker start timed out after 0s. 7221s 7221s /usr/lib/python3/dist-packages/distributed/core.py:667: TimeoutError 7221s 7221s During handling of the above exception, another exception occurred: 7221s 7221s fut = ._..test_func..async_fn at 0xe9b48110> 7221s timeout = 60 7221s 7221s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 7221s async with asyncio.timeout(timeout): 7221s > return await fut 7221s 7221s /usr/lib/python3/dist-packages/distributed/utils.py:1960: 7221s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7221s /usr/lib/python3/dist-packages/distributed/utils_test.py:999: in async_fn 7221s _cluster_factory() as (s, workers), 7221s /usr/lib/python3.13/contextlib.py:214: in __aenter__ 7221s return await anext(self.gen) 7221s /usr/lib/python3/dist-packages/distributed/utils_test.py:983: in _cluster_factory 7221s await asyncio.sleep(1) 7221s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7221s 7221s delay = 1, result = None 7221s 7221s async def sleep(delay, result=None): 7221s """Coroutine that completes after a given time (in seconds).""" 7221s if delay <= 0: 7221s await __sleep0() 7221s return result 7221s 7221s if math.isnan(delay): 7221s raise ValueError("Invalid delay: NaN (not a number)") 7221s 7221s loop = events.get_running_loop() 7221s future = loop.create_future() 7221s h = loop.call_later(delay, 7221s futures._set_result_unless_cancelled, 7221s future, result) 7221s try: 7221s > return await future 7221s E asyncio.exceptions.CancelledError 7221s 7221s /usr/lib/python3.13/asyncio/tasks.py:718: CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s args = (), kwds = {} 7221s 7221s @wraps(func) 7221s def inner(*args, **kwds): 7221s with self._recreate_cm(): 7221s > return func(*args, **kwds) 7221s 7221s /usr/lib/python3.13/contextlib.py:85: 7221s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7221s /usr/lib/python3.13/contextlib.py:85: in inner 7221s return func(*args, **kwds) 7221s /usr/lib/python3/dist-packages/distributed/utils_test.py:1102: in test_func 7221s return _run_and_close_tornado(async_fn_outer) 7221s /usr/lib/python3/dist-packages/distributed/utils_test.py:378: in _run_and_close_tornado 7221s return asyncio_run(inner_fn(), loop_factory=get_loop_factory()) 7221s /usr/lib/python3.13/asyncio/runners.py:194: in run 7221s return runner.run(main) 7221s /usr/lib/python3.13/asyncio/runners.py:118: in run 7221s return self._loop.run_until_complete(task) 7221s /usr/lib/python3.13/asyncio/base_events.py:720: in run_until_complete 7221s return future.result() 7221s /usr/lib/python3/dist-packages/distributed/utils_test.py:375: in inner_fn 7221s return await async_fn(*args, **kwargs) 7221s /usr/lib/python3/dist-packages/distributed/utils_test.py:1099: in async_fn_outer 7221s return await utils_wait_for(async_fn(), timeout=timeout * 2) 7221s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 7221s async with asyncio.timeout(timeout): 7221s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7221s 7221s self = 7221s exc_type = 7221s exc_val = CancelledError(), exc_tb = 7221s 7221s async def __aexit__( 7221s self, 7221s exc_type: Optional[Type[BaseException]], 7221s exc_val: Optional[BaseException], 7221s exc_tb: Optional[TracebackType], 7221s ) -> Optional[bool]: 7221s assert self._state in (_State.ENTERED, _State.EXPIRING) 7221s 7221s if self._timeout_handler is not None: 7221s self._timeout_handler.cancel() 7221s self._timeout_handler = None 7221s 7221s if self._state is _State.EXPIRING: 7221s self._state = _State.EXPIRED 7221s 7221s if self._task.uncancel() <= self._cancelling and exc_type is not None: 7221s # Since there are no new cancel requests, we're 7221s # handling this. 7221s if issubclass(exc_type, exceptions.CancelledError): 7221s > raise TimeoutError from exc_val 7221s E TimeoutError 7221s 7221s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 7221s ----------------------------- Captured stderr call ----------------------------- 7221s 2024-11-23 22:19:12,943 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:19:12,956 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:12,956 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33187/status 7221s 2024-11-23 22:19:12,957 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:19:12,980 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34353 7221s 2024-11-23 22:19:12,980 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34353 7221s 2024-11-23 22:19:12,980 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:19:12,980 - distributed.worker - INFO - dashboard at: 127.0.0.1:45095 7221s 2024-11-23 22:19:12,980 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:12,980 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:19:12,980 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:19:12,980 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:19:12,980 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-j9xa85wy 7221s 2024-11-23 22:19:12,981 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:19:12,984 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42833 7221s 2024-11-23 22:19:12,984 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42833 7221s 2024-11-23 22:19:12,984 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:19:12,984 - distributed.worker - INFO - dashboard at: 127.0.0.1:32871 7221s 2024-11-23 22:19:12,984 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:12,984 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:19:12,984 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:19:12,985 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:19:12,985 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-2efu3kv0 7221s 2024-11-23 22:19:12,985 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:19:13,000 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:13,001 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:13,001 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:32938': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:13,001 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:32954': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:13,116 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:13,117 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:13,117 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:32958': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:13,118 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:32966': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:13,233 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:13,234 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:13,234 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:32976': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:13,235 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:32992': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:13,352 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:13,352 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:13,353 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:33004': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:13,353 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:33018': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:13,468 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:13,468 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:13,474 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:33028': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:13,474 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:33032': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:13,584 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:13,584 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:13,585 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:33042': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:13,585 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:33058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:13,701 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:13,701 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:13,702 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:33068': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:13,702 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:33080': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:13,817 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:13,818 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:13,819 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:33092': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:13,819 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:33096': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:13,934 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:13,934 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:13,935 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:33100': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:13,935 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:33106': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:14,052 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:14,052 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:14,053 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:33108': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:14,053 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:33118': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:14,168 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:14,168 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:14,169 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:33130': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:14,169 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:33144': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:14,283 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:14,284 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:14,285 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:33146': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:14,285 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:33154': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:14,401 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:14,401 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:14,402 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:33166': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:14,402 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:33182': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:14,516 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:14,517 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:14,518 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:33188': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:14,518 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:33204': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:14,634 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:14,634 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:14,635 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:33208': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:14,635 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:33224': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:14,751 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:14,751 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:14,752 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:33232': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:14,752 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:33240': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:14,867 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:14,868 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:14,869 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:33250': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:14,869 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:33266': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:14,984 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:14,984 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:14,985 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:33270': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:14,985 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:33272': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:15,103 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:15,104 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:15,104 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:33282': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:15,105 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:33288': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:15,220 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:15,220 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:15,221 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:33298': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:15,221 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:33304': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:15,336 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:15,336 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:15,337 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:33318': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:15,337 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:33326': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:15,453 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:15,453 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:15,454 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:33334': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:15,454 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:33344': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:15,569 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:15,569 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:15,570 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:33358': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:15,570 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:33362': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:15,685 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:15,685 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:15,686 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:33364': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:15,686 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:33380': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:15,801 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:15,801 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:15,802 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:33394': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:15,802 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:33410': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:15,917 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:15,917 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:15,918 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:33422': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:15,918 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:33432': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:16,033 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:16,033 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:16,034 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:33444': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:16,034 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:33460': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:16,148 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:16,149 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:16,150 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:33474': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:16,150 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:33476': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:16,264 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:16,265 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:16,266 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:33478': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:16,266 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:33484': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:16,381 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:16,381 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:16,382 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:33494': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:16,382 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:33510': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:16,497 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:16,498 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:16,498 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:33524': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:16,498 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:33534': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:16,613 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:16,614 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:16,615 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:33536': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:16,615 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:33542': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:16,731 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:16,731 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:16,732 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:33552': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:16,732 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:33566': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:16,847 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:16,847 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:16,848 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:33574': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:16,848 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:33586': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:16,966 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:16,966 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:16,972 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:33596': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:16,972 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:33600': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:17,083 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:17,084 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:17,084 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:33606': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:17,084 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:33620': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:17,200 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:17,200 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:17,201 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:33626': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:17,201 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:33632': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:17,316 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:17,316 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:17,317 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:33638': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:17,317 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:33646': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:17,433 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:17,434 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:17,434 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:33656': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:17,435 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:33664': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:17,551 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:17,551 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:17,552 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:33676': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:17,552 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:33692': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:17,667 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:17,667 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:17,668 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:33706': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:17,668 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:33712': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:17,783 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:17,783 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:17,784 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:33722': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:17,784 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:33732': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:17,900 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:17,901 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:17,901 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:33738': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:17,901 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:33746': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:18,017 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:18,017 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:18,018 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:33760': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:18,018 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:33770': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:18,133 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:18,134 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:18,135 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:33782': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:18,135 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:33792': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:18,250 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:18,250 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:18,251 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:33796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:18,251 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:33806': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:18,366 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:18,366 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:18,367 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:33818': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:18,367 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:33822': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:18,481 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:18,482 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:18,482 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:33832': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:18,483 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:33844': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:18,599 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:18,599 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:18,600 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:33860': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:18,600 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:33874': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:18,715 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:18,716 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:18,719 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:33886': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:18,719 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:33888': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:18,831 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:18,831 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:18,832 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:33902': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:18,832 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:33906': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:18,947 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:18,947 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:18,948 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:33908': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:18,948 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:33924': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:19,064 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:19,064 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:19,065 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:33928': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:19,065 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:33940': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:19,180 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:19,180 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:19,181 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:33944': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:19,181 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:33956': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:19,296 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:19,296 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:19,297 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:33970': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:19,297 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:33974': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:19,412 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:19,412 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:19,413 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:33984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:19,413 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:33992': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:19,528 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:19,529 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:19,529 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:34006': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:19,529 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:34012': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:19,645 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:19,646 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:19,647 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:34024': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:19,647 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:34040': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:19,760 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:19,762 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:19,763 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:34052': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:19,763 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:34068': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:19,872 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:19,873 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:34076': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:19,879 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:19,880 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:34090': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:19,982 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:19,984 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:34106': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:19,991 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:19,992 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:34122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:20,091 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:20,092 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:34138': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:20,100 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:20,101 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:34148': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:20,201 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:20,202 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:34156': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:20,210 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:20,211 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:34158': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:20,310 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:20,311 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:34174': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:20,319 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:20,320 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:34190': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:20,421 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:20,423 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:34204': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:20,430 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:20,431 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:34218': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:20,531 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:20,532 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:34222': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:20,540 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:20,541 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:34236': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:20,641 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:20,642 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:34246': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:20,648 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:20,649 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:34256': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:20,749 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:20,749 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:34264': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:20,756 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:20,756 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:34278': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:20,857 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:20,858 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:34284': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:20,864 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:20,865 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:34296': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:20,969 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:20,970 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:34308': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:20,976 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:20,976 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:34316': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:21,077 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:21,077 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:34326': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:21,083 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:21,084 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:34330': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:21,184 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:21,185 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:34346': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:21,191 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:21,191 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:34348': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:21,292 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:21,293 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:34360': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:21,299 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:21,299 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:34370': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:21,400 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:21,400 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:34374': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:21,407 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:21,407 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:34386': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:21,507 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:21,508 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:34388': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:21,514 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:21,515 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:34398': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:21,615 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:21,615 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:34576': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:21,622 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:21,622 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:34586': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:21,723 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:21,723 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:34594': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:21,730 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:21,730 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:34604': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:21,831 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:21,831 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:34616': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:21,837 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:21,838 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:34620': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:21,938 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:21,939 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:34628': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:21,945 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:21,945 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:34630': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:22,046 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:22,046 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:34632': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:22,052 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:22,053 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:34642': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:22,156 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:22,157 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:34652': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:22,162 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:22,163 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:34664': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:22,263 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:22,264 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:34670': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:22,270 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:22,270 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:34684': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:22,371 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:22,372 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:34690': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:22,378 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:22,378 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:34694': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:22,479 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:22,479 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:34696': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:22,486 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:22,486 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:34712': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:22,587 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:22,588 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:34722': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:22,594 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:22,594 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:34728': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:22,694 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:22,695 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:34732': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:22,701 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:22,702 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:34742': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:22,802 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:22,803 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:34746': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:22,809 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:22,810 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:34754': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:22,910 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:22,910 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:34756': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:22,917 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:22,917 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:34768': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:23,018 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:23,019 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:34776': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:23,025 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:23,025 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:34792': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:23,126 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:23,126 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:34808': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:23,132 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:23,133 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:34822': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:23,234 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:23,235 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:34824': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:23,240 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:23,241 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:34840': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:23,341 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:23,342 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:34844': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:23,348 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:23,348 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:34860': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:23,449 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:23,449 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:34864': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:23,455 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:23,456 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:34872': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:23,557 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:23,558 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:34880': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:23,564 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:23,565 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:34884': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:23,665 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:23,665 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:34892': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:23,671 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:23,671 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:34898': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:23,773 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:23,775 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:34906': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:23,781 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:23,781 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:34916': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:23,881 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:23,882 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:34920': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:23,888 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:23,888 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:34926': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:23,990 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:23,991 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:34932': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:23,997 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:23,997 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:34948': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:24,098 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:24,098 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:34960': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:24,104 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:24,105 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:34962': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:24,205 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:24,205 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:34970': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:24,212 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:24,212 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:34982': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:24,312 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:24,313 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:34994': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:24,319 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:24,319 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:35000': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:24,419 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:24,420 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:35014': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:24,426 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:24,426 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:35028': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:24,527 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:24,527 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:35034': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:24,533 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:24,534 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:35042': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:24,635 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:24,635 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:35048': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:24,641 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:24,642 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:35064': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:24,742 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:24,743 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:35080': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:24,749 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:24,749 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:35092': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:24,849 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:24,850 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:35108': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:24,856 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:24,856 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:35114': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:24,957 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:24,957 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:35118': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:24,968 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:24,968 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:35134': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:25,064 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:25,064 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:35140': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:25,075 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:25,075 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:35148': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:25,172 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:25,172 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:35154': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:25,182 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:25,182 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:35166': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:25,280 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:25,280 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:35180': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:25,289 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:25,289 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:35192': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:25,387 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:25,388 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:35200': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:25,396 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:25,396 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:35212': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:25,495 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:25,495 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:35224': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:25,503 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:25,504 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:35232': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:25,603 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:25,603 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:35248': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:25,611 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:25,611 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:35260': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:25,711 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:25,711 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:35266': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:25,718 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:25,718 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:35276': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:25,818 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:25,819 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:35282': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:25,825 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:25,825 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:35298': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:25,925 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:25,926 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:35314': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:25,932 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:25,933 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:35316': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:26,033 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:26,033 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:35330': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:26,040 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:26,040 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:35346': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:26,140 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:26,141 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:35352': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:26,147 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:26,147 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:35368': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:26,248 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:26,248 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:35384': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:26,255 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:26,255 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:35390': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:26,355 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:26,356 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:35394': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:26,362 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:26,362 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:35396': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:26,467 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:26,467 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:35404': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:26,473 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:26,474 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:35406': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:26,575 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:26,576 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:35408': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:26,582 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:26,582 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:35414': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:26,684 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:26,684 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:35420': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:26,690 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:26,690 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:35430': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:26,791 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:26,792 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:35438': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:26,798 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:26,798 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:35448': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:26,898 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:26,899 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:35456': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:26,905 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:26,905 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:35468': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:27,007 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:27,007 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:35480': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:27,013 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:27,014 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:35496': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:27,115 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:27,116 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:35508': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:27,122 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:27,122 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:35522': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:27,223 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:27,223 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:35534': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:27,230 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:27,230 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:35542': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:27,331 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:27,332 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:35546': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:27,338 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:27,338 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:35558': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:27,438 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:27,439 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:35564': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:27,445 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:27,445 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:35576': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:27,546 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:27,547 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:35586': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:27,553 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:27,553 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:35600': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:27,654 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:27,654 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:35616': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:27,660 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:27,661 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:35626': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:27,761 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:27,761 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:35638': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:27,768 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:27,768 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:35650': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:27,868 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:27,869 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:35660': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:27,875 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:27,875 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:35666': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:27,975 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:27,976 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:35680': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:27,981 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34353. Reason: failure-to-start- 7221s 2024-11-23 22:19:27,981 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:19:27,983 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38941 7221s 2024-11-23 22:19:27,984 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38941': TLS handshake failed with remote 'tls://127.0.0.1:35688': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:27,984 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42833. Reason: failure-to-start- 7221s 2024-11-23 22:19:27,984 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:19:27,986 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 15s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 7221s stream = await stream.start_tls( 7221s ^^^^^^^^^^^^^^^^^^^^^^^ 7221s False, ssl_options=ssl_options, server_hostname=host 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 7221s self.socket.do_handshake() 7221s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 7221s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 7221s self._sslobj.do_handshake() 7221s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 7221s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 7221s raise FatalCommClosedError( 7221s ...<2 lines>... 7221s ) from err 7221s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 7221s 7221s During handling of the above exception, another exception occurred: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1218, in _register_with_scheduler 7221s await asyncio.sleep(0.1) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 718, in sleep 7221s return await future 7221s ^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 15s. 7221s 2024-11-23 22:19:28,992 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:19:29,000 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:29,000 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45021/status 7221s 2024-11-23 22:19:29,000 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:19:29,017 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43889 7221s 2024-11-23 22:19:29,017 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43889 7221s 2024-11-23 22:19:29,017 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:19:29,017 - distributed.worker - INFO - dashboard at: 127.0.0.1:37179 7221s 2024-11-23 22:19:29,017 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:29,017 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:19:29,017 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:19:29,018 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:19:29,018 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-csppfxir 7221s 2024-11-23 22:19:29,018 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:19:29,020 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36613 7221s 2024-11-23 22:19:29,020 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36613 7221s 2024-11-23 22:19:29,020 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:19:29,020 - distributed.worker - INFO - dashboard at: 127.0.0.1:37083 7221s 2024-11-23 22:19:29,020 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:29,020 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:19:29,020 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:19:29,020 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:19:29,020 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ezpey9t4 7221s 2024-11-23 22:19:29,020 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:19:29,033 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:29,033 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:29,033 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:57914': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:29,033 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:57926': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:29,146 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:29,146 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:29,146 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:57928': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:29,146 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:57936': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:29,259 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:29,259 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:29,259 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:57950': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:29,259 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:57960': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:29,372 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:29,372 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:29,372 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:57968': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:29,372 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:57982': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:29,485 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:29,485 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:29,485 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:57986': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:29,486 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:58002': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:29,598 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:29,598 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:29,599 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:58010': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:29,599 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:58020': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:29,711 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:29,712 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:29,712 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:58030': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:29,712 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:58034': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:29,825 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:29,825 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:29,825 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:58040': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:29,825 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:58050': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:29,938 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:29,938 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:29,938 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:58066': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:29,938 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:58074': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:30,051 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:30,051 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:30,052 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:58088': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:30,052 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:58100': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:30,164 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:30,164 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:30,165 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:58104': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:30,165 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:58112': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:30,278 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:30,279 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:30,279 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:58114': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:30,279 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:58118': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:30,391 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:30,391 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:30,392 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:58122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:30,392 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:58132': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:30,504 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:30,504 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:30,507 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:58148': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:30,507 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:58156': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:30,617 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:30,617 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:30,617 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:58168': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:30,617 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:58180': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:30,731 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:30,731 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:30,731 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:58196': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:30,731 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:58200': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:30,845 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:30,845 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:30,845 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:58216': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:30,845 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:58220': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:30,957 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:30,958 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:30,958 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:58234': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:30,958 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:58246': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:31,071 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:31,071 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:31,071 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:58260': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:31,071 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:58262': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:31,185 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:31,185 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:31,185 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:58274': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:31,185 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:58280': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:31,298 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:31,298 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:31,298 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:58294': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:31,299 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:58310': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:31,411 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:31,411 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:31,411 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:58324': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:31,412 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:58336': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:31,524 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:31,524 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:31,525 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:58352': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:31,525 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:58356': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:31,637 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:31,637 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:31,638 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:34308': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:31,638 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:34312': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:31,750 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:31,750 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:31,750 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:34326': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:31,750 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:34328': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:31,862 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:31,863 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:31,863 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:34340': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:31,863 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:34348': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:31,975 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:31,975 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:31,977 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:34360': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:31,977 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:34374': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:32,089 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:32,090 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:32,090 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:34376': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:32,090 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:34380': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:32,202 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:32,202 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:32,203 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:34382': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:32,203 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:34390': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:32,315 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:32,316 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:32,316 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:34406': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:32,316 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:34420': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:32,428 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:32,428 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:32,429 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:34426': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:32,429 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:34436': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:32,541 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:32,541 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:32,542 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:34450': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:32,542 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:34454': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:32,655 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:32,655 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:32,655 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:34460': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:32,656 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:34468': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:32,768 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:32,769 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:32,769 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:34480': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:32,769 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:34490': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:32,881 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:32,881 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:32,882 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:34492': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:32,882 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:34508': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:32,995 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:32,995 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:32,995 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:34522': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:32,995 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:34528': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:33,108 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:33,108 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:33,108 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:34540': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:33,108 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:34542': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:33,219 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:33,220 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:33,221 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:34554': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:33,221 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:34566': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:33,328 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:33,333 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:34578': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:33,334 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:33,334 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:34594': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:33,436 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:33,437 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:34604': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:33,443 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:33,443 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:34608': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:33,543 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:33,544 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:34624': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:33,550 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:33,550 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:34630': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:33,651 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:33,652 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:34632': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:33,658 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:33,658 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:34638': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:33,759 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:33,760 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:34654': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:33,766 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:33,766 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:34664': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:33,867 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:33,867 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:34680': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:33,873 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:33,874 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:34684': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:33,974 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:33,974 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:34686': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:33,981 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:33,981 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:34694': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:34,082 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:34,082 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:34710': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:34,088 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:34,089 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:34718': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:34,190 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:34,191 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:34720': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:34,196 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:34,197 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:34722': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:34,297 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:34,298 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:34724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:34,304 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:34,304 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:34738': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:34,406 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:34,407 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:34748': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:34,413 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:34,413 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:34756': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:34,513 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:34,514 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:34760': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:34,520 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:34,520 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:34770': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:34,622 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:34,623 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:34782': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:34,629 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:34,630 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:34788': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:34,730 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:34,730 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:34790': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:34,736 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:34,737 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:34806': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:34,837 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:34,837 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:34820': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:34,843 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:34,844 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:34822': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:34,945 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:34,946 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:34838': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:34,952 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:34,952 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:34846': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:35,053 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:35,054 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:34856': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:35,060 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:35,060 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:34868': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:35,161 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:35,162 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:34884': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:35,168 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:35,168 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:34896': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:35,269 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:35,270 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:34902': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:35,276 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:35,276 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:34918': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:35,378 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:35,379 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:34920': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:35,386 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:35,386 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:34924': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:35,487 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:35,488 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:34934': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:35,494 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:35,494 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:34946': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:35,595 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:35,595 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:34950': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:35,602 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:35,602 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:34958': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:35,703 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:35,703 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:34972': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:35,709 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:35,710 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:34986': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:35,810 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:35,811 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:34998': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:35,817 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:35,817 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:35006': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:35,918 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:35,919 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:35022': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:35,925 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:35,925 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:35030': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:36,026 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:36,027 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:35036': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:36,032 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:36,033 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:35052': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:36,134 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:36,135 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:35054': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:36,141 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:36,141 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:35066': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:36,242 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:36,243 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:35076': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:36,249 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:36,249 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:35088': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:36,349 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:36,349 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:35104': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:36,356 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:36,356 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:35116': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:36,457 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:36,458 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:35130': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:36,468 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:36,468 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:35146': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:36,565 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:36,565 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:35150': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:36,575 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:36,575 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:35166': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:36,672 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:36,672 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:35178': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:36,681 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:36,682 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:35190': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:36,780 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:36,780 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:35202': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:36,788 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:36,789 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:35206': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:36,887 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:36,887 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:35214': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:36,895 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:36,896 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:35222': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:36,995 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:36,996 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:35226': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:37,003 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:37,008 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:35232': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:37,104 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:37,104 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:35238': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:37,110 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:37,110 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:35254': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:37,212 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:37,212 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:35268': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:37,218 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:37,219 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:35270': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:37,319 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:37,319 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:35272': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:37,326 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:37,326 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:35288': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:37,427 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:37,428 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:35294': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:37,433 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:37,434 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:35296': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:37,535 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:37,536 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:35310': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:37,542 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:37,542 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:35324': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:37,643 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:37,644 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:35338': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:37,649 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:37,650 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:35348': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:37,752 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:37,753 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:35356': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:37,758 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:37,759 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:35368': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:37,860 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:37,861 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:35382': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:37,867 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:37,867 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:35388': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:37,969 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:37,970 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:35402': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:37,976 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:37,976 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:35410': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:38,076 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:38,076 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:35412': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:38,083 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:38,083 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:35420': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:38,184 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:38,185 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:35432': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:38,191 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:38,191 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:35438': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:38,291 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:38,292 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:35452': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:38,298 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:38,298 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:35464': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:38,399 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:38,399 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:35476': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:38,406 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:38,406 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:35490': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:38,510 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:38,511 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:35502': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:38,517 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:38,518 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:35508': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:38,619 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:38,619 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:35512': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:38,625 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:38,626 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:35518': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:38,727 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:38,728 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:35524': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:38,734 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:38,734 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:35528': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:38,835 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:38,836 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:35542': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:38,842 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:38,842 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:35556': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:38,943 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:38,944 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:35560': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:38,950 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:38,950 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:35574': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:39,051 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:39,051 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:35580': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:39,057 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:39,057 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:35584': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:39,158 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:39,159 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:35590': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:39,165 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:39,165 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:35592': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:39,265 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:39,266 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:35594': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:39,272 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:39,272 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:35596': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:39,373 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:39,374 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:35602': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:39,380 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:39,380 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:35604': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:39,480 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:39,481 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:35608': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:39,487 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:39,487 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:35618': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:39,589 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:39,590 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:35624': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:39,596 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:39,596 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:35628': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:39,697 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:39,698 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:35640': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:39,704 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:39,704 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:35644': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:39,805 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:39,806 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:35652': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:39,812 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:39,812 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:35666': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:39,913 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:39,913 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:35680': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:39,920 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:39,920 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:35684': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:40,022 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:40,022 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:35686': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:40,028 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:40,028 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:35694': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:40,129 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:40,130 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:35710': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:40,136 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:40,136 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:35716': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:40,237 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:40,237 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:35732': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:40,243 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:40,244 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:35748': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:40,346 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:40,348 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:35752': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:40,354 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:40,354 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:35764': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:40,453 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:40,454 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:35770': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:40,460 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:40,464 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:35780': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:40,561 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:40,561 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:35790': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:40,568 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:40,568 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:35792': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:40,669 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:40,669 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:35796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:40,675 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:40,676 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:35804': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:40,776 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:40,777 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:35820': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:40,783 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:40,783 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:35824': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:40,884 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:40,885 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:35830': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:40,891 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:40,891 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:35842': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:40,992 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:40,992 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:35850': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:40,998 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:40,998 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:35852': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:41,099 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:41,100 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:35864': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:41,106 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:41,106 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:35880': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:41,207 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:41,207 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:35886': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:41,213 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:41,214 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:35900': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:41,315 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:41,316 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:35912': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:41,322 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:41,322 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:35928': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:41,423 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:41,424 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:35944': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:41,430 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:41,430 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:35958': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:41,531 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:41,532 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:42190': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:41,538 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:41,538 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:42192': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:41,639 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:41,639 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:42204': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:41,645 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:41,646 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:42206': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:41,747 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:41,748 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:42222': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:41,753 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:41,754 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:42234': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:41,854 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:41,855 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:42242': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:41,861 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:41,861 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:42258': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:41,967 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:41,968 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:42274': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:41,975 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43883 7221s 2024-11-23 22:19:41,975 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43883': TLS handshake failed with remote 'tls://127.0.0.1:42282': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:19:42,017 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43889. Reason: failure-to-start- 7221s 2024-11-23 22:19:42,017 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:19:42,019 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36613. Reason: failure-to-start- 7221s 2024-11-23 22:19:42,019 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:19:42,019 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 13s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 7221s stream = await stream.start_tls( 7221s ^^^^^^^^^^^^^^^^^^^^^^^ 7221s False, ssl_options=ssl_options, server_hostname=host 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 7221s self.socket.do_handshake() 7221s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 7221s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 7221s self._sslobj.do_handshake() 7221s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 7221s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 7221s raise FatalCommClosedError( 7221s ...<2 lines>... 7221s ) from err 7221s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 7221s 7221s During handling of the above exception, another exception occurred: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1218, in _register_with_scheduler 7221s await asyncio.sleep(0.1) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 718, in sleep 7221s return await future 7221s ^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 13s. 7221s 2024-11-23 22:19:43,027 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:19:43,035 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37981 7221s 2024-11-23 22:19:43,035 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42975/status 7221s 2024-11-23 22:19:43,036 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:19:43,051 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39065 7221s 2024-11-23 22:19:43,051 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39065 7221s 2024-11-23 22:19:43,051 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:19:43,051 - distributed.worker - INFO - dashboard at: 127.0.0.1:39479 7221s 2024-11-23 22:19:43,051 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37981 7221s 2024-11-23 22:19:43,051 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:19:43,051 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:19:43,051 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:19:43,051 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-qirxo0f7 7221s 2024-11-23 22:19:43,052 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:19:43,054 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46527 7221s 2024-11-23 22:19:43,054 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46527 7221s 2024-11-23 22:19:43,054 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:19:43,054 - distributed.worker - INFO - dashboard at: 127.0.0.1:36243 7221s 2024-11-23 22:19:43,054 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37981 7221s 2024-11-23 22:19:43,054 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:19:43,054 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:19:43,054 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:19:43,054 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-3f3q69_l 7221s 2024-11-23 22:19:43,054 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:19:43,055 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39065. Reason: failure-to-start- 7221s 2024-11-23 22:19:43,055 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:19:43,055 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46527. Reason: failure-to-start- 7221s 2024-11-23 22:19:43,056 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:19:43,057 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37981': TLS handshake failed with remote 'tls://127.0.0.1:44412': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:19:43,057 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37981': TLS handshake failed with remote 'tls://127.0.0.1:44424': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:19:43,059 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s 2024-11-23 22:19:44,065 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:19:44,073 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43957 7221s 2024-11-23 22:19:44,073 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43343/status 7221s 2024-11-23 22:19:44,075 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:19:44,089 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44757 7221s 2024-11-23 22:19:44,089 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44757 7221s 2024-11-23 22:19:44,089 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:19:44,089 - distributed.worker - INFO - dashboard at: 127.0.0.1:40517 7221s 2024-11-23 22:19:44,089 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43957 7221s 2024-11-23 22:19:44,089 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:19:44,089 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:19:44,089 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:19:44,089 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-iju9jxih 7221s 2024-11-23 22:19:44,089 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:19:44,091 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40951 7221s 2024-11-23 22:19:44,092 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40951 7221s 2024-11-23 22:19:44,092 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:19:44,092 - distributed.worker - INFO - dashboard at: 127.0.0.1:42707 7221s 2024-11-23 22:19:44,092 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43957 7221s 2024-11-23 22:19:44,092 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:19:44,092 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:19:44,092 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:19:44,092 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-aav0rogq 7221s 2024-11-23 22:19:44,092 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:19:44,093 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44757. Reason: failure-to-start- 7221s 2024-11-23 22:19:44,093 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:19:44,093 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40951. Reason: failure-to-start- 7221s 2024-11-23 22:19:44,094 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:19:44,095 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43957': TLS handshake failed with remote 'tls://127.0.0.1:59772': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:19:44,095 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43957': TLS handshake failed with remote 'tls://127.0.0.1:59780': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:19:44,097 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s 2024-11-23 22:19:45,102 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:19:45,110 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39687 7221s 2024-11-23 22:19:45,110 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39337/status 7221s 2024-11-23 22:19:45,110 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:19:45,127 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44679 7221s 2024-11-23 22:19:45,127 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44679 7221s 2024-11-23 22:19:45,127 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:19:45,127 - distributed.worker - INFO - dashboard at: 127.0.0.1:44627 7221s 2024-11-23 22:19:45,127 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39687 7221s 2024-11-23 22:19:45,127 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:19:45,127 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:19:45,127 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:19:45,127 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-yh9jxi95 7221s 2024-11-23 22:19:45,127 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:19:45,129 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35273 7221s 2024-11-23 22:19:45,130 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35273 7221s 2024-11-23 22:19:45,130 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:19:45,130 - distributed.worker - INFO - dashboard at: 127.0.0.1:40015 7221s 2024-11-23 22:19:45,130 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39687 7221s 2024-11-23 22:19:45,130 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:19:45,130 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:19:45,130 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:19:45,130 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-g2gki7gt 7221s 2024-11-23 22:19:45,130 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:19:45,131 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44679. Reason: failure-to-start- 7221s 2024-11-23 22:19:45,131 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:19:45,131 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35273. Reason: failure-to-start- 7221s 2024-11-23 22:19:45,132 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:19:45,133 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39687': TLS handshake failed with remote 'tls://127.0.0.1:51094': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:19:45,133 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39687': TLS handshake failed with remote 'tls://127.0.0.1:51106': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:19:45,135 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s 2024-11-23 22:19:46,141 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:19:46,148 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45741 7221s 2024-11-23 22:19:46,149 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40233/status 7221s 2024-11-23 22:19:46,149 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:19:46,163 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36505 7221s 2024-11-23 22:19:46,163 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36505 7221s 2024-11-23 22:19:46,163 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:19:46,163 - distributed.worker - INFO - dashboard at: 127.0.0.1:37275 7221s 2024-11-23 22:19:46,163 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45741 7221s 2024-11-23 22:19:46,163 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:19:46,163 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:19:46,163 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:19:46,163 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-6oqvcogv 7221s 2024-11-23 22:19:46,163 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:19:46,165 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35197 7221s 2024-11-23 22:19:46,165 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35197 7221s 2024-11-23 22:19:46,165 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:19:46,166 - distributed.worker - INFO - dashboard at: 127.0.0.1:37151 7221s 2024-11-23 22:19:46,166 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45741 7221s 2024-11-23 22:19:46,166 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:19:46,166 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:19:46,166 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:19:46,166 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-4ttc2msd 7221s 2024-11-23 22:19:46,166 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:19:46,167 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36505. Reason: failure-to-start- 7221s 2024-11-23 22:19:46,167 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:19:46,167 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35197. Reason: failure-to-start- 7221s 2024-11-23 22:19:46,167 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:19:46,169 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45741': TLS handshake failed with remote 'tls://127.0.0.1:41166': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:19:46,169 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45741': TLS handshake failed with remote 'tls://127.0.0.1:41176': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:19:46,171 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s 2024-11-23 22:19:47,177 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:19:47,184 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40257 7221s 2024-11-23 22:19:47,185 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36961/status 7221s 2024-11-23 22:19:47,185 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:19:47,198 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34813 7221s 2024-11-23 22:19:47,199 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34813 7221s 2024-11-23 22:19:47,199 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:19:47,199 - distributed.worker - INFO - dashboard at: 127.0.0.1:35385 7221s 2024-11-23 22:19:47,199 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40257 7221s 2024-11-23 22:19:47,199 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:19:47,199 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:19:47,199 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:19:47,199 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-4kkcvx34 7221s 2024-11-23 22:19:47,199 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:19:47,201 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34121 7221s 2024-11-23 22:19:47,201 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34121 7221s 2024-11-23 22:19:47,201 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:19:47,201 - distributed.worker - INFO - dashboard at: 127.0.0.1:37579 7221s 2024-11-23 22:19:47,201 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40257 7221s 2024-11-23 22:19:47,201 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:19:47,201 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:19:47,201 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:19:47,201 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-gv5j0r54 7221s 2024-11-23 22:19:47,201 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:19:47,202 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34813. Reason: failure-to-start- 7221s 2024-11-23 22:19:47,203 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:19:47,203 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34121. Reason: failure-to-start- 7221s 2024-11-23 22:19:47,203 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:19:47,205 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40257': TLS handshake failed with remote 'tls://127.0.0.1:55474': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:19:47,205 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40257': TLS handshake failed with remote 'tls://127.0.0.1:55476': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:19:47,206 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s 2024-11-23 22:19:48,211 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:19:48,219 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:32941 7221s 2024-11-23 22:19:48,219 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43509/status 7221s 2024-11-23 22:19:48,219 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:19:48,238 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40427 7221s 2024-11-23 22:19:48,238 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40427 7221s 2024-11-23 22:19:48,238 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:19:48,238 - distributed.worker - INFO - dashboard at: 127.0.0.1:41447 7221s 2024-11-23 22:19:48,238 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:32941 7221s 2024-11-23 22:19:48,238 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:19:48,238 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:19:48,238 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:19:48,238 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-57vunyqk 7221s 2024-11-23 22:19:48,238 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:19:48,240 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41145 7221s 2024-11-23 22:19:48,240 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41145 7221s 2024-11-23 22:19:48,240 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:19:48,240 - distributed.worker - INFO - dashboard at: 127.0.0.1:45785 7221s 2024-11-23 22:19:48,240 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:32941 7221s 2024-11-23 22:19:48,240 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:19:48,240 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:19:48,240 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:19:48,240 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-_e25d5za 7221s 2024-11-23 22:19:48,240 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:19:48,242 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40427. Reason: failure-to-start- 7221s 2024-11-23 22:19:48,242 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:19:48,242 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41145. Reason: failure-to-start- 7221s 2024-11-23 22:19:48,242 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:19:48,244 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:32941': TLS handshake failed with remote 'tls://127.0.0.1:52626': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:19:48,244 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:32941': TLS handshake failed with remote 'tls://127.0.0.1:52628': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:19:48,245 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s 2024-11-23 22:19:49,251 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:19:49,258 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39531 7221s 2024-11-23 22:19:49,258 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43015/status 7221s 2024-11-23 22:19:49,258 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:19:49,273 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40209 7221s 2024-11-23 22:19:49,274 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40209 7221s 2024-11-23 22:19:49,274 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:19:49,274 - distributed.worker - INFO - dashboard at: 127.0.0.1:39009 7221s 2024-11-23 22:19:49,274 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39531 7221s 2024-11-23 22:19:49,274 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:19:49,274 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:19:49,274 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:19:49,274 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-_ssxu4x8 7221s 2024-11-23 22:19:49,274 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:19:49,276 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46711 7221s 2024-11-23 22:19:49,276 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46711 7221s 2024-11-23 22:19:49,276 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:19:49,276 - distributed.worker - INFO - dashboard at: 127.0.0.1:35883 7221s 2024-11-23 22:19:49,276 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39531 7221s 2024-11-23 22:19:49,276 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:19:49,276 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:19:49,276 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:19:49,276 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-wcuqi32_ 7221s 2024-11-23 22:19:49,276 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:19:49,278 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40209. Reason: failure-to-start- 7221s 2024-11-23 22:19:49,278 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:19:49,278 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46711. Reason: failure-to-start- 7221s 2024-11-23 22:19:49,278 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:19:49,280 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39531': TLS handshake failed with remote 'tls://127.0.0.1:60014': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:19:49,280 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39531': TLS handshake failed with remote 'tls://127.0.0.1:60018': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:19:49,281 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s 2024-11-23 22:19:50,288 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:19:50,296 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36797 7221s 2024-11-23 22:19:50,296 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40231/status 7221s 2024-11-23 22:19:50,296 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:19:50,311 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:32847 7221s 2024-11-23 22:19:50,311 - distributed.worker - INFO - Listening to: tls://127.0.0.1:32847 7221s 2024-11-23 22:19:50,311 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:19:50,311 - distributed.worker - INFO - dashboard at: 127.0.0.1:40523 7221s 2024-11-23 22:19:50,311 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36797 7221s 2024-11-23 22:19:50,311 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:19:50,311 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:19:50,311 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:19:50,311 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-5o69is0u 7221s 2024-11-23 22:19:50,311 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:19:50,313 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42341 7221s 2024-11-23 22:19:50,313 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42341 7221s 2024-11-23 22:19:50,314 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:19:50,314 - distributed.worker - INFO - dashboard at: 127.0.0.1:34631 7221s 2024-11-23 22:19:50,314 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36797 7221s 2024-11-23 22:19:50,314 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:19:50,314 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:19:50,314 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:19:50,314 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-4sdg897u 7221s 2024-11-23 22:19:50,314 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:19:50,315 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:32847. Reason: failure-to-start- 7221s 2024-11-23 22:19:50,315 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:19:50,315 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42341. Reason: failure-to-start- 7221s 2024-11-23 22:19:50,315 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:19:50,317 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36797': TLS handshake failed with remote 'tls://127.0.0.1:58712': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:19:50,317 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36797': TLS handshake failed with remote 'tls://127.0.0.1:58714': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:19:50,319 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s 2024-11-23 22:19:51,326 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:19:51,334 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35443 7221s 2024-11-23 22:19:51,335 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36101/status 7221s 2024-11-23 22:19:51,335 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:19:51,351 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40869 7221s 2024-11-23 22:19:51,351 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40869 7221s 2024-11-23 22:19:51,351 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:19:51,352 - distributed.worker - INFO - dashboard at: 127.0.0.1:41111 7221s 2024-11-23 22:19:51,352 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35443 7221s 2024-11-23 22:19:51,352 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:19:51,352 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:19:51,352 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:19:51,352 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-tpb0iqsq 7221s 2024-11-23 22:19:51,352 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:19:51,354 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34621 7221s 2024-11-23 22:19:51,354 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34621 7221s 2024-11-23 22:19:51,354 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:19:51,354 - distributed.worker - INFO - dashboard at: 127.0.0.1:46107 7221s 2024-11-23 22:19:51,354 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35443 7221s 2024-11-23 22:19:51,355 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:19:51,355 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:19:51,355 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:19:51,355 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-e_mq8qv0 7221s 2024-11-23 22:19:51,355 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:19:51,356 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40869. Reason: failure-to-start- 7221s 2024-11-23 22:19:51,356 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:19:51,357 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34621. Reason: failure-to-start- 7221s 2024-11-23 22:19:51,357 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:19:51,358 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35443': TLS handshake failed with remote 'tls://127.0.0.1:51286': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:19:51,358 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35443': TLS handshake failed with remote 'tls://127.0.0.1:51296': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:19:51,360 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s 2024-11-23 22:19:52,367 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:19:52,378 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42635 7221s 2024-11-23 22:19:52,379 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37775/status 7221s 2024-11-23 22:19:52,379 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:19:52,403 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41635 7221s 2024-11-23 22:19:52,403 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41635 7221s 2024-11-23 22:19:52,403 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:19:52,403 - distributed.worker - INFO - dashboard at: 127.0.0.1:41961 7221s 2024-11-23 22:19:52,404 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42635 7221s 2024-11-23 22:19:52,404 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:19:52,404 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:19:52,404 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:19:52,404 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ux8h076q 7221s 2024-11-23 22:19:52,404 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:19:52,407 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38979 7221s 2024-11-23 22:19:52,407 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38979 7221s 2024-11-23 22:19:52,407 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:19:52,407 - distributed.worker - INFO - dashboard at: 127.0.0.1:33523 7221s 2024-11-23 22:19:52,407 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42635 7221s 2024-11-23 22:19:52,407 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:19:52,407 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:19:52,408 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:19:52,408 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-284g5bo9 7221s 2024-11-23 22:19:52,408 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:19:52,410 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41635. Reason: failure-to-start- 7221s 2024-11-23 22:19:52,410 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:19:52,410 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38979. Reason: failure-to-start- 7221s 2024-11-23 22:19:52,411 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:19:52,413 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42635': TLS handshake failed with remote 'tls://127.0.0.1:58466': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:19:52,413 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42635': TLS handshake failed with remote 'tls://127.0.0.1:58480': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:19:52,416 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s 2024-11-23 22:19:53,424 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:19:53,436 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41071 7221s 2024-11-23 22:19:53,437 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33021/status 7221s 2024-11-23 22:19:53,437 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:19:53,462 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45301 7221s 2024-11-23 22:19:53,462 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45301 7221s 2024-11-23 22:19:53,462 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:19:53,462 - distributed.worker - INFO - dashboard at: 127.0.0.1:38363 7221s 2024-11-23 22:19:53,462 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41071 7221s 2024-11-23 22:19:53,462 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:19:53,462 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:19:53,462 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:19:53,462 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-7mxoo4x_ 7221s 2024-11-23 22:19:53,463 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:19:53,466 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45891 7221s 2024-11-23 22:19:53,466 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45891 7221s 2024-11-23 22:19:53,466 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:19:53,466 - distributed.worker - INFO - dashboard at: 127.0.0.1:43205 7221s 2024-11-23 22:19:53,466 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41071 7221s 2024-11-23 22:19:53,466 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:19:53,466 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:19:53,466 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:19:53,466 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-p1i3mr41 7221s 2024-11-23 22:19:53,467 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:19:53,472 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45301. Reason: failure-to-start- 7221s 2024-11-23 22:19:53,472 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:19:53,473 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45891. Reason: failure-to-start- 7221s 2024-11-23 22:19:53,473 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:19:53,476 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41071': TLS handshake failed with remote 'tls://127.0.0.1:34696': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:19:53,476 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41071': TLS handshake failed with remote 'tls://127.0.0.1:34712': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:19:53,479 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s 2024-11-23 22:19:54,487 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:19:54,498 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43347 7221s 2024-11-23 22:19:54,499 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38419/status 7221s 2024-11-23 22:19:54,499 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:19:54,521 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40841 7221s 2024-11-23 22:19:54,522 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40841 7221s 2024-11-23 22:19:54,522 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:19:54,522 - distributed.worker - INFO - dashboard at: 127.0.0.1:39775 7221s 2024-11-23 22:19:54,522 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43347 7221s 2024-11-23 22:19:54,522 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:19:54,522 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:19:54,522 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:19:54,522 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-4bajbayo 7221s 2024-11-23 22:19:54,522 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:19:54,526 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43223 7221s 2024-11-23 22:19:54,526 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43223 7221s 2024-11-23 22:19:54,526 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:19:54,526 - distributed.worker - INFO - dashboard at: 127.0.0.1:33271 7221s 2024-11-23 22:19:54,526 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43347 7221s 2024-11-23 22:19:54,526 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:19:54,526 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:19:54,526 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:19:54,526 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-3okvtrlb 7221s 2024-11-23 22:19:54,526 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:19:54,533 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40841. Reason: failure-to-start- 7221s 2024-11-23 22:19:54,534 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:19:54,535 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43223. Reason: failure-to-start- 7221s 2024-11-23 22:19:54,535 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:19:54,538 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43347': TLS handshake failed with remote 'tls://127.0.0.1:34598': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:19:54,538 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43347': TLS handshake failed with remote 'tls://127.0.0.1:34608': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:19:54,545 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s 2024-11-23 22:19:55,552 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:19:55,564 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44555 7221s 2024-11-23 22:19:55,564 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40535/status 7221s 2024-11-23 22:19:55,565 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:19:55,587 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:32773 7221s 2024-11-23 22:19:55,587 - distributed.worker - INFO - Listening to: tls://127.0.0.1:32773 7221s 2024-11-23 22:19:55,587 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:19:55,587 - distributed.worker - INFO - dashboard at: 127.0.0.1:33699 7221s 2024-11-23 22:19:55,587 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44555 7221s 2024-11-23 22:19:55,587 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:19:55,588 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:19:55,588 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:19:55,588 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-lua0xuz9 7221s 2024-11-23 22:19:55,588 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:19:55,591 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42813 7221s 2024-11-23 22:19:55,591 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42813 7221s 2024-11-23 22:19:55,591 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:19:55,592 - distributed.worker - INFO - dashboard at: 127.0.0.1:44441 7221s 2024-11-23 22:19:55,592 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44555 7221s 2024-11-23 22:19:55,592 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:19:55,592 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:19:55,592 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:19:55,592 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-mzq19vfx 7221s 2024-11-23 22:19:55,592 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:19:55,597 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:32773. Reason: failure-to-start- 7221s 2024-11-23 22:19:55,598 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:19:55,598 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42813. Reason: failure-to-start- 7221s 2024-11-23 22:19:55,599 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:19:55,602 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44555': TLS handshake failed with remote 'tls://127.0.0.1:46194': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:19:55,602 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44555': TLS handshake failed with remote 'tls://127.0.0.1:46204': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:19:55,605 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s 2024-11-23 22:19:56,613 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:19:56,626 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34715 7221s 2024-11-23 22:19:56,627 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37797/status 7221s 2024-11-23 22:19:56,627 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:19:56,653 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44583 7221s 2024-11-23 22:19:56,654 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44583 7221s 2024-11-23 22:19:56,654 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:19:56,654 - distributed.worker - INFO - dashboard at: 127.0.0.1:40037 7221s 2024-11-23 22:19:56,654 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34715 7221s 2024-11-23 22:19:56,654 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:19:56,654 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:19:56,654 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:19:56,654 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-zfaeargv 7221s 2024-11-23 22:19:56,654 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:19:56,657 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39735 7221s 2024-11-23 22:19:56,658 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39735 7221s 2024-11-23 22:19:56,658 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:19:56,658 - distributed.worker - INFO - dashboard at: 127.0.0.1:46445 7221s 2024-11-23 22:19:56,658 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34715 7221s 2024-11-23 22:19:56,658 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:19:56,658 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:19:56,658 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:19:56,658 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-i_aou8lj 7221s 2024-11-23 22:19:56,658 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:19:56,664 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44583. Reason: failure-to-start- 7221s 2024-11-23 22:19:56,664 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:19:56,665 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39735. Reason: failure-to-start- 7221s 2024-11-23 22:19:56,666 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:19:56,668 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34715': TLS handshake failed with remote 'tls://127.0.0.1:54124': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:19:56,669 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34715': TLS handshake failed with remote 'tls://127.0.0.1:54126': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:19:56,671 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s 2024-11-23 22:19:57,679 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:19:57,690 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38799 7221s 2024-11-23 22:19:57,691 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42719/status 7221s 2024-11-23 22:19:57,692 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:19:57,719 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34019 7221s 2024-11-23 22:19:57,719 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34019 7221s 2024-11-23 22:19:57,719 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:19:57,719 - distributed.worker - INFO - dashboard at: 127.0.0.1:43755 7221s 2024-11-23 22:19:57,719 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38799 7221s 2024-11-23 22:19:57,720 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:19:57,720 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:19:57,720 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:19:57,720 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-hut0k42y 7221s 2024-11-23 22:19:57,720 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:19:57,723 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35801 7221s 2024-11-23 22:19:57,723 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35801 7221s 2024-11-23 22:19:57,723 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:19:57,724 - distributed.worker - INFO - dashboard at: 127.0.0.1:35863 7221s 2024-11-23 22:19:57,724 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38799 7221s 2024-11-23 22:19:57,724 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:19:57,724 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:19:57,724 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:19:57,724 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-vbusfig4 7221s 2024-11-23 22:19:57,724 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:19:57,726 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34019. Reason: failure-to-start- 7221s 2024-11-23 22:19:57,726 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:19:57,727 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35801. Reason: failure-to-start- 7221s 2024-11-23 22:19:57,728 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:19:57,733 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38799': TLS handshake failed with remote 'tls://127.0.0.1:32906': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:19:57,733 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38799': TLS handshake failed with remote 'tls://127.0.0.1:32922': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:19:57,736 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s 2024-11-23 22:19:58,744 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:19:58,754 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41995 7221s 2024-11-23 22:19:58,754 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44789/status 7221s 2024-11-23 22:19:58,755 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:19:58,774 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33205 7221s 2024-11-23 22:19:58,774 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33205 7221s 2024-11-23 22:19:58,774 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:19:58,774 - distributed.worker - INFO - dashboard at: 127.0.0.1:36281 7221s 2024-11-23 22:19:58,774 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41995 7221s 2024-11-23 22:19:58,775 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:19:58,775 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:19:58,775 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:19:58,775 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-bi2md6ez 7221s 2024-11-23 22:19:58,776 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:19:58,780 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:32777 7221s 2024-11-23 22:19:58,780 - distributed.worker - INFO - Listening to: tls://127.0.0.1:32777 7221s 2024-11-23 22:19:58,780 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:19:58,780 - distributed.worker - INFO - dashboard at: 127.0.0.1:34057 7221s 2024-11-23 22:19:58,780 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41995 7221s 2024-11-23 22:19:58,780 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:19:58,780 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:19:58,780 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:19:58,781 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-51q1gc1n 7221s 2024-11-23 22:19:58,781 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:19:58,785 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33205. Reason: failure-to-start- 7221s 2024-11-23 22:19:58,786 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:19:58,787 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:32777. Reason: failure-to-start- 7221s 2024-11-23 22:19:58,787 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:19:58,790 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41995': TLS handshake failed with remote 'tls://127.0.0.1:58314': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:19:58,790 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41995': TLS handshake failed with remote 'tls://127.0.0.1:58324': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:19:58,792 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s 2024-11-23 22:19:59,799 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:19:59,806 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44683 7221s 2024-11-23 22:19:59,806 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33735/status 7221s 2024-11-23 22:19:59,806 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:19:59,822 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43321 7221s 2024-11-23 22:19:59,822 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43321 7221s 2024-11-23 22:19:59,822 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:19:59,822 - distributed.worker - INFO - dashboard at: 127.0.0.1:33721 7221s 2024-11-23 22:19:59,822 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44683 7221s 2024-11-23 22:19:59,822 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:19:59,822 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:19:59,822 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:19:59,823 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-056q1_x1 7221s 2024-11-23 22:19:59,823 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:19:59,825 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45785 7221s 2024-11-23 22:19:59,825 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45785 7221s 2024-11-23 22:19:59,825 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:19:59,825 - distributed.worker - INFO - dashboard at: 127.0.0.1:41053 7221s 2024-11-23 22:19:59,825 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44683 7221s 2024-11-23 22:19:59,825 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:19:59,825 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:19:59,825 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:19:59,825 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ypcjrtpr 7221s 2024-11-23 22:19:59,825 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:19:59,827 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43321. Reason: failure-to-start- 7221s 2024-11-23 22:19:59,827 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:19:59,828 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45785. Reason: failure-to-start- 7221s 2024-11-23 22:19:59,828 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:19:59,830 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44683': TLS handshake failed with remote 'tls://127.0.0.1:50626': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:19:59,830 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44683': TLS handshake failed with remote 'tls://127.0.0.1:50638': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:19:59,831 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s 2024-11-23 22:20:00,839 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:20:00,849 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41511 7221s 2024-11-23 22:20:00,850 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36929/status 7221s 2024-11-23 22:20:00,850 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:20:00,875 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46451 7221s 2024-11-23 22:20:00,875 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46451 7221s 2024-11-23 22:20:00,875 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:20:00,876 - distributed.worker - INFO - dashboard at: 127.0.0.1:45673 7221s 2024-11-23 22:20:00,876 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41511 7221s 2024-11-23 22:20:00,876 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:20:00,876 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:20:00,876 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:20:00,876 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-j4xo7djj 7221s 2024-11-23 22:20:00,876 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:20:00,879 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40607 7221s 2024-11-23 22:20:00,880 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40607 7221s 2024-11-23 22:20:00,880 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:20:00,880 - distributed.worker - INFO - dashboard at: 127.0.0.1:35437 7221s 2024-11-23 22:20:00,880 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41511 7221s 2024-11-23 22:20:00,880 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:20:00,880 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:20:00,880 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:20:00,880 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-n6ip8l2n 7221s 2024-11-23 22:20:00,880 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:20:00,883 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46451. Reason: failure-to-start- 7221s 2024-11-23 22:20:00,883 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:20:00,884 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40607. Reason: failure-to-start- 7221s 2024-11-23 22:20:00,886 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:20:00,892 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41511': TLS handshake failed with remote 'tls://127.0.0.1:60758': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:20:00,893 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41511': TLS handshake failed with remote 'tls://127.0.0.1:60772': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:20:00,895 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s 2024-11-23 22:20:01,903 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:20:01,914 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45885 7221s 2024-11-23 22:20:01,914 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39839/status 7221s 2024-11-23 22:20:01,915 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:20:01,937 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45395 7221s 2024-11-23 22:20:01,937 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45395 7221s 2024-11-23 22:20:01,937 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:20:01,937 - distributed.worker - INFO - dashboard at: 127.0.0.1:36457 7221s 2024-11-23 22:20:01,937 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45885 7221s 2024-11-23 22:20:01,937 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:20:01,938 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:20:01,938 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:20:01,938 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-5l1i42m8 7221s 2024-11-23 22:20:01,938 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:20:01,941 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43063 7221s 2024-11-23 22:20:01,941 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43063 7221s 2024-11-23 22:20:01,941 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:20:01,942 - distributed.worker - INFO - dashboard at: 127.0.0.1:34311 7221s 2024-11-23 22:20:01,942 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45885 7221s 2024-11-23 22:20:01,942 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:20:01,942 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:20:01,942 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:20:01,942 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-v8lghmnx 7221s 2024-11-23 22:20:01,942 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:20:01,944 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45395. Reason: failure-to-start- 7221s 2024-11-23 22:20:01,944 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:20:01,945 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43063. Reason: failure-to-start- 7221s 2024-11-23 22:20:01,946 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:20:01,952 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45885': TLS handshake failed with remote 'tls://127.0.0.1:45092': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:20:01,952 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45885': TLS handshake failed with remote 'tls://127.0.0.1:45104': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:20:01,956 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s 2024-11-23 22:20:02,967 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:20:02,976 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33401 7221s 2024-11-23 22:20:02,977 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36171/status 7221s 2024-11-23 22:20:02,978 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:20:02,998 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40903 7221s 2024-11-23 22:20:02,999 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40903 7221s 2024-11-23 22:20:02,999 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:20:02,999 - distributed.worker - INFO - dashboard at: 127.0.0.1:39349 7221s 2024-11-23 22:20:02,999 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33401 7221s 2024-11-23 22:20:02,999 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:20:02,999 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:20:02,999 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:20:02,999 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ay3rtqvf 7221s 2024-11-23 22:20:02,999 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:20:03,003 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38387 7221s 2024-11-23 22:20:03,003 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38387 7221s 2024-11-23 22:20:03,003 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:20:03,003 - distributed.worker - INFO - dashboard at: 127.0.0.1:39041 7221s 2024-11-23 22:20:03,003 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33401 7221s 2024-11-23 22:20:03,003 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:20:03,003 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:20:03,004 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:20:03,004 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ua3lvutt 7221s 2024-11-23 22:20:03,004 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:20:03,006 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40903. Reason: failure-to-start- 7221s 2024-11-23 22:20:03,006 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:20:03,007 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38387. Reason: failure-to-start- 7221s 2024-11-23 22:20:03,008 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:20:03,016 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33401': TLS handshake failed with remote 'tls://127.0.0.1:41384': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:20:03,017 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33401': TLS handshake failed with remote 'tls://127.0.0.1:41400': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:20:03,020 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s 2024-11-23 22:20:04,027 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:20:04,038 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36365 7221s 2024-11-23 22:20:04,039 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34321/status 7221s 2024-11-23 22:20:04,039 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:20:04,087 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37015 7221s 2024-11-23 22:20:04,088 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37015 7221s 2024-11-23 22:20:04,088 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:20:04,088 - distributed.worker - INFO - dashboard at: 127.0.0.1:33583 7221s 2024-11-23 22:20:04,088 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36365 7221s 2024-11-23 22:20:04,088 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:20:04,088 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:20:04,088 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:20:04,088 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-1xo12qvq 7221s 2024-11-23 22:20:04,088 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:20:04,092 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33997 7221s 2024-11-23 22:20:04,092 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33997 7221s 2024-11-23 22:20:04,092 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:20:04,092 - distributed.worker - INFO - dashboard at: 127.0.0.1:46789 7221s 2024-11-23 22:20:04,092 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36365 7221s 2024-11-23 22:20:04,092 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:20:04,092 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:20:04,092 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:20:04,092 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-t5cl9d2e 7221s 2024-11-23 22:20:04,092 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:20:04,102 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37015. Reason: failure-to-start- 7221s 2024-11-23 22:20:04,102 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:20:04,103 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33997. Reason: failure-to-start- 7221s 2024-11-23 22:20:04,103 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:20:04,106 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36365': TLS handshake failed with remote 'tls://127.0.0.1:58878': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:20:04,106 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36365': TLS handshake failed with remote 'tls://127.0.0.1:58880': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:20:04,109 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s 2024-11-23 22:20:05,118 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:20:05,128 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46289 7221s 2024-11-23 22:20:05,129 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35593/status 7221s 2024-11-23 22:20:05,129 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:20:05,150 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37815 7221s 2024-11-23 22:20:05,151 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37815 7221s 2024-11-23 22:20:05,151 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:20:05,151 - distributed.worker - INFO - dashboard at: 127.0.0.1:40235 7221s 2024-11-23 22:20:05,151 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46289 7221s 2024-11-23 22:20:05,151 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:20:05,151 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:20:05,151 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:20:05,151 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-5nra_96u 7221s 2024-11-23 22:20:05,153 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:20:05,157 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43275 7221s 2024-11-23 22:20:05,157 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43275 7221s 2024-11-23 22:20:05,157 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:20:05,157 - distributed.worker - INFO - dashboard at: 127.0.0.1:34727 7221s 2024-11-23 22:20:05,157 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46289 7221s 2024-11-23 22:20:05,157 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:20:05,157 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:20:05,158 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:20:05,158 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ux7pohfa 7221s 2024-11-23 22:20:05,158 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:20:05,164 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37815. Reason: failure-to-start- 7221s 2024-11-23 22:20:05,164 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:20:05,164 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43275. Reason: failure-to-start- 7221s 2024-11-23 22:20:05,165 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:20:05,171 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46289': TLS handshake failed with remote 'tls://127.0.0.1:50920': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:20:05,171 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46289': TLS handshake failed with remote 'tls://127.0.0.1:50932': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:20:05,174 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s 2024-11-23 22:20:06,181 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:20:06,188 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46287 7221s 2024-11-23 22:20:06,189 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38031/status 7221s 2024-11-23 22:20:06,189 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:20:06,206 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43809 7221s 2024-11-23 22:20:06,206 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43809 7221s 2024-11-23 22:20:06,206 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:20:06,206 - distributed.worker - INFO - dashboard at: 127.0.0.1:41901 7221s 2024-11-23 22:20:06,206 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46287 7221s 2024-11-23 22:20:06,206 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:20:06,206 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:20:06,206 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:20:06,206 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-z__nhwfm 7221s 2024-11-23 22:20:06,206 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:20:06,208 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36831 7221s 2024-11-23 22:20:06,208 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36831 7221s 2024-11-23 22:20:06,209 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:20:06,209 - distributed.worker - INFO - dashboard at: 127.0.0.1:41259 7221s 2024-11-23 22:20:06,209 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46287 7221s 2024-11-23 22:20:06,209 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:20:06,209 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:20:06,209 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:20:06,209 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-fpvewn7k 7221s 2024-11-23 22:20:06,209 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:20:06,213 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43809. Reason: failure-to-start- 7221s 2024-11-23 22:20:06,213 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:20:06,214 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36831. Reason: failure-to-start- 7221s 2024-11-23 22:20:06,214 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:20:06,215 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46287': TLS handshake failed with remote 'tls://127.0.0.1:36776': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:20:06,216 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46287': TLS handshake failed with remote 'tls://127.0.0.1:36778': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:20:06,218 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s 2024-11-23 22:20:07,225 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:20:07,234 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35661 7221s 2024-11-23 22:20:07,234 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35241/status 7221s 2024-11-23 22:20:07,234 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:20:07,249 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34433 7221s 2024-11-23 22:20:07,249 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34433 7221s 2024-11-23 22:20:07,249 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:20:07,249 - distributed.worker - INFO - dashboard at: 127.0.0.1:42025 7221s 2024-11-23 22:20:07,249 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35661 7221s 2024-11-23 22:20:07,249 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:20:07,249 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:20:07,249 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:20:07,249 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-_hdxdz8i 7221s 2024-11-23 22:20:07,249 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:20:07,251 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46481 7221s 2024-11-23 22:20:07,252 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46481 7221s 2024-11-23 22:20:07,252 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:20:07,252 - distributed.worker - INFO - dashboard at: 127.0.0.1:39555 7221s 2024-11-23 22:20:07,252 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35661 7221s 2024-11-23 22:20:07,252 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:20:07,252 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:20:07,252 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:20:07,252 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-3jw24me1 7221s 2024-11-23 22:20:07,252 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:20:07,253 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34433. Reason: failure-to-start- 7221s 2024-11-23 22:20:07,253 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:20:07,254 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46481. Reason: failure-to-start- 7221s 2024-11-23 22:20:07,254 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:20:07,256 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35661': TLS handshake failed with remote 'tls://127.0.0.1:54846': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:20:07,256 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35661': TLS handshake failed with remote 'tls://127.0.0.1:54852': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:20:07,262 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s 2024-11-23 22:20:08,268 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:20:08,275 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35157 7221s 2024-11-23 22:20:08,275 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46853/status 7221s 2024-11-23 22:20:08,275 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:20:08,291 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33109 7221s 2024-11-23 22:20:08,291 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33109 7221s 2024-11-23 22:20:08,291 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:20:08,292 - distributed.worker - INFO - dashboard at: 127.0.0.1:39695 7221s 2024-11-23 22:20:08,292 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35157 7221s 2024-11-23 22:20:08,292 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:20:08,292 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:20:08,292 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:20:08,292 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-_um235sg 7221s 2024-11-23 22:20:08,292 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:20:08,294 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37823 7221s 2024-11-23 22:20:08,294 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37823 7221s 2024-11-23 22:20:08,294 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:20:08,294 - distributed.worker - INFO - dashboard at: 127.0.0.1:35411 7221s 2024-11-23 22:20:08,294 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35157 7221s 2024-11-23 22:20:08,294 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:20:08,294 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:20:08,294 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:20:08,294 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-_crz3z8t 7221s 2024-11-23 22:20:08,294 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:20:08,296 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33109. Reason: failure-to-start- 7221s 2024-11-23 22:20:08,296 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:20:08,296 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37823. Reason: failure-to-start- 7221s 2024-11-23 22:20:08,296 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:20:08,298 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35157': TLS handshake failed with remote 'tls://127.0.0.1:46956': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:20:08,298 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35157': TLS handshake failed with remote 'tls://127.0.0.1:46964': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:20:08,303 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s 2024-11-23 22:20:09,308 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:20:09,315 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37399 7221s 2024-11-23 22:20:09,315 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42933/status 7221s 2024-11-23 22:20:09,316 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:20:09,331 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39367 7221s 2024-11-23 22:20:09,331 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39367 7221s 2024-11-23 22:20:09,331 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:20:09,331 - distributed.worker - INFO - dashboard at: 127.0.0.1:43821 7221s 2024-11-23 22:20:09,331 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37399 7221s 2024-11-23 22:20:09,331 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:20:09,331 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:20:09,331 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:20:09,331 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-guzeamc2 7221s 2024-11-23 22:20:09,331 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:20:09,333 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45181 7221s 2024-11-23 22:20:09,333 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45181 7221s 2024-11-23 22:20:09,333 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:20:09,334 - distributed.worker - INFO - dashboard at: 127.0.0.1:41275 7221s 2024-11-23 22:20:09,334 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37399 7221s 2024-11-23 22:20:09,334 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:20:09,334 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:20:09,334 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:20:09,334 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-chygadf1 7221s 2024-11-23 22:20:09,334 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:20:09,336 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39367. Reason: failure-to-start- 7221s 2024-11-23 22:20:09,336 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:20:09,337 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45181. Reason: failure-to-start- 7221s 2024-11-23 22:20:09,337 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:20:09,341 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37399': TLS handshake failed with remote 'tls://127.0.0.1:34460': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:20:09,341 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37399': TLS handshake failed with remote 'tls://127.0.0.1:34464': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:20:09,343 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s 2024-11-23 22:20:10,349 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:20:10,360 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40579 7221s 2024-11-23 22:20:10,360 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38137/status 7221s 2024-11-23 22:20:10,361 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:20:10,384 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37715 7221s 2024-11-23 22:20:10,385 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37715 7221s 2024-11-23 22:20:10,385 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:20:10,385 - distributed.worker - INFO - dashboard at: 127.0.0.1:35833 7221s 2024-11-23 22:20:10,385 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40579 7221s 2024-11-23 22:20:10,385 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:20:10,385 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:20:10,385 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:20:10,385 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ymz134qf 7221s 2024-11-23 22:20:10,385 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:20:10,388 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46299 7221s 2024-11-23 22:20:10,389 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46299 7221s 2024-11-23 22:20:10,389 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:20:10,389 - distributed.worker - INFO - dashboard at: 127.0.0.1:35461 7221s 2024-11-23 22:20:10,389 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40579 7221s 2024-11-23 22:20:10,389 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:20:10,389 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:20:10,389 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:20:10,389 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-z12f3s92 7221s 2024-11-23 22:20:10,389 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:20:10,395 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37715. Reason: failure-to-start- 7221s 2024-11-23 22:20:10,395 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:20:10,396 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46299. Reason: failure-to-start- 7221s 2024-11-23 22:20:10,397 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:20:10,399 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40579': TLS handshake failed with remote 'tls://127.0.0.1:53800': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:20:10,399 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40579': TLS handshake failed with remote 'tls://127.0.0.1:53816': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:20:10,402 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s 2024-11-23 22:20:11,410 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:20:11,423 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42721 7221s 2024-11-23 22:20:11,424 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45295/status 7221s 2024-11-23 22:20:11,425 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:20:11,449 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42629 7221s 2024-11-23 22:20:11,450 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42629 7221s 2024-11-23 22:20:11,450 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:20:11,450 - distributed.worker - INFO - dashboard at: 127.0.0.1:34563 7221s 2024-11-23 22:20:11,450 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42721 7221s 2024-11-23 22:20:11,450 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:20:11,450 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:20:11,450 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:20:11,450 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-yc5w2izw 7221s 2024-11-23 22:20:11,450 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:20:11,454 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:32811 7221s 2024-11-23 22:20:11,454 - distributed.worker - INFO - Listening to: tls://127.0.0.1:32811 7221s 2024-11-23 22:20:11,454 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:20:11,454 - distributed.worker - INFO - dashboard at: 127.0.0.1:39441 7221s 2024-11-23 22:20:11,454 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42721 7221s 2024-11-23 22:20:11,454 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:20:11,454 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:20:11,454 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:20:11,454 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-0d4hf8gb 7221s 2024-11-23 22:20:11,455 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:20:11,460 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42629. Reason: failure-to-start- 7221s 2024-11-23 22:20:11,460 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:20:11,461 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:32811. Reason: failure-to-start- 7221s 2024-11-23 22:20:11,462 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:20:11,464 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42721': TLS handshake failed with remote 'tls://127.0.0.1:58912': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:20:11,464 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42721': TLS handshake failed with remote 'tls://127.0.0.1:58916': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:20:11,471 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s 2024-11-23 22:20:12,477 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:20:12,488 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40337 7221s 2024-11-23 22:20:12,488 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40595/status 7221s 2024-11-23 22:20:12,489 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:20:12,517 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35675 7221s 2024-11-23 22:20:12,517 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35675 7221s 2024-11-23 22:20:12,518 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:20:12,518 - distributed.worker - INFO - dashboard at: 127.0.0.1:36467 7221s 2024-11-23 22:20:12,518 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40337 7221s 2024-11-23 22:20:12,518 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:20:12,518 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:20:12,518 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:20:12,518 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-wsmdihtf 7221s 2024-11-23 22:20:12,518 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:20:12,521 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44505 7221s 2024-11-23 22:20:12,522 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44505 7221s 2024-11-23 22:20:12,522 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:20:12,522 - distributed.worker - INFO - dashboard at: 127.0.0.1:42333 7221s 2024-11-23 22:20:12,522 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40337 7221s 2024-11-23 22:20:12,522 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:20:12,522 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:20:12,522 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:20:12,522 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-z6plqlth 7221s 2024-11-23 22:20:12,522 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:20:12,531 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35675. Reason: failure-to-start- 7221s 2024-11-23 22:20:12,531 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:20:12,532 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44505. Reason: failure-to-start- 7221s 2024-11-23 22:20:12,532 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:20:12,535 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40337': TLS handshake failed with remote 'tls://127.0.0.1:51064': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:20:12,535 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40337': TLS handshake failed with remote 'tls://127.0.0.1:51076': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:20:12,542 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s ______________________________ test_client_submit ______________________________ 7221s 7221s fut = , timeout = 0 7221s 7221s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 7221s async with asyncio.timeout(timeout): 7221s > return await fut 7221s 7221s /usr/lib/python3/dist-packages/distributed/utils.py:1960: 7221s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7221s /usr/lib/python3/dist-packages/distributed/worker.py:1480: in start_unsafe 7221s await self._register_with_scheduler() 7221s /usr/lib/python3/dist-packages/distributed/worker.py:1179: in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s /usr/lib/python3/dist-packages/distributed/comm/core.py:342: in connect 7221s comm = await wait_for( 7221s /usr/lib/python3/dist-packages/distributed/utils.py:1960: in wait_for 7221s return await fut 7221s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:546: in connect 7221s stream = await self.client.connect( 7221s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7221s 7221s self = , host = '127.0.0.1' 7221s port = 36023, af = 7221s ssl_options = 7221s max_buffer_size = 8364507136.0, source_ip = None, source_port = None 7221s timeout = None 7221s 7221s async def connect( 7221s self, 7221s host: str, 7221s port: int, 7221s af: socket.AddressFamily = socket.AF_UNSPEC, 7221s ssl_options: Optional[Union[Dict[str, Any], ssl.SSLContext]] = None, 7221s max_buffer_size: Optional[int] = None, 7221s source_ip: Optional[str] = None, 7221s source_port: Optional[int] = None, 7221s timeout: Optional[Union[float, datetime.timedelta]] = None, 7221s ) -> IOStream: 7221s """Connect to the given host and port. 7221s 7221s Asynchronously returns an `.IOStream` (or `.SSLIOStream` if 7221s ``ssl_options`` is not None). 7221s 7221s Using the ``source_ip`` kwarg, one can specify the source 7221s IP address to use when establishing the connection. 7221s In case the user needs to resolve and 7221s use a specific interface, it has to be handled outside 7221s of Tornado as this depends very much on the platform. 7221s 7221s Raises `TimeoutError` if the input future does not complete before 7221s ``timeout``, which may be specified in any form allowed by 7221s `.IOLoop.add_timeout` (i.e. a `datetime.timedelta` or an absolute time 7221s relative to `.IOLoop.time`) 7221s 7221s Similarly, when the user requires a certain source port, it can 7221s be specified using the ``source_port`` arg. 7221s 7221s .. versionchanged:: 4.5 7221s Added the ``source_ip`` and ``source_port`` arguments. 7221s 7221s .. versionchanged:: 5.0 7221s Added the ``timeout`` argument. 7221s """ 7221s if timeout is not None: 7221s if isinstance(timeout, numbers.Real): 7221s timeout = IOLoop.current().time() + timeout 7221s elif isinstance(timeout, datetime.timedelta): 7221s timeout = IOLoop.current().time() + timeout.total_seconds() 7221s else: 7221s raise TypeError("Unsupported timeout %r" % timeout) 7221s if timeout is not None: 7221s addrinfo = await gen.with_timeout( 7221s timeout, self.resolver.resolve(host, port, af) 7221s ) 7221s else: 7221s addrinfo = await self.resolver.resolve(host, port, af) 7221s connector = _Connector( 7221s addrinfo, 7221s functools.partial( 7221s self._create_stream, 7221s max_buffer_size, 7221s source_ip=source_ip, 7221s source_port=source_port, 7221s ), 7221s ) 7221s > af, addr, stream = await connector.start(connect_timeout=timeout) 7221s E asyncio.exceptions.CancelledError 7221s 7221s /usr/lib/python3/dist-packages/tornado/tcpclient.py:279: CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s self = 7221s 7221s @final 7221s async def start(self): 7221s async with self._startup_lock: 7221s if self.status == Status.failed: 7221s assert self.__startup_exc is not None 7221s raise self.__startup_exc 7221s elif self.status != Status.init: 7221s return self 7221s timeout = getattr(self, "death_timeout", None) 7221s 7221s async def _close_on_failure(exc: Exception) -> None: 7221s await self.close(reason=f"failure-to-start-{str(type(exc))}") 7221s self.status = Status.failed 7221s self.__startup_exc = exc 7221s 7221s try: 7221s > await wait_for(self.start_unsafe(), timeout=timeout) 7221s 7221s /usr/lib/python3/dist-packages/distributed/core.py:664: 7221s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7221s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 7221s async with asyncio.timeout(timeout): 7221s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7221s 7221s self = 7221s exc_type = 7221s exc_val = CancelledError(), exc_tb = 7221s 7221s async def __aexit__( 7221s self, 7221s exc_type: Optional[Type[BaseException]], 7221s exc_val: Optional[BaseException], 7221s exc_tb: Optional[TracebackType], 7221s ) -> Optional[bool]: 7221s assert self._state in (_State.ENTERED, _State.EXPIRING) 7221s 7221s if self._timeout_handler is not None: 7221s self._timeout_handler.cancel() 7221s self._timeout_handler = None 7221s 7221s if self._state is _State.EXPIRING: 7221s self._state = _State.EXPIRED 7221s 7221s if self._task.uncancel() <= self._cancelling and exc_type is not None: 7221s # Since there are no new cancel requests, we're 7221s # handling this. 7221s if issubclass(exc_type, exceptions.CancelledError): 7221s > raise TimeoutError from exc_val 7221s E TimeoutError 7221s 7221s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s @contextlib.asynccontextmanager 7221s async def _cluster_factory(): 7221s workers = [] 7221s s = None 7221s try: 7221s for _ in range(60): 7221s try: 7221s > s, ws = await start_cluster( 7221s nthreads, 7221s scheduler, 7221s security=security, 7221s Worker=Worker, 7221s scheduler_kwargs=scheduler_kwargs, 7221s worker_kwargs=merge( 7221s {"death_timeout": min(15, int(deadline.remaining))}, 7221s worker_kwargs, 7221s ), 7221s ) 7221s 7221s /usr/lib/python3/dist-packages/distributed/utils_test.py:966: 7221s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7221s /usr/lib/python3/dist-packages/distributed/utils_test.py:789: in start_cluster 7221s await asyncio.gather(*workers) 7221s /usr/lib/python3.13/asyncio/tasks.py:737: in _wrap_awaitable 7221s return await awaitable 7221s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7221s 7221s self = 7221s 7221s @final 7221s async def start(self): 7221s async with self._startup_lock: 7221s if self.status == Status.failed: 7221s assert self.__startup_exc is not None 7221s raise self.__startup_exc 7221s elif self.status != Status.init: 7221s return self 7221s timeout = getattr(self, "death_timeout", None) 7221s 7221s async def _close_on_failure(exc: Exception) -> None: 7221s await self.close(reason=f"failure-to-start-{str(type(exc))}") 7221s self.status = Status.failed 7221s self.__startup_exc = exc 7221s 7221s try: 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s except asyncio.TimeoutError as exc: 7221s await _close_on_failure(exc) 7221s > raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s E TimeoutError: Worker start timed out after 0s. 7221s 7221s /usr/lib/python3/dist-packages/distributed/core.py:667: TimeoutError 7221s 7221s During handling of the above exception, another exception occurred: 7221s 7221s fut = ._..test_func..async_fn at 0xe9b48b08> 7221s timeout = 60 7221s 7221s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 7221s async with asyncio.timeout(timeout): 7221s > return await fut 7221s 7221s /usr/lib/python3/dist-packages/distributed/utils.py:1960: 7221s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7221s /usr/lib/python3/dist-packages/distributed/utils_test.py:999: in async_fn 7221s _cluster_factory() as (s, workers), 7221s /usr/lib/python3.13/contextlib.py:214: in __aenter__ 7221s return await anext(self.gen) 7221s /usr/lib/python3/dist-packages/distributed/utils_test.py:983: in _cluster_factory 7221s await asyncio.sleep(1) 7221s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7221s 7221s delay = 1, result = None 7221s 7221s async def sleep(delay, result=None): 7221s """Coroutine that completes after a given time (in seconds).""" 7221s if delay <= 0: 7221s await __sleep0() 7221s return result 7221s 7221s if math.isnan(delay): 7221s raise ValueError("Invalid delay: NaN (not a number)") 7221s 7221s loop = events.get_running_loop() 7221s future = loop.create_future() 7221s h = loop.call_later(delay, 7221s futures._set_result_unless_cancelled, 7221s future, result) 7221s try: 7221s > return await future 7221s E asyncio.exceptions.CancelledError 7221s 7221s /usr/lib/python3.13/asyncio/tasks.py:718: CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s args = (), kwds = {} 7221s 7221s @wraps(func) 7221s def inner(*args, **kwds): 7221s with self._recreate_cm(): 7221s > return func(*args, **kwds) 7221s 7221s /usr/lib/python3.13/contextlib.py:85: 7221s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7221s /usr/lib/python3.13/contextlib.py:85: in inner 7221s return func(*args, **kwds) 7221s /usr/lib/python3/dist-packages/distributed/utils_test.py:1102: in test_func 7221s return _run_and_close_tornado(async_fn_outer) 7221s /usr/lib/python3/dist-packages/distributed/utils_test.py:378: in _run_and_close_tornado 7221s return asyncio_run(inner_fn(), loop_factory=get_loop_factory()) 7221s /usr/lib/python3.13/asyncio/runners.py:194: in run 7221s return runner.run(main) 7221s /usr/lib/python3.13/asyncio/runners.py:118: in run 7221s return self._loop.run_until_complete(task) 7221s /usr/lib/python3.13/asyncio/base_events.py:720: in run_until_complete 7221s return future.result() 7221s /usr/lib/python3/dist-packages/distributed/utils_test.py:375: in inner_fn 7221s return await async_fn(*args, **kwargs) 7221s /usr/lib/python3/dist-packages/distributed/utils_test.py:1099: in async_fn_outer 7221s return await utils_wait_for(async_fn(), timeout=timeout * 2) 7221s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 7221s async with asyncio.timeout(timeout): 7221s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7221s 7221s self = 7221s exc_type = 7221s exc_val = CancelledError(), exc_tb = 7221s 7221s async def __aexit__( 7221s self, 7221s exc_type: Optional[Type[BaseException]], 7221s exc_val: Optional[BaseException], 7221s exc_tb: Optional[TracebackType], 7221s ) -> Optional[bool]: 7221s assert self._state in (_State.ENTERED, _State.EXPIRING) 7221s 7221s if self._timeout_handler is not None: 7221s self._timeout_handler.cancel() 7221s self._timeout_handler = None 7221s 7221s if self._state is _State.EXPIRING: 7221s self._state = _State.EXPIRED 7221s 7221s if self._task.uncancel() <= self._cancelling and exc_type is not None: 7221s # Since there are no new cancel requests, we're 7221s # handling this. 7221s if issubclass(exc_type, exceptions.CancelledError): 7221s > raise TimeoutError from exc_val 7221s E TimeoutError 7221s 7221s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 7221s ----------------------------- Captured stderr call ----------------------------- 7221s 2024-11-23 22:20:13,651 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:20:13,663 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:13,663 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38353/status 7221s 2024-11-23 22:20:13,664 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:20:13,687 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37723 7221s 2024-11-23 22:20:13,687 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37723 7221s 2024-11-23 22:20:13,687 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:20:13,688 - distributed.worker - INFO - dashboard at: 127.0.0.1:41613 7221s 2024-11-23 22:20:13,688 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:13,688 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:20:13,688 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:20:13,688 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:20:13,688 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-7pqu0pys 7221s 2024-11-23 22:20:13,688 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:20:13,691 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41615 7221s 2024-11-23 22:20:13,692 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41615 7221s 2024-11-23 22:20:13,692 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:20:13,692 - distributed.worker - INFO - dashboard at: 127.0.0.1:41447 7221s 2024-11-23 22:20:13,692 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:13,692 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:20:13,692 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:20:13,692 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:20:13,692 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ephd6rjn 7221s 2024-11-23 22:20:13,692 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:20:13,708 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:13,709 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:13,709 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:41438': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:13,710 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:41454': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:13,825 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:13,825 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:13,826 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:41470': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:13,826 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:41472': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:13,941 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:13,941 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:13,942 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:41480': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:13,942 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:41482': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:14,059 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:14,060 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:14,060 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:41494': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:14,060 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:41502': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:14,181 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:14,181 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:14,182 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:41514': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:14,182 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:41524': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:14,297 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:14,298 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:14,298 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:41528': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:14,298 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:41530': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:14,413 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:14,414 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:14,415 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:41544': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:14,415 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:41556': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:14,530 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:14,531 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:14,531 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:41572': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:14,532 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:41576': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:14,647 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:14,647 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:14,648 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:41590': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:14,648 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:41596': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:14,764 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:14,764 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:14,765 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:41606': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:14,765 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:41618': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:14,880 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:14,881 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:14,881 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:41634': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:14,881 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:41650': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:14,996 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:14,997 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:14,997 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:41664': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:14,998 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:41680': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:15,114 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:15,114 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:15,115 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:41690': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:15,115 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:41692': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:15,230 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:15,231 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:15,231 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:41700': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:15,231 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:41704': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:15,347 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:15,348 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:15,348 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:41710': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:15,348 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:41716': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:15,463 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:15,464 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:15,464 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:41726': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:15,465 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:41728': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:15,580 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:15,581 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:15,581 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:41734': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:15,582 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:41736': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:15,696 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:15,697 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:15,698 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:41746': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:15,698 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:41762': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:15,815 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:15,815 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:15,816 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:41774': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:15,816 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:41788': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:15,926 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:15,931 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:41798': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:15,933 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:15,934 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:41814': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:16,035 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:16,037 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:41830': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:16,044 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:16,045 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:41838': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:16,146 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:16,146 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:41842': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:16,154 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:16,155 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:41848': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:16,256 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:16,256 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:41858': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:16,265 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:16,266 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:41866': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:16,365 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:16,366 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:41878': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:16,375 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:16,375 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:41886': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:16,474 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:16,475 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:41896': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:16,483 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:16,483 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:41906': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:16,584 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:16,585 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:41920': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:16,593 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:16,594 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:41936': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:16,694 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:16,695 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:41942': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:16,703 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:16,704 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:41952': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:16,804 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:16,805 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:41954': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:16,813 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:16,814 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:41964': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:16,914 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:16,915 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:41972': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:16,923 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:16,924 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:41980': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:17,023 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:17,024 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:41994': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:17,032 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:17,033 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:42004': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:17,133 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:17,134 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:42016': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:17,142 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:17,143 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:42032': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:17,242 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:17,243 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:42036': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:17,251 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:17,252 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:42048': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:17,353 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:17,355 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:42060': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:17,362 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:17,363 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:42072': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:17,463 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:17,464 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:42074': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:17,472 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:17,473 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:42084': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:17,576 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:17,577 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:42090': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:17,585 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:17,585 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:42102': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:17,685 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:17,685 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:42106': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:17,694 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:17,694 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:42118': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:17,794 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:17,795 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:42122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:17,803 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:17,804 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:42132': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:17,903 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:17,904 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:42140': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:17,912 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:17,913 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:42150': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:18,013 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:18,014 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:42166': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:18,022 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:18,023 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:42180': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:18,122 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:18,123 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:42184': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:18,131 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:18,132 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:42186': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:18,233 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:18,234 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:42190': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:18,242 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:18,243 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:42192': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:18,343 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:18,343 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:42196': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:18,352 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:18,352 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:42200': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:18,452 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:18,453 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:42212': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:18,461 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:18,462 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:42224': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:18,561 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:18,562 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:42240': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:18,571 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:18,572 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:42248': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:18,676 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:18,677 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:42252': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:18,685 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:18,686 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:42258': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:18,785 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:18,786 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:42272': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:18,795 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:18,795 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:42286': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:18,895 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:18,896 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:42296': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:18,904 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:18,905 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:42306': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:19,004 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:19,005 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:42308': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:19,014 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:19,014 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:42314': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:19,115 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:19,116 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:42326': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:19,124 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:19,125 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:42336': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:19,225 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:19,226 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:42340': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:19,236 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:19,237 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:42352': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:19,335 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:19,336 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:42366': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:19,345 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:19,346 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:42376': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:19,445 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:19,446 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:42390': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:19,454 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:19,455 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:42396': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:19,554 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:19,555 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:42410': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:19,563 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:19,564 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:42426': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:19,664 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:19,666 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:42428': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:19,679 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:19,680 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:42442': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:19,774 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:19,775 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:42454': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:19,788 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:19,789 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:42466': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:19,883 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:19,884 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:42472': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:19,898 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:19,898 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:42478': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:19,992 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:19,993 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:42484': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:20,007 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:20,008 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:42498': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:20,102 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:20,103 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:42510': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:20,116 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:20,117 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:42526': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:20,212 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:20,213 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:42540': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:20,225 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:20,226 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:42554': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:20,322 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:20,323 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:42568': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:20,335 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:20,336 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:42578': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:20,432 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:20,433 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:42590': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:20,444 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:20,445 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:42594': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:20,541 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:20,542 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:42604': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:20,553 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:20,554 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:42606': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:20,650 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:20,651 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:42616': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:20,662 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:20,663 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:42618': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:20,760 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:20,760 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:42622': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:20,771 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:20,772 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:42632': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:20,870 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:20,871 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:42642': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:20,881 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:20,882 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:42648': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:20,982 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:20,983 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:42654': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:20,991 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:20,992 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:42666': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:21,091 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:21,092 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:42676': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:21,100 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:21,101 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:42690': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:21,201 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:21,202 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:42696': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:21,210 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:21,210 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:42708': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:21,311 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:21,312 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:42720': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:21,320 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:21,321 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:42726': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:21,421 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:21,422 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:42740': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:21,430 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:21,431 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:42750': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:21,530 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:21,531 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:42758': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:21,539 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:21,540 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:36440': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:21,640 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:21,640 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:36452': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:21,648 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:21,649 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:36458': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:21,749 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:21,750 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:36472': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:21,758 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:21,758 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:36484': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:21,858 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:21,859 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:36498': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:21,867 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:21,868 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:36506': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:21,968 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:21,969 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:36508': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:21,977 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:21,977 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:36516': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:22,078 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:22,079 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:36518': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:22,086 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:22,087 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:36522': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:22,188 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:22,189 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:36528': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:22,197 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:22,197 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:36538': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:22,297 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:22,297 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:36554': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:22,306 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:22,307 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:36556': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:22,406 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:22,407 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:36566': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:22,415 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:22,416 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:36570': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:22,515 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:22,516 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:36574': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:22,524 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:22,525 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:36590': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:22,626 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:22,627 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:36604': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:22,637 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:22,638 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:36614': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:22,736 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:22,737 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:36618': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:22,746 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:22,747 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:36624': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:22,845 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:22,846 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:36632': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:22,854 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:22,855 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:36642': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:22,955 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:22,956 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:36658': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:22,964 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:22,965 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:36660': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:23,065 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:23,066 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:36676': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:23,074 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:23,075 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:36684': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:23,179 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:23,180 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:36690': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:23,188 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:23,189 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:36694': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:23,288 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:23,289 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:36696': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:23,297 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:23,298 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:36700': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:23,398 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:23,399 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:36702': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:23,407 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:23,408 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:36718': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:23,508 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:23,509 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:36724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:23,517 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:23,517 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:36736': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:23,618 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:23,619 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:36748': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:23,627 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:23,627 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:36750': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:23,727 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:23,728 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:36752': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:23,736 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:23,737 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:36762': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:23,836 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:23,837 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:36764': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:23,845 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:23,846 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:36778': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:23,946 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:23,947 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:36782': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:23,955 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:23,955 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:36784': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:24,055 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:24,056 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:36796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:24,064 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:24,064 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:36812': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:24,164 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:24,165 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:36814': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:24,178 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:24,179 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:36828': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:24,274 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:24,275 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:36834': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:24,287 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:24,288 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:36848': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:24,384 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:24,385 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:36850': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:24,395 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:24,396 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:36866': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:24,494 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:24,495 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:36872': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:24,504 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:24,505 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:36888': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:24,603 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:24,604 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:36902': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:24,613 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:24,614 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:36914': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:24,713 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:24,714 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:36928': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:24,722 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:24,723 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:36940': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:24,823 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:24,824 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:36956': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:24,832 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:24,833 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:36968': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:24,934 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:24,934 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:36978': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:24,942 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:24,943 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:36986': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:25,043 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:25,044 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:36990': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:25,052 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:25,053 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:37004': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:25,154 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:25,154 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:37020': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:25,163 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:25,163 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:37028': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:25,264 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:25,265 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:37036': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:25,273 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:25,274 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:37042': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:25,374 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:25,375 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:37052': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:25,383 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:25,383 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:37064': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:25,484 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:25,485 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:37066': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:25,493 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:25,494 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:37072': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:25,594 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:25,595 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:37082': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:25,603 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:25,604 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:37084': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:25,704 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:25,705 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:37094': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:25,713 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:25,714 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:37106': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:25,814 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:25,815 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:37114': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:25,823 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:25,824 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:37118': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:25,923 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:25,924 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:37130': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:25,932 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:25,933 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:37136': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:26,041 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:26,042 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:37140': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:26,048 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:26,049 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:37152': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:26,151 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:26,152 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:37168': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:26,160 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:26,160 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:37178': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:26,260 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:26,261 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:37194': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:26,269 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:26,270 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:37198': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:26,370 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:26,371 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:37202': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:26,379 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:26,380 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:37214': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:26,480 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:26,481 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:37222': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:26,489 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:26,490 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:37238': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:26,589 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:26,590 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:37248': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:26,598 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:26,599 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:37264': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:26,699 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:26,700 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:37270': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:26,708 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:26,709 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:37276': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:26,808 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:26,809 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:37292': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:26,817 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:26,818 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:37294': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:26,918 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:26,919 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:37296': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:26,928 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:26,929 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:37302': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:27,028 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:27,029 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:37304': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:27,037 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:27,038 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:37316': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:27,138 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:27,139 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:37322': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:27,147 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:27,147 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:37332': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:27,247 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:27,248 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:37342': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:27,256 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:27,257 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:37352': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:27,357 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:27,357 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:37356': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:27,366 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:27,366 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:37358': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:27,466 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:27,467 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:37374': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:27,475 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:27,476 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:37384': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:27,575 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:27,576 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:37400': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:27,584 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:27,585 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:37406': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:27,685 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:27,685 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:37422': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:27,696 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:27,697 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:37426': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:27,794 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:27,795 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:37438': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:27,805 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:27,805 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:37454': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:27,905 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:27,905 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:37464': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:27,914 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:27,914 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:37468': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:28,014 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:28,015 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:37482': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:28,023 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:28,024 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:37488': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:28,123 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:28,124 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:37490': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:28,132 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:28,132 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:37492': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:28,232 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:28,233 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:37494': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:28,241 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:28,242 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:37502': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:28,341 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:28,342 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:37506': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:28,350 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:28,350 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:37512': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:28,449 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:28,450 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:37526': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:28,457 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:28,458 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:37528': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:28,557 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:28,558 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:37544': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:28,564 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:28,565 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:37560': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:28,665 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:28,665 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:37574': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:28,675 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38459 7221s 2024-11-23 22:20:28,675 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38459': TLS handshake failed with remote 'tls://127.0.0.1:37584': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:28,685 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37723. Reason: failure-to-start- 7221s 2024-11-23 22:20:28,685 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:20:28,687 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 15s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 7221s stream = await stream.start_tls( 7221s ^^^^^^^^^^^^^^^^^^^^^^^ 7221s False, ssl_options=ssl_options, server_hostname=host 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 7221s self.socket.do_handshake() 7221s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 7221s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 7221s self._sslobj.do_handshake() 7221s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 7221s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 7221s raise FatalCommClosedError( 7221s ...<2 lines>... 7221s ) from err 7221s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 7221s 7221s During handling of the above exception, another exception occurred: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1218, in _register_with_scheduler 7221s await asyncio.sleep(0.1) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 718, in sleep 7221s return await future 7221s ^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 15s. 7221s 2024-11-23 22:20:28,691 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41615. Reason: failure-to-start- 7221s 2024-11-23 22:20:28,691 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:20:29,693 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:20:29,700 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:29,701 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37819/status 7221s 2024-11-23 22:20:29,701 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:20:29,715 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35487 7221s 2024-11-23 22:20:29,716 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35487 7221s 2024-11-23 22:20:29,716 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:20:29,716 - distributed.worker - INFO - dashboard at: 127.0.0.1:44793 7221s 2024-11-23 22:20:29,716 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:29,716 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:20:29,716 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:20:29,716 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:20:29,716 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-y9d3mven 7221s 2024-11-23 22:20:29,716 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:20:29,718 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43055 7221s 2024-11-23 22:20:29,718 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43055 7221s 2024-11-23 22:20:29,718 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:20:29,718 - distributed.worker - INFO - dashboard at: 127.0.0.1:32833 7221s 2024-11-23 22:20:29,718 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:29,718 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:20:29,718 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:20:29,719 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:20:29,719 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-xewprzfh 7221s 2024-11-23 22:20:29,719 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:20:29,731 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:29,732 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:29,732 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:49568': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:29,732 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:49570': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:29,844 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:29,844 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:29,845 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:49576': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:29,845 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:49578': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:29,957 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:29,957 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:29,958 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:49582': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:29,958 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:49590': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:30,070 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:30,070 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:30,071 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:49598': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:30,071 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:49602': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:30,183 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:30,183 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:30,184 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:49612': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:30,184 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:49624': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:30,296 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:30,296 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:30,296 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:49628': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:30,296 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:49630': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:30,409 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:30,409 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:30,410 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:49638': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:30,410 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:49654': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:30,522 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:30,523 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:30,523 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:49668': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:30,523 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:49678': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:30,635 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:30,635 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:30,636 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:49694': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:30,636 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:49696': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:30,748 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:30,748 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:30,749 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:49702': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:30,749 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:49714': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:30,862 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:30,862 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:30,862 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:49724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:30,863 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:49738': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:30,975 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:30,975 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:30,975 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:49748': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:30,975 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:49750': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:31,088 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:31,088 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:31,088 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:49752': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:31,088 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:49760': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:31,201 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:31,201 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:31,202 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:49776': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:31,202 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:49782': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:31,315 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:31,315 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:31,315 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:49798': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:31,315 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:49814': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:31,429 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:31,429 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:31,429 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:49830': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:31,430 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:49842': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:31,543 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:31,543 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:31,544 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:47882': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:31,544 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:47886': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:31,656 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:31,656 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:31,657 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:47892': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:31,657 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:47896': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:31,771 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:31,771 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:31,771 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:47904': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:31,771 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:47920': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:31,883 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:31,884 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:31,884 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:47936': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:31,884 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:47944': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:31,997 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:31,997 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:31,998 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:47950': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:31,998 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:47962': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:32,110 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:32,110 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:32,111 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:47970': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:32,111 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:47976': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:32,223 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:32,223 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:32,223 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:47982': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:32,223 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:47986': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:32,336 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:32,336 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:32,336 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:47990': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:32,336 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:47992': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:32,449 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:32,449 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:32,450 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:47998': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:32,450 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:48012': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:32,563 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:32,563 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:32,564 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:48018': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:32,564 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:48030': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:32,681 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:32,681 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:32,682 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:48042': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:32,682 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:48052': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:32,794 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:32,795 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:32,795 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:48056': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:32,795 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:48070': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:32,907 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:32,908 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:32,908 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:48072': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:32,908 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:48084': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:33,020 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:33,021 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:33,021 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:48096': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:33,021 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:48098': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:33,134 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:33,135 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:33,135 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:48108': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:33,135 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:48122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:33,248 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:33,248 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:33,248 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:48126': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:33,249 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:48140': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:33,362 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:33,362 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:33,362 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:48146': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:33,362 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:48148': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:33,475 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:33,476 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:33,476 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:48152': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:33,476 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:48164': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:33,589 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:33,589 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:33,590 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:48172': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:33,590 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:48180': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:33,702 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:33,702 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:33,703 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:48194': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:33,703 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:48198': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:33,815 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:33,816 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:33,816 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:48210': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:33,816 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:48212': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:33,928 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:33,928 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:33,929 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:48224': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:33,929 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:48238': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:34,042 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:34,042 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:34,042 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:48246': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:34,042 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:48256': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:34,155 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:34,155 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:34,155 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:48258': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:34,155 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:48266': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:34,269 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:34,269 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:34,269 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:48268': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:34,269 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:48280': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:34,382 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:34,383 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:34,383 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:48294': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:34,384 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:48296': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:34,490 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:34,491 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:48304': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:34,496 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:34,496 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:48308': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:34,599 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:34,600 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:48316': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:34,606 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:34,606 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:48322': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:34,711 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:34,712 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:48332': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:34,717 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:34,718 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:48336': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:34,820 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:34,821 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:48344': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:34,826 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:34,827 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:48352': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:34,927 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:34,928 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:48360': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:34,934 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:34,934 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:48366': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:35,036 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:35,037 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:48380': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:35,043 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:35,043 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:48396': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:35,145 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:35,146 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:48410': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:35,152 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:35,152 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:48418': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:35,253 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:35,253 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:48428': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:35,260 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:35,260 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:48434': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:35,362 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:35,363 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:48440': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:35,368 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:35,369 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:48448': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:35,469 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:35,470 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:48454': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:35,476 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:35,476 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:48460': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:35,577 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:35,578 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:48464': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:35,584 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:35,585 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:48472': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:35,685 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:35,686 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:48484': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:35,692 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:35,692 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:48490': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:35,794 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:35,795 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:48500': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:35,800 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:35,801 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:48516': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:35,902 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:35,903 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:48522': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:35,908 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:35,909 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:48538': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:36,009 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:36,009 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:48542': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:36,016 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:36,016 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:48544': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:36,118 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:36,119 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:48550': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:36,124 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:36,125 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:48552': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:36,226 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:36,227 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:48558': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:36,233 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:36,233 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:48564': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:36,334 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:36,334 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:48566': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:36,340 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:36,341 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:48580': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:36,442 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:36,443 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:48596': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:36,449 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:36,449 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:48610': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:36,550 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:36,551 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:48618': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:36,556 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:36,557 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:48626': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:36,657 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:36,658 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:48628': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:36,664 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:36,664 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:48644': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:36,765 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:36,766 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:48658': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:36,772 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:36,772 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:48670': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:36,874 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:36,875 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:48676': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:36,880 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:36,881 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:48686': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:36,981 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:36,981 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:48690': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:36,987 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:36,988 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:48692': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:37,088 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:37,089 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:48694': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:37,095 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:37,095 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:48704': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:37,196 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:37,197 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:48706': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:37,203 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:37,207 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:48716': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:37,304 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:37,305 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:48732': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:37,311 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:37,311 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:48736': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:37,411 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:37,412 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:48750': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:37,418 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:37,418 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:48752': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:37,520 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:37,521 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:48766': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:37,527 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:37,527 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:48770': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:37,628 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:37,629 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:48786': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:37,634 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:37,635 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:48792': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:37,735 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:37,736 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:48806': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:37,742 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:37,742 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:48812': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:37,843 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:37,844 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:48818': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:37,850 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:37,850 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:48832': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:37,950 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:37,951 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:48840': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:37,957 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:37,957 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:48848': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:38,058 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:38,058 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:48858': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:38,065 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:38,065 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:48872': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:38,166 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:38,169 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:48874': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:38,175 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:38,176 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:48878': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:38,274 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:38,274 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:48882': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:38,282 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:38,283 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:48892': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:38,381 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:38,382 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:48898': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:38,389 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:38,390 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:48908': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:38,489 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:38,489 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:48912': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:38,497 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:38,497 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:48920': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:38,598 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:38,599 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:48934': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:38,604 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:38,605 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:48942': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:38,706 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:38,709 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:48944': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:38,715 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:38,716 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:48948': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:38,814 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:38,814 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:48964': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:38,822 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:38,823 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:48980': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:38,922 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:38,922 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:48988': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:38,930 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:38,930 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:48996': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:39,029 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:39,030 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:49006': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:39,037 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:39,037 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:49022': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:39,137 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:39,138 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:49024': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:39,144 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:39,144 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:49036': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:39,245 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:39,246 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:49038': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:39,252 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:39,252 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:49042': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:39,354 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:39,355 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:49044': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:39,361 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:39,361 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:49048': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:39,462 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:39,462 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:49058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:39,469 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:39,469 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:49072': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:39,569 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:39,570 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:49078': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:39,576 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:39,576 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:49086': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:39,677 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:39,677 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:49088': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:39,683 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:39,684 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:49104': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:39,786 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:39,787 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:49106': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:39,792 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:39,793 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:49116': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:39,894 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:39,894 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:49120': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:39,900 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:39,900 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:49124': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:40,001 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:40,002 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:49138': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:40,008 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:40,008 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:49144': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:40,109 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:40,109 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:49154': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:40,115 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:40,116 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:49156': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:40,216 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:40,217 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:49158': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:40,223 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:40,223 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:49172': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:40,325 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:40,326 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:49174': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:40,331 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:40,332 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:49190': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:40,433 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:40,434 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:49202': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:40,439 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:40,440 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:49206': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:40,541 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:40,542 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:49212': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:40,547 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:40,548 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:49218': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:40,648 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:40,649 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:49226': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:40,655 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:40,655 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:49234': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:40,756 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:40,757 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:49250': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:40,763 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:40,763 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:49264': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:40,864 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:40,865 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:49272': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:40,871 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:40,871 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:49276': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:40,971 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:40,972 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:49286': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:40,979 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:40,980 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:49296': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:41,079 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:41,079 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:49308': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:41,086 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:41,087 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:49324': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:41,186 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:41,186 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:49328': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:41,194 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:41,194 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:49342': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:41,294 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:41,294 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:49358': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:41,301 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:41,301 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:49360': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:41,402 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:41,402 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:49368': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:41,408 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:41,409 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:49382': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:41,509 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:41,509 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:49394': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:41,515 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:41,516 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:49410': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:41,617 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:41,617 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:40362': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:41,623 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:41,623 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:40366': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:41,726 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:41,726 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:40378': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:41,732 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:41,732 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:40388': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:41,833 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:41,834 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:40394': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:41,840 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:41,840 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:40404': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:41,942 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:41,943 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:40418': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:41,949 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:41,949 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:40424': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:42,051 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:42,052 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:40430': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:42,057 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:42,058 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:40436': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:42,158 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:42,159 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:40446': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:42,165 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:42,165 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:40460': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:42,266 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:42,266 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:40462': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:42,272 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:42,273 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:40466': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:42,373 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:42,374 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:40468': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:42,380 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:42,380 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:40470': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:42,482 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:42,483 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:40478': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:42,489 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:42,489 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:40484': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:42,590 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:42,591 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:40496': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:42,597 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:42,597 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:40510': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:42,698 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:42,698 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:40520': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:42,705 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43981 7221s 2024-11-23 22:20:42,708 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43981': TLS handshake failed with remote 'tls://127.0.0.1:40526': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:20:42,714 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35487. Reason: failure-to-start- 7221s 2024-11-23 22:20:42,714 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:20:42,716 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 13s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 7221s stream = await stream.start_tls( 7221s ^^^^^^^^^^^^^^^^^^^^^^^ 7221s False, ssl_options=ssl_options, server_hostname=host 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 7221s self.socket.do_handshake() 7221s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 7221s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 7221s self._sslobj.do_handshake() 7221s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 7221s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 7221s raise FatalCommClosedError( 7221s ...<2 lines>... 7221s ) from err 7221s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 7221s 7221s During handling of the above exception, another exception occurred: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1218, in _register_with_scheduler 7221s await asyncio.sleep(0.1) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 718, in sleep 7221s return await future 7221s ^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 13s. 7221s 2024-11-23 22:20:42,719 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43055. Reason: failure-to-start- 7221s 2024-11-23 22:20:42,720 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:20:43,722 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:20:43,730 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36423 7221s 2024-11-23 22:20:43,730 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42807/status 7221s 2024-11-23 22:20:43,730 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:20:43,743 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34081 7221s 2024-11-23 22:20:43,743 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34081 7221s 2024-11-23 22:20:43,743 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:20:43,743 - distributed.worker - INFO - dashboard at: 127.0.0.1:44999 7221s 2024-11-23 22:20:43,743 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36423 7221s 2024-11-23 22:20:43,743 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:20:43,744 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:20:43,744 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:20:43,744 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-s3pz00pf 7221s 2024-11-23 22:20:43,744 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:20:43,746 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46321 7221s 2024-11-23 22:20:43,746 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46321 7221s 2024-11-23 22:20:43,746 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:20:43,746 - distributed.worker - INFO - dashboard at: 127.0.0.1:34653 7221s 2024-11-23 22:20:43,746 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36423 7221s 2024-11-23 22:20:43,746 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:20:43,746 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:20:43,746 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:20:43,746 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-vtk_ghbv 7221s 2024-11-23 22:20:43,746 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:20:43,747 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34081. Reason: failure-to-start- 7221s 2024-11-23 22:20:43,747 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:20:43,748 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46321. Reason: failure-to-start- 7221s 2024-11-23 22:20:43,748 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:20:43,749 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36423': TLS handshake failed with remote 'tls://127.0.0.1:56580': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:20:43,749 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36423': TLS handshake failed with remote 'tls://127.0.0.1:56586': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:20:43,751 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s 2024-11-23 22:20:44,756 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:20:44,765 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45689 7221s 2024-11-23 22:20:44,765 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39773/status 7221s 2024-11-23 22:20:44,765 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:20:44,779 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45929 7221s 2024-11-23 22:20:44,779 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45929 7221s 2024-11-23 22:20:44,779 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:20:44,779 - distributed.worker - INFO - dashboard at: 127.0.0.1:43281 7221s 2024-11-23 22:20:44,779 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45689 7221s 2024-11-23 22:20:44,779 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:20:44,779 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:20:44,779 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:20:44,779 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-uxovctu0 7221s 2024-11-23 22:20:44,779 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:20:44,781 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36419 7221s 2024-11-23 22:20:44,781 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36419 7221s 2024-11-23 22:20:44,781 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:20:44,781 - distributed.worker - INFO - dashboard at: 127.0.0.1:33121 7221s 2024-11-23 22:20:44,781 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45689 7221s 2024-11-23 22:20:44,782 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:20:44,782 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:20:44,782 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:20:44,782 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ju133paq 7221s 2024-11-23 22:20:44,782 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:20:44,783 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45929. Reason: failure-to-start- 7221s 2024-11-23 22:20:44,783 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:20:44,783 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36419. Reason: failure-to-start- 7221s 2024-11-23 22:20:44,783 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:20:44,785 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45689': TLS handshake failed with remote 'tls://127.0.0.1:52752': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:20:44,785 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45689': TLS handshake failed with remote 'tls://127.0.0.1:52760': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:20:44,786 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s 2024-11-23 22:20:45,791 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:20:45,800 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46783 7221s 2024-11-23 22:20:45,800 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33651/status 7221s 2024-11-23 22:20:45,800 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:20:45,818 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37097 7221s 2024-11-23 22:20:45,818 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37097 7221s 2024-11-23 22:20:45,818 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:20:45,818 - distributed.worker - INFO - dashboard at: 127.0.0.1:40781 7221s 2024-11-23 22:20:45,818 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46783 7221s 2024-11-23 22:20:45,818 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:20:45,818 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:20:45,818 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:20:45,818 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-g5c87o06 7221s 2024-11-23 22:20:45,819 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:20:45,821 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41065 7221s 2024-11-23 22:20:45,821 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41065 7221s 2024-11-23 22:20:45,821 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:20:45,821 - distributed.worker - INFO - dashboard at: 127.0.0.1:34791 7221s 2024-11-23 22:20:45,821 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46783 7221s 2024-11-23 22:20:45,821 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:20:45,821 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:20:45,821 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:20:45,821 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-5dbhkvml 7221s 2024-11-23 22:20:45,821 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:20:45,822 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37097. Reason: failure-to-start- 7221s 2024-11-23 22:20:45,823 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:20:45,823 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41065. Reason: failure-to-start- 7221s 2024-11-23 22:20:45,823 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:20:45,825 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46783': TLS handshake failed with remote 'tls://127.0.0.1:54098': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:20:45,825 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46783': TLS handshake failed with remote 'tls://127.0.0.1:54102': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:20:45,826 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s 2024-11-23 22:20:46,832 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:20:46,839 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39813 7221s 2024-11-23 22:20:46,840 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38707/status 7221s 2024-11-23 22:20:46,840 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:20:46,854 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39745 7221s 2024-11-23 22:20:46,854 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39745 7221s 2024-11-23 22:20:46,854 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:20:46,854 - distributed.worker - INFO - dashboard at: 127.0.0.1:39567 7221s 2024-11-23 22:20:46,854 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39813 7221s 2024-11-23 22:20:46,854 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:20:46,854 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:20:46,854 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:20:46,854 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ieoyf0ef 7221s 2024-11-23 22:20:46,855 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:20:46,857 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36029 7221s 2024-11-23 22:20:46,857 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36029 7221s 2024-11-23 22:20:46,857 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:20:46,857 - distributed.worker - INFO - dashboard at: 127.0.0.1:37193 7221s 2024-11-23 22:20:46,857 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39813 7221s 2024-11-23 22:20:46,857 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:20:46,857 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:20:46,857 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:20:46,857 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-rdyiosiq 7221s 2024-11-23 22:20:46,857 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:20:46,858 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39745. Reason: failure-to-start- 7221s 2024-11-23 22:20:46,858 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:20:46,859 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36029. Reason: failure-to-start- 7221s 2024-11-23 22:20:46,859 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:20:46,860 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39813': TLS handshake failed with remote 'tls://127.0.0.1:39950': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:20:46,860 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39813': TLS handshake failed with remote 'tls://127.0.0.1:39966': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:20:46,862 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s 2024-11-23 22:20:47,869 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:20:47,876 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40259 7221s 2024-11-23 22:20:47,876 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34219/status 7221s 2024-11-23 22:20:47,877 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:20:47,890 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34687 7221s 2024-11-23 22:20:47,890 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34687 7221s 2024-11-23 22:20:47,890 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:20:47,890 - distributed.worker - INFO - dashboard at: 127.0.0.1:38971 7221s 2024-11-23 22:20:47,890 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40259 7221s 2024-11-23 22:20:47,890 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:20:47,890 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:20:47,890 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:20:47,890 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-lb8gpkr8 7221s 2024-11-23 22:20:47,891 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:20:47,893 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40581 7221s 2024-11-23 22:20:47,893 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40581 7221s 2024-11-23 22:20:47,893 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:20:47,893 - distributed.worker - INFO - dashboard at: 127.0.0.1:38107 7221s 2024-11-23 22:20:47,893 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40259 7221s 2024-11-23 22:20:47,893 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:20:47,893 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:20:47,893 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:20:47,893 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-iyxnwbve 7221s 2024-11-23 22:20:47,893 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:20:47,894 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34687. Reason: failure-to-start- 7221s 2024-11-23 22:20:47,894 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:20:47,895 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40581. Reason: failure-to-start- 7221s 2024-11-23 22:20:47,895 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:20:47,896 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40259': TLS handshake failed with remote 'tls://127.0.0.1:59502': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:20:47,896 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40259': TLS handshake failed with remote 'tls://127.0.0.1:59506': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:20:47,898 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s 2024-11-23 22:20:48,903 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:20:48,911 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45069 7221s 2024-11-23 22:20:48,911 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40987/status 7221s 2024-11-23 22:20:48,911 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:20:48,927 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36673 7221s 2024-11-23 22:20:48,927 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36673 7221s 2024-11-23 22:20:48,927 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:20:48,927 - distributed.worker - INFO - dashboard at: 127.0.0.1:34101 7221s 2024-11-23 22:20:48,927 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45069 7221s 2024-11-23 22:20:48,927 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:20:48,927 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:20:48,927 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:20:48,927 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-w1irkhn0 7221s 2024-11-23 22:20:48,927 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:20:48,929 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44165 7221s 2024-11-23 22:20:48,929 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44165 7221s 2024-11-23 22:20:48,930 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:20:48,930 - distributed.worker - INFO - dashboard at: 127.0.0.1:35481 7221s 2024-11-23 22:20:48,930 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45069 7221s 2024-11-23 22:20:48,930 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:20:48,930 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:20:48,930 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:20:48,930 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-nakkcq5b 7221s 2024-11-23 22:20:48,930 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:20:48,931 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36673. Reason: failure-to-start- 7221s 2024-11-23 22:20:48,931 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:20:48,932 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44165. Reason: failure-to-start- 7221s 2024-11-23 22:20:48,932 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:20:48,933 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45069': TLS handshake failed with remote 'tls://127.0.0.1:34162': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:20:48,933 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45069': TLS handshake failed with remote 'tls://127.0.0.1:34164': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:20:48,935 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s 2024-11-23 22:20:49,941 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:20:49,948 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40413 7221s 2024-11-23 22:20:49,948 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37313/status 7221s 2024-11-23 22:20:49,948 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:20:49,961 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39607 7221s 2024-11-23 22:20:49,962 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39607 7221s 2024-11-23 22:20:49,962 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:20:49,962 - distributed.worker - INFO - dashboard at: 127.0.0.1:33653 7221s 2024-11-23 22:20:49,963 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40413 7221s 2024-11-23 22:20:49,963 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:20:49,963 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:20:49,963 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:20:49,963 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-gr16_jn_ 7221s 2024-11-23 22:20:49,963 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:20:49,965 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34971 7221s 2024-11-23 22:20:49,965 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34971 7221s 2024-11-23 22:20:49,965 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:20:49,965 - distributed.worker - INFO - dashboard at: 127.0.0.1:32841 7221s 2024-11-23 22:20:49,965 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40413 7221s 2024-11-23 22:20:49,965 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:20:49,965 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:20:49,966 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:20:49,966 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-y1bd8jv8 7221s 2024-11-23 22:20:49,966 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:20:49,967 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39607. Reason: failure-to-start- 7221s 2024-11-23 22:20:49,967 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:20:49,967 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34971. Reason: failure-to-start- 7221s 2024-11-23 22:20:49,968 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:20:49,969 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40413': TLS handshake failed with remote 'tls://127.0.0.1:52112': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:20:49,969 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40413': TLS handshake failed with remote 'tls://127.0.0.1:52114': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:20:49,970 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s 2024-11-23 22:20:50,976 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:20:50,983 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44239 7221s 2024-11-23 22:20:50,983 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43197/status 7221s 2024-11-23 22:20:50,983 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:20:50,997 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46083 7221s 2024-11-23 22:20:50,997 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46083 7221s 2024-11-23 22:20:50,997 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:20:50,997 - distributed.worker - INFO - dashboard at: 127.0.0.1:45793 7221s 2024-11-23 22:20:50,997 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44239 7221s 2024-11-23 22:20:50,997 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:20:50,997 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:20:50,997 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:20:50,997 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-zq1w4ifg 7221s 2024-11-23 22:20:50,997 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:20:50,999 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38843 7221s 2024-11-23 22:20:51,000 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38843 7221s 2024-11-23 22:20:51,000 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:20:51,000 - distributed.worker - INFO - dashboard at: 127.0.0.1:34785 7221s 2024-11-23 22:20:51,000 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44239 7221s 2024-11-23 22:20:51,000 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:20:51,000 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:20:51,000 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:20:51,000 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-m4y8f12e 7221s 2024-11-23 22:20:51,000 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:20:51,001 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46083. Reason: failure-to-start- 7221s 2024-11-23 22:20:51,001 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:20:51,002 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38843. Reason: failure-to-start- 7221s 2024-11-23 22:20:51,002 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:20:51,003 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44239': TLS handshake failed with remote 'tls://127.0.0.1:36808': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:20:51,003 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44239': TLS handshake failed with remote 'tls://127.0.0.1:36822': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:20:51,005 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s 2024-11-23 22:20:52,011 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:20:52,019 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35287 7221s 2024-11-23 22:20:52,019 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34693/status 7221s 2024-11-23 22:20:52,019 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:20:52,034 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44287 7221s 2024-11-23 22:20:52,034 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44287 7221s 2024-11-23 22:20:52,034 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:20:52,034 - distributed.worker - INFO - dashboard at: 127.0.0.1:45991 7221s 2024-11-23 22:20:52,034 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35287 7221s 2024-11-23 22:20:52,034 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:20:52,034 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:20:52,034 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:20:52,034 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-iaotva0i 7221s 2024-11-23 22:20:52,034 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:20:52,036 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40821 7221s 2024-11-23 22:20:52,037 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40821 7221s 2024-11-23 22:20:52,037 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:20:52,037 - distributed.worker - INFO - dashboard at: 127.0.0.1:43453 7221s 2024-11-23 22:20:52,037 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35287 7221s 2024-11-23 22:20:52,037 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:20:52,037 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:20:52,037 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:20:52,037 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-dhqccjdw 7221s 2024-11-23 22:20:52,037 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:20:52,038 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44287. Reason: failure-to-start- 7221s 2024-11-23 22:20:52,038 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:20:52,039 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40821. Reason: failure-to-start- 7221s 2024-11-23 22:20:52,039 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:20:52,040 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35287': TLS handshake failed with remote 'tls://127.0.0.1:46332': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:20:52,040 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35287': TLS handshake failed with remote 'tls://127.0.0.1:46334': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:20:52,042 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s 2024-11-23 22:20:53,047 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:20:53,055 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44147 7221s 2024-11-23 22:20:53,055 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37023/status 7221s 2024-11-23 22:20:53,055 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:20:53,070 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37847 7221s 2024-11-23 22:20:53,070 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37847 7221s 2024-11-23 22:20:53,070 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:20:53,070 - distributed.worker - INFO - dashboard at: 127.0.0.1:35681 7221s 2024-11-23 22:20:53,070 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44147 7221s 2024-11-23 22:20:53,071 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:20:53,071 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:20:53,071 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:20:53,071 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-2sxw5g10 7221s 2024-11-23 22:20:53,071 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:20:53,073 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42173 7221s 2024-11-23 22:20:53,073 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42173 7221s 2024-11-23 22:20:53,073 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:20:53,073 - distributed.worker - INFO - dashboard at: 127.0.0.1:40733 7221s 2024-11-23 22:20:53,073 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44147 7221s 2024-11-23 22:20:53,073 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:20:53,073 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:20:53,073 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:20:53,073 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-rm5z4it0 7221s 2024-11-23 22:20:53,073 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:20:53,075 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37847. Reason: failure-to-start- 7221s 2024-11-23 22:20:53,075 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:20:53,075 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42173. Reason: failure-to-start- 7221s 2024-11-23 22:20:53,075 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:20:53,077 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44147': TLS handshake failed with remote 'tls://127.0.0.1:35418': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:20:53,077 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44147': TLS handshake failed with remote 'tls://127.0.0.1:35432': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:20:53,078 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s 2024-11-23 22:20:54,084 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:20:54,091 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41167 7221s 2024-11-23 22:20:54,091 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35269/status 7221s 2024-11-23 22:20:54,091 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:20:54,105 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35513 7221s 2024-11-23 22:20:54,105 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35513 7221s 2024-11-23 22:20:54,105 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:20:54,105 - distributed.worker - INFO - dashboard at: 127.0.0.1:35917 7221s 2024-11-23 22:20:54,105 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41167 7221s 2024-11-23 22:20:54,105 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:20:54,106 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:20:54,106 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:20:54,106 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-1_aa3dv9 7221s 2024-11-23 22:20:54,106 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:20:54,109 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:32901 7221s 2024-11-23 22:20:54,109 - distributed.worker - INFO - Listening to: tls://127.0.0.1:32901 7221s 2024-11-23 22:20:54,109 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:20:54,109 - distributed.worker - INFO - dashboard at: 127.0.0.1:39667 7221s 2024-11-23 22:20:54,109 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41167 7221s 2024-11-23 22:20:54,109 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:20:54,109 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:20:54,109 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:20:54,109 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-xlgxvzec 7221s 2024-11-23 22:20:54,109 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:20:54,110 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35513. Reason: failure-to-start- 7221s 2024-11-23 22:20:54,111 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:20:54,111 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:32901. Reason: failure-to-start- 7221s 2024-11-23 22:20:54,111 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:20:54,113 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41167': TLS handshake failed with remote 'tls://127.0.0.1:56456': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:20:54,113 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41167': TLS handshake failed with remote 'tls://127.0.0.1:56470': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:20:54,115 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s 2024-11-23 22:20:55,120 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:20:55,127 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46539 7221s 2024-11-23 22:20:55,128 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33149/status 7221s 2024-11-23 22:20:55,128 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:20:55,142 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42721 7221s 2024-11-23 22:20:55,142 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42721 7221s 2024-11-23 22:20:55,142 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:20:55,142 - distributed.worker - INFO - dashboard at: 127.0.0.1:33087 7221s 2024-11-23 22:20:55,143 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46539 7221s 2024-11-23 22:20:55,143 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:20:55,143 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:20:55,143 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:20:55,143 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-_aff7y9f 7221s 2024-11-23 22:20:55,143 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:20:55,145 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35057 7221s 2024-11-23 22:20:55,145 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35057 7221s 2024-11-23 22:20:55,145 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:20:55,145 - distributed.worker - INFO - dashboard at: 127.0.0.1:36683 7221s 2024-11-23 22:20:55,145 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46539 7221s 2024-11-23 22:20:55,145 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:20:55,145 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:20:55,145 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:20:55,145 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-9w0y47lo 7221s 2024-11-23 22:20:55,145 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:20:55,147 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42721. Reason: failure-to-start- 7221s 2024-11-23 22:20:55,147 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:20:55,147 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35057. Reason: failure-to-start- 7221s 2024-11-23 22:20:55,147 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:20:55,149 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46539': TLS handshake failed with remote 'tls://127.0.0.1:51440': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:20:55,149 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46539': TLS handshake failed with remote 'tls://127.0.0.1:51456': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:20:55,150 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s 2024-11-23 22:20:56,156 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:20:56,166 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42407 7221s 2024-11-23 22:20:56,167 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46457/status 7221s 2024-11-23 22:20:56,167 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:20:56,186 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38769 7221s 2024-11-23 22:20:56,187 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38769 7221s 2024-11-23 22:20:56,187 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:20:56,187 - distributed.worker - INFO - dashboard at: 127.0.0.1:35821 7221s 2024-11-23 22:20:56,187 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42407 7221s 2024-11-23 22:20:56,187 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:20:56,187 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:20:56,187 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:20:56,187 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-kebminra 7221s 2024-11-23 22:20:56,187 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:20:56,189 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33365 7221s 2024-11-23 22:20:56,190 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33365 7221s 2024-11-23 22:20:56,190 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:20:56,190 - distributed.worker - INFO - dashboard at: 127.0.0.1:43581 7221s 2024-11-23 22:20:56,190 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42407 7221s 2024-11-23 22:20:56,190 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:20:56,190 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:20:56,190 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:20:56,190 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-5kuidt5_ 7221s 2024-11-23 22:20:56,190 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:20:56,191 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38769. Reason: failure-to-start- 7221s 2024-11-23 22:20:56,192 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:20:56,192 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33365. Reason: failure-to-start- 7221s 2024-11-23 22:20:56,192 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:20:56,194 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42407': TLS handshake failed with remote 'tls://127.0.0.1:58370': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:20:56,194 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42407': TLS handshake failed with remote 'tls://127.0.0.1:58378': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:20:56,195 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s 2024-11-23 22:20:57,201 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:20:57,208 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33035 7221s 2024-11-23 22:20:57,208 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36033/status 7221s 2024-11-23 22:20:57,209 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:20:57,226 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43269 7221s 2024-11-23 22:20:57,226 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43269 7221s 2024-11-23 22:20:57,226 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:20:57,226 - distributed.worker - INFO - dashboard at: 127.0.0.1:42519 7221s 2024-11-23 22:20:57,227 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33035 7221s 2024-11-23 22:20:57,227 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:20:57,227 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:20:57,227 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:20:57,227 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-qcvcsoqf 7221s 2024-11-23 22:20:57,227 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:20:57,229 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42235 7221s 2024-11-23 22:20:57,229 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42235 7221s 2024-11-23 22:20:57,229 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:20:57,229 - distributed.worker - INFO - dashboard at: 127.0.0.1:40117 7221s 2024-11-23 22:20:57,229 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33035 7221s 2024-11-23 22:20:57,229 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:20:57,229 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:20:57,229 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:20:57,229 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-zx_mznup 7221s 2024-11-23 22:20:57,230 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:20:57,231 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43269. Reason: failure-to-start- 7221s 2024-11-23 22:20:57,231 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:20:57,231 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42235. Reason: failure-to-start- 7221s 2024-11-23 22:20:57,231 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:20:57,233 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33035': TLS handshake failed with remote 'tls://127.0.0.1:37844': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:20:57,233 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33035': TLS handshake failed with remote 'tls://127.0.0.1:37854': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:20:57,237 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s 2024-11-23 22:20:58,242 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:20:58,248 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35729 7221s 2024-11-23 22:20:58,249 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40601/status 7221s 2024-11-23 22:20:58,249 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:20:58,262 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33569 7221s 2024-11-23 22:20:58,262 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33569 7221s 2024-11-23 22:20:58,262 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:20:58,262 - distributed.worker - INFO - dashboard at: 127.0.0.1:43049 7221s 2024-11-23 22:20:58,262 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35729 7221s 2024-11-23 22:20:58,262 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:20:58,262 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:20:58,262 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:20:58,262 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-xom_gahs 7221s 2024-11-23 22:20:58,262 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:20:58,265 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36713 7221s 2024-11-23 22:20:58,265 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36713 7221s 2024-11-23 22:20:58,265 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:20:58,265 - distributed.worker - INFO - dashboard at: 127.0.0.1:33589 7221s 2024-11-23 22:20:58,265 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35729 7221s 2024-11-23 22:20:58,266 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:20:58,266 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:20:58,266 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:20:58,266 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ple7pib_ 7221s 2024-11-23 22:20:58,266 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:20:58,267 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33569. Reason: failure-to-start- 7221s 2024-11-23 22:20:58,267 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:20:58,268 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36713. Reason: failure-to-start- 7221s 2024-11-23 22:20:58,268 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:20:58,271 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35729': TLS handshake failed with remote 'tls://127.0.0.1:39768': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:20:58,271 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35729': TLS handshake failed with remote 'tls://127.0.0.1:39770': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:20:58,273 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s 2024-11-23 22:20:59,278 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:20:59,285 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39929 7221s 2024-11-23 22:20:59,286 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46651/status 7221s 2024-11-23 22:20:59,286 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:20:59,300 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44889 7221s 2024-11-23 22:20:59,301 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44889 7221s 2024-11-23 22:20:59,301 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:20:59,301 - distributed.worker - INFO - dashboard at: 127.0.0.1:39243 7221s 2024-11-23 22:20:59,301 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39929 7221s 2024-11-23 22:20:59,301 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:20:59,301 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:20:59,301 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:20:59,301 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-acsg2iz0 7221s 2024-11-23 22:20:59,301 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:20:59,303 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40405 7221s 2024-11-23 22:20:59,304 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40405 7221s 2024-11-23 22:20:59,304 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:20:59,304 - distributed.worker - INFO - dashboard at: 127.0.0.1:34343 7221s 2024-11-23 22:20:59,304 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39929 7221s 2024-11-23 22:20:59,304 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:20:59,304 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:20:59,304 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:20:59,304 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-9tasficy 7221s 2024-11-23 22:20:59,304 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:20:59,306 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44889. Reason: failure-to-start- 7221s 2024-11-23 22:20:59,307 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:20:59,307 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40405. Reason: failure-to-start- 7221s 2024-11-23 22:20:59,307 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:20:59,311 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39929': TLS handshake failed with remote 'tls://127.0.0.1:60242': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:20:59,312 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39929': TLS handshake failed with remote 'tls://127.0.0.1:60254': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:20:59,313 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s 2024-11-23 22:21:00,319 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:21:00,326 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38915 7221s 2024-11-23 22:21:00,327 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45407/status 7221s 2024-11-23 22:21:00,327 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:21:00,342 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36743 7221s 2024-11-23 22:21:00,342 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36743 7221s 2024-11-23 22:21:00,342 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:21:00,343 - distributed.worker - INFO - dashboard at: 127.0.0.1:45035 7221s 2024-11-23 22:21:00,343 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38915 7221s 2024-11-23 22:21:00,343 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:21:00,343 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:21:00,343 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:21:00,343 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ocvi54lk 7221s 2024-11-23 22:21:00,343 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:21:00,345 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34181 7221s 2024-11-23 22:21:00,345 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34181 7221s 2024-11-23 22:21:00,345 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:21:00,345 - distributed.worker - INFO - dashboard at: 127.0.0.1:41875 7221s 2024-11-23 22:21:00,345 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38915 7221s 2024-11-23 22:21:00,345 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:21:00,346 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:21:00,346 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:21:00,346 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-k9ch5c_o 7221s 2024-11-23 22:21:00,346 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:21:00,349 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36743. Reason: failure-to-start- 7221s 2024-11-23 22:21:00,350 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:21:00,350 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34181. Reason: failure-to-start- 7221s 2024-11-23 22:21:00,350 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:21:00,352 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38915': TLS handshake failed with remote 'tls://127.0.0.1:34312': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:21:00,352 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38915': TLS handshake failed with remote 'tls://127.0.0.1:34316': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:21:00,353 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s 2024-11-23 22:21:01,359 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:21:01,368 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44635 7221s 2024-11-23 22:21:01,368 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37085/status 7221s 2024-11-23 22:21:01,369 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:21:01,383 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36951 7221s 2024-11-23 22:21:01,383 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36951 7221s 2024-11-23 22:21:01,383 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:21:01,383 - distributed.worker - INFO - dashboard at: 127.0.0.1:43797 7221s 2024-11-23 22:21:01,383 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44635 7221s 2024-11-23 22:21:01,384 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:21:01,384 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:21:01,384 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:21:01,384 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ccmd2sbx 7221s 2024-11-23 22:21:01,384 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:21:01,386 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36573 7221s 2024-11-23 22:21:01,386 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36573 7221s 2024-11-23 22:21:01,386 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:21:01,386 - distributed.worker - INFO - dashboard at: 127.0.0.1:42225 7221s 2024-11-23 22:21:01,386 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44635 7221s 2024-11-23 22:21:01,386 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:21:01,386 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:21:01,387 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:21:01,387 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-u2vdxab5 7221s 2024-11-23 22:21:01,387 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:21:01,391 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36951. Reason: failure-to-start- 7221s 2024-11-23 22:21:01,391 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:21:01,391 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36573. Reason: failure-to-start- 7221s 2024-11-23 22:21:01,391 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:21:01,393 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44635': TLS handshake failed with remote 'tls://127.0.0.1:33630': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:21:01,393 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44635': TLS handshake failed with remote 'tls://127.0.0.1:33632': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:21:01,395 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s 2024-11-23 22:21:02,400 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:21:02,407 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42321 7221s 2024-11-23 22:21:02,407 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41025/status 7221s 2024-11-23 22:21:02,407 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:21:02,435 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38515 7221s 2024-11-23 22:21:02,436 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38515 7221s 2024-11-23 22:21:02,436 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:21:02,436 - distributed.worker - INFO - dashboard at: 127.0.0.1:46241 7221s 2024-11-23 22:21:02,436 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42321 7221s 2024-11-23 22:21:02,436 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:21:02,436 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:21:02,436 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:21:02,436 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-xuzch29g 7221s 2024-11-23 22:21:02,436 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:21:02,438 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45499 7221s 2024-11-23 22:21:02,438 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45499 7221s 2024-11-23 22:21:02,438 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:21:02,438 - distributed.worker - INFO - dashboard at: 127.0.0.1:35557 7221s 2024-11-23 22:21:02,438 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42321 7221s 2024-11-23 22:21:02,438 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:21:02,438 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:21:02,439 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:21:02,439 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-b84d92c2 7221s 2024-11-23 22:21:02,439 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:21:02,443 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38515. Reason: failure-to-start- 7221s 2024-11-23 22:21:02,443 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:21:02,443 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45499. Reason: failure-to-start- 7221s 2024-11-23 22:21:02,444 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:21:02,445 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42321': TLS handshake failed with remote 'tls://127.0.0.1:59732': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:21:02,445 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42321': TLS handshake failed with remote 'tls://127.0.0.1:59740': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:21:02,447 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s 2024-11-23 22:21:03,455 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:21:03,462 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42857 7221s 2024-11-23 22:21:03,462 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46183/status 7221s 2024-11-23 22:21:03,463 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:21:03,477 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35369 7221s 2024-11-23 22:21:03,477 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35369 7221s 2024-11-23 22:21:03,477 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:21:03,477 - distributed.worker - INFO - dashboard at: 127.0.0.1:44867 7221s 2024-11-23 22:21:03,477 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42857 7221s 2024-11-23 22:21:03,478 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:21:03,478 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:21:03,478 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:21:03,478 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-izj2bc_a 7221s 2024-11-23 22:21:03,478 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:21:03,480 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38181 7221s 2024-11-23 22:21:03,480 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38181 7221s 2024-11-23 22:21:03,480 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:21:03,480 - distributed.worker - INFO - dashboard at: 127.0.0.1:35797 7221s 2024-11-23 22:21:03,480 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42857 7221s 2024-11-23 22:21:03,480 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:21:03,480 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:21:03,480 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:21:03,481 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-sy9jgpki 7221s 2024-11-23 22:21:03,481 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:21:03,739 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35369. Reason: failure-to-start- 7221s 2024-11-23 22:21:03,739 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:21:03,739 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38181. Reason: failure-to-start- 7221s 2024-11-23 22:21:03,739 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:21:03,762 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42857': TLS handshake failed with remote 'tls://127.0.0.1:41202': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:21:03,762 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42857': TLS handshake failed with remote 'tls://127.0.0.1:41204': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:21:03,766 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s 2024-11-23 22:21:04,772 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:21:04,779 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43303 7221s 2024-11-23 22:21:04,779 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38131/status 7221s 2024-11-23 22:21:04,779 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:21:04,794 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39247 7221s 2024-11-23 22:21:04,794 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39247 7221s 2024-11-23 22:21:04,794 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:21:04,794 - distributed.worker - INFO - dashboard at: 127.0.0.1:43703 7221s 2024-11-23 22:21:04,794 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43303 7221s 2024-11-23 22:21:04,794 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:21:04,794 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:21:04,794 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:21:04,794 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-paeuflbn 7221s 2024-11-23 22:21:04,794 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:21:04,796 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44439 7221s 2024-11-23 22:21:04,796 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44439 7221s 2024-11-23 22:21:04,796 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:21:04,796 - distributed.worker - INFO - dashboard at: 127.0.0.1:33437 7221s 2024-11-23 22:21:04,796 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43303 7221s 2024-11-23 22:21:04,796 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:21:04,796 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:21:04,796 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:21:04,796 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-qemrrpwb 7221s 2024-11-23 22:21:04,796 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:21:04,800 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39247. Reason: failure-to-start- 7221s 2024-11-23 22:21:04,800 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:21:04,800 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44439. Reason: failure-to-start- 7221s 2024-11-23 22:21:04,801 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:21:04,802 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43303': TLS handshake failed with remote 'tls://127.0.0.1:57010': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:21:04,802 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43303': TLS handshake failed with remote 'tls://127.0.0.1:57016': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:21:04,806 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s 2024-11-23 22:21:05,812 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:21:05,820 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33143 7221s 2024-11-23 22:21:05,821 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40907/status 7221s 2024-11-23 22:21:05,821 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:21:05,835 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35965 7221s 2024-11-23 22:21:05,835 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35965 7221s 2024-11-23 22:21:05,835 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:21:05,835 - distributed.worker - INFO - dashboard at: 127.0.0.1:40193 7221s 2024-11-23 22:21:05,835 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33143 7221s 2024-11-23 22:21:05,835 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:21:05,835 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:21:05,835 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:21:05,835 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-m86wpv85 7221s 2024-11-23 22:21:05,835 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:21:05,838 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39565 7221s 2024-11-23 22:21:05,838 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39565 7221s 2024-11-23 22:21:05,838 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:21:05,838 - distributed.worker - INFO - dashboard at: 127.0.0.1:43305 7221s 2024-11-23 22:21:05,838 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33143 7221s 2024-11-23 22:21:05,838 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:21:05,838 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:21:05,838 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:21:05,838 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-fq7op4gv 7221s 2024-11-23 22:21:05,838 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:21:05,842 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35965. Reason: failure-to-start- 7221s 2024-11-23 22:21:05,842 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:21:05,842 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39565. Reason: failure-to-start- 7221s 2024-11-23 22:21:05,842 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:21:05,844 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33143': TLS handshake failed with remote 'tls://127.0.0.1:53546': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:21:05,844 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33143': TLS handshake failed with remote 'tls://127.0.0.1:53562': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:21:05,847 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s 2024-11-23 22:21:06,853 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:21:06,859 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36091 7221s 2024-11-23 22:21:06,860 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35773/status 7221s 2024-11-23 22:21:06,860 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:21:06,875 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34413 7221s 2024-11-23 22:21:06,875 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34413 7221s 2024-11-23 22:21:06,875 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:21:06,875 - distributed.worker - INFO - dashboard at: 127.0.0.1:33217 7221s 2024-11-23 22:21:06,875 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36091 7221s 2024-11-23 22:21:06,876 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:21:06,876 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:21:06,876 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:21:06,876 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-0ah97t_0 7221s 2024-11-23 22:21:06,876 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:21:06,878 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46319 7221s 2024-11-23 22:21:06,878 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46319 7221s 2024-11-23 22:21:06,878 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:21:06,878 - distributed.worker - INFO - dashboard at: 127.0.0.1:43855 7221s 2024-11-23 22:21:06,878 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36091 7221s 2024-11-23 22:21:06,878 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:21:06,878 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:21:06,878 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:21:06,878 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-bih26vnv 7221s 2024-11-23 22:21:06,878 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:21:06,882 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34413. Reason: failure-to-start- 7221s 2024-11-23 22:21:06,882 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:21:06,883 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46319. Reason: failure-to-start- 7221s 2024-11-23 22:21:06,883 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:21:06,886 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36091': TLS handshake failed with remote 'tls://127.0.0.1:33822': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:21:06,887 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36091': TLS handshake failed with remote 'tls://127.0.0.1:33832': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:21:06,888 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s 2024-11-23 22:21:07,894 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:21:07,901 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37617 7221s 2024-11-23 22:21:07,901 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43823/status 7221s 2024-11-23 22:21:07,901 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:21:07,914 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39055 7221s 2024-11-23 22:21:07,914 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39055 7221s 2024-11-23 22:21:07,914 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:21:07,915 - distributed.worker - INFO - dashboard at: 127.0.0.1:38743 7221s 2024-11-23 22:21:07,915 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37617 7221s 2024-11-23 22:21:07,915 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:21:07,915 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:21:07,915 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:21:07,915 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-dtpdljeq 7221s 2024-11-23 22:21:07,915 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:21:07,917 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39521 7221s 2024-11-23 22:21:07,917 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39521 7221s 2024-11-23 22:21:07,917 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:21:07,917 - distributed.worker - INFO - dashboard at: 127.0.0.1:42173 7221s 2024-11-23 22:21:07,917 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37617 7221s 2024-11-23 22:21:07,917 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:21:07,917 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:21:07,917 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:21:07,917 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-n0ndz3le 7221s 2024-11-23 22:21:07,917 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:21:07,923 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39055. Reason: failure-to-start- 7221s 2024-11-23 22:21:07,924 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:21:07,924 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39521. Reason: failure-to-start- 7221s 2024-11-23 22:21:07,924 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:21:07,925 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37617': TLS handshake failed with remote 'tls://127.0.0.1:45434': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:21:07,925 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37617': TLS handshake failed with remote 'tls://127.0.0.1:45446': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:21:07,927 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s 2024-11-23 22:21:08,932 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:21:08,939 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45977 7221s 2024-11-23 22:21:08,939 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38729/status 7221s 2024-11-23 22:21:08,940 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:21:08,953 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45635 7221s 2024-11-23 22:21:08,953 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45635 7221s 2024-11-23 22:21:08,953 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:21:08,953 - distributed.worker - INFO - dashboard at: 127.0.0.1:45463 7221s 2024-11-23 22:21:08,953 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45977 7221s 2024-11-23 22:21:08,953 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:21:08,953 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:21:08,953 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:21:08,953 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-aoq6m7zq 7221s 2024-11-23 22:21:08,953 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:21:08,955 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44535 7221s 2024-11-23 22:21:08,956 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44535 7221s 2024-11-23 22:21:08,956 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:21:08,956 - distributed.worker - INFO - dashboard at: 127.0.0.1:36577 7221s 2024-11-23 22:21:08,956 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45977 7221s 2024-11-23 22:21:08,956 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:21:08,956 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:21:08,956 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:21:08,956 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ns1v4yfn 7221s 2024-11-23 22:21:08,956 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:21:08,959 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45635. Reason: failure-to-start- 7221s 2024-11-23 22:21:08,960 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:21:08,960 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44535. Reason: failure-to-start- 7221s 2024-11-23 22:21:08,960 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:21:08,961 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45977': TLS handshake failed with remote 'tls://127.0.0.1:39946': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:21:08,961 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45977': TLS handshake failed with remote 'tls://127.0.0.1:39960': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:21:08,963 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s 2024-11-23 22:21:09,968 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:21:09,976 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38471 7221s 2024-11-23 22:21:09,976 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46469/status 7221s 2024-11-23 22:21:09,977 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:21:09,990 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44731 7221s 2024-11-23 22:21:09,990 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44731 7221s 2024-11-23 22:21:09,990 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:21:09,990 - distributed.worker - INFO - dashboard at: 127.0.0.1:43753 7221s 2024-11-23 22:21:09,990 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38471 7221s 2024-11-23 22:21:09,990 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:21:09,990 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:21:09,990 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:21:09,990 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-dwsg8rkk 7221s 2024-11-23 22:21:09,990 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:21:09,992 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46785 7221s 2024-11-23 22:21:09,992 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46785 7221s 2024-11-23 22:21:09,992 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:21:09,992 - distributed.worker - INFO - dashboard at: 127.0.0.1:34559 7221s 2024-11-23 22:21:09,992 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38471 7221s 2024-11-23 22:21:09,992 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:21:09,992 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:21:09,992 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:21:09,992 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-wtj168eb 7221s 2024-11-23 22:21:09,993 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:21:09,996 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44731. Reason: failure-to-start- 7221s 2024-11-23 22:21:09,996 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:21:09,996 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46785. Reason: failure-to-start- 7221s 2024-11-23 22:21:09,997 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:21:09,998 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38471': TLS handshake failed with remote 'tls://127.0.0.1:43350': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:21:09,998 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38471': TLS handshake failed with remote 'tls://127.0.0.1:43366': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:21:09,999 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s 2024-11-23 22:21:11,005 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:21:11,012 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40611 7221s 2024-11-23 22:21:11,012 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34659/status 7221s 2024-11-23 22:21:11,012 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:21:11,028 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37303 7221s 2024-11-23 22:21:11,028 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37303 7221s 2024-11-23 22:21:11,028 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:21:11,028 - distributed.worker - INFO - dashboard at: 127.0.0.1:40933 7221s 2024-11-23 22:21:11,028 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40611 7221s 2024-11-23 22:21:11,028 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:21:11,028 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:21:11,028 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:21:11,028 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-4l8h4ief 7221s 2024-11-23 22:21:11,028 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:21:11,030 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36177 7221s 2024-11-23 22:21:11,030 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36177 7221s 2024-11-23 22:21:11,030 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:21:11,030 - distributed.worker - INFO - dashboard at: 127.0.0.1:45415 7221s 2024-11-23 22:21:11,030 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40611 7221s 2024-11-23 22:21:11,030 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:21:11,031 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:21:11,031 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:21:11,031 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-amrwkh3r 7221s 2024-11-23 22:21:11,031 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:21:11,034 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37303. Reason: failure-to-start- 7221s 2024-11-23 22:21:11,035 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:21:11,035 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36177. Reason: failure-to-start- 7221s 2024-11-23 22:21:11,035 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:21:11,036 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40611': TLS handshake failed with remote 'tls://127.0.0.1:42534': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:21:11,037 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40611': TLS handshake failed with remote 'tls://127.0.0.1:42542': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:21:11,038 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s 2024-11-23 22:21:12,043 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:21:12,050 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39583 7221s 2024-11-23 22:21:12,050 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35495/status 7221s 2024-11-23 22:21:12,051 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:21:12,064 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43913 7221s 2024-11-23 22:21:12,064 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43913 7221s 2024-11-23 22:21:12,064 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:21:12,064 - distributed.worker - INFO - dashboard at: 127.0.0.1:34151 7221s 2024-11-23 22:21:12,064 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39583 7221s 2024-11-23 22:21:12,064 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:21:12,064 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:21:12,064 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:21:12,064 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-rp2v3xt0 7221s 2024-11-23 22:21:12,064 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:21:12,068 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40141 7221s 2024-11-23 22:21:12,068 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40141 7221s 2024-11-23 22:21:12,068 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:21:12,068 - distributed.worker - INFO - dashboard at: 127.0.0.1:38089 7221s 2024-11-23 22:21:12,068 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39583 7221s 2024-11-23 22:21:12,068 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:21:12,068 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:21:12,068 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:21:12,068 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-5imjv5x2 7221s 2024-11-23 22:21:12,068 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:21:12,072 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43913. Reason: failure-to-start- 7221s 2024-11-23 22:21:12,072 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:21:12,072 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40141. Reason: failure-to-start- 7221s 2024-11-23 22:21:12,072 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:21:12,074 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39583': TLS handshake failed with remote 'tls://127.0.0.1:55084': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:21:12,074 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39583': TLS handshake failed with remote 'tls://127.0.0.1:55096': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:21:12,075 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s 2024-11-23 22:21:13,081 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:21:13,088 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36023 7221s 2024-11-23 22:21:13,088 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40789/status 7221s 2024-11-23 22:21:13,088 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:21:13,102 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37281 7221s 2024-11-23 22:21:13,102 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37281 7221s 2024-11-23 22:21:13,102 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:21:13,102 - distributed.worker - INFO - dashboard at: 127.0.0.1:36307 7221s 2024-11-23 22:21:13,102 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36023 7221s 2024-11-23 22:21:13,102 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:21:13,102 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:21:13,103 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:21:13,103 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-uadc0n75 7221s 2024-11-23 22:21:13,103 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:21:13,105 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41275 7221s 2024-11-23 22:21:13,105 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41275 7221s 2024-11-23 22:21:13,105 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:21:13,105 - distributed.worker - INFO - dashboard at: 127.0.0.1:45513 7221s 2024-11-23 22:21:13,105 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36023 7221s 2024-11-23 22:21:13,105 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:21:13,105 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:21:13,105 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:21:13,105 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-mkbgqox9 7221s 2024-11-23 22:21:13,105 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:21:13,110 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37281. Reason: failure-to-start- 7221s 2024-11-23 22:21:13,110 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:21:13,110 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41275. Reason: failure-to-start- 7221s 2024-11-23 22:21:13,110 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:21:13,112 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36023': TLS handshake failed with remote 'tls://127.0.0.1:41570': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:21:13,112 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36023': TLS handshake failed with remote 'tls://127.0.0.1:41572': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:21:13,114 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s _________________________________ test_gather __________________________________ 7221s 7221s fut = , timeout = 0 7221s 7221s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 7221s async with asyncio.timeout(timeout): 7221s > return await fut 7221s 7221s /usr/lib/python3/dist-packages/distributed/utils.py:1960: 7221s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7221s /usr/lib/python3/dist-packages/distributed/worker.py:1480: in start_unsafe 7221s await self._register_with_scheduler() 7221s /usr/lib/python3/dist-packages/distributed/worker.py:1179: in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s /usr/lib/python3/dist-packages/distributed/comm/core.py:342: in connect 7221s comm = await wait_for( 7221s /usr/lib/python3/dist-packages/distributed/utils.py:1960: in wait_for 7221s return await fut 7221s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:546: in connect 7221s stream = await self.client.connect( 7221s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7221s 7221s self = , host = '127.0.0.1' 7221s port = 39447, af = 7221s ssl_options = 7221s max_buffer_size = 8364507136.0, source_ip = None, source_port = None 7221s timeout = None 7221s 7221s async def connect( 7221s self, 7221s host: str, 7221s port: int, 7221s af: socket.AddressFamily = socket.AF_UNSPEC, 7221s ssl_options: Optional[Union[Dict[str, Any], ssl.SSLContext]] = None, 7221s max_buffer_size: Optional[int] = None, 7221s source_ip: Optional[str] = None, 7221s source_port: Optional[int] = None, 7221s timeout: Optional[Union[float, datetime.timedelta]] = None, 7221s ) -> IOStream: 7221s """Connect to the given host and port. 7221s 7221s Asynchronously returns an `.IOStream` (or `.SSLIOStream` if 7221s ``ssl_options`` is not None). 7221s 7221s Using the ``source_ip`` kwarg, one can specify the source 7221s IP address to use when establishing the connection. 7221s In case the user needs to resolve and 7221s use a specific interface, it has to be handled outside 7221s of Tornado as this depends very much on the platform. 7221s 7221s Raises `TimeoutError` if the input future does not complete before 7221s ``timeout``, which may be specified in any form allowed by 7221s `.IOLoop.add_timeout` (i.e. a `datetime.timedelta` or an absolute time 7221s relative to `.IOLoop.time`) 7221s 7221s Similarly, when the user requires a certain source port, it can 7221s be specified using the ``source_port`` arg. 7221s 7221s .. versionchanged:: 4.5 7221s Added the ``source_ip`` and ``source_port`` arguments. 7221s 7221s .. versionchanged:: 5.0 7221s Added the ``timeout`` argument. 7221s """ 7221s if timeout is not None: 7221s if isinstance(timeout, numbers.Real): 7221s timeout = IOLoop.current().time() + timeout 7221s elif isinstance(timeout, datetime.timedelta): 7221s timeout = IOLoop.current().time() + timeout.total_seconds() 7221s else: 7221s raise TypeError("Unsupported timeout %r" % timeout) 7221s if timeout is not None: 7221s addrinfo = await gen.with_timeout( 7221s timeout, self.resolver.resolve(host, port, af) 7221s ) 7221s else: 7221s addrinfo = await self.resolver.resolve(host, port, af) 7221s connector = _Connector( 7221s addrinfo, 7221s functools.partial( 7221s self._create_stream, 7221s max_buffer_size, 7221s source_ip=source_ip, 7221s source_port=source_port, 7221s ), 7221s ) 7221s > af, addr, stream = await connector.start(connect_timeout=timeout) 7221s E asyncio.exceptions.CancelledError 7221s 7221s /usr/lib/python3/dist-packages/tornado/tcpclient.py:279: CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s self = 7221s 7221s @final 7221s async def start(self): 7221s async with self._startup_lock: 7221s if self.status == Status.failed: 7221s assert self.__startup_exc is not None 7221s raise self.__startup_exc 7221s elif self.status != Status.init: 7221s return self 7221s timeout = getattr(self, "death_timeout", None) 7221s 7221s async def _close_on_failure(exc: Exception) -> None: 7221s await self.close(reason=f"failure-to-start-{str(type(exc))}") 7221s self.status = Status.failed 7221s self.__startup_exc = exc 7221s 7221s try: 7221s > await wait_for(self.start_unsafe(), timeout=timeout) 7221s 7221s /usr/lib/python3/dist-packages/distributed/core.py:664: 7221s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7221s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 7221s async with asyncio.timeout(timeout): 7221s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7221s 7221s self = 7221s exc_type = 7221s exc_val = CancelledError(), exc_tb = 7221s 7221s async def __aexit__( 7221s self, 7221s exc_type: Optional[Type[BaseException]], 7221s exc_val: Optional[BaseException], 7221s exc_tb: Optional[TracebackType], 7221s ) -> Optional[bool]: 7221s assert self._state in (_State.ENTERED, _State.EXPIRING) 7221s 7221s if self._timeout_handler is not None: 7221s self._timeout_handler.cancel() 7221s self._timeout_handler = None 7221s 7221s if self._state is _State.EXPIRING: 7221s self._state = _State.EXPIRED 7221s 7221s if self._task.uncancel() <= self._cancelling and exc_type is not None: 7221s # Since there are no new cancel requests, we're 7221s # handling this. 7221s if issubclass(exc_type, exceptions.CancelledError): 7221s > raise TimeoutError from exc_val 7221s E TimeoutError 7221s 7221s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s @contextlib.asynccontextmanager 7221s async def _cluster_factory(): 7221s workers = [] 7221s s = None 7221s try: 7221s for _ in range(60): 7221s try: 7221s > s, ws = await start_cluster( 7221s nthreads, 7221s scheduler, 7221s security=security, 7221s Worker=Worker, 7221s scheduler_kwargs=scheduler_kwargs, 7221s worker_kwargs=merge( 7221s {"death_timeout": min(15, int(deadline.remaining))}, 7221s worker_kwargs, 7221s ), 7221s ) 7221s 7221s /usr/lib/python3/dist-packages/distributed/utils_test.py:966: 7221s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7221s /usr/lib/python3/dist-packages/distributed/utils_test.py:789: in start_cluster 7221s await asyncio.gather(*workers) 7221s /usr/lib/python3.13/asyncio/tasks.py:737: in _wrap_awaitable 7221s return await awaitable 7221s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7221s 7221s self = 7221s 7221s @final 7221s async def start(self): 7221s async with self._startup_lock: 7221s if self.status == Status.failed: 7221s assert self.__startup_exc is not None 7221s raise self.__startup_exc 7221s elif self.status != Status.init: 7221s return self 7221s timeout = getattr(self, "death_timeout", None) 7221s 7221s async def _close_on_failure(exc: Exception) -> None: 7221s await self.close(reason=f"failure-to-start-{str(type(exc))}") 7221s self.status = Status.failed 7221s self.__startup_exc = exc 7221s 7221s try: 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s except asyncio.TimeoutError as exc: 7221s await _close_on_failure(exc) 7221s > raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s E TimeoutError: Worker start timed out after 0s. 7221s 7221s /usr/lib/python3/dist-packages/distributed/core.py:667: TimeoutError 7221s 7221s During handling of the above exception, another exception occurred: 7221s 7221s fut = ._..test_func..async_fn at 0xe9b48bf0> 7221s timeout = 60 7221s 7221s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 7221s async with asyncio.timeout(timeout): 7221s > return await fut 7221s 7221s /usr/lib/python3/dist-packages/distributed/utils.py:1960: 7221s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7221s /usr/lib/python3/dist-packages/distributed/utils_test.py:999: in async_fn 7221s _cluster_factory() as (s, workers), 7221s /usr/lib/python3.13/contextlib.py:214: in __aenter__ 7221s return await anext(self.gen) 7221s /usr/lib/python3/dist-packages/distributed/utils_test.py:983: in _cluster_factory 7221s await asyncio.sleep(1) 7221s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7221s 7221s delay = 1, result = None 7221s 7221s async def sleep(delay, result=None): 7221s """Coroutine that completes after a given time (in seconds).""" 7221s if delay <= 0: 7221s await __sleep0() 7221s return result 7221s 7221s if math.isnan(delay): 7221s raise ValueError("Invalid delay: NaN (not a number)") 7221s 7221s loop = events.get_running_loop() 7221s future = loop.create_future() 7221s h = loop.call_later(delay, 7221s futures._set_result_unless_cancelled, 7221s future, result) 7221s try: 7221s > return await future 7221s E asyncio.exceptions.CancelledError 7221s 7221s /usr/lib/python3.13/asyncio/tasks.py:718: CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s args = (), kwds = {} 7221s 7221s @wraps(func) 7221s def inner(*args, **kwds): 7221s with self._recreate_cm(): 7221s > return func(*args, **kwds) 7221s 7221s /usr/lib/python3.13/contextlib.py:85: 7221s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7221s /usr/lib/python3.13/contextlib.py:85: in inner 7221s return func(*args, **kwds) 7221s /usr/lib/python3/dist-packages/distributed/utils_test.py:1102: in test_func 7221s return _run_and_close_tornado(async_fn_outer) 7221s /usr/lib/python3/dist-packages/distributed/utils_test.py:378: in _run_and_close_tornado 7221s return asyncio_run(inner_fn(), loop_factory=get_loop_factory()) 7221s /usr/lib/python3.13/asyncio/runners.py:194: in run 7221s return runner.run(main) 7221s /usr/lib/python3.13/asyncio/runners.py:118: in run 7221s return self._loop.run_until_complete(task) 7221s /usr/lib/python3.13/asyncio/base_events.py:720: in run_until_complete 7221s return future.result() 7221s /usr/lib/python3/dist-packages/distributed/utils_test.py:375: in inner_fn 7221s return await async_fn(*args, **kwargs) 7221s /usr/lib/python3/dist-packages/distributed/utils_test.py:1099: in async_fn_outer 7221s return await utils_wait_for(async_fn(), timeout=timeout * 2) 7221s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 7221s async with asyncio.timeout(timeout): 7221s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7221s 7221s self = 7221s exc_type = 7221s exc_val = CancelledError(), exc_tb = 7221s 7221s async def __aexit__( 7221s self, 7221s exc_type: Optional[Type[BaseException]], 7221s exc_val: Optional[BaseException], 7221s exc_tb: Optional[TracebackType], 7221s ) -> Optional[bool]: 7221s assert self._state in (_State.ENTERED, _State.EXPIRING) 7221s 7221s if self._timeout_handler is not None: 7221s self._timeout_handler.cancel() 7221s self._timeout_handler = None 7221s 7221s if self._state is _State.EXPIRING: 7221s self._state = _State.EXPIRED 7221s 7221s if self._task.uncancel() <= self._cancelling and exc_type is not None: 7221s # Since there are no new cancel requests, we're 7221s # handling this. 7221s if issubclass(exc_type, exceptions.CancelledError): 7221s > raise TimeoutError from exc_val 7221s E TimeoutError 7221s 7221s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 7221s ----------------------------- Captured stderr call ----------------------------- 7221s 2024-11-23 22:21:14,175 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:21:14,182 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:14,182 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41065/status 7221s 2024-11-23 22:21:14,182 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:21:14,195 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44217 7221s 2024-11-23 22:21:14,196 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44217 7221s 2024-11-23 22:21:14,196 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:21:14,196 - distributed.worker - INFO - dashboard at: 127.0.0.1:34255 7221s 2024-11-23 22:21:14,196 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:14,196 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:21:14,196 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:21:14,196 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:21:14,196 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-0he2f4vl 7221s 2024-11-23 22:21:14,196 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:21:14,198 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42431 7221s 2024-11-23 22:21:14,198 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42431 7221s 2024-11-23 22:21:14,198 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:21:14,198 - distributed.worker - INFO - dashboard at: 127.0.0.1:42103 7221s 2024-11-23 22:21:14,198 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:14,198 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:21:14,198 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:21:14,198 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:21:14,198 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-6c8gcm_z 7221s 2024-11-23 22:21:14,198 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:21:14,211 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:14,212 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:14,212 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:52610': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:14,212 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:52618': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:14,325 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:14,325 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:14,326 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:52622': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:14,326 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:52636': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:14,440 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:14,440 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:14,441 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:52648': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:14,441 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:52656': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:14,553 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:14,553 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:14,554 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:52670': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:14,554 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:52686': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:14,668 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:14,668 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:14,668 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:52698': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:14,669 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:52706': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:14,781 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:14,781 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:14,782 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:52714': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:14,782 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:52718': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:14,895 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:14,895 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:14,896 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:52722': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:14,896 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:52730': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:15,009 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:15,009 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:15,010 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:52742': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:15,010 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:52750': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:15,123 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:15,123 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:15,123 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:52752': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:15,123 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:52754': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:15,236 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:15,236 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:15,237 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:52760': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:15,237 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:52766': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:15,350 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:15,350 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:15,350 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:52778': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:15,350 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:52780': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:15,463 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:15,463 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:15,463 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:52792': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:15,464 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:52808': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:15,576 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:15,576 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:15,576 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:52816': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:15,576 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:52830': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:15,689 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:15,690 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:15,693 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:52844': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:15,693 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:52854': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:15,802 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:15,802 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:15,803 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:52860': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:15,803 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:52862': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:15,915 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:15,915 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:15,916 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:52872': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:15,916 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:52876': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:16,031 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:16,031 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:16,031 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:52884': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:16,031 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:52890': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:16,143 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:16,143 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:16,144 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:52896': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:16,144 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:52898': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:16,258 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:16,258 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:16,259 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:52906': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:16,259 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:52912': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:16,372 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:16,372 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:16,372 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:52920': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:16,372 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:52924': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:16,485 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:16,485 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:16,486 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:52936': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:16,486 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:52952': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:16,598 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:16,598 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:16,598 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:52960': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:16,598 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:52972': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:16,711 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:16,711 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:16,711 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:52982': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:16,711 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:52986': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:16,824 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:16,825 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:16,825 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:53002': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:16,825 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:53008': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:16,938 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:16,938 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:16,939 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:53022': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:16,939 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:53026': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:17,051 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:17,051 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:17,052 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:53032': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:17,052 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:53038': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:17,165 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:17,165 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:17,165 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:53040': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:17,165 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:53056': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:17,278 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:17,278 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:17,279 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:53058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:17,279 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:53068': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:17,392 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:17,392 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:17,393 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:53070': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:17,393 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:53076': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:17,506 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:17,506 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:17,507 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:53080': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:17,507 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:53094': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:17,619 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:17,619 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:17,619 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:53096': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:17,619 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:53100': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:17,732 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:17,732 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:17,732 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:53102': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:17,733 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:53112': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:17,846 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:17,847 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:17,847 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:53120': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:17,847 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:53128': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:17,959 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:17,960 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:17,960 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:53142': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:17,960 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:53146': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:18,073 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:18,074 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:18,074 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:53162': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:18,074 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:53176': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:18,187 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:18,187 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:18,191 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:53192': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:18,191 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:53202': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:18,300 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:18,300 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:18,300 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:53218': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:18,300 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:53220': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:18,414 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:18,415 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:18,415 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:53226': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:18,415 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:53228': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:18,527 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:18,528 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:18,528 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:53230': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:18,528 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:53234': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:18,641 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:18,641 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:18,642 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:53248': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:18,642 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:53260': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:18,755 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:18,755 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:18,756 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:53266': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:18,756 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:53274': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:18,869 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:18,869 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:18,869 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:53288': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:18,869 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:53304': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:18,982 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:18,982 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:18,983 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:53306': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:18,983 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:53316': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:19,096 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:19,096 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:19,096 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:53324': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:19,096 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:53336': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:19,208 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:19,208 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:19,209 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:53342': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:19,209 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:53344': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:19,324 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:19,324 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:19,324 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:53346': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:19,325 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:53356': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:19,437 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:19,438 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:19,438 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:53364': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:19,438 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:53370': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:19,550 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:19,551 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:19,551 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:53374': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:19,551 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:53384': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:19,665 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:19,665 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:19,665 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:53388': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:19,665 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:53394': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:19,778 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:19,778 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:19,779 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:53396': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:19,779 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:53398': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:19,892 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:19,892 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:19,893 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:53406': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:19,893 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:53418': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:20,006 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:20,006 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:20,006 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:53426': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:20,006 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:53438': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:20,119 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:20,119 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:20,120 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:53454': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:20,120 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:53464': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:20,233 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:20,233 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:20,234 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:53470': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:20,234 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:53478': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:20,346 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:20,347 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:20,347 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:53492': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:20,347 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:53500': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:20,459 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:20,459 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:20,460 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:53504': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:20,460 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:53516': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:20,573 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:20,573 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:20,574 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:53532': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:20,574 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:53538': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:20,687 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:20,687 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:20,691 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:53548': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:20,691 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:53564': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:20,800 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:20,800 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:20,801 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:53574': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:20,801 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:53580': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:20,913 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:20,913 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:20,913 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:53592': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:20,913 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:53598': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:21,028 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:21,028 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:21,028 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:53606': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:21,028 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:53614': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:21,141 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:21,141 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:21,142 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:53626': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:21,142 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:53638': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:21,255 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:21,255 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:21,256 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:53640': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:21,256 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:53652': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:21,369 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:21,369 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:21,370 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:53656': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:21,370 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:53672': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:21,484 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:21,484 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:21,484 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:53682': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:21,485 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:53696': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:21,597 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:21,597 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:21,598 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:49572': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:21,598 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:49576': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:21,710 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:21,710 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:21,710 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:49582': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:21,710 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:49598': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:21,823 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:21,824 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:21,824 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:49606': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:21,824 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:49618': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:21,937 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:21,937 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:21,938 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:49630': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:21,938 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:49642': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:22,051 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:22,051 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:22,051 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:49656': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:22,051 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:49658': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:22,164 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:22,164 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:22,164 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:49674': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:22,165 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:49682': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:22,277 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:22,277 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:22,278 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:49698': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:22,278 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:49702': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:22,390 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:22,391 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:22,391 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:49708': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:22,391 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:49716': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:22,503 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:22,503 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:22,503 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:49730': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:22,504 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:49742': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:22,619 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:22,619 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:22,619 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:49750': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:22,619 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:49752': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:22,732 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:22,733 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:22,733 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:49764': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:22,733 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:49778': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:22,846 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:22,846 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:22,846 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:49794': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:22,846 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:49810': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:22,959 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:22,959 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:22,960 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:49816': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:22,960 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:49822': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:23,072 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:23,073 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:23,073 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:49824': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:23,073 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:49830': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:23,186 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:23,186 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:23,190 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:49846': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:23,190 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:49858': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:23,300 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:23,301 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:23,301 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:49872': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:23,301 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:49882': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:23,413 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:23,414 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:23,414 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:49894': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:23,414 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:49896': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:23,527 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:23,527 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:23,527 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:49910': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:23,527 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:49912': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:23,640 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:23,640 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:23,641 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:49924': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:23,641 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:49926': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:23,753 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:23,754 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:23,754 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:49938': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:23,754 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:49954': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:23,868 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:23,868 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:23,869 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:49958': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:23,869 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:49970': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:23,981 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:23,981 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:23,982 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:49984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:23,982 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:50000': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:24,095 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:24,095 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:24,095 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:50010': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:24,096 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:50026': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:24,209 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:24,210 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:24,210 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:50040': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:24,210 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:50046': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:24,325 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:24,325 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:24,325 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:50054': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:24,325 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:50062': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:24,438 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:24,438 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:24,439 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:50066': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:24,439 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:50078': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:24,551 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:24,551 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:24,552 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:50088': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:24,552 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:50100': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:24,665 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:24,665 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:24,665 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:50116': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:24,665 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:50126': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:24,779 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:24,779 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:24,779 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:50130': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:24,779 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:50138': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:24,893 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:24,893 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:24,893 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:50146': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:24,893 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:50154': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:25,006 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:25,006 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:25,007 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:50160': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:25,007 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:50170': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:25,120 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:25,120 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:25,120 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:50174': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:25,120 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:50182': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:25,233 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:25,233 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:25,234 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:50198': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:25,234 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:50208': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:25,346 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:25,346 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:25,347 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:50216': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:25,347 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:50220': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:25,460 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:25,460 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:25,461 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:50222': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:25,461 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:50234': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:25,574 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:25,574 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:25,575 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:50244': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:25,575 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:50250': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:25,688 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:25,688 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:25,692 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:50264': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:25,693 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:50280': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:25,802 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:25,802 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:25,802 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:50288': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:25,803 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:50298': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:25,916 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:25,916 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:25,917 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:50306': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:25,917 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:50310': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:26,030 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:26,030 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:26,030 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:50314': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:26,030 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:50324': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:26,144 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:26,144 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:26,144 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:50330': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:26,144 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:50336': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:26,257 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:26,257 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:26,257 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:50350': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:26,258 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:50362': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:26,371 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:26,371 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:26,372 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:50370': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:26,372 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:50376': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:26,484 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:26,485 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:26,485 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:50380': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:26,485 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:50386': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:26,597 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:26,598 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:26,598 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:50402': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:26,598 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:50418': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:26,711 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:26,711 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:26,711 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:50430': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:26,711 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:50442': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:26,824 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:26,824 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:26,824 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:50448': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:26,825 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:50464': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:26,939 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:26,939 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:26,940 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:50466': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:26,940 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:50472': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:27,052 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:27,052 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:27,052 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:50484': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:27,052 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:50494': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:27,166 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:27,166 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:27,166 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:50502': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:27,166 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:50516': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:27,279 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:27,279 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:27,280 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:50530': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:27,280 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:50538': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:27,393 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:27,393 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:27,393 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:50554': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:27,394 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:50558': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:27,507 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:27,507 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:27,509 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:50560': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:27,509 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:50570': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:27,621 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:27,621 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:27,621 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:50578': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:27,621 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:50586': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:27,735 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:27,735 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:27,735 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:50594': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:27,735 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:50600': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:27,849 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:27,849 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:27,850 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:50608': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:27,850 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:50614': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:27,962 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:27,962 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:27,963 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:50618': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:27,963 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:50628': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:28,076 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:28,076 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:28,077 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:50642': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:28,077 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:50654': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:28,191 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:28,191 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:28,194 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:50660': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:28,195 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:50664': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:28,304 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:28,304 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:28,304 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:50680': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:28,305 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:50686': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:28,417 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:28,417 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:28,417 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:50702': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:28,418 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:50716': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:28,530 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:28,530 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:28,531 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:50722': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:28,531 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:50728': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:28,644 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:28,644 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:28,645 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:50736': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:28,645 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:50742': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:28,758 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:28,758 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:28,759 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:50756': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:28,759 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:50766': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:28,873 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:28,873 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:28,873 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:50774': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:28,873 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:50782': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:28,986 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:28,986 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:28,987 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:50794': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:28,987 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:50804': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:29,099 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:29,099 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41661 7221s 2024-11-23 22:21:29,099 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:50816': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:29,099 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41661': TLS handshake failed with remote 'tls://127.0.0.1:50826': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:29,194 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44217. Reason: failure-to-start- 7221s 2024-11-23 22:21:29,194 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:21:29,196 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 15s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 7221s stream = await stream.start_tls( 7221s ^^^^^^^^^^^^^^^^^^^^^^^ 7221s False, ssl_options=ssl_options, server_hostname=host 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 7221s self.socket.do_handshake() 7221s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 7221s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 7221s self._sslobj.do_handshake() 7221s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 7221s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 7221s raise FatalCommClosedError( 7221s ...<2 lines>... 7221s ) from err 7221s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 7221s 7221s During handling of the above exception, another exception occurred: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1218, in _register_with_scheduler 7221s await asyncio.sleep(0.1) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 718, in sleep 7221s return await future 7221s ^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 15s. 7221s 2024-11-23 22:21:29,200 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42431. Reason: failure-to-start- 7221s 2024-11-23 22:21:29,200 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:21:30,203 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:21:30,210 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:30,210 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35747/status 7221s 2024-11-23 22:21:30,210 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:21:30,225 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35575 7221s 2024-11-23 22:21:30,225 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35575 7221s 2024-11-23 22:21:30,225 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:21:30,225 - distributed.worker - INFO - dashboard at: 127.0.0.1:42751 7221s 2024-11-23 22:21:30,225 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:30,225 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:21:30,225 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:21:30,225 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:21:30,225 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-pb4j35ss 7221s 2024-11-23 22:21:30,225 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:21:30,228 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46485 7221s 2024-11-23 22:21:30,228 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46485 7221s 2024-11-23 22:21:30,228 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:21:30,228 - distributed.worker - INFO - dashboard at: 127.0.0.1:34045 7221s 2024-11-23 22:21:30,228 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:30,228 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:21:30,228 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:21:30,228 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:21:30,228 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-0sgaxak8 7221s 2024-11-23 22:21:30,228 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:21:30,241 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:30,241 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:30,242 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:48614': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:30,242 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:48620': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:30,354 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:30,354 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:30,355 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:48636': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:30,355 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:48638': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:30,467 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:30,467 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:30,468 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:48640': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:30,468 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:48656': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:30,580 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:30,580 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:30,582 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:48666': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:30,582 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:48678': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:30,697 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:30,697 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:30,697 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:48684': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:30,697 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:48692': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:30,810 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:30,810 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:30,811 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:48704': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:30,811 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:48708': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:30,924 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:30,924 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:30,925 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:48716': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:30,925 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:48724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:31,038 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:31,038 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:31,038 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:48736': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:31,038 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:48746': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:31,151 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:31,151 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:31,152 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:48760': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:31,152 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:48762': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:31,265 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:31,265 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:31,266 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:48770': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:31,266 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:48778': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:31,378 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:31,379 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:31,379 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:48784': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:31,379 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:48794': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:31,493 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:31,494 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:31,494 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:48806': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:31,494 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:48822': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:31,607 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:31,607 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:31,608 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:38678': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:31,608 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:38694': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:31,721 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:31,721 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:31,725 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:38698': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:31,726 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:38708': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:31,834 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:31,834 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:31,835 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:38716': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:31,835 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:38720': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:31,948 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:31,948 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:31,948 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:38734': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:31,948 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:38744': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:32,062 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:32,063 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:32,063 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:38754': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:32,063 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:38770': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:32,177 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:32,177 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:32,177 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:38772': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:32,178 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:38778': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:32,290 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:32,291 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:32,291 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:38784': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:32,291 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:38786': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:32,404 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:32,404 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:32,405 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:38796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:32,405 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:38798': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:32,518 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:32,518 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:32,519 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:38814': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:32,519 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:38830': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:32,631 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:32,632 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:32,632 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:38832': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:32,632 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:38840': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:32,747 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:32,747 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:32,747 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:38854': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:32,747 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:38870': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:32,861 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:32,861 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:32,862 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:38882': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:32,862 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:38894': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:32,975 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:32,975 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:32,976 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:38908': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:32,976 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:38916': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:33,088 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:33,089 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:33,089 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:38932': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:33,089 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:38934': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:33,202 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:33,202 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:33,203 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:38942': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:33,203 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:38948': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:33,316 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:33,316 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:33,317 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:38958': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:33,317 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:38962': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:33,429 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:33,429 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:33,430 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:38978': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:33,430 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:38992': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:33,543 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:33,543 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:33,544 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:39004': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:33,544 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:39012': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:33,656 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:33,656 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:33,657 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:39028': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:33,657 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:39042': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:33,769 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:33,769 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:33,771 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:39056': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:33,771 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:39060': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:33,885 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:33,885 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:33,885 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:39070': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:33,886 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:39082': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:33,999 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:33,999 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:33,999 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:39090': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:33,999 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:39100': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:34,112 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:34,112 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:34,113 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:39104': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:34,113 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:39118': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:34,227 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:34,228 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:34,228 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:39120': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:34,228 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:39122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:34,341 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:34,341 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:34,341 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:39134': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:34,341 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:39150': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:34,454 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:34,454 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:34,455 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:39152': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:34,455 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:39164': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:34,567 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:34,568 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:34,568 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:39170': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:34,568 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:39180': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:34,680 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:34,681 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:34,681 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:39190': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:34,681 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:39200': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:34,794 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:34,795 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:34,795 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:39216': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:34,795 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:39228': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:34,907 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:34,908 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:34,908 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:39244': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:34,908 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:39250': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:35,021 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:35,021 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:35,021 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:39252': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:35,021 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:39264': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:35,134 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:35,134 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:35,135 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:39276': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:35,135 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:39290': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:35,247 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:35,248 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:35,248 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:39298': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:35,248 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:39302': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:35,361 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:35,361 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:35,362 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:39318': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:35,362 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:39330': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:35,475 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:35,475 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:35,476 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:39336': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:35,476 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:39342': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:35,589 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:35,590 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:35,590 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:39346': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:35,590 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:39362': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:35,704 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:35,704 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:35,704 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:39374': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:35,705 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:39376': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:35,817 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:35,818 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:35,818 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:39384': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:35,818 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:39400': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:35,931 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:35,931 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:35,932 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:39406': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:35,932 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:39418': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:36,045 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:36,045 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:36,046 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:39432': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:36,046 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:39444': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:36,158 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:36,159 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:36,159 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:39456': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:36,159 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:39462': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:36,273 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:36,273 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:36,273 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:39466': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:36,273 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:39476': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:36,386 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:36,386 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:36,387 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:39488': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:36,387 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:39494': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:36,500 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:36,500 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:36,501 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:39500': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:36,501 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:39504': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:36,614 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:36,614 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:36,614 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:39518': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:36,615 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:39520': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:36,727 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:36,727 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:36,728 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:39526': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:36,728 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:39534': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:36,840 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:36,841 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:36,841 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:39548': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:36,841 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:39558': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:36,954 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:36,955 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:36,955 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:39574': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:36,955 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:39580': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:37,068 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:37,068 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:37,069 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:39584': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:37,069 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:39586': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:37,181 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:37,182 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:37,182 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:39596': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:37,182 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:39602': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:37,295 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:37,295 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:37,296 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:39604': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:37,296 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:39614': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:37,409 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:37,409 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:37,410 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:39622': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:37,410 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:39634': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:37,523 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:37,523 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:37,524 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:39636': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:37,524 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:39640': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:37,636 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:37,636 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:37,637 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:39648': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:37,637 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:39660': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:37,749 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:37,749 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:37,750 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:39672': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:37,750 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:39684': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:37,862 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:37,862 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:37,863 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:39696': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:37,863 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:39704': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:37,975 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:37,975 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:37,976 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:39718': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:37,976 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:39724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:38,088 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:38,088 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:38,089 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:39728': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:38,089 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:39740': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:38,201 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:38,201 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:38,201 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:39750': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:38,201 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:39752': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:38,314 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:38,315 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:38,315 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:39766': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:38,315 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:39778': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:38,427 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:38,427 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:38,428 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:39782': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:38,428 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:39792': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:38,541 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:38,541 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:38,541 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:39794': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:38,541 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:39804': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:38,654 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:38,654 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:38,654 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:39808': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:38,654 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:39810': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:38,767 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:38,767 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:38,768 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:39818': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:38,768 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:39820': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:38,880 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:38,881 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:38,881 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:39824': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:38,881 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:39834': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:38,994 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:38,994 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:38,995 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:39846': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:38,995 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:39854': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:39,107 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:39,107 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:39,109 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:39860': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:39,109 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:39874': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:39,216 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:39,219 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:39886': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:39,224 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:39,225 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:39900': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:39,325 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:39,325 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:39912': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:39,332 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:39,332 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:39916': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:39,433 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:39,434 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:39928': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:39,440 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:39,440 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:39936': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:39,541 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:39,541 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:39946': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:39,547 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:39,548 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:39956': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:39,648 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:39,649 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:39958': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:39,655 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:39,656 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:39974': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:39,756 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:39,757 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:39988': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:39,763 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:39,764 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:40000': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:39,864 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:39,865 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:40008': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:39,871 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:39,871 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:40010': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:39,971 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:39,972 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:40024': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:39,978 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:39,979 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:40040': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:40,079 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:40,079 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:40046': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:40,086 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:40,086 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:40048': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:40,187 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:40,190 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:40058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:40,197 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:40,197 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:40062': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:40,294 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:40,295 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:40074': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:40,304 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:40,305 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:40084': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:40,402 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:40,403 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:40092': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:40,411 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:40,412 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:40100': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:40,510 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:40,510 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:40106': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:40,519 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:40,519 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:40108': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:40,618 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:40,618 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:40118': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:40,626 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:40,626 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:40132': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:40,726 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:40,726 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:40144': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:40,733 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:40,733 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:40154': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:40,835 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:40,836 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:40162': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:40,842 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:40,842 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:40176': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:40,943 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:40,944 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:40180': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:40,950 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:40,951 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:40194': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:41,052 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:41,053 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:40196': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:41,059 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:41,059 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:40200': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:41,160 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:41,160 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:40208': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:41,167 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:41,167 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:40222': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:41,267 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:41,268 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:40238': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:41,274 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:41,275 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:40244': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:41,375 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:41,376 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:40246': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:41,382 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:41,383 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:40262': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:41,483 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:41,483 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:40274': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:41,490 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:41,490 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:40286': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:41,591 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:41,591 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:39308': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:41,598 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:41,598 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:39322': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:41,699 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:41,699 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:39332': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:41,706 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:41,706 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:39348': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:41,806 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:41,807 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:39352': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:41,813 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:41,814 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:39364': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:41,914 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:41,914 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:39374': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:41,921 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:41,921 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:39386': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:42,021 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:42,022 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:39392': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:42,028 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:42,029 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:39408': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:42,129 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:42,130 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:39410': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:42,136 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:42,136 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:39414': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:42,237 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:42,237 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:39418': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:42,244 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:42,244 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:39424': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:42,346 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:42,347 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:39434': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:42,353 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:42,353 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:39438': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:42,454 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:42,458 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:39444': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:42,465 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:42,465 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:39460': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:42,562 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:42,562 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:39468': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:42,572 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:42,572 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:39472': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:42,670 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:42,670 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:39488': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:42,679 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:42,679 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:39504': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:42,778 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:42,778 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:39508': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:42,786 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:42,786 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:39524': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:42,887 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:42,888 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:39532': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:42,894 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:42,894 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:39534': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:42,995 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:42,995 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:39548': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:43,002 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:43,002 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:39558': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:43,102 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:43,103 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:39560': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:43,109 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:43,109 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:39574': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:43,210 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:43,210 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:39576': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:43,219 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37339 7221s 2024-11-23 22:21:43,220 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37339': TLS handshake failed with remote 'tls://127.0.0.1:39586': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:21:43,224 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35575. Reason: failure-to-start- 7221s 2024-11-23 22:21:43,224 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:21:43,226 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 13s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 7221s stream = await stream.start_tls( 7221s ^^^^^^^^^^^^^^^^^^^^^^^ 7221s False, ssl_options=ssl_options, server_hostname=host 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 7221s self.socket.do_handshake() 7221s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 7221s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 7221s self._sslobj.do_handshake() 7221s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 7221s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 7221s raise FatalCommClosedError( 7221s ...<2 lines>... 7221s ) from err 7221s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 7221s 7221s During handling of the above exception, another exception occurred: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1218, in _register_with_scheduler 7221s await asyncio.sleep(0.1) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 718, in sleep 7221s return await future 7221s ^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 13s. 7221s 2024-11-23 22:21:43,229 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46485. Reason: failure-to-start- 7221s 2024-11-23 22:21:43,229 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:21:44,232 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:21:44,239 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42411 7221s 2024-11-23 22:21:44,239 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39125/status 7221s 2024-11-23 22:21:44,239 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:21:44,253 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45099 7221s 2024-11-23 22:21:44,253 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45099 7221s 2024-11-23 22:21:44,253 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:21:44,253 - distributed.worker - INFO - dashboard at: 127.0.0.1:34467 7221s 2024-11-23 22:21:44,253 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42411 7221s 2024-11-23 22:21:44,253 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:21:44,253 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:21:44,253 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:21:44,253 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-lb2f4w_y 7221s 2024-11-23 22:21:44,253 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:21:44,256 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38263 7221s 2024-11-23 22:21:44,256 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38263 7221s 2024-11-23 22:21:44,256 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:21:44,256 - distributed.worker - INFO - dashboard at: 127.0.0.1:44921 7221s 2024-11-23 22:21:44,256 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42411 7221s 2024-11-23 22:21:44,256 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:21:44,256 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:21:44,256 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:21:44,256 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-_zy_75cc 7221s 2024-11-23 22:21:44,256 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:21:44,257 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45099. Reason: failure-to-start- 7221s 2024-11-23 22:21:44,257 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:21:44,258 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38263. Reason: failure-to-start- 7221s 2024-11-23 22:21:44,258 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:21:44,259 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42411': TLS handshake failed with remote 'tls://127.0.0.1:38354': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:21:44,259 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42411': TLS handshake failed with remote 'tls://127.0.0.1:38356': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:21:44,261 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s 2024-11-23 22:21:45,266 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:21:45,273 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37859 7221s 2024-11-23 22:21:45,273 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34981/status 7221s 2024-11-23 22:21:45,274 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:21:45,287 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43531 7221s 2024-11-23 22:21:45,287 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43531 7221s 2024-11-23 22:21:45,288 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:21:45,288 - distributed.worker - INFO - dashboard at: 127.0.0.1:36055 7221s 2024-11-23 22:21:45,288 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37859 7221s 2024-11-23 22:21:45,288 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:21:45,288 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:21:45,288 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:21:45,288 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-y4w25s0b 7221s 2024-11-23 22:21:45,288 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:21:45,290 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46879 7221s 2024-11-23 22:21:45,290 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46879 7221s 2024-11-23 22:21:45,290 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:21:45,290 - distributed.worker - INFO - dashboard at: 127.0.0.1:41549 7221s 2024-11-23 22:21:45,290 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37859 7221s 2024-11-23 22:21:45,290 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:21:45,290 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:21:45,290 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:21:45,290 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-tjhwuizp 7221s 2024-11-23 22:21:45,290 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:21:45,292 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43531. Reason: failure-to-start- 7221s 2024-11-23 22:21:45,292 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:21:45,292 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46879. Reason: failure-to-start- 7221s 2024-11-23 22:21:45,292 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:21:45,294 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37859': TLS handshake failed with remote 'tls://127.0.0.1:34880': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:21:45,294 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37859': TLS handshake failed with remote 'tls://127.0.0.1:34890': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:21:45,295 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s 2024-11-23 22:21:46,302 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:21:46,309 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46693 7221s 2024-11-23 22:21:46,309 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36829/status 7221s 2024-11-23 22:21:46,309 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:21:46,323 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39403 7221s 2024-11-23 22:21:46,323 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39403 7221s 2024-11-23 22:21:46,323 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:21:46,323 - distributed.worker - INFO - dashboard at: 127.0.0.1:46801 7221s 2024-11-23 22:21:46,323 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46693 7221s 2024-11-23 22:21:46,323 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:21:46,323 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:21:46,323 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:21:46,323 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-wqdl2ifv 7221s 2024-11-23 22:21:46,323 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:21:46,325 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39127 7221s 2024-11-23 22:21:46,325 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39127 7221s 2024-11-23 22:21:46,325 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:21:46,325 - distributed.worker - INFO - dashboard at: 127.0.0.1:40467 7221s 2024-11-23 22:21:46,325 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46693 7221s 2024-11-23 22:21:46,325 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:21:46,326 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:21:46,326 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:21:46,326 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-b4rlp6nz 7221s 2024-11-23 22:21:46,326 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:21:46,327 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39403. Reason: failure-to-start- 7221s 2024-11-23 22:21:46,327 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:21:46,327 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39127. Reason: failure-to-start- 7221s 2024-11-23 22:21:46,327 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:21:46,329 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46693': TLS handshake failed with remote 'tls://127.0.0.1:39788': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:21:46,329 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46693': TLS handshake failed with remote 'tls://127.0.0.1:39792': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:21:46,330 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s 2024-11-23 22:21:47,337 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:21:47,344 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33615 7221s 2024-11-23 22:21:47,344 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45791/status 7221s 2024-11-23 22:21:47,344 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:21:47,359 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45995 7221s 2024-11-23 22:21:47,359 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45995 7221s 2024-11-23 22:21:47,359 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:21:47,359 - distributed.worker - INFO - dashboard at: 127.0.0.1:39161 7221s 2024-11-23 22:21:47,359 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33615 7221s 2024-11-23 22:21:47,359 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:21:47,359 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:21:47,359 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:21:47,359 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-hs0cl7je 7221s 2024-11-23 22:21:47,359 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:21:47,361 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37185 7221s 2024-11-23 22:21:47,361 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37185 7221s 2024-11-23 22:21:47,361 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:21:47,361 - distributed.worker - INFO - dashboard at: 127.0.0.1:46481 7221s 2024-11-23 22:21:47,362 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33615 7221s 2024-11-23 22:21:47,362 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:21:47,362 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:21:47,362 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:21:47,362 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-kepgnicq 7221s 2024-11-23 22:21:47,362 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:21:47,363 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45995. Reason: failure-to-start- 7221s 2024-11-23 22:21:47,363 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:21:47,363 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37185. Reason: failure-to-start- 7221s 2024-11-23 22:21:47,363 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:21:47,365 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33615': TLS handshake failed with remote 'tls://127.0.0.1:39542': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:21:47,365 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33615': TLS handshake failed with remote 'tls://127.0.0.1:39550': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:21:47,366 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s 2024-11-23 22:21:48,372 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:21:48,379 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:32889 7221s 2024-11-23 22:21:48,379 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43397/status 7221s 2024-11-23 22:21:48,379 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:21:48,394 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34633 7221s 2024-11-23 22:21:48,395 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34633 7221s 2024-11-23 22:21:48,395 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:21:48,395 - distributed.worker - INFO - dashboard at: 127.0.0.1:38351 7221s 2024-11-23 22:21:48,395 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:32889 7221s 2024-11-23 22:21:48,395 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:21:48,395 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:21:48,395 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:21:48,395 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-f6uviz8e 7221s 2024-11-23 22:21:48,395 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:21:48,397 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44015 7221s 2024-11-23 22:21:48,397 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44015 7221s 2024-11-23 22:21:48,397 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:21:48,397 - distributed.worker - INFO - dashboard at: 127.0.0.1:38829 7221s 2024-11-23 22:21:48,397 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:32889 7221s 2024-11-23 22:21:48,397 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:21:48,398 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:21:48,398 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:21:48,398 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-8jqzojrt 7221s 2024-11-23 22:21:48,398 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:21:48,399 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34633. Reason: failure-to-start- 7221s 2024-11-23 22:21:48,399 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:21:48,399 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44015. Reason: failure-to-start- 7221s 2024-11-23 22:21:48,399 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:21:48,401 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:32889': TLS handshake failed with remote 'tls://127.0.0.1:43830': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:21:48,401 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:32889': TLS handshake failed with remote 'tls://127.0.0.1:43842': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:21:48,402 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s 2024-11-23 22:21:49,408 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:21:49,415 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36571 7221s 2024-11-23 22:21:49,416 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39897/status 7221s 2024-11-23 22:21:49,416 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:21:49,429 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38407 7221s 2024-11-23 22:21:49,429 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38407 7221s 2024-11-23 22:21:49,429 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:21:49,429 - distributed.worker - INFO - dashboard at: 127.0.0.1:41209 7221s 2024-11-23 22:21:49,429 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36571 7221s 2024-11-23 22:21:49,429 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:21:49,429 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:21:49,429 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:21:49,429 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-puk6ceks 7221s 2024-11-23 22:21:49,429 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:21:49,432 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38121 7221s 2024-11-23 22:21:49,432 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38121 7221s 2024-11-23 22:21:49,432 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:21:49,432 - distributed.worker - INFO - dashboard at: 127.0.0.1:46103 7221s 2024-11-23 22:21:49,432 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36571 7221s 2024-11-23 22:21:49,432 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:21:49,432 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:21:49,432 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:21:49,432 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-puejnx7q 7221s 2024-11-23 22:21:49,432 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:21:49,433 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38407. Reason: failure-to-start- 7221s 2024-11-23 22:21:49,433 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:21:49,434 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38121. Reason: failure-to-start- 7221s 2024-11-23 22:21:49,434 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:21:49,435 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36571': TLS handshake failed with remote 'tls://127.0.0.1:57308': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:21:49,436 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36571': TLS handshake failed with remote 'tls://127.0.0.1:57316': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:21:49,437 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s 2024-11-23 22:21:50,444 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:21:50,451 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42635 7221s 2024-11-23 22:21:50,451 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34769/status 7221s 2024-11-23 22:21:50,451 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:21:50,464 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39229 7221s 2024-11-23 22:21:50,464 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39229 7221s 2024-11-23 22:21:50,464 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:21:50,465 - distributed.worker - INFO - dashboard at: 127.0.0.1:40563 7221s 2024-11-23 22:21:50,465 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42635 7221s 2024-11-23 22:21:50,465 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:21:50,465 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:21:50,465 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:21:50,465 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-6lk_e07n 7221s 2024-11-23 22:21:50,465 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:21:50,467 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44721 7221s 2024-11-23 22:21:50,467 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44721 7221s 2024-11-23 22:21:50,467 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:21:50,467 - distributed.worker - INFO - dashboard at: 127.0.0.1:46801 7221s 2024-11-23 22:21:50,467 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42635 7221s 2024-11-23 22:21:50,467 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:21:50,467 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:21:50,467 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:21:50,467 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-e9ewpcsc 7221s 2024-11-23 22:21:50,467 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:21:50,468 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39229. Reason: failure-to-start- 7221s 2024-11-23 22:21:50,469 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:21:50,469 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44721. Reason: failure-to-start- 7221s 2024-11-23 22:21:50,469 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:21:50,471 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42635': TLS handshake failed with remote 'tls://127.0.0.1:59958': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:21:50,471 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42635': TLS handshake failed with remote 'tls://127.0.0.1:59972': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:21:50,472 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s 2024-11-23 22:21:51,478 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:21:51,485 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46231 7221s 2024-11-23 22:21:51,485 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44809/status 7221s 2024-11-23 22:21:51,485 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:21:51,499 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45911 7221s 2024-11-23 22:21:51,500 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45911 7221s 2024-11-23 22:21:51,500 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:21:51,500 - distributed.worker - INFO - dashboard at: 127.0.0.1:42641 7221s 2024-11-23 22:21:51,500 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46231 7221s 2024-11-23 22:21:51,500 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:21:51,500 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:21:51,500 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:21:51,500 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-7x13u18a 7221s 2024-11-23 22:21:51,500 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:21:51,502 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36149 7221s 2024-11-23 22:21:51,502 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36149 7221s 2024-11-23 22:21:51,502 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:21:51,502 - distributed.worker - INFO - dashboard at: 127.0.0.1:43633 7221s 2024-11-23 22:21:51,502 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46231 7221s 2024-11-23 22:21:51,503 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:21:51,503 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:21:51,503 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:21:51,503 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-fin25d2p 7221s 2024-11-23 22:21:51,503 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:21:51,504 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45911. Reason: failure-to-start- 7221s 2024-11-23 22:21:51,504 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:21:51,504 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36149. Reason: failure-to-start- 7221s 2024-11-23 22:21:51,505 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:21:51,506 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46231': TLS handshake failed with remote 'tls://127.0.0.1:57948': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:21:51,506 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46231': TLS handshake failed with remote 'tls://127.0.0.1:57964': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:21:51,507 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s 2024-11-23 22:21:52,513 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:21:52,520 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33495 7221s 2024-11-23 22:21:52,521 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44321/status 7221s 2024-11-23 22:21:52,521 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:21:52,535 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38599 7221s 2024-11-23 22:21:52,535 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38599 7221s 2024-11-23 22:21:52,535 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:21:52,535 - distributed.worker - INFO - dashboard at: 127.0.0.1:34325 7221s 2024-11-23 22:21:52,535 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33495 7221s 2024-11-23 22:21:52,535 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:21:52,535 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:21:52,535 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:21:52,536 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-mz62d7ub 7221s 2024-11-23 22:21:52,536 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:21:52,538 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42603 7221s 2024-11-23 22:21:52,538 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42603 7221s 2024-11-23 22:21:52,538 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:21:52,538 - distributed.worker - INFO - dashboard at: 127.0.0.1:38577 7221s 2024-11-23 22:21:52,538 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33495 7221s 2024-11-23 22:21:52,538 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:21:52,538 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:21:52,538 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:21:52,538 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-eebur9d6 7221s 2024-11-23 22:21:52,538 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:21:52,539 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38599. Reason: failure-to-start- 7221s 2024-11-23 22:21:52,540 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:21:52,540 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42603. Reason: failure-to-start- 7221s 2024-11-23 22:21:52,540 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:21:52,541 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33495': TLS handshake failed with remote 'tls://127.0.0.1:57148': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:21:52,542 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33495': TLS handshake failed with remote 'tls://127.0.0.1:57158': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:21:52,543 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s 2024-11-23 22:21:53,548 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:21:53,555 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40059 7221s 2024-11-23 22:21:53,556 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36157/status 7221s 2024-11-23 22:21:53,556 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:21:53,570 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37825 7221s 2024-11-23 22:21:53,570 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37825 7221s 2024-11-23 22:21:53,570 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:21:53,570 - distributed.worker - INFO - dashboard at: 127.0.0.1:38237 7221s 2024-11-23 22:21:53,570 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 7221s 2024-11-23 22:21:53,570 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:21:53,571 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:21:53,571 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:21:53,571 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-q4qs1n8z 7221s 2024-11-23 22:21:53,571 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:21:53,573 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37919 7221s 2024-11-23 22:21:53,573 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37919 7221s 2024-11-23 22:21:53,573 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:21:53,573 - distributed.worker - INFO - dashboard at: 127.0.0.1:43785 7221s 2024-11-23 22:21:53,573 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40059 7221s 2024-11-23 22:21:53,573 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:21:53,573 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:21:53,573 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:21:53,573 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-k7t_g2xm 7221s 2024-11-23 22:21:53,574 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:21:53,576 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37825. Reason: failure-to-start- 7221s 2024-11-23 22:21:53,576 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:21:53,576 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37919. Reason: failure-to-start- 7221s 2024-11-23 22:21:53,576 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:21:53,578 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:53588': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:21:53,578 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40059': TLS handshake failed with remote 'tls://127.0.0.1:53604': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:21:53,580 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s 2024-11-23 22:21:54,585 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:21:54,592 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45453 7221s 2024-11-23 22:21:54,593 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35467/status 7221s 2024-11-23 22:21:54,593 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:21:54,607 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39661 7221s 2024-11-23 22:21:54,607 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39661 7221s 2024-11-23 22:21:54,607 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:21:54,607 - distributed.worker - INFO - dashboard at: 127.0.0.1:37533 7221s 2024-11-23 22:21:54,607 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45453 7221s 2024-11-23 22:21:54,607 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:21:54,607 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:21:54,608 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:21:54,608 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-0u54jorz 7221s 2024-11-23 22:21:54,608 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:21:54,610 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45847 7221s 2024-11-23 22:21:54,610 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45847 7221s 2024-11-23 22:21:54,610 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:21:54,610 - distributed.worker - INFO - dashboard at: 127.0.0.1:37551 7221s 2024-11-23 22:21:54,610 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45453 7221s 2024-11-23 22:21:54,610 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:21:54,611 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:21:54,611 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:21:54,611 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-t6y1w743 7221s 2024-11-23 22:21:54,611 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:21:54,612 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39661. Reason: failure-to-start- 7221s 2024-11-23 22:21:54,612 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:21:54,613 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45847. Reason: failure-to-start- 7221s 2024-11-23 22:21:54,613 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:21:54,614 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45453': TLS handshake failed with remote 'tls://127.0.0.1:59872': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:21:54,614 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45453': TLS handshake failed with remote 'tls://127.0.0.1:59874': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:21:54,616 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s 2024-11-23 22:21:55,621 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:21:55,630 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42987 7221s 2024-11-23 22:21:55,631 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45689/status 7221s 2024-11-23 22:21:55,631 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:21:55,644 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37969 7221s 2024-11-23 22:21:55,644 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37969 7221s 2024-11-23 22:21:55,644 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:21:55,644 - distributed.worker - INFO - dashboard at: 127.0.0.1:43845 7221s 2024-11-23 22:21:55,644 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42987 7221s 2024-11-23 22:21:55,644 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:21:55,644 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:21:55,644 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:21:55,645 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-skuk6b14 7221s 2024-11-23 22:21:55,645 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:21:55,646 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40087 7221s 2024-11-23 22:21:55,647 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40087 7221s 2024-11-23 22:21:55,647 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:21:55,647 - distributed.worker - INFO - dashboard at: 127.0.0.1:38461 7221s 2024-11-23 22:21:55,647 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42987 7221s 2024-11-23 22:21:55,647 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:21:55,647 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:21:55,647 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:21:55,647 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-83lm0gnn 7221s 2024-11-23 22:21:55,647 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:21:55,648 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37969. Reason: failure-to-start- 7221s 2024-11-23 22:21:55,648 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:21:55,649 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40087. Reason: failure-to-start- 7221s 2024-11-23 22:21:55,649 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:21:55,650 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42987': TLS handshake failed with remote 'tls://127.0.0.1:60984': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:21:55,650 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42987': TLS handshake failed with remote 'tls://127.0.0.1:60996': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:21:55,652 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s 2024-11-23 22:21:56,658 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:21:56,665 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37733 7221s 2024-11-23 22:21:56,665 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41219/status 7221s 2024-11-23 22:21:56,665 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:21:56,681 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40415 7221s 2024-11-23 22:21:56,681 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40415 7221s 2024-11-23 22:21:56,681 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:21:56,681 - distributed.worker - INFO - dashboard at: 127.0.0.1:45287 7221s 2024-11-23 22:21:56,681 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37733 7221s 2024-11-23 22:21:56,682 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:21:56,682 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:21:56,682 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:21:56,682 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-tt_xwhkd 7221s 2024-11-23 22:21:56,682 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:21:56,684 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40429 7221s 2024-11-23 22:21:56,684 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40429 7221s 2024-11-23 22:21:56,684 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:21:56,684 - distributed.worker - INFO - dashboard at: 127.0.0.1:45889 7221s 2024-11-23 22:21:56,684 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37733 7221s 2024-11-23 22:21:56,684 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:21:56,684 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:21:56,684 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:21:56,685 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-zi0nl88k 7221s 2024-11-23 22:21:56,685 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:21:56,686 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40415. Reason: failure-to-start- 7221s 2024-11-23 22:21:56,686 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:21:56,686 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40429. Reason: failure-to-start- 7221s 2024-11-23 22:21:56,687 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:21:56,690 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37733': TLS handshake failed with remote 'tls://127.0.0.1:48314': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:21:56,691 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37733': TLS handshake failed with remote 'tls://127.0.0.1:48320': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:21:56,692 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s 2024-11-23 22:21:57,699 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:21:57,706 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41005 7221s 2024-11-23 22:21:57,706 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39841/status 7221s 2024-11-23 22:21:57,706 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:21:57,721 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44481 7221s 2024-11-23 22:21:57,721 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44481 7221s 2024-11-23 22:21:57,721 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:21:57,721 - distributed.worker - INFO - dashboard at: 127.0.0.1:38701 7221s 2024-11-23 22:21:57,721 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41005 7221s 2024-11-23 22:21:57,721 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:21:57,722 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:21:57,722 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:21:57,722 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-u_jimjf1 7221s 2024-11-23 22:21:57,722 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:21:57,724 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39509 7221s 2024-11-23 22:21:57,724 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39509 7221s 2024-11-23 22:21:57,724 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:21:57,724 - distributed.worker - INFO - dashboard at: 127.0.0.1:37471 7221s 2024-11-23 22:21:57,724 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41005 7221s 2024-11-23 22:21:57,724 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:21:57,724 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:21:57,724 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:21:57,725 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-yvu4i5eq 7221s 2024-11-23 22:21:57,725 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:21:57,728 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44481. Reason: failure-to-start- 7221s 2024-11-23 22:21:57,728 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:21:57,729 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39509. Reason: failure-to-start- 7221s 2024-11-23 22:21:57,729 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:21:57,730 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41005': TLS handshake failed with remote 'tls://127.0.0.1:43604': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:21:57,731 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41005': TLS handshake failed with remote 'tls://127.0.0.1:43616': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:21:57,732 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s 2024-11-23 22:21:58,737 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:21:58,744 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44025 7221s 2024-11-23 22:21:58,744 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36315/status 7221s 2024-11-23 22:21:58,745 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:21:58,760 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45991 7221s 2024-11-23 22:21:58,760 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45991 7221s 2024-11-23 22:21:58,760 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:21:58,760 - distributed.worker - INFO - dashboard at: 127.0.0.1:33647 7221s 2024-11-23 22:21:58,760 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44025 7221s 2024-11-23 22:21:58,760 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:21:58,760 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:21:58,760 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:21:58,760 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-qo9bz9ne 7221s 2024-11-23 22:21:58,760 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:21:58,762 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45193 7221s 2024-11-23 22:21:58,763 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45193 7221s 2024-11-23 22:21:58,763 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:21:58,763 - distributed.worker - INFO - dashboard at: 127.0.0.1:39049 7221s 2024-11-23 22:21:58,763 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44025 7221s 2024-11-23 22:21:58,763 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:21:58,763 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:21:58,763 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:21:58,763 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-pjyv9zeb 7221s 2024-11-23 22:21:58,763 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:21:58,778 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45991. Reason: failure-to-start- 7221s 2024-11-23 22:21:58,778 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:21:58,778 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45193. Reason: failure-to-start- 7221s 2024-11-23 22:21:58,778 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:21:58,780 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44025': TLS handshake failed with remote 'tls://127.0.0.1:51182': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:21:58,780 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44025': TLS handshake failed with remote 'tls://127.0.0.1:51196': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:21:58,784 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s 2024-11-23 22:21:59,790 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:21:59,797 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38793 7221s 2024-11-23 22:21:59,797 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35399/status 7221s 2024-11-23 22:21:59,797 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:21:59,811 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45637 7221s 2024-11-23 22:21:59,811 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45637 7221s 2024-11-23 22:21:59,811 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:21:59,811 - distributed.worker - INFO - dashboard at: 127.0.0.1:37981 7221s 2024-11-23 22:21:59,811 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38793 7221s 2024-11-23 22:21:59,812 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:21:59,812 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:21:59,812 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:21:59,812 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-flugemy1 7221s 2024-11-23 22:21:59,812 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:21:59,814 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45965 7221s 2024-11-23 22:21:59,814 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45965 7221s 2024-11-23 22:21:59,814 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:21:59,814 - distributed.worker - INFO - dashboard at: 127.0.0.1:37799 7221s 2024-11-23 22:21:59,814 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38793 7221s 2024-11-23 22:21:59,814 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:21:59,814 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:21:59,814 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:21:59,814 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-va8dk1aq 7221s 2024-11-23 22:21:59,814 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:21:59,816 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45637. Reason: failure-to-start- 7221s 2024-11-23 22:21:59,816 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:21:59,816 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45965. Reason: failure-to-start- 7221s 2024-11-23 22:21:59,816 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:21:59,820 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38793': TLS handshake failed with remote 'tls://127.0.0.1:38490': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:21:59,821 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38793': TLS handshake failed with remote 'tls://127.0.0.1:38496': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:21:59,822 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s 2024-11-23 22:22:00,828 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:22:00,836 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46789 7221s 2024-11-23 22:22:00,837 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42543/status 7221s 2024-11-23 22:22:00,837 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:22:00,852 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46137 7221s 2024-11-23 22:22:00,852 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46137 7221s 2024-11-23 22:22:00,852 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:22:00,852 - distributed.worker - INFO - dashboard at: 127.0.0.1:33151 7221s 2024-11-23 22:22:00,852 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46789 7221s 2024-11-23 22:22:00,852 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:22:00,852 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:22:00,852 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:22:00,852 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-vih9f0bc 7221s 2024-11-23 22:22:00,853 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:22:00,855 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39391 7221s 2024-11-23 22:22:00,855 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39391 7221s 2024-11-23 22:22:00,855 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:22:00,855 - distributed.worker - INFO - dashboard at: 127.0.0.1:35675 7221s 2024-11-23 22:22:00,855 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46789 7221s 2024-11-23 22:22:00,855 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:22:00,855 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:22:00,855 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:22:00,855 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-6zd2fvch 7221s 2024-11-23 22:22:00,855 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:22:00,859 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46137. Reason: failure-to-start- 7221s 2024-11-23 22:22:00,859 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:22:00,859 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39391. Reason: failure-to-start- 7221s 2024-11-23 22:22:00,860 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:22:00,861 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46789': TLS handshake failed with remote 'tls://127.0.0.1:43454': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:22:00,861 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46789': TLS handshake failed with remote 'tls://127.0.0.1:43462': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:22:00,863 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s 2024-11-23 22:22:01,870 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:22:01,876 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45383 7221s 2024-11-23 22:22:01,877 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38091/status 7221s 2024-11-23 22:22:01,877 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:22:01,893 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44089 7221s 2024-11-23 22:22:01,893 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44089 7221s 2024-11-23 22:22:01,893 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:22:01,893 - distributed.worker - INFO - dashboard at: 127.0.0.1:37219 7221s 2024-11-23 22:22:01,893 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45383 7221s 2024-11-23 22:22:01,893 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:22:01,893 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:22:01,893 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:22:01,893 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-xdpu2usm 7221s 2024-11-23 22:22:01,893 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:22:01,896 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41039 7221s 2024-11-23 22:22:01,896 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41039 7221s 2024-11-23 22:22:01,896 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:22:01,896 - distributed.worker - INFO - dashboard at: 127.0.0.1:39933 7221s 2024-11-23 22:22:01,896 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45383 7221s 2024-11-23 22:22:01,896 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:22:01,896 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:22:01,896 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:22:01,896 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-qmnbsgsh 7221s 2024-11-23 22:22:01,896 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:22:01,900 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44089. Reason: failure-to-start- 7221s 2024-11-23 22:22:01,900 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:22:01,900 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41039. Reason: failure-to-start- 7221s 2024-11-23 22:22:01,900 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:22:01,902 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45383': TLS handshake failed with remote 'tls://127.0.0.1:39344': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:22:01,902 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45383': TLS handshake failed with remote 'tls://127.0.0.1:39356': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:22:01,904 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s 2024-11-23 22:22:02,911 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:22:02,918 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40283 7221s 2024-11-23 22:22:02,918 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42715/status 7221s 2024-11-23 22:22:02,919 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:22:02,935 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35099 7221s 2024-11-23 22:22:02,936 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35099 7221s 2024-11-23 22:22:02,936 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:22:02,936 - distributed.worker - INFO - dashboard at: 127.0.0.1:40061 7221s 2024-11-23 22:22:02,936 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40283 7221s 2024-11-23 22:22:02,936 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:22:02,936 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:22:02,936 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:22:02,936 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-tgj9ch07 7221s 2024-11-23 22:22:02,936 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:22:02,938 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34427 7221s 2024-11-23 22:22:02,938 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34427 7221s 2024-11-23 22:22:02,938 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:22:02,939 - distributed.worker - INFO - dashboard at: 127.0.0.1:40435 7221s 2024-11-23 22:22:02,939 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40283 7221s 2024-11-23 22:22:02,939 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:22:02,939 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:22:02,939 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:22:02,939 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-k2__xo7q 7221s 2024-11-23 22:22:02,939 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:22:02,941 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35099. Reason: failure-to-start- 7221s 2024-11-23 22:22:02,941 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:22:02,942 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34427. Reason: failure-to-start- 7221s 2024-11-23 22:22:02,942 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:22:02,944 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40283': TLS handshake failed with remote 'tls://127.0.0.1:40008': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:22:02,944 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40283': TLS handshake failed with remote 'tls://127.0.0.1:40024': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:22:02,946 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s 2024-11-23 22:22:03,952 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:22:03,959 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42357 7221s 2024-11-23 22:22:03,959 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43625/status 7221s 2024-11-23 22:22:03,959 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:22:03,975 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34175 7221s 2024-11-23 22:22:03,975 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34175 7221s 2024-11-23 22:22:03,975 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:22:03,975 - distributed.worker - INFO - dashboard at: 127.0.0.1:44097 7221s 2024-11-23 22:22:03,975 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42357 7221s 2024-11-23 22:22:03,975 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:22:03,975 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:22:03,975 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:22:03,975 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-idve0qdb 7221s 2024-11-23 22:22:03,975 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:22:03,977 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36809 7221s 2024-11-23 22:22:03,978 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36809 7221s 2024-11-23 22:22:03,978 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:22:03,978 - distributed.worker - INFO - dashboard at: 127.0.0.1:45997 7221s 2024-11-23 22:22:03,978 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42357 7221s 2024-11-23 22:22:03,978 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:22:03,978 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:22:03,978 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:22:03,978 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-si5imw_0 7221s 2024-11-23 22:22:03,978 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:22:03,979 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34175. Reason: failure-to-start- 7221s 2024-11-23 22:22:03,979 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:22:03,980 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36809. Reason: failure-to-start- 7221s 2024-11-23 22:22:03,980 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:22:03,981 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42357': TLS handshake failed with remote 'tls://127.0.0.1:38858': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:22:03,981 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42357': TLS handshake failed with remote 'tls://127.0.0.1:38870': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:22:03,983 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s 2024-11-23 22:22:04,993 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:22:04,999 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38499 7221s 2024-11-23 22:22:04,999 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33269/status 7221s 2024-11-23 22:22:05,000 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:22:05,014 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35105 7221s 2024-11-23 22:22:05,014 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35105 7221s 2024-11-23 22:22:05,014 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:22:05,015 - distributed.worker - INFO - dashboard at: 127.0.0.1:40781 7221s 2024-11-23 22:22:05,015 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 7221s 2024-11-23 22:22:05,015 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:22:05,015 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:22:05,015 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:22:05,015 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-zokxk67u 7221s 2024-11-23 22:22:05,015 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:22:05,017 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33359 7221s 2024-11-23 22:22:05,017 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33359 7221s 2024-11-23 22:22:05,017 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:22:05,017 - distributed.worker - INFO - dashboard at: 127.0.0.1:33735 7221s 2024-11-23 22:22:05,017 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 7221s 2024-11-23 22:22:05,017 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:22:05,018 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:22:05,018 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:22:05,018 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-3famk7y9 7221s 2024-11-23 22:22:05,018 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:22:05,019 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35105. Reason: failure-to-start- 7221s 2024-11-23 22:22:05,019 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:22:05,019 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33359. Reason: failure-to-start- 7221s 2024-11-23 22:22:05,020 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:22:05,021 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:34874': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:22:05,021 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:34884': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:22:05,026 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s 2024-11-23 22:22:06,031 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:22:06,038 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43903 7221s 2024-11-23 22:22:06,038 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38769/status 7221s 2024-11-23 22:22:06,038 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:22:06,054 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40603 7221s 2024-11-23 22:22:06,055 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40603 7221s 2024-11-23 22:22:06,055 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:22:06,055 - distributed.worker - INFO - dashboard at: 127.0.0.1:33671 7221s 2024-11-23 22:22:06,055 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43903 7221s 2024-11-23 22:22:06,055 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:22:06,055 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:22:06,055 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:22:06,055 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-3ljeelnf 7221s 2024-11-23 22:22:06,055 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:22:06,057 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45225 7221s 2024-11-23 22:22:06,057 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45225 7221s 2024-11-23 22:22:06,058 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:22:06,058 - distributed.worker - INFO - dashboard at: 127.0.0.1:39949 7221s 2024-11-23 22:22:06,058 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43903 7221s 2024-11-23 22:22:06,058 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:22:06,058 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:22:06,058 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:22:06,058 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ddft9dly 7221s 2024-11-23 22:22:06,058 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:22:06,059 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40603. Reason: failure-to-start- 7221s 2024-11-23 22:22:06,059 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:22:06,060 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45225. Reason: failure-to-start- 7221s 2024-11-23 22:22:06,060 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:22:06,064 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43903': TLS handshake failed with remote 'tls://127.0.0.1:58530': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:22:06,064 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43903': TLS handshake failed with remote 'tls://127.0.0.1:58544': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:22:06,065 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s 2024-11-23 22:22:07,071 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:22:07,078 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40531 7221s 2024-11-23 22:22:07,078 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34831/status 7221s 2024-11-23 22:22:07,079 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:22:07,094 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40307 7221s 2024-11-23 22:22:07,094 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40307 7221s 2024-11-23 22:22:07,095 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:22:07,095 - distributed.worker - INFO - dashboard at: 127.0.0.1:43069 7221s 2024-11-23 22:22:07,095 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40531 7221s 2024-11-23 22:22:07,095 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:22:07,095 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:22:07,095 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:22:07,095 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-wilrw1vg 7221s 2024-11-23 22:22:07,095 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:22:07,098 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33311 7221s 2024-11-23 22:22:07,098 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33311 7221s 2024-11-23 22:22:07,098 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:22:07,098 - distributed.worker - INFO - dashboard at: 127.0.0.1:41109 7221s 2024-11-23 22:22:07,098 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40531 7221s 2024-11-23 22:22:07,098 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:22:07,098 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:22:07,098 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:22:07,098 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ouamdolq 7221s 2024-11-23 22:22:07,098 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:22:07,100 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40307. Reason: failure-to-start- 7221s 2024-11-23 22:22:07,100 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:22:07,100 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33311. Reason: failure-to-start- 7221s 2024-11-23 22:22:07,100 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:22:07,104 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40531': TLS handshake failed with remote 'tls://127.0.0.1:52734': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:22:07,105 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40531': TLS handshake failed with remote 'tls://127.0.0.1:52736': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:22:07,106 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s 2024-11-23 22:22:08,112 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:22:08,120 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44611 7221s 2024-11-23 22:22:08,120 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45803/status 7221s 2024-11-23 22:22:08,120 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:22:08,136 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39165 7221s 2024-11-23 22:22:08,136 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39165 7221s 2024-11-23 22:22:08,136 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:22:08,136 - distributed.worker - INFO - dashboard at: 127.0.0.1:45951 7221s 2024-11-23 22:22:08,136 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44611 7221s 2024-11-23 22:22:08,136 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:22:08,136 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:22:08,137 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:22:08,137 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-egg58lkc 7221s 2024-11-23 22:22:08,137 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:22:08,139 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40049 7221s 2024-11-23 22:22:08,139 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40049 7221s 2024-11-23 22:22:08,139 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:22:08,139 - distributed.worker - INFO - dashboard at: 127.0.0.1:35351 7221s 2024-11-23 22:22:08,139 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44611 7221s 2024-11-23 22:22:08,139 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:22:08,139 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:22:08,139 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:22:08,139 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-9zn8kicx 7221s 2024-11-23 22:22:08,140 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:22:08,145 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39165. Reason: failure-to-start- 7221s 2024-11-23 22:22:08,145 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:22:08,146 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40049. Reason: failure-to-start- 7221s 2024-11-23 22:22:08,146 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:22:08,148 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44611': TLS handshake failed with remote 'tls://127.0.0.1:54252': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:22:08,148 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44611': TLS handshake failed with remote 'tls://127.0.0.1:54258': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:22:08,150 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s 2024-11-23 22:22:09,155 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:22:09,162 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46163 7221s 2024-11-23 22:22:09,162 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41527/status 7221s 2024-11-23 22:22:09,163 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:22:09,176 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37837 7221s 2024-11-23 22:22:09,176 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37837 7221s 2024-11-23 22:22:09,176 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:22:09,176 - distributed.worker - INFO - dashboard at: 127.0.0.1:35937 7221s 2024-11-23 22:22:09,177 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46163 7221s 2024-11-23 22:22:09,177 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:22:09,177 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:22:09,177 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:22:09,177 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-0jriphcv 7221s 2024-11-23 22:22:09,177 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:22:09,179 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45331 7221s 2024-11-23 22:22:09,179 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45331 7221s 2024-11-23 22:22:09,179 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:22:09,179 - distributed.worker - INFO - dashboard at: 127.0.0.1:46133 7221s 2024-11-23 22:22:09,179 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46163 7221s 2024-11-23 22:22:09,179 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:22:09,179 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:22:09,179 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:22:09,179 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-dozwdsa6 7221s 2024-11-23 22:22:09,179 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:22:09,183 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37837. Reason: failure-to-start- 7221s 2024-11-23 22:22:09,183 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:22:09,184 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45331. Reason: failure-to-start- 7221s 2024-11-23 22:22:09,184 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:22:09,185 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46163': TLS handshake failed with remote 'tls://127.0.0.1:47066': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:22:09,186 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46163': TLS handshake failed with remote 'tls://127.0.0.1:47082': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:22:09,189 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s 2024-11-23 22:22:10,196 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:22:10,203 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40363 7221s 2024-11-23 22:22:10,203 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44601/status 7221s 2024-11-23 22:22:10,204 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:22:10,218 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39103 7221s 2024-11-23 22:22:10,218 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39103 7221s 2024-11-23 22:22:10,218 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:22:10,218 - distributed.worker - INFO - dashboard at: 127.0.0.1:46855 7221s 2024-11-23 22:22:10,218 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40363 7221s 2024-11-23 22:22:10,218 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:22:10,218 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:22:10,218 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:22:10,218 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-omqqvueu 7221s 2024-11-23 22:22:10,218 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:22:10,220 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39115 7221s 2024-11-23 22:22:10,221 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39115 7221s 2024-11-23 22:22:10,221 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:22:10,221 - distributed.worker - INFO - dashboard at: 127.0.0.1:35959 7221s 2024-11-23 22:22:10,221 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40363 7221s 2024-11-23 22:22:10,221 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:22:10,221 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:22:10,221 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:22:10,221 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ot7d37aq 7221s 2024-11-23 22:22:10,221 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:22:10,226 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39103. Reason: failure-to-start- 7221s 2024-11-23 22:22:10,227 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:22:10,227 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39115. Reason: failure-to-start- 7221s 2024-11-23 22:22:10,227 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:22:10,229 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40363': TLS handshake failed with remote 'tls://127.0.0.1:52424': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:22:10,229 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40363': TLS handshake failed with remote 'tls://127.0.0.1:52432': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:22:10,230 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s 2024-11-23 22:22:11,235 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:22:11,242 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36287 7221s 2024-11-23 22:22:11,242 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38825/status 7221s 2024-11-23 22:22:11,243 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:22:11,260 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42181 7221s 2024-11-23 22:22:11,261 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42181 7221s 2024-11-23 22:22:11,261 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:22:11,261 - distributed.worker - INFO - dashboard at: 127.0.0.1:43521 7221s 2024-11-23 22:22:11,261 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 7221s 2024-11-23 22:22:11,261 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:22:11,261 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:22:11,261 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:22:11,261 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-xqr7kn4a 7221s 2024-11-23 22:22:11,261 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:22:11,263 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45937 7221s 2024-11-23 22:22:11,263 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45937 7221s 2024-11-23 22:22:11,263 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:22:11,263 - distributed.worker - INFO - dashboard at: 127.0.0.1:33307 7221s 2024-11-23 22:22:11,263 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36287 7221s 2024-11-23 22:22:11,263 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:22:11,263 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:22:11,264 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:22:11,264 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-eip27do3 7221s 2024-11-23 22:22:11,264 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:22:11,267 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42181. Reason: failure-to-start- 7221s 2024-11-23 22:22:11,267 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:22:11,268 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45937. Reason: failure-to-start- 7221s 2024-11-23 22:22:11,268 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:22:11,269 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43632': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:22:11,269 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36287': TLS handshake failed with remote 'tls://127.0.0.1:43646': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:22:11,271 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s 2024-11-23 22:22:12,277 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:22:12,283 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34433 7221s 2024-11-23 22:22:12,284 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35981/status 7221s 2024-11-23 22:22:12,286 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:22:12,302 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44107 7221s 2024-11-23 22:22:12,302 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44107 7221s 2024-11-23 22:22:12,302 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:22:12,303 - distributed.worker - INFO - dashboard at: 127.0.0.1:34895 7221s 2024-11-23 22:22:12,303 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34433 7221s 2024-11-23 22:22:12,303 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:22:12,303 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:22:12,303 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:22:12,303 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-5ac78u1b 7221s 2024-11-23 22:22:12,303 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:22:12,305 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41905 7221s 2024-11-23 22:22:12,305 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41905 7221s 2024-11-23 22:22:12,305 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:22:12,305 - distributed.worker - INFO - dashboard at: 127.0.0.1:40875 7221s 2024-11-23 22:22:12,305 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34433 7221s 2024-11-23 22:22:12,305 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:22:12,305 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:22:12,305 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:22:12,305 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-d1ckbg9y 7221s 2024-11-23 22:22:12,306 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:22:12,309 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44107. Reason: failure-to-start- 7221s 2024-11-23 22:22:12,309 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:22:12,310 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41905. Reason: failure-to-start- 7221s 2024-11-23 22:22:12,310 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:22:12,311 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34433': TLS handshake failed with remote 'tls://127.0.0.1:55440': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:22:12,311 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34433': TLS handshake failed with remote 'tls://127.0.0.1:55456': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:22:12,315 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s 2024-11-23 22:22:13,320 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:22:13,327 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39447 7221s 2024-11-23 22:22:13,328 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38597/status 7221s 2024-11-23 22:22:13,328 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:22:13,342 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43003 7221s 2024-11-23 22:22:13,343 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43003 7221s 2024-11-23 22:22:13,343 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:22:13,343 - distributed.worker - INFO - dashboard at: 127.0.0.1:43831 7221s 2024-11-23 22:22:13,343 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39447 7221s 2024-11-23 22:22:13,343 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:22:13,343 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:22:13,343 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:22:13,343 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-2jix48mz 7221s 2024-11-23 22:22:13,343 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:22:13,345 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35405 7221s 2024-11-23 22:22:13,345 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35405 7221s 2024-11-23 22:22:13,345 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:22:13,346 - distributed.worker - INFO - dashboard at: 127.0.0.1:32961 7221s 2024-11-23 22:22:13,346 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39447 7221s 2024-11-23 22:22:13,346 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:22:13,346 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:22:13,346 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:22:13,346 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-q3c4pn2e 7221s 2024-11-23 22:22:13,346 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:22:13,351 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43003. Reason: failure-to-start- 7221s 2024-11-23 22:22:13,351 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:22:13,351 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35405. Reason: failure-to-start- 7221s 2024-11-23 22:22:13,351 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:22:13,355 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39447': TLS handshake failed with remote 'tls://127.0.0.1:53700': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:22:13,355 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39447': TLS handshake failed with remote 'tls://127.0.0.1:53708': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:22:13,357 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s _________________________________ test_scatter _________________________________ 7221s 7221s fut = , timeout = 0 7221s 7221s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 7221s async with asyncio.timeout(timeout): 7221s > return await fut 7221s 7221s /usr/lib/python3/dist-packages/distributed/utils.py:1960: 7221s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7221s /usr/lib/python3/dist-packages/distributed/worker.py:1480: in start_unsafe 7221s await self._register_with_scheduler() 7221s /usr/lib/python3/dist-packages/distributed/worker.py:1179: in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s /usr/lib/python3/dist-packages/distributed/comm/core.py:342: in connect 7221s comm = await wait_for( 7221s /usr/lib/python3/dist-packages/distributed/utils.py:1960: in wait_for 7221s return await fut 7221s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:546: in connect 7221s stream = await self.client.connect( 7221s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7221s 7221s self = , host = '127.0.0.1' 7221s port = 39835, af = 7221s ssl_options = 7221s max_buffer_size = 8364507136.0, source_ip = None, source_port = None 7221s timeout = None 7221s 7221s async def connect( 7221s self, 7221s host: str, 7221s port: int, 7221s af: socket.AddressFamily = socket.AF_UNSPEC, 7221s ssl_options: Optional[Union[Dict[str, Any], ssl.SSLContext]] = None, 7221s max_buffer_size: Optional[int] = None, 7221s source_ip: Optional[str] = None, 7221s source_port: Optional[int] = None, 7221s timeout: Optional[Union[float, datetime.timedelta]] = None, 7221s ) -> IOStream: 7221s """Connect to the given host and port. 7221s 7221s Asynchronously returns an `.IOStream` (or `.SSLIOStream` if 7221s ``ssl_options`` is not None). 7221s 7221s Using the ``source_ip`` kwarg, one can specify the source 7221s IP address to use when establishing the connection. 7221s In case the user needs to resolve and 7221s use a specific interface, it has to be handled outside 7221s of Tornado as this depends very much on the platform. 7221s 7221s Raises `TimeoutError` if the input future does not complete before 7221s ``timeout``, which may be specified in any form allowed by 7221s `.IOLoop.add_timeout` (i.e. a `datetime.timedelta` or an absolute time 7221s relative to `.IOLoop.time`) 7221s 7221s Similarly, when the user requires a certain source port, it can 7221s be specified using the ``source_port`` arg. 7221s 7221s .. versionchanged:: 4.5 7221s Added the ``source_ip`` and ``source_port`` arguments. 7221s 7221s .. versionchanged:: 5.0 7221s Added the ``timeout`` argument. 7221s """ 7221s if timeout is not None: 7221s if isinstance(timeout, numbers.Real): 7221s timeout = IOLoop.current().time() + timeout 7221s elif isinstance(timeout, datetime.timedelta): 7221s timeout = IOLoop.current().time() + timeout.total_seconds() 7221s else: 7221s raise TypeError("Unsupported timeout %r" % timeout) 7221s if timeout is not None: 7221s addrinfo = await gen.with_timeout( 7221s timeout, self.resolver.resolve(host, port, af) 7221s ) 7221s else: 7221s addrinfo = await self.resolver.resolve(host, port, af) 7221s connector = _Connector( 7221s addrinfo, 7221s functools.partial( 7221s self._create_stream, 7221s max_buffer_size, 7221s source_ip=source_ip, 7221s source_port=source_port, 7221s ), 7221s ) 7221s > af, addr, stream = await connector.start(connect_timeout=timeout) 7221s E asyncio.exceptions.CancelledError 7221s 7221s /usr/lib/python3/dist-packages/tornado/tcpclient.py:279: CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s self = 7221s 7221s @final 7221s async def start(self): 7221s async with self._startup_lock: 7221s if self.status == Status.failed: 7221s assert self.__startup_exc is not None 7221s raise self.__startup_exc 7221s elif self.status != Status.init: 7221s return self 7221s timeout = getattr(self, "death_timeout", None) 7221s 7221s async def _close_on_failure(exc: Exception) -> None: 7221s await self.close(reason=f"failure-to-start-{str(type(exc))}") 7221s self.status = Status.failed 7221s self.__startup_exc = exc 7221s 7221s try: 7221s > await wait_for(self.start_unsafe(), timeout=timeout) 7221s 7221s /usr/lib/python3/dist-packages/distributed/core.py:664: 7221s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7221s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 7221s async with asyncio.timeout(timeout): 7221s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7221s 7221s self = 7221s exc_type = 7221s exc_val = CancelledError(), exc_tb = 7221s 7221s async def __aexit__( 7221s self, 7221s exc_type: Optional[Type[BaseException]], 7221s exc_val: Optional[BaseException], 7221s exc_tb: Optional[TracebackType], 7221s ) -> Optional[bool]: 7221s assert self._state in (_State.ENTERED, _State.EXPIRING) 7221s 7221s if self._timeout_handler is not None: 7221s self._timeout_handler.cancel() 7221s self._timeout_handler = None 7221s 7221s if self._state is _State.EXPIRING: 7221s self._state = _State.EXPIRED 7221s 7221s if self._task.uncancel() <= self._cancelling and exc_type is not None: 7221s # Since there are no new cancel requests, we're 7221s # handling this. 7221s if issubclass(exc_type, exceptions.CancelledError): 7221s > raise TimeoutError from exc_val 7221s E TimeoutError 7221s 7221s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s @contextlib.asynccontextmanager 7221s async def _cluster_factory(): 7221s workers = [] 7221s s = None 7221s try: 7221s for _ in range(60): 7221s try: 7221s > s, ws = await start_cluster( 7221s nthreads, 7221s scheduler, 7221s security=security, 7221s Worker=Worker, 7221s scheduler_kwargs=scheduler_kwargs, 7221s worker_kwargs=merge( 7221s {"death_timeout": min(15, int(deadline.remaining))}, 7221s worker_kwargs, 7221s ), 7221s ) 7221s 7221s /usr/lib/python3/dist-packages/distributed/utils_test.py:966: 7221s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7221s /usr/lib/python3/dist-packages/distributed/utils_test.py:789: in start_cluster 7221s await asyncio.gather(*workers) 7221s /usr/lib/python3.13/asyncio/tasks.py:737: in _wrap_awaitable 7221s return await awaitable 7221s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7221s 7221s self = 7221s 7221s @final 7221s async def start(self): 7221s async with self._startup_lock: 7221s if self.status == Status.failed: 7221s assert self.__startup_exc is not None 7221s raise self.__startup_exc 7221s elif self.status != Status.init: 7221s return self 7221s timeout = getattr(self, "death_timeout", None) 7221s 7221s async def _close_on_failure(exc: Exception) -> None: 7221s await self.close(reason=f"failure-to-start-{str(type(exc))}") 7221s self.status = Status.failed 7221s self.__startup_exc = exc 7221s 7221s try: 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s except asyncio.TimeoutError as exc: 7221s await _close_on_failure(exc) 7221s > raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s E TimeoutError: Worker start timed out after 0s. 7221s 7221s /usr/lib/python3/dist-packages/distributed/core.py:667: TimeoutError 7221s 7221s During handling of the above exception, another exception occurred: 7221s 7221s fut = ._..test_func..async_fn at 0xe9b48938> 7221s timeout = 60 7221s 7221s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 7221s async with asyncio.timeout(timeout): 7221s > return await fut 7221s 7221s /usr/lib/python3/dist-packages/distributed/utils.py:1960: 7221s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7221s /usr/lib/python3/dist-packages/distributed/utils_test.py:999: in async_fn 7221s _cluster_factory() as (s, workers), 7221s /usr/lib/python3.13/contextlib.py:214: in __aenter__ 7221s return await anext(self.gen) 7221s /usr/lib/python3/dist-packages/distributed/utils_test.py:983: in _cluster_factory 7221s await asyncio.sleep(1) 7221s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7221s 7221s delay = 1, result = None 7221s 7221s async def sleep(delay, result=None): 7221s """Coroutine that completes after a given time (in seconds).""" 7221s if delay <= 0: 7221s await __sleep0() 7221s return result 7221s 7221s if math.isnan(delay): 7221s raise ValueError("Invalid delay: NaN (not a number)") 7221s 7221s loop = events.get_running_loop() 7221s future = loop.create_future() 7221s h = loop.call_later(delay, 7221s futures._set_result_unless_cancelled, 7221s future, result) 7221s try: 7221s > return await future 7221s E asyncio.exceptions.CancelledError 7221s 7221s /usr/lib/python3.13/asyncio/tasks.py:718: CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s args = (), kwds = {} 7221s 7221s @wraps(func) 7221s def inner(*args, **kwds): 7221s with self._recreate_cm(): 7221s > return func(*args, **kwds) 7221s 7221s /usr/lib/python3.13/contextlib.py:85: 7221s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7221s /usr/lib/python3.13/contextlib.py:85: in inner 7221s return func(*args, **kwds) 7221s /usr/lib/python3/dist-packages/distributed/utils_test.py:1102: in test_func 7221s return _run_and_close_tornado(async_fn_outer) 7221s /usr/lib/python3/dist-packages/distributed/utils_test.py:378: in _run_and_close_tornado 7221s return asyncio_run(inner_fn(), loop_factory=get_loop_factory()) 7221s /usr/lib/python3.13/asyncio/runners.py:194: in run 7221s return runner.run(main) 7221s /usr/lib/python3.13/asyncio/runners.py:118: in run 7221s return self._loop.run_until_complete(task) 7221s /usr/lib/python3.13/asyncio/base_events.py:720: in run_until_complete 7221s return future.result() 7221s /usr/lib/python3/dist-packages/distributed/utils_test.py:375: in inner_fn 7221s return await async_fn(*args, **kwargs) 7221s /usr/lib/python3/dist-packages/distributed/utils_test.py:1099: in async_fn_outer 7221s return await utils_wait_for(async_fn(), timeout=timeout * 2) 7221s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 7221s async with asyncio.timeout(timeout): 7221s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7221s 7221s self = 7221s exc_type = 7221s exc_val = CancelledError(), exc_tb = 7221s 7221s async def __aexit__( 7221s self, 7221s exc_type: Optional[Type[BaseException]], 7221s exc_val: Optional[BaseException], 7221s exc_tb: Optional[TracebackType], 7221s ) -> Optional[bool]: 7221s assert self._state in (_State.ENTERED, _State.EXPIRING) 7221s 7221s if self._timeout_handler is not None: 7221s self._timeout_handler.cancel() 7221s self._timeout_handler = None 7221s 7221s if self._state is _State.EXPIRING: 7221s self._state = _State.EXPIRED 7221s 7221s if self._task.uncancel() <= self._cancelling and exc_type is not None: 7221s # Since there are no new cancel requests, we're 7221s # handling this. 7221s if issubclass(exc_type, exceptions.CancelledError): 7221s > raise TimeoutError from exc_val 7221s E TimeoutError 7221s 7221s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 7221s ----------------------------- Captured stderr call ----------------------------- 7221s 2024-11-23 22:22:14,660 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:22:14,668 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:14,668 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38407/status 7221s 2024-11-23 22:22:14,668 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:22:14,681 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37523 7221s 2024-11-23 22:22:14,682 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37523 7221s 2024-11-23 22:22:14,682 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:22:14,682 - distributed.worker - INFO - dashboard at: 127.0.0.1:46823 7221s 2024-11-23 22:22:14,682 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:14,682 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:22:14,682 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:22:14,682 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:22:14,682 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-oxgn6a1a 7221s 2024-11-23 22:22:14,682 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:22:14,684 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35087 7221s 2024-11-23 22:22:14,684 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35087 7221s 2024-11-23 22:22:14,684 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:22:14,684 - distributed.worker - INFO - dashboard at: 127.0.0.1:44923 7221s 2024-11-23 22:22:14,684 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:14,684 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:22:14,684 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:22:14,684 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:22:14,684 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ok6p2kee 7221s 2024-11-23 22:22:14,685 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:22:14,697 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:14,697 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:14,698 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:38264': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:14,698 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:38268': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:14,811 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:14,811 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:14,811 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:38274': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:14,812 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:38278': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:14,925 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:14,925 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:14,927 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:38284': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:14,927 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:38288': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:15,033 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:15,034 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:38300': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:15,039 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:15,039 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:38306': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:15,141 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:15,142 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:38314': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:15,148 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:15,148 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:38316': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:15,248 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:15,249 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:38320': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:15,255 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:15,255 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:38324': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:15,356 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:15,356 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:38334': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:15,362 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:15,363 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:38340': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:15,464 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:15,465 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:38352': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:15,470 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:15,471 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:38356': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:15,571 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:15,572 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:38364': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:15,578 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:15,579 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:38374': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:15,679 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:15,679 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:38390': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:15,685 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:15,686 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:38406': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:15,786 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:15,786 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:38420': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:15,793 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:15,793 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:38430': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:15,894 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:15,895 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:38446': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:15,901 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:15,901 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:38462': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:16,002 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:16,002 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:38476': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:16,009 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:16,010 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:38480': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:16,110 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:16,111 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:38484': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:16,117 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:16,118 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:38492': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:16,218 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:16,219 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:38504': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:16,225 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:16,226 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:38518': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:16,326 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:16,327 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:38526': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:16,333 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:16,334 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:38530': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:16,435 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:16,436 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:38532': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:16,442 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:16,443 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:38548': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:16,543 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:16,544 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:38564': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:16,552 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:16,552 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:38568': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:16,652 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:16,652 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:38572': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:16,658 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:16,659 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:38588': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:16,760 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:16,760 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:38600': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:16,767 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:16,767 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:38614': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:16,868 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:16,868 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:38622': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:16,875 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:16,875 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:38628': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:16,976 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:16,976 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:38634': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:16,982 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:16,983 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:38636': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:17,083 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:17,084 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:38638': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:17,090 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:17,090 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:38652': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:17,190 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:17,191 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:38658': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:17,197 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:17,198 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:38668': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:17,298 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:17,298 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:38684': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:17,305 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:17,305 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:38688': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:17,406 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:17,406 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:38702': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:17,413 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:17,413 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:38712': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:17,513 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:17,513 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:38724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:17,520 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:17,520 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:38730': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:17,621 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:17,621 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:38744': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:17,628 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:17,628 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:38748': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:17,729 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:17,729 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:38756': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:17,736 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:17,736 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:38760': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:17,837 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:17,837 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:38764': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:17,843 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:17,844 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:38778': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:17,945 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:17,946 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:38786': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:17,952 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:17,953 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:38790': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:18,054 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:18,055 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:38794': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:18,061 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:18,061 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:38804': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:18,162 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:18,163 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:38814': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:18,172 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:18,176 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:38816': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:18,271 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:18,272 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:38826': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:18,280 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:18,280 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:38832': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:18,379 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:18,380 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:38846': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:18,386 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:18,386 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:38860': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:18,487 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:18,488 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:38862': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:18,494 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:18,494 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:38870': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:18,595 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:18,596 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:38882': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:18,602 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:18,603 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:38890': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:18,703 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:18,704 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:38892': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:18,710 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:18,710 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:38900': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:18,811 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:18,812 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:38912': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:18,818 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:18,819 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:38914': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:18,919 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:18,920 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:38918': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:18,926 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:18,926 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:38920': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:19,027 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:19,028 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:38936': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:19,034 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:19,035 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:38944': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:19,136 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:19,137 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:38956': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:19,143 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:19,143 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:38962': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:19,244 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:19,245 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:38978': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:19,251 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:19,252 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:38984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:19,353 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:19,353 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:39000': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:19,359 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:19,360 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:39006': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:19,460 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:19,461 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:39018': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:19,468 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:19,469 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:39026': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:19,568 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:19,569 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:39038': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:19,575 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:19,576 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:39046': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:19,680 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:19,681 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:39048': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:19,687 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:19,687 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:39054': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:19,788 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:19,788 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:39068': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:19,795 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:19,795 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:39072': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:19,897 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:19,900 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:39080': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:19,906 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:19,907 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:39094': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:20,007 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:20,007 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:39110': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:20,014 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:20,014 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:39116': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:20,115 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:20,115 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:39128': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:20,122 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:20,122 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:39134': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:20,223 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:20,223 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:39148': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:20,230 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:20,230 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:39154': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:20,331 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:20,332 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:39156': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:20,338 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:20,339 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:39158': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:20,439 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:20,439 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:39164': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:20,446 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:20,446 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:39172': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:20,548 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:20,549 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:39182': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:20,556 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:20,556 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:39196': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:20,657 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:20,657 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:39210': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:20,664 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:20,664 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:39224': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:20,764 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:20,765 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:39226': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:20,772 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:20,772 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:39228': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:20,873 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:20,873 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:39236': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:20,880 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:20,880 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:39246': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:20,981 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:20,981 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:39254': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:20,988 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:20,988 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:39266': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:21,088 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:21,089 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:39270': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:21,095 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:21,095 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:39280': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:21,197 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:21,198 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:39288': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:21,204 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:21,204 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:39304': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:21,305 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:21,305 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:39318': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:21,312 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:21,312 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:39322': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:21,413 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:21,414 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:39324': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:21,421 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:21,421 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:39326': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:21,521 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:21,522 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:39328': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:21,528 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:21,530 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:39330': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:21,631 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:21,632 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:42690': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:21,638 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:21,638 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:42696': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:21,740 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:21,741 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:42712': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:21,747 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:21,747 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:42716': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:21,849 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:21,850 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:42722': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:21,856 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:21,856 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:42726': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:21,957 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:21,957 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:42728': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:21,964 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:21,964 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:42734': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:22,065 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:22,066 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:42742': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:22,072 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:22,073 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:42754': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:22,173 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:22,177 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:42768': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:22,183 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:22,184 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:42772': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:22,280 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:22,281 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:42788': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:22,290 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:22,291 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:42794': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:22,389 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:22,389 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:42808': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:22,398 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:22,398 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:42812': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:22,496 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:22,496 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:42818': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:22,505 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:22,506 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:42834': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:22,603 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:22,604 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:42848': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:22,613 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:22,613 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:42858': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:22,712 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:22,712 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:42860': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:22,720 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:22,720 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:42866': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:22,820 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:22,821 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:42874': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:22,827 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:22,828 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:42886': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:22,928 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:22,928 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:42892': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:22,935 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:22,935 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:42906': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:23,037 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:23,038 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:42918': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:23,044 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:23,044 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:42924': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:23,145 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:23,146 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:42928': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:23,152 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:23,153 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:42944': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:23,254 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:23,255 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:42952': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:23,261 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:23,262 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:42968': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:23,363 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:23,364 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:42972': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:23,370 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:23,371 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:42974': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:23,472 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:23,473 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:42982': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:23,479 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:23,479 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:42988': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:23,579 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:23,579 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:42990': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:23,586 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:23,586 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:43002': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:23,687 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:23,688 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:43016': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:23,694 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:23,694 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:43030': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:23,796 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:23,797 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:43042': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:23,803 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:23,803 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:43056': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:23,904 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:23,904 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:43070': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:23,911 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:23,911 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:43082': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:24,013 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:24,014 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:43088': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:24,020 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:24,020 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:43102': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:24,121 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:24,122 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:43114': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:24,128 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:24,129 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:43122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:24,229 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:24,229 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:43132': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:24,236 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:24,236 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:43148': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:24,337 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:24,337 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:43162': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:24,344 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:24,344 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:43176': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:24,444 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:24,445 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:43182': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:24,451 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:24,452 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:43194': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:24,552 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:24,553 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:43204': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:24,559 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:24,560 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:43206': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:24,660 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:24,661 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:43218': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:24,667 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:24,668 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:43226': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:24,769 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:24,770 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:43236': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:24,776 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:24,776 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:43242': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:24,876 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:24,878 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:43258': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:24,885 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:24,885 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:43264': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:24,986 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:24,987 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:43272': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:24,993 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:24,994 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:43288': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:25,096 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:25,097 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:43298': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:25,103 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:25,103 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:43308': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:25,204 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:25,204 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:43316': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:25,211 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:25,211 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:43320': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:25,312 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:25,312 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:43326': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:25,319 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:25,319 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:43328': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:25,419 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:25,420 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:43338': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:25,426 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:25,427 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:43342': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:25,528 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:25,528 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:43356': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:25,535 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:25,535 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:43366': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:25,637 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:25,638 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:43380': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:25,644 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:25,644 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:43382': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:25,744 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:25,745 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:43396': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:25,751 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:25,752 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:43400': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:25,852 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:25,853 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:43402': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:25,859 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:25,860 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:43414': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:25,961 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:25,961 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:43428': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:25,968 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:25,968 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:43440': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:26,069 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:26,070 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:43444': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:26,076 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:26,077 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:43458': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:26,179 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:26,180 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:43460': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:26,186 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:26,187 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:43472': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:26,287 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:26,288 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:43478': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:26,294 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:26,295 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:43486': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:26,395 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:26,396 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:43498': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:26,402 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:26,402 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:43508': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:26,503 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:26,504 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:43522': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:26,510 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:26,511 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:43532': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:26,611 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:26,611 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:43538': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:26,618 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:26,618 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:43544': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:26,719 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:26,720 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:43552': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:26,726 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:26,726 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:43564': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:26,827 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:26,828 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:43578': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:26,834 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:26,835 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:43592': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:26,936 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:26,937 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:43594': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:26,943 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:26,944 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:43604': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:27,044 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:27,045 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:43616': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:27,051 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:27,052 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:43628': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:27,152 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:27,153 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:43634': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:27,159 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:27,160 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:43642': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:27,260 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:27,261 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:43652': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:27,267 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:27,268 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:43662': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:27,368 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:27,369 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:43676': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:27,375 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:27,375 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:43688': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:27,476 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:27,476 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:43696': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:27,483 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:27,483 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:43698': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:27,584 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:27,585 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:43704': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:27,591 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:27,592 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:43720': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:27,693 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:27,694 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:43728': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:27,700 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:27,700 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:43732': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:27,801 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:27,801 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:43746': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:27,808 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:27,808 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:43762': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:27,909 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:27,909 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:43772': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:27,915 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:27,916 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:43786': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:28,017 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:28,018 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:43794': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:28,024 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:28,024 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:43806': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:28,125 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:28,125 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:43812': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:28,132 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:28,132 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:43826': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:28,233 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:28,233 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:43832': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:28,240 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:28,240 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:43838': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:28,341 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:28,341 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:43842': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:28,348 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:28,348 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:43856': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:28,448 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:28,449 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:43868': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:28,455 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:28,456 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:43884': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:28,557 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:28,558 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:43894': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:28,564 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:28,564 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:43908': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:28,665 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:28,666 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:43922': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:28,672 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:28,676 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:43930': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:28,774 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:28,775 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:43936': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:28,781 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:28,781 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:43940': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:28,882 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:28,882 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:43954': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:28,889 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:28,889 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:43970': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:28,990 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:28,990 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:43986': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:28,997 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:28,997 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:43990': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:29,098 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:29,099 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:43998': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:29,105 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:29,105 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:44010': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:29,207 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:29,208 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:44024': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:29,214 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:29,214 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:44034': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:29,315 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:29,315 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:44042': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:29,322 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:29,322 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:44046': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:29,423 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:29,424 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:44060': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:29,430 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:29,431 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:44070': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:29,532 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:29,533 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:44084': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:29,539 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:29,539 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:44100': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:29,640 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:29,640 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:44114': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:29,647 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39231 7221s 2024-11-23 22:22:29,647 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39231': TLS handshake failed with remote 'tls://127.0.0.1:44128': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:29,681 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37523. Reason: failure-to-start- 7221s 2024-11-23 22:22:29,681 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:22:29,683 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35087. Reason: failure-to-start- 7221s 2024-11-23 22:22:29,683 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:22:29,684 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 15s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 7221s stream = await stream.start_tls( 7221s ^^^^^^^^^^^^^^^^^^^^^^^ 7221s False, ssl_options=ssl_options, server_hostname=host 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 7221s self.socket.do_handshake() 7221s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 7221s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 7221s self._sslobj.do_handshake() 7221s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 7221s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 7221s raise FatalCommClosedError( 7221s ...<2 lines>... 7221s ) from err 7221s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 7221s 7221s During handling of the above exception, another exception occurred: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1218, in _register_with_scheduler 7221s await asyncio.sleep(0.1) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 718, in sleep 7221s return await future 7221s ^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 15s. 7221s 2024-11-23 22:22:30,692 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:22:30,700 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:30,701 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34815/status 7221s 2024-11-23 22:22:30,701 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:22:30,716 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43259 7221s 2024-11-23 22:22:30,716 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43259 7221s 2024-11-23 22:22:30,716 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:22:30,716 - distributed.worker - INFO - dashboard at: 127.0.0.1:41625 7221s 2024-11-23 22:22:30,716 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:30,716 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:22:30,717 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:22:30,717 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:22:30,717 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-5zhzlidc 7221s 2024-11-23 22:22:30,717 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:22:30,719 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41935 7221s 2024-11-23 22:22:30,719 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41935 7221s 2024-11-23 22:22:30,719 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:22:30,719 - distributed.worker - INFO - dashboard at: 127.0.0.1:43761 7221s 2024-11-23 22:22:30,719 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:30,719 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:22:30,719 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:22:30,720 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:22:30,720 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-0kfqlqbd 7221s 2024-11-23 22:22:30,720 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:22:30,733 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:30,733 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:30,733 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:34038': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:30,734 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:34040': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:30,846 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:30,846 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:30,847 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:34052': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:30,847 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:34064': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:30,959 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:30,960 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:30,960 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:34070': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:30,960 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:34076': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:31,073 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:31,073 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:31,073 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:34080': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:31,073 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:34096': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:31,186 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:31,186 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:31,187 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:34102': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:31,187 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:34116': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:31,300 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:31,300 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:31,301 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:34122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:31,301 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:34132': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:31,415 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:31,415 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:31,416 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:34142': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:31,416 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:34150': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:31,530 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:31,530 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:31,531 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:34154': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:31,531 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:34160': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:31,644 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:31,644 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:31,644 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:47602': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:31,644 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:47612': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:31,757 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:31,758 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:31,758 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:47626': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:31,758 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:47636': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:31,871 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:31,871 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:31,872 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:47638': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:31,872 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:47654': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:31,985 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:31,985 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:31,986 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:47656': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:31,986 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:47662': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:32,098 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:32,099 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:32,099 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:47676': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:32,099 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:47688': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:32,216 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:32,216 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:32,216 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:47704': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:32,216 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:47720': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:32,329 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:32,329 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:32,329 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:47732': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:32,329 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:47746': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:32,442 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:32,442 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:32,443 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:47760': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:32,443 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:47766': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:32,556 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:32,557 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:32,557 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:47782': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:32,557 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:47796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:32,669 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:32,670 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:32,670 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:47810': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:32,670 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:47820': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:32,783 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:32,783 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:32,783 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:47834': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:32,784 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:47840': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:32,896 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:32,897 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:32,897 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:47854': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:32,897 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:47858': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:33,010 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:33,010 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:33,011 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:47870': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:33,011 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:47878': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:33,124 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:33,125 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:33,125 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:47892': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:33,125 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:47900': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:33,238 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:33,238 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:33,238 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:47902': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:33,239 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:47912': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:33,352 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:33,352 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:33,353 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:47922': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:33,353 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:47938': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:33,460 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:33,465 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:47950': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:33,466 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:33,466 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:47966': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:33,569 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:33,570 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:47974': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:33,576 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:33,577 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:47978': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:33,681 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:33,682 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:47980': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:33,688 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:33,688 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:47984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:33,788 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:33,789 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:47988': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:33,795 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:33,796 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:47994': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:33,897 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:33,898 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:48010': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:33,904 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:33,904 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:48026': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:34,005 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:34,006 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:48042': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:34,012 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:34,013 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:48050': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:34,113 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:34,113 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:48062': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:34,119 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:34,120 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:48064': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:34,221 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:34,221 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:48068': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:34,228 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:34,228 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:48080': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:34,329 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:34,329 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:48096': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:34,336 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:34,336 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:48100': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:34,437 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:34,437 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:48108': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:34,444 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:34,444 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:48110': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:34,545 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:34,545 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:48120': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:34,552 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:34,552 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:48122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:34,653 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:34,654 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:48132': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:34,660 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:34,660 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:48140': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:34,761 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:34,762 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:48146': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:34,770 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:34,770 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:48160': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:34,869 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:34,869 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:48170': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:34,877 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:34,877 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:48184': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:34,977 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:34,977 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:48186': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:34,985 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:34,985 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:48188': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:35,084 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:35,085 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:48190': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:35,091 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:35,092 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:48192': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:35,192 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:35,192 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:48196': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:35,199 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:35,199 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:48210': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:35,300 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:35,300 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:48216': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:35,307 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:35,307 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:48222': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:35,408 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:35,408 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:48230': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:35,414 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:35,415 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:48242': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:35,515 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:35,516 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:48256': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:35,522 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:35,522 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:48266': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:35,623 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:35,624 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:48276': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:35,630 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:35,630 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:48286': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:35,732 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:35,733 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:48302': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:35,739 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:35,739 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:48316': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:35,840 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:35,840 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:48330': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:35,847 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:35,847 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:48344': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:35,948 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:35,948 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:48356': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:35,955 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:35,955 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:48358': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:36,056 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:36,056 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:48368': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:36,062 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:36,063 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:48380': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:36,164 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:36,164 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:48396': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:36,171 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:36,174 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:48412': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:36,272 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:36,272 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:48426': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:36,279 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:36,279 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:48440': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:36,379 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:36,380 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:48456': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:36,386 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:36,387 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:48470': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:36,489 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:36,490 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:48486': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:36,496 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:36,496 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:48500': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:36,597 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:36,598 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:48510': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:36,604 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:36,604 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:48522': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:36,705 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:36,708 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:48530': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:36,715 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:36,715 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:48534': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:36,813 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:36,813 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:48540': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:36,823 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:36,823 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:48552': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:36,921 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:36,921 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:48568': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:36,930 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:36,931 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:48578': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:37,029 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:37,029 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:48584': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:37,037 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:37,038 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:48598': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:37,136 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:37,137 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:48610': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:37,145 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:37,145 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:48622': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:37,244 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:37,245 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:48634': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:37,252 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:37,252 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:48646': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:37,352 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:37,353 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:48658': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:37,359 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:37,360 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:48670': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:37,460 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:37,460 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:48684': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:37,467 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:37,467 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:48700': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:37,569 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:37,570 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:48708': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:37,576 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:37,577 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:48724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:37,680 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:37,681 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:48728': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:37,687 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:37,687 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:48742': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:37,789 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:37,790 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:48746': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:37,796 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:37,796 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:48756': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:37,898 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:37,898 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:48772': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:37,905 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:37,905 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:48788': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:38,005 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:38,006 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:48802': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:38,012 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:38,013 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:48816': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:38,112 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:38,113 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:48826': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:38,123 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:38,124 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:48842': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:38,221 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:38,222 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:48846': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:38,231 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:38,231 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:48848': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:38,329 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:38,329 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:48860': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:38,338 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:38,339 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:48868': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:38,437 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:38,437 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:48880': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:38,446 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:38,446 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:48886': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:38,546 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:38,546 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:48902': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:38,553 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:38,553 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:48914': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:38,654 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:38,655 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:48928': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:38,661 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:38,661 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:48940': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:38,762 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:38,762 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:48942': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:38,769 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:38,769 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:48946': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:38,870 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:38,871 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:48948': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:38,877 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:38,877 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:48958': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:38,978 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:38,979 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:48972': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:38,985 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:38,986 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:48986': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:39,086 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:39,087 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:48994': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:39,093 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:39,093 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:49002': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:39,195 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:39,196 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:49004': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:39,203 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:39,206 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:49020': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:39,304 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:39,304 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:49024': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:39,311 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:39,311 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:49034': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:39,411 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:39,412 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:49046': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:39,418 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:39,419 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:49050': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:39,520 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:39,521 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:49066': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:39,527 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:39,527 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:49082': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:39,629 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:39,630 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:49088': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:39,636 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:39,636 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:49100': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:39,736 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:39,737 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:49104': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:39,744 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:39,746 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:49106': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:39,846 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:39,847 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:49114': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:39,853 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:39,853 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:49128': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:39,954 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:39,954 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:49144': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:39,961 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:39,961 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:49158': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:40,062 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:40,063 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:49164': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:40,069 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:40,070 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:49174': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:40,171 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:40,174 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:49182': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:40,181 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:40,181 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:49194': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:40,278 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:40,279 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:49208': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:40,289 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:40,289 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:49222': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:40,387 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:40,387 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:49232': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:40,396 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:40,396 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:49236': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:40,495 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:40,496 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:49242': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:40,503 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:40,504 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:49250': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:40,603 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:40,604 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:49262': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:40,610 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:40,611 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:49264': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:40,712 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:40,713 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:49272': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:40,719 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:40,719 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:49288': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:40,819 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:40,819 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:49294': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:40,826 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:40,826 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:49306': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:40,926 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:40,926 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:49322': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:40,933 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:40,933 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:49324': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:41,034 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:41,035 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:49340': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:41,041 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:41,041 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:49348': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:41,142 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:41,142 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:49360': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:41,149 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:41,149 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:49376': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:41,250 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:41,251 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:49380': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:41,257 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:41,258 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:49396': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:41,358 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:41,359 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:49404': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:41,365 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:41,365 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:49420': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:41,467 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:41,468 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:49422': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:41,474 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:41,474 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:49434': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:41,575 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:41,576 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:55506': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:41,582 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:41,582 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:55520': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:41,683 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:41,683 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:55536': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:41,690 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:41,690 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:55538': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:41,791 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:41,791 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:55544': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:41,798 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:41,798 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:55552': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:41,899 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:41,900 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:55562': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:41,906 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:41,907 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:55564': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:42,007 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:42,007 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:55574': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:42,014 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:42,014 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:55582': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:42,115 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:42,116 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:55592': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:42,122 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:42,122 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:55596': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:42,222 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:42,223 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:55602': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:42,229 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:42,229 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:55608': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:42,330 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:42,331 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:55614': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:42,337 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:42,337 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:55618': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:42,438 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:42,439 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:55626': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:42,445 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:42,446 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:55636': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:42,546 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:42,546 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:55650': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:42,553 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:42,553 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:55654': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:42,654 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:42,654 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:55668': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:42,660 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:42,661 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:55670': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:42,762 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:42,763 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:55680': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:42,769 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:42,769 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:55692': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:42,870 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:42,871 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:55708': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:42,877 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:42,877 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:55714': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:42,979 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:42,979 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:55722': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:42,985 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:42,986 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:55724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:43,087 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:43,090 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:55726': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:43,096 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:43,096 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:55740': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:43,195 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:43,196 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:55752': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:43,204 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:43,207 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:55758': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:43,303 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:43,304 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:55774': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:43,311 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:43,311 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:55788': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:43,411 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:43,411 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:55798': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:43,418 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:43,418 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:55808': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:43,519 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:43,520 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:55818': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:43,526 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:43,527 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:55832': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:43,628 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:43,629 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:55848': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:43,635 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46395 7221s 2024-11-23 22:22:43,635 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46395': TLS handshake failed with remote 'tls://127.0.0.1:55850': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:22:43,715 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43259. Reason: failure-to-start- 7221s 2024-11-23 22:22:43,715 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:22:43,717 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 13s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 7221s stream = await stream.start_tls( 7221s ^^^^^^^^^^^^^^^^^^^^^^^ 7221s False, ssl_options=ssl_options, server_hostname=host 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 7221s self.socket.do_handshake() 7221s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 7221s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 7221s self._sslobj.do_handshake() 7221s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 7221s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 7221s raise FatalCommClosedError( 7221s ...<2 lines>... 7221s ) from err 7221s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 7221s 7221s During handling of the above exception, another exception occurred: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1218, in _register_with_scheduler 7221s await asyncio.sleep(0.1) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 718, in sleep 7221s return await future 7221s ^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 13s. 7221s 2024-11-23 22:22:43,721 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41935. Reason: failure-to-start- 7221s 2024-11-23 22:22:43,721 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:22:44,723 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:22:44,730 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44655 7221s 2024-11-23 22:22:44,731 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41575/status 7221s 2024-11-23 22:22:44,731 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:22:44,744 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39929 7221s 2024-11-23 22:22:44,745 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39929 7221s 2024-11-23 22:22:44,745 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:22:44,745 - distributed.worker - INFO - dashboard at: 127.0.0.1:42823 7221s 2024-11-23 22:22:44,745 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44655 7221s 2024-11-23 22:22:44,745 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:22:44,745 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:22:44,745 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:22:44,745 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-mh2j20ve 7221s 2024-11-23 22:22:44,745 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:22:44,748 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43299 7221s 2024-11-23 22:22:44,748 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43299 7221s 2024-11-23 22:22:44,748 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:22:44,748 - distributed.worker - INFO - dashboard at: 127.0.0.1:35141 7221s 2024-11-23 22:22:44,749 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44655 7221s 2024-11-23 22:22:44,749 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:22:44,749 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:22:44,749 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:22:44,749 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-1pf86mwl 7221s 2024-11-23 22:22:44,749 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:22:44,750 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39929. Reason: failure-to-start- 7221s 2024-11-23 22:22:44,750 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:22:44,750 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43299. Reason: failure-to-start- 7221s 2024-11-23 22:22:44,750 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:22:44,752 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44655': TLS handshake failed with remote 'tls://127.0.0.1:36032': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:22:44,752 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44655': TLS handshake failed with remote 'tls://127.0.0.1:36034': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:22:44,753 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s 2024-11-23 22:22:45,759 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:22:45,766 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45711 7221s 2024-11-23 22:22:45,766 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44177/status 7221s 2024-11-23 22:22:45,767 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:22:45,780 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45817 7221s 2024-11-23 22:22:45,780 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45817 7221s 2024-11-23 22:22:45,780 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:22:45,780 - distributed.worker - INFO - dashboard at: 127.0.0.1:34809 7221s 2024-11-23 22:22:45,780 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45711 7221s 2024-11-23 22:22:45,780 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:22:45,780 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:22:45,780 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:22:45,780 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-kjb6mzwh 7221s 2024-11-23 22:22:45,781 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:22:45,783 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39747 7221s 2024-11-23 22:22:45,783 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39747 7221s 2024-11-23 22:22:45,783 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:22:45,783 - distributed.worker - INFO - dashboard at: 127.0.0.1:37333 7221s 2024-11-23 22:22:45,783 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45711 7221s 2024-11-23 22:22:45,783 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:22:45,783 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:22:45,783 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:22:45,783 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-bda099_b 7221s 2024-11-23 22:22:45,783 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:22:45,784 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45817. Reason: failure-to-start- 7221s 2024-11-23 22:22:45,785 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:22:45,785 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39747. Reason: failure-to-start- 7221s 2024-11-23 22:22:45,785 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:22:45,786 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45711': TLS handshake failed with remote 'tls://127.0.0.1:57334': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:22:45,787 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45711': TLS handshake failed with remote 'tls://127.0.0.1:57340': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:22:45,788 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s 2024-11-23 22:22:46,794 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:22:46,803 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37875 7221s 2024-11-23 22:22:46,803 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35111/status 7221s 2024-11-23 22:22:46,803 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:22:46,817 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41909 7221s 2024-11-23 22:22:46,818 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41909 7221s 2024-11-23 22:22:46,818 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:22:46,818 - distributed.worker - INFO - dashboard at: 127.0.0.1:43321 7221s 2024-11-23 22:22:46,818 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37875 7221s 2024-11-23 22:22:46,818 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:22:46,818 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:22:46,818 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:22:46,818 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ez4yfh8q 7221s 2024-11-23 22:22:46,818 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:22:46,820 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42083 7221s 2024-11-23 22:22:46,820 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42083 7221s 2024-11-23 22:22:46,821 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:22:46,821 - distributed.worker - INFO - dashboard at: 127.0.0.1:43463 7221s 2024-11-23 22:22:46,821 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37875 7221s 2024-11-23 22:22:46,821 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:22:46,821 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:22:46,821 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:22:46,821 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-l7hliowl 7221s 2024-11-23 22:22:46,821 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:22:46,822 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41909. Reason: failure-to-start- 7221s 2024-11-23 22:22:46,822 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:22:46,823 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42083. Reason: failure-to-start- 7221s 2024-11-23 22:22:46,823 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:22:46,824 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37875': TLS handshake failed with remote 'tls://127.0.0.1:58214': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:22:46,824 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37875': TLS handshake failed with remote 'tls://127.0.0.1:58220': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:22:46,825 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s 2024-11-23 22:22:47,831 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:22:47,838 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39025 7221s 2024-11-23 22:22:47,838 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44379/status 7221s 2024-11-23 22:22:47,838 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:22:47,854 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33995 7221s 2024-11-23 22:22:47,854 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33995 7221s 2024-11-23 22:22:47,854 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:22:47,854 - distributed.worker - INFO - dashboard at: 127.0.0.1:42987 7221s 2024-11-23 22:22:47,854 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39025 7221s 2024-11-23 22:22:47,854 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:22:47,854 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:22:47,854 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:22:47,854 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-u_67gsoh 7221s 2024-11-23 22:22:47,854 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:22:47,856 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42421 7221s 2024-11-23 22:22:47,857 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42421 7221s 2024-11-23 22:22:47,857 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:22:47,857 - distributed.worker - INFO - dashboard at: 127.0.0.1:45981 7221s 2024-11-23 22:22:47,857 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39025 7221s 2024-11-23 22:22:47,857 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:22:47,857 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:22:47,857 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:22:47,857 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-gkj7dwno 7221s 2024-11-23 22:22:47,857 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:22:47,858 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33995. Reason: failure-to-start- 7221s 2024-11-23 22:22:47,858 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:22:47,859 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42421. Reason: failure-to-start- 7221s 2024-11-23 22:22:47,859 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:22:47,860 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39025': TLS handshake failed with remote 'tls://127.0.0.1:57378': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:22:47,860 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39025': TLS handshake failed with remote 'tls://127.0.0.1:57380': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:22:47,862 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s 2024-11-23 22:22:48,868 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:22:48,875 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44063 7221s 2024-11-23 22:22:48,875 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35477/status 7221s 2024-11-23 22:22:48,876 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:22:48,890 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38717 7221s 2024-11-23 22:22:48,890 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38717 7221s 2024-11-23 22:22:48,890 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:22:48,890 - distributed.worker - INFO - dashboard at: 127.0.0.1:42843 7221s 2024-11-23 22:22:48,891 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44063 7221s 2024-11-23 22:22:48,891 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:22:48,891 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:22:48,891 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:22:48,891 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-yti5whlp 7221s 2024-11-23 22:22:48,891 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:22:48,893 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44647 7221s 2024-11-23 22:22:48,893 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44647 7221s 2024-11-23 22:22:48,893 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:22:48,893 - distributed.worker - INFO - dashboard at: 127.0.0.1:39823 7221s 2024-11-23 22:22:48,893 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44063 7221s 2024-11-23 22:22:48,893 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:22:48,893 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:22:48,893 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:22:48,894 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-xrixa7ql 7221s 2024-11-23 22:22:48,894 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:22:48,895 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38717. Reason: failure-to-start- 7221s 2024-11-23 22:22:48,896 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:22:48,896 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44647. Reason: failure-to-start- 7221s 2024-11-23 22:22:48,896 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:22:48,898 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44063': TLS handshake failed with remote 'tls://127.0.0.1:52506': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:22:48,898 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44063': TLS handshake failed with remote 'tls://127.0.0.1:52512': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:22:48,899 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s 2024-11-23 22:22:49,905 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:22:49,912 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37451 7221s 2024-11-23 22:22:49,912 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41283/status 7221s 2024-11-23 22:22:49,913 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:22:49,927 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42035 7221s 2024-11-23 22:22:49,927 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42035 7221s 2024-11-23 22:22:49,927 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:22:49,927 - distributed.worker - INFO - dashboard at: 127.0.0.1:38069 7221s 2024-11-23 22:22:49,927 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37451 7221s 2024-11-23 22:22:49,927 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:22:49,927 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:22:49,927 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:22:49,927 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-q4e3q7kk 7221s 2024-11-23 22:22:49,927 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:22:49,929 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39793 7221s 2024-11-23 22:22:49,930 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39793 7221s 2024-11-23 22:22:49,930 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:22:49,930 - distributed.worker - INFO - dashboard at: 127.0.0.1:44061 7221s 2024-11-23 22:22:49,930 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37451 7221s 2024-11-23 22:22:49,930 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:22:49,930 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:22:49,930 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:22:49,930 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ziolmxnp 7221s 2024-11-23 22:22:49,930 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:22:49,931 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42035. Reason: failure-to-start- 7221s 2024-11-23 22:22:49,932 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:22:49,932 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39793. Reason: failure-to-start- 7221s 2024-11-23 22:22:49,932 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:22:49,933 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37451': TLS handshake failed with remote 'tls://127.0.0.1:37362': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:22:49,934 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37451': TLS handshake failed with remote 'tls://127.0.0.1:37364': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:22:49,935 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s 2024-11-23 22:22:50,941 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:22:50,950 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46503 7221s 2024-11-23 22:22:50,950 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37447/status 7221s 2024-11-23 22:22:50,950 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:22:50,965 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46097 7221s 2024-11-23 22:22:50,965 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46097 7221s 2024-11-23 22:22:50,966 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:22:50,966 - distributed.worker - INFO - dashboard at: 127.0.0.1:38225 7221s 2024-11-23 22:22:50,966 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46503 7221s 2024-11-23 22:22:50,966 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:22:50,966 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:22:50,966 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:22:50,966 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-d6_zqaqc 7221s 2024-11-23 22:22:50,966 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:22:50,968 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40477 7221s 2024-11-23 22:22:50,968 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40477 7221s 2024-11-23 22:22:50,968 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:22:50,969 - distributed.worker - INFO - dashboard at: 127.0.0.1:33595 7221s 2024-11-23 22:22:50,969 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46503 7221s 2024-11-23 22:22:50,969 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:22:50,969 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:22:50,969 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:22:50,969 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-u4cmarxl 7221s 2024-11-23 22:22:50,969 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:22:50,970 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46097. Reason: failure-to-start- 7221s 2024-11-23 22:22:50,970 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:22:50,971 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40477. Reason: failure-to-start- 7221s 2024-11-23 22:22:50,971 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:22:50,973 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46503': TLS handshake failed with remote 'tls://127.0.0.1:39586': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:22:50,973 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46503': TLS handshake failed with remote 'tls://127.0.0.1:39596': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:22:50,974 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s 2024-11-23 22:22:51,979 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:22:51,987 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36073 7221s 2024-11-23 22:22:51,987 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:32867/status 7221s 2024-11-23 22:22:51,987 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:22:52,004 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45935 7221s 2024-11-23 22:22:52,005 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45935 7221s 2024-11-23 22:22:52,005 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:22:52,005 - distributed.worker - INFO - dashboard at: 127.0.0.1:42041 7221s 2024-11-23 22:22:52,005 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36073 7221s 2024-11-23 22:22:52,005 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:22:52,005 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:22:52,005 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:22:52,005 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-q7r3v1wz 7221s 2024-11-23 22:22:52,005 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:22:52,007 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40173 7221s 2024-11-23 22:22:52,007 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40173 7221s 2024-11-23 22:22:52,007 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:22:52,007 - distributed.worker - INFO - dashboard at: 127.0.0.1:40829 7221s 2024-11-23 22:22:52,008 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36073 7221s 2024-11-23 22:22:52,008 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:22:52,008 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:22:52,008 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:22:52,008 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-2n27300q 7221s 2024-11-23 22:22:52,008 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:22:52,009 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45935. Reason: failure-to-start- 7221s 2024-11-23 22:22:52,009 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:22:52,010 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40173. Reason: failure-to-start- 7221s 2024-11-23 22:22:52,010 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:22:52,011 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36073': TLS handshake failed with remote 'tls://127.0.0.1:43336': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:22:52,011 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36073': TLS handshake failed with remote 'tls://127.0.0.1:43346': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:22:52,013 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s 2024-11-23 22:22:53,018 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:22:53,026 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45105 7221s 2024-11-23 22:22:53,026 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46707/status 7221s 2024-11-23 22:22:53,027 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:22:53,041 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34149 7221s 2024-11-23 22:22:53,041 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34149 7221s 2024-11-23 22:22:53,041 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:22:53,041 - distributed.worker - INFO - dashboard at: 127.0.0.1:35855 7221s 2024-11-23 22:22:53,041 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45105 7221s 2024-11-23 22:22:53,041 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:22:53,041 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:22:53,041 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:22:53,041 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ehq2_9yg 7221s 2024-11-23 22:22:53,041 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:22:53,043 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41531 7221s 2024-11-23 22:22:53,044 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41531 7221s 2024-11-23 22:22:53,044 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:22:53,044 - distributed.worker - INFO - dashboard at: 127.0.0.1:44117 7221s 2024-11-23 22:22:53,044 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45105 7221s 2024-11-23 22:22:53,044 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:22:53,044 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:22:53,044 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:22:53,044 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-enzrv402 7221s 2024-11-23 22:22:53,044 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:22:53,046 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34149. Reason: failure-to-start- 7221s 2024-11-23 22:22:53,046 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:22:53,047 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41531. Reason: failure-to-start- 7221s 2024-11-23 22:22:53,047 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:22:53,048 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45105': TLS handshake failed with remote 'tls://127.0.0.1:35714': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:22:53,048 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45105': TLS handshake failed with remote 'tls://127.0.0.1:35716': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:22:53,050 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s 2024-11-23 22:22:54,055 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:22:54,062 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45257 7221s 2024-11-23 22:22:54,063 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34257/status 7221s 2024-11-23 22:22:54,063 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:22:54,077 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36519 7221s 2024-11-23 22:22:54,078 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36519 7221s 2024-11-23 22:22:54,078 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:22:54,078 - distributed.worker - INFO - dashboard at: 127.0.0.1:46591 7221s 2024-11-23 22:22:54,078 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45257 7221s 2024-11-23 22:22:54,078 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:22:54,078 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:22:54,078 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:22:54,078 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-47t3vulh 7221s 2024-11-23 22:22:54,078 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:22:54,080 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38725 7221s 2024-11-23 22:22:54,080 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38725 7221s 2024-11-23 22:22:54,080 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:22:54,081 - distributed.worker - INFO - dashboard at: 127.0.0.1:34399 7221s 2024-11-23 22:22:54,081 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45257 7221s 2024-11-23 22:22:54,081 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:22:54,081 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:22:54,081 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:22:54,081 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-3jg7gsg5 7221s 2024-11-23 22:22:54,081 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:22:54,082 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36519. Reason: failure-to-start- 7221s 2024-11-23 22:22:54,082 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:22:54,083 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38725. Reason: failure-to-start- 7221s 2024-11-23 22:22:54,083 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:22:54,084 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45257': TLS handshake failed with remote 'tls://127.0.0.1:52790': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:22:54,084 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45257': TLS handshake failed with remote 'tls://127.0.0.1:52806': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:22:54,086 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s 2024-11-23 22:22:55,090 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:22:55,099 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44719 7221s 2024-11-23 22:22:55,099 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45253/status 7221s 2024-11-23 22:22:55,099 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:22:55,113 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35945 7221s 2024-11-23 22:22:55,114 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35945 7221s 2024-11-23 22:22:55,114 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:22:55,114 - distributed.worker - INFO - dashboard at: 127.0.0.1:44695 7221s 2024-11-23 22:22:55,114 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44719 7221s 2024-11-23 22:22:55,114 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:22:55,114 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:22:55,114 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:22:55,114 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-2rjz7apr 7221s 2024-11-23 22:22:55,114 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:22:55,116 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35057 7221s 2024-11-23 22:22:55,117 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35057 7221s 2024-11-23 22:22:55,117 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:22:55,117 - distributed.worker - INFO - dashboard at: 127.0.0.1:45147 7221s 2024-11-23 22:22:55,117 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44719 7221s 2024-11-23 22:22:55,117 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:22:55,117 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:22:55,117 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:22:55,117 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-kftm21wf 7221s 2024-11-23 22:22:55,117 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:22:55,118 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35945. Reason: failure-to-start- 7221s 2024-11-23 22:22:55,119 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:22:55,119 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35057. Reason: failure-to-start- 7221s 2024-11-23 22:22:55,119 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:22:55,121 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44719': TLS handshake failed with remote 'tls://127.0.0.1:52146': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:22:55,121 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44719': TLS handshake failed with remote 'tls://127.0.0.1:52152': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:22:55,122 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s 2024-11-23 22:22:56,127 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:22:56,135 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40653 7221s 2024-11-23 22:22:56,135 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42213/status 7221s 2024-11-23 22:22:56,135 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:22:56,159 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36681 7221s 2024-11-23 22:22:56,160 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36681 7221s 2024-11-23 22:22:56,160 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:22:56,160 - distributed.worker - INFO - dashboard at: 127.0.0.1:35363 7221s 2024-11-23 22:22:56,160 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40653 7221s 2024-11-23 22:22:56,160 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:22:56,160 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:22:56,160 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:22:56,160 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-16yuuz04 7221s 2024-11-23 22:22:56,160 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:22:56,162 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40995 7221s 2024-11-23 22:22:56,163 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40995 7221s 2024-11-23 22:22:56,163 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:22:56,163 - distributed.worker - INFO - dashboard at: 127.0.0.1:41903 7221s 2024-11-23 22:22:56,163 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40653 7221s 2024-11-23 22:22:56,163 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:22:56,163 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:22:56,163 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:22:56,163 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-uhxiwcgn 7221s 2024-11-23 22:22:56,163 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:22:56,164 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36681. Reason: failure-to-start- 7221s 2024-11-23 22:22:56,164 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:22:56,165 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40995. Reason: failure-to-start- 7221s 2024-11-23 22:22:56,165 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:22:56,167 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40653': TLS handshake failed with remote 'tls://127.0.0.1:50670': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:22:56,167 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40653': TLS handshake failed with remote 'tls://127.0.0.1:50678': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:22:56,168 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s 2024-11-23 22:22:57,175 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:22:57,182 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44913 7221s 2024-11-23 22:22:57,182 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46331/status 7221s 2024-11-23 22:22:57,182 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:22:57,197 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41107 7221s 2024-11-23 22:22:57,197 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41107 7221s 2024-11-23 22:22:57,197 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:22:57,197 - distributed.worker - INFO - dashboard at: 127.0.0.1:37819 7221s 2024-11-23 22:22:57,197 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44913 7221s 2024-11-23 22:22:57,197 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:22:57,197 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:22:57,197 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:22:57,197 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-7lkzb_in 7221s 2024-11-23 22:22:57,197 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:22:57,199 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37401 7221s 2024-11-23 22:22:57,200 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37401 7221s 2024-11-23 22:22:57,200 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:22:57,200 - distributed.worker - INFO - dashboard at: 127.0.0.1:32963 7221s 2024-11-23 22:22:57,200 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44913 7221s 2024-11-23 22:22:57,200 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:22:57,200 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:22:57,200 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:22:57,200 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-6vrqqh98 7221s 2024-11-23 22:22:57,200 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:22:57,201 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41107. Reason: failure-to-start- 7221s 2024-11-23 22:22:57,201 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:22:57,202 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37401. Reason: failure-to-start- 7221s 2024-11-23 22:22:57,202 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:22:57,203 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44913': TLS handshake failed with remote 'tls://127.0.0.1:56126': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:22:57,204 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44913': TLS handshake failed with remote 'tls://127.0.0.1:56134': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:22:57,209 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s 2024-11-23 22:22:58,214 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:22:58,221 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39383 7221s 2024-11-23 22:22:58,222 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41763/status 7221s 2024-11-23 22:22:58,222 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:22:58,237 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38385 7221s 2024-11-23 22:22:58,237 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38385 7221s 2024-11-23 22:22:58,237 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:22:58,237 - distributed.worker - INFO - dashboard at: 127.0.0.1:42531 7221s 2024-11-23 22:22:58,237 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39383 7221s 2024-11-23 22:22:58,237 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:22:58,237 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:22:58,237 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:22:58,237 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-62fuywyf 7221s 2024-11-23 22:22:58,237 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:22:58,239 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45423 7221s 2024-11-23 22:22:58,240 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45423 7221s 2024-11-23 22:22:58,240 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:22:58,240 - distributed.worker - INFO - dashboard at: 127.0.0.1:44309 7221s 2024-11-23 22:22:58,240 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39383 7221s 2024-11-23 22:22:58,240 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:22:58,240 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:22:58,240 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:22:58,240 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-th_hc9ec 7221s 2024-11-23 22:22:58,240 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:22:58,244 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38385. Reason: failure-to-start- 7221s 2024-11-23 22:22:58,244 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:22:58,244 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45423. Reason: failure-to-start- 7221s 2024-11-23 22:22:58,245 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:22:58,246 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39383': TLS handshake failed with remote 'tls://127.0.0.1:41078': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:22:58,246 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39383': TLS handshake failed with remote 'tls://127.0.0.1:41094': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:22:58,248 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s 2024-11-23 22:22:59,253 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:22:59,261 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35089 7221s 2024-11-23 22:22:59,262 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46323/status 7221s 2024-11-23 22:22:59,262 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:22:59,276 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39859 7221s 2024-11-23 22:22:59,276 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39859 7221s 2024-11-23 22:22:59,276 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:22:59,276 - distributed.worker - INFO - dashboard at: 127.0.0.1:42835 7221s 2024-11-23 22:22:59,276 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35089 7221s 2024-11-23 22:22:59,276 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:22:59,276 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:22:59,276 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:22:59,276 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-_7okg69v 7221s 2024-11-23 22:22:59,276 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:22:59,278 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38709 7221s 2024-11-23 22:22:59,278 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38709 7221s 2024-11-23 22:22:59,278 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:22:59,279 - distributed.worker - INFO - dashboard at: 127.0.0.1:35211 7221s 2024-11-23 22:22:59,279 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35089 7221s 2024-11-23 22:22:59,279 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:22:59,279 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:22:59,279 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:22:59,279 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-lszo_xo1 7221s 2024-11-23 22:22:59,279 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:22:59,282 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39859. Reason: failure-to-start- 7221s 2024-11-23 22:22:59,282 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:22:59,283 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38709. Reason: failure-to-start- 7221s 2024-11-23 22:22:59,283 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:22:59,285 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35089': TLS handshake failed with remote 'tls://127.0.0.1:45912': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:22:59,285 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35089': TLS handshake failed with remote 'tls://127.0.0.1:45922': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:22:59,286 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s 2024-11-23 22:23:00,292 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:23:00,299 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41049 7221s 2024-11-23 22:23:00,299 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33123/status 7221s 2024-11-23 22:23:00,300 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:23:00,316 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41037 7221s 2024-11-23 22:23:00,316 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41037 7221s 2024-11-23 22:23:00,316 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:23:00,316 - distributed.worker - INFO - dashboard at: 127.0.0.1:41441 7221s 2024-11-23 22:23:00,316 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41049 7221s 2024-11-23 22:23:00,316 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:23:00,316 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:23:00,316 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:23:00,316 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-7qq4czam 7221s 2024-11-23 22:23:00,317 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:23:00,319 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:32989 7221s 2024-11-23 22:23:00,319 - distributed.worker - INFO - Listening to: tls://127.0.0.1:32989 7221s 2024-11-23 22:23:00,319 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:23:00,319 - distributed.worker - INFO - dashboard at: 127.0.0.1:37949 7221s 2024-11-23 22:23:00,319 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41049 7221s 2024-11-23 22:23:00,319 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:23:00,319 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:23:00,319 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:23:00,319 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-gdelnfk2 7221s 2024-11-23 22:23:00,319 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:23:00,323 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41037. Reason: failure-to-start- 7221s 2024-11-23 22:23:00,323 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:23:00,323 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:32989. Reason: failure-to-start- 7221s 2024-11-23 22:23:00,324 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:23:00,325 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41049': TLS handshake failed with remote 'tls://127.0.0.1:36318': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:23:00,325 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41049': TLS handshake failed with remote 'tls://127.0.0.1:36320': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:23:00,327 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s 2024-11-23 22:23:01,333 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:23:01,340 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34203 7221s 2024-11-23 22:23:01,340 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39629/status 7221s 2024-11-23 22:23:01,340 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:23:01,356 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37049 7221s 2024-11-23 22:23:01,357 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37049 7221s 2024-11-23 22:23:01,357 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:23:01,357 - distributed.worker - INFO - dashboard at: 127.0.0.1:33985 7221s 2024-11-23 22:23:01,357 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34203 7221s 2024-11-23 22:23:01,357 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:23:01,357 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:23:01,357 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:23:01,357 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-h8qbdt0p 7221s 2024-11-23 22:23:01,357 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:23:01,359 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46407 7221s 2024-11-23 22:23:01,359 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46407 7221s 2024-11-23 22:23:01,359 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:23:01,359 - distributed.worker - INFO - dashboard at: 127.0.0.1:43197 7221s 2024-11-23 22:23:01,359 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34203 7221s 2024-11-23 22:23:01,359 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:23:01,359 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:23:01,360 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:23:01,360 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-btpc7od6 7221s 2024-11-23 22:23:01,360 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:23:01,362 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37049. Reason: failure-to-start- 7221s 2024-11-23 22:23:01,362 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:23:01,363 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46407. Reason: failure-to-start- 7221s 2024-11-23 22:23:01,363 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:23:01,364 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34203': TLS handshake failed with remote 'tls://127.0.0.1:55950': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:23:01,364 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34203': TLS handshake failed with remote 'tls://127.0.0.1:55952': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:23:01,366 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s 2024-11-23 22:23:02,371 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:23:02,378 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34619 7221s 2024-11-23 22:23:02,378 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35453/status 7221s 2024-11-23 22:23:02,378 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:23:02,393 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41743 7221s 2024-11-23 22:23:02,394 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41743 7221s 2024-11-23 22:23:02,394 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:23:02,394 - distributed.worker - INFO - dashboard at: 127.0.0.1:41205 7221s 2024-11-23 22:23:02,394 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34619 7221s 2024-11-23 22:23:02,394 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:23:02,394 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:23:02,394 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:23:02,394 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-qbovdh8a 7221s 2024-11-23 22:23:02,394 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:23:02,396 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46693 7221s 2024-11-23 22:23:02,396 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46693 7221s 2024-11-23 22:23:02,396 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:23:02,396 - distributed.worker - INFO - dashboard at: 127.0.0.1:34471 7221s 2024-11-23 22:23:02,396 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34619 7221s 2024-11-23 22:23:02,397 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:23:02,397 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:23:02,397 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:23:02,397 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-68fxxz5y 7221s 2024-11-23 22:23:02,397 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:23:02,398 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41743. Reason: failure-to-start- 7221s 2024-11-23 22:23:02,398 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:23:02,398 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46693. Reason: failure-to-start- 7221s 2024-11-23 22:23:02,399 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:23:02,400 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34619': TLS handshake failed with remote 'tls://127.0.0.1:51358': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:23:02,400 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34619': TLS handshake failed with remote 'tls://127.0.0.1:51364': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:23:02,402 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s 2024-11-23 22:23:03,407 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:23:03,416 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43705 7221s 2024-11-23 22:23:03,417 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34117/status 7221s 2024-11-23 22:23:03,417 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:23:03,433 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46605 7221s 2024-11-23 22:23:03,434 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46605 7221s 2024-11-23 22:23:03,434 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:23:03,434 - distributed.worker - INFO - dashboard at: 127.0.0.1:43137 7221s 2024-11-23 22:23:03,434 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43705 7221s 2024-11-23 22:23:03,434 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:23:03,434 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:23:03,434 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:23:03,434 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ni1azcpj 7221s 2024-11-23 22:23:03,434 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:23:03,436 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33197 7221s 2024-11-23 22:23:03,436 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33197 7221s 2024-11-23 22:23:03,436 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:23:03,437 - distributed.worker - INFO - dashboard at: 127.0.0.1:40877 7221s 2024-11-23 22:23:03,437 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43705 7221s 2024-11-23 22:23:03,437 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:23:03,437 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:23:03,437 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:23:03,437 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-2ey3rsq5 7221s 2024-11-23 22:23:03,437 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:23:03,438 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46605. Reason: failure-to-start- 7221s 2024-11-23 22:23:03,438 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:23:03,439 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33197. Reason: failure-to-start- 7221s 2024-11-23 22:23:03,439 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:23:03,440 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43705': TLS handshake failed with remote 'tls://127.0.0.1:56966': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:23:03,440 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43705': TLS handshake failed with remote 'tls://127.0.0.1:56972': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:23:03,442 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s 2024-11-23 22:23:04,448 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:23:04,455 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39091 7221s 2024-11-23 22:23:04,456 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46051/status 7221s 2024-11-23 22:23:04,456 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:23:04,474 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35349 7221s 2024-11-23 22:23:04,474 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35349 7221s 2024-11-23 22:23:04,474 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:23:04,474 - distributed.worker - INFO - dashboard at: 127.0.0.1:41997 7221s 2024-11-23 22:23:04,475 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39091 7221s 2024-11-23 22:23:04,475 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:23:04,475 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:23:04,475 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:23:04,475 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-syt2vauz 7221s 2024-11-23 22:23:04,475 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:23:04,477 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37761 7221s 2024-11-23 22:23:04,477 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37761 7221s 2024-11-23 22:23:04,477 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:23:04,477 - distributed.worker - INFO - dashboard at: 127.0.0.1:33533 7221s 2024-11-23 22:23:04,477 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39091 7221s 2024-11-23 22:23:04,477 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:23:04,477 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:23:04,478 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:23:04,478 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-u33spfdm 7221s 2024-11-23 22:23:04,478 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:23:04,479 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35349. Reason: failure-to-start- 7221s 2024-11-23 22:23:04,479 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:23:04,480 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37761. Reason: failure-to-start- 7221s 2024-11-23 22:23:04,480 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:23:04,481 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39091': TLS handshake failed with remote 'tls://127.0.0.1:41032': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:23:04,482 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39091': TLS handshake failed with remote 'tls://127.0.0.1:41038': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:23:04,483 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s 2024-11-23 22:23:05,489 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:23:05,497 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45723 7221s 2024-11-23 22:23:05,497 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40437/status 7221s 2024-11-23 22:23:05,498 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:23:05,515 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42517 7221s 2024-11-23 22:23:05,515 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42517 7221s 2024-11-23 22:23:05,515 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:23:05,515 - distributed.worker - INFO - dashboard at: 127.0.0.1:32791 7221s 2024-11-23 22:23:05,515 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45723 7221s 2024-11-23 22:23:05,515 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:23:05,515 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:23:05,516 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:23:05,516 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-kmtn3xea 7221s 2024-11-23 22:23:05,516 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:23:05,519 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46879 7221s 2024-11-23 22:23:05,519 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46879 7221s 2024-11-23 22:23:05,519 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:23:05,519 - distributed.worker - INFO - dashboard at: 127.0.0.1:33395 7221s 2024-11-23 22:23:05,519 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45723 7221s 2024-11-23 22:23:05,519 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:23:05,520 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:23:05,520 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:23:05,520 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-rl4wria8 7221s 2024-11-23 22:23:05,520 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:23:05,521 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42517. Reason: failure-to-start- 7221s 2024-11-23 22:23:05,521 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:23:05,522 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46879. Reason: failure-to-start- 7221s 2024-11-23 22:23:05,522 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:23:05,524 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45723': TLS handshake failed with remote 'tls://127.0.0.1:53538': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:23:05,524 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45723': TLS handshake failed with remote 'tls://127.0.0.1:53546': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:23:05,525 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s 2024-11-23 22:23:06,533 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:23:06,540 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33949 7221s 2024-11-23 22:23:06,540 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35935/status 7221s 2024-11-23 22:23:06,540 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:23:06,554 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35517 7221s 2024-11-23 22:23:06,554 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35517 7221s 2024-11-23 22:23:06,554 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:23:06,554 - distributed.worker - INFO - dashboard at: 127.0.0.1:34753 7221s 2024-11-23 22:23:06,554 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33949 7221s 2024-11-23 22:23:06,554 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:23:06,554 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:23:06,554 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:23:06,554 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-5vd8lbnr 7221s 2024-11-23 22:23:06,555 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:23:06,556 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37955 7221s 2024-11-23 22:23:06,557 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37955 7221s 2024-11-23 22:23:06,557 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:23:06,557 - distributed.worker - INFO - dashboard at: 127.0.0.1:46417 7221s 2024-11-23 22:23:06,557 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33949 7221s 2024-11-23 22:23:06,557 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:23:06,557 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:23:06,557 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:23:06,557 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-tkl9syh7 7221s 2024-11-23 22:23:06,557 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:23:06,558 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35517. Reason: failure-to-start- 7221s 2024-11-23 22:23:06,559 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:23:06,559 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37955. Reason: failure-to-start- 7221s 2024-11-23 22:23:06,559 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:23:06,561 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33949': TLS handshake failed with remote 'tls://127.0.0.1:52608': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:23:06,561 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33949': TLS handshake failed with remote 'tls://127.0.0.1:52618': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:23:06,562 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s 2024-11-23 22:23:07,570 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:23:07,577 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40835 7221s 2024-11-23 22:23:07,577 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38957/status 7221s 2024-11-23 22:23:07,578 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:23:07,591 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35229 7221s 2024-11-23 22:23:07,591 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35229 7221s 2024-11-23 22:23:07,592 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:23:07,592 - distributed.worker - INFO - dashboard at: 127.0.0.1:46433 7221s 2024-11-23 22:23:07,592 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40835 7221s 2024-11-23 22:23:07,592 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:23:07,592 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:23:07,592 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:23:07,592 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-4zvjrino 7221s 2024-11-23 22:23:07,592 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:23:07,594 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41689 7221s 2024-11-23 22:23:07,594 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41689 7221s 2024-11-23 22:23:07,594 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:23:07,594 - distributed.worker - INFO - dashboard at: 127.0.0.1:40719 7221s 2024-11-23 22:23:07,594 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40835 7221s 2024-11-23 22:23:07,595 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:23:07,595 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:23:07,595 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:23:07,595 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-fl1t7j4z 7221s 2024-11-23 22:23:07,595 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:23:07,596 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35229. Reason: failure-to-start- 7221s 2024-11-23 22:23:07,596 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:23:07,597 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41689. Reason: failure-to-start- 7221s 2024-11-23 22:23:07,597 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:23:07,598 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40835': TLS handshake failed with remote 'tls://127.0.0.1:35160': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:23:07,598 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40835': TLS handshake failed with remote 'tls://127.0.0.1:35174': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:23:07,600 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s 2024-11-23 22:23:08,606 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:23:08,613 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36699 7221s 2024-11-23 22:23:08,613 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37411/status 7221s 2024-11-23 22:23:08,613 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:23:08,629 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36625 7221s 2024-11-23 22:23:08,629 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36625 7221s 2024-11-23 22:23:08,629 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:23:08,629 - distributed.worker - INFO - dashboard at: 127.0.0.1:39795 7221s 2024-11-23 22:23:08,629 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36699 7221s 2024-11-23 22:23:08,629 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:23:08,629 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:23:08,629 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:23:08,629 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ukep5pwb 7221s 2024-11-23 22:23:08,629 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:23:08,631 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35369 7221s 2024-11-23 22:23:08,632 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35369 7221s 2024-11-23 22:23:08,632 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:23:08,632 - distributed.worker - INFO - dashboard at: 127.0.0.1:44613 7221s 2024-11-23 22:23:08,632 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36699 7221s 2024-11-23 22:23:08,632 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:23:08,632 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:23:08,632 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:23:08,632 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-77ph2z4r 7221s 2024-11-23 22:23:08,632 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:23:08,633 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36625. Reason: failure-to-start- 7221s 2024-11-23 22:23:08,634 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:23:08,634 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35369. Reason: failure-to-start- 7221s 2024-11-23 22:23:08,634 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:23:08,636 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36699': TLS handshake failed with remote 'tls://127.0.0.1:56856': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:23:08,636 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36699': TLS handshake failed with remote 'tls://127.0.0.1:56858': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:23:08,640 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s 2024-11-23 22:23:09,645 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:23:09,652 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40117 7221s 2024-11-23 22:23:09,653 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39419/status 7221s 2024-11-23 22:23:09,653 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:23:09,668 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39979 7221s 2024-11-23 22:23:09,669 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39979 7221s 2024-11-23 22:23:09,669 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:23:09,669 - distributed.worker - INFO - dashboard at: 127.0.0.1:34689 7221s 2024-11-23 22:23:09,669 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40117 7221s 2024-11-23 22:23:09,669 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:23:09,669 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:23:09,669 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:23:09,669 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-29zq39dw 7221s 2024-11-23 22:23:09,669 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:23:09,671 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41557 7221s 2024-11-23 22:23:09,671 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41557 7221s 2024-11-23 22:23:09,671 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:23:09,672 - distributed.worker - INFO - dashboard at: 127.0.0.1:39559 7221s 2024-11-23 22:23:09,672 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40117 7221s 2024-11-23 22:23:09,672 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:23:09,672 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:23:09,672 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:23:09,672 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-wcc2oszq 7221s 2024-11-23 22:23:09,672 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:23:09,673 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39979. Reason: failure-to-start- 7221s 2024-11-23 22:23:09,673 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:23:09,674 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41557. Reason: failure-to-start- 7221s 2024-11-23 22:23:09,674 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:23:09,678 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40117': TLS handshake failed with remote 'tls://127.0.0.1:57774': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:23:09,678 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40117': TLS handshake failed with remote 'tls://127.0.0.1:57790': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:23:09,680 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s 2024-11-23 22:23:10,685 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:23:10,692 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42591 7221s 2024-11-23 22:23:10,693 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35017/status 7221s 2024-11-23 22:23:10,693 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:23:10,710 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43903 7221s 2024-11-23 22:23:10,711 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43903 7221s 2024-11-23 22:23:10,711 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:23:10,711 - distributed.worker - INFO - dashboard at: 127.0.0.1:44693 7221s 2024-11-23 22:23:10,711 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42591 7221s 2024-11-23 22:23:10,711 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:23:10,711 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:23:10,711 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:23:10,711 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-suiiophl 7221s 2024-11-23 22:23:10,711 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:23:10,713 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45769 7221s 2024-11-23 22:23:10,713 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45769 7221s 2024-11-23 22:23:10,713 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:23:10,714 - distributed.worker - INFO - dashboard at: 127.0.0.1:32819 7221s 2024-11-23 22:23:10,714 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42591 7221s 2024-11-23 22:23:10,714 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:23:10,714 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:23:10,714 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:23:10,714 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-7_edn6p9 7221s 2024-11-23 22:23:10,714 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:23:10,719 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43903. Reason: failure-to-start- 7221s 2024-11-23 22:23:10,719 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:23:10,720 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45769. Reason: failure-to-start- 7221s 2024-11-23 22:23:10,720 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:23:10,721 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42591': TLS handshake failed with remote 'tls://127.0.0.1:35322': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:23:10,722 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42591': TLS handshake failed with remote 'tls://127.0.0.1:35324': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:23:10,723 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s 2024-11-23 22:23:11,729 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:23:11,736 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45581 7221s 2024-11-23 22:23:11,736 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44607/status 7221s 2024-11-23 22:23:11,736 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:23:11,753 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42979 7221s 2024-11-23 22:23:11,754 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42979 7221s 2024-11-23 22:23:11,754 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:23:11,754 - distributed.worker - INFO - dashboard at: 127.0.0.1:45905 7221s 2024-11-23 22:23:11,754 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45581 7221s 2024-11-23 22:23:11,754 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:23:11,754 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:23:11,754 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:23:11,754 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-nz7gkk08 7221s 2024-11-23 22:23:11,754 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:23:11,756 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43011 7221s 2024-11-23 22:23:11,756 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43011 7221s 2024-11-23 22:23:11,756 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:23:11,756 - distributed.worker - INFO - dashboard at: 127.0.0.1:45263 7221s 2024-11-23 22:23:11,757 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45581 7221s 2024-11-23 22:23:11,757 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:23:11,757 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:23:11,757 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:23:11,757 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-d27owv4u 7221s 2024-11-23 22:23:11,757 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:23:11,758 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42979. Reason: failure-to-start- 7221s 2024-11-23 22:23:11,758 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:23:11,759 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43011. Reason: failure-to-start- 7221s 2024-11-23 22:23:11,759 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:23:11,760 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45581': TLS handshake failed with remote 'tls://127.0.0.1:42800': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:23:11,760 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45581': TLS handshake failed with remote 'tls://127.0.0.1:42808': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:23:11,762 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s 2024-11-23 22:23:12,768 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:23:12,790 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35455 7221s 2024-11-23 22:23:12,790 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37379/status 7221s 2024-11-23 22:23:12,791 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:23:12,808 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45565 7221s 2024-11-23 22:23:12,808 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45565 7221s 2024-11-23 22:23:12,808 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:23:12,808 - distributed.worker - INFO - dashboard at: 127.0.0.1:36465 7221s 2024-11-23 22:23:12,808 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35455 7221s 2024-11-23 22:23:12,808 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:23:12,808 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:23:12,808 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:23:12,808 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-bkdrqpo6 7221s 2024-11-23 22:23:12,809 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:23:12,810 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43819 7221s 2024-11-23 22:23:12,811 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43819 7221s 2024-11-23 22:23:12,811 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:23:12,811 - distributed.worker - INFO - dashboard at: 127.0.0.1:43227 7221s 2024-11-23 22:23:12,811 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35455 7221s 2024-11-23 22:23:12,811 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:23:12,811 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:23:12,811 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:23:12,811 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-oxw315hm 7221s 2024-11-23 22:23:12,811 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:23:12,817 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45565. Reason: failure-to-start- 7221s 2024-11-23 22:23:12,817 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:23:12,817 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43819. Reason: failure-to-start- 7221s 2024-11-23 22:23:12,817 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:23:12,819 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35455': TLS handshake failed with remote 'tls://127.0.0.1:58066': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:23:12,819 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35455': TLS handshake failed with remote 'tls://127.0.0.1:58068': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:23:12,820 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s 2024-11-23 22:23:13,825 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:23:13,832 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39835 7221s 2024-11-23 22:23:13,833 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35219/status 7221s 2024-11-23 22:23:13,833 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:23:13,848 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36467 7221s 2024-11-23 22:23:13,849 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36467 7221s 2024-11-23 22:23:13,849 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:23:13,849 - distributed.worker - INFO - dashboard at: 127.0.0.1:42465 7221s 2024-11-23 22:23:13,849 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 7221s 2024-11-23 22:23:13,849 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:23:13,849 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:23:13,849 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:23:13,849 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-6z4h75fy 7221s 2024-11-23 22:23:13,849 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:23:13,851 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37293 7221s 2024-11-23 22:23:13,851 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37293 7221s 2024-11-23 22:23:13,851 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:23:13,851 - distributed.worker - INFO - dashboard at: 127.0.0.1:39173 7221s 2024-11-23 22:23:13,852 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 7221s 2024-11-23 22:23:13,852 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:23:13,852 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:23:13,852 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:23:13,852 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-z6iysv3r 7221s 2024-11-23 22:23:13,852 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:23:13,857 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36467. Reason: failure-to-start- 7221s 2024-11-23 22:23:13,857 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:23:13,857 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37293. Reason: failure-to-start- 7221s 2024-11-23 22:23:13,858 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:23:13,859 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:51618': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:23:13,859 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:51628': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:23:13,861 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Worker start timed out after 0s. 7221s __________________________________ test_nanny __________________________________ 7221s 7221s fut = , timeout = 0 7221s 7221s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 7221s async with asyncio.timeout(timeout): 7221s > return await fut 7221s 7221s /usr/lib/python3/dist-packages/distributed/utils.py:1960: 7221s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7221s /usr/lib/python3/dist-packages/distributed/nanny.py:358: in start_unsafe 7221s comm = await self.rpc.connect(saddr) 7221s /usr/lib/python3/dist-packages/distributed/core.py:1620: in connect 7221s return await self._connect(addr=addr, timeout=timeout) 7221s /usr/lib/python3/dist-packages/distributed/core.py:1564: in _connect 7221s comm = await connect( 7221s /usr/lib/python3/dist-packages/distributed/comm/core.py:342: in connect 7221s comm = await wait_for( 7221s /usr/lib/python3/dist-packages/distributed/utils.py:1960: in wait_for 7221s return await fut 7221s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:546: in connect 7221s stream = await self.client.connect( 7221s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7221s 7221s self = , host = '127.0.0.1' 7221s port = 43347, af = 7221s ssl_options = 7221s max_buffer_size = 8364507136.0, source_ip = None, source_port = None 7221s timeout = None 7221s 7221s async def connect( 7221s self, 7221s host: str, 7221s port: int, 7221s af: socket.AddressFamily = socket.AF_UNSPEC, 7221s ssl_options: Optional[Union[Dict[str, Any], ssl.SSLContext]] = None, 7221s max_buffer_size: Optional[int] = None, 7221s source_ip: Optional[str] = None, 7221s source_port: Optional[int] = None, 7221s timeout: Optional[Union[float, datetime.timedelta]] = None, 7221s ) -> IOStream: 7221s """Connect to the given host and port. 7221s 7221s Asynchronously returns an `.IOStream` (or `.SSLIOStream` if 7221s ``ssl_options`` is not None). 7221s 7221s Using the ``source_ip`` kwarg, one can specify the source 7221s IP address to use when establishing the connection. 7221s In case the user needs to resolve and 7221s use a specific interface, it has to be handled outside 7221s of Tornado as this depends very much on the platform. 7221s 7221s Raises `TimeoutError` if the input future does not complete before 7221s ``timeout``, which may be specified in any form allowed by 7221s `.IOLoop.add_timeout` (i.e. a `datetime.timedelta` or an absolute time 7221s relative to `.IOLoop.time`) 7221s 7221s Similarly, when the user requires a certain source port, it can 7221s be specified using the ``source_port`` arg. 7221s 7221s .. versionchanged:: 4.5 7221s Added the ``source_ip`` and ``source_port`` arguments. 7221s 7221s .. versionchanged:: 5.0 7221s Added the ``timeout`` argument. 7221s """ 7221s if timeout is not None: 7221s if isinstance(timeout, numbers.Real): 7221s timeout = IOLoop.current().time() + timeout 7221s elif isinstance(timeout, datetime.timedelta): 7221s timeout = IOLoop.current().time() + timeout.total_seconds() 7221s else: 7221s raise TypeError("Unsupported timeout %r" % timeout) 7221s if timeout is not None: 7221s addrinfo = await gen.with_timeout( 7221s timeout, self.resolver.resolve(host, port, af) 7221s ) 7221s else: 7221s addrinfo = await self.resolver.resolve(host, port, af) 7221s connector = _Connector( 7221s addrinfo, 7221s functools.partial( 7221s self._create_stream, 7221s max_buffer_size, 7221s source_ip=source_ip, 7221s source_port=source_port, 7221s ), 7221s ) 7221s > af, addr, stream = await connector.start(connect_timeout=timeout) 7221s E asyncio.exceptions.CancelledError 7221s 7221s /usr/lib/python3/dist-packages/tornado/tcpclient.py:279: CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s self = 7221s 7221s @final 7221s async def start(self): 7221s async with self._startup_lock: 7221s if self.status == Status.failed: 7221s assert self.__startup_exc is not None 7221s raise self.__startup_exc 7221s elif self.status != Status.init: 7221s return self 7221s timeout = getattr(self, "death_timeout", None) 7221s 7221s async def _close_on_failure(exc: Exception) -> None: 7221s await self.close(reason=f"failure-to-start-{str(type(exc))}") 7221s self.status = Status.failed 7221s self.__startup_exc = exc 7221s 7221s try: 7221s > await wait_for(self.start_unsafe(), timeout=timeout) 7221s 7221s /usr/lib/python3/dist-packages/distributed/core.py:664: 7221s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7221s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 7221s async with asyncio.timeout(timeout): 7221s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7221s 7221s self = 7221s exc_type = 7221s exc_val = CancelledError(), exc_tb = 7221s 7221s async def __aexit__( 7221s self, 7221s exc_type: Optional[Type[BaseException]], 7221s exc_val: Optional[BaseException], 7221s exc_tb: Optional[TracebackType], 7221s ) -> Optional[bool]: 7221s assert self._state in (_State.ENTERED, _State.EXPIRING) 7221s 7221s if self._timeout_handler is not None: 7221s self._timeout_handler.cancel() 7221s self._timeout_handler = None 7221s 7221s if self._state is _State.EXPIRING: 7221s self._state = _State.EXPIRED 7221s 7221s if self._task.uncancel() <= self._cancelling and exc_type is not None: 7221s # Since there are no new cancel requests, we're 7221s # handling this. 7221s if issubclass(exc_type, exceptions.CancelledError): 7221s > raise TimeoutError from exc_val 7221s E TimeoutError 7221s 7221s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s @contextlib.asynccontextmanager 7221s async def _cluster_factory(): 7221s workers = [] 7221s s = None 7221s try: 7221s for _ in range(60): 7221s try: 7221s > s, ws = await start_cluster( 7221s nthreads, 7221s scheduler, 7221s security=security, 7221s Worker=Worker, 7221s scheduler_kwargs=scheduler_kwargs, 7221s worker_kwargs=merge( 7221s {"death_timeout": min(15, int(deadline.remaining))}, 7221s worker_kwargs, 7221s ), 7221s ) 7221s 7221s /usr/lib/python3/dist-packages/distributed/utils_test.py:966: 7221s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7221s /usr/lib/python3/dist-packages/distributed/utils_test.py:789: in start_cluster 7221s await asyncio.gather(*workers) 7221s /usr/lib/python3.13/asyncio/tasks.py:737: in _wrap_awaitable 7221s return await awaitable 7221s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7221s 7221s self = 7221s 7221s @final 7221s async def start(self): 7221s async with self._startup_lock: 7221s if self.status == Status.failed: 7221s assert self.__startup_exc is not None 7221s raise self.__startup_exc 7221s elif self.status != Status.init: 7221s return self 7221s timeout = getattr(self, "death_timeout", None) 7221s 7221s async def _close_on_failure(exc: Exception) -> None: 7221s await self.close(reason=f"failure-to-start-{str(type(exc))}") 7221s self.status = Status.failed 7221s self.__startup_exc = exc 7221s 7221s try: 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s except asyncio.TimeoutError as exc: 7221s await _close_on_failure(exc) 7221s > raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s E TimeoutError: Nanny start timed out after 0s. 7221s 7221s /usr/lib/python3/dist-packages/distributed/core.py:667: TimeoutError 7221s 7221s During handling of the above exception, another exception occurred: 7221s 7221s fut = ._..test_func..async_fn at 0xe9b48dc0> 7221s timeout = 60 7221s 7221s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 7221s async with asyncio.timeout(timeout): 7221s > return await fut 7221s 7221s /usr/lib/python3/dist-packages/distributed/utils.py:1960: 7221s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7221s /usr/lib/python3/dist-packages/distributed/utils_test.py:999: in async_fn 7221s _cluster_factory() as (s, workers), 7221s /usr/lib/python3.13/contextlib.py:214: in __aenter__ 7221s return await anext(self.gen) 7221s /usr/lib/python3/dist-packages/distributed/utils_test.py:983: in _cluster_factory 7221s await asyncio.sleep(1) 7221s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7221s 7221s delay = 1, result = None 7221s 7221s async def sleep(delay, result=None): 7221s """Coroutine that completes after a given time (in seconds).""" 7221s if delay <= 0: 7221s await __sleep0() 7221s return result 7221s 7221s if math.isnan(delay): 7221s raise ValueError("Invalid delay: NaN (not a number)") 7221s 7221s loop = events.get_running_loop() 7221s future = loop.create_future() 7221s h = loop.call_later(delay, 7221s futures._set_result_unless_cancelled, 7221s future, result) 7221s try: 7221s > return await future 7221s E asyncio.exceptions.CancelledError 7221s 7221s /usr/lib/python3.13/asyncio/tasks.py:718: CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s args = (), kwds = {} 7221s 7221s @wraps(func) 7221s def inner(*args, **kwds): 7221s with self._recreate_cm(): 7221s > return func(*args, **kwds) 7221s 7221s /usr/lib/python3.13/contextlib.py:85: 7221s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7221s /usr/lib/python3.13/contextlib.py:85: in inner 7221s return func(*args, **kwds) 7221s /usr/lib/python3/dist-packages/distributed/utils_test.py:1102: in test_func 7221s return _run_and_close_tornado(async_fn_outer) 7221s /usr/lib/python3/dist-packages/distributed/utils_test.py:378: in _run_and_close_tornado 7221s return asyncio_run(inner_fn(), loop_factory=get_loop_factory()) 7221s /usr/lib/python3.13/asyncio/runners.py:194: in run 7221s return runner.run(main) 7221s /usr/lib/python3.13/asyncio/runners.py:118: in run 7221s return self._loop.run_until_complete(task) 7221s /usr/lib/python3.13/asyncio/base_events.py:720: in run_until_complete 7221s return future.result() 7221s /usr/lib/python3/dist-packages/distributed/utils_test.py:375: in inner_fn 7221s return await async_fn(*args, **kwargs) 7221s /usr/lib/python3/dist-packages/distributed/utils_test.py:1099: in async_fn_outer 7221s return await utils_wait_for(async_fn(), timeout=timeout * 2) 7221s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 7221s async with asyncio.timeout(timeout): 7221s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7221s 7221s self = 7221s exc_type = 7221s exc_val = CancelledError(), exc_tb = 7221s 7221s async def __aexit__( 7221s self, 7221s exc_type: Optional[Type[BaseException]], 7221s exc_val: Optional[BaseException], 7221s exc_tb: Optional[TracebackType], 7221s ) -> Optional[bool]: 7221s assert self._state in (_State.ENTERED, _State.EXPIRING) 7221s 7221s if self._timeout_handler is not None: 7221s self._timeout_handler.cancel() 7221s self._timeout_handler = None 7221s 7221s if self._state is _State.EXPIRING: 7221s self._state = _State.EXPIRED 7221s 7221s if self._task.uncancel() <= self._cancelling and exc_type is not None: 7221s # Since there are no new cancel requests, we're 7221s # handling this. 7221s if issubclass(exc_type, exceptions.CancelledError): 7221s > raise TimeoutError from exc_val 7221s E TimeoutError 7221s 7221s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 7221s ----------------------------- Captured stderr call ----------------------------- 7221s 2024-11-23 22:23:15,123 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:23:15,131 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40775 7221s 2024-11-23 22:23:15,132 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41589/status 7221s 2024-11-23 22:23:15,132 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:23:15,157 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:34297'. Reason: failure-to-start- 7221s 2024-11-23 22:23:15,158 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:35737'. Reason: failure-to-start- 7221s 2024-11-23 22:23:15,158 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40775': TLS handshake failed with remote 'tls://127.0.0.1:42920': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:23:15,158 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40775': TLS handshake failed with remote 'tls://127.0.0.1:42936': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:23:15,158 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 7221s stream = await stream.start_tls( 7221s ^^^^^^^^^^^^^^^^^^^^^^^ 7221s False, ssl_options=ssl_options, server_hostname=host 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 7221s self.socket.do_handshake() 7221s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 7221s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 7221s self._sslobj.do_handshake() 7221s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 7221s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7221s comm = await self.rpc.connect(saddr) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 7221s return await self._connect(addr=addr, timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 7221s comm = await connect( 7221s ^^^^^^^^^^^^^^ 7221s ...<4 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 7221s raise FatalCommClosedError( 7221s ...<2 lines>... 7221s ) from err 7221s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 7221s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 7221s RuntimeError: Nanny failed to start. 7221s 2024-11-23 22:23:16,166 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:23:16,173 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38057 7221s 2024-11-23 22:23:16,174 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33587/status 7221s 2024-11-23 22:23:16,174 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:23:16,203 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:39751'. Reason: failure-to-start- 7221s 2024-11-23 22:23:16,203 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:39799'. Reason: failure-to-start- 7221s 2024-11-23 22:23:16,204 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38057': TLS handshake failed with remote 'tls://127.0.0.1:42838': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:23:16,204 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38057': TLS handshake failed with remote 'tls://127.0.0.1:42840': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:23:16,204 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 7221s stream = await stream.start_tls( 7221s ^^^^^^^^^^^^^^^^^^^^^^^ 7221s False, ssl_options=ssl_options, server_hostname=host 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 7221s self.socket.do_handshake() 7221s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 7221s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 7221s self._sslobj.do_handshake() 7221s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 7221s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7221s comm = await self.rpc.connect(saddr) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 7221s return await self._connect(addr=addr, timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 7221s comm = await connect( 7221s ^^^^^^^^^^^^^^ 7221s ...<4 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 7221s raise FatalCommClosedError( 7221s ...<2 lines>... 7221s ) from err 7221s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 7221s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 7221s RuntimeError: Nanny failed to start. 7221s 2024-11-23 22:23:17,210 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:23:17,217 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34347 7221s 2024-11-23 22:23:17,218 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38257/status 7221s 2024-11-23 22:23:17,218 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:23:17,242 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:36469'. Reason: failure-to-start- 7221s 2024-11-23 22:23:17,242 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:36047'. Reason: failure-to-start- 7221s 2024-11-23 22:23:17,243 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34347': TLS handshake failed with remote 'tls://127.0.0.1:50426': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:23:17,243 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34347': TLS handshake failed with remote 'tls://127.0.0.1:50442': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:23:17,243 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 7221s stream = await stream.start_tls( 7221s ^^^^^^^^^^^^^^^^^^^^^^^ 7221s False, ssl_options=ssl_options, server_hostname=host 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 7221s self.socket.do_handshake() 7221s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 7221s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 7221s self._sslobj.do_handshake() 7221s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 7221s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7221s comm = await self.rpc.connect(saddr) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 7221s return await self._connect(addr=addr, timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 7221s comm = await connect( 7221s ^^^^^^^^^^^^^^ 7221s ...<4 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 7221s raise FatalCommClosedError( 7221s ...<2 lines>... 7221s ) from err 7221s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 7221s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 7221s RuntimeError: Nanny failed to start. 7221s 2024-11-23 22:23:18,249 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:23:18,257 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42271 7221s 2024-11-23 22:23:18,257 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41229/status 7221s 2024-11-23 22:23:18,258 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:23:18,282 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:44805'. Reason: failure-to-start- 7221s 2024-11-23 22:23:18,282 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:36421'. Reason: failure-to-start- 7221s 2024-11-23 22:23:18,283 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42271': TLS handshake failed with remote 'tls://127.0.0.1:59938': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:23:18,283 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42271': TLS handshake failed with remote 'tls://127.0.0.1:59952': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:23:18,283 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 7221s stream = await stream.start_tls( 7221s ^^^^^^^^^^^^^^^^^^^^^^^ 7221s False, ssl_options=ssl_options, server_hostname=host 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 7221s self.socket.do_handshake() 7221s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 7221s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 7221s self._sslobj.do_handshake() 7221s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 7221s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7221s comm = await self.rpc.connect(saddr) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 7221s return await self._connect(addr=addr, timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 7221s comm = await connect( 7221s ^^^^^^^^^^^^^^ 7221s ...<4 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 7221s raise FatalCommClosedError( 7221s ...<2 lines>... 7221s ) from err 7221s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 7221s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 7221s RuntimeError: Nanny failed to start. 7221s 2024-11-23 22:23:19,288 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:23:19,296 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44879 7221s 2024-11-23 22:23:19,296 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43833/status 7221s 2024-11-23 22:23:19,296 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:23:19,320 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:34223'. Reason: failure-to-start- 7221s 2024-11-23 22:23:19,320 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:39499'. Reason: failure-to-start- 7221s 2024-11-23 22:23:19,321 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44879': TLS handshake failed with remote 'tls://127.0.0.1:49276': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:23:19,321 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44879': TLS handshake failed with remote 'tls://127.0.0.1:49282': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:23:19,321 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 7221s stream = await stream.start_tls( 7221s ^^^^^^^^^^^^^^^^^^^^^^^ 7221s False, ssl_options=ssl_options, server_hostname=host 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 7221s self.socket.do_handshake() 7221s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 7221s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 7221s self._sslobj.do_handshake() 7221s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 7221s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7221s comm = await self.rpc.connect(saddr) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 7221s return await self._connect(addr=addr, timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 7221s comm = await connect( 7221s ^^^^^^^^^^^^^^ 7221s ...<4 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 7221s raise FatalCommClosedError( 7221s ...<2 lines>... 7221s ) from err 7221s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 7221s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 7221s RuntimeError: Nanny failed to start. 7221s 2024-11-23 22:23:20,327 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:23:20,334 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36817 7221s 2024-11-23 22:23:20,334 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39223/status 7221s 2024-11-23 22:23:20,335 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:23:20,360 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:42885'. Reason: failure-to-start- 7221s 2024-11-23 22:23:20,360 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:34419'. Reason: failure-to-start- 7221s 2024-11-23 22:23:20,361 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36817': TLS handshake failed with remote 'tls://127.0.0.1:37148': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:23:20,361 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36817': TLS handshake failed with remote 'tls://127.0.0.1:37152': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:23:20,361 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 7221s stream = await stream.start_tls( 7221s ^^^^^^^^^^^^^^^^^^^^^^^ 7221s False, ssl_options=ssl_options, server_hostname=host 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 7221s self.socket.do_handshake() 7221s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 7221s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 7221s self._sslobj.do_handshake() 7221s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 7221s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7221s comm = await self.rpc.connect(saddr) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 7221s return await self._connect(addr=addr, timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 7221s comm = await connect( 7221s ^^^^^^^^^^^^^^ 7221s ...<4 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 7221s raise FatalCommClosedError( 7221s ...<2 lines>... 7221s ) from err 7221s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 7221s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 7221s RuntimeError: Nanny failed to start. 7221s 2024-11-23 22:23:21,367 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:23:21,375 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37611 7221s 2024-11-23 22:23:21,375 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39563/status 7221s 2024-11-23 22:23:21,376 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:23:21,400 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:43729'. Reason: failure-to-start- 7221s 2024-11-23 22:23:21,401 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:44373'. Reason: failure-to-start- 7221s 2024-11-23 22:23:21,401 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37611': TLS handshake failed with remote 'tls://127.0.0.1:35272': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:23:21,401 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37611': TLS handshake failed with remote 'tls://127.0.0.1:35278': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:23:21,401 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 7221s stream = await stream.start_tls( 7221s ^^^^^^^^^^^^^^^^^^^^^^^ 7221s False, ssl_options=ssl_options, server_hostname=host 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 7221s self.socket.do_handshake() 7221s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 7221s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 7221s self._sslobj.do_handshake() 7221s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 7221s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7221s comm = await self.rpc.connect(saddr) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 7221s return await self._connect(addr=addr, timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 7221s comm = await connect( 7221s ^^^^^^^^^^^^^^ 7221s ...<4 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 7221s raise FatalCommClosedError( 7221s ...<2 lines>... 7221s ) from err 7221s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 7221s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 7221s RuntimeError: Nanny failed to start. 7221s 2024-11-23 22:23:22,407 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:23:22,414 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38345 7221s 2024-11-23 22:23:22,415 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45265/status 7221s 2024-11-23 22:23:22,415 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:23:22,441 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:33855'. Reason: failure-to-start- 7221s 2024-11-23 22:23:22,442 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:38279'. Reason: failure-to-start- 7221s 2024-11-23 22:23:22,442 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38345': TLS handshake failed with remote 'tls://127.0.0.1:43408': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:23:22,442 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38345': TLS handshake failed with remote 'tls://127.0.0.1:43422': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:23:22,442 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 7221s stream = await stream.start_tls( 7221s ^^^^^^^^^^^^^^^^^^^^^^^ 7221s False, ssl_options=ssl_options, server_hostname=host 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 7221s self.socket.do_handshake() 7221s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 7221s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 7221s self._sslobj.do_handshake() 7221s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 7221s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7221s comm = await self.rpc.connect(saddr) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 7221s return await self._connect(addr=addr, timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 7221s comm = await connect( 7221s ^^^^^^^^^^^^^^ 7221s ...<4 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 7221s raise FatalCommClosedError( 7221s ...<2 lines>... 7221s ) from err 7221s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 7221s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 7221s RuntimeError: Nanny failed to start. 7221s 2024-11-23 22:23:23,449 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:23:23,456 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43269 7221s 2024-11-23 22:23:23,457 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33347/status 7221s 2024-11-23 22:23:23,457 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:23:23,481 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:45851'. Reason: failure-to-start- 7221s 2024-11-23 22:23:23,482 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:40977'. Reason: failure-to-start- 7221s 2024-11-23 22:23:23,482 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43269': TLS handshake failed with remote 'tls://127.0.0.1:35788': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:23:23,482 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43269': TLS handshake failed with remote 'tls://127.0.0.1:35794': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:23:23,483 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 7221s stream = await stream.start_tls( 7221s ^^^^^^^^^^^^^^^^^^^^^^^ 7221s False, ssl_options=ssl_options, server_hostname=host 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 7221s self.socket.do_handshake() 7221s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 7221s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 7221s self._sslobj.do_handshake() 7221s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 7221s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7221s comm = await self.rpc.connect(saddr) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 7221s return await self._connect(addr=addr, timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 7221s comm = await connect( 7221s ^^^^^^^^^^^^^^ 7221s ...<4 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 7221s raise FatalCommClosedError( 7221s ...<2 lines>... 7221s ) from err 7221s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 7221s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 7221s RuntimeError: Nanny failed to start. 7221s 2024-11-23 22:23:24,489 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:23:24,497 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34835 7221s 2024-11-23 22:23:24,497 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46449/status 7221s 2024-11-23 22:23:24,498 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:23:24,524 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:43433'. Reason: failure-to-start- 7221s 2024-11-23 22:23:24,524 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:45639'. Reason: failure-to-start- 7221s 2024-11-23 22:23:24,525 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34835': TLS handshake failed with remote 'tls://127.0.0.1:41824': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:23:24,525 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34835': TLS handshake failed with remote 'tls://127.0.0.1:41832': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:23:24,525 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 7221s stream = await stream.start_tls( 7221s ^^^^^^^^^^^^^^^^^^^^^^^ 7221s False, ssl_options=ssl_options, server_hostname=host 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 7221s self.socket.do_handshake() 7221s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 7221s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 7221s self._sslobj.do_handshake() 7221s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 7221s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7221s comm = await self.rpc.connect(saddr) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 7221s return await self._connect(addr=addr, timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 7221s comm = await connect( 7221s ^^^^^^^^^^^^^^ 7221s ...<4 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 7221s raise FatalCommClosedError( 7221s ...<2 lines>... 7221s ) from err 7221s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 7221s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 7221s RuntimeError: Nanny failed to start. 7221s 2024-11-23 22:23:25,531 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:23:25,539 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46177 7221s 2024-11-23 22:23:25,540 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37341/status 7221s 2024-11-23 22:23:25,540 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:23:25,565 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:41089'. Reason: failure-to-start- 7221s 2024-11-23 22:23:25,565 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:37701'. Reason: failure-to-start- 7221s 2024-11-23 22:23:25,566 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46177': TLS handshake failed with remote 'tls://127.0.0.1:60492': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:23:25,566 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46177': TLS handshake failed with remote 'tls://127.0.0.1:60504': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:23:25,566 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 7221s stream = await stream.start_tls( 7221s ^^^^^^^^^^^^^^^^^^^^^^^ 7221s False, ssl_options=ssl_options, server_hostname=host 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 7221s self.socket.do_handshake() 7221s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 7221s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 7221s self._sslobj.do_handshake() 7221s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 7221s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7221s comm = await self.rpc.connect(saddr) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 7221s return await self._connect(addr=addr, timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 7221s comm = await connect( 7221s ^^^^^^^^^^^^^^ 7221s ...<4 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 7221s raise FatalCommClosedError( 7221s ...<2 lines>... 7221s ) from err 7221s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 7221s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 7221s RuntimeError: Nanny failed to start. 7221s 2024-11-23 22:23:26,572 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:23:26,579 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34945 7221s 2024-11-23 22:23:26,580 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33915/status 7221s 2024-11-23 22:23:26,580 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:23:26,606 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:42343'. Reason: failure-to-start- 7221s 2024-11-23 22:23:26,607 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:41697'. Reason: failure-to-start- 7221s 2024-11-23 22:23:26,607 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34945': TLS handshake failed with remote 'tls://127.0.0.1:34630': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:23:26,607 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34945': TLS handshake failed with remote 'tls://127.0.0.1:34638': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:23:26,607 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 7221s stream = await stream.start_tls( 7221s ^^^^^^^^^^^^^^^^^^^^^^^ 7221s False, ssl_options=ssl_options, server_hostname=host 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 7221s self.socket.do_handshake() 7221s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 7221s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 7221s self._sslobj.do_handshake() 7221s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 7221s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7221s comm = await self.rpc.connect(saddr) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 7221s return await self._connect(addr=addr, timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 7221s comm = await connect( 7221s ^^^^^^^^^^^^^^ 7221s ...<4 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 7221s raise FatalCommClosedError( 7221s ...<2 lines>... 7221s ) from err 7221s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 7221s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 7221s RuntimeError: Nanny failed to start. 7221s 2024-11-23 22:23:27,613 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:23:27,620 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39237 7221s 2024-11-23 22:23:27,621 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43305/status 7221s 2024-11-23 22:23:27,621 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:23:27,647 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:37397'. Reason: failure-to-start- 7221s 2024-11-23 22:23:27,648 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:37213'. Reason: failure-to-start- 7221s 2024-11-23 22:23:27,648 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39237': TLS handshake failed with remote 'tls://127.0.0.1:58166': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:23:27,648 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39237': TLS handshake failed with remote 'tls://127.0.0.1:58170': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:23:27,648 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 7221s stream = await stream.start_tls( 7221s ^^^^^^^^^^^^^^^^^^^^^^^ 7221s False, ssl_options=ssl_options, server_hostname=host 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 7221s self.socket.do_handshake() 7221s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 7221s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 7221s self._sslobj.do_handshake() 7221s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 7221s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7221s comm = await self.rpc.connect(saddr) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 7221s return await self._connect(addr=addr, timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 7221s comm = await connect( 7221s ^^^^^^^^^^^^^^ 7221s ...<4 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 7221s raise FatalCommClosedError( 7221s ...<2 lines>... 7221s ) from err 7221s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 7221s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 7221s RuntimeError: Nanny failed to start. 7221s 2024-11-23 22:23:28,654 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:23:28,661 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35929 7221s 2024-11-23 22:23:28,661 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37123/status 7221s 2024-11-23 22:23:28,662 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:23:28,689 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:44709'. Reason: failure-to-start- 7221s 2024-11-23 22:23:28,690 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:39681'. Reason: failure-to-start- 7221s 2024-11-23 22:23:28,690 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35929': TLS handshake failed with remote 'tls://127.0.0.1:60918': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:23:28,690 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35929': TLS handshake failed with remote 'tls://127.0.0.1:60924': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:23:28,691 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 7221s stream = await stream.start_tls( 7221s ^^^^^^^^^^^^^^^^^^^^^^^ 7221s False, ssl_options=ssl_options, server_hostname=host 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 7221s self.socket.do_handshake() 7221s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 7221s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 7221s self._sslobj.do_handshake() 7221s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 7221s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7221s comm = await self.rpc.connect(saddr) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 7221s return await self._connect(addr=addr, timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 7221s comm = await connect( 7221s ^^^^^^^^^^^^^^ 7221s ...<4 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 7221s raise FatalCommClosedError( 7221s ...<2 lines>... 7221s ) from err 7221s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 7221s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 7221s RuntimeError: Nanny failed to start. 7221s 2024-11-23 22:23:29,697 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:23:29,705 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42231 7221s 2024-11-23 22:23:29,705 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40365/status 7221s 2024-11-23 22:23:29,706 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:23:29,732 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:41575'. Reason: failure-to-start- 7221s 2024-11-23 22:23:29,732 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:35839'. Reason: failure-to-start- 7221s 2024-11-23 22:23:29,733 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42231': TLS handshake failed with remote 'tls://127.0.0.1:35514': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:23:29,733 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42231': TLS handshake failed with remote 'tls://127.0.0.1:35518': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:23:29,733 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 7221s stream = await stream.start_tls( 7221s ^^^^^^^^^^^^^^^^^^^^^^^ 7221s False, ssl_options=ssl_options, server_hostname=host 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 7221s self.socket.do_handshake() 7221s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 7221s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 7221s self._sslobj.do_handshake() 7221s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 7221s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7221s comm = await self.rpc.connect(saddr) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 7221s return await self._connect(addr=addr, timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 7221s comm = await connect( 7221s ^^^^^^^^^^^^^^ 7221s ...<4 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 7221s raise FatalCommClosedError( 7221s ...<2 lines>... 7221s ) from err 7221s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 7221s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 7221s RuntimeError: Nanny failed to start. 7221s 2024-11-23 22:23:30,739 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:23:30,746 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44349 7221s 2024-11-23 22:23:30,746 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37001/status 7221s 2024-11-23 22:23:30,746 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:23:30,774 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:36441'. Reason: failure-to-start- 7221s 2024-11-23 22:23:30,774 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:44947'. Reason: failure-to-start- 7221s 2024-11-23 22:23:30,774 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44349': TLS handshake failed with remote 'tls://127.0.0.1:41714': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:23:30,775 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44349': TLS handshake failed with remote 'tls://127.0.0.1:41726': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:23:30,775 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 7221s stream = await stream.start_tls( 7221s ^^^^^^^^^^^^^^^^^^^^^^^ 7221s False, ssl_options=ssl_options, server_hostname=host 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 7221s self.socket.do_handshake() 7221s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 7221s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 7221s self._sslobj.do_handshake() 7221s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 7221s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7221s comm = await self.rpc.connect(saddr) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 7221s return await self._connect(addr=addr, timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 7221s comm = await connect( 7221s ^^^^^^^^^^^^^^ 7221s ...<4 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 7221s raise FatalCommClosedError( 7221s ...<2 lines>... 7221s ) from err 7221s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 7221s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 7221s RuntimeError: Nanny failed to start. 7221s 2024-11-23 22:23:31,781 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:23:31,788 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33523 7221s 2024-11-23 22:23:31,789 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43451/status 7221s 2024-11-23 22:23:31,789 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:23:31,816 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:35233'. Reason: failure-to-start- 7221s 2024-11-23 22:23:31,817 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:44043'. Reason: failure-to-start- 7221s 2024-11-23 22:23:31,817 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33523': TLS handshake failed with remote 'tls://127.0.0.1:37958': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:23:31,817 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33523': TLS handshake failed with remote 'tls://127.0.0.1:37962': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:23:31,818 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 7221s stream = await stream.start_tls( 7221s ^^^^^^^^^^^^^^^^^^^^^^^ 7221s False, ssl_options=ssl_options, server_hostname=host 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 7221s self.socket.do_handshake() 7221s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 7221s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 7221s self._sslobj.do_handshake() 7221s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 7221s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7221s comm = await self.rpc.connect(saddr) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 7221s return await self._connect(addr=addr, timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 7221s comm = await connect( 7221s ^^^^^^^^^^^^^^ 7221s ...<4 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 7221s raise FatalCommClosedError( 7221s ...<2 lines>... 7221s ) from err 7221s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 7221s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 7221s RuntimeError: Nanny failed to start. 7221s 2024-11-23 22:23:32,823 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:23:32,830 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42055 7221s 2024-11-23 22:23:32,831 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46555/status 7221s 2024-11-23 22:23:32,831 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:23:32,860 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:40643'. Reason: failure-to-start- 7221s 2024-11-23 22:23:32,860 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:41491'. Reason: failure-to-start- 7221s 2024-11-23 22:23:32,861 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42055': TLS handshake failed with remote 'tls://127.0.0.1:46484': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:23:32,861 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42055': TLS handshake failed with remote 'tls://127.0.0.1:46486': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:23:32,861 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 7221s stream = await stream.start_tls( 7221s ^^^^^^^^^^^^^^^^^^^^^^^ 7221s False, ssl_options=ssl_options, server_hostname=host 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 7221s self.socket.do_handshake() 7221s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 7221s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 7221s self._sslobj.do_handshake() 7221s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 7221s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7221s comm = await self.rpc.connect(saddr) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 7221s return await self._connect(addr=addr, timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 7221s comm = await connect( 7221s ^^^^^^^^^^^^^^ 7221s ...<4 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 7221s raise FatalCommClosedError( 7221s ...<2 lines>... 7221s ) from err 7221s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 7221s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 7221s RuntimeError: Nanny failed to start. 7221s 2024-11-23 22:23:33,867 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:23:33,875 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37061 7221s 2024-11-23 22:23:33,875 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35775/status 7221s 2024-11-23 22:23:33,876 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:23:33,904 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:33503'. Reason: failure-to-start- 7221s 2024-11-23 22:23:33,904 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:43121'. Reason: failure-to-start- 7221s 2024-11-23 22:23:33,905 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37061': TLS handshake failed with remote 'tls://127.0.0.1:33186': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:23:33,905 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37061': TLS handshake failed with remote 'tls://127.0.0.1:33198': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:23:33,905 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 7221s stream = await stream.start_tls( 7221s ^^^^^^^^^^^^^^^^^^^^^^^ 7221s False, ssl_options=ssl_options, server_hostname=host 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 7221s self.socket.do_handshake() 7221s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 7221s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 7221s self._sslobj.do_handshake() 7221s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 7221s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7221s comm = await self.rpc.connect(saddr) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 7221s return await self._connect(addr=addr, timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 7221s comm = await connect( 7221s ^^^^^^^^^^^^^^ 7221s ...<4 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 7221s raise FatalCommClosedError( 7221s ...<2 lines>... 7221s ) from err 7221s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 7221s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 7221s RuntimeError: Nanny failed to start. 7221s 2024-11-23 22:23:34,911 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:23:34,918 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46075 7221s 2024-11-23 22:23:34,918 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40677/status 7221s 2024-11-23 22:23:34,918 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:23:34,946 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:34237'. Reason: failure-to-start- 7221s 2024-11-23 22:23:34,946 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:34349'. Reason: failure-to-start- 7221s 2024-11-23 22:23:34,947 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46075': TLS handshake failed with remote 'tls://127.0.0.1:41990': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:23:34,947 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46075': TLS handshake failed with remote 'tls://127.0.0.1:42000': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:23:34,947 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 7221s stream = await stream.start_tls( 7221s ^^^^^^^^^^^^^^^^^^^^^^^ 7221s False, ssl_options=ssl_options, server_hostname=host 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 7221s self.socket.do_handshake() 7221s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 7221s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 7221s self._sslobj.do_handshake() 7221s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 7221s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7221s comm = await self.rpc.connect(saddr) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 7221s return await self._connect(addr=addr, timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 7221s comm = await connect( 7221s ^^^^^^^^^^^^^^ 7221s ...<4 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 7221s raise FatalCommClosedError( 7221s ...<2 lines>... 7221s ) from err 7221s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 7221s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 7221s RuntimeError: Nanny failed to start. 7221s 2024-11-23 22:23:35,952 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:23:35,960 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43989 7221s 2024-11-23 22:23:35,960 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40011/status 7221s 2024-11-23 22:23:35,961 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:23:35,989 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:41487'. Reason: failure-to-start- 7221s 2024-11-23 22:23:35,989 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:44995'. Reason: failure-to-start- 7221s 2024-11-23 22:23:35,990 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43989': TLS handshake failed with remote 'tls://127.0.0.1:58416': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:23:35,990 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43989': TLS handshake failed with remote 'tls://127.0.0.1:58428': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:23:35,990 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 7221s stream = await stream.start_tls( 7221s ^^^^^^^^^^^^^^^^^^^^^^^ 7221s False, ssl_options=ssl_options, server_hostname=host 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 7221s self.socket.do_handshake() 7221s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 7221s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 7221s self._sslobj.do_handshake() 7221s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 7221s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7221s comm = await self.rpc.connect(saddr) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 7221s return await self._connect(addr=addr, timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 7221s comm = await connect( 7221s ^^^^^^^^^^^^^^ 7221s ...<4 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 7221s raise FatalCommClosedError( 7221s ...<2 lines>... 7221s ) from err 7221s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 7221s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 7221s RuntimeError: Nanny failed to start. 7221s 2024-11-23 22:23:36,995 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:23:37,003 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44599 7221s 2024-11-23 22:23:37,003 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35459/status 7221s 2024-11-23 22:23:37,003 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:23:37,033 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:32841'. Reason: failure-to-start- 7221s 2024-11-23 22:23:37,033 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:44523'. Reason: failure-to-start- 7221s 2024-11-23 22:23:37,034 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44599': TLS handshake failed with remote 'tls://127.0.0.1:58918': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:23:37,034 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44599': TLS handshake failed with remote 'tls://127.0.0.1:58924': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:23:37,034 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 7221s stream = await stream.start_tls( 7221s ^^^^^^^^^^^^^^^^^^^^^^^ 7221s False, ssl_options=ssl_options, server_hostname=host 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 7221s self.socket.do_handshake() 7221s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 7221s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 7221s self._sslobj.do_handshake() 7221s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 7221s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7221s comm = await self.rpc.connect(saddr) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 7221s return await self._connect(addr=addr, timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 7221s comm = await connect( 7221s ^^^^^^^^^^^^^^ 7221s ...<4 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 7221s raise FatalCommClosedError( 7221s ...<2 lines>... 7221s ) from err 7221s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 7221s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 7221s RuntimeError: Nanny failed to start. 7221s 2024-11-23 22:23:38,040 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:23:38,048 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46657 7221s 2024-11-23 22:23:38,048 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45561/status 7221s 2024-11-23 22:23:38,049 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:23:38,076 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:35935'. Reason: failure-to-start- 7221s 2024-11-23 22:23:38,076 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:45281'. Reason: failure-to-start- 7221s 2024-11-23 22:23:38,077 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46657': TLS handshake failed with remote 'tls://127.0.0.1:58336': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:23:38,077 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46657': TLS handshake failed with remote 'tls://127.0.0.1:58338': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:23:38,077 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 7221s stream = await stream.start_tls( 7221s ^^^^^^^^^^^^^^^^^^^^^^^ 7221s False, ssl_options=ssl_options, server_hostname=host 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 7221s self.socket.do_handshake() 7221s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 7221s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 7221s self._sslobj.do_handshake() 7221s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 7221s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7221s comm = await self.rpc.connect(saddr) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 7221s return await self._connect(addr=addr, timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 7221s comm = await connect( 7221s ^^^^^^^^^^^^^^ 7221s ...<4 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 7221s raise FatalCommClosedError( 7221s ...<2 lines>... 7221s ) from err 7221s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 7221s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 7221s RuntimeError: Nanny failed to start. 7221s 2024-11-23 22:23:39,083 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:23:39,091 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44723 7221s 2024-11-23 22:23:39,092 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42161/status 7221s 2024-11-23 22:23:39,092 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:23:39,120 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:34609'. Reason: failure-to-start- 7221s 2024-11-23 22:23:39,120 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:38415'. Reason: failure-to-start- 7221s 2024-11-23 22:23:39,121 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44723': TLS handshake failed with remote 'tls://127.0.0.1:58500': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:23:39,121 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44723': TLS handshake failed with remote 'tls://127.0.0.1:58516': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:23:39,121 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 7221s stream = await stream.start_tls( 7221s ^^^^^^^^^^^^^^^^^^^^^^^ 7221s False, ssl_options=ssl_options, server_hostname=host 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 7221s self.socket.do_handshake() 7221s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 7221s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 7221s self._sslobj.do_handshake() 7221s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 7221s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7221s comm = await self.rpc.connect(saddr) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 7221s return await self._connect(addr=addr, timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 7221s comm = await connect( 7221s ^^^^^^^^^^^^^^ 7221s ...<4 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 7221s raise FatalCommClosedError( 7221s ...<2 lines>... 7221s ) from err 7221s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 7221s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 7221s RuntimeError: Nanny failed to start. 7221s 2024-11-23 22:23:40,127 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:23:40,135 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40075 7221s 2024-11-23 22:23:40,135 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43455/status 7221s 2024-11-23 22:23:40,135 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:23:40,163 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:36577'. Reason: failure-to-start- 7221s 2024-11-23 22:23:40,163 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:44375'. Reason: failure-to-start- 7221s 2024-11-23 22:23:40,164 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40075': TLS handshake failed with remote 'tls://127.0.0.1:32836': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:23:40,164 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40075': TLS handshake failed with remote 'tls://127.0.0.1:32840': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:23:40,167 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 7221s stream = await stream.start_tls( 7221s ^^^^^^^^^^^^^^^^^^^^^^^ 7221s False, ssl_options=ssl_options, server_hostname=host 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 7221s self.socket.do_handshake() 7221s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 7221s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 7221s self._sslobj.do_handshake() 7221s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 7221s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7221s comm = await self.rpc.connect(saddr) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 7221s return await self._connect(addr=addr, timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 7221s comm = await connect( 7221s ^^^^^^^^^^^^^^ 7221s ...<4 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 7221s raise FatalCommClosedError( 7221s ...<2 lines>... 7221s ) from err 7221s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 7221s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 7221s RuntimeError: Nanny failed to start. 7221s 2024-11-23 22:23:41,173 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:23:41,192 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45391 7221s 2024-11-23 22:23:41,193 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44449/status 7221s 2024-11-23 22:23:41,193 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:23:41,225 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:41837'. Reason: failure-to-start- 7221s 2024-11-23 22:23:41,225 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:40423'. Reason: failure-to-start- 7221s 2024-11-23 22:23:41,229 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45391': TLS handshake failed with remote 'tls://127.0.0.1:37568': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:23:41,229 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45391': TLS handshake failed with remote 'tls://127.0.0.1:37574': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:23:41,229 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 7221s stream = await stream.start_tls( 7221s ^^^^^^^^^^^^^^^^^^^^^^^ 7221s False, ssl_options=ssl_options, server_hostname=host 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 7221s self.socket.do_handshake() 7221s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 7221s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 7221s self._sslobj.do_handshake() 7221s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 7221s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7221s comm = await self.rpc.connect(saddr) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 7221s return await self._connect(addr=addr, timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 7221s comm = await connect( 7221s ^^^^^^^^^^^^^^ 7221s ...<4 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 7221s raise FatalCommClosedError( 7221s ...<2 lines>... 7221s ) from err 7221s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 7221s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 7221s RuntimeError: Nanny failed to start. 7221s 2024-11-23 22:23:42,234 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:23:42,242 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36741 7221s 2024-11-23 22:23:42,242 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33257/status 7221s 2024-11-23 22:23:42,242 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:23:42,274 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:34899'. Reason: failure-to-start- 7221s 2024-11-23 22:23:42,274 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:45783'. Reason: failure-to-start- 7221s 2024-11-23 22:23:42,275 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36741': TLS handshake failed with remote 'tls://127.0.0.1:34108': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:23:42,275 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36741': TLS handshake failed with remote 'tls://127.0.0.1:34114': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:23:42,275 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 7221s stream = await stream.start_tls( 7221s ^^^^^^^^^^^^^^^^^^^^^^^ 7221s False, ssl_options=ssl_options, server_hostname=host 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 7221s self.socket.do_handshake() 7221s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 7221s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 7221s self._sslobj.do_handshake() 7221s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 7221s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7221s comm = await self.rpc.connect(saddr) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 7221s return await self._connect(addr=addr, timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 7221s comm = await connect( 7221s ^^^^^^^^^^^^^^ 7221s ...<4 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 7221s raise FatalCommClosedError( 7221s ...<2 lines>... 7221s ) from err 7221s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 7221s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 7221s RuntimeError: Nanny failed to start. 7221s 2024-11-23 22:23:43,281 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:23:43,289 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42893 7221s 2024-11-23 22:23:43,289 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44911/status 7221s 2024-11-23 22:23:43,290 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:23:43,659 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:33099'. Reason: failure-to-start- 7221s 2024-11-23 22:23:43,659 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:38389'. Reason: failure-to-start- 7221s 2024-11-23 22:23:43,660 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42893': TLS handshake failed with remote 'tls://127.0.0.1:36056': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:23:43,660 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42893': TLS handshake failed with remote 'tls://127.0.0.1:36064': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:23:43,660 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 7221s stream = await stream.start_tls( 7221s ^^^^^^^^^^^^^^^^^^^^^^^ 7221s False, ssl_options=ssl_options, server_hostname=host 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 7221s self.socket.do_handshake() 7221s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 7221s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 7221s self._sslobj.do_handshake() 7221s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 7221s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7221s comm = await self.rpc.connect(saddr) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 7221s return await self._connect(addr=addr, timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 7221s comm = await connect( 7221s ^^^^^^^^^^^^^^ 7221s ...<4 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 7221s raise FatalCommClosedError( 7221s ...<2 lines>... 7221s ) from err 7221s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 7221s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 7221s RuntimeError: Nanny failed to start. 7221s 2024-11-23 22:23:44,668 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:23:44,675 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40025 7221s 2024-11-23 22:23:44,675 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39529/status 7221s 2024-11-23 22:23:44,676 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:23:44,692 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:42317'. Reason: failure-to-start- 7221s 2024-11-23 22:23:44,692 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:42997'. Reason: failure-to-start- 7221s 2024-11-23 22:23:44,693 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40025': TLS handshake failed with remote 'tls://127.0.0.1:46974': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:23:44,693 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40025': TLS handshake failed with remote 'tls://127.0.0.1:46988': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:23:44,694 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7221s comm = await self.rpc.connect(saddr) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 7221s return await self._connect(addr=addr, timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 7221s comm = await connect( 7221s ^^^^^^^^^^^^^^ 7221s ...<4 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Nanny start timed out after 0s. 7221s 2024-11-23 22:23:45,699 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:23:45,707 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39637 7221s 2024-11-23 22:23:45,707 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43343/status 7221s 2024-11-23 22:23:45,709 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:23:45,730 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:44823'. Reason: failure-to-start- 7221s 2024-11-23 22:23:45,731 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:41133'. Reason: failure-to-start- 7221s 2024-11-23 22:23:45,732 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39637': TLS handshake failed with remote 'tls://127.0.0.1:52564': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:23:45,732 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39637': TLS handshake failed with remote 'tls://127.0.0.1:52578': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:23:45,732 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7221s comm = await self.rpc.connect(saddr) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 7221s return await self._connect(addr=addr, timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 7221s comm = await connect( 7221s ^^^^^^^^^^^^^^ 7221s ...<4 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Nanny start timed out after 0s. 7221s 2024-11-23 22:23:46,737 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:23:46,745 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41009 7221s 2024-11-23 22:23:46,745 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45247/status 7221s 2024-11-23 22:23:46,746 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:23:46,764 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:45259'. Reason: failure-to-start- 7221s 2024-11-23 22:23:46,765 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:33693'. Reason: failure-to-start- 7221s 2024-11-23 22:23:46,768 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41009': TLS handshake failed with remote 'tls://127.0.0.1:54988': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:23:46,768 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41009': TLS handshake failed with remote 'tls://127.0.0.1:55002': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:23:46,768 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7221s comm = await self.rpc.connect(saddr) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 7221s return await self._connect(addr=addr, timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 7221s comm = await connect( 7221s ^^^^^^^^^^^^^^ 7221s ...<4 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Nanny start timed out after 0s. 7221s 2024-11-23 22:23:47,775 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:23:47,782 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43711 7221s 2024-11-23 22:23:47,782 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36957/status 7221s 2024-11-23 22:23:47,782 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:23:47,800 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:40505'. Reason: failure-to-start- 7221s 2024-11-23 22:23:47,801 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:43075'. Reason: failure-to-start- 7221s 2024-11-23 22:23:47,804 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43711': TLS handshake failed with remote 'tls://127.0.0.1:39692': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:23:47,804 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43711': TLS handshake failed with remote 'tls://127.0.0.1:39706': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:23:47,804 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7221s comm = await self.rpc.connect(saddr) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 7221s return await self._connect(addr=addr, timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 7221s comm = await connect( 7221s ^^^^^^^^^^^^^^ 7221s ...<4 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Nanny start timed out after 0s. 7221s 2024-11-23 22:23:48,810 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:23:48,817 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38709 7221s 2024-11-23 22:23:48,818 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36065/status 7221s 2024-11-23 22:23:48,818 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:23:48,831 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:42983'. Reason: failure-to-start- 7221s 2024-11-23 22:23:48,831 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:39609'. Reason: failure-to-start- 7221s 2024-11-23 22:23:48,832 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38709': TLS handshake failed with remote 'tls://127.0.0.1:59376': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:23:48,833 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38709': TLS handshake failed with remote 'tls://127.0.0.1:59384': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:23:48,833 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7221s comm = await self.rpc.connect(saddr) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 7221s return await self._connect(addr=addr, timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 7221s comm = await connect( 7221s ^^^^^^^^^^^^^^ 7221s ...<4 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Nanny start timed out after 0s. 7221s 2024-11-23 22:23:49,840 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:23:49,847 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41095 7221s 2024-11-23 22:23:49,847 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40849/status 7221s 2024-11-23 22:23:49,847 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:23:49,864 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:33309'. Reason: failure-to-start- 7221s 2024-11-23 22:23:49,864 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:34943'. Reason: failure-to-start- 7221s 2024-11-23 22:23:49,865 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41095': TLS handshake failed with remote 'tls://127.0.0.1:33556': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:23:49,865 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41095': TLS handshake failed with remote 'tls://127.0.0.1:33570': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:23:49,865 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7221s comm = await self.rpc.connect(saddr) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 7221s return await self._connect(addr=addr, timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 7221s comm = await connect( 7221s ^^^^^^^^^^^^^^ 7221s ...<4 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Nanny start timed out after 0s. 7221s 2024-11-23 22:23:50,871 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:23:50,878 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35745 7221s 2024-11-23 22:23:50,879 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46203/status 7221s 2024-11-23 22:23:50,879 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:23:50,898 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:37697'. Reason: failure-to-start- 7221s 2024-11-23 22:23:50,898 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:43147'. Reason: failure-to-start- 7221s 2024-11-23 22:23:50,899 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:43840': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:23:50,899 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:43848': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:23:50,899 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7221s comm = await self.rpc.connect(saddr) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 7221s return await self._connect(addr=addr, timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 7221s comm = await connect( 7221s ^^^^^^^^^^^^^^ 7221s ...<4 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Nanny start timed out after 0s. 7221s 2024-11-23 22:23:51,905 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:23:51,912 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41953 7221s 2024-11-23 22:23:51,912 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35605/status 7221s 2024-11-23 22:23:51,913 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:23:51,934 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:35799'. Reason: failure-to-start- 7221s 2024-11-23 22:23:51,934 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:40841'. Reason: failure-to-start- 7221s 2024-11-23 22:23:51,935 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41953': TLS handshake failed with remote 'tls://127.0.0.1:53816': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:23:51,935 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41953': TLS handshake failed with remote 'tls://127.0.0.1:53822': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:23:51,936 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7221s comm = await self.rpc.connect(saddr) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 7221s return await self._connect(addr=addr, timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 7221s comm = await connect( 7221s ^^^^^^^^^^^^^^ 7221s ...<4 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Nanny start timed out after 0s. 7221s 2024-11-23 22:23:52,942 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:23:52,949 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40937 7221s 2024-11-23 22:23:52,950 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36599/status 7221s 2024-11-23 22:23:52,950 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:23:52,967 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:37713'. Reason: failure-to-start- 7221s 2024-11-23 22:23:52,967 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:44199'. Reason: failure-to-start- 7221s 2024-11-23 22:23:52,970 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40937': TLS handshake failed with remote 'tls://127.0.0.1:53108': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:23:52,970 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40937': TLS handshake failed with remote 'tls://127.0.0.1:53112': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:23:52,971 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7221s comm = await self.rpc.connect(saddr) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 7221s return await self._connect(addr=addr, timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 7221s comm = await connect( 7221s ^^^^^^^^^^^^^^ 7221s ...<4 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Nanny start timed out after 0s. 7221s 2024-11-23 22:23:53,976 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:23:53,986 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45899 7221s 2024-11-23 22:23:53,986 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33413/status 7221s 2024-11-23 22:23:53,987 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:23:54,001 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:32967'. Reason: failure-to-start- 7221s 2024-11-23 22:23:54,001 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:46335'. Reason: failure-to-start- 7221s 2024-11-23 22:23:54,004 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45899': TLS handshake failed with remote 'tls://127.0.0.1:48756': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:23:54,004 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45899': TLS handshake failed with remote 'tls://127.0.0.1:48772': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:23:54,004 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7221s comm = await self.rpc.connect(saddr) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 7221s return await self._connect(addr=addr, timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 7221s comm = await connect( 7221s ^^^^^^^^^^^^^^ 7221s ...<4 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Nanny start timed out after 0s. 7221s 2024-11-23 22:23:55,010 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:23:55,017 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43035 7221s 2024-11-23 22:23:55,017 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41731/status 7221s 2024-11-23 22:23:55,017 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:23:55,033 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:38413'. Reason: failure-to-start- 7221s 2024-11-23 22:23:55,034 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:34783'. Reason: failure-to-start- 7221s 2024-11-23 22:23:55,035 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43035': TLS handshake failed with remote 'tls://127.0.0.1:50252': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:23:55,035 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43035': TLS handshake failed with remote 'tls://127.0.0.1:50266': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:23:55,035 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7221s comm = await self.rpc.connect(saddr) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 7221s return await self._connect(addr=addr, timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 7221s comm = await connect( 7221s ^^^^^^^^^^^^^^ 7221s ...<4 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Nanny start timed out after 0s. 7221s 2024-11-23 22:23:56,040 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:23:56,049 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43405 7221s 2024-11-23 22:23:56,049 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33155/status 7221s 2024-11-23 22:23:56,050 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:23:56,069 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:39915'. Reason: failure-to-start- 7221s 2024-11-23 22:23:56,069 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:40485'. Reason: failure-to-start- 7221s 2024-11-23 22:23:56,070 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43405': TLS handshake failed with remote 'tls://127.0.0.1:53176': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:23:56,070 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43405': TLS handshake failed with remote 'tls://127.0.0.1:53180': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:23:56,070 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7221s comm = await self.rpc.connect(saddr) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 7221s return await self._connect(addr=addr, timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 7221s comm = await connect( 7221s ^^^^^^^^^^^^^^ 7221s ...<4 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Nanny start timed out after 0s. 7221s 2024-11-23 22:23:57,076 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:23:57,083 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36863 7221s 2024-11-23 22:23:57,084 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34545/status 7221s 2024-11-23 22:23:57,084 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:23:57,103 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:39451'. Reason: failure-to-start- 7221s 2024-11-23 22:23:57,103 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:36447'. Reason: failure-to-start- 7221s 2024-11-23 22:23:57,106 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36863': TLS handshake failed with remote 'tls://127.0.0.1:49918': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:23:57,106 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36863': TLS handshake failed with remote 'tls://127.0.0.1:49920': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:23:57,106 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7221s comm = await self.rpc.connect(saddr) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 7221s return await self._connect(addr=addr, timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 7221s comm = await connect( 7221s ^^^^^^^^^^^^^^ 7221s ...<4 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Nanny start timed out after 0s. 7221s 2024-11-23 22:23:58,114 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:23:58,121 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41297 7221s 2024-11-23 22:23:58,121 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43249/status 7221s 2024-11-23 22:23:58,122 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:23:58,141 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:39587'. Reason: failure-to-start- 7221s 2024-11-23 22:23:58,141 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:43547'. Reason: failure-to-start- 7221s 2024-11-23 22:23:58,142 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41297': TLS handshake failed with remote 'tls://127.0.0.1:44472': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:23:58,142 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41297': TLS handshake failed with remote 'tls://127.0.0.1:44476': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:23:58,145 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7221s comm = await self.rpc.connect(saddr) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 7221s return await self._connect(addr=addr, timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 7221s comm = await connect( 7221s ^^^^^^^^^^^^^^ 7221s ...<4 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Nanny start timed out after 0s. 7221s 2024-11-23 22:23:59,150 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:23:59,157 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41299 7221s 2024-11-23 22:23:59,157 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46729/status 7221s 2024-11-23 22:23:59,158 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:23:59,173 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:44277'. Reason: failure-to-start- 7221s 2024-11-23 22:23:59,173 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:35953'. Reason: failure-to-start- 7221s 2024-11-23 22:23:59,174 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41299': TLS handshake failed with remote 'tls://127.0.0.1:51838': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:23:59,174 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41299': TLS handshake failed with remote 'tls://127.0.0.1:51846': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:23:59,175 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7221s comm = await self.rpc.connect(saddr) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 7221s return await self._connect(addr=addr, timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 7221s comm = await connect( 7221s ^^^^^^^^^^^^^^ 7221s ...<4 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Nanny start timed out after 0s. 7221s 2024-11-23 22:24:00,180 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:24:00,187 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36533 7221s 2024-11-23 22:24:00,187 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36413/status 7221s 2024-11-23 22:24:00,188 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:24:00,207 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:45827'. Reason: failure-to-start- 7221s 2024-11-23 22:24:00,208 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:39827'. Reason: failure-to-start- 7221s 2024-11-23 22:24:00,209 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36533': TLS handshake failed with remote 'tls://127.0.0.1:38478': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:24:00,209 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36533': TLS handshake failed with remote 'tls://127.0.0.1:38494': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:24:00,211 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7221s comm = await self.rpc.connect(saddr) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 7221s return await self._connect(addr=addr, timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 7221s comm = await connect( 7221s ^^^^^^^^^^^^^^ 7221s ...<4 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Nanny start timed out after 0s. 7221s 2024-11-23 22:24:01,217 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:24:01,225 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38849 7221s 2024-11-23 22:24:01,225 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36165/status 7221s 2024-11-23 22:24:01,225 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:24:01,244 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:46105'. Reason: failure-to-start- 7221s 2024-11-23 22:24:01,244 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:41265'. Reason: failure-to-start- 7221s 2024-11-23 22:24:01,248 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38849': TLS handshake failed with remote 'tls://127.0.0.1:47918': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:24:01,248 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38849': TLS handshake failed with remote 'tls://127.0.0.1:47932': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:24:01,248 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7221s comm = await self.rpc.connect(saddr) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 7221s return await self._connect(addr=addr, timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 7221s comm = await connect( 7221s ^^^^^^^^^^^^^^ 7221s ...<4 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Nanny start timed out after 0s. 7221s 2024-11-23 22:24:02,255 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:24:02,262 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46053 7221s 2024-11-23 22:24:02,262 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44029/status 7221s 2024-11-23 22:24:02,263 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:24:02,280 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:35851'. Reason: failure-to-start- 7221s 2024-11-23 22:24:02,281 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:45801'. Reason: failure-to-start- 7221s 2024-11-23 22:24:02,282 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46053': TLS handshake failed with remote 'tls://127.0.0.1:60312': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:24:02,282 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46053': TLS handshake failed with remote 'tls://127.0.0.1:60322': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:24:02,282 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7221s comm = await self.rpc.connect(saddr) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 7221s return await self._connect(addr=addr, timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 7221s comm = await connect( 7221s ^^^^^^^^^^^^^^ 7221s ...<4 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Nanny start timed out after 0s. 7221s 2024-11-23 22:24:03,289 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:24:03,296 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44095 7221s 2024-11-23 22:24:03,296 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42023/status 7221s 2024-11-23 22:24:03,298 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:24:03,317 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:42709'. Reason: failure-to-start- 7221s 2024-11-23 22:24:03,318 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:36591'. Reason: failure-to-start- 7221s 2024-11-23 22:24:03,319 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44095': TLS handshake failed with remote 'tls://127.0.0.1:54278': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:24:03,319 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44095': TLS handshake failed with remote 'tls://127.0.0.1:54292': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:24:03,319 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7221s comm = await self.rpc.connect(saddr) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 7221s return await self._connect(addr=addr, timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 7221s comm = await connect( 7221s ^^^^^^^^^^^^^^ 7221s ...<4 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Nanny start timed out after 0s. 7221s 2024-11-23 22:24:04,324 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:24:04,331 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38977 7221s 2024-11-23 22:24:04,331 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34073/status 7221s 2024-11-23 22:24:04,332 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:24:04,351 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:35903'. Reason: failure-to-start- 7221s 2024-11-23 22:24:04,351 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:46279'. Reason: failure-to-start- 7221s 2024-11-23 22:24:04,352 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38977': TLS handshake failed with remote 'tls://127.0.0.1:60170': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:24:04,352 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38977': TLS handshake failed with remote 'tls://127.0.0.1:60178': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:24:04,355 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7221s comm = await self.rpc.connect(saddr) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 7221s return await self._connect(addr=addr, timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 7221s comm = await connect( 7221s ^^^^^^^^^^^^^^ 7221s ...<4 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Nanny start timed out after 0s. 7221s 2024-11-23 22:24:05,370 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:24:05,378 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34293 7221s 2024-11-23 22:24:05,378 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45993/status 7221s 2024-11-23 22:24:05,379 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:24:05,399 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:38243'. Reason: failure-to-start- 7221s 2024-11-23 22:24:05,400 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:40611'. Reason: failure-to-start- 7221s 2024-11-23 22:24:05,401 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34293': TLS handshake failed with remote 'tls://127.0.0.1:60772': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:24:05,401 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34293': TLS handshake failed with remote 'tls://127.0.0.1:60776': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:24:05,401 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7221s comm = await self.rpc.connect(saddr) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 7221s return await self._connect(addr=addr, timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 7221s comm = await connect( 7221s ^^^^^^^^^^^^^^ 7221s ...<4 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Nanny start timed out after 0s. 7221s 2024-11-23 22:24:06,407 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:24:06,415 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42483 7221s 2024-11-23 22:24:06,415 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35701/status 7221s 2024-11-23 22:24:06,416 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:24:06,438 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:33531'. Reason: failure-to-start- 7221s 2024-11-23 22:24:06,438 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:33371'. Reason: failure-to-start- 7221s 2024-11-23 22:24:06,439 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42483': TLS handshake failed with remote 'tls://127.0.0.1:46062': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:24:06,439 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42483': TLS handshake failed with remote 'tls://127.0.0.1:46076': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:24:06,439 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7221s comm = await self.rpc.connect(saddr) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 7221s return await self._connect(addr=addr, timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 7221s comm = await connect( 7221s ^^^^^^^^^^^^^^ 7221s ...<4 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Nanny start timed out after 0s. 7221s 2024-11-23 22:24:07,446 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:24:07,454 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38845 7221s 2024-11-23 22:24:07,454 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39383/status 7221s 2024-11-23 22:24:07,454 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:24:07,476 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:46671'. Reason: failure-to-start- 7221s 2024-11-23 22:24:07,477 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:39769'. Reason: failure-to-start- 7221s 2024-11-23 22:24:07,478 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38845': TLS handshake failed with remote 'tls://127.0.0.1:60882': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:24:07,478 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38845': TLS handshake failed with remote 'tls://127.0.0.1:60888': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:24:07,478 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7221s comm = await self.rpc.connect(saddr) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 7221s return await self._connect(addr=addr, timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 7221s comm = await connect( 7221s ^^^^^^^^^^^^^^ 7221s ...<4 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Nanny start timed out after 0s. 7221s 2024-11-23 22:24:08,484 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:24:08,491 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43485 7221s 2024-11-23 22:24:08,491 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40623/status 7221s 2024-11-23 22:24:08,492 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:24:08,512 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:34965'. Reason: failure-to-start- 7221s 2024-11-23 22:24:08,513 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:45835'. Reason: failure-to-start- 7221s 2024-11-23 22:24:08,516 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43485': TLS handshake failed with remote 'tls://127.0.0.1:39902': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:24:08,516 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43485': TLS handshake failed with remote 'tls://127.0.0.1:39910': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:24:08,516 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7221s comm = await self.rpc.connect(saddr) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 7221s return await self._connect(addr=addr, timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 7221s comm = await connect( 7221s ^^^^^^^^^^^^^^ 7221s ...<4 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Nanny start timed out after 0s. 7221s 2024-11-23 22:24:09,522 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:24:09,529 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38903 7221s 2024-11-23 22:24:09,529 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38117/status 7221s 2024-11-23 22:24:09,530 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:24:09,548 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:42449'. Reason: failure-to-start- 7221s 2024-11-23 22:24:09,549 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:36867'. Reason: failure-to-start- 7221s 2024-11-23 22:24:09,550 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38903': TLS handshake failed with remote 'tls://127.0.0.1:54522': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:24:09,550 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38903': TLS handshake failed with remote 'tls://127.0.0.1:54530': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:24:09,550 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7221s comm = await self.rpc.connect(saddr) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 7221s return await self._connect(addr=addr, timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 7221s comm = await connect( 7221s ^^^^^^^^^^^^^^ 7221s ...<4 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Nanny start timed out after 0s. 7221s 2024-11-23 22:24:10,557 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:24:10,564 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38825 7221s 2024-11-23 22:24:10,564 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35383/status 7221s 2024-11-23 22:24:10,567 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:24:10,584 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:46717'. Reason: failure-to-start- 7221s 2024-11-23 22:24:10,585 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:39385'. Reason: failure-to-start- 7221s 2024-11-23 22:24:10,588 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38825': TLS handshake failed with remote 'tls://127.0.0.1:53482': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:24:10,588 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38825': TLS handshake failed with remote 'tls://127.0.0.1:53484': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:24:10,589 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7221s comm = await self.rpc.connect(saddr) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 7221s return await self._connect(addr=addr, timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 7221s comm = await connect( 7221s ^^^^^^^^^^^^^^ 7221s ...<4 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Nanny start timed out after 0s. 7221s 2024-11-23 22:24:11,594 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:24:11,601 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41561 7221s 2024-11-23 22:24:11,602 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43199/status 7221s 2024-11-23 22:24:11,602 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:24:11,620 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:35483'. Reason: failure-to-start- 7221s 2024-11-23 22:24:11,621 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:42527'. Reason: failure-to-start- 7221s 2024-11-23 22:24:11,621 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41561': TLS handshake failed with remote 'tls://127.0.0.1:48736': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:24:11,622 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41561': TLS handshake failed with remote 'tls://127.0.0.1:48748': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:24:11,622 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7221s comm = await self.rpc.connect(saddr) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 7221s return await self._connect(addr=addr, timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 7221s comm = await connect( 7221s ^^^^^^^^^^^^^^ 7221s ...<4 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Nanny start timed out after 0s. 7221s 2024-11-23 22:24:12,627 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:24:12,634 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38167 7221s 2024-11-23 22:24:12,634 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35379/status 7221s 2024-11-23 22:24:12,637 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:24:12,659 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:36069'. Reason: failure-to-start- 7221s 2024-11-23 22:24:12,659 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:37209'. Reason: failure-to-start- 7221s 2024-11-23 22:24:12,663 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38167': TLS handshake failed with remote 'tls://127.0.0.1:45380': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:24:12,663 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38167': TLS handshake failed with remote 'tls://127.0.0.1:45388': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:24:12,663 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7221s comm = await self.rpc.connect(saddr) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 7221s return await self._connect(addr=addr, timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 7221s comm = await connect( 7221s ^^^^^^^^^^^^^^ 7221s ...<4 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Nanny start timed out after 0s. 7221s 2024-11-23 22:24:13,669 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:24:13,677 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45771 7221s 2024-11-23 22:24:13,677 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45691/status 7221s 2024-11-23 22:24:13,677 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:24:13,697 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:42159'. Reason: failure-to-start- 7221s 2024-11-23 22:24:13,697 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:44869'. Reason: failure-to-start- 7221s 2024-11-23 22:24:13,701 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45771': TLS handshake failed with remote 'tls://127.0.0.1:52942': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:24:13,701 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45771': TLS handshake failed with remote 'tls://127.0.0.1:52944': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:24:13,703 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7221s comm = await self.rpc.connect(saddr) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 7221s return await self._connect(addr=addr, timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 7221s comm = await connect( 7221s ^^^^^^^^^^^^^^ 7221s ...<4 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Nanny start timed out after 0s. 7221s 2024-11-23 22:24:14,708 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:24:14,715 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43347 7221s 2024-11-23 22:24:14,716 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40151/status 7221s 2024-11-23 22:24:14,716 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:24:14,742 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:33581'. Reason: failure-to-start- 7221s 2024-11-23 22:24:14,742 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:45713'. Reason: failure-to-start- 7221s 2024-11-23 22:24:14,743 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43347': TLS handshake failed with remote 'tls://127.0.0.1:33992': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:24:14,743 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43347': TLS handshake failed with remote 'tls://127.0.0.1:34008': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7221s 2024-11-23 22:24:14,744 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7221s comm = await self.rpc.connect(saddr) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 7221s return await self._connect(addr=addr, timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 7221s comm = await connect( 7221s ^^^^^^^^^^^^^^ 7221s ...<4 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7221s af, addr, stream = await connector.start(connect_timeout=timeout) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s asyncio.exceptions.CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7221s async with asyncio.timeout(timeout): 7221s ~~~~~~~~~~~~~~~^^^^^^^^^ 7221s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7221s raise TimeoutError from exc_val 7221s TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7221s s, ws = await start_cluster( 7221s ^^^^^^^^^^^^^^^^^^^^ 7221s ...<9 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7221s await asyncio.gather(*workers) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7221s return await awaitable 7221s ^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7221s raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s TimeoutError: Nanny start timed out after 0s. 7221s ________________________________ test_rebalance ________________________________ 7221s 7221s fut = , timeout = 0 7221s 7221s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 7221s async with asyncio.timeout(timeout): 7221s > return await fut 7221s 7221s /usr/lib/python3/dist-packages/distributed/utils.py:1960: 7221s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7221s /usr/lib/python3/dist-packages/distributed/worker.py:1480: in start_unsafe 7221s await self._register_with_scheduler() 7221s /usr/lib/python3/dist-packages/distributed/worker.py:1179: in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s /usr/lib/python3/dist-packages/distributed/comm/core.py:342: in connect 7221s comm = await wait_for( 7221s /usr/lib/python3/dist-packages/distributed/utils.py:1960: in wait_for 7221s return await fut 7221s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:546: in connect 7221s stream = await self.client.connect( 7221s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7221s 7221s self = , host = '127.0.0.1' 7221s port = 45945, af = 7221s ssl_options = 7221s max_buffer_size = 8364507136.0, source_ip = None, source_port = None 7221s timeout = None 7221s 7221s async def connect( 7221s self, 7221s host: str, 7221s port: int, 7221s af: socket.AddressFamily = socket.AF_UNSPEC, 7221s ssl_options: Optional[Union[Dict[str, Any], ssl.SSLContext]] = None, 7221s max_buffer_size: Optional[int] = None, 7221s source_ip: Optional[str] = None, 7221s source_port: Optional[int] = None, 7221s timeout: Optional[Union[float, datetime.timedelta]] = None, 7221s ) -> IOStream: 7221s """Connect to the given host and port. 7221s 7221s Asynchronously returns an `.IOStream` (or `.SSLIOStream` if 7221s ``ssl_options`` is not None). 7221s 7221s Using the ``source_ip`` kwarg, one can specify the source 7221s IP address to use when establishing the connection. 7221s In case the user needs to resolve and 7221s use a specific interface, it has to be handled outside 7221s of Tornado as this depends very much on the platform. 7221s 7221s Raises `TimeoutError` if the input future does not complete before 7221s ``timeout``, which may be specified in any form allowed by 7221s `.IOLoop.add_timeout` (i.e. a `datetime.timedelta` or an absolute time 7221s relative to `.IOLoop.time`) 7221s 7221s Similarly, when the user requires a certain source port, it can 7221s be specified using the ``source_port`` arg. 7221s 7221s .. versionchanged:: 4.5 7221s Added the ``source_ip`` and ``source_port`` arguments. 7221s 7221s .. versionchanged:: 5.0 7221s Added the ``timeout`` argument. 7221s """ 7221s if timeout is not None: 7221s if isinstance(timeout, numbers.Real): 7221s timeout = IOLoop.current().time() + timeout 7221s elif isinstance(timeout, datetime.timedelta): 7221s timeout = IOLoop.current().time() + timeout.total_seconds() 7221s else: 7221s raise TypeError("Unsupported timeout %r" % timeout) 7221s if timeout is not None: 7221s addrinfo = await gen.with_timeout( 7221s timeout, self.resolver.resolve(host, port, af) 7221s ) 7221s else: 7221s addrinfo = await self.resolver.resolve(host, port, af) 7221s connector = _Connector( 7221s addrinfo, 7221s functools.partial( 7221s self._create_stream, 7221s max_buffer_size, 7221s source_ip=source_ip, 7221s source_port=source_port, 7221s ), 7221s ) 7221s > af, addr, stream = await connector.start(connect_timeout=timeout) 7221s E asyncio.exceptions.CancelledError 7221s 7221s /usr/lib/python3/dist-packages/tornado/tcpclient.py:279: CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s self = 7221s 7221s @final 7221s async def start(self): 7221s async with self._startup_lock: 7221s if self.status == Status.failed: 7221s assert self.__startup_exc is not None 7221s raise self.__startup_exc 7221s elif self.status != Status.init: 7221s return self 7221s timeout = getattr(self, "death_timeout", None) 7221s 7221s async def _close_on_failure(exc: Exception) -> None: 7221s await self.close(reason=f"failure-to-start-{str(type(exc))}") 7221s self.status = Status.failed 7221s self.__startup_exc = exc 7221s 7221s try: 7221s > await wait_for(self.start_unsafe(), timeout=timeout) 7221s 7221s /usr/lib/python3/dist-packages/distributed/core.py:664: 7221s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7221s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 7221s async with asyncio.timeout(timeout): 7221s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7221s 7221s self = 7221s exc_type = 7221s exc_val = CancelledError(), exc_tb = 7221s 7221s async def __aexit__( 7221s self, 7221s exc_type: Optional[Type[BaseException]], 7221s exc_val: Optional[BaseException], 7221s exc_tb: Optional[TracebackType], 7221s ) -> Optional[bool]: 7221s assert self._state in (_State.ENTERED, _State.EXPIRING) 7221s 7221s if self._timeout_handler is not None: 7221s self._timeout_handler.cancel() 7221s self._timeout_handler = None 7221s 7221s if self._state is _State.EXPIRING: 7221s self._state = _State.EXPIRED 7221s 7221s if self._task.uncancel() <= self._cancelling and exc_type is not None: 7221s # Since there are no new cancel requests, we're 7221s # handling this. 7221s if issubclass(exc_type, exceptions.CancelledError): 7221s > raise TimeoutError from exc_val 7221s E TimeoutError 7221s 7221s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s @contextlib.asynccontextmanager 7221s async def _cluster_factory(): 7221s workers = [] 7221s s = None 7221s try: 7221s for _ in range(60): 7221s try: 7221s > s, ws = await start_cluster( 7221s nthreads, 7221s scheduler, 7221s security=security, 7221s Worker=Worker, 7221s scheduler_kwargs=scheduler_kwargs, 7221s worker_kwargs=merge( 7221s {"death_timeout": min(15, int(deadline.remaining))}, 7221s worker_kwargs, 7221s ), 7221s ) 7221s 7221s /usr/lib/python3/dist-packages/distributed/utils_test.py:966: 7221s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7221s /usr/lib/python3/dist-packages/distributed/utils_test.py:789: in start_cluster 7221s await asyncio.gather(*workers) 7221s /usr/lib/python3.13/asyncio/tasks.py:737: in _wrap_awaitable 7221s return await awaitable 7221s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7221s 7221s self = 7221s 7221s @final 7221s async def start(self): 7221s async with self._startup_lock: 7221s if self.status == Status.failed: 7221s assert self.__startup_exc is not None 7221s raise self.__startup_exc 7221s elif self.status != Status.init: 7221s return self 7221s timeout = getattr(self, "death_timeout", None) 7221s 7221s async def _close_on_failure(exc: Exception) -> None: 7221s await self.close(reason=f"failure-to-start-{str(type(exc))}") 7221s self.status = Status.failed 7221s self.__startup_exc = exc 7221s 7221s try: 7221s await wait_for(self.start_unsafe(), timeout=timeout) 7221s except asyncio.TimeoutError as exc: 7221s await _close_on_failure(exc) 7221s > raise asyncio.TimeoutError( 7221s f"{type(self).__name__} start timed out after {timeout}s." 7221s ) from exc 7221s E TimeoutError: Worker start timed out after 0s. 7221s 7221s /usr/lib/python3/dist-packages/distributed/core.py:667: TimeoutError 7221s 7221s During handling of the above exception, another exception occurred: 7221s 7221s fut = ._..test_func..async_fn at 0xe9b48b08> 7221s timeout = 60 7221s 7221s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 7221s async with asyncio.timeout(timeout): 7221s > return await fut 7221s 7221s /usr/lib/python3/dist-packages/distributed/utils.py:1960: 7221s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7221s /usr/lib/python3/dist-packages/distributed/utils_test.py:999: in async_fn 7221s _cluster_factory() as (s, workers), 7221s /usr/lib/python3.13/contextlib.py:214: in __aenter__ 7221s return await anext(self.gen) 7221s /usr/lib/python3/dist-packages/distributed/utils_test.py:983: in _cluster_factory 7221s await asyncio.sleep(1) 7221s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7221s 7221s delay = 1, result = None 7221s 7221s async def sleep(delay, result=None): 7221s """Coroutine that completes after a given time (in seconds).""" 7221s if delay <= 0: 7221s await __sleep0() 7221s return result 7221s 7221s if math.isnan(delay): 7221s raise ValueError("Invalid delay: NaN (not a number)") 7221s 7221s loop = events.get_running_loop() 7221s future = loop.create_future() 7221s h = loop.call_later(delay, 7221s futures._set_result_unless_cancelled, 7221s future, result) 7221s try: 7221s > return await future 7221s E asyncio.exceptions.CancelledError 7221s 7221s /usr/lib/python3.13/asyncio/tasks.py:718: CancelledError 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s args = (), kwds = {} 7221s 7221s @wraps(func) 7221s def inner(*args, **kwds): 7221s with self._recreate_cm(): 7221s > return func(*args, **kwds) 7221s 7221s /usr/lib/python3.13/contextlib.py:85: 7221s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7221s /usr/lib/python3.13/contextlib.py:85: in inner 7221s return func(*args, **kwds) 7221s /usr/lib/python3/dist-packages/distributed/utils_test.py:1102: in test_func 7221s return _run_and_close_tornado(async_fn_outer) 7221s /usr/lib/python3/dist-packages/distributed/utils_test.py:378: in _run_and_close_tornado 7221s return asyncio_run(inner_fn(), loop_factory=get_loop_factory()) 7221s /usr/lib/python3.13/asyncio/runners.py:194: in run 7221s return runner.run(main) 7221s /usr/lib/python3.13/asyncio/runners.py:118: in run 7221s return self._loop.run_until_complete(task) 7221s /usr/lib/python3.13/asyncio/base_events.py:720: in run_until_complete 7221s return future.result() 7221s /usr/lib/python3/dist-packages/distributed/utils_test.py:375: in inner_fn 7221s return await async_fn(*args, **kwargs) 7221s /usr/lib/python3/dist-packages/distributed/utils_test.py:1099: in async_fn_outer 7221s return await utils_wait_for(async_fn(), timeout=timeout * 2) 7221s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 7221s async with asyncio.timeout(timeout): 7221s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7221s 7221s self = 7221s exc_type = 7221s exc_val = CancelledError(), exc_tb = 7221s 7221s async def __aexit__( 7221s self, 7221s exc_type: Optional[Type[BaseException]], 7221s exc_val: Optional[BaseException], 7221s exc_tb: Optional[TracebackType], 7221s ) -> Optional[bool]: 7221s assert self._state in (_State.ENTERED, _State.EXPIRING) 7221s 7221s if self._timeout_handler is not None: 7221s self._timeout_handler.cancel() 7221s self._timeout_handler = None 7221s 7221s if self._state is _State.EXPIRING: 7221s self._state = _State.EXPIRED 7221s 7221s if self._task.uncancel() <= self._cancelling and exc_type is not None: 7221s # Since there are no new cancel requests, we're 7221s # handling this. 7221s if issubclass(exc_type, exceptions.CancelledError): 7221s > raise TimeoutError from exc_val 7221s E TimeoutError 7221s 7221s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 7221s ----------------------------- Captured stderr call ----------------------------- 7221s 2024-11-23 22:24:15,634 - distributed.scheduler - INFO - State start 7221s 2024-11-23 22:24:15,641 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:15,642 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39985/status 7221s 2024-11-23 22:24:15,642 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7221s 2024-11-23 22:24:15,657 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39825 7221s 2024-11-23 22:24:15,657 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39825 7221s 2024-11-23 22:24:15,657 - distributed.worker - INFO - Worker name: 0 7221s 2024-11-23 22:24:15,657 - distributed.worker - INFO - dashboard at: 127.0.0.1:39317 7221s 2024-11-23 22:24:15,657 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:15,657 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:24:15,657 - distributed.worker - INFO - Threads: 1 7221s 2024-11-23 22:24:15,657 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:24:15,658 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-i5iy1_sx 7221s 2024-11-23 22:24:15,658 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:24:15,660 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36303 7221s 2024-11-23 22:24:15,660 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36303 7221s 2024-11-23 22:24:15,660 - distributed.worker - INFO - Worker name: 1 7221s 2024-11-23 22:24:15,660 - distributed.worker - INFO - dashboard at: 127.0.0.1:33829 7221s 2024-11-23 22:24:15,660 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:15,660 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:24:15,660 - distributed.worker - INFO - Threads: 2 7221s 2024-11-23 22:24:15,660 - distributed.worker - INFO - Memory: 15.58 GiB 7221s 2024-11-23 22:24:15,660 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-bm5iryte 7221s 2024-11-23 22:24:15,660 - distributed.worker - INFO - ------------------------------------------------- 7221s 2024-11-23 22:24:15,673 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:15,674 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:15,674 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:54674': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:15,674 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:54688': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:15,786 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:15,786 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:15,787 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:54694': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:15,787 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:54700': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:15,900 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:15,901 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:15,901 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:54702': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:15,901 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:54710': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:16,013 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:16,014 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:16,014 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:54722': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:16,014 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:54726': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:16,126 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:16,127 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:16,127 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:54728': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:16,127 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:54730': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:16,239 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:16,240 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:16,240 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:54744': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:16,240 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:54746': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:16,353 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:16,354 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:16,354 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:54752': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:16,354 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:54758': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:16,467 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:16,467 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:16,467 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:54770': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:16,468 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:54774': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:16,581 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:16,581 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:16,581 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:54790': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:16,582 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:54798': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:16,695 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:16,695 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:16,695 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:54810': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:16,695 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:54816': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:16,809 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:16,809 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:16,809 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:54826': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:16,810 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:54828': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:16,922 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:16,922 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:16,923 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:54836': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:16,923 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:54848': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:17,036 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:17,037 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:17,037 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:54860': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:17,037 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:54872': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:17,151 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:17,151 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:17,154 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:54884': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:17,154 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:54890': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:17,266 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:17,267 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:17,268 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:54902': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:17,268 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:54916': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:17,384 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:17,384 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:17,385 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:54932': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:17,385 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:54934': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:17,502 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:17,503 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:17,503 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:54946': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:17,504 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:54962': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:17,619 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:17,619 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:17,620 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:54978': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:17,620 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:54982': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:17,736 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:17,736 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:17,737 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:54994': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:17,737 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:54996': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:17,852 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:17,853 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:17,854 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:55000': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:17,854 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:55010': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:17,969 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:17,969 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:17,970 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:55012': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:17,970 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:55018': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:18,086 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:18,087 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:18,087 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:55028': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:18,088 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:55042': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:18,203 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:18,203 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:18,204 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:55056': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:18,204 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:55070': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:18,319 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:18,319 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:18,320 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:55072': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:18,320 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:55080': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:18,436 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:18,436 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:18,437 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:55082': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:18,437 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:55098': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:18,553 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:18,553 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:18,554 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:55100': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:18,554 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:55104': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:18,670 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:18,670 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:18,671 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:55108': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:18,671 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:55118': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:18,787 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:18,787 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:18,788 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:55122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:18,788 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:55134': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:18,903 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:18,903 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:18,904 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:55140': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:18,904 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:55156': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:19,020 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:19,020 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:19,021 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:55168': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:19,021 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:55184': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:19,136 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:19,136 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:19,137 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:55200': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:19,137 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:55202': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:19,253 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:19,253 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:19,254 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:55204': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:19,254 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:55208': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:19,370 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:19,371 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:19,372 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:55214': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:19,372 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:55226': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:19,488 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:19,488 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:19,489 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:55228': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:19,489 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:55242': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:19,604 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:19,605 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:19,605 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:55250': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:19,606 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:55252': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:19,721 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:19,722 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:19,723 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:55264': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:19,723 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:55266': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:19,838 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:19,838 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:19,839 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:55272': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:19,839 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:55278': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:19,954 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:19,955 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:19,955 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:55286': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:19,956 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:55296': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:20,069 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:20,071 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:20,071 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:55304': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:20,072 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:55312': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:20,181 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:20,186 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:55328': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:20,188 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:20,189 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:55332': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:20,291 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:20,292 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:55334': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:20,300 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:20,301 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:55344': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:20,401 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:20,401 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:55346': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:20,410 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:20,410 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:55350': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:20,510 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:20,511 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:55358': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:20,518 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:20,519 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:55374': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:20,619 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:20,619 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:55390': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:20,626 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:20,627 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:55400': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:20,726 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:20,727 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:55408': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:20,733 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:20,734 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:55412': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:20,836 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:20,836 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:55424': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:20,842 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:20,843 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:55432': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:20,944 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:20,945 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:55442': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:20,951 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:20,951 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:55448': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:21,052 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:21,052 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:55462': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:21,058 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:21,059 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:55466': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:21,160 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:21,161 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:55476': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:21,167 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:21,167 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:55478': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:21,268 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:21,268 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:55490': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:21,274 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:21,275 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:55492': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:21,375 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:21,376 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:55504': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:21,382 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:21,382 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:55518': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:21,483 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:21,483 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:55520': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:21,490 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:21,490 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:55532': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:21,591 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:21,591 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:52880': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:21,597 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:21,598 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:52888': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:21,698 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:21,698 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:52894': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:21,705 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:21,705 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:52896': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:21,806 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:21,806 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:52912': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:21,813 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:21,813 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:52914': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:21,914 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:21,915 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:52918': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:21,921 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:21,922 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:52926': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:22,023 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:22,024 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:52938': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:22,030 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:22,031 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:52940': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:22,131 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:22,132 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:52948': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:22,138 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:22,138 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:52954': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:22,240 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:22,240 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:52956': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:22,247 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:22,247 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:52958': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:22,348 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:22,348 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:52968': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:22,356 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:22,356 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:52984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:22,456 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:22,456 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:52998': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:22,464 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:22,464 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:53010': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:22,564 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:22,565 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:53022': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:22,571 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:22,572 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:53024': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:22,673 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:22,674 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:53038': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:22,680 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:22,681 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:53050': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:22,781 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:22,782 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:53060': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:22,788 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:22,788 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:53074': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:22,890 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:22,891 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:53090': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:22,897 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:22,897 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:53102': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:22,998 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:22,998 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:53110': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:23,005 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:23,005 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:53126': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:23,106 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:23,107 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:53132': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:23,113 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:23,113 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:53148': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:23,214 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:23,215 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:53152': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:23,221 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:23,221 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:53158': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:23,323 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:23,324 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:53168': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:23,330 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:23,331 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:53184': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:23,432 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:23,432 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:53196': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:23,438 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:23,439 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:53206': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:23,539 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:23,540 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:53222': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:23,546 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:23,546 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:53230': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:23,647 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:23,650 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:53238': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:23,657 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:23,657 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:53252': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:23,755 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:23,755 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:53260': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:23,764 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:23,764 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:53264': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:23,863 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:23,863 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:53268': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:23,871 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:23,871 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:53276': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:23,970 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:23,971 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:53282': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:23,978 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:23,979 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:53294': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:24,078 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:24,079 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:53306': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:24,085 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:24,086 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:53310': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:24,186 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:24,187 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:53318': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:24,193 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:24,193 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:53320': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:24,294 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:24,294 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:53332': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:24,301 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:24,301 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:53336': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:24,402 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:24,402 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:53346': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:24,408 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:24,409 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:53358': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:24,510 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:24,511 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:53368': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:24,517 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:24,518 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:53380': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:24,619 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:24,620 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:53394': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:24,626 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:24,626 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:53398': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:24,727 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:24,728 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:53408': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:24,734 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:24,734 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:53424': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:24,835 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:24,835 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:53434': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:24,842 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:24,842 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:53450': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:24,943 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:24,944 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:53466': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:24,950 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:24,951 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:53468': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:25,051 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:25,052 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:53482': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:25,058 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:25,058 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:53496': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:25,159 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:25,159 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:53504': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:25,166 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:25,166 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:53520': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:25,266 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:25,267 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:53532': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:25,273 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:25,274 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:53534': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:25,374 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:25,375 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:53546': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:25,381 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:25,382 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:53562': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:25,482 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:25,482 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:53576': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:25,488 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:25,489 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:53578': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:25,589 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:25,590 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:53592': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:25,596 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:25,596 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:53608': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:25,697 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:25,697 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:53624': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:25,703 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:25,704 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:53634': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:25,804 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:25,804 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:53650': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:25,811 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:25,811 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:53654': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:25,912 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:25,913 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:53662': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:25,919 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:25,919 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:53664': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:26,020 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:26,020 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:53670': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:26,027 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:26,027 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:53676': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:26,128 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:26,128 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:53690': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:26,134 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:26,135 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:53706': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:26,235 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:26,235 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:53708': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:26,242 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:26,242 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:53724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:26,344 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:26,345 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:53728': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:26,351 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:26,351 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:53736': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:26,451 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:26,451 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:53744': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:26,458 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:26,458 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:53746': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:26,560 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:26,561 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:53760': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:26,567 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:26,567 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:53762': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:26,668 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:26,669 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:53768': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:26,675 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:26,675 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:53776': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:26,776 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:26,776 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:53790': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:26,782 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:26,783 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:53804': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:26,883 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:26,883 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:53806': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:26,890 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:26,890 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:53810': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:26,991 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:26,992 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:53822': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:26,998 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:26,998 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:53830': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:27,099 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:27,099 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:53836': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:27,106 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:27,106 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:53842': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:27,207 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:27,208 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:53858': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:27,214 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:27,214 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:53872': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:27,315 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:27,315 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:53876': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:27,322 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:27,322 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:53880': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:27,423 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:27,423 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:53888': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:27,429 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:27,430 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:53894': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:27,530 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:27,530 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:53910': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:27,537 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:27,537 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:53920': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:27,639 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:27,639 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:53934': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:27,646 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:27,649 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:53940': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:27,747 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:27,748 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:53950': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:27,754 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:27,754 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:53956': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:27,854 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:27,855 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:53972': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:27,861 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:27,862 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:53980': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:27,962 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:27,963 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:53992': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:27,969 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:27,970 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:53996': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:28,071 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:28,072 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:54002': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:28,078 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:28,078 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:54016': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:28,179 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:28,179 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:54026': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:28,185 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:28,186 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:54032': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:28,287 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:28,288 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:54044': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:28,294 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:28,294 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:54056': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:28,395 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:28,396 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:54070': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:28,402 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:28,402 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:54086': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:28,506 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:28,507 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:54094': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:28,513 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:28,514 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:54108': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:28,614 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:28,615 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:54114': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:28,621 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:28,621 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:54130': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:28,722 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:28,723 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:54146': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:28,729 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:28,729 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:54160': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:28,830 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:28,830 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:54164': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:28,837 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:28,837 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:54170': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:28,938 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:28,939 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:54182': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:28,945 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:28,945 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:54190': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:29,045 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:29,046 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:54192': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:29,052 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:29,053 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:54206': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:29,152 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:29,153 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:54214': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:29,159 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:29,160 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:54226': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:29,260 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:29,261 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:54230': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:29,267 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:29,268 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:54234': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:29,369 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:29,370 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:54244': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:29,376 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:29,376 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:54256': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:29,477 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:29,477 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:54264': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:29,483 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:29,484 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:54272': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:29,584 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:29,585 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:54274': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:29,591 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:29,591 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:54276': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:29,692 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:29,692 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:54282': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:29,699 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:29,699 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:54288': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:29,800 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:29,801 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:54292': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:29,807 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:29,808 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:54294': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:29,908 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:29,909 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:54300': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:29,915 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:29,915 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:54306': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:30,017 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:30,018 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:54308': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:30,024 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:30,024 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:54312': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:30,125 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:30,125 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:54318': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:30,132 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:30,132 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:54332': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:30,233 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:30,233 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:54342': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:30,240 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:30,240 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:54352': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:30,340 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:30,341 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:54360': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:30,347 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:30,348 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:54370': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:30,449 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:30,450 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:54374': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:30,456 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:30,456 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:54376': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:30,557 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:30,557 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:54384': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:30,563 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44153 7221s 2024-11-23 22:24:30,564 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44153': TLS handshake failed with remote 'tls://127.0.0.1:54394': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7221s 2024-11-23 22:24:30,657 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39825. Reason: failure-to-start- 7221s 2024-11-23 22:24:30,658 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:24:30,659 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36303. Reason: failure-to-start- 7221s 2024-11-23 22:24:30,659 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7221s 2024-11-23 22:24:30,661 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 15s.; retrying 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7221s stream = await self.client.connect( 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 7221s stream = await stream.start_tls( 7221s ^^^^^^^^^^^^^^^^^^^^^^^ 7221s False, ssl_options=ssl_options, server_hostname=host 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 7221s self.socket.do_handshake() 7221s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 7221s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 7221s self._sslobj.do_handshake() 7221s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 7221s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 7221s 7221s The above exception was the direct cause of the following exception: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7221s comm = await connect(self.scheduler.address, **self.connection_args) 7221s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7221s comm = await wait_for( 7221s ^^^^^^^^^^^^^^^ 7221s ...<2 lines>... 7221s ) 7221s ^ 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 7221s raise FatalCommClosedError( 7221s ...<2 lines>... 7221s ) from err 7221s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 7221s 7221s During handling of the above exception, another exception occurred: 7221s 7221s Traceback (most recent call last): 7221s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7221s return await fut 7221s ^^^^^^^^^ 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7221s await self._register_with_scheduler() 7221s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1218, in _register_with_scheduler 7221s await asyncio.sleep(0.1) 7221s File "/usr/lib/python3.13/asyncio/tasks.py", line 718, in sleep 7221s return await future 7222s ^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 15s. 7222s 2024-11-23 22:24:31,668 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:24:31,675 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:31,676 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40717/status 7222s 2024-11-23 22:24:31,676 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:24:31,691 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36129 7222s 2024-11-23 22:24:31,691 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36129 7222s 2024-11-23 22:24:31,691 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:24:31,691 - distributed.worker - INFO - dashboard at: 127.0.0.1:42613 7222s 2024-11-23 22:24:31,691 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:31,691 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:24:31,691 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:24:31,691 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:24:31,691 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-qcnf_a0_ 7222s 2024-11-23 22:24:31,691 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:24:31,693 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37577 7222s 2024-11-23 22:24:31,693 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37577 7222s 2024-11-23 22:24:31,693 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:24:31,693 - distributed.worker - INFO - dashboard at: 127.0.0.1:46449 7222s 2024-11-23 22:24:31,693 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:31,693 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:24:31,693 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:24:31,693 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:24:31,694 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-k5cm6hv1 7222s 2024-11-23 22:24:31,694 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:24:31,706 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:31,707 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:31,707 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:43652': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:31,707 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:43656': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:31,819 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:31,819 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:31,820 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:43670': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:31,820 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:43676': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:31,933 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:31,933 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:31,934 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:43690': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:31,934 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:43694': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:32,046 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:32,046 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:32,047 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:43696': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:32,047 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:43712': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:32,159 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:32,159 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:32,160 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:43718': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:32,160 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:43732': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:32,273 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:32,273 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:32,273 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:43744': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:32,273 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:43748': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:32,386 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:32,386 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:32,386 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:43760': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:32,387 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:43770': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:32,500 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:32,500 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:32,501 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:43774': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:32,501 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:43776': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:32,613 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:32,613 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:32,614 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:43788': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:32,614 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:43800': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:32,726 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:32,726 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:32,727 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:43802': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:32,727 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:43810': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:32,839 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:32,839 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:32,840 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:43822': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:32,840 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:43838': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:32,953 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:32,953 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:32,953 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:43846': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:32,953 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:43848': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:33,067 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:33,067 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:33,068 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:43850': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:33,068 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:43862': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:33,180 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:33,180 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:33,183 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:43878': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:33,183 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:43886': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:33,293 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:33,293 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:33,294 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:43896': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:33,294 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:43908': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:33,406 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:33,406 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:33,407 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:43910': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:33,407 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:43924': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:33,520 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:33,520 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:33,520 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:43932': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:33,520 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:43934': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:33,633 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:33,633 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:33,634 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:43936': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:33,634 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:43952': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:33,747 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:33,747 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:33,747 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:43964': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:33,747 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:43980': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:33,859 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:33,860 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:33,860 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:43982': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:33,860 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:43996': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:33,974 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:33,974 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:33,974 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:44008': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:33,975 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:44022': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:34,087 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:34,087 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:34,087 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:44028': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:34,087 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:44034': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:34,199 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:34,200 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:34,200 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:44040': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:34,200 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:44044': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:34,313 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:34,313 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:34,313 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:44060': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:34,313 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:44070': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:34,426 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:34,426 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:34,427 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:44082': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:34,427 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:44096': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:34,539 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:34,539 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:34,539 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:44112': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:34,539 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:44116': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:34,652 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:34,653 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:34,657 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:44124': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:34,657 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:44134': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:34,765 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:34,765 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:34,766 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:44138': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:34,766 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:44152': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:34,878 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:34,878 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:34,879 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:44160': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:34,879 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:44162': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:34,991 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:34,992 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:34,992 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:44176': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:34,992 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:44192': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:35,104 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:35,104 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:35,105 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:44204': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:35,105 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:44218': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:35,217 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:35,217 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:35,218 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:44234': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:35,218 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:44244': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:35,331 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:35,331 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:35,331 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:44260': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:35,331 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:44266': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:35,445 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:35,445 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:35,445 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:44268': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:35,445 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:44280': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:35,558 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:35,558 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:35,558 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:44294': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:35,558 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:44302': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:35,671 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:35,671 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:35,672 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:44318': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:35,672 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:44332': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:35,784 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:35,784 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:35,785 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:44338': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:35,785 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:44340': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:35,898 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:35,898 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:35,898 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:44350': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:35,898 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:44352': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:36,011 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:36,011 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:36,012 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:44362': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:36,012 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:44374': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:36,124 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:36,124 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:36,125 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:44384': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:36,125 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:44392': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:36,237 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:36,238 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:36,238 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:44398': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:36,238 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:44412': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:36,350 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:36,350 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:36,351 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:44418': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:36,351 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:44428': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:36,464 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:36,464 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:36,465 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:44432': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:36,465 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:44442': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:36,577 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:36,577 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:36,578 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:44458': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:36,578 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:44460': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:36,693 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:36,693 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:36,694 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:44466': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:36,694 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:44468': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:36,806 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:36,806 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:36,807 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:44476': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:36,807 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:44490': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:36,920 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:36,920 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:36,920 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:44504': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:36,921 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:44520': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:37,033 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:37,034 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:37,034 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:44522': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:37,034 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:44530': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:37,147 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:37,147 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:37,151 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:44544': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:37,151 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:44552': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:37,260 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:37,261 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:37,261 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:44560': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:37,261 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:44574': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:37,374 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:37,374 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:37,375 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:44584': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:37,375 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:44592': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:37,487 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:37,488 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:37,488 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:44604': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:37,488 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:44606': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:37,601 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:37,601 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:37,601 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:44612': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:37,601 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:44628': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:37,714 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:37,714 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:37,715 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:44642': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:37,715 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:44650': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:37,827 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:37,827 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:37,828 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:44666': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:37,828 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:44672': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:37,939 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:37,940 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:37,941 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:44688': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:37,941 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:44696': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:38,048 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:38,052 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:44704': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:38,054 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:38,054 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:44708': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:38,155 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:38,156 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:44724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:38,162 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:38,162 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:44730': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:38,264 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:38,265 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:44738': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:38,271 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:38,272 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:44744': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:38,372 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:38,373 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:44750': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:38,379 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:38,379 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:44752': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:38,481 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:38,482 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:44764': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:38,488 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:38,488 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:44776': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:38,588 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:38,588 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:44778': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:38,595 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:38,595 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:44784': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:38,697 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:38,698 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:44798': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:38,704 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:38,704 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:44810': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:38,805 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:38,806 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:44818': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:38,812 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:38,813 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:44824': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:38,915 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:38,915 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:44826': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:38,921 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:38,922 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:44832': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:39,022 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:39,022 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:44846': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:39,029 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:39,029 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:44850': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:39,130 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:39,131 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:44858': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:39,136 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:39,137 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:44862': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:39,237 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:39,238 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:44872': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:39,244 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:39,245 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:44886': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:39,345 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:39,346 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:44898': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:39,352 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:39,352 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:44906': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:39,453 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:39,453 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:44908': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:39,459 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:39,460 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:44910': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:39,561 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:39,562 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:44916': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:39,567 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:39,568 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:44926': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:39,669 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:39,670 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:44942': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:39,676 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:39,676 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:44956': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:39,778 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:39,779 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:44962': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:39,785 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:39,785 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:44974': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:39,887 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:39,888 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:44978': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:39,894 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:39,895 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:44982': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:39,994 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:39,995 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:44994': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:40,001 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:40,001 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:45008': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:40,103 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:40,104 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:45014': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:40,110 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:40,110 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:45024': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:40,210 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:40,211 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:45032': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:40,217 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:40,217 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:45036': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:40,318 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:40,319 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:45044': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:40,325 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:40,325 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:45060': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:40,426 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:40,426 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:45066': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:40,433 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:40,433 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:45078': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:40,534 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:40,535 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:45092': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:40,541 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:40,541 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:45094': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:40,643 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:40,644 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:45098': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:40,653 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:40,654 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:45106': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:40,750 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:40,750 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:45118': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:40,760 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:40,761 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:45122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:40,857 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:40,858 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:45132': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:40,867 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:40,868 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:45140': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:40,965 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:40,966 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:45156': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:40,974 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:40,975 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:45164': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:41,073 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:41,073 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:45176': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:41,082 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:41,082 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:45180': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:41,180 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:41,184 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:45182': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:41,190 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:41,191 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:45198': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:41,288 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:41,288 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:45202': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:41,298 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:41,298 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:45204': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:41,396 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:41,396 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:45212': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:41,405 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:41,405 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:45218': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:41,503 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:41,504 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:45220': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:41,514 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:41,514 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:45230': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:41,611 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:41,611 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:33552': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:41,621 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:41,621 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:33568': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:41,719 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:41,719 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:33584': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:41,728 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:41,729 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:33598': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:41,827 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:41,827 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:33600': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:41,835 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:41,835 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:33614': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:41,935 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:41,936 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:33626': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:41,942 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:41,942 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:33636': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:42,044 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:42,045 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:33642': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:42,051 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:42,052 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:33648': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:42,153 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:42,154 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:33652': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:42,160 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:42,161 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:33658': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:42,261 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:42,261 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:33674': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:42,267 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:42,268 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:33682': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:42,371 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:42,371 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:33694': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:42,377 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:42,378 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:33700': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:42,478 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:42,479 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:33714': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:42,485 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:42,486 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:33726': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:42,587 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:42,587 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:33728': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:42,593 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:42,594 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:33736': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:42,694 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:42,695 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:33744': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:42,701 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:42,702 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:33754': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:42,804 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:42,804 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:33766': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:42,810 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:42,811 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:33780': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:42,911 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:42,911 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:33782': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:42,918 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:42,918 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:33790': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:43,019 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:43,019 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:33792': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:43,025 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:43,026 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:33808': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:43,127 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:43,127 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:33820': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:43,133 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:43,134 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:33834': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:43,234 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:43,235 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:33840': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:43,241 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:43,242 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:33852': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:43,343 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:43,343 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:33860': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:43,350 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:43,350 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:33862': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:43,450 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:43,450 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:33870': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:43,456 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:43,457 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:33878': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:43,557 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:43,558 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:33884': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:43,564 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:43,565 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:33894': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:43,666 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:43,666 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:33896': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:43,672 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:43,672 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:33912': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:43,773 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:43,773 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:33914': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:43,779 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:43,780 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:33916': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:43,880 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:43,881 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:33918': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:43,887 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:43,887 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:33928': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:43,988 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:43,988 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:33940': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:43,995 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:43,995 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:33944': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:44,097 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:44,098 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:33954': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:44,104 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:44,104 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:33958': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:44,206 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:44,207 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:33962': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:44,213 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:44,213 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:33976': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:44,313 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:44,314 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:33992': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:44,320 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:44,320 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:33996': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:44,420 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:44,421 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:33998': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:44,427 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:44,428 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:34014': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:44,528 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:44,529 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:34026': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:44,535 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:44,535 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:34038': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:44,637 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:44,638 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:34052': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:44,644 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38261 7222s 2024-11-23 22:24:44,647 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38261': TLS handshake failed with remote 'tls://127.0.0.1:34054': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:24:44,690 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36129. Reason: failure-to-start- 7222s 2024-11-23 22:24:44,690 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:24:44,692 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 13s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 7222s stream = await stream.start_tls( 7222s ^^^^^^^^^^^^^^^^^^^^^^^ 7222s False, ssl_options=ssl_options, server_hostname=host 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 7222s self.socket.do_handshake() 7222s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 7222s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 7222s self._sslobj.do_handshake() 7222s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 7222s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 7222s raise FatalCommClosedError( 7222s ...<2 lines>... 7222s ) from err 7222s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 7222s 7222s During handling of the above exception, another exception occurred: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1218, in _register_with_scheduler 7222s await asyncio.sleep(0.1) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 718, in sleep 7222s return await future 7222s ^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 13s. 7222s 2024-11-23 22:24:44,696 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37577. Reason: failure-to-start- 7222s 2024-11-23 22:24:44,696 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:24:45,700 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:24:45,706 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46767 7222s 2024-11-23 22:24:45,707 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40179/status 7222s 2024-11-23 22:24:45,707 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:24:45,721 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35695 7222s 2024-11-23 22:24:45,721 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35695 7222s 2024-11-23 22:24:45,721 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:24:45,721 - distributed.worker - INFO - dashboard at: 127.0.0.1:37897 7222s 2024-11-23 22:24:45,721 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46767 7222s 2024-11-23 22:24:45,721 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:24:45,721 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:24:45,721 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:24:45,721 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-7s3yy3ha 7222s 2024-11-23 22:24:45,722 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:24:45,724 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41221 7222s 2024-11-23 22:24:45,724 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41221 7222s 2024-11-23 22:24:45,724 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:24:45,724 - distributed.worker - INFO - dashboard at: 127.0.0.1:35409 7222s 2024-11-23 22:24:45,724 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46767 7222s 2024-11-23 22:24:45,724 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:24:45,724 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:24:45,724 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:24:45,724 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ll5hxi0f 7222s 2024-11-23 22:24:45,724 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:24:45,725 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35695. Reason: failure-to-start- 7222s 2024-11-23 22:24:45,725 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:24:45,726 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41221. Reason: failure-to-start- 7222s 2024-11-23 22:24:45,726 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:24:45,727 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46767': TLS handshake failed with remote 'tls://127.0.0.1:36622': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:24:45,727 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46767': TLS handshake failed with remote 'tls://127.0.0.1:36626': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:24:45,729 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s 2024-11-23 22:24:46,734 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:24:46,741 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43003 7222s 2024-11-23 22:24:46,741 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33841/status 7222s 2024-11-23 22:24:46,742 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:24:46,757 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36863 7222s 2024-11-23 22:24:46,757 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36863 7222s 2024-11-23 22:24:46,757 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:24:46,757 - distributed.worker - INFO - dashboard at: 127.0.0.1:37453 7222s 2024-11-23 22:24:46,757 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43003 7222s 2024-11-23 22:24:46,757 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:24:46,757 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:24:46,757 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:24:46,757 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-o3bs2q8n 7222s 2024-11-23 22:24:46,757 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:24:46,759 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33067 7222s 2024-11-23 22:24:46,759 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33067 7222s 2024-11-23 22:24:46,759 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:24:46,759 - distributed.worker - INFO - dashboard at: 127.0.0.1:35827 7222s 2024-11-23 22:24:46,759 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43003 7222s 2024-11-23 22:24:46,760 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:24:46,760 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:24:46,760 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:24:46,760 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-gyphev88 7222s 2024-11-23 22:24:46,760 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:24:46,761 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36863. Reason: failure-to-start- 7222s 2024-11-23 22:24:46,761 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:24:46,761 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33067. Reason: failure-to-start- 7222s 2024-11-23 22:24:46,761 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:24:46,763 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43003': TLS handshake failed with remote 'tls://127.0.0.1:58892': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:24:46,763 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43003': TLS handshake failed with remote 'tls://127.0.0.1:58898': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:24:46,764 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s 2024-11-23 22:24:47,770 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:24:47,777 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43141 7222s 2024-11-23 22:24:47,777 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38665/status 7222s 2024-11-23 22:24:47,777 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:24:47,791 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35529 7222s 2024-11-23 22:24:47,792 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35529 7222s 2024-11-23 22:24:47,792 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:24:47,792 - distributed.worker - INFO - dashboard at: 127.0.0.1:44399 7222s 2024-11-23 22:24:47,792 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43141 7222s 2024-11-23 22:24:47,792 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:24:47,792 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:24:47,792 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:24:47,792 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-uibnwe2j 7222s 2024-11-23 22:24:47,792 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:24:47,798 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36211 7222s 2024-11-23 22:24:47,798 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36211 7222s 2024-11-23 22:24:47,798 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:24:47,798 - distributed.worker - INFO - dashboard at: 127.0.0.1:37215 7222s 2024-11-23 22:24:47,798 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43141 7222s 2024-11-23 22:24:47,798 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:24:47,798 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:24:47,798 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:24:47,798 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ee38628m 7222s 2024-11-23 22:24:47,799 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:24:47,800 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35529. Reason: failure-to-start- 7222s 2024-11-23 22:24:47,800 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:24:47,800 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36211. Reason: failure-to-start- 7222s 2024-11-23 22:24:47,800 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:24:47,802 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43141': TLS handshake failed with remote 'tls://127.0.0.1:59900': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:24:47,802 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43141': TLS handshake failed with remote 'tls://127.0.0.1:59904': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:24:47,803 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s 2024-11-23 22:24:48,808 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:24:48,815 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36459 7222s 2024-11-23 22:24:48,815 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39965/status 7222s 2024-11-23 22:24:48,816 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:24:48,829 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34303 7222s 2024-11-23 22:24:48,829 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34303 7222s 2024-11-23 22:24:48,829 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:24:48,829 - distributed.worker - INFO - dashboard at: 127.0.0.1:39399 7222s 2024-11-23 22:24:48,829 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36459 7222s 2024-11-23 22:24:48,829 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:24:48,830 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:24:48,830 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:24:48,830 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-lev4eiop 7222s 2024-11-23 22:24:48,830 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:24:48,832 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43155 7222s 2024-11-23 22:24:48,832 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43155 7222s 2024-11-23 22:24:48,832 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:24:48,832 - distributed.worker - INFO - dashboard at: 127.0.0.1:43975 7222s 2024-11-23 22:24:48,832 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36459 7222s 2024-11-23 22:24:48,832 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:24:48,832 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:24:48,832 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:24:48,832 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-tuxrvm5r 7222s 2024-11-23 22:24:48,832 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:24:48,833 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34303. Reason: failure-to-start- 7222s 2024-11-23 22:24:48,833 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:24:48,834 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43155. Reason: failure-to-start- 7222s 2024-11-23 22:24:48,834 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:24:48,835 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36459': TLS handshake failed with remote 'tls://127.0.0.1:54324': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:24:48,835 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36459': TLS handshake failed with remote 'tls://127.0.0.1:54332': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:24:48,837 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s 2024-11-23 22:24:49,842 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:24:49,849 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39835 7222s 2024-11-23 22:24:49,850 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38369/status 7222s 2024-11-23 22:24:49,850 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:24:49,866 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39349 7222s 2024-11-23 22:24:49,866 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39349 7222s 2024-11-23 22:24:49,866 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:24:49,866 - distributed.worker - INFO - dashboard at: 127.0.0.1:45795 7222s 2024-11-23 22:24:49,866 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 7222s 2024-11-23 22:24:49,866 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:24:49,866 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:24:49,866 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:24:49,866 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-4jpkd5ku 7222s 2024-11-23 22:24:49,866 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:24:49,868 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36515 7222s 2024-11-23 22:24:49,868 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36515 7222s 2024-11-23 22:24:49,869 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:24:49,869 - distributed.worker - INFO - dashboard at: 127.0.0.1:40621 7222s 2024-11-23 22:24:49,869 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39835 7222s 2024-11-23 22:24:49,869 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:24:49,869 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:24:49,869 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:24:49,869 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-jo6edm7p 7222s 2024-11-23 22:24:49,869 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:24:49,870 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39349. Reason: failure-to-start- 7222s 2024-11-23 22:24:49,870 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:24:49,870 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36515. Reason: failure-to-start- 7222s 2024-11-23 22:24:49,871 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:24:49,872 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:43686': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:24:49,872 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39835': TLS handshake failed with remote 'tls://127.0.0.1:43690': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:24:49,873 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s 2024-11-23 22:24:50,879 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:24:50,887 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44029 7222s 2024-11-23 22:24:50,887 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43879/status 7222s 2024-11-23 22:24:50,887 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:24:50,903 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40369 7222s 2024-11-23 22:24:50,903 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40369 7222s 2024-11-23 22:24:50,903 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:24:50,903 - distributed.worker - INFO - dashboard at: 127.0.0.1:39691 7222s 2024-11-23 22:24:50,903 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44029 7222s 2024-11-23 22:24:50,903 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:24:50,903 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:24:50,903 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:24:50,903 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-957holb1 7222s 2024-11-23 22:24:50,903 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:24:50,905 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39347 7222s 2024-11-23 22:24:50,906 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39347 7222s 2024-11-23 22:24:50,906 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:24:50,906 - distributed.worker - INFO - dashboard at: 127.0.0.1:39277 7222s 2024-11-23 22:24:50,906 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44029 7222s 2024-11-23 22:24:50,906 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:24:50,906 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:24:50,906 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:24:50,906 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-191nshh_ 7222s 2024-11-23 22:24:50,906 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:24:50,907 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40369. Reason: failure-to-start- 7222s 2024-11-23 22:24:50,907 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:24:50,908 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39347. Reason: failure-to-start- 7222s 2024-11-23 22:24:50,908 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:24:50,909 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44029': TLS handshake failed with remote 'tls://127.0.0.1:35536': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:24:50,909 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44029': TLS handshake failed with remote 'tls://127.0.0.1:35538': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:24:50,911 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s 2024-11-23 22:24:51,916 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:24:51,923 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34985 7222s 2024-11-23 22:24:51,923 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43991/status 7222s 2024-11-23 22:24:51,924 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:24:51,938 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45597 7222s 2024-11-23 22:24:51,938 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45597 7222s 2024-11-23 22:24:51,938 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:24:51,938 - distributed.worker - INFO - dashboard at: 127.0.0.1:35399 7222s 2024-11-23 22:24:51,938 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34985 7222s 2024-11-23 22:24:51,938 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:24:51,938 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:24:51,938 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:24:51,938 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-rdw63a4y 7222s 2024-11-23 22:24:51,939 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:24:51,941 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39983 7222s 2024-11-23 22:24:51,941 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39983 7222s 2024-11-23 22:24:51,941 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:24:51,941 - distributed.worker - INFO - dashboard at: 127.0.0.1:40041 7222s 2024-11-23 22:24:51,941 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34985 7222s 2024-11-23 22:24:51,941 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:24:51,941 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:24:51,941 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:24:51,941 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-0ezq44b7 7222s 2024-11-23 22:24:51,941 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:24:51,942 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45597. Reason: failure-to-start- 7222s 2024-11-23 22:24:51,942 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:24:51,943 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39983. Reason: failure-to-start- 7222s 2024-11-23 22:24:51,943 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:24:51,944 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34985': TLS handshake failed with remote 'tls://127.0.0.1:35020': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:24:51,944 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34985': TLS handshake failed with remote 'tls://127.0.0.1:35022': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:24:51,946 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s 2024-11-23 22:24:52,953 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:24:52,960 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40411 7222s 2024-11-23 22:24:52,960 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37157/status 7222s 2024-11-23 22:24:52,960 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:24:52,975 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45747 7222s 2024-11-23 22:24:52,975 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45747 7222s 2024-11-23 22:24:52,975 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:24:52,975 - distributed.worker - INFO - dashboard at: 127.0.0.1:35835 7222s 2024-11-23 22:24:52,975 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40411 7222s 2024-11-23 22:24:52,975 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:24:52,975 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:24:52,975 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:24:52,975 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-iz40cchx 7222s 2024-11-23 22:24:52,975 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:24:52,977 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41317 7222s 2024-11-23 22:24:52,977 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41317 7222s 2024-11-23 22:24:52,977 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:24:52,977 - distributed.worker - INFO - dashboard at: 127.0.0.1:42915 7222s 2024-11-23 22:24:52,977 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40411 7222s 2024-11-23 22:24:52,977 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:24:52,977 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:24:52,977 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:24:52,977 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-2m0bdqf3 7222s 2024-11-23 22:24:52,978 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:24:52,979 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45747. Reason: failure-to-start- 7222s 2024-11-23 22:24:52,979 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:24:52,979 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41317. Reason: failure-to-start- 7222s 2024-11-23 22:24:52,979 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:24:52,981 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40411': TLS handshake failed with remote 'tls://127.0.0.1:41030': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:24:52,981 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40411': TLS handshake failed with remote 'tls://127.0.0.1:41038': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:24:52,982 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s 2024-11-23 22:24:53,987 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:24:53,995 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38211 7222s 2024-11-23 22:24:53,995 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:32891/status 7222s 2024-11-23 22:24:53,995 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:24:54,010 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37963 7222s 2024-11-23 22:24:54,011 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37963 7222s 2024-11-23 22:24:54,011 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:24:54,011 - distributed.worker - INFO - dashboard at: 127.0.0.1:43033 7222s 2024-11-23 22:24:54,011 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 7222s 2024-11-23 22:24:54,011 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:24:54,011 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:24:54,011 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:24:54,011 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-xckn7wqe 7222s 2024-11-23 22:24:54,011 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:24:54,013 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42977 7222s 2024-11-23 22:24:54,013 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42977 7222s 2024-11-23 22:24:54,013 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:24:54,013 - distributed.worker - INFO - dashboard at: 127.0.0.1:42383 7222s 2024-11-23 22:24:54,013 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38211 7222s 2024-11-23 22:24:54,013 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:24:54,013 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:24:54,013 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:24:54,013 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-a7oyowst 7222s 2024-11-23 22:24:54,013 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:24:54,014 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37963. Reason: failure-to-start- 7222s 2024-11-23 22:24:54,015 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:24:54,015 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42977. Reason: failure-to-start- 7222s 2024-11-23 22:24:54,015 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:24:54,016 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:45850': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:24:54,017 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38211': TLS handshake failed with remote 'tls://127.0.0.1:45854': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:24:54,018 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s 2024-11-23 22:24:55,024 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:24:55,031 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40999 7222s 2024-11-23 22:24:55,032 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34383/status 7222s 2024-11-23 22:24:55,032 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:24:55,046 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45641 7222s 2024-11-23 22:24:55,046 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45641 7222s 2024-11-23 22:24:55,046 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:24:55,046 - distributed.worker - INFO - dashboard at: 127.0.0.1:35221 7222s 2024-11-23 22:24:55,046 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40999 7222s 2024-11-23 22:24:55,046 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:24:55,046 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:24:55,046 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:24:55,046 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-1q2ixs82 7222s 2024-11-23 22:24:55,046 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:24:55,049 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35417 7222s 2024-11-23 22:24:55,049 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35417 7222s 2024-11-23 22:24:55,049 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:24:55,050 - distributed.worker - INFO - dashboard at: 127.0.0.1:41115 7222s 2024-11-23 22:24:55,050 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40999 7222s 2024-11-23 22:24:55,050 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:24:55,050 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:24:55,050 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:24:55,050 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-jq2vncib 7222s 2024-11-23 22:24:55,050 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:24:55,051 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45641. Reason: failure-to-start- 7222s 2024-11-23 22:24:55,051 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:24:55,051 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35417. Reason: failure-to-start- 7222s 2024-11-23 22:24:55,051 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:24:55,053 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40999': TLS handshake failed with remote 'tls://127.0.0.1:56594': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:24:55,053 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40999': TLS handshake failed with remote 'tls://127.0.0.1:56604': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:24:55,054 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s 2024-11-23 22:24:56,060 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:24:56,067 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46557 7222s 2024-11-23 22:24:56,068 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42109/status 7222s 2024-11-23 22:24:56,068 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:24:56,082 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38689 7222s 2024-11-23 22:24:56,082 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38689 7222s 2024-11-23 22:24:56,082 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:24:56,082 - distributed.worker - INFO - dashboard at: 127.0.0.1:42437 7222s 2024-11-23 22:24:56,083 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46557 7222s 2024-11-23 22:24:56,083 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:24:56,083 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:24:56,083 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:24:56,083 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-dnkqy1sy 7222s 2024-11-23 22:24:56,083 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:24:56,085 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40025 7222s 2024-11-23 22:24:56,085 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40025 7222s 2024-11-23 22:24:56,085 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:24:56,085 - distributed.worker - INFO - dashboard at: 127.0.0.1:34681 7222s 2024-11-23 22:24:56,085 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46557 7222s 2024-11-23 22:24:56,085 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:24:56,085 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:24:56,085 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:24:56,085 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-69it8wkc 7222s 2024-11-23 22:24:56,085 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:24:56,087 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38689. Reason: failure-to-start- 7222s 2024-11-23 22:24:56,087 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:24:56,087 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40025. Reason: failure-to-start- 7222s 2024-11-23 22:24:56,087 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:24:56,088 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46557': TLS handshake failed with remote 'tls://127.0.0.1:60880': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:24:56,089 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46557': TLS handshake failed with remote 'tls://127.0.0.1:60892': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:24:56,090 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s 2024-11-23 22:24:57,096 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:24:57,104 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37501 7222s 2024-11-23 22:24:57,104 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43691/status 7222s 2024-11-23 22:24:57,104 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:24:57,118 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33669 7222s 2024-11-23 22:24:57,118 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33669 7222s 2024-11-23 22:24:57,118 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:24:57,118 - distributed.worker - INFO - dashboard at: 127.0.0.1:40577 7222s 2024-11-23 22:24:57,118 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37501 7222s 2024-11-23 22:24:57,119 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:24:57,119 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:24:57,119 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:24:57,119 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-yppnbt58 7222s 2024-11-23 22:24:57,119 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:24:57,121 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42057 7222s 2024-11-23 22:24:57,121 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42057 7222s 2024-11-23 22:24:57,121 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:24:57,121 - distributed.worker - INFO - dashboard at: 127.0.0.1:43721 7222s 2024-11-23 22:24:57,121 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37501 7222s 2024-11-23 22:24:57,121 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:24:57,121 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:24:57,121 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:24:57,121 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-jyy0g1bi 7222s 2024-11-23 22:24:57,121 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:24:57,122 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33669. Reason: failure-to-start- 7222s 2024-11-23 22:24:57,122 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:24:57,123 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42057. Reason: failure-to-start- 7222s 2024-11-23 22:24:57,123 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:24:57,124 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37501': TLS handshake failed with remote 'tls://127.0.0.1:50434': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:24:57,124 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37501': TLS handshake failed with remote 'tls://127.0.0.1:50448': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:24:57,126 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s 2024-11-23 22:24:58,131 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:24:58,139 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40471 7222s 2024-11-23 22:24:58,139 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41327/status 7222s 2024-11-23 22:24:58,140 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:24:58,155 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46367 7222s 2024-11-23 22:24:58,155 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46367 7222s 2024-11-23 22:24:58,155 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:24:58,155 - distributed.worker - INFO - dashboard at: 127.0.0.1:43151 7222s 2024-11-23 22:24:58,155 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40471 7222s 2024-11-23 22:24:58,155 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:24:58,155 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:24:58,155 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:24:58,156 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-9wvwq_7g 7222s 2024-11-23 22:24:58,156 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:24:58,158 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34635 7222s 2024-11-23 22:24:58,158 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34635 7222s 2024-11-23 22:24:58,158 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:24:58,158 - distributed.worker - INFO - dashboard at: 127.0.0.1:37557 7222s 2024-11-23 22:24:58,158 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40471 7222s 2024-11-23 22:24:58,158 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:24:58,158 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:24:58,158 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:24:58,158 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-bcprz25j 7222s 2024-11-23 22:24:58,158 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:24:58,162 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46367. Reason: failure-to-start- 7222s 2024-11-23 22:24:58,162 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:24:58,162 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34635. Reason: failure-to-start- 7222s 2024-11-23 22:24:58,162 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:24:58,164 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40471': TLS handshake failed with remote 'tls://127.0.0.1:43074': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:24:58,164 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40471': TLS handshake failed with remote 'tls://127.0.0.1:43080': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:24:58,165 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s 2024-11-23 22:24:59,170 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:24:59,178 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46355 7222s 2024-11-23 22:24:59,178 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41539/status 7222s 2024-11-23 22:24:59,178 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:24:59,196 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41139 7222s 2024-11-23 22:24:59,196 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41139 7222s 2024-11-23 22:24:59,196 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:24:59,196 - distributed.worker - INFO - dashboard at: 127.0.0.1:38381 7222s 2024-11-23 22:24:59,196 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46355 7222s 2024-11-23 22:24:59,196 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:24:59,196 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:24:59,196 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:24:59,196 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-z0wjc3gl 7222s 2024-11-23 22:24:59,196 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:24:59,198 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36319 7222s 2024-11-23 22:24:59,199 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36319 7222s 2024-11-23 22:24:59,199 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:24:59,199 - distributed.worker - INFO - dashboard at: 127.0.0.1:39147 7222s 2024-11-23 22:24:59,199 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46355 7222s 2024-11-23 22:24:59,199 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:24:59,199 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:24:59,199 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:24:59,199 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-zs7r0gne 7222s 2024-11-23 22:24:59,199 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:24:59,201 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41139. Reason: failure-to-start- 7222s 2024-11-23 22:24:59,201 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:24:59,202 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36319. Reason: failure-to-start- 7222s 2024-11-23 22:24:59,202 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:24:59,203 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46355': TLS handshake failed with remote 'tls://127.0.0.1:46776': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:24:59,204 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46355': TLS handshake failed with remote 'tls://127.0.0.1:46792': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:24:59,205 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s 2024-11-23 22:25:00,212 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:25:00,219 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34259 7222s 2024-11-23 22:25:00,220 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46381/status 7222s 2024-11-23 22:25:00,220 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:25:00,234 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38119 7222s 2024-11-23 22:25:00,235 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38119 7222s 2024-11-23 22:25:00,235 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:25:00,235 - distributed.worker - INFO - dashboard at: 127.0.0.1:33013 7222s 2024-11-23 22:25:00,235 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34259 7222s 2024-11-23 22:25:00,235 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:25:00,235 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:25:00,235 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:25:00,235 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-wa39teto 7222s 2024-11-23 22:25:00,235 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:25:00,237 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45079 7222s 2024-11-23 22:25:00,237 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45079 7222s 2024-11-23 22:25:00,237 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:25:00,237 - distributed.worker - INFO - dashboard at: 127.0.0.1:46269 7222s 2024-11-23 22:25:00,237 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34259 7222s 2024-11-23 22:25:00,238 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:25:00,238 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:25:00,238 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:25:00,238 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ew4_06gg 7222s 2024-11-23 22:25:00,238 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:25:00,239 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38119. Reason: failure-to-start- 7222s 2024-11-23 22:25:00,239 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:25:00,240 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45079. Reason: failure-to-start- 7222s 2024-11-23 22:25:00,240 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:25:00,241 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34259': TLS handshake failed with remote 'tls://127.0.0.1:35542': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:25:00,241 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34259': TLS handshake failed with remote 'tls://127.0.0.1:35558': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:25:00,243 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s 2024-11-23 22:25:01,248 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:25:01,257 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41763 7222s 2024-11-23 22:25:01,257 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35767/status 7222s 2024-11-23 22:25:01,257 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:25:01,272 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40981 7222s 2024-11-23 22:25:01,273 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40981 7222s 2024-11-23 22:25:01,273 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:25:01,273 - distributed.worker - INFO - dashboard at: 127.0.0.1:41609 7222s 2024-11-23 22:25:01,273 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41763 7222s 2024-11-23 22:25:01,273 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:25:01,273 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:25:01,273 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:25:01,273 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-54tjis6q 7222s 2024-11-23 22:25:01,273 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:25:01,275 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45901 7222s 2024-11-23 22:25:01,275 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45901 7222s 2024-11-23 22:25:01,276 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:25:01,276 - distributed.worker - INFO - dashboard at: 127.0.0.1:36335 7222s 2024-11-23 22:25:01,276 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41763 7222s 2024-11-23 22:25:01,276 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:25:01,276 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:25:01,276 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:25:01,276 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-lknpapzy 7222s 2024-11-23 22:25:01,276 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:25:01,277 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40981. Reason: failure-to-start- 7222s 2024-11-23 22:25:01,277 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:25:01,278 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45901. Reason: failure-to-start- 7222s 2024-11-23 22:25:01,278 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:25:01,280 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41763': TLS handshake failed with remote 'tls://127.0.0.1:47654': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:25:01,280 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41763': TLS handshake failed with remote 'tls://127.0.0.1:47668': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:25:01,284 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s 2024-11-23 22:25:02,290 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:25:02,297 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39685 7222s 2024-11-23 22:25:02,297 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40975/status 7222s 2024-11-23 22:25:02,298 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:25:02,313 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45667 7222s 2024-11-23 22:25:02,313 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45667 7222s 2024-11-23 22:25:02,313 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:25:02,314 - distributed.worker - INFO - dashboard at: 127.0.0.1:40423 7222s 2024-11-23 22:25:02,314 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39685 7222s 2024-11-23 22:25:02,314 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:25:02,314 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:25:02,314 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:25:02,314 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-roc7twjd 7222s 2024-11-23 22:25:02,314 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:25:02,316 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45225 7222s 2024-11-23 22:25:02,316 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45225 7222s 2024-11-23 22:25:02,316 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:25:02,316 - distributed.worker - INFO - dashboard at: 127.0.0.1:41227 7222s 2024-11-23 22:25:02,316 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39685 7222s 2024-11-23 22:25:02,316 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:25:02,316 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:25:02,316 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:25:02,316 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ifm_kcoc 7222s 2024-11-23 22:25:02,316 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:25:02,318 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45667. Reason: failure-to-start- 7222s 2024-11-23 22:25:02,318 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:25:02,318 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45225. Reason: failure-to-start- 7222s 2024-11-23 22:25:02,318 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:25:02,322 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39685': TLS handshake failed with remote 'tls://127.0.0.1:57750': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:25:02,323 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39685': TLS handshake failed with remote 'tls://127.0.0.1:57756': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:25:02,324 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s 2024-11-23 22:25:03,330 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:25:03,337 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33705 7222s 2024-11-23 22:25:03,337 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38997/status 7222s 2024-11-23 22:25:03,338 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:25:03,352 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36481 7222s 2024-11-23 22:25:03,352 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36481 7222s 2024-11-23 22:25:03,352 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:25:03,352 - distributed.worker - INFO - dashboard at: 127.0.0.1:34251 7222s 2024-11-23 22:25:03,352 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33705 7222s 2024-11-23 22:25:03,353 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:25:03,353 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:25:03,353 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:25:03,353 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-7m7qofio 7222s 2024-11-23 22:25:03,353 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:25:03,355 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36821 7222s 2024-11-23 22:25:03,355 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36821 7222s 2024-11-23 22:25:03,355 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:25:03,355 - distributed.worker - INFO - dashboard at: 127.0.0.1:46779 7222s 2024-11-23 22:25:03,355 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33705 7222s 2024-11-23 22:25:03,355 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:25:03,355 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:25:03,355 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:25:03,355 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-d1otcwoj 7222s 2024-11-23 22:25:03,355 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:25:03,358 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36481. Reason: failure-to-start- 7222s 2024-11-23 22:25:03,358 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:25:03,358 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36821. Reason: failure-to-start- 7222s 2024-11-23 22:25:03,359 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:25:03,362 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33705': TLS handshake failed with remote 'tls://127.0.0.1:59402': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:25:03,362 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33705': TLS handshake failed with remote 'tls://127.0.0.1:59410': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:25:03,364 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s 2024-11-23 22:25:04,370 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:25:04,377 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37835 7222s 2024-11-23 22:25:04,378 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41315/status 7222s 2024-11-23 22:25:04,378 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:25:04,393 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37499 7222s 2024-11-23 22:25:04,393 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37499 7222s 2024-11-23 22:25:04,393 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:25:04,393 - distributed.worker - INFO - dashboard at: 127.0.0.1:35061 7222s 2024-11-23 22:25:04,393 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37835 7222s 2024-11-23 22:25:04,393 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:25:04,393 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:25:04,393 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:25:04,393 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-5k_329v2 7222s 2024-11-23 22:25:04,393 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:25:04,395 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44765 7222s 2024-11-23 22:25:04,395 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44765 7222s 2024-11-23 22:25:04,396 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:25:04,396 - distributed.worker - INFO - dashboard at: 127.0.0.1:34885 7222s 2024-11-23 22:25:04,396 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37835 7222s 2024-11-23 22:25:04,396 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:25:04,396 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:25:04,396 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:25:04,396 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-6v90y5lg 7222s 2024-11-23 22:25:04,396 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:25:04,399 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37499. Reason: failure-to-start- 7222s 2024-11-23 22:25:04,400 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:25:04,400 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44765. Reason: failure-to-start- 7222s 2024-11-23 22:25:04,400 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:25:04,402 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37835': TLS handshake failed with remote 'tls://127.0.0.1:59580': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:25:04,402 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37835': TLS handshake failed with remote 'tls://127.0.0.1:59582': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:25:04,404 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s 2024-11-23 22:25:05,409 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:25:05,430 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34599 7222s 2024-11-23 22:25:05,430 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45075/status 7222s 2024-11-23 22:25:05,430 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:25:05,450 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43639 7222s 2024-11-23 22:25:05,450 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43639 7222s 2024-11-23 22:25:05,450 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:25:05,451 - distributed.worker - INFO - dashboard at: 127.0.0.1:41607 7222s 2024-11-23 22:25:05,451 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34599 7222s 2024-11-23 22:25:05,451 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:25:05,451 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:25:05,451 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:25:05,451 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-4r0ia7pv 7222s 2024-11-23 22:25:05,451 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:25:05,453 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41819 7222s 2024-11-23 22:25:05,453 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41819 7222s 2024-11-23 22:25:05,453 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:25:05,453 - distributed.worker - INFO - dashboard at: 127.0.0.1:45893 7222s 2024-11-23 22:25:05,453 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34599 7222s 2024-11-23 22:25:05,453 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:25:05,453 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:25:05,453 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:25:05,453 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-rnzbacd0 7222s 2024-11-23 22:25:05,453 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:25:05,455 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43639. Reason: failure-to-start- 7222s 2024-11-23 22:25:05,455 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:25:05,455 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41819. Reason: failure-to-start- 7222s 2024-11-23 22:25:05,455 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:25:05,457 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34599': TLS handshake failed with remote 'tls://127.0.0.1:54130': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:25:05,457 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34599': TLS handshake failed with remote 'tls://127.0.0.1:54132': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:25:05,459 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s 2024-11-23 22:25:06,467 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:25:06,474 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34639 7222s 2024-11-23 22:25:06,475 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41505/status 7222s 2024-11-23 22:25:06,475 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:25:06,493 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45017 7222s 2024-11-23 22:25:06,493 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45017 7222s 2024-11-23 22:25:06,493 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:25:06,493 - distributed.worker - INFO - dashboard at: 127.0.0.1:33121 7222s 2024-11-23 22:25:06,493 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34639 7222s 2024-11-23 22:25:06,493 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:25:06,493 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:25:06,493 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:25:06,493 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-z1cviz67 7222s 2024-11-23 22:25:06,493 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:25:06,495 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45777 7222s 2024-11-23 22:25:06,496 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45777 7222s 2024-11-23 22:25:06,496 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:25:06,496 - distributed.worker - INFO - dashboard at: 127.0.0.1:38057 7222s 2024-11-23 22:25:06,496 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34639 7222s 2024-11-23 22:25:06,496 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:25:06,496 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:25:06,496 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:25:06,496 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-sh860d4l 7222s 2024-11-23 22:25:06,496 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:25:06,497 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45017. Reason: failure-to-start- 7222s 2024-11-23 22:25:06,498 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:25:06,498 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45777. Reason: failure-to-start- 7222s 2024-11-23 22:25:06,498 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:25:06,502 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34639': TLS handshake failed with remote 'tls://127.0.0.1:38578': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:25:06,503 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34639': TLS handshake failed with remote 'tls://127.0.0.1:38588': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:25:06,504 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s 2024-11-23 22:25:07,510 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:25:07,517 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45785 7222s 2024-11-23 22:25:07,517 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41009/status 7222s 2024-11-23 22:25:07,518 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:25:07,533 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45689 7222s 2024-11-23 22:25:07,533 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45689 7222s 2024-11-23 22:25:07,534 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:25:07,534 - distributed.worker - INFO - dashboard at: 127.0.0.1:34573 7222s 2024-11-23 22:25:07,534 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45785 7222s 2024-11-23 22:25:07,534 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:25:07,534 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:25:07,534 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:25:07,534 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-6cs80n5e 7222s 2024-11-23 22:25:07,534 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:25:07,536 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39823 7222s 2024-11-23 22:25:07,536 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39823 7222s 2024-11-23 22:25:07,536 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:25:07,536 - distributed.worker - INFO - dashboard at: 127.0.0.1:44361 7222s 2024-11-23 22:25:07,537 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45785 7222s 2024-11-23 22:25:07,537 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:25:07,537 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:25:07,537 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:25:07,537 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-658zz6hy 7222s 2024-11-23 22:25:07,537 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:25:07,539 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45689. Reason: failure-to-start- 7222s 2024-11-23 22:25:07,539 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:25:07,540 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39823. Reason: failure-to-start- 7222s 2024-11-23 22:25:07,540 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:25:07,544 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45785': TLS handshake failed with remote 'tls://127.0.0.1:43872': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:25:07,544 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45785': TLS handshake failed with remote 'tls://127.0.0.1:43876': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:25:07,546 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s 2024-11-23 22:25:08,551 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:25:08,558 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46069 7222s 2024-11-23 22:25:08,559 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33569/status 7222s 2024-11-23 22:25:08,559 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:25:08,574 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41249 7222s 2024-11-23 22:25:08,574 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41249 7222s 2024-11-23 22:25:08,574 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:25:08,574 - distributed.worker - INFO - dashboard at: 127.0.0.1:38361 7222s 2024-11-23 22:25:08,574 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 7222s 2024-11-23 22:25:08,574 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:25:08,574 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:25:08,574 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:25:08,574 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-5v4x94wh 7222s 2024-11-23 22:25:08,574 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:25:08,576 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39311 7222s 2024-11-23 22:25:08,576 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39311 7222s 2024-11-23 22:25:08,576 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:25:08,576 - distributed.worker - INFO - dashboard at: 127.0.0.1:34513 7222s 2024-11-23 22:25:08,577 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46069 7222s 2024-11-23 22:25:08,577 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:25:08,577 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:25:08,577 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:25:08,577 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-oj_v7nrn 7222s 2024-11-23 22:25:08,577 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:25:08,580 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41249. Reason: failure-to-start- 7222s 2024-11-23 22:25:08,581 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:25:08,581 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39311. Reason: failure-to-start- 7222s 2024-11-23 22:25:08,581 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:25:08,583 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:49730': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:25:08,583 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46069': TLS handshake failed with remote 'tls://127.0.0.1:49746': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:25:08,585 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s 2024-11-23 22:25:09,592 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:25:09,601 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45645 7222s 2024-11-23 22:25:09,601 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38573/status 7222s 2024-11-23 22:25:09,602 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:25:09,617 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45609 7222s 2024-11-23 22:25:09,617 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45609 7222s 2024-11-23 22:25:09,617 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:25:09,617 - distributed.worker - INFO - dashboard at: 127.0.0.1:34353 7222s 2024-11-23 22:25:09,617 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45645 7222s 2024-11-23 22:25:09,617 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:25:09,617 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:25:09,617 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:25:09,617 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-h8m7ocsn 7222s 2024-11-23 22:25:09,617 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:25:09,619 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33341 7222s 2024-11-23 22:25:09,619 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33341 7222s 2024-11-23 22:25:09,619 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:25:09,619 - distributed.worker - INFO - dashboard at: 127.0.0.1:44241 7222s 2024-11-23 22:25:09,619 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45645 7222s 2024-11-23 22:25:09,619 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:25:09,620 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:25:09,620 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:25:09,620 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-h7jkoqf0 7222s 2024-11-23 22:25:09,620 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:25:09,623 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45609. Reason: failure-to-start- 7222s 2024-11-23 22:25:09,623 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:25:09,623 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33341. Reason: failure-to-start- 7222s 2024-11-23 22:25:09,623 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:25:09,625 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45645': TLS handshake failed with remote 'tls://127.0.0.1:45880': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:25:09,625 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45645': TLS handshake failed with remote 'tls://127.0.0.1:45892': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:25:09,627 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s 2024-11-23 22:25:10,633 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:25:10,640 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39665 7222s 2024-11-23 22:25:10,640 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35315/status 7222s 2024-11-23 22:25:10,641 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:25:10,660 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41241 7222s 2024-11-23 22:25:10,660 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41241 7222s 2024-11-23 22:25:10,660 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:25:10,660 - distributed.worker - INFO - dashboard at: 127.0.0.1:40583 7222s 2024-11-23 22:25:10,660 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39665 7222s 2024-11-23 22:25:10,660 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:25:10,660 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:25:10,660 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:25:10,660 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-veaptj5w 7222s 2024-11-23 22:25:10,660 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:25:10,662 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35937 7222s 2024-11-23 22:25:10,662 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35937 7222s 2024-11-23 22:25:10,662 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:25:10,662 - distributed.worker - INFO - dashboard at: 127.0.0.1:46277 7222s 2024-11-23 22:25:10,662 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39665 7222s 2024-11-23 22:25:10,662 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:25:10,663 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:25:10,663 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:25:10,663 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-t69jobo1 7222s 2024-11-23 22:25:10,663 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:25:10,666 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41241. Reason: failure-to-start- 7222s 2024-11-23 22:25:10,666 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:25:10,667 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35937. Reason: failure-to-start- 7222s 2024-11-23 22:25:10,667 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:25:10,669 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39665': TLS handshake failed with remote 'tls://127.0.0.1:37986': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:25:10,669 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39665': TLS handshake failed with remote 'tls://127.0.0.1:38002': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:25:10,671 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s 2024-11-23 22:25:11,676 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:25:11,683 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35259 7222s 2024-11-23 22:25:11,684 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40783/status 7222s 2024-11-23 22:25:11,684 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:25:11,703 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44481 7222s 2024-11-23 22:25:11,703 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44481 7222s 2024-11-23 22:25:11,703 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:25:11,704 - distributed.worker - INFO - dashboard at: 127.0.0.1:37199 7222s 2024-11-23 22:25:11,704 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35259 7222s 2024-11-23 22:25:11,704 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:25:11,704 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:25:11,704 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:25:11,704 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-a5gabrs9 7222s 2024-11-23 22:25:11,704 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:25:11,706 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36755 7222s 2024-11-23 22:25:11,706 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36755 7222s 2024-11-23 22:25:11,706 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:25:11,706 - distributed.worker - INFO - dashboard at: 127.0.0.1:34905 7222s 2024-11-23 22:25:11,706 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35259 7222s 2024-11-23 22:25:11,706 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:25:11,706 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:25:11,706 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:25:11,706 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-78sbs03t 7222s 2024-11-23 22:25:11,706 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:25:11,709 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44481. Reason: failure-to-start- 7222s 2024-11-23 22:25:11,709 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:25:11,710 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36755. Reason: failure-to-start- 7222s 2024-11-23 22:25:11,710 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:25:11,714 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35259': TLS handshake failed with remote 'tls://127.0.0.1:49696': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:25:11,714 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35259': TLS handshake failed with remote 'tls://127.0.0.1:49710': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:25:11,716 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s 2024-11-23 22:25:12,723 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:25:12,734 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40761 7222s 2024-11-23 22:25:12,735 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43769/status 7222s 2024-11-23 22:25:12,735 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:25:12,760 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:32953 7222s 2024-11-23 22:25:12,761 - distributed.worker - INFO - Listening to: tls://127.0.0.1:32953 7222s 2024-11-23 22:25:12,761 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:25:12,761 - distributed.worker - INFO - dashboard at: 127.0.0.1:44867 7222s 2024-11-23 22:25:12,761 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40761 7222s 2024-11-23 22:25:12,761 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:25:12,761 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:25:12,761 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:25:12,761 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-lb_ys4q8 7222s 2024-11-23 22:25:12,761 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:25:12,764 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44299 7222s 2024-11-23 22:25:12,764 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44299 7222s 2024-11-23 22:25:12,764 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:25:12,765 - distributed.worker - INFO - dashboard at: 127.0.0.1:44663 7222s 2024-11-23 22:25:12,765 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40761 7222s 2024-11-23 22:25:12,765 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:25:12,765 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:25:12,765 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:25:12,765 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-z6jmyne2 7222s 2024-11-23 22:25:12,765 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:25:12,771 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:32953. Reason: failure-to-start- 7222s 2024-11-23 22:25:12,771 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:25:12,772 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44299. Reason: failure-to-start- 7222s 2024-11-23 22:25:12,772 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:25:12,778 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40761': TLS handshake failed with remote 'tls://127.0.0.1:34068': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:25:12,778 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40761': TLS handshake failed with remote 'tls://127.0.0.1:34074': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:25:12,785 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s 2024-11-23 22:25:13,792 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:25:13,806 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45375 7222s 2024-11-23 22:25:13,807 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44767/status 7222s 2024-11-23 22:25:13,807 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:25:13,834 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38065 7222s 2024-11-23 22:25:13,834 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38065 7222s 2024-11-23 22:25:13,834 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:25:13,834 - distributed.worker - INFO - dashboard at: 127.0.0.1:45091 7222s 2024-11-23 22:25:13,835 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45375 7222s 2024-11-23 22:25:13,835 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:25:13,835 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:25:13,835 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:25:13,835 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-mxuvysj_ 7222s 2024-11-23 22:25:13,835 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:25:13,838 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36959 7222s 2024-11-23 22:25:13,838 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36959 7222s 2024-11-23 22:25:13,838 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:25:13,838 - distributed.worker - INFO - dashboard at: 127.0.0.1:40039 7222s 2024-11-23 22:25:13,838 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45375 7222s 2024-11-23 22:25:13,838 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:25:13,838 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:25:13,839 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:25:13,839 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-_zefjx_m 7222s 2024-11-23 22:25:13,839 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:25:13,845 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38065. Reason: failure-to-start- 7222s 2024-11-23 22:25:13,845 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:25:13,846 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36959. Reason: failure-to-start- 7222s 2024-11-23 22:25:13,846 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:25:13,852 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45375': TLS handshake failed with remote 'tls://127.0.0.1:58520': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:25:13,852 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45375': TLS handshake failed with remote 'tls://127.0.0.1:58536': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:25:13,859 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s 2024-11-23 22:25:14,866 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:25:14,877 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45945 7222s 2024-11-23 22:25:14,878 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38797/status 7222s 2024-11-23 22:25:14,879 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:25:14,911 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40345 7222s 2024-11-23 22:25:14,911 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40345 7222s 2024-11-23 22:25:14,911 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:25:14,911 - distributed.worker - INFO - dashboard at: 127.0.0.1:37337 7222s 2024-11-23 22:25:14,911 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45945 7222s 2024-11-23 22:25:14,911 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:25:14,911 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:25:14,911 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:25:14,911 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-cw3l60kj 7222s 2024-11-23 22:25:14,912 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:25:14,915 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45451 7222s 2024-11-23 22:25:14,915 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45451 7222s 2024-11-23 22:25:14,915 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:25:14,916 - distributed.worker - INFO - dashboard at: 127.0.0.1:41851 7222s 2024-11-23 22:25:14,916 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45945 7222s 2024-11-23 22:25:14,916 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:25:14,916 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:25:14,916 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:25:14,916 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ugcaeshw 7222s 2024-11-23 22:25:14,916 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:25:14,923 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40345. Reason: failure-to-start- 7222s 2024-11-23 22:25:14,923 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:25:14,924 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45451. Reason: failure-to-start- 7222s 2024-11-23 22:25:14,924 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:25:14,927 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45945': TLS handshake failed with remote 'tls://127.0.0.1:54532': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:25:14,927 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45945': TLS handshake failed with remote 'tls://127.0.0.1:54544': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:25:14,935 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s ______________________________ test_work_stealing ______________________________ 7222s 7222s fut = , timeout = 0 7222s 7222s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 7222s async with asyncio.timeout(timeout): 7222s > return await fut 7222s 7222s /usr/lib/python3/dist-packages/distributed/utils.py:1960: 7222s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7222s /usr/lib/python3/dist-packages/distributed/worker.py:1480: in start_unsafe 7222s await self._register_with_scheduler() 7222s /usr/lib/python3/dist-packages/distributed/worker.py:1179: in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s /usr/lib/python3/dist-packages/distributed/comm/core.py:342: in connect 7222s comm = await wait_for( 7222s /usr/lib/python3/dist-packages/distributed/utils.py:1960: in wait_for 7222s return await fut 7222s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:546: in connect 7222s stream = await self.client.connect( 7222s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7222s 7222s self = , host = '127.0.0.1' 7222s port = 46177, af = 7222s ssl_options = 7222s max_buffer_size = 8364507136.0, source_ip = None, source_port = None 7222s timeout = None 7222s 7222s async def connect( 7222s self, 7222s host: str, 7222s port: int, 7222s af: socket.AddressFamily = socket.AF_UNSPEC, 7222s ssl_options: Optional[Union[Dict[str, Any], ssl.SSLContext]] = None, 7222s max_buffer_size: Optional[int] = None, 7222s source_ip: Optional[str] = None, 7222s source_port: Optional[int] = None, 7222s timeout: Optional[Union[float, datetime.timedelta]] = None, 7222s ) -> IOStream: 7222s """Connect to the given host and port. 7222s 7222s Asynchronously returns an `.IOStream` (or `.SSLIOStream` if 7222s ``ssl_options`` is not None). 7222s 7222s Using the ``source_ip`` kwarg, one can specify the source 7222s IP address to use when establishing the connection. 7222s In case the user needs to resolve and 7222s use a specific interface, it has to be handled outside 7222s of Tornado as this depends very much on the platform. 7222s 7222s Raises `TimeoutError` if the input future does not complete before 7222s ``timeout``, which may be specified in any form allowed by 7222s `.IOLoop.add_timeout` (i.e. a `datetime.timedelta` or an absolute time 7222s relative to `.IOLoop.time`) 7222s 7222s Similarly, when the user requires a certain source port, it can 7222s be specified using the ``source_port`` arg. 7222s 7222s .. versionchanged:: 4.5 7222s Added the ``source_ip`` and ``source_port`` arguments. 7222s 7222s .. versionchanged:: 5.0 7222s Added the ``timeout`` argument. 7222s """ 7222s if timeout is not None: 7222s if isinstance(timeout, numbers.Real): 7222s timeout = IOLoop.current().time() + timeout 7222s elif isinstance(timeout, datetime.timedelta): 7222s timeout = IOLoop.current().time() + timeout.total_seconds() 7222s else: 7222s raise TypeError("Unsupported timeout %r" % timeout) 7222s if timeout is not None: 7222s addrinfo = await gen.with_timeout( 7222s timeout, self.resolver.resolve(host, port, af) 7222s ) 7222s else: 7222s addrinfo = await self.resolver.resolve(host, port, af) 7222s connector = _Connector( 7222s addrinfo, 7222s functools.partial( 7222s self._create_stream, 7222s max_buffer_size, 7222s source_ip=source_ip, 7222s source_port=source_port, 7222s ), 7222s ) 7222s > af, addr, stream = await connector.start(connect_timeout=timeout) 7222s E asyncio.exceptions.CancelledError 7222s 7222s /usr/lib/python3/dist-packages/tornado/tcpclient.py:279: CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s self = 7222s 7222s @final 7222s async def start(self): 7222s async with self._startup_lock: 7222s if self.status == Status.failed: 7222s assert self.__startup_exc is not None 7222s raise self.__startup_exc 7222s elif self.status != Status.init: 7222s return self 7222s timeout = getattr(self, "death_timeout", None) 7222s 7222s async def _close_on_failure(exc: Exception) -> None: 7222s await self.close(reason=f"failure-to-start-{str(type(exc))}") 7222s self.status = Status.failed 7222s self.__startup_exc = exc 7222s 7222s try: 7222s > await wait_for(self.start_unsafe(), timeout=timeout) 7222s 7222s /usr/lib/python3/dist-packages/distributed/core.py:664: 7222s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7222s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 7222s async with asyncio.timeout(timeout): 7222s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7222s 7222s self = 7222s exc_type = 7222s exc_val = CancelledError(), exc_tb = 7222s 7222s async def __aexit__( 7222s self, 7222s exc_type: Optional[Type[BaseException]], 7222s exc_val: Optional[BaseException], 7222s exc_tb: Optional[TracebackType], 7222s ) -> Optional[bool]: 7222s assert self._state in (_State.ENTERED, _State.EXPIRING) 7222s 7222s if self._timeout_handler is not None: 7222s self._timeout_handler.cancel() 7222s self._timeout_handler = None 7222s 7222s if self._state is _State.EXPIRING: 7222s self._state = _State.EXPIRED 7222s 7222s if self._task.uncancel() <= self._cancelling and exc_type is not None: 7222s # Since there are no new cancel requests, we're 7222s # handling this. 7222s if issubclass(exc_type, exceptions.CancelledError): 7222s > raise TimeoutError from exc_val 7222s E TimeoutError 7222s 7222s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s @contextlib.asynccontextmanager 7222s async def _cluster_factory(): 7222s workers = [] 7222s s = None 7222s try: 7222s for _ in range(60): 7222s try: 7222s > s, ws = await start_cluster( 7222s nthreads, 7222s scheduler, 7222s security=security, 7222s Worker=Worker, 7222s scheduler_kwargs=scheduler_kwargs, 7222s worker_kwargs=merge( 7222s {"death_timeout": min(15, int(deadline.remaining))}, 7222s worker_kwargs, 7222s ), 7222s ) 7222s 7222s /usr/lib/python3/dist-packages/distributed/utils_test.py:966: 7222s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7222s /usr/lib/python3/dist-packages/distributed/utils_test.py:789: in start_cluster 7222s await asyncio.gather(*workers) 7222s /usr/lib/python3.13/asyncio/tasks.py:737: in _wrap_awaitable 7222s return await awaitable 7222s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7222s 7222s self = 7222s 7222s @final 7222s async def start(self): 7222s async with self._startup_lock: 7222s if self.status == Status.failed: 7222s assert self.__startup_exc is not None 7222s raise self.__startup_exc 7222s elif self.status != Status.init: 7222s return self 7222s timeout = getattr(self, "death_timeout", None) 7222s 7222s async def _close_on_failure(exc: Exception) -> None: 7222s await self.close(reason=f"failure-to-start-{str(type(exc))}") 7222s self.status = Status.failed 7222s self.__startup_exc = exc 7222s 7222s try: 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s except asyncio.TimeoutError as exc: 7222s await _close_on_failure(exc) 7222s > raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s E TimeoutError: Worker start timed out after 0s. 7222s 7222s /usr/lib/python3/dist-packages/distributed/core.py:667: TimeoutError 7222s 7222s During handling of the above exception, another exception occurred: 7222s 7222s fut = ._..test_func..async_fn at 0xe9b48110> 7222s timeout = 60 7222s 7222s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 7222s async with asyncio.timeout(timeout): 7222s > return await fut 7222s 7222s /usr/lib/python3/dist-packages/distributed/utils.py:1960: 7222s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7222s /usr/lib/python3/dist-packages/distributed/utils_test.py:999: in async_fn 7222s _cluster_factory() as (s, workers), 7222s /usr/lib/python3.13/contextlib.py:214: in __aenter__ 7222s return await anext(self.gen) 7222s /usr/lib/python3/dist-packages/distributed/utils_test.py:983: in _cluster_factory 7222s await asyncio.sleep(1) 7222s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7222s 7222s delay = 1, result = None 7222s 7222s async def sleep(delay, result=None): 7222s """Coroutine that completes after a given time (in seconds).""" 7222s if delay <= 0: 7222s await __sleep0() 7222s return result 7222s 7222s if math.isnan(delay): 7222s raise ValueError("Invalid delay: NaN (not a number)") 7222s 7222s loop = events.get_running_loop() 7222s future = loop.create_future() 7222s h = loop.call_later(delay, 7222s futures._set_result_unless_cancelled, 7222s future, result) 7222s try: 7222s > return await future 7222s E asyncio.exceptions.CancelledError 7222s 7222s /usr/lib/python3.13/asyncio/tasks.py:718: CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s args = (), kwds = {} 7222s 7222s @wraps(func) 7222s def inner(*args, **kwds): 7222s with self._recreate_cm(): 7222s > return func(*args, **kwds) 7222s 7222s /usr/lib/python3.13/contextlib.py:85: 7222s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7222s /usr/lib/python3.13/contextlib.py:85: in inner 7222s return func(*args, **kwds) 7222s /usr/lib/python3/dist-packages/distributed/utils_test.py:1102: in test_func 7222s return _run_and_close_tornado(async_fn_outer) 7222s /usr/lib/python3/dist-packages/distributed/utils_test.py:378: in _run_and_close_tornado 7222s return asyncio_run(inner_fn(), loop_factory=get_loop_factory()) 7222s /usr/lib/python3.13/asyncio/runners.py:194: in run 7222s return runner.run(main) 7222s /usr/lib/python3.13/asyncio/runners.py:118: in run 7222s return self._loop.run_until_complete(task) 7222s /usr/lib/python3.13/asyncio/base_events.py:720: in run_until_complete 7222s return future.result() 7222s /usr/lib/python3/dist-packages/distributed/utils_test.py:375: in inner_fn 7222s return await async_fn(*args, **kwargs) 7222s /usr/lib/python3/dist-packages/distributed/utils_test.py:1099: in async_fn_outer 7222s return await utils_wait_for(async_fn(), timeout=timeout * 2) 7222s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 7222s async with asyncio.timeout(timeout): 7222s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7222s 7222s self = 7222s exc_type = 7222s exc_val = CancelledError(), exc_tb = 7222s 7222s async def __aexit__( 7222s self, 7222s exc_type: Optional[Type[BaseException]], 7222s exc_val: Optional[BaseException], 7222s exc_tb: Optional[TracebackType], 7222s ) -> Optional[bool]: 7222s assert self._state in (_State.ENTERED, _State.EXPIRING) 7222s 7222s if self._timeout_handler is not None: 7222s self._timeout_handler.cancel() 7222s self._timeout_handler = None 7222s 7222s if self._state is _State.EXPIRING: 7222s self._state = _State.EXPIRED 7222s 7222s if self._task.uncancel() <= self._cancelling and exc_type is not None: 7222s # Since there are no new cancel requests, we're 7222s # handling this. 7222s if issubclass(exc_type, exceptions.CancelledError): 7222s > raise TimeoutError from exc_val 7222s E TimeoutError 7222s 7222s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 7222s ----------------------------- Captured stderr call ----------------------------- 7222s 2024-11-23 22:25:16,333 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:25:16,345 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:16,345 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:32775/status 7222s 2024-11-23 22:25:16,346 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:25:16,369 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44151 7222s 2024-11-23 22:25:16,369 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44151 7222s 2024-11-23 22:25:16,370 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:25:16,370 - distributed.worker - INFO - dashboard at: 127.0.0.1:40281 7222s 2024-11-23 22:25:16,370 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:16,370 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:25:16,370 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:25:16,370 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:25:16,370 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-nymx2o8n 7222s 2024-11-23 22:25:16,370 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:25:16,373 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38761 7222s 2024-11-23 22:25:16,374 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38761 7222s 2024-11-23 22:25:16,374 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:25:16,374 - distributed.worker - INFO - dashboard at: 127.0.0.1:35995 7222s 2024-11-23 22:25:16,374 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:16,374 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:25:16,374 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:25:16,374 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:25:16,374 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-5640aj5l 7222s 2024-11-23 22:25:16,374 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:25:16,390 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:16,390 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:16,391 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:58154': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:16,391 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:58168': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:16,506 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:16,507 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:16,507 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:58172': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:16,507 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:58188': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:16,622 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:16,623 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:16,623 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:58190': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:16,624 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:58204': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:16,741 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:16,741 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:16,742 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:58208': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:16,742 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:58210': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:16,857 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:16,858 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:16,863 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:58216': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:16,863 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:58222': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:16,973 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:16,973 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:16,974 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:58234': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:16,974 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:58244': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:17,090 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:17,091 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:17,091 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:58250': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:17,091 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:58256': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:17,206 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:17,207 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:17,207 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:58266': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:17,208 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:58280': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:17,322 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:17,323 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:17,324 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:58292': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:17,324 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:58304': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:17,439 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:17,440 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:17,441 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:58312': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:17,441 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:58314': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:17,556 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:17,556 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:17,557 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:58326': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:17,557 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:58336': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:17,673 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:17,673 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:17,674 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:58348': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:17,674 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:58358': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:17,790 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:17,790 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:17,791 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:58362': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:17,791 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:58370': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:17,906 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:17,906 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:17,907 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:58384': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:17,907 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:58394': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:18,023 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:18,024 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:18,025 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:58408': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:18,025 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:58416': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:18,140 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:18,140 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:18,141 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:58426': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:18,141 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:58430': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:18,257 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:18,258 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:18,258 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:58446': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:18,259 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:58454': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:18,373 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:18,374 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:18,375 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:58462': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:18,375 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:58470': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:18,493 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:18,494 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:18,495 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:58476': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:18,495 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:58478': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:18,610 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:18,611 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:18,611 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:58486': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:18,612 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:58496': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:18,727 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:18,727 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:18,728 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:58504': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:18,728 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:58512': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:18,844 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:18,844 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:18,845 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:58524': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:18,845 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:58526': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:18,961 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:18,961 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:18,962 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:58542': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:18,962 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:58556': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:19,077 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:19,078 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:19,079 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:58558': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:19,079 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:58568': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:19,194 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:19,195 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:19,195 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:58584': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:19,195 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:58590': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:19,311 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:19,311 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:19,312 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:58592': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:19,312 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:58602': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:19,428 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:19,428 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:19,429 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:58612': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:19,429 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:58618': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:19,545 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:19,545 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:19,546 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:58634': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:19,546 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:58638': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:19,661 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:19,661 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:19,662 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:58652': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:19,662 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:58668': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:19,777 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:19,778 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:19,778 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:58680': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:19,779 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:58690': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:19,895 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:19,895 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:19,896 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:58692': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:19,896 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:58704': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:20,012 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:20,012 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:20,013 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:58710': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:20,013 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:58720': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:20,128 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:20,129 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:20,130 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:58732': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:20,130 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:58742': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:20,245 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:20,245 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:20,246 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:58758': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:20,246 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:58772': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:20,369 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:20,370 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:20,370 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:58780': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:20,370 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:58790': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:20,486 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:20,486 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:20,487 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:58796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:20,487 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:58804': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:20,603 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:20,603 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:20,604 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:58810': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:20,604 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:58814': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:20,719 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:20,720 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:20,720 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:58822': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:20,721 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:58828': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:20,837 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:20,838 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:20,838 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:58830': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:20,839 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:58832': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:20,954 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:20,954 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:20,955 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:58840': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:20,955 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:58850': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:21,070 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:21,070 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:21,071 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:58864': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:21,071 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:58874': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:21,186 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:21,186 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:21,187 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:58888': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:21,187 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:58902': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:21,303 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:21,303 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:21,304 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:58918': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:21,304 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:58932': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:21,419 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:21,420 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:21,420 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:58942': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:21,421 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:58954': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:21,537 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:21,537 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:21,538 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:58964': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:21,538 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:58976': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:21,653 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:21,654 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:21,654 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:34226': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:21,655 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:34236': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:21,770 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:21,771 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:21,771 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:34242': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:21,772 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:34244': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:21,886 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:21,887 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:21,887 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:34254': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:21,888 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:34266': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:22,003 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:22,004 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:22,004 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:34268': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:22,005 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:34284': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:22,119 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:22,119 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:22,120 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:34292': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:22,120 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:34300': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:22,239 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:22,239 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:22,240 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:34302': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:22,240 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:34306': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:22,356 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:22,356 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:22,362 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:34314': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:22,362 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:34324': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:22,472 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:22,472 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:22,473 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:34330': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:22,473 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:34340': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:22,588 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:22,588 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:22,589 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:34352': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:22,589 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:34362': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:22,704 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:22,705 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:22,705 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:34372': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:22,706 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:34382': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:22,821 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:22,821 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:22,822 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:34396': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:22,822 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:34402': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:22,937 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:22,937 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:22,938 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:34412': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:22,938 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:34428': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:23,054 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:23,054 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:23,055 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:34440': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:23,055 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:34444': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:23,165 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:23,170 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:34448': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:23,172 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:23,172 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:34460': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:23,275 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:23,276 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:34476': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:23,284 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:23,285 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:34490': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:23,384 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:23,385 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:34500': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:23,393 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:23,394 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:34512': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:23,493 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:23,494 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:34524': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:23,503 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:23,503 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:34528': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:23,603 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:23,604 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:34536': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:23,612 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:23,613 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:34548': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:23,713 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:23,714 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:34562': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:23,722 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:23,723 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:34564': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:23,823 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:23,824 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:34576': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:23,832 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:23,833 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:34590': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:23,934 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:23,936 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:34592': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:23,943 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:23,944 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:34598': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:24,047 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:24,049 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:34612': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:24,056 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:24,057 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:34622': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:24,156 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:24,157 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:34634': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:24,165 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:24,166 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:34636': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:24,266 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:24,266 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:34650': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:24,274 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:24,275 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:34660': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:24,376 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:24,377 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:34672': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:24,385 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:24,386 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:34674': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:24,486 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:24,487 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:34688': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:24,495 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:24,496 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:34692': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:24,595 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:24,596 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:34704': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:24,604 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:24,605 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:34706': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:24,705 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:24,706 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:34720': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:24,714 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:24,715 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:34722': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:24,815 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:24,816 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:34734': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:24,824 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:24,825 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:34738': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:24,924 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:24,925 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:34742': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:24,933 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:24,934 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:34750': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:25,034 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:25,035 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:34764': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:25,043 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:25,044 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:34776': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:25,143 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:25,144 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:34782': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:25,153 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:25,153 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:34794': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:25,254 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:25,255 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:34810': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:25,263 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:25,264 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:34824': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:25,363 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:25,364 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:34828': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:25,372 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:25,373 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:34836': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:25,473 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:25,474 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:34838': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:25,482 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:25,483 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:34840': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:25,584 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:25,586 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:34856': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:25,594 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:25,594 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:34862': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:25,694 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:25,695 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:34872': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:25,706 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:25,706 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:34882': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:25,804 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:25,805 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:34898': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:25,814 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:25,815 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:34902': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:25,914 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:25,914 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:34908': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:25,924 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:25,925 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:34916': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:26,024 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:26,025 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:34930': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:26,033 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:26,034 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:34934': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:26,134 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:26,135 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:34946': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:26,143 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:26,144 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:34956': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:26,244 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:26,244 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:34964': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:26,253 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:26,254 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:34972': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:26,359 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:26,360 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:34982': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:26,368 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:26,368 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:34990': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:26,468 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:26,469 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:34992': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:26,477 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:26,478 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:35006': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:26,578 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:26,578 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:35020': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:26,587 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:26,587 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:35022': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:26,687 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:26,688 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:35034': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:26,697 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:26,697 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:35046': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:26,797 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:26,798 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:35060': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:26,806 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:26,807 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:35070': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:26,907 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:26,908 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:35074': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:26,916 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:26,917 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:35078': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:27,016 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:27,017 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:35092': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:27,025 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:27,026 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:35108': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:27,126 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:27,127 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:35118': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:27,135 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:27,136 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:35126': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:27,235 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:27,236 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:35142': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:27,244 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:27,245 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:35150': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:27,346 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:27,347 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:35162': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:27,366 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:27,367 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:35178': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:27,456 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:27,457 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:35188': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:27,476 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:27,477 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:35200': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:27,566 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:27,567 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:35214': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:27,586 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:27,587 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:35220': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:27,676 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:27,676 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:35230': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:27,695 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:27,696 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:35236': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:27,786 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:27,786 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:35238': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:27,805 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:27,806 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:35252': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:27,895 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:27,896 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:35258': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:27,915 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:27,916 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:35272': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:28,004 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:28,005 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:35278': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:28,025 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:28,025 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:35292': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:28,114 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:28,115 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:35296': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:28,134 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:28,135 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:35302': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:28,225 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:28,225 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:35310': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:28,244 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:28,245 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:35324': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:28,335 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:28,335 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:35330': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:28,359 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:28,360 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:35336': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:28,444 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:28,445 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:35352': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:28,469 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:28,470 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:35368': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:28,555 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:28,555 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:35384': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:28,579 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:28,580 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:35390': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:28,664 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:28,665 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:35400': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:28,689 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:28,690 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:35412': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:28,775 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:28,776 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:35426': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:28,799 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:28,800 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:35436': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:28,885 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:28,885 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:35440': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:28,908 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:28,909 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:35452': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:28,994 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:28,995 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:35462': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:29,018 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:29,019 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:35466': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:29,107 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:29,108 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:35482': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:29,128 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:29,129 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:35488': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:29,217 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:29,218 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:35502': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:29,238 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:29,238 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:35506': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:29,328 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:29,329 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:35516': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:29,348 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:29,349 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:35528': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:29,438 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:29,439 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:35542': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:29,457 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:29,458 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:35550': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:29,548 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:29,549 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:35558': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:29,568 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:29,569 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:35564': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:29,658 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:29,659 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:35576': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:29,677 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:29,678 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:35584': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:29,767 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:29,768 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:35588': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:29,787 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:29,788 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:35596': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:29,877 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:29,878 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:35606': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:29,897 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:29,898 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:35618': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:29,987 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:29,987 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:35628': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:30,006 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:30,007 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:35638': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:30,097 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:30,097 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:35652': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:30,117 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:30,117 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:35654': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:30,206 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:30,207 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:35670': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:30,226 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:30,227 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:35686': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:30,316 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:30,317 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:35696': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:30,335 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:30,336 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:35698': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:30,425 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:30,426 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:35702': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:30,445 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:30,446 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:35708': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:30,536 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:30,536 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:35714': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:30,556 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:30,556 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:35728': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:30,645 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:30,646 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:35742': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:30,666 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:30,667 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:35758': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:30,755 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:30,756 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:35768': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:30,778 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:30,779 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:35772': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:30,865 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:30,866 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:35774': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:30,889 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:30,890 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:35778': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:30,975 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:30,976 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:35788': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:30,999 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:31,000 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:35792': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:31,084 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:31,085 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:35794': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:31,109 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:31,109 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:35800': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:31,194 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:31,195 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:35806': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:31,218 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:31,219 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:35808': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:31,304 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:31,305 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:35824': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:31,328 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37199 7222s 2024-11-23 22:25:31,328 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37199': TLS handshake failed with remote 'tls://127.0.0.1:35832': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:31,367 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44151. Reason: failure-to-start- 7222s 2024-11-23 22:25:31,368 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:25:31,371 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 15s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 7222s stream = await stream.start_tls( 7222s ^^^^^^^^^^^^^^^^^^^^^^^ 7222s False, ssl_options=ssl_options, server_hostname=host 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 7222s self.socket.do_handshake() 7222s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 7222s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 7222s self._sslobj.do_handshake() 7222s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 7222s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 7222s raise FatalCommClosedError( 7222s ...<2 lines>... 7222s ) from err 7222s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 7222s 7222s During handling of the above exception, another exception occurred: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1218, in _register_with_scheduler 7222s await asyncio.sleep(0.1) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 718, in sleep 7222s return await future 7222s ^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 15s. 7222s 2024-11-23 22:25:31,376 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38761. Reason: failure-to-start- 7222s 2024-11-23 22:25:31,376 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:25:32,380 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:25:32,393 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:32,394 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41879/status 7222s 2024-11-23 22:25:32,395 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:25:32,420 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39181 7222s 2024-11-23 22:25:32,420 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39181 7222s 2024-11-23 22:25:32,420 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:25:32,420 - distributed.worker - INFO - dashboard at: 127.0.0.1:36135 7222s 2024-11-23 22:25:32,420 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:32,420 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:25:32,420 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:25:32,421 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:25:32,421 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-gc1m2oz6 7222s 2024-11-23 22:25:32,421 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:25:32,427 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36785 7222s 2024-11-23 22:25:32,427 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36785 7222s 2024-11-23 22:25:32,427 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:25:32,427 - distributed.worker - INFO - dashboard at: 127.0.0.1:42147 7222s 2024-11-23 22:25:32,427 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:32,427 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:25:32,427 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:25:32,427 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:25:32,427 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ncsl1vyh 7222s 2024-11-23 22:25:32,428 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:25:32,444 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:32,444 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:32,445 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:53396': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:32,445 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:53406': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:32,561 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:32,561 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:32,562 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:53408': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:32,562 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:53414': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:32,677 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:32,678 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:32,678 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:53428': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:32,679 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:53438': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:32,794 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:32,794 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:32,795 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:53442': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:32,795 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:53448': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:32,915 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:32,916 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:32,916 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:53452': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:32,916 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:53454': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:33,032 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:33,032 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:33,033 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:53466': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:33,033 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:53468': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:33,148 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:33,148 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:33,149 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:53482': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:33,149 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:53496': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:33,263 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:33,264 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:33,264 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:53508': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:33,265 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:53524': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:33,381 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:33,381 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:33,382 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:53536': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:33,382 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:53542': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:33,497 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:33,498 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:33,498 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:53558': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:33,499 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:53568': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:33,613 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:33,614 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:33,614 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:53578': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:33,615 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:53584': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:33,732 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:33,733 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:33,733 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:53594': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:33,734 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:53608': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:33,848 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:33,849 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:33,849 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:53610': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:33,850 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:53618': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:33,959 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:33,964 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:53632': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:33,966 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:33,967 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:53638': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:34,072 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:34,073 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:53648': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:34,081 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:34,082 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:53662': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:34,183 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:34,184 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:53668': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:34,192 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:34,193 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:53678': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:34,293 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:34,294 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:53680': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:34,302 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:34,303 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:53690': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:34,408 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:34,409 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:53692': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:34,417 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:34,418 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:53700': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:34,519 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:34,520 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:53702': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:34,528 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:34,529 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:53710': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:34,629 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:34,630 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:53722': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:34,638 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:34,639 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:53732': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:34,738 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:34,739 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:53744': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:34,747 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:34,748 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:53748': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:34,847 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:34,848 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:53756': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:34,861 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:34,862 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:53768': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:34,957 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:34,958 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:53776': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:34,970 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:34,971 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:53788': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:35,067 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:35,068 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:53800': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:35,079 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:35,080 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:53814': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:35,177 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:35,178 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:53822': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:35,188 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:35,189 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:53824': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:35,287 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:35,288 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:53840': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:35,297 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:35,298 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:53848': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:35,397 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:35,402 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:53862': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:35,411 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:35,411 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:53874': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:35,507 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:35,508 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:53878': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:35,520 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:35,520 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:53890': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:35,616 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:35,617 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:53904': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:35,629 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:35,630 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:53916': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:35,726 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:35,727 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:53926': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:35,741 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:35,742 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:53932': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:35,836 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:35,836 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:53940': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:35,850 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:35,856 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:53946': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:35,946 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:35,947 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:53954': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:35,959 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:35,960 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:53958': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:36,056 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:36,056 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:53972': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:36,068 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:36,069 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:53978': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:36,166 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:36,166 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:53984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:36,177 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:36,177 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:53990': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:36,275 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:36,276 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:54004': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:36,285 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:36,286 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:54010': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:36,384 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:36,385 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:54012': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:36,394 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:36,395 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:54024': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:36,494 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:36,495 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:54026': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:36,503 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:36,504 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:54036': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:36,603 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:36,604 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:54048': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:36,612 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:36,613 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:54054': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:36,714 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:36,716 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:54060': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:36,723 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:36,723 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:54062': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:36,823 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:36,824 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:54070': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:36,832 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:36,833 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:54074': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:36,932 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:36,933 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:54084': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:36,941 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:36,942 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:54098': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:37,041 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:37,042 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:54112': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:37,050 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:37,051 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:54128': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:37,151 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:37,152 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:54144': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:37,160 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:37,161 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:54148': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:37,260 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:37,261 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:54154': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:37,269 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:37,270 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:54156': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:37,370 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:37,371 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:54172': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:37,379 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:37,380 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:54180': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:37,480 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:37,481 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:54182': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:37,489 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:37,489 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:54192': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:37,590 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:37,591 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:54200': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:37,599 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:37,599 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:54210': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:37,699 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:37,700 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:54222': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:37,708 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:37,709 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:54226': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:37,809 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:37,810 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:54242': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:37,818 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:37,818 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:54244': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:37,919 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:37,919 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:54254': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:37,927 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:37,928 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:54264': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:38,028 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:38,029 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:54268': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:38,036 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:38,037 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:54282': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:38,137 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:38,138 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:54292': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:38,146 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:38,146 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:54296': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:38,246 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:38,247 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:54312': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:38,255 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:38,255 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:54320': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:38,360 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:38,361 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:54326': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:38,369 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:38,369 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:54338': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:38,470 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:38,470 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:54344': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:38,478 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:38,479 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:54356': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:38,579 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:38,580 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:54364': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:38,588 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:38,589 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:54372': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:38,688 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:38,689 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:54384': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:38,697 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:38,698 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:54388': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:38,798 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:38,798 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:54392': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:38,806 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:38,807 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:54404': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:38,909 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:38,910 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:54412': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:38,917 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:38,918 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:54422': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:39,019 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:39,019 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:54426': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:39,027 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:39,028 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:54434': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:39,130 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:39,132 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:54436': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:39,139 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:39,140 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:54448': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:39,240 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:39,240 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:54452': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:39,248 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:39,249 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:54456': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:39,349 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:39,355 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:54462': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:39,363 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:39,363 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:54478': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:39,458 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:39,458 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:54484': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:39,471 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:39,472 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:54486': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:39,567 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:39,568 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:54488': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:39,580 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:39,580 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:54500': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:39,676 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:39,677 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:54506': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:39,688 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:39,688 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:54508': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:39,785 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:39,785 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:54510': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:39,796 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:39,797 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:54512': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:39,894 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:39,894 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:54516': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:39,908 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:39,908 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:54524': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:40,002 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:40,003 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:54534': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:40,016 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:40,017 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:54548': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:40,111 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:40,112 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:54556': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:40,125 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:40,126 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:54560': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:40,220 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:40,221 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:54570': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:40,234 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:40,234 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:54582': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:40,331 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:40,331 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:54590': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:40,342 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:40,343 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:54592': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:40,440 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:40,441 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:54606': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:40,451 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:40,452 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:54620': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:40,549 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:40,550 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:54628': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:40,560 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:40,560 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:54638': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:40,658 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:40,659 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:54642': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:40,668 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:40,668 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:54658': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:40,767 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:40,768 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:54668': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:40,779 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:40,780 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:54682': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:40,876 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:40,877 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:54696': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:40,887 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:40,888 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:54708': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:40,985 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:40,986 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:54710': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:40,996 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:40,997 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:54726': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:41,094 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:41,095 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:54730': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:41,105 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:41,106 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:54738': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:41,204 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:41,205 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:54740': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:41,213 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:41,214 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:54750': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:41,314 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:41,315 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:54764': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:41,323 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:41,324 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:54780': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:41,424 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:41,425 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:54796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:41,433 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:41,434 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:54798': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:41,534 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:41,535 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:52896': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:41,543 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:41,543 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:52910': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:41,643 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:41,644 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:52920': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:41,652 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:41,653 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:52928': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:41,752 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:41,753 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:52942': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:41,761 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:41,762 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:52952': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:41,861 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:41,862 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:52958': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:41,870 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:41,870 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:52974': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:41,970 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:41,971 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:52986': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:41,979 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:41,980 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:53002': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:42,080 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:42,081 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:53010': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:42,089 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:42,089 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:53024': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:42,189 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:42,190 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:53036': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:42,198 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:42,199 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:53052': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:42,299 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:42,300 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:53056': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:42,308 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:42,308 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:53068': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:42,408 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:42,409 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:53070': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:42,416 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:42,419 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:53078': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:42,518 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:42,519 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:53082': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:42,528 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:42,528 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:53086': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:42,627 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:42,628 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:53092': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:42,637 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:42,637 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:53094': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:42,736 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:42,737 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:53108': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:42,746 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:42,746 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:53116': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:42,845 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:42,846 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:53132': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:42,858 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:42,859 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:53136': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:42,955 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:42,956 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:53138': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:42,967 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:42,967 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:53154': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:43,065 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:43,065 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:53158': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:43,076 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:43,076 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:53170': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:43,175 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:43,176 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:53178': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:43,184 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:43,185 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:53184': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:43,284 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:43,285 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:53190': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:43,293 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:43,294 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:53198': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:43,394 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:43,394 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:53208': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:43,408 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:43,409 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:53212': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:43,503 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:43,504 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:53218': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:43,517 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:43,518 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:53226': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:43,612 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:43,613 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:53236': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:43,627 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:43,627 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:53250': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:43,721 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:43,722 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:53256': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:43,736 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:43,736 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:53272': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:43,832 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:43,832 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:53278': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:43,845 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:43,845 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:53280': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:43,941 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:43,942 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:53296': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:43,954 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:43,955 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:53312': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:44,051 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:44,052 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:53314': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:44,063 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:44,064 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:53326': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:44,162 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:44,163 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:53340': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:44,172 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:44,173 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:53346': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:44,271 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:44,272 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:53356': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:44,281 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:44,282 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:53364': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:44,381 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:44,382 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:53378': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:44,389 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:44,390 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:53394': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:44,490 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:44,491 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:53402': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:44,499 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:44,499 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:53412': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:44,600 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:44,601 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:53420': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:44,609 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:44,610 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:53434': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:44,709 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:44,710 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:53444': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:44,718 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:44,719 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:53458': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:44,819 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:44,820 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:53468': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:44,828 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:44,828 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:53480': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:44,929 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:44,930 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:53494': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:44,938 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:44,938 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:53498': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:45,038 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:45,039 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:53500': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:45,047 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:45,048 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:53512': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:45,147 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:45,148 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:53522': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:45,156 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:45,157 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:53530': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:45,257 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:45,257 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:53544': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:45,265 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:45,266 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:53554': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:45,365 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:45,366 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:53566': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:45,375 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36271 7222s 2024-11-23 22:25:45,375 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36271': TLS handshake failed with remote 'tls://127.0.0.1:53576': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:25:45,419 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39181. Reason: failure-to-start- 7222s 2024-11-23 22:25:45,419 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:25:45,421 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 13s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 7222s stream = await stream.start_tls( 7222s ^^^^^^^^^^^^^^^^^^^^^^^ 7222s False, ssl_options=ssl_options, server_hostname=host 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 7222s self.socket.do_handshake() 7222s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 7222s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 7222s self._sslobj.do_handshake() 7222s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 7222s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 7222s raise FatalCommClosedError( 7222s ...<2 lines>... 7222s ) from err 7222s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 7222s 7222s During handling of the above exception, another exception occurred: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1218, in _register_with_scheduler 7222s await asyncio.sleep(0.1) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 718, in sleep 7222s return await future 7222s ^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 13s. 7222s 2024-11-23 22:25:45,424 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36785. Reason: failure-to-start- 7222s 2024-11-23 22:25:45,424 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:25:46,429 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:25:46,438 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43939 7222s 2024-11-23 22:25:46,439 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34871/status 7222s 2024-11-23 22:25:46,439 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:25:46,456 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39529 7222s 2024-11-23 22:25:46,456 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39529 7222s 2024-11-23 22:25:46,456 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:25:46,456 - distributed.worker - INFO - dashboard at: 127.0.0.1:40145 7222s 2024-11-23 22:25:46,456 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43939 7222s 2024-11-23 22:25:46,456 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:25:46,456 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:25:46,457 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:25:46,457 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-nhg1i6mz 7222s 2024-11-23 22:25:46,457 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:25:46,459 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34849 7222s 2024-11-23 22:25:46,459 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34849 7222s 2024-11-23 22:25:46,459 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:25:46,459 - distributed.worker - INFO - dashboard at: 127.0.0.1:43531 7222s 2024-11-23 22:25:46,459 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43939 7222s 2024-11-23 22:25:46,459 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:25:46,459 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:25:46,459 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:25:46,459 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-mb2wawix 7222s 2024-11-23 22:25:46,459 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:25:46,460 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39529. Reason: failure-to-start- 7222s 2024-11-23 22:25:46,460 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:25:46,461 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34849. Reason: failure-to-start- 7222s 2024-11-23 22:25:46,461 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:25:46,462 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43939': TLS handshake failed with remote 'tls://127.0.0.1:48322': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:25:46,463 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43939': TLS handshake failed with remote 'tls://127.0.0.1:48326': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:25:46,464 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s 2024-11-23 22:25:47,470 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:25:47,479 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33585 7222s 2024-11-23 22:25:47,480 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35947/status 7222s 2024-11-23 22:25:47,480 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:25:47,500 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41897 7222s 2024-11-23 22:25:47,500 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41897 7222s 2024-11-23 22:25:47,500 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:25:47,500 - distributed.worker - INFO - dashboard at: 127.0.0.1:33867 7222s 2024-11-23 22:25:47,500 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33585 7222s 2024-11-23 22:25:47,500 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:25:47,500 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:25:47,500 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:25:47,500 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-5p7bg0j9 7222s 2024-11-23 22:25:47,500 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:25:47,502 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33685 7222s 2024-11-23 22:25:47,502 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33685 7222s 2024-11-23 22:25:47,502 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:25:47,503 - distributed.worker - INFO - dashboard at: 127.0.0.1:45339 7222s 2024-11-23 22:25:47,503 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33585 7222s 2024-11-23 22:25:47,503 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:25:47,503 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:25:47,503 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:25:47,503 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-hbo5rvl0 7222s 2024-11-23 22:25:47,503 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:25:47,504 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41897. Reason: failure-to-start- 7222s 2024-11-23 22:25:47,504 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:25:47,504 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33685. Reason: failure-to-start- 7222s 2024-11-23 22:25:47,505 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:25:47,506 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33585': TLS handshake failed with remote 'tls://127.0.0.1:56752': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:25:47,506 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33585': TLS handshake failed with remote 'tls://127.0.0.1:56764': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:25:47,508 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s 2024-11-23 22:25:48,514 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:25:48,523 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40379 7222s 2024-11-23 22:25:48,524 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45445/status 7222s 2024-11-23 22:25:48,524 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:25:48,541 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41849 7222s 2024-11-23 22:25:48,541 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41849 7222s 2024-11-23 22:25:48,541 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:25:48,541 - distributed.worker - INFO - dashboard at: 127.0.0.1:42747 7222s 2024-11-23 22:25:48,541 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40379 7222s 2024-11-23 22:25:48,541 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:25:48,541 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:25:48,541 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:25:48,541 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-lk99yw2v 7222s 2024-11-23 22:25:48,541 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:25:48,543 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37899 7222s 2024-11-23 22:25:48,543 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37899 7222s 2024-11-23 22:25:48,544 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:25:48,544 - distributed.worker - INFO - dashboard at: 127.0.0.1:37721 7222s 2024-11-23 22:25:48,544 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40379 7222s 2024-11-23 22:25:48,544 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:25:48,544 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:25:48,544 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:25:48,544 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-9f7qr9zj 7222s 2024-11-23 22:25:48,544 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:25:48,545 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41849. Reason: failure-to-start- 7222s 2024-11-23 22:25:48,545 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:25:48,545 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37899. Reason: failure-to-start- 7222s 2024-11-23 22:25:48,546 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:25:48,547 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40379': TLS handshake failed with remote 'tls://127.0.0.1:47994': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:25:48,547 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40379': TLS handshake failed with remote 'tls://127.0.0.1:48008': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:25:48,549 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s 2024-11-23 22:25:49,556 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:25:49,565 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36169 7222s 2024-11-23 22:25:49,565 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38953/status 7222s 2024-11-23 22:25:49,566 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:25:49,581 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44253 7222s 2024-11-23 22:25:49,581 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44253 7222s 2024-11-23 22:25:49,581 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:25:49,581 - distributed.worker - INFO - dashboard at: 127.0.0.1:41415 7222s 2024-11-23 22:25:49,581 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36169 7222s 2024-11-23 22:25:49,582 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:25:49,582 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:25:49,582 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:25:49,582 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-x_oedylp 7222s 2024-11-23 22:25:49,582 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:25:49,584 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45597 7222s 2024-11-23 22:25:49,584 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45597 7222s 2024-11-23 22:25:49,584 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:25:49,584 - distributed.worker - INFO - dashboard at: 127.0.0.1:42001 7222s 2024-11-23 22:25:49,584 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36169 7222s 2024-11-23 22:25:49,584 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:25:49,584 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:25:49,584 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:25:49,584 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-eyvasgqt 7222s 2024-11-23 22:25:49,584 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:25:49,585 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44253. Reason: failure-to-start- 7222s 2024-11-23 22:25:49,585 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:25:49,586 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45597. Reason: failure-to-start- 7222s 2024-11-23 22:25:49,586 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:25:49,588 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36169': TLS handshake failed with remote 'tls://127.0.0.1:49742': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:25:49,588 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36169': TLS handshake failed with remote 'tls://127.0.0.1:49746': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:25:49,589 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s 2024-11-23 22:25:50,595 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:25:50,603 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41027 7222s 2024-11-23 22:25:50,604 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42187/status 7222s 2024-11-23 22:25:50,604 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:25:50,621 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34551 7222s 2024-11-23 22:25:50,621 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34551 7222s 2024-11-23 22:25:50,621 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:25:50,621 - distributed.worker - INFO - dashboard at: 127.0.0.1:35645 7222s 2024-11-23 22:25:50,621 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41027 7222s 2024-11-23 22:25:50,621 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:25:50,621 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:25:50,621 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:25:50,621 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-dubp6tzm 7222s 2024-11-23 22:25:50,621 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:25:50,623 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39933 7222s 2024-11-23 22:25:50,623 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39933 7222s 2024-11-23 22:25:50,623 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:25:50,623 - distributed.worker - INFO - dashboard at: 127.0.0.1:33093 7222s 2024-11-23 22:25:50,623 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41027 7222s 2024-11-23 22:25:50,623 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:25:50,624 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:25:50,624 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:25:50,624 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-2mkzoww6 7222s 2024-11-23 22:25:50,624 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:25:50,625 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34551. Reason: failure-to-start- 7222s 2024-11-23 22:25:50,625 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:25:50,625 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39933. Reason: failure-to-start- 7222s 2024-11-23 22:25:50,625 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:25:50,627 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41027': TLS handshake failed with remote 'tls://127.0.0.1:36036': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:25:50,627 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41027': TLS handshake failed with remote 'tls://127.0.0.1:36038': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:25:50,629 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s 2024-11-23 22:25:51,634 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:25:51,643 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41201 7222s 2024-11-23 22:25:51,643 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34349/status 7222s 2024-11-23 22:25:51,644 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:25:51,658 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44137 7222s 2024-11-23 22:25:51,658 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44137 7222s 2024-11-23 22:25:51,658 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:25:51,658 - distributed.worker - INFO - dashboard at: 127.0.0.1:41101 7222s 2024-11-23 22:25:51,659 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41201 7222s 2024-11-23 22:25:51,659 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:25:51,659 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:25:51,659 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:25:51,659 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-2_jpak_0 7222s 2024-11-23 22:25:51,659 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:25:51,662 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33177 7222s 2024-11-23 22:25:51,662 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33177 7222s 2024-11-23 22:25:51,662 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:25:51,662 - distributed.worker - INFO - dashboard at: 127.0.0.1:37469 7222s 2024-11-23 22:25:51,662 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41201 7222s 2024-11-23 22:25:51,662 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:25:51,662 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:25:51,662 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:25:51,662 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-epf4e89v 7222s 2024-11-23 22:25:51,662 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:25:51,664 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44137. Reason: failure-to-start- 7222s 2024-11-23 22:25:51,664 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:25:51,664 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33177. Reason: failure-to-start- 7222s 2024-11-23 22:25:51,664 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:25:51,666 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41201': TLS handshake failed with remote 'tls://127.0.0.1:38748': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:25:51,666 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41201': TLS handshake failed with remote 'tls://127.0.0.1:38752': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:25:51,668 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s 2024-11-23 22:25:52,673 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:25:52,681 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33463 7222s 2024-11-23 22:25:52,681 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40743/status 7222s 2024-11-23 22:25:52,681 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:25:52,696 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38015 7222s 2024-11-23 22:25:52,696 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38015 7222s 2024-11-23 22:25:52,696 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:25:52,696 - distributed.worker - INFO - dashboard at: 127.0.0.1:37309 7222s 2024-11-23 22:25:52,696 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33463 7222s 2024-11-23 22:25:52,697 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:25:52,697 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:25:52,697 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:25:52,697 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-w55c0oll 7222s 2024-11-23 22:25:52,697 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:25:52,699 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46817 7222s 2024-11-23 22:25:52,699 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46817 7222s 2024-11-23 22:25:52,699 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:25:52,699 - distributed.worker - INFO - dashboard at: 127.0.0.1:39875 7222s 2024-11-23 22:25:52,699 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33463 7222s 2024-11-23 22:25:52,699 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:25:52,699 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:25:52,699 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:25:52,699 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-s9211av1 7222s 2024-11-23 22:25:52,699 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:25:52,700 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38015. Reason: failure-to-start- 7222s 2024-11-23 22:25:52,700 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:25:52,701 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46817. Reason: failure-to-start- 7222s 2024-11-23 22:25:52,701 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:25:52,702 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33463': TLS handshake failed with remote 'tls://127.0.0.1:41990': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:25:52,703 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33463': TLS handshake failed with remote 'tls://127.0.0.1:41992': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:25:52,704 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s 2024-11-23 22:25:53,709 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:25:53,718 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39155 7222s 2024-11-23 22:25:53,719 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40213/status 7222s 2024-11-23 22:25:53,719 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:25:53,735 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40729 7222s 2024-11-23 22:25:53,735 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40729 7222s 2024-11-23 22:25:53,735 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:25:53,735 - distributed.worker - INFO - dashboard at: 127.0.0.1:46277 7222s 2024-11-23 22:25:53,735 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39155 7222s 2024-11-23 22:25:53,735 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:25:53,735 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:25:53,735 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:25:53,735 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-x0ay_x4k 7222s 2024-11-23 22:25:53,735 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:25:53,737 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44931 7222s 2024-11-23 22:25:53,737 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44931 7222s 2024-11-23 22:25:53,737 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:25:53,738 - distributed.worker - INFO - dashboard at: 127.0.0.1:34509 7222s 2024-11-23 22:25:53,738 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39155 7222s 2024-11-23 22:25:53,738 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:25:53,738 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:25:53,738 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:25:53,738 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-f7j_gnji 7222s 2024-11-23 22:25:53,738 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:25:53,739 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40729. Reason: failure-to-start- 7222s 2024-11-23 22:25:53,739 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:25:53,740 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44931. Reason: failure-to-start- 7222s 2024-11-23 22:25:53,740 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:25:53,741 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39155': TLS handshake failed with remote 'tls://127.0.0.1:44050': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:25:53,741 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39155': TLS handshake failed with remote 'tls://127.0.0.1:44066': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:25:53,743 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s 2024-11-23 22:25:54,748 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:25:54,757 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44725 7222s 2024-11-23 22:25:54,757 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42899/status 7222s 2024-11-23 22:25:54,757 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:25:54,774 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39451 7222s 2024-11-23 22:25:54,775 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39451 7222s 2024-11-23 22:25:54,775 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:25:54,775 - distributed.worker - INFO - dashboard at: 127.0.0.1:37659 7222s 2024-11-23 22:25:54,775 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44725 7222s 2024-11-23 22:25:54,775 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:25:54,775 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:25:54,775 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:25:54,775 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-iwjmtp5b 7222s 2024-11-23 22:25:54,775 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:25:54,777 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44813 7222s 2024-11-23 22:25:54,777 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44813 7222s 2024-11-23 22:25:54,777 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:25:54,777 - distributed.worker - INFO - dashboard at: 127.0.0.1:45333 7222s 2024-11-23 22:25:54,777 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44725 7222s 2024-11-23 22:25:54,777 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:25:54,778 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:25:54,778 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:25:54,778 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-r4yah6r1 7222s 2024-11-23 22:25:54,778 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:25:54,779 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39451. Reason: failure-to-start- 7222s 2024-11-23 22:25:54,779 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:25:54,779 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44813. Reason: failure-to-start- 7222s 2024-11-23 22:25:54,780 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:25:54,781 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44725': TLS handshake failed with remote 'tls://127.0.0.1:35754': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:25:54,781 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44725': TLS handshake failed with remote 'tls://127.0.0.1:35762': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:25:54,783 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s 2024-11-23 22:25:55,789 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:25:55,797 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36149 7222s 2024-11-23 22:25:55,797 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34635/status 7222s 2024-11-23 22:25:55,798 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:25:55,813 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38787 7222s 2024-11-23 22:25:55,813 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38787 7222s 2024-11-23 22:25:55,813 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:25:55,813 - distributed.worker - INFO - dashboard at: 127.0.0.1:46857 7222s 2024-11-23 22:25:55,813 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36149 7222s 2024-11-23 22:25:55,813 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:25:55,813 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:25:55,813 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:25:55,813 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-482vb05a 7222s 2024-11-23 22:25:55,813 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:25:55,815 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37767 7222s 2024-11-23 22:25:55,815 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37767 7222s 2024-11-23 22:25:55,816 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:25:55,816 - distributed.worker - INFO - dashboard at: 127.0.0.1:39243 7222s 2024-11-23 22:25:55,816 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36149 7222s 2024-11-23 22:25:55,816 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:25:55,816 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:25:55,816 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:25:55,816 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-k_3rlw1i 7222s 2024-11-23 22:25:55,816 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:25:55,818 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38787. Reason: failure-to-start- 7222s 2024-11-23 22:25:55,818 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:25:55,818 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37767. Reason: failure-to-start- 7222s 2024-11-23 22:25:55,819 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:25:55,820 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36149': TLS handshake failed with remote 'tls://127.0.0.1:55478': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:25:55,820 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36149': TLS handshake failed with remote 'tls://127.0.0.1:55482': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:25:55,822 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s 2024-11-23 22:25:56,827 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:25:56,836 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33311 7222s 2024-11-23 22:25:56,836 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38881/status 7222s 2024-11-23 22:25:56,837 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:25:56,853 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44649 7222s 2024-11-23 22:25:56,853 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44649 7222s 2024-11-23 22:25:56,853 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:25:56,853 - distributed.worker - INFO - dashboard at: 127.0.0.1:46577 7222s 2024-11-23 22:25:56,853 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33311 7222s 2024-11-23 22:25:56,854 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:25:56,854 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:25:56,854 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:25:56,854 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-z29t8009 7222s 2024-11-23 22:25:56,854 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:25:56,856 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43703 7222s 2024-11-23 22:25:56,856 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43703 7222s 2024-11-23 22:25:56,856 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:25:56,856 - distributed.worker - INFO - dashboard at: 127.0.0.1:34393 7222s 2024-11-23 22:25:56,856 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33311 7222s 2024-11-23 22:25:56,856 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:25:56,856 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:25:56,856 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:25:56,856 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ag3dcurz 7222s 2024-11-23 22:25:56,857 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:25:56,861 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44649. Reason: failure-to-start- 7222s 2024-11-23 22:25:56,861 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:25:56,862 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43703. Reason: failure-to-start- 7222s 2024-11-23 22:25:56,862 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:25:56,864 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33311': TLS handshake failed with remote 'tls://127.0.0.1:56618': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:25:56,864 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33311': TLS handshake failed with remote 'tls://127.0.0.1:56626': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:25:56,865 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s 2024-11-23 22:25:57,870 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:25:57,880 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41503 7222s 2024-11-23 22:25:57,880 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39899/status 7222s 2024-11-23 22:25:57,881 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:25:57,896 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35489 7222s 2024-11-23 22:25:57,896 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35489 7222s 2024-11-23 22:25:57,896 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:25:57,897 - distributed.worker - INFO - dashboard at: 127.0.0.1:38205 7222s 2024-11-23 22:25:57,897 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 7222s 2024-11-23 22:25:57,897 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:25:57,897 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:25:57,897 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:25:57,897 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-9zj6p7us 7222s 2024-11-23 22:25:57,897 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:25:57,899 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40823 7222s 2024-11-23 22:25:57,899 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40823 7222s 2024-11-23 22:25:57,900 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:25:57,900 - distributed.worker - INFO - dashboard at: 127.0.0.1:37025 7222s 2024-11-23 22:25:57,900 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41503 7222s 2024-11-23 22:25:57,900 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:25:57,900 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:25:57,900 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:25:57,900 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-xdzm4453 7222s 2024-11-23 22:25:57,900 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:25:57,901 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35489. Reason: failure-to-start- 7222s 2024-11-23 22:25:57,901 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:25:57,902 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40823. Reason: failure-to-start- 7222s 2024-11-23 22:25:57,902 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:25:57,906 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:40906': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:25:57,906 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:40920': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:25:57,907 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s 2024-11-23 22:25:58,913 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:25:58,921 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37107 7222s 2024-11-23 22:25:58,921 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35231/status 7222s 2024-11-23 22:25:58,922 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:25:58,938 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33855 7222s 2024-11-23 22:25:58,939 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33855 7222s 2024-11-23 22:25:58,939 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:25:58,939 - distributed.worker - INFO - dashboard at: 127.0.0.1:40299 7222s 2024-11-23 22:25:58,939 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37107 7222s 2024-11-23 22:25:58,939 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:25:58,939 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:25:58,939 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:25:58,939 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-94lu1i9r 7222s 2024-11-23 22:25:58,939 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:25:58,941 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46705 7222s 2024-11-23 22:25:58,941 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46705 7222s 2024-11-23 22:25:58,941 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:25:58,942 - distributed.worker - INFO - dashboard at: 127.0.0.1:46831 7222s 2024-11-23 22:25:58,942 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37107 7222s 2024-11-23 22:25:58,942 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:25:58,942 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:25:58,942 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:25:58,942 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-aupwi52k 7222s 2024-11-23 22:25:58,942 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:25:58,943 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33855. Reason: failure-to-start- 7222s 2024-11-23 22:25:58,943 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:25:58,944 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46705. Reason: failure-to-start- 7222s 2024-11-23 22:25:58,944 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:25:58,948 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37107': TLS handshake failed with remote 'tls://127.0.0.1:36744': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:25:58,948 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37107': TLS handshake failed with remote 'tls://127.0.0.1:36760': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:25:58,950 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s 2024-11-23 22:25:59,956 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:25:59,964 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42999 7222s 2024-11-23 22:25:59,965 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41355/status 7222s 2024-11-23 22:25:59,965 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:25:59,981 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43137 7222s 2024-11-23 22:25:59,981 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43137 7222s 2024-11-23 22:25:59,981 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:25:59,981 - distributed.worker - INFO - dashboard at: 127.0.0.1:44405 7222s 2024-11-23 22:25:59,981 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42999 7222s 2024-11-23 22:25:59,982 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:25:59,982 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:25:59,982 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:25:59,982 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-v4or2mst 7222s 2024-11-23 22:25:59,982 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:25:59,984 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:32913 7222s 2024-11-23 22:25:59,984 - distributed.worker - INFO - Listening to: tls://127.0.0.1:32913 7222s 2024-11-23 22:25:59,985 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:25:59,985 - distributed.worker - INFO - dashboard at: 127.0.0.1:39707 7222s 2024-11-23 22:25:59,985 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42999 7222s 2024-11-23 22:25:59,985 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:25:59,985 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:25:59,985 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:25:59,985 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-c29d5cqh 7222s 2024-11-23 22:25:59,985 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:25:59,987 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43137. Reason: failure-to-start- 7222s 2024-11-23 22:25:59,988 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:25:59,988 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:32913. Reason: failure-to-start- 7222s 2024-11-23 22:25:59,988 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:25:59,993 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42999': TLS handshake failed with remote 'tls://127.0.0.1:51282': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:25:59,993 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42999': TLS handshake failed with remote 'tls://127.0.0.1:51294': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:25:59,994 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s 2024-11-23 22:26:01,001 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:26:01,009 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45531 7222s 2024-11-23 22:26:01,009 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43107/status 7222s 2024-11-23 22:26:01,010 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:26:01,025 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40527 7222s 2024-11-23 22:26:01,026 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40527 7222s 2024-11-23 22:26:01,026 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:26:01,026 - distributed.worker - INFO - dashboard at: 127.0.0.1:36603 7222s 2024-11-23 22:26:01,026 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45531 7222s 2024-11-23 22:26:01,026 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:26:01,026 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:26:01,026 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:26:01,026 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-cfnv0ebw 7222s 2024-11-23 22:26:01,026 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:26:01,029 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41363 7222s 2024-11-23 22:26:01,029 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41363 7222s 2024-11-23 22:26:01,029 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:26:01,029 - distributed.worker - INFO - dashboard at: 127.0.0.1:44573 7222s 2024-11-23 22:26:01,029 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45531 7222s 2024-11-23 22:26:01,029 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:26:01,029 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:26:01,029 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:26:01,029 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-5yodmurt 7222s 2024-11-23 22:26:01,029 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:26:01,031 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40527. Reason: failure-to-start- 7222s 2024-11-23 22:26:01,031 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:26:01,031 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41363. Reason: failure-to-start- 7222s 2024-11-23 22:26:01,031 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:26:01,036 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45531': TLS handshake failed with remote 'tls://127.0.0.1:54660': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:26:01,036 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45531': TLS handshake failed with remote 'tls://127.0.0.1:54662': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:26:01,038 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s 2024-11-23 22:26:02,044 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:26:02,054 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37771 7222s 2024-11-23 22:26:02,054 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38963/status 7222s 2024-11-23 22:26:02,055 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:26:02,070 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46111 7222s 2024-11-23 22:26:02,070 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46111 7222s 2024-11-23 22:26:02,070 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:26:02,070 - distributed.worker - INFO - dashboard at: 127.0.0.1:44421 7222s 2024-11-23 22:26:02,070 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37771 7222s 2024-11-23 22:26:02,070 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:26:02,070 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:26:02,070 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:26:02,070 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-aj9iurao 7222s 2024-11-23 22:26:02,071 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:26:02,073 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40501 7222s 2024-11-23 22:26:02,073 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40501 7222s 2024-11-23 22:26:02,073 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:26:02,073 - distributed.worker - INFO - dashboard at: 127.0.0.1:45987 7222s 2024-11-23 22:26:02,073 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37771 7222s 2024-11-23 22:26:02,073 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:26:02,073 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:26:02,073 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:26:02,073 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-oztc1ylt 7222s 2024-11-23 22:26:02,073 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:26:02,077 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46111. Reason: failure-to-start- 7222s 2024-11-23 22:26:02,077 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:26:02,078 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40501. Reason: failure-to-start- 7222s 2024-11-23 22:26:02,078 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:26:02,080 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37771': TLS handshake failed with remote 'tls://127.0.0.1:33630': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:26:02,081 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37771': TLS handshake failed with remote 'tls://127.0.0.1:33644': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:26:02,084 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s 2024-11-23 22:26:03,092 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:26:03,103 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37475 7222s 2024-11-23 22:26:03,104 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44119/status 7222s 2024-11-23 22:26:03,104 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:26:03,134 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43945 7222s 2024-11-23 22:26:03,134 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43945 7222s 2024-11-23 22:26:03,134 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:26:03,135 - distributed.worker - INFO - dashboard at: 127.0.0.1:43741 7222s 2024-11-23 22:26:03,135 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37475 7222s 2024-11-23 22:26:03,135 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:26:03,135 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:26:03,135 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:26:03,135 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-qtqjbl8u 7222s 2024-11-23 22:26:03,135 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:26:03,138 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36273 7222s 2024-11-23 22:26:03,139 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36273 7222s 2024-11-23 22:26:03,139 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:26:03,139 - distributed.worker - INFO - dashboard at: 127.0.0.1:35411 7222s 2024-11-23 22:26:03,139 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37475 7222s 2024-11-23 22:26:03,139 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:26:03,139 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:26:03,139 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:26:03,139 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-m3i28vv3 7222s 2024-11-23 22:26:03,139 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:26:03,141 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43945. Reason: failure-to-start- 7222s 2024-11-23 22:26:03,142 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:26:03,142 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36273. Reason: failure-to-start- 7222s 2024-11-23 22:26:03,143 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:26:03,145 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37475': TLS handshake failed with remote 'tls://127.0.0.1:56740': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:26:03,145 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37475': TLS handshake failed with remote 'tls://127.0.0.1:56744': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:26:03,152 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s 2024-11-23 22:26:04,159 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:26:04,171 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34111 7222s 2024-11-23 22:26:04,172 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33901/status 7222s 2024-11-23 22:26:04,173 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:26:04,195 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39101 7222s 2024-11-23 22:26:04,196 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39101 7222s 2024-11-23 22:26:04,196 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:26:04,196 - distributed.worker - INFO - dashboard at: 127.0.0.1:40153 7222s 2024-11-23 22:26:04,196 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34111 7222s 2024-11-23 22:26:04,196 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:26:04,196 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:26:04,196 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:26:04,196 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-y7fqtmj3 7222s 2024-11-23 22:26:04,196 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:26:04,221 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40293 7222s 2024-11-23 22:26:04,221 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40293 7222s 2024-11-23 22:26:04,221 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:26:04,221 - distributed.worker - INFO - dashboard at: 127.0.0.1:45619 7222s 2024-11-23 22:26:04,222 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34111 7222s 2024-11-23 22:26:04,222 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:26:04,222 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:26:04,222 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:26:04,222 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-02uzwbd_ 7222s 2024-11-23 22:26:04,222 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:26:04,228 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39101. Reason: failure-to-start- 7222s 2024-11-23 22:26:04,228 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:26:04,229 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40293. Reason: failure-to-start- 7222s 2024-11-23 22:26:04,229 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:26:04,236 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34111': TLS handshake failed with remote 'tls://127.0.0.1:53416': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:26:04,236 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34111': TLS handshake failed with remote 'tls://127.0.0.1:53420': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:26:04,239 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s 2024-11-23 22:26:05,246 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:26:05,258 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34165 7222s 2024-11-23 22:26:05,259 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35623/status 7222s 2024-11-23 22:26:05,260 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:26:05,287 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37289 7222s 2024-11-23 22:26:05,288 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37289 7222s 2024-11-23 22:26:05,288 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:26:05,288 - distributed.worker - INFO - dashboard at: 127.0.0.1:43249 7222s 2024-11-23 22:26:05,288 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34165 7222s 2024-11-23 22:26:05,288 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:26:05,288 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:26:05,288 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:26:05,288 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-4uoe6e60 7222s 2024-11-23 22:26:05,288 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:26:05,291 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44445 7222s 2024-11-23 22:26:05,292 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44445 7222s 2024-11-23 22:26:05,292 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:26:05,292 - distributed.worker - INFO - dashboard at: 127.0.0.1:46731 7222s 2024-11-23 22:26:05,292 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34165 7222s 2024-11-23 22:26:05,292 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:26:05,292 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:26:05,292 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:26:05,292 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-54fnxiz0 7222s 2024-11-23 22:26:05,292 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:26:05,294 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37289. Reason: failure-to-start- 7222s 2024-11-23 22:26:05,295 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:26:05,295 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44445. Reason: failure-to-start- 7222s 2024-11-23 22:26:05,296 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:26:05,298 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34165': TLS handshake failed with remote 'tls://127.0.0.1:45198': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:26:05,298 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34165': TLS handshake failed with remote 'tls://127.0.0.1:45206': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:26:05,305 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s 2024-11-23 22:26:06,312 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:26:06,327 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37381 7222s 2024-11-23 22:26:06,328 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41401/status 7222s 2024-11-23 22:26:06,328 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:26:06,353 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41771 7222s 2024-11-23 22:26:06,353 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41771 7222s 2024-11-23 22:26:06,353 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:26:06,353 - distributed.worker - INFO - dashboard at: 127.0.0.1:34521 7222s 2024-11-23 22:26:06,353 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37381 7222s 2024-11-23 22:26:06,354 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:26:06,354 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:26:06,354 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:26:06,354 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-8vv246qz 7222s 2024-11-23 22:26:06,354 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:26:06,357 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35697 7222s 2024-11-23 22:26:06,358 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35697 7222s 2024-11-23 22:26:06,358 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:26:06,358 - distributed.worker - INFO - dashboard at: 127.0.0.1:43169 7222s 2024-11-23 22:26:06,358 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37381 7222s 2024-11-23 22:26:06,358 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:26:06,358 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:26:06,358 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:26:06,358 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-be_466g9 7222s 2024-11-23 22:26:06,358 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:26:06,367 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41771. Reason: failure-to-start- 7222s 2024-11-23 22:26:06,367 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:26:06,368 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35697. Reason: failure-to-start- 7222s 2024-11-23 22:26:06,369 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:26:06,371 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37381': TLS handshake failed with remote 'tls://127.0.0.1:47892': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:26:06,372 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37381': TLS handshake failed with remote 'tls://127.0.0.1:47908': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:26:06,374 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s 2024-11-23 22:26:07,382 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:26:07,394 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43507 7222s 2024-11-23 22:26:07,394 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44281/status 7222s 2024-11-23 22:26:07,394 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:26:07,415 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33969 7222s 2024-11-23 22:26:07,415 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33969 7222s 2024-11-23 22:26:07,415 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:26:07,415 - distributed.worker - INFO - dashboard at: 127.0.0.1:44967 7222s 2024-11-23 22:26:07,415 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43507 7222s 2024-11-23 22:26:07,415 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:26:07,415 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:26:07,415 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:26:07,415 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-rnkijbvd 7222s 2024-11-23 22:26:07,416 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:26:07,418 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39263 7222s 2024-11-23 22:26:07,418 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39263 7222s 2024-11-23 22:26:07,418 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:26:07,418 - distributed.worker - INFO - dashboard at: 127.0.0.1:40215 7222s 2024-11-23 22:26:07,418 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43507 7222s 2024-11-23 22:26:07,418 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:26:07,418 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:26:07,418 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:26:07,418 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-tur8qnxw 7222s 2024-11-23 22:26:07,418 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:26:07,423 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33969. Reason: failure-to-start- 7222s 2024-11-23 22:26:07,423 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:26:07,423 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39263. Reason: failure-to-start- 7222s 2024-11-23 22:26:07,423 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:26:07,425 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43507': TLS handshake failed with remote 'tls://127.0.0.1:57136': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:26:07,425 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43507': TLS handshake failed with remote 'tls://127.0.0.1:57140': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:26:07,429 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s 2024-11-23 22:26:08,435 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:26:08,442 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40475 7222s 2024-11-23 22:26:08,443 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45095/status 7222s 2024-11-23 22:26:08,443 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:26:08,462 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35857 7222s 2024-11-23 22:26:08,462 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35857 7222s 2024-11-23 22:26:08,463 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:26:08,463 - distributed.worker - INFO - dashboard at: 127.0.0.1:36153 7222s 2024-11-23 22:26:08,463 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40475 7222s 2024-11-23 22:26:08,463 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:26:08,463 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:26:08,463 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:26:08,463 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-raiz30e8 7222s 2024-11-23 22:26:08,463 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:26:08,465 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46737 7222s 2024-11-23 22:26:08,465 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46737 7222s 2024-11-23 22:26:08,465 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:26:08,465 - distributed.worker - INFO - dashboard at: 127.0.0.1:39297 7222s 2024-11-23 22:26:08,465 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40475 7222s 2024-11-23 22:26:08,465 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:26:08,465 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:26:08,465 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:26:08,466 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-str336ti 7222s 2024-11-23 22:26:08,466 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:26:08,468 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35857. Reason: failure-to-start- 7222s 2024-11-23 22:26:08,468 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:26:08,469 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46737. Reason: failure-to-start- 7222s 2024-11-23 22:26:08,469 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:26:08,473 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40475': TLS handshake failed with remote 'tls://127.0.0.1:48876': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:26:08,473 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40475': TLS handshake failed with remote 'tls://127.0.0.1:48882': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:26:08,475 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s 2024-11-23 22:26:09,480 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:26:09,488 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33397 7222s 2024-11-23 22:26:09,489 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42355/status 7222s 2024-11-23 22:26:09,489 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:26:09,507 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37777 7222s 2024-11-23 22:26:09,507 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37777 7222s 2024-11-23 22:26:09,507 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:26:09,508 - distributed.worker - INFO - dashboard at: 127.0.0.1:35413 7222s 2024-11-23 22:26:09,508 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33397 7222s 2024-11-23 22:26:09,508 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:26:09,508 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:26:09,508 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:26:09,508 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-9x9adzeq 7222s 2024-11-23 22:26:09,508 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:26:09,510 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44727 7222s 2024-11-23 22:26:09,510 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44727 7222s 2024-11-23 22:26:09,510 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:26:09,510 - distributed.worker - INFO - dashboard at: 127.0.0.1:34483 7222s 2024-11-23 22:26:09,510 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33397 7222s 2024-11-23 22:26:09,510 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:26:09,510 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:26:09,511 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:26:09,511 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-8gmz1pt3 7222s 2024-11-23 22:26:09,511 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:26:09,512 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37777. Reason: failure-to-start- 7222s 2024-11-23 22:26:09,512 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:26:09,513 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44727. Reason: failure-to-start- 7222s 2024-11-23 22:26:09,513 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:26:09,517 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33397': TLS handshake failed with remote 'tls://127.0.0.1:58246': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:26:09,517 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33397': TLS handshake failed with remote 'tls://127.0.0.1:58254': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:26:09,519 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s 2024-11-23 22:26:10,524 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:26:10,533 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33945 7222s 2024-11-23 22:26:10,534 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44443/status 7222s 2024-11-23 22:26:10,534 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:26:10,552 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38795 7222s 2024-11-23 22:26:10,553 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38795 7222s 2024-11-23 22:26:10,553 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:26:10,553 - distributed.worker - INFO - dashboard at: 127.0.0.1:38387 7222s 2024-11-23 22:26:10,553 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33945 7222s 2024-11-23 22:26:10,553 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:26:10,553 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:26:10,553 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:26:10,553 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-5bad4ddt 7222s 2024-11-23 22:26:10,553 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:26:10,555 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36647 7222s 2024-11-23 22:26:10,555 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36647 7222s 2024-11-23 22:26:10,555 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:26:10,555 - distributed.worker - INFO - dashboard at: 127.0.0.1:43763 7222s 2024-11-23 22:26:10,555 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33945 7222s 2024-11-23 22:26:10,555 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:26:10,555 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:26:10,556 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:26:10,556 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ip93rqgd 7222s 2024-11-23 22:26:10,556 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:26:10,557 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38795. Reason: failure-to-start- 7222s 2024-11-23 22:26:10,557 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:26:10,558 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36647. Reason: failure-to-start- 7222s 2024-11-23 22:26:10,558 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:26:10,561 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33945': TLS handshake failed with remote 'tls://127.0.0.1:36274': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:26:10,562 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33945': TLS handshake failed with remote 'tls://127.0.0.1:36290': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:26:10,563 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s 2024-11-23 22:26:11,572 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:26:11,579 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36437 7222s 2024-11-23 22:26:11,580 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38707/status 7222s 2024-11-23 22:26:11,580 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:26:11,598 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36733 7222s 2024-11-23 22:26:11,598 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36733 7222s 2024-11-23 22:26:11,598 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:26:11,598 - distributed.worker - INFO - dashboard at: 127.0.0.1:40833 7222s 2024-11-23 22:26:11,598 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36437 7222s 2024-11-23 22:26:11,598 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:26:11,598 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:26:11,598 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:26:11,598 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-2l2or74r 7222s 2024-11-23 22:26:11,598 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:26:11,600 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45489 7222s 2024-11-23 22:26:11,601 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45489 7222s 2024-11-23 22:26:11,601 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:26:11,601 - distributed.worker - INFO - dashboard at: 127.0.0.1:46725 7222s 2024-11-23 22:26:11,601 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36437 7222s 2024-11-23 22:26:11,601 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:26:11,601 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:26:11,601 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:26:11,601 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-5w3pfpt_ 7222s 2024-11-23 22:26:11,601 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:26:11,602 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36733. Reason: failure-to-start- 7222s 2024-11-23 22:26:11,602 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:26:11,603 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45489. Reason: failure-to-start- 7222s 2024-11-23 22:26:11,603 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:26:11,605 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36437': TLS handshake failed with remote 'tls://127.0.0.1:56770': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:26:11,605 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36437': TLS handshake failed with remote 'tls://127.0.0.1:56772': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:26:11,611 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s 2024-11-23 22:26:12,617 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:26:12,624 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41099 7222s 2024-11-23 22:26:12,625 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46579/status 7222s 2024-11-23 22:26:12,625 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:26:12,639 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36485 7222s 2024-11-23 22:26:12,639 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36485 7222s 2024-11-23 22:26:12,640 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:26:12,640 - distributed.worker - INFO - dashboard at: 127.0.0.1:40941 7222s 2024-11-23 22:26:12,640 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41099 7222s 2024-11-23 22:26:12,640 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:26:12,640 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:26:12,640 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:26:12,640 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-bk93x7tn 7222s 2024-11-23 22:26:12,640 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:26:12,643 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33591 7222s 2024-11-23 22:26:12,643 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33591 7222s 2024-11-23 22:26:12,643 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:26:12,643 - distributed.worker - INFO - dashboard at: 127.0.0.1:33647 7222s 2024-11-23 22:26:12,643 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41099 7222s 2024-11-23 22:26:12,643 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:26:12,643 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:26:12,643 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:26:12,643 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-bfmow6fl 7222s 2024-11-23 22:26:12,644 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:26:12,645 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36485. Reason: failure-to-start- 7222s 2024-11-23 22:26:12,645 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:26:12,645 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33591. Reason: failure-to-start- 7222s 2024-11-23 22:26:12,646 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:26:12,649 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41099': TLS handshake failed with remote 'tls://127.0.0.1:41018': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:26:12,650 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41099': TLS handshake failed with remote 'tls://127.0.0.1:41022': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:26:12,651 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s 2024-11-23 22:26:13,656 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:26:13,664 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38507 7222s 2024-11-23 22:26:13,664 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41899/status 7222s 2024-11-23 22:26:13,664 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:26:13,679 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43713 7222s 2024-11-23 22:26:13,679 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43713 7222s 2024-11-23 22:26:13,679 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:26:13,679 - distributed.worker - INFO - dashboard at: 127.0.0.1:44229 7222s 2024-11-23 22:26:13,679 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38507 7222s 2024-11-23 22:26:13,679 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:26:13,679 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:26:13,679 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:26:13,679 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-e4qj4w5j 7222s 2024-11-23 22:26:13,679 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:26:13,681 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44571 7222s 2024-11-23 22:26:13,682 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44571 7222s 2024-11-23 22:26:13,682 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:26:13,682 - distributed.worker - INFO - dashboard at: 127.0.0.1:37773 7222s 2024-11-23 22:26:13,682 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38507 7222s 2024-11-23 22:26:13,682 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:26:13,682 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:26:13,682 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:26:13,682 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-26hb9uil 7222s 2024-11-23 22:26:13,682 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:26:13,686 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43713. Reason: failure-to-start- 7222s 2024-11-23 22:26:13,687 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:26:13,687 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44571. Reason: failure-to-start- 7222s 2024-11-23 22:26:13,687 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:26:13,691 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38507': TLS handshake failed with remote 'tls://127.0.0.1:52568': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:26:13,691 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38507': TLS handshake failed with remote 'tls://127.0.0.1:52576': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:26:13,693 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s 2024-11-23 22:26:14,698 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:26:14,706 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46649 7222s 2024-11-23 22:26:14,706 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44811/status 7222s 2024-11-23 22:26:14,707 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:26:14,722 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34935 7222s 2024-11-23 22:26:14,722 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34935 7222s 2024-11-23 22:26:14,722 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:26:14,722 - distributed.worker - INFO - dashboard at: 127.0.0.1:39001 7222s 2024-11-23 22:26:14,723 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46649 7222s 2024-11-23 22:26:14,723 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:26:14,723 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:26:14,723 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:26:14,723 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-drx7nyok 7222s 2024-11-23 22:26:14,723 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:26:14,725 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36521 7222s 2024-11-23 22:26:14,725 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36521 7222s 2024-11-23 22:26:14,725 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:26:14,725 - distributed.worker - INFO - dashboard at: 127.0.0.1:38497 7222s 2024-11-23 22:26:14,725 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46649 7222s 2024-11-23 22:26:14,725 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:26:14,725 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:26:14,725 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:26:14,725 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-fnqkkmau 7222s 2024-11-23 22:26:14,726 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:26:14,729 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34935. Reason: failure-to-start- 7222s 2024-11-23 22:26:14,729 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:26:14,730 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36521. Reason: failure-to-start- 7222s 2024-11-23 22:26:14,730 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:26:14,732 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46649': TLS handshake failed with remote 'tls://127.0.0.1:48882': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:26:14,732 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46649': TLS handshake failed with remote 'tls://127.0.0.1:48884': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:26:14,733 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s 2024-11-23 22:26:15,739 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:26:15,749 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46177 7222s 2024-11-23 22:26:15,749 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40289/status 7222s 2024-11-23 22:26:15,749 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:26:15,765 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35459 7222s 2024-11-23 22:26:15,765 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35459 7222s 2024-11-23 22:26:15,765 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:26:15,765 - distributed.worker - INFO - dashboard at: 127.0.0.1:33465 7222s 2024-11-23 22:26:15,765 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46177 7222s 2024-11-23 22:26:15,765 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:26:15,765 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:26:15,765 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:26:15,765 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-rqear3x4 7222s 2024-11-23 22:26:15,765 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:26:15,767 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44065 7222s 2024-11-23 22:26:15,767 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44065 7222s 2024-11-23 22:26:15,767 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:26:15,767 - distributed.worker - INFO - dashboard at: 127.0.0.1:46663 7222s 2024-11-23 22:26:15,767 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46177 7222s 2024-11-23 22:26:15,767 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:26:15,768 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:26:15,768 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:26:15,768 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-39wppole 7222s 2024-11-23 22:26:15,768 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:26:15,772 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35459. Reason: failure-to-start- 7222s 2024-11-23 22:26:15,772 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:26:15,772 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44065. Reason: failure-to-start- 7222s 2024-11-23 22:26:15,773 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:26:15,777 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46177': TLS handshake failed with remote 'tls://127.0.0.1:46162': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:26:15,777 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46177': TLS handshake failed with remote 'tls://127.0.0.1:46166': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:26:15,778 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s ______________________________ test_worker_client ______________________________ 7222s 7222s fut = , timeout = 0 7222s 7222s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 7222s async with asyncio.timeout(timeout): 7222s > return await fut 7222s 7222s /usr/lib/python3/dist-packages/distributed/utils.py:1960: 7222s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7222s /usr/lib/python3/dist-packages/distributed/worker.py:1480: in start_unsafe 7222s await self._register_with_scheduler() 7222s /usr/lib/python3/dist-packages/distributed/worker.py:1179: in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s /usr/lib/python3/dist-packages/distributed/comm/core.py:342: in connect 7222s comm = await wait_for( 7222s /usr/lib/python3/dist-packages/distributed/utils.py:1960: in wait_for 7222s return await fut 7222s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:546: in connect 7222s stream = await self.client.connect( 7222s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7222s 7222s self = , host = '127.0.0.1' 7222s port = 36395, af = 7222s ssl_options = 7222s max_buffer_size = 8364507136.0, source_ip = None, source_port = None 7222s timeout = None 7222s 7222s async def connect( 7222s self, 7222s host: str, 7222s port: int, 7222s af: socket.AddressFamily = socket.AF_UNSPEC, 7222s ssl_options: Optional[Union[Dict[str, Any], ssl.SSLContext]] = None, 7222s max_buffer_size: Optional[int] = None, 7222s source_ip: Optional[str] = None, 7222s source_port: Optional[int] = None, 7222s timeout: Optional[Union[float, datetime.timedelta]] = None, 7222s ) -> IOStream: 7222s """Connect to the given host and port. 7222s 7222s Asynchronously returns an `.IOStream` (or `.SSLIOStream` if 7222s ``ssl_options`` is not None). 7222s 7222s Using the ``source_ip`` kwarg, one can specify the source 7222s IP address to use when establishing the connection. 7222s In case the user needs to resolve and 7222s use a specific interface, it has to be handled outside 7222s of Tornado as this depends very much on the platform. 7222s 7222s Raises `TimeoutError` if the input future does not complete before 7222s ``timeout``, which may be specified in any form allowed by 7222s `.IOLoop.add_timeout` (i.e. a `datetime.timedelta` or an absolute time 7222s relative to `.IOLoop.time`) 7222s 7222s Similarly, when the user requires a certain source port, it can 7222s be specified using the ``source_port`` arg. 7222s 7222s .. versionchanged:: 4.5 7222s Added the ``source_ip`` and ``source_port`` arguments. 7222s 7222s .. versionchanged:: 5.0 7222s Added the ``timeout`` argument. 7222s """ 7222s if timeout is not None: 7222s if isinstance(timeout, numbers.Real): 7222s timeout = IOLoop.current().time() + timeout 7222s elif isinstance(timeout, datetime.timedelta): 7222s timeout = IOLoop.current().time() + timeout.total_seconds() 7222s else: 7222s raise TypeError("Unsupported timeout %r" % timeout) 7222s if timeout is not None: 7222s addrinfo = await gen.with_timeout( 7222s timeout, self.resolver.resolve(host, port, af) 7222s ) 7222s else: 7222s addrinfo = await self.resolver.resolve(host, port, af) 7222s connector = _Connector( 7222s addrinfo, 7222s functools.partial( 7222s self._create_stream, 7222s max_buffer_size, 7222s source_ip=source_ip, 7222s source_port=source_port, 7222s ), 7222s ) 7222s > af, addr, stream = await connector.start(connect_timeout=timeout) 7222s E asyncio.exceptions.CancelledError 7222s 7222s /usr/lib/python3/dist-packages/tornado/tcpclient.py:279: CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s self = 7222s 7222s @final 7222s async def start(self): 7222s async with self._startup_lock: 7222s if self.status == Status.failed: 7222s assert self.__startup_exc is not None 7222s raise self.__startup_exc 7222s elif self.status != Status.init: 7222s return self 7222s timeout = getattr(self, "death_timeout", None) 7222s 7222s async def _close_on_failure(exc: Exception) -> None: 7222s await self.close(reason=f"failure-to-start-{str(type(exc))}") 7222s self.status = Status.failed 7222s self.__startup_exc = exc 7222s 7222s try: 7222s > await wait_for(self.start_unsafe(), timeout=timeout) 7222s 7222s /usr/lib/python3/dist-packages/distributed/core.py:664: 7222s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7222s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 7222s async with asyncio.timeout(timeout): 7222s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7222s 7222s self = 7222s exc_type = 7222s exc_val = CancelledError(), exc_tb = 7222s 7222s async def __aexit__( 7222s self, 7222s exc_type: Optional[Type[BaseException]], 7222s exc_val: Optional[BaseException], 7222s exc_tb: Optional[TracebackType], 7222s ) -> Optional[bool]: 7222s assert self._state in (_State.ENTERED, _State.EXPIRING) 7222s 7222s if self._timeout_handler is not None: 7222s self._timeout_handler.cancel() 7222s self._timeout_handler = None 7222s 7222s if self._state is _State.EXPIRING: 7222s self._state = _State.EXPIRED 7222s 7222s if self._task.uncancel() <= self._cancelling and exc_type is not None: 7222s # Since there are no new cancel requests, we're 7222s # handling this. 7222s if issubclass(exc_type, exceptions.CancelledError): 7222s > raise TimeoutError from exc_val 7222s E TimeoutError 7222s 7222s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s @contextlib.asynccontextmanager 7222s async def _cluster_factory(): 7222s workers = [] 7222s s = None 7222s try: 7222s for _ in range(60): 7222s try: 7222s > s, ws = await start_cluster( 7222s nthreads, 7222s scheduler, 7222s security=security, 7222s Worker=Worker, 7222s scheduler_kwargs=scheduler_kwargs, 7222s worker_kwargs=merge( 7222s {"death_timeout": min(15, int(deadline.remaining))}, 7222s worker_kwargs, 7222s ), 7222s ) 7222s 7222s /usr/lib/python3/dist-packages/distributed/utils_test.py:966: 7222s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7222s /usr/lib/python3/dist-packages/distributed/utils_test.py:789: in start_cluster 7222s await asyncio.gather(*workers) 7222s /usr/lib/python3.13/asyncio/tasks.py:737: in _wrap_awaitable 7222s return await awaitable 7222s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7222s 7222s self = 7222s 7222s @final 7222s async def start(self): 7222s async with self._startup_lock: 7222s if self.status == Status.failed: 7222s assert self.__startup_exc is not None 7222s raise self.__startup_exc 7222s elif self.status != Status.init: 7222s return self 7222s timeout = getattr(self, "death_timeout", None) 7222s 7222s async def _close_on_failure(exc: Exception) -> None: 7222s await self.close(reason=f"failure-to-start-{str(type(exc))}") 7222s self.status = Status.failed 7222s self.__startup_exc = exc 7222s 7222s try: 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s except asyncio.TimeoutError as exc: 7222s await _close_on_failure(exc) 7222s > raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s E TimeoutError: Worker start timed out after 0s. 7222s 7222s /usr/lib/python3/dist-packages/distributed/core.py:667: TimeoutError 7222s 7222s During handling of the above exception, another exception occurred: 7222s 7222s fut = ._..test_func..async_fn at 0xe9b48cd8> 7222s timeout = 60 7222s 7222s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 7222s async with asyncio.timeout(timeout): 7222s > return await fut 7222s 7222s /usr/lib/python3/dist-packages/distributed/utils.py:1960: 7222s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7222s /usr/lib/python3/dist-packages/distributed/utils_test.py:999: in async_fn 7222s _cluster_factory() as (s, workers), 7222s /usr/lib/python3.13/contextlib.py:214: in __aenter__ 7222s return await anext(self.gen) 7222s /usr/lib/python3/dist-packages/distributed/utils_test.py:983: in _cluster_factory 7222s await asyncio.sleep(1) 7222s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7222s 7222s delay = 1, result = None 7222s 7222s async def sleep(delay, result=None): 7222s """Coroutine that completes after a given time (in seconds).""" 7222s if delay <= 0: 7222s await __sleep0() 7222s return result 7222s 7222s if math.isnan(delay): 7222s raise ValueError("Invalid delay: NaN (not a number)") 7222s 7222s loop = events.get_running_loop() 7222s future = loop.create_future() 7222s h = loop.call_later(delay, 7222s futures._set_result_unless_cancelled, 7222s future, result) 7222s try: 7222s > return await future 7222s E asyncio.exceptions.CancelledError 7222s 7222s /usr/lib/python3.13/asyncio/tasks.py:718: CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s args = (), kwds = {} 7222s 7222s @wraps(func) 7222s def inner(*args, **kwds): 7222s with self._recreate_cm(): 7222s > return func(*args, **kwds) 7222s 7222s /usr/lib/python3.13/contextlib.py:85: 7222s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7222s /usr/lib/python3.13/contextlib.py:85: in inner 7222s return func(*args, **kwds) 7222s /usr/lib/python3/dist-packages/distributed/utils_test.py:1102: in test_func 7222s return _run_and_close_tornado(async_fn_outer) 7222s /usr/lib/python3/dist-packages/distributed/utils_test.py:378: in _run_and_close_tornado 7222s return asyncio_run(inner_fn(), loop_factory=get_loop_factory()) 7222s /usr/lib/python3.13/asyncio/runners.py:194: in run 7222s return runner.run(main) 7222s /usr/lib/python3.13/asyncio/runners.py:118: in run 7222s return self._loop.run_until_complete(task) 7222s /usr/lib/python3.13/asyncio/base_events.py:720: in run_until_complete 7222s return future.result() 7222s /usr/lib/python3/dist-packages/distributed/utils_test.py:375: in inner_fn 7222s return await async_fn(*args, **kwargs) 7222s /usr/lib/python3/dist-packages/distributed/utils_test.py:1099: in async_fn_outer 7222s return await utils_wait_for(async_fn(), timeout=timeout * 2) 7222s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 7222s async with asyncio.timeout(timeout): 7222s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7222s 7222s self = 7222s exc_type = 7222s exc_val = CancelledError(), exc_tb = 7222s 7222s async def __aexit__( 7222s self, 7222s exc_type: Optional[Type[BaseException]], 7222s exc_val: Optional[BaseException], 7222s exc_tb: Optional[TracebackType], 7222s ) -> Optional[bool]: 7222s assert self._state in (_State.ENTERED, _State.EXPIRING) 7222s 7222s if self._timeout_handler is not None: 7222s self._timeout_handler.cancel() 7222s self._timeout_handler = None 7222s 7222s if self._state is _State.EXPIRING: 7222s self._state = _State.EXPIRED 7222s 7222s if self._task.uncancel() <= self._cancelling and exc_type is not None: 7222s # Since there are no new cancel requests, we're 7222s # handling this. 7222s if issubclass(exc_type, exceptions.CancelledError): 7222s > raise TimeoutError from exc_val 7222s E TimeoutError 7222s 7222s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 7222s ----------------------------- Captured stderr call ----------------------------- 7222s 2024-11-23 22:26:16,834 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:26:16,842 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:16,842 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38541/status 7222s 2024-11-23 22:26:16,843 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:26:16,858 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44635 7222s 2024-11-23 22:26:16,858 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44635 7222s 2024-11-23 22:26:16,858 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:26:16,858 - distributed.worker - INFO - dashboard at: 127.0.0.1:40493 7222s 2024-11-23 22:26:16,858 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:16,858 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:26:16,858 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:26:16,858 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:26:16,858 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-s4mb6vk4 7222s 2024-11-23 22:26:16,858 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:26:16,860 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43869 7222s 2024-11-23 22:26:16,860 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43869 7222s 2024-11-23 22:26:16,861 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:26:16,861 - distributed.worker - INFO - dashboard at: 127.0.0.1:41705 7222s 2024-11-23 22:26:16,861 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:16,861 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:26:16,861 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:26:16,861 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:26:16,861 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-yoa452mk 7222s 2024-11-23 22:26:16,861 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:26:16,874 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:16,874 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:16,874 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:40948': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:16,874 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:40962': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:16,987 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:16,987 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:16,988 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:40964': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:16,988 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:40976': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:17,100 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:17,100 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:17,100 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:40982': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:17,100 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:40990': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:17,213 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:17,213 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:17,214 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:41000': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:17,214 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:41004': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:17,327 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:17,327 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:17,328 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:41010': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:17,328 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:41020': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:17,440 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:17,441 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:17,441 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:41022': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:17,441 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:41024': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:17,554 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:17,554 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:17,554 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:41032': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:17,554 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:41042': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:17,666 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:17,667 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:17,667 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:41048': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:17,667 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:41060': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:17,779 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:17,779 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:17,779 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:41062': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:17,780 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:41066': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:17,892 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:17,892 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:17,893 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:41068': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:17,893 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:41076': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:18,006 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:18,006 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:18,006 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:41082': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:18,006 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:41096': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:18,119 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:18,119 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:18,119 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:41112': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:18,119 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:41120': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:18,231 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:18,231 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:18,231 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:41134': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:18,232 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:41146': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:18,345 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:18,345 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:18,345 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:41156': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:18,345 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:41158': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:18,457 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:18,458 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:18,458 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:41174': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:18,458 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:41182': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:18,570 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:18,570 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:18,570 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:41196': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:18,570 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:41198': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:18,684 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:18,685 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:18,685 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:41210': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:18,685 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:41222': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:18,797 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:18,797 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:18,797 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:41230': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:18,797 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:41246': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:18,911 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:18,911 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:18,911 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:41254': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:18,911 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:41268': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:19,024 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:19,024 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:19,025 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:41280': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:19,025 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:41296': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:19,137 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:19,137 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:19,138 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:41300': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:19,138 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:41306': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:19,250 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:19,250 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:19,250 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:41314': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:19,250 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:41318': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:19,362 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:19,362 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:19,363 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:41328': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:19,363 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:41342': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:19,475 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:19,475 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:19,476 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:41350': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:19,476 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:41358': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:19,588 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:19,589 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:19,589 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:41366': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:19,589 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:41370': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:19,701 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:19,701 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:19,702 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:41386': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:19,702 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:41396': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:19,816 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:19,816 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:19,816 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:41402': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:19,816 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:41412': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:19,928 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:19,929 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:19,929 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:41426': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:19,929 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:41438': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:20,042 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:20,042 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:20,042 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:41450': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:20,042 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:41452': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:20,155 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:20,155 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:20,155 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:41466': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:20,155 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:41472': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:20,268 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:20,268 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:20,268 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:41484': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:20,269 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:41486': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:20,380 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:20,381 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:20,381 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:41488': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:20,381 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:41494': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:20,495 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:20,495 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:20,495 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:41502': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:20,495 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:41514': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:20,607 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:20,607 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:20,608 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:41524': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:20,608 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:41530': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:20,721 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:20,721 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:20,722 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:41540': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:20,722 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:41554': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:20,835 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:20,835 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:20,835 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:41556': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:20,835 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:41572': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:20,947 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:20,948 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:20,948 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:41582': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:20,948 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:41586': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:21,060 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:21,060 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:21,060 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:41602': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:21,060 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:41614': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:21,173 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:21,173 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:21,174 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:41616': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:21,174 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:41632': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:21,285 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:21,286 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:21,286 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:41636': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:21,286 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:41640': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:21,399 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:21,399 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:21,399 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:41654': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:21,400 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:41662': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:21,512 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:21,512 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:21,513 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:41676': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:21,513 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:41678': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:21,625 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:21,625 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:21,625 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:60890': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:21,625 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:60900': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:21,739 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:21,739 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:21,739 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:60906': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:21,739 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:60922': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:21,852 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:21,852 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:21,856 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:60936': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:21,856 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:60944': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:21,965 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:21,965 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:21,966 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:60948': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:21,966 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:60964': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:22,078 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:22,078 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:22,078 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:60980': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:22,078 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:60992': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:22,190 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:22,191 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:22,191 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:32776': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:22,191 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:32778': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:22,304 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:22,304 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:22,304 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:32788': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:22,304 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:32802': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:22,417 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:22,417 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:22,417 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:32804': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:22,417 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:32818': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:22,532 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:22,532 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:22,532 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:32834': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:22,532 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:32850': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:22,645 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:22,646 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:22,646 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:32860': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:22,646 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:32872': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:22,759 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:22,759 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:22,760 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:32874': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:22,760 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:32878': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:22,872 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:22,873 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:22,873 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:32884': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:22,873 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:32894': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:22,985 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:22,986 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:22,986 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:32900': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:22,986 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:32914': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:23,099 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:23,099 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:23,099 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:32916': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:23,099 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:32930': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:23,211 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:23,212 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:23,212 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:32938': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:23,212 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:32942': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:23,325 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:23,325 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:23,325 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:32956': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:23,325 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:32972': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:23,438 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:23,439 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:23,439 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:32976': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:23,439 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:32984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:23,552 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:23,552 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:23,553 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:32996': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:23,553 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:33010': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:23,666 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:23,667 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:23,667 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:33020': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:23,667 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:33030': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:23,779 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:23,779 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:23,780 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:33040': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:23,780 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:33046': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:23,892 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:23,892 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:23,893 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:33050': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:23,893 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:33064': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:24,006 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:24,006 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:24,006 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:33072': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:24,006 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:33076': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:24,119 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:24,120 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:24,120 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:33088': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:24,120 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:33100': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:24,233 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:24,233 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:24,233 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:33108': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:24,233 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:33120': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:24,348 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:24,348 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:24,353 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:33132': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:24,353 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:33138': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:24,461 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:24,461 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:24,461 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:33144': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:24,461 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:33156': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:24,574 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:24,574 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:24,574 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:33162': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:24,574 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:33172': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:24,687 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:24,688 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:24,688 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:33188': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:24,688 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:33198': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:24,800 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:24,801 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:24,801 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:33202': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:24,801 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:33204': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:24,914 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:24,914 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:24,915 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:33208': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:24,915 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:33214': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:25,029 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:25,029 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:25,030 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:33228': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:25,030 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:33244': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:25,143 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:25,143 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:25,144 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:33260': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:25,144 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:33272': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:25,256 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:25,256 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:25,257 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:33278': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:25,257 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:33290': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:25,369 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:25,369 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:25,370 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:33296': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:25,370 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:33302': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:25,483 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:25,483 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:25,483 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:33310': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:25,483 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:33314': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:25,596 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:25,596 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:25,597 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:33316': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:25,597 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:33324': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:25,710 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:25,711 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:25,711 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:33328': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:25,711 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:33344': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:25,824 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:25,824 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:25,825 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:33346': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:25,825 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:33352': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:25,939 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:25,939 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:25,940 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:33356': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:25,940 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:33366': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:26,054 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:26,054 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:26,054 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:33380': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:26,054 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:33396': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:26,170 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:26,170 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:26,170 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:33406': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:26,171 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:33416': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:26,283 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:26,283 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:26,284 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:33422': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:26,284 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:33436': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:26,397 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:26,398 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:26,398 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:33444': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:26,398 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:33456': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:26,511 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:26,512 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:26,512 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:33466': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:26,512 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:33482': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:26,625 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:26,626 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:26,626 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:33486': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:26,626 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:33498': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:26,739 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:26,739 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:26,739 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:33508': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:26,739 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:33520': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:26,852 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:26,853 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:26,857 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:33524': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:26,857 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:33532': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:26,965 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:26,966 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:26,966 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:33538': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:26,966 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:33548': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:27,078 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:27,078 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:27,079 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:33550': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:27,079 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:33564': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:27,191 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:27,191 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:27,191 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:33580': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:27,192 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:33586': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:27,304 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:27,305 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:27,305 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:33594': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:27,305 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:33610': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:27,418 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:27,418 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:27,418 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:33624': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:27,418 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:33636': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:27,531 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:27,532 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:27,532 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:33650': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:27,532 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:33666': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:27,645 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:27,645 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:27,646 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:33674': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:27,646 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:33682': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:27,758 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:27,759 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:27,759 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:33692': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:27,759 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:33700': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:27,871 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:27,872 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:27,872 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:33716': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:27,872 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:33726': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:28,290 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:28,290 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:28,291 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:33728': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:28,291 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:33742': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:28,404 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:28,404 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:28,404 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:33750': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:28,405 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:33756': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:28,518 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:28,518 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:28,518 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:33762': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:28,519 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:33766': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:28,631 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:28,632 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:28,632 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:33776': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:28,632 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:33788': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:28,745 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:28,745 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:28,746 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:33800': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:28,746 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:33806': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:28,859 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:28,860 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:28,860 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:33808': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:28,860 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:33814': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:28,973 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:28,973 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:28,973 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:33826': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:28,973 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:33836': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:29,085 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:29,086 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:29,086 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:33842': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:29,086 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:33850': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:29,199 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:29,199 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:29,199 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:33864': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:29,199 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:33874': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:29,312 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:29,312 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:29,312 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:33884': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:29,312 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:33890': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:29,425 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:29,426 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:29,426 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:33904': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:29,426 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:33920': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:29,539 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:29,540 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:29,541 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:33926': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:29,541 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:33934': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:29,653 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:29,653 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:29,653 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:33948': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:29,653 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:33958': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:29,767 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:29,767 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:29,767 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:33966': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:29,767 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:33968': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:29,881 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:29,881 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:29,881 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:33974': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:29,881 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:33988': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:29,994 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:29,994 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:29,994 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:33998': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:29,995 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:34000': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:30,107 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:30,108 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:30,108 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:34016': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:30,108 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:34020': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:30,221 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:30,222 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:30,222 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:34028': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:30,222 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:34038': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:30,335 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:30,336 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:30,336 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:34052': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:30,336 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:34058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:30,450 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:30,450 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:30,450 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:34062': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:30,450 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:34072': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:30,563 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:30,563 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:30,563 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:34084': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:30,564 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:34098': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:30,677 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:30,677 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:30,677 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:34110': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:30,677 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:34116': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:30,790 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:30,790 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:30,790 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:34130': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:30,790 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:34140': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:30,903 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:30,903 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:30,904 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:34154': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:30,904 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:34170': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:31,017 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:31,017 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:31,018 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:34186': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:31,018 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:34196': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:31,131 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:31,131 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:31,132 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:34206': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:31,132 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:34212': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:31,245 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:31,245 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:31,246 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:34226': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:31,246 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:34240': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:31,359 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:31,359 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:31,359 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:34246': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:31,360 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:34254': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:31,472 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:31,472 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:31,472 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:34266': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:31,472 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:34270': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:31,585 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:31,585 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:31,586 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:33048': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:31,586 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:33060': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:31,699 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:31,699 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:31,700 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:33068': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:31,700 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:33082': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:31,812 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:31,812 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35107 7222s 2024-11-23 22:26:31,813 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:33098': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:31,813 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35107': TLS handshake failed with remote 'tls://127.0.0.1:33112': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:31,857 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44635. Reason: failure-to-start- 7222s 2024-11-23 22:26:31,858 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:26:31,859 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43869. Reason: failure-to-start- 7222s 2024-11-23 22:26:31,859 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:26:31,861 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 15s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 7222s stream = await stream.start_tls( 7222s ^^^^^^^^^^^^^^^^^^^^^^^ 7222s False, ssl_options=ssl_options, server_hostname=host 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 7222s self.socket.do_handshake() 7222s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 7222s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 7222s self._sslobj.do_handshake() 7222s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 7222s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 7222s raise FatalCommClosedError( 7222s ...<2 lines>... 7222s ) from err 7222s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 7222s 7222s During handling of the above exception, another exception occurred: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1218, in _register_with_scheduler 7222s await asyncio.sleep(0.1) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 718, in sleep 7222s return await future 7222s ^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 15s. 7222s 2024-11-23 22:26:32,869 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:26:32,876 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:32,877 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42731/status 7222s 2024-11-23 22:26:32,877 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:26:32,893 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46191 7222s 2024-11-23 22:26:32,893 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46191 7222s 2024-11-23 22:26:32,893 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:26:32,893 - distributed.worker - INFO - dashboard at: 127.0.0.1:34627 7222s 2024-11-23 22:26:32,893 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:32,893 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:26:32,893 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:26:32,893 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:26:32,893 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-5vr4u8i_ 7222s 2024-11-23 22:26:32,894 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:26:32,896 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37895 7222s 2024-11-23 22:26:32,896 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37895 7222s 2024-11-23 22:26:32,896 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:26:32,896 - distributed.worker - INFO - dashboard at: 127.0.0.1:36229 7222s 2024-11-23 22:26:32,896 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:32,896 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:26:32,896 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:26:32,896 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:26:32,896 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ukvkvzhp 7222s 2024-11-23 22:26:32,896 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:26:32,909 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:32,910 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:32,910 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:46440': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:32,910 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:46456': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:33,023 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:33,023 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:33,023 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:46470': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:33,023 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:46474': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:33,137 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:33,137 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:33,137 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:46478': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:33,137 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:46488': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:33,251 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:33,251 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:33,251 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:46502': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:33,251 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:46516': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:33,364 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:33,364 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:33,365 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:46532': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:33,365 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:46540': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:33,478 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:33,478 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:33,479 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:46546': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:33,479 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:46548': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:33,591 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:33,591 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:33,592 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:46564': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:33,592 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:46580': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:33,704 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:33,704 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:33,705 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:46590': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:33,705 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:46606': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:33,817 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:33,818 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:33,818 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:46610': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:33,818 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:46618': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:33,931 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:33,931 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:33,932 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:46622': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:33,932 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:46626': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:34,044 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:34,044 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:34,045 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:46642': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:34,045 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:46652': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:34,159 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:34,159 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:34,160 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:46660': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:34,160 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:46664': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:34,273 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:34,273 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:34,273 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:46668': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:34,274 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:46684': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:34,391 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:34,391 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:34,391 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:46686': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:34,391 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:46690': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:34,505 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:34,505 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:34,506 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:46706': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:34,506 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:46714': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:34,619 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:34,619 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:34,619 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:46726': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:34,619 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:46730': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:34,732 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:34,733 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:34,733 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:46732': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:34,733 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:46742': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:34,845 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:34,846 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:34,850 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:46748': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:34,850 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:46760': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:34,959 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:34,959 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:34,959 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:46766': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:34,959 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:46776': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:35,072 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:35,072 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:35,073 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:46780': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:35,073 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:46796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:35,185 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:35,185 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:35,186 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:46802': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:35,186 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:46816': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:35,298 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:35,298 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:35,299 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:46828': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:35,299 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:46832': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:35,411 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:35,412 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:35,412 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:46834': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:35,412 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:46844': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:35,525 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:35,525 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:35,525 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:46858': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:35,525 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:46874': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:35,639 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:35,639 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:35,639 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:46882': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:35,639 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:46894': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:35,754 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:35,754 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:35,754 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:46902': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:35,754 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:46914': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:35,867 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:35,867 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:35,868 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:46920': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:35,868 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:46928': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:35,980 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:35,981 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:35,981 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:46932': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:35,981 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:46942': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:36,094 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:36,094 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:36,095 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:46946': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:36,095 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:46960': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:36,208 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:36,208 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:36,208 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:46970': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:36,208 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:46982': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:36,321 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:36,321 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:36,321 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:46998': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:36,321 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:47000': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:36,434 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:36,434 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:36,435 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:47008': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:36,435 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:47016': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:36,548 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:36,549 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:36,549 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:47026': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:36,549 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:47036': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:36,662 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:36,662 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:36,662 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:47048': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:36,662 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:47054': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:36,775 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:36,775 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:36,776 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:47066': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:36,776 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:47072': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:36,887 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:36,891 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:47078': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:36,892 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:36,892 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:47092': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:36,994 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:36,995 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:47102': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:37,001 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:37,001 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:47112': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:37,101 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:37,102 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:47116': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:37,108 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:37,108 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:47132': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:37,209 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:37,209 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:47138': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:37,216 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:37,216 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:47142': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:37,316 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:37,317 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:47156': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:37,325 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:37,325 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:47162': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:37,425 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:37,425 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:47166': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:37,432 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:37,432 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:47172': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:37,532 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:37,533 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:47174': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:37,540 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:37,540 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:47184': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:37,640 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:37,641 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:47194': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:37,647 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:37,648 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:47208': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:37,749 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:37,750 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:47210': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:37,756 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:37,756 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:47216': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:37,856 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:37,857 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:47222': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:37,864 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:37,864 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:47230': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:37,965 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:37,966 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:47246': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:37,972 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:37,973 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:47256': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:38,073 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:38,073 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:47270': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:38,080 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:38,080 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:47278': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:38,180 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:38,181 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:47290': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:38,187 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:38,187 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:47300': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:38,289 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:38,290 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:47306': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:38,296 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:38,296 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:47308': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:38,397 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:38,397 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:47310': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:38,404 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:38,404 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:47318': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:38,505 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:38,505 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:47330': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:38,512 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:38,512 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:47338': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:38,612 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:38,613 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:47342': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:38,619 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:38,620 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:47356': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:38,720 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:38,721 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:47360': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:38,727 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:38,728 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:47374': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:38,827 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:38,828 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:47378': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:38,834 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:38,836 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:47392': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:38,935 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:38,936 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:47406': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:38,942 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:38,943 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:47422': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:39,043 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:39,044 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:47432': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:39,050 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:39,050 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:47444': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:39,151 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:39,151 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:47460': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:39,158 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:39,158 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:47462': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:39,258 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:39,259 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:47464': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:39,265 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:39,266 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:47474': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:39,366 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:39,366 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:47482': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:39,373 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:39,373 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:47496': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:39,473 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:39,474 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:47510': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:39,480 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:39,481 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:47516': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:39,581 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:39,582 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:47528': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:39,588 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:39,589 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:47538': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:39,689 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:39,690 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:47550': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:39,696 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:39,696 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:47560': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:39,798 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:39,798 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:47564': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:39,805 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:39,805 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:47580': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:39,905 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:39,906 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:47596': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:39,912 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:39,913 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:47600': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:40,014 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:40,014 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:47612': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:40,020 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:40,021 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:47620': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:40,121 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:40,122 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:47634': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:40,128 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:40,129 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:47638': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:40,229 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:40,229 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:47652': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:40,235 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:40,236 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:47658': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:40,338 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:40,339 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:47670': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:40,346 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:40,349 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:47684': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:40,445 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:40,446 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:47696': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:40,452 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:40,453 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:47712': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:40,553 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:40,554 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:47716': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:40,560 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:40,560 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:47724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:40,661 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:40,662 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:47740': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:40,669 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:40,669 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:47746': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:40,770 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:40,771 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:47748': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:40,777 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:40,778 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:47762': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:40,879 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:40,883 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:47778': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:40,889 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:40,889 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:47780': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:40,986 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:40,987 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:47796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:40,997 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:40,997 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:47800': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:41,096 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:41,096 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:47806': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:41,104 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:41,105 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:47816': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:41,204 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:41,205 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:47824': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:41,211 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:41,212 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:47834': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:41,312 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:41,312 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:47840': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:41,319 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:41,319 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:47850': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:41,420 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:41,421 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:47860': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:41,427 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:41,427 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:47870': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:41,528 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:41,529 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:47884': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:41,535 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:41,536 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:38780': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:41,636 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:41,637 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:38790': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:41,643 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:41,643 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:38802': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:41,746 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:41,747 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:38810': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:41,753 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:41,753 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:38818': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:41,853 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:41,853 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:38832': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:41,861 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:41,862 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:38836': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:41,961 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:41,962 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:38842': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:41,968 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:41,968 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:38856': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:42,069 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:42,070 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:38872': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:42,076 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:42,076 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:38882': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:42,178 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:42,179 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:38884': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:42,185 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:42,185 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:38898': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:42,285 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:42,286 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:38900': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:42,292 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:42,292 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:38906': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:42,392 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:42,393 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:38916': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:42,399 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:42,400 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:38924': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:42,501 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:42,502 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:38926': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:42,508 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:42,508 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:38928': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:42,608 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:42,608 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:38934': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:42,615 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:42,615 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:38948': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:42,716 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:42,716 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:38962': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:42,722 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:42,723 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:38976': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:42,823 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:42,824 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:38990': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:42,830 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:42,830 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:39006': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:42,931 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:42,931 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:39020': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:42,938 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:42,938 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:39026': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:43,039 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:43,040 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:39028': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:43,046 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:43,046 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:39036': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:43,146 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:43,147 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:39052': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:43,153 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:43,153 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:39056': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:43,254 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:43,254 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:39064': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:43,261 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:43,261 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:39074': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:43,361 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:43,362 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:39080': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:43,369 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:43,370 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:39090': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:43,471 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:43,472 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:39096': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:43,478 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:43,478 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:39106': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:43,579 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:43,579 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:39112': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:43,586 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:43,586 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:39122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:43,686 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:43,687 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:39128': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:43,693 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:43,693 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:39140': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:43,795 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:43,796 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:39144': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:43,802 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:43,802 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:39160': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:43,902 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:43,903 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:39162': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:43,909 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:43,910 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:39174': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:44,012 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:44,013 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:39188': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:44,019 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:44,019 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:39202': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:44,120 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:44,121 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:39214': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:44,127 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:44,127 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:39230': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:44,228 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:44,229 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:39244': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:44,235 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:44,236 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:39254': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:44,336 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:44,337 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:39256': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:44,343 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:44,344 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:39270': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:44,445 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:44,446 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:39286': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:44,452 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:44,452 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:39296': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:44,552 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:44,553 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:39312': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:44,559 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:44,559 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:39322': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:44,660 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:44,661 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:39336': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:44,667 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:44,668 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:39350': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:44,768 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:44,768 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:39362': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:44,775 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:44,775 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:39372': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:44,876 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:44,877 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:39374': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:44,887 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:44,888 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:39384': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:44,984 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:44,985 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:39398': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:44,995 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:44,995 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:39408': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:45,092 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:45,093 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:39414': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:45,102 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:45,102 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:39424': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:45,200 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:45,201 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:39436': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:45,209 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:45,210 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:39448': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:45,308 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:45,308 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:39462': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:45,317 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:45,317 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:39476': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:45,415 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:45,416 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:39478': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:45,423 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:45,424 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:39492': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:45,523 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:45,524 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:39508': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:45,530 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:45,530 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:39518': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:45,630 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:45,631 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:39524': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:45,637 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:45,638 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:39532': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:45,739 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:45,739 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:39536': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:45,746 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:45,746 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:39546': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:45,847 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:45,851 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:39558': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:45,857 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36759 7222s 2024-11-23 22:26:45,858 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:39574': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:26:45,892 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46191. Reason: failure-to-start- 7222s 2024-11-23 22:26:45,892 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:26:45,894 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 13s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 7222s stream = await stream.start_tls( 7222s ^^^^^^^^^^^^^^^^^^^^^^^ 7222s False, ssl_options=ssl_options, server_hostname=host 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 7222s self.socket.do_handshake() 7222s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 7222s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 7222s self._sslobj.do_handshake() 7222s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 7222s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 7222s raise FatalCommClosedError( 7222s ...<2 lines>... 7222s ) from err 7222s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 7222s 7222s During handling of the above exception, another exception occurred: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1218, in _register_with_scheduler 7222s await asyncio.sleep(0.1) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 718, in sleep 7222s return await future 7222s ^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 13s. 7222s 2024-11-23 22:26:45,898 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37895. Reason: failure-to-start- 7222s 2024-11-23 22:26:45,898 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:26:46,900 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:26:46,907 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35931 7222s 2024-11-23 22:26:46,907 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41609/status 7222s 2024-11-23 22:26:46,908 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:26:46,924 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42283 7222s 2024-11-23 22:26:46,925 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42283 7222s 2024-11-23 22:26:46,925 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:26:46,925 - distributed.worker - INFO - dashboard at: 127.0.0.1:40349 7222s 2024-11-23 22:26:46,925 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35931 7222s 2024-11-23 22:26:46,925 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:26:46,925 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:26:46,925 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:26:46,925 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-f51u_vp6 7222s 2024-11-23 22:26:46,925 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:26:46,927 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44451 7222s 2024-11-23 22:26:46,927 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44451 7222s 2024-11-23 22:26:46,927 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:26:46,927 - distributed.worker - INFO - dashboard at: 127.0.0.1:35479 7222s 2024-11-23 22:26:46,927 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35931 7222s 2024-11-23 22:26:46,927 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:26:46,927 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:26:46,927 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:26:46,928 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-gptm1tck 7222s 2024-11-23 22:26:46,928 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:26:46,929 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42283. Reason: failure-to-start- 7222s 2024-11-23 22:26:46,929 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:26:46,929 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44451. Reason: failure-to-start- 7222s 2024-11-23 22:26:46,929 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:26:46,931 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35931': TLS handshake failed with remote 'tls://127.0.0.1:44678': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:26:46,931 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35931': TLS handshake failed with remote 'tls://127.0.0.1:44694': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:26:46,933 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s 2024-11-23 22:26:47,940 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:26:47,947 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38949 7222s 2024-11-23 22:26:47,947 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45223/status 7222s 2024-11-23 22:26:47,947 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:26:47,960 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43151 7222s 2024-11-23 22:26:47,960 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43151 7222s 2024-11-23 22:26:47,960 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:26:47,961 - distributed.worker - INFO - dashboard at: 127.0.0.1:45129 7222s 2024-11-23 22:26:47,961 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38949 7222s 2024-11-23 22:26:47,961 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:26:47,961 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:26:47,961 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:26:47,961 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-42rpc2ca 7222s 2024-11-23 22:26:47,961 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:26:47,964 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35151 7222s 2024-11-23 22:26:47,964 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35151 7222s 2024-11-23 22:26:47,964 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:26:47,964 - distributed.worker - INFO - dashboard at: 127.0.0.1:35601 7222s 2024-11-23 22:26:47,964 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38949 7222s 2024-11-23 22:26:47,964 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:26:47,964 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:26:47,964 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:26:47,964 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-40gdwxsk 7222s 2024-11-23 22:26:47,964 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:26:47,965 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43151. Reason: failure-to-start- 7222s 2024-11-23 22:26:47,966 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:26:47,966 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35151. Reason: failure-to-start- 7222s 2024-11-23 22:26:47,966 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:26:47,967 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38949': TLS handshake failed with remote 'tls://127.0.0.1:53036': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:26:47,968 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38949': TLS handshake failed with remote 'tls://127.0.0.1:53050': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:26:47,969 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s 2024-11-23 22:26:48,975 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:26:48,982 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42007 7222s 2024-11-23 22:26:48,982 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37547/status 7222s 2024-11-23 22:26:48,982 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:26:48,995 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46419 7222s 2024-11-23 22:26:48,995 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46419 7222s 2024-11-23 22:26:48,995 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:26:48,995 - distributed.worker - INFO - dashboard at: 127.0.0.1:45827 7222s 2024-11-23 22:26:48,995 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42007 7222s 2024-11-23 22:26:48,996 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:26:48,996 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:26:48,996 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:26:48,996 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-u3ynb_zh 7222s 2024-11-23 22:26:48,996 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:26:48,998 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37995 7222s 2024-11-23 22:26:48,998 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37995 7222s 2024-11-23 22:26:48,998 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:26:48,998 - distributed.worker - INFO - dashboard at: 127.0.0.1:40617 7222s 2024-11-23 22:26:48,998 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42007 7222s 2024-11-23 22:26:48,998 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:26:48,998 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:26:48,998 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:26:48,998 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-sw7qi3ax 7222s 2024-11-23 22:26:48,998 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:26:48,999 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46419. Reason: failure-to-start- 7222s 2024-11-23 22:26:49,000 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:26:49,000 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37995. Reason: failure-to-start- 7222s 2024-11-23 22:26:49,000 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:26:49,001 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42007': TLS handshake failed with remote 'tls://127.0.0.1:32812': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:26:49,002 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42007': TLS handshake failed with remote 'tls://127.0.0.1:32820': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:26:49,003 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s 2024-11-23 22:26:50,009 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:26:50,016 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37617 7222s 2024-11-23 22:26:50,016 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41381/status 7222s 2024-11-23 22:26:50,016 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:26:50,029 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37719 7222s 2024-11-23 22:26:50,029 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37719 7222s 2024-11-23 22:26:50,029 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:26:50,029 - distributed.worker - INFO - dashboard at: 127.0.0.1:42875 7222s 2024-11-23 22:26:50,030 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37617 7222s 2024-11-23 22:26:50,030 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:26:50,030 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:26:50,030 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:26:50,030 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-jr8xbefn 7222s 2024-11-23 22:26:50,030 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:26:50,032 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43339 7222s 2024-11-23 22:26:50,032 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43339 7222s 2024-11-23 22:26:50,032 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:26:50,032 - distributed.worker - INFO - dashboard at: 127.0.0.1:44965 7222s 2024-11-23 22:26:50,032 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37617 7222s 2024-11-23 22:26:50,032 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:26:50,032 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:26:50,032 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:26:50,032 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-g3ee2idr 7222s 2024-11-23 22:26:50,032 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:26:50,033 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37719. Reason: failure-to-start- 7222s 2024-11-23 22:26:50,033 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:26:50,034 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43339. Reason: failure-to-start- 7222s 2024-11-23 22:26:50,034 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:26:50,035 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37617': TLS handshake failed with remote 'tls://127.0.0.1:46952': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:26:50,036 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37617': TLS handshake failed with remote 'tls://127.0.0.1:46968': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:26:50,037 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s 2024-11-23 22:26:51,043 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:26:51,051 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35095 7222s 2024-11-23 22:26:51,051 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45923/status 7222s 2024-11-23 22:26:51,051 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:26:51,067 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40405 7222s 2024-11-23 22:26:51,067 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40405 7222s 2024-11-23 22:26:51,067 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:26:51,067 - distributed.worker - INFO - dashboard at: 127.0.0.1:45637 7222s 2024-11-23 22:26:51,067 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35095 7222s 2024-11-23 22:26:51,068 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:26:51,068 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:26:51,068 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:26:51,068 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-db0f774j 7222s 2024-11-23 22:26:51,068 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:26:51,070 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35235 7222s 2024-11-23 22:26:51,070 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35235 7222s 2024-11-23 22:26:51,070 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:26:51,070 - distributed.worker - INFO - dashboard at: 127.0.0.1:45121 7222s 2024-11-23 22:26:51,070 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35095 7222s 2024-11-23 22:26:51,070 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:26:51,070 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:26:51,070 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:26:51,070 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-6jjok_fl 7222s 2024-11-23 22:26:51,071 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:26:51,072 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40405. Reason: failure-to-start- 7222s 2024-11-23 22:26:51,072 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:26:51,072 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35235. Reason: failure-to-start- 7222s 2024-11-23 22:26:51,073 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:26:51,074 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35095': TLS handshake failed with remote 'tls://127.0.0.1:60912': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:26:51,074 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35095': TLS handshake failed with remote 'tls://127.0.0.1:60928': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:26:51,075 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s 2024-11-23 22:26:52,080 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:26:52,088 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42175 7222s 2024-11-23 22:26:52,088 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34937/status 7222s 2024-11-23 22:26:52,088 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:26:52,102 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42287 7222s 2024-11-23 22:26:52,102 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42287 7222s 2024-11-23 22:26:52,103 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:26:52,103 - distributed.worker - INFO - dashboard at: 127.0.0.1:42475 7222s 2024-11-23 22:26:52,103 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42175 7222s 2024-11-23 22:26:52,103 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:26:52,103 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:26:52,103 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:26:52,103 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-c2zcmzuo 7222s 2024-11-23 22:26:52,103 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:26:52,106 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45947 7222s 2024-11-23 22:26:52,106 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45947 7222s 2024-11-23 22:26:52,106 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:26:52,106 - distributed.worker - INFO - dashboard at: 127.0.0.1:36713 7222s 2024-11-23 22:26:52,106 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42175 7222s 2024-11-23 22:26:52,106 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:26:52,106 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:26:52,106 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:26:52,106 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-82dguxei 7222s 2024-11-23 22:26:52,106 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:26:52,108 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42287. Reason: failure-to-start- 7222s 2024-11-23 22:26:52,108 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:26:52,108 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45947. Reason: failure-to-start- 7222s 2024-11-23 22:26:52,108 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:26:52,109 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42175': TLS handshake failed with remote 'tls://127.0.0.1:59302': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:26:52,110 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42175': TLS handshake failed with remote 'tls://127.0.0.1:59308': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:26:52,111 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s 2024-11-23 22:26:53,116 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:26:53,123 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40365 7222s 2024-11-23 22:26:53,123 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39555/status 7222s 2024-11-23 22:26:53,123 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:26:53,137 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39367 7222s 2024-11-23 22:26:53,137 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39367 7222s 2024-11-23 22:26:53,137 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:26:53,137 - distributed.worker - INFO - dashboard at: 127.0.0.1:39551 7222s 2024-11-23 22:26:53,137 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40365 7222s 2024-11-23 22:26:53,137 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:26:53,137 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:26:53,137 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:26:53,137 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-tou8icei 7222s 2024-11-23 22:26:53,137 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:26:53,139 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35679 7222s 2024-11-23 22:26:53,139 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35679 7222s 2024-11-23 22:26:53,139 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:26:53,140 - distributed.worker - INFO - dashboard at: 127.0.0.1:36763 7222s 2024-11-23 22:26:53,140 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40365 7222s 2024-11-23 22:26:53,140 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:26:53,140 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:26:53,140 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:26:53,140 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-6ymmgji7 7222s 2024-11-23 22:26:53,140 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:26:53,141 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39367. Reason: failure-to-start- 7222s 2024-11-23 22:26:53,141 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:26:53,141 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35679. Reason: failure-to-start- 7222s 2024-11-23 22:26:53,142 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:26:53,143 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40365': TLS handshake failed with remote 'tls://127.0.0.1:34760': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:26:53,143 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40365': TLS handshake failed with remote 'tls://127.0.0.1:34776': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:26:53,144 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s 2024-11-23 22:26:54,151 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:26:54,158 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41687 7222s 2024-11-23 22:26:54,158 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38521/status 7222s 2024-11-23 22:26:54,159 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:26:54,172 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45681 7222s 2024-11-23 22:26:54,172 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45681 7222s 2024-11-23 22:26:54,172 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:26:54,172 - distributed.worker - INFO - dashboard at: 127.0.0.1:40679 7222s 2024-11-23 22:26:54,172 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41687 7222s 2024-11-23 22:26:54,172 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:26:54,172 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:26:54,172 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:26:54,172 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-3ymmc7s6 7222s 2024-11-23 22:26:54,172 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:26:54,175 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37541 7222s 2024-11-23 22:26:54,175 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37541 7222s 2024-11-23 22:26:54,175 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:26:54,175 - distributed.worker - INFO - dashboard at: 127.0.0.1:33249 7222s 2024-11-23 22:26:54,175 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41687 7222s 2024-11-23 22:26:54,175 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:26:54,175 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:26:54,175 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:26:54,175 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-jlors1le 7222s 2024-11-23 22:26:54,175 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:26:54,176 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45681. Reason: failure-to-start- 7222s 2024-11-23 22:26:54,176 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:26:54,177 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37541. Reason: failure-to-start- 7222s 2024-11-23 22:26:54,177 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:26:54,178 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41687': TLS handshake failed with remote 'tls://127.0.0.1:56664': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:26:54,178 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41687': TLS handshake failed with remote 'tls://127.0.0.1:56678': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:26:54,180 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s 2024-11-23 22:26:55,185 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:26:55,192 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41939 7222s 2024-11-23 22:26:55,192 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44893/status 7222s 2024-11-23 22:26:55,192 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:26:55,207 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44311 7222s 2024-11-23 22:26:55,207 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44311 7222s 2024-11-23 22:26:55,207 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:26:55,207 - distributed.worker - INFO - dashboard at: 127.0.0.1:35877 7222s 2024-11-23 22:26:55,207 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41939 7222s 2024-11-23 22:26:55,208 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:26:55,208 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:26:55,208 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:26:55,208 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-7kgxutt6 7222s 2024-11-23 22:26:55,208 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:26:55,210 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39445 7222s 2024-11-23 22:26:55,210 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39445 7222s 2024-11-23 22:26:55,210 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:26:55,210 - distributed.worker - INFO - dashboard at: 127.0.0.1:43405 7222s 2024-11-23 22:26:55,210 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41939 7222s 2024-11-23 22:26:55,210 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:26:55,210 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:26:55,210 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:26:55,210 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-b7bnoxyt 7222s 2024-11-23 22:26:55,210 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:26:55,212 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44311. Reason: failure-to-start- 7222s 2024-11-23 22:26:55,212 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:26:55,212 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39445. Reason: failure-to-start- 7222s 2024-11-23 22:26:55,212 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:26:55,214 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41939': TLS handshake failed with remote 'tls://127.0.0.1:55330': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:26:55,214 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41939': TLS handshake failed with remote 'tls://127.0.0.1:55342': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:26:55,215 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s 2024-11-23 22:26:56,221 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:26:56,227 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39077 7222s 2024-11-23 22:26:56,228 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41043/status 7222s 2024-11-23 22:26:56,228 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:26:56,241 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39893 7222s 2024-11-23 22:26:56,242 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39893 7222s 2024-11-23 22:26:56,242 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:26:56,242 - distributed.worker - INFO - dashboard at: 127.0.0.1:38407 7222s 2024-11-23 22:26:56,242 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39077 7222s 2024-11-23 22:26:56,242 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:26:56,242 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:26:56,242 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:26:56,242 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-a5736izw 7222s 2024-11-23 22:26:56,242 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:26:56,244 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41403 7222s 2024-11-23 22:26:56,244 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41403 7222s 2024-11-23 22:26:56,244 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:26:56,244 - distributed.worker - INFO - dashboard at: 127.0.0.1:40811 7222s 2024-11-23 22:26:56,244 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39077 7222s 2024-11-23 22:26:56,245 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:26:56,245 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:26:56,245 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:26:56,245 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-373y8u5s 7222s 2024-11-23 22:26:56,245 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:26:56,246 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39893. Reason: failure-to-start- 7222s 2024-11-23 22:26:56,246 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:26:56,246 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41403. Reason: failure-to-start- 7222s 2024-11-23 22:26:56,247 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:26:56,248 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39077': TLS handshake failed with remote 'tls://127.0.0.1:33028': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:26:56,248 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39077': TLS handshake failed with remote 'tls://127.0.0.1:33030': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:26:56,249 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s 2024-11-23 22:26:57,255 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:26:57,262 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39689 7222s 2024-11-23 22:26:57,263 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45175/status 7222s 2024-11-23 22:26:57,263 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:26:57,277 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46631 7222s 2024-11-23 22:26:57,277 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46631 7222s 2024-11-23 22:26:57,277 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:26:57,277 - distributed.worker - INFO - dashboard at: 127.0.0.1:33423 7222s 2024-11-23 22:26:57,277 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39689 7222s 2024-11-23 22:26:57,277 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:26:57,277 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:26:57,277 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:26:57,277 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-qcjha1d9 7222s 2024-11-23 22:26:57,277 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:26:57,279 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:32991 7222s 2024-11-23 22:26:57,279 - distributed.worker - INFO - Listening to: tls://127.0.0.1:32991 7222s 2024-11-23 22:26:57,279 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:26:57,280 - distributed.worker - INFO - dashboard at: 127.0.0.1:45135 7222s 2024-11-23 22:26:57,280 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39689 7222s 2024-11-23 22:26:57,281 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:26:57,281 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:26:57,281 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:26:57,281 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-owkk77zr 7222s 2024-11-23 22:26:57,281 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:26:57,282 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46631. Reason: failure-to-start- 7222s 2024-11-23 22:26:57,282 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:26:57,282 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:32991. Reason: failure-to-start- 7222s 2024-11-23 22:26:57,283 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:26:57,284 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39689': TLS handshake failed with remote 'tls://127.0.0.1:35670': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:26:57,284 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39689': TLS handshake failed with remote 'tls://127.0.0.1:35676': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:26:57,285 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s 2024-11-23 22:26:58,291 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:26:58,298 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41383 7222s 2024-11-23 22:26:58,298 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35047/status 7222s 2024-11-23 22:26:58,298 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:26:58,312 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39215 7222s 2024-11-23 22:26:58,312 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39215 7222s 2024-11-23 22:26:58,312 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:26:58,312 - distributed.worker - INFO - dashboard at: 127.0.0.1:40133 7222s 2024-11-23 22:26:58,312 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41383 7222s 2024-11-23 22:26:58,312 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:26:58,312 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:26:58,312 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:26:58,312 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-dxu1132c 7222s 2024-11-23 22:26:58,312 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:26:58,315 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37743 7222s 2024-11-23 22:26:58,315 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37743 7222s 2024-11-23 22:26:58,315 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:26:58,315 - distributed.worker - INFO - dashboard at: 127.0.0.1:44079 7222s 2024-11-23 22:26:58,315 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41383 7222s 2024-11-23 22:26:58,315 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:26:58,315 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:26:58,315 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:26:58,315 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-3_ukgkow 7222s 2024-11-23 22:26:58,315 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:26:58,316 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39215. Reason: failure-to-start- 7222s 2024-11-23 22:26:58,317 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:26:58,317 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37743. Reason: failure-to-start- 7222s 2024-11-23 22:26:58,317 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:26:58,318 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41383': TLS handshake failed with remote 'tls://127.0.0.1:39986': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:26:58,318 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41383': TLS handshake failed with remote 'tls://127.0.0.1:39996': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:26:58,320 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s 2024-11-23 22:26:59,326 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:26:59,333 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34807 7222s 2024-11-23 22:26:59,333 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34125/status 7222s 2024-11-23 22:26:59,333 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:26:59,346 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43013 7222s 2024-11-23 22:26:59,346 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43013 7222s 2024-11-23 22:26:59,346 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:26:59,346 - distributed.worker - INFO - dashboard at: 127.0.0.1:38483 7222s 2024-11-23 22:26:59,346 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34807 7222s 2024-11-23 22:26:59,346 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:26:59,346 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:26:59,346 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:26:59,346 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-z7g_f_31 7222s 2024-11-23 22:26:59,347 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:26:59,349 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35803 7222s 2024-11-23 22:26:59,349 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35803 7222s 2024-11-23 22:26:59,349 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:26:59,349 - distributed.worker - INFO - dashboard at: 127.0.0.1:38173 7222s 2024-11-23 22:26:59,349 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34807 7222s 2024-11-23 22:26:59,349 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:26:59,349 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:26:59,349 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:26:59,349 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-li549oo_ 7222s 2024-11-23 22:26:59,349 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:26:59,353 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43013. Reason: failure-to-start- 7222s 2024-11-23 22:26:59,353 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:26:59,353 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35803. Reason: failure-to-start- 7222s 2024-11-23 22:26:59,353 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:26:59,355 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34807': TLS handshake failed with remote 'tls://127.0.0.1:35840': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:26:59,355 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34807': TLS handshake failed with remote 'tls://127.0.0.1:35846': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:26:59,356 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s 2024-11-23 22:27:00,362 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:27:00,368 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35595 7222s 2024-11-23 22:27:00,368 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46253/status 7222s 2024-11-23 22:27:00,369 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:27:00,383 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43775 7222s 2024-11-23 22:27:00,383 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43775 7222s 2024-11-23 22:27:00,383 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:27:00,383 - distributed.worker - INFO - dashboard at: 127.0.0.1:39713 7222s 2024-11-23 22:27:00,383 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35595 7222s 2024-11-23 22:27:00,383 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:27:00,383 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:27:00,383 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:27:00,383 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ufb7i1fp 7222s 2024-11-23 22:27:00,383 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:27:00,385 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44547 7222s 2024-11-23 22:27:00,386 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44547 7222s 2024-11-23 22:27:00,386 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:27:00,386 - distributed.worker - INFO - dashboard at: 127.0.0.1:46435 7222s 2024-11-23 22:27:00,386 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35595 7222s 2024-11-23 22:27:00,386 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:27:00,386 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:27:00,386 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:27:00,386 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-tqcsd870 7222s 2024-11-23 22:27:00,386 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:27:00,390 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43775. Reason: failure-to-start- 7222s 2024-11-23 22:27:00,390 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:27:00,390 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44547. Reason: failure-to-start- 7222s 2024-11-23 22:27:00,390 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:27:00,392 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35595': TLS handshake failed with remote 'tls://127.0.0.1:46960': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:27:00,392 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35595': TLS handshake failed with remote 'tls://127.0.0.1:46962': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:27:00,393 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s 2024-11-23 22:27:01,399 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:27:01,405 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34907 7222s 2024-11-23 22:27:01,405 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33081/status 7222s 2024-11-23 22:27:01,405 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:27:01,419 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39749 7222s 2024-11-23 22:27:01,419 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39749 7222s 2024-11-23 22:27:01,419 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:27:01,419 - distributed.worker - INFO - dashboard at: 127.0.0.1:37435 7222s 2024-11-23 22:27:01,419 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 7222s 2024-11-23 22:27:01,419 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:27:01,420 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:27:01,420 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:27:01,420 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-tt8mb84w 7222s 2024-11-23 22:27:01,420 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:27:01,422 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35781 7222s 2024-11-23 22:27:01,422 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35781 7222s 2024-11-23 22:27:01,422 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:27:01,422 - distributed.worker - INFO - dashboard at: 127.0.0.1:39813 7222s 2024-11-23 22:27:01,422 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34907 7222s 2024-11-23 22:27:01,422 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:27:01,422 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:27:01,422 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:27:01,422 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-wjcgmfon 7222s 2024-11-23 22:27:01,422 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:27:01,426 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39749. Reason: failure-to-start- 7222s 2024-11-23 22:27:01,426 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:27:01,427 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35781. Reason: failure-to-start- 7222s 2024-11-23 22:27:01,427 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:27:01,429 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:42244': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:27:01,429 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34907': TLS handshake failed with remote 'tls://127.0.0.1:42260': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:27:01,430 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s 2024-11-23 22:27:02,436 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:27:02,442 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35027 7222s 2024-11-23 22:27:02,442 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43027/status 7222s 2024-11-23 22:27:02,443 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:27:02,455 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:32813 7222s 2024-11-23 22:27:02,455 - distributed.worker - INFO - Listening to: tls://127.0.0.1:32813 7222s 2024-11-23 22:27:02,455 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:27:02,455 - distributed.worker - INFO - dashboard at: 127.0.0.1:40689 7222s 2024-11-23 22:27:02,456 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35027 7222s 2024-11-23 22:27:02,456 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:27:02,456 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:27:02,456 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:27:02,456 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-qijc8ic7 7222s 2024-11-23 22:27:02,456 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:27:02,471 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36199 7222s 2024-11-23 22:27:02,471 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36199 7222s 2024-11-23 22:27:02,471 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:27:02,471 - distributed.worker - INFO - dashboard at: 127.0.0.1:43867 7222s 2024-11-23 22:27:02,471 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35027 7222s 2024-11-23 22:27:02,471 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:27:02,471 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:27:02,471 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:27:02,471 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-p5mpsimj 7222s 2024-11-23 22:27:02,471 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:27:02,475 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:32813. Reason: failure-to-start- 7222s 2024-11-23 22:27:02,475 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:27:02,475 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36199. Reason: failure-to-start- 7222s 2024-11-23 22:27:02,476 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:27:02,477 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35027': TLS handshake failed with remote 'tls://127.0.0.1:57066': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:27:02,477 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35027': TLS handshake failed with remote 'tls://127.0.0.1:57072': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:27:02,479 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s 2024-11-23 22:27:03,485 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:27:03,491 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42895 7222s 2024-11-23 22:27:03,492 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38743/status 7222s 2024-11-23 22:27:03,492 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:27:03,506 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37333 7222s 2024-11-23 22:27:03,507 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37333 7222s 2024-11-23 22:27:03,507 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:27:03,507 - distributed.worker - INFO - dashboard at: 127.0.0.1:37481 7222s 2024-11-23 22:27:03,507 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42895 7222s 2024-11-23 22:27:03,507 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:27:03,507 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:27:03,507 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:27:03,507 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-u4kniakz 7222s 2024-11-23 22:27:03,507 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:27:03,509 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37689 7222s 2024-11-23 22:27:03,509 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37689 7222s 2024-11-23 22:27:03,509 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:27:03,509 - distributed.worker - INFO - dashboard at: 127.0.0.1:39471 7222s 2024-11-23 22:27:03,510 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42895 7222s 2024-11-23 22:27:03,510 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:27:03,510 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:27:03,510 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:27:03,510 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-a090jb0m 7222s 2024-11-23 22:27:03,510 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:27:03,511 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37333. Reason: failure-to-start- 7222s 2024-11-23 22:27:03,511 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:27:03,511 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37689. Reason: failure-to-start- 7222s 2024-11-23 22:27:03,512 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:27:03,513 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42895': TLS handshake failed with remote 'tls://127.0.0.1:52606': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:27:03,513 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42895': TLS handshake failed with remote 'tls://127.0.0.1:52612': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:27:03,514 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s 2024-11-23 22:27:04,522 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:27:04,530 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42813 7222s 2024-11-23 22:27:04,531 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37339/status 7222s 2024-11-23 22:27:04,531 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:27:04,545 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45267 7222s 2024-11-23 22:27:04,545 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45267 7222s 2024-11-23 22:27:04,545 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:27:04,545 - distributed.worker - INFO - dashboard at: 127.0.0.1:46337 7222s 2024-11-23 22:27:04,545 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42813 7222s 2024-11-23 22:27:04,545 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:27:04,545 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:27:04,545 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:27:04,545 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-6heyu4qa 7222s 2024-11-23 22:27:04,546 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:27:04,548 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41829 7222s 2024-11-23 22:27:04,548 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41829 7222s 2024-11-23 22:27:04,548 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:27:04,548 - distributed.worker - INFO - dashboard at: 127.0.0.1:39181 7222s 2024-11-23 22:27:04,548 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42813 7222s 2024-11-23 22:27:04,548 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:27:04,548 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:27:04,548 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:27:04,548 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-w_kyuirx 7222s 2024-11-23 22:27:04,548 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:27:04,550 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45267. Reason: failure-to-start- 7222s 2024-11-23 22:27:04,550 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:27:04,550 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41829. Reason: failure-to-start- 7222s 2024-11-23 22:27:04,550 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:27:04,552 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42813': TLS handshake failed with remote 'tls://127.0.0.1:50088': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:27:04,552 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42813': TLS handshake failed with remote 'tls://127.0.0.1:50096': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:27:04,556 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s 2024-11-23 22:27:05,561 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:27:05,569 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41035 7222s 2024-11-23 22:27:05,569 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34745/status 7222s 2024-11-23 22:27:05,569 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:27:05,585 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36857 7222s 2024-11-23 22:27:05,585 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36857 7222s 2024-11-23 22:27:05,585 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:27:05,585 - distributed.worker - INFO - dashboard at: 127.0.0.1:39287 7222s 2024-11-23 22:27:05,585 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41035 7222s 2024-11-23 22:27:05,586 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:27:05,586 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:27:05,586 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:27:05,586 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ntdg5_4n 7222s 2024-11-23 22:27:05,586 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:27:05,588 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44951 7222s 2024-11-23 22:27:05,588 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44951 7222s 2024-11-23 22:27:05,588 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:27:05,588 - distributed.worker - INFO - dashboard at: 127.0.0.1:35169 7222s 2024-11-23 22:27:05,588 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41035 7222s 2024-11-23 22:27:05,588 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:27:05,588 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:27:05,588 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:27:05,588 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ucv2xnpe 7222s 2024-11-23 22:27:05,588 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:27:05,590 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36857. Reason: failure-to-start- 7222s 2024-11-23 22:27:05,590 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:27:05,590 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44951. Reason: failure-to-start- 7222s 2024-11-23 22:27:05,591 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:27:05,594 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41035': TLS handshake failed with remote 'tls://127.0.0.1:47144': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:27:05,594 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41035': TLS handshake failed with remote 'tls://127.0.0.1:47154': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:27:05,596 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s 2024-11-23 22:27:06,602 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:27:06,609 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37875 7222s 2024-11-23 22:27:06,609 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43835/status 7222s 2024-11-23 22:27:06,609 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:27:06,622 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45161 7222s 2024-11-23 22:27:06,623 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45161 7222s 2024-11-23 22:27:06,623 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:27:06,623 - distributed.worker - INFO - dashboard at: 127.0.0.1:41795 7222s 2024-11-23 22:27:06,623 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37875 7222s 2024-11-23 22:27:06,623 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:27:06,623 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:27:06,623 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:27:06,623 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-nu7_7q8s 7222s 2024-11-23 22:27:06,623 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:27:06,625 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46023 7222s 2024-11-23 22:27:06,625 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46023 7222s 2024-11-23 22:27:06,625 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:27:06,625 - distributed.worker - INFO - dashboard at: 127.0.0.1:34961 7222s 2024-11-23 22:27:06,626 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37875 7222s 2024-11-23 22:27:06,626 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:27:06,626 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:27:06,626 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:27:06,626 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-wiu4v2h5 7222s 2024-11-23 22:27:06,626 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:27:06,628 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45161. Reason: failure-to-start- 7222s 2024-11-23 22:27:06,628 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:27:06,629 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46023. Reason: failure-to-start- 7222s 2024-11-23 22:27:06,629 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:27:06,633 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37875': TLS handshake failed with remote 'tls://127.0.0.1:37402': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:27:06,633 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37875': TLS handshake failed with remote 'tls://127.0.0.1:37404': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:27:06,634 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s 2024-11-23 22:27:07,640 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:27:07,647 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41771 7222s 2024-11-23 22:27:07,647 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42971/status 7222s 2024-11-23 22:27:07,647 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:27:07,667 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46291 7222s 2024-11-23 22:27:07,667 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46291 7222s 2024-11-23 22:27:07,667 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:27:07,667 - distributed.worker - INFO - dashboard at: 127.0.0.1:35913 7222s 2024-11-23 22:27:07,667 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41771 7222s 2024-11-23 22:27:07,667 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:27:07,667 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:27:07,667 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:27:07,667 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ydbi9dx9 7222s 2024-11-23 22:27:07,668 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:27:07,670 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34577 7222s 2024-11-23 22:27:07,670 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34577 7222s 2024-11-23 22:27:07,670 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:27:07,670 - distributed.worker - INFO - dashboard at: 127.0.0.1:45807 7222s 2024-11-23 22:27:07,670 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41771 7222s 2024-11-23 22:27:07,670 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:27:07,670 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:27:07,670 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:27:07,670 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-iotph3h9 7222s 2024-11-23 22:27:07,670 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:27:07,674 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46291. Reason: failure-to-start- 7222s 2024-11-23 22:27:07,674 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:27:07,675 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34577. Reason: failure-to-start- 7222s 2024-11-23 22:27:07,675 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:27:07,676 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41771': TLS handshake failed with remote 'tls://127.0.0.1:34968': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:27:07,676 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41771': TLS handshake failed with remote 'tls://127.0.0.1:34976': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:27:07,678 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s 2024-11-23 22:27:08,685 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:27:08,692 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39017 7222s 2024-11-23 22:27:08,692 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45759/status 7222s 2024-11-23 22:27:08,692 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:27:08,706 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44267 7222s 2024-11-23 22:27:08,706 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44267 7222s 2024-11-23 22:27:08,706 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:27:08,706 - distributed.worker - INFO - dashboard at: 127.0.0.1:36561 7222s 2024-11-23 22:27:08,706 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39017 7222s 2024-11-23 22:27:08,706 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:27:08,706 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:27:08,707 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:27:08,707 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-_bfefi7g 7222s 2024-11-23 22:27:08,707 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:27:08,709 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36613 7222s 2024-11-23 22:27:08,709 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36613 7222s 2024-11-23 22:27:08,709 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:27:08,709 - distributed.worker - INFO - dashboard at: 127.0.0.1:41989 7222s 2024-11-23 22:27:08,709 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39017 7222s 2024-11-23 22:27:08,709 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:27:08,709 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:27:08,709 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:27:08,709 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-oe3z7r70 7222s 2024-11-23 22:27:08,709 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:27:08,713 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44267. Reason: failure-to-start- 7222s 2024-11-23 22:27:08,713 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:27:08,714 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36613. Reason: failure-to-start- 7222s 2024-11-23 22:27:08,714 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:27:08,715 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39017': TLS handshake failed with remote 'tls://127.0.0.1:42538': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:27:08,715 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39017': TLS handshake failed with remote 'tls://127.0.0.1:42544': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:27:08,717 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s 2024-11-23 22:27:09,724 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:27:09,734 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39413 7222s 2024-11-23 22:27:09,735 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39305/status 7222s 2024-11-23 22:27:09,736 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:27:09,765 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37621 7222s 2024-11-23 22:27:09,765 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37621 7222s 2024-11-23 22:27:09,765 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:27:09,765 - distributed.worker - INFO - dashboard at: 127.0.0.1:39015 7222s 2024-11-23 22:27:09,765 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39413 7222s 2024-11-23 22:27:09,766 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:27:09,766 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:27:09,766 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:27:09,766 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-hpvu1lkv 7222s 2024-11-23 22:27:09,766 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:27:09,769 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33111 7222s 2024-11-23 22:27:09,770 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33111 7222s 2024-11-23 22:27:09,770 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:27:09,770 - distributed.worker - INFO - dashboard at: 127.0.0.1:33559 7222s 2024-11-23 22:27:09,770 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39413 7222s 2024-11-23 22:27:09,770 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:27:09,770 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:27:09,770 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:27:09,770 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-gqmla7e6 7222s 2024-11-23 22:27:09,770 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:27:09,773 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37621. Reason: failure-to-start- 7222s 2024-11-23 22:27:09,773 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:27:09,774 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33111. Reason: failure-to-start- 7222s 2024-11-23 22:27:09,774 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:27:09,780 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39413': TLS handshake failed with remote 'tls://127.0.0.1:39552': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:27:09,780 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39413': TLS handshake failed with remote 'tls://127.0.0.1:39566': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:27:09,783 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s 2024-11-23 22:27:10,791 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:27:10,801 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46563 7222s 2024-11-23 22:27:10,802 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36955/status 7222s 2024-11-23 22:27:10,802 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:27:10,830 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43159 7222s 2024-11-23 22:27:10,831 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43159 7222s 2024-11-23 22:27:10,831 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:27:10,831 - distributed.worker - INFO - dashboard at: 127.0.0.1:45493 7222s 2024-11-23 22:27:10,831 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46563 7222s 2024-11-23 22:27:10,831 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:27:10,831 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:27:10,831 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:27:10,831 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-om_8el4q 7222s 2024-11-23 22:27:10,831 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:27:10,835 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40917 7222s 2024-11-23 22:27:10,835 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40917 7222s 2024-11-23 22:27:10,835 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:27:10,835 - distributed.worker - INFO - dashboard at: 127.0.0.1:39487 7222s 2024-11-23 22:27:10,835 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46563 7222s 2024-11-23 22:27:10,835 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:27:10,835 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:27:10,836 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:27:10,836 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-sij_o95p 7222s 2024-11-23 22:27:10,836 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:27:10,838 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43159. Reason: failure-to-start- 7222s 2024-11-23 22:27:10,838 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:27:10,839 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40917. Reason: failure-to-start- 7222s 2024-11-23 22:27:10,840 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:27:10,846 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46563': TLS handshake failed with remote 'tls://127.0.0.1:55454': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:27:10,846 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46563': TLS handshake failed with remote 'tls://127.0.0.1:55470': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:27:10,852 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s 2024-11-23 22:27:11,860 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:27:11,870 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40093 7222s 2024-11-23 22:27:11,871 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35167/status 7222s 2024-11-23 22:27:11,872 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:27:11,899 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35431 7222s 2024-11-23 22:27:11,899 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35431 7222s 2024-11-23 22:27:11,899 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:27:11,899 - distributed.worker - INFO - dashboard at: 127.0.0.1:39945 7222s 2024-11-23 22:27:11,899 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40093 7222s 2024-11-23 22:27:11,899 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:27:11,899 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:27:11,899 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:27:11,899 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-aypdbtn_ 7222s 2024-11-23 22:27:11,899 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:27:11,903 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34157 7222s 2024-11-23 22:27:11,903 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34157 7222s 2024-11-23 22:27:11,904 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:27:11,904 - distributed.worker - INFO - dashboard at: 127.0.0.1:40607 7222s 2024-11-23 22:27:11,904 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40093 7222s 2024-11-23 22:27:11,904 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:27:11,904 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:27:11,904 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:27:11,904 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-yfw6a6nc 7222s 2024-11-23 22:27:11,904 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:27:11,913 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35431. Reason: failure-to-start- 7222s 2024-11-23 22:27:11,913 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:27:11,914 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34157. Reason: failure-to-start- 7222s 2024-11-23 22:27:11,914 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:27:11,921 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40093': TLS handshake failed with remote 'tls://127.0.0.1:39976': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:27:11,921 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40093': TLS handshake failed with remote 'tls://127.0.0.1:39992': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:27:11,927 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s 2024-11-23 22:27:12,935 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:27:12,946 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38235 7222s 2024-11-23 22:27:12,947 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39427/status 7222s 2024-11-23 22:27:12,948 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:27:12,978 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40923 7222s 2024-11-23 22:27:12,978 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40923 7222s 2024-11-23 22:27:12,978 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:27:12,978 - distributed.worker - INFO - dashboard at: 127.0.0.1:45343 7222s 2024-11-23 22:27:12,978 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38235 7222s 2024-11-23 22:27:12,978 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:27:12,978 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:27:12,978 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:27:12,979 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ahp486dn 7222s 2024-11-23 22:27:12,979 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:27:12,982 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40941 7222s 2024-11-23 22:27:12,983 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40941 7222s 2024-11-23 22:27:12,983 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:27:12,983 - distributed.worker - INFO - dashboard at: 127.0.0.1:34821 7222s 2024-11-23 22:27:12,983 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38235 7222s 2024-11-23 22:27:12,983 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:27:12,983 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:27:12,983 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:27:12,983 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-zp1nbamm 7222s 2024-11-23 22:27:12,983 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:27:12,988 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40923. Reason: failure-to-start- 7222s 2024-11-23 22:27:12,988 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:27:12,989 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40941. Reason: failure-to-start- 7222s 2024-11-23 22:27:12,989 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:27:12,995 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38235': TLS handshake failed with remote 'tls://127.0.0.1:60980': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:27:12,995 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38235': TLS handshake failed with remote 'tls://127.0.0.1:60992': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:27:13,001 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s 2024-11-23 22:27:14,010 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:27:14,020 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43465 7222s 2024-11-23 22:27:14,021 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40941/status 7222s 2024-11-23 22:27:14,021 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:27:14,047 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38035 7222s 2024-11-23 22:27:14,048 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38035 7222s 2024-11-23 22:27:14,048 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:27:14,048 - distributed.worker - INFO - dashboard at: 127.0.0.1:43151 7222s 2024-11-23 22:27:14,048 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43465 7222s 2024-11-23 22:27:14,048 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:27:14,048 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:27:14,048 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:27:14,048 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-_cyl1oq9 7222s 2024-11-23 22:27:14,048 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:27:14,052 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33301 7222s 2024-11-23 22:27:14,052 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33301 7222s 2024-11-23 22:27:14,052 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:27:14,052 - distributed.worker - INFO - dashboard at: 127.0.0.1:46139 7222s 2024-11-23 22:27:14,053 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43465 7222s 2024-11-23 22:27:14,053 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:27:14,053 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:27:14,053 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:27:14,053 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-viz7ujd3 7222s 2024-11-23 22:27:14,053 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:27:14,061 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38035. Reason: failure-to-start- 7222s 2024-11-23 22:27:14,061 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:27:14,062 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33301. Reason: failure-to-start- 7222s 2024-11-23 22:27:14,062 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:27:14,068 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43465': TLS handshake failed with remote 'tls://127.0.0.1:35382': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:27:14,069 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43465': TLS handshake failed with remote 'tls://127.0.0.1:35384': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:27:14,075 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s 2024-11-23 22:27:15,081 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:27:15,088 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37961 7222s 2024-11-23 22:27:15,088 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39813/status 7222s 2024-11-23 22:27:15,089 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:27:15,105 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33087 7222s 2024-11-23 22:27:15,105 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33087 7222s 2024-11-23 22:27:15,105 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:27:15,105 - distributed.worker - INFO - dashboard at: 127.0.0.1:44869 7222s 2024-11-23 22:27:15,105 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37961 7222s 2024-11-23 22:27:15,105 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:27:15,105 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:27:15,105 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:27:15,105 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-l61wvlul 7222s 2024-11-23 22:27:15,105 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:27:15,107 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34677 7222s 2024-11-23 22:27:15,108 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34677 7222s 2024-11-23 22:27:15,108 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:27:15,108 - distributed.worker - INFO - dashboard at: 127.0.0.1:34039 7222s 2024-11-23 22:27:15,108 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37961 7222s 2024-11-23 22:27:15,108 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:27:15,108 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:27:15,108 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:27:15,108 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ikqqyq0e 7222s 2024-11-23 22:27:15,108 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:27:15,109 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33087. Reason: failure-to-start- 7222s 2024-11-23 22:27:15,110 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:27:15,110 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34677. Reason: failure-to-start- 7222s 2024-11-23 22:27:15,110 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:27:15,112 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37961': TLS handshake failed with remote 'tls://127.0.0.1:58186': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:27:15,112 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37961': TLS handshake failed with remote 'tls://127.0.0.1:58190': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:27:15,116 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s 2024-11-23 22:27:16,122 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:27:16,129 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36395 7222s 2024-11-23 22:27:16,129 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46579/status 7222s 2024-11-23 22:27:16,130 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:27:16,145 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41879 7222s 2024-11-23 22:27:16,145 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41879 7222s 2024-11-23 22:27:16,145 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:27:16,146 - distributed.worker - INFO - dashboard at: 127.0.0.1:41671 7222s 2024-11-23 22:27:16,146 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:27:16,146 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:27:16,146 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:27:16,146 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:27:16,146 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-mu79oy1a 7222s 2024-11-23 22:27:16,146 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:27:16,148 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36817 7222s 2024-11-23 22:27:16,148 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36817 7222s 2024-11-23 22:27:16,148 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:27:16,148 - distributed.worker - INFO - dashboard at: 127.0.0.1:43017 7222s 2024-11-23 22:27:16,148 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:27:16,148 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:27:16,148 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:27:16,148 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:27:16,148 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-5fr9m8_s 7222s 2024-11-23 22:27:16,149 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:27:16,150 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41879. Reason: failure-to-start- 7222s 2024-11-23 22:27:16,150 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:27:16,150 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36817. Reason: failure-to-start- 7222s 2024-11-23 22:27:16,151 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:27:16,154 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:56988': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:27:16,154 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:56990': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:27:16,156 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s __________________________ test_worker_client_gather ___________________________ 7222s 7222s fut = , timeout = 0 7222s 7222s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 7222s async with asyncio.timeout(timeout): 7222s > return await fut 7222s 7222s /usr/lib/python3/dist-packages/distributed/utils.py:1960: 7222s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7222s /usr/lib/python3/dist-packages/distributed/worker.py:1480: in start_unsafe 7222s await self._register_with_scheduler() 7222s /usr/lib/python3/dist-packages/distributed/worker.py:1179: in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s /usr/lib/python3/dist-packages/distributed/comm/core.py:342: in connect 7222s comm = await wait_for( 7222s /usr/lib/python3/dist-packages/distributed/utils.py:1960: in wait_for 7222s return await fut 7222s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:546: in connect 7222s stream = await self.client.connect( 7222s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7222s 7222s self = , host = '127.0.0.1' 7222s port = 43955, af = 7222s ssl_options = 7222s max_buffer_size = 8364507136.0, source_ip = None, source_port = None 7222s timeout = None 7222s 7222s async def connect( 7222s self, 7222s host: str, 7222s port: int, 7222s af: socket.AddressFamily = socket.AF_UNSPEC, 7222s ssl_options: Optional[Union[Dict[str, Any], ssl.SSLContext]] = None, 7222s max_buffer_size: Optional[int] = None, 7222s source_ip: Optional[str] = None, 7222s source_port: Optional[int] = None, 7222s timeout: Optional[Union[float, datetime.timedelta]] = None, 7222s ) -> IOStream: 7222s """Connect to the given host and port. 7222s 7222s Asynchronously returns an `.IOStream` (or `.SSLIOStream` if 7222s ``ssl_options`` is not None). 7222s 7222s Using the ``source_ip`` kwarg, one can specify the source 7222s IP address to use when establishing the connection. 7222s In case the user needs to resolve and 7222s use a specific interface, it has to be handled outside 7222s of Tornado as this depends very much on the platform. 7222s 7222s Raises `TimeoutError` if the input future does not complete before 7222s ``timeout``, which may be specified in any form allowed by 7222s `.IOLoop.add_timeout` (i.e. a `datetime.timedelta` or an absolute time 7222s relative to `.IOLoop.time`) 7222s 7222s Similarly, when the user requires a certain source port, it can 7222s be specified using the ``source_port`` arg. 7222s 7222s .. versionchanged:: 4.5 7222s Added the ``source_ip`` and ``source_port`` arguments. 7222s 7222s .. versionchanged:: 5.0 7222s Added the ``timeout`` argument. 7222s """ 7222s if timeout is not None: 7222s if isinstance(timeout, numbers.Real): 7222s timeout = IOLoop.current().time() + timeout 7222s elif isinstance(timeout, datetime.timedelta): 7222s timeout = IOLoop.current().time() + timeout.total_seconds() 7222s else: 7222s raise TypeError("Unsupported timeout %r" % timeout) 7222s if timeout is not None: 7222s addrinfo = await gen.with_timeout( 7222s timeout, self.resolver.resolve(host, port, af) 7222s ) 7222s else: 7222s addrinfo = await self.resolver.resolve(host, port, af) 7222s connector = _Connector( 7222s addrinfo, 7222s functools.partial( 7222s self._create_stream, 7222s max_buffer_size, 7222s source_ip=source_ip, 7222s source_port=source_port, 7222s ), 7222s ) 7222s > af, addr, stream = await connector.start(connect_timeout=timeout) 7222s E asyncio.exceptions.CancelledError 7222s 7222s /usr/lib/python3/dist-packages/tornado/tcpclient.py:279: CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s self = 7222s 7222s @final 7222s async def start(self): 7222s async with self._startup_lock: 7222s if self.status == Status.failed: 7222s assert self.__startup_exc is not None 7222s raise self.__startup_exc 7222s elif self.status != Status.init: 7222s return self 7222s timeout = getattr(self, "death_timeout", None) 7222s 7222s async def _close_on_failure(exc: Exception) -> None: 7222s await self.close(reason=f"failure-to-start-{str(type(exc))}") 7222s self.status = Status.failed 7222s self.__startup_exc = exc 7222s 7222s try: 7222s > await wait_for(self.start_unsafe(), timeout=timeout) 7222s 7222s /usr/lib/python3/dist-packages/distributed/core.py:664: 7222s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7222s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 7222s async with asyncio.timeout(timeout): 7222s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7222s 7222s self = 7222s exc_type = 7222s exc_val = CancelledError(), exc_tb = 7222s 7222s async def __aexit__( 7222s self, 7222s exc_type: Optional[Type[BaseException]], 7222s exc_val: Optional[BaseException], 7222s exc_tb: Optional[TracebackType], 7222s ) -> Optional[bool]: 7222s assert self._state in (_State.ENTERED, _State.EXPIRING) 7222s 7222s if self._timeout_handler is not None: 7222s self._timeout_handler.cancel() 7222s self._timeout_handler = None 7222s 7222s if self._state is _State.EXPIRING: 7222s self._state = _State.EXPIRED 7222s 7222s if self._task.uncancel() <= self._cancelling and exc_type is not None: 7222s # Since there are no new cancel requests, we're 7222s # handling this. 7222s if issubclass(exc_type, exceptions.CancelledError): 7222s > raise TimeoutError from exc_val 7222s E TimeoutError 7222s 7222s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s @contextlib.asynccontextmanager 7222s async def _cluster_factory(): 7222s workers = [] 7222s s = None 7222s try: 7222s for _ in range(60): 7222s try: 7222s > s, ws = await start_cluster( 7222s nthreads, 7222s scheduler, 7222s security=security, 7222s Worker=Worker, 7222s scheduler_kwargs=scheduler_kwargs, 7222s worker_kwargs=merge( 7222s {"death_timeout": min(15, int(deadline.remaining))}, 7222s worker_kwargs, 7222s ), 7222s ) 7222s 7222s /usr/lib/python3/dist-packages/distributed/utils_test.py:966: 7222s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7222s /usr/lib/python3/dist-packages/distributed/utils_test.py:789: in start_cluster 7222s await asyncio.gather(*workers) 7222s /usr/lib/python3.13/asyncio/tasks.py:737: in _wrap_awaitable 7222s return await awaitable 7222s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7222s 7222s self = 7222s 7222s @final 7222s async def start(self): 7222s async with self._startup_lock: 7222s if self.status == Status.failed: 7222s assert self.__startup_exc is not None 7222s raise self.__startup_exc 7222s elif self.status != Status.init: 7222s return self 7222s timeout = getattr(self, "death_timeout", None) 7222s 7222s async def _close_on_failure(exc: Exception) -> None: 7222s await self.close(reason=f"failure-to-start-{str(type(exc))}") 7222s self.status = Status.failed 7222s self.__startup_exc = exc 7222s 7222s try: 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s except asyncio.TimeoutError as exc: 7222s await _close_on_failure(exc) 7222s > raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s E TimeoutError: Worker start timed out after 0s. 7222s 7222s /usr/lib/python3/dist-packages/distributed/core.py:667: TimeoutError 7222s 7222s During handling of the above exception, another exception occurred: 7222s 7222s fut = ._..test_func..async_fn at 0xe9b48dc0> 7222s timeout = 60 7222s 7222s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 7222s async with asyncio.timeout(timeout): 7222s > return await fut 7222s 7222s /usr/lib/python3/dist-packages/distributed/utils.py:1960: 7222s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7222s /usr/lib/python3/dist-packages/distributed/utils_test.py:999: in async_fn 7222s _cluster_factory() as (s, workers), 7222s /usr/lib/python3.13/contextlib.py:214: in __aenter__ 7222s return await anext(self.gen) 7222s /usr/lib/python3/dist-packages/distributed/utils_test.py:983: in _cluster_factory 7222s await asyncio.sleep(1) 7222s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7222s 7222s delay = 1, result = None 7222s 7222s async def sleep(delay, result=None): 7222s """Coroutine that completes after a given time (in seconds).""" 7222s if delay <= 0: 7222s await __sleep0() 7222s return result 7222s 7222s if math.isnan(delay): 7222s raise ValueError("Invalid delay: NaN (not a number)") 7222s 7222s loop = events.get_running_loop() 7222s future = loop.create_future() 7222s h = loop.call_later(delay, 7222s futures._set_result_unless_cancelled, 7222s future, result) 7222s try: 7222s > return await future 7222s E asyncio.exceptions.CancelledError 7222s 7222s /usr/lib/python3.13/asyncio/tasks.py:718: CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s args = (), kwds = {} 7222s 7222s @wraps(func) 7222s def inner(*args, **kwds): 7222s with self._recreate_cm(): 7222s > return func(*args, **kwds) 7222s 7222s /usr/lib/python3.13/contextlib.py:85: 7222s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7222s /usr/lib/python3.13/contextlib.py:85: in inner 7222s return func(*args, **kwds) 7222s /usr/lib/python3/dist-packages/distributed/utils_test.py:1102: in test_func 7222s return _run_and_close_tornado(async_fn_outer) 7222s /usr/lib/python3/dist-packages/distributed/utils_test.py:378: in _run_and_close_tornado 7222s return asyncio_run(inner_fn(), loop_factory=get_loop_factory()) 7222s /usr/lib/python3.13/asyncio/runners.py:194: in run 7222s return runner.run(main) 7222s /usr/lib/python3.13/asyncio/runners.py:118: in run 7222s return self._loop.run_until_complete(task) 7222s /usr/lib/python3.13/asyncio/base_events.py:720: in run_until_complete 7222s return future.result() 7222s /usr/lib/python3/dist-packages/distributed/utils_test.py:375: in inner_fn 7222s return await async_fn(*args, **kwargs) 7222s /usr/lib/python3/dist-packages/distributed/utils_test.py:1099: in async_fn_outer 7222s return await utils_wait_for(async_fn(), timeout=timeout * 2) 7222s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 7222s async with asyncio.timeout(timeout): 7222s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7222s 7222s self = 7222s exc_type = 7222s exc_val = CancelledError(), exc_tb = 7222s 7222s async def __aexit__( 7222s self, 7222s exc_type: Optional[Type[BaseException]], 7222s exc_val: Optional[BaseException], 7222s exc_tb: Optional[TracebackType], 7222s ) -> Optional[bool]: 7222s assert self._state in (_State.ENTERED, _State.EXPIRING) 7222s 7222s if self._timeout_handler is not None: 7222s self._timeout_handler.cancel() 7222s self._timeout_handler = None 7222s 7222s if self._state is _State.EXPIRING: 7222s self._state = _State.EXPIRED 7222s 7222s if self._task.uncancel() <= self._cancelling and exc_type is not None: 7222s # Since there are no new cancel requests, we're 7222s # handling this. 7222s if issubclass(exc_type, exceptions.CancelledError): 7222s > raise TimeoutError from exc_val 7222s E TimeoutError 7222s 7222s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 7222s ----------------------------- Captured stderr call ----------------------------- 7222s 2024-11-23 22:27:17,342 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:27:17,349 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:17,350 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35321/status 7222s 2024-11-23 22:27:17,350 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:27:17,363 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38955 7222s 2024-11-23 22:27:17,364 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38955 7222s 2024-11-23 22:27:17,364 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:27:17,364 - distributed.worker - INFO - dashboard at: 127.0.0.1:45761 7222s 2024-11-23 22:27:17,364 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:17,364 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:27:17,364 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:27:17,364 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:27:17,364 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-e0255e46 7222s 2024-11-23 22:27:17,364 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:27:17,366 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34665 7222s 2024-11-23 22:27:17,366 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34665 7222s 2024-11-23 22:27:17,366 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:27:17,366 - distributed.worker - INFO - dashboard at: 127.0.0.1:41631 7222s 2024-11-23 22:27:17,366 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:17,366 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:27:17,366 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:27:17,366 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:27:17,366 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-jvagxesj 7222s 2024-11-23 22:27:17,367 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:27:17,379 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:17,380 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:17,380 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:48370': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:17,380 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:48380': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:17,492 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:17,492 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:17,493 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:48394': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:17,493 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:48396': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:17,607 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:17,607 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:17,608 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:48402': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:17,608 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:48410': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:17,720 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:17,720 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:17,720 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:48422': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:17,720 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:48434': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:17,833 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:17,833 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:17,833 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:48446': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:17,834 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:48450': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:17,946 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:17,946 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:17,946 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:48452': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:17,946 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:48456': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:18,059 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:18,059 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:18,060 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:48464': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:18,060 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:48470': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:18,173 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:18,174 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:18,174 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:48484': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:18,174 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:48490': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:18,286 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:18,286 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:18,287 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:48500': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:18,287 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:48502': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:18,400 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:18,400 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:18,400 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:48504': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:18,400 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:48508': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:18,514 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:18,514 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:18,514 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:48514': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:18,514 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:48524': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:18,628 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:18,628 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:18,628 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:48538': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:18,628 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:48544': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:18,741 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:18,741 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:18,742 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:48556': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:18,742 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:48558': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:18,855 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:18,855 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:18,859 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:48572': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:18,859 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:48580': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:18,968 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:18,968 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:18,969 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:48586': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:18,969 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:48602': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:19,076 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:19,081 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:48614': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:19,082 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:19,082 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:48624': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:19,186 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:19,186 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:48626': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:19,192 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:19,193 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:48630': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:19,293 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:19,294 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:48632': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:19,301 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:19,302 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:48642': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:19,401 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:19,401 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:48644': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:19,408 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:19,408 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:48660': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:19,508 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:19,509 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:48674': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:19,515 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:19,516 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:48684': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:19,618 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:19,618 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:48700': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:19,624 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:19,625 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:48706': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:19,725 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:19,725 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:48708': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:19,732 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:19,732 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:48720': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:19,832 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:19,833 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:48722': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:19,839 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:19,840 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:48732': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:19,940 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:19,941 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:48748': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:19,947 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:19,947 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:48756': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:20,048 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:20,048 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:48766': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:20,054 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:20,055 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:48780': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:20,155 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:20,155 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:48790': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:20,162 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:20,162 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:48798': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:20,263 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:20,263 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:48804': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:20,269 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:20,270 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:48818': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:20,371 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:20,372 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:48834': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:20,378 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:20,378 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:48844': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:20,479 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:20,479 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:48852': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:20,486 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:20,486 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:48868': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:20,587 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:20,587 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:48882': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:20,593 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:20,594 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:48892': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:20,694 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:20,695 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:48896': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:20,701 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:20,701 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:48912': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:20,802 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:20,802 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:48916': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:20,809 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:20,809 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:48930': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:20,910 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:20,911 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:48946': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:20,917 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:20,917 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:48956': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:21,019 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:21,020 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:48962': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:21,026 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:21,026 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:48966': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:21,127 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:21,128 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:48968': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:21,134 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:21,135 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:48970': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:21,235 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:21,236 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:48978': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:21,242 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:21,243 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:48990': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:21,343 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:21,343 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:48998': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:21,350 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:21,350 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:49008': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:21,451 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:21,452 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:49022': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:21,458 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:21,459 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:49028': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:21,559 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:21,560 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:44406': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:21,566 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:21,566 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:44416': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:21,668 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:21,669 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:44422': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:21,675 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:21,675 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:44432': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:21,777 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:21,778 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:44434': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:21,784 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:21,784 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:44446': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:21,884 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:21,885 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:44458': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:21,891 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:21,892 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:44460': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:21,992 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:21,993 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:44464': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:21,999 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:21,999 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:44480': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:22,100 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:22,100 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:44488': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:22,107 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:22,107 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:44494': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:22,208 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:22,208 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:44498': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:22,214 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:22,215 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:44504': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:22,315 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:22,316 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:44520': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:22,322 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:22,322 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:44526': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:22,423 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:22,423 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:44538': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:22,430 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:22,430 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:44540': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:22,532 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:22,533 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:44542': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:22,539 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:22,539 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:44558': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:22,640 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:22,643 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:44562': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:22,650 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:22,650 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:44578': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:22,751 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:22,751 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:44584': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:22,758 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:22,758 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:44590': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:22,860 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:22,861 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:44594': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:22,867 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:22,867 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:44608': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:22,968 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:22,968 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:44616': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:22,975 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:22,975 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:44620': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:23,075 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:23,076 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:44630': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:23,082 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:23,083 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:44646': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:23,183 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:23,184 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:44658': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:23,190 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:23,190 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:44664': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:23,291 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:23,291 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:44666': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:23,297 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:23,298 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:44680': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:23,398 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:23,399 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:44684': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:23,405 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:23,406 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:44698': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:23,506 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:23,506 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:44700': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:23,513 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:23,513 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:44716': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:23,614 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:23,615 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:44732': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:23,621 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:23,621 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:44734': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:23,722 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:23,722 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:44746': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:23,728 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:23,729 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:44762': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:23,830 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:23,831 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:44770': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:23,837 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:23,838 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:44780': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:23,938 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:23,939 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:44794': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:23,945 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:23,946 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:44796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:24,046 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:24,046 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:44802': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:24,052 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:24,053 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:44814': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:24,153 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:24,154 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:44822': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:24,160 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:24,160 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:44830': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:24,261 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:24,262 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:44844': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:24,268 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:24,268 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:44850': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:24,370 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:24,371 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:44864': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:24,376 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:24,377 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:44878': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:24,477 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:24,478 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:44882': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:24,484 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:24,484 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:44892': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:24,584 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:24,585 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:44900': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:24,591 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:24,592 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:44910': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:24,692 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:24,693 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:44920': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:24,699 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:24,699 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:44932': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:24,800 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:24,800 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:44940': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:24,807 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:24,807 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:44956': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:24,908 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:24,908 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:44960': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:24,914 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:24,915 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:44972': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:25,015 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:25,016 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:44978': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:25,022 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:25,023 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:44990': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:25,123 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:25,124 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:44998': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:25,130 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:25,130 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:45002': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:25,231 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:25,231 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:45012': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:25,237 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:25,238 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:45028': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:25,338 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:25,338 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:45042': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:25,345 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:25,345 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:45046': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:25,445 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:25,446 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:45052': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:25,452 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:25,453 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:45058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:25,553 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:25,554 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:45074': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:25,560 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:25,560 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:45086': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:25,661 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:25,662 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:45098': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:25,668 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:25,668 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:45106': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:25,769 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:25,769 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:45110': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:25,775 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:25,776 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:45116': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:25,876 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:25,877 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:45118': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:25,883 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:25,884 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:45120': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:25,984 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:25,986 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:45122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:25,992 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:25,992 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:45128': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:26,094 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:26,094 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:45130': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:26,100 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:26,101 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:45134': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:26,201 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:26,202 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:45144': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:26,208 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:26,208 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:45148': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:26,309 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:26,309 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:45158': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:26,315 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:26,316 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:45164': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:26,417 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:26,418 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:45168': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:26,423 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:26,424 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:45180': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:26,524 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:26,525 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:45194': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:26,531 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:26,532 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:45210': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:26,632 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:26,633 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:45220': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:26,639 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:26,640 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:45230': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:26,740 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:26,741 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:45232': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:26,747 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:26,747 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:45242': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:26,848 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:26,848 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:45250': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:26,855 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:26,859 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:45258': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:26,956 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:26,956 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:45270': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:26,963 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:26,963 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:45274': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:27,063 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:27,064 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:45290': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:27,070 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:27,070 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:45292': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:27,171 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:27,172 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:45296': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:27,178 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:27,178 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:45308': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:27,279 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:27,279 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:45316': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:27,286 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:27,286 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:45318': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:27,387 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:27,388 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:45330': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:27,394 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:27,395 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:45336': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:27,495 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:27,496 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:45346': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:27,502 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:27,502 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:45348': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:27,603 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:27,603 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:45356': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:27,610 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:27,610 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:45362': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:27,712 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:27,713 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:45366': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:27,719 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:27,719 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:45382': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:27,820 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:27,821 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:45388': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:27,827 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:27,827 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:45398': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:27,929 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:27,930 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:45414': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:27,936 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:27,936 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:45428': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:28,037 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:28,037 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:45430': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:28,043 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:28,044 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:45440': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:28,144 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:28,145 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:45454': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:28,151 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:28,152 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:45460': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:28,252 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:28,253 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:45466': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:28,259 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:28,260 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:45478': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:28,361 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:28,362 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:45494': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:28,368 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:28,369 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:45502': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:28,469 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:28,469 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:45504': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:28,475 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:28,476 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:45514': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:28,579 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:28,580 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:45516': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:28,588 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:28,588 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:45526': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:28,688 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:28,689 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:45538': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:28,698 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:28,699 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:45544': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:28,798 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:28,799 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:45560': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:28,808 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:28,808 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:45568': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:28,909 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:28,910 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:45574': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:28,918 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:28,918 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:45582': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:29,018 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:29,019 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:45584': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:29,025 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:29,026 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:45592': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:29,127 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:29,128 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:45606': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:29,134 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:29,135 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:45614': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:29,235 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:29,235 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:45622': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:29,242 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:29,242 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:45632': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:29,343 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:29,345 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:45638': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:29,351 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:29,352 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:45646': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:29,452 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:29,453 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:45656': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:29,459 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:29,459 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:45670': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:29,561 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:29,562 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:45682': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:29,567 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:29,568 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:45690': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:29,668 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:29,669 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:45694': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:29,675 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:29,675 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:45700': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:29,777 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:29,778 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:45710': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:29,788 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:29,788 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:45718': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:29,885 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:29,885 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:45722': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:29,895 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:29,895 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:45736': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:29,992 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:29,993 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:45740': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:30,003 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:30,003 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:45754': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:30,100 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:30,100 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:45756': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:30,110 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:30,111 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:45762': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:30,207 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:30,208 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:45776': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:30,218 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:30,218 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:45792': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:30,316 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:30,316 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:45802': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:30,325 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:30,325 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:45818': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:30,425 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:30,426 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:45826': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:30,433 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:30,433 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:45830': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:30,534 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:30,534 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:45832': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:30,541 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:30,541 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:45844': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:30,644 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:30,645 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:45848': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:30,653 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:30,653 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:45860': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:30,752 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:30,753 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:45874': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:30,760 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:30,761 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:45880': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:30,864 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:30,865 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:45892': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:30,874 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:30,874 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:45904': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:30,972 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:30,973 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:45906': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:30,981 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:30,983 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:45912': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:31,080 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:31,080 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:45926': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:31,089 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:31,090 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:45936': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:31,188 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:31,188 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:45942': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:31,197 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:31,197 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:45958': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:31,296 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:31,296 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:45970': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:31,304 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:31,305 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:45972': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:31,403 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:31,404 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:45980': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:31,411 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:31,412 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:45988': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:31,511 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:31,512 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:46002': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:31,518 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:31,518 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:46006': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:31,619 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:31,620 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:36404': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:31,626 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:31,627 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:36408': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:31,727 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:31,728 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:36412': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:31,734 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:31,735 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:36420': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:31,836 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:31,836 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:36426': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:31,842 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:31,843 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:36432': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:31,944 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:31,945 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:36438': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:31,951 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:31,951 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:36452': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:32,052 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:32,052 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:36456': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:32,059 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:32,059 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:36460': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:32,160 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:32,160 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:36470': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:32,167 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:32,167 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:36478': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:32,268 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:32,268 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:36490': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:32,275 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40767 7222s 2024-11-23 22:27:32,275 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40767': TLS handshake failed with remote 'tls://127.0.0.1:36506': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:32,362 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38955. Reason: failure-to-start- 7222s 2024-11-23 22:27:32,362 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:27:32,364 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 15s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 7222s stream = await stream.start_tls( 7222s ^^^^^^^^^^^^^^^^^^^^^^^ 7222s False, ssl_options=ssl_options, server_hostname=host 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 7222s self.socket.do_handshake() 7222s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 7222s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 7222s self._sslobj.do_handshake() 7222s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 7222s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 7222s raise FatalCommClosedError( 7222s ...<2 lines>... 7222s ) from err 7222s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 7222s 7222s During handling of the above exception, another exception occurred: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1218, in _register_with_scheduler 7222s await asyncio.sleep(0.1) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 718, in sleep 7222s return await future 7222s ^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 15s. 7222s 2024-11-23 22:27:32,368 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34665. Reason: failure-to-start- 7222s 2024-11-23 22:27:32,368 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:27:33,371 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:27:33,379 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:33,379 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38835/status 7222s 2024-11-23 22:27:33,380 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:27:33,393 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34091 7222s 2024-11-23 22:27:33,393 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34091 7222s 2024-11-23 22:27:33,393 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:27:33,393 - distributed.worker - INFO - dashboard at: 127.0.0.1:42933 7222s 2024-11-23 22:27:33,393 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:33,393 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:27:33,393 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:27:33,393 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:27:33,393 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-qmn949l2 7222s 2024-11-23 22:27:33,393 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:27:33,396 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35991 7222s 2024-11-23 22:27:33,396 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35991 7222s 2024-11-23 22:27:33,396 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:27:33,396 - distributed.worker - INFO - dashboard at: 127.0.0.1:45153 7222s 2024-11-23 22:27:33,396 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:33,396 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:27:33,396 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:27:33,396 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:27:33,396 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-zog9e13w 7222s 2024-11-23 22:27:33,396 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:27:33,409 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:33,409 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:33,410 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:55398': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:33,410 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:55404': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:33,522 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:33,522 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:33,523 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:55410': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:33,523 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:55418': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:33,636 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:33,636 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:33,637 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:55420': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:33,637 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:55432': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:33,749 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:33,749 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:33,750 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:55444': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:33,750 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:55452': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:33,866 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:33,866 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:33,866 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:55464': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:33,866 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:55478': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:33,979 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:33,980 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:33,980 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:55486': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:33,980 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:55494': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:34,092 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:34,093 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:34,093 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:55504': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:34,093 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:55518': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:34,208 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:34,208 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:34,209 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:55530': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:34,209 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:55534': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:34,321 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:34,321 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:34,322 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:55546': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:34,322 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:55554': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:34,435 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:34,435 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:34,435 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:55560': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:34,435 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:55568': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:34,548 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:34,548 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:34,549 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:55572': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:34,549 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:55578': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:34,665 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:34,665 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:34,666 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:55580': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:34,666 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:55588': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:34,778 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:34,779 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:34,779 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:55598': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:34,779 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:55608': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:34,894 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:34,894 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:34,895 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:55612': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:34,895 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:55618': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:35,007 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:35,007 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:35,007 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:55620': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:35,007 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:55626': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:35,120 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:35,120 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:35,121 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:55632': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:35,121 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:55646': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:35,234 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:35,234 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:35,235 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:55658': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:35,235 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:55666': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:35,347 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:35,347 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:35,347 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:55678': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:35,347 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:55686': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:35,460 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:35,461 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:35,461 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:55702': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:35,461 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:55714': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:35,574 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:35,574 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:35,574 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:55730': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:35,574 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:55738': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:35,687 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:35,688 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:35,688 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:55748': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:35,688 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:55758': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:35,800 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:35,801 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:35,801 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:55762': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:35,801 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:55776': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:35,914 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:35,914 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:35,915 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:55778': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:35,916 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:55784': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:36,027 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:36,027 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:36,028 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:55798': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:36,028 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:55804': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:36,140 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:36,141 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:36,141 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:55812': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:36,141 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:55818': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:36,253 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:36,254 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:36,254 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:55822': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:36,254 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:55824': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:36,368 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:36,368 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:36,368 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:55826': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:36,368 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:55836': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:36,481 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:36,481 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:36,482 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:55840': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:36,482 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:55856': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:36,594 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:36,594 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:36,594 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:55860': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:36,595 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:55874': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:36,707 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:36,707 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:36,707 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:55886': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:36,708 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:55902': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:36,819 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:36,820 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:36,820 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:55916': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:36,820 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:55932': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:36,933 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:36,933 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:36,933 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:55948': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:36,934 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:55958': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:37,046 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:37,047 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:37,047 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:55970': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:37,047 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:55978': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:37,160 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:37,160 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:37,160 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:55988': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:37,160 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:55996': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:37,273 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:37,274 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:37,274 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:56000': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:37,274 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:56010': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:37,386 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:37,387 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:37,390 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:56024': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:37,390 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:56030': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:37,500 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:37,500 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:37,501 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:56038': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:37,501 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:56050': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:37,613 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:37,614 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:37,614 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:56052': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:37,614 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:56064': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:37,728 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:37,729 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:37,729 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:56076': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:37,729 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:56078': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:37,841 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:37,841 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:37,841 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:56080': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:37,842 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:56090': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:37,954 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:37,954 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:37,955 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:56098': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:37,955 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:56100': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:38,066 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:38,067 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:38,067 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:56102': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:38,068 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:56108': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:38,174 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:38,175 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:56114': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:38,180 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:38,180 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:56128': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:38,282 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:38,283 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:56144': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:38,289 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:38,289 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:56148': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:38,391 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:38,392 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:56158': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:38,397 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:38,398 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:56172': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:38,499 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:38,500 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:56174': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:38,506 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:38,506 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:56184': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:38,607 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:38,608 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:56200': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:38,614 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:38,614 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:56206': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:38,715 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:38,716 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:56218': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:38,722 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:38,722 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:56230': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:38,824 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:38,824 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:56240': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:38,831 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:38,831 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:56248': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:38,932 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:38,933 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:56250': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:38,939 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:38,939 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:56264': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:39,041 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:39,041 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:56278': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:39,047 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:39,047 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:56288': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:39,148 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:39,149 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:56300': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:39,155 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:39,156 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:56308': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:39,256 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:39,256 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:56312': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:39,262 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:39,263 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:56316': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:39,364 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:39,364 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:56332': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:39,372 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:39,372 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:56344': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:39,471 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:39,471 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:56358': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:39,479 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:39,479 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:56362': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:39,578 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:39,578 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:56370': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:39,586 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:39,586 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:56378': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:39,685 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:39,686 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:56388': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:39,693 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:39,693 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:56404': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:39,793 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:39,793 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:56414': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:39,799 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:39,799 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:56420': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:39,901 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:39,902 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:56434': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:39,908 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:39,908 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:56448': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:40,009 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:40,009 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:56456': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:40,015 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:40,016 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:56464': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:40,116 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:40,116 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:56470': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:40,122 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:40,123 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:56480': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:40,225 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:40,226 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:56482': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:40,232 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:40,232 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:56498': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:40,332 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:40,333 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:56514': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:40,339 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:40,339 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:56520': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:40,440 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:40,441 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:56528': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:40,447 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:40,448 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:56542': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:40,549 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:40,550 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:56552': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:40,556 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:40,556 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:56568': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:40,657 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:40,658 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:56578': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:40,664 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:40,664 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:56590': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:40,765 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:40,765 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:56602': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:40,772 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:40,772 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:56612': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:40,872 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:40,873 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:56624': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:40,879 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:40,880 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:56634': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:40,980 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:40,980 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:56640': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:40,986 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:40,987 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:56644': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:41,089 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:41,090 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:56654': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:41,096 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:41,096 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:56658': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:41,198 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:41,199 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:56666': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:41,204 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:41,205 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:56682': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:41,306 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:41,307 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:56684': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:41,313 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:41,313 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:56690': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:41,414 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:41,414 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:56698': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:41,421 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:41,421 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:56710': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:41,522 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:41,522 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:56716': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:41,528 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:41,529 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:56732': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:41,630 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:41,631 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:51166': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:41,637 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:41,637 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:51178': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:41,737 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:41,738 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:51180': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:41,744 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:41,745 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:51190': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:41,845 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:41,846 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:51204': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:41,853 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:41,856 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:51216': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:41,953 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:41,954 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:51220': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:41,960 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:41,961 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:51224': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:42,061 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:42,061 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:51226': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:42,068 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:42,068 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:51242': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:42,168 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:42,169 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:51254': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:42,175 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:42,176 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:51264': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:42,277 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:42,278 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:51270': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:42,284 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:42,285 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:51284': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:42,388 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:42,389 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:51292': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:42,395 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:42,395 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:51304': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:42,497 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:42,498 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:51318': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:42,504 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:42,504 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:51334': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:42,606 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:42,607 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:51338': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:42,613 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:42,614 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:51348': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:42,715 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:42,719 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:51364': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:42,725 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:42,725 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:51378': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:42,823 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:42,823 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:51380': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:42,832 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:42,832 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:51384': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:42,930 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:42,931 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:51398': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:42,939 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:42,940 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:51400': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:43,037 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:43,038 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:51412': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:43,046 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:43,047 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:51414': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:43,145 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:43,145 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:51416': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:43,153 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:43,154 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:51428': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:43,253 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:43,254 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:51440': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:43,260 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:43,260 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:51452': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:43,360 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:43,360 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:51462': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:43,367 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:43,367 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:51476': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:43,468 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:43,469 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:51492': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:43,475 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:43,475 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:51500': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:43,577 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:43,578 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:51516': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:43,583 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:43,584 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:51520': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:43,685 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:43,686 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:51528': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:43,692 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:43,692 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:51536': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:43,792 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:43,793 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:51540': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:43,799 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:43,799 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:51556': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:43,900 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:43,901 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:51568': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:43,907 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:43,907 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:51572': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:44,009 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:44,010 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:51580': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:44,016 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:44,016 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:51592': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:44,118 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:44,119 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:51600': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:44,125 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:44,125 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:51616': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:44,226 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:44,227 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:51628': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:44,233 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:44,233 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:51630': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:44,334 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:44,335 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:51636': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:44,340 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:44,341 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:51648': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:44,442 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:44,443 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:51652': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:44,449 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:44,449 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:51656': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:44,550 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:44,550 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:51668': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:44,557 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:44,557 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:51678': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:44,658 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:44,658 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:51682': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:44,664 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:44,665 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:51688': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:44,766 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:44,766 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:51698': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:44,772 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:44,773 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:51702': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:44,873 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:44,873 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:51706': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:44,880 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:44,880 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:51718': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:44,981 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:44,981 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:51734': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:44,988 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:44,988 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:51750': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:45,088 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:45,088 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:51754': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:45,095 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:45,095 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:51764': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:45,197 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:45,198 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:51780': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:45,204 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:45,204 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:51784': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:45,306 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:45,307 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:51786': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:45,313 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:45,313 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:51790': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:45,414 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:45,415 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:51792': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:45,421 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:45,422 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:51806': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:45,522 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:45,522 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:51814': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:45,528 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:45,528 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:51818': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:45,629 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:45,630 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:51820': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:45,636 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:45,636 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:51834': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:45,738 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:45,738 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:51842': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:45,744 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:45,745 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:51844': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:45,845 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:45,846 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:51852': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:45,852 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:45,855 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:51866': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:45,953 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:45,953 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:51878': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:45,959 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:45,960 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:51886': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:46,062 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:46,063 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:51892': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:46,069 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:46,069 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:51906': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:46,169 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:46,170 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:51908': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:46,176 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:46,176 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:51922': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:46,277 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:46,278 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:51932': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:46,284 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:46,284 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:51938': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:46,385 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:46,388 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:51944': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:46,394 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 7222s 2024-11-23 22:27:46,394 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34091. Reason: failure-to-start- 7222s 2024-11-23 22:27:46,394 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:27:46,395 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:51960': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:27:46,395 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35991. Reason: failure-to-start- 7222s 2024-11-23 22:27:46,395 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:27:46,398 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 13s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 7222s stream = await stream.start_tls( 7222s ^^^^^^^^^^^^^^^^^^^^^^^ 7222s False, ssl_options=ssl_options, server_hostname=host 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 7222s self.socket.do_handshake() 7222s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 7222s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 7222s self._sslobj.do_handshake() 7222s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 7222s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 7222s raise FatalCommClosedError( 7222s ...<2 lines>... 7222s ) from err 7222s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 7222s 7222s During handling of the above exception, another exception occurred: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1218, in _register_with_scheduler 7222s await asyncio.sleep(0.1) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 718, in sleep 7222s return await future 7222s ^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 13s. 7222s 2024-11-23 22:27:47,404 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:27:47,411 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37511 7222s 2024-11-23 22:27:47,411 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38709/status 7222s 2024-11-23 22:27:47,411 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:27:47,424 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43711 7222s 2024-11-23 22:27:47,424 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43711 7222s 2024-11-23 22:27:47,424 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:27:47,424 - distributed.worker - INFO - dashboard at: 127.0.0.1:45147 7222s 2024-11-23 22:27:47,424 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37511 7222s 2024-11-23 22:27:47,424 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:27:47,424 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:27:47,424 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:27:47,424 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-thwsftuy 7222s 2024-11-23 22:27:47,424 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:27:47,427 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38817 7222s 2024-11-23 22:27:47,427 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38817 7222s 2024-11-23 22:27:47,427 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:27:47,427 - distributed.worker - INFO - dashboard at: 127.0.0.1:37745 7222s 2024-11-23 22:27:47,427 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37511 7222s 2024-11-23 22:27:47,427 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:27:47,427 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:27:47,427 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:27:47,427 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-6qyzru_o 7222s 2024-11-23 22:27:47,427 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:27:47,428 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43711. Reason: failure-to-start- 7222s 2024-11-23 22:27:47,428 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:27:47,429 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38817. Reason: failure-to-start- 7222s 2024-11-23 22:27:47,430 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:27:47,431 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37511': TLS handshake failed with remote 'tls://127.0.0.1:56650': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:27:47,431 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37511': TLS handshake failed with remote 'tls://127.0.0.1:56666': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:27:47,432 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s 2024-11-23 22:27:48,438 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:27:48,445 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35721 7222s 2024-11-23 22:27:48,445 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:32929/status 7222s 2024-11-23 22:27:48,446 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:27:48,459 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35037 7222s 2024-11-23 22:27:48,460 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35037 7222s 2024-11-23 22:27:48,460 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:27:48,460 - distributed.worker - INFO - dashboard at: 127.0.0.1:44803 7222s 2024-11-23 22:27:48,460 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35721 7222s 2024-11-23 22:27:48,460 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:27:48,460 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:27:48,460 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:27:48,460 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ycagpkd7 7222s 2024-11-23 22:27:48,460 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:27:48,462 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40519 7222s 2024-11-23 22:27:48,462 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40519 7222s 2024-11-23 22:27:48,462 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:27:48,463 - distributed.worker - INFO - dashboard at: 127.0.0.1:32955 7222s 2024-11-23 22:27:48,463 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35721 7222s 2024-11-23 22:27:48,463 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:27:48,463 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:27:48,463 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:27:48,463 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-dbhspscw 7222s 2024-11-23 22:27:48,463 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:27:48,464 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35037. Reason: failure-to-start- 7222s 2024-11-23 22:27:48,464 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:27:48,465 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40519. Reason: failure-to-start- 7222s 2024-11-23 22:27:48,465 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:27:48,467 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35721': TLS handshake failed with remote 'tls://127.0.0.1:59038': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:27:48,467 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35721': TLS handshake failed with remote 'tls://127.0.0.1:59052': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:27:48,468 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s 2024-11-23 22:27:49,474 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:27:49,482 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39093 7222s 2024-11-23 22:27:49,482 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43769/status 7222s 2024-11-23 22:27:49,483 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:27:49,496 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38373 7222s 2024-11-23 22:27:49,496 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38373 7222s 2024-11-23 22:27:49,496 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:27:49,496 - distributed.worker - INFO - dashboard at: 127.0.0.1:34361 7222s 2024-11-23 22:27:49,496 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39093 7222s 2024-11-23 22:27:49,496 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:27:49,496 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:27:49,496 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:27:49,496 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ikdpra5t 7222s 2024-11-23 22:27:49,497 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:27:49,499 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43103 7222s 2024-11-23 22:27:49,499 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43103 7222s 2024-11-23 22:27:49,499 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:27:49,499 - distributed.worker - INFO - dashboard at: 127.0.0.1:46365 7222s 2024-11-23 22:27:49,499 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39093 7222s 2024-11-23 22:27:49,499 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:27:49,499 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:27:49,499 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:27:49,499 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-t7623fg9 7222s 2024-11-23 22:27:49,499 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:27:49,500 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38373. Reason: failure-to-start- 7222s 2024-11-23 22:27:49,500 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:27:49,501 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43103. Reason: failure-to-start- 7222s 2024-11-23 22:27:49,501 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:27:49,502 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39093': TLS handshake failed with remote 'tls://127.0.0.1:50412': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:27:49,502 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39093': TLS handshake failed with remote 'tls://127.0.0.1:50414': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:27:49,503 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s 2024-11-23 22:27:50,509 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:27:50,516 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38575 7222s 2024-11-23 22:27:50,516 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34453/status 7222s 2024-11-23 22:27:50,516 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:27:50,531 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34753 7222s 2024-11-23 22:27:50,531 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34753 7222s 2024-11-23 22:27:50,532 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:27:50,532 - distributed.worker - INFO - dashboard at: 127.0.0.1:41951 7222s 2024-11-23 22:27:50,532 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38575 7222s 2024-11-23 22:27:50,532 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:27:50,532 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:27:50,532 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:27:50,532 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ydmchehk 7222s 2024-11-23 22:27:50,532 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:27:50,534 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44521 7222s 2024-11-23 22:27:50,534 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44521 7222s 2024-11-23 22:27:50,534 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:27:50,534 - distributed.worker - INFO - dashboard at: 127.0.0.1:36433 7222s 2024-11-23 22:27:50,534 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38575 7222s 2024-11-23 22:27:50,534 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:27:50,534 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:27:50,534 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:27:50,534 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-wqyu4ao4 7222s 2024-11-23 22:27:50,534 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:27:50,535 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34753. Reason: failure-to-start- 7222s 2024-11-23 22:27:50,536 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:27:50,536 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44521. Reason: failure-to-start- 7222s 2024-11-23 22:27:50,536 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:27:50,537 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38575': TLS handshake failed with remote 'tls://127.0.0.1:60942': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:27:50,537 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38575': TLS handshake failed with remote 'tls://127.0.0.1:60954': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:27:50,539 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s 2024-11-23 22:27:51,544 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:27:51,551 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37523 7222s 2024-11-23 22:27:51,551 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33561/status 7222s 2024-11-23 22:27:51,551 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:27:51,564 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36233 7222s 2024-11-23 22:27:51,564 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36233 7222s 2024-11-23 22:27:51,564 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:27:51,564 - distributed.worker - INFO - dashboard at: 127.0.0.1:45577 7222s 2024-11-23 22:27:51,564 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37523 7222s 2024-11-23 22:27:51,564 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:27:51,564 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:27:51,564 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:27:51,564 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-7g95clkd 7222s 2024-11-23 22:27:51,565 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:27:51,566 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35465 7222s 2024-11-23 22:27:51,567 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35465 7222s 2024-11-23 22:27:51,567 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:27:51,567 - distributed.worker - INFO - dashboard at: 127.0.0.1:35027 7222s 2024-11-23 22:27:51,567 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37523 7222s 2024-11-23 22:27:51,567 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:27:51,567 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:27:51,567 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:27:51,567 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-cr87fals 7222s 2024-11-23 22:27:51,567 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:27:51,569 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36233. Reason: failure-to-start- 7222s 2024-11-23 22:27:51,569 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:27:51,569 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35465. Reason: failure-to-start- 7222s 2024-11-23 22:27:51,569 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:27:51,571 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37523': TLS handshake failed with remote 'tls://127.0.0.1:37926': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:27:51,571 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37523': TLS handshake failed with remote 'tls://127.0.0.1:37938': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:27:51,572 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s 2024-11-23 22:27:52,577 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:27:52,584 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45241 7222s 2024-11-23 22:27:52,584 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41867/status 7222s 2024-11-23 22:27:52,584 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:27:52,598 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38355 7222s 2024-11-23 22:27:52,598 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38355 7222s 2024-11-23 22:27:52,598 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:27:52,598 - distributed.worker - INFO - dashboard at: 127.0.0.1:33267 7222s 2024-11-23 22:27:52,598 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45241 7222s 2024-11-23 22:27:52,598 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:27:52,598 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:27:52,598 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:27:52,599 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-3kkgx_cj 7222s 2024-11-23 22:27:52,599 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:27:52,601 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36843 7222s 2024-11-23 22:27:52,601 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36843 7222s 2024-11-23 22:27:52,601 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:27:52,601 - distributed.worker - INFO - dashboard at: 127.0.0.1:45233 7222s 2024-11-23 22:27:52,601 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45241 7222s 2024-11-23 22:27:52,601 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:27:52,601 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:27:52,601 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:27:52,601 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-uxc0g1vp 7222s 2024-11-23 22:27:52,601 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:27:52,602 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38355. Reason: failure-to-start- 7222s 2024-11-23 22:27:52,602 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:27:52,603 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36843. Reason: failure-to-start- 7222s 2024-11-23 22:27:52,603 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:27:52,604 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45241': TLS handshake failed with remote 'tls://127.0.0.1:56918': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:27:52,604 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45241': TLS handshake failed with remote 'tls://127.0.0.1:56928': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:27:52,606 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s 2024-11-23 22:27:53,611 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:27:53,618 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35815 7222s 2024-11-23 22:27:53,618 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45877/status 7222s 2024-11-23 22:27:53,619 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:27:53,631 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42987 7222s 2024-11-23 22:27:53,631 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42987 7222s 2024-11-23 22:27:53,631 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:27:53,631 - distributed.worker - INFO - dashboard at: 127.0.0.1:36891 7222s 2024-11-23 22:27:53,631 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35815 7222s 2024-11-23 22:27:53,631 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:27:53,631 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:27:53,631 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:27:53,631 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-x0824cyt 7222s 2024-11-23 22:27:53,631 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:27:53,633 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:32959 7222s 2024-11-23 22:27:53,633 - distributed.worker - INFO - Listening to: tls://127.0.0.1:32959 7222s 2024-11-23 22:27:53,633 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:27:53,633 - distributed.worker - INFO - dashboard at: 127.0.0.1:34325 7222s 2024-11-23 22:27:53,634 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35815 7222s 2024-11-23 22:27:53,634 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:27:53,634 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:27:53,634 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:27:53,634 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-2ehby9pq 7222s 2024-11-23 22:27:53,634 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:27:53,635 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42987. Reason: failure-to-start- 7222s 2024-11-23 22:27:53,635 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:27:53,635 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:32959. Reason: failure-to-start- 7222s 2024-11-23 22:27:53,635 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:27:53,637 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35815': TLS handshake failed with remote 'tls://127.0.0.1:58728': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:27:53,637 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35815': TLS handshake failed with remote 'tls://127.0.0.1:58734': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:27:53,638 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s 2024-11-23 22:27:54,644 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:27:54,651 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40421 7222s 2024-11-23 22:27:54,651 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43985/status 7222s 2024-11-23 22:27:54,651 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:27:54,666 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45207 7222s 2024-11-23 22:27:54,666 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45207 7222s 2024-11-23 22:27:54,666 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:27:54,666 - distributed.worker - INFO - dashboard at: 127.0.0.1:41865 7222s 2024-11-23 22:27:54,666 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40421 7222s 2024-11-23 22:27:54,666 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:27:54,666 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:27:54,666 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:27:54,666 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ufwn280p 7222s 2024-11-23 22:27:54,666 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:27:54,669 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45735 7222s 2024-11-23 22:27:54,669 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45735 7222s 2024-11-23 22:27:54,669 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:27:54,669 - distributed.worker - INFO - dashboard at: 127.0.0.1:42181 7222s 2024-11-23 22:27:54,669 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40421 7222s 2024-11-23 22:27:54,669 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:27:54,669 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:27:54,669 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:27:54,669 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-vw2yt7ke 7222s 2024-11-23 22:27:54,669 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:27:54,670 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45207. Reason: failure-to-start- 7222s 2024-11-23 22:27:54,670 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:27:54,671 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45735. Reason: failure-to-start- 7222s 2024-11-23 22:27:54,671 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:27:54,672 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40421': TLS handshake failed with remote 'tls://127.0.0.1:49932': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:27:54,672 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40421': TLS handshake failed with remote 'tls://127.0.0.1:49934': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:27:54,674 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s 2024-11-23 22:27:55,680 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:27:55,686 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44239 7222s 2024-11-23 22:27:55,686 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34751/status 7222s 2024-11-23 22:27:55,687 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:27:55,699 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37743 7222s 2024-11-23 22:27:55,700 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37743 7222s 2024-11-23 22:27:55,700 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:27:55,700 - distributed.worker - INFO - dashboard at: 127.0.0.1:42611 7222s 2024-11-23 22:27:55,700 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44239 7222s 2024-11-23 22:27:55,700 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:27:55,700 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:27:55,700 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:27:55,700 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-uyh76heg 7222s 2024-11-23 22:27:55,700 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:27:55,702 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43657 7222s 2024-11-23 22:27:55,702 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43657 7222s 2024-11-23 22:27:55,702 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:27:55,702 - distributed.worker - INFO - dashboard at: 127.0.0.1:45567 7222s 2024-11-23 22:27:55,702 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44239 7222s 2024-11-23 22:27:55,702 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:27:55,702 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:27:55,702 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:27:55,702 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-2thtifjg 7222s 2024-11-23 22:27:55,703 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:27:55,704 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37743. Reason: failure-to-start- 7222s 2024-11-23 22:27:55,705 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:27:55,705 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43657. Reason: failure-to-start- 7222s 2024-11-23 22:27:55,705 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:27:55,706 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44239': TLS handshake failed with remote 'tls://127.0.0.1:50546': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:27:55,706 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44239': TLS handshake failed with remote 'tls://127.0.0.1:50556': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:27:55,708 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s 2024-11-23 22:27:56,713 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:27:56,720 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38011 7222s 2024-11-23 22:27:56,720 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45679/status 7222s 2024-11-23 22:27:56,721 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:27:56,735 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44895 7222s 2024-11-23 22:27:56,735 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44895 7222s 2024-11-23 22:27:56,735 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:27:56,735 - distributed.worker - INFO - dashboard at: 127.0.0.1:42397 7222s 2024-11-23 22:27:56,735 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38011 7222s 2024-11-23 22:27:56,735 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:27:56,735 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:27:56,735 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:27:56,735 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-lpdxlhax 7222s 2024-11-23 22:27:56,736 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:27:56,738 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41111 7222s 2024-11-23 22:27:56,738 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41111 7222s 2024-11-23 22:27:56,738 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:27:56,738 - distributed.worker - INFO - dashboard at: 127.0.0.1:33377 7222s 2024-11-23 22:27:56,738 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38011 7222s 2024-11-23 22:27:56,738 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:27:56,738 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:27:56,738 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:27:56,738 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ayyelhyv 7222s 2024-11-23 22:27:56,739 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:27:56,740 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44895. Reason: failure-to-start- 7222s 2024-11-23 22:27:56,740 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:27:56,740 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41111. Reason: failure-to-start- 7222s 2024-11-23 22:27:56,741 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:27:56,742 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38011': TLS handshake failed with remote 'tls://127.0.0.1:37682': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:27:56,742 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38011': TLS handshake failed with remote 'tls://127.0.0.1:37688': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:27:56,743 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s 2024-11-23 22:27:57,749 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:27:57,758 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41073 7222s 2024-11-23 22:27:57,758 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41643/status 7222s 2024-11-23 22:27:57,758 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:27:57,773 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33223 7222s 2024-11-23 22:27:57,774 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33223 7222s 2024-11-23 22:27:57,774 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:27:57,774 - distributed.worker - INFO - dashboard at: 127.0.0.1:46565 7222s 2024-11-23 22:27:57,774 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41073 7222s 2024-11-23 22:27:57,774 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:27:57,774 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:27:57,774 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:27:57,774 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-bgk22aj1 7222s 2024-11-23 22:27:57,774 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:27:57,776 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36145 7222s 2024-11-23 22:27:57,777 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36145 7222s 2024-11-23 22:27:57,777 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:27:57,777 - distributed.worker - INFO - dashboard at: 127.0.0.1:39521 7222s 2024-11-23 22:27:57,777 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41073 7222s 2024-11-23 22:27:57,777 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:27:57,777 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:27:57,777 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:27:57,777 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-dal54fjy 7222s 2024-11-23 22:27:57,777 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:27:57,778 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33223. Reason: failure-to-start- 7222s 2024-11-23 22:27:57,778 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:27:57,779 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36145. Reason: failure-to-start- 7222s 2024-11-23 22:27:57,779 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:27:57,780 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41073': TLS handshake failed with remote 'tls://127.0.0.1:43198': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:27:57,780 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41073': TLS handshake failed with remote 'tls://127.0.0.1:43212': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:27:57,782 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s 2024-11-23 22:27:58,787 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:27:58,795 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46675 7222s 2024-11-23 22:27:58,795 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39475/status 7222s 2024-11-23 22:27:58,795 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:27:58,810 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44945 7222s 2024-11-23 22:27:58,810 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44945 7222s 2024-11-23 22:27:58,810 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:27:58,810 - distributed.worker - INFO - dashboard at: 127.0.0.1:33221 7222s 2024-11-23 22:27:58,810 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46675 7222s 2024-11-23 22:27:58,810 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:27:58,810 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:27:58,810 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:27:58,811 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-vzzotb93 7222s 2024-11-23 22:27:58,811 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:27:58,813 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44363 7222s 2024-11-23 22:27:58,813 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44363 7222s 2024-11-23 22:27:58,813 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:27:58,813 - distributed.worker - INFO - dashboard at: 127.0.0.1:40543 7222s 2024-11-23 22:27:58,813 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46675 7222s 2024-11-23 22:27:58,813 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:27:58,813 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:27:58,813 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:27:58,813 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-5tuzhvnc 7222s 2024-11-23 22:27:58,813 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:27:58,815 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44945. Reason: failure-to-start- 7222s 2024-11-23 22:27:58,815 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:27:58,815 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44363. Reason: failure-to-start- 7222s 2024-11-23 22:27:58,815 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:27:58,817 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46675': TLS handshake failed with remote 'tls://127.0.0.1:59604': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:27:58,817 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46675': TLS handshake failed with remote 'tls://127.0.0.1:59620': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:27:58,818 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s 2024-11-23 22:27:59,824 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:27:59,831 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37979 7222s 2024-11-23 22:27:59,831 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41213/status 7222s 2024-11-23 22:27:59,831 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:27:59,845 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34535 7222s 2024-11-23 22:27:59,845 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34535 7222s 2024-11-23 22:27:59,845 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:27:59,845 - distributed.worker - INFO - dashboard at: 127.0.0.1:32833 7222s 2024-11-23 22:27:59,845 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37979 7222s 2024-11-23 22:27:59,845 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:27:59,845 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:27:59,845 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:27:59,846 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-a1gysd67 7222s 2024-11-23 22:27:59,846 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:27:59,857 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43949 7222s 2024-11-23 22:27:59,857 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43949 7222s 2024-11-23 22:27:59,857 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:27:59,858 - distributed.worker - INFO - dashboard at: 127.0.0.1:38643 7222s 2024-11-23 22:27:59,858 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37979 7222s 2024-11-23 22:27:59,858 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:27:59,858 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:27:59,858 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:27:59,858 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ox78qzpb 7222s 2024-11-23 22:27:59,858 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:27:59,859 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34535. Reason: failure-to-start- 7222s 2024-11-23 22:27:59,859 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:27:59,860 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43949. Reason: failure-to-start- 7222s 2024-11-23 22:27:59,860 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:27:59,864 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37979': TLS handshake failed with remote 'tls://127.0.0.1:34506': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:27:59,864 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37979': TLS handshake failed with remote 'tls://127.0.0.1:34512': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:27:59,865 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s 2024-11-23 22:28:00,872 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:28:00,880 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46515 7222s 2024-11-23 22:28:00,880 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42453/status 7222s 2024-11-23 22:28:00,880 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:28:00,897 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38599 7222s 2024-11-23 22:28:00,897 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38599 7222s 2024-11-23 22:28:00,897 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:28:00,897 - distributed.worker - INFO - dashboard at: 127.0.0.1:41393 7222s 2024-11-23 22:28:00,897 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46515 7222s 2024-11-23 22:28:00,897 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:28:00,897 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:28:00,897 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:28:00,897 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-fk0wjwv_ 7222s 2024-11-23 22:28:00,898 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:28:00,900 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35015 7222s 2024-11-23 22:28:00,900 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35015 7222s 2024-11-23 22:28:00,900 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:28:00,900 - distributed.worker - INFO - dashboard at: 127.0.0.1:36039 7222s 2024-11-23 22:28:00,900 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46515 7222s 2024-11-23 22:28:00,900 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:28:00,900 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:28:00,900 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:28:00,900 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-2ukds18u 7222s 2024-11-23 22:28:00,900 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:28:00,902 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38599. Reason: failure-to-start- 7222s 2024-11-23 22:28:00,902 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:28:00,902 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35015. Reason: failure-to-start- 7222s 2024-11-23 22:28:00,902 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:28:00,904 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46515': TLS handshake failed with remote 'tls://127.0.0.1:34888': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:28:00,904 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46515': TLS handshake failed with remote 'tls://127.0.0.1:34896': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:28:00,905 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s 2024-11-23 22:28:01,911 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:28:01,919 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34175 7222s 2024-11-23 22:28:01,919 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42649/status 7222s 2024-11-23 22:28:01,919 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:28:01,935 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34869 7222s 2024-11-23 22:28:01,935 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34869 7222s 2024-11-23 22:28:01,935 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:28:01,935 - distributed.worker - INFO - dashboard at: 127.0.0.1:40691 7222s 2024-11-23 22:28:01,936 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34175 7222s 2024-11-23 22:28:01,936 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:28:01,936 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:28:01,936 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:28:01,936 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-_j1k5viv 7222s 2024-11-23 22:28:01,936 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:28:01,938 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35275 7222s 2024-11-23 22:28:01,938 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35275 7222s 2024-11-23 22:28:01,938 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:28:01,938 - distributed.worker - INFO - dashboard at: 127.0.0.1:40177 7222s 2024-11-23 22:28:01,938 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34175 7222s 2024-11-23 22:28:01,938 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:28:01,938 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:28:01,938 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:28:01,938 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-7ppimc8e 7222s 2024-11-23 22:28:01,938 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:28:01,940 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34869. Reason: failure-to-start- 7222s 2024-11-23 22:28:01,940 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:28:01,940 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35275. Reason: failure-to-start- 7222s 2024-11-23 22:28:01,940 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:28:01,942 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34175': TLS handshake failed with remote 'tls://127.0.0.1:52604': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:28:01,942 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34175': TLS handshake failed with remote 'tls://127.0.0.1:52612': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:28:01,943 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s 2024-11-23 22:28:02,949 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:28:02,956 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44451 7222s 2024-11-23 22:28:02,956 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35241/status 7222s 2024-11-23 22:28:02,959 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:28:02,975 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45185 7222s 2024-11-23 22:28:02,975 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45185 7222s 2024-11-23 22:28:02,975 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:28:02,975 - distributed.worker - INFO - dashboard at: 127.0.0.1:33495 7222s 2024-11-23 22:28:02,975 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44451 7222s 2024-11-23 22:28:02,975 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:28:02,975 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:28:02,975 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:28:02,975 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-979q1858 7222s 2024-11-23 22:28:02,975 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:28:02,978 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39507 7222s 2024-11-23 22:28:02,978 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39507 7222s 2024-11-23 22:28:02,978 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:28:02,978 - distributed.worker - INFO - dashboard at: 127.0.0.1:34775 7222s 2024-11-23 22:28:02,978 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44451 7222s 2024-11-23 22:28:02,978 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:28:02,978 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:28:02,978 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:28:02,978 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-w76_kqp0 7222s 2024-11-23 22:28:02,978 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:28:02,979 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45185. Reason: failure-to-start- 7222s 2024-11-23 22:28:02,979 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:28:02,980 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39507. Reason: failure-to-start- 7222s 2024-11-23 22:28:02,980 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:28:02,981 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44451': TLS handshake failed with remote 'tls://127.0.0.1:48368': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:28:02,982 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44451': TLS handshake failed with remote 'tls://127.0.0.1:48380': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:28:02,983 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s 2024-11-23 22:28:03,988 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:28:03,995 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39845 7222s 2024-11-23 22:28:03,995 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37887/status 7222s 2024-11-23 22:28:03,995 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:28:04,009 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35417 7222s 2024-11-23 22:28:04,009 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35417 7222s 2024-11-23 22:28:04,009 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:28:04,009 - distributed.worker - INFO - dashboard at: 127.0.0.1:45825 7222s 2024-11-23 22:28:04,009 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39845 7222s 2024-11-23 22:28:04,009 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:28:04,009 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:28:04,009 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:28:04,009 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-v1fanbtq 7222s 2024-11-23 22:28:04,009 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:28:04,011 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36873 7222s 2024-11-23 22:28:04,011 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36873 7222s 2024-11-23 22:28:04,011 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:28:04,012 - distributed.worker - INFO - dashboard at: 127.0.0.1:33239 7222s 2024-11-23 22:28:04,012 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39845 7222s 2024-11-23 22:28:04,012 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:28:04,012 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:28:04,012 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:28:04,012 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-_nqts9yh 7222s 2024-11-23 22:28:04,012 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:28:04,014 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35417. Reason: failure-to-start- 7222s 2024-11-23 22:28:04,014 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:28:04,015 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36873. Reason: failure-to-start- 7222s 2024-11-23 22:28:04,015 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:28:04,016 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39845': TLS handshake failed with remote 'tls://127.0.0.1:42974': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:28:04,016 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39845': TLS handshake failed with remote 'tls://127.0.0.1:42988': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:28:04,020 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s 2024-11-23 22:28:05,025 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:28:05,032 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42811 7222s 2024-11-23 22:28:05,032 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39243/status 7222s 2024-11-23 22:28:05,032 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:28:05,045 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43275 7222s 2024-11-23 22:28:05,045 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43275 7222s 2024-11-23 22:28:05,045 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:28:05,045 - distributed.worker - INFO - dashboard at: 127.0.0.1:45439 7222s 2024-11-23 22:28:05,045 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42811 7222s 2024-11-23 22:28:05,046 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:28:05,046 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:28:05,046 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:28:05,046 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-9en0f8bn 7222s 2024-11-23 22:28:05,046 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:28:05,048 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34637 7222s 2024-11-23 22:28:05,048 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34637 7222s 2024-11-23 22:28:05,048 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:28:05,048 - distributed.worker - INFO - dashboard at: 127.0.0.1:38381 7222s 2024-11-23 22:28:05,048 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42811 7222s 2024-11-23 22:28:05,048 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:28:05,048 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:28:05,048 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:28:05,048 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-8j_3dnxe 7222s 2024-11-23 22:28:05,048 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:28:05,049 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43275. Reason: failure-to-start- 7222s 2024-11-23 22:28:05,049 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:28:05,050 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34637. Reason: failure-to-start- 7222s 2024-11-23 22:28:05,050 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:28:05,051 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42811': TLS handshake failed with remote 'tls://127.0.0.1:37066': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:28:05,052 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42811': TLS handshake failed with remote 'tls://127.0.0.1:37082': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:28:05,055 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s 2024-11-23 22:28:06,061 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:28:06,069 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42777 7222s 2024-11-23 22:28:06,069 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40445/status 7222s 2024-11-23 22:28:06,069 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:28:06,083 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46669 7222s 2024-11-23 22:28:06,083 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46669 7222s 2024-11-23 22:28:06,083 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:28:06,083 - distributed.worker - INFO - dashboard at: 127.0.0.1:32817 7222s 2024-11-23 22:28:06,083 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 7222s 2024-11-23 22:28:06,083 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:28:06,083 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:28:06,083 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:28:06,083 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-myj2j6xk 7222s 2024-11-23 22:28:06,083 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:28:06,085 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34761 7222s 2024-11-23 22:28:06,085 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34761 7222s 2024-11-23 22:28:06,085 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:28:06,085 - distributed.worker - INFO - dashboard at: 127.0.0.1:39493 7222s 2024-11-23 22:28:06,085 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42777 7222s 2024-11-23 22:28:06,086 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:28:06,086 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:28:06,086 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:28:06,086 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-fa0t227f 7222s 2024-11-23 22:28:06,086 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:28:06,087 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46669. Reason: failure-to-start- 7222s 2024-11-23 22:28:06,087 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:28:06,088 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34761. Reason: failure-to-start- 7222s 2024-11-23 22:28:06,088 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:28:06,091 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:50474': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:28:06,091 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42777': TLS handshake failed with remote 'tls://127.0.0.1:50480': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:28:06,093 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s 2024-11-23 22:28:07,099 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:28:07,105 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33539 7222s 2024-11-23 22:28:07,106 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35379/status 7222s 2024-11-23 22:28:07,106 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:28:07,121 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34945 7222s 2024-11-23 22:28:07,122 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34945 7222s 2024-11-23 22:28:07,122 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:28:07,122 - distributed.worker - INFO - dashboard at: 127.0.0.1:45429 7222s 2024-11-23 22:28:07,122 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33539 7222s 2024-11-23 22:28:07,122 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:28:07,122 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:28:07,122 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:28:07,122 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-8370mcpx 7222s 2024-11-23 22:28:07,122 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:28:07,124 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33087 7222s 2024-11-23 22:28:07,124 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33087 7222s 2024-11-23 22:28:07,124 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:28:07,125 - distributed.worker - INFO - dashboard at: 127.0.0.1:40305 7222s 2024-11-23 22:28:07,125 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33539 7222s 2024-11-23 22:28:07,125 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:28:07,125 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:28:07,125 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:28:07,125 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-rkt67skv 7222s 2024-11-23 22:28:07,125 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:28:07,128 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34945. Reason: failure-to-start- 7222s 2024-11-23 22:28:07,128 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:28:07,129 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33087. Reason: failure-to-start- 7222s 2024-11-23 22:28:07,129 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:28:07,130 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33539': TLS handshake failed with remote 'tls://127.0.0.1:44190': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:28:07,130 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33539': TLS handshake failed with remote 'tls://127.0.0.1:44202': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:28:07,132 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s 2024-11-23 22:28:08,138 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:28:08,144 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38883 7222s 2024-11-23 22:28:08,145 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36315/status 7222s 2024-11-23 22:28:08,145 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:28:08,158 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37969 7222s 2024-11-23 22:28:08,159 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37969 7222s 2024-11-23 22:28:08,159 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:28:08,159 - distributed.worker - INFO - dashboard at: 127.0.0.1:33917 7222s 2024-11-23 22:28:08,159 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38883 7222s 2024-11-23 22:28:08,159 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:28:08,159 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:28:08,159 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:28:08,159 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-896pitn_ 7222s 2024-11-23 22:28:08,159 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:28:08,161 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43005 7222s 2024-11-23 22:28:08,161 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43005 7222s 2024-11-23 22:28:08,161 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:28:08,161 - distributed.worker - INFO - dashboard at: 127.0.0.1:41411 7222s 2024-11-23 22:28:08,161 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38883 7222s 2024-11-23 22:28:08,161 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:28:08,161 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:28:08,161 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:28:08,161 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-h0sbiggp 7222s 2024-11-23 22:28:08,162 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:28:08,165 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37969. Reason: failure-to-start- 7222s 2024-11-23 22:28:08,165 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:28:08,165 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43005. Reason: failure-to-start- 7222s 2024-11-23 22:28:08,166 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:28:08,167 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38883': TLS handshake failed with remote 'tls://127.0.0.1:47470': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:28:08,167 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38883': TLS handshake failed with remote 'tls://127.0.0.1:47486': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:28:08,168 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s 2024-11-23 22:28:09,173 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:28:09,180 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42413 7222s 2024-11-23 22:28:09,180 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36537/status 7222s 2024-11-23 22:28:09,180 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:28:09,193 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42093 7222s 2024-11-23 22:28:09,193 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42093 7222s 2024-11-23 22:28:09,193 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:28:09,193 - distributed.worker - INFO - dashboard at: 127.0.0.1:39341 7222s 2024-11-23 22:28:09,193 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42413 7222s 2024-11-23 22:28:09,193 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:28:09,193 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:28:09,193 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:28:09,193 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-xuz6rzd1 7222s 2024-11-23 22:28:09,193 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:28:09,195 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38395 7222s 2024-11-23 22:28:09,196 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38395 7222s 2024-11-23 22:28:09,196 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:28:09,196 - distributed.worker - INFO - dashboard at: 127.0.0.1:41795 7222s 2024-11-23 22:28:09,196 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42413 7222s 2024-11-23 22:28:09,196 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:28:09,196 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:28:09,196 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:28:09,196 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-as44w7uq 7222s 2024-11-23 22:28:09,196 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:28:09,200 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42093. Reason: failure-to-start- 7222s 2024-11-23 22:28:09,201 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:28:09,201 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38395. Reason: failure-to-start- 7222s 2024-11-23 22:28:09,201 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:28:09,203 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42413': TLS handshake failed with remote 'tls://127.0.0.1:50310': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:28:09,203 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42413': TLS handshake failed with remote 'tls://127.0.0.1:50322': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:28:09,204 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s 2024-11-23 22:28:10,209 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:28:10,216 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41993 7222s 2024-11-23 22:28:10,216 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33369/status 7222s 2024-11-23 22:28:10,216 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:28:10,229 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42101 7222s 2024-11-23 22:28:10,230 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42101 7222s 2024-11-23 22:28:10,230 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:28:10,230 - distributed.worker - INFO - dashboard at: 127.0.0.1:43455 7222s 2024-11-23 22:28:10,230 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41993 7222s 2024-11-23 22:28:10,230 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:28:10,230 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:28:10,230 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:28:10,230 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-5wa_rwco 7222s 2024-11-23 22:28:10,230 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:28:10,232 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33593 7222s 2024-11-23 22:28:10,232 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33593 7222s 2024-11-23 22:28:10,232 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:28:10,232 - distributed.worker - INFO - dashboard at: 127.0.0.1:41111 7222s 2024-11-23 22:28:10,232 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41993 7222s 2024-11-23 22:28:10,233 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:28:10,233 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:28:10,233 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:28:10,233 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ekppyw8q 7222s 2024-11-23 22:28:10,233 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:28:10,236 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42101. Reason: failure-to-start- 7222s 2024-11-23 22:28:10,236 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:28:10,237 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33593. Reason: failure-to-start- 7222s 2024-11-23 22:28:10,237 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:28:10,238 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41993': TLS handshake failed with remote 'tls://127.0.0.1:57370': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:28:10,238 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41993': TLS handshake failed with remote 'tls://127.0.0.1:57374': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:28:10,240 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s 2024-11-23 22:28:11,246 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:28:11,254 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40081 7222s 2024-11-23 22:28:11,255 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34767/status 7222s 2024-11-23 22:28:11,255 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:28:11,268 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43783 7222s 2024-11-23 22:28:11,269 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43783 7222s 2024-11-23 22:28:11,269 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:28:11,269 - distributed.worker - INFO - dashboard at: 127.0.0.1:37653 7222s 2024-11-23 22:28:11,269 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40081 7222s 2024-11-23 22:28:11,269 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:28:11,269 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:28:11,269 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:28:11,269 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-c1cd_ffp 7222s 2024-11-23 22:28:11,269 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:28:11,271 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34523 7222s 2024-11-23 22:28:11,271 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34523 7222s 2024-11-23 22:28:11,271 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:28:11,271 - distributed.worker - INFO - dashboard at: 127.0.0.1:46313 7222s 2024-11-23 22:28:11,271 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40081 7222s 2024-11-23 22:28:11,271 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:28:11,271 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:28:11,272 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:28:11,272 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-itqi82vz 7222s 2024-11-23 22:28:11,272 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:28:11,275 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43783. Reason: failure-to-start- 7222s 2024-11-23 22:28:11,275 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:28:11,276 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34523. Reason: failure-to-start- 7222s 2024-11-23 22:28:11,276 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:28:11,277 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40081': TLS handshake failed with remote 'tls://127.0.0.1:33358': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:28:11,277 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40081': TLS handshake failed with remote 'tls://127.0.0.1:33366': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:28:11,279 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s 2024-11-23 22:28:12,285 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:28:12,292 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34601 7222s 2024-11-23 22:28:12,292 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38833/status 7222s 2024-11-23 22:28:12,292 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:28:12,307 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44837 7222s 2024-11-23 22:28:12,307 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44837 7222s 2024-11-23 22:28:12,307 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:28:12,307 - distributed.worker - INFO - dashboard at: 127.0.0.1:42993 7222s 2024-11-23 22:28:12,307 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34601 7222s 2024-11-23 22:28:12,307 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:28:12,308 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:28:12,308 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:28:12,308 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-_o06tv_7 7222s 2024-11-23 22:28:12,308 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:28:12,310 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37179 7222s 2024-11-23 22:28:12,310 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37179 7222s 2024-11-23 22:28:12,310 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:28:12,310 - distributed.worker - INFO - dashboard at: 127.0.0.1:42179 7222s 2024-11-23 22:28:12,310 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34601 7222s 2024-11-23 22:28:12,310 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:28:12,310 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:28:12,310 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:28:12,310 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-vflgoudd 7222s 2024-11-23 22:28:12,310 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:28:12,314 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44837. Reason: failure-to-start- 7222s 2024-11-23 22:28:12,314 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:28:12,314 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37179. Reason: failure-to-start- 7222s 2024-11-23 22:28:12,315 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:28:12,316 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34601': TLS handshake failed with remote 'tls://127.0.0.1:43432': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:28:12,316 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34601': TLS handshake failed with remote 'tls://127.0.0.1:43442': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:28:12,318 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s 2024-11-23 22:28:13,323 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:28:13,330 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:32959 7222s 2024-11-23 22:28:13,330 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36325/status 7222s 2024-11-23 22:28:13,330 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:28:13,344 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44031 7222s 2024-11-23 22:28:13,345 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44031 7222s 2024-11-23 22:28:13,345 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:28:13,345 - distributed.worker - INFO - dashboard at: 127.0.0.1:40169 7222s 2024-11-23 22:28:13,345 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:32959 7222s 2024-11-23 22:28:13,345 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:28:13,345 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:28:13,345 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:28:13,345 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-flrpgjkb 7222s 2024-11-23 22:28:13,345 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:28:13,349 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35699 7222s 2024-11-23 22:28:13,349 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35699 7222s 2024-11-23 22:28:13,349 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:28:13,349 - distributed.worker - INFO - dashboard at: 127.0.0.1:46063 7222s 2024-11-23 22:28:13,349 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:32959 7222s 2024-11-23 22:28:13,349 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:28:13,349 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:28:13,349 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:28:13,349 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ombicm8h 7222s 2024-11-23 22:28:13,349 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:28:13,353 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44031. Reason: failure-to-start- 7222s 2024-11-23 22:28:13,353 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:28:13,354 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35699. Reason: failure-to-start- 7222s 2024-11-23 22:28:13,354 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:28:13,355 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:32959': TLS handshake failed with remote 'tls://127.0.0.1:33820': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:28:13,355 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:32959': TLS handshake failed with remote 'tls://127.0.0.1:33832': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:28:13,360 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s 2024-11-23 22:28:14,365 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:28:14,372 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45711 7222s 2024-11-23 22:28:14,372 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33949/status 7222s 2024-11-23 22:28:14,372 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:28:14,385 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45095 7222s 2024-11-23 22:28:14,386 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45095 7222s 2024-11-23 22:28:14,386 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:28:14,386 - distributed.worker - INFO - dashboard at: 127.0.0.1:43747 7222s 2024-11-23 22:28:14,386 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45711 7222s 2024-11-23 22:28:14,386 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:28:14,386 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:28:14,386 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:28:14,386 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-_d2awoo_ 7222s 2024-11-23 22:28:14,386 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:28:14,388 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34817 7222s 2024-11-23 22:28:14,388 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34817 7222s 2024-11-23 22:28:14,388 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:28:14,389 - distributed.worker - INFO - dashboard at: 127.0.0.1:41563 7222s 2024-11-23 22:28:14,389 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45711 7222s 2024-11-23 22:28:14,389 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:28:14,389 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:28:14,389 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:28:14,389 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-5pht5uq5 7222s 2024-11-23 22:28:14,389 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:28:14,396 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45095. Reason: failure-to-start- 7222s 2024-11-23 22:28:14,396 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:28:14,396 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34817. Reason: failure-to-start- 7222s 2024-11-23 22:28:14,397 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:28:14,398 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45711': TLS handshake failed with remote 'tls://127.0.0.1:45218': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:28:14,398 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45711': TLS handshake failed with remote 'tls://127.0.0.1:45222': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:28:14,400 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s 2024-11-23 22:28:15,405 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:28:15,412 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36959 7222s 2024-11-23 22:28:15,412 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40965/status 7222s 2024-11-23 22:28:15,412 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:28:15,428 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37891 7222s 2024-11-23 22:28:15,428 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37891 7222s 2024-11-23 22:28:15,428 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:28:15,428 - distributed.worker - INFO - dashboard at: 127.0.0.1:45825 7222s 2024-11-23 22:28:15,428 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36959 7222s 2024-11-23 22:28:15,428 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:28:15,428 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:28:15,428 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:28:15,428 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-3mtsfl1f 7222s 2024-11-23 22:28:15,429 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:28:15,431 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40229 7222s 2024-11-23 22:28:15,431 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40229 7222s 2024-11-23 22:28:15,431 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:28:15,431 - distributed.worker - INFO - dashboard at: 127.0.0.1:46333 7222s 2024-11-23 22:28:15,431 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36959 7222s 2024-11-23 22:28:15,431 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:28:15,431 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:28:15,431 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:28:15,431 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-6cec9e8l 7222s 2024-11-23 22:28:15,431 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:28:15,435 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37891. Reason: failure-to-start- 7222s 2024-11-23 22:28:15,435 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:28:15,436 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40229. Reason: failure-to-start- 7222s 2024-11-23 22:28:15,436 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:28:15,437 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36959': TLS handshake failed with remote 'tls://127.0.0.1:32958': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:28:15,438 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36959': TLS handshake failed with remote 'tls://127.0.0.1:32966': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:28:15,439 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s 2024-11-23 22:28:16,445 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:28:16,465 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43955 7222s 2024-11-23 22:28:16,466 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43141/status 7222s 2024-11-23 22:28:16,466 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:28:16,485 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45015 7222s 2024-11-23 22:28:16,486 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45015 7222s 2024-11-23 22:28:16,486 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:28:16,486 - distributed.worker - INFO - dashboard at: 127.0.0.1:33975 7222s 2024-11-23 22:28:16,486 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43955 7222s 2024-11-23 22:28:16,486 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:28:16,486 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:28:16,486 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:28:16,486 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-oolnvv3b 7222s 2024-11-23 22:28:16,486 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:28:16,488 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37811 7222s 2024-11-23 22:28:16,488 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37811 7222s 2024-11-23 22:28:16,488 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:28:16,488 - distributed.worker - INFO - dashboard at: 127.0.0.1:44075 7222s 2024-11-23 22:28:16,489 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43955 7222s 2024-11-23 22:28:16,489 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:28:16,489 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:28:16,489 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:28:16,489 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-4ncmsadd 7222s 2024-11-23 22:28:16,489 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:28:16,492 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45015. Reason: failure-to-start- 7222s 2024-11-23 22:28:16,492 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:28:16,493 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37811. Reason: failure-to-start- 7222s 2024-11-23 22:28:16,493 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:28:16,495 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43955': TLS handshake failed with remote 'tls://127.0.0.1:46072': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:28:16,495 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43955': TLS handshake failed with remote 'tls://127.0.0.1:46084': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:28:16,496 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s _________________________ test_worker_client_executor __________________________ 7222s 7222s fut = , timeout = 0 7222s 7222s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 7222s async with asyncio.timeout(timeout): 7222s > return await fut 7222s 7222s /usr/lib/python3/dist-packages/distributed/utils.py:1960: 7222s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7222s /usr/lib/python3/dist-packages/distributed/worker.py:1480: in start_unsafe 7222s await self._register_with_scheduler() 7222s /usr/lib/python3/dist-packages/distributed/worker.py:1179: in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s /usr/lib/python3/dist-packages/distributed/comm/core.py:342: in connect 7222s comm = await wait_for( 7222s /usr/lib/python3/dist-packages/distributed/utils.py:1960: in wait_for 7222s return await fut 7222s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:546: in connect 7222s stream = await self.client.connect( 7222s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7222s 7222s self = , host = '127.0.0.1' 7222s port = 35555, af = 7222s ssl_options = 7222s max_buffer_size = 8364507136.0, source_ip = None, source_port = None 7222s timeout = None 7222s 7222s async def connect( 7222s self, 7222s host: str, 7222s port: int, 7222s af: socket.AddressFamily = socket.AF_UNSPEC, 7222s ssl_options: Optional[Union[Dict[str, Any], ssl.SSLContext]] = None, 7222s max_buffer_size: Optional[int] = None, 7222s source_ip: Optional[str] = None, 7222s source_port: Optional[int] = None, 7222s timeout: Optional[Union[float, datetime.timedelta]] = None, 7222s ) -> IOStream: 7222s """Connect to the given host and port. 7222s 7222s Asynchronously returns an `.IOStream` (or `.SSLIOStream` if 7222s ``ssl_options`` is not None). 7222s 7222s Using the ``source_ip`` kwarg, one can specify the source 7222s IP address to use when establishing the connection. 7222s In case the user needs to resolve and 7222s use a specific interface, it has to be handled outside 7222s of Tornado as this depends very much on the platform. 7222s 7222s Raises `TimeoutError` if the input future does not complete before 7222s ``timeout``, which may be specified in any form allowed by 7222s `.IOLoop.add_timeout` (i.e. a `datetime.timedelta` or an absolute time 7222s relative to `.IOLoop.time`) 7222s 7222s Similarly, when the user requires a certain source port, it can 7222s be specified using the ``source_port`` arg. 7222s 7222s .. versionchanged:: 4.5 7222s Added the ``source_ip`` and ``source_port`` arguments. 7222s 7222s .. versionchanged:: 5.0 7222s Added the ``timeout`` argument. 7222s """ 7222s if timeout is not None: 7222s if isinstance(timeout, numbers.Real): 7222s timeout = IOLoop.current().time() + timeout 7222s elif isinstance(timeout, datetime.timedelta): 7222s timeout = IOLoop.current().time() + timeout.total_seconds() 7222s else: 7222s raise TypeError("Unsupported timeout %r" % timeout) 7222s if timeout is not None: 7222s addrinfo = await gen.with_timeout( 7222s timeout, self.resolver.resolve(host, port, af) 7222s ) 7222s else: 7222s addrinfo = await self.resolver.resolve(host, port, af) 7222s connector = _Connector( 7222s addrinfo, 7222s functools.partial( 7222s self._create_stream, 7222s max_buffer_size, 7222s source_ip=source_ip, 7222s source_port=source_port, 7222s ), 7222s ) 7222s > af, addr, stream = await connector.start(connect_timeout=timeout) 7222s E asyncio.exceptions.CancelledError 7222s 7222s /usr/lib/python3/dist-packages/tornado/tcpclient.py:279: CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s self = 7222s 7222s @final 7222s async def start(self): 7222s async with self._startup_lock: 7222s if self.status == Status.failed: 7222s assert self.__startup_exc is not None 7222s raise self.__startup_exc 7222s elif self.status != Status.init: 7222s return self 7222s timeout = getattr(self, "death_timeout", None) 7222s 7222s async def _close_on_failure(exc: Exception) -> None: 7222s await self.close(reason=f"failure-to-start-{str(type(exc))}") 7222s self.status = Status.failed 7222s self.__startup_exc = exc 7222s 7222s try: 7222s > await wait_for(self.start_unsafe(), timeout=timeout) 7222s 7222s /usr/lib/python3/dist-packages/distributed/core.py:664: 7222s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7222s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 7222s async with asyncio.timeout(timeout): 7222s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7222s 7222s self = 7222s exc_type = 7222s exc_val = CancelledError(), exc_tb = 7222s 7222s async def __aexit__( 7222s self, 7222s exc_type: Optional[Type[BaseException]], 7222s exc_val: Optional[BaseException], 7222s exc_tb: Optional[TracebackType], 7222s ) -> Optional[bool]: 7222s assert self._state in (_State.ENTERED, _State.EXPIRING) 7222s 7222s if self._timeout_handler is not None: 7222s self._timeout_handler.cancel() 7222s self._timeout_handler = None 7222s 7222s if self._state is _State.EXPIRING: 7222s self._state = _State.EXPIRED 7222s 7222s if self._task.uncancel() <= self._cancelling and exc_type is not None: 7222s # Since there are no new cancel requests, we're 7222s # handling this. 7222s if issubclass(exc_type, exceptions.CancelledError): 7222s > raise TimeoutError from exc_val 7222s E TimeoutError 7222s 7222s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s @contextlib.asynccontextmanager 7222s async def _cluster_factory(): 7222s workers = [] 7222s s = None 7222s try: 7222s for _ in range(60): 7222s try: 7222s > s, ws = await start_cluster( 7222s nthreads, 7222s scheduler, 7222s security=security, 7222s Worker=Worker, 7222s scheduler_kwargs=scheduler_kwargs, 7222s worker_kwargs=merge( 7222s {"death_timeout": min(15, int(deadline.remaining))}, 7222s worker_kwargs, 7222s ), 7222s ) 7222s 7222s /usr/lib/python3/dist-packages/distributed/utils_test.py:966: 7222s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7222s /usr/lib/python3/dist-packages/distributed/utils_test.py:789: in start_cluster 7222s await asyncio.gather(*workers) 7222s /usr/lib/python3.13/asyncio/tasks.py:737: in _wrap_awaitable 7222s return await awaitable 7222s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7222s 7222s self = 7222s 7222s @final 7222s async def start(self): 7222s async with self._startup_lock: 7222s if self.status == Status.failed: 7222s assert self.__startup_exc is not None 7222s raise self.__startup_exc 7222s elif self.status != Status.init: 7222s return self 7222s timeout = getattr(self, "death_timeout", None) 7222s 7222s async def _close_on_failure(exc: Exception) -> None: 7222s await self.close(reason=f"failure-to-start-{str(type(exc))}") 7222s self.status = Status.failed 7222s self.__startup_exc = exc 7222s 7222s try: 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s except asyncio.TimeoutError as exc: 7222s await _close_on_failure(exc) 7222s > raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s E TimeoutError: Worker start timed out after 0s. 7222s 7222s /usr/lib/python3/dist-packages/distributed/core.py:667: TimeoutError 7222s 7222s During handling of the above exception, another exception occurred: 7222s 7222s fut = ._..test_func..async_fn at 0xe9b48938> 7222s timeout = 60 7222s 7222s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 7222s async with asyncio.timeout(timeout): 7222s > return await fut 7222s 7222s /usr/lib/python3/dist-packages/distributed/utils.py:1960: 7222s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7222s /usr/lib/python3/dist-packages/distributed/utils_test.py:999: in async_fn 7222s _cluster_factory() as (s, workers), 7222s /usr/lib/python3.13/contextlib.py:214: in __aenter__ 7222s return await anext(self.gen) 7222s /usr/lib/python3/dist-packages/distributed/utils_test.py:983: in _cluster_factory 7222s await asyncio.sleep(1) 7222s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7222s 7222s delay = 1, result = None 7222s 7222s async def sleep(delay, result=None): 7222s """Coroutine that completes after a given time (in seconds).""" 7222s if delay <= 0: 7222s await __sleep0() 7222s return result 7222s 7222s if math.isnan(delay): 7222s raise ValueError("Invalid delay: NaN (not a number)") 7222s 7222s loop = events.get_running_loop() 7222s future = loop.create_future() 7222s h = loop.call_later(delay, 7222s futures._set_result_unless_cancelled, 7222s future, result) 7222s try: 7222s > return await future 7222s E asyncio.exceptions.CancelledError 7222s 7222s /usr/lib/python3.13/asyncio/tasks.py:718: CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s args = (), kwds = {} 7222s 7222s @wraps(func) 7222s def inner(*args, **kwds): 7222s with self._recreate_cm(): 7222s > return func(*args, **kwds) 7222s 7222s /usr/lib/python3.13/contextlib.py:85: 7222s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7222s /usr/lib/python3.13/contextlib.py:85: in inner 7222s return func(*args, **kwds) 7222s /usr/lib/python3/dist-packages/distributed/utils_test.py:1102: in test_func 7222s return _run_and_close_tornado(async_fn_outer) 7222s /usr/lib/python3/dist-packages/distributed/utils_test.py:378: in _run_and_close_tornado 7222s return asyncio_run(inner_fn(), loop_factory=get_loop_factory()) 7222s /usr/lib/python3.13/asyncio/runners.py:194: in run 7222s return runner.run(main) 7222s /usr/lib/python3.13/asyncio/runners.py:118: in run 7222s return self._loop.run_until_complete(task) 7222s /usr/lib/python3.13/asyncio/base_events.py:720: in run_until_complete 7222s return future.result() 7222s /usr/lib/python3/dist-packages/distributed/utils_test.py:375: in inner_fn 7222s return await async_fn(*args, **kwargs) 7222s /usr/lib/python3/dist-packages/distributed/utils_test.py:1099: in async_fn_outer 7222s return await utils_wait_for(async_fn(), timeout=timeout * 2) 7222s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 7222s async with asyncio.timeout(timeout): 7222s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7222s 7222s self = 7222s exc_type = 7222s exc_val = CancelledError(), exc_tb = 7222s 7222s async def __aexit__( 7222s self, 7222s exc_type: Optional[Type[BaseException]], 7222s exc_val: Optional[BaseException], 7222s exc_tb: Optional[TracebackType], 7222s ) -> Optional[bool]: 7222s assert self._state in (_State.ENTERED, _State.EXPIRING) 7222s 7222s if self._timeout_handler is not None: 7222s self._timeout_handler.cancel() 7222s self._timeout_handler = None 7222s 7222s if self._state is _State.EXPIRING: 7222s self._state = _State.EXPIRED 7222s 7222s if self._task.uncancel() <= self._cancelling and exc_type is not None: 7222s # Since there are no new cancel requests, we're 7222s # handling this. 7222s if issubclass(exc_type, exceptions.CancelledError): 7222s > raise TimeoutError from exc_val 7222s E TimeoutError 7222s 7222s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 7222s ----------------------------- Captured stderr call ----------------------------- 7222s 2024-11-23 22:28:17,807 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:28:17,815 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:17,815 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44271/status 7222s 2024-11-23 22:28:17,815 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:28:17,830 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34981 7222s 2024-11-23 22:28:17,830 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34981 7222s 2024-11-23 22:28:17,830 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:28:17,830 - distributed.worker - INFO - dashboard at: 127.0.0.1:41761 7222s 2024-11-23 22:28:17,830 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:17,830 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:28:17,830 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:28:17,830 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:28:17,830 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-21c_but7 7222s 2024-11-23 22:28:17,830 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:28:17,832 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39553 7222s 2024-11-23 22:28:17,833 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39553 7222s 2024-11-23 22:28:17,833 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:28:17,833 - distributed.worker - INFO - dashboard at: 127.0.0.1:38353 7222s 2024-11-23 22:28:17,833 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:17,833 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:28:17,833 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:28:17,833 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:28:17,833 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-zfhrjh69 7222s 2024-11-23 22:28:17,833 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:28:17,846 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:17,846 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:17,846 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:36428': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:17,846 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:36430': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:17,958 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:17,959 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:17,959 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:36442': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:17,959 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:36458': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:18,071 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:18,071 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:18,072 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:36462': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:18,072 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:36468': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:18,185 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:18,185 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:18,185 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:36476': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:18,186 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:36486': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:18,297 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:18,298 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:18,298 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:36500': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:18,298 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:36514': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:18,410 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:18,410 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:18,411 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:36528': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:18,411 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:36536': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:18,524 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:18,524 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:18,525 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:36552': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:18,525 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:36566': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:18,637 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:18,637 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:18,637 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:36580': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:18,637 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:36596': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:18,750 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:18,751 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:18,751 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:36610': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:18,751 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:36622': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:18,863 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:18,863 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:18,863 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:36630': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:18,863 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:36642': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:18,976 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:18,976 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:18,976 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:36656': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:18,977 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:36670': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:19,089 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:19,089 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:19,089 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:36682': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:19,089 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:36688': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:19,202 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:19,202 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:19,203 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:36692': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:19,203 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:36702': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:19,316 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:19,316 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:19,316 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:36714': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:19,316 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:36730': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:19,427 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:19,428 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:19,429 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:36746': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:19,429 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:36750': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:19,541 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:19,541 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:19,541 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:36762': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:19,541 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:36764': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:19,654 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:19,654 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:19,654 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:36770': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:19,655 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:36774': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:19,767 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:19,768 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:19,768 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:36776': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:19,768 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:36782': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:19,884 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:19,884 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:19,884 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:36792': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:19,885 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:36804': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:19,998 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:19,998 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:19,998 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:36808': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:19,998 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:36816': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:20,111 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:20,111 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:20,111 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:36826': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:20,111 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:36832': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:20,224 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:20,224 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:20,225 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:36838': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:20,225 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:36850': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:20,337 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:20,337 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:20,337 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:36866': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:20,337 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:36868': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:20,450 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:20,450 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:20,450 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:36876': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:20,450 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:36892': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:20,563 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:20,563 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:20,564 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:36904': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:20,564 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:36920': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:20,676 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:20,676 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:20,676 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:36922': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:20,676 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:36924': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:20,789 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:20,789 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:20,789 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:36932': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:20,789 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:36944': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:20,902 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:20,902 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:20,903 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:36946': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:20,903 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:36962': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:21,015 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:21,015 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:21,016 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:36972': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:21,016 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:36980': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:21,128 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:21,128 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:21,128 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:36986': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:21,128 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:37000': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:21,240 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:21,241 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:21,241 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:37008': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:21,241 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:37022': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:21,353 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:21,354 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:21,354 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:37036': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:21,354 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:37038': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:21,467 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:21,468 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:21,468 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:37054': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:21,468 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:37064': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:21,581 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:21,581 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:21,581 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:41890': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:21,581 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:41906': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:21,696 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:21,696 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:21,696 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:41920': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:21,696 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:41924': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:21,809 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:21,809 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:21,810 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:41934': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:21,810 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:41938': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:21,923 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:21,923 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:21,923 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:41942': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:21,923 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:41954': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:22,036 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:22,036 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:22,036 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:41970': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:22,036 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:41986': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:22,149 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:22,149 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:22,149 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:41990': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:22,149 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:42006': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:22,261 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:22,261 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:22,262 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:42020': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:22,262 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:42034': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:22,375 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:22,375 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:22,375 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:42046': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:22,375 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:42052': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:22,489 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:22,489 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:22,489 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:42058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:22,489 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:42074': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:22,602 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:22,602 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:22,602 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:42086': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:22,603 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:42090': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:22,715 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:22,716 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:22,716 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:42100': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:22,716 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:42108': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:22,832 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:22,833 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:22,833 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:42124': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:22,833 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:42128': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:22,945 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:22,945 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:22,945 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:42136': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:22,945 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:42152': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:23,058 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:23,058 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:23,058 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:42162': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:23,058 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:42166': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:23,171 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:23,171 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:23,171 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:42178': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:23,171 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:42194': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:23,284 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:23,284 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:23,284 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:42204': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:23,284 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:42220': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:23,397 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:23,397 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:23,397 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:42224': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:23,397 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:42240': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:23,511 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:23,511 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:23,511 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:42244': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:23,512 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:42254': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:23,624 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:23,624 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:23,624 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:42262': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:23,625 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:42264': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:23,736 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:23,736 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:23,737 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:42270': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:23,737 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:42274': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:23,849 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:23,849 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:23,850 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:42280': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:23,850 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:42282': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:23,963 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:23,963 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:23,963 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:42284': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:23,963 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:42298': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:24,076 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:24,076 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:24,076 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:42300': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:24,076 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:42316': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:24,188 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:24,189 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:24,189 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:42320': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:24,189 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:42336': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:24,302 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:24,302 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:24,302 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:42338': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:24,302 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:42354': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:24,415 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:24,415 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:24,415 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:42364': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:24,415 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:42368': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:24,528 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:24,529 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:24,529 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:42382': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:24,529 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:42388': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:24,642 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:24,642 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:24,643 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:42404': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:24,643 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:42414': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:24,756 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:24,756 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:24,756 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:42430': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:24,756 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:42446': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:24,870 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:24,870 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:24,871 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:42452': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:24,871 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:42464': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:24,984 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:24,984 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:24,984 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:42466': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:24,984 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:42474': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:25,099 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:25,099 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:25,099 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:42486': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:25,099 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:42494': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:25,212 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:25,212 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:25,212 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:42502': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:25,212 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:42510': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:25,330 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:25,330 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:25,330 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:42526': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:25,330 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:42536': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:25,443 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:25,443 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:25,443 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:42552': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:25,443 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:42568': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:25,556 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:25,557 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:25,557 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:42576': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:25,557 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:42588': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:25,671 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:25,672 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:25,672 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:42594': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:25,673 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:42604': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:25,788 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:25,788 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:25,789 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:42610': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:25,789 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:42614': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:25,904 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:25,905 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:25,906 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:42620': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:25,906 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:42628': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:26,021 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:26,022 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:26,022 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:42638': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:26,022 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:42644': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:26,137 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:26,138 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:26,138 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:42652': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:26,139 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:42660': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:26,253 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:26,253 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:26,254 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:42670': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:26,254 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:42686': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:26,368 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:26,368 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:26,369 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:42700': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:26,369 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:42706': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:26,484 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:26,485 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:26,485 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:42720': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:26,485 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:42724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:26,600 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:26,601 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:26,601 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:42732': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:26,601 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:42734': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:26,715 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:26,716 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:26,717 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:42748': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:26,717 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:42760': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:26,835 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:26,836 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:26,836 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:42764': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:26,837 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:42770': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:26,952 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:26,952 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:26,953 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:42772': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:26,953 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:42778': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:27,069 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:27,069 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:27,072 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:42794': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:27,073 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:42804': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:27,180 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:27,181 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:42806': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:27,187 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:27,188 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:42814': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:27,290 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:27,291 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:42822': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:27,299 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:27,299 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:42824': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:27,399 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:27,400 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:42830': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:27,408 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:27,409 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:42844': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:27,508 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:27,509 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:42850': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:27,517 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:27,518 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:42860': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:27,618 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:27,619 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:42862': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:27,627 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:27,628 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:42872': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:27,728 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:27,728 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:42886': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:27,736 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:27,737 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:42900': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:27,854 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:27,856 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:42910': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:27,862 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:27,863 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:42914': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:27,963 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:27,963 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:42922': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:27,970 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:27,971 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:42938': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:28,071 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:28,071 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:42946': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:28,077 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:28,078 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:42954': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:28,178 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:28,179 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:42960': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:28,185 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:28,185 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:42974': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:28,286 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:28,286 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:42982': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:28,292 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:28,293 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:42986': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:28,393 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:28,394 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:42994': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:28,400 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:28,400 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:42996': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:28,501 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:28,501 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:43002': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:28,508 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:28,508 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:43010': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:28,609 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:28,610 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:43016': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:28,615 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:28,616 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:43024': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:28,717 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:28,718 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:43040': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:28,724 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:28,724 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:43052': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:28,828 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:28,829 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:43054': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:28,835 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:28,835 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:43066': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:28,935 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:28,936 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:43080': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:28,942 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:28,942 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:43090': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:29,043 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:29,043 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:43100': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:29,050 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:29,050 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:43106': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:29,151 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:29,152 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:43110': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:29,158 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:29,158 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:43122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:29,260 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:29,261 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:43130': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:29,267 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:29,267 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:43132': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:29,368 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:29,368 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:43144': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:29,375 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:29,375 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:43158': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:29,476 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:29,477 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:43174': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:29,484 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:29,484 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:43182': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:29,584 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:29,585 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:43190': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:29,591 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:29,592 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:43204': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:29,692 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:29,693 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:43214': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:29,699 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:29,699 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:43222': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:29,799 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:29,800 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:43234': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:29,806 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:29,806 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:43242': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:29,907 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:29,907 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:43246': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:29,913 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:29,914 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:43250': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:30,014 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:30,014 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:43266': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:30,021 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:30,021 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:43270': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:30,121 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:30,122 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:43274': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:30,128 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:30,129 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:43280': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:30,229 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:30,229 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:43286': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:30,235 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:30,236 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:43302': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:30,336 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:30,336 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:43310': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:30,342 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:30,343 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:43316': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:30,446 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:30,447 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:43324': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:30,452 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:30,453 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:43336': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:30,553 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:30,554 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:43338': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:30,560 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:30,560 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:43352': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:30,661 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:30,662 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:43368': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:30,668 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:30,668 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:43374': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:30,769 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:30,769 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:43382': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:30,776 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:30,776 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:43390': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:30,877 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:30,878 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:43404': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:30,883 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:30,884 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:43410': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:30,984 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:30,985 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:43426': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:30,991 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:30,991 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:43432': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:31,092 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:31,093 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:43436': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:31,099 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:31,099 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:43440': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:31,200 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:31,200 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:43448': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:31,207 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:31,207 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:43464': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:31,307 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:31,308 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:43480': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:31,314 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:31,314 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:43482': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:31,415 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:31,415 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:43496': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:31,421 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:31,422 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:43500': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:31,522 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:31,522 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:43504': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:31,529 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:31,529 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:43508': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:31,630 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:31,631 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:55644': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:31,637 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:31,637 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:55658': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:31,738 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:31,738 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:55666': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:31,744 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:31,745 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:55672': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:31,846 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:31,846 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:55674': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:31,852 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:31,853 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:55680': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:31,953 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:31,953 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:55688': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:31,960 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:31,960 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:55700': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:32,061 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:32,061 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:55710': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:32,069 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:32,069 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:55712': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:32,170 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:32,170 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:55718': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:32,177 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:32,177 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:55720': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:32,277 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:32,278 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:55736': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:32,284 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:32,284 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:55752': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:32,387 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:32,389 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:55756': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:32,396 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:32,397 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:55770': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:32,497 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:32,498 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:55782': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:32,506 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:32,507 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:55786': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:32,607 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:32,608 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:55796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:32,616 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:32,617 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:55812': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:32,717 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:32,718 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:55814': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:32,726 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:32,727 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:55824': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:32,829 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37403 7222s 2024-11-23 22:28:32,831 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37403': TLS handshake failed with remote 'tls://127.0.0.1:55830': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:32,831 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34981. Reason: failure-to-start- 7222s 2024-11-23 22:28:32,831 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:28:32,834 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39553. Reason: failure-to-start- 7222s 2024-11-23 22:28:32,834 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:28:32,836 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 15s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 7222s stream = await stream.start_tls( 7222s ^^^^^^^^^^^^^^^^^^^^^^^ 7222s False, ssl_options=ssl_options, server_hostname=host 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 7222s self.socket.do_handshake() 7222s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 7222s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 7222s self._sslobj.do_handshake() 7222s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 7222s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 7222s raise FatalCommClosedError( 7222s ...<2 lines>... 7222s ) from err 7222s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 7222s 7222s During handling of the above exception, another exception occurred: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1218, in _register_with_scheduler 7222s await asyncio.sleep(0.1) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 718, in sleep 7222s return await future 7222s ^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 15s. 7222s 2024-11-23 22:28:33,846 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:28:33,857 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:33,858 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38261/status 7222s 2024-11-23 22:28:33,858 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:28:33,883 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43303 7222s 2024-11-23 22:28:33,883 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43303 7222s 2024-11-23 22:28:33,883 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:28:33,883 - distributed.worker - INFO - dashboard at: 127.0.0.1:36869 7222s 2024-11-23 22:28:33,883 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:33,883 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:28:33,883 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:28:33,884 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:28:33,884 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-f1_f4tgw 7222s 2024-11-23 22:28:33,884 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:28:33,887 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34961 7222s 2024-11-23 22:28:33,887 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34961 7222s 2024-11-23 22:28:33,887 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:28:33,888 - distributed.worker - INFO - dashboard at: 127.0.0.1:41863 7222s 2024-11-23 22:28:33,888 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:33,888 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:28:33,888 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:28:33,888 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:28:33,888 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-iugnaw02 7222s 2024-11-23 22:28:33,888 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:28:33,903 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:33,904 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:33,905 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:58046': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:33,905 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:58052': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:34,020 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:34,020 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:34,021 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:58066': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:34,021 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:58078': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:34,136 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:34,136 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:34,137 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:58080': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:34,137 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:58086': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:34,252 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:34,253 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:34,253 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:58100': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:34,253 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:58110': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:34,368 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:34,368 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:34,373 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:58118': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:34,373 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:58128': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:34,484 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:34,485 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:34,486 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:58134': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:34,486 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:58136': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:34,600 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:34,601 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:34,601 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:58152': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:34,601 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:58164': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:34,716 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:34,716 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:34,717 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:58178': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:34,717 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:58182': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:34,833 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:34,834 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:34,834 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:58196': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:34,835 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:58202': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:34,942 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:34,946 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:58204': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:34,947 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:34,948 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:58212': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:35,050 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:35,051 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:58226': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:35,057 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:35,057 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:58232': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:35,158 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:35,158 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:58240': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:35,165 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:35,165 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:58250': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:35,266 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:35,267 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:58266': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:35,274 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:35,274 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:58268': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:35,374 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:35,374 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:58272': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:35,381 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:35,381 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:58276': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:35,482 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:35,483 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:58284': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:35,489 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:35,489 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:58298': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:35,589 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:35,590 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:58306': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:35,596 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:35,596 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:58310': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:35,697 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:35,698 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:58326': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:35,704 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:35,705 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:58332': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:35,805 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:35,806 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:58338': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:35,812 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:35,813 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:58354': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:35,914 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:35,915 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:58364': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:35,921 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:35,921 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:58380': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:36,022 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:36,023 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:58384': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:36,029 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:36,029 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:58394': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:36,129 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:36,130 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:58406': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:36,136 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:36,136 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:58410': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:36,244 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:36,245 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:58412': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:36,251 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:36,251 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:58422': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:36,352 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:36,352 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:58426': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:36,358 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:36,359 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:58438': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:36,460 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:36,461 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:58444': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:36,467 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:36,468 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:58460': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:36,568 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:36,569 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:58464': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:36,575 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:36,575 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:58480': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:36,676 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:36,677 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:58486': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:36,683 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:36,683 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:58498': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:36,785 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:36,786 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:58512': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:36,792 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:36,792 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:58526': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:36,893 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:36,894 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:58528': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:36,901 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:36,902 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:58530': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:37,001 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:37,001 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:58536': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:37,009 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:37,009 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:58544': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:37,108 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:37,108 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:58546': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:37,116 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:37,116 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:58554': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:37,216 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:37,216 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:58568': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:37,223 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:37,223 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:58570': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:37,327 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:37,327 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:58580': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:37,333 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:37,334 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:58592': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:37,435 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:37,436 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:58602': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:37,441 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:37,442 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:58610': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:37,542 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:37,543 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:58624': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:37,549 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:37,549 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:58636': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:37,650 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:37,651 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:58646': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:37,657 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:37,657 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:58662': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:37,758 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:37,759 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:58670': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:37,765 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:37,766 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:58680': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:37,869 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:37,870 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:58682': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:37,876 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:37,876 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:58686': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:37,977 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:37,978 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:58698': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:37,984 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:37,985 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:58714': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:38,085 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:38,085 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:58716': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:38,092 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:38,092 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:58724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:38,193 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:38,194 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:58740': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:38,200 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:38,200 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:58752': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:38,301 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:38,302 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:58762': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:38,308 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:38,308 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:58770': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:38,409 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:38,410 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:58778': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:38,416 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:38,417 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:58794': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:38,517 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:38,518 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:58810': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:38,524 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:38,525 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:58824': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:38,626 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:38,627 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:58834': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:38,633 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:38,634 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:58836': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:38,734 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:38,734 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:58852': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:38,741 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:38,741 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:58856': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:38,843 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:38,844 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:58868': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:38,850 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:38,850 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:58870': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:38,951 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:38,952 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:58880': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:38,958 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:38,958 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:58882': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:39,060 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:39,061 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:58898': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:39,067 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:39,068 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:58902': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:39,168 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:39,169 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:58914': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:39,175 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:39,175 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:58918': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:39,276 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:39,277 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:58924': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:39,283 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:39,283 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:58926': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:39,384 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:39,384 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:58942': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:39,390 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:39,391 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:58954': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:39,491 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:39,491 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:58960': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:39,498 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:39,498 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:58966': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:39,600 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:39,601 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:58982': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:39,607 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:39,607 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:58996': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:39,707 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:39,708 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:59004': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:39,714 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:39,715 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:59018': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:39,816 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:39,817 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:59032': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:39,838 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:39,839 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:59038': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:39,923 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:39,924 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:59046': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:39,945 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:39,946 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:59058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:40,030 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:40,031 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:59070': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:40,053 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:40,053 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:59080': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:40,138 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:40,139 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:59090': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:40,161 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:40,161 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:59104': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:40,246 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:40,246 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:59112': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:40,272 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:40,272 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:59122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:40,353 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:40,354 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:59130': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:40,380 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:40,380 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:59146': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:40,461 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:40,462 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:59158': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:40,488 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:40,488 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:59166': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:40,569 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:40,570 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:59168': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:40,596 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:40,596 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:59172': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:40,677 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:40,677 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:59188': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:40,703 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:40,704 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:59204': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:40,785 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:40,786 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:59218': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:40,811 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:40,812 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:59226': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:40,894 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:40,894 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:59240': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:40,920 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:40,921 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:59250': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:41,001 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:41,001 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:59252': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:41,028 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:41,028 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:59258': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:41,109 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:41,109 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:59272': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:41,135 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:41,135 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:59280': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:41,217 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:41,217 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:59284': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:41,243 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:41,243 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:59300': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:41,326 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:41,327 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:59308': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:41,351 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:41,351 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:59324': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:41,434 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:41,435 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:59336': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:41,459 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:41,459 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:59340': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:41,543 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:41,543 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:44972': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:41,575 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:41,577 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:44978': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:41,651 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:41,651 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:44980': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:41,683 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:41,684 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:44988': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:41,758 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:41,759 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:45002': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:41,790 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:41,791 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:45012': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:41,868 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:41,869 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:45020': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:41,898 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:41,899 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:45022': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:41,978 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:41,978 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:45024': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:42,006 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:42,007 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:45032': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:42,086 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:42,086 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:45034': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:42,114 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:42,114 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:45042': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:42,193 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:42,193 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:45058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:42,221 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:42,222 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:45064': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:42,300 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:42,301 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:45068': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:42,329 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:42,329 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:45076': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:42,408 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:42,408 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:45086': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:42,437 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:42,438 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:45096': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:42,515 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:42,516 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:45098': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:42,544 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:42,545 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:45106': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:42,624 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:42,624 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:45120': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:42,652 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:42,653 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:45124': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:42,731 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:42,732 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:45126': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:42,759 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:42,760 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:45136': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:42,839 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:42,839 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:45148': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:42,869 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:42,869 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:45156': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:42,946 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:42,946 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:45164': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:42,977 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:42,978 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:45172': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:43,053 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:43,054 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:45182': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:43,085 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:43,085 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:45192': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:43,161 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:43,161 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:45204': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:43,192 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:43,193 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:45210': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:43,268 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:43,268 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:45220': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:43,299 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:43,299 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:45226': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:43,376 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:43,376 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:45230': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:43,407 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:43,407 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:45236': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:43,483 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:43,483 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:45240': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:43,515 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:43,515 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:45246': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:43,592 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:43,592 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:45254': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:43,622 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:43,622 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:45260': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:43,700 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:43,700 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:45264': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:43,730 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:43,731 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:45268': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:43,808 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:43,808 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:45272': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:43,838 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:43,838 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:45282': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:43,918 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:43,919 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:45290': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:43,948 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:43,949 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:45294': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:44,031 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:44,032 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:45298': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:44,062 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:44,063 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:45302': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:44,139 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:44,139 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:45318': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:44,169 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:44,170 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:45332': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:44,246 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:44,247 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:45338': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:44,277 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:44,277 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:45348': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:44,355 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:44,356 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:45360': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:44,384 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:44,384 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:45364': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:44,463 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:44,464 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:45372': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:44,491 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:44,492 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:45374': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:44,571 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:44,571 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:45376': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:44,599 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:44,600 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:45384': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:44,678 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:44,679 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:45392': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:44,707 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:44,707 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:45398': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:44,786 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:44,786 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:45404': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:44,814 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:44,815 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:45408': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:44,893 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:44,894 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:45420': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:44,922 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:44,922 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:45422': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:45,001 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:45,001 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:45436': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:45,030 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:45,030 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:45442': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:45,110 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:45,110 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:45446': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:45,138 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:45,138 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:45452': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:45,217 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:45,218 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:45456': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:45,246 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:45,246 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:45466': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:45,326 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:45,326 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:45480': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:45,353 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:45,354 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:45492': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:45,434 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:45,434 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:45498': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:45,461 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:45,462 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:45502': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:45,542 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:45,543 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:45514': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:45,569 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:45,570 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:45530': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:45,651 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:45,651 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:45544': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:45,677 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:45,678 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:45558': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:45,758 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:45,758 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:45568': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:45,785 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:45,786 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:45572': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:45,869 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:45,869 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:45580': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:45,893 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:45,893 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:45594': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:45,976 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:45,977 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:45610': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:46,000 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:46,001 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:45622': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:46,084 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:46,085 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:45636': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:46,107 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:46,108 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:45642': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:46,193 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:46,193 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:45658': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:46,215 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:46,215 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:45674': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:46,300 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:46,301 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:45684': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:46,326 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:46,327 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:45698': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:46,408 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:46,409 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:45704': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:46,434 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:46,434 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:45716': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:46,516 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:46,517 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:45730': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:46,543 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:46,543 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:45744': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:46,623 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:46,624 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:45746': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:46,651 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:46,651 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:45760': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:46,731 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:46,731 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:45774': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:46,758 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:46,759 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:45782': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:46,838 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:46,839 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:45796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:46,870 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34237 7222s 2024-11-23 22:28:46,871 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34237': TLS handshake failed with remote 'tls://127.0.0.1:45804': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:28:46,881 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43303. Reason: failure-to-start- 7222s 2024-11-23 22:28:46,881 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:28:46,894 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 13s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 7222s stream = await stream.start_tls( 7222s ^^^^^^^^^^^^^^^^^^^^^^^ 7222s False, ssl_options=ssl_options, server_hostname=host 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 7222s self.socket.do_handshake() 7222s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 7222s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 7222s self._sslobj.do_handshake() 7222s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 7222s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 7222s raise FatalCommClosedError( 7222s ...<2 lines>... 7222s ) from err 7222s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 7222s 7222s During handling of the above exception, another exception occurred: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1218, in _register_with_scheduler 7222s await asyncio.sleep(0.1) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 718, in sleep 7222s return await future 7222s ^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 13s. 7222s 2024-11-23 22:28:46,899 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34961. Reason: failure-to-start- 7222s 2024-11-23 22:28:46,899 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:28:47,904 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:28:47,912 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42863 7222s 2024-11-23 22:28:47,913 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37621/status 7222s 2024-11-23 22:28:47,913 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:28:47,928 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37671 7222s 2024-11-23 22:28:47,928 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37671 7222s 2024-11-23 22:28:47,928 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:28:47,928 - distributed.worker - INFO - dashboard at: 127.0.0.1:40405 7222s 2024-11-23 22:28:47,928 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42863 7222s 2024-11-23 22:28:47,928 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:28:47,928 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:28:47,928 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:28:47,928 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-6zej1oad 7222s 2024-11-23 22:28:47,928 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:28:47,931 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44803 7222s 2024-11-23 22:28:47,931 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44803 7222s 2024-11-23 22:28:47,931 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:28:47,931 - distributed.worker - INFO - dashboard at: 127.0.0.1:34139 7222s 2024-11-23 22:28:47,931 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42863 7222s 2024-11-23 22:28:47,931 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:28:47,931 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:28:47,931 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:28:47,931 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-iwfkbi6n 7222s 2024-11-23 22:28:47,931 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:28:47,933 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37671. Reason: failure-to-start- 7222s 2024-11-23 22:28:47,933 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:28:47,933 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44803. Reason: failure-to-start- 7222s 2024-11-23 22:28:47,933 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:28:47,934 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42863': TLS handshake failed with remote 'tls://127.0.0.1:52774': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:28:47,935 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42863': TLS handshake failed with remote 'tls://127.0.0.1:52778': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:28:47,937 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s 2024-11-23 22:28:48,943 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:28:48,950 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44567 7222s 2024-11-23 22:28:48,951 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44905/status 7222s 2024-11-23 22:28:48,951 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:28:48,967 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37417 7222s 2024-11-23 22:28:48,967 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37417 7222s 2024-11-23 22:28:48,967 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:28:48,967 - distributed.worker - INFO - dashboard at: 127.0.0.1:42451 7222s 2024-11-23 22:28:48,967 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44567 7222s 2024-11-23 22:28:48,967 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:28:48,968 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:28:48,968 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:28:48,968 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-2n5a0d3q 7222s 2024-11-23 22:28:48,968 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:28:48,970 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44067 7222s 2024-11-23 22:28:48,970 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44067 7222s 2024-11-23 22:28:48,970 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:28:48,970 - distributed.worker - INFO - dashboard at: 127.0.0.1:35577 7222s 2024-11-23 22:28:48,970 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44567 7222s 2024-11-23 22:28:48,970 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:28:48,970 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:28:48,970 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:28:48,970 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-8x9ek80s 7222s 2024-11-23 22:28:48,971 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:28:48,972 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37417. Reason: failure-to-start- 7222s 2024-11-23 22:28:48,972 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:28:48,972 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44067. Reason: failure-to-start- 7222s 2024-11-23 22:28:48,973 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:28:48,974 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44567': TLS handshake failed with remote 'tls://127.0.0.1:36832': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:28:48,974 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44567': TLS handshake failed with remote 'tls://127.0.0.1:36844': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:28:48,975 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s 2024-11-23 22:28:49,982 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:28:49,989 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36407 7222s 2024-11-23 22:28:49,990 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45527/status 7222s 2024-11-23 22:28:49,990 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:28:50,006 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41753 7222s 2024-11-23 22:28:50,006 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41753 7222s 2024-11-23 22:28:50,006 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:28:50,006 - distributed.worker - INFO - dashboard at: 127.0.0.1:41487 7222s 2024-11-23 22:28:50,006 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36407 7222s 2024-11-23 22:28:50,006 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:28:50,007 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:28:50,007 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:28:50,007 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-hdg997cr 7222s 2024-11-23 22:28:50,007 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:28:50,009 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35499 7222s 2024-11-23 22:28:50,009 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35499 7222s 2024-11-23 22:28:50,009 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:28:50,009 - distributed.worker - INFO - dashboard at: 127.0.0.1:35581 7222s 2024-11-23 22:28:50,009 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36407 7222s 2024-11-23 22:28:50,009 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:28:50,009 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:28:50,009 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:28:50,009 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ojk010vc 7222s 2024-11-23 22:28:50,010 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:28:50,011 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41753. Reason: failure-to-start- 7222s 2024-11-23 22:28:50,011 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:28:50,011 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35499. Reason: failure-to-start- 7222s 2024-11-23 22:28:50,011 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:28:50,012 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36407': TLS handshake failed with remote 'tls://127.0.0.1:32800': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:28:50,013 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36407': TLS handshake failed with remote 'tls://127.0.0.1:32812': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:28:50,014 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s 2024-11-23 22:28:51,020 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:28:51,027 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35309 7222s 2024-11-23 22:28:51,028 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45213/status 7222s 2024-11-23 22:28:51,028 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:28:51,042 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36085 7222s 2024-11-23 22:28:51,042 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36085 7222s 2024-11-23 22:28:51,042 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:28:51,042 - distributed.worker - INFO - dashboard at: 127.0.0.1:40225 7222s 2024-11-23 22:28:51,042 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35309 7222s 2024-11-23 22:28:51,042 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:28:51,042 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:28:51,042 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:28:51,042 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-em190rm0 7222s 2024-11-23 22:28:51,043 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:28:51,045 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40115 7222s 2024-11-23 22:28:51,045 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40115 7222s 2024-11-23 22:28:51,045 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:28:51,045 - distributed.worker - INFO - dashboard at: 127.0.0.1:41605 7222s 2024-11-23 22:28:51,045 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35309 7222s 2024-11-23 22:28:51,045 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:28:51,045 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:28:51,045 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:28:51,045 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-x0apt0yd 7222s 2024-11-23 22:28:51,045 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:28:51,046 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36085. Reason: failure-to-start- 7222s 2024-11-23 22:28:51,047 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:28:51,047 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40115. Reason: failure-to-start- 7222s 2024-11-23 22:28:51,047 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:28:51,048 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35309': TLS handshake failed with remote 'tls://127.0.0.1:52686': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:28:51,048 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35309': TLS handshake failed with remote 'tls://127.0.0.1:52700': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:28:51,050 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s 2024-11-23 22:28:52,056 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:28:52,064 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42307 7222s 2024-11-23 22:28:52,064 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36945/status 7222s 2024-11-23 22:28:52,064 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:28:52,079 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46319 7222s 2024-11-23 22:28:52,079 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46319 7222s 2024-11-23 22:28:52,079 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:28:52,079 - distributed.worker - INFO - dashboard at: 127.0.0.1:40215 7222s 2024-11-23 22:28:52,079 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42307 7222s 2024-11-23 22:28:52,079 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:28:52,079 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:28:52,079 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:28:52,080 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ogxh_bv9 7222s 2024-11-23 22:28:52,080 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:28:52,082 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37223 7222s 2024-11-23 22:28:52,082 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37223 7222s 2024-11-23 22:28:52,082 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:28:52,082 - distributed.worker - INFO - dashboard at: 127.0.0.1:39187 7222s 2024-11-23 22:28:52,082 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42307 7222s 2024-11-23 22:28:52,082 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:28:52,082 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:28:52,082 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:28:52,082 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-g10hiaip 7222s 2024-11-23 22:28:52,082 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:28:52,083 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46319. Reason: failure-to-start- 7222s 2024-11-23 22:28:52,084 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:28:52,084 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37223. Reason: failure-to-start- 7222s 2024-11-23 22:28:52,084 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:28:52,085 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42307': TLS handshake failed with remote 'tls://127.0.0.1:37722': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:28:52,086 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42307': TLS handshake failed with remote 'tls://127.0.0.1:37726': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:28:52,087 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s 2024-11-23 22:28:53,092 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:28:53,100 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43667 7222s 2024-11-23 22:28:53,100 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45933/status 7222s 2024-11-23 22:28:53,100 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:28:53,115 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40655 7222s 2024-11-23 22:28:53,115 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40655 7222s 2024-11-23 22:28:53,115 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:28:53,115 - distributed.worker - INFO - dashboard at: 127.0.0.1:36199 7222s 2024-11-23 22:28:53,115 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43667 7222s 2024-11-23 22:28:53,115 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:28:53,115 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:28:53,115 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:28:53,115 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-cf496315 7222s 2024-11-23 22:28:53,116 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:28:53,118 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36805 7222s 2024-11-23 22:28:53,118 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36805 7222s 2024-11-23 22:28:53,118 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:28:53,118 - distributed.worker - INFO - dashboard at: 127.0.0.1:34027 7222s 2024-11-23 22:28:53,118 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43667 7222s 2024-11-23 22:28:53,118 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:28:53,118 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:28:53,118 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:28:53,118 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-8zxu2m5s 7222s 2024-11-23 22:28:53,118 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:28:53,120 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40655. Reason: failure-to-start- 7222s 2024-11-23 22:28:53,120 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:28:53,120 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36805. Reason: failure-to-start- 7222s 2024-11-23 22:28:53,120 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:28:53,122 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43667': TLS handshake failed with remote 'tls://127.0.0.1:59680': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:28:53,122 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43667': TLS handshake failed with remote 'tls://127.0.0.1:59692': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:28:53,123 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s 2024-11-23 22:28:54,129 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:28:54,135 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45663 7222s 2024-11-23 22:28:54,136 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34809/status 7222s 2024-11-23 22:28:54,136 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:28:54,149 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37219 7222s 2024-11-23 22:28:54,149 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37219 7222s 2024-11-23 22:28:54,149 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:28:54,149 - distributed.worker - INFO - dashboard at: 127.0.0.1:41529 7222s 2024-11-23 22:28:54,149 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45663 7222s 2024-11-23 22:28:54,149 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:28:54,149 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:28:54,149 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:28:54,149 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-0fvbb0ea 7222s 2024-11-23 22:28:54,149 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:28:54,152 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38239 7222s 2024-11-23 22:28:54,152 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38239 7222s 2024-11-23 22:28:54,153 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:28:54,153 - distributed.worker - INFO - dashboard at: 127.0.0.1:40295 7222s 2024-11-23 22:28:54,153 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45663 7222s 2024-11-23 22:28:54,153 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:28:54,153 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:28:54,153 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:28:54,153 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-quqosc5q 7222s 2024-11-23 22:28:54,153 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:28:54,154 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37219. Reason: failure-to-start- 7222s 2024-11-23 22:28:54,154 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:28:54,154 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38239. Reason: failure-to-start- 7222s 2024-11-23 22:28:54,155 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:28:54,156 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45663': TLS handshake failed with remote 'tls://127.0.0.1:45768': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:28:54,156 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45663': TLS handshake failed with remote 'tls://127.0.0.1:45776': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:28:54,157 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s 2024-11-23 22:28:55,163 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:28:55,170 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34445 7222s 2024-11-23 22:28:55,171 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42081/status 7222s 2024-11-23 22:28:55,171 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:28:55,184 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38181 7222s 2024-11-23 22:28:55,184 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38181 7222s 2024-11-23 22:28:55,185 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:28:55,185 - distributed.worker - INFO - dashboard at: 127.0.0.1:46229 7222s 2024-11-23 22:28:55,185 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34445 7222s 2024-11-23 22:28:55,185 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:28:55,185 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:28:55,185 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:28:55,185 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ynvs630n 7222s 2024-11-23 22:28:55,185 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:28:55,187 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39479 7222s 2024-11-23 22:28:55,187 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39479 7222s 2024-11-23 22:28:55,187 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:28:55,187 - distributed.worker - INFO - dashboard at: 127.0.0.1:42563 7222s 2024-11-23 22:28:55,187 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34445 7222s 2024-11-23 22:28:55,187 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:28:55,187 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:28:55,188 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:28:55,188 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-mja2_sb_ 7222s 2024-11-23 22:28:55,188 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:28:55,189 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38181. Reason: failure-to-start- 7222s 2024-11-23 22:28:55,189 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:28:55,189 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39479. Reason: failure-to-start- 7222s 2024-11-23 22:28:55,190 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:28:55,191 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34445': TLS handshake failed with remote 'tls://127.0.0.1:33552': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:28:55,191 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34445': TLS handshake failed with remote 'tls://127.0.0.1:33566': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:28:55,192 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s 2024-11-23 22:28:56,198 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:28:56,207 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44581 7222s 2024-11-23 22:28:56,207 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44969/status 7222s 2024-11-23 22:28:56,208 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:28:56,221 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33731 7222s 2024-11-23 22:28:56,222 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33731 7222s 2024-11-23 22:28:56,222 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:28:56,222 - distributed.worker - INFO - dashboard at: 127.0.0.1:36707 7222s 2024-11-23 22:28:56,222 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44581 7222s 2024-11-23 22:28:56,222 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:28:56,222 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:28:56,222 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:28:56,222 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-bhyjhxfm 7222s 2024-11-23 22:28:56,222 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:28:56,224 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42217 7222s 2024-11-23 22:28:56,224 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42217 7222s 2024-11-23 22:28:56,224 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:28:56,225 - distributed.worker - INFO - dashboard at: 127.0.0.1:37571 7222s 2024-11-23 22:28:56,225 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44581 7222s 2024-11-23 22:28:56,225 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:28:56,225 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:28:56,225 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:28:56,225 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-weqv5dl6 7222s 2024-11-23 22:28:56,225 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:28:56,226 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33731. Reason: failure-to-start- 7222s 2024-11-23 22:28:56,226 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:28:56,227 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42217. Reason: failure-to-start- 7222s 2024-11-23 22:28:56,227 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:28:56,228 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44581': TLS handshake failed with remote 'tls://127.0.0.1:37430': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:28:56,228 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44581': TLS handshake failed with remote 'tls://127.0.0.1:37438': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:28:56,230 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s 2024-11-23 22:28:57,235 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:28:57,243 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45615 7222s 2024-11-23 22:28:57,243 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45247/status 7222s 2024-11-23 22:28:57,243 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:28:57,259 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39251 7222s 2024-11-23 22:28:57,259 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39251 7222s 2024-11-23 22:28:57,259 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:28:57,260 - distributed.worker - INFO - dashboard at: 127.0.0.1:43847 7222s 2024-11-23 22:28:57,260 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45615 7222s 2024-11-23 22:28:57,260 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:28:57,260 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:28:57,260 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:28:57,260 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-arqggd3d 7222s 2024-11-23 22:28:57,260 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:28:57,262 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34419 7222s 2024-11-23 22:28:57,262 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34419 7222s 2024-11-23 22:28:57,262 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:28:57,262 - distributed.worker - INFO - dashboard at: 127.0.0.1:38239 7222s 2024-11-23 22:28:57,262 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45615 7222s 2024-11-23 22:28:57,262 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:28:57,263 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:28:57,263 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:28:57,263 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-epne3ua7 7222s 2024-11-23 22:28:57,263 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:28:57,264 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39251. Reason: failure-to-start- 7222s 2024-11-23 22:28:57,264 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:28:57,264 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34419. Reason: failure-to-start- 7222s 2024-11-23 22:28:57,265 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:28:57,266 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45615': TLS handshake failed with remote 'tls://127.0.0.1:44808': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:28:57,266 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45615': TLS handshake failed with remote 'tls://127.0.0.1:44810': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:28:57,268 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s 2024-11-23 22:28:58,274 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:28:58,282 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41971 7222s 2024-11-23 22:28:58,282 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37563/status 7222s 2024-11-23 22:28:58,283 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:28:58,298 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44009 7222s 2024-11-23 22:28:58,298 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44009 7222s 2024-11-23 22:28:58,298 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:28:58,298 - distributed.worker - INFO - dashboard at: 127.0.0.1:35457 7222s 2024-11-23 22:28:58,298 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41971 7222s 2024-11-23 22:28:58,298 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:28:58,298 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:28:58,299 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:28:58,299 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-1yazsbhf 7222s 2024-11-23 22:28:58,299 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:28:58,309 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33539 7222s 2024-11-23 22:28:58,309 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33539 7222s 2024-11-23 22:28:58,309 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:28:58,309 - distributed.worker - INFO - dashboard at: 127.0.0.1:38695 7222s 2024-11-23 22:28:58,309 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41971 7222s 2024-11-23 22:28:58,309 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:28:58,309 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:28:58,309 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:28:58,309 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-szs9j6sx 7222s 2024-11-23 22:28:58,309 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:28:58,311 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44009. Reason: failure-to-start- 7222s 2024-11-23 22:28:58,311 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:28:58,311 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33539. Reason: failure-to-start- 7222s 2024-11-23 22:28:58,311 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:28:58,313 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41971': TLS handshake failed with remote 'tls://127.0.0.1:51396': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:28:58,313 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41971': TLS handshake failed with remote 'tls://127.0.0.1:51402': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:28:58,315 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s 2024-11-23 22:28:59,321 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:28:59,329 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45083 7222s 2024-11-23 22:28:59,329 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38577/status 7222s 2024-11-23 22:28:59,330 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:28:59,344 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35303 7222s 2024-11-23 22:28:59,345 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35303 7222s 2024-11-23 22:28:59,345 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:28:59,345 - distributed.worker - INFO - dashboard at: 127.0.0.1:42515 7222s 2024-11-23 22:28:59,345 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45083 7222s 2024-11-23 22:28:59,345 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:28:59,345 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:28:59,345 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:28:59,345 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-2938dyzi 7222s 2024-11-23 22:28:59,345 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:28:59,347 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34131 7222s 2024-11-23 22:28:59,347 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34131 7222s 2024-11-23 22:28:59,348 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:28:59,348 - distributed.worker - INFO - dashboard at: 127.0.0.1:35901 7222s 2024-11-23 22:28:59,348 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45083 7222s 2024-11-23 22:28:59,348 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:28:59,348 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:28:59,348 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:28:59,348 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-wxhggim6 7222s 2024-11-23 22:28:59,348 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:28:59,349 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35303. Reason: failure-to-start- 7222s 2024-11-23 22:28:59,349 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:28:59,350 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34131. Reason: failure-to-start- 7222s 2024-11-23 22:28:59,350 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:28:59,351 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45083': TLS handshake failed with remote 'tls://127.0.0.1:55262': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:28:59,351 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45083': TLS handshake failed with remote 'tls://127.0.0.1:55274': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:28:59,353 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s 2024-11-23 22:29:00,359 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:29:00,367 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37787 7222s 2024-11-23 22:29:00,367 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42299/status 7222s 2024-11-23 22:29:00,367 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:29:00,385 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:32771 7222s 2024-11-23 22:29:00,386 - distributed.worker - INFO - Listening to: tls://127.0.0.1:32771 7222s 2024-11-23 22:29:00,386 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:29:00,386 - distributed.worker - INFO - dashboard at: 127.0.0.1:34991 7222s 2024-11-23 22:29:00,386 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37787 7222s 2024-11-23 22:29:00,386 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:29:00,386 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:29:00,386 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:29:00,386 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-pk96pfsf 7222s 2024-11-23 22:29:00,386 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:29:00,388 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40725 7222s 2024-11-23 22:29:00,389 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40725 7222s 2024-11-23 22:29:00,389 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:29:00,389 - distributed.worker - INFO - dashboard at: 127.0.0.1:43913 7222s 2024-11-23 22:29:00,389 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37787 7222s 2024-11-23 22:29:00,389 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:29:00,389 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:29:00,389 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:29:00,389 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-2ab95mo1 7222s 2024-11-23 22:29:00,389 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:29:00,390 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:32771. Reason: failure-to-start- 7222s 2024-11-23 22:29:00,390 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:29:00,391 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40725. Reason: failure-to-start- 7222s 2024-11-23 22:29:00,391 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:29:00,392 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37787': TLS handshake failed with remote 'tls://127.0.0.1:54744': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:29:00,392 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37787': TLS handshake failed with remote 'tls://127.0.0.1:54754': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:29:00,394 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s 2024-11-23 22:29:01,399 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:29:01,407 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40039 7222s 2024-11-23 22:29:01,408 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40103/status 7222s 2024-11-23 22:29:01,408 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:29:01,424 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46799 7222s 2024-11-23 22:29:01,424 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46799 7222s 2024-11-23 22:29:01,424 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:29:01,425 - distributed.worker - INFO - dashboard at: 127.0.0.1:37359 7222s 2024-11-23 22:29:01,425 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40039 7222s 2024-11-23 22:29:01,425 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:29:01,425 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:29:01,425 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:29:01,425 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-f7tgnab4 7222s 2024-11-23 22:29:01,425 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:29:01,427 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35253 7222s 2024-11-23 22:29:01,427 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35253 7222s 2024-11-23 22:29:01,427 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:29:01,428 - distributed.worker - INFO - dashboard at: 127.0.0.1:38865 7222s 2024-11-23 22:29:01,428 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40039 7222s 2024-11-23 22:29:01,428 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:29:01,428 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:29:01,428 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:29:01,428 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-20mogykt 7222s 2024-11-23 22:29:01,428 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:29:01,431 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46799. Reason: failure-to-start- 7222s 2024-11-23 22:29:01,431 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:29:01,432 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35253. Reason: failure-to-start- 7222s 2024-11-23 22:29:01,432 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:29:01,433 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40039': TLS handshake failed with remote 'tls://127.0.0.1:42786': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:29:01,434 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40039': TLS handshake failed with remote 'tls://127.0.0.1:42794': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:29:01,435 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s 2024-11-23 22:29:02,441 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:29:02,448 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35687 7222s 2024-11-23 22:29:02,449 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46693/status 7222s 2024-11-23 22:29:02,449 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:29:02,462 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44331 7222s 2024-11-23 22:29:02,462 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44331 7222s 2024-11-23 22:29:02,462 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:29:02,462 - distributed.worker - INFO - dashboard at: 127.0.0.1:39699 7222s 2024-11-23 22:29:02,462 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35687 7222s 2024-11-23 22:29:02,462 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:29:02,462 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:29:02,463 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:29:02,463 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-hdg5nw1i 7222s 2024-11-23 22:29:02,463 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:29:02,465 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43725 7222s 2024-11-23 22:29:02,465 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43725 7222s 2024-11-23 22:29:02,465 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:29:02,465 - distributed.worker - INFO - dashboard at: 127.0.0.1:37931 7222s 2024-11-23 22:29:02,465 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35687 7222s 2024-11-23 22:29:02,465 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:29:02,465 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:29:02,465 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:29:02,465 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-x7na056f 7222s 2024-11-23 22:29:02,465 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:29:02,469 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44331. Reason: failure-to-start- 7222s 2024-11-23 22:29:02,469 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:29:02,470 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43725. Reason: failure-to-start- 7222s 2024-11-23 22:29:02,470 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:29:02,471 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35687': TLS handshake failed with remote 'tls://127.0.0.1:52408': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:29:02,471 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35687': TLS handshake failed with remote 'tls://127.0.0.1:52420': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:29:02,473 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s 2024-11-23 22:29:03,478 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:29:03,485 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38329 7222s 2024-11-23 22:29:03,485 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40773/status 7222s 2024-11-23 22:29:03,486 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:29:03,500 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34897 7222s 2024-11-23 22:29:03,500 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34897 7222s 2024-11-23 22:29:03,500 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:29:03,500 - distributed.worker - INFO - dashboard at: 127.0.0.1:32973 7222s 2024-11-23 22:29:03,500 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38329 7222s 2024-11-23 22:29:03,500 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:29:03,500 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:29:03,500 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:29:03,501 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-qnwnzmpt 7222s 2024-11-23 22:29:03,501 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:29:03,503 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45733 7222s 2024-11-23 22:29:03,503 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45733 7222s 2024-11-23 22:29:03,503 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:29:03,503 - distributed.worker - INFO - dashboard at: 127.0.0.1:44341 7222s 2024-11-23 22:29:03,503 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38329 7222s 2024-11-23 22:29:03,503 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:29:03,503 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:29:03,503 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:29:03,503 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-r45bf5dq 7222s 2024-11-23 22:29:03,503 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:29:03,507 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34897. Reason: failure-to-start- 7222s 2024-11-23 22:29:03,507 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:29:03,508 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45733. Reason: failure-to-start- 7222s 2024-11-23 22:29:03,508 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:29:03,509 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38329': TLS handshake failed with remote 'tls://127.0.0.1:41908': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:29:03,509 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38329': TLS handshake failed with remote 'tls://127.0.0.1:41910': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:29:03,511 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s 2024-11-23 22:29:04,516 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:29:04,525 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41255 7222s 2024-11-23 22:29:04,525 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37055/status 7222s 2024-11-23 22:29:04,525 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:29:04,539 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44021 7222s 2024-11-23 22:29:04,539 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44021 7222s 2024-11-23 22:29:04,539 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:29:04,539 - distributed.worker - INFO - dashboard at: 127.0.0.1:34215 7222s 2024-11-23 22:29:04,539 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41255 7222s 2024-11-23 22:29:04,539 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:29:04,540 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:29:04,540 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:29:04,540 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ky_bwekh 7222s 2024-11-23 22:29:04,540 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:29:04,542 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33247 7222s 2024-11-23 22:29:04,542 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33247 7222s 2024-11-23 22:29:04,542 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:29:04,542 - distributed.worker - INFO - dashboard at: 127.0.0.1:35699 7222s 2024-11-23 22:29:04,542 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41255 7222s 2024-11-23 22:29:04,542 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:29:04,542 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:29:04,542 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:29:04,542 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-avizk3n3 7222s 2024-11-23 22:29:04,542 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:29:04,546 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44021. Reason: failure-to-start- 7222s 2024-11-23 22:29:04,546 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:29:04,547 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33247. Reason: failure-to-start- 7222s 2024-11-23 22:29:04,547 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:29:04,548 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41255': TLS handshake failed with remote 'tls://127.0.0.1:57466': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:29:04,548 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41255': TLS handshake failed with remote 'tls://127.0.0.1:57468': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:29:04,550 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s 2024-11-23 22:29:05,555 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:29:05,562 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35397 7222s 2024-11-23 22:29:05,562 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35429/status 7222s 2024-11-23 22:29:05,562 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:29:05,577 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40001 7222s 2024-11-23 22:29:05,578 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40001 7222s 2024-11-23 22:29:05,578 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:29:05,578 - distributed.worker - INFO - dashboard at: 127.0.0.1:34023 7222s 2024-11-23 22:29:05,578 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35397 7222s 2024-11-23 22:29:05,578 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:29:05,578 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:29:05,578 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:29:05,578 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-zy2q2x0a 7222s 2024-11-23 22:29:05,578 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:29:05,580 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41739 7222s 2024-11-23 22:29:05,580 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41739 7222s 2024-11-23 22:29:05,580 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:29:05,580 - distributed.worker - INFO - dashboard at: 127.0.0.1:46323 7222s 2024-11-23 22:29:05,580 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35397 7222s 2024-11-23 22:29:05,581 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:29:05,581 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:29:05,581 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:29:05,581 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-utzq78xw 7222s 2024-11-23 22:29:05,581 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:29:05,584 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40001. Reason: failure-to-start- 7222s 2024-11-23 22:29:05,584 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:29:05,585 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41739. Reason: failure-to-start- 7222s 2024-11-23 22:29:05,585 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:29:05,586 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35397': TLS handshake failed with remote 'tls://127.0.0.1:50088': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:29:05,587 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35397': TLS handshake failed with remote 'tls://127.0.0.1:50092': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:29:05,588 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s 2024-11-23 22:29:06,594 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:29:06,601 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36035 7222s 2024-11-23 22:29:06,601 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37547/status 7222s 2024-11-23 22:29:06,602 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:29:06,618 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43489 7222s 2024-11-23 22:29:06,618 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43489 7222s 2024-11-23 22:29:06,618 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:29:06,618 - distributed.worker - INFO - dashboard at: 127.0.0.1:36569 7222s 2024-11-23 22:29:06,618 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36035 7222s 2024-11-23 22:29:06,619 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:29:06,619 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:29:06,619 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:29:06,619 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-t30mlx1x 7222s 2024-11-23 22:29:06,619 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:29:06,621 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42763 7222s 2024-11-23 22:29:06,621 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42763 7222s 2024-11-23 22:29:06,621 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:29:06,621 - distributed.worker - INFO - dashboard at: 127.0.0.1:40759 7222s 2024-11-23 22:29:06,621 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36035 7222s 2024-11-23 22:29:06,621 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:29:06,621 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:29:06,621 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:29:06,621 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-mkxkwz30 7222s 2024-11-23 22:29:06,622 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:29:06,624 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43489. Reason: failure-to-start- 7222s 2024-11-23 22:29:06,624 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:29:06,624 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42763. Reason: failure-to-start- 7222s 2024-11-23 22:29:06,625 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:29:06,626 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36035': TLS handshake failed with remote 'tls://127.0.0.1:47530': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:29:06,626 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36035': TLS handshake failed with remote 'tls://127.0.0.1:47534': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:29:06,627 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s 2024-11-23 22:29:07,634 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:29:07,641 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46607 7222s 2024-11-23 22:29:07,642 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40029/status 7222s 2024-11-23 22:29:07,642 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:29:07,658 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36901 7222s 2024-11-23 22:29:07,658 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36901 7222s 2024-11-23 22:29:07,658 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:29:07,658 - distributed.worker - INFO - dashboard at: 127.0.0.1:37629 7222s 2024-11-23 22:29:07,658 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46607 7222s 2024-11-23 22:29:07,658 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:29:07,658 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:29:07,658 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:29:07,658 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-22iakxv0 7222s 2024-11-23 22:29:07,658 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:29:07,661 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36589 7222s 2024-11-23 22:29:07,661 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36589 7222s 2024-11-23 22:29:07,661 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:29:07,661 - distributed.worker - INFO - dashboard at: 127.0.0.1:37869 7222s 2024-11-23 22:29:07,661 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46607 7222s 2024-11-23 22:29:07,661 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:29:07,661 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:29:07,661 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:29:07,661 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-_smh_78q 7222s 2024-11-23 22:29:07,661 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:29:07,663 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36901. Reason: failure-to-start- 7222s 2024-11-23 22:29:07,663 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:29:07,663 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36589. Reason: failure-to-start- 7222s 2024-11-23 22:29:07,663 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:29:07,665 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46607': TLS handshake failed with remote 'tls://127.0.0.1:40244': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:29:07,665 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46607': TLS handshake failed with remote 'tls://127.0.0.1:40246': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:29:07,667 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s 2024-11-23 22:29:08,673 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:29:08,680 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37223 7222s 2024-11-23 22:29:08,680 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38879/status 7222s 2024-11-23 22:29:08,681 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:29:08,696 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38863 7222s 2024-11-23 22:29:08,696 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38863 7222s 2024-11-23 22:29:08,696 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:29:08,696 - distributed.worker - INFO - dashboard at: 127.0.0.1:42321 7222s 2024-11-23 22:29:08,696 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37223 7222s 2024-11-23 22:29:08,696 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:29:08,696 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:29:08,696 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:29:08,696 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-kcnrjadq 7222s 2024-11-23 22:29:08,697 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:29:08,698 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39165 7222s 2024-11-23 22:29:08,699 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39165 7222s 2024-11-23 22:29:08,699 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:29:08,699 - distributed.worker - INFO - dashboard at: 127.0.0.1:35605 7222s 2024-11-23 22:29:08,699 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37223 7222s 2024-11-23 22:29:08,699 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:29:08,699 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:29:08,699 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:29:08,699 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-pa97g2rn 7222s 2024-11-23 22:29:08,699 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:29:08,700 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38863. Reason: failure-to-start- 7222s 2024-11-23 22:29:08,700 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:29:08,701 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39165. Reason: failure-to-start- 7222s 2024-11-23 22:29:08,701 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:29:08,702 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37223': TLS handshake failed with remote 'tls://127.0.0.1:43062': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:29:08,702 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37223': TLS handshake failed with remote 'tls://127.0.0.1:43076': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:29:08,704 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s 2024-11-23 22:29:09,709 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:29:09,716 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37345 7222s 2024-11-23 22:29:09,717 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43063/status 7222s 2024-11-23 22:29:09,717 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:29:09,735 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39045 7222s 2024-11-23 22:29:09,735 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39045 7222s 2024-11-23 22:29:09,735 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:29:09,735 - distributed.worker - INFO - dashboard at: 127.0.0.1:35827 7222s 2024-11-23 22:29:09,735 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37345 7222s 2024-11-23 22:29:09,735 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:29:09,736 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:29:09,736 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:29:09,736 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-7km55g0f 7222s 2024-11-23 22:29:09,736 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:29:09,738 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34133 7222s 2024-11-23 22:29:09,738 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34133 7222s 2024-11-23 22:29:09,738 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:29:09,738 - distributed.worker - INFO - dashboard at: 127.0.0.1:33967 7222s 2024-11-23 22:29:09,738 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37345 7222s 2024-11-23 22:29:09,738 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:29:09,738 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:29:09,738 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:29:09,738 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-cqfp6006 7222s 2024-11-23 22:29:09,739 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:29:09,740 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39045. Reason: failure-to-start- 7222s 2024-11-23 22:29:09,740 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:29:09,740 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34133. Reason: failure-to-start- 7222s 2024-11-23 22:29:09,741 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:29:09,742 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37345': TLS handshake failed with remote 'tls://127.0.0.1:41144': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:29:09,742 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37345': TLS handshake failed with remote 'tls://127.0.0.1:41146': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:29:09,744 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s 2024-11-23 22:29:10,751 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:29:10,759 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44901 7222s 2024-11-23 22:29:10,759 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33163/status 7222s 2024-11-23 22:29:10,760 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:29:10,773 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40437 7222s 2024-11-23 22:29:10,774 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40437 7222s 2024-11-23 22:29:10,774 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:29:10,774 - distributed.worker - INFO - dashboard at: 127.0.0.1:46231 7222s 2024-11-23 22:29:10,774 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44901 7222s 2024-11-23 22:29:10,774 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:29:10,774 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:29:10,774 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:29:10,774 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-z6zrn1_g 7222s 2024-11-23 22:29:10,774 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:29:10,777 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39423 7222s 2024-11-23 22:29:10,777 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39423 7222s 2024-11-23 22:29:10,777 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:29:10,777 - distributed.worker - INFO - dashboard at: 127.0.0.1:34271 7222s 2024-11-23 22:29:10,778 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44901 7222s 2024-11-23 22:29:10,778 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:29:10,778 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:29:10,778 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:29:10,778 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-1og919t4 7222s 2024-11-23 22:29:10,778 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:29:10,779 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40437. Reason: failure-to-start- 7222s 2024-11-23 22:29:10,779 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:29:10,780 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39423. Reason: failure-to-start- 7222s 2024-11-23 22:29:10,780 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:29:10,781 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44901': TLS handshake failed with remote 'tls://127.0.0.1:57878': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:29:10,782 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44901': TLS handshake failed with remote 'tls://127.0.0.1:57890': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:29:10,783 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s 2024-11-23 22:29:11,789 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:29:11,796 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41521 7222s 2024-11-23 22:29:11,797 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45143/status 7222s 2024-11-23 22:29:11,797 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:29:11,812 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41745 7222s 2024-11-23 22:29:11,812 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41745 7222s 2024-11-23 22:29:11,812 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:29:11,812 - distributed.worker - INFO - dashboard at: 127.0.0.1:38799 7222s 2024-11-23 22:29:11,812 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41521 7222s 2024-11-23 22:29:11,812 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:29:11,812 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:29:11,812 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:29:11,812 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-pd86uz4u 7222s 2024-11-23 22:29:11,812 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:29:11,815 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35707 7222s 2024-11-23 22:29:11,815 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35707 7222s 2024-11-23 22:29:11,815 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:29:11,815 - distributed.worker - INFO - dashboard at: 127.0.0.1:40189 7222s 2024-11-23 22:29:11,815 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41521 7222s 2024-11-23 22:29:11,815 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:29:11,815 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:29:11,815 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:29:11,815 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-z0jb0j4c 7222s 2024-11-23 22:29:11,815 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:29:11,818 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41745. Reason: failure-to-start- 7222s 2024-11-23 22:29:11,818 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:29:11,819 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35707. Reason: failure-to-start- 7222s 2024-11-23 22:29:11,819 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:29:11,823 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41521': TLS handshake failed with remote 'tls://127.0.0.1:54314': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:29:11,823 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41521': TLS handshake failed with remote 'tls://127.0.0.1:54316': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:29:11,825 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s 2024-11-23 22:29:12,830 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:29:12,838 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46097 7222s 2024-11-23 22:29:12,839 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38917/status 7222s 2024-11-23 22:29:12,839 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:29:12,856 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43111 7222s 2024-11-23 22:29:12,856 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43111 7222s 2024-11-23 22:29:12,857 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:29:12,857 - distributed.worker - INFO - dashboard at: 127.0.0.1:35617 7222s 2024-11-23 22:29:12,857 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46097 7222s 2024-11-23 22:29:12,857 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:29:12,857 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:29:12,857 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:29:12,857 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ojcqq35r 7222s 2024-11-23 22:29:12,857 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:29:12,859 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45929 7222s 2024-11-23 22:29:12,859 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45929 7222s 2024-11-23 22:29:12,859 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:29:12,860 - distributed.worker - INFO - dashboard at: 127.0.0.1:38405 7222s 2024-11-23 22:29:12,860 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46097 7222s 2024-11-23 22:29:12,860 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:29:12,860 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:29:12,860 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:29:12,860 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-egb5os7w 7222s 2024-11-23 22:29:12,860 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:29:12,862 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43111. Reason: failure-to-start- 7222s 2024-11-23 22:29:12,862 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:29:12,862 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45929. Reason: failure-to-start- 7222s 2024-11-23 22:29:12,862 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:29:12,866 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46097': TLS handshake failed with remote 'tls://127.0.0.1:51480': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:29:12,866 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46097': TLS handshake failed with remote 'tls://127.0.0.1:51484': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:29:12,868 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s 2024-11-23 22:29:13,874 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:29:13,882 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44139 7222s 2024-11-23 22:29:13,883 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43007/status 7222s 2024-11-23 22:29:13,883 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:29:13,900 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43645 7222s 2024-11-23 22:29:13,900 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43645 7222s 2024-11-23 22:29:13,900 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:29:13,900 - distributed.worker - INFO - dashboard at: 127.0.0.1:37903 7222s 2024-11-23 22:29:13,900 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44139 7222s 2024-11-23 22:29:13,900 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:29:13,901 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:29:13,901 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:29:13,901 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-drzlyuwc 7222s 2024-11-23 22:29:13,901 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:29:13,903 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41375 7222s 2024-11-23 22:29:13,903 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41375 7222s 2024-11-23 22:29:13,903 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:29:13,903 - distributed.worker - INFO - dashboard at: 127.0.0.1:34213 7222s 2024-11-23 22:29:13,903 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44139 7222s 2024-11-23 22:29:13,903 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:29:13,903 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:29:13,903 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:29:13,904 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-kuumrv9b 7222s 2024-11-23 22:29:13,904 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:29:13,905 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43645. Reason: failure-to-start- 7222s 2024-11-23 22:29:13,905 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:29:13,906 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41375. Reason: failure-to-start- 7222s 2024-11-23 22:29:13,906 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:29:13,907 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44139': TLS handshake failed with remote 'tls://127.0.0.1:46982': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:29:13,907 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44139': TLS handshake failed with remote 'tls://127.0.0.1:46998': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:29:13,909 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s 2024-11-23 22:29:14,915 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:29:14,922 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45763 7222s 2024-11-23 22:29:14,923 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33509/status 7222s 2024-11-23 22:29:14,923 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:29:14,954 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39395 7222s 2024-11-23 22:29:14,955 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39395 7222s 2024-11-23 22:29:14,955 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:29:14,955 - distributed.worker - INFO - dashboard at: 127.0.0.1:32885 7222s 2024-11-23 22:29:14,955 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45763 7222s 2024-11-23 22:29:14,955 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:29:14,955 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:29:14,955 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:29:14,955 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-cr7h0kt1 7222s 2024-11-23 22:29:14,955 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:29:14,957 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37617 7222s 2024-11-23 22:29:14,958 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37617 7222s 2024-11-23 22:29:14,958 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:29:14,958 - distributed.worker - INFO - dashboard at: 127.0.0.1:35093 7222s 2024-11-23 22:29:14,958 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45763 7222s 2024-11-23 22:29:14,958 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:29:14,958 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:29:14,958 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:29:14,958 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-79n0octl 7222s 2024-11-23 22:29:14,958 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:29:14,962 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39395. Reason: failure-to-start- 7222s 2024-11-23 22:29:14,962 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:29:14,963 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37617. Reason: failure-to-start- 7222s 2024-11-23 22:29:14,963 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:29:14,967 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45763': TLS handshake failed with remote 'tls://127.0.0.1:38914': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:29:14,967 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45763': TLS handshake failed with remote 'tls://127.0.0.1:38916': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:29:14,969 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s 2024-11-23 22:29:15,974 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:29:15,981 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35401 7222s 2024-11-23 22:29:15,982 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36041/status 7222s 2024-11-23 22:29:15,982 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:29:15,997 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:32855 7222s 2024-11-23 22:29:15,997 - distributed.worker - INFO - Listening to: tls://127.0.0.1:32855 7222s 2024-11-23 22:29:15,997 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:29:15,997 - distributed.worker - INFO - dashboard at: 127.0.0.1:38423 7222s 2024-11-23 22:29:15,997 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35401 7222s 2024-11-23 22:29:15,997 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:29:15,997 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:29:15,997 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:29:15,997 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-m2hbwjl_ 7222s 2024-11-23 22:29:15,997 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:29:15,999 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44119 7222s 2024-11-23 22:29:16,000 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44119 7222s 2024-11-23 22:29:16,000 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:29:16,000 - distributed.worker - INFO - dashboard at: 127.0.0.1:46483 7222s 2024-11-23 22:29:16,000 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35401 7222s 2024-11-23 22:29:16,000 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:29:16,000 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:29:16,000 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:29:16,000 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-qy1nd22z 7222s 2024-11-23 22:29:16,000 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:29:16,294 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:32855. Reason: failure-to-start- 7222s 2024-11-23 22:29:16,295 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:29:16,295 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44119. Reason: failure-to-start- 7222s 2024-11-23 22:29:16,295 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:29:16,323 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35401': TLS handshake failed with remote 'tls://127.0.0.1:38328': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:29:16,323 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35401': TLS handshake failed with remote 'tls://127.0.0.1:38336': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:29:16,328 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s 2024-11-23 22:29:17,336 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:29:17,342 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35555 7222s 2024-11-23 22:29:17,343 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45689/status 7222s 2024-11-23 22:29:17,343 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:29:17,359 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33427 7222s 2024-11-23 22:29:17,359 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33427 7222s 2024-11-23 22:29:17,359 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:29:17,359 - distributed.worker - INFO - dashboard at: 127.0.0.1:35187 7222s 2024-11-23 22:29:17,359 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35555 7222s 2024-11-23 22:29:17,359 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:29:17,359 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:29:17,359 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:29:17,359 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-krn2215y 7222s 2024-11-23 22:29:17,359 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:29:17,361 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44845 7222s 2024-11-23 22:29:17,361 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44845 7222s 2024-11-23 22:29:17,361 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:29:17,361 - distributed.worker - INFO - dashboard at: 127.0.0.1:46393 7222s 2024-11-23 22:29:17,361 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35555 7222s 2024-11-23 22:29:17,362 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:29:17,362 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:29:17,362 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:29:17,362 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-l28qr8cd 7222s 2024-11-23 22:29:17,362 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:29:17,363 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33427. Reason: failure-to-start- 7222s 2024-11-23 22:29:17,363 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:29:17,364 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44845. Reason: failure-to-start- 7222s 2024-11-23 22:29:17,364 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:29:17,367 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35555': TLS handshake failed with remote 'tls://127.0.0.1:34768': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:29:17,367 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35555': TLS handshake failed with remote 'tls://127.0.0.1:34770': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:29:17,369 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s _____________________________ test_retire_workers ______________________________ 7222s 7222s fut = , timeout = 0 7222s 7222s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 7222s async with asyncio.timeout(timeout): 7222s > return await fut 7222s 7222s /usr/lib/python3/dist-packages/distributed/utils.py:1960: 7222s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7222s /usr/lib/python3/dist-packages/distributed/nanny.py:358: in start_unsafe 7222s comm = await self.rpc.connect(saddr) 7222s /usr/lib/python3/dist-packages/distributed/core.py:1620: in connect 7222s return await self._connect(addr=addr, timeout=timeout) 7222s /usr/lib/python3/dist-packages/distributed/core.py:1564: in _connect 7222s comm = await connect( 7222s /usr/lib/python3/dist-packages/distributed/comm/core.py:342: in connect 7222s comm = await wait_for( 7222s /usr/lib/python3/dist-packages/distributed/utils.py:1960: in wait_for 7222s return await fut 7222s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:546: in connect 7222s stream = await self.client.connect( 7222s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7222s 7222s self = , host = '127.0.0.1' 7222s port = 38783, af = 7222s ssl_options = 7222s max_buffer_size = 8364507136.0, source_ip = None, source_port = None 7222s timeout = None 7222s 7222s async def connect( 7222s self, 7222s host: str, 7222s port: int, 7222s af: socket.AddressFamily = socket.AF_UNSPEC, 7222s ssl_options: Optional[Union[Dict[str, Any], ssl.SSLContext]] = None, 7222s max_buffer_size: Optional[int] = None, 7222s source_ip: Optional[str] = None, 7222s source_port: Optional[int] = None, 7222s timeout: Optional[Union[float, datetime.timedelta]] = None, 7222s ) -> IOStream: 7222s """Connect to the given host and port. 7222s 7222s Asynchronously returns an `.IOStream` (or `.SSLIOStream` if 7222s ``ssl_options`` is not None). 7222s 7222s Using the ``source_ip`` kwarg, one can specify the source 7222s IP address to use when establishing the connection. 7222s In case the user needs to resolve and 7222s use a specific interface, it has to be handled outside 7222s of Tornado as this depends very much on the platform. 7222s 7222s Raises `TimeoutError` if the input future does not complete before 7222s ``timeout``, which may be specified in any form allowed by 7222s `.IOLoop.add_timeout` (i.e. a `datetime.timedelta` or an absolute time 7222s relative to `.IOLoop.time`) 7222s 7222s Similarly, when the user requires a certain source port, it can 7222s be specified using the ``source_port`` arg. 7222s 7222s .. versionchanged:: 4.5 7222s Added the ``source_ip`` and ``source_port`` arguments. 7222s 7222s .. versionchanged:: 5.0 7222s Added the ``timeout`` argument. 7222s """ 7222s if timeout is not None: 7222s if isinstance(timeout, numbers.Real): 7222s timeout = IOLoop.current().time() + timeout 7222s elif isinstance(timeout, datetime.timedelta): 7222s timeout = IOLoop.current().time() + timeout.total_seconds() 7222s else: 7222s raise TypeError("Unsupported timeout %r" % timeout) 7222s if timeout is not None: 7222s addrinfo = await gen.with_timeout( 7222s timeout, self.resolver.resolve(host, port, af) 7222s ) 7222s else: 7222s addrinfo = await self.resolver.resolve(host, port, af) 7222s connector = _Connector( 7222s addrinfo, 7222s functools.partial( 7222s self._create_stream, 7222s max_buffer_size, 7222s source_ip=source_ip, 7222s source_port=source_port, 7222s ), 7222s ) 7222s > af, addr, stream = await connector.start(connect_timeout=timeout) 7222s E asyncio.exceptions.CancelledError 7222s 7222s /usr/lib/python3/dist-packages/tornado/tcpclient.py:279: CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s self = 7222s 7222s @final 7222s async def start(self): 7222s async with self._startup_lock: 7222s if self.status == Status.failed: 7222s assert self.__startup_exc is not None 7222s raise self.__startup_exc 7222s elif self.status != Status.init: 7222s return self 7222s timeout = getattr(self, "death_timeout", None) 7222s 7222s async def _close_on_failure(exc: Exception) -> None: 7222s await self.close(reason=f"failure-to-start-{str(type(exc))}") 7222s self.status = Status.failed 7222s self.__startup_exc = exc 7222s 7222s try: 7222s > await wait_for(self.start_unsafe(), timeout=timeout) 7222s 7222s /usr/lib/python3/dist-packages/distributed/core.py:664: 7222s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7222s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 7222s async with asyncio.timeout(timeout): 7222s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7222s 7222s self = 7222s exc_type = 7222s exc_val = CancelledError(), exc_tb = 7222s 7222s async def __aexit__( 7222s self, 7222s exc_type: Optional[Type[BaseException]], 7222s exc_val: Optional[BaseException], 7222s exc_tb: Optional[TracebackType], 7222s ) -> Optional[bool]: 7222s assert self._state in (_State.ENTERED, _State.EXPIRING) 7222s 7222s if self._timeout_handler is not None: 7222s self._timeout_handler.cancel() 7222s self._timeout_handler = None 7222s 7222s if self._state is _State.EXPIRING: 7222s self._state = _State.EXPIRED 7222s 7222s if self._task.uncancel() <= self._cancelling and exc_type is not None: 7222s # Since there are no new cancel requests, we're 7222s # handling this. 7222s if issubclass(exc_type, exceptions.CancelledError): 7222s > raise TimeoutError from exc_val 7222s E TimeoutError 7222s 7222s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s @contextlib.asynccontextmanager 7222s async def _cluster_factory(): 7222s workers = [] 7222s s = None 7222s try: 7222s for _ in range(60): 7222s try: 7222s > s, ws = await start_cluster( 7222s nthreads, 7222s scheduler, 7222s security=security, 7222s Worker=Worker, 7222s scheduler_kwargs=scheduler_kwargs, 7222s worker_kwargs=merge( 7222s {"death_timeout": min(15, int(deadline.remaining))}, 7222s worker_kwargs, 7222s ), 7222s ) 7222s 7222s /usr/lib/python3/dist-packages/distributed/utils_test.py:966: 7222s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7222s /usr/lib/python3/dist-packages/distributed/utils_test.py:789: in start_cluster 7222s await asyncio.gather(*workers) 7222s /usr/lib/python3.13/asyncio/tasks.py:737: in _wrap_awaitable 7222s return await awaitable 7222s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7222s 7222s self = 7222s 7222s @final 7222s async def start(self): 7222s async with self._startup_lock: 7222s if self.status == Status.failed: 7222s assert self.__startup_exc is not None 7222s raise self.__startup_exc 7222s elif self.status != Status.init: 7222s return self 7222s timeout = getattr(self, "death_timeout", None) 7222s 7222s async def _close_on_failure(exc: Exception) -> None: 7222s await self.close(reason=f"failure-to-start-{str(type(exc))}") 7222s self.status = Status.failed 7222s self.__startup_exc = exc 7222s 7222s try: 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s except asyncio.TimeoutError as exc: 7222s await _close_on_failure(exc) 7222s > raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s E TimeoutError: Nanny start timed out after 0s. 7222s 7222s /usr/lib/python3/dist-packages/distributed/core.py:667: TimeoutError 7222s 7222s During handling of the above exception, another exception occurred: 7222s 7222s fut = ._..test_func..async_fn at 0xe9b48b08> 7222s timeout = 60 7222s 7222s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 7222s async with asyncio.timeout(timeout): 7222s > return await fut 7222s 7222s /usr/lib/python3/dist-packages/distributed/utils.py:1960: 7222s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7222s /usr/lib/python3/dist-packages/distributed/utils_test.py:999: in async_fn 7222s _cluster_factory() as (s, workers), 7222s /usr/lib/python3.13/contextlib.py:214: in __aenter__ 7222s return await anext(self.gen) 7222s /usr/lib/python3/dist-packages/distributed/utils_test.py:983: in _cluster_factory 7222s await asyncio.sleep(1) 7222s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7222s 7222s delay = 1, result = None 7222s 7222s async def sleep(delay, result=None): 7222s """Coroutine that completes after a given time (in seconds).""" 7222s if delay <= 0: 7222s await __sleep0() 7222s return result 7222s 7222s if math.isnan(delay): 7222s raise ValueError("Invalid delay: NaN (not a number)") 7222s 7222s loop = events.get_running_loop() 7222s future = loop.create_future() 7222s h = loop.call_later(delay, 7222s futures._set_result_unless_cancelled, 7222s future, result) 7222s try: 7222s > return await future 7222s E asyncio.exceptions.CancelledError 7222s 7222s /usr/lib/python3.13/asyncio/tasks.py:718: CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s args = (), kwds = {} 7222s 7222s @wraps(func) 7222s def inner(*args, **kwds): 7222s with self._recreate_cm(): 7222s > return func(*args, **kwds) 7222s 7222s /usr/lib/python3.13/contextlib.py:85: 7222s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7222s /usr/lib/python3.13/contextlib.py:85: in inner 7222s return func(*args, **kwds) 7222s /usr/lib/python3/dist-packages/distributed/utils_test.py:1102: in test_func 7222s return _run_and_close_tornado(async_fn_outer) 7222s /usr/lib/python3/dist-packages/distributed/utils_test.py:378: in _run_and_close_tornado 7222s return asyncio_run(inner_fn(), loop_factory=get_loop_factory()) 7222s /usr/lib/python3.13/asyncio/runners.py:194: in run 7222s return runner.run(main) 7222s /usr/lib/python3.13/asyncio/runners.py:118: in run 7222s return self._loop.run_until_complete(task) 7222s /usr/lib/python3.13/asyncio/base_events.py:720: in run_until_complete 7222s return future.result() 7222s /usr/lib/python3/dist-packages/distributed/utils_test.py:375: in inner_fn 7222s return await async_fn(*args, **kwargs) 7222s /usr/lib/python3/dist-packages/distributed/utils_test.py:1099: in async_fn_outer 7222s return await utils_wait_for(async_fn(), timeout=timeout * 2) 7222s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 7222s async with asyncio.timeout(timeout): 7222s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7222s 7222s self = 7222s exc_type = 7222s exc_val = CancelledError(), exc_tb = 7222s 7222s async def __aexit__( 7222s self, 7222s exc_type: Optional[Type[BaseException]], 7222s exc_val: Optional[BaseException], 7222s exc_tb: Optional[TracebackType], 7222s ) -> Optional[bool]: 7222s assert self._state in (_State.ENTERED, _State.EXPIRING) 7222s 7222s if self._timeout_handler is not None: 7222s self._timeout_handler.cancel() 7222s self._timeout_handler = None 7222s 7222s if self._state is _State.EXPIRING: 7222s self._state = _State.EXPIRED 7222s 7222s if self._task.uncancel() <= self._cancelling and exc_type is not None: 7222s # Since there are no new cancel requests, we're 7222s # handling this. 7222s if issubclass(exc_type, exceptions.CancelledError): 7222s > raise TimeoutError from exc_val 7222s E TimeoutError 7222s 7222s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 7222s ----------------------------- Captured stderr call ----------------------------- 7222s 2024-11-23 22:29:18,309 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:29:18,316 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40353 7222s 2024-11-23 22:29:18,317 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33649/status 7222s 2024-11-23 22:29:18,317 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:29:18,342 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:36133'. Reason: failure-to-start- 7222s 2024-11-23 22:29:18,343 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:41533'. Reason: failure-to-start- 7222s 2024-11-23 22:29:18,343 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40353': TLS handshake failed with remote 'tls://127.0.0.1:42592': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:29:18,343 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40353': TLS handshake failed with remote 'tls://127.0.0.1:42608': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:29:18,343 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 7222s stream = await stream.start_tls( 7222s ^^^^^^^^^^^^^^^^^^^^^^^ 7222s False, ssl_options=ssl_options, server_hostname=host 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 7222s self.socket.do_handshake() 7222s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 7222s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 7222s self._sslobj.do_handshake() 7222s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 7222s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7222s comm = await self.rpc.connect(saddr) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 7222s return await self._connect(addr=addr, timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 7222s comm = await connect( 7222s ^^^^^^^^^^^^^^ 7222s ...<4 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 7222s raise FatalCommClosedError( 7222s ...<2 lines>... 7222s ) from err 7222s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 7222s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 7222s RuntimeError: Nanny failed to start. 7222s 2024-11-23 22:29:19,351 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:29:19,358 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34075 7222s 2024-11-23 22:29:19,358 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45287/status 7222s 2024-11-23 22:29:19,358 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:29:19,386 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:46413'. Reason: failure-to-start- 7222s 2024-11-23 22:29:19,386 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:40773'. Reason: failure-to-start- 7222s 2024-11-23 22:29:19,386 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34075': TLS handshake failed with remote 'tls://127.0.0.1:36086': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:29:19,387 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34075': TLS handshake failed with remote 'tls://127.0.0.1:36090': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:29:19,387 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 7222s stream = await stream.start_tls( 7222s ^^^^^^^^^^^^^^^^^^^^^^^ 7222s False, ssl_options=ssl_options, server_hostname=host 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 7222s self.socket.do_handshake() 7222s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 7222s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 7222s self._sslobj.do_handshake() 7222s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 7222s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7222s comm = await self.rpc.connect(saddr) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 7222s return await self._connect(addr=addr, timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 7222s comm = await connect( 7222s ^^^^^^^^^^^^^^ 7222s ...<4 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 7222s raise FatalCommClosedError( 7222s ...<2 lines>... 7222s ) from err 7222s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 7222s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 7222s RuntimeError: Nanny failed to start. 7222s 2024-11-23 22:29:20,392 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:29:20,400 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37645 7222s 2024-11-23 22:29:20,400 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39665/status 7222s 2024-11-23 22:29:20,401 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:29:20,426 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:45351'. Reason: failure-to-start- 7222s 2024-11-23 22:29:20,427 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:36975'. Reason: failure-to-start- 7222s 2024-11-23 22:29:20,428 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37645': TLS handshake failed with remote 'tls://127.0.0.1:39236': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:29:20,428 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37645': TLS handshake failed with remote 'tls://127.0.0.1:39242': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:29:20,428 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 7222s stream = await stream.start_tls( 7222s ^^^^^^^^^^^^^^^^^^^^^^^ 7222s False, ssl_options=ssl_options, server_hostname=host 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 7222s self.socket.do_handshake() 7222s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 7222s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 7222s self._sslobj.do_handshake() 7222s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 7222s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7222s comm = await self.rpc.connect(saddr) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 7222s return await self._connect(addr=addr, timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 7222s comm = await connect( 7222s ^^^^^^^^^^^^^^ 7222s ...<4 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 7222s raise FatalCommClosedError( 7222s ...<2 lines>... 7222s ) from err 7222s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 7222s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 7222s RuntimeError: Nanny failed to start. 7222s 2024-11-23 22:29:21,434 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:29:21,441 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39401 7222s 2024-11-23 22:29:21,442 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40527/status 7222s 2024-11-23 22:29:21,442 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:29:21,467 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:45535'. Reason: failure-to-start- 7222s 2024-11-23 22:29:21,467 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:36359'. Reason: failure-to-start- 7222s 2024-11-23 22:29:21,468 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39401': TLS handshake failed with remote 'tls://127.0.0.1:44390': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:29:21,468 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39401': TLS handshake failed with remote 'tls://127.0.0.1:44402': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:29:21,468 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 7222s stream = await stream.start_tls( 7222s ^^^^^^^^^^^^^^^^^^^^^^^ 7222s False, ssl_options=ssl_options, server_hostname=host 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 7222s self.socket.do_handshake() 7222s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 7222s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 7222s self._sslobj.do_handshake() 7222s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 7222s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7222s comm = await self.rpc.connect(saddr) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 7222s return await self._connect(addr=addr, timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 7222s comm = await connect( 7222s ^^^^^^^^^^^^^^ 7222s ...<4 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 7222s raise FatalCommClosedError( 7222s ...<2 lines>... 7222s ) from err 7222s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 7222s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 7222s RuntimeError: Nanny failed to start. 7222s 2024-11-23 22:29:22,474 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:29:22,481 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40225 7222s 2024-11-23 22:29:22,482 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44673/status 7222s 2024-11-23 22:29:22,482 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:29:22,508 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:38999'. Reason: failure-to-start- 7222s 2024-11-23 22:29:22,508 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:39531'. Reason: failure-to-start- 7222s 2024-11-23 22:29:22,509 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40225': TLS handshake failed with remote 'tls://127.0.0.1:60876': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:29:22,509 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40225': TLS handshake failed with remote 'tls://127.0.0.1:60892': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:29:22,509 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 7222s stream = await stream.start_tls( 7222s ^^^^^^^^^^^^^^^^^^^^^^^ 7222s False, ssl_options=ssl_options, server_hostname=host 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 7222s self.socket.do_handshake() 7222s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 7222s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 7222s self._sslobj.do_handshake() 7222s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 7222s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7222s comm = await self.rpc.connect(saddr) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 7222s return await self._connect(addr=addr, timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 7222s comm = await connect( 7222s ^^^^^^^^^^^^^^ 7222s ...<4 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 7222s raise FatalCommClosedError( 7222s ...<2 lines>... 7222s ) from err 7222s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 7222s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 7222s RuntimeError: Nanny failed to start. 7222s 2024-11-23 22:29:23,515 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:29:23,522 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40377 7222s 2024-11-23 22:29:23,522 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37507/status 7222s 2024-11-23 22:29:23,523 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:29:23,548 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:42997'. Reason: failure-to-start- 7222s 2024-11-23 22:29:23,549 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:45117'. Reason: failure-to-start- 7222s 2024-11-23 22:29:23,549 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40377': TLS handshake failed with remote 'tls://127.0.0.1:41404': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:29:23,549 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40377': TLS handshake failed with remote 'tls://127.0.0.1:41408': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:29:23,549 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 7222s stream = await stream.start_tls( 7222s ^^^^^^^^^^^^^^^^^^^^^^^ 7222s False, ssl_options=ssl_options, server_hostname=host 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 7222s self.socket.do_handshake() 7222s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 7222s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 7222s self._sslobj.do_handshake() 7222s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 7222s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7222s comm = await self.rpc.connect(saddr) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 7222s return await self._connect(addr=addr, timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 7222s comm = await connect( 7222s ^^^^^^^^^^^^^^ 7222s ...<4 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 7222s raise FatalCommClosedError( 7222s ...<2 lines>... 7222s ) from err 7222s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 7222s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 7222s RuntimeError: Nanny failed to start. 7222s 2024-11-23 22:29:24,555 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:29:24,562 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40243 7222s 2024-11-23 22:29:24,563 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:32769/status 7222s 2024-11-23 22:29:24,563 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:29:24,587 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:33125'. Reason: failure-to-start- 7222s 2024-11-23 22:29:24,588 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:33857'. Reason: failure-to-start- 7222s 2024-11-23 22:29:24,588 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40243': TLS handshake failed with remote 'tls://127.0.0.1:47414': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:29:24,589 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40243': TLS handshake failed with remote 'tls://127.0.0.1:47420': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:29:24,589 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 7222s stream = await stream.start_tls( 7222s ^^^^^^^^^^^^^^^^^^^^^^^ 7222s False, ssl_options=ssl_options, server_hostname=host 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 7222s self.socket.do_handshake() 7222s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 7222s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 7222s self._sslobj.do_handshake() 7222s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 7222s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7222s comm = await self.rpc.connect(saddr) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 7222s return await self._connect(addr=addr, timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 7222s comm = await connect( 7222s ^^^^^^^^^^^^^^ 7222s ...<4 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 7222s raise FatalCommClosedError( 7222s ...<2 lines>... 7222s ) from err 7222s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 7222s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 7222s RuntimeError: Nanny failed to start. 7222s 2024-11-23 22:29:25,598 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:29:25,606 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39411 7222s 2024-11-23 22:29:25,606 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:32925/status 7222s 2024-11-23 22:29:25,607 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:29:25,633 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:37611'. Reason: failure-to-start- 7222s 2024-11-23 22:29:25,633 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:38747'. Reason: failure-to-start- 7222s 2024-11-23 22:29:25,634 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39411': TLS handshake failed with remote 'tls://127.0.0.1:55280': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:29:25,634 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39411': TLS handshake failed with remote 'tls://127.0.0.1:55284': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:29:25,634 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 7222s stream = await stream.start_tls( 7222s ^^^^^^^^^^^^^^^^^^^^^^^ 7222s False, ssl_options=ssl_options, server_hostname=host 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 7222s self.socket.do_handshake() 7222s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 7222s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 7222s self._sslobj.do_handshake() 7222s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 7222s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7222s comm = await self.rpc.connect(saddr) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 7222s return await self._connect(addr=addr, timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 7222s comm = await connect( 7222s ^^^^^^^^^^^^^^ 7222s ...<4 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 7222s raise FatalCommClosedError( 7222s ...<2 lines>... 7222s ) from err 7222s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 7222s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 7222s RuntimeError: Nanny failed to start. 7222s 2024-11-23 22:29:26,640 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:29:26,647 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38319 7222s 2024-11-23 22:29:26,648 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42475/status 7222s 2024-11-23 22:29:26,648 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:29:26,690 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:37707'. Reason: failure-to-start- 7222s 2024-11-23 22:29:26,690 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:33125'. Reason: failure-to-start- 7222s 2024-11-23 22:29:26,691 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38319': TLS handshake failed with remote 'tls://127.0.0.1:43912': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:29:26,691 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38319': TLS handshake failed with remote 'tls://127.0.0.1:43926': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:29:26,691 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 7222s stream = await stream.start_tls( 7222s ^^^^^^^^^^^^^^^^^^^^^^^ 7222s False, ssl_options=ssl_options, server_hostname=host 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 7222s self.socket.do_handshake() 7222s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 7222s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 7222s self._sslobj.do_handshake() 7222s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 7222s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7222s comm = await self.rpc.connect(saddr) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 7222s return await self._connect(addr=addr, timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 7222s comm = await connect( 7222s ^^^^^^^^^^^^^^ 7222s ...<4 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 7222s raise FatalCommClosedError( 7222s ...<2 lines>... 7222s ) from err 7222s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 7222s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 7222s RuntimeError: Nanny failed to start. 7222s 2024-11-23 22:29:27,697 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:29:27,705 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44513 7222s 2024-11-23 22:29:27,705 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42975/status 7222s 2024-11-23 22:29:27,706 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:29:27,731 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:37121'. Reason: failure-to-start- 7222s 2024-11-23 22:29:27,732 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:33669'. Reason: failure-to-start- 7222s 2024-11-23 22:29:27,732 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44513': TLS handshake failed with remote 'tls://127.0.0.1:38650': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:29:27,732 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44513': TLS handshake failed with remote 'tls://127.0.0.1:38652': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:29:27,733 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 7222s stream = await stream.start_tls( 7222s ^^^^^^^^^^^^^^^^^^^^^^^ 7222s False, ssl_options=ssl_options, server_hostname=host 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 7222s self.socket.do_handshake() 7222s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 7222s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 7222s self._sslobj.do_handshake() 7222s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 7222s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7222s comm = await self.rpc.connect(saddr) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 7222s return await self._connect(addr=addr, timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 7222s comm = await connect( 7222s ^^^^^^^^^^^^^^ 7222s ...<4 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 7222s raise FatalCommClosedError( 7222s ...<2 lines>... 7222s ) from err 7222s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 7222s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 7222s RuntimeError: Nanny failed to start. 7222s 2024-11-23 22:29:28,739 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:29:28,746 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45653 7222s 2024-11-23 22:29:28,746 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37965/status 7222s 2024-11-23 22:29:28,746 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:29:28,771 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:37739'. Reason: failure-to-start- 7222s 2024-11-23 22:29:28,772 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:43727'. Reason: failure-to-start- 7222s 2024-11-23 22:29:28,772 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45653': TLS handshake failed with remote 'tls://127.0.0.1:49030': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:29:28,772 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45653': TLS handshake failed with remote 'tls://127.0.0.1:49042': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:29:28,772 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 7222s stream = await stream.start_tls( 7222s ^^^^^^^^^^^^^^^^^^^^^^^ 7222s False, ssl_options=ssl_options, server_hostname=host 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 7222s self.socket.do_handshake() 7222s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 7222s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 7222s self._sslobj.do_handshake() 7222s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 7222s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7222s comm = await self.rpc.connect(saddr) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 7222s return await self._connect(addr=addr, timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 7222s comm = await connect( 7222s ^^^^^^^^^^^^^^ 7222s ...<4 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 7222s raise FatalCommClosedError( 7222s ...<2 lines>... 7222s ) from err 7222s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 7222s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 7222s RuntimeError: Nanny failed to start. 7222s 2024-11-23 22:29:29,778 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:29:29,785 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41765 7222s 2024-11-23 22:29:29,785 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46795/status 7222s 2024-11-23 22:29:29,786 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:29:29,812 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:43221'. Reason: failure-to-start- 7222s 2024-11-23 22:29:29,812 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:46615'. Reason: failure-to-start- 7222s 2024-11-23 22:29:29,812 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41765': TLS handshake failed with remote 'tls://127.0.0.1:34180': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:29:29,813 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41765': TLS handshake failed with remote 'tls://127.0.0.1:34190': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:29:29,813 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 7222s stream = await stream.start_tls( 7222s ^^^^^^^^^^^^^^^^^^^^^^^ 7222s False, ssl_options=ssl_options, server_hostname=host 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 7222s self.socket.do_handshake() 7222s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 7222s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 7222s self._sslobj.do_handshake() 7222s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 7222s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7222s comm = await self.rpc.connect(saddr) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 7222s return await self._connect(addr=addr, timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 7222s comm = await connect( 7222s ^^^^^^^^^^^^^^ 7222s ...<4 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 7222s raise FatalCommClosedError( 7222s ...<2 lines>... 7222s ) from err 7222s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 7222s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 7222s RuntimeError: Nanny failed to start. 7222s 2024-11-23 22:29:30,819 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:29:30,826 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36963 7222s 2024-11-23 22:29:30,827 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44847/status 7222s 2024-11-23 22:29:30,827 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:29:30,854 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:45533'. Reason: failure-to-start- 7222s 2024-11-23 22:29:30,854 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:42073'. Reason: failure-to-start- 7222s 2024-11-23 22:29:30,855 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36963': TLS handshake failed with remote 'tls://127.0.0.1:48482': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:29:30,855 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36963': TLS handshake failed with remote 'tls://127.0.0.1:48484': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:29:30,855 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 7222s stream = await stream.start_tls( 7222s ^^^^^^^^^^^^^^^^^^^^^^^ 7222s False, ssl_options=ssl_options, server_hostname=host 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 7222s self.socket.do_handshake() 7222s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 7222s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 7222s self._sslobj.do_handshake() 7222s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 7222s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7222s comm = await self.rpc.connect(saddr) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 7222s return await self._connect(addr=addr, timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 7222s comm = await connect( 7222s ^^^^^^^^^^^^^^ 7222s ...<4 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 7222s raise FatalCommClosedError( 7222s ...<2 lines>... 7222s ) from err 7222s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 7222s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 7222s RuntimeError: Nanny failed to start. 7222s 2024-11-23 22:29:31,861 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:29:31,869 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46499 7222s 2024-11-23 22:29:31,870 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44055/status 7222s 2024-11-23 22:29:31,870 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:29:31,900 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:40541'. Reason: failure-to-start- 7222s 2024-11-23 22:29:31,900 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:37833'. Reason: failure-to-start- 7222s 2024-11-23 22:29:31,901 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46499': TLS handshake failed with remote 'tls://127.0.0.1:33278': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:29:31,901 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46499': TLS handshake failed with remote 'tls://127.0.0.1:33290': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:29:31,901 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 7222s stream = await stream.start_tls( 7222s ^^^^^^^^^^^^^^^^^^^^^^^ 7222s False, ssl_options=ssl_options, server_hostname=host 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 7222s self.socket.do_handshake() 7222s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 7222s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 7222s self._sslobj.do_handshake() 7222s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 7222s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7222s comm = await self.rpc.connect(saddr) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 7222s return await self._connect(addr=addr, timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 7222s comm = await connect( 7222s ^^^^^^^^^^^^^^ 7222s ...<4 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 7222s raise FatalCommClosedError( 7222s ...<2 lines>... 7222s ) from err 7222s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 7222s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 7222s RuntimeError: Nanny failed to start. 7222s 2024-11-23 22:29:32,907 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:29:32,914 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44433 7222s 2024-11-23 22:29:32,915 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39171/status 7222s 2024-11-23 22:29:32,915 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:29:32,940 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:41321'. Reason: failure-to-start- 7222s 2024-11-23 22:29:32,940 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:43107'. Reason: failure-to-start- 7222s 2024-11-23 22:29:32,941 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44433': TLS handshake failed with remote 'tls://127.0.0.1:39242': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:29:32,941 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44433': TLS handshake failed with remote 'tls://127.0.0.1:39254': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:29:32,941 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 7222s stream = await stream.start_tls( 7222s ^^^^^^^^^^^^^^^^^^^^^^^ 7222s False, ssl_options=ssl_options, server_hostname=host 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 7222s self.socket.do_handshake() 7222s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 7222s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 7222s self._sslobj.do_handshake() 7222s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 7222s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7222s comm = await self.rpc.connect(saddr) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 7222s return await self._connect(addr=addr, timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 7222s comm = await connect( 7222s ^^^^^^^^^^^^^^ 7222s ...<4 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 7222s raise FatalCommClosedError( 7222s ...<2 lines>... 7222s ) from err 7222s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 7222s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 7222s RuntimeError: Nanny failed to start. 7222s 2024-11-23 22:29:33,949 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:29:33,956 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43831 7222s 2024-11-23 22:29:33,956 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35361/status 7222s 2024-11-23 22:29:33,957 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:29:33,982 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:38577'. Reason: failure-to-start- 7222s 2024-11-23 22:29:33,983 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:36189'. Reason: failure-to-start- 7222s 2024-11-23 22:29:33,983 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43831': TLS handshake failed with remote 'tls://127.0.0.1:51212': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:29:33,983 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43831': TLS handshake failed with remote 'tls://127.0.0.1:51224': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:29:33,983 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 7222s stream = await stream.start_tls( 7222s ^^^^^^^^^^^^^^^^^^^^^^^ 7222s False, ssl_options=ssl_options, server_hostname=host 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 7222s self.socket.do_handshake() 7222s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 7222s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 7222s self._sslobj.do_handshake() 7222s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 7222s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7222s comm = await self.rpc.connect(saddr) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 7222s return await self._connect(addr=addr, timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 7222s comm = await connect( 7222s ^^^^^^^^^^^^^^ 7222s ...<4 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 7222s raise FatalCommClosedError( 7222s ...<2 lines>... 7222s ) from err 7222s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 7222s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 7222s RuntimeError: Nanny failed to start. 7222s 2024-11-23 22:29:34,989 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:29:34,996 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34501 7222s 2024-11-23 22:29:34,997 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46327/status 7222s 2024-11-23 22:29:34,997 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:29:35,023 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:36997'. Reason: failure-to-start- 7222s 2024-11-23 22:29:35,023 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:41847'. Reason: failure-to-start- 7222s 2024-11-23 22:29:35,024 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34501': TLS handshake failed with remote 'tls://127.0.0.1:60390': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:29:35,024 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34501': TLS handshake failed with remote 'tls://127.0.0.1:60398': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:29:35,024 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 7222s stream = await stream.start_tls( 7222s ^^^^^^^^^^^^^^^^^^^^^^^ 7222s False, ssl_options=ssl_options, server_hostname=host 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 7222s self.socket.do_handshake() 7222s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 7222s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 7222s self._sslobj.do_handshake() 7222s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 7222s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7222s comm = await self.rpc.connect(saddr) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 7222s return await self._connect(addr=addr, timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 7222s comm = await connect( 7222s ^^^^^^^^^^^^^^ 7222s ...<4 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 7222s raise FatalCommClosedError( 7222s ...<2 lines>... 7222s ) from err 7222s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 7222s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 7222s RuntimeError: Nanny failed to start. 7222s 2024-11-23 22:29:36,029 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:29:36,037 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39649 7222s 2024-11-23 22:29:36,038 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:32817/status 7222s 2024-11-23 22:29:36,038 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:29:36,061 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:38119'. Reason: failure-to-start- 7222s 2024-11-23 22:29:36,062 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:45143'. Reason: failure-to-start- 7222s 2024-11-23 22:29:36,062 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39649': TLS handshake failed with remote 'tls://127.0.0.1:53456': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:29:36,062 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39649': TLS handshake failed with remote 'tls://127.0.0.1:53466': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:29:36,062 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 7222s stream = await stream.start_tls( 7222s ^^^^^^^^^^^^^^^^^^^^^^^ 7222s False, ssl_options=ssl_options, server_hostname=host 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 7222s self.socket.do_handshake() 7222s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 7222s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 7222s self._sslobj.do_handshake() 7222s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 7222s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7222s comm = await self.rpc.connect(saddr) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 7222s return await self._connect(addr=addr, timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 7222s comm = await connect( 7222s ^^^^^^^^^^^^^^ 7222s ...<4 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 7222s raise FatalCommClosedError( 7222s ...<2 lines>... 7222s ) from err 7222s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 7222s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 7222s RuntimeError: Nanny failed to start. 7222s 2024-11-23 22:29:37,071 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:29:37,078 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33633 7222s 2024-11-23 22:29:37,079 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43195/status 7222s 2024-11-23 22:29:37,079 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:29:37,104 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:34683'. Reason: failure-to-start- 7222s 2024-11-23 22:29:37,105 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:33203'. Reason: failure-to-start- 7222s 2024-11-23 22:29:37,106 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33633': TLS handshake failed with remote 'tls://127.0.0.1:44322': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:29:37,106 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33633': TLS handshake failed with remote 'tls://127.0.0.1:44332': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:29:37,106 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 7222s stream = await stream.start_tls( 7222s ^^^^^^^^^^^^^^^^^^^^^^^ 7222s False, ssl_options=ssl_options, server_hostname=host 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 7222s self.socket.do_handshake() 7222s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 7222s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 7222s self._sslobj.do_handshake() 7222s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 7222s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7222s comm = await self.rpc.connect(saddr) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 7222s return await self._connect(addr=addr, timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 7222s comm = await connect( 7222s ^^^^^^^^^^^^^^ 7222s ...<4 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 7222s raise FatalCommClosedError( 7222s ...<2 lines>... 7222s ) from err 7222s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 7222s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 7222s RuntimeError: Nanny failed to start. 7222s 2024-11-23 22:29:38,114 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:29:38,124 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42219 7222s 2024-11-23 22:29:38,124 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38381/status 7222s 2024-11-23 22:29:38,125 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:29:38,150 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:37915'. Reason: failure-to-start- 7222s 2024-11-23 22:29:38,151 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:43937'. Reason: failure-to-start- 7222s 2024-11-23 22:29:38,154 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42219': TLS handshake failed with remote 'tls://127.0.0.1:50330': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:29:38,154 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42219': TLS handshake failed with remote 'tls://127.0.0.1:50336': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:29:38,154 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 7222s stream = await stream.start_tls( 7222s ^^^^^^^^^^^^^^^^^^^^^^^ 7222s False, ssl_options=ssl_options, server_hostname=host 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 7222s self.socket.do_handshake() 7222s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 7222s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 7222s self._sslobj.do_handshake() 7222s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 7222s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7222s comm = await self.rpc.connect(saddr) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 7222s return await self._connect(addr=addr, timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 7222s comm = await connect( 7222s ^^^^^^^^^^^^^^ 7222s ...<4 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 7222s raise FatalCommClosedError( 7222s ...<2 lines>... 7222s ) from err 7222s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 7222s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 7222s RuntimeError: Nanny failed to start. 7222s 2024-11-23 22:29:39,160 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:29:39,167 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35851 7222s 2024-11-23 22:29:39,167 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34797/status 7222s 2024-11-23 22:29:39,168 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:29:39,192 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:42205'. Reason: failure-to-start- 7222s 2024-11-23 22:29:39,192 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:44801'. Reason: failure-to-start- 7222s 2024-11-23 22:29:39,193 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35851': TLS handshake failed with remote 'tls://127.0.0.1:59252': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:29:39,193 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35851': TLS handshake failed with remote 'tls://127.0.0.1:59264': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:29:39,193 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 7222s stream = await stream.start_tls( 7222s ^^^^^^^^^^^^^^^^^^^^^^^ 7222s False, ssl_options=ssl_options, server_hostname=host 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 7222s self.socket.do_handshake() 7222s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 7222s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 7222s self._sslobj.do_handshake() 7222s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 7222s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7222s comm = await self.rpc.connect(saddr) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 7222s return await self._connect(addr=addr, timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 7222s comm = await connect( 7222s ^^^^^^^^^^^^^^ 7222s ...<4 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 7222s raise FatalCommClosedError( 7222s ...<2 lines>... 7222s ) from err 7222s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 7222s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 7222s RuntimeError: Nanny failed to start. 7222s 2024-11-23 22:29:40,201 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:29:40,209 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45395 7222s 2024-11-23 22:29:40,209 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38987/status 7222s 2024-11-23 22:29:40,210 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:29:40,239 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:35359'. Reason: failure-to-start- 7222s 2024-11-23 22:29:40,239 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:36467'. Reason: failure-to-start- 7222s 2024-11-23 22:29:40,240 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:48328': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:29:40,240 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:48330': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:29:40,240 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 7222s stream = await stream.start_tls( 7222s ^^^^^^^^^^^^^^^^^^^^^^^ 7222s False, ssl_options=ssl_options, server_hostname=host 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 7222s self.socket.do_handshake() 7222s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 7222s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 7222s self._sslobj.do_handshake() 7222s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 7222s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7222s comm = await self.rpc.connect(saddr) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 7222s return await self._connect(addr=addr, timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 7222s comm = await connect( 7222s ^^^^^^^^^^^^^^ 7222s ...<4 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 7222s raise FatalCommClosedError( 7222s ...<2 lines>... 7222s ) from err 7222s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 7222s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 7222s RuntimeError: Nanny failed to start. 7222s 2024-11-23 22:29:41,246 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:29:41,253 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40651 7222s 2024-11-23 22:29:41,254 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40667/status 7222s 2024-11-23 22:29:41,254 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:29:41,282 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:35391'. Reason: failure-to-start- 7222s 2024-11-23 22:29:41,282 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:41215'. Reason: failure-to-start- 7222s 2024-11-23 22:29:41,283 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40651': TLS handshake failed with remote 'tls://127.0.0.1:41570': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:29:41,283 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40651': TLS handshake failed with remote 'tls://127.0.0.1:41584': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:29:41,283 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 7222s stream = await stream.start_tls( 7222s ^^^^^^^^^^^^^^^^^^^^^^^ 7222s False, ssl_options=ssl_options, server_hostname=host 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 7222s self.socket.do_handshake() 7222s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 7222s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 7222s self._sslobj.do_handshake() 7222s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 7222s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7222s comm = await self.rpc.connect(saddr) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 7222s return await self._connect(addr=addr, timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 7222s comm = await connect( 7222s ^^^^^^^^^^^^^^ 7222s ...<4 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 7222s raise FatalCommClosedError( 7222s ...<2 lines>... 7222s ) from err 7222s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 7222s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 7222s RuntimeError: Nanny failed to start. 7222s 2024-11-23 22:29:42,292 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:29:42,299 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41357 7222s 2024-11-23 22:29:42,299 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35533/status 7222s 2024-11-23 22:29:42,299 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:29:42,325 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:41143'. Reason: failure-to-start- 7222s 2024-11-23 22:29:42,325 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:44811'. Reason: failure-to-start- 7222s 2024-11-23 22:29:42,328 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41357': TLS handshake failed with remote 'tls://127.0.0.1:43970': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:29:42,328 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41357': TLS handshake failed with remote 'tls://127.0.0.1:43980': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:29:42,328 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 7222s stream = await stream.start_tls( 7222s ^^^^^^^^^^^^^^^^^^^^^^^ 7222s False, ssl_options=ssl_options, server_hostname=host 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 7222s self.socket.do_handshake() 7222s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 7222s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 7222s self._sslobj.do_handshake() 7222s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 7222s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7222s comm = await self.rpc.connect(saddr) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 7222s return await self._connect(addr=addr, timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 7222s comm = await connect( 7222s ^^^^^^^^^^^^^^ 7222s ...<4 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 7222s raise FatalCommClosedError( 7222s ...<2 lines>... 7222s ) from err 7222s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 7222s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 7222s RuntimeError: Nanny failed to start. 7222s 2024-11-23 22:29:43,335 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:29:43,342 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40083 7222s 2024-11-23 22:29:43,342 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38995/status 7222s 2024-11-23 22:29:43,343 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:29:43,386 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:36735'. Reason: failure-to-start- 7222s 2024-11-23 22:29:43,387 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:33365'. Reason: failure-to-start- 7222s 2024-11-23 22:29:43,387 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40083': TLS handshake failed with remote 'tls://127.0.0.1:55534': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:29:43,388 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40083': TLS handshake failed with remote 'tls://127.0.0.1:55548': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:29:43,388 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 7222s stream = await stream.start_tls( 7222s ^^^^^^^^^^^^^^^^^^^^^^^ 7222s False, ssl_options=ssl_options, server_hostname=host 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 7222s self.socket.do_handshake() 7222s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 7222s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 7222s self._sslobj.do_handshake() 7222s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 7222s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7222s comm = await self.rpc.connect(saddr) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 7222s return await self._connect(addr=addr, timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 7222s comm = await connect( 7222s ^^^^^^^^^^^^^^ 7222s ...<4 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 7222s raise FatalCommClosedError( 7222s ...<2 lines>... 7222s ) from err 7222s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 7222s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 7222s RuntimeError: Nanny failed to start. 7222s 2024-11-23 22:29:44,394 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:29:44,401 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46829 7222s 2024-11-23 22:29:44,401 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40919/status 7222s 2024-11-23 22:29:44,402 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:29:44,432 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:46861'. Reason: failure-to-start- 7222s 2024-11-23 22:29:44,433 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:39403'. Reason: failure-to-start- 7222s 2024-11-23 22:29:44,433 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46829': TLS handshake failed with remote 'tls://127.0.0.1:50896': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:29:44,433 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46829': TLS handshake failed with remote 'tls://127.0.0.1:50898': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:29:44,433 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 7222s stream = await stream.start_tls( 7222s ^^^^^^^^^^^^^^^^^^^^^^^ 7222s False, ssl_options=ssl_options, server_hostname=host 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 7222s self.socket.do_handshake() 7222s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 7222s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 7222s self._sslobj.do_handshake() 7222s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 7222s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7222s comm = await self.rpc.connect(saddr) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 7222s return await self._connect(addr=addr, timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 7222s comm = await connect( 7222s ^^^^^^^^^^^^^^ 7222s ...<4 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 7222s raise FatalCommClosedError( 7222s ...<2 lines>... 7222s ) from err 7222s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 7222s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 7222s RuntimeError: Nanny failed to start. 7222s 2024-11-23 22:29:45,440 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:29:45,447 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36473 7222s 2024-11-23 22:29:45,448 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46563/status 7222s 2024-11-23 22:29:45,448 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:29:45,481 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:39269'. Reason: failure-to-start- 7222s 2024-11-23 22:29:45,481 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:40231'. Reason: failure-to-start- 7222s 2024-11-23 22:29:45,482 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36473': TLS handshake failed with remote 'tls://127.0.0.1:60252': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:29:45,482 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36473': TLS handshake failed with remote 'tls://127.0.0.1:60262': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:29:45,482 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 7222s stream = await stream.start_tls( 7222s ^^^^^^^^^^^^^^^^^^^^^^^ 7222s False, ssl_options=ssl_options, server_hostname=host 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 7222s self.socket.do_handshake() 7222s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 7222s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 7222s self._sslobj.do_handshake() 7222s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 7222s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7222s comm = await self.rpc.connect(saddr) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 7222s return await self._connect(addr=addr, timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 7222s comm = await connect( 7222s ^^^^^^^^^^^^^^ 7222s ...<4 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 7222s raise FatalCommClosedError( 7222s ...<2 lines>... 7222s ) from err 7222s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 7222s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 7222s RuntimeError: Nanny failed to start. 7222s 2024-11-23 22:29:46,489 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:29:46,497 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46409 7222s 2024-11-23 22:29:46,497 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33231/status 7222s 2024-11-23 22:29:46,497 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:29:46,525 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:34823'. Reason: failure-to-start- 7222s 2024-11-23 22:29:46,525 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:35995'. Reason: failure-to-start- 7222s 2024-11-23 22:29:46,526 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46409': TLS handshake failed with remote 'tls://127.0.0.1:57272': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:29:46,526 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46409': TLS handshake failed with remote 'tls://127.0.0.1:57288': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:29:46,528 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 7222s stream = await stream.start_tls( 7222s ^^^^^^^^^^^^^^^^^^^^^^^ 7222s False, ssl_options=ssl_options, server_hostname=host 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 7222s self.socket.do_handshake() 7222s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 7222s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 7222s self._sslobj.do_handshake() 7222s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 7222s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7222s comm = await self.rpc.connect(saddr) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 7222s return await self._connect(addr=addr, timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 7222s comm = await connect( 7222s ^^^^^^^^^^^^^^ 7222s ...<4 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 7222s raise FatalCommClosedError( 7222s ...<2 lines>... 7222s ) from err 7222s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 7222s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 7222s RuntimeError: Nanny failed to start. 7222s 2024-11-23 22:29:47,534 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:29:47,541 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44895 7222s 2024-11-23 22:29:47,541 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43259/status 7222s 2024-11-23 22:29:47,541 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:29:47,557 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:36763'. Reason: failure-to-start- 7222s 2024-11-23 22:29:47,558 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:43643'. Reason: failure-to-start- 7222s 2024-11-23 22:29:47,559 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44895': TLS handshake failed with remote 'tls://127.0.0.1:58724': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:29:47,559 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44895': TLS handshake failed with remote 'tls://127.0.0.1:58738': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:29:47,559 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7222s comm = await self.rpc.connect(saddr) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 7222s return await self._connect(addr=addr, timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 7222s comm = await connect( 7222s ^^^^^^^^^^^^^^ 7222s ...<4 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Nanny start timed out after 0s. 7222s 2024-11-23 22:29:48,564 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:29:48,571 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40995 7222s 2024-11-23 22:29:48,572 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36011/status 7222s 2024-11-23 22:29:48,572 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:29:48,591 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:41133'. Reason: failure-to-start- 7222s 2024-11-23 22:29:48,591 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:43115'. Reason: failure-to-start- 7222s 2024-11-23 22:29:48,592 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40995': TLS handshake failed with remote 'tls://127.0.0.1:34068': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:29:48,592 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40995': TLS handshake failed with remote 'tls://127.0.0.1:34078': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:29:48,592 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7222s comm = await self.rpc.connect(saddr) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 7222s return await self._connect(addr=addr, timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 7222s comm = await connect( 7222s ^^^^^^^^^^^^^^ 7222s ...<4 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Nanny start timed out after 0s. 7222s 2024-11-23 22:29:49,597 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:29:49,604 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:32803 7222s 2024-11-23 22:29:49,605 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41967/status 7222s 2024-11-23 22:29:49,605 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:29:49,622 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:33833'. Reason: failure-to-start- 7222s 2024-11-23 22:29:49,622 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:39317'. Reason: failure-to-start- 7222s 2024-11-23 22:29:49,623 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:32803': TLS handshake failed with remote 'tls://127.0.0.1:57796': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:29:49,623 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:32803': TLS handshake failed with remote 'tls://127.0.0.1:57804': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:29:49,623 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7222s comm = await self.rpc.connect(saddr) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 7222s return await self._connect(addr=addr, timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 7222s comm = await connect( 7222s ^^^^^^^^^^^^^^ 7222s ...<4 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Nanny start timed out after 0s. 7222s 2024-11-23 22:29:50,633 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:29:50,642 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39435 7222s 2024-11-23 22:29:50,642 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40489/status 7222s 2024-11-23 22:29:50,643 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:29:50,659 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:44051'. Reason: failure-to-start- 7222s 2024-11-23 22:29:50,660 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:33319'. Reason: failure-to-start- 7222s 2024-11-23 22:29:50,661 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39435': TLS handshake failed with remote 'tls://127.0.0.1:53482': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:29:50,661 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39435': TLS handshake failed with remote 'tls://127.0.0.1:53494': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:29:50,661 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7222s comm = await self.rpc.connect(saddr) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 7222s return await self._connect(addr=addr, timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 7222s comm = await connect( 7222s ^^^^^^^^^^^^^^ 7222s ...<4 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Nanny start timed out after 0s. 7222s 2024-11-23 22:29:51,667 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:29:51,676 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36999 7222s 2024-11-23 22:29:51,677 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40619/status 7222s 2024-11-23 22:29:51,677 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:29:51,694 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:33147'. Reason: failure-to-start- 7222s 2024-11-23 22:29:51,695 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:35265'. Reason: failure-to-start- 7222s 2024-11-23 22:29:51,696 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36999': TLS handshake failed with remote 'tls://127.0.0.1:40450': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:29:51,696 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36999': TLS handshake failed with remote 'tls://127.0.0.1:40462': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:29:51,696 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7222s comm = await self.rpc.connect(saddr) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 7222s return await self._connect(addr=addr, timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 7222s comm = await connect( 7222s ^^^^^^^^^^^^^^ 7222s ...<4 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Nanny start timed out after 0s. 7222s 2024-11-23 22:29:52,701 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:29:52,708 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42903 7222s 2024-11-23 22:29:52,708 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39251/status 7222s 2024-11-23 22:29:52,709 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:29:52,726 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:37669'. Reason: failure-to-start- 7222s 2024-11-23 22:29:52,726 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:45743'. Reason: failure-to-start- 7222s 2024-11-23 22:29:52,727 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42903': TLS handshake failed with remote 'tls://127.0.0.1:41784': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:29:52,728 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42903': TLS handshake failed with remote 'tls://127.0.0.1:41800': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:29:52,728 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7222s comm = await self.rpc.connect(saddr) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 7222s return await self._connect(addr=addr, timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 7222s comm = await connect( 7222s ^^^^^^^^^^^^^^ 7222s ...<4 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Nanny start timed out after 0s. 7222s 2024-11-23 22:29:53,735 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:29:53,743 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45561 7222s 2024-11-23 22:29:53,743 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37269/status 7222s 2024-11-23 22:29:53,743 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:29:53,761 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:37603'. Reason: failure-to-start- 7222s 2024-11-23 22:29:53,761 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:44669'. Reason: failure-to-start- 7222s 2024-11-23 22:29:53,764 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45561': TLS handshake failed with remote 'tls://127.0.0.1:58928': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:29:53,765 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45561': TLS handshake failed with remote 'tls://127.0.0.1:58942': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:29:53,765 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7222s comm = await self.rpc.connect(saddr) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 7222s return await self._connect(addr=addr, timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 7222s comm = await connect( 7222s ^^^^^^^^^^^^^^ 7222s ...<4 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Nanny start timed out after 0s. 7222s 2024-11-23 22:29:54,772 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:29:54,779 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35237 7222s 2024-11-23 22:29:54,780 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40011/status 7222s 2024-11-23 22:29:54,780 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:29:54,796 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:42681'. Reason: failure-to-start- 7222s 2024-11-23 22:29:54,796 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:43105'. Reason: failure-to-start- 7222s 2024-11-23 22:29:54,797 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35237': TLS handshake failed with remote 'tls://127.0.0.1:35958': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:29:54,797 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35237': TLS handshake failed with remote 'tls://127.0.0.1:35966': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:29:54,797 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7222s comm = await self.rpc.connect(saddr) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 7222s return await self._connect(addr=addr, timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 7222s comm = await connect( 7222s ^^^^^^^^^^^^^^ 7222s ...<4 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Nanny start timed out after 0s. 7222s 2024-11-23 22:29:55,804 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:29:55,811 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35177 7222s 2024-11-23 22:29:55,811 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43497/status 7222s 2024-11-23 22:29:55,812 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:29:55,827 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:38743'. Reason: failure-to-start- 7222s 2024-11-23 22:29:55,827 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:42445'. Reason: failure-to-start- 7222s 2024-11-23 22:29:55,828 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35177': TLS handshake failed with remote 'tls://127.0.0.1:45742': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:29:55,828 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35177': TLS handshake failed with remote 'tls://127.0.0.1:45748': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:29:55,829 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7222s comm = await self.rpc.connect(saddr) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 7222s return await self._connect(addr=addr, timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 7222s comm = await connect( 7222s ^^^^^^^^^^^^^^ 7222s ...<4 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Nanny start timed out after 0s. 7222s 2024-11-23 22:29:56,835 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:29:56,842 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46233 7222s 2024-11-23 22:29:56,842 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38293/status 7222s 2024-11-23 22:29:56,843 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:29:56,859 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:35121'. Reason: failure-to-start- 7222s 2024-11-23 22:29:56,859 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:42415'. Reason: failure-to-start- 7222s 2024-11-23 22:29:56,860 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46233': TLS handshake failed with remote 'tls://127.0.0.1:46558': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:29:56,861 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46233': TLS handshake failed with remote 'tls://127.0.0.1:46572': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:29:56,863 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7222s comm = await self.rpc.connect(saddr) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 7222s return await self._connect(addr=addr, timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 7222s comm = await connect( 7222s ^^^^^^^^^^^^^^ 7222s ...<4 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Nanny start timed out after 0s. 7222s 2024-11-23 22:29:57,868 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:29:57,875 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38287 7222s 2024-11-23 22:29:57,875 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40499/status 7222s 2024-11-23 22:29:57,876 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:29:57,891 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:34147'. Reason: failure-to-start- 7222s 2024-11-23 22:29:57,891 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:35155'. Reason: failure-to-start- 7222s 2024-11-23 22:29:57,892 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38287': TLS handshake failed with remote 'tls://127.0.0.1:34900': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:29:57,892 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38287': TLS handshake failed with remote 'tls://127.0.0.1:34916': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:29:57,892 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7222s comm = await self.rpc.connect(saddr) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 7222s return await self._connect(addr=addr, timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 7222s comm = await connect( 7222s ^^^^^^^^^^^^^^ 7222s ...<4 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Nanny start timed out after 0s. 7222s 2024-11-23 22:29:58,901 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:29:58,911 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43493 7222s 2024-11-23 22:29:58,911 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45623/status 7222s 2024-11-23 22:29:58,912 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:29:58,936 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:41463'. Reason: failure-to-start- 7222s 2024-11-23 22:29:58,936 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:34053'. Reason: failure-to-start- 7222s 2024-11-23 22:29:58,938 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43493': TLS handshake failed with remote 'tls://127.0.0.1:40164': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:29:58,938 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43493': TLS handshake failed with remote 'tls://127.0.0.1:40172': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:29:58,938 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7222s comm = await self.rpc.connect(saddr) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 7222s return await self._connect(addr=addr, timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 7222s comm = await connect( 7222s ^^^^^^^^^^^^^^ 7222s ...<4 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Nanny start timed out after 0s. 7222s 2024-11-23 22:29:59,944 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:29:59,951 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45297 7222s 2024-11-23 22:29:59,952 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41253/status 7222s 2024-11-23 22:29:59,952 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:29:59,972 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:41871'. Reason: failure-to-start- 7222s 2024-11-23 22:29:59,973 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:35443'. Reason: failure-to-start- 7222s 2024-11-23 22:29:59,973 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45297': TLS handshake failed with remote 'tls://127.0.0.1:42052': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:29:59,974 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45297': TLS handshake failed with remote 'tls://127.0.0.1:42062': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:29:59,974 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7222s comm = await self.rpc.connect(saddr) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 7222s return await self._connect(addr=addr, timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 7222s comm = await connect( 7222s ^^^^^^^^^^^^^^ 7222s ...<4 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Nanny start timed out after 0s. 7222s 2024-11-23 22:30:00,980 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:30:00,989 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44063 7222s 2024-11-23 22:30:00,989 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34125/status 7222s 2024-11-23 22:30:00,990 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:30:01,014 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:46569'. Reason: failure-to-start- 7222s 2024-11-23 22:30:01,014 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:35671'. Reason: failure-to-start- 7222s 2024-11-23 22:30:01,016 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44063': TLS handshake failed with remote 'tls://127.0.0.1:39082': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:30:01,016 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44063': TLS handshake failed with remote 'tls://127.0.0.1:39092': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:30:01,016 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7222s comm = await self.rpc.connect(saddr) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 7222s return await self._connect(addr=addr, timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 7222s comm = await connect( 7222s ^^^^^^^^^^^^^^ 7222s ...<4 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Nanny start timed out after 0s. 7222s 2024-11-23 22:30:02,022 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:30:02,030 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33955 7222s 2024-11-23 22:30:02,030 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36979/status 7222s 2024-11-23 22:30:02,030 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:30:02,052 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:44781'. Reason: failure-to-start- 7222s 2024-11-23 22:30:02,053 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:45249'. Reason: failure-to-start- 7222s 2024-11-23 22:30:02,054 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33955': TLS handshake failed with remote 'tls://127.0.0.1:51134': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:30:02,054 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33955': TLS handshake failed with remote 'tls://127.0.0.1:51146': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:30:02,054 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7222s comm = await self.rpc.connect(saddr) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 7222s return await self._connect(addr=addr, timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 7222s comm = await connect( 7222s ^^^^^^^^^^^^^^ 7222s ...<4 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Nanny start timed out after 0s. 7222s 2024-11-23 22:30:03,061 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:30:03,069 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46583 7222s 2024-11-23 22:30:03,069 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37467/status 7222s 2024-11-23 22:30:03,072 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:30:03,093 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:45975'. Reason: failure-to-start- 7222s 2024-11-23 22:30:03,093 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:42681'. Reason: failure-to-start- 7222s 2024-11-23 22:30:03,094 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46583': TLS handshake failed with remote 'tls://127.0.0.1:49506': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:30:03,094 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46583': TLS handshake failed with remote 'tls://127.0.0.1:49514': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:30:03,094 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7222s comm = await self.rpc.connect(saddr) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 7222s return await self._connect(addr=addr, timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 7222s comm = await connect( 7222s ^^^^^^^^^^^^^^ 7222s ...<4 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Nanny start timed out after 0s. 7222s 2024-11-23 22:30:04,100 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:30:04,107 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43755 7222s 2024-11-23 22:30:04,107 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35243/status 7222s 2024-11-23 22:30:04,108 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:30:04,127 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:42675'. Reason: failure-to-start- 7222s 2024-11-23 22:30:04,127 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:36783'. Reason: failure-to-start- 7222s 2024-11-23 22:30:04,130 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43755': TLS handshake failed with remote 'tls://127.0.0.1:55362': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:30:04,131 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43755': TLS handshake failed with remote 'tls://127.0.0.1:55376': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:30:04,131 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7222s comm = await self.rpc.connect(saddr) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 7222s return await self._connect(addr=addr, timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 7222s comm = await connect( 7222s ^^^^^^^^^^^^^^ 7222s ...<4 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Nanny start timed out after 0s. 7222s 2024-11-23 22:30:05,137 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:30:05,144 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41391 7222s 2024-11-23 22:30:05,145 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42807/status 7222s 2024-11-23 22:30:05,145 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:30:05,178 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:39667'. Reason: failure-to-start- 7222s 2024-11-23 22:30:05,178 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:35627'. Reason: failure-to-start- 7222s 2024-11-23 22:30:05,180 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41391': TLS handshake failed with remote 'tls://127.0.0.1:55684': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:30:05,180 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41391': TLS handshake failed with remote 'tls://127.0.0.1:55700': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:30:05,183 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7222s comm = await self.rpc.connect(saddr) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 7222s return await self._connect(addr=addr, timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 7222s comm = await connect( 7222s ^^^^^^^^^^^^^^ 7222s ...<4 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Nanny start timed out after 0s. 7222s 2024-11-23 22:30:06,190 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:30:06,198 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46673 7222s 2024-11-23 22:30:06,198 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39095/status 7222s 2024-11-23 22:30:06,199 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:30:06,254 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:45549'. Reason: failure-to-start- 7222s 2024-11-23 22:30:06,254 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:33055'. Reason: failure-to-start- 7222s 2024-11-23 22:30:06,255 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46673': TLS handshake failed with remote 'tls://127.0.0.1:57980': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:30:06,255 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46673': TLS handshake failed with remote 'tls://127.0.0.1:57994': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:30:06,260 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7222s comm = await self.rpc.connect(saddr) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 7222s return await self._connect(addr=addr, timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 7222s comm = await connect( 7222s ^^^^^^^^^^^^^^ 7222s ...<4 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Nanny start timed out after 0s. 7222s 2024-11-23 22:30:07,266 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:30:07,274 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36223 7222s 2024-11-23 22:30:07,274 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40381/status 7222s 2024-11-23 22:30:07,275 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:30:07,292 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:38173'. Reason: failure-to-start- 7222s 2024-11-23 22:30:07,292 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:46141'. Reason: failure-to-start- 7222s 2024-11-23 22:30:07,295 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36223': TLS handshake failed with remote 'tls://127.0.0.1:47742': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:30:07,296 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36223': TLS handshake failed with remote 'tls://127.0.0.1:47748': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:30:07,296 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7222s comm = await self.rpc.connect(saddr) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 7222s return await self._connect(addr=addr, timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 7222s comm = await connect( 7222s ^^^^^^^^^^^^^^ 7222s ...<4 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Nanny start timed out after 0s. 7222s 2024-11-23 22:30:08,302 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:30:08,311 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35911 7222s 2024-11-23 22:30:08,312 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41701/status 7222s 2024-11-23 22:30:08,312 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:30:08,337 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:33039'. Reason: failure-to-start- 7222s 2024-11-23 22:30:08,337 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:42973'. Reason: failure-to-start- 7222s 2024-11-23 22:30:08,340 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35911': TLS handshake failed with remote 'tls://127.0.0.1:51248': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:30:08,340 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35911': TLS handshake failed with remote 'tls://127.0.0.1:51250': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:30:08,341 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7222s comm = await self.rpc.connect(saddr) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 7222s return await self._connect(addr=addr, timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 7222s comm = await connect( 7222s ^^^^^^^^^^^^^^ 7222s ...<4 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Nanny start timed out after 0s. 7222s 2024-11-23 22:30:09,349 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:30:09,356 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36111 7222s 2024-11-23 22:30:09,357 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39601/status 7222s 2024-11-23 22:30:09,357 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:30:09,373 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:44363'. Reason: failure-to-start- 7222s 2024-11-23 22:30:09,373 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:38315'. Reason: failure-to-start- 7222s 2024-11-23 22:30:09,374 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36111': TLS handshake failed with remote 'tls://127.0.0.1:33480': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:30:09,374 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36111': TLS handshake failed with remote 'tls://127.0.0.1:33494': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:30:09,376 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7222s comm = await self.rpc.connect(saddr) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 7222s return await self._connect(addr=addr, timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 7222s comm = await connect( 7222s ^^^^^^^^^^^^^^ 7222s ...<4 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Nanny start timed out after 0s. 7222s 2024-11-23 22:30:10,384 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:30:10,391 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46005 7222s 2024-11-23 22:30:10,391 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44163/status 7222s 2024-11-23 22:30:10,392 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:30:10,420 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:44569'. Reason: failure-to-start- 7222s 2024-11-23 22:30:10,420 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:40637'. Reason: failure-to-start- 7222s 2024-11-23 22:30:10,424 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46005': TLS handshake failed with remote 'tls://127.0.0.1:43540': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:30:10,424 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46005': TLS handshake failed with remote 'tls://127.0.0.1:43544': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:30:10,428 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7222s comm = await self.rpc.connect(saddr) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 7222s return await self._connect(addr=addr, timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 7222s comm = await connect( 7222s ^^^^^^^^^^^^^^ 7222s ...<4 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Nanny start timed out after 0s. 7222s 2024-11-23 22:30:11,435 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:30:11,444 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38263 7222s 2024-11-23 22:30:11,444 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39017/status 7222s 2024-11-23 22:30:11,445 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:30:11,467 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:41139'. Reason: failure-to-start- 7222s 2024-11-23 22:30:11,468 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:40503'. Reason: failure-to-start- 7222s 2024-11-23 22:30:11,469 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38263': TLS handshake failed with remote 'tls://127.0.0.1:54550': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:30:11,469 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38263': TLS handshake failed with remote 'tls://127.0.0.1:54566': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:30:11,469 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7222s comm = await self.rpc.connect(saddr) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 7222s return await self._connect(addr=addr, timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 7222s comm = await connect( 7222s ^^^^^^^^^^^^^^ 7222s ...<4 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Nanny start timed out after 0s. 7222s 2024-11-23 22:30:12,476 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:30:12,483 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46389 7222s 2024-11-23 22:30:12,484 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43385/status 7222s 2024-11-23 22:30:12,484 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:30:12,508 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:41831'. Reason: failure-to-start- 7222s 2024-11-23 22:30:12,508 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:32961'. Reason: failure-to-start- 7222s 2024-11-23 22:30:12,512 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46389': TLS handshake failed with remote 'tls://127.0.0.1:38922': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:30:12,512 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46389': TLS handshake failed with remote 'tls://127.0.0.1:38938': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:30:12,512 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7222s comm = await self.rpc.connect(saddr) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 7222s return await self._connect(addr=addr, timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 7222s comm = await connect( 7222s ^^^^^^^^^^^^^^ 7222s ...<4 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Nanny start timed out after 0s. 7222s 2024-11-23 22:30:13,519 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:30:13,527 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42895 7222s 2024-11-23 22:30:13,528 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42305/status 7222s 2024-11-23 22:30:13,528 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:30:13,550 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:45925'. Reason: failure-to-start- 7222s 2024-11-23 22:30:13,550 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:43669'. Reason: failure-to-start- 7222s 2024-11-23 22:30:13,554 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42895': TLS handshake failed with remote 'tls://127.0.0.1:49370': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:30:13,554 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42895': TLS handshake failed with remote 'tls://127.0.0.1:49374': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:30:13,554 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7222s comm = await self.rpc.connect(saddr) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 7222s return await self._connect(addr=addr, timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 7222s comm = await connect( 7222s ^^^^^^^^^^^^^^ 7222s ...<4 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Nanny start timed out after 0s. 7222s 2024-11-23 22:30:14,560 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:30:14,567 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44057 7222s 2024-11-23 22:30:14,568 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34343/status 7222s 2024-11-23 22:30:14,568 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:30:14,595 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:35379'. Reason: failure-to-start- 7222s 2024-11-23 22:30:14,595 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:45555'. Reason: failure-to-start- 7222s 2024-11-23 22:30:14,596 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44057': TLS handshake failed with remote 'tls://127.0.0.1:38324': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:30:14,596 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44057': TLS handshake failed with remote 'tls://127.0.0.1:38328': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:30:14,597 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7222s comm = await self.rpc.connect(saddr) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 7222s return await self._connect(addr=addr, timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 7222s comm = await connect( 7222s ^^^^^^^^^^^^^^ 7222s ...<4 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Nanny start timed out after 0s. 7222s 2024-11-23 22:30:15,602 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:30:15,610 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42631 7222s 2024-11-23 22:30:15,611 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39675/status 7222s 2024-11-23 22:30:15,611 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:30:15,635 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:44577'. Reason: failure-to-start- 7222s 2024-11-23 22:30:15,635 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:36041'. Reason: failure-to-start- 7222s 2024-11-23 22:30:15,637 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42631': TLS handshake failed with remote 'tls://127.0.0.1:60594': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:30:15,637 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42631': TLS handshake failed with remote 'tls://127.0.0.1:60600': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:30:15,637 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7222s comm = await self.rpc.connect(saddr) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 7222s return await self._connect(addr=addr, timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 7222s comm = await connect( 7222s ^^^^^^^^^^^^^^ 7222s ...<4 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Nanny start timed out after 0s. 7222s 2024-11-23 22:30:16,644 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:30:16,653 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39729 7222s 2024-11-23 22:30:16,654 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38267/status 7222s 2024-11-23 22:30:16,654 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:30:16,681 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:43459'. Reason: failure-to-start- 7222s 2024-11-23 22:30:16,681 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:37461'. Reason: failure-to-start- 7222s 2024-11-23 22:30:16,682 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39729': TLS handshake failed with remote 'tls://127.0.0.1:55446': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:30:16,682 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39729': TLS handshake failed with remote 'tls://127.0.0.1:55452': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:30:16,685 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7222s comm = await self.rpc.connect(saddr) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 7222s return await self._connect(addr=addr, timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 7222s comm = await connect( 7222s ^^^^^^^^^^^^^^ 7222s ...<4 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Nanny start timed out after 0s. 7222s 2024-11-23 22:30:17,692 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:30:17,700 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38783 7222s 2024-11-23 22:30:17,701 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38071/status 7222s 2024-11-23 22:30:17,701 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:30:17,726 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:39597'. Reason: failure-to-start- 7222s 2024-11-23 22:30:17,726 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:40707'. Reason: failure-to-start- 7222s 2024-11-23 22:30:17,727 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38783': TLS handshake failed with remote 'tls://127.0.0.1:50464': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:30:17,728 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38783': TLS handshake failed with remote 'tls://127.0.0.1:50466': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:30:17,728 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7222s comm = await self.rpc.connect(saddr) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 7222s return await self._connect(addr=addr, timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 7222s comm = await connect( 7222s ^^^^^^^^^^^^^^ 7222s ...<4 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Nanny start timed out after 0s. 7222s ___________________________ test_security_dict_input ___________________________ 7222s 7222s self = 7222s address = '127.0.0.1:36395', deserialize = True 7222s connection_args = {'extra_conn_args': {}, 'require_encryption': True, 'ssl_context': } 7222s ip = '127.0.0.1', port = 36395 7222s kwargs = {'ssl_options': } 7222s 7222s async def connect(self, address, deserialize=True, **connection_args): 7222s self._check_encryption(address, connection_args) 7222s ip, port = parse_host_port(address) 7222s kwargs = self._get_connect_args(**connection_args) 7222s 7222s try: 7222s # server_hostname option (for SNI) only works with tornado.iostream.IOStream 7222s if "server_hostname" in kwargs: 7222s stream = await self.client.connect( 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE 7222s ) 7222s stream = await stream.start_tls(False, **kwargs) 7222s else: 7222s > stream = await self.client.connect( 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ) 7222s 7222s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:546: 7222s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7222s /usr/lib/python3/dist-packages/tornado/tcpclient.py:292: in connect 7222s stream = await stream.start_tls( 7222s /usr/lib/python3/dist-packages/tornado/iostream.py:1367: in _do_ssl_handshake 7222s self.socket.do_handshake() 7222s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7222s 7222s self = , block = False 7222s 7222s @_sslcopydoc 7222s def do_handshake(self, block=False): 7222s self._check_connected() 7222s timeout = self.gettimeout() 7222s try: 7222s if timeout == 0.0 and block: 7222s self.settimeout(None) 7222s > self._sslobj.do_handshake() 7222s E ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 7222s 7222s /usr/lib/python3.13/ssl.py:1372: SSLCertVerificationError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s self = 7222s 7222s async def _register_with_scheduler(self) -> None: 7222s self.periodic_callbacks["keep-alive"].stop() 7222s self.periodic_callbacks["heartbeat"].stop() 7222s start = time() 7222s if self.contact_address is None: 7222s self.contact_address = self.address 7222s logger.info("-" * 49) 7222s 7222s # Worker reconnection is not supported 7222s assert not self.data 7222s assert not self.state.tasks 7222s 7222s while True: 7222s try: 7222s _start = time() 7222s > comm = await connect(self.scheduler.address, **self.connection_args) 7222s 7222s /usr/lib/python3/dist-packages/distributed/worker.py:1179: 7222s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7222s /usr/lib/python3/dist-packages/distributed/comm/core.py:342: in connect 7222s comm = await wait_for( 7222s /usr/lib/python3/dist-packages/distributed/utils.py:1960: in wait_for 7222s return await fut 7222s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7222s 7222s self = 7222s address = '127.0.0.1:36395', deserialize = True 7222s connection_args = {'extra_conn_args': {}, 'require_encryption': True, 'ssl_context': } 7222s ip = '127.0.0.1', port = 36395 7222s kwargs = {'ssl_options': } 7222s 7222s async def connect(self, address, deserialize=True, **connection_args): 7222s self._check_encryption(address, connection_args) 7222s ip, port = parse_host_port(address) 7222s kwargs = self._get_connect_args(**connection_args) 7222s 7222s try: 7222s # server_hostname option (for SNI) only works with tornado.iostream.IOStream 7222s if "server_hostname" in kwargs: 7222s stream = await self.client.connect( 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE 7222s ) 7222s stream = await stream.start_tls(False, **kwargs) 7222s else: 7222s stream = await self.client.connect( 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ) 7222s 7222s # Under certain circumstances tornado will have a closed connection with an 7222s # error and not raise a StreamClosedError. 7222s # 7222s # This occurs with tornado 5.x and openssl 1.1+ 7222s if stream.closed() and stream.error: 7222s raise StreamClosedError(stream.error) 7222s 7222s except StreamClosedError as e: 7222s # The socket connect() call failed 7222s convert_stream_closed_error(self, e) 7222s except SSLCertVerificationError as err: 7222s > raise FatalCommClosedError( 7222s "TLS certificate does not match. Check your security settings. " 7222s "More info at https://distributed.dask.org/en/latest/tls.html" 7222s ) from err 7222s E distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 7222s 7222s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:561: FatalCommClosedError 7222s 7222s During handling of the above exception, another exception occurred: 7222s 7222s @gen_test() 7222s async def test_security_dict_input(): 7222s conf = tls_config() 7222s ca_file = conf["distributed"]["comm"]["tls"]["ca-file"] 7222s client = conf["distributed"]["comm"]["tls"]["client"]["cert"] 7222s worker = conf["distributed"]["comm"]["tls"]["worker"]["cert"] 7222s scheduler = conf["distributed"]["comm"]["tls"]["scheduler"]["cert"] 7222s 7222s async with Scheduler( 7222s host="localhost", 7222s dashboard_address=":0", 7222s security={"tls_ca_file": ca_file, "tls_scheduler_cert": scheduler}, 7222s ) as s: 7222s assert s.address.startswith("tls://") 7222s > async with Worker( 7222s s.address, security={"tls_ca_file": ca_file, "tls_worker_cert": worker} 7222s ) as w: 7222s 7222s /usr/lib/python3/dist-packages/distributed/tests/test_tls_functional.py:225: 7222s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7222s /usr/lib/python3/dist-packages/distributed/core.py:678: in __aenter__ 7222s await self 7222s /usr/lib/python3/dist-packages/distributed/core.py:664: in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s /usr/lib/python3/dist-packages/distributed/utils.py:1960: in wait_for 7222s return await fut 7222s /usr/lib/python3/dist-packages/distributed/worker.py:1480: in start_unsafe 7222s await self._register_with_scheduler() 7222s /usr/lib/python3/dist-packages/distributed/worker.py:1218: in _register_with_scheduler 7222s await asyncio.sleep(0.1) 7222s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7222s 7222s delay = 0.1, result = None 7222s 7222s async def sleep(delay, result=None): 7222s """Coroutine that completes after a given time (in seconds).""" 7222s if delay <= 0: 7222s await __sleep0() 7222s return result 7222s 7222s if math.isnan(delay): 7222s raise ValueError("Invalid delay: NaN (not a number)") 7222s 7222s loop = events.get_running_loop() 7222s future = loop.create_future() 7222s h = loop.call_later(delay, 7222s futures._set_result_unless_cancelled, 7222s future, result) 7222s try: 7222s > return await future 7222s E asyncio.exceptions.CancelledError 7222s 7222s /usr/lib/python3.13/asyncio/tasks.py:718: CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s args = (), kwds = {} 7222s 7222s @wraps(func) 7222s def inner(*args, **kwds): 7222s with self._recreate_cm(): 7222s > return func(*args, **kwds) 7222s 7222s /usr/lib/python3.13/contextlib.py:85: 7222s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7222s /usr/lib/python3.13/contextlib.py:85: in inner 7222s return func(*args, **kwds) 7222s /usr/lib/python3/dist-packages/distributed/utils_test.py:746: in test_func 7222s return _run_and_close_tornado(async_fn_outer, func, *args, **kwargs) 7222s /usr/lib/python3/dist-packages/distributed/utils_test.py:378: in _run_and_close_tornado 7222s return asyncio_run(inner_fn(), loop_factory=get_loop_factory()) 7222s /usr/lib/python3.13/asyncio/runners.py:194: in run 7222s return runner.run(main) 7222s /usr/lib/python3.13/asyncio/runners.py:118: in run 7222s return self._loop.run_until_complete(task) 7222s /usr/lib/python3.13/asyncio/base_events.py:720: in run_until_complete 7222s return future.result() 7222s /usr/lib/python3/dist-packages/distributed/utils_test.py:375: in inner_fn 7222s return await async_fn(*args, **kwargs) 7222s /usr/lib/python3/dist-packages/distributed/utils_test.py:736: in async_fn_outer 7222s return await utils_wait_for(async_fn(*args, **kwargs), timeout) 7222s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 7222s async with asyncio.timeout(timeout): 7222s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7222s 7222s self = 7222s exc_type = 7222s exc_val = CancelledError(), exc_tb = 7222s 7222s async def __aexit__( 7222s self, 7222s exc_type: Optional[Type[BaseException]], 7222s exc_val: Optional[BaseException], 7222s exc_tb: Optional[TracebackType], 7222s ) -> Optional[bool]: 7222s assert self._state in (_State.ENTERED, _State.EXPIRING) 7222s 7222s if self._timeout_handler is not None: 7222s self._timeout_handler.cancel() 7222s self._timeout_handler = None 7222s 7222s if self._state is _State.EXPIRING: 7222s self._state = _State.EXPIRED 7222s 7222s if self._task.uncancel() <= self._cancelling and exc_type is not None: 7222s # Since there are no new cancel requests, we're 7222s # handling this. 7222s if issubclass(exc_type, exceptions.CancelledError): 7222s > raise TimeoutError from exc_val 7222s E TimeoutError 7222s 7222s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 7222s ----------------------------- Captured stderr call ----------------------------- 7222s 2024-11-23 22:30:18,844 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:30:18,852 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:18,852 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38917/status 7222s 2024-11-23 22:30:18,853 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:30:18,861 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46855 7222s 2024-11-23 22:30:18,862 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46855 7222s 2024-11-23 22:30:18,862 - distributed.worker - INFO - dashboard at: 127.0.0.1:38021 7222s 2024-11-23 22:30:18,862 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:18,862 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:30:18,862 - distributed.worker - INFO - Threads: 8 7222s 2024-11-23 22:30:18,862 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:30:18,862 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-mpgxqql8 7222s 2024-11-23 22:30:18,862 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:30:18,870 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:18,870 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:38228': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:18,977 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:18,977 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:38232': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:19,085 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:19,086 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:38248': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:19,193 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:19,193 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:38254': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:19,301 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:19,301 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:38266': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:19,408 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:19,409 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:38274': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:19,518 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:19,518 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:38290': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:19,625 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:19,626 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:38304': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:19,734 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:19,735 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:38306': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:19,842 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:19,842 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:38312': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:19,950 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:19,950 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:38318': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:20,058 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:20,058 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:38322': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:20,165 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:20,165 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:38324': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:20,272 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:20,273 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:38340': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:20,379 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:20,380 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:38356': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:20,488 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:20,489 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:38358': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:20,596 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:20,597 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:38364': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:20,704 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:20,704 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:38366': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:20,812 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:20,812 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:38368': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:20,919 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:20,920 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:38376': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:21,029 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:21,030 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:38386': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:21,138 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:21,138 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:38392': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:21,246 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:21,247 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:38408': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:21,355 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:21,359 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:38416': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:21,462 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:21,463 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:38418': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:21,571 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:21,571 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:39902': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:21,678 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:21,679 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:39910': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:21,786 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:21,786 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:39924': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:21,894 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:21,894 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:39932': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:22,002 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:22,002 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:39944': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:22,110 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:22,111 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:39952': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:22,218 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:22,219 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:39958': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:22,328 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:22,329 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:39972': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:22,436 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:22,436 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:39980': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:22,544 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:22,544 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:39982': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:22,652 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:22,652 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:39994': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:22,760 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:22,760 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:40006': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:22,867 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:22,868 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:40020': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:22,975 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:22,976 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:40022': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:23,083 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:23,083 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:40024': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:23,191 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:23,192 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:40036': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:23,299 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:23,299 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:40052': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:23,407 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:23,407 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:40056': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:23,522 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:23,522 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:40068': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:23,630 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:23,631 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:40078': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:23,738 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:23,739 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:40080': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:23,846 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:23,847 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:40084': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:23,955 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:23,955 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:40088': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:24,062 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:24,062 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:40104': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:24,170 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:24,171 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:40114': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:24,278 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:24,279 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:40124': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:24,386 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:24,387 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:40130': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:24,494 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:24,495 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:40134': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:24,602 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:24,602 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:40142': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:24,710 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:24,710 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:40152': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:24,818 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:24,818 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:40160': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:24,926 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:24,926 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:40164': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:25,034 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:25,034 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:40178': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:25,141 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:25,141 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:40186': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:25,249 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:25,249 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:40196': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:25,358 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:25,361 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:40208': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:25,465 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:25,465 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:40216': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:25,573 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:25,573 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:40230': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:25,680 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:25,681 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:40234': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:25,789 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:25,789 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:40248': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:25,896 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:25,897 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:40252': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:26,004 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:26,004 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:40268': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:26,111 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:26,111 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:40284': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:26,219 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:26,220 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:40286': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:26,327 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:26,328 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:40290': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:26,435 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:26,436 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:40292': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:26,543 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:26,544 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:40302': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:26,652 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:26,652 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:40308': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:26,760 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:26,760 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:40314': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:26,867 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:26,867 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:40326': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:26,974 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:26,975 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:40336': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:27,083 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:27,083 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:40344': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:27,190 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:27,190 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:40356': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:27,298 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:27,298 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:40362': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:27,405 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:27,406 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:40364': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:27,514 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:27,514 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:40380': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:27,622 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:27,622 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:40384': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:27,729 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:27,730 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:40388': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:27,837 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:27,838 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:40398': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:27,946 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:27,946 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:40410': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:28,054 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:28,054 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:40422': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:28,161 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:28,161 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:40434': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:28,269 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:28,269 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:40436': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:28,377 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:28,377 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:40450': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:28,487 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:28,487 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:40460': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:28,595 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:28,595 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:40462': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:28,703 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:28,704 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:40472': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:28,811 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:28,811 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:40482': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:28,919 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:28,920 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:40486': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:29,027 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:29,028 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:40494': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:29,135 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:29,135 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:40506': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:29,244 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:29,244 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:40516': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:29,352 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:29,352 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:40524': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:29,460 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:29,461 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:40540': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:29,568 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:29,568 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:40548': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:29,676 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:29,676 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:40558': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:29,784 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:29,784 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:40570': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:29,892 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:29,892 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:40586': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:30,000 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:30,000 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:40590': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:30,108 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:30,108 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:40598': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:30,216 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:30,217 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:40612': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:30,324 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:30,325 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:40616': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:30,433 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:30,434 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:40624': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:30,541 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:30,542 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:40632': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:30,649 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:30,649 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:40648': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:30,757 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:30,758 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:40654': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:30,864 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:30,865 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:40660': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:30,973 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:30,973 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:40666': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:31,081 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:31,081 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:40668': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:31,188 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:31,188 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:40672': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:31,296 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:31,297 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:40686': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:31,404 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:31,405 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:40688': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:31,513 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:31,515 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:40704': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:31,623 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:31,623 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:50794': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:31,731 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:31,731 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:50806': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:31,839 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:31,839 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:50808': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:31,946 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:31,946 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:50814': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:32,054 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:32,055 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:50818': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:32,161 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:32,162 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:50824': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:32,269 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:32,270 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:50828': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:32,378 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:32,379 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:50838': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:32,486 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:32,487 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:50842': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:32,594 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:32,595 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:50848': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:32,703 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:32,703 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:50864': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:32,811 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:32,811 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:50880': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:32,918 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:32,919 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:50882': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:33,027 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:33,027 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:50888': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:33,135 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:33,135 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:50892': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:33,243 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:33,243 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:50894': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:33,351 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:33,351 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:50896': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:33,459 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:33,459 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:50898': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:33,567 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:33,567 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:50914': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:33,683 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:33,683 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:50924': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:33,790 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:33,791 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:50926': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:33,898 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:33,898 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:50942': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:34,006 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:34,006 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:50956': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:34,113 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:34,114 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:50972': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:34,221 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:34,221 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:50988': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:34,329 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:34,330 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:50998': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:34,437 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:34,437 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:51002': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:34,545 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:34,545 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:51006': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:34,654 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:34,655 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:51022': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:34,762 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:34,762 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:51034': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:34,870 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:34,870 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:51042': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:34,978 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:34,978 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:51058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:35,086 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:35,086 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:51074': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:35,193 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:35,194 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:51080': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:35,302 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:35,302 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:51088': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:35,409 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:35,409 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:51104': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:35,517 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:35,517 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:51106': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:35,625 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:35,626 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:51108': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:35,733 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:35,734 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:51124': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:35,841 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:35,842 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:51126': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:35,950 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:35,950 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:51138': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:36,058 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:36,058 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:51142': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:36,166 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:36,167 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:51152': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:36,274 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:36,275 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:51168': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:36,383 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:36,383 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:51176': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:36,491 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:36,491 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:51178': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:36,599 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:36,599 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:51194': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:36,706 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:36,707 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:51208': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:36,814 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:36,815 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:51218': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:36,924 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:36,924 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:51224': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:37,033 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:37,033 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:51234': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:37,140 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:37,140 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:51250': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:37,250 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:37,251 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:51264': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:37,363 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:37,363 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:51280': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:37,470 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:37,471 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:51286': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:37,579 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:37,580 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:51288': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:37,688 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:37,688 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:51294': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:37,797 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:37,797 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:51298': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:37,906 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:37,907 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:51304': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:38,014 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:38,015 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:51308': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:38,122 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:38,122 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:51310': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:38,230 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:38,230 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:51318': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:38,338 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:38,338 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:51332': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:38,446 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:38,446 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:51336': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:38,554 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:38,555 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:51348': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:38,662 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:38,663 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:51360': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:38,770 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:38,771 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:51366': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:38,878 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:38,879 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:51370': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:38,986 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:38,986 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:51380': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:39,094 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:39,094 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:51394': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:39,202 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:39,203 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:51396': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:39,310 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:39,311 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:51398': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:39,418 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:39,418 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:51412': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:39,526 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:39,526 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:51420': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:39,634 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:39,635 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:51436': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:39,742 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:39,743 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:51448': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:39,850 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:39,850 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:51458': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:39,958 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:39,959 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:51466': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:40,066 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:40,066 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:51478': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:40,175 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:40,175 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:51482': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:40,283 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:40,283 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:51496': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:40,392 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:40,392 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:51500': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:40,500 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:40,500 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:51516': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:40,608 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:40,608 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:51520': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:40,716 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:40,716 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:51528': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:40,824 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:40,826 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:51538': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:40,932 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:40,933 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:51544': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:41,040 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:41,041 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:51546': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:41,149 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:41,149 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:51560': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:41,257 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:41,257 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:51572': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:41,364 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:41,364 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:51578': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:41,471 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:41,471 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:51592': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:41,580 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:41,580 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:37822': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:41,688 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:41,689 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:37828': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:41,796 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:41,797 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:37834': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:41,904 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:41,905 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:37846': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:42,012 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:42,013 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:37860': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:42,121 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:42,121 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:37864': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:42,229 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:42,230 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:37880': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:42,337 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:42,337 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:37882': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:42,444 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:42,445 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:37886': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:42,552 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:42,553 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:37902': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:42,660 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:42,661 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:37912': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:42,768 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:42,768 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:37922': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:42,875 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:42,876 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:37928': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:42,983 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:42,984 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:37936': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:43,092 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:43,093 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:37942': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:43,199 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:43,200 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:37954': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:43,308 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:43,308 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:37960': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:43,416 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:43,416 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:37968': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:43,524 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:43,524 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:37984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:43,632 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:43,632 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:37992': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:43,740 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:43,740 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:37996': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:43,848 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:43,848 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:38006': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:43,957 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:43,958 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:38008': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:44,076 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:44,076 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:38022': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:44,184 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:44,184 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:38030': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:44,292 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:44,292 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:38046': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:44,400 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:44,400 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:38058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:44,508 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:44,508 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:38068': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:44,616 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:44,616 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:38072': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:44,724 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:44,724 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:38080': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:44,833 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:44,833 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:38084': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:44,941 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:44,942 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:38096': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:45,049 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:45,049 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:38108': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:45,157 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:45,158 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:38122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:45,265 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:45,266 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:38132': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:45,373 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:45,374 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:38148': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:45,481 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:45,482 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:38160': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:45,589 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:45,590 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:38162': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:45,698 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:45,698 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:38172': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:45,806 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:45,806 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:38176': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:45,913 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:45,914 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:38178': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:46,021 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:46,022 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:38192': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:46,130 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:46,130 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:38204': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:46,238 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:46,238 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:38208': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:46,346 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:46,347 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:38214': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:46,455 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:46,455 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:38230': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:46,563 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:46,564 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:38232': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:46,671 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:46,671 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:38236': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:46,780 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:46,780 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:38248': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:46,888 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:46,889 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:38262': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:46,996 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:46,997 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:38278': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:47,104 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:47,105 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:38290': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:47,213 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:47,214 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:38304': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:47,321 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:47,322 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:38310': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:47,429 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:47,429 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:38316': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:47,537 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:47,537 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:38318': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:47,645 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:47,645 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:38324': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:47,753 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:47,753 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:38330': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:47,864 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:47,864 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:38340': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:47,971 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:47,971 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:38348': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:48,080 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:48,081 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:38354': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:48,188 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:48,188 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:38356': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:48,296 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:48,296 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:38368': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:48,404 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:48,404 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:38372': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:48,512 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:48,512 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:38382': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:48,619 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:48,619 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:38392': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:48,727 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36395 7222s 2024-11-23 22:30:48,727 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36395': TLS handshake failed with remote 'tls://127.0.0.1:38396': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:48,827 - distributed.scheduler - INFO - Scheduler closing due to unknown reason... 7222s 2024-11-23 22:30:48,828 - distributed.scheduler - INFO - Scheduler closing all comms 7222s _____________________________ test_gen_cluster_tls _____________________________ 7222s 7222s fut = , timeout = 0 7222s 7222s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 7222s async with asyncio.timeout(timeout): 7222s > return await fut 7222s 7222s /usr/lib/python3/dist-packages/distributed/utils.py:1960: 7222s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7222s /usr/lib/python3/dist-packages/distributed/worker.py:1480: in start_unsafe 7222s await self._register_with_scheduler() 7222s /usr/lib/python3/dist-packages/distributed/worker.py:1179: in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s /usr/lib/python3/dist-packages/distributed/comm/core.py:342: in connect 7222s comm = await wait_for( 7222s /usr/lib/python3/dist-packages/distributed/utils.py:1960: in wait_for 7222s return await fut 7222s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:546: in connect 7222s stream = await self.client.connect( 7222s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7222s 7222s self = , host = '127.0.0.1' 7222s port = 46447, af = 7222s ssl_options = 7222s max_buffer_size = 8364507136.0, source_ip = None, source_port = None 7222s timeout = None 7222s 7222s async def connect( 7222s self, 7222s host: str, 7222s port: int, 7222s af: socket.AddressFamily = socket.AF_UNSPEC, 7222s ssl_options: Optional[Union[Dict[str, Any], ssl.SSLContext]] = None, 7222s max_buffer_size: Optional[int] = None, 7222s source_ip: Optional[str] = None, 7222s source_port: Optional[int] = None, 7222s timeout: Optional[Union[float, datetime.timedelta]] = None, 7222s ) -> IOStream: 7222s """Connect to the given host and port. 7222s 7222s Asynchronously returns an `.IOStream` (or `.SSLIOStream` if 7222s ``ssl_options`` is not None). 7222s 7222s Using the ``source_ip`` kwarg, one can specify the source 7222s IP address to use when establishing the connection. 7222s In case the user needs to resolve and 7222s use a specific interface, it has to be handled outside 7222s of Tornado as this depends very much on the platform. 7222s 7222s Raises `TimeoutError` if the input future does not complete before 7222s ``timeout``, which may be specified in any form allowed by 7222s `.IOLoop.add_timeout` (i.e. a `datetime.timedelta` or an absolute time 7222s relative to `.IOLoop.time`) 7222s 7222s Similarly, when the user requires a certain source port, it can 7222s be specified using the ``source_port`` arg. 7222s 7222s .. versionchanged:: 4.5 7222s Added the ``source_ip`` and ``source_port`` arguments. 7222s 7222s .. versionchanged:: 5.0 7222s Added the ``timeout`` argument. 7222s """ 7222s if timeout is not None: 7222s if isinstance(timeout, numbers.Real): 7222s timeout = IOLoop.current().time() + timeout 7222s elif isinstance(timeout, datetime.timedelta): 7222s timeout = IOLoop.current().time() + timeout.total_seconds() 7222s else: 7222s raise TypeError("Unsupported timeout %r" % timeout) 7222s if timeout is not None: 7222s addrinfo = await gen.with_timeout( 7222s timeout, self.resolver.resolve(host, port, af) 7222s ) 7222s else: 7222s addrinfo = await self.resolver.resolve(host, port, af) 7222s connector = _Connector( 7222s addrinfo, 7222s functools.partial( 7222s self._create_stream, 7222s max_buffer_size, 7222s source_ip=source_ip, 7222s source_port=source_port, 7222s ), 7222s ) 7222s > af, addr, stream = await connector.start(connect_timeout=timeout) 7222s E asyncio.exceptions.CancelledError 7222s 7222s /usr/lib/python3/dist-packages/tornado/tcpclient.py:279: CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s self = 7222s 7222s @final 7222s async def start(self): 7222s async with self._startup_lock: 7222s if self.status == Status.failed: 7222s assert self.__startup_exc is not None 7222s raise self.__startup_exc 7222s elif self.status != Status.init: 7222s return self 7222s timeout = getattr(self, "death_timeout", None) 7222s 7222s async def _close_on_failure(exc: Exception) -> None: 7222s await self.close(reason=f"failure-to-start-{str(type(exc))}") 7222s self.status = Status.failed 7222s self.__startup_exc = exc 7222s 7222s try: 7222s > await wait_for(self.start_unsafe(), timeout=timeout) 7222s 7222s /usr/lib/python3/dist-packages/distributed/core.py:664: 7222s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7222s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 7222s async with asyncio.timeout(timeout): 7222s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7222s 7222s self = 7222s exc_type = 7222s exc_val = CancelledError(), exc_tb = 7222s 7222s async def __aexit__( 7222s self, 7222s exc_type: Optional[Type[BaseException]], 7222s exc_val: Optional[BaseException], 7222s exc_tb: Optional[TracebackType], 7222s ) -> Optional[bool]: 7222s assert self._state in (_State.ENTERED, _State.EXPIRING) 7222s 7222s if self._timeout_handler is not None: 7222s self._timeout_handler.cancel() 7222s self._timeout_handler = None 7222s 7222s if self._state is _State.EXPIRING: 7222s self._state = _State.EXPIRED 7222s 7222s if self._task.uncancel() <= self._cancelling and exc_type is not None: 7222s # Since there are no new cancel requests, we're 7222s # handling this. 7222s if issubclass(exc_type, exceptions.CancelledError): 7222s > raise TimeoutError from exc_val 7222s E TimeoutError 7222s 7222s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s @contextlib.asynccontextmanager 7222s async def _cluster_factory(): 7222s workers = [] 7222s s = None 7222s try: 7222s for _ in range(60): 7222s try: 7222s > s, ws = await start_cluster( 7222s nthreads, 7222s scheduler, 7222s security=security, 7222s Worker=Worker, 7222s scheduler_kwargs=scheduler_kwargs, 7222s worker_kwargs=merge( 7222s {"death_timeout": min(15, int(deadline.remaining))}, 7222s worker_kwargs, 7222s ), 7222s ) 7222s 7222s /usr/lib/python3/dist-packages/distributed/utils_test.py:966: 7222s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7222s /usr/lib/python3/dist-packages/distributed/utils_test.py:789: in start_cluster 7222s await asyncio.gather(*workers) 7222s /usr/lib/python3.13/asyncio/tasks.py:737: in _wrap_awaitable 7222s return await awaitable 7222s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7222s 7222s self = 7222s 7222s @final 7222s async def start(self): 7222s async with self._startup_lock: 7222s if self.status == Status.failed: 7222s assert self.__startup_exc is not None 7222s raise self.__startup_exc 7222s elif self.status != Status.init: 7222s return self 7222s timeout = getattr(self, "death_timeout", None) 7222s 7222s async def _close_on_failure(exc: Exception) -> None: 7222s await self.close(reason=f"failure-to-start-{str(type(exc))}") 7222s self.status = Status.failed 7222s self.__startup_exc = exc 7222s 7222s try: 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s except asyncio.TimeoutError as exc: 7222s await _close_on_failure(exc) 7222s > raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s E TimeoutError: Worker start timed out after 0s. 7222s 7222s /usr/lib/python3/dist-packages/distributed/core.py:667: TimeoutError 7222s 7222s During handling of the above exception, another exception occurred: 7222s 7222s fut = ._..test_func..async_fn at 0xe9b48110> 7222s timeout = 60 7222s 7222s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 7222s async with asyncio.timeout(timeout): 7222s > return await fut 7222s 7222s /usr/lib/python3/dist-packages/distributed/utils.py:1960: 7222s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7222s /usr/lib/python3/dist-packages/distributed/utils_test.py:999: in async_fn 7222s _cluster_factory() as (s, workers), 7222s /usr/lib/python3.13/contextlib.py:214: in __aenter__ 7222s return await anext(self.gen) 7222s /usr/lib/python3/dist-packages/distributed/utils_test.py:983: in _cluster_factory 7222s await asyncio.sleep(1) 7222s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7222s 7222s delay = 1, result = None 7222s 7222s async def sleep(delay, result=None): 7222s """Coroutine that completes after a given time (in seconds).""" 7222s if delay <= 0: 7222s await __sleep0() 7222s return result 7222s 7222s if math.isnan(delay): 7222s raise ValueError("Invalid delay: NaN (not a number)") 7222s 7222s loop = events.get_running_loop() 7222s future = loop.create_future() 7222s h = loop.call_later(delay, 7222s futures._set_result_unless_cancelled, 7222s future, result) 7222s try: 7222s > return await future 7222s E asyncio.exceptions.CancelledError 7222s 7222s /usr/lib/python3.13/asyncio/tasks.py:718: CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s args = (), kwds = {} 7222s 7222s @wraps(func) 7222s def inner(*args, **kwds): 7222s with self._recreate_cm(): 7222s > return func(*args, **kwds) 7222s 7222s /usr/lib/python3.13/contextlib.py:85: 7222s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7222s /usr/lib/python3.13/contextlib.py:85: in inner 7222s return func(*args, **kwds) 7222s /usr/lib/python3/dist-packages/distributed/utils_test.py:1102: in test_func 7222s return _run_and_close_tornado(async_fn_outer) 7222s /usr/lib/python3/dist-packages/distributed/utils_test.py:378: in _run_and_close_tornado 7222s return asyncio_run(inner_fn(), loop_factory=get_loop_factory()) 7222s /usr/lib/python3.13/asyncio/runners.py:194: in run 7222s return runner.run(main) 7222s /usr/lib/python3.13/asyncio/runners.py:118: in run 7222s return self._loop.run_until_complete(task) 7222s /usr/lib/python3.13/asyncio/base_events.py:720: in run_until_complete 7222s return future.result() 7222s /usr/lib/python3/dist-packages/distributed/utils_test.py:375: in inner_fn 7222s return await async_fn(*args, **kwargs) 7222s /usr/lib/python3/dist-packages/distributed/utils_test.py:1099: in async_fn_outer 7222s return await utils_wait_for(async_fn(), timeout=timeout * 2) 7222s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 7222s async with asyncio.timeout(timeout): 7222s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7222s 7222s self = 7222s exc_type = 7222s exc_val = CancelledError(), exc_tb = 7222s 7222s async def __aexit__( 7222s self, 7222s exc_type: Optional[Type[BaseException]], 7222s exc_val: Optional[BaseException], 7222s exc_tb: Optional[TracebackType], 7222s ) -> Optional[bool]: 7222s assert self._state in (_State.ENTERED, _State.EXPIRING) 7222s 7222s if self._timeout_handler is not None: 7222s self._timeout_handler.cancel() 7222s self._timeout_handler = None 7222s 7222s if self._state is _State.EXPIRING: 7222s self._state = _State.EXPIRED 7222s 7222s if self._task.uncancel() <= self._cancelling and exc_type is not None: 7222s # Since there are no new cancel requests, we're 7222s # handling this. 7222s if issubclass(exc_type, exceptions.CancelledError): 7222s > raise TimeoutError from exc_val 7222s E TimeoutError 7222s 7222s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 7222s ----------------------------- Captured stderr call ----------------------------- 7222s 2024-11-23 22:30:49,344 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:30:49,355 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:49,356 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40925/status 7222s 2024-11-23 22:30:49,356 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:30:49,371 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37461 7222s 2024-11-23 22:30:49,371 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37461 7222s 2024-11-23 22:30:49,371 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:30:49,372 - distributed.worker - INFO - dashboard at: 127.0.0.1:37295 7222s 2024-11-23 22:30:49,372 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:49,372 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:30:49,372 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:30:49,372 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:30:49,372 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-acvf4te9 7222s 2024-11-23 22:30:49,372 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:30:49,374 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41645 7222s 2024-11-23 22:30:49,374 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41645 7222s 2024-11-23 22:30:49,374 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:30:49,374 - distributed.worker - INFO - dashboard at: 127.0.0.1:42909 7222s 2024-11-23 22:30:49,374 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:49,374 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:30:49,374 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:30:49,374 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:30:49,374 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-jvoejite 7222s 2024-11-23 22:30:49,374 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:30:49,387 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:49,387 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:49,388 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:55540': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:49,388 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:55544': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:49,501 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:49,501 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:49,501 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:55548': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:49,501 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:55556': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:49,615 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:49,616 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:49,616 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:55566': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:49,616 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:55568': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:49,729 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:49,729 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:49,730 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:55580': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:49,730 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:55584': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:49,842 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:49,842 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:49,843 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:55598': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:49,843 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:55610': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:49,956 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:49,956 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:49,956 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:55616': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:49,956 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:55622': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:50,069 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:50,069 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:50,070 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:55628': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:50,070 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:55632': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:50,182 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:50,182 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:50,182 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:55640': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:50,182 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:55650': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:50,295 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:50,295 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:50,295 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:55658': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:50,295 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:55660': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:50,408 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:50,408 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:50,408 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:55664': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:50,409 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:55680': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:50,521 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:50,521 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:50,521 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:55690': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:50,521 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:55700': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:50,634 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:50,634 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:50,634 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:55716': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:50,634 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:55724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:50,747 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:50,747 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:50,747 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:55728': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:50,747 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:55742': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:50,860 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:50,860 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:50,864 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:55754': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:50,864 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:55764': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:50,974 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:50,974 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:50,974 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:55770': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:50,974 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:55772': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:51,087 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:51,087 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:51,087 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:55780': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:51,087 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:55792': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:51,201 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:51,201 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:51,201 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:55808': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:51,201 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:55816': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:51,314 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:51,314 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:51,314 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:55826': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:51,314 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:55840': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:51,427 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:51,427 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:51,427 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:55852': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:51,427 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:55854': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:51,541 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:51,542 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:51,542 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:37620': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:51,542 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:37622': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:51,655 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:51,655 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:51,655 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:37630': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:51,655 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:37632': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:51,769 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:51,769 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:51,769 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:37642': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:51,769 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:37646': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:51,882 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:51,882 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:51,882 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:37656': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:51,882 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:37664': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:51,995 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:51,995 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:51,995 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:37674': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:51,996 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:37676': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:52,109 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:52,109 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:52,109 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:37692': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:52,110 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:37698': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:52,223 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:52,223 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:52,224 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:37702': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:52,224 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:37710': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:52,338 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:52,338 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:52,339 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:37724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:52,339 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:37738': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:52,451 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:52,451 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:52,452 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:37742': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:52,452 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:37750': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:52,565 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:52,565 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:52,565 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:37752': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:52,566 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:37756': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:52,678 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:52,678 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:52,678 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:37760': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:52,678 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:37768': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:52,791 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:52,792 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:52,792 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:37780': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:52,792 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:37796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:52,904 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:52,904 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:52,905 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:37806': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:52,905 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:37812': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:53,020 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:53,020 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:53,021 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:37816': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:53,021 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:37832': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:53,134 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:53,134 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:53,134 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:37840': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:53,134 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:37842': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:53,247 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:53,247 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:53,248 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:37854': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:53,248 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:37862': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:53,361 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:53,361 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:53,365 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:37870': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:53,365 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:37880': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:53,474 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:53,475 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:53,475 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:37886': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:53,475 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:37892': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:53,589 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:53,589 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:53,589 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:37908': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:53,589 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:37916': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:53,702 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:53,702 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:53,702 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:37922': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:53,703 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:37930': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:53,815 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:53,816 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:53,816 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:37940': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:53,816 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:37956': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:53,929 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:53,929 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:53,929 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:37962': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:53,929 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:37976': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:54,043 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:54,043 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:54,043 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:37980': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:54,043 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:37986': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:54,157 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:54,157 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:54,157 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:38000': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:54,157 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:38014': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:54,270 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:54,271 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:54,271 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:38026': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:54,271 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:38038': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:54,384 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:54,384 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:54,384 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:38052': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:54,384 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:38060': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:54,497 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:54,498 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:54,498 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:38064': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:54,498 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:38078': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:54,611 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:54,611 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:54,612 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:38088': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:54,612 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:38094': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:54,724 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:54,724 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:54,724 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:38098': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:54,726 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:38106': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:54,839 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:54,839 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:54,839 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:38112': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:54,839 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:38116': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:54,952 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:54,952 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:54,952 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:38122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:54,952 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:38126': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:55,066 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:55,066 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:55,066 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:38132': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:55,066 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:38138': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:55,179 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:55,180 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:55,180 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:38146': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:55,180 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:38152': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:55,293 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:55,293 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:55,293 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:38160': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:55,294 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:38168': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:55,406 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:55,406 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:55,407 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:38174': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:55,407 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:38188': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:55,520 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:55,520 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:55,520 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:38200': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:55,520 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:38206': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:55,634 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:55,634 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:55,634 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:38214': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:55,634 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:38230': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:55,747 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:55,748 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:55,748 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:38238': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:55,748 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:38244': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:55,860 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:55,860 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:55,864 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:38258': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:55,864 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:38268': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:55,973 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:55,974 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:55,974 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:38272': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:55,974 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:38286': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:56,097 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:56,097 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:56,097 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:38288': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:56,097 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:38296': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:56,210 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:56,211 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:56,211 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:38306': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:56,211 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:38318': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:56,324 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:56,324 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:56,325 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:38332': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:56,325 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:38348': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:56,438 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:56,438 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:56,438 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:38364': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:56,438 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:38372': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:56,553 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:56,553 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:56,553 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:38384': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:56,553 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:38388': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:56,667 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:56,667 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:56,667 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:38398': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:56,668 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:38408': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:56,780 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:56,780 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:56,780 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:38424': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:56,780 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:38426': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:56,893 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:56,893 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:56,893 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:38430': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:56,893 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:38442': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:57,007 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:57,007 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:57,007 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:38450': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:57,007 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:38452': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:57,120 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:57,120 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:57,120 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:38460': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:57,120 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:38462': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:57,232 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:57,233 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:57,233 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:38476': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:57,233 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:38492': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:57,345 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:57,345 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:57,346 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:38498': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:57,346 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:38504': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:57,458 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:57,459 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:57,459 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:38520': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:57,459 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:38532': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:57,573 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:57,574 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:57,574 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:38538': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:57,574 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:38542': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:57,687 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:57,687 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:57,687 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:38546': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:57,687 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:38552': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:57,799 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:57,800 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:57,800 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:38558': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:57,800 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:38564': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:57,913 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:57,913 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:57,913 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:38578': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:57,913 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:38594': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:58,026 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:58,027 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:58,027 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:38604': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:58,027 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:38614': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:58,139 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:58,140 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:58,140 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:38622': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:58,140 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:38636': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:58,252 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:58,253 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:58,253 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:38646': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:58,253 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:38654': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:58,371 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:58,371 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:58,372 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:38668': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:58,372 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:38678': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:58,485 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:58,485 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:58,485 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:38680': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:58,485 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:38686': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:58,599 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:58,599 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:58,599 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:38696': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:58,599 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:38708': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:58,712 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:58,712 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:58,712 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:38718': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:58,712 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:38724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:58,825 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:58,826 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:58,826 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:38734': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:58,826 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:38740': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:58,938 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:58,938 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:58,939 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:38754': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:58,939 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:38770': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:59,052 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:59,052 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:59,052 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:38774': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:59,053 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:38786': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:59,165 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:59,165 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:59,165 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:38800': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:59,166 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:38808': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:59,278 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:59,278 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:59,278 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:38814': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:59,278 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:38820': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:59,392 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:59,392 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:59,393 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:38826': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:59,393 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:38834': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:59,507 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:59,507 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:59,507 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:38850': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:59,508 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:38860': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:59,620 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:59,620 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:59,620 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:38876': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:59,620 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:38884': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:59,733 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:59,733 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:59,734 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:38894': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:59,734 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:38898': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:59,847 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:59,847 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:59,847 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:38910': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:59,847 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:38914': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:59,960 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:59,961 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:30:59,961 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:38924': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:30:59,961 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:38932': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:00,073 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:31:00,073 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:31:00,075 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:38946': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:00,075 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:38948': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:00,182 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:31:00,182 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:38956': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:00,188 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:31:00,188 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:38958': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:00,290 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:31:00,291 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:38968': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:00,297 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:31:00,297 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:38970': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:00,398 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:31:00,398 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:38974': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:00,405 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:31:00,405 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:38976': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:00,506 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:31:00,506 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:38988': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:00,513 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:31:00,513 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:38992': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:00,613 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:31:00,614 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:39008': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:00,620 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:31:00,620 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:39014': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:00,721 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:31:00,722 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:39030': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:00,728 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:31:00,728 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:39038': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:00,829 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:31:00,830 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:39044': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:00,836 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:31:00,836 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:39058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:00,937 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:31:00,938 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:39074': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:00,944 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:31:00,944 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:39088': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:01,045 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:31:01,045 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:39096': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:01,052 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:31:01,052 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:39102': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:01,152 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:31:01,152 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:39116': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:01,159 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:31:01,159 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:39130': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:01,259 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:31:01,260 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:39134': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:01,266 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:31:01,267 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:39150': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:01,367 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:31:01,367 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:39152': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:01,373 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:31:01,374 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:39168': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:01,474 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:31:01,475 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:39180': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:01,481 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:31:01,482 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:39196': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:01,583 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:31:01,584 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:59742': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:01,590 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:31:01,590 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:59752': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:01,692 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:31:01,692 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:59754': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:01,698 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:31:01,699 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:59758': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:01,801 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:31:01,802 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:59770': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:01,808 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:31:01,808 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:59784': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:01,909 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:31:01,910 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:59786': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:01,916 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:31:01,916 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:59798': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:02,019 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:31:02,020 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:59806': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:02,025 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:31:02,026 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:59816': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:02,127 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:31:02,127 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:59832': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:02,133 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:31:02,134 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:59844': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:02,234 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:31:02,235 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:59856': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:02,241 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:31:02,242 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:59860': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:02,342 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:31:02,342 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:59868': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:02,349 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:31:02,349 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:59870': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:02,450 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:31:02,451 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:59876': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:02,457 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:31:02,458 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:59886': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:02,558 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:31:02,558 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:59900': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:02,565 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:31:02,565 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:59904': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:02,666 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:31:02,666 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:59918': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:02,672 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:31:02,673 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:59930': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:02,774 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:31:02,775 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:59944': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:02,781 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:31:02,781 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:59958': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:02,890 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:31:02,891 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:59974': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:02,897 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:31:02,898 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:59984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:02,998 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:31:02,999 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:59998': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:03,005 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:31:03,006 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:60006': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:03,106 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:31:03,107 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:60008': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:03,113 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:31:03,113 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:60010': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:03,214 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:31:03,215 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:60012': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:03,221 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:31:03,221 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:60018': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:03,322 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:31:03,323 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:60020': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:03,329 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:31:03,329 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:60028': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:03,430 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:31:03,433 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:60038': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:03,439 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:31:03,439 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:60048': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:03,538 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:31:03,538 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:60054': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:03,546 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:31:03,546 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:60068': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:03,645 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:31:03,646 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:60070': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:03,653 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:31:03,654 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:60074': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:03,754 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:31:03,755 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:60076': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:03,761 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:31:03,761 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:60080': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:03,865 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:31:03,866 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:60084': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:03,872 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:31:03,873 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:60094': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:03,974 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:31:03,975 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:60104': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:03,981 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:31:03,981 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:60112': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:04,083 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:31:04,084 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:60124': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:04,090 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:31:04,090 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:60134': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:04,191 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:31:04,192 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:60136': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:04,198 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:31:04,199 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:60150': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:04,299 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:31:04,300 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:60162': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:04,306 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42981 7222s 2024-11-23 22:31:04,306 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42981': TLS handshake failed with remote 'tls://127.0.0.1:60166': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:04,371 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37461. Reason: failure-to-start- 7222s 2024-11-23 22:31:04,371 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:31:04,373 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41645. Reason: failure-to-start- 7222s 2024-11-23 22:31:04,373 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:31:04,374 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 15s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 7222s stream = await stream.start_tls( 7222s ^^^^^^^^^^^^^^^^^^^^^^^ 7222s False, ssl_options=ssl_options, server_hostname=host 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 7222s self.socket.do_handshake() 7222s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 7222s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 7222s self._sslobj.do_handshake() 7222s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 7222s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 7222s raise FatalCommClosedError( 7222s ...<2 lines>... 7222s ) from err 7222s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 7222s 7222s During handling of the above exception, another exception occurred: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1218, in _register_with_scheduler 7222s await asyncio.sleep(0.1) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 718, in sleep 7222s return await future 7222s ^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 15s. 7222s 2024-11-23 22:31:05,383 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:31:05,392 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:05,392 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39235/status 7222s 2024-11-23 22:31:05,393 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:31:05,413 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39509 7222s 2024-11-23 22:31:05,413 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39509 7222s 2024-11-23 22:31:05,413 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:31:05,413 - distributed.worker - INFO - dashboard at: 127.0.0.1:36583 7222s 2024-11-23 22:31:05,413 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:05,413 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:31:05,413 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:31:05,413 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:31:05,413 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ugsyflzb 7222s 2024-11-23 22:31:05,413 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:31:05,416 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43469 7222s 2024-11-23 22:31:05,416 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43469 7222s 2024-11-23 22:31:05,416 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:31:05,416 - distributed.worker - INFO - dashboard at: 127.0.0.1:39973 7222s 2024-11-23 22:31:05,416 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:05,416 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:31:05,416 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:31:05,416 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:31:05,416 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-05su7t_3 7222s 2024-11-23 22:31:05,416 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:31:05,429 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:05,429 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:05,430 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:53606': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:05,430 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:53612': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:05,542 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:05,542 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:05,543 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:53614': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:05,543 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:53622': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:05,657 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:05,657 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:05,658 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:53628': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:05,658 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:53644': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:05,770 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:05,770 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:05,771 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:53656': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:05,771 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:53658': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:05,883 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:05,883 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:05,884 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:53666': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:05,884 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:53670': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:05,998 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:05,998 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:05,999 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:53672': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:05,999 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:53686': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:06,111 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:06,112 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:06,112 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:53694': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:06,112 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:53704': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:06,225 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:06,225 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:06,226 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:53706': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:06,226 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:53712': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:06,338 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:06,338 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:06,339 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:53714': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:06,339 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:53720': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:06,452 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:06,452 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:06,452 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:53734': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:06,452 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:53742': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:06,565 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:06,565 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:06,566 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:53744': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:06,566 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:53754': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:06,678 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:06,678 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:06,679 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:53766': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:06,679 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:53770': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:06,792 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:06,793 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:06,793 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:53772': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:06,793 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:53786': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:06,908 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:06,908 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:06,909 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:53798': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:06,909 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:53806': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:07,021 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:07,021 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:07,022 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:53814': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:07,022 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:53830': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:07,135 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:07,135 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:07,135 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:53842': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:07,135 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:53848': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:07,249 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:07,249 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:07,249 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:53850': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:07,249 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:53854': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:07,362 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:07,362 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:07,366 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:53856': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:07,366 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:53866': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:07,475 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:07,475 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:07,476 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:53868': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:07,476 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:53874': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:07,589 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:07,589 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:07,589 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:53884': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:07,590 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:53890': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:07,702 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:07,703 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:07,703 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:53898': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:07,703 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:53906': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:07,816 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:07,816 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:07,816 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:53922': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:07,816 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:53924': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:07,929 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:07,929 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:07,929 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:53928': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:07,929 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:53942': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:08,042 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:08,042 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:08,042 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:53954': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:08,043 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:53964': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:08,157 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:08,157 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:08,158 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:53970': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:08,158 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:53980': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:08,270 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:08,270 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:08,271 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:53984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:08,271 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:53996': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:08,384 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:08,384 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:08,384 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:54002': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:08,384 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:54018': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:08,500 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:08,500 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:08,500 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:54022': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:08,501 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:54036': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:08,613 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:08,613 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:08,614 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:54044': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:08,614 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:54046': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:08,726 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:08,726 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:08,727 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:54056': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:08,727 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:54066': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:08,839 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:08,839 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:08,840 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:54070': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:08,840 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:54078': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:08,952 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:08,952 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:08,952 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:54092': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:08,952 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:54106': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:09,066 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:09,066 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:09,066 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:54114': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:09,067 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:54128': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:09,178 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:09,179 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:09,179 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:54140': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:09,179 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:54150': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:09,291 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:09,291 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:09,292 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:54152': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:09,292 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:54158': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:09,407 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:09,407 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:09,407 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:54168': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:09,407 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:54172': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:09,521 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:09,521 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:09,522 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:54184': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:09,522 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:54198': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:09,635 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:09,635 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:09,635 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:54202': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:09,635 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:54206': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:09,748 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:09,749 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:09,749 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:54212': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:09,749 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:54218': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:09,869 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:09,870 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:09,874 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:54232': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:09,874 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:54236': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:09,982 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:09,982 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:09,982 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:54252': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:09,982 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:54254': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:10,095 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:10,095 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:10,095 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:54266': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:10,095 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:54272': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:10,208 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:10,208 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:10,208 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:54278': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:10,208 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:54282': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:10,322 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:10,322 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:10,322 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:54296': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:10,322 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:54300': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:10,436 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:10,436 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:10,436 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:54302': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:10,436 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:54310': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:10,549 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:10,549 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:10,549 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:54318': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:10,549 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:54322': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:10,662 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:10,662 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:10,662 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:54326': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:10,662 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:54334': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:10,774 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:10,774 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:10,775 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:54336': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:10,775 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:54352': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:10,888 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:10,888 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:10,889 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:54362': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:10,889 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:54366': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:11,001 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:11,001 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:11,002 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:54368': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:11,002 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:54380': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:11,114 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:11,114 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:11,114 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:54384': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:11,115 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:54388': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:11,227 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:11,227 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:11,227 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:54390': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:11,227 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:54398': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:11,339 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:11,339 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:11,340 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:54402': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:11,340 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:54404': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:11,452 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:11,452 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:11,453 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:54414': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:11,453 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:54424': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:11,565 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:11,565 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:11,566 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:34328': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:11,566 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:34334': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:11,678 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:11,678 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:11,678 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:34346': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:11,678 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:34352': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:11,790 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:11,791 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:11,791 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:34364': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:11,791 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:34370': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:11,906 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:11,906 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:11,907 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:34380': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:11,907 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:34386': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:12,019 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:12,019 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:12,019 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:34390': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:12,020 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:34400': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:12,134 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:12,135 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:12,135 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:34408': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:12,135 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:34422': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:12,248 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:12,248 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:12,248 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:34424': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:12,248 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:34426': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:12,360 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:12,360 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:12,364 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:34440': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:12,364 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:34442': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:12,473 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:12,473 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:12,474 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:34446': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:12,474 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:34458': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:12,586 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:12,586 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:12,586 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:34466': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:12,586 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:34472': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:12,699 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:12,700 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:12,700 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:34486': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:12,700 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:34490': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:12,812 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:12,812 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:12,812 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:34496': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:12,812 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:34510': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:12,924 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:12,924 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:12,925 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:34518': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:12,925 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:34520': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:13,037 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:13,037 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:13,037 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:34522': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:13,037 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:34532': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:13,150 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:13,150 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:13,150 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:34548': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:13,151 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:34564': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:13,263 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:13,263 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:13,263 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:34578': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:13,263 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:34588': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:13,376 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:13,376 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:13,376 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:34600': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:13,376 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:34614': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:13,489 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:13,489 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:13,489 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:34628': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:13,489 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:34644': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:13,601 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:13,602 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:13,602 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:34660': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:13,602 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:34664': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:13,714 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:13,714 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:13,714 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:34678': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:13,714 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:34680': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:13,827 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:13,827 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:13,829 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:34686': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:13,829 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:34698': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:13,939 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:13,940 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:13,940 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:34708': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:13,940 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:34724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:14,053 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:14,053 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:14,053 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:34738': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:14,053 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:34754': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:14,166 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:14,166 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:14,167 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:34756': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:14,167 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:34768': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:14,279 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:14,279 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:14,279 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:34778': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:14,280 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:34794': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:14,393 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:14,393 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:14,393 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:34802': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:14,393 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:34812': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:14,508 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:14,508 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:14,508 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:34816': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:14,508 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:34824': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:14,620 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:14,621 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:14,621 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:34830': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:14,621 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:34832': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:14,734 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:14,734 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:14,735 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:34842': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:14,735 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:34858': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:14,847 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:14,848 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:14,848 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:34874': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:14,848 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:34886': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:14,960 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:14,960 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:14,961 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:34892': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:14,961 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:34906': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:15,073 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:15,074 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:15,074 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:34912': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:15,074 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:34914': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:15,187 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:15,187 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:15,187 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:34922': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:15,187 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:34934': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:15,299 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:15,300 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:15,300 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:34950': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:15,300 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:34962': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:15,412 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:15,412 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:15,413 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:34978': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:15,413 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:34988': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:15,526 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:15,526 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:15,527 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:34994': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:15,527 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:35008': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:15,640 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:15,641 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:15,641 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:35018': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:15,641 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:35034': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:15,754 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:15,754 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:15,754 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:35036': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:15,754 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:35044': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:15,870 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:15,870 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:15,870 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:35050': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:15,870 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:35060': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:15,983 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:15,983 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:15,984 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:35066': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:15,984 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:35070': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:16,096 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:16,097 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:16,097 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:35078': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:16,097 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:35082': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:16,209 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:16,209 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:16,210 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:35092': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:16,210 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:35094': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:16,323 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:16,324 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:16,324 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:35108': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:16,324 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:35118': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:16,437 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:16,437 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:16,437 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:35130': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:16,437 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:35146': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:16,552 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:16,552 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:16,553 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:35162': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:16,553 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:35178': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:16,665 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:16,665 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:16,666 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:35184': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:16,666 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:35200': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:16,779 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:16,779 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:16,780 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:35204': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:16,780 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:35216': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:16,893 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:16,893 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:16,893 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:35222': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:16,893 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:35230': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:17,007 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:17,007 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:17,007 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:35238': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:17,007 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:35250': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:17,115 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:17,119 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:35254': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:17,121 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:17,121 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:35264': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:17,223 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:17,224 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:35276': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:17,230 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:17,230 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:35290': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:17,331 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:17,332 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:35294': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:17,338 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:17,338 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:35310': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:17,438 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:17,439 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:35326': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:17,445 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:17,445 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:35332': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:17,546 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:17,547 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:35342': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:17,553 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:17,553 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:35352': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:17,654 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:17,654 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:35354': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:17,660 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:17,661 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:35356': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:17,762 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:17,762 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:35372': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:17,768 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:17,768 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:35376': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:17,869 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:17,869 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:35384': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:17,875 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:17,876 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:35394': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:17,976 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:17,976 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:35402': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:17,982 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:17,983 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:35406': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:18,084 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:18,085 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:35418': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:18,091 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:18,091 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:35424': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:18,191 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:18,192 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:35440': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:18,198 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:18,199 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:35448': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:18,299 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:18,300 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:35458': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:18,306 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:18,306 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:35474': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:18,407 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:18,408 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:35486': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:18,414 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36405 7222s 2024-11-23 22:31:18,414 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39509. Reason: failure-to-start- 7222s 2024-11-23 22:31:18,414 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:31:18,416 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36405': TLS handshake failed with remote 'tls://127.0.0.1:35490': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 7222s 2024-11-23 22:31:18,416 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43469. Reason: failure-to-start- 7222s 2024-11-23 22:31:18,416 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:31:18,419 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 13s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 7222s stream = await stream.start_tls( 7222s ^^^^^^^^^^^^^^^^^^^^^^^ 7222s False, ssl_options=ssl_options, server_hostname=host 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 7222s self.socket.do_handshake() 7222s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 7222s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 7222s self._sslobj.do_handshake() 7222s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 7222s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 7222s raise FatalCommClosedError( 7222s ...<2 lines>... 7222s ) from err 7222s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 7222s 7222s During handling of the above exception, another exception occurred: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1218, in _register_with_scheduler 7222s await asyncio.sleep(0.1) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 718, in sleep 7222s return await future 7222s ^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 13s. 7222s 2024-11-23 22:31:19,427 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:31:19,435 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:32925 7222s 2024-11-23 22:31:19,436 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46809/status 7222s 2024-11-23 22:31:19,436 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:31:19,453 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37033 7222s 2024-11-23 22:31:19,453 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37033 7222s 2024-11-23 22:31:19,453 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:31:19,453 - distributed.worker - INFO - dashboard at: 127.0.0.1:42623 7222s 2024-11-23 22:31:19,453 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:32925 7222s 2024-11-23 22:31:19,453 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:31:19,453 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:31:19,453 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:31:19,453 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-l1e9hs7k 7222s 2024-11-23 22:31:19,453 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:31:19,455 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35057 7222s 2024-11-23 22:31:19,455 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35057 7222s 2024-11-23 22:31:19,455 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:31:19,456 - distributed.worker - INFO - dashboard at: 127.0.0.1:44765 7222s 2024-11-23 22:31:19,456 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:32925 7222s 2024-11-23 22:31:19,456 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:31:19,456 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:31:19,456 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:31:19,456 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-7_fo4z91 7222s 2024-11-23 22:31:19,456 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:31:19,457 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37033. Reason: failure-to-start- 7222s 2024-11-23 22:31:19,457 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:31:19,457 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35057. Reason: failure-to-start- 7222s 2024-11-23 22:31:19,458 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:31:19,459 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:32925': TLS handshake failed with remote 'tls://127.0.0.1:36814': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:31:19,459 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:32925': TLS handshake failed with remote 'tls://127.0.0.1:36816': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:31:19,460 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s 2024-11-23 22:31:20,466 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:31:20,473 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44475 7222s 2024-11-23 22:31:20,474 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41371/status 7222s 2024-11-23 22:31:20,474 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:31:20,489 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36843 7222s 2024-11-23 22:31:20,489 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36843 7222s 2024-11-23 22:31:20,489 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:31:20,489 - distributed.worker - INFO - dashboard at: 127.0.0.1:38389 7222s 2024-11-23 22:31:20,489 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44475 7222s 2024-11-23 22:31:20,489 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:31:20,489 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:31:20,489 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:31:20,489 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-mzfjk7t0 7222s 2024-11-23 22:31:20,490 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:31:20,493 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44735 7222s 2024-11-23 22:31:20,493 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44735 7222s 2024-11-23 22:31:20,493 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:31:20,493 - distributed.worker - INFO - dashboard at: 127.0.0.1:34889 7222s 2024-11-23 22:31:20,493 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44475 7222s 2024-11-23 22:31:20,493 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:31:20,493 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:31:20,493 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:31:20,493 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-tonegi3h 7222s 2024-11-23 22:31:20,493 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:31:20,494 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36843. Reason: failure-to-start- 7222s 2024-11-23 22:31:20,494 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:31:20,495 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44735. Reason: failure-to-start- 7222s 2024-11-23 22:31:20,495 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:31:20,497 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44475': TLS handshake failed with remote 'tls://127.0.0.1:49842': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:31:20,497 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44475': TLS handshake failed with remote 'tls://127.0.0.1:49854': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:31:20,498 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s 2024-11-23 22:31:21,504 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:31:21,511 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37369 7222s 2024-11-23 22:31:21,512 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34291/status 7222s 2024-11-23 22:31:21,512 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:31:21,526 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42155 7222s 2024-11-23 22:31:21,526 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42155 7222s 2024-11-23 22:31:21,526 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:31:21,526 - distributed.worker - INFO - dashboard at: 127.0.0.1:40121 7222s 2024-11-23 22:31:21,526 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37369 7222s 2024-11-23 22:31:21,526 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:31:21,527 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:31:21,527 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:31:21,527 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-uphgls9s 7222s 2024-11-23 22:31:21,527 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:31:21,529 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43653 7222s 2024-11-23 22:31:21,529 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43653 7222s 2024-11-23 22:31:21,529 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:31:21,529 - distributed.worker - INFO - dashboard at: 127.0.0.1:43255 7222s 2024-11-23 22:31:21,529 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37369 7222s 2024-11-23 22:31:21,529 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:31:21,529 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:31:21,529 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:31:21,529 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-fi9ld00w 7222s 2024-11-23 22:31:21,529 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:31:21,530 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42155. Reason: failure-to-start- 7222s 2024-11-23 22:31:21,531 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:31:21,531 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43653. Reason: failure-to-start- 7222s 2024-11-23 22:31:21,531 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:31:21,532 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37369': TLS handshake failed with remote 'tls://127.0.0.1:38996': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:31:21,533 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37369': TLS handshake failed with remote 'tls://127.0.0.1:39002': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:31:21,534 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s 2024-11-23 22:31:22,540 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:31:22,547 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37137 7222s 2024-11-23 22:31:22,548 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42151/status 7222s 2024-11-23 22:31:22,548 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:31:22,562 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44061 7222s 2024-11-23 22:31:22,563 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44061 7222s 2024-11-23 22:31:22,563 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:31:22,563 - distributed.worker - INFO - dashboard at: 127.0.0.1:32921 7222s 2024-11-23 22:31:22,563 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37137 7222s 2024-11-23 22:31:22,563 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:31:22,563 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:31:22,563 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:31:22,563 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-z944atv6 7222s 2024-11-23 22:31:22,563 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:31:22,565 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38845 7222s 2024-11-23 22:31:22,565 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38845 7222s 2024-11-23 22:31:22,565 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:31:22,565 - distributed.worker - INFO - dashboard at: 127.0.0.1:39549 7222s 2024-11-23 22:31:22,565 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37137 7222s 2024-11-23 22:31:22,565 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:31:22,565 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:31:22,565 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:31:22,566 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-t_l0qd_2 7222s 2024-11-23 22:31:22,566 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:31:22,567 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44061. Reason: failure-to-start- 7222s 2024-11-23 22:31:22,567 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:31:22,567 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38845. Reason: failure-to-start- 7222s 2024-11-23 22:31:22,567 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:31:22,569 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37137': TLS handshake failed with remote 'tls://127.0.0.1:41364': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:31:22,569 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37137': TLS handshake failed with remote 'tls://127.0.0.1:41372': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:31:22,570 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s 2024-11-23 22:31:23,576 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:31:23,584 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39099 7222s 2024-11-23 22:31:23,584 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43855/status 7222s 2024-11-23 22:31:23,585 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:31:23,601 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41125 7222s 2024-11-23 22:31:23,601 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41125 7222s 2024-11-23 22:31:23,601 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:31:23,601 - distributed.worker - INFO - dashboard at: 127.0.0.1:37121 7222s 2024-11-23 22:31:23,601 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39099 7222s 2024-11-23 22:31:23,601 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:31:23,601 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:31:23,601 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:31:23,601 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-27a2v_g3 7222s 2024-11-23 22:31:23,601 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:31:23,603 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33279 7222s 2024-11-23 22:31:23,603 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33279 7222s 2024-11-23 22:31:23,603 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:31:23,603 - distributed.worker - INFO - dashboard at: 127.0.0.1:42327 7222s 2024-11-23 22:31:23,603 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39099 7222s 2024-11-23 22:31:23,604 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:31:23,604 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:31:23,604 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:31:23,604 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-w726kowx 7222s 2024-11-23 22:31:23,604 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:31:23,605 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41125. Reason: failure-to-start- 7222s 2024-11-23 22:31:23,605 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:31:23,605 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33279. Reason: failure-to-start- 7222s 2024-11-23 22:31:23,606 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:31:23,607 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39099': TLS handshake failed with remote 'tls://127.0.0.1:45066': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:31:23,607 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39099': TLS handshake failed with remote 'tls://127.0.0.1:45080': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:31:23,608 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s 2024-11-23 22:31:24,614 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:31:24,622 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44137 7222s 2024-11-23 22:31:24,623 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40375/status 7222s 2024-11-23 22:31:24,623 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:31:24,638 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33219 7222s 2024-11-23 22:31:24,638 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33219 7222s 2024-11-23 22:31:24,638 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:31:24,638 - distributed.worker - INFO - dashboard at: 127.0.0.1:34897 7222s 2024-11-23 22:31:24,638 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44137 7222s 2024-11-23 22:31:24,638 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:31:24,638 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:31:24,638 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:31:24,638 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-h2w24orv 7222s 2024-11-23 22:31:24,638 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:31:24,646 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46553 7222s 2024-11-23 22:31:24,646 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46553 7222s 2024-11-23 22:31:24,646 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:31:24,646 - distributed.worker - INFO - dashboard at: 127.0.0.1:38025 7222s 2024-11-23 22:31:24,646 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44137 7222s 2024-11-23 22:31:24,646 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:31:24,646 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:31:24,646 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:31:24,646 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-5ri2b8aq 7222s 2024-11-23 22:31:24,646 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:31:24,647 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33219. Reason: failure-to-start- 7222s 2024-11-23 22:31:24,648 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:31:24,648 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46553. Reason: failure-to-start- 7222s 2024-11-23 22:31:24,648 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:31:24,650 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44137': TLS handshake failed with remote 'tls://127.0.0.1:34312': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:31:24,650 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44137': TLS handshake failed with remote 'tls://127.0.0.1:34314': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:31:24,651 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s 2024-11-23 22:31:25,657 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:31:25,665 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44965 7222s 2024-11-23 22:31:25,666 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36461/status 7222s 2024-11-23 22:31:25,666 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:31:25,694 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34027 7222s 2024-11-23 22:31:25,694 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34027 7222s 2024-11-23 22:31:25,694 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:31:25,694 - distributed.worker - INFO - dashboard at: 127.0.0.1:35383 7222s 2024-11-23 22:31:25,694 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44965 7222s 2024-11-23 22:31:25,694 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:31:25,694 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:31:25,694 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:31:25,694 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-9hpgabi3 7222s 2024-11-23 22:31:25,695 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:31:25,697 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45409 7222s 2024-11-23 22:31:25,697 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45409 7222s 2024-11-23 22:31:25,697 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:31:25,697 - distributed.worker - INFO - dashboard at: 127.0.0.1:45925 7222s 2024-11-23 22:31:25,697 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44965 7222s 2024-11-23 22:31:25,697 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:31:25,697 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:31:25,697 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:31:25,697 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-y672enpz 7222s 2024-11-23 22:31:25,697 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:31:25,699 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34027. Reason: failure-to-start- 7222s 2024-11-23 22:31:25,699 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:31:25,699 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45409. Reason: failure-to-start- 7222s 2024-11-23 22:31:25,700 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:31:25,701 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44965': TLS handshake failed with remote 'tls://127.0.0.1:36446': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:31:25,701 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44965': TLS handshake failed with remote 'tls://127.0.0.1:36448': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:31:25,702 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s 2024-11-23 22:31:26,709 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:31:26,717 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45565 7222s 2024-11-23 22:31:26,718 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37977/status 7222s 2024-11-23 22:31:26,718 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:31:26,734 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43915 7222s 2024-11-23 22:31:26,734 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43915 7222s 2024-11-23 22:31:26,734 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:31:26,734 - distributed.worker - INFO - dashboard at: 127.0.0.1:33705 7222s 2024-11-23 22:31:26,734 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45565 7222s 2024-11-23 22:31:26,734 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:31:26,734 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:31:26,734 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:31:26,734 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-llbmismd 7222s 2024-11-23 22:31:26,734 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:31:26,737 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40099 7222s 2024-11-23 22:31:26,737 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40099 7222s 2024-11-23 22:31:26,737 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:31:26,737 - distributed.worker - INFO - dashboard at: 127.0.0.1:45035 7222s 2024-11-23 22:31:26,737 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45565 7222s 2024-11-23 22:31:26,737 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:31:26,737 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:31:26,737 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:31:26,737 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-gb9665k1 7222s 2024-11-23 22:31:26,737 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:31:26,738 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43915. Reason: failure-to-start- 7222s 2024-11-23 22:31:26,738 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:31:26,739 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40099. Reason: failure-to-start- 7222s 2024-11-23 22:31:26,739 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:31:26,740 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45565': TLS handshake failed with remote 'tls://127.0.0.1:59464': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:31:26,740 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45565': TLS handshake failed with remote 'tls://127.0.0.1:59478': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:31:26,742 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s 2024-11-23 22:31:27,748 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:31:27,756 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42601 7222s 2024-11-23 22:31:27,757 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37487/status 7222s 2024-11-23 22:31:27,757 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:31:27,774 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41945 7222s 2024-11-23 22:31:27,774 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41945 7222s 2024-11-23 22:31:27,774 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:31:27,774 - distributed.worker - INFO - dashboard at: 127.0.0.1:38899 7222s 2024-11-23 22:31:27,774 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42601 7222s 2024-11-23 22:31:27,774 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:31:27,774 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:31:27,774 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:31:27,774 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-jgoq8bft 7222s 2024-11-23 22:31:27,774 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:31:27,776 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34265 7222s 2024-11-23 22:31:27,777 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34265 7222s 2024-11-23 22:31:27,777 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:31:27,777 - distributed.worker - INFO - dashboard at: 127.0.0.1:34151 7222s 2024-11-23 22:31:27,777 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42601 7222s 2024-11-23 22:31:27,777 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:31:27,777 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:31:27,777 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:31:27,777 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-6v6k57m3 7222s 2024-11-23 22:31:27,777 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:31:27,778 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41945. Reason: failure-to-start- 7222s 2024-11-23 22:31:27,778 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:31:27,779 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34265. Reason: failure-to-start- 7222s 2024-11-23 22:31:27,779 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:31:27,780 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42601': TLS handshake failed with remote 'tls://127.0.0.1:56750': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:31:27,780 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42601': TLS handshake failed with remote 'tls://127.0.0.1:56766': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:31:27,781 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s 2024-11-23 22:31:28,789 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:31:28,798 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40071 7222s 2024-11-23 22:31:28,798 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40899/status 7222s 2024-11-23 22:31:28,799 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:31:28,815 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40351 7222s 2024-11-23 22:31:28,815 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40351 7222s 2024-11-23 22:31:28,815 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:31:28,815 - distributed.worker - INFO - dashboard at: 127.0.0.1:35323 7222s 2024-11-23 22:31:28,815 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40071 7222s 2024-11-23 22:31:28,815 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:31:28,815 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:31:28,815 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:31:28,815 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-wzeiw6ml 7222s 2024-11-23 22:31:28,815 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:31:28,818 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42333 7222s 2024-11-23 22:31:28,818 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42333 7222s 2024-11-23 22:31:28,818 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:31:28,818 - distributed.worker - INFO - dashboard at: 127.0.0.1:38889 7222s 2024-11-23 22:31:28,818 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40071 7222s 2024-11-23 22:31:28,818 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:31:28,818 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:31:28,818 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:31:28,818 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-spza_yfi 7222s 2024-11-23 22:31:28,818 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:31:28,819 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40351. Reason: failure-to-start- 7222s 2024-11-23 22:31:28,820 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:31:28,820 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42333. Reason: failure-to-start- 7222s 2024-11-23 22:31:28,820 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:31:28,822 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40071': TLS handshake failed with remote 'tls://127.0.0.1:50040': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:31:28,822 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40071': TLS handshake failed with remote 'tls://127.0.0.1:50044': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:31:28,823 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s 2024-11-23 22:31:29,831 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:31:29,839 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41883 7222s 2024-11-23 22:31:29,840 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45459/status 7222s 2024-11-23 22:31:29,840 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:31:29,856 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46521 7222s 2024-11-23 22:31:29,856 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46521 7222s 2024-11-23 22:31:29,856 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:31:29,857 - distributed.worker - INFO - dashboard at: 127.0.0.1:33933 7222s 2024-11-23 22:31:29,857 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41883 7222s 2024-11-23 22:31:29,857 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:31:29,857 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:31:29,857 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:31:29,857 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-0222_o6e 7222s 2024-11-23 22:31:29,857 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:31:29,859 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39517 7222s 2024-11-23 22:31:29,859 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39517 7222s 2024-11-23 22:31:29,859 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:31:29,859 - distributed.worker - INFO - dashboard at: 127.0.0.1:39935 7222s 2024-11-23 22:31:29,859 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41883 7222s 2024-11-23 22:31:29,859 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:31:29,859 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:31:29,859 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:31:29,859 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-lefheamz 7222s 2024-11-23 22:31:29,859 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:31:29,861 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46521. Reason: failure-to-start- 7222s 2024-11-23 22:31:29,861 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:31:29,861 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39517. Reason: failure-to-start- 7222s 2024-11-23 22:31:29,861 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:31:29,865 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41883': TLS handshake failed with remote 'tls://127.0.0.1:57066': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:31:29,866 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41883': TLS handshake failed with remote 'tls://127.0.0.1:57076': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:31:29,867 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s 2024-11-23 22:31:30,873 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:31:30,881 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41743 7222s 2024-11-23 22:31:30,881 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35025/status 7222s 2024-11-23 22:31:30,882 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:31:30,899 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44857 7222s 2024-11-23 22:31:30,900 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44857 7222s 2024-11-23 22:31:30,900 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:31:30,900 - distributed.worker - INFO - dashboard at: 127.0.0.1:46293 7222s 2024-11-23 22:31:30,900 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41743 7222s 2024-11-23 22:31:30,900 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:31:30,900 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:31:30,900 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:31:30,900 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-m6hp6n39 7222s 2024-11-23 22:31:30,900 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:31:30,902 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33399 7222s 2024-11-23 22:31:30,902 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33399 7222s 2024-11-23 22:31:30,902 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:31:30,902 - distributed.worker - INFO - dashboard at: 127.0.0.1:45825 7222s 2024-11-23 22:31:30,903 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41743 7222s 2024-11-23 22:31:30,903 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:31:30,903 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:31:30,903 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:31:30,903 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ol1wg2zx 7222s 2024-11-23 22:31:30,903 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:31:30,906 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44857. Reason: failure-to-start- 7222s 2024-11-23 22:31:30,907 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:31:30,907 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33399. Reason: failure-to-start- 7222s 2024-11-23 22:31:30,907 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:31:30,909 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41743': TLS handshake failed with remote 'tls://127.0.0.1:44342': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:31:30,909 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41743': TLS handshake failed with remote 'tls://127.0.0.1:44354': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:31:30,910 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s 2024-11-23 22:31:31,916 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:31:31,924 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42659 7222s 2024-11-23 22:31:31,925 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43921/status 7222s 2024-11-23 22:31:31,925 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:31:31,943 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33307 7222s 2024-11-23 22:31:31,943 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33307 7222s 2024-11-23 22:31:31,943 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:31:31,943 - distributed.worker - INFO - dashboard at: 127.0.0.1:43885 7222s 2024-11-23 22:31:31,943 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42659 7222s 2024-11-23 22:31:31,943 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:31:31,943 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:31:31,943 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:31:31,943 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-6ywel4_g 7222s 2024-11-23 22:31:31,943 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:31:31,945 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43273 7222s 2024-11-23 22:31:31,946 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43273 7222s 2024-11-23 22:31:31,946 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:31:31,946 - distributed.worker - INFO - dashboard at: 127.0.0.1:33987 7222s 2024-11-23 22:31:31,946 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42659 7222s 2024-11-23 22:31:31,946 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:31:31,946 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:31:31,946 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:31:31,946 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-u4cpikbn 7222s 2024-11-23 22:31:31,946 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:31:31,950 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33307. Reason: failure-to-start- 7222s 2024-11-23 22:31:31,950 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:31:31,950 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43273. Reason: failure-to-start- 7222s 2024-11-23 22:31:31,950 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:31:31,952 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42659': TLS handshake failed with remote 'tls://127.0.0.1:51328': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:31:31,952 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42659': TLS handshake failed with remote 'tls://127.0.0.1:51342': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:31:31,953 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s 2024-11-23 22:31:32,960 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:31:32,970 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38045 7222s 2024-11-23 22:31:32,970 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36417/status 7222s 2024-11-23 22:31:32,970 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:31:32,987 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39081 7222s 2024-11-23 22:31:32,987 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39081 7222s 2024-11-23 22:31:32,987 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:31:32,987 - distributed.worker - INFO - dashboard at: 127.0.0.1:34175 7222s 2024-11-23 22:31:32,987 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38045 7222s 2024-11-23 22:31:32,987 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:31:32,987 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:31:32,987 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:31:32,987 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-fenx6s13 7222s 2024-11-23 22:31:32,987 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:31:32,990 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46335 7222s 2024-11-23 22:31:32,990 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46335 7222s 2024-11-23 22:31:32,990 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:31:32,990 - distributed.worker - INFO - dashboard at: 127.0.0.1:35983 7222s 2024-11-23 22:31:32,990 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38045 7222s 2024-11-23 22:31:32,990 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:31:32,990 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:31:32,990 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:31:32,990 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-b46v6gub 7222s 2024-11-23 22:31:32,990 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:31:32,995 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39081. Reason: failure-to-start- 7222s 2024-11-23 22:31:32,995 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:31:32,996 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46335. Reason: failure-to-start- 7222s 2024-11-23 22:31:32,996 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:31:32,998 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38045': TLS handshake failed with remote 'tls://127.0.0.1:41476': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:31:32,998 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38045': TLS handshake failed with remote 'tls://127.0.0.1:41482': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:31:32,999 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s 2024-11-23 22:31:34,007 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:31:34,017 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35943 7222s 2024-11-23 22:31:34,017 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35899/status 7222s 2024-11-23 22:31:34,018 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:31:34,037 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41789 7222s 2024-11-23 22:31:34,038 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41789 7222s 2024-11-23 22:31:34,038 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:31:34,038 - distributed.worker - INFO - dashboard at: 127.0.0.1:42773 7222s 2024-11-23 22:31:34,038 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35943 7222s 2024-11-23 22:31:34,038 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:31:34,038 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:31:34,038 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:31:34,038 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-rxh6281x 7222s 2024-11-23 22:31:34,038 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:31:34,040 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41289 7222s 2024-11-23 22:31:34,040 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41289 7222s 2024-11-23 22:31:34,040 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:31:34,040 - distributed.worker - INFO - dashboard at: 127.0.0.1:44083 7222s 2024-11-23 22:31:34,040 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35943 7222s 2024-11-23 22:31:34,041 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:31:34,041 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:31:34,041 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:31:34,041 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-6320y_uh 7222s 2024-11-23 22:31:34,041 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:31:34,042 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41789. Reason: failure-to-start- 7222s 2024-11-23 22:31:34,042 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:31:34,043 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41289. Reason: failure-to-start- 7222s 2024-11-23 22:31:34,043 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:31:34,044 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35943': TLS handshake failed with remote 'tls://127.0.0.1:52050': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:31:34,045 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35943': TLS handshake failed with remote 'tls://127.0.0.1:52054': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:31:34,046 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s 2024-11-23 22:31:35,056 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:31:35,066 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44221 7222s 2024-11-23 22:31:35,067 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37771/status 7222s 2024-11-23 22:31:35,067 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:31:35,085 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44227 7222s 2024-11-23 22:31:35,085 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44227 7222s 2024-11-23 22:31:35,085 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:31:35,085 - distributed.worker - INFO - dashboard at: 127.0.0.1:35117 7222s 2024-11-23 22:31:35,085 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44221 7222s 2024-11-23 22:31:35,085 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:31:35,085 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:31:35,085 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:31:35,085 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-7z6jzrms 7222s 2024-11-23 22:31:35,086 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:31:35,088 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44405 7222s 2024-11-23 22:31:35,088 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44405 7222s 2024-11-23 22:31:35,088 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:31:35,088 - distributed.worker - INFO - dashboard at: 127.0.0.1:32849 7222s 2024-11-23 22:31:35,088 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44221 7222s 2024-11-23 22:31:35,088 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:31:35,088 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:31:35,088 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:31:35,088 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-k09oiqyt 7222s 2024-11-23 22:31:35,088 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:31:35,090 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44227. Reason: failure-to-start- 7222s 2024-11-23 22:31:35,090 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:31:35,091 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44405. Reason: failure-to-start- 7222s 2024-11-23 22:31:35,091 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:31:35,095 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44221': TLS handshake failed with remote 'tls://127.0.0.1:44248': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:31:35,095 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44221': TLS handshake failed with remote 'tls://127.0.0.1:44260': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:31:35,097 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s 2024-11-23 22:31:36,102 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:31:36,111 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36737 7222s 2024-11-23 22:31:36,111 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38865/status 7222s 2024-11-23 22:31:36,112 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:31:36,130 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44683 7222s 2024-11-23 22:31:36,130 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44683 7222s 2024-11-23 22:31:36,130 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:31:36,130 - distributed.worker - INFO - dashboard at: 127.0.0.1:42737 7222s 2024-11-23 22:31:36,130 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36737 7222s 2024-11-23 22:31:36,130 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:31:36,130 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:31:36,130 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:31:36,130 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-wdjai7g8 7222s 2024-11-23 22:31:36,130 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:31:36,133 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33143 7222s 2024-11-23 22:31:36,133 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33143 7222s 2024-11-23 22:31:36,133 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:31:36,133 - distributed.worker - INFO - dashboard at: 127.0.0.1:37007 7222s 2024-11-23 22:31:36,133 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36737 7222s 2024-11-23 22:31:36,133 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:31:36,133 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:31:36,133 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:31:36,133 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ijyi3f08 7222s 2024-11-23 22:31:36,133 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:31:36,137 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44683. Reason: failure-to-start- 7222s 2024-11-23 22:31:36,138 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:31:36,138 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33143. Reason: failure-to-start- 7222s 2024-11-23 22:31:36,138 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:31:36,140 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36737': TLS handshake failed with remote 'tls://127.0.0.1:40488': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:31:36,140 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36737': TLS handshake failed with remote 'tls://127.0.0.1:40494': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:31:36,141 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s 2024-11-23 22:31:37,146 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:31:37,154 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:32905 7222s 2024-11-23 22:31:37,155 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39171/status 7222s 2024-11-23 22:31:37,155 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:31:37,172 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:32849 7222s 2024-11-23 22:31:37,172 - distributed.worker - INFO - Listening to: tls://127.0.0.1:32849 7222s 2024-11-23 22:31:37,172 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:31:37,172 - distributed.worker - INFO - dashboard at: 127.0.0.1:40523 7222s 2024-11-23 22:31:37,172 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:32905 7222s 2024-11-23 22:31:37,172 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:31:37,172 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:31:37,172 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:31:37,172 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-3wqtqxc0 7222s 2024-11-23 22:31:37,173 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:31:37,176 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45115 7222s 2024-11-23 22:31:37,176 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45115 7222s 2024-11-23 22:31:37,176 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:31:37,176 - distributed.worker - INFO - dashboard at: 127.0.0.1:46411 7222s 2024-11-23 22:31:37,176 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:32905 7222s 2024-11-23 22:31:37,176 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:31:37,176 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:31:37,176 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:31:37,177 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-5ra6c8re 7222s 2024-11-23 22:31:37,177 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:31:37,181 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:32849. Reason: failure-to-start- 7222s 2024-11-23 22:31:37,181 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:31:37,181 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45115. Reason: failure-to-start- 7222s 2024-11-23 22:31:37,181 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:31:37,183 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:32905': TLS handshake failed with remote 'tls://127.0.0.1:38930': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:31:37,183 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:32905': TLS handshake failed with remote 'tls://127.0.0.1:38934': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:31:37,184 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s 2024-11-23 22:31:38,192 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:31:38,201 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35909 7222s 2024-11-23 22:31:38,201 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39679/status 7222s 2024-11-23 22:31:38,202 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:31:38,218 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34081 7222s 2024-11-23 22:31:38,218 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34081 7222s 2024-11-23 22:31:38,218 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:31:38,218 - distributed.worker - INFO - dashboard at: 127.0.0.1:42153 7222s 2024-11-23 22:31:38,219 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35909 7222s 2024-11-23 22:31:38,219 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:31:38,219 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:31:38,219 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:31:38,219 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-2v7ymufq 7222s 2024-11-23 22:31:38,219 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:31:38,221 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45077 7222s 2024-11-23 22:31:38,221 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45077 7222s 2024-11-23 22:31:38,221 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:31:38,221 - distributed.worker - INFO - dashboard at: 127.0.0.1:42097 7222s 2024-11-23 22:31:38,221 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35909 7222s 2024-11-23 22:31:38,221 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:31:38,221 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:31:38,222 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:31:38,222 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-11gdgten 7222s 2024-11-23 22:31:38,222 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:31:38,223 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34081. Reason: failure-to-start- 7222s 2024-11-23 22:31:38,223 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:31:38,224 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45077. Reason: failure-to-start- 7222s 2024-11-23 22:31:38,224 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:31:38,228 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35909': TLS handshake failed with remote 'tls://127.0.0.1:37810': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:31:38,228 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35909': TLS handshake failed with remote 'tls://127.0.0.1:37824': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:31:38,229 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s 2024-11-23 22:31:39,237 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:31:39,245 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39079 7222s 2024-11-23 22:31:39,246 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36415/status 7222s 2024-11-23 22:31:39,246 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:31:39,263 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44147 7222s 2024-11-23 22:31:39,263 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44147 7222s 2024-11-23 22:31:39,263 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:31:39,263 - distributed.worker - INFO - dashboard at: 127.0.0.1:46611 7222s 2024-11-23 22:31:39,263 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 7222s 2024-11-23 22:31:39,263 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:31:39,263 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:31:39,263 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:31:39,263 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-01i23_ij 7222s 2024-11-23 22:31:39,264 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:31:39,266 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45863 7222s 2024-11-23 22:31:39,266 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45863 7222s 2024-11-23 22:31:39,266 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:31:39,266 - distributed.worker - INFO - dashboard at: 127.0.0.1:41687 7222s 2024-11-23 22:31:39,266 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 7222s 2024-11-23 22:31:39,266 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:31:39,266 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:31:39,266 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:31:39,266 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-7wyz8cpa 7222s 2024-11-23 22:31:39,266 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:31:39,271 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44147. Reason: failure-to-start- 7222s 2024-11-23 22:31:39,271 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:31:39,271 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45863. Reason: failure-to-start- 7222s 2024-11-23 22:31:39,272 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:31:39,273 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:42558': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:31:39,273 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:42574': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:31:39,275 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s 2024-11-23 22:31:40,281 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:31:40,290 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39937 7222s 2024-11-23 22:31:40,291 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40167/status 7222s 2024-11-23 22:31:40,291 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:31:40,308 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41749 7222s 2024-11-23 22:31:40,309 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41749 7222s 2024-11-23 22:31:40,309 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:31:40,309 - distributed.worker - INFO - dashboard at: 127.0.0.1:43655 7222s 2024-11-23 22:31:40,309 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39937 7222s 2024-11-23 22:31:40,309 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:31:40,309 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:31:40,309 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:31:40,309 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-d_4s47t0 7222s 2024-11-23 22:31:40,309 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:31:40,311 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39821 7222s 2024-11-23 22:31:40,311 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39821 7222s 2024-11-23 22:31:40,311 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:31:40,311 - distributed.worker - INFO - dashboard at: 127.0.0.1:43151 7222s 2024-11-23 22:31:40,312 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39937 7222s 2024-11-23 22:31:40,312 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:31:40,312 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:31:40,312 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:31:40,312 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-eqkv097c 7222s 2024-11-23 22:31:40,312 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:31:40,316 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41749. Reason: failure-to-start- 7222s 2024-11-23 22:31:40,316 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:31:40,316 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39821. Reason: failure-to-start- 7222s 2024-11-23 22:31:40,317 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:31:40,318 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39937': TLS handshake failed with remote 'tls://127.0.0.1:42330': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:31:40,318 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39937': TLS handshake failed with remote 'tls://127.0.0.1:42332': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:31:40,320 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s 2024-11-23 22:31:41,326 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:31:41,334 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34375 7222s 2024-11-23 22:31:41,334 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45705/status 7222s 2024-11-23 22:31:41,335 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:31:41,363 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38185 7222s 2024-11-23 22:31:41,364 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38185 7222s 2024-11-23 22:31:41,364 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:31:41,364 - distributed.worker - INFO - dashboard at: 127.0.0.1:42949 7222s 2024-11-23 22:31:41,364 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34375 7222s 2024-11-23 22:31:41,364 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:31:41,364 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:31:41,364 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:31:41,364 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-zgbp7d17 7222s 2024-11-23 22:31:41,364 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:31:41,366 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36369 7222s 2024-11-23 22:31:41,366 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36369 7222s 2024-11-23 22:31:41,367 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:31:41,367 - distributed.worker - INFO - dashboard at: 127.0.0.1:37053 7222s 2024-11-23 22:31:41,367 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34375 7222s 2024-11-23 22:31:41,367 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:31:41,367 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:31:41,367 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:31:41,367 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-mb7a7c0_ 7222s 2024-11-23 22:31:41,367 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:31:41,371 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38185. Reason: failure-to-start- 7222s 2024-11-23 22:31:41,371 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:31:41,372 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36369. Reason: failure-to-start- 7222s 2024-11-23 22:31:41,372 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:31:41,376 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34375': TLS handshake failed with remote 'tls://127.0.0.1:39662': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:31:41,376 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34375': TLS handshake failed with remote 'tls://127.0.0.1:39666': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:31:41,378 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s 2024-11-23 22:31:42,385 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:31:42,394 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39605 7222s 2024-11-23 22:31:42,394 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40891/status 7222s 2024-11-23 22:31:42,395 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:31:42,416 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33733 7222s 2024-11-23 22:31:42,416 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33733 7222s 2024-11-23 22:31:42,416 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:31:42,416 - distributed.worker - INFO - dashboard at: 127.0.0.1:41221 7222s 2024-11-23 22:31:42,416 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39605 7222s 2024-11-23 22:31:42,416 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:31:42,416 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:31:42,416 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:31:42,416 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-rr8ad3ma 7222s 2024-11-23 22:31:42,416 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:31:42,419 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40897 7222s 2024-11-23 22:31:42,419 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40897 7222s 2024-11-23 22:31:42,419 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:31:42,419 - distributed.worker - INFO - dashboard at: 127.0.0.1:45467 7222s 2024-11-23 22:31:42,419 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39605 7222s 2024-11-23 22:31:42,419 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:31:42,419 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:31:42,419 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:31:42,419 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-__ve1qrq 7222s 2024-11-23 22:31:42,419 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:31:42,421 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33733. Reason: failure-to-start- 7222s 2024-11-23 22:31:42,421 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:31:42,421 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40897. Reason: failure-to-start- 7222s 2024-11-23 22:31:42,422 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:31:42,423 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39605': TLS handshake failed with remote 'tls://127.0.0.1:51982': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:31:42,423 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39605': TLS handshake failed with remote 'tls://127.0.0.1:51988': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:31:42,425 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s 2024-11-23 22:31:43,432 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:31:43,442 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42153 7222s 2024-11-23 22:31:43,442 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41867/status 7222s 2024-11-23 22:31:43,442 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:31:43,461 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45489 7222s 2024-11-23 22:31:43,461 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45489 7222s 2024-11-23 22:31:43,461 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:31:43,461 - distributed.worker - INFO - dashboard at: 127.0.0.1:36575 7222s 2024-11-23 22:31:43,461 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42153 7222s 2024-11-23 22:31:43,461 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:31:43,461 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:31:43,461 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:31:43,461 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-hxlop9cn 7222s 2024-11-23 22:31:43,461 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:31:43,464 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41533 7222s 2024-11-23 22:31:43,464 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41533 7222s 2024-11-23 22:31:43,464 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:31:43,464 - distributed.worker - INFO - dashboard at: 127.0.0.1:37689 7222s 2024-11-23 22:31:43,464 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42153 7222s 2024-11-23 22:31:43,464 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:31:43,464 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:31:43,464 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:31:43,464 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-50hqoebc 7222s 2024-11-23 22:31:43,464 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:31:43,465 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45489. Reason: failure-to-start- 7222s 2024-11-23 22:31:43,465 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:31:43,466 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41533. Reason: failure-to-start- 7222s 2024-11-23 22:31:43,466 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:31:43,467 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42153': TLS handshake failed with remote 'tls://127.0.0.1:44330': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:31:43,467 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42153': TLS handshake failed with remote 'tls://127.0.0.1:44342': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:31:43,469 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s 2024-11-23 22:31:44,477 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:31:44,485 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45919 7222s 2024-11-23 22:31:44,485 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35419/status 7222s 2024-11-23 22:31:44,486 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:31:44,506 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37447 7222s 2024-11-23 22:31:44,506 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37447 7222s 2024-11-23 22:31:44,506 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:31:44,507 - distributed.worker - INFO - dashboard at: 127.0.0.1:35183 7222s 2024-11-23 22:31:44,507 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45919 7222s 2024-11-23 22:31:44,507 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:31:44,507 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:31:44,507 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:31:44,507 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-jb94at6b 7222s 2024-11-23 22:31:44,507 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:31:44,509 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39843 7222s 2024-11-23 22:31:44,509 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39843 7222s 2024-11-23 22:31:44,509 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:31:44,509 - distributed.worker - INFO - dashboard at: 127.0.0.1:45181 7222s 2024-11-23 22:31:44,509 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45919 7222s 2024-11-23 22:31:44,509 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:31:44,509 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:31:44,509 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:31:44,509 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-kyc25qg8 7222s 2024-11-23 22:31:44,509 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:31:44,511 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37447. Reason: failure-to-start- 7222s 2024-11-23 22:31:44,511 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:31:44,511 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39843. Reason: failure-to-start- 7222s 2024-11-23 22:31:44,512 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:31:44,513 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45919': TLS handshake failed with remote 'tls://127.0.0.1:44580': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:31:44,513 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45919': TLS handshake failed with remote 'tls://127.0.0.1:44586': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:31:44,517 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s 2024-11-23 22:31:45,523 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:31:45,531 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36087 7222s 2024-11-23 22:31:45,532 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40135/status 7222s 2024-11-23 22:31:45,532 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:31:45,552 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46737 7222s 2024-11-23 22:31:45,552 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46737 7222s 2024-11-23 22:31:45,552 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:31:45,552 - distributed.worker - INFO - dashboard at: 127.0.0.1:40419 7222s 2024-11-23 22:31:45,552 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36087 7222s 2024-11-23 22:31:45,552 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:31:45,552 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:31:45,553 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:31:45,553 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-bhjga0_w 7222s 2024-11-23 22:31:45,553 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:31:45,555 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34021 7222s 2024-11-23 22:31:45,555 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34021 7222s 2024-11-23 22:31:45,555 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:31:45,555 - distributed.worker - INFO - dashboard at: 127.0.0.1:46575 7222s 2024-11-23 22:31:45,555 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36087 7222s 2024-11-23 22:31:45,555 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:31:45,555 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:31:45,555 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:31:45,555 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-p3sc7cyy 7222s 2024-11-23 22:31:45,555 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:31:45,561 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46737. Reason: failure-to-start- 7222s 2024-11-23 22:31:45,561 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:31:45,561 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34021. Reason: failure-to-start- 7222s 2024-11-23 22:31:45,562 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:31:45,563 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36087': TLS handshake failed with remote 'tls://127.0.0.1:60750': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:31:45,563 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36087': TLS handshake failed with remote 'tls://127.0.0.1:60762': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:31:45,564 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s 2024-11-23 22:31:46,572 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:31:46,583 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35017 7222s 2024-11-23 22:31:46,583 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36271/status 7222s 2024-11-23 22:31:46,586 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:31:46,607 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39245 7222s 2024-11-23 22:31:46,607 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39245 7222s 2024-11-23 22:31:46,607 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:31:46,607 - distributed.worker - INFO - dashboard at: 127.0.0.1:38109 7222s 2024-11-23 22:31:46,607 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35017 7222s 2024-11-23 22:31:46,607 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:31:46,607 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:31:46,608 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:31:46,608 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-8kqhgydk 7222s 2024-11-23 22:31:46,608 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:31:46,610 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46485 7222s 2024-11-23 22:31:46,610 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46485 7222s 2024-11-23 22:31:46,610 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:31:46,610 - distributed.worker - INFO - dashboard at: 127.0.0.1:43235 7222s 2024-11-23 22:31:46,610 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35017 7222s 2024-11-23 22:31:46,610 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:31:46,610 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:31:46,610 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:31:46,610 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-rba5kyy2 7222s 2024-11-23 22:31:46,610 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:31:46,612 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39245. Reason: failure-to-start- 7222s 2024-11-23 22:31:46,612 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:31:46,612 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46485. Reason: failure-to-start- 7222s 2024-11-23 22:31:46,612 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:31:46,614 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35017': TLS handshake failed with remote 'tls://127.0.0.1:56714': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:31:46,614 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35017': TLS handshake failed with remote 'tls://127.0.0.1:56730': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:31:46,618 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s 2024-11-23 22:31:47,625 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:31:47,634 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38223 7222s 2024-11-23 22:31:47,635 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42359/status 7222s 2024-11-23 22:31:47,635 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:31:47,653 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43515 7222s 2024-11-23 22:31:47,654 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43515 7222s 2024-11-23 22:31:47,654 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:31:47,654 - distributed.worker - INFO - dashboard at: 127.0.0.1:44679 7222s 2024-11-23 22:31:47,654 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38223 7222s 2024-11-23 22:31:47,654 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:31:47,654 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:31:47,654 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:31:47,654 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-d_4w32kf 7222s 2024-11-23 22:31:47,654 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:31:47,656 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44729 7222s 2024-11-23 22:31:47,656 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44729 7222s 2024-11-23 22:31:47,656 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:31:47,656 - distributed.worker - INFO - dashboard at: 127.0.0.1:33645 7222s 2024-11-23 22:31:47,656 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38223 7222s 2024-11-23 22:31:47,656 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:31:47,656 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:31:47,656 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:31:47,657 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ugn19hn0 7222s 2024-11-23 22:31:47,657 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:31:47,658 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43515. Reason: failure-to-start- 7222s 2024-11-23 22:31:47,658 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:31:47,659 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44729. Reason: failure-to-start- 7222s 2024-11-23 22:31:47,659 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:31:47,662 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38223': TLS handshake failed with remote 'tls://127.0.0.1:58462': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:31:47,662 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38223': TLS handshake failed with remote 'tls://127.0.0.1:58476': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:31:47,664 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s 2024-11-23 22:31:48,670 - distributed.scheduler - INFO - State start 7222s 2024-11-23 22:31:48,678 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46447 7222s 2024-11-23 22:31:48,678 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42027/status 7222s 2024-11-23 22:31:48,681 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7222s 2024-11-23 22:31:48,700 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39759 7222s 2024-11-23 22:31:48,700 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39759 7222s 2024-11-23 22:31:48,700 - distributed.worker - INFO - Worker name: 0 7222s 2024-11-23 22:31:48,700 - distributed.worker - INFO - dashboard at: 127.0.0.1:41295 7222s 2024-11-23 22:31:48,700 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46447 7222s 2024-11-23 22:31:48,700 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:31:48,700 - distributed.worker - INFO - Threads: 1 7222s 2024-11-23 22:31:48,700 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:31:48,700 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-czb2fvh4 7222s 2024-11-23 22:31:48,700 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:31:48,703 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34335 7222s 2024-11-23 22:31:48,703 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34335 7222s 2024-11-23 22:31:48,703 - distributed.worker - INFO - Worker name: 1 7222s 2024-11-23 22:31:48,703 - distributed.worker - INFO - dashboard at: 127.0.0.1:43913 7222s 2024-11-23 22:31:48,703 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46447 7222s 2024-11-23 22:31:48,703 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:31:48,703 - distributed.worker - INFO - Threads: 2 7222s 2024-11-23 22:31:48,703 - distributed.worker - INFO - Memory: 15.58 GiB 7222s 2024-11-23 22:31:48,703 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-jk5218bi 7222s 2024-11-23 22:31:48,703 - distributed.worker - INFO - ------------------------------------------------- 7222s 2024-11-23 22:31:48,705 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39759. Reason: failure-to-start- 7222s 2024-11-23 22:31:48,705 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:31:48,705 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34335. Reason: failure-to-start- 7222s 2024-11-23 22:31:48,706 - distributed.worker - INFO - Closed worker has not yet started: Status.init 7222s 2024-11-23 22:31:48,710 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46447': TLS handshake failed with remote 'tls://127.0.0.1:48582': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:31:48,710 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46447': TLS handshake failed with remote 'tls://127.0.0.1:48590': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 7222s 2024-11-23 22:31:48,711 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 7222s await self._register_with_scheduler() 7222s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 7222s comm = await connect(self.scheduler.address, **self.connection_args) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7222s comm = await wait_for( 7222s ^^^^^^^^^^^^^^^ 7222s ...<2 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 7222s return await fut 7222s ^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7222s stream = await self.client.connect( 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7222s af, addr, stream = await connector.start(connect_timeout=timeout) 7222s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7222s asyncio.exceptions.CancelledError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 7222s await wait_for(self.start_unsafe(), timeout=timeout) 7222s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 7222s async with asyncio.timeout(timeout): 7222s ~~~~~~~~~~~~~~~^^^^^^^^^ 7222s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7222s raise TimeoutError from exc_val 7222s TimeoutError 7222s 7222s The above exception was the direct cause of the following exception: 7222s 7222s Traceback (most recent call last): 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 7222s s, ws = await start_cluster( 7222s ^^^^^^^^^^^^^^^^^^^^ 7222s ...<9 lines>... 7222s ) 7222s ^ 7222s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 7222s await asyncio.gather(*workers) 7222s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7222s return await awaitable 7222s ^^^^^^^^^^^^^^^ 7222s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 7222s raise asyncio.TimeoutError( 7222s f"{type(self).__name__} start timed out after {timeout}s." 7222s ) from exc 7222s TimeoutError: Worker start timed out after 0s. 7222s ============================= slowest 20 durations ============================= 7222s 300.02s setup tests/test_utils_test.py::test_tls_cluster 7222s 60.01s call tests/test_tls_functional.py::test_Queue 7222s 60.01s call tests/test_tls_functional.py::test_work_stealing 7222s 60.01s call tests/test_tls_functional.py::test_retire_workers 7222s 60.01s call tests/test_tls_functional.py::test_rebalance 7222s 60.01s call tests/test_tls_functional.py::test_basic 7222s 60.01s call tests/test_tls_functional.py::test_nanny 7222s 60.01s call tests/test_scheduler.py::test_broadcast_tls 7222s 60.01s call tests/test_tls_functional.py::test_worker_client_executor 7222s 60.01s call tests/test_utils_test.py::test_gen_cluster_tls 7222s 60.01s call tests/test_tls_functional.py::test_client_submit 7222s 60.01s call tests/test_tls_functional.py::test_gather 7222s 60.01s call tests/test_tls_functional.py::test_scatter 7222s 60.01s call tests/test_tls_functional.py::test_worker_client 7222s 60.01s call tests/test_tls_functional.py::test_worker_client_gather 7222s 30.01s call tests/test_tls_functional.py::test_security_dict_input 7222s 5.03s call cli/tests/test_tls_cli.py::test_nanny 7222s 3.75s call cli/tests/test_tls_cli.py::test_use_config_file 7222s 3.63s call cli/tests/test_dask_scheduler.py::test_multiple_workers_2 7222s 3.52s call cli/tests/test_tls_cli.py::test_basic 7222s =========================== short test summary info ============================ 7222s FAILED cli/tests/test_dask_scheduler.py::test_preload_file - distributed.comm.core.CommClosedError: in : Stream is closed 7222s FAILED cli/tests/test_dask_scheduler.py::test_preload_module - distributed.comm.core.CommClosedError: in : Stream is closed 7222s FAILED cli/tests/test_dask_scheduler.py::test_preload_remote_module - SystemError: no locals when deleting 7222s FAILED cli/tests/test_dask_scheduler.py::test_preload_config - SystemError: no locals found when setting up annotations 7222s FAILED cli/tests/test_dask_scheduler.py::test_preload_command - distributed.comm.core.CommClosedError: in : Stream is closed 7222s FAILED cli/tests/test_dask_scheduler.py::test_preload_command_default - distributed.comm.core.CommClosedError: in : Stream is closed 7222s FAILED cli/tests/test_dask_scheduler.py::test_multiple_workers_2 - SystemError: no locals found when setting up annotations 7222s FAILED cli/tests/test_tls_cli.py::test_basic - distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 7222s FAILED cli/tests/test_tls_cli.py::test_sni - distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 7222s FAILED cli/tests/test_tls_cli.py::test_nanny - distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 7222s FAILED cli/tests/test_tls_cli.py::test_separate_key_cert - distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 7222s FAILED cli/tests/test_tls_cli.py::test_use_config_file - distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 7222s FAILED deploy/tests/test_subprocess.py::test_basic - SystemError: no locals found when setting up annotations 7222s FAILED deploy/tests/test_subprocess.py::test_n_workers - SystemError: no locals found when setting up annotations 7222s FAILED tests/test_client.py::test_upload_file_zip - KeyError: '/tmp/dask-scratch-space/scheduler-0zwy0_n8/myfile.zip' 7222s FAILED tests/test_profile.py::test_info_frame_f_lineno[22-4] - TypeError: '<=' not supported between instances of 'int' and 'NoneType' 7222s FAILED tests/test_profile.py::test_info_frame_f_lineno[23-4] - TypeError: '<=' not supported between instances of 'int' and 'NoneType' 7222s FAILED tests/test_profile.py::test_call_stack_f_lineno[22-4] - TypeError: '<=' not supported between instances of 'int' and 'NoneType' 7222s FAILED tests/test_profile.py::test_call_stack_f_lineno[23-4] - TypeError: '<=' not supported between instances of 'int' and 'NoneType' 7222s FAILED tests/test_scheduler.py::test_broadcast_tls - TimeoutError 7222s FAILED tests/test_security.py::test_repr_temp_keys - ImportError: Using `Security.temporary` requires `cryptography`, please install it using either pip or conda 7222s FAILED tests/test_security.py::test_temporary_credentials - ImportError: Using `Security.temporary` requires `cryptography`, please install it using either pip or conda 7222s FAILED tests/test_security.py::test_extra_conn_args_in_temporary_credentials - ImportError: Using `Security.temporary` requires `cryptography`, please install it using either pip or conda 7222s FAILED tests/test_tls_functional.py::test_basic - TimeoutError 7222s FAILED tests/test_tls_functional.py::test_Queue - TimeoutError 7222s FAILED tests/test_tls_functional.py::test_client_submit - TimeoutError 7222s FAILED tests/test_tls_functional.py::test_gather - TimeoutError 7222s FAILED tests/test_tls_functional.py::test_scatter - TimeoutError 7222s FAILED tests/test_tls_functional.py::test_nanny - TimeoutError 7222s FAILED tests/test_tls_functional.py::test_rebalance - TimeoutError 7222s FAILED tests/test_tls_functional.py::test_work_stealing - TimeoutError 7222s FAILED tests/test_tls_functional.py::test_worker_client - TimeoutError 7222s FAILED tests/test_tls_functional.py::test_worker_client_gather - TimeoutError 7222s FAILED tests/test_tls_functional.py::test_worker_client_executor - TimeoutError 7222s FAILED tests/test_tls_functional.py::test_retire_workers - TimeoutError 7222s FAILED tests/test_tls_functional.py::test_security_dict_input - TimeoutError 7222s FAILED tests/test_utils_test.py::test_gen_cluster_tls - TimeoutError 7222s ERROR tests/test_utils_test.py::test_tls_cluster - Failed: Timeout >300.0s 7222s ==== 37 failed, 30 skipped, 3311 deselected, 1 error in 1233.48s (0:20:33) ===== 7222s *** END OF RUN 4: NOT ALL TESTS HAVE YET PASSED/XFAILED *** 7222s *** STARTING RUN 5: python3.13 -m pytest --pyargs distributed --verbose --color=no --timeout-method=signal --timeout=300 -m not avoid_ci -rfE --last-failed --last-failed-no-failures none --ignore=../../../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_comms.py --ignore=../../../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_ws.py --ignore=../../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_adaptive.py --ignore=../../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py --ignore=../../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_slow_adaptive.py --ignore=../../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_spec_cluster.py --deselect=cli/tests/test_dask_scheduler.py::test_no_dashboard --deselect=deploy/tests/test_local.py::test_localcluster_get_client --deselect=deploy/tests/test_old_ssh.py::test_cluster --deselect=deploy/tests/test_old_ssh.py::test_old_ssh_nprocs_renamed_to_n_workers --deselect=deploy/tests/test_old_ssh.py::test_nprocs_attribute_is_deprecated --deselect=deploy/tests/test_ssh.py::test_nprocs_attribute_is_deprecated --deselect=http/tests/test_core.py::test_prometheus_api_doc --deselect=tests/test_init.py::test_git_revision --deselect=tests/test_jupyter.py::test_jupyter_idle_timeout --deselect=tests/test_jupyter.py::test_jupyter_idle_timeout_returned --deselect=tests/test_jupyter.py::test_jupyter_server --deselect=tests/test_jupyter.py::test_shutsdown_cleanly --deselect=tests/test_profile.py::test_stack_overflow --deselect=tests/test_pubsub.py::test_client_worker --deselect=tests/test_queues.py::test_queue_in_task --deselect=tests/test_spill.py::test_spillbuffer_oserror --deselect=tests/test_steal.py::test_steal_twice --deselect=tests/test_utils_test.py::test_cluster --deselect=tests/test_variable.py::test_variable_in_task --deselect=tests/test_worker.py::test_process_executor_kills_process --deselect=tests/test_worker_memory.py::test_fail_to_pickle_execute_1 --deselect=tests/test_worker_state_machine.py::test_task_state_instance_are_garbage_collected --deselect=protocol/tests/test_protocol.py::test_deeply_nested_structures --deselect=protocol/tests/test_serialize.py::test_deeply_nested_structures --deselect=deploy/tests/test_local.py::test_local_cluster_redundant_kwarg --deselect=deploy/tests/test_slow_adaptive.py::test_adaptive --deselect=tests/test_client.py::test_futures_in_subgraphs --deselect=tests/test_dask_collections.py::test_dataframe_groupby_tasks --deselect=tests/test_dask_collections.py::test_dataframes --deselect=tests/test_dask_collections.py::test_rolling_sync --deselect=tests/test_scheduler.py::test_balance_many_workers_2 --deselect=tests/test_scheduler.py::test_default_task_duration_splits --deselect=tests/test_steal.py::test_blocklist_shuffle_split --deselect=cli/tests/test_dask_scheduler.py::test_defaults --deselect=cli/tests/test_dask_scheduler.py::test_hostport --deselect=cli/tests/test_dask_spec.py::test_errors --deselect=cli/tests/test_dask_worker.py::test_scheduler_file --deselect=cli/tests/test_dask_worker.py::test_scheduler_file --deselect=cli/tests/test_dask_worker.py::test_scheduler_file --deselect=dashboard/tests/test_scheduler_bokeh.py::test_counters --deselect=dashboard/tests/test_worker_bokeh.py::test_counters --deselect=deploy/tests/test_local.py::test_adapt_then_manual --deselect=deploy/tests/test_local.py::test_async_with --deselect=deploy/tests/test_local.py::test_close_twice --deselect=deploy/tests/test_local.py::test_cluster_info_sync --deselect=deploy/tests/test_local.py::test_local_tls --deselect=deploy/tests/test_local.py::test_no_dangling_asyncio_tasks --deselect=deploy/tests/test_local.py::test_only_local_access --deselect=deploy/tests/test_local.py::test_remote_access --deselect=diagnostics/tests/test_progress_widgets.py::test_serializers --deselect=diagnostics/tests/test_scheduler_plugin.py::test_lifecycle --deselect=http/scheduler/tests/test_missing_bokeh.py::test_missing_bokeh --deselect=http/scheduler/tests/test_scheduler_http.py::test_metrics_when_prometheus_client_not_installed --deselect=protocol/tests/test_serialize.py::test_errors --deselect=tests/test_batched.py::test_BatchedSend --deselect=tests/test_batched.py::test_close_closed --deselect=tests/test_batched.py::test_close_twice --deselect=tests/test_batched.py::test_send_after_stream_start --deselect=tests/test_batched.py::test_send_before_close --deselect=tests/test_batched.py::test_send_before_start --deselect=tests/test_batched.py::test_sending_traffic_jam --deselect=tests/test_batched.py::test_serializers --deselect=tests/test_client.py::TestClientSecurityLoader::test_security_loader --deselect=tests/test_client.py::TestClientSecurityLoader::test_security_loader_ignored_if_explicit_security_provided --deselect=tests/test_client.py::TestClientSecurityLoader::test_security_loader_ignored_if_returns_none --deselect=tests/test_client.py::test_async_with --deselect=tests/test_client.py::test_client_is_quiet_cluster_close --deselect=tests/test_client.py::test_dashboard_link_cluster --deselect=tests/test_client.py::test_dashboard_link_inproc --deselect=tests/test_client.py::test_file_descriptors_dont_leak --deselect=tests/test_client.py::test_mixing_clients_different_scheduler --deselect=tests/test_client.py::test_quiet_client_close --deselect=tests/test_client.py::test_rebalance_sync --deselect=tests/test_client.py::test_repr_localcluster --deselect=tests/test_client.py::test_security_loader --deselect=tests/test_client.py::test_security_loader_ignored_if_explicit_security_provided --deselect=tests/test_client.py::test_security_loader_ignored_if_returns_none --deselect=tests/test_client.py::test_shutdown --deselect=tests/test_client.py::test_shutdown_is_quiet_with_cluster --deselect=tests/test_client.py::test_shutdown_localcluster --deselect=tests/test_client.py::test_shutdown_stops_callbacks --deselect=tests/test_client_loop.py::test_close_loop_sync_start_new_loop --deselect=tests/test_client_loop.py::test_close_loop_sync_use_running_loop --deselect=tests/test_core.py::test_close_fast_without_active_handlers --deselect=tests/test_core.py::test_close_grace_period_for_handlers --deselect=tests/test_core.py::test_close_properly --deselect=tests/test_core.py::test_compression --deselect=tests/test_core.py::test_connection_pool --deselect=tests/test_core.py::test_connection_pool_close_while_connecting --deselect=tests/test_core.py::test_connection_pool_detects_remote_close --deselect=tests/test_core.py::test_connection_pool_outside_cancellation --deselect=tests/test_core.py::test_connection_pool_remove --deselect=tests/test_core.py::test_connection_pool_respects_limit --deselect=tests/test_core.py::test_connection_pool_tls --deselect=tests/test_core.py::test_counters --deselect=tests/test_core.py::test_deserialize_error --deselect=tests/test_core.py::test_errors --deselect=tests/test_core.py::test_identity_inproc --deselect=tests/test_core.py::test_identity_tcp --deselect=tests/test_core.py::test_large_packets_inproc --deselect=tests/test_core.py::test_messages_are_ordered_bsend --deselect=tests/test_core.py::test_messages_are_ordered_raw --deselect=tests/test_core.py::test_ports --deselect=tests/test_core.py::test_rpc_default --deselect=tests/test_core.py::test_rpc_inproc --deselect=tests/test_core.py::test_rpc_message_lifetime_default --deselect=tests/test_core.py::test_rpc_message_lifetime_inproc --deselect=tests/test_core.py::test_rpc_message_lifetime_tcp --deselect=tests/test_core.py::test_rpc_serialization --deselect=tests/test_core.py::test_rpc_tcp --deselect=tests/test_core.py::test_rpc_tls --deselect=tests/test_core.py::test_rpc_with_many_connections_inproc --deselect=tests/test_core.py::test_rpc_with_many_connections_tcp --deselect=tests/test_core.py::test_send_recv_args --deselect=tests/test_core.py::test_send_recv_cancelled --deselect=tests/test_core.py::test_server --deselect=tests/test_core.py::test_server_comms_mark_active_handlers --deselect=tests/test_core.py::test_server_raises_on_blocked_handlers --deselect=tests/test_jupyter.py::test_jupyter_idle_timeout --deselect=tests/test_jupyter.py::test_jupyter_server --deselect=tests/test_locks.py::test_errors --deselect=tests/test_nanny.py::test_scheduler_file --deselect=tests/test_nanny.py::test_scheduler_file --deselect=tests/test_nanny.py::test_scheduler_file --deselect=tests/test_nanny.py::test_worker_uses_same_host_as_nanny --deselect=tests/test_preload.py::test_failure_doesnt_crash_scheduler --deselect=tests/test_preload.py::test_preload_import_time --deselect=tests/test_preload.py::test_preload_manager_sequence --deselect=tests/test_preload.py::test_worker_preload_text --deselect=tests/test_scheduler.py::test_allowed_failures_config --deselect=tests/test_scheduler.py::test_async_context_manager --deselect=tests/test_scheduler.py::test_dashboard_host --deselect=tests/test_scheduler.py::test_file_descriptors_dont_leak --deselect=tests/test_scheduler.py::test_finished --deselect=tests/test_scheduler.py::test_multiple_listeners --deselect=tests/test_scheduler.py::test_no_dangling_asyncio_tasks --deselect=tests/test_scheduler.py::test_scheduler_file --deselect=tests/test_scheduler.py::test_scheduler_file --deselect=tests/test_scheduler.py::test_scheduler_file --deselect=tests/test_security.py::test_require_encryption --deselect=tests/test_security.py::test_tls_listen_connect --deselect=tests/test_security.py::test_tls_temporary_credentials_functional --deselect=tests/test_semaphore.py::test_threadpoolworkers_pick_correct_ioloop --deselect=tests/test_tls_functional.py::test_security_dict_input_no_security --deselect=tests/test_utils_test.py::test_ensure_no_new_clients --deselect=tests/test_utils_test.py::test_freeze_batched_send --deselect=tests/test_utils_test.py::test_locked_comm_drop_in_replacement --deselect=tests/test_utils_test.py::test_locked_comm_intercept_read --deselect=tests/test_utils_test.py::test_locked_comm_intercept_write --deselect=tests/test_worker.py::test_host_uses_scheduler_protocol --deselect=tests/test_worker.py::test_plugin_exception --deselect=tests/test_worker.py::test_plugin_internal_exception --deselect=tests/test_worker.py::test_plugin_multiple_exceptions --deselect=tests/test_worker.py::test_scheduler_file --deselect=tests/test_worker.py::test_scheduler_file --deselect=tests/test_worker.py::test_scheduler_file --deselect=tests/test_worker_client.py::test_dont_override_default_get 7224s ============================= test session starts ============================== 7224s platform linux -- Python 3.13.0, pytest-8.3.3, pluggy-1.5.0 -- /usr/bin/python3.13 7224s cachedir: .pytest_cache 7224s rootdir: /tmp/autopkgtest.1vd31g/autopkgtest_tmp/build 7224s configfile: pyproject.toml 7224s plugins: typeguard-4.4.1, anyio-4.6.2, rerunfailures-14.0, timeout-2.3.1 7224s timeout: 300.0s 7224s timeout method: signal 7224s timeout func_only: False 7233s collecting ... collected 3349 items / 3311 deselected / 30 skipped / 38 selected 7233s run-last-failure: rerun previous 38 failures 7233s 7235s cli/tests/test_dask_scheduler.py::test_preload_file <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py FAILED [ 2%] 7237s cli/tests/test_dask_scheduler.py::test_preload_module <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py FAILED [ 5%] 7239s cli/tests/test_dask_scheduler.py::test_preload_remote_module <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py FAILED [ 7%] 7240s cli/tests/test_dask_scheduler.py::test_preload_config <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py FAILED [ 10%] 7242s cli/tests/test_dask_scheduler.py::test_preload_command <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py FAILED [ 13%] 7244s cli/tests/test_dask_scheduler.py::test_preload_command_default <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py FAILED [ 15%] 7247s cli/tests/test_dask_scheduler.py::test_multiple_workers_2 <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py FAILED [ 18%] 7250s cli/tests/test_tls_cli.py::test_basic <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_tls_cli.py FAILED [ 21%] 7253s cli/tests/test_tls_cli.py::test_sni <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_tls_cli.py FAILED [ 23%] 7257s cli/tests/test_tls_cli.py::test_nanny <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_tls_cli.py FAILED [ 26%] 7261s cli/tests/test_tls_cli.py::test_separate_key_cert <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_tls_cli.py FAILED [ 28%] 7264s cli/tests/test_tls_cli.py::test_use_config_file <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_tls_cli.py FAILED [ 31%] 7267s deploy/tests/test_subprocess.py::test_basic <- ../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_subprocess.py FAILED [ 34%] 7269s deploy/tests/test_subprocess.py::test_n_workers <- ../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_subprocess.py FAILED [ 36%] 7270s tests/test_client.py::test_upload_file_zip <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py FAILED [ 39%] 7270s tests/test_profile.py::test_info_frame_f_lineno[22-4] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py FAILED [ 42%] 7270s tests/test_profile.py::test_info_frame_f_lineno[23-4] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py FAILED [ 44%] 7271s tests/test_profile.py::test_call_stack_f_lineno[22-4] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py FAILED [ 47%] 7271s tests/test_profile.py::test_call_stack_f_lineno[23-4] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py FAILED [ 50%] 7331s tests/test_scheduler.py::test_broadcast_tls <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py FAILED [ 52%] 7331s tests/test_security.py::test_repr_temp_keys <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py FAILED [ 55%] 7331s tests/test_security.py::test_temporary_credentials <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py FAILED [ 57%] 7332s tests/test_security.py::test_extra_conn_args_in_temporary_credentials <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py FAILED [ 60%] 7392s tests/test_tls_functional.py::test_basic <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_tls_functional.py FAILED [ 63%] 7453s tests/test_tls_functional.py::test_Queue <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_tls_functional.py FAILED [ 65%] 7513s tests/test_tls_functional.py::test_client_submit <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_tls_functional.py FAILED [ 68%] 7574s tests/test_tls_functional.py::test_gather <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_tls_functional.py FAILED [ 71%] 7635s tests/test_tls_functional.py::test_scatter <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_tls_functional.py FAILED [ 73%] 7695s tests/test_tls_functional.py::test_nanny <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_tls_functional.py FAILED [ 76%] 7755s tests/test_tls_functional.py::test_rebalance <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_tls_functional.py FAILED [ 78%] 7816s tests/test_tls_functional.py::test_work_stealing <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_tls_functional.py FAILED [ 81%] 7876s tests/test_tls_functional.py::test_worker_client <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_tls_functional.py FAILED [ 84%] 7937s tests/test_tls_functional.py::test_worker_client_gather <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_tls_functional.py FAILED [ 86%] 7998s tests/test_tls_functional.py::test_worker_client_executor <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_tls_functional.py FAILED [ 89%] 8058s tests/test_tls_functional.py::test_retire_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_tls_functional.py FAILED [ 92%] 8088s tests/test_tls_functional.py::test_security_dict_input <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_tls_functional.py FAILED [ 94%] 8149s tests/test_utils_test.py::test_gen_cluster_tls <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py FAILED [ 97%] 8449s tests/test_utils_test.py::test_tls_cluster <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py +++++++++++++++++++++++++++++++++++ Timeout ++++++++++++++++++++++++++++++++++++ 8449s ~~~~~~~~~~~~~~~~~~~~~ Stack of test IOLoop_0 (3882873856) ~~~~~~~~~~~~~~~~~~~~~~ 8449s File "/usr/lib/python3.13/threading.py", line 1012, in _bootstrap 8449s self._bootstrap_inner() 8449s File "/usr/lib/python3.13/threading.py", line 1041, in _bootstrap_inner 8449s self.run() 8449s File "/usr/lib/python3.13/threading.py", line 992, in run 8449s self._target(*self._args, **self._kwargs) 8449s File "/usr/lib/python3.13/concurrent/futures/thread.py", line 92, in _worker 8449s work_item.run() 8449s File "/usr/lib/python3.13/concurrent/futures/thread.py", line 58, in run 8449s result = self.fn(*self.args, **self.kwargs) 8449s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 378, in _run_and_close_tornado 8449s return asyncio_run(inner_fn(), loop_factory=get_loop_factory()) 8449s File "/usr/lib/python3.13/asyncio/runners.py", line 194, in run 8449s return runner.run(main) 8449s File "/usr/lib/python3.13/asyncio/runners.py", line 118, in run 8449s return self._loop.run_until_complete(task) 8449s File "/usr/lib/python3.13/asyncio/base_events.py", line 707, in run_until_complete 8449s self.run_forever() 8449s File "/usr/lib/python3.13/asyncio/base_events.py", line 678, in run_forever 8449s self._run_once() 8449s File "/usr/lib/python3.13/asyncio/base_events.py", line 1995, in _run_once 8449s event_list = self._selector.select(timeout) 8449s File "/usr/lib/python3.13/selectors.py", line 452, in select 8449s fd_event_list = self._selector.poll(timeout, max_ev) 8449s ~~~~~~~~~~~~~~~~~~~~~ Stack of Dask-Offload_0 (4034118656) ~~~~~~~~~~~~~~~~~~~~~ 8449s File "/usr/lib/python3.13/threading.py", line 1012, in _bootstrap 8449s self._bootstrap_inner() 8449s File "/usr/lib/python3.13/threading.py", line 1041, in _bootstrap_inner 8449s self.run() 8449s File "/usr/lib/python3.13/threading.py", line 992, in run 8449s self._target(*self._args, **self._kwargs) 8449s File "/usr/lib/python3.13/concurrent/futures/thread.py", line 89, in _worker 8449s work_item = work_queue.get(block=True) 8449s +++++++++++++++++++++++++++++++++++ Timeout ++++++++++++++++++++++++++++++++++++ 8449s ERROR [100%] 8449s 8449s ==================================== ERRORS ==================================== 8449s ______________________ ERROR at setup of test_tls_cluster ______________________ 8449s 8449s loop = 8449s security = Security(require_encryption=True, tls_ca_file=Local (/usr/lib/python3/dist-packages/distributed/tests/tls-ca-cert.pem)...ted/tests/tls-key-cert.pem), tls_worker_cert=Local (/usr/lib/python3/dist-packages/distributed/tests/tls-key-cert.pem)) 8449s 8449s @pytest.fixture 8449s def tls_cluster(loop, security): 8449s > with tls_cluster_context(security=security) as (scheduler, workers): 8449s 8449s /usr/lib/python3/dist-packages/distributed/utils_test.py:573: 8449s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8449s /usr/lib/python3.13/contextlib.py:141: in __enter__ 8449s return next(self.gen) 8449s /usr/lib/python3/dist-packages/distributed/utils_test.py:565: in tls_cluster_context 8449s with cluster( 8449s /usr/lib/python3.13/contextlib.py:141: in __enter__ 8449s return next(self.gen) 8449s /usr/lib/python3/dist-packages/distributed/utils_test.py:672: in cluster 8449s pid, addr_or_exception = q.get() 8449s /usr/lib/python3.13/multiprocessing/queues.py:101: in get 8449s res = self._recv_bytes() 8449s /usr/lib/python3.13/multiprocessing/connection.py:216: in recv_bytes 8449s buf = self._recv_bytes(maxlength) 8449s /usr/lib/python3.13/multiprocessing/connection.py:430: in _recv_bytes 8449s buf = self._recv(4) 8449s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8449s 8449s self = , size = 4 8449s read = 8449s 8449s def _recv(self, size, read=_read): 8449s buf = io.BytesIO() 8449s handle = self._handle 8449s remaining = size 8449s while remaining > 0: 8449s > chunk = read(handle, remaining) 8449s E Failed: Timeout >300.0s 8449s 8449s /usr/lib/python3.13/multiprocessing/connection.py:395: Failed 8449s ---------------------------- Captured stderr setup ----------------------------- 8449s 2024-11-23 22:52:20,172 - distributed.http.proxy - INFO - To route to workers diagnostics web server please install jupyter-server-proxy: python -m pip install jupyter-server-proxy 8449s 2024-11-23 22:52:20,178 - distributed.scheduler - INFO - State start 8449s 2024-11-23 22:52:20,219 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:20,222 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:8787/status 8449s 2024-11-23 22:52:20,223 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8449s 2024-11-23 22:52:20,260 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45531 8449s 2024-11-23 22:52:20,261 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45531 8449s 2024-11-23 22:52:20,261 - distributed.worker - INFO - dashboard at: 127.0.0.1:39035 8449s 2024-11-23 22:52:20,261 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:20,261 - distributed.worker - INFO - ------------------------------------------------- 8449s 2024-11-23 22:52:20,261 - distributed.worker - INFO - Threads: 1 8449s 2024-11-23 22:52:20,261 - distributed.worker - INFO - Memory: 15.58 GiB 8449s 2024-11-23 22:52:20,261 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-oyxbau7e 8449s 2024-11-23 22:52:20,261 - distributed.worker - INFO - ------------------------------------------------- 8449s 2024-11-23 22:52:20,262 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44319 8449s 2024-11-23 22:52:20,263 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44319 8449s 2024-11-23 22:52:20,263 - distributed.worker - INFO - dashboard at: 127.0.0.1:33815 8449s 2024-11-23 22:52:20,263 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:20,263 - distributed.worker - INFO - ------------------------------------------------- 8449s 2024-11-23 22:52:20,263 - distributed.worker - INFO - Threads: 1 8449s 2024-11-23 22:52:20,263 - distributed.worker - INFO - Memory: 15.58 GiB 8449s 2024-11-23 22:52:20,263 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-2m4gomzs 8449s 2024-11-23 22:52:20,263 - distributed.worker - INFO - ------------------------------------------------- 8449s 2024-11-23 22:52:20,270 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:20,275 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44242': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:20,276 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:20,276 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44250': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:20,378 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:20,383 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44254': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:20,383 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:20,383 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44266': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:20,485 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:20,490 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44282': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:20,491 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:20,491 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44298': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:20,592 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:20,598 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44314': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:20,598 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:20,599 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44318': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:20,699 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:20,700 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44326': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:20,706 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:20,706 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44338': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:20,807 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:20,807 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44348': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:20,813 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:20,814 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44352': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:20,914 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:20,915 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44364': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:20,921 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:20,921 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44378': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:21,022 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:21,022 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44392': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:21,028 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:21,029 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44408': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:21,129 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:21,130 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44418': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:21,136 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:21,136 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44422': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:21,236 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:21,236 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44424': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:21,243 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:21,243 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44426': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:21,343 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:21,344 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44430': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:21,350 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:21,351 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44440': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:21,451 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:21,451 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44452': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:21,457 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:21,458 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44460': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:21,558 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:21,558 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:37736': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:21,565 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:21,565 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:37750': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:21,666 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:21,666 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:37758': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:21,672 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:21,672 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:37762': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:21,776 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:21,781 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:37774': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:21,782 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:21,782 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:37786': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:21,884 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:21,889 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:37798': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:21,890 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:21,890 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:37808': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:21,992 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:21,997 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:37810': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:21,998 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:21,998 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:37816': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:22,099 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:22,105 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:37832': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:22,105 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:22,106 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:37836': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:22,207 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:22,208 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:37842': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:22,214 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:22,214 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:37858': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:22,314 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:22,314 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:37866': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:22,321 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:22,321 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:37882': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:22,421 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:22,422 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:37892': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:22,428 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:22,428 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:37906': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:22,529 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:22,529 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:37912': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:22,535 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:22,536 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:37918': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:22,636 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:22,637 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:37926': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:22,643 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:22,643 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:37942': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:22,744 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:22,744 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:37954': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:22,750 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:22,750 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:37966': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:22,851 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:22,851 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:37980': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:22,858 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:22,858 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:37996': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:22,958 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:22,959 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38012': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:22,965 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:22,965 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38028': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:23,066 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:23,067 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38038': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:23,073 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:23,073 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38054': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:23,174 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:23,175 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38068': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:23,181 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:23,182 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38082': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:23,281 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:23,281 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38098': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:23,288 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:23,289 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38102': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:23,389 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:23,389 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38114': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:23,395 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:23,396 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38120': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:23,496 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:23,496 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38126': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:23,503 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:23,503 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38136': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:23,604 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:23,604 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38144': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:23,610 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:23,611 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38158': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:23,712 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:23,717 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38166': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:23,718 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:23,718 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38178': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:23,821 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:23,826 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38184': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:23,826 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:23,826 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38190': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:23,928 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:23,933 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38198': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:23,934 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:23,934 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38206': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:24,035 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:24,040 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38216': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:24,041 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:24,041 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38230': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:24,143 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:24,148 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38238': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:24,148 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:24,148 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38254': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:24,250 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:24,255 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38258': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:24,256 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:24,256 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38262': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:24,358 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:24,363 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38266': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:24,363 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:24,363 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38270': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:24,465 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:24,470 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38282': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:24,471 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:24,471 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38296': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:24,573 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:24,578 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38312': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:24,578 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:24,579 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38318': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:24,681 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:24,686 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38330': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:24,686 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:24,686 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38336': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:24,789 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:24,793 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38350': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:24,794 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:24,794 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38352': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:24,896 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:24,901 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38362': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:24,901 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:24,901 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38372': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:25,003 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:25,008 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38378': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:25,008 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:25,009 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38380': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:25,111 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:25,116 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38394': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:25,116 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:25,117 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38402': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:25,218 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:25,223 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38418': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:25,224 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:25,224 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38420': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:25,326 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:25,331 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38436': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:25,331 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:25,332 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38448': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:25,434 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:25,439 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38464': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:25,439 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:25,439 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38480': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:25,541 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:25,546 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38484': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:25,546 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:25,547 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38490': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:25,649 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:25,653 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38494': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:25,654 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:25,654 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38502': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:25,756 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:25,761 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38510': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:25,761 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:25,761 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38518': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:25,863 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:25,868 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38528': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:25,868 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:25,869 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38538': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:25,971 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:25,975 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38548': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:25,976 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:25,977 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38562': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:26,078 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:26,083 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38564': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:26,083 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:26,083 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38572': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:26,185 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:26,190 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38582': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:26,190 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:26,191 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38590': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:26,293 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:26,297 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38594': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:26,298 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:26,298 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38598': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:26,400 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:26,405 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38610': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:26,405 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:26,405 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38612': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:26,508 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:26,513 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38622': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:26,514 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:26,514 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38628': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:26,616 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:26,621 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38638': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:26,621 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:26,621 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38652': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:26,723 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:26,728 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38666': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:26,728 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:26,733 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38676': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:26,831 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:26,836 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38686': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:26,836 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:26,836 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38692': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:26,938 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:26,943 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38704': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:26,943 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:26,944 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38716': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:27,045 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:27,050 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:27,051 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:27,051 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38726': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:27,153 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:27,158 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38736': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:27,159 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:27,159 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38748': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:27,261 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:27,266 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38756': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:27,266 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:27,267 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38762': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:27,368 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:27,373 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38778': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:27,374 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:27,374 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38794': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:27,475 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:27,480 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38806': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:27,481 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:27,481 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38808': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:27,583 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:27,588 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38818': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:27,588 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:27,588 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38830': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:27,690 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:27,697 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38834': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:27,697 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:27,697 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38842': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:27,798 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:27,798 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38852': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:27,804 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:27,804 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38860': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:27,905 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:27,905 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38874': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:27,911 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:27,912 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38878': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:28,012 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:28,013 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38894': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:28,019 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:28,019 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38904': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:28,120 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:28,121 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38916': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:28,127 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:28,127 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38930': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:28,228 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:28,232 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38934': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:28,238 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:28,238 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38940': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:28,335 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:28,335 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38948': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:28,345 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:28,346 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38950': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:28,442 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:28,442 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38958': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:28,452 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:28,453 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38974': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:28,550 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:28,550 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38976': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:28,560 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:28,560 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:28,657 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:28,657 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38990': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:28,666 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:28,667 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38992': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:28,764 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:28,764 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38996': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:28,773 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:28,773 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39012': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:28,872 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:28,872 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39028': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:28,880 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:28,881 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39044': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:29,000 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:29,004 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39054': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:29,005 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:29,005 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39070': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:29,107 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:29,112 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39076': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:29,113 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:29,113 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39078': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:29,215 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:29,219 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39090': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:29,220 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:29,220 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39106': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:29,322 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:29,327 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39114': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:29,327 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:29,327 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39124': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:29,429 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:29,434 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39136': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:29,435 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:29,435 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39150': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:29,536 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:29,542 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39152': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:29,542 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:29,543 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39154': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:29,643 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:29,644 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39162': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:29,650 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:29,650 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39164': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:29,751 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:29,751 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39176': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:29,757 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:29,757 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39190': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:29,858 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:29,858 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39200': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:29,865 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:29,865 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39204': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:29,966 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:29,966 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39216': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:29,972 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:29,972 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39218': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:30,073 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:30,073 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39222': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:30,080 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:30,080 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39236': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:30,181 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:30,181 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39240': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:30,187 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:30,187 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39244': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:30,288 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:30,288 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39256': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:30,295 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:30,295 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39268': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:30,395 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:30,396 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39282': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:30,402 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:30,402 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39290': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:30,503 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:30,503 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39296': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:30,510 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:30,510 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39308': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:30,611 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:30,616 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39316': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:30,617 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:30,617 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39330': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:30,719 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:30,719 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39338': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:30,725 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:30,729 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39354': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:30,826 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:30,832 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39364': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:30,832 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:30,832 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39368': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:30,934 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:30,939 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39370': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:30,940 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:30,940 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39384': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:31,041 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:31,047 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39386': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:31,047 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:31,047 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39396': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:31,148 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:31,149 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39406': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:31,155 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:31,155 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39420': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:31,256 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:31,256 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39434': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:31,262 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:31,262 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39446': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:31,363 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:31,363 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39458': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:31,370 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:31,370 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39464': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:31,471 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:31,471 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39478': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:31,477 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:31,478 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39484': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:31,578 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:31,579 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:42914': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:31,586 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:31,587 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:42920': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:31,686 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:31,687 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:42936': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:31,695 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:31,695 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:42946': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:31,795 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:31,796 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:42956': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:31,810 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:31,811 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:42958': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:31,905 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:31,905 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:42960': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:31,918 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:31,918 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:42964': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:32,012 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:32,013 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:42970': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:32,025 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:32,026 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:42980': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:32,120 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:32,120 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:42992': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:32,133 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:32,133 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43002': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:32,227 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:32,234 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43018': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:32,241 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:32,241 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43026': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:32,336 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:32,336 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43034': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:32,348 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:32,349 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43040': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:32,443 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:32,443 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43056': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:32,456 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:32,456 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43062': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:32,551 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:32,551 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43074': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:32,564 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:32,564 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43078': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:32,658 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:32,659 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43090': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:32,672 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:32,672 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43104': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:32,766 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:32,766 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43108': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:32,779 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:32,779 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43124': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:32,873 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:32,873 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43126': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:32,887 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:32,887 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43136': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:32,980 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:32,980 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43140': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:32,994 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:32,994 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43152': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:33,087 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:33,088 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43162': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:33,101 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:33,101 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43164': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:33,195 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:33,195 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43174': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:33,209 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:33,209 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43186': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:33,302 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:33,303 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43190': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:33,316 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:33,316 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43192': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:33,410 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:33,410 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43208': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:33,423 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:33,424 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43210': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:33,517 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:33,517 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43226': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:33,531 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:33,531 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43230': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:33,625 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:33,625 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43244': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:33,638 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:33,638 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43250': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:33,735 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:33,735 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43260': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:33,745 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:33,745 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43262': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:33,842 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:33,843 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43272': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:33,852 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:33,852 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43276': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:33,950 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:33,950 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43284': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:33,959 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:33,959 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43294': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:34,058 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:34,058 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43298': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:34,066 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:34,066 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43300': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:34,165 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:34,166 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43306': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:34,173 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:34,173 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43320': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:34,273 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:34,273 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43322': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:34,280 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:34,280 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43334': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:34,380 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:34,380 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43346': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:34,387 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:34,387 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43362': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:34,487 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:34,487 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43370': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:34,494 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:34,494 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43386': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:34,595 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:34,595 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43398': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:34,601 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:34,601 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43400': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:34,702 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:34,702 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43402': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:34,709 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:34,709 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43408': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:34,809 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:34,809 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43420': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:34,816 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:34,816 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43434': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:34,916 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:34,917 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43438': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:34,923 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:34,923 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43440': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:35,024 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:35,024 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43456': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:35,031 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:35,031 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43468': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:35,131 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:35,131 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43482': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:35,137 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:35,138 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43492': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:35,238 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:35,238 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43498': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:35,245 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:35,245 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43512': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:35,345 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:35,346 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43524': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:35,352 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:35,352 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43528': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:35,453 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43536': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:35,453 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:35,458 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43548': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:35,458 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:35,559 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43562': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:35,559 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:35,565 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43572': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:35,565 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:35,666 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43584': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:35,666 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:35,671 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43592': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:35,671 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:35,773 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:35,777 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43602': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:35,777 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43616': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:35,778 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:35,880 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:35,883 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43620': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:35,884 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43624': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:35,884 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:35,986 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:35,990 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43634': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:35,990 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43636': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:35,990 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:36,092 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:36,096 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43650': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:36,097 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43656': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:36,097 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:36,199 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:36,202 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43664': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:36,203 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43678': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:36,203 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:36,305 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:36,309 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43684': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:36,310 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43686': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:36,310 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:36,412 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:36,416 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43700': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:36,416 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43710': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:36,416 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:36,518 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:36,522 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43718': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:36,523 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:36,523 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:36,625 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:36,628 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43734': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:36,629 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43748': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:36,629 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:36,733 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:36,737 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43764': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:36,738 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43780': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:36,738 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:36,840 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:36,843 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43782': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:36,844 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43788': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:36,844 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:36,946 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:36,950 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43794': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:36,950 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:36,950 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:37,053 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:37,056 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43808': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:37,057 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43812': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:37,057 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:37,159 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:37,163 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43824': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:37,163 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43840': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:37,163 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:37,265 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:37,269 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43848': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:37,270 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43862': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:37,270 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:37,372 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:37,376 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43870': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:37,376 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43872': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:37,376 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:37,479 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:37,483 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43882': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:37,484 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43888': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:37,484 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:37,586 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:37,589 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43890': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:37,590 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43900': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:37,590 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:37,692 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:37,696 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43912': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:37,697 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43920': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:37,697 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:37,799 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:37,802 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43934': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:37,803 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43950': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:37,803 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:37,905 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:37,909 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43964': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:37,909 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43980': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:37,909 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:38,024 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:38,026 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43990': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:38,027 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43994': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:38,027 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:38,131 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:38,134 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43996': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:38,135 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44004': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:38,135 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:38,237 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:38,240 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44020': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:38,241 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44036': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:38,241 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:38,343 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:38,347 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44050': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:38,347 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44054': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:38,347 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:38,450 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:38,454 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44062': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:38,454 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44074': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:38,454 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:38,556 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:38,560 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44080': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:38,560 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44096': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:38,560 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:38,662 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:38,666 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44110': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:38,667 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44112': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:38,667 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:38,769 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:38,773 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44124': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:38,773 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44138': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:38,773 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:38,875 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:38,879 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44148': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:38,880 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:38,880 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44150': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:38,982 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:38,986 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44152': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:38,986 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44166': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:38,986 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:39,088 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:39,092 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44170': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:39,093 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44180': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:39,093 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:39,196 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:39,199 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44196': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:39,200 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44204': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:39,200 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:39,302 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:39,306 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44214': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:39,306 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44230': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:39,306 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:39,408 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:39,412 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44232': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:39,413 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44248': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:39,413 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:39,515 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:39,519 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44264': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:39,519 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44268': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:39,519 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:39,621 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:39,625 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44276': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:39,626 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44282': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:39,626 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:39,728 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:39,734 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44298': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:39,735 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44314': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:39,735 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:39,834 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44324': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:39,834 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:39,841 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44330': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:39,841 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:39,941 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:39,941 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44340': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:39,947 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44356': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:39,947 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:40,048 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44370': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:40,048 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:40,054 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44386': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:40,054 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:40,155 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44390': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:40,155 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:40,160 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44400': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:40,160 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:40,262 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:40,265 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44404': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:40,266 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44410': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:40,266 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:40,368 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:40,372 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44424': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:40,373 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44440': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:40,373 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:40,475 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:40,479 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44448': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:40,479 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44452': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:40,479 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:40,581 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:40,585 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44464': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:40,586 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44476': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:40,586 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:40,688 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:40,692 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44482': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:40,692 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44494': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:40,692 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:40,794 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:40,798 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44504': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:40,798 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44506': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:40,798 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:40,902 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:40,905 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44522': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:40,906 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44528': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:40,906 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:41,008 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:41,011 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44534': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:41,012 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44550': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:41,012 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:41,114 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:41,118 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44554': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:41,119 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44558': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:41,119 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:41,221 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:41,225 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44572': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:41,225 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:41,229 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44578': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:41,328 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:41,331 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44580': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:41,332 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44586': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:41,332 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:41,435 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:41,438 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44600': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:41,439 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44612': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:41,439 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:41,541 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:41,545 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33004': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:41,546 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33008': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:41,546 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:41,647 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:41,651 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33022': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:41,652 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33028': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:41,652 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:41,754 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:41,758 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33036': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:41,758 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33048': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:41,758 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:41,860 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:41,864 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33056': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:41,864 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33068': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:41,865 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:41,967 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:41,970 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33080': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:41,971 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33084': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:41,971 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:42,073 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:42,077 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33096': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:42,077 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33100': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:42,077 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:42,179 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:42,183 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33108': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:42,184 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33114': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:42,184 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:42,286 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:42,289 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33130': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:42,290 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33140': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:42,290 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:42,392 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:42,396 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33156': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:42,396 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33170': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:42,396 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:42,498 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:42,502 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33186': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:42,502 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33196': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:42,502 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:42,605 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:42,609 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33206': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:42,610 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33216': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:42,610 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:42,712 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:42,715 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33230': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:42,716 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33240': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:42,716 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:42,818 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:42,822 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33244': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:42,822 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33246': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:42,822 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:42,924 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:42,928 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33262': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:42,928 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33276': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:42,929 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:43,031 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:43,034 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33290': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:43,035 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33306': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:43,035 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:43,137 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:43,141 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33312': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:43,141 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33320': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:43,141 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:43,243 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:43,247 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33324': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:43,248 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33332': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:43,248 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:43,350 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:43,353 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33346': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:43,354 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33354': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:43,354 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:43,456 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:43,460 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33358': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:43,461 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33370': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:43,461 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:43,563 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:43,566 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33376': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:43,567 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33386': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:43,567 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:43,669 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:43,673 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33400': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:43,674 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33410': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:43,674 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:43,776 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:43,779 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33420': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:43,780 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33424': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:43,780 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:43,882 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33436': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:43,882 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:43,886 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33448': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:43,886 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:43,988 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33456': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:43,988 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:43,993 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33460': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:43,993 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:44,094 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33474': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:44,094 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:44,099 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33484': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:44,099 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:44,201 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:44,201 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33492': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:44,206 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33502': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:44,206 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:44,308 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:44,311 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33514': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:44,312 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33522': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:44,312 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:44,414 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:44,418 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33526': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:44,418 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33540': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:44,418 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:44,520 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:44,524 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33548': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:44,525 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33562': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:44,525 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:44,627 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:44,631 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33564': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:44,631 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33568': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:44,631 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:44,733 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:44,737 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33584': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:44,737 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33588': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:44,737 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:44,840 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:44,843 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33604': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:44,844 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33618': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:44,844 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:44,946 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:44,950 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33628': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:44,950 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33638': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:44,950 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:45,052 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:45,056 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33644': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:45,057 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33658': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:45,057 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:45,159 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:45,162 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33664': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:45,163 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33680': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:45,163 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:45,265 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:45,269 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33692': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:45,270 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33696': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:45,270 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:45,371 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:45,375 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33700': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:45,376 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33714': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:45,376 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:45,478 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:45,482 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33722': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:45,482 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33738': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:45,482 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:45,584 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:45,588 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33752': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:45,588 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33756': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:45,589 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:45,691 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:45,694 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33768': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:45,695 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33776': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:45,695 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:45,798 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:45,801 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33778': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:45,802 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33780': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:45,802 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:45,904 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:45,908 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33788': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:45,909 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33800': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:45,909 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:46,011 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:46,015 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33808': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:46,016 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33812': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:46,016 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:46,118 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:46,122 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33822': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:46,122 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33832': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:46,122 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:46,224 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:46,228 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33844': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:46,229 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:46,231 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33856': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:46,331 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:46,334 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33868': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:46,335 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33882': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:46,335 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:46,437 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:46,441 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33896': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:46,441 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33902': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:46,441 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:46,543 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:46,547 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33914': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:46,548 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33922': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:46,548 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:46,650 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:46,653 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33932': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:46,654 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33944': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:46,654 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:46,766 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:46,769 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33956': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:46,770 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33958': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:46,771 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:46,872 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:46,873 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33968': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:46,878 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33982': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:46,878 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:46,979 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33988': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:46,979 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:46,984 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33990': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:46,984 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:47,085 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:47,085 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34002': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:47,090 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34010': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:47,090 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:47,192 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34020': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:47,192 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:47,197 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34024': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:47,197 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:47,298 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34030': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:47,298 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:47,303 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34034': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:47,303 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:47,404 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:47,405 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34046': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:47,409 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34050': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:47,409 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:47,511 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34052': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:47,511 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:47,516 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:47,517 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34060': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:47,617 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:47,617 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34074': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:47,622 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34076': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:47,622 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:47,724 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:47,728 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34082': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:47,729 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:47,731 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34084': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:47,831 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:47,834 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34090': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:47,835 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34094': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:47,835 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:47,937 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:47,941 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34110': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:47,941 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34126': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:47,941 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:48,043 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:48,047 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34130': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:48,048 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34140': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:48,048 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:48,150 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:48,154 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34148': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:48,154 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34156': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:48,154 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:48,256 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:48,260 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34162': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:48,261 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34174': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:48,261 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:48,363 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:48,366 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34188': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:48,367 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34196': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:48,367 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:48,469 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:48,473 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34210': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:48,473 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34226': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:48,473 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:48,575 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:48,579 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34234': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:48,580 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34236': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:48,580 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:48,682 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:48,685 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34252': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:48,686 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34268': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:48,686 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:48,788 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:48,792 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34280': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:48,792 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34290': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:48,792 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:48,894 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:48,898 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34292': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:48,899 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34298': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:48,899 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:49,001 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:49,004 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34300': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:49,005 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34302': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:49,005 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:49,107 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:49,111 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34314': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:49,111 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34326': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:49,111 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:49,213 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:49,217 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34336': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:49,218 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34346': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:49,218 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:49,323 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34360': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:49,323 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:49,328 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34366': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:49,328 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:49,431 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:49,435 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34370': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:49,436 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34372': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:49,436 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:49,537 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34376': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:49,537 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:49,542 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:49,542 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34378': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:49,643 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34394': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:49,643 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:49,648 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34400': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:49,648 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:49,750 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:49,750 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34406': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:49,755 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:49,755 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34422': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:49,856 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:49,860 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34436': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:49,861 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34440': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:49,861 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:49,962 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34446': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:49,963 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:49,967 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34458': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:49,967 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:50,069 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34462': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:50,069 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:50,074 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34472': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:50,074 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:50,176 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34488': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:50,176 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:50,182 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34494': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:50,182 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:50,282 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34508': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:50,282 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:50,288 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34512': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:50,288 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:50,389 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:50,389 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34518': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:50,394 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34534': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:50,394 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:50,495 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:50,495 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34540': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:50,500 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34552': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:50,500 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:50,602 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:50,606 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34556': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:50,607 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34568': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:50,607 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:50,708 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:50,712 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34580': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:50,713 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34588': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:50,713 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:50,815 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:50,819 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34596': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:50,819 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34598': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:50,819 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:50,922 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:50,925 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34612': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:50,926 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34628': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:50,926 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:51,028 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:51,032 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34632': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:51,032 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34648': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:51,033 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:51,136 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:51,139 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34662': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:51,140 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34670': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:51,140 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:51,242 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:51,246 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34672': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:51,246 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34678': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:51,246 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:51,349 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:51,352 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34692': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:51,353 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34704': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:51,353 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:51,455 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:51,459 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34716': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:51,459 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34726': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:51,459 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:51,561 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:51,565 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59304': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:51,566 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59316': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:51,566 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:51,668 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:51,672 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59324': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:51,672 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59330': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:51,672 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:51,774 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:51,778 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59340': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:51,779 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59356': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:51,779 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:51,881 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:51,885 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59362': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:51,885 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59364': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:51,885 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:51,987 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:51,991 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59380': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:51,992 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59384': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:51,992 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:52,094 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:52,097 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59398': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:52,098 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59406': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:52,098 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:52,200 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:52,204 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59414': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:52,204 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59424': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:52,204 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:52,306 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:52,310 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59434': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:52,311 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59442': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:52,311 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:52,413 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:52,417 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59454': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:52,417 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59460': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:52,417 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:52,519 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:52,523 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59470': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:52,524 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59474': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:52,524 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:52,626 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:52,630 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59488': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:52,630 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59494': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:52,631 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:52,734 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:52,738 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59510': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:52,738 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59514': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:52,738 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:52,841 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:52,845 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59516': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:52,845 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59530': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:52,845 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:52,947 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:52,951 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59540': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:52,952 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59556': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:52,952 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:53,054 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:53,058 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59566': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:53,058 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59572': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:53,058 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:53,160 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:53,164 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59584': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:53,165 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:53,165 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59596': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:53,267 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:53,271 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59598': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:53,271 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59602': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:53,271 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:53,373 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:53,377 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59616': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:53,377 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59632': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:53,377 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:53,480 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:53,483 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59638': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:53,484 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59642': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:53,484 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:53,586 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:53,590 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59654': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:53,590 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59662': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:53,590 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:53,693 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:53,696 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59672': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:53,697 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59678': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:53,697 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:53,799 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:53,803 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59680': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:53,803 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59682': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:53,803 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:53,906 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:53,909 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59698': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:53,910 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59712': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:53,910 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:54,012 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:54,015 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59720': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:54,016 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59730': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:54,016 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:54,118 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:54,122 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59732': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:54,123 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59744': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:54,123 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:54,239 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:54,241 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59752': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:54,242 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:54,248 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59768': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:54,348 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:54,351 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59778': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:54,352 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59780': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:54,352 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:54,455 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:54,458 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:54,459 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59806': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:54,459 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:54,562 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:54,566 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59822': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:54,567 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59828': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:54,567 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:54,669 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:54,672 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59844': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:54,673 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59848': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:54,673 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:54,775 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:54,779 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59862': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:54,779 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59874': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:54,780 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:54,882 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:54,885 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59888': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:54,886 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59894': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:54,886 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:54,988 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:54,992 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59906': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:54,992 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59916': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:54,992 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:55,095 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:55,098 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59932': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:55,099 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59942': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:55,099 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:55,201 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:55,205 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59944': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:55,205 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59952': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:55,205 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:55,307 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:55,311 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59962': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:55,312 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59976': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:55,312 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:55,414 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:55,418 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59992': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:55,418 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:60002': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:55,418 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:55,520 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:55,524 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:60016': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:55,525 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:60024': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:55,525 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:55,628 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:55,631 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:60032': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:55,631 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:60040': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:55,632 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:55,734 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:55,737 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:60054': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:55,738 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:60068': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:55,738 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:55,840 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:55,844 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:60084': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:55,844 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:60092': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:55,844 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:55,947 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:55,950 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:60106': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:55,951 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:60116': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:55,951 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:56,053 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:56,057 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:60126': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:56,057 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:60132': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:56,057 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:56,159 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:56,163 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:60148': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:56,163 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:60154': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:56,164 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:56,269 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:56,273 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:60166': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:56,273 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:60178': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:56,273 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:56,375 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:56,379 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:60182': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:56,380 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:60192': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:56,380 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:56,482 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:56,485 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:60204': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:56,486 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:60214': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:56,486 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:56,588 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:56,592 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:60216': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:56,592 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:60228': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:56,592 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:56,695 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:56,698 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:60236': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:56,699 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:60242': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:56,699 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:56,801 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:56,804 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:60244': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:56,805 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:60252': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:56,805 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:56,907 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:56,911 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:60264': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:56,911 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:60278': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:56,911 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:57,014 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:57,017 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:60282': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:57,018 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:60298': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:57,018 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:57,120 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:57,124 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:60312': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:57,124 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:60314': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:57,124 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:57,226 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:57,233 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:60330': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:57,234 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:60342': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:57,234 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:57,333 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:60344': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:57,333 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:57,340 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:60354': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:57,340 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:57,440 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:60364': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:57,440 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:57,446 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:60380': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:57,446 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:57,546 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:57,546 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:60382': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:57,552 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:60394': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:57,552 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:57,652 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:60404': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:57,652 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:57,659 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:60418': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:57,659 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:57,759 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:60424': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:57,759 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:57,765 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:60428': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:57,765 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:57,865 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:60442': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:57,865 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:57,871 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:60450': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:57,871 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:57,973 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:57,977 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:60464': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:57,977 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:60476': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:57,977 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:58,079 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:58,083 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:60492': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:58,083 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:60498': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:58,083 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:58,185 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:58,189 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:60508': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:58,190 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:60522': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:58,190 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:58,292 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:58,296 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:60532': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:58,296 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:60534': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:58,296 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:58,398 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:58,402 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:60550': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:58,403 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:60566': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:58,403 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:58,505 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:58,509 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:60580': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:58,509 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:60594': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:58,509 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:58,611 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:58,615 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:60598': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:58,616 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:60606': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:58,616 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:58,718 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:58,722 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:60622': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:58,722 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:58,722 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:60630': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:58,824 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:60644': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:58,824 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:58,829 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:60658': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:58,829 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:58,931 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:58,935 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:60668': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:58,935 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:60670': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:58,935 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:59,044 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:59,048 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:60674': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:59,048 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:60684': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:59,048 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:59,150 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:59,154 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:59,154 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:60686': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:59,155 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:60696': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:59,256 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:59,260 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:60708': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:59,260 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:60724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:59,260 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:59,363 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:59,366 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:60730': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:59,367 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:60738': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:59,367 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:59,469 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:59,473 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:60742': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:59,473 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:60744': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:59,473 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:59,575 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:59,579 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:60760': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:59,580 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:60772': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:59,580 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:59,683 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:59,686 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:60780': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:59,687 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:60782': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:59,687 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:59,789 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:59,792 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:60784': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:59,793 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:60790': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:59,793 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:59,895 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:52:59,899 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:60800': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:59,900 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:60812': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:52:59,900 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:00,002 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:00,005 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:60818': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:00,006 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:60820': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:00,006 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:00,108 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:00,112 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:60834': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:00,112 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:60836': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:00,112 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:00,215 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:00,218 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:60844': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:00,219 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:60848': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:00,219 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:00,321 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:00,325 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:60856': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:00,326 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:60870': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:00,326 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:00,427 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:00,431 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:60884': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:00,432 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:60900': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:00,432 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:00,534 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:00,538 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:60914': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:00,538 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:00,539 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:60924': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:00,640 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:00,645 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:60938': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:00,645 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:00,646 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:60946': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:00,748 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:00,752 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:60962': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:00,753 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:60968': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:00,753 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:00,855 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:00,860 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:60982': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:00,860 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:00,860 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:60990': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:00,961 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:60996': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:00,961 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:00,967 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:32768': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:00,967 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:01,068 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:01,068 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:32770': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:01,073 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:32778': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:01,073 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:01,174 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:32792': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:01,174 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:01,179 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:32806': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:01,179 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:01,280 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:32812': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:01,280 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:01,285 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:32816': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:01,285 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:01,388 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:01,391 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:32822': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:01,392 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:01,392 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:32828': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:01,494 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:01,498 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:32842': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:01,498 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:32850': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:01,498 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:01,604 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:01,607 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:48234': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:01,607 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:48248': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:01,607 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:01,711 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:01,715 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:48252': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:01,715 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:48264': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:01,715 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:01,817 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:01,821 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:48270': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:01,822 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:48286': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:01,822 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:01,924 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:01,928 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:48300': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:01,928 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:48306': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:01,928 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:02,030 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:02,034 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:48310': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:02,035 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:48312': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:02,035 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:02,137 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:02,140 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:48316': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:02,141 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:48322': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:02,141 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:02,243 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:02,246 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:48332': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:02,247 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:48338': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:02,247 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:02,349 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:02,353 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:48344': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:02,354 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:48358': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:02,354 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:02,456 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:02,459 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:48360': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:02,460 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:48366': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:02,460 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:02,562 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:02,566 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:48368': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:02,566 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:48380': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:02,566 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:02,669 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:02,672 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:48392': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:02,673 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:48400': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:02,673 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:02,775 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:02,779 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:48406': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:02,779 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:48418': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:02,779 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:02,882 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:02,885 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:48424': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:02,886 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:48436': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:02,886 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:02,988 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:02,992 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:48442': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:02,992 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:48454': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:02,992 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:03,095 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:03,099 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:48468': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:03,100 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:48482': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:03,100 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:03,202 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:48496': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:03,202 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:03,207 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:48510': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:03,207 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:03,308 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:48524': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:03,308 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:03,313 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:48536': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:03,313 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:03,416 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:03,420 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:48538': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:03,421 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:48552': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:03,421 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:03,522 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:03,526 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:48568': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:03,527 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:48578': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:03,527 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:03,629 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:03,633 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:48582': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:03,633 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:48590': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:03,633 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:03,735 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:03,739 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:48594': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:03,739 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:48606': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:03,739 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:03,841 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:03,845 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:48616': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:03,846 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:48620': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:03,846 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:03,948 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:03,951 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:48636': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:03,952 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:03,952 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:48642': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:04,054 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:04,058 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:48646': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:04,059 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:48650': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:04,059 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:04,161 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:04,164 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:48656': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:04,165 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:48662': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:04,165 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:04,267 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:04,271 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:48666': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:04,272 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:48676': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:04,272 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:04,374 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:04,377 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:48682': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:04,378 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:48696': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:04,378 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:04,480 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:04,484 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:48706': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:04,484 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:48714': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:04,484 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:04,587 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:04,590 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:48724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:04,591 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:48728': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:04,591 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:04,693 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:04,697 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:48742': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:04,697 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:48748': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:04,697 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:04,800 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:04,804 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:48750': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:04,805 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:48764': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:04,805 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:04,907 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:04,911 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:48778': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:04,911 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:48786': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:04,911 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:05,013 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:05,017 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:48796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:05,018 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:48810': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:05,018 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:05,120 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:05,124 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:48812': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:05,124 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:48824': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:05,124 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:05,226 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:05,233 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:48836': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:05,234 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:48844': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:05,234 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:05,333 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:48850': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:05,333 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:05,340 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:48856': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:05,340 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:05,439 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:48872': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:05,439 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:05,447 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:48882': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:05,447 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:05,546 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:48888': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:05,546 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:05,553 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:48900': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:05,553 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:05,653 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:48912': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:05,653 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:05,660 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:48920': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:05,660 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:05,759 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:48924': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:05,759 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:05,767 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:48926': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:05,767 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:05,865 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:48934': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:05,865 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:05,873 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:48948': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:05,873 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:05,972 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:48958': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:05,972 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:05,979 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:48966': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:05,979 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:06,079 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:48970': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:06,079 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:06,086 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:48972': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:06,086 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:06,185 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:48982': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:06,185 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:06,192 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:48996': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:06,192 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:06,292 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49000': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:06,292 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:06,299 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49002': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:06,299 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:06,398 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49012': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:06,398 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:06,405 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49026': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:06,405 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:06,506 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49040': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:06,506 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:06,511 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49052': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:06,511 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:06,612 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49064': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:06,612 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:06,618 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49066': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:06,618 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:06,719 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49070': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:06,719 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:06,724 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:06,724 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49072': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:06,825 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49084': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:06,825 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:06,831 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49100': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:06,831 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:06,932 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:06,932 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49110': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:06,937 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:06,937 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49118': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:07,038 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:07,038 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49130': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:07,043 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49144': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:07,043 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:07,145 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49156': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:07,145 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:07,150 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49170': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:07,150 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:07,251 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49178': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:07,251 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:07,256 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49180': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:07,256 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:07,357 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49182': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:07,357 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:07,362 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49190': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:07,362 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:07,464 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49192': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:07,464 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:07,469 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49198': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:07,469 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:07,571 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:07,574 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49208': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:07,575 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49214': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:07,575 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:07,677 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49218': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:07,677 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:07,682 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49220': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:07,682 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:07,783 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49228': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:07,783 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:07,788 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49234': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:07,788 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:07,890 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:07,894 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49250': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:07,894 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49262': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:07,894 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:07,996 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:08,000 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49278': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:08,000 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49290': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:08,000 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:08,102 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:08,106 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49304': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:08,107 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49314': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:08,107 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:08,210 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:08,214 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49320': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:08,215 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49334': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:08,215 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:08,316 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:08,316 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49346': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:08,322 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:08,322 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49358': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:08,423 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:08,423 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49366': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:08,428 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49376': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:08,428 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:08,529 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:08,529 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49386': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:08,535 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:08,535 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49396': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:08,636 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49408': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:08,636 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:08,641 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49420': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:08,641 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:08,742 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49426': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:08,742 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:08,748 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49428': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:08,748 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:08,849 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49436': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:08,849 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:08,854 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49448': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:08,854 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:08,955 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49462': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:08,955 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:08,961 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49468': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:08,961 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:09,062 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49474': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:09,062 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:09,067 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49484': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:09,067 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:09,168 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:09,168 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49498': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:09,173 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49506': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:09,173 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:09,275 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:09,275 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49520': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:09,280 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49534': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:09,280 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:09,381 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:09,381 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49542': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:09,386 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49546': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:09,386 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:09,487 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:09,487 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49550': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:09,492 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49552': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:09,492 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:09,594 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:09,594 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49564': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:09,599 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49566': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:09,599 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:09,700 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:09,700 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49570': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:09,705 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49584': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:09,705 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:09,807 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:09,807 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49596': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:09,812 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:09,812 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49610': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:09,914 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:09,918 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49620': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:09,918 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49624': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:09,918 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:10,020 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:10,024 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49632': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:10,024 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49640': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:10,024 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:10,126 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:10,130 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49648': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:10,131 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49664': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:10,131 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:10,233 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:10,236 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49678': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:10,237 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49682': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:10,237 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:10,339 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:10,343 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49686': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:10,343 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49690': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:10,343 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:10,445 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:10,449 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49694': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:10,449 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49706': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:10,449 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:10,552 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:10,555 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49716': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:10,556 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49726': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:10,556 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:10,658 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:10,662 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49730': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:10,663 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49734': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:10,663 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:10,765 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:10,768 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49744': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:10,769 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49758': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:10,769 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:10,872 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:10,875 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49770': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:10,876 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49782': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:10,876 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:10,978 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:10,982 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:10,982 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49804': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:10,982 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:11,084 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:11,088 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49812': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:11,089 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49816': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:11,089 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:11,191 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:11,194 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49826': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:11,195 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49830': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:11,195 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:11,297 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:11,301 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49838': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:11,301 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49840': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:11,301 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:11,403 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:11,407 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49844': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:11,408 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49850': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:11,408 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:11,510 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:11,513 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49852': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:11,514 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49856': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:11,514 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:11,617 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:11,621 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38430': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:11,621 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38434': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:11,621 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:11,724 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:11,728 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38436': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:11,728 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:11,731 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38442': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:11,830 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:11,834 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38446': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:11,834 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38452': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:11,834 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:11,937 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:11,940 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38454': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:11,941 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38456': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:11,941 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:12,043 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:12,047 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38472': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:12,047 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38484': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:12,047 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:12,149 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:12,153 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38500': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:12,153 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38514': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:12,153 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:12,256 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:12,260 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38524': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:12,261 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38534': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:12,261 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:12,363 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:12,366 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38544': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:12,367 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38548': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:12,367 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:12,469 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:12,473 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38554': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:12,473 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38556': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:12,473 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:12,575 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:12,579 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38568': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:12,580 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38574': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:12,580 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:12,682 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:12,685 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38580': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:12,686 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38586': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:12,686 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:12,788 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:12,792 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38596': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:12,792 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38610': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:12,792 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:12,894 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:12,898 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38616': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:12,899 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38630': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:12,899 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:13,001 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:13,004 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38640': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:13,005 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38648': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:13,005 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:13,107 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:13,111 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38664': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:13,111 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38670': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:13,111 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:13,214 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:13,217 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38678': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:13,218 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38694': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:13,218 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:13,321 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:13,325 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38698': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:13,325 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38704': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:13,325 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:13,427 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38708': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:13,428 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:13,434 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38716': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:13,434 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:13,534 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38718': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:13,534 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:13,541 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38722': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:13,541 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:13,640 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:13,640 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:13,647 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38730': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:13,647 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:13,747 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38732': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:13,747 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:13,753 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38746': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:13,753 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:13,853 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38762': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:13,853 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:13,859 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38772': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:13,859 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:13,959 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38774': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:13,959 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:13,966 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38784': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:13,966 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:14,066 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38800': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:14,066 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:14,072 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38816': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:14,072 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:14,172 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38822': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:14,172 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:14,178 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38832': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:14,178 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:14,278 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38834': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:14,278 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:14,284 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:14,285 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38850': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:14,384 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38860': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:14,384 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:14,390 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38872': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:14,391 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:14,491 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:14,491 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38886': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:14,497 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38888': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:14,497 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:14,598 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:14,598 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38894': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:14,603 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38902': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:14,603 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:14,704 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:14,708 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38904': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:14,709 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38906': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:14,709 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:14,810 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:14,814 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38918': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:14,815 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38934': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:14,815 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:14,917 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:14,920 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38946': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:14,921 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38962': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:14,921 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:15,024 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:15,028 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38976': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:15,028 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:15,028 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:15,131 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:15,134 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38998': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:15,135 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39002': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:15,135 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:15,237 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:15,241 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39012': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:15,241 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39022': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:15,241 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:15,344 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:15,347 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39028': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:15,348 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39032': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:15,348 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:15,450 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:15,453 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39042': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:15,454 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39044': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:15,454 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:15,556 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:15,560 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:15,560 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39070': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:15,560 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:15,663 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:15,666 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39082': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:15,667 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39098': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:15,667 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:15,769 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:15,773 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39102': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:15,773 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:15,773 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39104': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:15,875 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:15,879 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39106': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:15,880 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:15,880 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:15,982 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:15,985 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39126': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:15,986 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39142': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:15,986 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:16,088 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:16,091 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39148': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:16,092 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39164': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:16,092 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:16,194 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:16,198 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39180': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:16,198 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39194': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:16,198 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:16,301 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:16,304 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39196': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:16,305 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39212': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:16,305 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:16,407 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:16,411 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39216': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:16,411 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39232': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:16,411 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:16,514 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:16,517 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39234': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:16,518 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39240': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:16,518 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:16,620 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:16,624 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39244': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:16,624 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39248': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:16,624 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:16,727 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:16,733 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39258': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:16,734 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39260': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:16,734 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:16,834 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39274': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:16,834 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:16,841 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39284': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:16,841 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:16,941 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39300': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:16,941 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:16,947 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39302': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:16,947 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:17,048 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39308': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:17,048 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:17,054 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39310': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:17,054 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:17,154 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39326': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:17,154 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:17,160 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39342': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:17,160 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:17,261 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:17,261 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39346': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:17,266 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39350': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:17,266 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:17,368 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:17,371 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39364': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:17,372 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39374': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:17,372 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:17,474 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:17,478 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39386': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:17,478 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39388': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:17,478 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:17,580 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:17,585 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39398': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:17,585 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39402': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:17,585 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:17,687 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39406': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:17,687 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:17,692 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39416': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:17,692 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:17,793 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:17,797 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39420': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:17,798 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39434': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:17,798 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:17,900 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:17,903 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39436': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:17,904 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39444': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:17,904 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:18,007 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:18,010 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39460': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:18,011 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39462': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:18,011 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:18,113 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:18,117 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39478': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:18,117 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39482': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:18,117 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:18,219 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:18,223 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39492': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:18,224 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39498': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:18,224 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:18,326 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:18,330 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39500': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:18,330 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39508': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:18,330 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:18,433 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:18,436 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39512': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:18,437 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39518': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:18,437 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:18,539 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:18,543 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39520': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:18,543 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39528': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:18,544 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:18,646 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:18,649 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39544': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:18,650 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39546': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:18,650 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:18,752 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:18,756 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39560': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:18,756 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39564': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:18,757 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:18,859 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:18,862 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39578': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:18,863 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39594': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:18,863 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:18,965 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:18,969 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39604': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:18,969 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39618': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:18,969 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:19,071 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:19,075 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39634': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:19,075 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39644': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:19,075 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:19,178 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:19,181 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39652': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:19,182 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39656': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:19,182 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:19,284 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:19,288 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39666': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:19,288 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39682': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:19,289 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:19,391 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:19,394 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39696': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:19,395 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39710': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:19,395 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:19,497 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:19,501 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39722': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:19,501 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:19,501 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:19,603 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:19,607 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39730': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:19,607 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39736': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:19,608 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:19,710 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:19,713 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39752': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:19,714 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39764': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:19,714 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:19,816 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:19,820 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39772': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:19,820 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39786': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:19,820 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:19,922 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:19,926 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39790': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:19,927 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39794': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:19,927 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:20,029 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:20,033 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:20,033 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39810': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:20,033 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:20,136 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:20,140 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39812': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:20,140 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39820': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:20,140 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:20,242 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:20,246 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39826': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:20,247 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39838': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:20,247 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:20,349 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:20,353 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39840': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:20,353 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39842': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:20,353 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:20,455 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:20,459 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39854': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:20,460 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39856': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:20,460 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:20,562 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:20,565 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39864': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:20,566 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39880': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:20,566 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:20,668 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:20,672 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39888': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:20,672 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39894': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:20,672 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:20,775 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:20,779 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39908': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:20,780 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39922': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:20,780 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:20,882 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:20,886 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39930': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:20,886 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39934': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:20,886 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:20,988 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:20,992 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39936': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:20,992 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39948': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:20,992 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:21,095 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:21,099 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39960': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:21,099 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39974': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:21,099 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:21,201 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:21,205 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39980': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:21,206 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:21,206 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39982': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:21,308 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:21,312 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39998': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:21,312 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40002': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:21,312 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:21,414 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:21,418 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40010': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:21,419 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40022': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:21,419 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:21,521 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:21,525 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40034': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:21,525 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40046': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:21,526 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:21,628 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:21,632 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44472': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:21,633 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44488': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:21,633 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:21,735 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44502': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:21,735 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:21,740 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44514': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:21,740 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:21,842 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:21,845 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44516': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:21,846 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44518': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:21,846 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:21,949 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:21,952 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44528': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:21,953 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44540': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:21,953 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:22,055 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:22,059 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44542': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:22,059 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44548': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:22,059 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:22,162 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:22,165 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44562': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:22,166 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44570': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:22,166 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:22,268 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:22,272 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44572': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:22,273 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44580': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:22,273 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:22,375 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:22,379 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44592': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:22,379 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44606': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:22,379 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:22,483 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:22,487 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44618': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:22,488 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44634': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:22,488 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:22,590 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:22,594 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44644': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:22,595 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44658': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:22,595 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:22,696 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44670': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:22,696 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:22,701 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44678': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:22,701 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:22,803 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:22,806 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44684': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:22,807 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44698': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:22,807 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:22,910 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:22,913 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44706': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:22,914 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44712': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:22,914 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:23,016 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:23,020 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:23,020 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44726': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:23,020 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:23,123 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:23,126 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44732': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:23,127 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44744': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:23,127 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:23,232 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:23,236 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44750': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:23,236 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44764': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:23,236 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:23,339 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:23,342 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44772': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:23,343 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:23,343 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44782': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:23,445 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:23,449 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44786': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:23,450 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44792': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:23,450 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:23,553 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:23,556 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44794': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:23,557 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44808': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:23,557 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:23,660 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:23,664 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44820': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:23,664 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44828': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:23,664 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:23,767 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:23,772 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44836': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:23,773 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:23,773 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44848': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:23,874 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44856': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:23,874 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:23,879 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44866': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:23,879 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:23,982 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:23,986 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44880': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:23,987 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:23,987 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44884': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:24,088 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:24,088 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44890': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:24,094 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:24,094 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44902': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:24,195 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44916': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:24,195 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:24,201 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44928': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:24,201 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:24,301 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44930': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:24,301 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:24,307 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44944': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:24,307 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:24,408 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44960': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:24,408 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:24,414 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44972': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:24,414 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:24,514 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44986': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:24,514 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:24,520 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45000': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:24,520 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:24,621 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:24,621 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45006': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:24,627 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45022': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:24,627 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:24,727 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:24,730 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45038': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:24,735 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45052': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:24,735 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:24,834 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45062': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:24,834 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:24,842 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45072': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:24,842 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:24,940 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45088': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:24,940 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:24,948 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:24,948 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45092': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:25,047 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45104': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:25,047 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:25,055 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45108': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:25,055 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:25,153 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:25,153 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45110': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:25,161 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:25,161 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:25,260 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45134': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:25,260 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:25,268 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45144': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:25,268 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:25,367 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45150': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:25,367 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:25,374 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45156': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:25,374 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:25,473 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:25,473 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45168': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:25,481 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45172': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:25,481 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:25,579 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45184': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:25,579 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:25,587 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45190': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:25,587 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:25,686 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:25,686 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45194': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:25,693 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45208': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:25,694 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:25,792 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45222': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:25,792 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:25,800 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45234': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:25,800 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:25,899 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45250': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:25,899 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:25,906 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45256': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:25,906 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:26,006 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45262': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:26,006 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:26,013 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45268': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:26,013 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:26,112 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45284': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:26,112 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:26,119 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45292': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:26,119 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:26,219 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45296': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:26,219 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:26,226 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:26,228 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45298': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:26,325 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45312': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:26,326 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:26,332 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45326': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:26,333 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:26,432 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45334': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:26,432 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:26,440 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45338': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:26,440 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:26,539 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45344': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:26,539 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:26,546 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45352': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:26,546 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:26,645 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45358': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:26,645 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:26,653 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45366': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:26,653 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:26,752 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45376': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:26,752 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:26,759 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45382': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:26,759 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:26,858 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45388': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:26,858 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:26,866 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45396': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:26,866 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:26,965 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45402': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:26,965 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:26,972 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45410': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:26,972 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:27,072 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45418': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:27,072 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:27,079 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45430': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:27,079 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:27,178 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45432': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:27,178 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:27,185 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45448': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:27,185 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:27,284 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45460': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:27,284 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:27,292 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45462': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:27,292 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:27,391 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45466': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:27,391 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:27,398 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45482': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:27,398 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:27,497 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45494': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:27,497 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:27,505 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:27,505 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45504': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:27,604 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45514': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:27,604 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:27,611 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45528': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:27,611 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:27,710 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45542': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:27,710 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:27,717 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45552': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:27,717 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:27,816 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45562': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:27,816 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:27,824 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:27,824 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45576': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:27,923 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:27,923 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45590': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:27,930 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45604': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:27,930 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:28,029 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45614': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:28,029 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:28,037 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45620': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:28,037 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:28,136 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45628': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:28,136 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:28,143 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45638': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:28,143 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:28,242 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45642': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:28,242 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:28,249 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45656': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:28,249 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:28,349 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45672': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:28,349 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:28,356 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45676': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:28,356 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:28,455 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45688': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:28,455 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:28,462 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45704': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:28,462 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:28,561 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45710': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:28,561 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:28,568 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45718': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:28,568 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:28,668 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45720': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:28,668 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:28,675 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:28,675 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:28,775 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45728': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:28,775 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:28,781 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45744': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:28,781 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:28,881 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45750': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:28,881 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:28,887 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45760': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:28,887 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:28,987 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45768': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:28,987 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:28,993 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45776': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:28,993 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:29,094 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45782': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:29,094 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:29,100 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:29,100 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:29,200 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45802': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:29,200 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:29,206 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45806': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:29,206 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:29,306 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45808': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:29,306 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:29,312 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45824': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:29,312 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:29,413 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45836': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:29,413 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:29,418 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45846': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:29,418 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:29,519 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45856': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:29,519 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:29,525 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:29,525 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45870': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:29,625 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45876': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:29,625 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:29,631 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45882': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:29,631 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:29,733 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45898': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:29,733 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:29,738 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:29,738 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45908': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:29,839 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45924': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:29,839 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:29,844 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45926': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:29,844 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:29,945 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:29,945 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45932': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:29,950 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45934': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:29,950 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:30,052 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:30,052 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45942': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:30,057 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45958': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:30,057 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:30,158 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:30,158 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45966': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:30,163 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45978': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:30,163 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:30,264 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:30,265 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45990': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:30,270 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:46004': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:30,270 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:30,372 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:30,375 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:46012': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:30,376 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:46022': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:30,376 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:30,478 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:30,482 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:46036': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:30,482 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:46038': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:30,482 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:30,585 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:30,588 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:46040': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:30,589 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:46048': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:30,589 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:30,691 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:30,695 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:46060': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:30,695 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:46068': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:30,695 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:30,797 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:30,801 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:46080': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:30,802 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:46090': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:30,802 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:30,904 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:30,907 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:46094': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:30,908 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:46106': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:30,908 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:31,010 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:31,014 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:46122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:31,014 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:46124': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:31,014 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:31,117 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:31,121 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:46138': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:31,122 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:46150': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:31,122 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:31,224 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:31,227 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:46156': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:31,228 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:31,230 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:46166': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:31,330 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:31,334 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:46180': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:31,334 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:46194': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:31,334 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:31,436 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:31,440 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:46208': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:31,440 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:46214': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:31,440 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:31,543 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:31,546 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:55954': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:31,547 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:55960': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:31,547 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:31,649 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:31,653 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:55970': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:31,654 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:55982': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:31,654 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:31,755 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:31,759 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:55998': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:31,760 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56012': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:31,760 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:31,862 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:31,866 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56018': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:31,866 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56022': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:31,866 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:31,968 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:31,972 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56036': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:31,972 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56042': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:31,972 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:32,075 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:32,079 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56044': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:32,079 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56052': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:32,079 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:32,181 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:32,185 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56056': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:32,186 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56072': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:32,186 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:32,288 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:32,291 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56086': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:32,292 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56090': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:32,292 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:32,394 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:32,398 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56100': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:32,398 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56102': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:32,398 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:32,500 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:32,505 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56112': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:32,506 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56116': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:32,506 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:32,607 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:32,607 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56128': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:32,612 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56130': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:32,612 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:32,713 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56142': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:32,713 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:32,719 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56158': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:32,719 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:32,819 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:32,819 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56166': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:32,825 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56176': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:32,825 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:32,926 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56184': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:32,926 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:32,931 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56186': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:32,931 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:33,032 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56190': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:33,032 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:33,038 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56202': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:33,038 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:33,138 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56216': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:33,138 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:33,144 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56228': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:33,144 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:33,244 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56234': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:33,244 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:33,251 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56236': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:33,251 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:33,351 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56240': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:33,351 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:33,357 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56248': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:33,357 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:33,457 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56250': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:33,457 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:33,464 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56258': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:33,464 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:33,563 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56262': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:33,563 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:33,570 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56268': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:33,570 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:33,670 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56276': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:33,670 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:33,676 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56282': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:33,676 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:33,777 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:33,777 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56296': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:33,782 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56304': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:33,783 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:33,883 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:33,883 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56306': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:33,889 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56318': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:33,889 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:33,989 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56334': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:33,990 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:33,995 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56336': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:33,996 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:34,096 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56344': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:34,096 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:34,102 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:34,102 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56348': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:34,202 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56358': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:34,202 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:34,208 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56364': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:34,208 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:34,308 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56372': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:34,308 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:34,315 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56384': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:34,315 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:34,415 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56398': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:34,415 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:34,421 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56408': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:34,421 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:34,521 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56416': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:34,521 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:34,527 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56428': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:34,527 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:34,627 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56434': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:34,627 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:34,634 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56450': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:34,634 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:34,733 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56456': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:34,733 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:34,740 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56468': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:34,740 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:34,840 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:34,840 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56478': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:34,846 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56492': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:34,846 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:34,946 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:34,946 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56500': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:34,953 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56516': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:34,953 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:35,053 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56526': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:35,053 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:35,059 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56542': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:35,059 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:35,159 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56556': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:35,159 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:35,165 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56566': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:35,165 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:35,265 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56578': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:35,265 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:35,272 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56582': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:35,272 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:35,372 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:35,372 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56590': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:35,378 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56604': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:35,378 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:35,479 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56616': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:35,479 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:35,485 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56622': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:35,485 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:35,585 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56634': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:35,585 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:35,591 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56646': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:35,591 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:35,691 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56648': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:35,691 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:35,697 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56656': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:35,697 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:35,798 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56672': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:35,798 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:35,804 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56686': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:35,804 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:35,905 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56694': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:35,905 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:35,911 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56698': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:35,911 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:36,011 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56702': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:36,011 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:36,018 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56706': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:36,018 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:36,118 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56718': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:36,118 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:36,125 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56732': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:36,125 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:36,224 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:36,224 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56738': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:36,232 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56748': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:36,232 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:36,331 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56752': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:36,331 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:36,339 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56764': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:36,339 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:36,437 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56768': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:36,437 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:36,446 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56782': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:36,446 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:36,544 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56792': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:36,544 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:36,552 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:36,552 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:36,650 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56808': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:36,650 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:36,658 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56824': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:36,658 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:36,756 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56826': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:36,756 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:36,765 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56830': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:36,765 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:36,863 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:36,863 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56842': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:36,871 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56844': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:36,871 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:36,969 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56858': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:36,969 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:36,977 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56868': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:36,977 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:37,076 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56880': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:37,076 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:37,084 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56888': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:37,084 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:37,183 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56894': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:37,183 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:37,190 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:37,190 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56898': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:37,289 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56902': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:37,289 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:37,296 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:37,296 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56904': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:37,396 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56914': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:37,396 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:37,403 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:37,403 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56916': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:37,502 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56926': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:37,502 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:37,509 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56932': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:37,509 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:37,609 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56942': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:37,609 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:37,615 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56952': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:37,615 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:37,715 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56954': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:37,715 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:37,721 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56960': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:37,721 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:37,822 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:37,822 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56964': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:37,827 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56974': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:37,827 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:37,929 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:37,929 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:37,934 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56990': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:37,934 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:38,035 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56992': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:38,035 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:38,040 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:38,040 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56998': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:38,142 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:38,145 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:57000': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:38,146 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:57014': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:38,146 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:38,248 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:38,252 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:57016': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:38,253 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:57030': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:38,253 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:38,354 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:38,358 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:57032': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:38,359 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:57042': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:38,359 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:38,461 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:38,465 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:57048': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:38,465 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:57064': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:38,465 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:38,567 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:38,571 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:57074': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:38,572 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:57080': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:38,572 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:38,674 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:38,678 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:57096': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:38,678 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:57098': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:38,678 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:38,780 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:38,784 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:57108': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:38,785 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:57118': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:38,785 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:38,888 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:38,891 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:57126': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:38,892 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:57138': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:38,892 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:38,994 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:38,998 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:57152': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:38,998 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:57158': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:38,998 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:39,101 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:39,104 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:57160': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:39,105 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:57172': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:39,105 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:39,207 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:39,211 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:57186': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:39,211 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:57200': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:39,211 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:39,314 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:39,317 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:57216': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:39,318 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:57220': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:39,318 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:39,420 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:39,424 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:57228': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:39,424 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:39,424 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:57234': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:39,526 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:39,530 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:57250': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:39,531 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:57252': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:39,531 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:39,633 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:39,636 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:57266': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:39,637 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:57272': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:39,637 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:39,739 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:39,743 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:57286': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:39,743 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:57302': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:39,743 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:39,846 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:39,849 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:57312': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:39,850 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:57316': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:39,850 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:39,952 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:39,956 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:57318': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:39,956 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:57326': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:39,956 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:40,058 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:40,062 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:57342': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:40,063 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:57352': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:40,063 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:40,165 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:40,169 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:57360': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:40,169 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:57364': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:40,169 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:40,271 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:40,275 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:57378': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:40,276 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:57382': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:40,276 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:40,378 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:40,382 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:57396': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:40,382 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:57408': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:40,382 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:40,484 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:40,488 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:57416': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:40,489 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:57428': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:40,489 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:40,592 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:40,595 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:57444': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:40,596 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:57454': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:40,596 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:40,699 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:40,703 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:57464': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:40,703 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:57480': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:40,703 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:40,805 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:40,809 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:57482': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:40,810 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:57496': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:40,810 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:40,912 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:40,915 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:57512': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:40,916 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:57524': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:40,916 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:41,018 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:41,022 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:57532': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:41,022 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:57548': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:41,022 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:41,124 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:41,128 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:57556': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:41,129 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:57558': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:41,129 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:41,233 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:41,237 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:57562': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:41,237 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:57578': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:41,237 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:41,339 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:41,343 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:57582': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:41,343 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:57594': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:41,343 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:41,445 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:41,449 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:57608': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:41,450 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:57618': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:41,450 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:41,552 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:41,556 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:37094': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:41,556 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:37098': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:41,556 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:41,658 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:41,662 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:37106': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:41,662 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:37110': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:41,662 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:41,765 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:41,768 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:37116': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:41,769 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:37128': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:41,769 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:41,871 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:41,875 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:37144': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:41,875 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:37160': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:41,875 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:41,977 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:41,981 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:37172': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:41,982 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:37188': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:41,982 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:42,084 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:42,087 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:37196': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:42,088 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:37212': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:42,088 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:42,190 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:42,194 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:37216': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:42,194 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:37218': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:42,194 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:42,297 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:42,301 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:37228': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:42,301 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:37242': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:42,301 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:42,403 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:42,407 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:37256': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:42,408 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:37264': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:42,408 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:42,510 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:42,514 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:37276': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:42,514 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:37288': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:42,514 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:42,616 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:42,620 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:37296': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:42,620 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:37306': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:42,620 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:42,722 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:42,726 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:37318': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:42,727 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:42,729 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:37328': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:42,828 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:42,832 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:37338': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:42,833 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:37344': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:42,833 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:42,935 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:42,939 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:37348': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:42,939 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:37356': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:42,939 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:43,041 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:43,045 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:37366': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:43,046 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:37372': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:43,046 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:43,148 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:43,151 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:37384': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:43,152 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:37396': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:43,152 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:43,254 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:43,258 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:37404': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:43,258 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:37418': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:43,258 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:43,360 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:43,364 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:37422': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:43,365 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:37428': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:43,365 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:43,467 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:43,471 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:37442': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:43,471 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:37446': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:43,471 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:43,573 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:43,577 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:37456': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:43,578 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:37466': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:43,578 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:43,680 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:43,684 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:37478': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:43,684 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:37488': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:43,684 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:43,786 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:43,790 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:37490': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:43,791 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:37492': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:43,791 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:43,892 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:43,896 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:37502': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:43,897 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:37506': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:43,897 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:44,000 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:44,003 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:37522': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:44,004 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:37528': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:44,004 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:44,106 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:44,110 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:37542': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:44,110 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:44,110 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:37546': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:44,212 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:44,216 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:37554': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:44,217 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:37570': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:44,217 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:44,319 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:44,322 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:37576': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:44,323 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:37592': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:44,323 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:44,425 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:44,429 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:37608': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:44,429 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:37616': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:44,430 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:44,531 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:44,535 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:37628': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:44,536 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:37640': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:44,536 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:44,638 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:44,641 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:37642': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:44,642 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:37652': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:44,642 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:44,744 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:44,748 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:37654': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:44,748 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:37666': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:44,748 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:44,850 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:44,854 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:37676': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:44,854 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:37690': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:44,854 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:44,957 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:44,960 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:37700': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:44,961 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:37712': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:44,961 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:45,063 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:45,067 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:37724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:45,067 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:37736': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:45,067 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:45,169 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:45,173 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:37742': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:45,174 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:45,174 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:37750': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:45,276 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:45,279 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:37762': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:45,280 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:37772': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:45,280 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:45,382 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:45,386 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:37774': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:45,386 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:37786': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:45,386 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:45,490 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:45,493 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:37790': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:45,494 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:37798': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:45,494 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:45,596 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:45,600 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:37800': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:45,600 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:37808': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:45,600 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:45,703 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:45,707 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:37824': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:45,708 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:37838': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:45,708 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:45,810 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:45,814 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:37848': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:45,814 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:37862': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:45,814 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:45,916 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:45,920 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:37868': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:45,921 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:37874': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:45,921 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:46,023 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:46,026 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:37880': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:46,027 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:37890': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:46,027 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:46,129 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:46,133 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:37900': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:46,134 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:37906': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:46,134 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:46,236 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:46,239 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:37922': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:46,240 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:37926': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:46,240 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:46,342 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:46,346 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:37938': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:46,346 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:37942': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:46,346 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:46,448 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:46,452 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:37950': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:46,453 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:37958': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:46,453 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:46,555 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:46,559 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:37966': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:46,559 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:46,559 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:37982': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:46,662 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:46,665 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:37994': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:46,666 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38000': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:46,666 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:46,768 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:46,772 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38014': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:46,772 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38026': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:46,772 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:46,874 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:46,878 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38032': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:46,878 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38044': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:46,879 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:46,981 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:46,984 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38052': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:46,985 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38066': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:46,985 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:47,087 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:47,091 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38070': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:47,092 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38074': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:47,092 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:47,194 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:47,198 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38080': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:47,199 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38090': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:47,199 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:47,300 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:47,300 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38106': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:47,305 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38114': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:47,305 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:47,407 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:47,411 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38116': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:47,411 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38124': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:47,411 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:47,514 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:47,518 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38126': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:47,518 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38132': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:47,518 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:47,620 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:47,624 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38148': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:47,624 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:47,624 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38162': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:47,726 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:47,732 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38164': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:47,733 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38170': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:47,733 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:47,832 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38178': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:47,832 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:47,839 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:47,839 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38182': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:47,939 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:47,939 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38188': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:47,945 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38204': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:47,945 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:48,045 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38214': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:48,045 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:48,052 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38222': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:48,052 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:48,152 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38224': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:48,152 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:48,158 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:48,158 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38236': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:48,258 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38250': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:48,258 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:48,264 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38254': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:48,264 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:48,365 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38268': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:48,365 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:48,371 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38280': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:48,371 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:48,471 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:48,471 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38284': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:48,477 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:48,477 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38296': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:48,577 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38308': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:48,577 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:48,583 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38322': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:48,583 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:48,684 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:48,684 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38326': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:48,690 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38332': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:48,690 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:48,790 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38348': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:48,790 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:48,796 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:48,796 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38350': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:48,897 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38360': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:48,897 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:48,902 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38362': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:48,902 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:49,003 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38366': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:49,003 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:49,009 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38368': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:49,009 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:49,110 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:49,110 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38372': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:49,115 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38378': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:49,115 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:49,216 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:49,216 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38388': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:49,221 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38390': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:49,221 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:49,322 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38396': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:49,322 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:49,328 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38406': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:49,328 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:49,428 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:49,429 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38408': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:49,434 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38412': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:49,434 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:49,535 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38426': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:49,535 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:49,540 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38434': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:49,540 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:49,642 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38436': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:49,642 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:49,646 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38442': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:49,647 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:49,748 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:49,752 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38452': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:49,753 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38458': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:49,753 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:49,854 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:49,858 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38460': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:49,859 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38474': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:49,859 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:49,961 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:49,964 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38490': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:49,965 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38492': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:49,965 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:50,067 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:50,071 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38508': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:50,071 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38520': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:50,071 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:50,174 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:50,177 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38526': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:50,178 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38534': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:50,178 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:50,281 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:50,285 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38544': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:50,285 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38560': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:50,285 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:50,387 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:50,391 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38568': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:50,391 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38570': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:50,391 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:50,493 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:50,497 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38572': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:50,498 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38584': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:50,498 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:50,600 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:50,603 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38590': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:50,604 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38594': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:50,604 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:50,706 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:50,710 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38596': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:50,710 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38608': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:50,710 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:50,813 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:50,817 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38620': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:50,818 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38630': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:50,818 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:50,919 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:50,923 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38640': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:50,924 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38656': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:50,924 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:51,025 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:51,029 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38660': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:51,030 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38664': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:51,030 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:51,132 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:51,135 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38672': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:51,136 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38674': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:51,136 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:51,238 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38682': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:51,238 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:51,243 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38688': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:51,243 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:51,344 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:51,344 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38696': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:51,349 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38702': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:51,349 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:51,450 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:51,450 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38706': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:51,455 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38714': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:51,455 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:51,556 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54704': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:51,556 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:51,561 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54706': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:51,561 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:51,662 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54712': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:51,662 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:51,668 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54716': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:51,668 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:51,768 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:51,768 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54718': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:51,774 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54732': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:51,774 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:51,874 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54744': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:51,874 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:51,880 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54760': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:51,880 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:51,980 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54764': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:51,980 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:51,986 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54772': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:51,986 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:52,086 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54780': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:52,086 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:52,092 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:52,092 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:52,192 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:52,192 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54812': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:52,198 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54828': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:52,198 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:52,299 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54830': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:52,299 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:52,304 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54836': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:52,304 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:52,405 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54852': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:52,405 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:52,411 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54854': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:52,411 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:52,512 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:52,512 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54864': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:52,517 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54874': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:52,517 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:52,618 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54878': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:52,618 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:52,623 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54888': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:52,623 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:52,724 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54904': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:52,724 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:52,729 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:52,731 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54918': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:52,830 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54932': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:52,830 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:52,835 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54936': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:52,835 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:52,937 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54950': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:52,937 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:52,941 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54956': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:52,941 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:53,043 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54962': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:53,043 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:53,048 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54978': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:53,048 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:53,149 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:53,149 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54994': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:53,154 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:55008': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:53,155 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:53,255 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:55014': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:53,255 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:53,261 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:55026': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:53,261 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:53,361 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:55038': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:53,361 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:53,367 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:55040': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:53,367 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:53,467 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:55054': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:53,467 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:53,473 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:55060': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:53,473 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:53,574 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:55070': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:53,574 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:53,579 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:55074': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:53,579 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:53,680 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:53,681 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:55090': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:53,686 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:55102': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:53,686 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:53,787 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:55112': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:53,787 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:53,792 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:55118': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:53,792 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:53,893 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:55128': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:53,893 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:53,898 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:55142': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:53,898 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:53,999 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:55146': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:53,999 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:54,004 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:55160': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:54,004 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:54,106 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:54,110 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:55174': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:54,110 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:55188': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:54,111 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:54,213 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:54,217 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:55194': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:54,217 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:55210': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:54,217 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:54,319 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:54,323 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:55212': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:54,323 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:55224': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:54,324 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:54,426 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:54,429 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:55228': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:54,430 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:55240': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:54,430 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:54,532 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:54,536 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:55242': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:54,536 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:55256': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:54,536 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:54,639 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:54,642 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:55258': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:54,643 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:55260': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:54,643 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:54,745 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:54,749 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:55266': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:54,749 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:55270': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:54,749 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:54,852 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:54,855 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:55276': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:54,856 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:55288': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:54,856 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:54,958 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:54,962 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:55302': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:54,963 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:55312': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:54,963 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:55,066 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:55,070 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:55320': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:55,070 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:55324': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:55,070 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:55,172 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:55,176 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:55332': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:55,176 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:55334': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:55,176 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:55,279 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:55,282 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:55344': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:55,283 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:55358': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:55,283 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:55,385 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:55,389 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:55360': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:55,389 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:55368': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:55,389 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:55,491 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:55,495 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:55372': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:55,496 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:55382': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:55,496 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:55,598 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:55,601 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:55394': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:55,602 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:55408': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:55,602 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:55,704 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:55,708 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:55422': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:55,708 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:55432': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:55,708 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:55,811 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:55,814 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:55442': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:55,815 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:55456': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:55,815 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:55,918 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:55,921 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:55470': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:55,922 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:55484': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:55,922 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:56,024 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:56,028 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:55494': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:56,028 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:55498': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:56,028 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:56,130 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:56,134 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:55504': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:56,134 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:55506': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:56,135 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:56,237 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:56,240 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:55522': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:56,241 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:55534': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:56,241 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:56,343 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:56,347 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:55536': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:56,347 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:55540': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:56,347 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:56,449 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:56,453 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:55556': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:56,454 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:55568': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:56,454 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:56,556 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:56,559 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:55580': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:56,560 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:55588': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:56,560 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:56,662 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:56,666 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:55600': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:56,666 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:55610': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:56,666 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:56,768 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:56,772 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:55620': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:56,772 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:55626': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:56,772 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:56,875 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:56,878 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:55640': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:56,879 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:55654': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:56,879 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:56,981 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:56,984 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:55660': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:56,985 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:55674': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:56,985 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:57,087 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:57,092 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:57,091 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:55686': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:57,092 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:55690': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:57,193 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:57,197 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:55698': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:57,198 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:55714': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:57,198 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:57,300 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:57,303 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:55726': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:57,304 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:55730': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:57,304 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:57,406 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:57,410 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:55732': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:57,410 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:55740': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:57,410 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:57,513 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:57,516 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:55744': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:57,517 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:55758': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:57,517 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:57,620 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:57,624 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:55772': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:57,624 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:55786': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:57,624 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:57,727 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:57,733 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:55796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:57,733 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:55802': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:57,733 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:57,833 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:55814': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:57,833 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:57,840 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:55830': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:57,840 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:57,939 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:55844': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:57,939 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:57,946 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:55858': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:57,946 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:58,046 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:55864': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:58,046 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:58,052 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:55866': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:58,052 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:58,152 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:55870': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:58,152 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:58,158 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:55876': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:58,158 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:58,259 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:55886': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:58,259 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:58,264 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:55898': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:58,264 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:58,365 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:58,365 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:55900': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:58,370 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:55914': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:58,370 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:58,472 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:55922': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:58,472 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:58,477 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:55936': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:58,477 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:58,578 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:55952': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:58,578 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:58,583 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:58,583 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:55966': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:58,684 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:55972': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:58,684 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:58,689 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:55982': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:58,689 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:58,791 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:55984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:58,791 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:58,796 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56000': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:58,796 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:58,897 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56004': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:58,897 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:58,902 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56006': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:58,902 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:59,004 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:59,007 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56016': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:59,008 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56026': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:59,008 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:59,110 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:59,114 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56032': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:59,114 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56036': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:59,114 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:59,216 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:59,220 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56046': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:59,220 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:59,220 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:59,323 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:59,327 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56068': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:59,327 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56072': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:59,327 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:59,430 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:59,433 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56078': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:59,434 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56086': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:59,434 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:59,536 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:59,540 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56088': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:59,540 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56090': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:59,540 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:59,642 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:59,646 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56092': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:59,646 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56100': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:59,646 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:59,748 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:59,752 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56110': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:59,753 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56114': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:59,753 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:59,856 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:59,859 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56126': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:59,860 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56132': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:59,860 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:59,962 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:53:59,965 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56140': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:59,966 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56144': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:53:59,966 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:00,068 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:00,072 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56152': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:00,072 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56156': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:00,072 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:00,175 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:00,178 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56162': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:00,179 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56168': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:00,179 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:00,281 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:00,285 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56176': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:00,285 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56186': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:00,285 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:00,387 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:00,391 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56190': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:00,391 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56196': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:00,392 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:00,494 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:00,497 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56208': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:00,498 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56220': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:00,498 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:00,600 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:00,604 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56236': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:00,604 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56252': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:00,604 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:00,706 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:00,710 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56264': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:00,711 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56266': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:00,711 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:00,813 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:00,817 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56272': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:00,817 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56278': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:00,817 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:00,920 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:00,923 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56282': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:00,924 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56296': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:00,924 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:01,027 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:01,031 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56312': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:01,031 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56322': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:01,031 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:01,133 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:01,137 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56324': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:01,138 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56330': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:01,138 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:01,239 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56334': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:01,239 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:01,244 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56344': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:01,244 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:01,346 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56352': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:01,346 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:01,351 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56358': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:01,351 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:01,452 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:01,452 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56366': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:01,457 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56376': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:01,457 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:01,558 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:01,558 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53022': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:01,563 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53032': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:01,563 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:01,665 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:01,665 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53048': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:01,670 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53056': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:01,670 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:01,771 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53072': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:01,771 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:01,776 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53088': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:01,776 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:01,877 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53102': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:01,877 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:01,882 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53108': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:01,882 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:01,984 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53118': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:01,984 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:01,989 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53124': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:01,989 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:02,091 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:02,095 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53136': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:02,096 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53148': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:02,096 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:02,197 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:02,201 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53158': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:02,202 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53168': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:02,202 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:02,304 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:02,307 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53172': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:02,308 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53186': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:02,308 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:02,410 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:02,414 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53192': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:02,414 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53200': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:02,414 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:02,516 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:02,520 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53208': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:02,520 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53214': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:02,520 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:02,623 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:02,627 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53230': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:02,627 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53236': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:02,627 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:02,732 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:02,736 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53244': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:02,736 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53256': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:02,737 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:02,839 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:02,842 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53268': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:02,843 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53272': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:02,843 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:02,945 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:02,949 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53276': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:02,949 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53288': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:02,949 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:03,051 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:03,055 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53302': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:03,056 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53314': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:03,056 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:03,158 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:03,161 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53322': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:03,162 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53324': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:03,162 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:03,264 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:03,268 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53334': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:03,268 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53350': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:03,268 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:03,371 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:03,374 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53360': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:03,375 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53366': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:03,375 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:03,477 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:03,481 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53370': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:03,481 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53384': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:03,481 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:03,583 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:03,587 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53394': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:03,587 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53406': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:03,587 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:03,690 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:03,693 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53408': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:03,694 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53412': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:03,694 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:03,796 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:03,800 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53426': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:03,800 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53436': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:03,800 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:03,903 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:03,906 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53440': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:03,907 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53442': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:03,907 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:04,009 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:04,013 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53446': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:04,013 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53462': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:04,013 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:04,115 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:04,119 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53476': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:04,120 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53478': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:04,120 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:04,221 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:04,225 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53482': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:04,226 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:04,228 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53484': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:04,328 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:04,331 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53486': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:04,332 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53500': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:04,332 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:04,435 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:04,438 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53512': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:04,439 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53514': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:04,439 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:04,541 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:04,545 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53524': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:04,545 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53532': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:04,545 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:04,648 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:04,652 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53536': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:04,653 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53548': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:04,653 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:04,755 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:04,759 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53562': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:04,759 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53574': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:04,759 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:04,861 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:04,865 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53586': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:04,865 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53594': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:04,865 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:04,968 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:04,971 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53610': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:04,972 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53626': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:04,972 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:05,074 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:05,078 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53638': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:05,078 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53654': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:05,079 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:05,181 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:05,184 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53666': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:05,185 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53672': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:05,185 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:05,287 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:05,291 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53678': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:05,291 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53688': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:05,291 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:05,394 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:05,398 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53704': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:05,398 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53712': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:05,398 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:05,500 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:05,504 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53726': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:05,504 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53730': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:05,505 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:05,607 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:05,610 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53736': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:05,611 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53744': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:05,611 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:05,713 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:05,716 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53746': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:05,717 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53754': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:05,717 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:05,819 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:05,823 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53762': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:05,824 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53768': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:05,824 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:05,925 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53770': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:05,925 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:05,930 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53778': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:05,930 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:06,032 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:06,032 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53788': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:06,037 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53802': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:06,037 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:06,139 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:06,142 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53810': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:06,143 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53822': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:06,143 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:06,245 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:06,248 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53836': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:06,249 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53840': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:06,249 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:06,351 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:06,355 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53848': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:06,355 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53854': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:06,355 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:06,457 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:06,461 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53866': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:06,462 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53878': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:06,462 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:06,564 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:06,567 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53886': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:06,568 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53892': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:06,568 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:06,670 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:06,673 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53902': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:06,674 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53904': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:06,674 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:06,776 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:06,780 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53920': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:06,780 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53928': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:06,780 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:06,883 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:06,886 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53932': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:06,887 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53938': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:06,887 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:06,989 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:06,993 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53950': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:06,993 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53952': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:06,993 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:07,095 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:07,100 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53964': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:07,100 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53980': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:07,100 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:07,202 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:07,202 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53992': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:07,207 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54008': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:07,207 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:07,308 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54020': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:07,308 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:07,313 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54026': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:07,313 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:07,414 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54028': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:07,414 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:07,419 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54034': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:07,419 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:07,521 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:07,525 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54046': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:07,526 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:07,526 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:07,627 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:07,631 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54074': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:07,632 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54086': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:07,632 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:07,734 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:07,737 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54100': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:07,738 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54104': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:07,738 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:07,841 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:07,844 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54118': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:07,845 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54120': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:07,845 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:07,947 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:07,951 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54124': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:07,951 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54130': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:07,951 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:08,054 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:08,057 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54142': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:08,058 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54152': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:08,058 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:08,160 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:08,163 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54166': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:08,164 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54180': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:08,164 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:08,266 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:08,270 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54194': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:08,270 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54200': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:08,270 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:08,373 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:08,376 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54216': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:08,377 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54232': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:08,377 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:08,479 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:08,483 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54246': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:08,483 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54256': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:08,483 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:08,585 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:08,589 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54262': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:08,589 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54274': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:08,589 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:08,692 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:08,695 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54286': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:08,696 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54300': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:08,696 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:08,798 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:08,802 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54316': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:08,802 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54324': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:08,802 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:08,905 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:08,908 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54326': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:08,909 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54328': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:08,909 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:09,011 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:09,015 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54344': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:09,015 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54358': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:09,015 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:09,117 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:09,121 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54372': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:09,122 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54380': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:09,122 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:09,224 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:09,227 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54382': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:09,228 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:09,230 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54388': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:09,330 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:09,333 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54402': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:09,334 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54416': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:09,334 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:09,437 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:09,441 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54428': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:09,441 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54444': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:09,441 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:09,544 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:09,548 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54446': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:09,549 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54460': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:09,549 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:09,651 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:09,654 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54470': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:09,655 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54476': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:09,655 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:09,757 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:09,761 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54492': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:09,761 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54502': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:09,761 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:09,863 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:09,867 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54510': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:09,868 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54518': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:09,868 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:09,970 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:09,973 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54532': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:09,974 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54542': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:09,974 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:10,076 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:10,080 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54558': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:10,081 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54566': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:10,081 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:10,183 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:10,186 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54580': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:10,187 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54594': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:10,187 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:10,289 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:10,293 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54604': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:10,293 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54608': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:10,293 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:10,395 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:10,399 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54620': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:10,400 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54622': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:10,400 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:10,502 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:10,505 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54630': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:10,506 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54634': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:10,506 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:10,608 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:10,612 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54648': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:10,612 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54650': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:10,612 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:10,715 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:10,718 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54662': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:10,719 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54668': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:10,719 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:10,821 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:10,825 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54674': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:10,825 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54684': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:10,825 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:10,927 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:10,931 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54700': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:10,932 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54710': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:10,932 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:11,034 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:11,038 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54726': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:11,038 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54728': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:11,038 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:11,140 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:11,144 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54740': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:11,144 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54752': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:11,144 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:11,248 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:11,251 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54764': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:11,252 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54774': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:11,252 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:11,354 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:11,358 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54788': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:11,358 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54794': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:11,358 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:11,460 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:11,464 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54810': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:11,464 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54814': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:11,464 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:11,567 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:11,570 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50550': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:11,571 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50564': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:11,571 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:11,673 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:11,677 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50568': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:11,677 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50584': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:11,677 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:11,779 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:11,783 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50592': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:11,783 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50596': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:11,784 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:11,886 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:11,889 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50610': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:11,890 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50622': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:11,890 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:11,992 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:11,995 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50624': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:11,996 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50638': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:11,996 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:12,098 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:12,103 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50652': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:12,103 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50658': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:12,103 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:12,204 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50662': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:12,204 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:12,209 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50664': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:12,210 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:12,311 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:12,311 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50666': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:12,316 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50682': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:12,316 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:12,417 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50686': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:12,417 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:12,422 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50696': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:12,422 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:12,523 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50710': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:12,523 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:12,528 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:12,528 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:12,630 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:12,634 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50740': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:12,634 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50748': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:12,635 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:12,736 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:12,740 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50750': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:12,741 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50760': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:12,741 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:12,843 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:12,846 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50772': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:12,847 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50784': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:12,847 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:12,950 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:12,953 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50792': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:12,954 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50806': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:12,954 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:13,057 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:13,060 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50822': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:13,061 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50838': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:13,061 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:13,163 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:13,167 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50854': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:13,167 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50860': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:13,168 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:13,270 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:13,274 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50868': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:13,274 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50878': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:13,274 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:13,376 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:13,380 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50882': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:13,381 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50898': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:13,381 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:13,483 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:13,487 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50908': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:13,487 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50924': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:13,487 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:13,589 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:13,593 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50930': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:13,594 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50942': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:13,594 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:13,696 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:13,700 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50950': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:13,700 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50964': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:13,700 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:13,802 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:13,806 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50966': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:13,807 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50968': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:13,807 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:13,909 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:13,913 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:13,913 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50998': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:13,913 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:14,015 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:14,019 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51012': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:14,020 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51028': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:14,020 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:14,122 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:14,126 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51032': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:14,126 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51040': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:14,126 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:14,232 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:14,235 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51048': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:14,236 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51054': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:14,236 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:14,338 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:14,342 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:14,342 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51074': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:14,342 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:14,444 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:14,448 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51082': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:14,449 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51088': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:14,449 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:14,551 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:14,555 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51104': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:14,555 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51108': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:14,555 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:14,659 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:14,662 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51114': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:14,663 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51116': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:14,663 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:14,765 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:14,769 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51130': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:14,769 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51138': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:14,770 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:14,872 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:14,876 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51142': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:14,876 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51156': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:14,876 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:14,979 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:14,982 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51160': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:14,983 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51176': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:14,983 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:15,085 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:15,089 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51192': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:15,089 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51202': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:15,089 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:15,192 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:15,196 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51210': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:15,196 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51214': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:15,196 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:15,298 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:15,302 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51230': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:15,303 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51246': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:15,303 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:15,405 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:15,409 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51262': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:15,409 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51266': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:15,409 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:15,511 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:15,515 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51276': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:15,516 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51286': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:15,516 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:15,618 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:15,622 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51290': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:15,622 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51302': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:15,622 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:15,724 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:15,728 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51312': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:15,729 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:15,731 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51328': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:15,831 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:15,835 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51340': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:15,835 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51352': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:15,835 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:15,938 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:15,941 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51356': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:15,942 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51364': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:15,942 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:16,044 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:16,048 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51374': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:16,048 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51382': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:16,048 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:16,150 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:16,154 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51398': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:16,155 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51400': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:16,155 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:16,258 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:16,264 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51404': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:16,264 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:16,264 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51416': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:16,366 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:16,371 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51422': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:16,372 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:16,372 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51432': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:16,473 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:16,473 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51440': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:16,478 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51446': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:16,478 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:16,579 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:16,579 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51450': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:16,584 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51462': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:16,584 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:16,685 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:16,685 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51468': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:16,690 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51476': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:16,690 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:16,792 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51478': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:16,792 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:16,797 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51484': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:16,797 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:16,898 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:16,898 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51492': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:16,903 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51494': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:16,903 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:17,004 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:17,004 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51496': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:17,010 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51508': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:17,010 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:17,111 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:17,112 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51522': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:17,117 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51530': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:17,117 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:17,217 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51540': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:17,217 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:17,223 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51546': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:17,223 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:17,323 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51554': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:17,323 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:17,329 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51566': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:17,329 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:17,430 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:17,430 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51572': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:17,436 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51574': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:17,436 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:17,536 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:17,536 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51578': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:17,542 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51588': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:17,542 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:17,642 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:17,642 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51598': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:17,648 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51608': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:17,648 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:17,749 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51610': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:17,749 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:17,755 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51622': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:17,755 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:17,855 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51636': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:17,855 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:17,861 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51646': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:17,861 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:17,961 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51656': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:17,961 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:17,967 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51658': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:17,967 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:18,068 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:18,068 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51662': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:18,073 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51672': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:18,073 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:18,175 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:18,179 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51684': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:18,180 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51688': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:18,180 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:18,281 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51694': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:18,281 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:18,286 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51700': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:18,286 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:18,388 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:18,388 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51706': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:18,393 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51712': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:18,393 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:18,494 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51728': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:18,494 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:18,499 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51730': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:18,499 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:18,601 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:18,605 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51736': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:18,606 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51748': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:18,606 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:18,707 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51764': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:18,707 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:18,712 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51770': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:18,712 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:18,813 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51772': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:18,814 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:18,818 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51774': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:18,818 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:18,920 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:18,924 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51776': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:18,924 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51792': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:18,924 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:19,027 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:19,031 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51806': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:19,032 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51818': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:19,032 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:19,134 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:19,138 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51830': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:19,138 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51842': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:19,138 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:19,240 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:19,244 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51848': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:19,245 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51854': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:19,245 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:19,347 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:19,350 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51864': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:19,351 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51868': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:19,351 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:19,453 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:19,457 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51884': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:19,457 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51900': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:19,457 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:19,559 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:19,563 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51902': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:19,564 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51910': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:19,564 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:19,666 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:19,669 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51920': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:19,670 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:19,670 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51928': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:19,773 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:19,777 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51942': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:19,777 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51948': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:19,777 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:19,879 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:19,883 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51954': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:19,883 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51962': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:19,883 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:19,986 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:19,989 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51978': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:19,990 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51990': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:19,990 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:20,092 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:20,096 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52002': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:20,096 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52008': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:20,096 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:20,199 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:20,202 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52020': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:20,203 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52032': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:20,203 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:20,305 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:20,309 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52038': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:20,309 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52052': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:20,309 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:20,411 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:20,415 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52060': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:20,416 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52062': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:20,416 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:20,518 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:20,522 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52074': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:20,522 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52086': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:20,522 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:20,624 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:20,628 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52094': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:20,629 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52110': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:20,629 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:20,733 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:20,736 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52120': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:20,737 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52134': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:20,737 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:20,840 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:20,843 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52148': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:20,844 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52150': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:20,844 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:20,946 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:20,950 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52162': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:20,950 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52172': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:20,950 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:21,052 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:21,056 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52178': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:21,057 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52186': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:21,057 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:21,159 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:21,162 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52196': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:21,163 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52208': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:21,163 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:21,265 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:21,268 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52220': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:21,269 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52224': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:21,269 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:21,371 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:21,375 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52230': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:21,375 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52232': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:21,375 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:21,479 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:21,482 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52238': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:21,483 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52244': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:21,483 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:21,585 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:21,589 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51486': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:21,589 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51490': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:21,589 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:21,692 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:21,695 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51504': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:21,696 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51514': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:21,696 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:21,798 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:21,802 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51516': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:21,802 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51532': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:21,802 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:21,905 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:21,908 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51548': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:21,909 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51552': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:21,909 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:22,011 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:22,015 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51564': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:22,015 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51580': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:22,015 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:22,118 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:22,122 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51592': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:22,123 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51608': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:22,123 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:22,224 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:22,224 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51612': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:22,229 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:22,231 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51622': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:22,330 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51626': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:22,330 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:22,335 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:22,336 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51634': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:22,437 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51640': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:22,437 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:22,441 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51656': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:22,441 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:22,543 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:22,547 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51672': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:22,547 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51684': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:22,548 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:22,649 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:22,653 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51696': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:22,654 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51710': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:22,654 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:22,756 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:22,759 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51716': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:22,760 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51728': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:22,760 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:22,862 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:22,866 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51734': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:22,866 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51746': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:22,866 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:22,968 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:22,972 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51752': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:22,972 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51766': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:22,972 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:23,074 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:23,078 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51772': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:23,079 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51774': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:23,079 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:23,182 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:23,185 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51788': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:23,186 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51800': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:23,186 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:23,288 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:23,291 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51812': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:23,292 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51822': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:23,292 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:23,394 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:23,398 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51824': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:23,398 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51840': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:23,398 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:23,500 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:23,504 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51848': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:23,504 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51854': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:23,505 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:23,607 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:23,610 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51866': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:23,611 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51880': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:23,611 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:23,713 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:23,717 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51884': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:23,717 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51888': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:23,717 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:23,820 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:23,824 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51894': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:23,825 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51896': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:23,825 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:23,927 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:23,931 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51906': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:23,931 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51916': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:23,931 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:24,033 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:24,037 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51922': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:24,038 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51936': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:24,038 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:24,140 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:24,143 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51940': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:24,144 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51948': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:24,144 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:24,246 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:24,250 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51962': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:24,251 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51974': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:24,251 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:24,353 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:24,357 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51982': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:24,357 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:24,357 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:24,460 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:24,464 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51988': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:24,464 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52000': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:24,464 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:24,567 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:24,571 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52016': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:24,571 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52028': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:24,571 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:24,674 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:24,677 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52038': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:24,678 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52040': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:24,678 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:24,780 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:24,784 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52046': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:24,784 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52054': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:24,785 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:24,888 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:24,892 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52056': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:24,892 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52066': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:24,892 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:24,994 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:24,998 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52080': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:24,999 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52090': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:24,999 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:25,101 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:25,105 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52094': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:25,105 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52108': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:25,105 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:25,207 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:25,211 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52114': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:25,211 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52116': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:25,211 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:25,314 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:25,317 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52126': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:25,318 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52142': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:25,318 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:25,420 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:25,424 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52146': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:25,424 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:25,424 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52154': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:25,526 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:25,530 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52164': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:25,531 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52168': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:25,531 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:25,633 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:25,637 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52184': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:25,638 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52200': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:25,638 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:25,740 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:25,743 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52212': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:25,744 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52226': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:25,744 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:25,846 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:25,850 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52242': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:25,850 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52256': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:25,850 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:25,953 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:25,956 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52258': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:25,957 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52270': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:25,957 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:26,059 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:26,063 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52274': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:26,063 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52290': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:26,063 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:26,166 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:26,169 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52292': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:26,170 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52302': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:26,170 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:26,272 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:26,276 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52308': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:26,276 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52324': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:26,276 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:26,378 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:26,382 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52338': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:26,383 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52346': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:26,383 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:26,485 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:26,488 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52362': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:26,489 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52364': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:26,489 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:26,592 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:26,596 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52366': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:26,596 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52370': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:26,596 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:26,698 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:26,702 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52386': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:26,702 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52396': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:26,703 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:26,805 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:26,809 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52398': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:26,809 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52402': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:26,809 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:26,911 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:26,915 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52404': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:26,916 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52410': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:26,916 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:27,018 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:27,021 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52424': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:27,022 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52428': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:27,022 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:27,124 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:27,129 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52430': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:27,129 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52440': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:27,129 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:27,233 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:27,237 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52454': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:27,237 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52460': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:27,237 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:27,339 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:27,343 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52466': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:27,343 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52474': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:27,343 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:27,445 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:27,449 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52482': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:27,450 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52498': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:27,450 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:27,552 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:27,556 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52502': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:27,556 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52516': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:27,556 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:27,658 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:27,662 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52526': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:27,663 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52528': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:27,663 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:27,765 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:27,768 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52540': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:27,769 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52546': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:27,769 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:27,871 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:27,875 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52560': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:27,875 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52566': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:27,875 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:27,977 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:27,981 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52578': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:27,982 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52584': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:27,982 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:28,084 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:28,087 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52600': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:28,088 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52614': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:28,088 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:28,190 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:28,194 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52616': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:28,195 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52622': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:28,195 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:28,297 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:28,301 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52628': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:28,301 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52644': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:28,302 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:28,404 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:28,407 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52650': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:28,408 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52654': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:28,408 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:28,510 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:28,514 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52658': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:28,515 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52670': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:28,515 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:28,618 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:28,621 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52676': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:28,622 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52678': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:28,622 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:28,724 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:28,728 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52690': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:28,729 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:28,732 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52704': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:28,830 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:28,831 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52712': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:28,837 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52728': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:28,837 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:28,937 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:28,937 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52742': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:28,946 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52746': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:28,946 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:29,044 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52750': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:29,044 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:29,055 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52758': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:29,055 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:29,151 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52768': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:29,151 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:29,164 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52774': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:29,164 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:29,257 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:29,257 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52778': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:29,273 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52786': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:29,274 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:29,364 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:29,364 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52802': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:29,382 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52810': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:29,382 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:29,471 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:29,471 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52824': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:29,491 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52840': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:29,491 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:29,578 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52846': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:29,578 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:29,600 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52860': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:29,601 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:29,685 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52868': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:29,685 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:29,709 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52874': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:29,710 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:29,792 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52884': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:29,792 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:29,818 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52888': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:29,819 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:29,898 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52904': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:29,899 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:29,927 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52906': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:29,928 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:30,006 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52908': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:30,006 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:30,036 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52918': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:30,037 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:30,113 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52928': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:30,113 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:30,145 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52938': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:30,145 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:30,220 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52946': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:30,220 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:30,254 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52962': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:30,254 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:30,327 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52968': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:30,327 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:30,363 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52982': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:30,363 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:30,433 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52994': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:30,433 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:30,472 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52998': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:30,472 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:30,540 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53012': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:30,540 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:30,580 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53018': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:30,581 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:30,647 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53026': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:30,647 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:30,690 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53028': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:30,690 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:30,753 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53032': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:30,753 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:30,798 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:30,798 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53036': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:30,860 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53050': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:30,860 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:30,905 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53066': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:30,905 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:30,967 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:30,967 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53074': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:31,011 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53088': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:31,011 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:31,073 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53092': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:31,073 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:31,118 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53106': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:31,118 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:31,180 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:31,180 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53116': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:31,224 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53124': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:31,224 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:31,286 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53130': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:31,286 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:31,331 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53142': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:31,331 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:31,393 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53152': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:31,393 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:31,437 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53164': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:31,437 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:31,499 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53180': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:31,499 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:31,543 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45178': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:31,543 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:31,606 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45192': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:31,606 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:31,650 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45194': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:31,650 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:31,713 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45204': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:31,714 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:31,757 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45212': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:31,757 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:31,820 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45218': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:31,820 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:31,863 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45224': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:31,863 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:31,926 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45240': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:31,927 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:31,970 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:31,970 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45252': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:32,033 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45266': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:32,033 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:32,076 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45272': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:32,076 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:32,140 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:32,140 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45284': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:32,183 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45290': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:32,183 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:32,246 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45300': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:32,246 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:32,289 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45316': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:32,289 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:32,353 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45330': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:32,353 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:32,396 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45336': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:32,396 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:32,459 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45338': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:32,459 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:32,502 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45340': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:32,502 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:32,565 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45352': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:32,565 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:32,609 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45364': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:32,609 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:32,672 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45376': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:32,672 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:32,715 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45384': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:32,715 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:32,778 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45400': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:32,778 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:32,822 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45406': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:32,822 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:32,884 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45414': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:32,884 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:32,929 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45418': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:32,929 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:32,991 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45432': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:32,991 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:33,035 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45436': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:33,035 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:33,097 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45442': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:33,097 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:33,142 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45452': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:33,142 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:33,203 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45464': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:33,203 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:33,248 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45474': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:33,248 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:33,310 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45480': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:33,310 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:33,355 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45486': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:33,355 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:33,418 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45494': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:33,418 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:33,462 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45508': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:33,462 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:33,525 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:33,525 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45518': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:33,569 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45524': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:33,569 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:33,631 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45532': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:33,631 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:33,675 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45540': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:33,675 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:33,738 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45552': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:33,738 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:33,782 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45556': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:33,782 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:33,844 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45566': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:33,844 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:33,888 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45582': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:33,888 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:33,951 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45592': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:33,951 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:33,995 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45600': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:33,995 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:34,057 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45602': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:34,057 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:34,101 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45610': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:34,101 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:34,164 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45616': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:34,164 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:34,207 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45618': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:34,207 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:34,270 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45628': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:34,270 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:34,314 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45638': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:34,314 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:34,377 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45640': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:34,377 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:34,420 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45650': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:34,420 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:34,483 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45662': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:34,483 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:34,526 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45670': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:34,526 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:34,590 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45676': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:34,590 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:34,633 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45690': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:34,633 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:34,696 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45692': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:34,696 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:34,739 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45704': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:34,739 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:34,803 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45706': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:34,803 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:34,845 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45722': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:34,846 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:34,909 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:34,909 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:34,952 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45730': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:34,952 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:35,015 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45738': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:35,015 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:35,059 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45744': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:35,059 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:35,123 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45760': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:35,123 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:35,165 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45768': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:35,165 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:35,232 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45782': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:35,232 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:35,271 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:35,271 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:35,338 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45806': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:35,338 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:35,378 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45822': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:35,378 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:35,445 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45828': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:35,445 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:35,484 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45838': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:35,484 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:35,552 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45850': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:35,552 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:35,591 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45864': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:35,591 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:35,658 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45874': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:35,658 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:35,697 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45890': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:35,697 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:35,764 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45902': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:35,765 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:35,803 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45916': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:35,803 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:35,871 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45920': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:35,871 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:35,910 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45934': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:35,910 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:35,977 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:35,977 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45950': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:36,017 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45956': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:36,017 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:36,084 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45960': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:36,084 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:36,123 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45974': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:36,123 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:36,191 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45976': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:36,191 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:36,232 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45982': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:36,232 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:36,300 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:45990': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:36,301 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:36,338 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:46002': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:36,338 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:36,410 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:46008': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:36,410 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:36,445 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:46012': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:36,445 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:36,519 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:46022': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:36,519 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:36,551 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:46026': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:36,551 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:36,628 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:46030': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:36,629 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:36,658 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:46038': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:36,658 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:36,738 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:46050': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:36,738 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:36,765 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:36,765 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:46054': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:36,849 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:46060': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:36,849 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:36,873 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:36,873 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:46076': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:36,958 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:46080': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:36,959 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:36,980 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:36,980 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:46086': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:37,068 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:46088': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:37,068 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:37,087 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:46102': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:37,087 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:37,177 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:46112': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:37,177 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:37,194 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:46116': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:37,194 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:37,286 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:46118': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:37,286 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:37,300 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:46124': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:37,300 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:37,395 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:46132': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:37,395 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:37,407 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:46148': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:37,407 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:37,504 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:46156': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:37,505 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:37,514 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:46164': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:37,514 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:37,613 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:46170': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:37,614 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:37,620 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:37,620 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:46172': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:37,723 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:37,727 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:46176': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:37,727 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:37,730 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:46184': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:37,832 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:37,835 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:46198': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:37,836 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:46210': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:37,836 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:37,941 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:37,944 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:46216': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:37,945 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:46226': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:37,946 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:38,050 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:38,053 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:46238': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:38,055 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:46246': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:38,055 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:38,159 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:38,163 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:46256': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:38,163 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:46260': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:38,163 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:38,270 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:38,273 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:46274': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:38,274 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:46290': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:38,274 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:38,379 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:38,382 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:46302': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:38,383 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:46316': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:38,383 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:38,489 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:38,492 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:46322': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:38,493 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:46326': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:38,493 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:38,598 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:38,601 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:46336': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:38,602 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:46350': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:38,602 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:38,708 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:38,710 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:46356': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:38,711 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:46358': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:38,711 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:38,817 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:38,820 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:46372': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:38,820 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:46382': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:38,820 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:38,926 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:38,929 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:46386': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:38,929 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:46396': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:38,929 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:39,035 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:39,038 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:46404': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:39,038 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:46412': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:39,039 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:39,144 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:39,147 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:46428': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:39,148 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:46444': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:39,148 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:39,254 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:39,256 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:46456': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:39,257 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:46466': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:39,257 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:39,362 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:39,366 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:46472': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:39,366 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:46486': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:39,366 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:39,471 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:39,474 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:46492': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:39,475 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:46496': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:39,475 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:39,581 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:39,583 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:46506': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:39,584 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:46508': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:39,584 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:39,689 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:39,692 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:46516': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:39,693 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:46528': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:39,693 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:39,798 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:39,801 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:46532': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:39,802 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:46544': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:39,802 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:39,907 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:39,910 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:46546': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:39,911 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:46548': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:39,911 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:40,016 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:40,019 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:46558': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:40,020 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:46572': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:40,020 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:40,125 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:40,128 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:46576': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:40,128 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:46588': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:40,129 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:40,234 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:40,236 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:46590': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:40,237 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:46596': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:40,237 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:40,343 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:40,346 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:46598': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:40,347 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:46602': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:40,347 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:40,453 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:40,455 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:46612': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:40,456 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:46614': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:40,456 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:40,562 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:40,565 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:46626': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:40,565 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:46636': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:40,565 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:40,671 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:40,674 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:46644': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:40,674 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:46660': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:40,675 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:40,781 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:40,783 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:46668': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:40,784 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:46684': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:40,784 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:40,890 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:40,892 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:46686': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:40,893 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:46692': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:40,893 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:40,999 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:41,002 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:46696': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:41,003 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:46712': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:41,003 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:41,109 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:41,111 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:46726': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:41,112 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:46734': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:41,112 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:41,216 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:41,219 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:46736': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:41,220 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:41,220 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:46738': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:41,322 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:41,326 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:46746': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:41,326 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:41,326 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:46760': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:41,429 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:41,433 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:46764': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:41,433 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:46778': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:41,433 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:41,535 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:41,539 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:58616': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:41,540 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:58630': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:41,540 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:41,642 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:41,646 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:58642': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:41,646 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:58652': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:41,646 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:41,749 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:41,752 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:58660': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:41,753 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:58672': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:41,753 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:41,855 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:41,859 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:58682': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:41,859 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:58684': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:41,859 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:41,962 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:41,965 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:58698': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:41,966 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:58712': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:41,966 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:42,069 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:42,073 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:58726': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:42,074 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:58732': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:42,074 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:42,176 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:42,180 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:58736': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:42,181 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:58744': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:42,181 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:42,282 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:58752': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:42,282 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:42,287 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:58768': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:42,287 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:42,389 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:42,393 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:58780': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:42,393 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:58782': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:42,393 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:42,495 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:42,499 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:58784': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:42,500 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:58796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:42,500 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:42,602 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:42,606 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:58810': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:42,607 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:58818': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:42,607 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:42,709 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:42,713 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:58828': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:42,713 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:58834': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:42,713 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:42,815 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:42,819 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:58840': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:42,819 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:58842': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:42,820 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:42,922 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:42,926 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:58850': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:42,926 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:58858': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:42,926 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:43,029 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:43,032 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:58866': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:43,033 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:58868': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:43,033 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:43,136 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:43,140 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:58880': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:43,140 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:58892': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:43,140 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:43,243 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:43,246 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:58908': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:43,247 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:58916': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:43,247 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:43,349 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:43,353 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:58920': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:43,354 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:58936': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:43,354 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:43,456 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:43,459 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:58946': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:43,460 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:58950': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:43,460 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:43,562 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:43,566 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:58952': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:43,567 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:58960': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:43,567 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:43,670 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:43,672 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:58974': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:43,673 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:58980': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:43,673 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:43,780 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:43,783 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:58988': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:43,784 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:58992': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:43,784 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:43,888 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:43,892 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59008': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:43,892 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59014': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:43,892 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:43,994 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:43,998 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59028': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:43,999 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59036': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:43,999 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:44,101 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:44,104 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59048': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:44,105 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59060': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:44,105 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:44,208 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:44,212 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59066': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:44,212 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59076': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:44,213 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:44,316 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:44,319 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59078': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:44,320 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59088': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:44,320 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:44,422 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:44,426 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59100': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:44,427 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59104': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:44,427 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:44,529 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:44,533 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59118': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:44,533 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59134': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:44,533 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:44,635 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:44,639 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59136': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:44,640 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59140': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:44,640 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:44,741 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:44,745 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59142': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:44,746 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59156': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:44,746 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:44,848 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:44,851 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59168': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:44,852 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59182': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:44,852 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:44,954 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:44,958 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59196': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:44,958 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59202': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:44,958 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:45,060 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:45,064 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59216': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:45,065 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59220': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:45,065 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:45,167 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:45,170 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59222': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:45,171 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59230': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:45,171 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:45,273 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:45,277 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59234': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:45,277 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59236': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:45,278 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:45,380 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:45,384 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59244': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:45,384 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59252': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:45,384 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:45,487 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:45,490 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59266': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:45,491 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59282': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:45,491 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:45,593 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:45,597 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59284': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:45,597 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59288': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:45,597 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:45,700 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:45,703 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59290': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:45,704 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59302': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:45,704 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:45,806 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:45,809 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59318': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:45,810 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59320': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:45,810 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:45,912 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:45,916 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59330': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:45,916 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59344': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:45,916 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:46,019 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:46,022 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59348': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:46,023 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59360': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:46,023 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:46,125 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:46,129 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59374': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:46,129 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59382': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:46,129 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:46,232 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:46,236 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59396': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:46,237 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59398': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:46,237 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:46,339 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:46,343 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59414': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:46,344 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59422': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:46,344 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:46,446 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:46,449 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59428': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:46,450 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59438': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:46,450 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:46,552 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:46,556 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59448': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:46,556 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59452': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:46,556 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:46,659 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:46,662 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59468': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:46,663 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:46,663 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59482': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:46,765 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:46,769 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59484': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:46,769 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59496': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:46,769 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:46,871 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:46,875 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59506': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:46,876 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59516': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:46,876 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:46,978 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:46,981 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59518': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:46,982 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59530': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:46,982 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:47,084 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59540': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:47,084 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:47,089 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59556': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:47,089 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:47,191 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:47,195 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59570': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:47,196 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59572': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:47,196 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:47,297 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59576': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:47,297 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:47,302 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59580': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:47,302 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:47,403 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59584': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:47,403 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:47,409 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59594': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:47,409 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:47,509 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59598': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:47,509 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:47,515 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59608': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:47,515 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:47,615 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59616': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:47,615 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:47,621 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59632': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:47,621 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:47,722 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59640': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:47,722 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:47,727 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:47,729 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59648': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:47,828 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59652': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:47,828 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:47,834 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59664': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:47,834 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:47,935 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59680': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:47,935 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:47,941 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59696': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:47,941 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:48,041 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59708': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:48,041 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:48,047 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59718': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:48,047 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:48,148 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59732': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:48,148 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:48,153 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59736': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:48,153 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:48,254 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59750': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:48,254 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:48,260 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59762': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:48,260 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:48,360 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:48,361 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59776': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:48,366 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59778': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:48,366 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:48,467 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:48,467 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59790': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:48,472 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59804': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:48,472 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:48,573 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:48,578 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59820': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:48,578 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59832': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:48,578 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:48,680 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:48,684 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59844': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:48,684 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59852': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:48,684 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:48,786 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:48,790 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59860': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:48,790 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:48,791 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59874': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:48,893 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:48,897 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59890': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:48,898 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59902': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:48,898 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:48,999 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:49,003 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59918': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:49,004 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59932': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:49,004 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:49,105 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:49,109 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59936': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:49,110 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59952': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:49,110 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:49,212 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:49,215 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59964': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:49,216 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59966': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:49,216 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:49,318 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:49,321 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59978': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:49,322 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:59990': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:49,322 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:49,424 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:49,428 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:60004': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:49,428 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:60018': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:49,428 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:49,531 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:49,534 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:60032': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:49,535 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:60036': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:49,535 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:49,637 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:49,640 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:60044': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:49,641 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:60054': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:49,641 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:49,743 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:49,747 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:60064': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:49,747 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:60070': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:49,747 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:49,849 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:49,853 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:60076': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:49,853 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:60082': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:49,853 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:49,956 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:49,959 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:60094': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:49,960 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:60110': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:49,960 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:50,062 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:50,066 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:60114': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:50,066 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:60120': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:50,066 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:50,168 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:50,172 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:60134': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:50,173 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:60144': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:50,173 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:50,275 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:50,279 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:60158': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:50,279 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:60164': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:50,279 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:50,381 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:50,385 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:60180': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:50,386 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:60194': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:50,386 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:50,488 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:50,491 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:60208': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:50,492 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:60216': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:50,492 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:50,595 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:50,598 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:60232': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:50,599 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:60244': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:50,599 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:50,701 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:50,705 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:60250': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:50,705 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:60258': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:50,705 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:50,807 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:50,811 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:60266': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:50,811 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:60280': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:50,811 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:50,914 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:50,917 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:60288': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:50,918 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:60302': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:50,918 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:51,021 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:51,024 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:60308': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:51,025 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:51,025 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:60314': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:51,127 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:51,131 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:60326': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:51,131 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:60332': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:51,131 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:51,234 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:51,237 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:60348': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:51,238 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:60354': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:51,238 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:51,340 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:51,343 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:60360': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:51,344 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:60372': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:51,344 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:51,446 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:51,450 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:60378': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:51,450 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:60386': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:51,450 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:51,552 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:51,556 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56174': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:51,557 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56176': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:51,557 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:51,659 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:51,662 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56180': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:51,663 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56192': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:51,663 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:51,765 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:51,768 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56196': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:51,769 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56204': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:51,769 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:51,871 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:51,875 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56214': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:51,875 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56218': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:51,875 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:51,978 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:51,981 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56234': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:51,982 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56240': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:51,982 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:52,084 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:52,088 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56242': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:52,088 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56244': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:52,088 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:52,190 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:52,195 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56256': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:52,195 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56258': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:52,195 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:52,297 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:52,301 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56268': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:52,302 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56276': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:52,302 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:52,403 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:52,407 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56292': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:52,408 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56306': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:52,408 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:52,510 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:52,513 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56310': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:52,514 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56322': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:52,514 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:52,616 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:52,619 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56334': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:52,620 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56342': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:52,620 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:52,723 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:52,727 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56348': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:52,728 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:52,730 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56356': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:52,830 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:52,833 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56364': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:52,834 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56370': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:52,834 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:52,936 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:52,940 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56386': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:52,940 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56398': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:52,940 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:53,042 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:53,046 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56414': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:53,046 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56424': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:53,047 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:53,149 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:53,152 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56432': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:53,153 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56448': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:53,153 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:53,255 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:53,258 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56450': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:53,259 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56454': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:53,259 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:53,361 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:53,365 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56464': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:53,366 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56476': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:53,366 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:53,468 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56480': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:53,468 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:53,474 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56488': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:53,474 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:53,574 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56504': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:53,574 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:53,583 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56514': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:53,583 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:53,680 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56524': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:53,680 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:53,691 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56540': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:53,691 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:53,787 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56544': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:53,787 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:53,800 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56554': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:53,800 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:53,893 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56560': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:53,893 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:53,908 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56576': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:53,909 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:54,000 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56580': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:54,000 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:54,017 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56586': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:54,017 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:54,107 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56600': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:54,107 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:54,126 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56616': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:54,126 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:54,213 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56622': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:54,213 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:54,234 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56628': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:54,234 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:54,319 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56640': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:54,319 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:54,343 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56652': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:54,343 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:54,426 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56662': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:54,426 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:54,451 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56668': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:54,452 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:54,532 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56684': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:54,532 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:54,560 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56688': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:54,561 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:54,639 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56700': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:54,639 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:54,669 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56710': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:54,669 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:54,745 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56716': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:54,745 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:54,777 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56730': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:54,778 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:54,852 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56734': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:54,852 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:54,886 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56736': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:54,886 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:54,958 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56742': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:54,958 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:54,994 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56750': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:54,995 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:55,065 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56764': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:55,065 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:55,103 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56770': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:55,103 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:55,171 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56782': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:55,171 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:55,212 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56794': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:55,212 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:55,278 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:55,278 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:55,320 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56808': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:55,321 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:55,384 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56818': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:55,384 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:55,429 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56830': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:55,429 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:55,491 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56834': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:55,491 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:55,538 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56836': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:55,538 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:55,597 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56852': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:55,597 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:55,646 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56858': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:55,647 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:55,704 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56862': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:55,704 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:55,755 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56866': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:55,755 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:55,810 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56880': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:55,810 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:55,863 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56884': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:55,864 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:55,917 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56886': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:55,917 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:55,972 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56902': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:55,973 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:56,023 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56906': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:56,023 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:56,081 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56920': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:56,081 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:56,130 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56922': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:56,130 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:56,190 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56928': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:56,190 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:56,236 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56932': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:56,236 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:56,298 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56940': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:56,299 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:56,343 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56946': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:56,343 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:56,407 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56954': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:56,407 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:56,450 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56966': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:56,450 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:56,515 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56972': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:56,515 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:56,556 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56980': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:56,556 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:56,624 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:56992': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:56,624 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:56,664 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:56,664 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:57008': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:56,734 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:57022': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:56,734 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:56,771 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:56,771 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:57036': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:56,842 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:57048': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:56,842 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:56,878 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:56,879 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:57056': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:56,950 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:57058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:56,950 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:56,986 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:56,986 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:57066': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:57,058 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:57082': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:57,059 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:57,093 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:57,093 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:57084': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:57,167 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:57088': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:57,167 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:57,200 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:57,200 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:57100': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:57,275 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:57110': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:57,275 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:57,307 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:57,307 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:57122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:57,383 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:57128': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:57,383 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:57,415 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:57,416 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:57140': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:57,492 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:57156': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:57,492 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:57,523 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:57,523 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:57164': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:57,602 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:57180': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:57,602 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:57,630 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:57184': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:57,630 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:57,711 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:57190': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:57,711 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:57,736 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:57196': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:57,736 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:57,820 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:57206': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:57,820 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:57,843 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:57218': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:57,843 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:57,928 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:57222': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:57,928 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:57,950 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:57234': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:57,950 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:58,036 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:57240': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:58,037 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:58,057 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:57252': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:58,057 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:58,145 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:57268': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:58,145 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:58,164 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:57276': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:58,164 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:58,253 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:57280': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:58,254 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:58,270 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:57296': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:58,270 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:58,362 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:57304': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:58,362 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:58,376 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:57320': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:58,376 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:58,470 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:57326': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:58,471 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:58,483 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:57332': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:58,483 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:58,579 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:57340': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:58,579 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:58,590 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:57342': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:58,590 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:58,688 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:57348': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:58,688 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:58,696 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:57354': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:58,696 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:58,796 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:57358': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:58,797 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:58,803 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:57374': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:58,803 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:58,906 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:58,909 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:57382': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:58,909 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:57396': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:58,909 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:59,016 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:59,019 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:57410': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:59,019 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:57412': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:59,019 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:59,125 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:59,129 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:57424': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:59,129 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:57428': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:59,129 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:59,235 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:59,238 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:57438': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:59,238 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:57454': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:59,238 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:59,344 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:59,347 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:57466': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:59,347 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:57478': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:59,347 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:59,453 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:59,456 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:57488': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:59,457 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:57490': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:59,457 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:59,562 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:59,565 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:57504': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:59,566 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:57516': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:59,566 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:59,671 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:59,674 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:57528': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:59,675 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:57532': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:59,675 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:59,780 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:59,783 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:57536': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:59,784 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:57544': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:59,784 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:59,888 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:59,891 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:57560': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:59,892 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:57562': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:59,892 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:59,995 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:54:59,998 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:57568': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:59,999 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:57574': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:54:59,999 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:00,101 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:00,105 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:57588': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:00,105 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:57596': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:00,105 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:00,208 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:00,211 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:57602': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:00,212 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:57610': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:00,212 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:00,314 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:00,318 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:57618': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:00,318 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:57620': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:00,319 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:00,421 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:00,424 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:57628': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:00,425 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:57638': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:00,425 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:00,527 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:00,531 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:57650': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:00,532 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:57658': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:00,532 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:00,634 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:00,637 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:57660': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:00,638 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:57664': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:00,638 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:00,740 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:00,744 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:57680': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:00,745 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:57686': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:00,745 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:00,846 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:00,851 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:57696': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:00,852 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:57704': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:00,852 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:00,953 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:00,953 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:57720': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:00,958 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:57730': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:00,958 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:01,060 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:57738': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:01,060 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:01,065 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:57742': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:01,065 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:01,166 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:01,166 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:57744': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:01,171 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:57746': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:01,171 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:01,273 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:57756': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:01,273 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:01,278 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:57764': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:01,278 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:01,380 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:57780': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:01,380 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:01,385 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:57792': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:01,385 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:01,486 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:01,490 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:57800': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:01,491 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:57806': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:01,491 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:01,593 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:01,597 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40114': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:01,597 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:01,597 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:01,699 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:01,703 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40132': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:01,704 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40140': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:01,704 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:01,806 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:01,810 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40142': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:01,810 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40156': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:01,810 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:01,913 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:01,916 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40160': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:01,917 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40174': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:01,917 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:02,019 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:02,023 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40186': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:02,023 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40196': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:02,023 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:02,126 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:02,129 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40202': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:02,130 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40206': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:02,130 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:02,234 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:02,238 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40212': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:02,238 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40224': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:02,239 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:02,341 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:02,341 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40240': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:02,346 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40248': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:02,346 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:02,448 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:02,451 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40252': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:02,452 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40266': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:02,452 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:02,554 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:02,559 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40268': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:02,559 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40276': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:02,559 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:02,661 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:02,661 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40292': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:02,666 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40306': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:02,666 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:02,770 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:02,773 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40312': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:02,773 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40322': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:02,773 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:02,879 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:02,882 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40330': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:02,882 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40346': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:02,882 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:02,988 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:02,990 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40356': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:02,991 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40360': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:02,991 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:03,097 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:03,100 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40370': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:03,100 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40384': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:03,100 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:03,206 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:03,209 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40398': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:03,210 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40414': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:03,210 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:03,316 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:03,318 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40424': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:03,319 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40434': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:03,319 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:03,425 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:03,428 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40438': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:03,428 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40444': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:03,428 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:03,533 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:03,536 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40460': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:03,537 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40472': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:03,537 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:03,642 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:03,645 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40488': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:03,646 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40504': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:03,646 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:03,751 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:03,754 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40508': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:03,755 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40524': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:03,755 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:03,860 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:03,863 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40534': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:03,864 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40544': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:03,864 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:03,969 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:03,972 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40552': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:03,972 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40564': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:03,972 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:04,078 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:04,081 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40574': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:04,082 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40578': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:04,082 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:04,187 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:04,190 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40588': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:04,191 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40596': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:04,191 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:04,296 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:04,300 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40600': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:04,300 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40610': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:04,301 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:04,405 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:04,408 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40612': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:04,409 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40626': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:04,409 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:04,515 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:04,517 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40640': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:04,518 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40642': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:04,518 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:04,624 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:04,627 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40650': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:04,627 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40656': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:04,627 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:04,733 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:04,736 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40666': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:04,737 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40670': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:04,737 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:04,842 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:04,845 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40674': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:04,846 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40676': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:04,846 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:04,951 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:04,955 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40692': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:04,955 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40706': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:04,955 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:05,060 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:05,063 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40712': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:05,064 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:05,064 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:05,169 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:05,172 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40730': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:05,172 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40744': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:05,172 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:05,278 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:05,281 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40750': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:05,281 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40752': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:05,281 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:05,386 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:05,389 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40758': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:05,390 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40764': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:05,390 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:05,496 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:05,499 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40780': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:05,499 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40786': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:05,499 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:05,605 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:05,608 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40790': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:05,608 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40806': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:05,608 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:05,714 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:05,717 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40814': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:05,717 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40824': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:05,717 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:05,822 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:05,825 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40832': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:05,826 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40848': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:05,826 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:05,931 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:05,935 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40856': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:05,935 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40858': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:05,935 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:06,040 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:06,044 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40874': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:06,044 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40888': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:06,044 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:06,149 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:06,152 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40900': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:06,152 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40902': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:06,153 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:06,258 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:06,261 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40916': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:06,261 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40932': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:06,261 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:06,366 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:06,370 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40942': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:06,370 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40950': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:06,370 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:06,473 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:06,477 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40964': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:06,477 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40968': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:06,477 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:06,579 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:06,583 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40976': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:06,584 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40988': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:06,584 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:06,686 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:06,689 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40996': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:06,690 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41008': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:06,690 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:06,792 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:06,796 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41024': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:06,797 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41028': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:06,797 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:06,899 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:06,903 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41032': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:06,903 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41038': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:06,903 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:07,005 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:07,009 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41042': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:07,010 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:07,010 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:07,112 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:07,115 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41060': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:07,116 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41066': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:07,116 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:07,218 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:07,223 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41076': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:07,224 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41090': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:07,224 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:07,325 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:07,325 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41092': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:07,330 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41098': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:07,330 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:07,432 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:07,432 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41102': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:07,437 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41114': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:07,437 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:07,538 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:07,538 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:07,543 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41134': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:07,543 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:07,645 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41142': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:07,645 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:07,650 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41156': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:07,650 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:07,751 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:07,751 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41166': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:07,757 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41182': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:07,757 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:07,857 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:07,857 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41196': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:07,863 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41204': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:07,863 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:07,964 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:07,964 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41218': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:07,970 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41220': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:07,970 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:08,071 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:08,072 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41224': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:08,077 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41238': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:08,077 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:08,177 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41240': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:08,177 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:08,183 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41252': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:08,183 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:08,284 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:08,285 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41256': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:08,290 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41268': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:08,290 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:08,391 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:08,391 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41282': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:08,396 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41288': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:08,396 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:08,497 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41290': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:08,497 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:08,502 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41300': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:08,502 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:08,604 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41308': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:08,604 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:08,609 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41316': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:08,609 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:08,710 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41332': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:08,711 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:08,716 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41346': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:08,716 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:08,817 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41358': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:08,817 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:08,822 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41366': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:08,822 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:08,923 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41380': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:08,923 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:08,928 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41386': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:08,928 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:09,030 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:09,034 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41396': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:09,034 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41402': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:09,034 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:09,136 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:09,140 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41410': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:09,141 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41414': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:09,141 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:09,242 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:09,246 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41426': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:09,247 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41428': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:09,247 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:09,349 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:09,352 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41442': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:09,353 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41452': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:09,353 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:09,455 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:09,459 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41462': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:09,460 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41470': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:09,460 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:09,562 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:09,566 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41480': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:09,566 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41494': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:09,566 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:09,668 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:09,672 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41506': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:09,673 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41510': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:09,673 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:09,774 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:09,778 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41522': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:09,779 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41526': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:09,779 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:09,881 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:09,884 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41530': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:09,885 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41542': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:09,885 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:09,987 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:09,991 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41546': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:09,991 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41560': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:09,991 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:10,094 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:10,097 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41570': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:10,098 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41584': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:10,098 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:10,200 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:10,203 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41590': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:10,204 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41592': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:10,204 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:10,306 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:10,310 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41600': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:10,310 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41602': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:10,310 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:10,412 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:10,416 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41614': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:10,417 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41618': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:10,417 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:10,519 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:10,523 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41620': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:10,523 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41628': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:10,523 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:10,625 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:10,629 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41630': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:10,629 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41646': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:10,629 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:10,733 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:10,737 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41662': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:10,737 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41666': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:10,737 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:10,840 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:10,843 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41668': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:10,844 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41676': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:10,844 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:10,946 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:10,950 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41680': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:10,950 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41692': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:10,950 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:11,053 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:11,056 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41704': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:11,057 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41706': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:11,057 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:11,159 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:11,163 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41720': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:11,164 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41726': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:11,164 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:11,265 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41738': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:11,265 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:11,270 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41742': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:11,270 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:11,372 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:11,376 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41754': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:11,376 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41762': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:11,376 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:11,478 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:11,482 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41768': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:11,482 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41780': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:11,482 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:11,584 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:11,588 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43206': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:11,589 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43222': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:11,589 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:11,691 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:11,695 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43238': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:11,695 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43240': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:11,695 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:11,797 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:11,801 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43254': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:11,801 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43270': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:11,801 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:11,904 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:11,908 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43276': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:11,908 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43292': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:11,908 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:12,010 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:12,010 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43306': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:12,016 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43308': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:12,016 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:12,118 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:12,121 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43310': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:12,122 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43312': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:12,122 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:12,224 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:12,229 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43316': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:12,229 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:12,232 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43318': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:12,330 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:12,331 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43324': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:12,336 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43336': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:12,336 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:12,437 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:12,437 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43340': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:12,442 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43352': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:12,442 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:12,544 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:12,544 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43358': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:12,549 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43366': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:12,549 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:12,650 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:12,650 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43380': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:12,655 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43384': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:12,655 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:12,759 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:12,762 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43400': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:12,762 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43402': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:12,762 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:12,868 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:12,871 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43412': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:12,872 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43426': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:12,872 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:12,977 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:12,980 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43428': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:12,980 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43432': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:12,980 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:13,086 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:13,088 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43444': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:13,089 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43456': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:13,089 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:13,194 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:13,197 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43472': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:13,198 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43480': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:13,198 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:13,303 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:13,306 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43496': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:13,307 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43500': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:13,307 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:13,412 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:13,415 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43512': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:13,415 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43516': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:13,415 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:13,521 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:13,524 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43520': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:13,524 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43536': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:13,524 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:13,630 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:13,633 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43550': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:13,633 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43564': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:13,633 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:13,738 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:13,741 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43580': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:13,742 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43590': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:13,742 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:13,847 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:13,850 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43602': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:13,851 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43610': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:13,851 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:13,956 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:13,959 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43612': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:13,960 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43618': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:13,960 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:14,065 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:14,068 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43622': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:14,068 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43628': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:14,069 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:14,174 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:14,177 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43642': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:14,177 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43652': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:14,177 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:14,283 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:14,285 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43660': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:14,286 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43672': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:14,286 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:14,392 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:14,395 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43674': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:14,395 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43678': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:14,395 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:14,501 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:14,503 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43692': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:14,504 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43706': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:14,504 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:14,610 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:14,613 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43716': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:14,614 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43718': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:14,614 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:14,718 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:14,721 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:14,722 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43734': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:14,722 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:14,827 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:14,830 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43738': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:14,831 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43748': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:14,831 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:14,936 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:14,939 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43762': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:14,939 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43774': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:14,939 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:15,044 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:15,047 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43786': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:15,047 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:15,047 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:15,151 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:15,154 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43804': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:15,155 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43820': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:15,155 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:15,257 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:15,260 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43834': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:15,261 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43844': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:15,261 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:15,363 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:15,367 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43850': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:15,367 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43858': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:15,367 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:15,470 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:15,474 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43868': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:15,474 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43878': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:15,474 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:15,577 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:15,581 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43888': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:15,582 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43890': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:15,582 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:15,684 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:15,687 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43892': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:15,688 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43902': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:15,688 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:15,790 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:15,794 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43914': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:15,794 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43930': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:15,794 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:15,898 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:15,901 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43944': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:15,902 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43948': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:15,902 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:16,004 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:16,008 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43954': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:16,008 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43966': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:16,008 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:16,111 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:16,114 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43976': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:16,115 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43978': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:16,115 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:16,218 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:16,221 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:43994': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:16,221 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44002': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:16,221 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:16,325 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:16,329 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44018': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:16,330 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44022': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:16,330 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:16,431 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:16,435 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44032': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:16,436 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44046': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:16,436 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:16,538 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:16,542 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44062': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:16,542 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44066': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:16,542 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:16,644 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:16,648 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44068': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:16,649 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44076': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:16,649 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:16,752 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:16,755 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44084': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:16,755 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44094': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:16,755 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:16,858 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:16,862 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44098': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:16,862 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:16,862 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44106': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:16,965 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:16,969 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44110': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:16,970 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44126': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:16,970 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:17,072 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:17,075 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44136': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:17,076 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44150': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:17,076 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:17,178 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:17,182 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44158': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:17,182 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44172': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:17,182 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:17,284 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:17,288 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44186': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:17,289 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44202': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:17,289 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:17,391 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:17,395 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44214': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:17,395 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44222': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:17,395 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:17,498 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:17,501 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44226': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:17,502 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44240': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:17,502 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:17,604 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:17,608 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44250': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:17,608 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44266': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:17,608 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:17,711 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:17,714 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44276': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:17,715 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44288': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:17,715 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:17,818 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:17,821 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44298': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:17,821 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44314': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:17,821 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:17,925 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:17,929 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44326': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:17,929 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44332': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:17,929 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:18,031 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:18,036 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44340': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:18,036 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44348': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:18,036 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:18,138 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:18,142 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44364': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:18,142 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:18,142 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44366': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:18,245 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:18,248 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44370': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:18,249 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44374': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:18,249 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:18,351 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44390': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:18,351 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:18,356 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:18,356 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44398': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:18,458 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:18,462 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44412': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:18,462 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44418': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:18,462 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:18,564 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:18,568 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44432': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:18,569 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44444': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:18,569 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:18,671 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:18,675 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44452': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:18,675 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44456': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:18,675 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:18,777 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:18,781 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44464': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:18,781 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44474': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:18,781 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:18,883 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:18,887 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44486': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:18,888 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44494': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:18,888 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:18,990 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:18,994 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44504': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:18,994 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44510': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:18,994 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:19,096 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:19,100 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44514': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:19,100 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44516': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:19,101 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:19,203 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:19,206 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44532': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:19,207 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44542': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:19,207 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:19,309 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:19,313 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44544': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:19,314 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44548': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:19,314 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:19,416 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:19,419 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44550': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:19,420 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44556': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:19,420 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:19,522 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:19,526 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44558': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:19,526 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44572': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:19,526 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:19,628 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:19,632 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44576': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:19,632 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44588': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:19,632 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:19,734 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:19,739 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44600': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:19,739 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44606': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:19,739 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:19,841 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44612': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:19,841 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:19,846 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44618': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:19,846 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:19,947 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44634': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:19,947 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:19,952 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44638': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:19,952 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:20,053 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44642': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:20,054 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:20,058 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44644': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:20,058 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:20,160 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44658': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:20,160 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:20,165 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44662': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:20,165 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:20,266 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44664': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:20,266 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:20,271 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44676': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:20,271 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:20,373 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:20,377 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44680': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:20,377 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44692': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:20,377 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:20,479 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:20,483 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44700': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:20,484 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44712': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:20,484 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:20,586 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:20,589 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44718': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:20,590 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44728': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:20,590 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:20,692 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:20,696 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44736': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:20,696 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44744': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:20,696 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:20,798 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:20,802 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44760': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:20,803 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44776': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:20,803 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:20,905 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:20,908 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44792': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:20,909 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44808': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:20,909 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:21,011 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:21,015 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44818': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:21,015 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44826': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:21,015 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:21,118 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:21,121 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44830': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:21,122 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44832': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:21,122 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:21,224 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:21,228 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44846': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:21,228 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:21,231 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44848': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:21,331 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:21,334 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44854': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:21,335 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44856': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:21,335 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:21,437 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:21,442 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44864': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:21,442 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:44866': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:21,442 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:21,544 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39018': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:21,544 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:21,549 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39026': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:21,549 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:21,650 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39028': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:21,650 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:21,656 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39042': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:21,656 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:21,758 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:21,761 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:21,762 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39060': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:21,762 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:21,864 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:21,868 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39070': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:21,868 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39086': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:21,868 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:21,971 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:21,974 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39090': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:21,975 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39096': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:21,975 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:22,077 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:22,081 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39106': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:22,081 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:22,081 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:22,183 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:22,188 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39134': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:22,188 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39142': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:22,188 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:22,290 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39152': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:22,290 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:22,295 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39156': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:22,295 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:22,396 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39162': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:22,396 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:22,401 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39178': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:22,401 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:22,503 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39186': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:22,503 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:22,508 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39188': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:22,508 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:22,609 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39194': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:22,609 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:22,614 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39206': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:22,614 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:22,716 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:22,720 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39208': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:22,721 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39224': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:22,721 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:22,822 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:22,826 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39234': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:22,827 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39240': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:22,827 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:22,929 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:22,933 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39248': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:22,933 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39254': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:22,933 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:23,035 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:23,039 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39260': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:23,040 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39276': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:23,040 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:23,142 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:23,147 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39284': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:23,147 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39290': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:23,147 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:23,249 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39298': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:23,249 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:23,254 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39300': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:23,254 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:23,355 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:23,359 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39316': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:23,360 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39332': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:23,360 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:23,462 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:23,466 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39336': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:23,466 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39350': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:23,466 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:23,568 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:23,572 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39360': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:23,573 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39368': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:23,573 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:23,674 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:23,678 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39372': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:23,679 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39380': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:23,679 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:23,781 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:23,785 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39388': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:23,785 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39390': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:23,785 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:23,887 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:23,891 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39406': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:23,891 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39408': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:23,891 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:23,994 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:23,997 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39416': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:23,998 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39424': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:23,998 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:24,100 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:24,104 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39438': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:24,104 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39454': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:24,104 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:24,207 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:24,211 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39470': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:24,211 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39478': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:24,211 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:24,313 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:24,317 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39482': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:24,318 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39486': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:24,318 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:24,420 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:24,424 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39496': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:24,424 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39512': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:24,424 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:24,526 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:24,530 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39524': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:24,530 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39536': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:24,530 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:24,632 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:24,636 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39552': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:24,637 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39558': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:24,637 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:24,739 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:24,742 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39570': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:24,743 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39580': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:24,743 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:24,845 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:24,850 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39594': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:24,851 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39600': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:24,851 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:24,951 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39610': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:24,951 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:24,957 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39624': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:24,957 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:25,058 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39626': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:25,058 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:25,064 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39628': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:25,064 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:25,164 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39640': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:25,164 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:25,170 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39652': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:25,170 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:25,271 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39658': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:25,271 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:25,277 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39670': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:25,277 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:25,377 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39686': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:25,377 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:25,383 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39694': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:25,383 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:25,483 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39708': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:25,483 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:25,489 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39718': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:25,489 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:25,590 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39734': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:25,590 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:25,596 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39742': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:25,596 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:25,697 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39756': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:25,697 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:25,703 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39772': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:25,703 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:25,803 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39776': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:25,803 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:25,809 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39780': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:25,809 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:25,909 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39784': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:25,909 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:25,915 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39790': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:25,915 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:26,016 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:26,016 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:26,022 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39802': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:26,022 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:26,122 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:26,122 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39814': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:26,128 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39830': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:26,128 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:26,229 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:26,231 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39844': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:26,236 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39860': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:26,236 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:26,335 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39864': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:26,335 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:26,343 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39868': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:26,343 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:26,442 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39878': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:26,442 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:26,450 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39888': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:26,450 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:26,549 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:26,549 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39890': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:26,557 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39904': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:26,557 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:26,656 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:26,656 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39912': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:26,664 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39914': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:26,664 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:26,762 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:26,762 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39916': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:26,770 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39922': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:26,770 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:26,869 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39932': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:26,869 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:26,877 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39944': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:26,877 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:26,975 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39960': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:26,975 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:26,984 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:26,984 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39972': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:27,082 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39986': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:27,082 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:27,090 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39996': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:27,090 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:27,189 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40000': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:27,189 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:27,197 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40012': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:27,197 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:27,295 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40014': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:27,295 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:27,303 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40026': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:27,303 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:27,402 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40034': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:27,402 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:27,410 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40040': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:27,410 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:27,509 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:27,509 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40052': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:27,516 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:27,516 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:27,616 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40060': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:27,616 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:27,623 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40068': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:27,623 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:27,722 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40084': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:27,722 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:27,729 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:27,731 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40094': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:27,829 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40098': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:27,829 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:27,835 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40110': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:27,835 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:27,936 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40112': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:27,936 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:27,942 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40118': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:27,942 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:28,042 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40132': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:28,042 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:28,048 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40136': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:28,048 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:28,149 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40146': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:28,149 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:28,154 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40160': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:28,154 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:28,256 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:28,256 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40170': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:28,261 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40172': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:28,261 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:28,362 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40178': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:28,362 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:28,368 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40190': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:28,368 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:28,469 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40196': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:28,469 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:28,474 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40206': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:28,474 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:28,575 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40220': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:28,575 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:28,580 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40236': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:28,580 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:28,681 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:28,681 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40248': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:28,686 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40258': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:28,686 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:28,788 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:28,792 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40274': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:28,793 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40284': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:28,793 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:28,894 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40296': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:28,894 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:28,899 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40306': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:28,899 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:29,001 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:29,005 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40312': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:29,006 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40328': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:29,006 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:29,108 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:29,111 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40340': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:29,112 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40354': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:29,112 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:29,214 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:29,217 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40370': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:29,218 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40380': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:29,218 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:29,320 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:29,324 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40394': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:29,325 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40410': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:29,325 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:29,427 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:29,431 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40412': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:29,431 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40418': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:29,431 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:29,533 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:29,537 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40432': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:29,538 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40434': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:29,538 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:29,639 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:29,643 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40436': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:29,644 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40448': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:29,644 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:29,746 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:29,750 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40462': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:29,750 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40468': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:29,750 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:29,853 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:29,856 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40474': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:29,857 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40476': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:29,857 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:29,959 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:29,963 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40492': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:29,964 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40500': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:29,964 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:30,065 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:30,065 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40506': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:30,070 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40518': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:30,070 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:30,172 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:30,172 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40534': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:30,177 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40542': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:30,177 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:30,278 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40552': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:30,278 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:30,283 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40566': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:30,283 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:30,385 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:30,389 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40574': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:30,390 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40576': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:30,390 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:30,491 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40584': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:30,491 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:30,497 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40598': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:30,497 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:30,598 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:30,598 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40604': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:30,603 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40620': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:30,603 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:30,705 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:30,709 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40624': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:30,710 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40640': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:30,710 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:30,811 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40646': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:30,811 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:30,816 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:30,817 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40660': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:30,918 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:30,918 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40662': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:30,923 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40678': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:30,923 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:31,024 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:31,024 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40686': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:31,029 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40702': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:31,029 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:31,131 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:31,131 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40708': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:31,136 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40716': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:31,136 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:31,237 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40720': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:31,237 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:31,243 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40728': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:31,243 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:31,345 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:31,345 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40740': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:31,350 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40746': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:31,350 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:31,451 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:31,451 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40762': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:31,456 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40772': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:31,456 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:31,558 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:31,558 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39966': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:31,563 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39974': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:31,563 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:31,664 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:31,664 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39988': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:31,670 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39996': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:31,670 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:31,771 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40008': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:31,771 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:31,777 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40024': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:31,777 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:31,877 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40038': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:31,877 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:31,883 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40048': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:31,883 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:31,983 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:31,983 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:31,990 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40060': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:31,990 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:32,090 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:32,090 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40070': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:32,096 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40086': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:32,096 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:32,197 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:32,197 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40090': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:32,202 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40104': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:32,202 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:32,303 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40110': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:32,303 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:32,309 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40114': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:32,309 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:32,410 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:32,410 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40118': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:32,415 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40126': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:32,415 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:32,516 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:32,516 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40132': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:32,521 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40144': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:32,521 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:32,623 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40154': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:32,623 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:32,628 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40160': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:32,628 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:32,733 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:32,736 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40174': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:32,737 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40180': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:32,737 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:32,839 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:32,843 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40190': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:32,843 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40192': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:32,843 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:32,946 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:32,949 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40208': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:32,950 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40212': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:32,950 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:33,052 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:33,056 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40222': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:33,056 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40236': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:33,056 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:33,159 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:33,162 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40244': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:33,163 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40260': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:33,163 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:33,265 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:33,269 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40272': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:33,270 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40286': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:33,270 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:33,372 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:33,376 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40288': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:33,377 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40304': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:33,377 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:33,478 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40312': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:33,478 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:33,483 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40328': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:33,483 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:33,585 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40344': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:33,585 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:33,590 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40356': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:33,590 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:33,691 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40372': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:33,691 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:33,696 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40380': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:33,696 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:33,798 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40390': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:33,798 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:33,803 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40392': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:33,803 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:33,904 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40394': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:33,904 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:33,909 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40408': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:33,909 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:34,011 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:34,015 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40424': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:34,015 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40428': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:34,015 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:34,117 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:34,121 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40444': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:34,122 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40454': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:34,122 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:34,224 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:34,227 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40456': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:34,228 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:34,230 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40464': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:34,330 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:34,334 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40476': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:34,335 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40486': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:34,335 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:34,437 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:34,440 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40500': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:34,441 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40506': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:34,441 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:34,543 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:34,547 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40514': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:34,548 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40526': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:34,548 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:34,650 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:34,653 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40536': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:34,654 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40548': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:34,654 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:34,756 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:34,760 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40556': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:34,760 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40566': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:34,760 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:34,863 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:34,866 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40576': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:34,867 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40580': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:34,867 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:34,969 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:34,973 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40594': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:34,973 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40610': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:34,973 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:35,076 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:35,080 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40624': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:35,081 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40638': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:35,081 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:35,182 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40650': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:35,182 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:35,188 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40654': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:35,188 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:35,289 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40668': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:35,289 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:35,294 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40676': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:35,294 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:35,395 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40678': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:35,395 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:35,401 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40680': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:35,401 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:35,502 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40690': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:35,502 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:35,507 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40704': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:35,508 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:35,609 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:35,609 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40716': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:35,614 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40732': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:35,614 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:35,715 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40740': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:35,715 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:35,721 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40756': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:35,721 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:35,824 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:35,827 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40760': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:35,828 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40774': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:35,828 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:35,933 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:35,936 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40778': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:35,937 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40786': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:35,937 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:36,042 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:36,045 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:36,045 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40798': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:36,045 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:36,152 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:36,155 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40814': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:36,157 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40800': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:36,157 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:36,259 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:36,259 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40820': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:36,266 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40828': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:36,266 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:36,366 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40830': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:36,366 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:36,375 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40844': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:36,375 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:36,473 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40854': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:36,473 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:36,484 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40858': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:36,484 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:36,580 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40870': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:36,580 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:36,592 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40872': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:36,592 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:36,687 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40886': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:36,687 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:36,699 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40894': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:36,699 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:36,794 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40906': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:36,794 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:36,806 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40922': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:36,806 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:36,900 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40928': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:36,901 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:36,913 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40936': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:36,913 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:37,007 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40950': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:37,007 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:37,019 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40960': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:37,019 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:37,113 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40974': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:37,113 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:37,126 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40978': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:37,126 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:37,220 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:37,220 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:37,232 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40994': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:37,233 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:37,327 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41010': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:37,327 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:37,339 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41020': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:37,339 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:37,433 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41032': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:37,433 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:37,445 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41040': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:37,445 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:37,540 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41046': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:37,540 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:37,551 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41054': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:37,551 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:37,647 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41062': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:37,647 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:37,657 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41078': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:37,657 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:37,753 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41088': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:37,753 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:37,763 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41104': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:37,763 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:37,860 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41114': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:37,860 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:37,870 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:37,870 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41128': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:37,966 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41140': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:37,966 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:37,976 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41144': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:37,976 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:38,073 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41154': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:38,073 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:38,082 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41158': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:38,082 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:38,180 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41168': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:38,180 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:38,188 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41174': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:38,188 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:38,287 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41186': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:38,287 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:38,295 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41200': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:38,295 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:38,394 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41206': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:38,394 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:38,401 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41222': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:38,401 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:38,500 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41224': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:38,500 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:38,508 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41228': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:38,508 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:38,607 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:38,607 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41238': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:38,615 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41254': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:38,615 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:38,714 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41268': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:38,714 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:38,721 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41270': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:38,721 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:38,820 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41274': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:38,820 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:38,828 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41280': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:38,828 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:38,927 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41290': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:38,927 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:38,934 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41296': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:38,934 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:39,033 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41300': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:39,033 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:39,041 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41304': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:39,041 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:39,140 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:39,140 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41308': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:39,147 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41320': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:39,147 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:39,246 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41332': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:39,246 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:39,253 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41338': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:39,253 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:39,353 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41350': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:39,353 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:39,360 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41362': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:39,360 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:39,459 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41364': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:39,459 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:39,466 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41368': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:39,466 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:39,566 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41380': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:39,566 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:39,575 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41386': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:39,575 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:39,673 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41394': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:39,673 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:39,683 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41396': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:39,684 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:39,779 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41398': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:39,779 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:39,792 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41412': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:39,793 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:39,886 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41422': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:39,886 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:39,901 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41438': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:39,901 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:39,992 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41454': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:39,992 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:40,010 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41468': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:40,010 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:40,099 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41476': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:40,099 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:40,119 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41480': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:40,119 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:40,205 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41484': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:40,205 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:40,229 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:40,230 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41496': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:40,312 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41498': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:40,312 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:40,338 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41512': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:40,338 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:40,419 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41518': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:40,419 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:40,446 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41534': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:40,447 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:40,525 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41544': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:40,525 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:40,555 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41554': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:40,555 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:40,632 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41556': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:40,632 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:40,664 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41570': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:40,664 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:40,738 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41574': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:40,738 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:40,772 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41586': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:40,773 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:40,845 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:40,845 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41592': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:40,881 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41596': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:40,882 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:40,952 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41602': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:40,952 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:40,992 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41616': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:40,992 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:41,058 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:41,058 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41624': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:41,101 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41630': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:41,101 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:41,165 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41642': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:41,165 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:41,209 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41644': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:41,210 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:41,272 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:41,272 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41658': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:41,318 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41660': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:41,318 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:41,378 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41672': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:41,378 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:41,427 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41686': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:41,427 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:41,485 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:41692': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:41,485 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:41,536 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53700': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:41,536 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:41,592 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:41,592 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53710': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:41,644 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53726': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:41,645 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:41,699 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53728': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:41,699 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:41,753 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53734': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:41,754 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:41,806 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53746': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:41,806 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:41,862 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53756': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:41,862 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:41,913 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53762': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:41,913 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:41,972 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53774': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:41,972 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:42,020 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53784': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:42,020 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:42,080 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53798': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:42,081 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:42,126 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53806': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:42,127 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:42,189 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53812': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:42,190 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:42,233 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53826': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:42,233 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:42,298 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53842': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:42,299 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:42,340 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53844': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:42,340 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:42,407 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53856': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:42,408 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:42,446 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53858': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:42,446 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:42,516 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53874': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:42,516 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:42,553 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53876': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:42,553 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:42,625 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53884': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:42,625 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:42,660 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53888': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:42,660 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:42,735 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53900': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:42,735 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:42,766 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53908': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:42,766 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:42,844 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53918': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:42,844 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:42,873 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53934': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:42,873 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:42,953 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53948': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:42,953 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:42,980 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53962': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:42,980 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:43,062 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53970': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:43,062 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:43,086 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53980': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:43,086 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:43,170 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53996': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:43,170 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:43,193 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54000': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:43,193 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:43,277 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54008': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:43,277 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:43,299 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54022': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:43,299 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:43,383 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54028': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:43,383 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:43,406 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54038': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:43,406 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:43,490 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54054': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:43,490 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:43,512 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54056': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:43,512 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:43,596 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:43,596 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:43,619 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54060': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:43,619 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:43,704 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54064': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:43,704 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:43,725 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:43,727 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54074': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:43,811 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54080': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:43,811 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:43,832 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54096': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:43,832 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:43,918 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:43,918 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54100': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:43,938 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:43,938 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54116': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:44,024 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:44,024 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:44,045 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:44,045 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54126': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:44,131 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54132': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:44,131 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:44,151 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54134': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:44,151 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:44,237 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54136': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:44,237 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:44,257 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54144': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:44,257 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:44,344 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54156': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:44,344 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:44,364 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54162': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:44,364 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:44,451 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54166': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:44,451 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:44,470 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54182': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:44,470 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:44,557 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54196': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:44,557 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:44,577 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54206': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:44,577 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:44,664 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54212': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:44,664 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:44,683 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54224': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:44,683 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:44,771 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54228': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:44,771 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:44,790 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54238': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:44,790 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:44,877 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54250': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:44,877 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:44,896 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54262': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:44,896 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:44,984 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54266': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:44,984 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:45,003 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54272': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:45,003 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:45,090 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54278': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:45,090 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:45,109 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:45,110 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54294': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:45,197 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54298': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:45,197 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:45,216 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54314': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:45,216 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:45,304 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54324': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:45,304 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:45,322 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54328': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:45,322 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:45,411 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54342': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:45,411 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:45,429 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54352': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:45,429 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:45,518 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54360': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:45,518 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:45,535 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54374': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:45,535 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:45,624 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:45,624 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54382': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:45,643 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54396': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:45,643 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:45,733 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54408': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:45,733 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:45,750 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54414': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:45,750 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:45,840 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54420': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:45,840 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:45,857 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54426': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:45,857 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:45,947 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54430': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:45,947 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:45,963 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54444': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:45,963 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:46,054 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54452': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:46,054 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:46,069 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:46,069 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54454': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:46,160 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54470': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:46,160 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:46,176 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:46,176 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54472': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:46,267 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54488': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:46,267 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:46,283 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54490': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:46,283 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:46,374 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54500': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:46,374 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:46,389 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54512': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:46,389 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:46,480 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54522': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:46,480 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:46,496 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54530': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:46,496 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:46,587 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54536': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:46,587 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:46,602 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54552': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:46,602 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:46,694 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54562': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:46,694 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:46,708 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54578': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:46,708 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:46,801 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54588': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:46,801 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:46,815 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54594': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:46,815 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:46,908 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54606': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:46,908 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:46,921 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54622': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:46,921 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:47,014 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54626': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:47,014 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:47,028 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54630': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:47,028 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:47,122 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54640': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:47,122 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:47,134 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54644': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:47,134 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:47,229 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:47,231 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54648': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:47,241 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54656': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:47,241 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:47,335 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54666': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:47,335 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:47,347 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54674': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:47,347 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:47,442 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54686': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:47,442 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:47,454 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:47,454 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54700': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:47,548 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54714': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:47,548 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:47,560 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54716': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:47,560 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:47,655 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54722': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:47,655 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:47,667 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:47,667 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:47,761 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54738': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:47,761 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:47,774 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54742': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:47,774 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:47,868 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54746': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:47,868 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:47,880 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54756': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:47,880 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:47,975 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:47,975 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54772': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:47,986 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54788': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:47,987 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:48,081 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54802': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:48,081 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:48,093 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54810': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:48,093 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:48,188 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54814': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:48,188 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:48,200 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54824': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:48,200 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:48,294 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54840': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:48,294 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:48,306 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54854': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:48,306 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:48,401 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54862': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:48,401 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:48,413 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54872': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:48,413 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:48,508 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54876': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:48,508 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:48,519 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54888': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:48,519 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:48,614 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54902': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:48,614 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:48,626 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54916': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:48,626 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:48,721 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54932': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:48,721 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:48,733 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54944': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:48,733 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:48,828 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54946': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:48,828 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:48,839 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54952': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:48,839 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:48,935 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54964': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:48,935 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:48,946 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54970': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:48,946 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:49,041 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54978': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:49,041 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:49,052 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54988': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:49,052 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:49,148 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:49,148 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:55000': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:49,159 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:55010': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:49,159 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:49,254 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:55012': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:49,255 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:49,265 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:55022': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:49,265 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:49,361 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:55024': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:49,361 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:49,372 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:55038': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:49,372 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:49,468 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:55054': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:49,468 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:49,478 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:55060': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:49,478 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:49,575 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:55074': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:49,575 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:49,585 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:55086': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:49,585 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:49,681 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:55096': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:49,681 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:49,691 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:55104': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:49,691 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:49,788 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:49,788 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:55118': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:49,798 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:55130': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:49,798 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:49,894 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:55136': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:49,894 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:49,904 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:55144': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:49,904 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:50,001 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:55154': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:50,001 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:50,011 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:55166': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:50,011 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:50,108 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:55174': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:50,108 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:50,117 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:55186': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:50,117 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:50,214 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:55198': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:50,214 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:50,223 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:55204': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:50,223 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:50,321 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:55208': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:50,321 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:50,330 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:50,330 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:55218': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:50,429 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:55220': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:50,430 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:50,437 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:55234': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:50,437 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:50,539 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:50,543 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:55242': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:50,544 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:55250': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:50,544 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:50,651 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:50,654 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:55262': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:50,654 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:55272': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:50,654 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:50,760 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:50,763 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:55274': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:50,764 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:55290': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:50,764 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:50,869 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:50,872 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:55296': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:50,873 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:55306': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:50,873 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:50,977 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:50,980 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:55318': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:50,981 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:55320': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:50,981 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:51,086 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:51,089 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:55332': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:51,090 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:55336': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:51,090 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:51,195 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:51,198 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:55340': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:51,199 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:55354': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:51,199 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:51,304 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:51,307 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:55364': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:51,308 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:55368': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:51,308 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:51,413 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:51,416 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:55372': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:51,416 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:55386': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:51,417 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:51,522 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:51,524 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:55400': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:51,525 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:55412': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:51,525 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:51,631 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:51,634 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51930': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:51,634 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51946': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:51,634 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:51,740 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:51,743 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51956': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:51,743 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51970': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:51,743 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:51,849 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:51,852 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51974': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:51,852 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51982': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:51,852 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:51,958 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:51,961 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51996': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:51,961 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52010': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:51,962 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:52,067 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:52,070 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52020': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:52,070 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52024': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:52,070 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:52,176 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:52,179 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52032': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:52,180 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52044': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:52,180 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:52,286 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:52,289 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:52,290 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52066': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:52,290 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:52,395 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:52,398 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52070': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:52,399 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52084': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:52,399 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:52,505 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:52,507 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52098': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:52,508 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52104': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:52,508 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:52,614 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:52,617 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52120': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:52,617 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52128': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:52,617 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:52,723 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:52,726 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52138': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:52,727 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:52,729 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52152': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:52,832 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:52,835 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52158': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:52,835 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52168': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:52,835 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:52,941 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:52,946 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52180': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:52,946 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:52,946 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52182': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:53,049 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:53,054 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52184': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:53,054 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:53,055 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52198': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:53,156 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:53,161 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52212': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:53,162 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:53,162 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52222': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:53,264 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:53,269 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52238': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:53,269 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:53,270 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52252': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:53,371 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:53,376 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52266': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:53,377 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:53,377 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52278': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:53,478 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:53,484 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52292': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:53,485 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:53,485 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52298': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:53,586 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:53,587 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52310': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:53,593 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:53,593 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52312': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:53,693 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:53,693 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52318': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:53,700 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:53,700 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52326': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:53,800 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:53,801 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52328': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:53,807 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:53,807 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52342': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:53,908 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:53,908 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52358': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:53,915 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:53,915 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52364': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:54,017 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:54,022 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52376': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:54,023 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:54,023 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52384': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:54,124 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:54,130 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52392': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:54,130 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:54,131 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52404': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:54,235 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:54,240 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52414': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:54,241 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:54,241 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52416': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:54,342 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:54,348 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52422': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:54,348 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:54,349 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52424': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:54,450 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:54,455 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52436': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:54,455 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:54,456 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52438': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:54,557 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:54,562 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52452': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:54,562 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:54,563 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52468': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:54,664 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:54,669 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52470': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:54,670 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:54,670 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52484': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:54,772 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:54,777 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52496': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:54,777 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:54,778 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52504': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:54,879 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:54,884 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52510': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:54,885 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:54,885 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52518': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:54,986 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:54,992 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52532': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:54,992 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:54,993 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52534': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:55,094 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:55,099 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52538': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:55,100 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:55,100 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52542': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:55,201 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:55,207 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52554': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:55,207 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:55,207 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52562': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:55,309 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:55,309 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52570': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:55,315 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:55,316 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52584': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:55,416 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:55,416 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52598': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:55,423 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:55,423 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52600': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:55,525 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:55,530 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52616': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:55,530 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:55,531 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52632': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:55,632 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:55,637 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52638': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:55,637 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:55,637 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52652': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:55,739 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:55,744 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52666': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:55,745 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:55,745 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52682': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:55,847 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:55,852 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52684': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:55,852 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:55,852 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52690': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:55,954 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:55,959 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52704': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:55,959 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:55,960 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52708': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:56,061 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:56,066 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52714': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:56,067 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:56,067 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52722': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:56,168 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:56,173 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:56,174 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:56,174 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52730': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:56,276 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:56,281 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52738': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:56,282 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:56,282 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52740': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:56,384 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:56,389 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52756': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:56,389 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:56,389 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52772': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:56,491 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:56,496 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52782': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:56,497 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:56,497 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52792': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:56,599 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:56,604 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52802': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:56,604 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:56,605 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52804': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:56,706 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:56,711 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52820': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:56,712 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:56,712 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52826': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:56,814 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:56,819 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52834': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:56,819 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:56,820 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52836': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:56,921 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52844': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:56,921 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:56,925 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52846': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:56,925 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:57,027 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:57,031 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52862': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:57,031 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52864': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:57,031 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:57,134 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:57,137 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52868': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:57,138 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52874': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:57,138 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:57,240 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:57,244 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52880': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:57,245 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52886': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:57,245 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:57,347 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:57,350 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52892': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:57,351 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52900': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:57,351 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:57,454 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:57,458 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52914': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:57,458 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52916': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:57,459 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:57,561 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:57,564 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52932': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:57,565 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52934': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:57,565 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:57,668 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:57,671 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52940': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:57,672 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52954': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:57,672 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:57,774 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:57,778 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52964': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:57,778 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52974': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:57,778 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:57,881 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:57,884 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:57,885 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52988': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:57,885 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:57,987 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:57,991 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52996': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:57,991 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53010': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:57,991 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:58,094 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:58,097 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53018': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:58,098 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53030': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:58,098 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:58,201 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:58,204 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53044': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:58,205 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53048': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:58,205 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:58,307 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:58,311 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:58,311 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53064': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:58,311 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:58,414 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:58,417 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53076': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:58,418 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53084': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:58,418 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:58,521 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:58,524 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53096': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:58,525 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53102': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:58,525 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:58,627 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:58,631 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53108': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:58,631 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53116': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:58,631 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:58,733 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:58,737 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53130': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:58,737 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53136': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:58,737 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:58,840 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:58,843 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53138': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:58,844 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53154': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:58,844 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:58,946 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:58,950 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53162': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:58,950 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53178': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:58,950 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:59,053 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:59,056 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53184': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:59,057 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53192': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:59,057 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:59,160 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:59,163 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53204': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:59,164 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53210': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:59,164 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:59,266 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:59,270 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53220': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:59,271 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53226': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:59,271 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:59,373 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:59,376 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53228': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:59,377 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53242': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:59,377 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:59,479 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:59,483 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53248': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:59,484 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53250': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:59,484 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:59,586 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:59,590 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53266': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:59,590 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:59,591 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53270': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:59,693 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:59,696 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53280': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:59,697 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53296': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:59,697 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:59,799 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:59,803 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53312': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:59,804 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53314': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:59,804 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:59,906 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:55:59,909 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53318': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:59,910 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53334': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:55:59,910 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:00,012 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:00,016 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53336': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:00,016 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53350': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:00,016 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:00,119 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53364': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:00,119 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:00,124 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53376': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:00,124 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:00,226 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:00,232 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53390': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:00,232 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53400': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:00,232 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:00,333 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53404': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:00,333 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:00,338 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53408': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:00,338 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:00,440 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:00,440 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53422': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:00,445 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53430': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:00,445 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:00,546 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:00,546 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53446': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:00,551 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53460': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:00,551 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:00,652 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:00,656 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53472': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:00,657 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:00,657 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53480': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:00,759 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:00,762 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53496': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:00,763 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53500': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:00,763 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:00,866 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:00,869 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53512': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:00,870 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53514': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:00,870 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:00,972 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:00,976 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53522': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:00,977 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53530': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:00,977 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:01,079 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:01,082 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53536': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:01,083 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53552': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:01,083 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:01,185 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:01,189 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53562': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:01,189 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53572': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:01,189 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:01,291 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:01,295 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53582': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:01,296 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53584': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:01,296 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:01,398 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:01,401 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53594': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:01,402 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53596': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:01,402 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:01,504 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:01,508 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53606': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:01,508 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53622': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:01,508 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:01,611 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:01,614 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49238': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:01,615 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49252': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:01,615 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:01,717 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:01,721 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49258': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:01,721 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49264': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:01,721 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:01,824 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:01,827 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49268': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:01,828 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49274': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:01,828 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:01,930 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:01,933 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49288': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:01,934 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49302': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:01,934 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:02,036 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:02,040 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49314': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:02,040 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49326': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:02,041 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:02,143 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:02,147 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49340': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:02,148 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49356': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:02,148 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:02,249 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49370': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:02,249 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:02,255 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49382': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:02,255 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:02,356 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:02,356 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49388': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:02,361 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49396': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:02,361 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:02,462 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:02,462 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49408': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:02,467 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:02,467 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49412': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:02,570 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:02,573 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49416': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:02,574 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:02,574 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49422': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:02,676 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:02,680 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49436': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:02,680 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49438': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:02,680 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:02,782 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:02,786 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49442': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:02,787 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49458': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:02,787 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:02,889 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:02,892 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49462': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:02,893 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49472': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:02,893 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:02,995 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:02,998 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49484': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:02,999 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49486': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:02,999 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:03,101 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:03,105 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49500': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:03,105 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49504': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:03,105 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:03,208 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:03,211 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49508': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:03,212 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49512': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:03,212 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:03,314 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:03,318 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49526': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:03,319 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49528': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:03,319 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:03,421 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:03,425 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49534': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:03,425 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49540': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:03,425 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:03,528 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:03,531 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49554': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:03,532 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:03,532 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49568': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:03,634 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:03,638 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49580': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:03,639 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49588': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:03,639 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:03,741 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:03,745 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49596': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:03,745 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49602': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:03,745 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:03,848 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:03,851 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49614': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:03,852 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49618': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:03,852 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:03,954 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:03,958 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49620': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:03,958 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49622': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:03,958 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:04,061 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:04,064 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49632': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:04,065 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49636': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:04,065 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:04,167 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:04,171 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49650': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:04,171 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49654': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:04,171 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:04,274 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:04,278 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49658': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:04,278 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49660': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:04,278 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:04,381 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:04,384 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49662': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:04,385 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49666': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:04,385 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:04,487 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:04,491 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49668': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:04,491 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49670': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:04,492 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:04,594 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:04,597 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49682': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:04,598 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49684': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:04,598 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:04,700 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:04,704 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49694': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:04,705 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49700': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:04,705 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:04,807 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:04,811 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49702': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:04,811 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49706': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:04,811 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:04,913 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49716': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:04,913 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:04,918 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49732': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:04,918 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:05,020 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:05,024 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49736': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:05,025 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49740': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:05,025 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:05,127 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:05,131 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49744': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:05,132 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49756': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:05,132 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:05,234 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:05,237 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49766': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:05,238 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49782': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:05,238 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:05,340 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:05,344 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49792': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:05,344 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49798': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:05,344 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:05,447 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:05,450 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49808': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:05,451 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49810': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:05,451 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:05,553 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:05,557 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49812': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:05,557 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49828': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:05,557 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:05,660 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:05,663 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49830': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:05,664 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49838': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:05,664 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:05,766 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:05,770 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49852': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:05,770 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49856': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:05,770 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:05,873 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:05,876 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49860': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:05,877 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49862': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:05,877 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:05,980 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:05,984 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49868': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:05,985 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49874': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:05,985 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:06,087 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:06,090 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49890': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:06,091 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49904': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:06,091 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:06,193 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:06,197 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49908': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:06,198 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49910': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:06,198 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:06,300 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:06,303 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49920': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:06,304 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49936': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:06,304 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:06,407 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:06,410 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49940': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:06,411 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49948': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:06,411 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:06,513 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:06,517 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49962': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:06,517 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49968': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:06,517 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:06,620 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:06,623 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49982': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:06,624 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49990': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:06,624 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:06,726 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:06,733 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49992': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:06,733 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50002': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:06,733 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:06,833 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50004': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:06,833 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:06,839 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50018': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:06,839 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:06,940 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50028': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:06,940 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:06,946 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50042': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:06,946 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:07,046 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50048': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:07,046 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:07,052 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:07,052 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:07,153 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50074': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:07,153 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:07,159 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50078': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:07,159 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:07,260 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50094': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:07,260 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:07,265 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50102': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:07,265 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:07,366 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:07,366 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50116': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:07,371 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50118': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:07,371 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:07,473 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:07,477 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50130': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:07,477 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50142': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:07,477 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:07,580 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:07,584 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50144': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:07,584 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50160': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:07,584 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:07,687 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:07,691 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50164': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:07,692 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50168': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:07,692 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:07,794 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:07,797 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50178': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:07,798 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50182': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:07,798 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:07,900 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:07,904 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50192': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:07,904 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50208': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:07,904 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:08,007 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:08,011 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50218': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:08,011 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50224': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:08,011 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:08,114 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:08,117 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50232': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:08,118 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:08,118 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50244': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:08,220 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:08,224 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50250': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:08,224 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50260': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:08,224 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:08,327 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:08,330 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50266': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:08,331 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50272': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:08,331 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:08,433 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:08,437 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50278': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:08,437 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50288': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:08,437 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:08,539 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:08,543 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50296': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:08,544 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50312': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:08,544 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:08,646 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:08,649 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50322': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:08,650 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50334': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:08,650 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:08,752 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:08,756 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50346': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:08,757 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50350': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:08,757 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:08,859 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:08,863 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50358': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:08,863 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50366': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:08,863 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:08,966 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:08,969 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50380': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:08,970 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50386': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:08,970 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:09,072 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:09,075 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50390': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:09,076 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50396': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:09,076 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:09,179 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:09,182 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50408': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:09,183 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50422': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:09,183 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:09,285 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:09,289 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50426': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:09,289 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50438': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:09,289 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:09,392 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:09,396 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50454': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:09,396 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50456': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:09,396 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:09,499 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:09,502 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50468': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:09,503 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50480': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:09,503 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:09,605 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:09,609 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50492': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:09,609 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50496': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:09,609 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:09,712 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50510': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:09,712 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:09,717 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50518': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:09,717 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:09,818 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:09,822 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50526': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:09,823 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50530': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:09,823 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:09,926 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:09,929 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50544': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:09,930 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50556': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:09,930 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:10,032 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:10,035 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50568': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:10,036 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50574': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:10,036 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:10,139 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:10,142 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50584': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:10,143 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50598': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:10,143 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:10,245 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:10,248 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50614': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:10,249 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50628': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:10,249 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:10,351 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:10,355 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50644': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:10,356 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50652': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:10,356 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:10,458 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:10,462 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50660': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:10,462 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50676': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:10,462 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:10,564 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:10,568 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50678': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:10,569 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50682': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:10,569 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:10,671 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:10,674 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50694': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:10,675 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50708': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:10,675 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:10,777 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:10,781 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:10,782 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50730': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:10,782 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:10,884 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:10,888 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50746': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:10,888 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50748': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:10,888 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:10,991 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:10,994 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50760': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:10,995 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50762': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:10,995 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:11,098 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:11,101 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50778': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:11,102 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50782': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:11,102 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:11,205 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:11,208 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50790': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:11,209 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:11,209 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:11,311 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:11,315 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50804': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:11,315 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50812': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:11,315 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:11,418 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:11,421 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50818': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:11,422 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50824': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:11,422 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:11,524 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:11,528 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50832': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:11,528 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50842': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:11,528 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:11,631 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:11,634 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53238': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:11,635 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53242': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:11,635 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:11,737 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:11,741 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53254': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:11,741 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53264': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:11,742 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:11,844 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:11,847 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53278': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:11,848 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53280': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:11,848 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:11,950 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:11,954 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53288': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:11,955 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53292': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:11,955 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:12,057 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:12,060 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53302': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:12,061 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53306': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:12,061 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:12,164 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:12,168 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53314': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:12,169 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53316': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:12,169 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:12,270 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53322': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:12,270 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:12,275 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53326': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:12,275 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:12,377 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:12,381 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53336': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:12,381 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53338': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:12,381 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:12,483 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:12,487 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53340': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:12,487 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53350': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:12,487 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:12,590 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:12,593 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53360': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:12,594 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53368': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:12,594 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:12,696 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:12,700 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53384': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:12,700 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53398': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:12,701 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:12,804 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:12,807 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53412': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:12,808 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53424': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:12,808 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:12,910 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:12,914 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53432': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:12,914 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53442': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:12,914 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:13,017 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:13,020 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53448': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:13,021 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53458': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:13,021 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:13,124 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:13,127 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53460': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:13,127 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53462': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:13,127 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:13,233 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:13,236 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53472': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:13,237 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53478': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:13,237 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:13,339 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:13,342 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53494': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:13,343 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53496': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:13,343 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:13,445 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:13,449 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53506': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:13,450 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53522': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:13,450 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:13,552 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:13,555 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53524': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:13,556 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53532': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:13,556 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:13,658 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:13,662 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53538': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:13,663 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53550': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:13,663 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:13,765 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:13,768 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53558': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:13,769 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53564': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:13,769 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:13,871 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:13,875 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53570': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:13,876 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53574': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:13,876 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:13,978 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:13,982 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53590': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:13,982 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53604': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:13,982 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:14,084 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:14,088 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53616': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:14,089 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53618': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:14,089 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:14,191 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:14,194 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53634': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:14,195 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53644': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:14,195 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:14,297 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:14,301 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53652': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:14,301 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53666': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:14,301 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:14,404 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:14,407 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53670': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:14,408 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53676': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:14,408 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:14,511 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:14,514 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53682': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:14,515 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53694': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:14,515 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:14,617 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:14,621 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53704': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:14,621 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53716': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:14,621 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:14,725 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:14,729 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:14,731 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:14,731 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53732': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:14,831 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:14,835 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53748': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:14,836 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53758': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:14,836 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:14,938 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:14,942 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53762': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:14,943 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53770': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:14,943 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:15,045 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:15,048 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53772': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:15,049 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53788': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:15,049 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:15,151 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:15,155 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53804': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:15,155 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53818': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:15,156 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:15,258 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:15,261 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53828': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:15,262 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53832': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:15,262 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:15,364 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:15,368 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53838': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:15,369 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53854': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:15,369 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:15,471 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:15,475 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53856': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:15,475 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53872': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:15,475 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:15,578 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:15,581 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53880': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:15,582 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53892': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:15,582 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:15,684 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:15,687 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53902': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:15,688 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53910': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:15,688 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:15,790 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:15,794 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53924': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:15,794 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53938': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:15,795 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:15,897 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:15,901 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53944': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:15,901 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53956': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:15,901 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:16,004 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:16,007 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53962': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:16,008 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53972': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:16,008 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:16,110 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:16,114 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53976': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:16,114 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53992': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:16,114 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:16,218 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:16,221 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54002': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:16,222 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54014': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:16,222 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:16,324 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:16,328 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54026': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:16,328 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54030': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:16,328 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:16,431 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:16,434 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54042': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:16,435 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54050': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:16,435 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:16,537 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:16,540 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54062': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:16,541 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54072': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:16,541 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:16,643 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:16,647 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54080': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:16,647 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54084': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:16,647 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:16,749 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:16,753 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54096': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:16,753 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54102': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:16,754 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:16,856 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:16,859 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54110': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:16,860 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54126': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:16,860 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:16,962 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:16,966 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54140': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:16,966 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54150': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:16,966 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:17,068 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:17,072 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54166': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:17,073 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54168': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:17,073 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:17,175 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:17,179 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54184': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:17,180 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54198': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:17,180 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:17,281 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54210': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:17,281 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:17,286 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54220': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:17,286 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:17,388 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:17,391 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54236': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:17,392 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54240': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:17,392 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:17,494 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:17,498 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54244': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:17,498 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54246': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:17,498 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:17,600 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:17,604 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54248': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:17,605 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54262': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:17,605 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:17,707 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:17,710 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54270': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:17,711 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54276': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:17,711 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:17,813 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:17,817 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54286': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:17,818 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54290': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:17,818 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:17,920 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:17,924 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54294': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:17,925 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54302': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:17,925 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:18,027 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:18,030 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54310': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:18,031 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54324': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:18,031 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:18,133 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:18,137 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54338': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:18,137 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54348': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:18,137 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:18,239 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:18,243 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54356': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:18,244 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54370': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:18,244 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:18,346 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:18,349 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54386': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:18,350 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54394': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:18,350 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:18,452 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:18,456 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54400': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:18,456 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54402': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:18,456 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:18,558 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:18,562 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54412': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:18,563 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54428': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:18,563 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:18,665 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:18,668 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54432': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:18,669 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54434': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:18,669 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:18,771 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:18,774 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54448': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:18,775 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54454': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:18,775 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:18,877 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:18,881 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54456': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:18,881 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54466': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:18,881 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:18,983 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:18,987 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54478': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:18,987 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54492': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:18,987 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:19,089 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:19,093 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54498': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:19,094 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:19,094 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54500': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:19,196 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:19,199 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54508': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:19,200 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54514': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:19,200 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:19,303 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:19,306 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54530': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:19,307 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54544': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:19,307 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:19,409 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:19,412 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54552': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:19,413 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54566': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:19,413 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:19,520 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:19,522 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54570': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:19,523 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54586': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:19,523 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:19,629 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:19,632 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54590': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:19,633 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54592': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:19,633 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:19,738 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:19,741 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54602': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:19,741 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54618': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:19,741 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:19,847 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:19,850 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54626': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:19,850 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54642': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:19,850 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:19,956 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:19,959 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54654': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:19,959 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54660': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:19,959 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:20,065 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:20,068 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54676': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:20,068 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54678': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:20,068 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:20,174 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:20,176 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54690': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:20,177 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54694': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:20,177 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:20,283 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:20,285 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54706': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:20,286 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54710': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:20,286 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:20,391 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:20,395 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54716': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:20,395 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54730': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:20,395 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:20,498 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:20,501 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54732': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:20,502 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54742': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:20,502 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:20,604 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:20,608 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54756': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:20,608 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54766': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:20,608 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:20,711 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:20,714 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54772': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:20,715 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:20,715 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54778': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:20,817 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:20,820 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54794': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:20,821 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54798': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:20,821 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:20,923 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:20,927 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54806': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:20,927 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54822': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:20,927 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:21,029 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:21,033 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54834': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:21,034 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54850': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:21,034 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:21,136 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:21,139 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54852': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:21,140 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54856': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:21,140 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:21,242 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:21,245 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54870': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:21,246 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54882': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:21,246 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:21,349 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:21,353 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54890': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:21,353 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54896': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:21,353 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:21,455 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:21,459 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54898': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:21,460 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54910': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:21,460 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:21,562 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:21,565 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53146': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:21,566 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53148': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:21,566 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:21,668 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:21,671 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53160': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:21,672 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53174': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:21,672 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:21,774 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:21,778 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53190': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:21,779 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53206': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:21,779 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:21,881 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:21,885 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53208': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:21,885 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53214': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:21,885 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:21,987 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:21,991 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53226': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:21,992 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53230': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:21,992 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:22,094 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:22,097 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53234': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:22,098 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53250': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:22,098 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:22,200 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:22,204 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53262': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:22,205 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53270': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:22,205 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:22,306 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53282': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:22,306 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:22,311 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53284': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:22,311 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:22,413 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:22,417 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53300': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:22,418 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53308': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:22,418 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:22,519 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:22,523 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53324': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:22,524 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53336': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:22,524 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:22,626 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:22,629 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53350': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:22,630 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53356': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:22,630 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:22,732 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:22,736 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53364': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:22,737 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53372': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:22,737 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:22,839 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:22,842 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53380': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:22,843 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53394': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:22,843 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:22,945 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:22,949 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53402': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:22,949 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53418': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:22,949 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:23,052 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8449s 2024-11-23 22:56:23,056 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53420': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:23,056 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53430': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8449s 2024-11-23 22:56:23,056 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:23,159 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:23,162 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53436': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:23,163 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53438': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:23,163 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:23,265 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:23,269 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53452': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:23,269 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53460': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:23,269 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:23,371 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:23,375 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53466': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:23,375 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53480': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:23,376 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:23,478 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:23,481 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53486': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:23,482 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53500': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:23,482 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:23,584 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:23,587 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53506': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:23,588 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53520': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:23,588 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:23,690 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:23,694 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53528': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:23,694 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53544': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:23,694 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:23,796 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:23,800 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53552': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:23,800 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53564': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:23,800 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:23,903 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:23,906 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53572': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:23,907 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53586': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:23,907 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:24,009 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:24,012 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53598': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:24,013 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53604': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:24,013 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:24,115 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:24,115 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53620': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:24,120 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53630': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:24,120 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:24,221 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:24,221 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53642': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:24,226 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:24,228 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53650': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:24,328 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:24,332 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53656': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:24,333 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53658': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:24,333 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:24,435 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:24,438 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53662': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:24,439 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53664': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:24,439 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:24,541 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:24,545 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53674': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:24,545 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53684': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:24,545 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:24,647 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:24,651 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53700': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:24,651 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53710': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:24,652 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:24,754 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:24,758 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53714': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:24,758 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53716': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:24,759 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:24,860 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:24,864 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53732': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:24,865 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53740': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:24,865 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:24,967 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:24,970 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53742': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:24,971 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53758': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:24,971 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:25,073 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:25,077 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53762': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:25,077 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53772': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:25,077 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:25,179 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:25,183 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53778': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:25,183 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53780': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:25,184 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:25,286 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:25,289 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53784': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:25,290 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:25,290 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53800': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:25,392 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:25,395 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53806': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:25,396 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53822': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:25,396 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:25,498 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:25,502 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53830': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:25,503 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53834': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:25,503 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:25,605 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:25,608 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53836': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:25,609 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53848': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:25,609 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:25,711 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:25,714 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53850': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:25,715 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53856': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:25,715 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:25,817 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:25,821 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53872': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:25,821 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53882': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:25,821 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:25,923 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:25,927 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53896': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:25,928 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53898': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:25,928 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:26,030 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:26,034 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53914': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:26,034 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53930': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:26,034 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:26,137 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:26,140 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53932': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:26,141 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53946': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:26,141 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:26,243 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:26,247 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53954': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:26,247 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53958': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:26,247 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:26,350 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:26,353 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53960': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:26,354 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53968': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:26,354 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:26,457 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:26,460 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:26,461 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:53992': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:26,461 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:26,563 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:26,567 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54000': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:26,568 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54014': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:26,568 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:26,670 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:26,673 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54018': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:26,674 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54034': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:26,674 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:26,776 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:26,780 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54036': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:26,781 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54044': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:26,781 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:26,883 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:26,886 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54050': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:26,887 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:26,887 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:26,989 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:26,993 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54072': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:26,994 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54088': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:26,994 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:27,096 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:27,099 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54100': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:27,100 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54108': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:27,100 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:27,203 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:27,207 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54116': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:27,208 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:27,208 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:27,309 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:27,309 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54134': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:27,314 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54142': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:27,314 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:27,416 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:27,420 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54158': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:27,420 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54160': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:27,420 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:27,522 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:27,526 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54168': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:27,526 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54184': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:27,526 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:27,628 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:27,632 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54198': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:27,632 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54210': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:27,633 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:27,735 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:27,738 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54218': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:27,739 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54222': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:27,739 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:27,841 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:27,844 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54234': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:27,845 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54236': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:27,845 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:27,947 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:27,951 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54244': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:27,952 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54254': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:27,952 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:28,054 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:28,057 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54266': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:28,058 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54270': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:28,058 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:28,161 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:28,165 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54272': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:28,165 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54286': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:28,165 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:28,268 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:28,271 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54298': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:28,272 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54312': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:28,272 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:28,374 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:28,378 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54314': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:28,379 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54318': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:28,379 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:28,481 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:28,485 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54322': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:28,485 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54330': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:28,485 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:28,588 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:28,591 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54334': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:28,592 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54336': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:28,592 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:28,694 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:28,698 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54350': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:28,698 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54358': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:28,698 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:28,801 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:28,805 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54368': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:28,805 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54384': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:28,805 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:28,907 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:28,911 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54394': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:28,912 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54400': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:28,912 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:29,014 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:29,014 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54412': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:29,019 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54424': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:29,019 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:29,121 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:29,124 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54430': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:29,125 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54436': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:29,125 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:29,227 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:29,233 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54440': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:29,233 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54442': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:29,233 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:29,334 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54450': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:29,334 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:29,340 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54458': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:29,340 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:29,440 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54468': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:29,440 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:29,446 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54474': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:29,446 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:29,546 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54480': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:29,546 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:29,552 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54490': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:29,552 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:29,653 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54500': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:29,653 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:29,658 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54508': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:29,658 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:29,759 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:29,759 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54516': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:29,764 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54524': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:29,764 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:29,866 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:29,870 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54538': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:29,870 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54546': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:29,870 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:29,973 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:29,976 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54562': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:29,977 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54578': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:29,977 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:30,079 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:30,083 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54588': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:30,083 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54594': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:30,083 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:30,185 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:30,189 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54602': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:30,190 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54616': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:30,190 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:30,292 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:30,296 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54622': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:30,296 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54624': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:30,296 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:30,399 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:30,402 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54630': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:30,403 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54636': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:30,403 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:30,506 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:30,510 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54646': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:30,510 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54652': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:30,510 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:30,612 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:30,616 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54662': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:30,616 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54676': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:30,616 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:30,719 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:30,722 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54684': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:30,723 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54686': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:30,723 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:30,825 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:30,829 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54694': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:30,830 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54698': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:30,830 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:30,932 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:30,935 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54710': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:30,936 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54714': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:30,936 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:31,039 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:31,042 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54718': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:31,043 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54732': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:31,043 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:31,145 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:31,149 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54738': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:31,149 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54754': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:31,149 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:31,252 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:31,255 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54766': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:31,256 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54770': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:31,256 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:31,358 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:31,362 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54786': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:31,362 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54794': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:31,362 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:31,464 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:31,468 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54798': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:31,469 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:54808': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:31,469 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:31,571 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:31,575 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38622': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:31,576 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38632': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:31,576 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:31,678 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:31,681 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38640': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:31,682 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38646': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:31,682 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:31,784 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:31,788 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38650': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:31,789 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38662': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:31,789 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:31,891 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:31,894 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38666': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:31,895 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38672': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:31,895 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:31,997 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:32,001 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38678': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:32,001 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38686': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:32,001 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:32,104 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:32,107 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38702': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:32,108 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38706': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:32,108 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:32,210 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:32,215 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38710': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:32,216 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38712': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:32,216 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:32,317 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38714': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:32,317 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:32,322 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38720': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:32,322 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:32,424 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:32,428 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38726': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:32,428 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38738': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:32,428 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:32,530 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:32,534 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38748': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:32,535 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38758': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:32,535 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:32,637 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:32,640 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38766': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:32,641 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38782': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:32,641 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:32,743 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:32,747 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38790': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:32,747 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38800': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:32,747 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:32,850 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:32,853 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38814': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:32,854 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38826': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:32,854 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:32,956 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:32,960 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38842': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:32,961 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38856': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:32,961 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:33,063 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:33,067 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38862': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:33,067 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38870': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:33,067 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:33,169 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:33,173 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38876': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:33,174 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38884': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:33,174 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:33,277 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:33,280 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38892': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:33,281 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38904': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:33,281 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:33,384 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:33,387 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38920': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:33,388 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38928': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:33,388 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:33,490 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:33,493 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38944': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:33,494 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38954': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:33,494 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:33,597 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:33,600 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38956': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:33,601 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38964': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:33,601 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:33,703 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:33,707 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38966': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:33,708 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38978': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:33,708 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:33,810 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:33,813 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38980': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:33,814 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38992': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:33,814 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:33,917 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:33,921 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:38998': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:33,921 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39008': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:33,921 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:34,024 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:34,027 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39014': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:34,028 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39018': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:34,028 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:34,130 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:34,134 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39028': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:34,135 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39042': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:34,135 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:34,237 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:34,240 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39046': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:34,241 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39062': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:34,241 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:34,343 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:34,347 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39074': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:34,347 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39082': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:34,348 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:34,450 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:34,453 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39084': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:34,454 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39100': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:34,454 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:34,556 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:34,560 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39106': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:34,560 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39120': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:34,560 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:34,663 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:34,666 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39128': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:34,667 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39144': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:34,667 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:34,769 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:34,773 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39160': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:34,774 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39174': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:34,774 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:34,876 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:34,879 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39176': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:34,880 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39184': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:34,880 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:34,983 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:34,986 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39186': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:34,987 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39202': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:34,987 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:35,089 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:35,093 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39214': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:35,094 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39228': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:35,094 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:35,196 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:35,199 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39232': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:35,200 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39236': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:35,200 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:35,302 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:35,306 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39250': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:35,306 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39256': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:35,306 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:35,409 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:35,412 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39260': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:35,413 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39268': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:35,413 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:35,515 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:35,519 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39272': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:35,519 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39288': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:35,519 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:35,622 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:35,625 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39296': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:35,626 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39300': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:35,626 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:35,728 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:35,734 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39312': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:35,735 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39324': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:35,735 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:35,835 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39326': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:35,835 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:35,841 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39334': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:35,841 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:35,941 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39348': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:35,941 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:35,948 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39354': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:35,948 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:36,047 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39366': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:36,047 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:36,054 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39376': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:36,054 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:36,154 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39382': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:36,154 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:36,161 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39388': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:36,161 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:36,260 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39392': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:36,260 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:36,267 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39406': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:36,267 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:36,367 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:36,367 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39410': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:36,373 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39414': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:36,373 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:36,473 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39420': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:36,473 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:36,479 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39434': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:36,479 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:36,579 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39436': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:36,580 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:36,585 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39448': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:36,585 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:36,687 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:36,687 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39450': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:36,692 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39464': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:36,692 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:36,793 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:36,793 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39474': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:36,798 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39486': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:36,798 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:36,899 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:36,899 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39488': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:36,904 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39498': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:36,904 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:37,006 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39510': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:37,006 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:37,011 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39516': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:37,011 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:37,112 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39528': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:37,112 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:37,117 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39532': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:37,117 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:37,219 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:37,224 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39546': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:37,225 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:37,227 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39560': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:37,325 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39576': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:37,325 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:37,331 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39586': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:37,331 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:37,432 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:37,432 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39596': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:37,439 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:37,440 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39612': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:37,538 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39620': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:37,539 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:37,546 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39636': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:37,546 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:37,646 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:37,646 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39646': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:37,653 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39652': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:37,653 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:37,752 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39662': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:37,752 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:37,759 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39674': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:37,759 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:37,859 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:37,859 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39684': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:37,866 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39696': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:37,866 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:37,965 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39700': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:37,965 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:37,972 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39712': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:37,972 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:38,072 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:38,072 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39714': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:38,078 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:38,078 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:38,179 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39736': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:38,179 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:38,185 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:38,185 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39738': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:38,286 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39754': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:38,286 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:38,292 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39762': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:38,292 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:38,393 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:38,393 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39766': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:38,398 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39772': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:38,398 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:38,499 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39788': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:38,499 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:38,505 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39800': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:38,505 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:38,606 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:38,606 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39804': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:38,611 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39816': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:38,612 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:38,713 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:38,717 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39818': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:38,718 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39828': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:38,718 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:38,820 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:38,823 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39836': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:38,824 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39840': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:38,824 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:38,926 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:38,930 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39856': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:38,930 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39862': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:38,930 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:39,032 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:39,036 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39872': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:39,037 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39876': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:39,037 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:39,139 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:39,142 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39878': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:39,143 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39882': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:39,143 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:39,245 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:39,249 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39890': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:39,249 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39902': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:39,249 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:39,351 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:39,355 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39904': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:39,355 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39906': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:39,355 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:39,458 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:39,461 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39918': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:39,462 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39926': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:39,462 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:39,564 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:39,568 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39932': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:39,568 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39938': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:39,568 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:39,671 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:39,674 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39944': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:39,675 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39946': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:39,675 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:39,777 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:39,781 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39948': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:39,781 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39950': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:39,781 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:39,883 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:39,887 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39954': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:39,887 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39960': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:39,887 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:39,990 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:39,993 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39968': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:39,994 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39974': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:39,994 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:40,097 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:40,100 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:39990': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:40,101 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40002': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:40,101 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:40,203 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:40,207 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40006': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:40,207 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40022': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:40,208 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:40,310 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:40,313 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40024': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:40,314 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40030': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:40,314 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:40,416 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:40,419 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40046': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:40,420 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40050': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:40,420 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:40,522 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:40,526 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:40,526 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40068': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:40,526 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:40,628 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:40,632 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40074': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:40,633 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40078': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:40,633 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:40,734 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:40,738 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40090': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:40,739 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40092': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:40,739 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:40,841 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:40,844 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40096': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:40,845 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40102': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:40,845 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:40,947 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:40,950 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40104': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:40,951 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40118': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:40,951 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:41,053 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:41,057 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40124': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:41,057 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40126': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:41,057 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:41,159 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:41,163 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40130': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:41,164 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40146': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:41,164 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:41,266 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:41,269 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40148': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:41,270 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40154': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:41,270 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:41,372 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:41,375 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40156': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:41,376 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40172': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:41,376 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:41,478 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:41,482 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40186': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:41,482 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:40202': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:41,482 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:41,584 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:41,588 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49060': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:41,588 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49074': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:41,588 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:41,690 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:41,694 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49080': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:41,695 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49094': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:41,695 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:41,798 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:41,801 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49110': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:41,802 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49116': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:41,802 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:41,904 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:41,908 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49128': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:41,908 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49132': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:41,908 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:42,011 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:42,014 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49134': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:42,015 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49142': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:42,015 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:42,117 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:42,121 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49158': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:42,121 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49172': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:42,121 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:42,223 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:42,228 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49178': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:42,229 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:42,231 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49180': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:42,330 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:42,330 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49192': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:42,335 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49194': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:42,335 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:42,436 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:42,436 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49210': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:42,441 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49216': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:42,441 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:42,542 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49226': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:42,542 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:42,547 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49230': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:42,547 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:42,649 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:42,653 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49242': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:42,653 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49246': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:42,653 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:42,755 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:42,759 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49250': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:42,760 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49258': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:42,760 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:42,862 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:42,866 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49266': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:42,867 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49270': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:42,867 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:42,968 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:42,972 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49276': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:42,973 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49286': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:42,973 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:43,075 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:43,078 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49288': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:43,079 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49292': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:43,079 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:43,181 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:43,185 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49296': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:43,185 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49304': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:43,185 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:43,287 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49318': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:43,287 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:43,292 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49330': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:43,292 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:43,394 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49332': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:43,394 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:43,399 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49334': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:43,399 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:43,502 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:43,506 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49348': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:43,506 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49354': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:43,506 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:43,608 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:43,612 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49364': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:43,612 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49380': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:43,612 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:43,715 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:43,718 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49396': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:43,719 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49404': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:43,719 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:43,821 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:43,824 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49412': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:43,825 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49426': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:43,825 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:43,927 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:43,931 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49428': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:43,932 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49430': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:43,932 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:44,034 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:44,037 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49438': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:44,038 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49454': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:44,038 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:44,140 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:44,143 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49470': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:44,144 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49480': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:44,144 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:44,246 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:44,250 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49496': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:44,250 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49510': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:44,250 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:44,352 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:44,356 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49526': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:44,357 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49536': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:44,357 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:44,459 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:44,462 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49552': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:44,463 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49562': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:44,463 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:44,565 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:44,568 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49578': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:44,569 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49594': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:44,569 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:44,671 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:44,675 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49600': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:44,676 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49604': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:44,676 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:44,779 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:44,782 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49616': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:44,782 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49630': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:44,782 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:44,885 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:44,888 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49640': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:44,889 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49646': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:44,889 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:44,991 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:44,995 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49648': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:44,996 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49652': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:44,996 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:45,098 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:45,101 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49658': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:45,102 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49672': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:45,102 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:45,205 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:45,208 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49678': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:45,209 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49694': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:45,209 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:45,311 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:45,315 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49698': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:45,315 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49714': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:45,315 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:45,418 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:45,421 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49720': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:45,422 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49726': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:45,422 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:45,524 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:45,528 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49730': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:45,528 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49744': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:45,528 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:45,630 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:45,633 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49752': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:45,634 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49756': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:45,634 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:45,736 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:45,740 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49772': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:45,741 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49780': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:45,741 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:45,843 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:45,846 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49784': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:45,847 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49798': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:45,847 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:45,949 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:45,953 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49812': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:45,953 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49826': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:45,953 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:46,056 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:46,059 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49838': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:46,060 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49844': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:46,060 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:46,162 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:46,165 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49848': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:46,166 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49854': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:46,166 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:46,268 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:46,272 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49866': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:46,272 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49880': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:46,273 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:46,375 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:46,378 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49888': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:46,379 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49900': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:46,379 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:46,481 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:46,484 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49912': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:46,485 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49928': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:46,485 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:46,587 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:46,591 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49934': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:46,591 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49940': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:46,591 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:46,693 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:46,697 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49948': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:46,698 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49962': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:46,698 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:46,799 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:46,803 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49964': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:46,804 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49968': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:46,804 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:46,907 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:46,910 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49974': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:46,911 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49990': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:46,911 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:47,013 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:47,016 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:49998': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:47,017 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50006': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:47,017 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:47,119 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:47,123 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50010': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:47,123 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50022': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:47,123 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:47,225 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:47,232 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50030': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:47,233 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50044': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:47,233 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:47,332 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:47,332 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:47,339 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50072': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:47,339 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:47,438 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50076': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:47,438 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:47,446 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50082': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:47,446 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:47,544 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:47,544 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50098': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:47,552 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50114': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:47,552 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:47,651 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50126': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:47,651 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:47,658 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50130': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:47,658 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:47,757 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50138': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:47,757 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:47,764 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50146': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:47,764 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:47,863 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50160': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:47,863 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:47,870 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50166': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:47,870 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:47,969 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50168': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:47,969 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:47,977 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50180': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:47,977 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:48,075 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50196': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:48,076 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:48,084 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50200': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:48,084 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:48,182 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50212': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:48,182 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:48,190 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50216': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:48,190 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:48,289 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50220': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:48,289 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:48,296 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50230': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:48,296 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:48,395 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50244': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:48,395 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:48,403 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50258': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:48,403 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:48,502 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50260': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:48,502 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:48,509 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50266': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:48,509 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:48,609 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50274': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:48,609 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:48,615 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50290': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:48,615 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:48,715 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50292': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:48,715 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:48,721 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50304': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:48,721 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:48,821 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50314': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:48,821 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:48,827 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50320': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:48,827 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:48,928 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50330': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:48,928 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:48,933 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50334': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:48,933 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:49,034 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:49,035 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50342': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:49,040 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50350': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:49,040 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:49,141 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:49,141 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50362': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:49,146 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50378': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:49,146 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:49,248 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50388': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:49,248 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:49,253 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50390': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:49,253 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:49,354 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:49,358 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50392': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:49,359 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50400': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:49,359 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:49,461 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:49,464 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50414': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:49,465 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50428': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:49,465 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:49,567 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:49,571 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50430': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:49,572 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50444': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:49,572 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:49,674 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:49,677 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50450': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:49,678 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50466': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:49,678 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:49,780 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:49,783 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50478': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:49,784 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50482': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:49,784 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:49,886 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:49,890 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50498': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:49,890 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50514': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:49,890 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:49,993 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:49,996 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50518': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:49,997 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50524': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:49,997 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:50,100 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:50,103 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50540': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:50,104 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50556': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:50,104 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:50,206 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:50,210 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50562': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:50,211 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50576': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:50,211 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:50,314 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:50,318 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50586': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:50,318 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50590': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:50,318 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:50,420 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:50,424 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50592': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:50,425 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50594': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:50,425 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:50,527 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:50,530 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50604': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:50,531 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50620': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:50,531 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:50,633 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:50,637 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50632': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:50,637 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50644': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:50,637 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:50,739 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:50,743 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50648': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:50,744 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50658': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:50,744 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:50,846 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:50,849 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50666': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:50,850 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50676': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:50,850 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:50,952 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:50,956 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50682': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:50,956 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50688': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:50,956 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:51,059 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:51,062 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50694': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:51,063 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50708': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:51,063 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:51,165 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:51,168 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:51,169 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50732': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:51,169 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:51,271 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:51,275 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50748': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:51,275 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50750': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:51,275 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:51,378 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:51,381 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50764': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:51,382 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50776': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:51,382 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:51,484 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:51,487 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50788': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:51,488 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:50792': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:51,488 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:51,590 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:51,594 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34490': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:51,594 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34502': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:51,595 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:51,697 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:51,700 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34512': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:51,701 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34516': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:51,701 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:51,803 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:51,806 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34522': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:51,807 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34536': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:51,807 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:51,909 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:51,913 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34546': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:51,914 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34558': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:51,914 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:52,017 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:52,020 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34570': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:52,021 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34582': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:52,021 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:52,123 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:52,127 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34592': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:52,127 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34594': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:52,128 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:52,233 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:52,237 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34610': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:52,237 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34612': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:52,237 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:52,339 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:52,343 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34622': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:52,344 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34630': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:52,344 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:52,446 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:52,449 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34634': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:52,450 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34646': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:52,450 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:52,552 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:52,556 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34660': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:52,556 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34676': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:52,556 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:52,658 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:52,662 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34690': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:52,662 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34698': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:52,662 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:52,765 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:52,768 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34712': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:52,769 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34728': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:52,769 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:52,871 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34740': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:52,871 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:52,922 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34746': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:52,922 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:52,978 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34754': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:52,978 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:53,028 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34762': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:53,028 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:53,133 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:53,136 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34776': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:53,137 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34778': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:53,137 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:53,239 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:53,243 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34790': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:53,243 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34800': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:53,243 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:53,346 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:53,349 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34804': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:53,350 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34814': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:53,350 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:53,452 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:53,456 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34818': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:53,457 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34824': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:53,457 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:53,559 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:53,562 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34836': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:53,563 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34844': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:53,563 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:53,665 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:53,669 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34856': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:53,670 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34866': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:53,670 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:53,772 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:53,776 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34878': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:53,777 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34890': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:53,777 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:53,878 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:53,882 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34896': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:53,883 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34906': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:53,883 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:53,985 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:53,988 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34910': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:53,989 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34926': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:53,989 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:54,091 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:54,095 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34942': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:54,095 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34948': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:54,095 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:54,198 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:54,201 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34958': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:54,202 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34962': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:54,202 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:54,304 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:54,307 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34970': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:54,308 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34978': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:54,308 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:54,410 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:54,414 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34988': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:54,415 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34996': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:54,415 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:54,517 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:54,520 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34998': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:54,521 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:35012': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:54,521 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:54,623 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:54,627 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:35018': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:54,627 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:35026': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:54,627 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:54,732 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:54,735 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:35034': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:54,736 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:35040': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:54,736 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:54,838 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:54,842 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:35056': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:54,842 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:35058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:54,842 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:54,944 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:54,948 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:35074': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:54,949 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:35084': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:54,949 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:55,051 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:55,054 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:35094': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:55,055 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:35106': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:55,055 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:55,157 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:55,161 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:35114': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:55,161 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:35124': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:55,161 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:55,263 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:55,267 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:35136': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:55,268 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:35144': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:55,268 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:55,370 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:55,374 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:35152': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:55,374 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:35154': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:55,374 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:55,477 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:55,481 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:35166': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:55,482 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:55,482 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:35168': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:55,584 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:55,588 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:35170': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:55,588 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:35176': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:55,588 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:55,690 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:55,694 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:35180': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:55,695 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:35196': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:55,695 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:55,797 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:55,801 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:35204': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:55,801 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:35208': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:55,801 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:55,903 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:55,907 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:35222': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:55,908 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:35224': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:55,908 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:56,010 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:56,013 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:35226': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:56,014 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:35228': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:56,014 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:56,116 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:56,120 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:35244': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:56,121 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:35254': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:56,121 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:56,223 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:56,226 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:35268': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:56,227 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:56,229 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:35282': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:56,329 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:56,333 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:35288': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:56,333 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:35298': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:56,334 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:56,435 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:56,439 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:35314': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:56,440 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:35318': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:56,440 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:56,542 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:56,545 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:35320': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:56,546 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:35324': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:56,546 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:56,649 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:56,652 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:35336': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:56,653 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:35338': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:56,653 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:56,755 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:56,759 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:35354': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:56,759 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:35366': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:56,759 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:56,861 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:56,865 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:35374': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:56,865 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:35388': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:56,866 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:56,968 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:56,971 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:35396': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:56,972 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:35408': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:56,972 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:57,074 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:57,077 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:35416': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:57,078 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:35420': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:57,078 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:57,181 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:57,185 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:35430': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:57,185 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:35432': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:57,185 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:57,288 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:57,291 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:35446': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:57,292 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:35462': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:57,292 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:57,394 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:57,398 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:35472': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:57,398 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:35484': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:57,398 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:57,500 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:57,504 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:35488': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:57,504 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:35498': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:57,504 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:57,607 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:57,610 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:35508': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:57,611 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:35522': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:57,611 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:57,713 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:57,717 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:35528': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:57,717 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:35530': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:57,717 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:57,820 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:57,823 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:35532': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:57,824 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:35536': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:57,824 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:57,927 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:57,930 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:35538': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:57,930 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:35544': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:57,930 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:58,036 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:58,038 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:35560': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:58,039 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:35566': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:58,039 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:58,144 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:58,147 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:35568': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:58,148 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:35580': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:58,148 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:58,253 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:58,256 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:35594': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:58,256 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:35598': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:58,256 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:58,361 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:58,364 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:35610': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:58,365 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:35612': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:58,365 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:58,470 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:58,473 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:35614': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:58,474 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:58,474 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:35628': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:58,579 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:58,582 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:35634': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:58,582 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:35650': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:58,582 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:58,687 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:58,690 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:35664': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:58,691 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:35672': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:58,691 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:58,796 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:58,799 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:35676': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:58,799 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:35692': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:58,799 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:58,905 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:58,908 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:35704': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:58,909 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:35706': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:58,909 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:59,014 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:59,017 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:35714': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:59,018 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:35722': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:59,018 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:59,122 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:59,125 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:35736': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:59,126 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:35746': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:59,126 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:59,232 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:59,235 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:35752': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:59,236 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:35756': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:59,236 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:59,338 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:59,342 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:35758': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:59,343 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:35760': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:59,343 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:59,445 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:59,449 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:35776': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:59,449 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:35792': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:59,449 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:59,551 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:59,555 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:35794': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:59,556 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:35802': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:59,556 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:59,658 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:59,662 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:35808': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:59,663 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:35810': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:59,663 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:59,765 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:59,768 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:35822': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:59,769 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:35834': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:59,769 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:59,871 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:59,875 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:35838': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:59,876 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:35846': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:59,876 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:59,978 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:56:59,981 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:35850': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:59,982 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:35854': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:56:59,982 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:00,085 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:00,088 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:35858': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:00,089 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:35868': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:00,089 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:00,191 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:00,195 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:35870': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:00,195 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:35876': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:00,195 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:00,297 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:00,301 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:35882': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:00,302 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:35890': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:00,302 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:00,404 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:00,407 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:35902': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:00,408 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:35916': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:00,408 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:00,510 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:00,513 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:35922': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:00,514 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:35924': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:00,514 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:00,617 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:00,621 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:35934': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:00,622 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:35948': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:00,623 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:00,724 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:00,724 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:35962': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:00,729 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:00,732 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:35968': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:00,830 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:35984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:00,831 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:00,835 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:35992': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:00,835 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:00,938 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:00,941 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:36006': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:00,942 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:36010': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:00,942 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:01,044 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:01,047 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:36024': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:01,048 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:36036': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:01,048 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:01,150 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:01,154 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:36038': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:01,155 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:36050': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:01,155 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:01,257 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:01,260 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:36064': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:01,261 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:36070': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:01,261 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:01,363 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:01,367 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:36074': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:01,368 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:36082': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:01,368 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:01,470 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:01,474 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:36092': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:01,475 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:36102': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:01,475 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:01,576 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:01,580 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51218': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:01,581 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51220': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:01,581 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:01,683 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51236': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:01,683 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:01,688 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51240': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:01,688 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:01,789 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:01,793 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51252': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:01,794 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51266': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:01,794 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:01,896 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:01,900 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51272': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:01,900 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51288': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:01,900 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:02,002 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:02,006 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51302': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:02,007 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51308': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:02,007 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:02,109 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:02,112 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51322': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:02,113 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51326': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:02,113 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:02,215 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:02,259 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51340': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:02,259 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:02,262 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51356': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:02,322 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51364': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:02,322 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:02,366 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51366': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:02,366 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:02,429 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51370': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:02,429 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:02,472 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51386': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:02,472 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:02,536 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51398': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:02,536 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:02,579 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51406': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:02,579 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:02,642 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51408': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:02,642 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:02,685 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51410': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:02,685 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:02,749 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51424': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:02,749 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:02,792 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51436': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:02,792 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:02,855 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51438': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:02,855 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:02,898 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51454': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:02,898 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:02,962 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51460': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:02,962 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:03,005 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51470': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:03,005 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:03,068 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51484': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:03,068 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:03,111 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51488': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:03,111 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:03,175 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51500': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:03,175 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:03,218 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51510': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:03,218 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:03,282 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51516': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:03,282 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:03,325 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51522': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:03,325 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:03,388 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51530': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:03,388 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:03,431 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51534': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:03,431 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:03,495 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51542': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:03,495 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:03,538 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51552': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:03,538 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:03,601 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51562': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:03,601 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:03,644 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51572': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:03,644 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:03,708 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51580': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:03,708 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:03,751 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51592': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:03,751 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:03,815 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51608': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:03,815 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:03,857 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51622': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:03,857 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:03,922 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51630': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:03,922 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:03,964 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51640': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:03,964 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:04,029 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51652': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:04,029 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:04,070 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51660': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:04,070 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:04,136 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51670': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:04,136 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:04,176 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51672': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:04,176 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:04,242 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51684': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:04,242 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:04,283 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51690': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:04,283 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:04,349 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51706': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:04,349 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:04,389 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51714': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:04,389 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:04,456 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51716': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:04,456 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:04,495 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51732': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:04,495 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:04,562 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51746': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:04,562 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:04,602 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51760': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:04,602 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:04,669 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51762': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:04,669 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:04,708 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51776': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:04,708 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:04,775 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51782': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:04,775 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:04,815 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51788': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:04,815 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:04,882 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51804': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:04,882 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:04,921 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51806': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:04,921 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:04,989 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51818': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:04,989 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:05,028 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51822': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:05,029 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:05,096 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51832': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:05,096 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:05,135 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51834': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:05,135 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:05,202 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51840': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:05,203 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:05,241 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51850': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:05,241 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:05,310 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51854': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:05,310 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:05,348 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51858': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:05,348 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:05,416 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51870': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:05,416 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:05,454 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51880': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:05,454 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:05,523 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51888': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:05,523 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:05,560 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51904': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:05,560 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:05,630 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51906': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:05,630 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:05,667 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51910': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:05,667 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:05,737 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51916': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:05,737 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:05,773 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51924': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:05,773 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:05,843 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51930': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:05,844 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:05,879 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51932': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:05,879 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:05,950 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51944': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:05,950 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:05,985 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51948': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:05,985 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:06,057 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51950': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:06,057 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:06,092 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51958': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:06,092 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:06,163 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51968': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:06,164 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:06,198 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:06,198 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:06,270 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:51998': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:06,270 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:06,304 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52012': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:06,304 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:06,377 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:06,377 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52020': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:06,410 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52024': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:06,410 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:06,483 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52036': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:06,483 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:06,517 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52052': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:06,517 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:06,590 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52056': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:06,590 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:06,623 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52060': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:06,623 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:06,697 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52064': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:06,697 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:06,732 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52074': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:06,732 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:06,804 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52090': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:06,804 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:06,838 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52106': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:06,838 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:06,911 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52116': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:06,911 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:06,944 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52132': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:06,944 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:07,017 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52148': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:07,017 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:07,051 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52154': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:07,051 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:07,124 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52168': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:07,124 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:07,157 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52176': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:07,157 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:07,233 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52188': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:07,233 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:07,263 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52204': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:07,263 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:07,340 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52208': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:07,340 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:07,369 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52224': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:07,369 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:07,447 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52240': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:07,447 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:07,476 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52244': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:07,476 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:07,554 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52248': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:07,554 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:07,582 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52258': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:07,582 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:07,661 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52262': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:07,661 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:07,688 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52276': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:07,689 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:07,767 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52278': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:07,767 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:07,797 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52282': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:07,797 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:07,874 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52290': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:07,874 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:07,903 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52300': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:07,903 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:07,981 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52314': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:07,981 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:08,010 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52322': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:08,010 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:08,088 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52326': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:08,088 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:08,117 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52340': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:08,117 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:08,194 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:08,194 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52356': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:08,223 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52360': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:08,223 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:08,301 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52366': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:08,301 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:08,329 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52374': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:08,329 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:08,407 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52390': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:08,407 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:08,436 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52396': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:08,436 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:08,514 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52404': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:08,514 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:08,542 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52406': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:08,542 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:08,620 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52410': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:08,620 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:08,648 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52426': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:08,648 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:08,727 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:08,729 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52428': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:08,755 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52438': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:08,755 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:08,834 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52442': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:08,834 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:08,861 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52452': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:08,861 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:08,940 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52464': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:08,940 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:08,967 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52472': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:08,967 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:09,047 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52484': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:09,047 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:09,073 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52500': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:09,074 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:09,154 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52508': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:09,154 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:09,180 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52512': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:09,180 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:09,261 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52520': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:09,261 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:09,286 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52530': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:09,286 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:09,367 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52532': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:09,368 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:09,392 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52546': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:09,392 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:09,474 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52554': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:09,474 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:09,499 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52558': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:09,499 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:09,581 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52572': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:09,581 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:09,606 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52586': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:09,606 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:09,688 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52598': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:09,688 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:09,712 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52610': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:09,712 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:09,795 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52626': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:09,795 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:09,819 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52638': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:09,819 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:09,901 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52652': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:09,901 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:09,926 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52660': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:09,926 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:10,008 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52676': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:10,008 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:10,032 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52688': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:10,032 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:10,114 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52702': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:10,114 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:10,139 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52706': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:10,139 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:10,221 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52720': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:10,221 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:10,245 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:10,245 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:10,328 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52740': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:10,328 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:10,352 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52742': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:10,352 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:10,434 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52752': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:10,434 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:10,458 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52768': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:10,458 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:10,541 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52770': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:10,541 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:10,565 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:10,565 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52776': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:10,647 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52778': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:10,647 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:10,672 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52782': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:10,672 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:10,753 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52798': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:10,754 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:10,778 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52808': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:10,778 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:10,861 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52812': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:10,861 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:10,885 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52824': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:10,885 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:10,968 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52840': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:10,968 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:10,991 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52846': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:10,991 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:11,074 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52858': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:11,074 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:11,098 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52862': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:11,098 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:11,181 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52864': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:11,181 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:11,204 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:11,204 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52870': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:11,288 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52886': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:11,288 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:11,311 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52896': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:11,311 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:11,394 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52910': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:11,394 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:11,417 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52916': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:11,417 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:11,501 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52932': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:11,501 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:11,524 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:52942': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:11,524 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:11,608 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33336': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:11,608 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:11,630 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33346': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:11,630 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:11,714 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33358': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:11,714 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:11,736 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33362': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:11,737 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:11,821 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33366': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:11,821 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:11,843 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33380': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:11,843 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:11,927 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33386': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:11,927 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:11,949 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33392': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:11,949 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:12,034 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33396': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:12,034 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:12,056 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33398': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:12,056 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:12,142 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33414': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:12,143 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:12,162 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33426': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:12,162 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:12,249 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33430': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:12,249 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:12,268 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33444': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:12,268 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:12,356 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33452': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:12,356 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:12,375 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33460': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:12,375 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:12,462 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33476': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:12,462 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:12,481 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33480': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:12,481 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:12,570 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33490': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:12,570 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:12,588 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33492': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:12,588 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:12,676 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33508': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:12,676 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:12,694 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33514': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:12,694 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:12,783 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33520': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:12,783 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:12,800 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33534': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:12,800 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:12,889 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33540': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:12,889 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:12,907 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33556': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:12,907 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:12,996 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33558': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:12,996 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:13,013 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33560': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:13,013 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:13,102 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33572': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:13,103 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:13,120 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33580': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:13,120 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:13,209 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33590': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:13,209 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:13,226 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:13,228 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33594': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:13,316 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33608': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:13,316 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:13,333 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33620': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:13,333 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:13,423 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33630': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:13,423 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:13,439 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33646': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:13,439 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:13,529 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33650': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:13,529 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:13,546 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33658': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:13,546 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:13,636 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33660': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:13,636 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:13,652 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33672': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:13,652 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:13,742 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33676': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:13,742 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:13,758 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33680': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:13,758 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:13,849 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33688': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:13,849 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:13,866 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33694': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:13,866 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:13,955 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33702': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:13,955 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:13,972 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33714': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:13,972 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:14,063 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33718': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:14,063 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:14,079 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33720': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:14,079 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:14,170 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:14,170 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:14,185 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33738': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:14,185 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:14,277 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33746': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:14,277 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:14,292 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33748': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:14,292 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:14,383 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33764': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:14,383 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:14,398 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33776': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:14,398 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:14,490 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33784': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:14,490 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:14,504 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33792': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:14,504 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:14,596 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:14,596 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33798': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:14,611 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33810': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:14,611 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:14,703 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33814': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:14,703 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:14,717 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33822': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:14,717 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:14,810 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33828': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:14,810 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:14,824 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33834': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:14,824 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:14,916 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33836': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:14,916 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:14,930 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33840': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:14,930 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:15,023 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33842': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:15,023 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:15,037 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33854': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:15,037 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:15,129 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33866': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:15,129 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:15,143 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33870': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:15,143 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:15,236 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33876': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:15,236 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:15,250 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:15,250 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33884': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:15,342 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33898': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:15,342 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:15,356 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33912': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:15,356 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:15,449 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33914': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:15,449 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:15,463 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33928': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:15,463 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:15,555 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33942': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:15,555 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:15,569 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33952': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:15,569 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:15,661 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33962': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:15,662 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:15,676 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33970': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:15,676 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:15,768 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33978': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:15,768 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:15,782 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:33994': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:15,782 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:15,875 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34004': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:15,875 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:15,888 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34010': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:15,888 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:15,982 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34018': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:15,982 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:15,995 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:15,995 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34034': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:16,089 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34036': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:16,089 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:16,102 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34050': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:16,102 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:16,195 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34066': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:16,195 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:16,208 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34076': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:16,208 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:16,302 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34084': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:16,302 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:16,315 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34092': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:16,315 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:16,409 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34108': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:16,409 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:16,421 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34120': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:16,421 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:16,516 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34124': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:16,516 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:16,528 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34128': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:16,528 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:16,622 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34132': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:16,622 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:16,634 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34140': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:16,634 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:16,729 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:16,731 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34142': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:16,740 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34146': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:16,740 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:16,835 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34152': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:16,835 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:16,847 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34160': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:16,847 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:16,942 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34176': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:16,942 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:16,953 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34188': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:16,953 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:17,048 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34190': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:17,048 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:17,060 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34202': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:17,060 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:17,155 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34204': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:17,155 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:17,166 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34210': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:17,166 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:17,261 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34218': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:17,261 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:17,272 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34226': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:17,272 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:17,368 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34232': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:17,368 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:17,379 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34234': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:17,379 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:17,474 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34248': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:17,474 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:17,485 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34250': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:17,485 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:17,581 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34254': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:17,581 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:17,591 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34268': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:17,591 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:17,688 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34270': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:17,688 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:17,698 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34278': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:17,698 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:17,795 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34294': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:17,795 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:17,804 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34302': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:17,804 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:17,901 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34318': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:17,901 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:17,911 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34322': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:17,911 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:18,008 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34328': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:18,008 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:18,017 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34340': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:18,017 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:18,114 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34356': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:18,114 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:18,124 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34372': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:18,124 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:18,221 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34382': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:18,221 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:18,233 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34392': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:18,233 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:18,327 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34396': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:18,327 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s 2024-11-23 22:57:18,339 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36853': TLS handshake failed with remote 'tls://127.0.0.1:34410': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:57:18,339 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36853 8450s =================================== FAILURES =================================== 8450s ______________________________ test_preload_file _______________________________ 8450s 8450s self = 8450s deserializers = None 8450s 8450s async def read(self, deserializers=None): 8450s stream = self.stream 8450s if stream is None: 8450s raise CommClosedError() 8450s 8450s fmt = "Q" 8450s fmt_size = struct.calcsize(fmt) 8450s 8450s try: 8450s # Don't store multiple numpy or parquet buffers into the same buffer, or 8450s # none will be released until all are released. 8450s > frames_nosplit_nbytes_bin = await stream.read_bytes(fmt_size) 8450s E tornado.iostream.StreamClosedError: Stream is closed 8450s 8450s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:225: StreamClosedError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s loop = 8450s tmp_path = PosixPath('/tmp/pytest-of-ubuntu/pytest-4/test_preload_file0') 8450s 8450s def test_preload_file(loop, tmp_path): 8450s def check_scheduler(): 8450s import scheduler_info 8450s 8450s return scheduler_info.get_scheduler_address() 8450s 8450s path = tmp_path / "scheduler_info.py" 8450s with open(path, "w") as f: 8450s f.write(PRELOAD_TEXT) 8450s with tmpfile() as fn: 8450s with popen( 8450s [ 8450s "dask", 8450s "scheduler", 8450s "--scheduler-file", 8450s fn, 8450s "--preload", 8450s path, 8450s f"--port={open_port()}", 8450s ] 8450s ): 8450s with Client(scheduler_file=fn, loop=loop) as c: 8450s > assert c.run_on_scheduler(check_scheduler) == c.scheduler.address 8450s 8450s /usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py:342: 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s /usr/lib/python3/dist-packages/distributed/client.py:2858: in run_on_scheduler 8450s return self.sync(self._run_on_scheduler, function, *args, **kwargs) 8450s /usr/lib/python3/dist-packages/distributed/utils.py:362: in sync 8450s return sync( 8450s /usr/lib/python3/dist-packages/distributed/utils.py:438: in sync 8450s raise error 8450s /usr/lib/python3/dist-packages/distributed/utils.py:412: in f 8450s result = yield future 8450s /usr/lib/python3/dist-packages/tornado/gen.py:766: in run 8450s value = future.result() 8450s /usr/lib/python3/dist-packages/distributed/client.py:2809: in _run_on_scheduler 8450s response = await self.scheduler.run_function( 8450s /usr/lib/python3/dist-packages/distributed/core.py:1395: in send_recv_from_rpc 8450s return await send_recv(comm=comm, op=key, **kwargs) 8450s /usr/lib/python3/dist-packages/distributed/core.py:1154: in send_recv 8450s response = await comm.read(deserializers=deserializers) 8450s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:236: in read 8450s convert_stream_closed_error(self, e) 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s 8450s obj = 8450s exc = StreamClosedError('Stream is closed') 8450s 8450s def convert_stream_closed_error(obj, exc): 8450s """ 8450s Re-raise StreamClosedError as CommClosedError. 8450s """ 8450s if exc.real_error is not None: 8450s # The stream was closed because of an underlying OS error 8450s exc = exc.real_error 8450s if isinstance(exc, ssl.SSLError): 8450s if exc.reason and "UNKNOWN_CA" in exc.reason: 8450s raise FatalCommClosedError(f"in {obj}: {exc.__class__.__name__}: {exc}") 8450s raise CommClosedError(f"in {obj}: {exc.__class__.__name__}: {exc}") from exc 8450s else: 8450s > raise CommClosedError(f"in {obj}: {exc}") from exc 8450s E distributed.comm.core.CommClosedError: in : Stream is closed 8450s 8450s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:142: CommClosedError 8450s ----------------------------- Captured stderr call ----------------------------- 8450s 2024-11-23 22:37:03,284 - distributed.utils - INFO - Reload module scheduler_info from .py file 8450s 2024-11-23 22:37:03,285 - distributed.preloading - INFO - Import preload module: /tmp/pytest-of-ubuntu/pytest-4/test_preload_file0/scheduler_info.py 8450s 2024-11-23 22:37:03,286 - distributed.scheduler - INFO - ----------------------------------------------- 8450s 2024-11-23 22:37:03,288 - distributed.preloading - INFO - Creating preload: /tmp/pytest-of-ubuntu/pytest-4/test_preload_file0/scheduler_info.py 8450s 2024-11-23 22:37:03,288 - distributed.utils - INFO - Reload module scheduler_info from .py file 8450s 2024-11-23 22:37:03,289 - distributed.preloading - INFO - Import preload module: /tmp/pytest-of-ubuntu/pytest-4/test_preload_file0/scheduler_info.py 8450s 2024-11-23 22:37:03,312 - distributed.http.proxy - INFO - To route to workers diagnostics web server please install jupyter-server-proxy: python -m pip install jupyter-server-proxy 8450s 2024-11-23 22:37:03,316 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:37:03,317 - distributed.diskutils - INFO - Found stale lock file and directory '/tmp/dask-scratch-space/scheduler-af0eyats', purging 8450s 2024-11-23 22:37:03,318 - distributed.diskutils - INFO - Found stale lock file and directory '/tmp/dask-scratch-space/worker-0hgap_hi', purging 8450s 2024-11-23 22:37:03,318 - distributed.diskutils - INFO - Found stale lock file and directory '/tmp/dask-scratch-space/worker-m4ngi458', purging 8450s 2024-11-23 22:37:03,325 - distributed.scheduler - INFO - ----------------------------------------------- 8450s 2024-11-23 22:37:03,326 - distributed.scheduler - INFO - Scheduler at: tcp://10.0.4.73:56345 8450s 2024-11-23 22:37:03,326 - distributed.scheduler - INFO - dashboard at: http://10.0.4.73:8787/status 8450s 2024-11-23 22:37:03,327 - distributed.preloading - INFO - Run preload setup: /tmp/pytest-of-ubuntu/pytest-4/test_preload_file0/scheduler_info.py 8450s 2024-11-23 22:37:03,327 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:37:03,341 - distributed.scheduler - INFO - Receive client connection: Client-758cb67d-a9eb-11ef-bf02-00163e4db70f 8450s 2024-11-23 22:37:03,657 - distributed.core - INFO - Starting established connection to tcp://10.0.4.73:40026 8450s 2024-11-23 22:37:03,662 - distributed.worker - INFO - Run out-of-band function 'check_scheduler' 8450s 2024-11-23 22:37:04,189 - distributed.client - ERROR - 8450s ConnectionRefusedError: [Errno 111] Connection refused 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 559, in connect 8450s convert_stream_closed_error(self, e) 8450s ~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 140, in convert_stream_closed_error 8450s raise CommClosedError(f"in {obj}: {exc.__class__.__name__}: {exc}") from exc 8450s distributed.comm.core.CommClosedError: in : ConnectionRefusedError: [Errno 111] Connection refused 8450s 8450s During handling of the above exception, another exception occurred: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 836, in wrapper 8450s return await func(*args, **kwargs) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/client.py", line 1331, in _reconnect 8450s await self._ensure_connected(timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/client.py", line 1361, in _ensure_connected 8450s comm = await connect( 8450s ^^^^^^^^^^^^^^ 8450s self.scheduler.address, timeout=timeout, **self.connection_args 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 366, in connect 8450s await asyncio.sleep(backoff) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 718, in sleep 8450s return await future 8450s ^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s _____________________________ test_preload_module ______________________________ 8450s 8450s self = 8450s deserializers = None 8450s 8450s async def read(self, deserializers=None): 8450s stream = self.stream 8450s if stream is None: 8450s raise CommClosedError() 8450s 8450s fmt = "Q" 8450s fmt_size = struct.calcsize(fmt) 8450s 8450s try: 8450s # Don't store multiple numpy or parquet buffers into the same buffer, or 8450s # none will be released until all are released. 8450s > frames_nosplit_nbytes_bin = await stream.read_bytes(fmt_size) 8450s E tornado.iostream.StreamClosedError: Stream is closed 8450s 8450s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:225: StreamClosedError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s loop = 8450s tmp_path = PosixPath('/tmp/pytest-of-ubuntu/pytest-4/test_preload_module0') 8450s 8450s def test_preload_module(loop, tmp_path): 8450s def check_scheduler(): 8450s import scheduler_info 8450s 8450s return scheduler_info.get_scheduler_address() 8450s 8450s path = tmp_path / "scheduler_info.py" 8450s with open(path, "w") as f: 8450s f.write(PRELOAD_TEXT) 8450s env = os.environ.copy() 8450s if "PYTHONPATH" in env: 8450s env["PYTHONPATH"] = str(tmp_path) + ":" + env["PYTHONPATH"] 8450s else: 8450s env["PYTHONPATH"] = str(tmp_path) 8450s with tmpfile() as fn: 8450s with popen( 8450s [ 8450s "dask", 8450s "scheduler", 8450s "--scheduler-file", 8450s fn, 8450s "--preload", 8450s "scheduler_info", 8450s f"--port={open_port()}", 8450s ], 8450s env=env, 8450s ): 8450s with Client(scheduler_file=fn, loop=loop) as c: 8450s > assert c.run_on_scheduler(check_scheduler) == c.scheduler.address 8450s 8450s /usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py:373: 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s /usr/lib/python3/dist-packages/distributed/client.py:2858: in run_on_scheduler 8450s return self.sync(self._run_on_scheduler, function, *args, **kwargs) 8450s /usr/lib/python3/dist-packages/distributed/utils.py:362: in sync 8450s return sync( 8450s /usr/lib/python3/dist-packages/distributed/utils.py:438: in sync 8450s raise error 8450s /usr/lib/python3/dist-packages/distributed/utils.py:412: in f 8450s result = yield future 8450s /usr/lib/python3/dist-packages/tornado/gen.py:766: in run 8450s value = future.result() 8450s /usr/lib/python3/dist-packages/distributed/client.py:2809: in _run_on_scheduler 8450s response = await self.scheduler.run_function( 8450s /usr/lib/python3/dist-packages/distributed/core.py:1395: in send_recv_from_rpc 8450s return await send_recv(comm=comm, op=key, **kwargs) 8450s /usr/lib/python3/dist-packages/distributed/core.py:1154: in send_recv 8450s response = await comm.read(deserializers=deserializers) 8450s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:236: in read 8450s convert_stream_closed_error(self, e) 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s 8450s obj = 8450s exc = StreamClosedError('Stream is closed') 8450s 8450s def convert_stream_closed_error(obj, exc): 8450s """ 8450s Re-raise StreamClosedError as CommClosedError. 8450s """ 8450s if exc.real_error is not None: 8450s # The stream was closed because of an underlying OS error 8450s exc = exc.real_error 8450s if isinstance(exc, ssl.SSLError): 8450s if exc.reason and "UNKNOWN_CA" in exc.reason: 8450s raise FatalCommClosedError(f"in {obj}: {exc.__class__.__name__}: {exc}") 8450s raise CommClosedError(f"in {obj}: {exc.__class__.__name__}: {exc}") from exc 8450s else: 8450s > raise CommClosedError(f"in {obj}: {exc}") from exc 8450s E distributed.comm.core.CommClosedError: in : Stream is closed 8450s 8450s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:142: CommClosedError 8450s ----------------------------- Captured stderr call ----------------------------- 8450s 2024-11-23 22:37:05,101 - distributed.preloading - INFO - Import preload module: scheduler_info 8450s 2024-11-23 22:37:05,102 - distributed.scheduler - INFO - ----------------------------------------------- 8450s 2024-11-23 22:37:05,104 - distributed.preloading - INFO - Creating preload: scheduler_info 8450s 2024-11-23 22:37:05,104 - distributed.preloading - INFO - Import preload module: scheduler_info 8450s 2024-11-23 22:37:05,123 - distributed.http.proxy - INFO - To route to workers diagnostics web server please install jupyter-server-proxy: python -m pip install jupyter-server-proxy 8450s 2024-11-23 22:37:05,127 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:37:05,128 - distributed.diskutils - INFO - Found stale lock file and directory '/tmp/dask-scratch-space/scheduler-39ibevyp', purging 8450s 2024-11-23 22:37:05,135 - distributed.scheduler - INFO - ----------------------------------------------- 8450s 2024-11-23 22:37:05,136 - distributed.scheduler - INFO - Scheduler at: tcp://10.0.4.73:56313 8450s 2024-11-23 22:37:05,136 - distributed.scheduler - INFO - dashboard at: http://10.0.4.73:8787/status 8450s 2024-11-23 22:37:05,136 - distributed.preloading - INFO - Run preload setup: scheduler_info 8450s 2024-11-23 22:37:05,137 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:37:05,152 - distributed.scheduler - INFO - Receive client connection: Client-76acf66d-a9eb-11ef-bf02-00163e4db70f 8450s 2024-11-23 22:37:05,453 - distributed.core - INFO - Starting established connection to tcp://10.0.4.73:46736 8450s 2024-11-23 22:37:05,457 - distributed.worker - INFO - Run out-of-band function 'check_scheduler' 8450s 2024-11-23 22:37:05,975 - distributed.client - ERROR - 8450s ConnectionRefusedError: [Errno 111] Connection refused 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 559, in connect 8450s convert_stream_closed_error(self, e) 8450s ~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 140, in convert_stream_closed_error 8450s raise CommClosedError(f"in {obj}: {exc.__class__.__name__}: {exc}") from exc 8450s distributed.comm.core.CommClosedError: in : ConnectionRefusedError: [Errno 111] Connection refused 8450s 8450s During handling of the above exception, another exception occurred: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 836, in wrapper 8450s return await func(*args, **kwargs) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/client.py", line 1331, in _reconnect 8450s await self._ensure_connected(timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/client.py", line 1361, in _ensure_connected 8450s comm = await connect( 8450s ^^^^^^^^^^^^^^ 8450s self.scheduler.address, timeout=timeout, **self.connection_args 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 366, in connect 8450s await asyncio.sleep(backoff) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 718, in sleep 8450s return await future 8450s ^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s __________________________ test_preload_remote_module __________________________ 8450s 8450s self = 8450s deserializers = None 8450s 8450s async def read(self, deserializers=None): 8450s stream = self.stream 8450s if stream is None: 8450s raise CommClosedError() 8450s 8450s fmt = "Q" 8450s fmt_size = struct.calcsize(fmt) 8450s 8450s try: 8450s # Don't store multiple numpy or parquet buffers into the same buffer, or 8450s # none will be released until all are released. 8450s > frames_nosplit_nbytes_bin = await stream.read_bytes(fmt_size) 8450s E tornado.iostream.StreamClosedError: Stream is closed 8450s 8450s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:225: StreamClosedError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s loop = 8450s tmp_path = PosixPath('/tmp/pytest-of-ubuntu/pytest-4/test_preload_remote_module0') 8450s 8450s def test_preload_remote_module(loop, tmp_path): 8450s with open(tmp_path / "scheduler_info.py", "w") as f: 8450s f.write(PRELOAD_TEXT) 8450s http_server_port = open_port() 8450s with popen( 8450s [sys.executable, "-m", "http.server", str(http_server_port)], cwd=tmp_path 8450s ): 8450s with popen( 8450s [ 8450s "dask", 8450s "scheduler", 8450s "--scheduler-file", 8450s str(tmp_path / "scheduler-file.json"), 8450s "--preload", 8450s f"http://localhost:{http_server_port}/scheduler_info.py", 8450s f"--port={open_port()}", 8450s ] 8450s ) as proc: 8450s with Client( 8450s scheduler_file=tmp_path / "scheduler-file.json", loop=loop 8450s ) as c: 8450s > assert ( 8450s c.run_on_scheduler( 8450s lambda dask_scheduler: getattr(dask_scheduler, "foo", None) 8450s ) 8450s == "bar" 8450s ) 8450s 8450s /usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py:397: 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s /usr/lib/python3/dist-packages/distributed/client.py:2858: in run_on_scheduler 8450s return self.sync(self._run_on_scheduler, function, *args, **kwargs) 8450s /usr/lib/python3/dist-packages/distributed/utils.py:362: in sync 8450s return sync( 8450s /usr/lib/python3/dist-packages/distributed/utils.py:438: in sync 8450s raise error 8450s /usr/lib/python3/dist-packages/distributed/utils.py:412: in f 8450s result = yield future 8450s /usr/lib/python3/dist-packages/tornado/gen.py:766: in run 8450s value = future.result() 8450s /usr/lib/python3/dist-packages/distributed/client.py:2809: in _run_on_scheduler 8450s response = await self.scheduler.run_function( 8450s /usr/lib/python3/dist-packages/distributed/core.py:1395: in send_recv_from_rpc 8450s return await send_recv(comm=comm, op=key, **kwargs) 8450s /usr/lib/python3/dist-packages/distributed/core.py:1154: in send_recv 8450s response = await comm.read(deserializers=deserializers) 8450s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:236: in read 8450s convert_stream_closed_error(self, e) 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s 8450s obj = 8450s exc = StreamClosedError('Stream is closed') 8450s 8450s def convert_stream_closed_error(obj, exc): 8450s """ 8450s Re-raise StreamClosedError as CommClosedError. 8450s """ 8450s if exc.real_error is not None: 8450s # The stream was closed because of an underlying OS error 8450s exc = exc.real_error 8450s if isinstance(exc, ssl.SSLError): 8450s if exc.reason and "UNKNOWN_CA" in exc.reason: 8450s raise FatalCommClosedError(f"in {obj}: {exc.__class__.__name__}: {exc}") 8450s raise CommClosedError(f"in {obj}: {exc.__class__.__name__}: {exc}") from exc 8450s else: 8450s > raise CommClosedError(f"in {obj}: {exc}") from exc 8450s E distributed.comm.core.CommClosedError: in : Stream is closed 8450s 8450s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:142: CommClosedError 8450s ----------------------------- Captured stdout call ----------------------------- 8450s Serving HTTP on 0.0.0.0 port 58039 (http://0.0.0.0:58039/) ... 8450s 8450s Keyboard interrupt received, exiting. 8450s ----------------------------- Captured stderr call ----------------------------- 8450s 2024-11-23 22:37:06,872 - distributed.scheduler - INFO - ----------------------------------------------- 8450s 2024-11-23 22:37:06,874 - distributed.preloading - INFO - Creating preload: http://localhost:58039/scheduler_info.py 8450s 2024-11-23 22:37:06,875 - distributed.preloading - INFO - Downloading preload at http://localhost:58039/scheduler_info.py 8450s 127.0.0.1 - - [23/Nov/2024 22:37:06] "GET /scheduler_info.py HTTP/1.1" 200 - 8450s 2024-11-23 22:37:06,929 - distributed.http.proxy - INFO - To route to workers diagnostics web server please install jupyter-server-proxy: python -m pip install jupyter-server-proxy 8450s 2024-11-23 22:37:06,932 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:37:06,934 - distributed.diskutils - INFO - Found stale lock file and directory '/tmp/dask-scratch-space/scheduler-5mtk9fht', purging 8450s 2024-11-23 22:37:06,941 - distributed.scheduler - INFO - ----------------------------------------------- 8450s 2024-11-23 22:37:06,943 - distributed.scheduler - INFO - Scheduler at: tcp://10.0.4.73:42993 8450s 2024-11-23 22:37:06,943 - distributed.scheduler - INFO - dashboard at: http://10.0.4.73:8787/status 8450s 2024-11-23 22:37:06,943 - distributed.preloading - INFO - Run preload setup: http://localhost:58039/scheduler_info.py 8450s 2024-11-23 22:37:06,944 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:37:06,953 - distributed.scheduler - INFO - Receive client connection: Client-77b20093-a9eb-11ef-bf02-00163e4db70f 8450s 2024-11-23 22:37:07,287 - distributed.core - INFO - Starting established connection to tcp://10.0.4.73:34560 8450s 2024-11-23 22:37:07,291 - distributed.worker - INFO - Run out-of-band function 'lambda' 8450s 2024-11-23 22:37:07,735 - distributed.client - ERROR - 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 836, in wrapper 8450s return await func(*args, **kwargs) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/client.py", line 1331, in _reconnect 8450s await self._ensure_connected(timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/client.py", line 1361, in _ensure_connected 8450s comm = await connect( 8450s ^^^^^^^^^^^^^^ 8450s self.scheduler.address, timeout=timeout, **self.connection_args 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s _____________________________ test_preload_config ______________________________ 8450s 8450s loop = 8450s 8450s def test_preload_config(loop): 8450s # Ensure dask scheduler pulls the preload from the Dask config if 8450s # not specified via a command line option 8450s with tmpfile() as fn: 8450s env = os.environ.copy() 8450s env["DASK_DISTRIBUTED__SCHEDULER__PRELOAD"] = PRELOAD_TEXT 8450s with popen(["dask", "scheduler", "--scheduler-file", fn], env=env): 8450s with Client(scheduler_file=fn, loop=loop) as c: 8450s > assert ( 8450s c.run_on_scheduler(lambda dask_scheduler: dask_scheduler.foo) 8450s == "bar" 8450s ) 8450s 8450s /usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py:413: 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s /usr/lib/python3/dist-packages/distributed/client.py:2858: in run_on_scheduler 8450s return self.sync(self._run_on_scheduler, function, *args, **kwargs) 8450s /usr/lib/python3/dist-packages/distributed/utils.py:362: in sync 8450s return sync( 8450s /usr/lib/python3/dist-packages/distributed/utils.py:438: in sync 8450s raise error 8450s /usr/lib/python3/dist-packages/distributed/utils.py:412: in f 8450s result = yield future 8450s /usr/lib/python3/dist-packages/tornado/gen.py:766: in run 8450s value = future.result() 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s 8450s self = 8450s function = . at 0xe93e2348> 8450s wait = True, args = (), kwargs = {} 8450s response = {'exception': b'\x80\x05\x953\x02\x00\x00\x00\x00\x00\x00\x8c\x16tblib.pickling_support\x94\x8c\x12unpickle_exception\...ext': "SystemError('no locals found when setting up annotations')", 'status': 'error', 'traceback': b'\x80\x05N.', ...} 8450s typ = 8450s exc = SystemError('no locals found when setting up annotations'), tb = None 8450s 8450s async def _run_on_scheduler(self, function, *args, wait=True, **kwargs): 8450s response = await self.scheduler.run_function( 8450s function=dumps(function), 8450s args=dumps(args), 8450s kwargs=dumps(kwargs), 8450s wait=wait, 8450s ) 8450s if response["status"] == "error": 8450s typ, exc, tb = clean_exception(**response) 8450s > raise exc.with_traceback(tb) 8450s E SystemError: no locals found when setting up annotations 8450s 8450s /usr/lib/python3/dist-packages/distributed/client.py:2817: SystemError 8450s ----------------------------- Captured stderr call ----------------------------- 8450s 2024-11-23 22:37:08,725 - distributed.scheduler - INFO - ----------------------------------------------- 8450s 2024-11-23 22:37:08,728 - distributed.preloading - INFO - Creating preload: 8450s _scheduler_info = {} 8450s 8450s def dask_setup(scheduler): 8450s _scheduler_info['address'] = scheduler.address 8450s scheduler.foo = "bar" 8450s 8450s def get_scheduler_address(): 8450s return _scheduler_info['address'] 8450s 8450s 2024-11-23 22:37:08,729 - distributed.utils - INFO - Reload module tmp9e71xhg0 from .py file 8450s 2024-11-23 22:37:08,730 - distributed.preloading - INFO - Import preload module: /tmp/tmp9e71xhg0.py 8450s 2024-11-23 22:37:08,754 - distributed.http.proxy - INFO - To route to workers diagnostics web server please install jupyter-server-proxy: python -m pip install jupyter-server-proxy 8450s 2024-11-23 22:37:08,757 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:37:08,759 - distributed.diskutils - INFO - Found stale lock file and directory '/tmp/dask-scratch-space/scheduler-qw6jc_h2', purging 8450s 2024-11-23 22:37:08,766 - distributed.scheduler - INFO - ----------------------------------------------- 8450s 2024-11-23 22:37:08,767 - distributed.scheduler - INFO - Scheduler at: tcp://10.0.4.73:8786 8450s 2024-11-23 22:37:08,767 - distributed.scheduler - INFO - dashboard at: http://10.0.4.73:8787/status 8450s 2024-11-23 22:37:08,768 - distributed.preloading - INFO - Run preload setup: 8450s _scheduler_info = {} 8450s 8450s def dask_setup(scheduler): 8450s _scheduler_info['address'] = scheduler.address 8450s scheduler.foo = "bar" 8450s 8450s def get_scheduler_address(): 8450s return _scheduler_info['address'] 8450s 8450s 2024-11-23 22:37:08,768 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:37:08,784 - distributed.scheduler - INFO - Receive client connection: Client-78cbe027-a9eb-11ef-bf02-00163e4db70f 8450s 2024-11-23 22:37:09,111 - distributed.core - INFO - Starting established connection to tcp://10.0.4.73:53062 8450s 2024-11-23 22:37:09,116 - distributed.worker - INFO - Run out-of-band function 'lambda' 8450s 2024-11-23 22:37:09,116 - distributed.worker - WARNING - Run Failed 8450s Function: lambda 8450s args: () 8450s kwargs: {'dask_scheduler': } 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 3182, in run 8450s result = function(*args, **kwargs) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s SystemError: no locals found when setting up annotations 8450s 2024-11-23 22:37:09,125 - distributed.scheduler - INFO - Remove client Client-78cbe027-a9eb-11ef-bf02-00163e4db70f 8450s 2024-11-23 22:37:09,125 - distributed.core - INFO - Received 'close-stream' from tcp://10.0.4.73:53062; closing. 8450s 2024-11-23 22:37:09,126 - distributed.scheduler - INFO - Remove client Client-78cbe027-a9eb-11ef-bf02-00163e4db70f 8450s 2024-11-23 22:37:09,126 - distributed.scheduler - INFO - Close client connection: Client-78cbe027-a9eb-11ef-bf02-00163e4db70f 8450s 2024-11-23 22:37:09,127 - distributed._signals - INFO - Received signal SIGINT (2) 8450s 2024-11-23 22:37:09,127 - distributed.scheduler - INFO - Scheduler closing due to signal-2... 8450s 2024-11-23 22:37:09,128 - distributed.scheduler - INFO - Scheduler closing all comms 8450s 2024-11-23 22:37:09,128 - distributed.scheduler - INFO - Stopped scheduler at 'tcp://10.0.4.73:8786' 8450s 2024-11-23 22:37:09,129 - distributed.scheduler - INFO - End scheduler 8450s _____________________________ test_preload_command _____________________________ 8450s 8450s self = 8450s deserializers = None 8450s 8450s async def read(self, deserializers=None): 8450s stream = self.stream 8450s if stream is None: 8450s raise CommClosedError() 8450s 8450s fmt = "Q" 8450s fmt_size = struct.calcsize(fmt) 8450s 8450s try: 8450s # Don't store multiple numpy or parquet buffers into the same buffer, or 8450s # none will be released until all are released. 8450s > frames_nosplit_nbytes_bin = await stream.read_bytes(fmt_size) 8450s E tornado.iostream.StreamClosedError: Stream is closed 8450s 8450s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:225: StreamClosedError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s loop = 8450s 8450s def test_preload_command(loop): 8450s def check_passthrough(): 8450s import passthrough_info 8450s 8450s return passthrough_info.get_passthrough() 8450s 8450s tmpdir = tempfile.mkdtemp() 8450s try: 8450s path = os.path.join(tmpdir, "passthrough_info.py") 8450s with open(path, "w") as f: 8450s f.write(PRELOAD_COMMAND_TEXT) 8450s 8450s with tmpfile() as fn: 8450s print(fn) 8450s with popen( 8450s [ 8450s "dask", 8450s "scheduler", 8450s "--scheduler-file", 8450s fn, 8450s "--preload", 8450s path, 8450s "--passthrough", 8450s "foobar", 8450s ] 8450s ): 8450s with Client(scheduler_file=fn, loop=loop) as c: 8450s > assert c.run_on_scheduler(check_passthrough) == "foobar" 8450s 8450s /usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py:460: 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s /usr/lib/python3/dist-packages/distributed/client.py:2858: in run_on_scheduler 8450s return self.sync(self._run_on_scheduler, function, *args, **kwargs) 8450s /usr/lib/python3/dist-packages/distributed/utils.py:362: in sync 8450s return sync( 8450s /usr/lib/python3/dist-packages/distributed/utils.py:438: in sync 8450s raise error 8450s /usr/lib/python3/dist-packages/distributed/utils.py:412: in f 8450s result = yield future 8450s /usr/lib/python3/dist-packages/tornado/gen.py:766: in run 8450s value = future.result() 8450s /usr/lib/python3/dist-packages/distributed/client.py:2809: in _run_on_scheduler 8450s response = await self.scheduler.run_function( 8450s /usr/lib/python3/dist-packages/distributed/core.py:1395: in send_recv_from_rpc 8450s return await send_recv(comm=comm, op=key, **kwargs) 8450s /usr/lib/python3/dist-packages/distributed/core.py:1154: in send_recv 8450s response = await comm.read(deserializers=deserializers) 8450s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:236: in read 8450s convert_stream_closed_error(self, e) 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s 8450s obj = 8450s exc = StreamClosedError('Stream is closed') 8450s 8450s def convert_stream_closed_error(obj, exc): 8450s """ 8450s Re-raise StreamClosedError as CommClosedError. 8450s """ 8450s if exc.real_error is not None: 8450s # The stream was closed because of an underlying OS error 8450s exc = exc.real_error 8450s if isinstance(exc, ssl.SSLError): 8450s if exc.reason and "UNKNOWN_CA" in exc.reason: 8450s raise FatalCommClosedError(f"in {obj}: {exc.__class__.__name__}: {exc}") 8450s raise CommClosedError(f"in {obj}: {exc.__class__.__name__}: {exc}") from exc 8450s else: 8450s > raise CommClosedError(f"in {obj}: {exc}") from exc 8450s E distributed.comm.core.CommClosedError: in : Stream is closed 8450s 8450s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:142: CommClosedError 8450s ----------------------------- Captured stdout call ----------------------------- 8450s /tmp/tmpq2ddb0gi 8450s ----------------------------- Captured stderr call ----------------------------- 8450s 2024-11-23 22:37:10,185 - distributed.utils - INFO - Reload module passthrough_info from .py file 8450s 2024-11-23 22:37:10,187 - distributed.preloading - INFO - Import preload module: /tmp/tmpcq38uuv_/passthrough_info.py 8450s 2024-11-23 22:37:10,188 - distributed.scheduler - INFO - ----------------------------------------------- 8450s 2024-11-23 22:37:10,190 - distributed.preloading - INFO - Creating preload: /tmp/tmpcq38uuv_/passthrough_info.py 8450s 2024-11-23 22:37:10,190 - distributed.utils - INFO - Reload module passthrough_info from .py file 8450s 2024-11-23 22:37:10,191 - distributed.preloading - INFO - Import preload module: /tmp/tmpcq38uuv_/passthrough_info.py 8450s 2024-11-23 22:37:10,212 - distributed.http.proxy - INFO - To route to workers diagnostics web server please install jupyter-server-proxy: python -m pip install jupyter-server-proxy 8450s 2024-11-23 22:37:10,216 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:37:10,223 - distributed.scheduler - INFO - ----------------------------------------------- 8450s 2024-11-23 22:37:10,224 - distributed.scheduler - INFO - Scheduler at: tcp://10.0.4.73:8786 8450s 2024-11-23 22:37:10,225 - distributed.scheduler - INFO - dashboard at: http://10.0.4.73:8787/status 8450s 2024-11-23 22:37:10,225 - distributed.preloading - INFO - Run preload setup: /tmp/tmpcq38uuv_/passthrough_info.py 8450s 2024-11-23 22:37:10,226 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:37:10,231 - distributed.scheduler - INFO - Receive client connection: Client-79b0ef9c-a9eb-11ef-bf02-00163e4db70f 8450s 2024-11-23 22:37:10,536 - distributed.core - INFO - Starting established connection to tcp://10.0.4.73:53082 8450s 2024-11-23 22:37:10,540 - distributed.worker - INFO - Run out-of-band function 'check_passthrough' 8450s 2024-11-23 22:37:10,967 - distributed.client - ERROR - 8450s ConnectionRefusedError: [Errno 111] Connection refused 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 559, in connect 8450s convert_stream_closed_error(self, e) 8450s ~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 140, in convert_stream_closed_error 8450s raise CommClosedError(f"in {obj}: {exc.__class__.__name__}: {exc}") from exc 8450s distributed.comm.core.CommClosedError: in : ConnectionRefusedError: [Errno 111] Connection refused 8450s 8450s During handling of the above exception, another exception occurred: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 836, in wrapper 8450s return await func(*args, **kwargs) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/client.py", line 1331, in _reconnect 8450s await self._ensure_connected(timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/client.py", line 1361, in _ensure_connected 8450s comm = await connect( 8450s ^^^^^^^^^^^^^^ 8450s self.scheduler.address, timeout=timeout, **self.connection_args 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 366, in connect 8450s await asyncio.sleep(backoff) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 718, in sleep 8450s return await future 8450s ^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s _________________________ test_preload_command_default _________________________ 8450s 8450s self = 8450s deserializers = None 8450s 8450s async def read(self, deserializers=None): 8450s stream = self.stream 8450s if stream is None: 8450s raise CommClosedError() 8450s 8450s fmt = "Q" 8450s fmt_size = struct.calcsize(fmt) 8450s 8450s try: 8450s # Don't store multiple numpy or parquet buffers into the same buffer, or 8450s # none will be released until all are released. 8450s > frames_nosplit_nbytes_bin = await stream.read_bytes(fmt_size) 8450s E tornado.iostream.StreamClosedError: Stream is closed 8450s 8450s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:225: StreamClosedError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s loop = 8450s 8450s def test_preload_command_default(loop): 8450s def check_passthrough(): 8450s import passthrough_info 8450s 8450s return passthrough_info.get_passthrough() 8450s 8450s tmpdir = tempfile.mkdtemp() 8450s try: 8450s path = os.path.join(tmpdir, "passthrough_info.py") 8450s with open(path, "w") as f: 8450s f.write(PRELOAD_COMMAND_TEXT) 8450s 8450s with tmpfile() as fn2: 8450s print(fn2) 8450s with popen( 8450s ["dask", "scheduler", "--scheduler-file", fn2, "--preload", path], 8450s stdout=sys.stdout, 8450s stderr=sys.stderr, 8450s ): 8450s with Client(scheduler_file=fn2, loop=loop) as c: 8450s > assert c.run_on_scheduler(check_passthrough) == "default" 8450s 8450s /usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py:485: 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s /usr/lib/python3/dist-packages/distributed/client.py:2858: in run_on_scheduler 8450s return self.sync(self._run_on_scheduler, function, *args, **kwargs) 8450s /usr/lib/python3/dist-packages/distributed/utils.py:362: in sync 8450s return sync( 8450s /usr/lib/python3/dist-packages/distributed/utils.py:438: in sync 8450s raise error 8450s /usr/lib/python3/dist-packages/distributed/utils.py:412: in f 8450s result = yield future 8450s /usr/lib/python3/dist-packages/tornado/gen.py:766: in run 8450s value = future.result() 8450s /usr/lib/python3/dist-packages/distributed/client.py:2809: in _run_on_scheduler 8450s response = await self.scheduler.run_function( 8450s /usr/lib/python3/dist-packages/distributed/core.py:1395: in send_recv_from_rpc 8450s return await send_recv(comm=comm, op=key, **kwargs) 8450s /usr/lib/python3/dist-packages/distributed/core.py:1154: in send_recv 8450s response = await comm.read(deserializers=deserializers) 8450s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:236: in read 8450s convert_stream_closed_error(self, e) 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s 8450s obj = 8450s exc = StreamClosedError('Stream is closed') 8450s 8450s def convert_stream_closed_error(obj, exc): 8450s """ 8450s Re-raise StreamClosedError as CommClosedError. 8450s """ 8450s if exc.real_error is not None: 8450s # The stream was closed because of an underlying OS error 8450s exc = exc.real_error 8450s if isinstance(exc, ssl.SSLError): 8450s if exc.reason and "UNKNOWN_CA" in exc.reason: 8450s raise FatalCommClosedError(f"in {obj}: {exc.__class__.__name__}: {exc}") 8450s raise CommClosedError(f"in {obj}: {exc.__class__.__name__}: {exc}") from exc 8450s else: 8450s > raise CommClosedError(f"in {obj}: {exc}") from exc 8450s E distributed.comm.core.CommClosedError: in : Stream is closed 8450s 8450s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:142: CommClosedError 8450s ----------------------------- Captured stdout call ----------------------------- 8450s /tmp/tmpckj2ghy8 8450s ----------------------------- Captured stderr call ----------------------------- 8450s 2024-11-23 22:37:12,097 - distributed.utils - INFO - Reload module passthrough_info from .py file 8450s 2024-11-23 22:37:12,098 - distributed.preloading - INFO - Import preload module: /tmp/tmp3pveul0d/passthrough_info.py 8450s 2024-11-23 22:37:12,100 - distributed.scheduler - INFO - ----------------------------------------------- 8450s 2024-11-23 22:37:12,101 - distributed.preloading - INFO - Creating preload: /tmp/tmp3pveul0d/passthrough_info.py 8450s 2024-11-23 22:37:12,102 - distributed.utils - INFO - Reload module passthrough_info from .py file 8450s 2024-11-23 22:37:12,103 - distributed.preloading - INFO - Import preload module: /tmp/tmp3pveul0d/passthrough_info.py 8450s 2024-11-23 22:37:12,126 - distributed.http.proxy - INFO - To route to workers diagnostics web server please install jupyter-server-proxy: python -m pip install jupyter-server-proxy 8450s 2024-11-23 22:37:12,129 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:37:12,131 - distributed.diskutils - INFO - Found stale lock file and directory '/tmp/dask-scratch-space/scheduler-_yg7t0dh', purging 8450s 2024-11-23 22:37:12,138 - distributed.scheduler - INFO - ----------------------------------------------- 8450s 2024-11-23 22:37:12,139 - distributed.scheduler - INFO - Scheduler at: tcp://10.0.4.73:8786 8450s 2024-11-23 22:37:12,139 - distributed.scheduler - INFO - dashboard at: http://10.0.4.73:8787/status 8450s 2024-11-23 22:37:12,140 - distributed.preloading - INFO - Run preload setup: /tmp/tmp3pveul0d/passthrough_info.py 8450s 2024-11-23 22:37:12,140 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:37:12,151 - distributed.scheduler - INFO - Receive client connection: Client-7ad112a6-a9eb-11ef-bf02-00163e4db70f 8450s 2024-11-23 22:37:12,470 - distributed.core - INFO - Starting established connection to tcp://10.0.4.73:36298 8450s 2024-11-23 22:37:12,474 - distributed.worker - INFO - Run out-of-band function 'check_passthrough' 8450s 2024-11-23 22:37:12,952 - distributed.client - ERROR - 8450s ConnectionRefusedError: [Errno 111] Connection refused 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 559, in connect 8450s convert_stream_closed_error(self, e) 8450s ~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 140, in convert_stream_closed_error 8450s raise CommClosedError(f"in {obj}: {exc.__class__.__name__}: {exc}") from exc 8450s distributed.comm.core.CommClosedError: in : ConnectionRefusedError: [Errno 111] Connection refused 8450s 8450s During handling of the above exception, another exception occurred: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 836, in wrapper 8450s return await func(*args, **kwargs) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/client.py", line 1331, in _reconnect 8450s await self._ensure_connected(timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/client.py", line 1361, in _ensure_connected 8450s comm = await connect( 8450s ^^^^^^^^^^^^^^ 8450s self.scheduler.address, timeout=timeout, **self.connection_args 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 366, in connect 8450s await asyncio.sleep(backoff) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 718, in sleep 8450s return await future 8450s ^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s ___________________________ test_multiple_workers_2 ____________________________ 8450s 8450s loop = 8450s 8450s def test_multiple_workers_2(loop): 8450s text = """ 8450s def dask_setup(worker): 8450s worker.foo = 'setup' 8450s """ 8450s port = open_port() 8450s with popen( 8450s ["dask", "scheduler", "--no-dashboard", "--host", f"127.0.0.1:{port}"] 8450s ) as s: 8450s with popen( 8450s [ 8450s "dask", 8450s "worker", 8450s f"localhost:{port}", 8450s "--no-dashboard", 8450s "--preload", 8450s text, 8450s "--preload-nanny", 8450s text, 8450s ] 8450s ) as a: 8450s with Client(f"127.0.0.1:{port}", loop=loop) as c: 8450s c.wait_for_workers(1) 8450s > [foo] = c.run(lambda dask_worker: dask_worker.foo).values() 8450s 8450s /usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py:549: 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s /usr/lib/python3/dist-packages/distributed/client.py:2993: in run 8450s return self.sync( 8450s /usr/lib/python3/dist-packages/distributed/utils.py:362: in sync 8450s return sync( 8450s /usr/lib/python3/dist-packages/distributed/utils.py:438: in sync 8450s raise error 8450s /usr/lib/python3/dist-packages/distributed/utils.py:412: in f 8450s result = yield future 8450s /usr/lib/python3/dist-packages/tornado/gen.py:766: in run 8450s value = future.result() 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s 8450s self = 8450s function = . at 0xe8f0e078> 8450s nanny = False, workers = None, wait = True, on_error = 'raise', args = () 8450s kwargs = {} 8450s responses = {'tcp://127.0.0.1:33849': {'exception': b'\x80\x05\x953\x02\x00\x00\x00\x00\x00\x00\x8c\x16tblib.pickling_support\x94\...xt': "SystemError('no locals found when setting up annotations')", 'status': 'error', 'traceback': b'\x80\x05N.', ...}} 8450s results = {}, key = 'tcp://127.0.0.1:33849' 8450s resp = {'exception': b'\x80\x05\x953\x02\x00\x00\x00\x00\x00\x00\x8c\x16tblib.pickling_support\x94\x8c\x12unpickle_exception\...ext': "SystemError('no locals found when setting up annotations')", 'status': 'error', 'traceback': b'\x80\x05N.', ...} 8450s exc = SystemError('no locals found when setting up annotations') 8450s _ = 8450s 8450s async def _run( 8450s self, 8450s function, 8450s *args, 8450s nanny: bool = False, 8450s workers: list[str] | None = None, 8450s wait: bool = True, 8450s on_error: Literal["raise", "return", "ignore"] = "raise", 8450s **kwargs, 8450s ): 8450s responses = await self.scheduler.broadcast( 8450s msg=dict( 8450s op="run", 8450s function=dumps(function), 8450s args=dumps(args), 8450s wait=wait, 8450s kwargs=dumps(kwargs), 8450s ), 8450s workers=workers, 8450s nanny=nanny, 8450s on_error="return_pickle", 8450s ) 8450s results = {} 8450s for key, resp in responses.items(): 8450s if isinstance(resp, bytes): 8450s # Pickled RPC exception 8450s exc = loads(resp) 8450s assert isinstance(exc, Exception) 8450s elif resp["status"] == "error": 8450s # Exception raised by the remote function 8450s _, exc, tb = clean_exception(**resp) 8450s exc = exc.with_traceback(tb) 8450s else: 8450s assert resp["status"] == "OK" 8450s results[key] = resp["result"] 8450s continue 8450s 8450s if on_error == "raise": 8450s > raise exc 8450s E SystemError: no locals found when setting up annotations 8450s 8450s /usr/lib/python3/dist-packages/distributed/client.py:2898: SystemError 8450s ----------------------------- Captured stderr call ----------------------------- 8450s 2024-11-23 22:37:13,845 - distributed.scheduler - INFO - ----------------------------------------------- 8450s 2024-11-23 22:37:13,868 - distributed.http.proxy - INFO - To route to workers diagnostics web server please install jupyter-server-proxy: python -m pip install jupyter-server-proxy 8450s 2024-11-23 22:37:13,871 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:37:13,873 - distributed.diskutils - INFO - Found stale lock file and directory '/tmp/dask-scratch-space/scheduler-ltoxhusl', purging 8450s 2024-11-23 22:37:13,881 - distributed.scheduler - INFO - ----------------------------------------------- 8450s 2024-11-23 22:37:13,882 - distributed.scheduler - INFO - Scheduler at: tcp://127.0.0.1:44075 8450s 2024-11-23 22:37:13,882 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:8787/status 8450s 2024-11-23 22:37:13,883 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:37:13,917 - distributed.scheduler - INFO - Receive client connection: Client-7bd9b8fb-a9eb-11ef-bf02-00163e4db70f 8450s 2024-11-23 22:37:14,089 - distributed.utils - INFO - Reload module tmp1qc0gofh from .py file 8450s 2024-11-23 22:37:14,091 - distributed.preloading - INFO - Import preload module: /tmp/tmp1qc0gofh.py 8450s 2024-11-23 22:37:14,105 - distributed.preloading - INFO - Creating preload: 8450s def dask_setup(worker): 8450s worker.foo = 'setup' 8450s 8450s 2024-11-23 22:37:14,107 - distributed.utils - INFO - Reload module tmpzhlf0fy_ from .py file 8450s 2024-11-23 22:37:14,108 - distributed.preloading - INFO - Import preload module: /tmp/tmpzhlf0fy_.py 8450s 2024-11-23 22:37:14,111 - distributed.preloading - INFO - Run preload setup: 8450s def dask_setup(worker): 8450s worker.foo = 'setup' 8450s 8450s 2024-11-23 22:37:14,239 - distributed.core - INFO - Starting established connection to tcp://127.0.0.1:53084 8450s 2024-11-23 22:37:14,243 - distributed.nanny - INFO - Start Nanny at: 'tcp://127.0.0.1:33055' 8450s 2024-11-23 22:37:14,868 - distributed.preloading - INFO - Creating preload: 8450s def dask_setup(worker): 8450s worker.foo = 'setup' 8450s 8450s 2024-11-23 22:37:14,869 - distributed.utils - INFO - Reload module tmp4041kka7 from .py file 8450s 2024-11-23 22:37:14,870 - distributed.preloading - INFO - Import preload module: /tmp/tmp4041kka7.py 8450s 2024-11-23 22:37:14,897 - distributed.preloading - INFO - Run preload setup: 8450s def dask_setup(worker): 8450s worker.foo = 'setup' 8450s 8450s 2024-11-23 22:37:14,897 - distributed.worker - INFO - Start worker at: tcp://127.0.0.1:33849 8450s 2024-11-23 22:37:14,897 - distributed.worker - INFO - Listening to: tcp://127.0.0.1:33849 8450s 2024-11-23 22:37:14,897 - distributed.worker - INFO - dashboard at: 127.0.0.1:43877 8450s 2024-11-23 22:37:14,897 - distributed.worker - INFO - Waiting to connect to: tcp://localhost:44075 8450s 2024-11-23 22:37:14,897 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:37:14,897 - distributed.worker - INFO - Threads: 8 8450s 2024-11-23 22:37:14,897 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:37:14,897 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-2o2d5wa9 8450s 2024-11-23 22:37:14,897 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:37:15,209 - distributed.scheduler - INFO - Register worker 8450s 2024-11-23 22:37:15,210 - distributed.scheduler - INFO - Starting worker compute stream, tcp://127.0.0.1:33849 8450s 2024-11-23 22:37:15,211 - distributed.core - INFO - Starting established connection to tcp://127.0.0.1:53106 8450s 2024-11-23 22:37:15,211 - distributed.worker - INFO - Starting Worker plugin shuffle 8450s 2024-11-23 22:37:15,212 - distributed.worker - INFO - Registered to: tcp://localhost:44075 8450s 2024-11-23 22:37:15,212 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:37:15,213 - distributed.core - INFO - Starting established connection to tcp://localhost:44075 8450s 2024-11-23 22:37:15,267 - distributed.worker - INFO - Run out-of-band function 'lambda' 8450s 2024-11-23 22:37:15,267 - distributed.worker - WARNING - Run Failed 8450s Function: lambda 8450s args: () 8450s kwargs: {'dask_worker': } 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 3182, in run 8450s result = function(*args, **kwargs) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s SystemError: no locals found when setting up annotations 8450s 2024-11-23 22:37:15,273 - distributed.scheduler - INFO - Remove client Client-7bd9b8fb-a9eb-11ef-bf02-00163e4db70f 8450s 2024-11-23 22:37:15,274 - distributed.core - INFO - Received 'close-stream' from tcp://127.0.0.1:53084; closing. 8450s 2024-11-23 22:37:15,274 - distributed.scheduler - INFO - Remove client Client-7bd9b8fb-a9eb-11ef-bf02-00163e4db70f 8450s 2024-11-23 22:37:15,274 - distributed.scheduler - INFO - Close client connection: Client-7bd9b8fb-a9eb-11ef-bf02-00163e4db70f 8450s 2024-11-23 22:37:15,275 - distributed._signals - INFO - Received signal SIGINT (2) 8450s 2024-11-23 22:37:15,276 - distributed.nanny - INFO - Closing Nanny at 'tcp://127.0.0.1:33055'. Reason: signal-2 8450s 2024-11-23 22:37:15,276 - distributed.nanny - INFO - Nanny asking worker to close. Reason: signal-2 8450s 2024-11-23 22:37:15,277 - distributed.worker - INFO - Stopping worker at tcp://127.0.0.1:33849. Reason: signal-2 8450s 2024-11-23 22:37:15,279 - distributed.core - INFO - Received 'close-stream' from tcp://127.0.0.1:53106; closing. 8450s 2024-11-23 22:37:15,279 - distributed.core - INFO - Connection to tcp://localhost:44075 has been closed. 8450s 2024-11-23 22:37:15,280 - distributed.scheduler - INFO - Remove worker (stimulus_id='handle-worker-cleanup-1732401435.280192') 8450s 2024-11-23 22:37:15,280 - distributed.scheduler - INFO - Lost all workers 8450s 2024-11-23 22:37:15,281 - distributed.nanny - INFO - Worker closed 8450s 2024-11-23 22:37:15,540 - distributed.dask_worker - INFO - End worker 8450s 2024-11-23 22:37:15,842 - distributed._signals - INFO - Received signal SIGINT (2) 8450s 2024-11-23 22:37:15,842 - distributed.scheduler - INFO - Scheduler closing due to signal-2... 8450s 2024-11-23 22:37:15,843 - distributed.scheduler - INFO - Scheduler closing all comms 8450s 2024-11-23 22:37:15,844 - distributed.scheduler - INFO - Stopped scheduler at 'tcp://127.0.0.1:44075' 8450s 2024-11-23 22:37:15,844 - distributed.scheduler - INFO - End scheduler 8450s __________________________________ test_basic __________________________________ 8450s 8450s self = 8450s address = '127.0.0.1:8786', deserialize = True 8450s connection_args = {'extra_conn_args': {}, 'require_encryption': False, 'ssl_context': } 8450s ip = '127.0.0.1', port = 8786 8450s kwargs = {'ssl_options': } 8450s 8450s async def connect(self, address, deserialize=True, **connection_args): 8450s self._check_encryption(address, connection_args) 8450s ip, port = parse_host_port(address) 8450s kwargs = self._get_connect_args(**connection_args) 8450s 8450s try: 8450s # server_hostname option (for SNI) only works with tornado.iostream.IOStream 8450s if "server_hostname" in kwargs: 8450s stream = await self.client.connect( 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE 8450s ) 8450s stream = await stream.start_tls(False, **kwargs) 8450s else: 8450s > stream = await self.client.connect( 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ) 8450s 8450s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:546: 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s /usr/lib/python3/dist-packages/tornado/tcpclient.py:292: in connect 8450s stream = await stream.start_tls( 8450s /usr/lib/python3/dist-packages/tornado/iostream.py:1367: in _do_ssl_handshake 8450s self.socket.do_handshake() 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s 8450s self = , block = False 8450s 8450s @_sslcopydoc 8450s def do_handshake(self, block=False): 8450s self._check_connected() 8450s timeout = self.gettimeout() 8450s try: 8450s if timeout == 0.0 and block: 8450s self.settimeout(None) 8450s > self._sslobj.do_handshake() 8450s E ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 8450s 8450s /usr/lib/python3.13/ssl.py:1372: SSLCertVerificationError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s loop = 8450s requires_default_ports = None 8450s 8450s def test_basic(loop, requires_default_ports): 8450s with ( 8450s popen(["dask", "scheduler", "--no-dashboard"] + tls_args), 8450s popen(["dask", "worker", "--no-dashboard", "tls://127.0.0.1:8786"] + tls_args), 8450s > Client("tls://127.0.0.1:8786", loop=loop, security=tls_security()) as c, 8450s ): 8450s 8450s /usr/lib/python3/dist-packages/distributed/cli/tests/test_tls_cli.py:37: 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s /usr/lib/python3/dist-packages/distributed/client.py:1018: in __init__ 8450s self.start(timeout=timeout) 8450s /usr/lib/python3/dist-packages/distributed/client.py:1220: in start 8450s sync(self.loop, self._start, **kwargs) 8450s /usr/lib/python3/dist-packages/distributed/utils.py:438: in sync 8450s raise error 8450s /usr/lib/python3/dist-packages/distributed/utils.py:412: in f 8450s result = yield future 8450s /usr/lib/python3/dist-packages/tornado/gen.py:766: in run 8450s value = future.result() 8450s /usr/lib/python3/dist-packages/distributed/client.py:1299: in _start 8450s await self._ensure_connected(timeout=timeout) 8450s /usr/lib/python3/dist-packages/distributed/client.py:1361: in _ensure_connected 8450s comm = await connect( 8450s /usr/lib/python3/dist-packages/distributed/comm/core.py:342: in connect 8450s comm = await wait_for( 8450s /usr/lib/python3/dist-packages/distributed/utils.py:1960: in wait_for 8450s return await fut 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s 8450s self = 8450s address = '127.0.0.1:8786', deserialize = True 8450s connection_args = {'extra_conn_args': {}, 'require_encryption': False, 'ssl_context': } 8450s ip = '127.0.0.1', port = 8786 8450s kwargs = {'ssl_options': } 8450s 8450s async def connect(self, address, deserialize=True, **connection_args): 8450s self._check_encryption(address, connection_args) 8450s ip, port = parse_host_port(address) 8450s kwargs = self._get_connect_args(**connection_args) 8450s 8450s try: 8450s # server_hostname option (for SNI) only works with tornado.iostream.IOStream 8450s if "server_hostname" in kwargs: 8450s stream = await self.client.connect( 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE 8450s ) 8450s stream = await stream.start_tls(False, **kwargs) 8450s else: 8450s stream = await self.client.connect( 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ) 8450s 8450s # Under certain circumstances tornado will have a closed connection with an 8450s # error and not raise a StreamClosedError. 8450s # 8450s # This occurs with tornado 5.x and openssl 1.1+ 8450s if stream.closed() and stream.error: 8450s raise StreamClosedError(stream.error) 8450s 8450s except StreamClosedError as e: 8450s # The socket connect() call failed 8450s convert_stream_closed_error(self, e) 8450s except SSLCertVerificationError as err: 8450s > raise FatalCommClosedError( 8450s "TLS certificate does not match. Check your security settings. " 8450s "More info at https://distributed.dask.org/en/latest/tls.html" 8450s ) from err 8450s E distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 8450s 8450s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:561: FatalCommClosedError 8450s ----------------------------- Captured stderr call ----------------------------- 8450s 2024-11-23 22:37:16,956 - distributed.scheduler - INFO - ----------------------------------------------- 8450s 2024-11-23 22:37:16,979 - distributed.http.proxy - INFO - To route to workers diagnostics web server please install jupyter-server-proxy: python -m pip install jupyter-server-proxy 8450s 2024-11-23 22:37:16,982 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:37:16,989 - distributed.scheduler - INFO - ----------------------------------------------- 8450s 2024-11-23 22:37:16,992 - distributed.scheduler - INFO - Scheduler at: tls://10.0.4.73:8786 8450s 2024-11-23 22:37:16,992 - distributed.scheduler - INFO - dashboard at: http://10.0.4.73:8787/status 8450s 2024-11-23 22:37:16,992 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:37:17,021 - distributed.nanny - INFO - Start Nanny at: 'tls://127.0.0.1:37197' 8450s 2024-11-23 22:37:17,660 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45863 8450s 2024-11-23 22:37:17,660 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45863 8450s 2024-11-23 22:37:17,660 - distributed.worker - INFO - dashboard at: 127.0.0.1:44623 8450s 2024-11-23 22:37:17,660 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:8786 8450s 2024-11-23 22:37:17,660 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:37:17,660 - distributed.worker - INFO - Threads: 8 8450s 2024-11-23 22:37:17,660 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:37:17,660 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-qxw7zizv 8450s 2024-11-23 22:37:17,660 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:37:17,979 - distributed.scheduler - INFO - Register worker 8450s 2024-11-23 22:37:17,981 - distributed._signals - INFO - Received signal SIGINT (2) 8450s 2024-11-23 22:37:17,981 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:37197'. Reason: signal-2 8450s 2024-11-23 22:37:18,296 - distributed.scheduler - INFO - Starting worker compute stream, tls://127.0.0.1:45863 8450s 2024-11-23 22:37:18,297 - distributed.core - INFO - Starting established connection to tls://127.0.0.1:57370 8450s 2024-11-23 22:37:18,297 - distributed.worker - INFO - Starting Worker plugin shuffle 8450s 2024-11-23 22:37:18,298 - distributed.comm.tcp - WARNING - Listener on 'tls://0.0.0.0:8786': TLS handshake failed with remote 'tls://127.0.0.1:57384': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1000) 8450s 2024-11-23 22:37:18,298 - distributed.worker - INFO - Registered to: tls://127.0.0.1:8786 8450s 2024-11-23 22:37:18,298 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:37:18,300 - distributed.core - INFO - Starting established connection to tls://127.0.0.1:8786 8450s 2024-11-23 22:37:18,339 - distributed.nanny - INFO - Nanny asking worker to close. Reason: signal-2 8450s 2024-11-23 22:37:18,341 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45863. Reason: signal-2 8450s 2024-11-23 22:37:18,342 - distributed.core - INFO - Received 'close-stream' from tls://127.0.0.1:57370; closing. 8450s 2024-11-23 22:37:18,342 - distributed.core - INFO - Connection to tls://127.0.0.1:8786 has been closed. 8450s 2024-11-23 22:37:18,343 - distributed.scheduler - INFO - Remove worker (stimulus_id='handle-worker-cleanup-1732401438.343303') 8450s 2024-11-23 22:37:18,344 - distributed.scheduler - INFO - Lost all workers 8450s 2024-11-23 22:37:18,345 - distributed.nanny - INFO - Worker closed 8450s 2024-11-23 22:37:18,623 - distributed.dask_worker - INFO - End worker 8450s 2024-11-23 22:37:18,848 - distributed._signals - INFO - Received signal SIGINT (2) 8450s 2024-11-23 22:37:18,849 - distributed.scheduler - INFO - Scheduler closing due to signal-2... 8450s 2024-11-23 22:37:18,849 - distributed.scheduler - INFO - Scheduler closing all comms 8450s 2024-11-23 22:37:18,850 - distributed.scheduler - INFO - Stopped scheduler at 'tls://10.0.4.73:8786' 8450s 2024-11-23 22:37:18,850 - distributed.scheduler - INFO - End scheduler 8450s ___________________________________ test_sni ___________________________________ 8450s 8450s self = 8450s address = '127.0.0.1:39569', deserialize = True 8450s connection_args = {'extra_conn_args': {}, 'require_encryption': False, 'ssl_context': } 8450s ip = '127.0.0.1', port = 39569 8450s kwargs = {'ssl_options': } 8450s 8450s async def connect(self, address, deserialize=True, **connection_args): 8450s self._check_encryption(address, connection_args) 8450s ip, port = parse_host_port(address) 8450s kwargs = self._get_connect_args(**connection_args) 8450s 8450s try: 8450s # server_hostname option (for SNI) only works with tornado.iostream.IOStream 8450s if "server_hostname" in kwargs: 8450s stream = await self.client.connect( 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE 8450s ) 8450s stream = await stream.start_tls(False, **kwargs) 8450s else: 8450s > stream = await self.client.connect( 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ) 8450s 8450s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:546: 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s /usr/lib/python3/dist-packages/tornado/tcpclient.py:292: in connect 8450s stream = await stream.start_tls( 8450s /usr/lib/python3/dist-packages/tornado/iostream.py:1367: in _do_ssl_handshake 8450s self.socket.do_handshake() 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s 8450s self = , block = False 8450s 8450s @_sslcopydoc 8450s def do_handshake(self, block=False): 8450s self._check_connected() 8450s timeout = self.gettimeout() 8450s try: 8450s if timeout == 0.0 and block: 8450s self.settimeout(None) 8450s > self._sslobj.do_handshake() 8450s E ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 8450s 8450s /usr/lib/python3.13/ssl.py:1372: SSLCertVerificationError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s loop = 8450s 8450s def test_sni(loop): 8450s port = open_port() 8450s with popen( 8450s ["dask", "scheduler", "--no-dashboard", f"--port={port}"] + tls_args 8450s ) as s: 8450s with popen( 8450s [ 8450s "dask", 8450s "worker", 8450s "--no-dashboard", 8450s "--scheduler-sni", 8450s "localhost", 8450s f"tls://127.0.0.1:{port}", 8450s ] 8450s + tls_args 8450s ) as w: 8450s > with Client( 8450s f"tls://127.0.0.1:{port}", loop=loop, security=tls_security() 8450s ) as c: 8450s 8450s /usr/lib/python3/dist-packages/distributed/cli/tests/test_tls_cli.py:58: 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s /usr/lib/python3/dist-packages/distributed/client.py:1018: in __init__ 8450s self.start(timeout=timeout) 8450s /usr/lib/python3/dist-packages/distributed/client.py:1220: in start 8450s sync(self.loop, self._start, **kwargs) 8450s /usr/lib/python3/dist-packages/distributed/utils.py:438: in sync 8450s raise error 8450s /usr/lib/python3/dist-packages/distributed/utils.py:412: in f 8450s result = yield future 8450s /usr/lib/python3/dist-packages/tornado/gen.py:766: in run 8450s value = future.result() 8450s /usr/lib/python3/dist-packages/distributed/client.py:1299: in _start 8450s await self._ensure_connected(timeout=timeout) 8450s /usr/lib/python3/dist-packages/distributed/client.py:1361: in _ensure_connected 8450s comm = await connect( 8450s /usr/lib/python3/dist-packages/distributed/comm/core.py:342: in connect 8450s comm = await wait_for( 8450s /usr/lib/python3/dist-packages/distributed/utils.py:1960: in wait_for 8450s return await fut 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s 8450s self = 8450s address = '127.0.0.1:39569', deserialize = True 8450s connection_args = {'extra_conn_args': {}, 'require_encryption': False, 'ssl_context': } 8450s ip = '127.0.0.1', port = 39569 8450s kwargs = {'ssl_options': } 8450s 8450s async def connect(self, address, deserialize=True, **connection_args): 8450s self._check_encryption(address, connection_args) 8450s ip, port = parse_host_port(address) 8450s kwargs = self._get_connect_args(**connection_args) 8450s 8450s try: 8450s # server_hostname option (for SNI) only works with tornado.iostream.IOStream 8450s if "server_hostname" in kwargs: 8450s stream = await self.client.connect( 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE 8450s ) 8450s stream = await stream.start_tls(False, **kwargs) 8450s else: 8450s stream = await self.client.connect( 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ) 8450s 8450s # Under certain circumstances tornado will have a closed connection with an 8450s # error and not raise a StreamClosedError. 8450s # 8450s # This occurs with tornado 5.x and openssl 1.1+ 8450s if stream.closed() and stream.error: 8450s raise StreamClosedError(stream.error) 8450s 8450s except StreamClosedError as e: 8450s # The socket connect() call failed 8450s convert_stream_closed_error(self, e) 8450s except SSLCertVerificationError as err: 8450s > raise FatalCommClosedError( 8450s "TLS certificate does not match. Check your security settings. " 8450s "More info at https://distributed.dask.org/en/latest/tls.html" 8450s ) from err 8450s E distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 8450s 8450s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:561: FatalCommClosedError 8450s ----------------------------- Captured stderr call ----------------------------- 8450s 2024-11-23 22:37:20,111 - distributed.scheduler - INFO - ----------------------------------------------- 8450s 2024-11-23 22:37:20,134 - distributed.http.proxy - INFO - To route to workers diagnostics web server please install jupyter-server-proxy: python -m pip install jupyter-server-proxy 8450s 2024-11-23 22:37:20,137 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:37:20,144 - distributed.scheduler - INFO - ----------------------------------------------- 8450s 2024-11-23 22:37:20,147 - distributed.scheduler - INFO - Scheduler at: tls://10.0.4.73:39569 8450s 2024-11-23 22:37:20,147 - distributed.scheduler - INFO - dashboard at: http://10.0.4.73:8787/status 8450s 2024-11-23 22:37:20,147 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:37:20,165 - distributed.nanny - INFO - Start Nanny at: 'tls://127.0.0.1:45085' 8450s 2024-11-23 22:37:20,442 - distributed.comm.tcp - WARNING - Listener on 'tls://0.0.0.0:39569': TLS handshake failed with remote 'tls://127.0.0.1:57918': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1000) 8450s 2024-11-23 22:37:20,443 - distributed._signals - INFO - Received signal SIGINT (2) 8450s 2024-11-23 22:37:20,443 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:45085'. Reason: signal-2 8450s 2024-11-23 22:37:20,855 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44359 8450s 2024-11-23 22:37:20,855 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44359 8450s 2024-11-23 22:37:20,855 - distributed.worker - INFO - dashboard at: 127.0.0.1:43809 8450s 2024-11-23 22:37:20,855 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39569 8450s 2024-11-23 22:37:20,855 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:37:20,855 - distributed.worker - INFO - Threads: 8 8450s 2024-11-23 22:37:20,855 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:37:20,855 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-bs1axgac 8450s 2024-11-23 22:37:20,855 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:37:21,180 - distributed.scheduler - INFO - Register worker 8450s 2024-11-23 22:37:21,488 - distributed.scheduler - INFO - Starting worker compute stream, tls://127.0.0.1:44359 8450s 2024-11-23 22:37:21,488 - distributed.core - INFO - Starting established connection to tls://127.0.0.1:57934 8450s 2024-11-23 22:37:21,489 - distributed.worker - INFO - Starting Worker plugin shuffle 8450s 2024-11-23 22:37:21,490 - distributed.worker - INFO - Registered to: tls://127.0.0.1:39569 8450s 2024-11-23 22:37:21,490 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:37:21,491 - distributed.core - INFO - Starting established connection to tls://127.0.0.1:39569 8450s 2024-11-23 22:37:21,535 - distributed.nanny - INFO - Nanny asking worker to close. Reason: signal-2 8450s 2024-11-23 22:37:21,536 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44359. Reason: signal-2 8450s 2024-11-23 22:37:21,538 - distributed.core - INFO - Received 'close-stream' from tls://127.0.0.1:57934; closing. 8450s 2024-11-23 22:37:21,538 - distributed.core - INFO - Connection to tls://127.0.0.1:39569 has been closed. 8450s 2024-11-23 22:37:21,539 - distributed.scheduler - INFO - Remove worker (stimulus_id='handle-worker-cleanup-1732401441.5393436') 8450s 2024-11-23 22:37:21,539 - distributed.scheduler - INFO - Lost all workers 8450s 2024-11-23 22:37:21,541 - distributed.nanny - INFO - Worker closed 8450s 2024-11-23 22:37:21,815 - distributed.dask_worker - INFO - End worker 8450s 2024-11-23 22:37:22,012 - distributed._signals - INFO - Received signal SIGINT (2) 8450s 2024-11-23 22:37:22,012 - distributed.scheduler - INFO - Scheduler closing due to signal-2... 8450s 2024-11-23 22:37:22,013 - distributed.scheduler - INFO - Scheduler closing all comms 8450s 2024-11-23 22:37:22,014 - distributed.scheduler - INFO - Stopped scheduler at 'tls://10.0.4.73:39569' 8450s 2024-11-23 22:37:22,014 - distributed.scheduler - INFO - End scheduler 8450s __________________________________ test_nanny __________________________________ 8450s 8450s self = 8450s address = '127.0.0.1:56611', deserialize = True 8450s connection_args = {'extra_conn_args': {}, 'require_encryption': False, 'ssl_context': } 8450s ip = '127.0.0.1', port = 56611 8450s kwargs = {'ssl_options': } 8450s 8450s async def connect(self, address, deserialize=True, **connection_args): 8450s self._check_encryption(address, connection_args) 8450s ip, port = parse_host_port(address) 8450s kwargs = self._get_connect_args(**connection_args) 8450s 8450s try: 8450s # server_hostname option (for SNI) only works with tornado.iostream.IOStream 8450s if "server_hostname" in kwargs: 8450s stream = await self.client.connect( 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE 8450s ) 8450s stream = await stream.start_tls(False, **kwargs) 8450s else: 8450s > stream = await self.client.connect( 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ) 8450s 8450s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:546: 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s /usr/lib/python3/dist-packages/tornado/tcpclient.py:292: in connect 8450s stream = await stream.start_tls( 8450s /usr/lib/python3/dist-packages/tornado/iostream.py:1367: in _do_ssl_handshake 8450s self.socket.do_handshake() 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s 8450s self = , block = False 8450s 8450s @_sslcopydoc 8450s def do_handshake(self, block=False): 8450s self._check_connected() 8450s timeout = self.gettimeout() 8450s try: 8450s if timeout == 0.0 and block: 8450s self.settimeout(None) 8450s > self._sslobj.do_handshake() 8450s E ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 8450s 8450s /usr/lib/python3.13/ssl.py:1372: SSLCertVerificationError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s loop = 8450s 8450s def test_nanny(loop): 8450s port = open_port() 8450s with popen( 8450s [ 8450s "dask", 8450s "scheduler", 8450s "--no-dashboard", 8450s f"--port={port}", 8450s ] 8450s + tls_args 8450s ) as s: 8450s with popen( 8450s ["dask", "worker", "--no-dashboard", "--nanny", f"tls://127.0.0.1:{port}"] 8450s + tls_args 8450s ) as w: 8450s > with Client( 8450s f"tls://127.0.0.1:{port}", loop=loop, security=tls_security() 8450s ) as c: 8450s 8450s /usr/lib/python3/dist-packages/distributed/cli/tests/test_tls_cli.py:79: 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s /usr/lib/python3/dist-packages/distributed/client.py:1018: in __init__ 8450s self.start(timeout=timeout) 8450s /usr/lib/python3/dist-packages/distributed/client.py:1220: in start 8450s sync(self.loop, self._start, **kwargs) 8450s /usr/lib/python3/dist-packages/distributed/utils.py:438: in sync 8450s raise error 8450s /usr/lib/python3/dist-packages/distributed/utils.py:412: in f 8450s result = yield future 8450s /usr/lib/python3/dist-packages/tornado/gen.py:766: in run 8450s value = future.result() 8450s /usr/lib/python3/dist-packages/distributed/client.py:1299: in _start 8450s await self._ensure_connected(timeout=timeout) 8450s /usr/lib/python3/dist-packages/distributed/client.py:1361: in _ensure_connected 8450s comm = await connect( 8450s /usr/lib/python3/dist-packages/distributed/comm/core.py:342: in connect 8450s comm = await wait_for( 8450s /usr/lib/python3/dist-packages/distributed/utils.py:1960: in wait_for 8450s return await fut 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s 8450s self = 8450s address = '127.0.0.1:56611', deserialize = True 8450s connection_args = {'extra_conn_args': {}, 'require_encryption': False, 'ssl_context': } 8450s ip = '127.0.0.1', port = 56611 8450s kwargs = {'ssl_options': } 8450s 8450s async def connect(self, address, deserialize=True, **connection_args): 8450s self._check_encryption(address, connection_args) 8450s ip, port = parse_host_port(address) 8450s kwargs = self._get_connect_args(**connection_args) 8450s 8450s try: 8450s # server_hostname option (for SNI) only works with tornado.iostream.IOStream 8450s if "server_hostname" in kwargs: 8450s stream = await self.client.connect( 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE 8450s ) 8450s stream = await stream.start_tls(False, **kwargs) 8450s else: 8450s stream = await self.client.connect( 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ) 8450s 8450s # Under certain circumstances tornado will have a closed connection with an 8450s # error and not raise a StreamClosedError. 8450s # 8450s # This occurs with tornado 5.x and openssl 1.1+ 8450s if stream.closed() and stream.error: 8450s raise StreamClosedError(stream.error) 8450s 8450s except StreamClosedError as e: 8450s # The socket connect() call failed 8450s convert_stream_closed_error(self, e) 8450s except SSLCertVerificationError as err: 8450s > raise FatalCommClosedError( 8450s "TLS certificate does not match. Check your security settings. " 8450s "More info at https://distributed.dask.org/en/latest/tls.html" 8450s ) from err 8450s E distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 8450s 8450s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:561: FatalCommClosedError 8450s ----------------------------- Captured stderr call ----------------------------- 8450s 2024-11-23 22:37:23,545 - distributed.scheduler - INFO - ----------------------------------------------- 8450s 2024-11-23 22:37:23,581 - distributed.http.proxy - INFO - To route to workers diagnostics web server please install jupyter-server-proxy: python -m pip install jupyter-server-proxy 8450s 2024-11-23 22:37:23,586 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:37:23,597 - distributed.scheduler - INFO - ----------------------------------------------- 8450s 2024-11-23 22:37:23,601 - distributed.scheduler - INFO - Scheduler at: tls://10.0.4.73:56611 8450s 2024-11-23 22:37:23,601 - distributed.scheduler - INFO - dashboard at: http://10.0.4.73:8787/status 8450s 2024-11-23 22:37:23,602 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:37:23,623 - distributed.nanny - INFO - Start Nanny at: 'tls://127.0.0.1:43977' 8450s 2024-11-23 22:37:24,283 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42899 8450s 2024-11-23 22:37:24,283 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42899 8450s 2024-11-23 22:37:24,283 - distributed.worker - INFO - dashboard at: 127.0.0.1:39365 8450s 2024-11-23 22:37:24,283 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:56611 8450s 2024-11-23 22:37:24,284 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:37:24,284 - distributed.worker - INFO - Threads: 8 8450s 2024-11-23 22:37:24,284 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:37:24,284 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-a8zzcj75 8450s 2024-11-23 22:37:24,284 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:37:24,426 - distributed.comm.tcp - WARNING - Listener on 'tls://0.0.0.0:56611': TLS handshake failed with remote 'tls://127.0.0.1:34024': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1000) 8450s 2024-11-23 22:37:24,426 - distributed._signals - INFO - Received signal SIGINT (2) 8450s 2024-11-23 22:37:24,427 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:43977'. Reason: signal-2 8450s 2024-11-23 22:37:24,610 - distributed.scheduler - INFO - Register worker 8450s 2024-11-23 22:37:25,061 - distributed.scheduler - INFO - Starting worker compute stream, tls://127.0.0.1:42899 8450s 2024-11-23 22:37:25,062 - distributed.core - INFO - Starting established connection to tls://127.0.0.1:34010 8450s 2024-11-23 22:37:25,062 - distributed.worker - INFO - Starting Worker plugin shuffle 8450s 2024-11-23 22:37:25,063 - distributed.worker - INFO - Registered to: tls://127.0.0.1:56611 8450s 2024-11-23 22:37:25,063 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:37:25,064 - distributed.core - INFO - Starting established connection to tls://127.0.0.1:56611 8450s 2024-11-23 22:37:25,091 - distributed.nanny - INFO - Nanny asking worker to close. Reason: signal-2 8450s 2024-11-23 22:37:25,092 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42899. Reason: signal-2 8450s 2024-11-23 22:37:25,094 - distributed.core - INFO - Received 'close-stream' from tls://127.0.0.1:34010; closing. 8450s 2024-11-23 22:37:25,094 - distributed.core - INFO - Connection to tls://127.0.0.1:56611 has been closed. 8450s 2024-11-23 22:37:25,095 - distributed.scheduler - INFO - Remove worker (stimulus_id='handle-worker-cleanup-1732401445.0955913') 8450s 2024-11-23 22:37:25,096 - distributed.scheduler - INFO - Lost all workers 8450s 2024-11-23 22:37:25,097 - distributed.nanny - INFO - Worker closed 8450s 2024-11-23 22:37:25,370 - distributed.dask_worker - INFO - End worker 8450s 2024-11-23 22:37:25,594 - distributed._signals - INFO - Received signal SIGINT (2) 8450s 2024-11-23 22:37:25,594 - distributed.scheduler - INFO - Scheduler closing due to signal-2... 8450s 2024-11-23 22:37:25,595 - distributed.scheduler - INFO - Scheduler closing all comms 8450s 2024-11-23 22:37:25,596 - distributed.scheduler - INFO - Stopped scheduler at 'tls://10.0.4.73:56611' 8450s 2024-11-23 22:37:25,597 - distributed.scheduler - INFO - End scheduler 8450s ____________________________ test_separate_key_cert ____________________________ 8450s 8450s self = 8450s address = '127.0.0.1:50625', deserialize = True 8450s connection_args = {'extra_conn_args': {}, 'require_encryption': False, 'ssl_context': } 8450s ip = '127.0.0.1', port = 50625 8450s kwargs = {'ssl_options': } 8450s 8450s async def connect(self, address, deserialize=True, **connection_args): 8450s self._check_encryption(address, connection_args) 8450s ip, port = parse_host_port(address) 8450s kwargs = self._get_connect_args(**connection_args) 8450s 8450s try: 8450s # server_hostname option (for SNI) only works with tornado.iostream.IOStream 8450s if "server_hostname" in kwargs: 8450s stream = await self.client.connect( 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE 8450s ) 8450s stream = await stream.start_tls(False, **kwargs) 8450s else: 8450s > stream = await self.client.connect( 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ) 8450s 8450s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:546: 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s /usr/lib/python3/dist-packages/tornado/tcpclient.py:292: in connect 8450s stream = await stream.start_tls( 8450s /usr/lib/python3/dist-packages/tornado/iostream.py:1367: in _do_ssl_handshake 8450s self.socket.do_handshake() 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s 8450s self = , block = False 8450s 8450s @_sslcopydoc 8450s def do_handshake(self, block=False): 8450s self._check_connected() 8450s timeout = self.gettimeout() 8450s try: 8450s if timeout == 0.0 and block: 8450s self.settimeout(None) 8450s > self._sslobj.do_handshake() 8450s E ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 8450s 8450s /usr/lib/python3.13/ssl.py:1372: SSLCertVerificationError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s loop = 8450s 8450s def test_separate_key_cert(loop): 8450s port = open_port() 8450s with popen( 8450s [ 8450s "dask", 8450s "scheduler", 8450s "--no-dashboard", 8450s f"--port={port}", 8450s ] 8450s + tls_args_2 8450s ) as s: 8450s with popen( 8450s ["dask", "worker", "--no-dashboard", f"tls://127.0.0.1:{port}"] + tls_args_2 8450s ) as w: 8450s > with Client( 8450s f"tls://127.0.0.1:{port}", loop=loop, security=tls_security() 8450s ) as c: 8450s 8450s /usr/lib/python3/dist-packages/distributed/cli/tests/test_tls_cli.py:99: 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s /usr/lib/python3/dist-packages/distributed/client.py:1018: in __init__ 8450s self.start(timeout=timeout) 8450s /usr/lib/python3/dist-packages/distributed/client.py:1220: in start 8450s sync(self.loop, self._start, **kwargs) 8450s /usr/lib/python3/dist-packages/distributed/utils.py:438: in sync 8450s raise error 8450s /usr/lib/python3/dist-packages/distributed/utils.py:412: in f 8450s result = yield future 8450s /usr/lib/python3/dist-packages/tornado/gen.py:766: in run 8450s value = future.result() 8450s /usr/lib/python3/dist-packages/distributed/client.py:1299: in _start 8450s await self._ensure_connected(timeout=timeout) 8450s /usr/lib/python3/dist-packages/distributed/client.py:1361: in _ensure_connected 8450s comm = await connect( 8450s /usr/lib/python3/dist-packages/distributed/comm/core.py:342: in connect 8450s comm = await wait_for( 8450s /usr/lib/python3/dist-packages/distributed/utils.py:1960: in wait_for 8450s return await fut 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s 8450s self = 8450s address = '127.0.0.1:50625', deserialize = True 8450s connection_args = {'extra_conn_args': {}, 'require_encryption': False, 'ssl_context': } 8450s ip = '127.0.0.1', port = 50625 8450s kwargs = {'ssl_options': } 8450s 8450s async def connect(self, address, deserialize=True, **connection_args): 8450s self._check_encryption(address, connection_args) 8450s ip, port = parse_host_port(address) 8450s kwargs = self._get_connect_args(**connection_args) 8450s 8450s try: 8450s # server_hostname option (for SNI) only works with tornado.iostream.IOStream 8450s if "server_hostname" in kwargs: 8450s stream = await self.client.connect( 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE 8450s ) 8450s stream = await stream.start_tls(False, **kwargs) 8450s else: 8450s stream = await self.client.connect( 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ) 8450s 8450s # Under certain circumstances tornado will have a closed connection with an 8450s # error and not raise a StreamClosedError. 8450s # 8450s # This occurs with tornado 5.x and openssl 1.1+ 8450s if stream.closed() and stream.error: 8450s raise StreamClosedError(stream.error) 8450s 8450s except StreamClosedError as e: 8450s # The socket connect() call failed 8450s convert_stream_closed_error(self, e) 8450s except SSLCertVerificationError as err: 8450s > raise FatalCommClosedError( 8450s "TLS certificate does not match. Check your security settings. " 8450s "More info at https://distributed.dask.org/en/latest/tls.html" 8450s ) from err 8450s E distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 8450s 8450s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:561: FatalCommClosedError 8450s ----------------------------- Captured stderr call ----------------------------- 8450s 2024-11-23 22:37:27,227 - distributed.scheduler - INFO - ----------------------------------------------- 8450s 2024-11-23 22:37:27,259 - distributed.http.proxy - INFO - To route to workers diagnostics web server please install jupyter-server-proxy: python -m pip install jupyter-server-proxy 8450s 2024-11-23 22:37:27,264 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:37:27,276 - distributed.scheduler - INFO - ----------------------------------------------- 8450s 2024-11-23 22:37:27,279 - distributed.scheduler - INFO - Scheduler at: tls://10.0.4.73:50625 8450s 2024-11-23 22:37:27,280 - distributed.scheduler - INFO - dashboard at: http://10.0.4.73:8787/status 8450s 2024-11-23 22:37:27,280 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:37:27,330 - distributed.comm.tcp - WARNING - Listener on 'tls://0.0.0.0:50625': TLS handshake failed with remote 'tls://127.0.0.1:41434': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1000) 8450s 2024-11-23 22:37:27,331 - distributed._signals - INFO - Received signal SIGINT (2) 8450s 2024-11-23 22:37:27,331 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:42365'. Reason: signal-2 8450s 2024-11-23 22:37:27,337 - distributed.dask_worker - INFO - End worker 8450s ConnectionRefusedError: [Errno 111] Connection refused 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 559, in connect 8450s convert_stream_closed_error(self, e) 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 140, in convert_stream_closed_error 8450s raise CommClosedError(f"in {obj}: {exc.__class__.__name__}: {exc}") from exc 8450s distributed.comm.core.CommClosedError: in : ConnectionRefusedError: [Errno 111] Connection refused 8450s 8450s During handling of the above exception, another exception occurred: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 8450s return await self._connect(addr=addr, timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 8450s comm = await connect( 8450s ^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 366, in connect 8450s await asyncio.sleep(backoff) 8450s File "/usr/lib/python3.12/asyncio/tasks.py", line 665, in sleep 8450s return await future 8450s ^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1611, in connect 8450s async with asyncio.timeout(math.inf) as scope: 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3.12/asyncio/timeouts.py", line 115, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s During handling of the above exception, another exception occurred: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 8450s comm = await self.rpc.connect(saddr) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1632, in connect 8450s raise CommClosedError(reason) 8450s distributed.comm.core.CommClosedError: ConnectionPool closing. 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/bin/dask", line 8, in 8450s sys.exit(main()) 8450s ^^^^^^ 8450s File "/usr/lib/python3/dist-packages/dask/__main__.py", line 7, in main 8450s run_cli() 8450s File "/usr/lib/python3/dist-packages/dask/cli.py", line 209, in run_cli 8450s cli() 8450s File "/usr/lib/python3/dist-packages/click/core.py", line 1157, in __call__ 8450s return self.main(*args, **kwargs) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/click/core.py", line 1078, in main 8450s rv = self.invoke(ctx) 8450s ^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/click/core.py", line 1688, in invoke 8450s return _process_result(sub_ctx.command.invoke(sub_ctx)) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/click/core.py", line 1434, in invoke 8450s return ctx.invoke(self.callback, **ctx.params) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/click/core.py", line 783, in invoke 8450s return __callback(*args, **kwargs) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/cli/dask_worker.py", line 450, in main 8450s asyncio_run(run(), loop_factory=get_loop_factory()) 8450s File "/usr/lib/python3.12/asyncio/runners.py", line 194, in run 8450s return runner.run(main) 8450s ^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3.12/asyncio/runners.py", line 118, in run 8450s return self._loop.run_until_complete(task) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3.12/asyncio/base_events.py", line 686, in run_until_complete 8450s return future.result() 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/cli/dask_worker.py", line 447, in run 8450s [task.result() for task in done] 8450s ^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/cli/dask_worker.py", line 420, in wait_for_nannies_to_finish 8450s await asyncio.gather(*nannies) 8450s File "/usr/lib/python3.12/asyncio/tasks.py", line 684, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 8450s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 8450s RuntimeError: Nanny failed to start. 8450s 2024-11-23 22:37:30,103 - distributed._signals - INFO - Received signal SIGINT (2) 8450s 2024-11-23 22:37:30,103 - distributed.scheduler - INFO - Scheduler closing due to signal-2... 8450s 2024-11-23 22:37:30,104 - distributed.scheduler - INFO - Scheduler closing all comms 8450s 2024-11-23 22:37:30,105 - distributed.scheduler - INFO - Stopped scheduler at 'tls://10.0.4.73:50625' 8450s 2024-11-23 22:37:30,106 - distributed.scheduler - INFO - End scheduler 8450s _____________________________ test_use_config_file _____________________________ 8450s 8450s self = 8450s address = '127.0.0.1:46799', deserialize = True 8450s connection_args = {'extra_conn_args': {}, 'require_encryption': False, 'ssl_context': } 8450s ip = '127.0.0.1', port = 46799 8450s kwargs = {'ssl_options': } 8450s 8450s async def connect(self, address, deserialize=True, **connection_args): 8450s self._check_encryption(address, connection_args) 8450s ip, port = parse_host_port(address) 8450s kwargs = self._get_connect_args(**connection_args) 8450s 8450s try: 8450s # server_hostname option (for SNI) only works with tornado.iostream.IOStream 8450s if "server_hostname" in kwargs: 8450s stream = await self.client.connect( 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE 8450s ) 8450s stream = await stream.start_tls(False, **kwargs) 8450s else: 8450s > stream = await self.client.connect( 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ) 8450s 8450s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:546: 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s /usr/lib/python3/dist-packages/tornado/tcpclient.py:292: in connect 8450s stream = await stream.start_tls( 8450s /usr/lib/python3/dist-packages/tornado/iostream.py:1367: in _do_ssl_handshake 8450s self.socket.do_handshake() 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s 8450s self = , block = False 8450s 8450s @_sslcopydoc 8450s def do_handshake(self, block=False): 8450s self._check_connected() 8450s timeout = self.gettimeout() 8450s try: 8450s if timeout == 0.0 and block: 8450s self.settimeout(None) 8450s > self._sslobj.do_handshake() 8450s E ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 8450s 8450s /usr/lib/python3.13/ssl.py:1372: SSLCertVerificationError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s loop = 8450s 8450s def test_use_config_file(loop): 8450s port = open_port() 8450s with new_config_file(tls_only_config()): 8450s with popen( 8450s [ 8450s "dask", 8450s "scheduler", 8450s "--no-dashboard", 8450s "--host", 8450s "tls://", 8450s "--port", 8450s str(port), 8450s ] 8450s ) as s: 8450s with popen( 8450s ["dask", "worker", "--no-dashboard", f"tls://127.0.0.1:{port}"] 8450s ) as w: 8450s > with Client( 8450s f"tls://127.0.0.1:{port}", loop=loop, security=tls_security() 8450s ) as c: 8450s 8450s /usr/lib/python3/dist-packages/distributed/cli/tests/test_tls_cli.py:122: 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s /usr/lib/python3/dist-packages/distributed/client.py:1018: in __init__ 8450s self.start(timeout=timeout) 8450s /usr/lib/python3/dist-packages/distributed/client.py:1220: in start 8450s sync(self.loop, self._start, **kwargs) 8450s /usr/lib/python3/dist-packages/distributed/utils.py:438: in sync 8450s raise error 8450s /usr/lib/python3/dist-packages/distributed/utils.py:412: in f 8450s result = yield future 8450s /usr/lib/python3/dist-packages/tornado/gen.py:766: in run 8450s value = future.result() 8450s /usr/lib/python3/dist-packages/distributed/client.py:1299: in _start 8450s await self._ensure_connected(timeout=timeout) 8450s /usr/lib/python3/dist-packages/distributed/client.py:1361: in _ensure_connected 8450s comm = await connect( 8450s /usr/lib/python3/dist-packages/distributed/comm/core.py:342: in connect 8450s comm = await wait_for( 8450s /usr/lib/python3/dist-packages/distributed/utils.py:1960: in wait_for 8450s return await fut 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s 8450s self = 8450s address = '127.0.0.1:46799', deserialize = True 8450s connection_args = {'extra_conn_args': {}, 'require_encryption': False, 'ssl_context': } 8450s ip = '127.0.0.1', port = 46799 8450s kwargs = {'ssl_options': } 8450s 8450s async def connect(self, address, deserialize=True, **connection_args): 8450s self._check_encryption(address, connection_args) 8450s ip, port = parse_host_port(address) 8450s kwargs = self._get_connect_args(**connection_args) 8450s 8450s try: 8450s # server_hostname option (for SNI) only works with tornado.iostream.IOStream 8450s if "server_hostname" in kwargs: 8450s stream = await self.client.connect( 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE 8450s ) 8450s stream = await stream.start_tls(False, **kwargs) 8450s else: 8450s stream = await self.client.connect( 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ) 8450s 8450s # Under certain circumstances tornado will have a closed connection with an 8450s # error and not raise a StreamClosedError. 8450s # 8450s # This occurs with tornado 5.x and openssl 1.1+ 8450s if stream.closed() and stream.error: 8450s raise StreamClosedError(stream.error) 8450s 8450s except StreamClosedError as e: 8450s # The socket connect() call failed 8450s convert_stream_closed_error(self, e) 8450s except SSLCertVerificationError as err: 8450s > raise FatalCommClosedError( 8450s "TLS certificate does not match. Check your security settings. " 8450s "More info at https://distributed.dask.org/en/latest/tls.html" 8450s ) from err 8450s E distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 8450s 8450s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:561: FatalCommClosedError 8450s ----------------------------- Captured stderr call ----------------------------- 8450s 2024-11-23 22:37:31,410 - distributed.scheduler - INFO - ----------------------------------------------- 8450s 2024-11-23 22:37:31,433 - distributed.http.proxy - INFO - To route to workers diagnostics web server please install jupyter-server-proxy: python -m pip install jupyter-server-proxy 8450s 2024-11-23 22:37:31,437 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:37:31,444 - distributed.scheduler - INFO - ----------------------------------------------- 8450s 2024-11-23 22:37:31,447 - distributed.scheduler - INFO - Scheduler at: tls://10.0.4.73:46799 8450s 2024-11-23 22:37:31,447 - distributed.scheduler - INFO - dashboard at: http://10.0.4.73:8787/status 8450s 2024-11-23 22:37:31,447 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:37:31,471 - distributed.nanny - INFO - Start Nanny at: 'tls://127.0.0.1:35617' 8450s 2024-11-23 22:37:32,144 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35541 8450s 2024-11-23 22:37:32,144 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35541 8450s 2024-11-23 22:37:32,144 - distributed.worker - INFO - dashboard at: 127.0.0.1:39491 8450s 2024-11-23 22:37:32,144 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46799 8450s 2024-11-23 22:37:32,145 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:37:32,145 - distributed.worker - INFO - Threads: 8 8450s 2024-11-23 22:37:32,145 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:37:32,145 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ueif8kmi 8450s 2024-11-23 22:37:32,145 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:37:32,352 - distributed.comm.tcp - WARNING - Listener on 'tls://0.0.0.0:46799': TLS handshake failed with remote 'tls://127.0.0.1:49642': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1000) 8450s 2024-11-23 22:37:32,353 - distributed._signals - INFO - Received signal SIGINT (2) 8450s 2024-11-23 22:37:32,353 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:35617'. Reason: signal-2 8450s 2024-11-23 22:37:32,468 - distributed.scheduler - INFO - Register worker 8450s 2024-11-23 22:37:32,767 - distributed.scheduler - INFO - Starting worker compute stream, tls://127.0.0.1:35541 8450s 2024-11-23 22:37:32,767 - distributed.core - INFO - Starting established connection to tls://127.0.0.1:49626 8450s 2024-11-23 22:37:32,768 - distributed.worker - INFO - Starting Worker plugin shuffle 8450s 2024-11-23 22:37:32,769 - distributed.worker - INFO - Registered to: tls://127.0.0.1:46799 8450s 2024-11-23 22:37:32,769 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:37:32,770 - distributed.core - INFO - Starting established connection to tls://127.0.0.1:46799 8450s 2024-11-23 22:37:32,793 - distributed.nanny - INFO - Nanny asking worker to close. Reason: signal-2 8450s 2024-11-23 22:37:32,794 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35541. Reason: signal-2 8450s 2024-11-23 22:37:32,797 - distributed.core - INFO - Received 'close-stream' from tls://127.0.0.1:49626; closing. 8450s 2024-11-23 22:37:32,797 - distributed.core - INFO - Connection to tls://127.0.0.1:46799 has been closed. 8450s 2024-11-23 22:37:32,797 - distributed.scheduler - INFO - Remove worker (stimulus_id='handle-worker-cleanup-1732401452.7975268') 8450s 2024-11-23 22:37:32,797 - distributed.scheduler - INFO - Lost all workers 8450s 2024-11-23 22:37:32,799 - distributed.nanny - INFO - Worker closed 8450s 2024-11-23 22:37:33,069 - distributed.dask_worker - INFO - End worker 8450s 2024-11-23 22:37:33,269 - distributed._signals - INFO - Received signal SIGINT (2) 8450s 2024-11-23 22:37:33,270 - distributed.scheduler - INFO - Scheduler closing due to signal-2... 8450s 2024-11-23 22:37:33,270 - distributed.scheduler - INFO - Scheduler closing all comms 8450s 2024-11-23 22:37:33,271 - distributed.scheduler - INFO - Stopped scheduler at 'tls://10.0.4.73:46799' 8450s 2024-11-23 22:37:33,271 - distributed.scheduler - INFO - End scheduler 8450s __________________________________ test_basic __________________________________ 8450s 8450s @pytest.mark.skipif(WINDOWS, reason="distributed#7434") 8450s @gen_test() 8450s async def test_basic(): 8450s async with SubprocessCluster( 8450s asynchronous=True, 8450s dashboard_address=":0", 8450s scheduler_kwargs={"idle_timeout": "5s"}, 8450s worker_kwargs={"death_timeout": "5s"}, 8450s ) as cluster: 8450s async with Client(cluster, asynchronous=True) as client: 8450s > result = await client.submit(lambda x: x + 1, 10) 8450s 8450s /usr/lib/python3/dist-packages/distributed/deploy/tests/test_subprocess.py:27: 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s 8450s self = 8450s raiseit = True 8450s 8450s async def _result(self, raiseit=True): 8450s await self._state.wait() 8450s if self.status == "error": 8450s exc = clean_exception(self._state.exception, self._state.traceback) 8450s if raiseit: 8450s typ, exc, tb = exc 8450s > raise exc.with_traceback(tb) 8450s E SystemError: no locals found when setting up annotations 8450s 8450s /usr/lib/python3/dist-packages/distributed/client.py:337: SystemError 8450s ----------------------------- Captured stderr call ----------------------------- 8450s 2024-11-23 22:37:36,253 - distributed.worker - WARNING - Compute Failed 8450s Key: lambda-f3b41d234e8d3805a39c193d3564145c 8450s Function: lambda 8450s args: (10) 8450s kwargs: {} 8450s Exception: "SystemError('no locals found when setting up annotations')" 8450s 8450s ________________________________ test_n_workers ________________________________ 8450s 8450s @pytest.mark.skipif(WINDOWS, reason="distributed#7434") 8450s @gen_test() 8450s async def test_n_workers(): 8450s async with SubprocessCluster( 8450s asynchronous=True, dashboard_address=":0", n_workers=2 8450s ) as cluster: 8450s async with Client(cluster, asynchronous=True) as client: 8450s assert len(cluster.workers) == 2 8450s > result = await client.submit(lambda x: x + 1, 10) 8450s 8450s /usr/lib/python3/dist-packages/distributed/deploy/tests/test_subprocess.py:41: 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s 8450s self = 8450s raiseit = True 8450s 8450s async def _result(self, raiseit=True): 8450s await self._state.wait() 8450s if self.status == "error": 8450s exc = clean_exception(self._state.exception, self._state.traceback) 8450s if raiseit: 8450s typ, exc, tb = exc 8450s > raise exc.with_traceback(tb) 8450s E SystemError: no locals found when setting up annotations 8450s 8450s /usr/lib/python3/dist-packages/distributed/client.py:337: SystemError 8450s ----------------------------- Captured stderr call ----------------------------- 8450s 2024-11-23 22:37:38,803 - distributed.worker - WARNING - Compute Failed 8450s Key: lambda-181b28c0c705f6e48fbf22b0c3a995c6 8450s Function: lambda 8450s args: (10) 8450s kwargs: {} 8450s Exception: "SystemError('no locals found when setting up annotations')" 8450s 8450s _____________________________ test_upload_file_zip _____________________________ 8450s 8450s c = 8450s s = 8450s a = 8450s b = 8450s 8450s @gen_cluster(client=True) 8450s async def test_upload_file_zip(c, s, a, b): 8450s def g(): 8450s import myfile 8450s 8450s return myfile.f() 8450s 8450s with save_sys_modules(): 8450s try: 8450s for value in [123, 456]: 8450s with tmp_text( 8450s "myfile.py", f"def f():\n return {value}" 8450s ) as fn_my_file: 8450s with zipfile.ZipFile("myfile.zip", "w") as z: 8450s z.write(fn_my_file, arcname=os.path.basename(fn_my_file)) 8450s > await c.upload_file("myfile.zip") 8450s 8450s /usr/lib/python3/dist-packages/distributed/tests/test_client.py:1716: 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s /usr/lib/python3/dist-packages/distributed/client.py:3824: in _ 8450s results = await asyncio.gather( 8450s /usr/lib/python3/dist-packages/distributed/client.py:4939: in _register_scheduler_plugin 8450s return await self.scheduler.register_scheduler_plugin( 8450s /usr/lib/python3/dist-packages/distributed/core.py:1395: in send_recv_from_rpc 8450s return await send_recv(comm=comm, op=key, **kwargs) 8450s /usr/lib/python3/dist-packages/distributed/core.py:1179: in send_recv 8450s raise exc.with_traceback(tb) 8450s /usr/lib/python3/dist-packages/distributed/core.py:970: in _handle_comm 8450s result = await result 8450s /usr/lib/python3/dist-packages/distributed/scheduler.py:6035: in register_scheduler_plugin 8450s await result 8450s /usr/lib/python3/dist-packages/distributed/diagnostics/plugin.py:396: in start 8450s await scheduler.upload_file(self.filename, self.data, load=self.load) 8450s /usr/lib/python3/dist-packages/distributed/core.py:563: in upload_file 8450s raise e 8450s /usr/lib/python3/dist-packages/distributed/core.py:560: in upload_file 8450s import_file(out_filename) 8450s /usr/lib/python3/dist-packages/distributed/utils.py:1162: in import_file 8450s names_to_import.extend(names) 8450s /usr/lib/python3/dist-packages/distributed/utils.py:1161: in 8450s names = (mod_info.name for mod_info in pkgutil.iter_modules([path])) 8450s /usr/lib/python3.13/pkgutil.py:116: in iter_modules 8450s for name, ispkg in iter_importer_modules(i, prefix): 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s 8450s """Utilities to support packages.""" 8450s 8450s from collections import namedtuple 8450s from functools import singledispatch as simplegeneric 8450s import importlib 8450s import importlib.util 8450s import importlib.machinery 8450s import os 8450s import os.path 8450s import sys 8450s from types import ModuleType 8450s import warnings 8450s 8450s __all__ = [ 8450s 'get_importer', 'iter_importers', 'get_loader', 'find_loader', 8450s 'walk_packages', 'iter_modules', 'get_data', 8450s 'read_code', 'extend_path', 8450s 'ModuleInfo', 8450s ] 8450s 8450s 8450s ModuleInfo = namedtuple('ModuleInfo', 'module_finder name ispkg') 8450s ModuleInfo.__doc__ = 'A namedtuple with minimal info about a module.' 8450s 8450s 8450s def read_code(stream): 8450s # This helper is needed in order for the PEP 302 emulation to 8450s # correctly handle compiled files 8450s import marshal 8450s 8450s magic = stream.read(4) 8450s if magic != importlib.util.MAGIC_NUMBER: 8450s return None 8450s 8450s stream.read(12) # Skip rest of the header 8450s return marshal.load(stream) 8450s 8450s 8450s def walk_packages(path=None, prefix='', onerror=None): 8450s """Yields ModuleInfo for all modules recursively 8450s on path, or, if path is None, all accessible modules. 8450s 8450s 'path' should be either None or a list of paths to look for 8450s modules in. 8450s 8450s 'prefix' is a string to output on the front of every module name 8450s on output. 8450s 8450s Note that this function must import all *packages* (NOT all 8450s modules!) on the given path, in order to access the __path__ 8450s attribute to find submodules. 8450s 8450s 'onerror' is a function which gets called with one argument (the 8450s name of the package which was being imported) if any exception 8450s occurs while trying to import a package. If no onerror function is 8450s supplied, ImportErrors are caught and ignored, while all other 8450s exceptions are propagated, terminating the search. 8450s 8450s Examples: 8450s 8450s # list all modules python can access 8450s walk_packages() 8450s 8450s # list all submodules of ctypes 8450s walk_packages(ctypes.__path__, ctypes.__name__+'.') 8450s """ 8450s 8450s def seen(p, m={}): 8450s if p in m: 8450s return True 8450s m[p] = True 8450s 8450s for info in iter_modules(path, prefix): 8450s yield info 8450s 8450s if info.ispkg: 8450s try: 8450s __import__(info.name) 8450s except ImportError: 8450s if onerror is not None: 8450s onerror(info.name) 8450s except Exception: 8450s if onerror is not None: 8450s onerror(info.name) 8450s else: 8450s raise 8450s else: 8450s path = getattr(sys.modules[info.name], '__path__', None) or [] 8450s 8450s # don't traverse path items we've seen before 8450s path = [p for p in path if not seen(p)] 8450s 8450s yield from walk_packages(path, info.name+'.', onerror) 8450s 8450s 8450s def iter_modules(path=None, prefix=''): 8450s """Yields ModuleInfo for all submodules on path, 8450s or, if path is None, all top-level modules on sys.path. 8450s 8450s 'path' should be either None or a list of paths to look for 8450s modules in. 8450s 8450s 'prefix' is a string to output on the front of every module name 8450s on output. 8450s """ 8450s if path is None: 8450s importers = iter_importers() 8450s elif isinstance(path, str): 8450s raise ValueError("path must be None or list of paths to look for " 8450s "modules in") 8450s else: 8450s importers = map(get_importer, path) 8450s 8450s yielded = {} 8450s for i in importers: 8450s for name, ispkg in iter_importer_modules(i, prefix): 8450s if name not in yielded: 8450s yielded[name] = 1 8450s yield ModuleInfo(i, name, ispkg) 8450s 8450s 8450s @simplegeneric 8450s def iter_importer_modules(importer, prefix=''): 8450s if not hasattr(importer, 'iter_modules'): 8450s return [] 8450s return importer.iter_modules(prefix) 8450s 8450s 8450s # Implement a file walker for the normal importlib path hook 8450s def _iter_file_finder_modules(importer, prefix=''): 8450s if importer.path is None or not os.path.isdir(importer.path): 8450s return 8450s 8450s yielded = {} 8450s import inspect 8450s try: 8450s filenames = os.listdir(importer.path) 8450s except OSError: 8450s # ignore unreadable directories like import does 8450s filenames = [] 8450s filenames.sort() # handle packages before same-named modules 8450s 8450s for fn in filenames: 8450s modname = inspect.getmodulename(fn) 8450s if modname=='__init__' or modname in yielded: 8450s continue 8450s 8450s path = os.path.join(importer.path, fn) 8450s ispkg = False 8450s 8450s if not modname and os.path.isdir(path) and '.' not in fn: 8450s modname = fn 8450s try: 8450s dircontents = os.listdir(path) 8450s except OSError: 8450s # ignore unreadable directories like import does 8450s dircontents = [] 8450s for fn in dircontents: 8450s subname = inspect.getmodulename(fn) 8450s if subname=='__init__': 8450s ispkg = True 8450s break 8450s else: 8450s continue # not a package 8450s 8450s if modname and '.' not in modname: 8450s yielded[modname] = 1 8450s yield prefix + modname, ispkg 8450s 8450s iter_importer_modules.register( 8450s importlib.machinery.FileFinder, _iter_file_finder_modules) 8450s 8450s 8450s try: 8450s import zipimport 8450s from zipimport import zipimporter 8450s 8450s def iter_zipimport_modules(importer, prefix=''): 8450s > dirlist = sorted(zipimport._zip_directory_cache[importer.archive]) 8450s E KeyError: '/tmp/dask-scratch-space/scheduler-w6bmicz4/myfile.zip' 8450s 8450s /usr/lib/python3.13/pkgutil.py:179: KeyError 8450s ----------------------------- Captured stdout call ----------------------------- 8450s Dumped cluster state to test_cluster_dump/test_upload_file_zip.yaml 8450s ----------------------------- Captured stderr call ----------------------------- 8450s 2024-11-23 22:37:38,957 - distributed.http.proxy - INFO - To route to workers diagnostics web server please install jupyter-server-proxy: python -m pip install jupyter-server-proxy 8450s 2024-11-23 22:37:38,959 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:37:38,960 - distributed.diskutils - INFO - Found stale lock file and directory '/tmp/dask-scratch-space/worker-y15qglhf', purging 8450s 2024-11-23 22:37:38,961 - distributed.diskutils - INFO - Found stale lock file and directory '/tmp/dask-scratch-space/worker-s21wv17i', purging 8450s 2024-11-23 22:37:38,967 - distributed.scheduler - INFO - Scheduler at: tcp://127.0.0.1:43637 8450s 2024-11-23 22:37:38,967 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42687/status 8450s 2024-11-23 22:37:38,967 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:37:38,982 - distributed.worker - INFO - Start worker at: tcp://127.0.0.1:35943 8450s 2024-11-23 22:37:38,982 - distributed.worker - INFO - Listening to: tcp://127.0.0.1:35943 8450s 2024-11-23 22:37:38,982 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:37:38,982 - distributed.worker - INFO - dashboard at: 127.0.0.1:44367 8450s 2024-11-23 22:37:38,982 - distributed.worker - INFO - Waiting to connect to: tcp://127.0.0.1:43637 8450s 2024-11-23 22:37:38,982 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:37:38,983 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:37:38,983 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:37:38,983 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-tm4cstrm 8450s 2024-11-23 22:37:38,983 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:37:38,984 - distributed.worker - INFO - Start worker at: tcp://127.0.0.1:36267 8450s 2024-11-23 22:37:38,984 - distributed.worker - INFO - Listening to: tcp://127.0.0.1:36267 8450s 2024-11-23 22:37:38,984 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:37:38,984 - distributed.worker - INFO - dashboard at: 127.0.0.1:38827 8450s 2024-11-23 22:37:38,984 - distributed.worker - INFO - Waiting to connect to: tcp://127.0.0.1:43637 8450s 2024-11-23 22:37:38,984 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:37:38,984 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:37:38,984 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:37:38,984 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-yllgss2w 8450s 2024-11-23 22:37:38,984 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:37:38,990 - distributed.scheduler - INFO - Register worker 8450s 2024-11-23 22:37:38,991 - distributed.scheduler - INFO - Starting worker compute stream, tcp://127.0.0.1:35943 8450s 2024-11-23 22:37:38,991 - distributed.core - INFO - Starting established connection to tcp://127.0.0.1:49820 8450s 2024-11-23 22:37:38,992 - distributed.scheduler - INFO - Register worker 8450s 2024-11-23 22:37:38,993 - distributed.scheduler - INFO - Starting worker compute stream, tcp://127.0.0.1:36267 8450s 2024-11-23 22:37:38,993 - distributed.core - INFO - Starting established connection to tcp://127.0.0.1:49832 8450s 2024-11-23 22:37:38,993 - distributed.worker - INFO - Starting Worker plugin shuffle 8450s 2024-11-23 22:37:38,994 - distributed.worker - INFO - Starting Worker plugin shuffle 8450s 2024-11-23 22:37:38,994 - distributed.worker - INFO - Registered to: tcp://127.0.0.1:43637 8450s 2024-11-23 22:37:38,994 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:37:38,995 - distributed.worker - INFO - Registered to: tcp://127.0.0.1:43637 8450s 2024-11-23 22:37:38,995 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:37:38,995 - distributed.core - INFO - Starting established connection to tcp://127.0.0.1:43637 8450s 2024-11-23 22:37:38,996 - distributed.core - INFO - Starting established connection to tcp://127.0.0.1:43637 8450s 2024-11-23 22:37:39,001 - distributed.scheduler - INFO - Receive client connection: Client-8b392547-a9eb-11ef-bf02-00163e4db70f 8450s 2024-11-23 22:37:39,002 - distributed.core - INFO - Starting established connection to tcp://127.0.0.1:49844 8450s 2024-11-23 22:37:39,010 - distributed.utils - INFO - Reload module myfile from .zip file 8450s 2024-11-23 22:37:39,013 - distributed.scheduler - INFO - Registering Worker plugin myfile.zipc3f9a0a2-4906-4e4e-8d0c-2c24952ca07b 8450s 2024-11-23 22:37:39,016 - distributed.worker - INFO - Starting Worker plugin myfile.zipc3f9a0a2-4906-4e4e-8d0c-2c24952ca07b 8450s 2024-11-23 22:37:39,018 - distributed.utils - INFO - Reload module myfile from .zip file 8450s 2024-11-23 22:37:39,020 - distributed.worker - INFO - Starting Worker plugin myfile.zipc3f9a0a2-4906-4e4e-8d0c-2c24952ca07b 8450s 2024-11-23 22:37:39,022 - distributed.utils - INFO - Reload module myfile from .zip file 8450s 2024-11-23 22:37:39,040 - distributed.core - ERROR - '/tmp/dask-scratch-space/scheduler-w6bmicz4/myfile.zip' 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 560, in upload_file 8450s import_file(out_filename) 8450s ~~~~~~~~~~~^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1162, in import_file 8450s names_to_import.extend(names) 8450s ~~~~~~~~~~~~~~~~~~~~~~^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1161, in 8450s names = (mod_info.name for mod_info in pkgutil.iter_modules([path])) 8450s ~~~~~~~~~~~~~~~~~~~~^^^^^^^^ 8450s File "/usr/lib/python3.13/pkgutil.py", line 116, in iter_modules 8450s for name, ispkg in iter_importer_modules(i, prefix): 8450s ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^ 8450s File "/usr/lib/python3.13/pkgutil.py", line 179, in iter_zipimport_modules 8450s dirlist = sorted(zipimport._zip_directory_cache[importer.archive]) 8450s ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^ 8450s KeyError: '/tmp/dask-scratch-space/scheduler-w6bmicz4/myfile.zip' 8450s 2024-11-23 22:37:39,041 - distributed.core - ERROR - Exception while handling op register_scheduler_plugin 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 970, in _handle_comm 8450s result = await result 8450s ^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/scheduler.py", line 6035, in register_scheduler_plugin 8450s await result 8450s File "/usr/lib/python3/dist-packages/distributed/diagnostics/plugin.py", line 396, in start 8450s await scheduler.upload_file(self.filename, self.data, load=self.load) 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 563, in upload_file 8450s raise e 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 560, in upload_file 8450s import_file(out_filename) 8450s ~~~~~~~~~~~^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1162, in import_file 8450s names_to_import.extend(names) 8450s ~~~~~~~~~~~~~~~~~~~~~~^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1161, in 8450s names = (mod_info.name for mod_info in pkgutil.iter_modules([path])) 8450s ~~~~~~~~~~~~~~~~~~~~^^^^^^^^ 8450s File "/usr/lib/python3.13/pkgutil.py", line 116, in iter_modules 8450s for name, ispkg in iter_importer_modules(i, prefix): 8450s ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^ 8450s File "/usr/lib/python3.13/pkgutil.py", line 179, in iter_zipimport_modules 8450s dirlist = sorted(zipimport._zip_directory_cache[importer.archive]) 8450s ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^ 8450s KeyError: '/tmp/dask-scratch-space/scheduler-w6bmicz4/myfile.zip' 8450s 2024-11-23 22:37:39,049 - distributed.scheduler - INFO - Registering Worker plugin myfile.zip1e4024ad-81c6-4337-935b-01d80061edf7 8450s 2024-11-23 22:37:39,052 - distributed.worker - INFO - Starting Worker plugin myfile.zip1e4024ad-81c6-4337-935b-01d80061edf7 8450s 2024-11-23 22:37:39,054 - distributed.core - ERROR - '/tmp/dask-scratch-space/worker-tm4cstrm/myfile.zip' 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 560, in upload_file 8450s import_file(out_filename) 8450s ~~~~~~~~~~~^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1162, in import_file 8450s names_to_import.extend(names) 8450s ~~~~~~~~~~~~~~~~~~~~~~^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1161, in 8450s names = (mod_info.name for mod_info in pkgutil.iter_modules([path])) 8450s ~~~~~~~~~~~~~~~~~~~~^^^^^^^^ 8450s File "/usr/lib/python3.13/pkgutil.py", line 116, in iter_modules 8450s for name, ispkg in iter_importer_modules(i, prefix): 8450s ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^ 8450s File "/usr/lib/python3.13/pkgutil.py", line 179, in iter_zipimport_modules 8450s dirlist = sorted(zipimport._zip_directory_cache[importer.archive]) 8450s ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^ 8450s KeyError: '/tmp/dask-scratch-space/worker-tm4cstrm/myfile.zip' 8450s 2024-11-23 22:37:39,125 - distributed.worker - INFO - Starting Worker plugin myfile.zip1e4024ad-81c6-4337-935b-01d80061edf7 8450s 2024-11-23 22:37:39,127 - distributed.utils - INFO - Reload module myfile from .zip file 8450s 2024-11-23 22:37:39,129 - distributed.scheduler - INFO - Remove client Client-8b392547-a9eb-11ef-bf02-00163e4db70f 8450s 2024-11-23 22:37:39,130 - distributed.core - INFO - Received 'close-stream' from tcp://127.0.0.1:49844; closing. 8450s 2024-11-23 22:37:39,130 - distributed.scheduler - INFO - Remove client Client-8b392547-a9eb-11ef-bf02-00163e4db70f 8450s 2024-11-23 22:37:39,132 - distributed.scheduler - INFO - Close client connection: Client-8b392547-a9eb-11ef-bf02-00163e4db70f 8450s 2024-11-23 22:37:39,133 - distributed.worker - INFO - Stopping worker at tcp://127.0.0.1:35943. Reason: worker-close 8450s 2024-11-23 22:37:39,134 - distributed.worker - INFO - Stopping worker at tcp://127.0.0.1:36267. Reason: worker-close 8450s 2024-11-23 22:37:39,136 - distributed.core - INFO - Received 'close-stream' from tcp://127.0.0.1:49820; closing. 8450s 2024-11-23 22:37:39,137 - distributed.scheduler - INFO - Remove worker (stimulus_id='handle-worker-cleanup-1732401459.1373343') 8450s 2024-11-23 22:37:39,137 - distributed.core - INFO - Connection to tcp://127.0.0.1:43637 has been closed. 8450s 2024-11-23 22:37:39,140 - distributed.core - INFO - Connection to tcp://127.0.0.1:43637 has been closed. 8450s 2024-11-23 22:37:39,140 - distributed.core - INFO - Received 'close-stream' from tcp://127.0.0.1:49832; closing. 8450s 2024-11-23 22:37:39,141 - distributed.scheduler - INFO - Remove worker (stimulus_id='handle-worker-cleanup-1732401459.1412146') 8450s 2024-11-23 22:37:39,141 - distributed.scheduler - INFO - Lost all workers 8450s 2024-11-23 22:37:39,144 - distributed.scheduler - INFO - Scheduler closing due to unknown reason... 8450s 2024-11-23 22:37:39,144 - distributed.scheduler - INFO - Scheduler closing all comms 8450s ________________________ test_info_frame_f_lineno[22-4] ________________________ 8450s 8450s f_lasti = 22, f_lineno = 4 8450s 8450s @pytest.mark.parametrize( 8450s "f_lasti,f_lineno", 8450s [ 8450s (-1, 1), 8450s (0, 2), 8450s (1, 2), 8450s (11, 2), 8450s (12, 3), 8450s (21, 4), 8450s (22, 4), 8450s (23, 4), 8450s (24, 2), 8450s (25, 2), 8450s (26, 2), 8450s (27, 2), 8450s (100, 2), 8450s ], 8450s ) 8450s def test_info_frame_f_lineno(f_lasti: int, f_lineno: int) -> None: 8450s > assert info_frame(FakeFrame(f_lasti=f_lasti, f_code=FAKE_CODE)) == { # type: ignore 8450s "filename": "", 8450s "name": "example", 8450s "line_number": f_lineno, 8450s "line": "", 8450s } 8450s 8450s /usr/lib/python3/dist-packages/distributed/tests/test_profile.py:327: 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s /usr/lib/python3/dist-packages/distributed/profile.py:115: in info_frame 8450s line = linecache.getline(co.co_filename, f_lineno, frame.f_globals).lstrip() 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s 8450s filename = '', lineno = None, module_globals = {} 8450s 8450s def getline(filename, lineno, module_globals=None): 8450s """Get a line for a Python source file from the cache. 8450s Update the cache if it doesn't contain an entry for this file already.""" 8450s 8450s lines = getlines(filename, module_globals) 8450s > if 1 <= lineno <= len(lines): 8450s E TypeError: '<=' not supported between instances of 'int' and 'NoneType' 8450s 8450s /usr/lib/python3.13/linecache.py:26: TypeError 8450s ________________________ test_info_frame_f_lineno[23-4] ________________________ 8450s 8450s f_lasti = 23, f_lineno = 4 8450s 8450s @pytest.mark.parametrize( 8450s "f_lasti,f_lineno", 8450s [ 8450s (-1, 1), 8450s (0, 2), 8450s (1, 2), 8450s (11, 2), 8450s (12, 3), 8450s (21, 4), 8450s (22, 4), 8450s (23, 4), 8450s (24, 2), 8450s (25, 2), 8450s (26, 2), 8450s (27, 2), 8450s (100, 2), 8450s ], 8450s ) 8450s def test_info_frame_f_lineno(f_lasti: int, f_lineno: int) -> None: 8450s > assert info_frame(FakeFrame(f_lasti=f_lasti, f_code=FAKE_CODE)) == { # type: ignore 8450s "filename": "", 8450s "name": "example", 8450s "line_number": f_lineno, 8450s "line": "", 8450s } 8450s 8450s /usr/lib/python3/dist-packages/distributed/tests/test_profile.py:327: 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s /usr/lib/python3/dist-packages/distributed/profile.py:115: in info_frame 8450s line = linecache.getline(co.co_filename, f_lineno, frame.f_globals).lstrip() 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s 8450s filename = '', lineno = None, module_globals = {} 8450s 8450s def getline(filename, lineno, module_globals=None): 8450s """Get a line for a Python source file from the cache. 8450s Update the cache if it doesn't contain an entry for this file already.""" 8450s 8450s lines = getlines(filename, module_globals) 8450s > if 1 <= lineno <= len(lines): 8450s E TypeError: '<=' not supported between instances of 'int' and 'NoneType' 8450s 8450s /usr/lib/python3.13/linecache.py:26: TypeError 8450s ________________________ test_call_stack_f_lineno[22-4] ________________________ 8450s 8450s f_lasti = 22, f_lineno = 4 8450s 8450s @pytest.mark.parametrize( 8450s "f_lasti,f_lineno", 8450s [ 8450s (-1, 1), 8450s (0, 2), 8450s (1, 2), 8450s (11, 2), 8450s (12, 3), 8450s (21, 4), 8450s (22, 4), 8450s (23, 4), 8450s (24, 2), 8450s (25, 2), 8450s (26, 2), 8450s (27, 2), 8450s (100, 2), 8450s ], 8450s ) 8450s def test_call_stack_f_lineno(f_lasti: int, f_lineno: int) -> None: 8450s > assert call_stack(FakeFrame(f_lasti=f_lasti, f_code=FAKE_CODE)) == [ # type: ignore 8450s f' File "", line {f_lineno}, in example\n\t' 8450s ] 8450s 8450s /usr/lib/python3/dist-packages/distributed/tests/test_profile.py:354: 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s /usr/lib/python3/dist-packages/distributed/profile.py:263: in call_stack 8450s L.append(repr_frame(cur_frame)) 8450s /usr/lib/python3/dist-packages/distributed/profile.py:105: in repr_frame 8450s line = linecache.getline(co.co_filename, f_lineno, frame.f_globals).lstrip() 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s 8450s filename = '', lineno = None, module_globals = {} 8450s 8450s def getline(filename, lineno, module_globals=None): 8450s """Get a line for a Python source file from the cache. 8450s Update the cache if it doesn't contain an entry for this file already.""" 8450s 8450s lines = getlines(filename, module_globals) 8450s > if 1 <= lineno <= len(lines): 8450s E TypeError: '<=' not supported between instances of 'int' and 'NoneType' 8450s 8450s /usr/lib/python3.13/linecache.py:26: TypeError 8450s ________________________ test_call_stack_f_lineno[23-4] ________________________ 8450s 8450s f_lasti = 23, f_lineno = 4 8450s 8450s @pytest.mark.parametrize( 8450s "f_lasti,f_lineno", 8450s [ 8450s (-1, 1), 8450s (0, 2), 8450s (1, 2), 8450s (11, 2), 8450s (12, 3), 8450s (21, 4), 8450s (22, 4), 8450s (23, 4), 8450s (24, 2), 8450s (25, 2), 8450s (26, 2), 8450s (27, 2), 8450s (100, 2), 8450s ], 8450s ) 8450s def test_call_stack_f_lineno(f_lasti: int, f_lineno: int) -> None: 8450s > assert call_stack(FakeFrame(f_lasti=f_lasti, f_code=FAKE_CODE)) == [ # type: ignore 8450s f' File "", line {f_lineno}, in example\n\t' 8450s ] 8450s 8450s /usr/lib/python3/dist-packages/distributed/tests/test_profile.py:354: 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s /usr/lib/python3/dist-packages/distributed/profile.py:263: in call_stack 8450s L.append(repr_frame(cur_frame)) 8450s /usr/lib/python3/dist-packages/distributed/profile.py:105: in repr_frame 8450s line = linecache.getline(co.co_filename, f_lineno, frame.f_globals).lstrip() 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s 8450s filename = '', lineno = None, module_globals = {} 8450s 8450s def getline(filename, lineno, module_globals=None): 8450s """Get a line for a Python source file from the cache. 8450s Update the cache if it doesn't contain an entry for this file already.""" 8450s 8450s lines = getlines(filename, module_globals) 8450s > if 1 <= lineno <= len(lines): 8450s E TypeError: '<=' not supported between instances of 'int' and 'NoneType' 8450s 8450s /usr/lib/python3.13/linecache.py:26: TypeError 8450s ______________________________ test_broadcast_tls ______________________________ 8450s 8450s fut = , timeout = 0 8450s 8450s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 8450s async with asyncio.timeout(timeout): 8450s > return await fut 8450s 8450s /usr/lib/python3/dist-packages/distributed/utils.py:1960: 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s /usr/lib/python3/dist-packages/distributed/worker.py:1480: in start_unsafe 8450s await self._register_with_scheduler() 8450s /usr/lib/python3/dist-packages/distributed/worker.py:1179: in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s /usr/lib/python3/dist-packages/distributed/comm/core.py:342: in connect 8450s comm = await wait_for( 8450s /usr/lib/python3/dist-packages/distributed/utils.py:1960: in wait_for 8450s return await fut 8450s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:546: in connect 8450s stream = await self.client.connect( 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s 8450s self = , host = '127.0.0.1' 8450s port = 39731, af = 8450s ssl_options = 8450s max_buffer_size = 8364507136.0, source_ip = None, source_port = None 8450s timeout = None 8450s 8450s async def connect( 8450s self, 8450s host: str, 8450s port: int, 8450s af: socket.AddressFamily = socket.AF_UNSPEC, 8450s ssl_options: Optional[Union[Dict[str, Any], ssl.SSLContext]] = None, 8450s max_buffer_size: Optional[int] = None, 8450s source_ip: Optional[str] = None, 8450s source_port: Optional[int] = None, 8450s timeout: Optional[Union[float, datetime.timedelta]] = None, 8450s ) -> IOStream: 8450s """Connect to the given host and port. 8450s 8450s Asynchronously returns an `.IOStream` (or `.SSLIOStream` if 8450s ``ssl_options`` is not None). 8450s 8450s Using the ``source_ip`` kwarg, one can specify the source 8450s IP address to use when establishing the connection. 8450s In case the user needs to resolve and 8450s use a specific interface, it has to be handled outside 8450s of Tornado as this depends very much on the platform. 8450s 8450s Raises `TimeoutError` if the input future does not complete before 8450s ``timeout``, which may be specified in any form allowed by 8450s `.IOLoop.add_timeout` (i.e. a `datetime.timedelta` or an absolute time 8450s relative to `.IOLoop.time`) 8450s 8450s Similarly, when the user requires a certain source port, it can 8450s be specified using the ``source_port`` arg. 8450s 8450s .. versionchanged:: 4.5 8450s Added the ``source_ip`` and ``source_port`` arguments. 8450s 8450s .. versionchanged:: 5.0 8450s Added the ``timeout`` argument. 8450s """ 8450s if timeout is not None: 8450s if isinstance(timeout, numbers.Real): 8450s timeout = IOLoop.current().time() + timeout 8450s elif isinstance(timeout, datetime.timedelta): 8450s timeout = IOLoop.current().time() + timeout.total_seconds() 8450s else: 8450s raise TypeError("Unsupported timeout %r" % timeout) 8450s if timeout is not None: 8450s addrinfo = await gen.with_timeout( 8450s timeout, self.resolver.resolve(host, port, af) 8450s ) 8450s else: 8450s addrinfo = await self.resolver.resolve(host, port, af) 8450s connector = _Connector( 8450s addrinfo, 8450s functools.partial( 8450s self._create_stream, 8450s max_buffer_size, 8450s source_ip=source_ip, 8450s source_port=source_port, 8450s ), 8450s ) 8450s > af, addr, stream = await connector.start(connect_timeout=timeout) 8450s E asyncio.exceptions.CancelledError 8450s 8450s /usr/lib/python3/dist-packages/tornado/tcpclient.py:279: CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s self = 8450s 8450s @final 8450s async def start(self): 8450s async with self._startup_lock: 8450s if self.status == Status.failed: 8450s assert self.__startup_exc is not None 8450s raise self.__startup_exc 8450s elif self.status != Status.init: 8450s return self 8450s timeout = getattr(self, "death_timeout", None) 8450s 8450s async def _close_on_failure(exc: Exception) -> None: 8450s await self.close(reason=f"failure-to-start-{str(type(exc))}") 8450s self.status = Status.failed 8450s self.__startup_exc = exc 8450s 8450s try: 8450s > await wait_for(self.start_unsafe(), timeout=timeout) 8450s 8450s /usr/lib/python3/dist-packages/distributed/core.py:664: 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 8450s async with asyncio.timeout(timeout): 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s 8450s self = 8450s exc_type = 8450s exc_val = CancelledError(), exc_tb = 8450s 8450s async def __aexit__( 8450s self, 8450s exc_type: Optional[Type[BaseException]], 8450s exc_val: Optional[BaseException], 8450s exc_tb: Optional[TracebackType], 8450s ) -> Optional[bool]: 8450s assert self._state in (_State.ENTERED, _State.EXPIRING) 8450s 8450s if self._timeout_handler is not None: 8450s self._timeout_handler.cancel() 8450s self._timeout_handler = None 8450s 8450s if self._state is _State.EXPIRING: 8450s self._state = _State.EXPIRED 8450s 8450s if self._task.uncancel() <= self._cancelling and exc_type is not None: 8450s # Since there are no new cancel requests, we're 8450s # handling this. 8450s if issubclass(exc_type, exceptions.CancelledError): 8450s > raise TimeoutError from exc_val 8450s E TimeoutError 8450s 8450s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s @contextlib.asynccontextmanager 8450s async def _cluster_factory(): 8450s workers = [] 8450s s = None 8450s try: 8450s for _ in range(60): 8450s try: 8450s > s, ws = await start_cluster( 8450s nthreads, 8450s scheduler, 8450s security=security, 8450s Worker=Worker, 8450s scheduler_kwargs=scheduler_kwargs, 8450s worker_kwargs=merge( 8450s {"death_timeout": min(15, int(deadline.remaining))}, 8450s worker_kwargs, 8450s ), 8450s ) 8450s 8450s /usr/lib/python3/dist-packages/distributed/utils_test.py:966: 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s /usr/lib/python3/dist-packages/distributed/utils_test.py:789: in start_cluster 8450s await asyncio.gather(*workers) 8450s /usr/lib/python3.13/asyncio/tasks.py:737: in _wrap_awaitable 8450s return await awaitable 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s 8450s self = 8450s 8450s @final 8450s async def start(self): 8450s async with self._startup_lock: 8450s if self.status == Status.failed: 8450s assert self.__startup_exc is not None 8450s raise self.__startup_exc 8450s elif self.status != Status.init: 8450s return self 8450s timeout = getattr(self, "death_timeout", None) 8450s 8450s async def _close_on_failure(exc: Exception) -> None: 8450s await self.close(reason=f"failure-to-start-{str(type(exc))}") 8450s self.status = Status.failed 8450s self.__startup_exc = exc 8450s 8450s try: 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s except asyncio.TimeoutError as exc: 8450s await _close_on_failure(exc) 8450s > raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s E TimeoutError: Worker start timed out after 0s. 8450s 8450s /usr/lib/python3/dist-packages/distributed/core.py:667: TimeoutError 8450s 8450s During handling of the above exception, another exception occurred: 8450s 8450s fut = ._..test_func..async_fn at 0xe8325a20> 8450s timeout = 60 8450s 8450s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 8450s async with asyncio.timeout(timeout): 8450s > return await fut 8450s 8450s /usr/lib/python3/dist-packages/distributed/utils.py:1960: 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s /usr/lib/python3/dist-packages/distributed/utils_test.py:999: in async_fn 8450s _cluster_factory() as (s, workers), 8450s /usr/lib/python3.13/contextlib.py:214: in __aenter__ 8450s return await anext(self.gen) 8450s /usr/lib/python3/dist-packages/distributed/utils_test.py:983: in _cluster_factory 8450s await asyncio.sleep(1) 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s 8450s delay = 1, result = None 8450s 8450s async def sleep(delay, result=None): 8450s """Coroutine that completes after a given time (in seconds).""" 8450s if delay <= 0: 8450s await __sleep0() 8450s return result 8450s 8450s if math.isnan(delay): 8450s raise ValueError("Invalid delay: NaN (not a number)") 8450s 8450s loop = events.get_running_loop() 8450s future = loop.create_future() 8450s h = loop.call_later(delay, 8450s futures._set_result_unless_cancelled, 8450s future, result) 8450s try: 8450s > return await future 8450s E asyncio.exceptions.CancelledError 8450s 8450s /usr/lib/python3.13/asyncio/tasks.py:718: CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s args = (), kwds = {} 8450s 8450s @wraps(func) 8450s def inner(*args, **kwds): 8450s with self._recreate_cm(): 8450s > return func(*args, **kwds) 8450s 8450s /usr/lib/python3.13/contextlib.py:85: 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s /usr/lib/python3.13/contextlib.py:85: in inner 8450s return func(*args, **kwds) 8450s /usr/lib/python3/dist-packages/distributed/utils_test.py:1102: in test_func 8450s return _run_and_close_tornado(async_fn_outer) 8450s /usr/lib/python3/dist-packages/distributed/utils_test.py:378: in _run_and_close_tornado 8450s return asyncio_run(inner_fn(), loop_factory=get_loop_factory()) 8450s /usr/lib/python3.13/asyncio/runners.py:194: in run 8450s return runner.run(main) 8450s /usr/lib/python3.13/asyncio/runners.py:118: in run 8450s return self._loop.run_until_complete(task) 8450s /usr/lib/python3.13/asyncio/base_events.py:720: in run_until_complete 8450s return future.result() 8450s /usr/lib/python3/dist-packages/distributed/utils_test.py:375: in inner_fn 8450s return await async_fn(*args, **kwargs) 8450s /usr/lib/python3/dist-packages/distributed/utils_test.py:1099: in async_fn_outer 8450s return await utils_wait_for(async_fn(), timeout=timeout * 2) 8450s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 8450s async with asyncio.timeout(timeout): 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s 8450s self = 8450s exc_type = 8450s exc_val = CancelledError(), exc_tb = 8450s 8450s async def __aexit__( 8450s self, 8450s exc_type: Optional[Type[BaseException]], 8450s exc_val: Optional[BaseException], 8450s exc_tb: Optional[TracebackType], 8450s ) -> Optional[bool]: 8450s assert self._state in (_State.ENTERED, _State.EXPIRING) 8450s 8450s if self._timeout_handler is not None: 8450s self._timeout_handler.cancel() 8450s self._timeout_handler = None 8450s 8450s if self._state is _State.EXPIRING: 8450s self._state = _State.EXPIRED 8450s 8450s if self._task.uncancel() <= self._cancelling and exc_type is not None: 8450s # Since there are no new cancel requests, we're 8450s # handling this. 8450s if issubclass(exc_type, exceptions.CancelledError): 8450s > raise TimeoutError from exc_val 8450s E TimeoutError 8450s 8450s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 8450s ----------------------------- Captured stderr call ----------------------------- 8450s 2024-11-23 22:37:40,001 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:37:40,009 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:40,010 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33697/status 8450s 2024-11-23 22:37:40,010 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:37:40,025 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38489 8450s 2024-11-23 22:37:40,025 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38489 8450s 2024-11-23 22:37:40,025 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:37:40,025 - distributed.worker - INFO - dashboard at: 127.0.0.1:33603 8450s 2024-11-23 22:37:40,025 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:40,025 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:37:40,025 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:37:40,025 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:37:40,025 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-315y8i4g 8450s 2024-11-23 22:37:40,025 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:37:40,027 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40549 8450s 2024-11-23 22:37:40,028 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40549 8450s 2024-11-23 22:37:40,028 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:37:40,028 - distributed.worker - INFO - dashboard at: 127.0.0.1:41829 8450s 2024-11-23 22:37:40,028 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:40,028 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:37:40,028 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:37:40,028 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:37:40,028 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-_j37eclv 8450s 2024-11-23 22:37:40,028 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:37:40,041 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:40,041 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:40,042 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:37748': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:40,042 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:37764': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:40,154 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:40,154 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:40,155 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:37768': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:40,155 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:37778': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:40,268 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:40,268 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:40,269 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:37786': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:40,269 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:37792': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:40,381 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:40,382 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:40,382 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:37808': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:40,382 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:37816': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:40,496 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:40,496 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:40,497 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:37822': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:40,497 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:37828': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:40,610 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:40,610 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:40,611 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:37834': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:40,611 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:37842': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:40,724 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:40,724 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:40,725 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:37846': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:40,725 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:37852': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:40,837 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:40,837 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:40,838 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:37862': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:40,838 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:37870': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:40,951 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:40,951 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:40,952 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:37878': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:40,952 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:37880': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:41,065 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:41,066 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:41,066 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:37896': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:41,066 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:37906': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:41,178 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:41,178 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:41,179 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:37920': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:41,179 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:37926': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:41,292 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:41,293 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:41,293 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:37934': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:41,293 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:37946': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:41,405 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:41,405 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:41,406 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:37952': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:41,406 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:37962': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:41,519 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:41,519 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:41,523 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:37966': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:41,523 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:37968': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:41,632 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:41,633 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:41,633 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:57722': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:41,633 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:57724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:41,745 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:41,746 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:41,746 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:57730': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:41,746 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:57740': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:41,860 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:41,861 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:41,861 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:57754': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:41,861 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:57760': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:41,974 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:41,975 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:41,975 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:57772': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:41,975 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:57778': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:42,088 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:42,088 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:42,089 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:57782': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:42,089 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:57794': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:42,201 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:42,201 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:42,202 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:57800': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:42,202 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:57802': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:42,314 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:42,314 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:42,315 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:57816': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:42,315 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:57824': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:42,428 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:42,428 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:42,428 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:57828': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:42,428 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:57834': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:42,541 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:42,541 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:42,542 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:57842': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:42,542 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:57852': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:42,655 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:42,655 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:42,655 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:57858': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:42,655 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:57874': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:42,768 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:42,769 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:42,769 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:57876': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:42,769 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:57882': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:42,882 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:42,882 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:42,882 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:57892': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:42,882 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:57908': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:42,996 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:42,996 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:42,996 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:57914': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:42,996 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:57926': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:43,109 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:43,109 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:43,110 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:57940': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:43,110 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:57948': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:43,223 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:43,223 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:43,224 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:57952': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:43,224 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:57964': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:43,337 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:43,338 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:43,338 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:57974': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:43,338 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:57980': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:43,452 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:43,452 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:43,453 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:57992': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:43,453 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:58006': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:43,565 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:43,566 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:43,566 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:58012': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:43,566 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:58016': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:43,680 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:43,680 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:43,681 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:58018': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:43,681 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:58030': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:43,793 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:43,794 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:43,794 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:58046': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:43,794 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:58052': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:43,907 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:43,908 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:43,908 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:58062': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:43,908 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:58072': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:44,025 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:44,025 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:44,025 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:58084': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:44,026 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:58092': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:44,138 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:44,138 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:44,138 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:58104': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:44,138 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:58120': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:44,252 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:44,252 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:44,253 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:58132': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:44,253 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:58140': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:44,365 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:44,366 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:44,366 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:58144': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:44,366 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:58152': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:44,478 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:44,479 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:44,479 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:58156': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:44,479 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:58168': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:44,592 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:44,593 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:44,593 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:58176': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:44,593 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:58186': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:44,705 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:44,706 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:44,706 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:58200': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:44,706 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:58208': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:44,819 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:44,819 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:44,819 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:58218': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:44,819 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:58234': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:44,932 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:44,932 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:44,932 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:58244': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:44,933 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:58250': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:45,046 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:45,047 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:45,047 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:58260': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:45,047 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:58276': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:45,161 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:45,161 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:45,161 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:58280': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:45,161 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:58284': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:45,273 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:45,274 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:45,274 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:58286': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:45,275 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:58294': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:45,381 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:45,382 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:58296': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:45,387 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:45,387 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:58310': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:45,491 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:45,492 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:58324': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:45,498 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:45,498 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:58338': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:45,599 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:45,599 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:58346': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:45,606 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:45,606 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:58354': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:45,707 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:45,707 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:58364': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:45,713 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:45,714 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:58376': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:45,814 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:45,815 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:58384': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:45,822 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:45,822 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:58388': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:45,923 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:45,923 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:58394': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:45,929 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:45,930 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:58410': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:46,031 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:46,032 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:58424': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:46,038 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:46,038 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:58430': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:46,139 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:46,139 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:58432': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:46,146 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:46,147 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:58434': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:46,247 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:46,248 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:58442': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:46,254 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:46,254 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:58446': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:46,356 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:46,357 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:58448': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:46,363 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:46,363 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:58462': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:46,464 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:46,464 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:58464': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:46,470 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:46,471 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:58468': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:46,571 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:46,572 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:58476': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:46,578 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:46,579 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:58482': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:46,680 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:46,681 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:58494': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:46,687 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:46,688 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:58496': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:46,789 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:46,790 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:58500': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:46,796 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:46,796 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:58516': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:46,897 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:46,897 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:58526': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:46,904 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:46,904 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:58536': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:47,006 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:47,007 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:58550': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:47,013 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:47,017 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:58560': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:47,114 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:47,114 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:58568': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:47,121 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:47,121 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:58572': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:47,222 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:47,222 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:58574': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:47,229 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:47,229 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:58576': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:47,330 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:47,331 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:58590': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:47,337 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:47,337 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:58594': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:47,438 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:47,438 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:58600': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:47,445 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:47,445 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:58602': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:47,546 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:47,546 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:58604': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:47,553 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:47,553 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:58618': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:47,655 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:47,656 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:58626': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:47,662 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:47,663 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:58638': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:47,763 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:47,764 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:58648': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:47,770 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:47,771 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:58664': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:47,872 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:47,872 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:58670': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:47,878 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:47,879 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:58682': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:47,979 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:47,980 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:58690': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:47,986 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:47,987 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:58694': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:48,088 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:48,089 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:58706': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:48,095 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:48,095 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:58710': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:48,196 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:48,196 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:58714': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:48,204 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:48,204 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:58730': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:48,303 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:48,304 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:58746': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:48,311 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:48,312 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:58756': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:48,411 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:48,411 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:58758': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:48,418 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:48,418 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:58770': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:48,521 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:48,522 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:58776': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:48,528 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:48,528 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:58782': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:48,629 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:48,629 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:58788': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:48,636 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:48,636 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:58800': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:48,737 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:48,737 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:58816': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:48,744 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:48,744 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:58830': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:48,845 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:48,845 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:58832': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:48,851 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:48,852 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:58848': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:48,953 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:48,954 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:58860': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:48,960 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:48,960 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:58874': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:49,061 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:49,061 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:58888': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:49,068 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:49,068 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:58896': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:49,168 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:49,169 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:58900': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:49,175 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:49,176 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:58912': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:49,277 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:49,277 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:58926': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:49,283 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:49,284 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:58936': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:49,384 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:49,385 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:58944': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:49,391 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:49,391 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:58958': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:49,492 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:49,492 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:58962': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:49,499 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:49,499 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:58970': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:49,600 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:49,601 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:58972': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:49,607 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:49,608 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:58984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:49,708 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:49,709 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:58996': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:49,716 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:49,717 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:59012': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:49,817 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:49,817 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:59014': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:49,824 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:49,824 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:59022': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:49,925 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:49,926 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:59032': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:49,931 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:49,932 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:59034': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:50,032 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:50,033 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:59046': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:50,039 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:50,040 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:59048': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:50,140 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:50,141 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:59056': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:50,147 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:50,148 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:59062': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:50,248 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:50,249 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:59076': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:50,255 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:50,256 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:59080': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:50,356 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:50,357 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:59084': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:50,363 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:50,364 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:59094': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:50,464 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:50,465 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:59110': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:50,471 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:50,472 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:59116': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:50,572 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:50,573 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:59128': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:50,579 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:50,579 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:59138': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:50,681 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:50,682 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:59148': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:50,688 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:50,688 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:59150': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:50,789 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:50,790 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:59164': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:50,796 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:50,796 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:59180': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:50,897 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:50,898 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:59186': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:50,904 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:50,905 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:59194': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:51,006 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:51,007 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:59202': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:51,013 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:51,017 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:59216': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:51,114 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:51,114 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:59228': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:51,121 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:51,121 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:59234': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:51,222 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:51,222 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:59248': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:51,230 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:51,230 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:59258': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:51,330 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:51,330 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:59264': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:51,337 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:51,337 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:59274': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:51,438 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:51,439 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:59288': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:51,445 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:51,445 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:59294': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:51,545 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:51,546 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:40396': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:51,552 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:51,553 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:40400': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:51,653 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:51,654 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:40414': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:51,660 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:51,661 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:40426': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:51,761 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:51,762 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:40440': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:51,769 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:51,769 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:40444': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:51,870 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:51,870 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:40454': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:51,877 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:51,877 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:40468': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:51,980 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:51,981 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:40478': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:51,987 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:51,987 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:40480': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:52,088 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:52,089 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:40486': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:52,095 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:52,096 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:40502': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:52,196 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:52,197 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:40512': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:52,203 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:52,204 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:40520': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:52,304 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:52,304 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:40532': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:52,311 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:52,311 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:40536': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:52,413 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:52,414 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:40548': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:52,420 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:52,420 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:40556': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:52,522 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:52,523 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:40572': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:52,529 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:52,529 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:40576': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:52,630 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:52,631 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:40588': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:52,637 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:52,637 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:40590': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:52,738 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:52,739 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:40600': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:52,745 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:52,746 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:40616': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:52,846 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:52,846 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:40630': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:52,852 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:52,853 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:40638': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:52,954 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:52,955 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:40640': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:52,961 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:52,962 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:40650': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:53,062 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:53,063 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:40654': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:53,069 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:53,070 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:40656': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:53,170 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:53,170 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:40658': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:53,177 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:53,177 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:40664': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:53,278 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:53,279 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:40670': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:53,286 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:53,286 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:40674': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:53,386 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:53,387 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:40676': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:53,393 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:53,394 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:40682': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:53,495 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:53,495 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:40690': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:53,501 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:53,502 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:40704': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:53,603 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:53,604 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:40714': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:53,610 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:53,610 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:40718': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:53,711 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:53,711 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:40730': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:53,718 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:53,718 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:40736': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:53,818 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:53,818 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:40742': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:53,825 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:53,825 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:40744': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:53,926 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:53,926 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:40758': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:53,933 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:53,933 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:40774': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:54,034 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:54,034 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:40788': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:54,041 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:54,041 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:40790': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:54,142 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:54,143 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:40804': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:54,149 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:54,150 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:40806': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:54,251 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:54,252 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:40808': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:54,258 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:54,259 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:40812': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:54,358 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:54,359 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:40816': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:54,365 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:54,365 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:40826': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:54,466 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:54,467 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:40832': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:54,473 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:54,474 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:40844': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:54,575 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:54,576 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:40860': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:54,582 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:54,582 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:40874': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:54,683 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:54,683 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:40882': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:54,690 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:54,690 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:40884': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:54,791 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:54,791 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:40888': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:54,798 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:54,798 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:40896': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:54,899 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:54,899 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:40912': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:54,906 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:54,906 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:40924': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:55,007 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:55,008 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:40932': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:55,014 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35605 8450s 2024-11-23 22:37:55,018 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:40936': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:55,024 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38489. Reason: failure-to-start- 8450s 2024-11-23 22:37:55,024 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:37:55,027 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40549. Reason: failure-to-start- 8450s 2024-11-23 22:37:55,027 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:37:55,027 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 15s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 8450s stream = await stream.start_tls( 8450s ^^^^^^^^^^^^^^^^^^^^^^^ 8450s False, ssl_options=ssl_options, server_hostname=host 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 8450s self.socket.do_handshake() 8450s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 8450s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 8450s self._sslobj.do_handshake() 8450s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 8450s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 8450s raise FatalCommClosedError( 8450s ...<2 lines>... 8450s ) from err 8450s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 8450s 8450s During handling of the above exception, another exception occurred: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1218, in _register_with_scheduler 8450s await asyncio.sleep(0.1) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 718, in sleep 8450s return await future 8450s ^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 15s. 8450s 2024-11-23 22:37:56,036 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:37:56,043 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35967 8450s 2024-11-23 22:37:56,044 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38749/status 8450s 2024-11-23 22:37:56,044 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:37:56,062 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40067 8450s 2024-11-23 22:37:56,062 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40067 8450s 2024-11-23 22:37:56,062 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:37:56,063 - distributed.worker - INFO - dashboard at: 127.0.0.1:36361 8450s 2024-11-23 22:37:56,063 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:37:56,063 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:37:56,063 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:37:56,063 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:37:56,063 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-zughspri 8450s 2024-11-23 22:37:56,063 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:37:56,065 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44523 8450s 2024-11-23 22:37:56,065 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44523 8450s 2024-11-23 22:37:56,065 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:37:56,065 - distributed.worker - INFO - dashboard at: 127.0.0.1:45335 8450s 2024-11-23 22:37:56,065 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:37:56,065 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:37:56,065 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:37:56,065 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:37:56,065 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-kic7euyx 8450s 2024-11-23 22:37:56,066 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:37:56,078 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:37:56,079 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:37:56,079 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:53448': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:56,079 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:53456': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:56,191 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:37:56,192 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:37:56,192 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:53468': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:56,192 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:53482': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:56,305 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:37:56,306 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:37:56,306 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:53490': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:56,306 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:53500': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:56,418 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:37:56,419 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:37:56,419 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:53510': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:56,419 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:53522': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:56,531 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:37:56,532 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:37:56,532 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:53526': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:56,532 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:53530': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:56,645 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:37:56,645 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:37:56,646 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:53534': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:56,646 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:53536': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:56,758 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:37:56,758 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:37:56,759 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:53550': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:56,759 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:53554': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:56,872 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:37:56,872 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:37:56,873 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:53564': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:56,873 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:53568': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:56,986 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:37:56,986 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:37:56,986 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:53584': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:56,987 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:53586': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:57,099 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:37:57,099 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:37:57,099 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:53596': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:57,100 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:53604': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:57,213 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:37:57,213 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:37:57,214 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:53616': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:57,214 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:53624': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:57,326 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:37:57,327 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:37:57,327 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:53632': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:57,327 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:53640': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:57,440 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:37:57,440 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:37:57,440 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:53646': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:57,440 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:53652': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:57,553 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:37:57,553 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:37:57,557 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:53664': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:57,557 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:53680': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:57,667 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:37:57,667 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:37:57,667 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:53690': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:57,668 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:53702': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:57,780 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:37:57,780 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:37:57,781 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:53706': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:57,781 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:53708': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:57,896 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:37:57,896 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:37:57,896 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:53710': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:57,896 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:53716': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:58,009 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:37:58,009 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:37:58,010 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:53724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:58,010 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:53730': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:58,122 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:37:58,123 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:37:58,123 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:53738': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:58,123 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:53754': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:58,236 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:37:58,236 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:37:58,236 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:53756': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:58,236 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:53764': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:58,350 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:37:58,351 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:37:58,351 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:53766': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:58,351 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:53770': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:58,464 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:37:58,464 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:37:58,464 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:53772': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:58,464 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:53774': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:58,577 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:37:58,577 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:37:58,577 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:53784': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:58,577 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:53800': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:58,690 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:37:58,690 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:37:58,690 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:53802': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:58,690 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:53806': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:58,804 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:37:58,804 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:37:58,804 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:53808': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:58,804 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:53822': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:58,917 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:37:58,917 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:37:58,918 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:53834': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:58,918 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:53840': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:59,030 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:37:59,030 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:37:59,031 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:53850': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:59,031 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:53866': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:59,143 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:37:59,143 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:37:59,143 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:53882': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:59,143 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:53884': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:59,256 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:37:59,256 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:37:59,256 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:53886': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:59,257 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:53900': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:59,369 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:37:59,370 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:37:59,370 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:53910': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:59,370 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:53922': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:59,483 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:37:59,483 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:37:59,483 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:53924': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:59,483 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:53928': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:59,597 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:37:59,598 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:37:59,598 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:53930': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:59,598 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:53938': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:59,711 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:37:59,712 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:37:59,712 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:53944': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:59,712 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:53946': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:59,825 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:37:59,825 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:37:59,826 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:53956': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:59,826 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:53970': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:59,938 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:37:59,938 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:37:59,939 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:53972': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:37:59,939 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:53984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:00,051 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:38:00,052 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:38:00,056 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:53992': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:00,056 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:54000': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:00,165 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:38:00,165 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:38:00,166 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:54006': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:00,166 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:54010': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:00,279 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:38:00,279 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:38:00,280 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:54016': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:00,280 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:54030': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:00,392 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:38:00,393 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:38:00,393 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:54042': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:00,393 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:54048': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:00,506 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:38:00,506 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:38:00,506 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:54064': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:00,507 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:54070': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:00,619 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:38:00,619 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:38:00,620 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:54078': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:00,620 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:54086': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:00,734 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:38:00,734 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:38:00,734 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:54098': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:00,734 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:54114': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:00,847 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:38:00,848 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:38:00,848 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:54130': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:00,848 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:54142': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:00,961 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:38:00,961 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:38:00,962 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:54156': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:00,962 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:54160': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:01,075 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:38:01,075 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:38:01,076 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:54166': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:01,076 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:54176': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:01,189 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:38:01,189 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:38:01,189 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:54184': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:01,190 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:54196': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:01,302 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:38:01,302 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:38:01,303 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:54198': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:01,303 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:54208': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:01,415 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:38:01,416 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:38:01,416 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:54224': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:01,416 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:54230': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:01,529 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:38:01,530 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:38:01,530 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:54242': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:01,530 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:54258': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:01,643 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:38:01,643 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:38:01,643 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:50436': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:01,643 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:50446': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:01,756 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:38:01,756 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:38:01,757 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:50454': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:01,757 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:50470': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:01,869 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:38:01,869 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:38:01,870 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:50480': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:01,870 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:50494': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:01,983 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:38:01,983 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:38:01,983 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:50504': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:01,983 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:50514': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:02,097 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:38:02,097 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:38:02,098 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:50520': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:02,098 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:50522': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:02,210 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:38:02,211 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:38:02,211 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:50530': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:02,211 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:50540': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:02,332 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:38:02,332 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:38:02,333 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:50548': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:02,333 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:50550': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:02,445 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:38:02,446 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:38:02,446 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:50566': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:02,446 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:50572': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:02,560 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:38:02,560 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:38:02,561 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:50582': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:02,561 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:50592': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:02,673 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:38:02,673 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:38:02,673 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:50604': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:02,674 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:50606': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:02,787 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:38:02,788 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:38:02,788 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:50618': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:02,788 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:50624': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:02,901 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:38:02,901 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:38:02,902 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:50626': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:02,902 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:50642': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:03,014 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:38:03,014 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:38:03,018 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:50652': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:03,019 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:50660': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:03,128 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:38:03,128 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:38:03,128 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:50664': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:03,128 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:50668': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:03,241 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:38:03,241 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:38:03,242 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:50674': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:03,242 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:50690': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:03,356 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:38:03,356 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:38:03,357 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:50698': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:03,357 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:50710': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:03,470 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:38:03,470 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:38:03,471 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:50714': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:03,471 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:50716': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:03,584 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:38:03,584 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:38:03,585 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:50730': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:03,585 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:50746': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:03,697 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:38:03,698 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:38:03,698 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:50758': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:03,698 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:50762': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:03,811 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:38:03,812 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:38:03,812 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:50770': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:03,812 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:50784': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:03,925 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:38:03,925 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:38:03,926 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:50788': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:03,926 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:50794': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:04,038 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:38:04,038 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:38:04,039 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:50806': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:04,039 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:50812': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:04,151 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:38:04,152 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:38:04,152 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:50826': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:04,152 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:50838': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:04,265 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:38:04,265 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:38:04,266 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:50844': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:04,266 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:50856': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:04,378 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:38:04,379 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:38:04,379 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:50864': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:04,379 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:50880': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:04,492 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:38:04,492 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:38:04,493 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:50884': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:04,493 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:50892': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:04,606 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:38:04,606 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:38:04,607 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:50900': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:04,607 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:50906': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:04,719 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:38:04,719 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:38:04,720 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:50908': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:04,720 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:50918': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:04,834 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:38:04,834 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:38:04,835 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:50930': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:04,835 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:50940': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:04,947 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:38:04,947 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:38:04,948 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:50944': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:04,948 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:50952': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:05,081 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:38:05,081 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:38:05,082 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:50964': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:05,082 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:50980': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:05,195 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:38:05,195 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:38:05,196 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:50990': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:05,196 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:51004': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:05,308 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:38:05,309 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:38:05,309 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:51020': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:05,309 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:51028': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:05,422 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:38:05,422 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:38:05,422 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:51030': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:05,422 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:51042': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:05,535 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:38:05,535 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:38:05,536 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:51044': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:05,536 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:51048': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:05,648 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:38:05,649 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:38:05,649 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:51050': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:05,649 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:51052': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:05,761 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:38:05,761 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:38:05,762 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:51062': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:05,762 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:51066': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:05,877 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:38:05,877 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:38:05,877 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:51082': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:05,877 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:51088': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:05,990 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:38:05,990 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:38:05,991 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:51092': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:05,991 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:51096': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:06,104 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:38:06,104 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:38:06,104 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:51110': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:06,104 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:51122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:06,217 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:38:06,217 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:38:06,217 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:51134': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:06,218 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:51138': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:06,330 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:38:06,330 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:38:06,331 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:51152': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:06,331 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:51158': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:06,443 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:38:06,444 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:38:06,444 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:51168': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:06,444 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:51180': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:06,559 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:38:06,560 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:38:06,560 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:51188': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:06,560 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:51196': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:06,673 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:38:06,674 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:38:06,674 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:51198': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:06,674 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:51214': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:06,787 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:38:06,788 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:38:06,788 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:51228': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:06,788 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:51244': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:06,901 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:38:06,902 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:38:06,902 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:51258': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:06,902 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:51272': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:07,016 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:38:07,016 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:38:07,021 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:51276': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:07,021 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:51284': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:07,129 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:38:07,130 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:38:07,130 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:51290': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:07,130 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:51298': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:07,242 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:38:07,243 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:38:07,243 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:51312': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:07,243 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:51324': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:07,356 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:38:07,356 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:38:07,356 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:51328': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:07,357 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:51344': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:07,469 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:38:07,469 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:38:07,470 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:51356': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:07,470 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:51372': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:07,582 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:38:07,582 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:38:07,583 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:51374': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:07,583 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:51378': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:07,696 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:38:07,696 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:38:07,697 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:51392': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:07,697 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:51394': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:07,810 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:38:07,810 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:38:07,811 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:51408': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:07,811 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:51416': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:07,923 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:38:07,923 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:38:07,924 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:51426': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:07,924 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:51436': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:08,037 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:38:08,037 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:38:08,038 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:51452': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:08,038 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:51460': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:08,150 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:38:08,151 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:38:08,151 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:51476': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:08,151 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:51486': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:08,264 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:38:08,264 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:38:08,265 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:51500': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:08,265 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:51516': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:08,378 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:38:08,378 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:38:08,378 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:51532': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:08,378 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:51548': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:08,491 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:38:08,491 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:38:08,491 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:51562': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:08,491 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:51568': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:08,604 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:38:08,604 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:38:08,605 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:51576': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:08,605 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:51592': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:08,717 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:38:08,717 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:38:08,718 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:51604': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:08,718 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:51620': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:08,831 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:38:08,832 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:38:08,832 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:51624': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:08,832 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:51636': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:08,944 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:38:08,945 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:38:08,945 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:51644': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:08,945 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:51650': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:09,060 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:38:09,061 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35967 8450s 2024-11-23 22:38:09,061 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:51664': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:09,061 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35967': TLS handshake failed with remote 'tls://127.0.0.1:51668': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:09,061 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40067. Reason: failure-to-start- 8450s 2024-11-23 22:38:09,061 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:38:09,063 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 13s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 8450s stream = await stream.start_tls( 8450s ^^^^^^^^^^^^^^^^^^^^^^^ 8450s False, ssl_options=ssl_options, server_hostname=host 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 8450s self.socket.do_handshake() 8450s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 8450s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 8450s self._sslobj.do_handshake() 8450s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 8450s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 8450s raise FatalCommClosedError( 8450s ...<2 lines>... 8450s ) from err 8450s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 8450s 8450s During handling of the above exception, another exception occurred: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1218, in _register_with_scheduler 8450s await asyncio.sleep(0.1) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 718, in sleep 8450s return await future 8450s ^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 13s. 8450s 2024-11-23 22:38:09,067 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44523. Reason: failure-to-start- 8450s 2024-11-23 22:38:09,067 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:38:10,070 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:38:10,080 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44933 8450s 2024-11-23 22:38:10,080 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45767/status 8450s 2024-11-23 22:38:10,080 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:38:10,095 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44645 8450s 2024-11-23 22:38:10,096 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44645 8450s 2024-11-23 22:38:10,096 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:38:10,096 - distributed.worker - INFO - dashboard at: 127.0.0.1:46057 8450s 2024-11-23 22:38:10,096 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44933 8450s 2024-11-23 22:38:10,096 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:38:10,096 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:38:10,096 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:38:10,096 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-hcsxtvmy 8450s 2024-11-23 22:38:10,096 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:38:10,098 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46511 8450s 2024-11-23 22:38:10,098 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46511 8450s 2024-11-23 22:38:10,099 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:38:10,099 - distributed.worker - INFO - dashboard at: 127.0.0.1:34815 8450s 2024-11-23 22:38:10,099 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44933 8450s 2024-11-23 22:38:10,099 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:38:10,099 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:38:10,099 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:38:10,099 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-dx0lxxxu 8450s 2024-11-23 22:38:10,099 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:38:10,100 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44645. Reason: failure-to-start- 8450s 2024-11-23 22:38:10,100 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:38:10,101 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46511. Reason: failure-to-start- 8450s 2024-11-23 22:38:10,101 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:38:10,102 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44933': TLS handshake failed with remote 'tls://127.0.0.1:58680': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:38:10,102 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44933': TLS handshake failed with remote 'tls://127.0.0.1:58688': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:38:10,104 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:38:11,109 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:38:11,116 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45061 8450s 2024-11-23 22:38:11,117 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40273/status 8450s 2024-11-23 22:38:11,117 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:38:11,133 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45593 8450s 2024-11-23 22:38:11,133 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45593 8450s 2024-11-23 22:38:11,133 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:38:11,133 - distributed.worker - INFO - dashboard at: 127.0.0.1:35679 8450s 2024-11-23 22:38:11,133 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45061 8450s 2024-11-23 22:38:11,133 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:38:11,133 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:38:11,133 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:38:11,133 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-3ji_7y4_ 8450s 2024-11-23 22:38:11,133 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:38:11,136 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44515 8450s 2024-11-23 22:38:11,136 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44515 8450s 2024-11-23 22:38:11,136 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:38:11,136 - distributed.worker - INFO - dashboard at: 127.0.0.1:44809 8450s 2024-11-23 22:38:11,136 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45061 8450s 2024-11-23 22:38:11,136 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:38:11,136 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:38:11,136 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:38:11,136 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-lho80j75 8450s 2024-11-23 22:38:11,136 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:38:11,137 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45593. Reason: failure-to-start- 8450s 2024-11-23 22:38:11,137 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:38:11,138 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44515. Reason: failure-to-start- 8450s 2024-11-23 22:38:11,138 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:38:11,139 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45061': TLS handshake failed with remote 'tls://127.0.0.1:42928': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:38:11,139 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45061': TLS handshake failed with remote 'tls://127.0.0.1:42932': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:38:11,141 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:38:12,147 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:38:12,154 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43609 8450s 2024-11-23 22:38:12,155 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45155/status 8450s 2024-11-23 22:38:12,155 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:38:12,168 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34837 8450s 2024-11-23 22:38:12,168 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34837 8450s 2024-11-23 22:38:12,169 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:38:12,169 - distributed.worker - INFO - dashboard at: 127.0.0.1:39637 8450s 2024-11-23 22:38:12,169 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43609 8450s 2024-11-23 22:38:12,169 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:38:12,169 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:38:12,169 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:38:12,169 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-6lfvh3u2 8450s 2024-11-23 22:38:12,169 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:38:12,171 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45689 8450s 2024-11-23 22:38:12,171 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45689 8450s 2024-11-23 22:38:12,171 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:38:12,171 - distributed.worker - INFO - dashboard at: 127.0.0.1:37823 8450s 2024-11-23 22:38:12,171 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43609 8450s 2024-11-23 22:38:12,171 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:38:12,171 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:38:12,171 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:38:12,171 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-mv_2j8c0 8450s 2024-11-23 22:38:12,171 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:38:12,173 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34837. Reason: failure-to-start- 8450s 2024-11-23 22:38:12,173 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:38:12,174 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45689. Reason: failure-to-start- 8450s 2024-11-23 22:38:12,174 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:38:12,175 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43609': TLS handshake failed with remote 'tls://127.0.0.1:37198': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:38:12,175 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43609': TLS handshake failed with remote 'tls://127.0.0.1:37214': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:38:12,176 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:38:13,183 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:38:13,190 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43413 8450s 2024-11-23 22:38:13,190 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41651/status 8450s 2024-11-23 22:38:13,190 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:38:13,204 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40799 8450s 2024-11-23 22:38:13,204 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40799 8450s 2024-11-23 22:38:13,204 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:38:13,204 - distributed.worker - INFO - dashboard at: 127.0.0.1:40677 8450s 2024-11-23 22:38:13,204 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43413 8450s 2024-11-23 22:38:13,204 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:38:13,204 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:38:13,204 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:38:13,204 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-0p6g5z4s 8450s 2024-11-23 22:38:13,204 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:38:13,206 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35569 8450s 2024-11-23 22:38:13,207 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35569 8450s 2024-11-23 22:38:13,207 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:38:13,207 - distributed.worker - INFO - dashboard at: 127.0.0.1:33845 8450s 2024-11-23 22:38:13,207 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43413 8450s 2024-11-23 22:38:13,207 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:38:13,207 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:38:13,207 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:38:13,207 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-real_ial 8450s 2024-11-23 22:38:13,207 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:38:13,208 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40799. Reason: failure-to-start- 8450s 2024-11-23 22:38:13,208 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:38:13,209 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35569. Reason: failure-to-start- 8450s 2024-11-23 22:38:13,209 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:38:13,210 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43413': TLS handshake failed with remote 'tls://127.0.0.1:36624': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:38:13,210 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43413': TLS handshake failed with remote 'tls://127.0.0.1:36640': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:38:13,212 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:38:14,217 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:38:14,226 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35907 8450s 2024-11-23 22:38:14,226 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45513/status 8450s 2024-11-23 22:38:14,226 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:38:14,241 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46863 8450s 2024-11-23 22:38:14,241 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46863 8450s 2024-11-23 22:38:14,241 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:38:14,241 - distributed.worker - INFO - dashboard at: 127.0.0.1:37815 8450s 2024-11-23 22:38:14,241 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35907 8450s 2024-11-23 22:38:14,241 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:38:14,241 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:38:14,242 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:38:14,242 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ylf6k6mr 8450s 2024-11-23 22:38:14,242 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:38:14,244 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44907 8450s 2024-11-23 22:38:14,244 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44907 8450s 2024-11-23 22:38:14,244 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:38:14,244 - distributed.worker - INFO - dashboard at: 127.0.0.1:40235 8450s 2024-11-23 22:38:14,244 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35907 8450s 2024-11-23 22:38:14,244 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:38:14,244 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:38:14,244 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:38:14,244 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-idtci3ie 8450s 2024-11-23 22:38:14,244 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:38:14,245 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46863. Reason: failure-to-start- 8450s 2024-11-23 22:38:14,246 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:38:14,246 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44907. Reason: failure-to-start- 8450s 2024-11-23 22:38:14,246 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:38:14,247 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35907': TLS handshake failed with remote 'tls://127.0.0.1:53482': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:38:14,247 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35907': TLS handshake failed with remote 'tls://127.0.0.1:53486': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:38:14,249 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:38:15,256 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:38:15,263 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38461 8450s 2024-11-23 22:38:15,263 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39375/status 8450s 2024-11-23 22:38:15,263 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:38:15,283 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40329 8450s 2024-11-23 22:38:15,283 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40329 8450s 2024-11-23 22:38:15,283 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:38:15,283 - distributed.worker - INFO - dashboard at: 127.0.0.1:34973 8450s 2024-11-23 22:38:15,283 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38461 8450s 2024-11-23 22:38:15,283 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:38:15,283 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:38:15,283 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:38:15,283 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-h9k7pgdq 8450s 2024-11-23 22:38:15,283 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:38:15,285 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37729 8450s 2024-11-23 22:38:15,285 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37729 8450s 2024-11-23 22:38:15,285 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:38:15,285 - distributed.worker - INFO - dashboard at: 127.0.0.1:34659 8450s 2024-11-23 22:38:15,285 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38461 8450s 2024-11-23 22:38:15,285 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:38:15,285 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:38:15,286 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:38:15,286 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-fmgup__2 8450s 2024-11-23 22:38:15,286 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:38:15,287 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40329. Reason: failure-to-start- 8450s 2024-11-23 22:38:15,287 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:38:15,288 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37729. Reason: failure-to-start- 8450s 2024-11-23 22:38:15,288 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:38:15,289 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38461': TLS handshake failed with remote 'tls://127.0.0.1:42554': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:38:15,289 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38461': TLS handshake failed with remote 'tls://127.0.0.1:42570': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:38:15,291 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:38:16,297 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:38:16,315 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33299 8450s 2024-11-23 22:38:16,316 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46095/status 8450s 2024-11-23 22:38:16,316 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:38:16,333 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38683 8450s 2024-11-23 22:38:16,333 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38683 8450s 2024-11-23 22:38:16,333 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:38:16,333 - distributed.worker - INFO - dashboard at: 127.0.0.1:43993 8450s 2024-11-23 22:38:16,333 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33299 8450s 2024-11-23 22:38:16,333 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:38:16,333 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:38:16,333 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:38:16,333 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-0ybwz1vq 8450s 2024-11-23 22:38:16,333 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:38:16,336 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45207 8450s 2024-11-23 22:38:16,336 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45207 8450s 2024-11-23 22:38:16,336 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:38:16,336 - distributed.worker - INFO - dashboard at: 127.0.0.1:36913 8450s 2024-11-23 22:38:16,336 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33299 8450s 2024-11-23 22:38:16,336 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:38:16,336 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:38:16,336 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:38:16,336 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-m8g7zmwr 8450s 2024-11-23 22:38:16,336 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:38:16,339 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38683. Reason: failure-to-start- 8450s 2024-11-23 22:38:16,339 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:38:16,339 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45207. Reason: failure-to-start- 8450s 2024-11-23 22:38:16,340 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:38:16,341 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33299': TLS handshake failed with remote 'tls://127.0.0.1:52716': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:38:16,341 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33299': TLS handshake failed with remote 'tls://127.0.0.1:52728': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:38:16,343 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:38:17,348 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:38:17,356 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36873 8450s 2024-11-23 22:38:17,356 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43373/status 8450s 2024-11-23 22:38:17,357 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:38:17,371 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40807 8450s 2024-11-23 22:38:17,371 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40807 8450s 2024-11-23 22:38:17,371 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:38:17,371 - distributed.worker - INFO - dashboard at: 127.0.0.1:38927 8450s 2024-11-23 22:38:17,371 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36873 8450s 2024-11-23 22:38:17,371 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:38:17,371 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:38:17,371 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:38:17,371 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-mgelkeqf 8450s 2024-11-23 22:38:17,371 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:38:17,374 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46685 8450s 2024-11-23 22:38:17,374 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46685 8450s 2024-11-23 22:38:17,374 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:38:17,374 - distributed.worker - INFO - dashboard at: 127.0.0.1:43577 8450s 2024-11-23 22:38:17,374 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36873 8450s 2024-11-23 22:38:17,374 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:38:17,374 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:38:17,374 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:38:17,374 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-z6xmx_hw 8450s 2024-11-23 22:38:17,374 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:38:17,375 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40807. Reason: failure-to-start- 8450s 2024-11-23 22:38:17,376 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:38:17,376 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46685. Reason: failure-to-start- 8450s 2024-11-23 22:38:17,376 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:38:17,377 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36873': TLS handshake failed with remote 'tls://127.0.0.1:47050': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:38:17,378 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36873': TLS handshake failed with remote 'tls://127.0.0.1:47052': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:38:17,379 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:38:18,384 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:38:18,394 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41717 8450s 2024-11-23 22:38:18,394 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36497/status 8450s 2024-11-23 22:38:18,394 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:38:18,409 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37785 8450s 2024-11-23 22:38:18,410 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37785 8450s 2024-11-23 22:38:18,410 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:38:18,410 - distributed.worker - INFO - dashboard at: 127.0.0.1:42425 8450s 2024-11-23 22:38:18,410 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41717 8450s 2024-11-23 22:38:18,410 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:38:18,410 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:38:18,410 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:38:18,410 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ep3599pc 8450s 2024-11-23 22:38:18,410 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:38:18,412 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41285 8450s 2024-11-23 22:38:18,412 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41285 8450s 2024-11-23 22:38:18,412 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:38:18,412 - distributed.worker - INFO - dashboard at: 127.0.0.1:46159 8450s 2024-11-23 22:38:18,412 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41717 8450s 2024-11-23 22:38:18,412 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:38:18,413 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:38:18,413 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:38:18,413 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-1k1rs5qd 8450s 2024-11-23 22:38:18,413 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:38:18,414 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37785. Reason: failure-to-start- 8450s 2024-11-23 22:38:18,414 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:38:18,414 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41285. Reason: failure-to-start- 8450s 2024-11-23 22:38:18,415 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:38:18,416 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41717': TLS handshake failed with remote 'tls://127.0.0.1:58160': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:38:18,416 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41717': TLS handshake failed with remote 'tls://127.0.0.1:58174': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:38:18,418 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:38:19,424 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:38:19,432 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33169 8450s 2024-11-23 22:38:19,432 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37707/status 8450s 2024-11-23 22:38:19,432 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:38:19,448 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44691 8450s 2024-11-23 22:38:19,448 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44691 8450s 2024-11-23 22:38:19,448 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:38:19,448 - distributed.worker - INFO - dashboard at: 127.0.0.1:38287 8450s 2024-11-23 22:38:19,448 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33169 8450s 2024-11-23 22:38:19,448 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:38:19,448 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:38:19,448 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:38:19,448 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-0v1ewv9q 8450s 2024-11-23 22:38:19,448 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:38:19,451 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37153 8450s 2024-11-23 22:38:19,451 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37153 8450s 2024-11-23 22:38:19,451 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:38:19,451 - distributed.worker - INFO - dashboard at: 127.0.0.1:40389 8450s 2024-11-23 22:38:19,451 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33169 8450s 2024-11-23 22:38:19,451 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:38:19,451 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:38:19,451 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:38:19,451 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-k9vl4rlu 8450s 2024-11-23 22:38:19,451 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:38:19,452 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44691. Reason: failure-to-start- 8450s 2024-11-23 22:38:19,453 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:38:19,453 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37153. Reason: failure-to-start- 8450s 2024-11-23 22:38:19,453 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:38:19,455 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33169': TLS handshake failed with remote 'tls://127.0.0.1:42740': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:38:19,455 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33169': TLS handshake failed with remote 'tls://127.0.0.1:42744': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:38:19,456 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:38:20,462 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:38:20,470 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44291 8450s 2024-11-23 22:38:20,470 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36909/status 8450s 2024-11-23 22:38:20,471 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:38:20,485 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34585 8450s 2024-11-23 22:38:20,485 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34585 8450s 2024-11-23 22:38:20,485 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:38:20,485 - distributed.worker - INFO - dashboard at: 127.0.0.1:44185 8450s 2024-11-23 22:38:20,485 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44291 8450s 2024-11-23 22:38:20,485 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:38:20,485 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:38:20,485 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:38:20,485 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-g6b4hb1_ 8450s 2024-11-23 22:38:20,485 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:38:20,488 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39043 8450s 2024-11-23 22:38:20,488 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39043 8450s 2024-11-23 22:38:20,489 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:38:20,489 - distributed.worker - INFO - dashboard at: 127.0.0.1:44321 8450s 2024-11-23 22:38:20,489 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44291 8450s 2024-11-23 22:38:20,489 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:38:20,489 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:38:20,489 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:38:20,489 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-euqxpbnh 8450s 2024-11-23 22:38:20,489 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:38:20,490 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34585. Reason: failure-to-start- 8450s 2024-11-23 22:38:20,490 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:38:20,491 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39043. Reason: failure-to-start- 8450s 2024-11-23 22:38:20,491 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:38:20,492 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44291': TLS handshake failed with remote 'tls://127.0.0.1:53388': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:38:20,492 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44291': TLS handshake failed with remote 'tls://127.0.0.1:53394': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:38:20,494 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:38:21,502 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:38:21,510 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37007 8450s 2024-11-23 22:38:21,510 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40565/status 8450s 2024-11-23 22:38:21,510 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:38:21,529 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43425 8450s 2024-11-23 22:38:21,529 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43425 8450s 2024-11-23 22:38:21,529 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:38:21,529 - distributed.worker - INFO - dashboard at: 127.0.0.1:42083 8450s 2024-11-23 22:38:21,529 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37007 8450s 2024-11-23 22:38:21,530 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:38:21,530 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:38:21,530 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:38:21,530 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-8wb85gdq 8450s 2024-11-23 22:38:21,530 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:38:21,532 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41435 8450s 2024-11-23 22:38:21,532 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41435 8450s 2024-11-23 22:38:21,532 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:38:21,532 - distributed.worker - INFO - dashboard at: 127.0.0.1:41429 8450s 2024-11-23 22:38:21,532 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37007 8450s 2024-11-23 22:38:21,532 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:38:21,532 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:38:21,532 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:38:21,532 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-_i03115p 8450s 2024-11-23 22:38:21,532 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:38:21,534 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43425. Reason: failure-to-start- 8450s 2024-11-23 22:38:21,534 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:38:21,534 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41435. Reason: failure-to-start- 8450s 2024-11-23 22:38:21,535 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:38:21,536 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37007': TLS handshake failed with remote 'tls://127.0.0.1:35860': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:38:21,536 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37007': TLS handshake failed with remote 'tls://127.0.0.1:35868': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:38:21,537 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:38:22,545 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:38:22,552 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35445 8450s 2024-11-23 22:38:22,553 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35559/status 8450s 2024-11-23 22:38:22,553 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:38:22,570 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40113 8450s 2024-11-23 22:38:22,570 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40113 8450s 2024-11-23 22:38:22,570 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:38:22,571 - distributed.worker - INFO - dashboard at: 127.0.0.1:35179 8450s 2024-11-23 22:38:22,571 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35445 8450s 2024-11-23 22:38:22,571 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:38:22,571 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:38:22,571 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:38:22,571 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-twztyura 8450s 2024-11-23 22:38:22,571 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:38:22,573 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44181 8450s 2024-11-23 22:38:22,573 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44181 8450s 2024-11-23 22:38:22,573 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:38:22,573 - distributed.worker - INFO - dashboard at: 127.0.0.1:40939 8450s 2024-11-23 22:38:22,573 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35445 8450s 2024-11-23 22:38:22,574 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:38:22,574 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:38:22,574 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:38:22,574 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-nbp3oizt 8450s 2024-11-23 22:38:22,574 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:38:22,575 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40113. Reason: failure-to-start- 8450s 2024-11-23 22:38:22,575 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:38:22,576 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44181. Reason: failure-to-start- 8450s 2024-11-23 22:38:22,576 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:38:22,577 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35445': TLS handshake failed with remote 'tls://127.0.0.1:54912': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:38:22,577 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35445': TLS handshake failed with remote 'tls://127.0.0.1:54922': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:38:22,579 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:38:23,587 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:38:23,594 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34095 8450s 2024-11-23 22:38:23,594 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40323/status 8450s 2024-11-23 22:38:23,594 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:38:23,610 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39481 8450s 2024-11-23 22:38:23,610 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39481 8450s 2024-11-23 22:38:23,610 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:38:23,610 - distributed.worker - INFO - dashboard at: 127.0.0.1:40883 8450s 2024-11-23 22:38:23,610 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34095 8450s 2024-11-23 22:38:23,610 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:38:23,610 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:38:23,610 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:38:23,610 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-v3r92ong 8450s 2024-11-23 22:38:23,611 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:38:23,613 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38409 8450s 2024-11-23 22:38:23,613 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38409 8450s 2024-11-23 22:38:23,613 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:38:23,613 - distributed.worker - INFO - dashboard at: 127.0.0.1:34143 8450s 2024-11-23 22:38:23,613 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34095 8450s 2024-11-23 22:38:23,613 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:38:23,613 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:38:23,613 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:38:23,613 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-yg2la68p 8450s 2024-11-23 22:38:23,613 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:38:23,614 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39481. Reason: failure-to-start- 8450s 2024-11-23 22:38:23,614 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:38:23,615 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38409. Reason: failure-to-start- 8450s 2024-11-23 22:38:23,615 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:38:23,616 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34095': TLS handshake failed with remote 'tls://127.0.0.1:36618': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:38:23,616 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34095': TLS handshake failed with remote 'tls://127.0.0.1:36624': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:38:23,621 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:38:24,626 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:38:24,633 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44105 8450s 2024-11-23 22:38:24,634 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37911/status 8450s 2024-11-23 22:38:24,634 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:38:24,649 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34389 8450s 2024-11-23 22:38:24,650 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34389 8450s 2024-11-23 22:38:24,650 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:38:24,650 - distributed.worker - INFO - dashboard at: 127.0.0.1:36177 8450s 2024-11-23 22:38:24,650 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44105 8450s 2024-11-23 22:38:24,650 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:38:24,650 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:38:24,650 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:38:24,650 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-er4ixb49 8450s 2024-11-23 22:38:24,650 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:38:24,652 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35247 8450s 2024-11-23 22:38:24,653 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35247 8450s 2024-11-23 22:38:24,653 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:38:24,653 - distributed.worker - INFO - dashboard at: 127.0.0.1:36709 8450s 2024-11-23 22:38:24,653 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44105 8450s 2024-11-23 22:38:24,653 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:38:24,653 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:38:24,653 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:38:24,653 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-xoxiba8c 8450s 2024-11-23 22:38:24,653 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:38:24,654 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34389. Reason: failure-to-start- 8450s 2024-11-23 22:38:24,654 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:38:24,655 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35247. Reason: failure-to-start- 8450s 2024-11-23 22:38:24,655 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:38:24,656 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44105': TLS handshake failed with remote 'tls://127.0.0.1:51192': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:38:24,656 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44105': TLS handshake failed with remote 'tls://127.0.0.1:51194': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:38:24,661 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:38:25,669 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:38:25,676 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33289 8450s 2024-11-23 22:38:25,676 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40231/status 8450s 2024-11-23 22:38:25,676 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:38:25,690 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38141 8450s 2024-11-23 22:38:25,690 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38141 8450s 2024-11-23 22:38:25,690 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:38:25,690 - distributed.worker - INFO - dashboard at: 127.0.0.1:42147 8450s 2024-11-23 22:38:25,690 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33289 8450s 2024-11-23 22:38:25,690 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:38:25,691 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:38:25,691 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:38:25,691 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-pddu5q82 8450s 2024-11-23 22:38:25,691 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:38:25,693 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36351 8450s 2024-11-23 22:38:25,693 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36351 8450s 2024-11-23 22:38:25,693 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:38:25,693 - distributed.worker - INFO - dashboard at: 127.0.0.1:43843 8450s 2024-11-23 22:38:25,693 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33289 8450s 2024-11-23 22:38:25,693 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:38:25,693 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:38:25,693 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:38:25,693 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-8_75duse 8450s 2024-11-23 22:38:25,693 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:38:25,695 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38141. Reason: failure-to-start- 8450s 2024-11-23 22:38:25,696 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:38:25,696 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36351. Reason: failure-to-start- 8450s 2024-11-23 22:38:25,696 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:38:25,700 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33289': TLS handshake failed with remote 'tls://127.0.0.1:44498': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:38:25,700 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33289': TLS handshake failed with remote 'tls://127.0.0.1:44512': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:38:25,702 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:38:26,708 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:38:26,715 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36961 8450s 2024-11-23 22:38:26,715 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37483/status 8450s 2024-11-23 22:38:26,716 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:38:26,731 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35327 8450s 2024-11-23 22:38:26,731 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35327 8450s 2024-11-23 22:38:26,731 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:38:26,731 - distributed.worker - INFO - dashboard at: 127.0.0.1:46519 8450s 2024-11-23 22:38:26,731 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36961 8450s 2024-11-23 22:38:26,731 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:38:26,731 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:38:26,731 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:38:26,731 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-_i9ucqt0 8450s 2024-11-23 22:38:26,731 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:38:26,734 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41011 8450s 2024-11-23 22:38:26,734 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41011 8450s 2024-11-23 22:38:26,734 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:38:26,734 - distributed.worker - INFO - dashboard at: 127.0.0.1:40989 8450s 2024-11-23 22:38:26,734 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36961 8450s 2024-11-23 22:38:26,734 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:38:26,734 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:38:26,734 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:38:26,734 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-4j0f3ifb 8450s 2024-11-23 22:38:26,734 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:38:26,739 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35327. Reason: failure-to-start- 8450s 2024-11-23 22:38:26,739 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:38:26,740 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41011. Reason: failure-to-start- 8450s 2024-11-23 22:38:26,740 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:38:26,741 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36961': TLS handshake failed with remote 'tls://127.0.0.1:43426': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:38:26,742 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36961': TLS handshake failed with remote 'tls://127.0.0.1:43428': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:38:26,743 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:38:27,763 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:38:27,772 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40137 8450s 2024-11-23 22:38:27,772 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39917/status 8450s 2024-11-23 22:38:27,772 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:38:27,789 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37615 8450s 2024-11-23 22:38:27,790 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37615 8450s 2024-11-23 22:38:27,790 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:38:27,790 - distributed.worker - INFO - dashboard at: 127.0.0.1:38509 8450s 2024-11-23 22:38:27,790 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40137 8450s 2024-11-23 22:38:27,790 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:38:27,790 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:38:27,790 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:38:27,790 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-agxoekq5 8450s 2024-11-23 22:38:27,790 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:38:27,792 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36887 8450s 2024-11-23 22:38:27,793 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36887 8450s 2024-11-23 22:38:27,793 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:38:27,793 - distributed.worker - INFO - dashboard at: 127.0.0.1:40581 8450s 2024-11-23 22:38:27,793 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40137 8450s 2024-11-23 22:38:27,793 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:38:27,793 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:38:27,793 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:38:27,793 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-zpke6i8f 8450s 2024-11-23 22:38:27,793 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:38:27,794 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37615. Reason: failure-to-start- 8450s 2024-11-23 22:38:27,795 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:38:27,795 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36887. Reason: failure-to-start- 8450s 2024-11-23 22:38:27,795 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:38:27,797 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40137': TLS handshake failed with remote 'tls://127.0.0.1:50250': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:38:27,797 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40137': TLS handshake failed with remote 'tls://127.0.0.1:50252': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:38:27,799 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:38:28,805 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:38:28,812 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39659 8450s 2024-11-23 22:38:28,812 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41899/status 8450s 2024-11-23 22:38:28,812 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:38:28,828 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39773 8450s 2024-11-23 22:38:28,829 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39773 8450s 2024-11-23 22:38:28,829 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:38:28,829 - distributed.worker - INFO - dashboard at: 127.0.0.1:37969 8450s 2024-11-23 22:38:28,829 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39659 8450s 2024-11-23 22:38:28,829 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:38:28,829 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:38:28,829 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:38:28,829 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-9xbzxdgl 8450s 2024-11-23 22:38:28,829 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:38:28,831 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45463 8450s 2024-11-23 22:38:28,832 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45463 8450s 2024-11-23 22:38:28,832 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:38:28,832 - distributed.worker - INFO - dashboard at: 127.0.0.1:37301 8450s 2024-11-23 22:38:28,832 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39659 8450s 2024-11-23 22:38:28,832 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:38:28,832 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:38:28,832 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:38:28,832 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-0loua3fb 8450s 2024-11-23 22:38:28,832 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:38:28,836 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39773. Reason: failure-to-start- 8450s 2024-11-23 22:38:28,836 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:38:28,837 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45463. Reason: failure-to-start- 8450s 2024-11-23 22:38:28,837 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:38:28,839 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39659': TLS handshake failed with remote 'tls://127.0.0.1:50870': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:38:28,839 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39659': TLS handshake failed with remote 'tls://127.0.0.1:50884': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:38:28,840 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:38:29,847 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:38:29,855 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41473 8450s 2024-11-23 22:38:29,855 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39287/status 8450s 2024-11-23 22:38:29,855 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:38:29,870 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33801 8450s 2024-11-23 22:38:29,870 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33801 8450s 2024-11-23 22:38:29,870 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:38:29,870 - distributed.worker - INFO - dashboard at: 127.0.0.1:42683 8450s 2024-11-23 22:38:29,871 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41473 8450s 2024-11-23 22:38:29,871 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:38:29,871 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:38:29,872 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:38:29,872 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-umzlukdx 8450s 2024-11-23 22:38:29,872 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:38:29,874 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39557 8450s 2024-11-23 22:38:29,874 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39557 8450s 2024-11-23 22:38:29,874 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:38:29,874 - distributed.worker - INFO - dashboard at: 127.0.0.1:36859 8450s 2024-11-23 22:38:29,874 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41473 8450s 2024-11-23 22:38:29,874 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:38:29,874 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:38:29,874 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:38:29,874 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-94frdown 8450s 2024-11-23 22:38:29,874 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:38:29,878 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33801. Reason: failure-to-start- 8450s 2024-11-23 22:38:29,879 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:38:29,879 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39557. Reason: failure-to-start- 8450s 2024-11-23 22:38:29,879 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:38:29,881 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41473': TLS handshake failed with remote 'tls://127.0.0.1:39076': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:38:29,881 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41473': TLS handshake failed with remote 'tls://127.0.0.1:39092': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:38:29,882 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:38:30,888 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:38:30,896 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35569 8450s 2024-11-23 22:38:30,896 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44471/status 8450s 2024-11-23 22:38:30,896 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:38:30,913 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39239 8450s 2024-11-23 22:38:30,914 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39239 8450s 2024-11-23 22:38:30,914 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:38:30,914 - distributed.worker - INFO - dashboard at: 127.0.0.1:40647 8450s 2024-11-23 22:38:30,914 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35569 8450s 2024-11-23 22:38:30,914 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:38:30,914 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:38:30,914 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:38:30,914 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-o7aeg95t 8450s 2024-11-23 22:38:30,914 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:38:30,916 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34993 8450s 2024-11-23 22:38:30,917 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34993 8450s 2024-11-23 22:38:30,917 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:38:30,917 - distributed.worker - INFO - dashboard at: 127.0.0.1:38687 8450s 2024-11-23 22:38:30,917 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35569 8450s 2024-11-23 22:38:30,917 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:38:30,917 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:38:30,917 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:38:30,917 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-2b4wd8hv 8450s 2024-11-23 22:38:30,917 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:38:30,931 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39239. Reason: failure-to-start- 8450s 2024-11-23 22:38:30,931 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:38:30,932 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34993. Reason: failure-to-start- 8450s 2024-11-23 22:38:30,932 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:38:30,933 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35569': TLS handshake failed with remote 'tls://127.0.0.1:43916': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:38:30,934 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35569': TLS handshake failed with remote 'tls://127.0.0.1:43928': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:38:30,939 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:38:31,945 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:38:31,952 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40209 8450s 2024-11-23 22:38:31,952 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43655/status 8450s 2024-11-23 22:38:31,953 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:38:31,968 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37387 8450s 2024-11-23 22:38:31,968 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37387 8450s 2024-11-23 22:38:31,968 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:38:31,968 - distributed.worker - INFO - dashboard at: 127.0.0.1:44045 8450s 2024-11-23 22:38:31,968 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40209 8450s 2024-11-23 22:38:31,968 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:38:31,968 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:38:31,968 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:38:31,968 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-jfpn2a7d 8450s 2024-11-23 22:38:31,968 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:38:31,971 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38193 8450s 2024-11-23 22:38:31,971 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38193 8450s 2024-11-23 22:38:31,971 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:38:31,971 - distributed.worker - INFO - dashboard at: 127.0.0.1:38077 8450s 2024-11-23 22:38:31,971 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40209 8450s 2024-11-23 22:38:31,971 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:38:31,971 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:38:31,971 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:38:31,971 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-78j9_fcl 8450s 2024-11-23 22:38:31,971 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:38:31,972 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37387. Reason: failure-to-start- 8450s 2024-11-23 22:38:31,973 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:38:31,973 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38193. Reason: failure-to-start- 8450s 2024-11-23 22:38:31,973 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:38:31,978 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40209': TLS handshake failed with remote 'tls://127.0.0.1:43840': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:38:31,978 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40209': TLS handshake failed with remote 'tls://127.0.0.1:43852': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:38:31,979 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:38:32,985 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:38:32,994 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37671 8450s 2024-11-23 22:38:32,994 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35499/status 8450s 2024-11-23 22:38:32,994 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:38:33,010 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42651 8450s 2024-11-23 22:38:33,010 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42651 8450s 2024-11-23 22:38:33,010 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:38:33,010 - distributed.worker - INFO - dashboard at: 127.0.0.1:36255 8450s 2024-11-23 22:38:33,010 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37671 8450s 2024-11-23 22:38:33,010 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:38:33,010 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:38:33,010 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:38:33,010 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-9fhesiee 8450s 2024-11-23 22:38:33,010 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:38:33,013 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35919 8450s 2024-11-23 22:38:33,013 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35919 8450s 2024-11-23 22:38:33,013 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:38:33,013 - distributed.worker - INFO - dashboard at: 127.0.0.1:40645 8450s 2024-11-23 22:38:33,013 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37671 8450s 2024-11-23 22:38:33,013 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:38:33,013 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:38:33,013 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:38:33,013 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-iiqim84o 8450s 2024-11-23 22:38:33,013 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:38:33,015 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42651. Reason: failure-to-start- 8450s 2024-11-23 22:38:33,015 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:38:33,015 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35919. Reason: failure-to-start- 8450s 2024-11-23 22:38:33,016 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:38:33,022 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37671': TLS handshake failed with remote 'tls://127.0.0.1:55054': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:38:33,022 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37671': TLS handshake failed with remote 'tls://127.0.0.1:55064': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:38:33,024 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:38:34,030 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:38:34,037 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41215 8450s 2024-11-23 22:38:34,037 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36839/status 8450s 2024-11-23 22:38:34,038 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:38:34,055 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40935 8450s 2024-11-23 22:38:34,055 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40935 8450s 2024-11-23 22:38:34,055 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:38:34,055 - distributed.worker - INFO - dashboard at: 127.0.0.1:46233 8450s 2024-11-23 22:38:34,055 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41215 8450s 2024-11-23 22:38:34,056 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:38:34,056 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:38:34,056 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:38:34,056 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-h2zfg6xh 8450s 2024-11-23 22:38:34,056 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:38:34,058 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45741 8450s 2024-11-23 22:38:34,058 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45741 8450s 2024-11-23 22:38:34,058 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:38:34,058 - distributed.worker - INFO - dashboard at: 127.0.0.1:39393 8450s 2024-11-23 22:38:34,058 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41215 8450s 2024-11-23 22:38:34,058 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:38:34,058 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:38:34,058 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:38:34,058 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-rrcfm0am 8450s 2024-11-23 22:38:34,059 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:38:34,064 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40935. Reason: failure-to-start- 8450s 2024-11-23 22:38:34,064 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:38:34,064 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45741. Reason: failure-to-start- 8450s 2024-11-23 22:38:34,064 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:38:34,069 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41215': TLS handshake failed with remote 'tls://127.0.0.1:46638': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:38:34,069 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41215': TLS handshake failed with remote 'tls://127.0.0.1:46654': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:38:34,071 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:38:35,079 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:38:35,087 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40355 8450s 2024-11-23 22:38:35,088 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46109/status 8450s 2024-11-23 22:38:35,088 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:38:35,106 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45101 8450s 2024-11-23 22:38:35,106 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45101 8450s 2024-11-23 22:38:35,107 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:38:35,107 - distributed.worker - INFO - dashboard at: 127.0.0.1:38729 8450s 2024-11-23 22:38:35,107 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40355 8450s 2024-11-23 22:38:35,107 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:38:35,107 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:38:35,107 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:38:35,107 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-qxetkffn 8450s 2024-11-23 22:38:35,107 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:38:35,109 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35763 8450s 2024-11-23 22:38:35,109 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35763 8450s 2024-11-23 22:38:35,109 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:38:35,109 - distributed.worker - INFO - dashboard at: 127.0.0.1:41645 8450s 2024-11-23 22:38:35,109 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40355 8450s 2024-11-23 22:38:35,109 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:38:35,109 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:38:35,110 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:38:35,110 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-cmqgclcr 8450s 2024-11-23 22:38:35,110 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:38:35,115 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45101. Reason: failure-to-start- 8450s 2024-11-23 22:38:35,115 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:38:35,115 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35763. Reason: failure-to-start- 8450s 2024-11-23 22:38:35,115 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:38:35,117 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40355': TLS handshake failed with remote 'tls://127.0.0.1:51564': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:38:35,117 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40355': TLS handshake failed with remote 'tls://127.0.0.1:51568': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:38:35,121 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:38:36,127 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:38:36,134 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45387 8450s 2024-11-23 22:38:36,135 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46071/status 8450s 2024-11-23 22:38:36,135 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:38:36,153 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43143 8450s 2024-11-23 22:38:36,153 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43143 8450s 2024-11-23 22:38:36,153 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:38:36,153 - distributed.worker - INFO - dashboard at: 127.0.0.1:43395 8450s 2024-11-23 22:38:36,153 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45387 8450s 2024-11-23 22:38:36,153 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:38:36,153 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:38:36,153 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:38:36,153 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-8rgfvgn9 8450s 2024-11-23 22:38:36,153 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:38:36,155 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39431 8450s 2024-11-23 22:38:36,156 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39431 8450s 2024-11-23 22:38:36,156 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:38:36,156 - distributed.worker - INFO - dashboard at: 127.0.0.1:37783 8450s 2024-11-23 22:38:36,156 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45387 8450s 2024-11-23 22:38:36,156 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:38:36,156 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:38:36,156 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:38:36,156 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-5aomosay 8450s 2024-11-23 22:38:36,156 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:38:36,158 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43143. Reason: failure-to-start- 8450s 2024-11-23 22:38:36,159 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:38:36,159 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39431. Reason: failure-to-start- 8450s 2024-11-23 22:38:36,159 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:38:36,164 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45387': TLS handshake failed with remote 'tls://127.0.0.1:51512': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:38:36,164 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45387': TLS handshake failed with remote 'tls://127.0.0.1:51518': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:38:36,166 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:38:37,173 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:38:37,182 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33243 8450s 2024-11-23 22:38:37,182 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35041/status 8450s 2024-11-23 22:38:37,182 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:38:37,201 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37649 8450s 2024-11-23 22:38:37,201 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37649 8450s 2024-11-23 22:38:37,201 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:38:37,201 - distributed.worker - INFO - dashboard at: 127.0.0.1:43611 8450s 2024-11-23 22:38:37,201 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33243 8450s 2024-11-23 22:38:37,201 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:38:37,201 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:38:37,201 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:38:37,201 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-qzcnnlzi 8450s 2024-11-23 22:38:37,201 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:38:37,204 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35273 8450s 2024-11-23 22:38:37,204 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35273 8450s 2024-11-23 22:38:37,204 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:38:37,204 - distributed.worker - INFO - dashboard at: 127.0.0.1:33459 8450s 2024-11-23 22:38:37,204 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33243 8450s 2024-11-23 22:38:37,204 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:38:37,204 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:38:37,204 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:38:37,204 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-gaixpbvv 8450s 2024-11-23 22:38:37,204 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:38:37,209 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37649. Reason: failure-to-start- 8450s 2024-11-23 22:38:37,209 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:38:37,209 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35273. Reason: failure-to-start- 8450s 2024-11-23 22:38:37,210 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:38:37,211 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33243': TLS handshake failed with remote 'tls://127.0.0.1:51504': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:38:37,211 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33243': TLS handshake failed with remote 'tls://127.0.0.1:51518': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:38:37,213 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:38:38,219 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:38:38,226 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44463 8450s 2024-11-23 22:38:38,226 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40041/status 8450s 2024-11-23 22:38:38,229 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:38:38,248 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34215 8450s 2024-11-23 22:38:38,248 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34215 8450s 2024-11-23 22:38:38,248 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:38:38,248 - distributed.worker - INFO - dashboard at: 127.0.0.1:41061 8450s 2024-11-23 22:38:38,248 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44463 8450s 2024-11-23 22:38:38,248 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:38:38,248 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:38:38,248 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:38:38,248 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-fuv44zyi 8450s 2024-11-23 22:38:38,248 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:38:38,251 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38859 8450s 2024-11-23 22:38:38,251 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38859 8450s 2024-11-23 22:38:38,251 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:38:38,251 - distributed.worker - INFO - dashboard at: 127.0.0.1:46171 8450s 2024-11-23 22:38:38,251 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44463 8450s 2024-11-23 22:38:38,251 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:38:38,251 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:38:38,251 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:38:38,251 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-zrt35srj 8450s 2024-11-23 22:38:38,251 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:38:38,253 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34215. Reason: failure-to-start- 8450s 2024-11-23 22:38:38,253 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:38:38,253 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38859. Reason: failure-to-start- 8450s 2024-11-23 22:38:38,253 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:38:38,255 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44463': TLS handshake failed with remote 'tls://127.0.0.1:47788': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:38:38,255 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44463': TLS handshake failed with remote 'tls://127.0.0.1:47798': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:38:38,256 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:38:39,262 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:38:39,269 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39731 8450s 2024-11-23 22:38:39,269 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40545/status 8450s 2024-11-23 22:38:39,269 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:38:39,286 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37885 8450s 2024-11-23 22:38:39,287 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37885 8450s 2024-11-23 22:38:39,287 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:38:39,287 - distributed.worker - INFO - dashboard at: 127.0.0.1:39745 8450s 2024-11-23 22:38:39,287 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39731 8450s 2024-11-23 22:38:39,287 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:38:39,287 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:38:39,287 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:38:39,287 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-yxibd0q9 8450s 2024-11-23 22:38:39,287 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:38:39,289 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33885 8450s 2024-11-23 22:38:39,289 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33885 8450s 2024-11-23 22:38:39,289 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:38:39,289 - distributed.worker - INFO - dashboard at: 127.0.0.1:42667 8450s 2024-11-23 22:38:39,289 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39731 8450s 2024-11-23 22:38:39,289 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:38:39,289 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:38:39,289 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:38:39,289 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ups9nar8 8450s 2024-11-23 22:38:39,289 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:38:39,293 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37885. Reason: failure-to-start- 8450s 2024-11-23 22:38:39,293 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:38:39,294 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33885. Reason: failure-to-start- 8450s 2024-11-23 22:38:39,294 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:38:39,295 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39731': TLS handshake failed with remote 'tls://127.0.0.1:36748': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:38:39,295 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39731': TLS handshake failed with remote 'tls://127.0.0.1:36758': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:38:39,297 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s _____________________________ test_repr_temp_keys ______________________________ 8450s 8450s cls = , kwargs = {} 8450s 8450s @classmethod 8450s def temporary(cls, **kwargs): 8450s """Create a new temporary Security object. 8450s 8450s This creates a new self-signed key/cert pair suitable for securing 8450s communication for all roles in a Dask cluster. These keys/certs exist 8450s only in memory, and are stored in this object. 8450s 8450s This method requires the library ``cryptography`` be installed. 8450s """ 8450s try: 8450s > from cryptography import x509 8450s 8450s /usr/lib/python3/dist-packages/distributed/security.py:165: 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s /usr/lib/python3/dist-packages/cryptography/x509/__init__.py:7: in 8450s from cryptography.x509 import certificate_transparency, verification 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s 8450s # This file is dual licensed under the terms of the Apache License, Version 8450s # 2.0, and the BSD License. See the LICENSE file in the root of this repository 8450s # for complete details. 8450s 8450s from __future__ import annotations 8450s 8450s import abc 8450s import datetime 8450s 8450s from cryptography import utils 8450s > from cryptography.hazmat.bindings._rust import x509 as rust_x509 8450s E ImportError: cannot import name 'x509' from 'cryptography.hazmat.bindings._rust' (unknown location) 8450s 8450s /usr/lib/python3/dist-packages/cryptography/x509/certificate_transparency.py:11: ImportError 8450s 8450s During handling of the above exception, another exception occurred: 8450s 8450s def test_repr_temp_keys(): 8450s > xfail_ssl_issue5601() 8450s 8450s /usr/lib/python3/dist-packages/distributed/tests/test_security.py:155: 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s /usr/lib/python3/dist-packages/distributed/utils_test.py:1945: in xfail_ssl_issue5601 8450s Security.temporary() 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s 8450s cls = , kwargs = {} 8450s 8450s @classmethod 8450s def temporary(cls, **kwargs): 8450s """Create a new temporary Security object. 8450s 8450s This creates a new self-signed key/cert pair suitable for securing 8450s communication for all roles in a Dask cluster. These keys/certs exist 8450s only in memory, and are stored in this object. 8450s 8450s This method requires the library ``cryptography`` be installed. 8450s """ 8450s try: 8450s from cryptography import x509 8450s from cryptography.hazmat.backends import default_backend 8450s from cryptography.hazmat.primitives import hashes, serialization 8450s from cryptography.hazmat.primitives.asymmetric import rsa 8450s from cryptography.x509.oid import NameOID 8450s except ImportError: 8450s > raise ImportError( 8450s "Using `Security.temporary` requires `cryptography`, please " 8450s "install it using either pip or conda" 8450s ) 8450s E ImportError: Using `Security.temporary` requires `cryptography`, please install it using either pip or conda 8450s 8450s /usr/lib/python3/dist-packages/distributed/security.py:171: ImportError 8450s __________________________ test_temporary_credentials __________________________ 8450s 8450s cls = , kwargs = {} 8450s 8450s @classmethod 8450s def temporary(cls, **kwargs): 8450s """Create a new temporary Security object. 8450s 8450s This creates a new self-signed key/cert pair suitable for securing 8450s communication for all roles in a Dask cluster. These keys/certs exist 8450s only in memory, and are stored in this object. 8450s 8450s This method requires the library ``cryptography`` be installed. 8450s """ 8450s try: 8450s > from cryptography import x509 8450s 8450s /usr/lib/python3/dist-packages/distributed/security.py:165: 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s /usr/lib/python3/dist-packages/cryptography/x509/__init__.py:7: in 8450s from cryptography.x509 import certificate_transparency, verification 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s 8450s # This file is dual licensed under the terms of the Apache License, Version 8450s # 2.0, and the BSD License. See the LICENSE file in the root of this repository 8450s # for complete details. 8450s 8450s from __future__ import annotations 8450s 8450s import abc 8450s import datetime 8450s 8450s from cryptography import utils 8450s > from cryptography.hazmat.bindings._rust import x509 as rust_x509 8450s E ImportError: cannot import name 'x509' from 'cryptography.hazmat.bindings._rust' (unknown location) 8450s 8450s /usr/lib/python3/dist-packages/cryptography/x509/certificate_transparency.py:11: ImportError 8450s 8450s During handling of the above exception, another exception occurred: 8450s 8450s def test_temporary_credentials(): 8450s > xfail_ssl_issue5601() 8450s 8450s /usr/lib/python3/dist-packages/distributed/tests/test_security.py:448: 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s /usr/lib/python3/dist-packages/distributed/utils_test.py:1945: in xfail_ssl_issue5601 8450s Security.temporary() 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s 8450s cls = , kwargs = {} 8450s 8450s @classmethod 8450s def temporary(cls, **kwargs): 8450s """Create a new temporary Security object. 8450s 8450s This creates a new self-signed key/cert pair suitable for securing 8450s communication for all roles in a Dask cluster. These keys/certs exist 8450s only in memory, and are stored in this object. 8450s 8450s This method requires the library ``cryptography`` be installed. 8450s """ 8450s try: 8450s from cryptography import x509 8450s from cryptography.hazmat.backends import default_backend 8450s from cryptography.hazmat.primitives import hashes, serialization 8450s from cryptography.hazmat.primitives.asymmetric import rsa 8450s from cryptography.x509.oid import NameOID 8450s except ImportError: 8450s > raise ImportError( 8450s "Using `Security.temporary` requires `cryptography`, please " 8450s "install it using either pip or conda" 8450s ) 8450s E ImportError: Using `Security.temporary` requires `cryptography`, please install it using either pip or conda 8450s 8450s /usr/lib/python3/dist-packages/distributed/security.py:171: ImportError 8450s ________________ test_extra_conn_args_in_temporary_credentials _________________ 8450s 8450s cls = , kwargs = {} 8450s 8450s @classmethod 8450s def temporary(cls, **kwargs): 8450s """Create a new temporary Security object. 8450s 8450s This creates a new self-signed key/cert pair suitable for securing 8450s communication for all roles in a Dask cluster. These keys/certs exist 8450s only in memory, and are stored in this object. 8450s 8450s This method requires the library ``cryptography`` be installed. 8450s """ 8450s try: 8450s > from cryptography import x509 8450s 8450s /usr/lib/python3/dist-packages/distributed/security.py:165: 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s /usr/lib/python3/dist-packages/cryptography/x509/__init__.py:7: in 8450s from cryptography.x509 import certificate_transparency, verification 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s 8450s # This file is dual licensed under the terms of the Apache License, Version 8450s # 2.0, and the BSD License. See the LICENSE file in the root of this repository 8450s # for complete details. 8450s 8450s from __future__ import annotations 8450s 8450s import abc 8450s import datetime 8450s 8450s from cryptography import utils 8450s > from cryptography.hazmat.bindings._rust import x509 as rust_x509 8450s E ImportError: cannot import name 'x509' from 'cryptography.hazmat.bindings._rust' (unknown location) 8450s 8450s /usr/lib/python3/dist-packages/cryptography/x509/certificate_transparency.py:11: ImportError 8450s 8450s During handling of the above exception, another exception occurred: 8450s 8450s def test_extra_conn_args_in_temporary_credentials(): 8450s > xfail_ssl_issue5601() 8450s 8450s /usr/lib/python3/dist-packages/distributed/tests/test_security.py:466: 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s /usr/lib/python3/dist-packages/distributed/utils_test.py:1945: in xfail_ssl_issue5601 8450s Security.temporary() 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s 8450s cls = , kwargs = {} 8450s 8450s @classmethod 8450s def temporary(cls, **kwargs): 8450s """Create a new temporary Security object. 8450s 8450s This creates a new self-signed key/cert pair suitable for securing 8450s communication for all roles in a Dask cluster. These keys/certs exist 8450s only in memory, and are stored in this object. 8450s 8450s This method requires the library ``cryptography`` be installed. 8450s """ 8450s try: 8450s from cryptography import x509 8450s from cryptography.hazmat.backends import default_backend 8450s from cryptography.hazmat.primitives import hashes, serialization 8450s from cryptography.hazmat.primitives.asymmetric import rsa 8450s from cryptography.x509.oid import NameOID 8450s except ImportError: 8450s > raise ImportError( 8450s "Using `Security.temporary` requires `cryptography`, please " 8450s "install it using either pip or conda" 8450s ) 8450s E ImportError: Using `Security.temporary` requires `cryptography`, please install it using either pip or conda 8450s 8450s /usr/lib/python3/dist-packages/distributed/security.py:171: ImportError 8450s __________________________________ test_basic __________________________________ 8450s 8450s fut = , timeout = 0 8450s 8450s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 8450s async with asyncio.timeout(timeout): 8450s > return await fut 8450s 8450s /usr/lib/python3/dist-packages/distributed/utils.py:1960: 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s /usr/lib/python3/dist-packages/distributed/worker.py:1480: in start_unsafe 8450s await self._register_with_scheduler() 8450s /usr/lib/python3/dist-packages/distributed/worker.py:1179: in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s /usr/lib/python3/dist-packages/distributed/comm/core.py:342: in connect 8450s comm = await wait_for( 8450s /usr/lib/python3/dist-packages/distributed/utils.py:1960: in wait_for 8450s return await fut 8450s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:546: in connect 8450s stream = await self.client.connect( 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s 8450s self = , host = '127.0.0.1' 8450s port = 46727, af = 8450s ssl_options = 8450s max_buffer_size = 8364507136.0, source_ip = None, source_port = None 8450s timeout = None 8450s 8450s async def connect( 8450s self, 8450s host: str, 8450s port: int, 8450s af: socket.AddressFamily = socket.AF_UNSPEC, 8450s ssl_options: Optional[Union[Dict[str, Any], ssl.SSLContext]] = None, 8450s max_buffer_size: Optional[int] = None, 8450s source_ip: Optional[str] = None, 8450s source_port: Optional[int] = None, 8450s timeout: Optional[Union[float, datetime.timedelta]] = None, 8450s ) -> IOStream: 8450s """Connect to the given host and port. 8450s 8450s Asynchronously returns an `.IOStream` (or `.SSLIOStream` if 8450s ``ssl_options`` is not None). 8450s 8450s Using the ``source_ip`` kwarg, one can specify the source 8450s IP address to use when establishing the connection. 8450s In case the user needs to resolve and 8450s use a specific interface, it has to be handled outside 8450s of Tornado as this depends very much on the platform. 8450s 8450s Raises `TimeoutError` if the input future does not complete before 8450s ``timeout``, which may be specified in any form allowed by 8450s `.IOLoop.add_timeout` (i.e. a `datetime.timedelta` or an absolute time 8450s relative to `.IOLoop.time`) 8450s 8450s Similarly, when the user requires a certain source port, it can 8450s be specified using the ``source_port`` arg. 8450s 8450s .. versionchanged:: 4.5 8450s Added the ``source_ip`` and ``source_port`` arguments. 8450s 8450s .. versionchanged:: 5.0 8450s Added the ``timeout`` argument. 8450s """ 8450s if timeout is not None: 8450s if isinstance(timeout, numbers.Real): 8450s timeout = IOLoop.current().time() + timeout 8450s elif isinstance(timeout, datetime.timedelta): 8450s timeout = IOLoop.current().time() + timeout.total_seconds() 8450s else: 8450s raise TypeError("Unsupported timeout %r" % timeout) 8450s if timeout is not None: 8450s addrinfo = await gen.with_timeout( 8450s timeout, self.resolver.resolve(host, port, af) 8450s ) 8450s else: 8450s addrinfo = await self.resolver.resolve(host, port, af) 8450s connector = _Connector( 8450s addrinfo, 8450s functools.partial( 8450s self._create_stream, 8450s max_buffer_size, 8450s source_ip=source_ip, 8450s source_port=source_port, 8450s ), 8450s ) 8450s > af, addr, stream = await connector.start(connect_timeout=timeout) 8450s E asyncio.exceptions.CancelledError 8450s 8450s /usr/lib/python3/dist-packages/tornado/tcpclient.py:279: CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s self = 8450s 8450s @final 8450s async def start(self): 8450s async with self._startup_lock: 8450s if self.status == Status.failed: 8450s assert self.__startup_exc is not None 8450s raise self.__startup_exc 8450s elif self.status != Status.init: 8450s return self 8450s timeout = getattr(self, "death_timeout", None) 8450s 8450s async def _close_on_failure(exc: Exception) -> None: 8450s await self.close(reason=f"failure-to-start-{str(type(exc))}") 8450s self.status = Status.failed 8450s self.__startup_exc = exc 8450s 8450s try: 8450s > await wait_for(self.start_unsafe(), timeout=timeout) 8450s 8450s /usr/lib/python3/dist-packages/distributed/core.py:664: 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 8450s async with asyncio.timeout(timeout): 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s 8450s self = 8450s exc_type = 8450s exc_val = CancelledError(), exc_tb = 8450s 8450s async def __aexit__( 8450s self, 8450s exc_type: Optional[Type[BaseException]], 8450s exc_val: Optional[BaseException], 8450s exc_tb: Optional[TracebackType], 8450s ) -> Optional[bool]: 8450s assert self._state in (_State.ENTERED, _State.EXPIRING) 8450s 8450s if self._timeout_handler is not None: 8450s self._timeout_handler.cancel() 8450s self._timeout_handler = None 8450s 8450s if self._state is _State.EXPIRING: 8450s self._state = _State.EXPIRED 8450s 8450s if self._task.uncancel() <= self._cancelling and exc_type is not None: 8450s # Since there are no new cancel requests, we're 8450s # handling this. 8450s if issubclass(exc_type, exceptions.CancelledError): 8450s > raise TimeoutError from exc_val 8450s E TimeoutError 8450s 8450s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s @contextlib.asynccontextmanager 8450s async def _cluster_factory(): 8450s workers = [] 8450s s = None 8450s try: 8450s for _ in range(60): 8450s try: 8450s > s, ws = await start_cluster( 8450s nthreads, 8450s scheduler, 8450s security=security, 8450s Worker=Worker, 8450s scheduler_kwargs=scheduler_kwargs, 8450s worker_kwargs=merge( 8450s {"death_timeout": min(15, int(deadline.remaining))}, 8450s worker_kwargs, 8450s ), 8450s ) 8450s 8450s /usr/lib/python3/dist-packages/distributed/utils_test.py:966: 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s /usr/lib/python3/dist-packages/distributed/utils_test.py:789: in start_cluster 8450s await asyncio.gather(*workers) 8450s /usr/lib/python3.13/asyncio/tasks.py:737: in _wrap_awaitable 8450s return await awaitable 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s 8450s self = 8450s 8450s @final 8450s async def start(self): 8450s async with self._startup_lock: 8450s if self.status == Status.failed: 8450s assert self.__startup_exc is not None 8450s raise self.__startup_exc 8450s elif self.status != Status.init: 8450s return self 8450s timeout = getattr(self, "death_timeout", None) 8450s 8450s async def _close_on_failure(exc: Exception) -> None: 8450s await self.close(reason=f"failure-to-start-{str(type(exc))}") 8450s self.status = Status.failed 8450s self.__startup_exc = exc 8450s 8450s try: 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s except asyncio.TimeoutError as exc: 8450s await _close_on_failure(exc) 8450s > raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s E TimeoutError: Worker start timed out after 0s. 8450s 8450s /usr/lib/python3/dist-packages/distributed/core.py:667: TimeoutError 8450s 8450s During handling of the above exception, another exception occurred: 8450s 8450s fut = ._..test_func..async_fn at 0xe87982e0> 8450s timeout = 60 8450s 8450s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 8450s async with asyncio.timeout(timeout): 8450s > return await fut 8450s 8450s /usr/lib/python3/dist-packages/distributed/utils.py:1960: 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s /usr/lib/python3/dist-packages/distributed/utils_test.py:999: in async_fn 8450s _cluster_factory() as (s, workers), 8450s /usr/lib/python3.13/contextlib.py:214: in __aenter__ 8450s return await anext(self.gen) 8450s /usr/lib/python3/dist-packages/distributed/utils_test.py:983: in _cluster_factory 8450s await asyncio.sleep(1) 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s 8450s delay = 1, result = None 8450s 8450s async def sleep(delay, result=None): 8450s """Coroutine that completes after a given time (in seconds).""" 8450s if delay <= 0: 8450s await __sleep0() 8450s return result 8450s 8450s if math.isnan(delay): 8450s raise ValueError("Invalid delay: NaN (not a number)") 8450s 8450s loop = events.get_running_loop() 8450s future = loop.create_future() 8450s h = loop.call_later(delay, 8450s futures._set_result_unless_cancelled, 8450s future, result) 8450s try: 8450s > return await future 8450s E asyncio.exceptions.CancelledError 8450s 8450s /usr/lib/python3.13/asyncio/tasks.py:718: CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s args = (), kwds = {} 8450s 8450s @wraps(func) 8450s def inner(*args, **kwds): 8450s with self._recreate_cm(): 8450s > return func(*args, **kwds) 8450s 8450s /usr/lib/python3.13/contextlib.py:85: 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s /usr/lib/python3.13/contextlib.py:85: in inner 8450s return func(*args, **kwds) 8450s /usr/lib/python3/dist-packages/distributed/utils_test.py:1102: in test_func 8450s return _run_and_close_tornado(async_fn_outer) 8450s /usr/lib/python3/dist-packages/distributed/utils_test.py:378: in _run_and_close_tornado 8450s return asyncio_run(inner_fn(), loop_factory=get_loop_factory()) 8450s /usr/lib/python3.13/asyncio/runners.py:194: in run 8450s return runner.run(main) 8450s /usr/lib/python3.13/asyncio/runners.py:118: in run 8450s return self._loop.run_until_complete(task) 8450s /usr/lib/python3.13/asyncio/base_events.py:720: in run_until_complete 8450s return future.result() 8450s /usr/lib/python3/dist-packages/distributed/utils_test.py:375: in inner_fn 8450s return await async_fn(*args, **kwargs) 8450s /usr/lib/python3/dist-packages/distributed/utils_test.py:1099: in async_fn_outer 8450s return await utils_wait_for(async_fn(), timeout=timeout * 2) 8450s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 8450s async with asyncio.timeout(timeout): 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s 8450s self = 8450s exc_type = 8450s exc_val = CancelledError(), exc_tb = 8450s 8450s async def __aexit__( 8450s self, 8450s exc_type: Optional[Type[BaseException]], 8450s exc_val: Optional[BaseException], 8450s exc_tb: Optional[TracebackType], 8450s ) -> Optional[bool]: 8450s assert self._state in (_State.ENTERED, _State.EXPIRING) 8450s 8450s if self._timeout_handler is not None: 8450s self._timeout_handler.cancel() 8450s self._timeout_handler = None 8450s 8450s if self._state is _State.EXPIRING: 8450s self._state = _State.EXPIRED 8450s 8450s if self._task.uncancel() <= self._cancelling and exc_type is not None: 8450s # Since there are no new cancel requests, we're 8450s # handling this. 8450s if issubclass(exc_type, exceptions.CancelledError): 8450s > raise TimeoutError from exc_val 8450s E TimeoutError 8450s 8450s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 8450s ----------------------------- Captured stderr call ----------------------------- 8450s 2024-11-23 22:38:41,040 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:38:41,049 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:41,049 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40499/status 8450s 2024-11-23 22:38:41,049 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:38:41,066 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37313 8450s 2024-11-23 22:38:41,066 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37313 8450s 2024-11-23 22:38:41,066 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:38:41,066 - distributed.worker - INFO - dashboard at: 127.0.0.1:36991 8450s 2024-11-23 22:38:41,066 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:41,066 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:38:41,066 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:38:41,066 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:38:41,066 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-551l5k4r 8450s 2024-11-23 22:38:41,066 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:38:41,069 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44417 8450s 2024-11-23 22:38:41,069 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44417 8450s 2024-11-23 22:38:41,069 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:38:41,069 - distributed.worker - INFO - dashboard at: 127.0.0.1:45725 8450s 2024-11-23 22:38:41,069 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:41,069 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:38:41,069 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:38:41,069 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:38:41,069 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-mocfxmzv 8450s 2024-11-23 22:38:41,069 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:38:41,083 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:41,084 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:41,084 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:42000': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:41,084 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:42004': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:41,191 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:41,192 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:42018': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:41,197 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:41,197 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:42030': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:41,299 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:41,300 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:42038': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:41,307 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:41,308 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:42050': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:41,408 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:41,408 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:42062': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:41,415 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:41,415 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:42068': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:41,516 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:41,516 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:42076': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:41,523 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:41,523 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:42086': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:41,624 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:41,624 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:35290': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:41,631 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:41,631 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:35306': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:41,732 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:41,732 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:35314': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:41,739 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:41,739 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:35324': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:41,840 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:41,840 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:35340': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:41,847 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:41,847 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:35352': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:41,948 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:41,949 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:35362': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:41,955 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:41,956 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:35366': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:42,060 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:42,060 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:35382': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:42,067 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:42,067 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:35398': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:42,168 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:42,169 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:35412': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:42,175 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:42,176 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:35420': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:42,276 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:42,277 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:35426': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:42,283 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:42,284 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:35438': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:42,386 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:42,387 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:35452': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:42,393 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:42,393 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:35460': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:42,495 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:42,496 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:35466': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:42,502 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:42,503 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:35468': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:42,603 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:42,603 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:35470': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:42,610 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:42,610 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:35474': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:42,711 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:42,712 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:35484': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:42,718 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:42,719 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:35486': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:42,820 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:42,820 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:35500': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:42,827 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:42,827 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:35508': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:42,928 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:42,928 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:35514': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:42,935 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:42,935 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:35530': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:43,036 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:43,036 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:35544': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:43,043 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:43,043 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:35556': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:43,144 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:43,144 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:35566': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:43,151 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:43,151 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:35578': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:43,252 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:43,252 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:35584': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:43,259 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:43,259 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:35598': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:43,360 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:43,360 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:35612': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:43,366 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:43,367 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:35622': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:43,467 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:43,468 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:35632': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:43,474 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:43,475 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:35644': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:43,575 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:43,576 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:35654': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:43,582 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:43,583 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:35668': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:43,683 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:43,684 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:35670': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:43,690 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:43,691 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:35672': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:43,791 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:43,792 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:35686': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:43,798 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:43,800 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:35696': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:43,900 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:43,901 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:35710': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:43,907 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:43,907 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:35724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:44,008 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:44,009 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:35732': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:44,015 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:44,015 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:35742': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:44,116 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:44,116 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:35752': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:44,123 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:44,123 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:35754': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:44,224 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:44,225 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:35756': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:44,231 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:44,231 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:35770': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:44,333 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:44,334 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:35778': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:44,340 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:44,340 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:35780': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:44,441 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:44,441 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:35788': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:44,448 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:44,448 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:35794': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:44,550 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:44,551 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:35808': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:44,560 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:44,561 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:35812': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:44,657 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:44,658 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:35820': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:44,668 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:44,668 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:35824': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:44,765 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:44,765 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:35832': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:44,775 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:44,776 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:35838': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:44,873 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:44,873 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:35840': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:44,883 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:44,883 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:35846': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:44,980 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:44,981 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:35848': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:44,991 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:44,991 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:35856': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:45,088 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:45,088 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:35872': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:45,098 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:45,099 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:35884': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:45,196 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:45,196 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:35892': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:45,206 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:45,207 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:35898': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:45,303 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:45,304 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:35906': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:45,315 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:45,316 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:35920': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:45,411 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:45,412 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:35928': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:45,423 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:45,423 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:35940': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:45,519 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:45,519 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:35950': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:45,530 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:45,531 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:35956': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:45,627 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:45,628 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:35964': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:45,637 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:45,638 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:35966': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:45,735 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:45,735 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:35976': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:45,745 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:45,746 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:35982': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:45,843 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:45,843 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:35986': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:45,853 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:45,854 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:35998': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:45,951 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:45,952 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:36006': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:45,960 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:45,961 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:36010': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:46,060 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:46,061 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:36012': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:46,068 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:46,068 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:36026': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:46,169 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:46,170 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:36038': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:46,176 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:46,176 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:36052': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:46,278 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:46,279 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:36062': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:46,285 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:46,286 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:36070': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:46,387 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:46,387 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:36078': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:46,394 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:46,394 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:36094': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:46,495 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:46,496 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:36098': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:46,502 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:46,502 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:36104': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:46,603 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:46,603 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:36108': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:46,610 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:46,610 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:36112': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:46,711 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:46,712 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:36122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:46,718 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:46,718 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:36124': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:46,831 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:46,833 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:36128': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:46,840 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:46,841 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:36138': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:46,940 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:46,940 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:36146': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:46,948 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:46,948 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:36150': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:47,048 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:47,048 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:36162': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:47,061 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:47,061 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:36172': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:47,157 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:47,157 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:36184': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:47,168 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:47,169 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:36200': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:47,265 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:47,265 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:36216': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:47,276 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:47,276 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:36228': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:47,372 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:47,373 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:36240': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:47,383 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:47,384 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:36248': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:47,480 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:47,480 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:36262': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:47,491 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:47,491 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:36268': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:47,588 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:47,588 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:36280': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:47,599 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:47,600 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:36282': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:47,696 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:47,696 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:36290': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:47,707 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:47,708 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:36298': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:47,803 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:47,804 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:36310': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:47,815 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:47,815 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:36316': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:47,911 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:47,911 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:36318': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:47,922 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:47,923 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:36322': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:48,019 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:48,020 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:36328': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:48,029 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:48,030 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:36330': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:48,127 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:48,127 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:36338': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:48,137 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:48,138 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:36354': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:48,235 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:48,236 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:36368': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:48,245 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:48,245 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:36378': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:48,343 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:48,344 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:36390': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:48,354 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:48,354 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:36404': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:48,452 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:48,452 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:36420': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:48,461 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:48,461 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:36424': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:48,561 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:48,561 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:36434': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:48,568 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:48,568 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:36442': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:48,669 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:48,669 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:36452': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:48,676 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:48,676 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:36454': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:48,777 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:48,777 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:36460': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:48,784 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:48,784 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:36468': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:48,885 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:48,886 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:36472': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:48,892 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:48,893 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:36482': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:48,994 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:48,995 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:36484': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:49,001 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:49,002 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:36498': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:49,102 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:49,103 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:36512': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:49,110 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:49,110 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:36524': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:49,211 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:49,212 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:36540': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:49,218 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:49,218 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:36550': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:49,319 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:49,320 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:36558': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:49,326 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:49,327 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:36562': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:49,428 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:49,429 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:36570': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:49,435 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:49,435 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:36584': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:49,536 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:49,537 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:36598': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:49,543 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:49,543 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:36608': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:49,643 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:49,644 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:36618': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:49,650 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:49,651 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:36630': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:49,753 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:49,754 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:36632': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:49,760 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:49,760 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:36646': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:49,860 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:49,861 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:36654': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:49,868 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:49,869 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:36662': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:49,968 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:49,969 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:36666': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:49,975 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:49,976 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:36668': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:50,076 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:50,077 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:36678': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:50,084 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:50,084 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:36690': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:50,185 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:50,186 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:36706': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:50,192 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:50,193 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:36714': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:50,294 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:50,295 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:36724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:50,302 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:50,302 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:36730': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:50,402 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:50,403 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:36742': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:50,409 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:50,409 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:36752': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:50,510 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:50,511 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:36760': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:50,517 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:50,517 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:36772': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:50,618 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:50,619 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:36774': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:50,625 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:50,626 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:36782': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:50,726 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:50,727 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:36784': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:50,734 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:50,734 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:36788': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:50,835 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:50,836 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:36796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:50,842 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:50,842 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:36804': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:50,943 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:50,943 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:36810': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:50,950 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:50,950 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:36814': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:51,052 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:51,056 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:36820': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:51,062 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:51,063 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:36832': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:51,160 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:51,160 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:36840': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:51,170 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:51,170 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:36852': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:51,268 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:51,268 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:36868': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:51,277 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:51,278 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:36884': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:51,377 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:51,377 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:36896': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:51,386 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:51,387 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:36908': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:51,485 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:51,486 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:36918': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:51,493 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:51,494 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:36932': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:51,593 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:51,593 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:41022': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:51,600 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:51,600 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:41038': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:51,702 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:51,702 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:41050': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:51,709 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:51,709 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:41064': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:51,809 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:51,810 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:41066': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:51,816 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:51,817 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:41070': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:51,917 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:51,918 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:41076': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:51,924 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:51,925 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:41088': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:52,025 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:52,026 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:41104': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:52,032 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:52,033 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:41120': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:52,134 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:52,135 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:41128': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:52,142 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:52,142 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:41140': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:52,243 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:52,244 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:41152': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:52,250 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:52,250 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:41166': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:52,352 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:52,353 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:41170': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:52,359 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:52,359 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:41178': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:52,459 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:52,459 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:41188': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:52,466 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:52,466 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:41196': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:52,567 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:52,567 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:41204': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:52,574 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:52,574 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:41206': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:52,675 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:52,676 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:41210': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:52,682 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:52,682 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:41226': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:52,783 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:52,784 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:41228': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:52,790 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:52,791 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:41240': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:52,891 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:52,891 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:41246': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:52,899 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:52,900 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:41248': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:52,999 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:53,000 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:41264': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:53,006 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:53,006 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:41276': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:53,107 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:53,108 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:41282': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:53,114 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:53,114 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:41298': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:53,216 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:53,217 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:41312': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:53,223 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:53,224 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:41326': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:53,324 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:53,324 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:41336': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:53,331 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:53,332 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:41350': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:53,432 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:53,433 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:41362': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:53,439 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:53,440 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:41372': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:53,541 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:53,542 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:41382': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:53,548 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:53,548 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:41394': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:53,649 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:53,650 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:41398': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:53,657 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:53,657 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:41412': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:53,758 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:53,758 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:41420': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:53,765 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:53,765 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:41428': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:53,867 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:53,868 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:41430': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:53,874 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:53,875 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:41432': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:53,976 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:53,977 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:41444': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:53,984 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:53,984 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:41446': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:54,085 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:54,085 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:41462': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:54,092 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:54,092 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:41476': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:54,192 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:54,193 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:41482': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:54,200 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:54,200 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:41490': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:54,300 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:54,301 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:41502': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:54,307 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:54,308 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:41506': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:54,408 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:54,409 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:41518': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:54,415 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:54,417 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:41528': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:54,516 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:54,516 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:41530': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:54,524 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:54,525 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:41542': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:54,624 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:54,624 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:41552': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:54,632 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:54,632 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:41556': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:54,732 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:54,732 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:41560': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:54,739 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:54,739 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:41566': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:54,839 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:54,840 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:41568': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:54,846 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:54,847 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:41578': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:54,948 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:54,949 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:41584': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:54,955 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:54,956 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:41586': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:55,059 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:55,059 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:41596': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:55,066 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:55,066 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:41612': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:55,166 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:55,167 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:41618': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:55,173 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:55,173 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:41620': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:55,274 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:55,275 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:41636': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:55,281 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:55,282 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:41648': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:55,382 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:55,382 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:41650': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:55,389 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:55,389 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:41654': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:55,490 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:55,491 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:41656': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:55,497 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:55,497 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:41660': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:55,599 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:55,600 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:41666': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:55,606 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:55,606 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:41678': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:55,707 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:55,707 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:41690': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:55,714 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:55,714 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:41696': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:55,815 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:55,816 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:41708': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:55,822 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:55,822 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:41714': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:55,934 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:55,937 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:41728': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:55,943 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:55,943 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:41736': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:56,043 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:56,044 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:41746': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:56,050 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36503 8450s 2024-11-23 22:38:56,050 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36503': TLS handshake failed with remote 'tls://127.0.0.1:41754': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:56,064 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37313. Reason: failure-to-start- 8450s 2024-11-23 22:38:56,065 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:38:56,067 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44417. Reason: failure-to-start- 8450s 2024-11-23 22:38:56,068 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:38:56,069 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 15s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 8450s stream = await stream.start_tls( 8450s ^^^^^^^^^^^^^^^^^^^^^^^ 8450s False, ssl_options=ssl_options, server_hostname=host 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 8450s self.socket.do_handshake() 8450s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 8450s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 8450s self._sslobj.do_handshake() 8450s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 8450s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 8450s raise FatalCommClosedError( 8450s ...<2 lines>... 8450s ) from err 8450s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 8450s 8450s During handling of the above exception, another exception occurred: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1218, in _register_with_scheduler 8450s await asyncio.sleep(0.1) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 718, in sleep 8450s return await future 8450s ^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 15s. 8450s 2024-11-23 22:38:57,079 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:38:57,087 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33817 8450s 2024-11-23 22:38:57,087 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37015/status 8450s 2024-11-23 22:38:57,087 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:38:57,103 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44159 8450s 2024-11-23 22:38:57,103 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44159 8450s 2024-11-23 22:38:57,103 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:38:57,103 - distributed.worker - INFO - dashboard at: 127.0.0.1:40399 8450s 2024-11-23 22:38:57,103 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:38:57,103 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:38:57,103 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:38:57,103 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:38:57,103 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-0mljj741 8450s 2024-11-23 22:38:57,103 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:38:57,106 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35875 8450s 2024-11-23 22:38:57,107 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35875 8450s 2024-11-23 22:38:57,107 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:38:57,107 - distributed.worker - INFO - dashboard at: 127.0.0.1:37339 8450s 2024-11-23 22:38:57,107 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:38:57,107 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:38:57,107 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:38:57,107 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:38:57,107 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-cw3m80e_ 8450s 2024-11-23 22:38:57,107 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:38:57,121 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:38:57,121 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:38:57,121 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:43112': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:57,121 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:43122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:57,234 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:38:57,234 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:38:57,235 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:43124': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:57,235 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:43140': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:57,348 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:38:57,348 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:38:57,349 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:43148': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:57,349 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:43158': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:57,466 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:38:57,467 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:38:57,467 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:43172': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:57,467 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:43184': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:57,581 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:38:57,581 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:38:57,581 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:43194': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:57,582 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:43200': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:57,694 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:38:57,695 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:38:57,695 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:43206': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:57,695 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:43212': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:57,823 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:38:57,824 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:38:57,826 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:43214': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:57,826 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:43222': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:57,939 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:38:57,939 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:38:57,940 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:43236': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:57,940 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:43248': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:58,054 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:38:58,054 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:38:58,059 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:43264': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:58,059 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:43280': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:58,167 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:38:58,168 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:38:58,168 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:43282': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:58,168 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:43298': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:58,282 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:38:58,282 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:38:58,283 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:43304': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:58,283 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:43310': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:58,395 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:38:58,395 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:38:58,396 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:43316': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:58,396 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:43318': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:58,509 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:38:58,509 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:38:58,510 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:43328': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:58,510 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:43330': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:58,623 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:38:58,623 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:38:58,623 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:43342': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:58,624 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:43348': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:58,737 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:38:58,737 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:38:58,737 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:43356': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:58,737 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:43366': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:58,851 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:38:58,851 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:38:58,852 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:43368': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:58,852 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:43376': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:58,966 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:38:58,966 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:38:58,966 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:43390': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:58,966 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:43400': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:59,080 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:38:59,080 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:38:59,081 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:43408': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:59,081 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:43416': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:59,194 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:38:59,194 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:38:59,195 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:43426': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:59,195 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:43438': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:59,307 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:38:59,308 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:38:59,308 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:43452': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:59,308 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:43464': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:59,421 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:38:59,421 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:38:59,422 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:43472': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:59,422 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:43476': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:59,534 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:38:59,535 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:38:59,535 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:43492': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:59,535 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:43506': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:59,648 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:38:59,648 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:38:59,649 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:43518': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:59,649 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:43520': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:59,761 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:38:59,762 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:38:59,762 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:43534': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:59,762 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:43544': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:59,875 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:38:59,875 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:38:59,876 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:43560': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:59,876 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:43568': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:59,988 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:38:59,989 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:38:59,989 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:43574': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:38:59,989 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:43576': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:00,104 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:00,105 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:00,105 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:43584': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:00,105 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:43586': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:00,219 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:00,219 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:00,219 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:43596': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:00,219 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:43608': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:00,332 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:00,332 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:00,333 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:43610': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:00,333 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:43626': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:00,446 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:00,446 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:00,447 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:43638': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:00,447 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:43644': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:00,559 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:00,560 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:00,563 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:43650': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:00,564 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:43664': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:00,674 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:00,675 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:00,675 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:43670': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:00,675 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:43684': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:00,790 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:00,790 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:00,791 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:43690': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:00,791 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:43692': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:00,903 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:00,903 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:00,904 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:43694': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:00,904 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:43708': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:01,017 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:01,017 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:01,017 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:43718': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:01,017 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:43732': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:01,131 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:01,131 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:01,132 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:43746': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:01,132 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:43758': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:01,245 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:01,245 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:01,245 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:43762': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:01,245 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:43774': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:01,358 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:01,358 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:01,358 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:43776': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:01,359 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:43792': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:01,471 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:01,471 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:01,472 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:43806': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:01,472 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:43808': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:01,586 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:01,587 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:01,587 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:48652': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:01,587 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:48658': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:01,700 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:01,700 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:01,700 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:48672': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:01,700 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:48674': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:01,814 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:01,814 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:01,814 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:48680': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:01,814 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:48696': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:01,928 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:01,929 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:01,929 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:48710': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:01,929 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:48726': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:02,042 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:02,043 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:02,043 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:48734': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:02,043 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:48746': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:02,158 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:02,158 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:02,158 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:48754': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:02,158 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:48768': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:02,272 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:02,272 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:02,272 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:48770': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:02,272 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:48786': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:02,385 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:02,385 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:02,386 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:48802': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:02,386 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:48814': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:02,499 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:02,499 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:02,499 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:48818': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:02,499 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:48830': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:02,614 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:02,615 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:02,615 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:48846': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:02,615 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:48856': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:02,728 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:02,728 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:02,728 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:48866': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:02,729 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:48870': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:02,842 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:02,842 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:02,843 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:48878': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:02,843 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:48890': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:02,956 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:02,956 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:02,957 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:48898': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:02,957 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:48912': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:03,069 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:03,070 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:03,070 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:48920': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:03,070 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:48924': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:03,184 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:03,184 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:03,184 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:48932': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:03,184 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:48946': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:03,298 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:03,298 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:03,298 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:48948': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:03,298 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:48950': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:03,411 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:03,412 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:03,412 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:48954': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:03,412 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:48968': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:03,524 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:03,525 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:03,525 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:48974': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:03,525 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:48980': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:03,638 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:03,638 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:03,639 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:48996': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:03,639 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:49002': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:03,752 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:03,753 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:03,753 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:49010': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:03,753 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:49022': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:03,865 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:03,866 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:03,866 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:49032': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:03,866 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:49036': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:03,979 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:03,979 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:03,980 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:49050': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:03,980 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:49054': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:04,095 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:04,095 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:04,099 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:49066': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:04,099 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:49072': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:04,208 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:04,208 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:04,209 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:49082': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:04,209 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:49088': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:04,322 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:04,322 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:04,323 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:49090': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:04,323 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:49106': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:04,438 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:04,438 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:04,439 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:49122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:04,439 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:49132': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:04,552 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:04,552 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:04,552 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:49148': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:04,552 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:49150': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:04,665 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:04,666 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:04,666 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:49160': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:04,666 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:49168': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:04,779 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:04,779 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:04,780 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:49180': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:04,780 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:49192': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:04,893 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:04,893 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:04,893 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:49208': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:04,893 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:49214': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:05,006 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:05,006 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:05,007 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:49218': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:05,007 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:49222': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:05,120 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:05,120 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:05,120 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:49236': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:05,121 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:49238': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:05,233 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:05,234 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:05,234 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:49252': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:05,234 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:49262': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:05,347 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:05,348 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:05,348 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:49270': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:05,348 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:49272': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:05,461 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:05,462 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:05,462 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:49276': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:05,462 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:49292': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:05,574 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:05,575 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:05,575 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:49300': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:05,575 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:49306': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:05,688 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:05,688 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:05,688 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:49316': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:05,688 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:49324': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:05,801 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:05,801 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:05,802 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:49334': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:05,802 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:49338': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:05,915 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:05,915 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:05,916 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:49340': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:05,916 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:49344': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:06,029 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:06,029 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:06,030 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:49348': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:06,030 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:49350': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:06,143 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:06,143 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:06,144 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:49364': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:06,144 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:49368': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:06,259 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:06,259 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:06,260 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:49374': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:06,260 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:49378': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:06,373 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:06,374 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:06,374 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:49388': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:06,374 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:49398': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:06,487 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:06,487 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:06,487 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:49402': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:06,487 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:49418': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:06,603 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:06,603 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:06,604 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:49420': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:06,604 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:49426': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:06,716 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:06,716 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:06,717 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:49434': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:06,717 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:49438': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:06,829 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:06,829 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:06,830 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:49442': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:06,830 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:49450': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:06,943 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:06,943 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:06,943 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:49464': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:06,943 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:49478': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:07,056 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:07,057 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:07,061 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:49490': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:07,061 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:49494': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:07,170 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:07,170 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:07,171 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:49500': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:07,171 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:49506': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:07,284 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:07,284 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:07,284 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:49510': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:07,285 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:49512': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:07,398 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:07,398 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:07,398 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:49528': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:07,399 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:49532': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:07,511 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:07,511 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:07,512 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:49534': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:07,512 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:49540': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:07,625 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:07,625 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:07,625 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:49554': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:07,625 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:49558': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:07,738 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:07,738 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:07,738 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:49574': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:07,739 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:49578': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:07,852 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:07,852 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:07,852 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:49594': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:07,852 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:49600': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:07,965 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:07,965 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:07,966 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:49612': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:07,966 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:49622': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:08,080 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:08,080 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:08,081 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:49636': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:08,081 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:49650': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:08,193 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:08,193 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:08,194 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:49652': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:08,194 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:49658': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:08,307 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:08,307 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:08,308 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:49666': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:08,308 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:49672': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:08,420 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:08,420 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:08,421 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:49682': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:08,421 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:49694': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:08,534 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:08,534 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:08,534 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:49702': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:08,534 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:49712': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:08,647 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:08,647 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:08,647 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:49716': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:08,647 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:49718': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:08,761 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:08,761 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:08,762 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:49724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:08,762 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:49738': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:08,874 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:08,874 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:08,875 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:49750': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:08,875 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:49762': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:08,987 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:08,987 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:08,988 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:49766': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:08,988 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:49770': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:09,103 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:09,104 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:09,104 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:49780': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:09,104 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:49794': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:09,236 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:09,236 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:09,237 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:49796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:09,237 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:49798': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:09,349 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:09,349 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:09,350 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:49802': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:09,350 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:49806': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:09,462 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:09,462 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:09,463 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:49810': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:09,464 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:49814': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:09,576 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:09,576 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:09,576 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:49824': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:09,576 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:49834': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:09,690 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:09,690 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:09,690 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:49848': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:09,691 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:49856': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:09,805 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:09,805 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:09,806 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:49858': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:09,806 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:49872': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:09,919 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:09,919 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:09,920 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:49876': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:09,920 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:49886': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:10,032 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:10,032 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33817 8450s 2024-11-23 22:39:10,033 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:49892': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:10,033 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33817': TLS handshake failed with remote 'tls://127.0.0.1:49902': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:10,102 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44159. Reason: failure-to-start- 8450s 2024-11-23 22:39:10,102 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:39:10,104 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 13s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 8450s stream = await stream.start_tls( 8450s ^^^^^^^^^^^^^^^^^^^^^^^ 8450s False, ssl_options=ssl_options, server_hostname=host 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 8450s self.socket.do_handshake() 8450s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 8450s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 8450s self._sslobj.do_handshake() 8450s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 8450s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 8450s raise FatalCommClosedError( 8450s ...<2 lines>... 8450s ) from err 8450s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 8450s 8450s During handling of the above exception, another exception occurred: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1218, in _register_with_scheduler 8450s await asyncio.sleep(0.1) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 718, in sleep 8450s return await future 8450s ^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 13s. 8450s 2024-11-23 22:39:10,109 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35875. Reason: failure-to-start- 8450s 2024-11-23 22:39:10,109 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:39:11,113 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:39:11,121 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33397 8450s 2024-11-23 22:39:11,121 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43863/status 8450s 2024-11-23 22:39:11,121 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:39:11,135 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38289 8450s 2024-11-23 22:39:11,135 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38289 8450s 2024-11-23 22:39:11,135 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:39:11,135 - distributed.worker - INFO - dashboard at: 127.0.0.1:39491 8450s 2024-11-23 22:39:11,135 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33397 8450s 2024-11-23 22:39:11,135 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:39:11,135 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:39:11,135 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:39:11,135 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-t4sezdmo 8450s 2024-11-23 22:39:11,135 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:39:11,137 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42229 8450s 2024-11-23 22:39:11,137 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42229 8450s 2024-11-23 22:39:11,137 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:39:11,137 - distributed.worker - INFO - dashboard at: 127.0.0.1:35011 8450s 2024-11-23 22:39:11,137 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33397 8450s 2024-11-23 22:39:11,137 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:39:11,137 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:39:11,137 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:39:11,138 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-zmbwj07k 8450s 2024-11-23 22:39:11,138 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:39:11,138 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38289. Reason: failure-to-start- 8450s 2024-11-23 22:39:11,139 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:39:11,139 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42229. Reason: failure-to-start- 8450s 2024-11-23 22:39:11,139 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:39:11,140 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33397': TLS handshake failed with remote 'tls://127.0.0.1:35140': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:39:11,140 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33397': TLS handshake failed with remote 'tls://127.0.0.1:35144': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:39:11,142 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:39:12,147 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:39:12,156 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36215 8450s 2024-11-23 22:39:12,157 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41097/status 8450s 2024-11-23 22:39:12,157 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:39:12,171 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33907 8450s 2024-11-23 22:39:12,171 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33907 8450s 2024-11-23 22:39:12,171 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:39:12,171 - distributed.worker - INFO - dashboard at: 127.0.0.1:38001 8450s 2024-11-23 22:39:12,171 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36215 8450s 2024-11-23 22:39:12,171 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:39:12,171 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:39:12,171 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:39:12,171 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-5tz0a340 8450s 2024-11-23 22:39:12,171 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:39:12,173 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46633 8450s 2024-11-23 22:39:12,174 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46633 8450s 2024-11-23 22:39:12,174 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:39:12,174 - distributed.worker - INFO - dashboard at: 127.0.0.1:38341 8450s 2024-11-23 22:39:12,174 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36215 8450s 2024-11-23 22:39:12,174 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:39:12,174 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:39:12,174 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:39:12,174 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ck9ku494 8450s 2024-11-23 22:39:12,174 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:39:12,175 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33907. Reason: failure-to-start- 8450s 2024-11-23 22:39:12,175 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:39:12,175 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46633. Reason: failure-to-start- 8450s 2024-11-23 22:39:12,175 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:39:12,177 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36215': TLS handshake failed with remote 'tls://127.0.0.1:43838': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:39:12,177 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36215': TLS handshake failed with remote 'tls://127.0.0.1:43854': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:39:12,178 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:39:13,184 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:39:13,192 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39441 8450s 2024-11-23 22:39:13,192 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46127/status 8450s 2024-11-23 22:39:13,192 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:39:13,208 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33423 8450s 2024-11-23 22:39:13,208 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33423 8450s 2024-11-23 22:39:13,208 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:39:13,208 - distributed.worker - INFO - dashboard at: 127.0.0.1:32873 8450s 2024-11-23 22:39:13,208 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39441 8450s 2024-11-23 22:39:13,209 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:39:13,209 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:39:13,209 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:39:13,209 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-x4mi52cj 8450s 2024-11-23 22:39:13,209 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:39:13,211 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33413 8450s 2024-11-23 22:39:13,211 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33413 8450s 2024-11-23 22:39:13,211 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:39:13,211 - distributed.worker - INFO - dashboard at: 127.0.0.1:42539 8450s 2024-11-23 22:39:13,211 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39441 8450s 2024-11-23 22:39:13,211 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:39:13,211 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:39:13,211 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:39:13,211 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-a7lqtiob 8450s 2024-11-23 22:39:13,211 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:39:13,212 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33423. Reason: failure-to-start- 8450s 2024-11-23 22:39:13,212 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:39:13,213 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33413. Reason: failure-to-start- 8450s 2024-11-23 22:39:13,213 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:39:13,214 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39441': TLS handshake failed with remote 'tls://127.0.0.1:51730': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:39:13,214 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39441': TLS handshake failed with remote 'tls://127.0.0.1:51736': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:39:13,216 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:39:14,221 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:39:14,229 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43643 8450s 2024-11-23 22:39:14,229 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41661/status 8450s 2024-11-23 22:39:14,229 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:39:14,243 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37377 8450s 2024-11-23 22:39:14,243 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37377 8450s 2024-11-23 22:39:14,243 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:39:14,243 - distributed.worker - INFO - dashboard at: 127.0.0.1:43705 8450s 2024-11-23 22:39:14,243 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43643 8450s 2024-11-23 22:39:14,243 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:39:14,243 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:39:14,243 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:39:14,243 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-qz1yeztc 8450s 2024-11-23 22:39:14,243 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:39:14,245 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37071 8450s 2024-11-23 22:39:14,246 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37071 8450s 2024-11-23 22:39:14,246 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:39:14,246 - distributed.worker - INFO - dashboard at: 127.0.0.1:41663 8450s 2024-11-23 22:39:14,246 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43643 8450s 2024-11-23 22:39:14,246 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:39:14,246 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:39:14,246 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:39:14,246 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-aan1cke5 8450s 2024-11-23 22:39:14,246 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:39:14,248 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37377. Reason: failure-to-start- 8450s 2024-11-23 22:39:14,248 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:39:14,248 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37071. Reason: failure-to-start- 8450s 2024-11-23 22:39:14,248 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:39:14,250 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43643': TLS handshake failed with remote 'tls://127.0.0.1:43300': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:39:14,250 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43643': TLS handshake failed with remote 'tls://127.0.0.1:43302': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:39:14,251 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:39:15,257 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:39:15,265 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38579 8450s 2024-11-23 22:39:15,266 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42529/status 8450s 2024-11-23 22:39:15,266 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:39:15,280 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42505 8450s 2024-11-23 22:39:15,280 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42505 8450s 2024-11-23 22:39:15,280 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:39:15,280 - distributed.worker - INFO - dashboard at: 127.0.0.1:34267 8450s 2024-11-23 22:39:15,280 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38579 8450s 2024-11-23 22:39:15,280 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:39:15,280 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:39:15,280 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:39:15,280 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-sxs1alyr 8450s 2024-11-23 22:39:15,280 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:39:15,282 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41271 8450s 2024-11-23 22:39:15,283 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41271 8450s 2024-11-23 22:39:15,283 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:39:15,283 - distributed.worker - INFO - dashboard at: 127.0.0.1:41645 8450s 2024-11-23 22:39:15,283 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38579 8450s 2024-11-23 22:39:15,283 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:39:15,283 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:39:15,283 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:39:15,283 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ksaitwrg 8450s 2024-11-23 22:39:15,283 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:39:15,284 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42505. Reason: failure-to-start- 8450s 2024-11-23 22:39:15,284 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:39:15,284 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41271. Reason: failure-to-start- 8450s 2024-11-23 22:39:15,285 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:39:15,286 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38579': TLS handshake failed with remote 'tls://127.0.0.1:50356': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:39:15,286 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38579': TLS handshake failed with remote 'tls://127.0.0.1:50360': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:39:15,288 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:39:16,293 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:39:16,302 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33773 8450s 2024-11-23 22:39:16,302 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46463/status 8450s 2024-11-23 22:39:16,302 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:39:16,316 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37625 8450s 2024-11-23 22:39:16,317 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37625 8450s 2024-11-23 22:39:16,317 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:39:16,317 - distributed.worker - INFO - dashboard at: 127.0.0.1:44889 8450s 2024-11-23 22:39:16,317 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33773 8450s 2024-11-23 22:39:16,317 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:39:16,317 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:39:16,317 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:39:16,317 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ai7hgnui 8450s 2024-11-23 22:39:16,317 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:39:16,319 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39903 8450s 2024-11-23 22:39:16,320 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39903 8450s 2024-11-23 22:39:16,320 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:39:16,320 - distributed.worker - INFO - dashboard at: 127.0.0.1:39841 8450s 2024-11-23 22:39:16,320 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33773 8450s 2024-11-23 22:39:16,320 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:39:16,320 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:39:16,320 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:39:16,320 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-mptr95zd 8450s 2024-11-23 22:39:16,320 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:39:16,321 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37625. Reason: failure-to-start- 8450s 2024-11-23 22:39:16,321 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:39:16,322 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39903. Reason: failure-to-start- 8450s 2024-11-23 22:39:16,322 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:39:16,323 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33773': TLS handshake failed with remote 'tls://127.0.0.1:34416': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:39:16,323 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33773': TLS handshake failed with remote 'tls://127.0.0.1:34430': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:39:16,324 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:39:17,331 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:39:17,338 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33689 8450s 2024-11-23 22:39:17,339 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41631/status 8450s 2024-11-23 22:39:17,339 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:39:17,358 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39823 8450s 2024-11-23 22:39:17,358 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39823 8450s 2024-11-23 22:39:17,358 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:39:17,358 - distributed.worker - INFO - dashboard at: 127.0.0.1:44879 8450s 2024-11-23 22:39:17,358 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33689 8450s 2024-11-23 22:39:17,359 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:39:17,359 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:39:17,359 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:39:17,359 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-blbom_eg 8450s 2024-11-23 22:39:17,359 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:39:17,361 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42309 8450s 2024-11-23 22:39:17,361 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42309 8450s 2024-11-23 22:39:17,361 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:39:17,361 - distributed.worker - INFO - dashboard at: 127.0.0.1:38955 8450s 2024-11-23 22:39:17,361 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33689 8450s 2024-11-23 22:39:17,361 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:39:17,361 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:39:17,361 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:39:17,361 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-g2k19k1s 8450s 2024-11-23 22:39:17,361 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:39:17,363 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39823. Reason: failure-to-start- 8450s 2024-11-23 22:39:17,363 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:39:17,363 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42309. Reason: failure-to-start- 8450s 2024-11-23 22:39:17,364 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:39:17,365 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33689': TLS handshake failed with remote 'tls://127.0.0.1:34616': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:39:17,365 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33689': TLS handshake failed with remote 'tls://127.0.0.1:34618': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:39:17,367 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:39:18,373 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:39:18,381 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46381 8450s 2024-11-23 22:39:18,381 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34721/status 8450s 2024-11-23 22:39:18,381 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:39:18,396 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43355 8450s 2024-11-23 22:39:18,397 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43355 8450s 2024-11-23 22:39:18,397 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:39:18,397 - distributed.worker - INFO - dashboard at: 127.0.0.1:39611 8450s 2024-11-23 22:39:18,397 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46381 8450s 2024-11-23 22:39:18,397 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:39:18,397 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:39:18,397 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:39:18,397 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-1lvpyd06 8450s 2024-11-23 22:39:18,397 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:39:18,399 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38645 8450s 2024-11-23 22:39:18,399 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38645 8450s 2024-11-23 22:39:18,399 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:39:18,399 - distributed.worker - INFO - dashboard at: 127.0.0.1:44783 8450s 2024-11-23 22:39:18,400 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46381 8450s 2024-11-23 22:39:18,400 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:39:18,400 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:39:18,400 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:39:18,400 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-x9lgzb9x 8450s 2024-11-23 22:39:18,400 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:39:18,402 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43355. Reason: failure-to-start- 8450s 2024-11-23 22:39:18,402 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:39:18,402 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38645. Reason: failure-to-start- 8450s 2024-11-23 22:39:18,403 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:39:18,404 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46381': TLS handshake failed with remote 'tls://127.0.0.1:34902': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:39:18,404 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46381': TLS handshake failed with remote 'tls://127.0.0.1:34916': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:39:18,406 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:39:19,412 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:39:19,419 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45881 8450s 2024-11-23 22:39:19,420 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41891/status 8450s 2024-11-23 22:39:19,420 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:39:19,434 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40005 8450s 2024-11-23 22:39:19,434 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40005 8450s 2024-11-23 22:39:19,434 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:39:19,434 - distributed.worker - INFO - dashboard at: 127.0.0.1:37571 8450s 2024-11-23 22:39:19,435 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45881 8450s 2024-11-23 22:39:19,435 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:39:19,435 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:39:19,435 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:39:19,435 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-oo963s5p 8450s 2024-11-23 22:39:19,435 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:39:19,437 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38787 8450s 2024-11-23 22:39:19,437 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38787 8450s 2024-11-23 22:39:19,437 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:39:19,437 - distributed.worker - INFO - dashboard at: 127.0.0.1:33315 8450s 2024-11-23 22:39:19,437 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45881 8450s 2024-11-23 22:39:19,437 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:39:19,437 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:39:19,437 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:39:19,437 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-vdt2bgbg 8450s 2024-11-23 22:39:19,437 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:39:19,439 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40005. Reason: failure-to-start- 8450s 2024-11-23 22:39:19,439 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:39:19,439 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38787. Reason: failure-to-start- 8450s 2024-11-23 22:39:19,440 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:39:19,441 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45881': TLS handshake failed with remote 'tls://127.0.0.1:42334': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:39:19,441 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45881': TLS handshake failed with remote 'tls://127.0.0.1:42342': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:39:19,443 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:39:20,448 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:39:20,457 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45471 8450s 2024-11-23 22:39:20,457 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34517/status 8450s 2024-11-23 22:39:20,457 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:39:20,472 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46677 8450s 2024-11-23 22:39:20,472 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46677 8450s 2024-11-23 22:39:20,472 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:39:20,472 - distributed.worker - INFO - dashboard at: 127.0.0.1:33151 8450s 2024-11-23 22:39:20,472 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45471 8450s 2024-11-23 22:39:20,472 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:39:20,472 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:39:20,472 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:39:20,472 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-vga9y87p 8450s 2024-11-23 22:39:20,472 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:39:20,474 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36727 8450s 2024-11-23 22:39:20,475 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36727 8450s 2024-11-23 22:39:20,475 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:39:20,475 - distributed.worker - INFO - dashboard at: 127.0.0.1:34611 8450s 2024-11-23 22:39:20,475 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45471 8450s 2024-11-23 22:39:20,475 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:39:20,475 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:39:20,475 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:39:20,475 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-5q_3_4rz 8450s 2024-11-23 22:39:20,475 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:39:20,476 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46677. Reason: failure-to-start- 8450s 2024-11-23 22:39:20,476 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:39:20,476 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36727. Reason: failure-to-start- 8450s 2024-11-23 22:39:20,477 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:39:20,478 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45471': TLS handshake failed with remote 'tls://127.0.0.1:51764': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:39:20,478 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45471': TLS handshake failed with remote 'tls://127.0.0.1:51780': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:39:20,479 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:39:21,485 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:39:21,511 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46801 8450s 2024-11-23 22:39:21,514 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37497/status 8450s 2024-11-23 22:39:21,515 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:39:21,540 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46317 8450s 2024-11-23 22:39:21,540 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46317 8450s 2024-11-23 22:39:21,540 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:39:21,540 - distributed.worker - INFO - dashboard at: 127.0.0.1:41325 8450s 2024-11-23 22:39:21,540 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46801 8450s 2024-11-23 22:39:21,540 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:39:21,540 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:39:21,540 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:39:21,540 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-lyzjwmod 8450s 2024-11-23 22:39:21,540 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:39:21,543 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44459 8450s 2024-11-23 22:39:21,543 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44459 8450s 2024-11-23 22:39:21,543 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:39:21,543 - distributed.worker - INFO - dashboard at: 127.0.0.1:36637 8450s 2024-11-23 22:39:21,543 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46801 8450s 2024-11-23 22:39:21,543 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:39:21,543 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:39:21,543 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:39:21,543 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-mmtczhew 8450s 2024-11-23 22:39:21,543 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:39:21,545 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46317. Reason: failure-to-start- 8450s 2024-11-23 22:39:21,545 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:39:21,546 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44459. Reason: failure-to-start- 8450s 2024-11-23 22:39:21,546 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:39:21,547 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46801': TLS handshake failed with remote 'tls://127.0.0.1:50348': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:39:21,547 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46801': TLS handshake failed with remote 'tls://127.0.0.1:50362': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:39:21,549 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:39:22,556 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:39:22,563 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41227 8450s 2024-11-23 22:39:22,563 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33109/status 8450s 2024-11-23 22:39:22,563 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:39:22,579 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42175 8450s 2024-11-23 22:39:22,579 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42175 8450s 2024-11-23 22:39:22,579 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:39:22,579 - distributed.worker - INFO - dashboard at: 127.0.0.1:45291 8450s 2024-11-23 22:39:22,579 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41227 8450s 2024-11-23 22:39:22,579 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:39:22,579 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:39:22,579 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:39:22,579 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-bothh_cz 8450s 2024-11-23 22:39:22,579 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:39:22,583 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33295 8450s 2024-11-23 22:39:22,583 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33295 8450s 2024-11-23 22:39:22,583 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:39:22,583 - distributed.worker - INFO - dashboard at: 127.0.0.1:35695 8450s 2024-11-23 22:39:22,583 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41227 8450s 2024-11-23 22:39:22,583 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:39:22,583 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:39:22,583 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:39:22,583 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-kceqpzz4 8450s 2024-11-23 22:39:22,583 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:39:22,584 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42175. Reason: failure-to-start- 8450s 2024-11-23 22:39:22,584 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:39:22,585 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33295. Reason: failure-to-start- 8450s 2024-11-23 22:39:22,585 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:39:22,586 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41227': TLS handshake failed with remote 'tls://127.0.0.1:49622': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:39:22,586 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41227': TLS handshake failed with remote 'tls://127.0.0.1:49624': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:39:22,588 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:39:23,594 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:39:23,601 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37745 8450s 2024-11-23 22:39:23,601 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43903/status 8450s 2024-11-23 22:39:23,601 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:39:23,615 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41625 8450s 2024-11-23 22:39:23,615 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41625 8450s 2024-11-23 22:39:23,615 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:39:23,615 - distributed.worker - INFO - dashboard at: 127.0.0.1:34889 8450s 2024-11-23 22:39:23,615 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37745 8450s 2024-11-23 22:39:23,616 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:39:23,616 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:39:23,616 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:39:23,616 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-twgweq2b 8450s 2024-11-23 22:39:23,616 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:39:23,618 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41785 8450s 2024-11-23 22:39:23,618 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41785 8450s 2024-11-23 22:39:23,618 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:39:23,618 - distributed.worker - INFO - dashboard at: 127.0.0.1:43599 8450s 2024-11-23 22:39:23,618 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37745 8450s 2024-11-23 22:39:23,618 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:39:23,618 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:39:23,618 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:39:23,618 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-v3g7fbv1 8450s 2024-11-23 22:39:23,618 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:39:23,620 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41625. Reason: failure-to-start- 8450s 2024-11-23 22:39:23,620 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:39:23,621 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41785. Reason: failure-to-start- 8450s 2024-11-23 22:39:23,622 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:39:23,623 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37745': TLS handshake failed with remote 'tls://127.0.0.1:43482': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:39:23,623 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37745': TLS handshake failed with remote 'tls://127.0.0.1:43490': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:39:23,627 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:39:24,637 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:39:24,647 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41947 8450s 2024-11-23 22:39:24,647 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42851/status 8450s 2024-11-23 22:39:24,647 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:39:24,662 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40691 8450s 2024-11-23 22:39:24,663 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40691 8450s 2024-11-23 22:39:24,663 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:39:24,663 - distributed.worker - INFO - dashboard at: 127.0.0.1:45629 8450s 2024-11-23 22:39:24,663 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41947 8450s 2024-11-23 22:39:24,663 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:39:24,663 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:39:24,663 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:39:24,663 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-cg11o6v4 8450s 2024-11-23 22:39:24,663 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:39:24,665 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44651 8450s 2024-11-23 22:39:24,665 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44651 8450s 2024-11-23 22:39:24,665 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:39:24,665 - distributed.worker - INFO - dashboard at: 127.0.0.1:39137 8450s 2024-11-23 22:39:24,665 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41947 8450s 2024-11-23 22:39:24,665 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:39:24,665 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:39:24,665 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:39:24,665 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-yu4h3njq 8450s 2024-11-23 22:39:24,666 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:39:24,669 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40691. Reason: failure-to-start- 8450s 2024-11-23 22:39:24,669 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:39:24,670 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44651. Reason: failure-to-start- 8450s 2024-11-23 22:39:24,670 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:39:24,671 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41947': TLS handshake failed with remote 'tls://127.0.0.1:58980': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:39:24,671 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41947': TLS handshake failed with remote 'tls://127.0.0.1:58986': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:39:24,673 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:39:25,680 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:39:25,687 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34217 8450s 2024-11-23 22:39:25,687 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44331/status 8450s 2024-11-23 22:39:25,688 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:39:25,701 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43393 8450s 2024-11-23 22:39:25,701 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43393 8450s 2024-11-23 22:39:25,702 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:39:25,702 - distributed.worker - INFO - dashboard at: 127.0.0.1:36125 8450s 2024-11-23 22:39:25,702 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34217 8450s 2024-11-23 22:39:25,702 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:39:25,702 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:39:25,702 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:39:25,702 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-58m5eqkn 8450s 2024-11-23 22:39:25,702 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:39:25,704 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42527 8450s 2024-11-23 22:39:25,704 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42527 8450s 2024-11-23 22:39:25,704 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:39:25,704 - distributed.worker - INFO - dashboard at: 127.0.0.1:34865 8450s 2024-11-23 22:39:25,704 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34217 8450s 2024-11-23 22:39:25,704 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:39:25,704 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:39:25,704 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:39:25,704 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-6lozz_u5 8450s 2024-11-23 22:39:25,704 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:39:25,708 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43393. Reason: failure-to-start- 8450s 2024-11-23 22:39:25,708 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:39:25,709 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42527. Reason: failure-to-start- 8450s 2024-11-23 22:39:25,709 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:39:25,710 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34217': TLS handshake failed with remote 'tls://127.0.0.1:35842': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:39:25,710 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34217': TLS handshake failed with remote 'tls://127.0.0.1:35844': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:39:25,712 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:39:26,717 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:39:26,724 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41111 8450s 2024-11-23 22:39:26,724 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35729/status 8450s 2024-11-23 22:39:26,724 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:39:26,739 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39819 8450s 2024-11-23 22:39:26,739 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39819 8450s 2024-11-23 22:39:26,739 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:39:26,740 - distributed.worker - INFO - dashboard at: 127.0.0.1:41387 8450s 2024-11-23 22:39:26,740 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41111 8450s 2024-11-23 22:39:26,740 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:39:26,740 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:39:26,740 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:39:26,740 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-nx7x7nbi 8450s 2024-11-23 22:39:26,740 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:39:26,742 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44925 8450s 2024-11-23 22:39:26,742 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44925 8450s 2024-11-23 22:39:26,742 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:39:26,742 - distributed.worker - INFO - dashboard at: 127.0.0.1:41345 8450s 2024-11-23 22:39:26,742 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41111 8450s 2024-11-23 22:39:26,742 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:39:26,742 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:39:26,742 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:39:26,742 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-o9pvcccj 8450s 2024-11-23 22:39:26,742 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:39:26,746 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39819. Reason: failure-to-start- 8450s 2024-11-23 22:39:26,746 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:39:26,746 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44925. Reason: failure-to-start- 8450s 2024-11-23 22:39:26,746 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:39:26,748 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41111': TLS handshake failed with remote 'tls://127.0.0.1:46658': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:39:26,748 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41111': TLS handshake failed with remote 'tls://127.0.0.1:46666': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:39:26,749 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:39:27,755 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:39:27,762 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45947 8450s 2024-11-23 22:39:27,762 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41843/status 8450s 2024-11-23 22:39:27,762 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:39:27,777 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46745 8450s 2024-11-23 22:39:27,777 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46745 8450s 2024-11-23 22:39:27,777 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:39:27,777 - distributed.worker - INFO - dashboard at: 127.0.0.1:41043 8450s 2024-11-23 22:39:27,777 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45947 8450s 2024-11-23 22:39:27,777 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:39:27,777 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:39:27,777 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:39:27,777 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-vjtfazra 8450s 2024-11-23 22:39:27,777 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:39:27,780 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43987 8450s 2024-11-23 22:39:27,780 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43987 8450s 2024-11-23 22:39:27,780 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:39:27,780 - distributed.worker - INFO - dashboard at: 127.0.0.1:35453 8450s 2024-11-23 22:39:27,780 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45947 8450s 2024-11-23 22:39:27,780 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:39:27,780 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:39:27,780 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:39:27,780 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-p6lq1q4w 8450s 2024-11-23 22:39:27,780 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:39:27,784 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46745. Reason: failure-to-start- 8450s 2024-11-23 22:39:27,785 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:39:27,785 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43987. Reason: failure-to-start- 8450s 2024-11-23 22:39:27,785 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:39:27,787 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45947': TLS handshake failed with remote 'tls://127.0.0.1:60226': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:39:27,787 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45947': TLS handshake failed with remote 'tls://127.0.0.1:60240': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:39:27,788 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:39:28,794 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:39:28,802 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38847 8450s 2024-11-23 22:39:28,802 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38573/status 8450s 2024-11-23 22:39:28,802 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:39:28,819 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35519 8450s 2024-11-23 22:39:28,819 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35519 8450s 2024-11-23 22:39:28,819 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:39:28,819 - distributed.worker - INFO - dashboard at: 127.0.0.1:36543 8450s 2024-11-23 22:39:28,819 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38847 8450s 2024-11-23 22:39:28,819 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:39:28,819 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:39:28,819 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:39:28,819 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ex64edtm 8450s 2024-11-23 22:39:28,819 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:39:28,822 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41049 8450s 2024-11-23 22:39:28,823 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41049 8450s 2024-11-23 22:39:28,823 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:39:28,823 - distributed.worker - INFO - dashboard at: 127.0.0.1:33527 8450s 2024-11-23 22:39:28,823 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38847 8450s 2024-11-23 22:39:28,823 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:39:28,823 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:39:28,823 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:39:28,823 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-1zd2210c 8450s 2024-11-23 22:39:28,823 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:39:28,825 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35519. Reason: failure-to-start- 8450s 2024-11-23 22:39:28,826 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:39:28,826 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41049. Reason: failure-to-start- 8450s 2024-11-23 22:39:28,826 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:39:28,828 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38847': TLS handshake failed with remote 'tls://127.0.0.1:35200': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:39:28,828 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38847': TLS handshake failed with remote 'tls://127.0.0.1:35210': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:39:28,829 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:39:29,835 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:39:29,866 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44463 8450s 2024-11-23 22:39:29,867 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:32945/status 8450s 2024-11-23 22:39:29,867 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:39:29,886 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36293 8450s 2024-11-23 22:39:29,887 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36293 8450s 2024-11-23 22:39:29,887 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:39:29,887 - distributed.worker - INFO - dashboard at: 127.0.0.1:40299 8450s 2024-11-23 22:39:29,887 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44463 8450s 2024-11-23 22:39:29,887 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:39:29,887 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:39:29,887 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:39:29,887 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ly17qm67 8450s 2024-11-23 22:39:29,887 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:39:29,889 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44963 8450s 2024-11-23 22:39:29,890 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44963 8450s 2024-11-23 22:39:29,890 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:39:29,890 - distributed.worker - INFO - dashboard at: 127.0.0.1:32773 8450s 2024-11-23 22:39:29,890 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44463 8450s 2024-11-23 22:39:29,890 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:39:29,890 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:39:29,890 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:39:29,890 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ls5b8dbi 8450s 2024-11-23 22:39:29,890 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:39:29,894 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36293. Reason: failure-to-start- 8450s 2024-11-23 22:39:29,894 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:39:29,895 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44963. Reason: failure-to-start- 8450s 2024-11-23 22:39:29,896 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:39:29,897 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44463': TLS handshake failed with remote 'tls://127.0.0.1:35240': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:39:29,897 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44463': TLS handshake failed with remote 'tls://127.0.0.1:35242': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:39:29,899 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:39:30,906 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:39:30,913 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43331 8450s 2024-11-23 22:39:30,913 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42457/status 8450s 2024-11-23 22:39:30,914 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:39:30,928 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37895 8450s 2024-11-23 22:39:30,929 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37895 8450s 2024-11-23 22:39:30,929 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:39:30,929 - distributed.worker - INFO - dashboard at: 127.0.0.1:35991 8450s 2024-11-23 22:39:30,929 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43331 8450s 2024-11-23 22:39:30,929 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:39:30,929 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:39:30,929 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:39:30,929 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-68r6h8_y 8450s 2024-11-23 22:39:30,929 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:39:30,931 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38037 8450s 2024-11-23 22:39:30,931 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38037 8450s 2024-11-23 22:39:30,932 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:39:30,932 - distributed.worker - INFO - dashboard at: 127.0.0.1:36629 8450s 2024-11-23 22:39:30,932 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43331 8450s 2024-11-23 22:39:30,932 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:39:30,932 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:39:30,932 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:39:30,932 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-hww67w_2 8450s 2024-11-23 22:39:30,932 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:39:30,936 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37895. Reason: failure-to-start- 8450s 2024-11-23 22:39:30,936 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:39:30,936 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38037. Reason: failure-to-start- 8450s 2024-11-23 22:39:30,936 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:39:30,938 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43331': TLS handshake failed with remote 'tls://127.0.0.1:60246': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:39:30,938 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43331': TLS handshake failed with remote 'tls://127.0.0.1:60260': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:39:30,939 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:39:31,944 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:39:31,952 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36187 8450s 2024-11-23 22:39:31,952 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42769/status 8450s 2024-11-23 22:39:31,952 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:39:31,967 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35955 8450s 2024-11-23 22:39:31,968 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35955 8450s 2024-11-23 22:39:31,968 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:39:31,968 - distributed.worker - INFO - dashboard at: 127.0.0.1:33559 8450s 2024-11-23 22:39:31,968 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36187 8450s 2024-11-23 22:39:31,968 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:39:31,968 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:39:31,968 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:39:31,968 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-fosir7y4 8450s 2024-11-23 22:39:31,968 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:39:31,970 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46321 8450s 2024-11-23 22:39:31,970 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46321 8450s 2024-11-23 22:39:31,970 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:39:31,970 - distributed.worker - INFO - dashboard at: 127.0.0.1:38631 8450s 2024-11-23 22:39:31,970 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36187 8450s 2024-11-23 22:39:31,971 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:39:31,971 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:39:31,971 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:39:31,971 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-lsn2ki0c 8450s 2024-11-23 22:39:31,971 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:39:31,974 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35955. Reason: failure-to-start- 8450s 2024-11-23 22:39:31,974 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:39:31,975 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46321. Reason: failure-to-start- 8450s 2024-11-23 22:39:31,975 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:39:31,976 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36187': TLS handshake failed with remote 'tls://127.0.0.1:48998': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:39:31,976 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36187': TLS handshake failed with remote 'tls://127.0.0.1:49006': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:39:31,978 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:39:32,983 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:39:32,990 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36643 8450s 2024-11-23 22:39:32,991 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46633/status 8450s 2024-11-23 22:39:32,992 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:39:33,021 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40903 8450s 2024-11-23 22:39:33,022 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40903 8450s 2024-11-23 22:39:33,022 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:39:33,022 - distributed.worker - INFO - dashboard at: 127.0.0.1:42371 8450s 2024-11-23 22:39:33,022 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36643 8450s 2024-11-23 22:39:33,022 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:39:33,022 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:39:33,022 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:39:33,022 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-bylb1xe1 8450s 2024-11-23 22:39:33,022 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:39:33,024 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36703 8450s 2024-11-23 22:39:33,024 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36703 8450s 2024-11-23 22:39:33,024 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:39:33,024 - distributed.worker - INFO - dashboard at: 127.0.0.1:38099 8450s 2024-11-23 22:39:33,024 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36643 8450s 2024-11-23 22:39:33,024 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:39:33,024 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:39:33,024 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:39:33,024 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-c1jz85cc 8450s 2024-11-23 22:39:33,025 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:39:33,029 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40903. Reason: failure-to-start- 8450s 2024-11-23 22:39:33,029 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:39:33,029 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36703. Reason: failure-to-start- 8450s 2024-11-23 22:39:33,029 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:39:33,030 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36643': TLS handshake failed with remote 'tls://127.0.0.1:41242': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:39:33,031 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36643': TLS handshake failed with remote 'tls://127.0.0.1:41244': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:39:33,032 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:39:34,038 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:39:34,047 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36873 8450s 2024-11-23 22:39:34,047 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34115/status 8450s 2024-11-23 22:39:34,048 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:39:34,063 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45565 8450s 2024-11-23 22:39:34,063 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45565 8450s 2024-11-23 22:39:34,063 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:39:34,063 - distributed.worker - INFO - dashboard at: 127.0.0.1:40469 8450s 2024-11-23 22:39:34,063 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36873 8450s 2024-11-23 22:39:34,063 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:39:34,063 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:39:34,063 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:39:34,063 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-qi0dkn4x 8450s 2024-11-23 22:39:34,063 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:39:34,065 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38467 8450s 2024-11-23 22:39:34,066 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38467 8450s 2024-11-23 22:39:34,066 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:39:34,066 - distributed.worker - INFO - dashboard at: 127.0.0.1:34955 8450s 2024-11-23 22:39:34,066 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36873 8450s 2024-11-23 22:39:34,066 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:39:34,066 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:39:34,066 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:39:34,066 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-6dpq6e12 8450s 2024-11-23 22:39:34,066 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:39:34,072 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45565. Reason: failure-to-start- 8450s 2024-11-23 22:39:34,072 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:39:34,073 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38467. Reason: failure-to-start- 8450s 2024-11-23 22:39:34,073 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:39:34,077 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36873': TLS handshake failed with remote 'tls://127.0.0.1:38818': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:39:34,077 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36873': TLS handshake failed with remote 'tls://127.0.0.1:38830': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:39:34,079 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:39:35,084 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:39:35,092 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43305 8450s 2024-11-23 22:39:35,092 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43387/status 8450s 2024-11-23 22:39:35,093 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:39:35,110 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43735 8450s 2024-11-23 22:39:35,110 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43735 8450s 2024-11-23 22:39:35,110 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:39:35,110 - distributed.worker - INFO - dashboard at: 127.0.0.1:37251 8450s 2024-11-23 22:39:35,110 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43305 8450s 2024-11-23 22:39:35,110 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:39:35,110 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:39:35,110 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:39:35,110 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-0ghp955u 8450s 2024-11-23 22:39:35,111 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:39:35,113 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37883 8450s 2024-11-23 22:39:35,113 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37883 8450s 2024-11-23 22:39:35,113 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:39:35,113 - distributed.worker - INFO - dashboard at: 127.0.0.1:35719 8450s 2024-11-23 22:39:35,113 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43305 8450s 2024-11-23 22:39:35,113 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:39:35,113 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:39:35,113 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:39:35,113 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-lsuchfhf 8450s 2024-11-23 22:39:35,113 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:39:35,117 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43735. Reason: failure-to-start- 8450s 2024-11-23 22:39:35,118 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:39:35,118 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37883. Reason: failure-to-start- 8450s 2024-11-23 22:39:35,118 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:39:35,120 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43305': TLS handshake failed with remote 'tls://127.0.0.1:57612': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:39:35,120 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43305': TLS handshake failed with remote 'tls://127.0.0.1:57622': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:39:35,122 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:39:36,128 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:39:36,137 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44275 8450s 2024-11-23 22:39:36,138 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41387/status 8450s 2024-11-23 22:39:36,138 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:39:36,153 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46543 8450s 2024-11-23 22:39:36,153 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46543 8450s 2024-11-23 22:39:36,153 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:39:36,153 - distributed.worker - INFO - dashboard at: 127.0.0.1:38169 8450s 2024-11-23 22:39:36,153 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44275 8450s 2024-11-23 22:39:36,153 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:39:36,153 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:39:36,153 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:39:36,153 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-q8fi3rh4 8450s 2024-11-23 22:39:36,153 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:39:36,155 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37239 8450s 2024-11-23 22:39:36,155 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37239 8450s 2024-11-23 22:39:36,155 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:39:36,156 - distributed.worker - INFO - dashboard at: 127.0.0.1:40263 8450s 2024-11-23 22:39:36,156 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44275 8450s 2024-11-23 22:39:36,156 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:39:36,156 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:39:36,156 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:39:36,156 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-5j2u9j_m 8450s 2024-11-23 22:39:36,156 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:39:36,161 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46543. Reason: failure-to-start- 8450s 2024-11-23 22:39:36,161 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:39:36,161 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37239. Reason: failure-to-start- 8450s 2024-11-23 22:39:36,161 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:39:36,163 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44275': TLS handshake failed with remote 'tls://127.0.0.1:43924': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:39:36,163 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44275': TLS handshake failed with remote 'tls://127.0.0.1:43930': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:39:36,168 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:39:37,173 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:39:37,181 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40671 8450s 2024-11-23 22:39:37,181 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40451/status 8450s 2024-11-23 22:39:37,181 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:39:37,198 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40233 8450s 2024-11-23 22:39:37,198 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40233 8450s 2024-11-23 22:39:37,198 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:39:37,198 - distributed.worker - INFO - dashboard at: 127.0.0.1:43777 8450s 2024-11-23 22:39:37,198 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40671 8450s 2024-11-23 22:39:37,198 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:39:37,198 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:39:37,198 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:39:37,198 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-nysa7lvc 8450s 2024-11-23 22:39:37,198 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:39:37,200 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42429 8450s 2024-11-23 22:39:37,201 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42429 8450s 2024-11-23 22:39:37,201 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:39:37,201 - distributed.worker - INFO - dashboard at: 127.0.0.1:34425 8450s 2024-11-23 22:39:37,201 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40671 8450s 2024-11-23 22:39:37,201 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:39:37,201 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:39:37,201 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:39:37,201 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-xwcqpj1u 8450s 2024-11-23 22:39:37,201 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:39:37,207 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40233. Reason: failure-to-start- 8450s 2024-11-23 22:39:37,207 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:39:37,208 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42429. Reason: failure-to-start- 8450s 2024-11-23 22:39:37,208 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:39:37,209 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40671': TLS handshake failed with remote 'tls://127.0.0.1:38922': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:39:37,209 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40671': TLS handshake failed with remote 'tls://127.0.0.1:38938': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:39:37,211 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:39:38,216 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:39:38,225 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46245 8450s 2024-11-23 22:39:38,225 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33281/status 8450s 2024-11-23 22:39:38,225 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:39:38,243 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35213 8450s 2024-11-23 22:39:38,243 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35213 8450s 2024-11-23 22:39:38,243 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:39:38,243 - distributed.worker - INFO - dashboard at: 127.0.0.1:38795 8450s 2024-11-23 22:39:38,243 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46245 8450s 2024-11-23 22:39:38,243 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:39:38,243 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:39:38,243 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:39:38,243 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-n387462v 8450s 2024-11-23 22:39:38,243 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:39:38,247 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40495 8450s 2024-11-23 22:39:38,247 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40495 8450s 2024-11-23 22:39:38,247 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:39:38,247 - distributed.worker - INFO - dashboard at: 127.0.0.1:45411 8450s 2024-11-23 22:39:38,247 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46245 8450s 2024-11-23 22:39:38,247 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:39:38,247 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:39:38,247 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:39:38,247 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-yrsfptaf 8450s 2024-11-23 22:39:38,247 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:39:38,251 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35213. Reason: failure-to-start- 8450s 2024-11-23 22:39:38,251 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:39:38,252 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40495. Reason: failure-to-start- 8450s 2024-11-23 22:39:38,252 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:39:38,253 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46245': TLS handshake failed with remote 'tls://127.0.0.1:48104': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:39:38,253 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46245': TLS handshake failed with remote 'tls://127.0.0.1:48112': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:39:38,255 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:39:39,260 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:39:39,268 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38425 8450s 2024-11-23 22:39:39,268 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39661/status 8450s 2024-11-23 22:39:39,269 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:39:39,289 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41077 8450s 2024-11-23 22:39:39,289 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41077 8450s 2024-11-23 22:39:39,289 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:39:39,289 - distributed.worker - INFO - dashboard at: 127.0.0.1:33227 8450s 2024-11-23 22:39:39,289 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38425 8450s 2024-11-23 22:39:39,289 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:39:39,289 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:39:39,289 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:39:39,289 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-xw9c8zku 8450s 2024-11-23 22:39:39,289 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:39:39,291 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34381 8450s 2024-11-23 22:39:39,292 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34381 8450s 2024-11-23 22:39:39,292 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:39:39,292 - distributed.worker - INFO - dashboard at: 127.0.0.1:38497 8450s 2024-11-23 22:39:39,292 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38425 8450s 2024-11-23 22:39:39,292 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:39:39,292 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:39:39,292 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:39:39,292 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-p6o5u88v 8450s 2024-11-23 22:39:39,292 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:39:39,293 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41077. Reason: failure-to-start- 8450s 2024-11-23 22:39:39,293 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:39:39,295 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34381. Reason: failure-to-start- 8450s 2024-11-23 22:39:39,295 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:39:39,297 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38425': TLS handshake failed with remote 'tls://127.0.0.1:45510': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:39:39,297 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38425': TLS handshake failed with remote 'tls://127.0.0.1:45514': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:39:39,298 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:39:40,306 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:39:40,314 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46727 8450s 2024-11-23 22:39:40,314 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33205/status 8450s 2024-11-23 22:39:40,315 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:39:40,336 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46623 8450s 2024-11-23 22:39:40,336 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46623 8450s 2024-11-23 22:39:40,336 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:39:40,336 - distributed.worker - INFO - dashboard at: 127.0.0.1:34991 8450s 2024-11-23 22:39:40,336 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46727 8450s 2024-11-23 22:39:40,336 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:39:40,336 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:39:40,336 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:39:40,336 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ie18vs44 8450s 2024-11-23 22:39:40,336 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:39:40,339 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44369 8450s 2024-11-23 22:39:40,339 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44369 8450s 2024-11-23 22:39:40,339 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:39:40,339 - distributed.worker - INFO - dashboard at: 127.0.0.1:42855 8450s 2024-11-23 22:39:40,339 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46727 8450s 2024-11-23 22:39:40,339 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:39:40,339 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:39:40,339 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:39:40,339 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-2ccb3dgv 8450s 2024-11-23 22:39:40,339 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:39:40,341 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46623. Reason: failure-to-start- 8450s 2024-11-23 22:39:40,341 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:39:40,342 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44369. Reason: failure-to-start- 8450s 2024-11-23 22:39:40,342 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:39:40,346 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46727': TLS handshake failed with remote 'tls://127.0.0.1:37938': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:39:40,346 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46727': TLS handshake failed with remote 'tls://127.0.0.1:37950': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:39:40,348 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s __________________________________ test_Queue __________________________________ 8450s 8450s fut = , timeout = 0 8450s 8450s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 8450s async with asyncio.timeout(timeout): 8450s > return await fut 8450s 8450s /usr/lib/python3/dist-packages/distributed/utils.py:1960: 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s /usr/lib/python3/dist-packages/distributed/worker.py:1480: in start_unsafe 8450s await self._register_with_scheduler() 8450s /usr/lib/python3/dist-packages/distributed/worker.py:1179: in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s /usr/lib/python3/dist-packages/distributed/comm/core.py:342: in connect 8450s comm = await wait_for( 8450s /usr/lib/python3/dist-packages/distributed/utils.py:1960: in wait_for 8450s return await fut 8450s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:546: in connect 8450s stream = await self.client.connect( 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s 8450s self = , host = '127.0.0.1' 8450s port = 45485, af = 8450s ssl_options = 8450s max_buffer_size = 8364507136.0, source_ip = None, source_port = None 8450s timeout = None 8450s 8450s async def connect( 8450s self, 8450s host: str, 8450s port: int, 8450s af: socket.AddressFamily = socket.AF_UNSPEC, 8450s ssl_options: Optional[Union[Dict[str, Any], ssl.SSLContext]] = None, 8450s max_buffer_size: Optional[int] = None, 8450s source_ip: Optional[str] = None, 8450s source_port: Optional[int] = None, 8450s timeout: Optional[Union[float, datetime.timedelta]] = None, 8450s ) -> IOStream: 8450s """Connect to the given host and port. 8450s 8450s Asynchronously returns an `.IOStream` (or `.SSLIOStream` if 8450s ``ssl_options`` is not None). 8450s 8450s Using the ``source_ip`` kwarg, one can specify the source 8450s IP address to use when establishing the connection. 8450s In case the user needs to resolve and 8450s use a specific interface, it has to be handled outside 8450s of Tornado as this depends very much on the platform. 8450s 8450s Raises `TimeoutError` if the input future does not complete before 8450s ``timeout``, which may be specified in any form allowed by 8450s `.IOLoop.add_timeout` (i.e. a `datetime.timedelta` or an absolute time 8450s relative to `.IOLoop.time`) 8450s 8450s Similarly, when the user requires a certain source port, it can 8450s be specified using the ``source_port`` arg. 8450s 8450s .. versionchanged:: 4.5 8450s Added the ``source_ip`` and ``source_port`` arguments. 8450s 8450s .. versionchanged:: 5.0 8450s Added the ``timeout`` argument. 8450s """ 8450s if timeout is not None: 8450s if isinstance(timeout, numbers.Real): 8450s timeout = IOLoop.current().time() + timeout 8450s elif isinstance(timeout, datetime.timedelta): 8450s timeout = IOLoop.current().time() + timeout.total_seconds() 8450s else: 8450s raise TypeError("Unsupported timeout %r" % timeout) 8450s if timeout is not None: 8450s addrinfo = await gen.with_timeout( 8450s timeout, self.resolver.resolve(host, port, af) 8450s ) 8450s else: 8450s addrinfo = await self.resolver.resolve(host, port, af) 8450s connector = _Connector( 8450s addrinfo, 8450s functools.partial( 8450s self._create_stream, 8450s max_buffer_size, 8450s source_ip=source_ip, 8450s source_port=source_port, 8450s ), 8450s ) 8450s > af, addr, stream = await connector.start(connect_timeout=timeout) 8450s E asyncio.exceptions.CancelledError 8450s 8450s /usr/lib/python3/dist-packages/tornado/tcpclient.py:279: CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s self = 8450s 8450s @final 8450s async def start(self): 8450s async with self._startup_lock: 8450s if self.status == Status.failed: 8450s assert self.__startup_exc is not None 8450s raise self.__startup_exc 8450s elif self.status != Status.init: 8450s return self 8450s timeout = getattr(self, "death_timeout", None) 8450s 8450s async def _close_on_failure(exc: Exception) -> None: 8450s await self.close(reason=f"failure-to-start-{str(type(exc))}") 8450s self.status = Status.failed 8450s self.__startup_exc = exc 8450s 8450s try: 8450s > await wait_for(self.start_unsafe(), timeout=timeout) 8450s 8450s /usr/lib/python3/dist-packages/distributed/core.py:664: 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 8450s async with asyncio.timeout(timeout): 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s 8450s self = 8450s exc_type = 8450s exc_val = CancelledError(), exc_tb = 8450s 8450s async def __aexit__( 8450s self, 8450s exc_type: Optional[Type[BaseException]], 8450s exc_val: Optional[BaseException], 8450s exc_tb: Optional[TracebackType], 8450s ) -> Optional[bool]: 8450s assert self._state in (_State.ENTERED, _State.EXPIRING) 8450s 8450s if self._timeout_handler is not None: 8450s self._timeout_handler.cancel() 8450s self._timeout_handler = None 8450s 8450s if self._state is _State.EXPIRING: 8450s self._state = _State.EXPIRED 8450s 8450s if self._task.uncancel() <= self._cancelling and exc_type is not None: 8450s # Since there are no new cancel requests, we're 8450s # handling this. 8450s if issubclass(exc_type, exceptions.CancelledError): 8450s > raise TimeoutError from exc_val 8450s E TimeoutError 8450s 8450s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s @contextlib.asynccontextmanager 8450s async def _cluster_factory(): 8450s workers = [] 8450s s = None 8450s try: 8450s for _ in range(60): 8450s try: 8450s > s, ws = await start_cluster( 8450s nthreads, 8450s scheduler, 8450s security=security, 8450s Worker=Worker, 8450s scheduler_kwargs=scheduler_kwargs, 8450s worker_kwargs=merge( 8450s {"death_timeout": min(15, int(deadline.remaining))}, 8450s worker_kwargs, 8450s ), 8450s ) 8450s 8450s /usr/lib/python3/dist-packages/distributed/utils_test.py:966: 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s /usr/lib/python3/dist-packages/distributed/utils_test.py:789: in start_cluster 8450s await asyncio.gather(*workers) 8450s /usr/lib/python3.13/asyncio/tasks.py:737: in _wrap_awaitable 8450s return await awaitable 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s 8450s self = 8450s 8450s @final 8450s async def start(self): 8450s async with self._startup_lock: 8450s if self.status == Status.failed: 8450s assert self.__startup_exc is not None 8450s raise self.__startup_exc 8450s elif self.status != Status.init: 8450s return self 8450s timeout = getattr(self, "death_timeout", None) 8450s 8450s async def _close_on_failure(exc: Exception) -> None: 8450s await self.close(reason=f"failure-to-start-{str(type(exc))}") 8450s self.status = Status.failed 8450s self.__startup_exc = exc 8450s 8450s try: 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s except asyncio.TimeoutError as exc: 8450s await _close_on_failure(exc) 8450s > raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s E TimeoutError: Worker start timed out after 0s. 8450s 8450s /usr/lib/python3/dist-packages/distributed/core.py:667: TimeoutError 8450s 8450s During handling of the above exception, another exception occurred: 8450s 8450s fut = ._..test_func..async_fn at 0xe8325dc0> 8450s timeout = 60 8450s 8450s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 8450s async with asyncio.timeout(timeout): 8450s > return await fut 8450s 8450s /usr/lib/python3/dist-packages/distributed/utils.py:1960: 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s /usr/lib/python3/dist-packages/distributed/utils_test.py:999: in async_fn 8450s _cluster_factory() as (s, workers), 8450s /usr/lib/python3.13/contextlib.py:214: in __aenter__ 8450s return await anext(self.gen) 8450s /usr/lib/python3/dist-packages/distributed/utils_test.py:983: in _cluster_factory 8450s await asyncio.sleep(1) 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s 8450s delay = 1, result = None 8450s 8450s async def sleep(delay, result=None): 8450s """Coroutine that completes after a given time (in seconds).""" 8450s if delay <= 0: 8450s await __sleep0() 8450s return result 8450s 8450s if math.isnan(delay): 8450s raise ValueError("Invalid delay: NaN (not a number)") 8450s 8450s loop = events.get_running_loop() 8450s future = loop.create_future() 8450s h = loop.call_later(delay, 8450s futures._set_result_unless_cancelled, 8450s future, result) 8450s try: 8450s > return await future 8450s E asyncio.exceptions.CancelledError 8450s 8450s /usr/lib/python3.13/asyncio/tasks.py:718: CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s args = (), kwds = {} 8450s 8450s @wraps(func) 8450s def inner(*args, **kwds): 8450s with self._recreate_cm(): 8450s > return func(*args, **kwds) 8450s 8450s /usr/lib/python3.13/contextlib.py:85: 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s /usr/lib/python3.13/contextlib.py:85: in inner 8450s return func(*args, **kwds) 8450s /usr/lib/python3/dist-packages/distributed/utils_test.py:1102: in test_func 8450s return _run_and_close_tornado(async_fn_outer) 8450s /usr/lib/python3/dist-packages/distributed/utils_test.py:378: in _run_and_close_tornado 8450s return asyncio_run(inner_fn(), loop_factory=get_loop_factory()) 8450s /usr/lib/python3.13/asyncio/runners.py:194: in run 8450s return runner.run(main) 8450s /usr/lib/python3.13/asyncio/runners.py:118: in run 8450s return self._loop.run_until_complete(task) 8450s /usr/lib/python3.13/asyncio/base_events.py:720: in run_until_complete 8450s return future.result() 8450s /usr/lib/python3/dist-packages/distributed/utils_test.py:375: in inner_fn 8450s return await async_fn(*args, **kwargs) 8450s /usr/lib/python3/dist-packages/distributed/utils_test.py:1099: in async_fn_outer 8450s return await utils_wait_for(async_fn(), timeout=timeout * 2) 8450s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 8450s async with asyncio.timeout(timeout): 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s 8450s self = 8450s exc_type = 8450s exc_val = CancelledError(), exc_tb = 8450s 8450s async def __aexit__( 8450s self, 8450s exc_type: Optional[Type[BaseException]], 8450s exc_val: Optional[BaseException], 8450s exc_tb: Optional[TracebackType], 8450s ) -> Optional[bool]: 8450s assert self._state in (_State.ENTERED, _State.EXPIRING) 8450s 8450s if self._timeout_handler is not None: 8450s self._timeout_handler.cancel() 8450s self._timeout_handler = None 8450s 8450s if self._state is _State.EXPIRING: 8450s self._state = _State.EXPIRED 8450s 8450s if self._task.uncancel() <= self._cancelling and exc_type is not None: 8450s # Since there are no new cancel requests, we're 8450s # handling this. 8450s if issubclass(exc_type, exceptions.CancelledError): 8450s > raise TimeoutError from exc_val 8450s E TimeoutError 8450s 8450s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 8450s ----------------------------- Captured stderr call ----------------------------- 8450s 2024-11-23 22:39:41,614 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:39:41,625 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:41,625 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42491/status 8450s 2024-11-23 22:39:41,625 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:39:41,640 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37937 8450s 2024-11-23 22:39:41,640 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37937 8450s 2024-11-23 22:39:41,640 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:39:41,640 - distributed.worker - INFO - dashboard at: 127.0.0.1:36691 8450s 2024-11-23 22:39:41,640 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:41,641 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:39:41,641 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:39:41,641 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:39:41,641 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-_s9_oz0_ 8450s 2024-11-23 22:39:41,641 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:39:41,644 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33129 8450s 2024-11-23 22:39:41,644 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33129 8450s 2024-11-23 22:39:41,644 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:39:41,644 - distributed.worker - INFO - dashboard at: 127.0.0.1:33833 8450s 2024-11-23 22:39:41,644 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:41,644 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:39:41,644 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:39:41,644 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:39:41,644 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-t8repi8n 8450s 2024-11-23 22:39:41,644 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:39:41,658 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:41,658 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:41,658 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:49254': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:41,658 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:49264': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:41,771 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:41,772 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:41,772 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:49280': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:41,772 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:49292': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:41,884 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:41,885 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:41,886 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:49306': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:41,887 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:49322': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:41,999 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:41,999 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:41,999 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:49326': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:42,000 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:49338': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:42,113 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:42,113 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:42,114 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:49354': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:42,114 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:49360': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:42,227 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:42,227 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:42,228 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:49372': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:42,228 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:49378': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:42,340 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:42,341 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:42,341 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:49390': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:42,341 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:49394': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:42,454 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:42,454 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:42,455 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:49402': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:42,455 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:49406': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:42,567 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:42,568 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:42,568 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:49418': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:42,568 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:49420': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:42,681 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:42,681 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:42,682 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:49430': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:42,682 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:49434': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:42,795 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:42,795 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:42,795 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:49438': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:42,795 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:49452': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:42,908 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:42,908 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:42,909 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:49468': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:42,909 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:49470': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:43,022 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:43,022 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:43,023 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:49474': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:43,023 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:49482': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:43,135 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:43,136 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:43,139 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:49490': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:43,139 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:49498': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:43,249 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:43,249 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:43,249 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:49500': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:43,249 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:49504': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:43,362 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:43,362 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:43,362 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:49508': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:43,362 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:49510': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:43,477 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:43,477 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:43,477 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:49524': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:43,478 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:49526': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:43,592 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:43,592 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:43,594 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:49542': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:43,594 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:49554': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:43,701 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:43,705 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:49558': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:43,706 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:43,707 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:49570': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:43,808 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:43,809 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:49582': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:43,815 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:43,816 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:49586': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:43,917 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:43,917 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:49588': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:43,923 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:43,924 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:49604': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:44,025 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:44,025 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:49608': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:44,031 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:44,032 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:49618': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:44,136 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:44,137 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:49624': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:44,142 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:44,143 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:49632': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:44,244 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:44,245 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:49642': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:44,251 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:44,251 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:49644': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:44,352 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:44,353 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:49658': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:44,359 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:44,360 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:49672': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:44,461 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:44,462 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:49684': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:44,468 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:44,469 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:49694': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:44,571 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:44,572 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:49706': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:44,578 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:44,578 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:49716': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:44,679 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:44,679 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:49732': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:44,686 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:44,686 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:49744': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:44,787 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:44,787 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:49752': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:44,795 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:44,795 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:49764': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:44,894 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:44,895 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:49778': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:44,901 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:44,902 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:49792': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:45,002 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:45,003 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:49806': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:45,009 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:45,010 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:49814': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:45,110 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:45,111 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:49824': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:45,117 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:45,118 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:49832': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:45,219 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:45,220 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:49836': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:45,226 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:45,226 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:49838': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:45,328 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:45,328 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:49840': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:45,335 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:45,335 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:49844': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:45,435 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:45,436 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:49848': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:45,442 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:45,443 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:49862': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:45,544 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:45,545 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:49876': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:45,551 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:45,551 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:49888': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:45,652 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:45,653 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:49902': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:45,659 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:45,659 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:49918': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:45,760 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:45,761 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:49932': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:45,767 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:45,767 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:49944': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:45,868 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:45,869 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:49946': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:45,875 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:45,875 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:49950': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:45,975 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:45,976 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:49958': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:45,982 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:45,983 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:49964': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:46,083 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:46,084 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:49966': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:46,090 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:46,091 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:49972': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:46,196 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:46,198 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:49982': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:46,203 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:46,204 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:49984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:46,304 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:46,304 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:49988': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:46,310 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:46,311 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:49994': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:46,411 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:46,412 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:50010': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:46,418 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:46,418 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:50026': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:46,519 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:46,520 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:50032': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:46,526 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:46,526 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:50044': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:46,628 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:46,632 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:50052': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:46,638 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:46,638 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:50054': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:46,735 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:46,735 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:50062': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:46,746 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:46,746 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:50074': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:46,843 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:46,844 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:50076': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:46,852 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:46,852 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:50078': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:46,953 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:46,954 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:50088': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:46,960 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:46,960 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:50090': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:47,063 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:47,064 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:50106': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:47,070 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:47,070 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:50114': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:47,171 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:47,171 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:50122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:47,177 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:47,178 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:50138': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:47,278 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:47,278 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:50142': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:47,284 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:47,285 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:50146': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:47,385 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:47,386 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:50156': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:47,392 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:47,392 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:50162': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:47,494 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:47,494 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:50176': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:47,500 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:47,501 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:50180': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:47,601 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:47,601 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:50182': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:47,607 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:47,608 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:50188': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:47,710 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:47,710 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:50202': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:47,716 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:47,716 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:50206': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:47,817 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:47,818 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:50216': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:47,824 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:47,824 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:50232': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:47,925 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:47,926 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:50238': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:47,932 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:47,932 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:50246': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:48,032 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:48,033 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:50258': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:48,039 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:48,039 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:50272': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:48,139 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:48,140 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:50278': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:48,146 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:48,146 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:50294': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:48,248 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:48,249 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:50298': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:48,254 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:48,255 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:50306': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:48,355 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:48,355 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:50312': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:48,362 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:48,362 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:50326': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:48,463 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:48,464 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:50342': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:48,469 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:48,470 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:50358': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:48,570 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:48,571 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:50362': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:48,577 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:48,577 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:50368': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:48,679 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:48,680 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:50370': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:48,685 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:48,686 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:50372': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:48,786 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:48,786 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:50382': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:48,793 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:48,793 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:50394': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:48,894 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:48,895 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:50408': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:48,900 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:48,901 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:50418': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:49,001 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:49,001 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:50432': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:49,007 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:49,008 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:50444': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:49,108 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:49,109 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:50446': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:49,115 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:49,115 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:50452': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:49,215 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:49,216 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:50464': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:49,222 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:49,222 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:50478': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:49,322 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:49,323 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:50492': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:49,329 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:49,330 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:50500': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:49,430 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:49,431 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:50514': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:49,437 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:49,437 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:50524': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:49,537 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:49,538 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:50532': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:49,544 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:49,544 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:50542': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:49,646 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:49,647 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:50546': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:49,652 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:49,653 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:50560': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:49,753 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:49,753 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:50576': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:49,759 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:49,759 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:50578': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:49,860 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:49,860 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:50584': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:49,866 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:49,866 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:50586': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:49,967 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:49,968 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:50598': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:49,974 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:49,974 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:50602': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:50,074 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:50,075 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:50618': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:50,098 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:50,101 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:50632': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:50,183 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:50,184 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:50646': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:50,207 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:50,207 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:50648': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:50,293 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:50,294 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:50650': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:50,314 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:50,315 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:50662': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:50,401 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:50,402 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:50678': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:50,422 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:50,423 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:50684': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:50,509 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:50,509 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:50694': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:50,530 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:50,530 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:50704': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:50,616 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:50,617 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:50720': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:50,636 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:50,637 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:50730': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:50,724 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:50,724 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:50740': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:50,744 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:50,744 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:50754': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:50,832 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:50,832 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:50768': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:50,851 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:50,851 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:50778': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:50,939 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:50,939 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:50794': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:50,958 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:50,958 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:50796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:51,047 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:51,048 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:50798': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:51,066 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:51,066 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:50810': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:51,156 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:51,157 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:50812': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:51,173 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:51,174 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:50820': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:51,264 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:51,264 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:50828': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:51,281 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:51,282 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:50830': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:51,372 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:51,372 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:50832': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:51,388 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:51,389 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:50840': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:51,479 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:51,479 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:50852': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:51,496 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:51,496 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:50866': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:51,586 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:51,587 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:38678': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:51,603 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:51,604 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:38684': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:51,694 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:51,694 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:38686': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:51,711 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:51,711 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:38692': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:51,801 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:51,802 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:38702': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:51,818 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:51,818 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:38706': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:51,910 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:51,911 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:38712': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:51,927 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:51,928 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:38726': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:52,018 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:52,019 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:38728': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:52,035 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:52,035 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:38740': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:52,127 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:52,132 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:38750': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:52,142 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:52,142 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:38762': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:52,234 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:52,235 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:38768': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:52,249 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:52,250 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:38778': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:52,343 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:52,344 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:38792': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:52,356 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:52,357 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:38802': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:52,452 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:52,453 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:38804': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:52,463 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:52,464 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:38818': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:52,560 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:52,560 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:38828': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:52,570 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:52,570 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:38842': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:52,667 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:52,668 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:38850': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:52,677 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:52,678 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:38852': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:52,775 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:52,775 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:38868': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:52,785 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:52,785 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:38882': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:52,882 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:52,883 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:38884': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:52,891 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:52,892 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:38894': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:52,990 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:52,990 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:38896': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:52,999 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:52,999 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:38908': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:53,097 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:53,098 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:38910': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:53,106 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:53,106 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:38926': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:53,205 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:53,205 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:38940': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:53,213 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:53,213 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:38944': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:53,313 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:53,313 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:38948': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:53,320 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:53,320 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:38950': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:53,420 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:53,420 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:38960': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:53,427 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:53,427 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:38962': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:53,528 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:53,529 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:38972': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:53,534 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:53,535 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:38984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:53,637 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:53,638 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:38994': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:53,644 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:53,644 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:39008': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:53,745 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:53,746 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:39018': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:53,751 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:53,751 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:39026': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:53,854 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:53,855 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:39032': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:53,860 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:53,861 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:39034': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:53,962 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:53,962 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:39044': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:53,968 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:53,969 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:39050': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:54,070 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:54,071 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:39062': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:54,077 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:54,077 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:39076': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:54,177 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:54,178 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:39078': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:54,184 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:54,185 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:39082': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:54,286 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:54,287 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:39088': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:54,292 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:54,293 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:39094': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:54,394 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:54,395 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:39102': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:54,401 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:54,401 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:39106': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:54,501 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:54,502 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:39122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:54,508 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:54,508 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:39128': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:54,609 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:54,610 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:39138': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:54,616 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:54,616 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:39148': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:54,717 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:54,717 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:39150': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:54,723 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:54,723 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:39158': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:54,824 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:54,824 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:39166': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:54,830 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:54,830 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:39170': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:54,931 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:54,932 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:39174': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:54,938 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:54,938 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:39186': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:55,038 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:55,039 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:39198': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:55,045 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:55,045 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:39206': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:55,146 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:55,147 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:39208': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:55,153 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:55,153 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:39224': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:55,260 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:55,261 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:39240': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:55,266 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:55,266 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:39252': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:55,368 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:55,369 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:39264': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:55,374 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:55,375 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:39268': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:55,475 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:55,476 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:39284': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:55,482 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:55,482 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:39290': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:55,583 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:55,584 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:39296': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:55,589 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:55,590 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:39310': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:55,691 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:55,691 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:39324': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:55,697 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:55,697 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:39332': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:55,798 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:55,798 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:39336': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:55,804 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:55,804 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:39344': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:55,905 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:55,905 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:39352': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:55,911 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:55,912 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:39362': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:56,012 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:56,012 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:39376': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:56,018 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:56,019 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:39386': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:56,121 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:56,122 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:39394': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:56,127 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:56,131 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:39404': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:56,228 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:56,229 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:39418': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:56,235 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:56,235 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:39430': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:56,335 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:56,336 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:39442': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:56,342 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:56,342 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:39456': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:56,443 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:56,443 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:39464': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:56,449 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:56,449 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:39474': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:56,550 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:56,550 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:39486': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:56,556 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44505 8450s 2024-11-23 22:39:56,556 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44505': TLS handshake failed with remote 'tls://127.0.0.1:39500': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:56,640 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37937. Reason: failure-to-start- 8450s 2024-11-23 22:39:56,640 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:39:56,643 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33129. Reason: failure-to-start- 8450s 2024-11-23 22:39:56,643 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:39:56,645 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 15s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 8450s stream = await stream.start_tls( 8450s ^^^^^^^^^^^^^^^^^^^^^^^ 8450s False, ssl_options=ssl_options, server_hostname=host 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 8450s self.socket.do_handshake() 8450s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 8450s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 8450s self._sslobj.do_handshake() 8450s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 8450s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 8450s raise FatalCommClosedError( 8450s ...<2 lines>... 8450s ) from err 8450s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 8450s 8450s During handling of the above exception, another exception occurred: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1218, in _register_with_scheduler 8450s await asyncio.sleep(0.1) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 718, in sleep 8450s return await future 8450s ^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 15s. 8450s 2024-11-23 22:39:57,652 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:39:57,660 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35745 8450s 2024-11-23 22:39:57,661 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39145/status 8450s 2024-11-23 22:39:57,661 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:39:57,675 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37685 8450s 2024-11-23 22:39:57,675 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37685 8450s 2024-11-23 22:39:57,675 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:39:57,675 - distributed.worker - INFO - dashboard at: 127.0.0.1:41803 8450s 2024-11-23 22:39:57,675 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:39:57,675 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:39:57,675 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:39:57,676 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:39:57,676 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-d6bqfgyu 8450s 2024-11-23 22:39:57,676 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:39:57,678 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36539 8450s 2024-11-23 22:39:57,678 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36539 8450s 2024-11-23 22:39:57,678 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:39:57,678 - distributed.worker - INFO - dashboard at: 127.0.0.1:37387 8450s 2024-11-23 22:39:57,678 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:39:57,678 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:39:57,678 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:39:57,678 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:39:57,678 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-kwmwrb7z 8450s 2024-11-23 22:39:57,678 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:39:57,709 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:39:57,710 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:39:57,710 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:49898': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:57,710 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:49906': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:57,822 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:39:57,822 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:39:57,823 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:49918': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:57,823 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:49928': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:57,934 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:39:57,935 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:39:57,935 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:49938': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:57,935 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:49942': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:58,048 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:39:58,048 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:39:58,049 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:49956': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:58,049 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:49958': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:58,162 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:39:58,162 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:39:58,162 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:49966': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:58,162 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:49968': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:58,274 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:39:58,274 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:39:58,274 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:49984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:58,275 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:49998': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:58,388 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:39:58,388 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:39:58,388 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:50006': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:58,389 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:50018': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:58,502 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:39:58,503 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:39:58,503 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:50032': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:58,503 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:50042': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:58,615 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:39:58,615 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:39:58,615 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:50044': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:58,615 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:50056': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:58,727 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:39:58,728 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:39:58,728 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:50072': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:58,728 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:50086': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:58,840 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:39:58,840 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:39:58,840 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:50102': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:58,840 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:50104': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:58,953 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:39:58,954 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:39:58,954 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:50106': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:58,954 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:50118': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:59,066 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:39:59,066 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:39:59,066 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:50122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:59,066 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:50126': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:59,178 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:39:59,178 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:39:59,178 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:50140': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:59,178 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:50148': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:59,290 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:39:59,291 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:39:59,291 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:50156': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:59,291 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:50166': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:59,403 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:39:59,403 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:39:59,403 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:50178': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:59,403 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:50186': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:59,516 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:39:59,516 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:39:59,516 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:50196': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:59,517 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:50206': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:59,629 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:39:59,629 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:39:59,633 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:50220': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:59,633 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:50224': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:59,742 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:39:59,742 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:39:59,742 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:50236': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:59,742 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:50248': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:59,854 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:39:59,854 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:39:59,854 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:50256': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:59,854 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:50268': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:59,967 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:39:59,967 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:39:59,967 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:50280': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:39:59,967 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:50282': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:00,079 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:00,079 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:00,079 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:50294': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:00,079 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:50298': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:00,193 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:00,193 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:00,193 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:50306': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:00,193 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:50322': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:00,305 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:00,305 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:00,306 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:50328': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:00,306 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:50338': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:00,418 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:00,418 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:00,419 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:50350': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:00,419 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:50360': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:00,531 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:00,531 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:00,531 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:50374': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:00,531 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:50390': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:00,643 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:00,643 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:00,644 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:50398': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:00,644 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:50400': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:00,756 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:00,756 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:00,756 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:50412': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:00,756 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:50414': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:00,869 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:00,869 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:00,869 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:50428': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:00,869 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:50444': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:00,981 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:00,981 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:00,981 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:50454': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:00,982 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:50470': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:01,094 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:01,095 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:01,095 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:50476': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:01,095 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:50486': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:01,207 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:01,208 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:01,208 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:50488': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:01,208 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:50494': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:01,320 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:01,321 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:01,321 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:50510': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:01,321 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:50512': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:01,433 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:01,433 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:01,434 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:50514': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:01,434 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:50530': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:01,545 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:01,546 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:01,546 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:51006': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:01,546 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:51020': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:01,658 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:01,658 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:01,658 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:51036': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:01,658 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:51040': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:01,770 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:01,770 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:01,771 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:51046': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:01,771 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:51048': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:01,884 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:01,884 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:01,885 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:51052': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:01,885 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:51054': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:01,999 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:01,999 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:01,999 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:51058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:01,999 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:51072': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:02,111 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:02,111 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:02,112 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:51080': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:02,112 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:51086': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:02,224 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:02,225 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:02,225 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:51096': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:02,225 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:51100': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:02,337 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:02,337 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:02,337 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:51110': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:02,338 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:51120': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:02,449 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:02,450 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:02,450 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:51124': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:02,450 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:51138': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:02,562 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:02,562 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:02,563 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:51148': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:02,563 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:51162': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:02,676 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:02,677 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:02,677 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:51172': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:02,677 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:51178': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:02,789 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:02,789 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:02,789 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:51186': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:02,789 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:51196': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:02,902 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:02,902 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:02,903 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:51208': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:02,903 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:51210': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:03,014 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:03,015 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:03,015 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:51218': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:03,015 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:51224': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:03,127 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:03,128 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:03,131 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:51236': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:03,131 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:51240': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:03,239 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:03,240 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:03,240 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:51248': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:03,240 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:51264': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:03,353 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:03,353 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:03,353 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:51266': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:03,353 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:51282': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:03,467 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:03,467 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:03,467 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:51292': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:03,467 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:51296': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:03,579 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:03,579 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:03,579 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:51298': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:03,580 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:51306': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:03,692 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:03,692 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:03,694 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:51318': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:03,694 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:51330': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:03,805 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:03,805 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:03,805 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:51346': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:03,805 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:51350': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:03,923 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:03,923 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:03,923 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:51354': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:03,923 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:51362': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:04,035 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:04,036 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:04,036 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:51364': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:04,036 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:51376': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:04,148 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:04,148 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:04,149 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:51378': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:04,149 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:51392': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:04,261 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:04,261 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:04,262 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:51400': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:04,262 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:51410': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:04,375 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:04,375 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:04,375 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:51414': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:04,375 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:51424': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:04,487 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:04,487 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:04,487 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:51426': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:04,488 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:51442': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:04,599 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:04,599 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:04,599 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:51444': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:04,600 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:51454': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:04,712 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:04,712 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:04,712 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:51460': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:04,712 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:51470': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:04,824 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:04,825 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:04,825 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:51476': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:04,825 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:51490': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:04,939 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:04,940 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:04,940 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:51494': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:04,940 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:51510': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:05,053 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:05,053 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:05,053 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:51526': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:05,053 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:51540': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:05,166 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:05,166 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:05,170 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:51552': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:05,170 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:51564': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:05,279 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:05,279 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:05,280 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:51578': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:05,280 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:51590': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:05,392 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:05,392 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:05,392 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:51606': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:05,392 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:51610': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:05,506 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:05,506 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:05,506 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:51622': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:05,506 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:51632': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:05,618 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:05,618 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:05,618 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:51642': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:05,618 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:51648': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:05,734 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:05,735 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:05,736 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:51654': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:05,736 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:51656': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:05,849 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:05,849 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:05,849 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:51666': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:05,849 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:51676': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:05,961 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:05,961 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:05,962 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:51678': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:05,962 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:51686': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:06,072 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:06,074 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:06,074 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:51694': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:06,074 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:51700': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:06,181 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:06,185 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:51714': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:06,186 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:06,186 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:51724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:06,287 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:06,288 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:51726': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:06,294 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:06,294 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:51734': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:06,395 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:06,396 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:51746': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:06,401 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:06,402 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:51748': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:06,501 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:06,502 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:51752': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:06,508 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:06,508 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:51766': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:06,608 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:06,609 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:51778': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:06,615 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:06,615 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:51792': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:06,717 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:06,718 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:51802': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:06,723 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:06,724 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:51808': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:06,824 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:06,824 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:51818': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:06,830 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:06,831 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:51832': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:06,931 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:06,932 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:51838': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:06,938 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:06,938 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:51844': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:07,038 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:07,039 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:51856': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:07,044 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:07,045 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:51868': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:07,146 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:07,147 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:51880': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:07,153 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:07,153 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:51884': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:07,254 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:07,254 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:51888': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:07,260 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:07,261 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:51890': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:07,361 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:07,361 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:51892': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:07,367 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:07,368 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:51896': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:07,468 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:07,468 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:51902': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:07,474 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:07,475 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:51914': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:07,575 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:07,575 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:51922': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:07,582 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:07,582 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:51932': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:07,683 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:07,684 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:51936': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:07,690 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:07,690 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:51952': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:07,790 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:07,791 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:51960': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:07,797 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:07,797 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:51976': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:07,898 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:07,899 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:51990': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:07,904 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:07,905 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:52002': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:08,005 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:08,006 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:52004': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:08,012 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:08,012 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:52008': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:08,112 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:08,113 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:52010': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:08,119 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:08,119 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:52020': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:08,219 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:08,220 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:52026': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:08,226 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:08,226 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:52034': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:08,326 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:08,327 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:52038': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:08,333 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:08,333 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:52048': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:08,435 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:08,436 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:52064': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:08,441 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:08,441 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:52070': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:08,543 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:08,544 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:52074': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:08,549 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:08,550 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:52084': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:08,650 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:08,650 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:52098': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:08,656 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:08,657 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:52100': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:08,757 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:08,757 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:52106': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:08,763 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:08,764 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:52108': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:08,865 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:08,866 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:52120': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:08,872 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:08,872 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:52136': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:08,973 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:08,973 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:52138': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:08,979 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:08,979 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:52154': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:09,080 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:09,080 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:52170': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:09,086 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:09,086 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:52182': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:09,187 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:09,187 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:52188': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:09,193 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:09,194 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:52192': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:09,295 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:09,296 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:52200': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:09,302 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:09,302 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:52202': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:09,403 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:09,404 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:52212': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:09,409 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:09,410 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:52224': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:09,510 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:09,510 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:52232': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:09,531 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:09,532 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:52246': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:09,617 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:09,617 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:52260': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:09,638 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:09,639 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:52276': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:09,724 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:09,725 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:52280': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:09,747 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:09,747 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:52290': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:09,832 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:09,832 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:52292': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:09,854 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:09,854 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:52296': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:09,939 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:09,939 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:52302': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:09,961 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:09,961 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:52306': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:10,047 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:10,048 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:52322': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:10,068 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:10,069 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:52336': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:10,155 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:10,156 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:52344': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:10,175 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:10,176 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:52358': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:10,262 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:10,263 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:52366': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:10,283 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:10,284 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:52376': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:10,370 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:10,370 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:52392': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:10,391 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:10,391 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:52400': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:10,478 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:10,478 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:52414': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:10,500 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:10,501 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:52428': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:10,585 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:10,585 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:52436': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:10,608 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35745 8450s 2024-11-23 22:40:10,608 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35745': TLS handshake failed with remote 'tls://127.0.0.1:52446': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:10,674 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37685. Reason: failure-to-start- 8450s 2024-11-23 22:40:10,675 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:40:10,676 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36539. Reason: failure-to-start- 8450s 2024-11-23 22:40:10,677 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:40:10,679 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 13s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 8450s stream = await stream.start_tls( 8450s ^^^^^^^^^^^^^^^^^^^^^^^ 8450s False, ssl_options=ssl_options, server_hostname=host 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 8450s self.socket.do_handshake() 8450s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 8450s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 8450s self._sslobj.do_handshake() 8450s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 8450s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 8450s raise FatalCommClosedError( 8450s ...<2 lines>... 8450s ) from err 8450s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 8450s 8450s During handling of the above exception, another exception occurred: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1218, in _register_with_scheduler 8450s await asyncio.sleep(0.1) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 718, in sleep 8450s return await future 8450s ^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 13s. 8450s 2024-11-23 22:40:11,691 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:40:11,698 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33451 8450s 2024-11-23 22:40:11,699 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46357/status 8450s 2024-11-23 22:40:11,700 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:40:11,714 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40259 8450s 2024-11-23 22:40:11,714 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40259 8450s 2024-11-23 22:40:11,714 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:40:11,714 - distributed.worker - INFO - dashboard at: 127.0.0.1:43175 8450s 2024-11-23 22:40:11,714 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33451 8450s 2024-11-23 22:40:11,714 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:40:11,714 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:40:11,714 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:40:11,714 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ww_bup0n 8450s 2024-11-23 22:40:11,714 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:40:11,717 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35693 8450s 2024-11-23 22:40:11,717 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35693 8450s 2024-11-23 22:40:11,717 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:40:11,717 - distributed.worker - INFO - dashboard at: 127.0.0.1:44583 8450s 2024-11-23 22:40:11,717 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33451 8450s 2024-11-23 22:40:11,717 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:40:11,717 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:40:11,717 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:40:11,717 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-qbm1jsl6 8450s 2024-11-23 22:40:11,717 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:40:11,718 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40259. Reason: failure-to-start- 8450s 2024-11-23 22:40:11,719 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:40:11,719 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35693. Reason: failure-to-start- 8450s 2024-11-23 22:40:11,719 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:40:11,720 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33451': TLS handshake failed with remote 'tls://127.0.0.1:43710': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:40:11,720 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33451': TLS handshake failed with remote 'tls://127.0.0.1:43716': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:40:11,722 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:40:12,728 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:40:12,737 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33823 8450s 2024-11-23 22:40:12,738 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40921/status 8450s 2024-11-23 22:40:12,738 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:40:12,751 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:32801 8450s 2024-11-23 22:40:12,751 - distributed.worker - INFO - Listening to: tls://127.0.0.1:32801 8450s 2024-11-23 22:40:12,751 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:40:12,751 - distributed.worker - INFO - dashboard at: 127.0.0.1:44321 8450s 2024-11-23 22:40:12,751 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33823 8450s 2024-11-23 22:40:12,751 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:40:12,751 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:40:12,751 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:40:12,751 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-hd17jz_y 8450s 2024-11-23 22:40:12,751 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:40:12,753 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35903 8450s 2024-11-23 22:40:12,753 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35903 8450s 2024-11-23 22:40:12,754 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:40:12,754 - distributed.worker - INFO - dashboard at: 127.0.0.1:42273 8450s 2024-11-23 22:40:12,754 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33823 8450s 2024-11-23 22:40:12,754 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:40:12,754 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:40:12,754 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:40:12,754 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-oxuwuaqz 8450s 2024-11-23 22:40:12,754 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:40:12,755 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:32801. Reason: failure-to-start- 8450s 2024-11-23 22:40:12,755 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:40:12,755 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35903. Reason: failure-to-start- 8450s 2024-11-23 22:40:12,756 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:40:12,757 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33823': TLS handshake failed with remote 'tls://127.0.0.1:60016': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:40:12,757 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33823': TLS handshake failed with remote 'tls://127.0.0.1:60030': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:40:12,758 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:40:13,764 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:40:13,770 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46275 8450s 2024-11-23 22:40:13,771 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46193/status 8450s 2024-11-23 22:40:13,771 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:40:13,785 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39935 8450s 2024-11-23 22:40:13,786 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39935 8450s 2024-11-23 22:40:13,786 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:40:13,786 - distributed.worker - INFO - dashboard at: 127.0.0.1:35655 8450s 2024-11-23 22:40:13,786 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46275 8450s 2024-11-23 22:40:13,786 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:40:13,786 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:40:13,786 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:40:13,786 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-bdjcc4my 8450s 2024-11-23 22:40:13,786 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:40:13,788 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38639 8450s 2024-11-23 22:40:13,788 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38639 8450s 2024-11-23 22:40:13,788 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:40:13,788 - distributed.worker - INFO - dashboard at: 127.0.0.1:36617 8450s 2024-11-23 22:40:13,788 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46275 8450s 2024-11-23 22:40:13,788 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:40:13,788 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:40:13,788 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:40:13,788 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-2v04go77 8450s 2024-11-23 22:40:13,788 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:40:13,789 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39935. Reason: failure-to-start- 8450s 2024-11-23 22:40:13,789 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:40:13,790 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38639. Reason: failure-to-start- 8450s 2024-11-23 22:40:13,790 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:40:13,791 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46275': TLS handshake failed with remote 'tls://127.0.0.1:49668': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:40:13,791 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46275': TLS handshake failed with remote 'tls://127.0.0.1:49682': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:40:13,793 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:40:14,797 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:40:14,805 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44269 8450s 2024-11-23 22:40:14,805 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38943/status 8450s 2024-11-23 22:40:14,805 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:40:14,819 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42671 8450s 2024-11-23 22:40:14,820 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42671 8450s 2024-11-23 22:40:14,820 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:40:14,820 - distributed.worker - INFO - dashboard at: 127.0.0.1:36127 8450s 2024-11-23 22:40:14,820 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44269 8450s 2024-11-23 22:40:14,820 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:40:14,820 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:40:14,820 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:40:14,820 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-_v8rr2wd 8450s 2024-11-23 22:40:14,820 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:40:14,822 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45231 8450s 2024-11-23 22:40:14,822 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45231 8450s 2024-11-23 22:40:14,822 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:40:14,822 - distributed.worker - INFO - dashboard at: 127.0.0.1:39703 8450s 2024-11-23 22:40:14,822 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44269 8450s 2024-11-23 22:40:14,822 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:40:14,823 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:40:14,823 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:40:14,823 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-20uurp0d 8450s 2024-11-23 22:40:14,823 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:40:14,828 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42671. Reason: failure-to-start- 8450s 2024-11-23 22:40:14,828 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:40:14,829 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45231. Reason: failure-to-start- 8450s 2024-11-23 22:40:14,829 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:40:14,830 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44269': TLS handshake failed with remote 'tls://127.0.0.1:39342': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:40:14,830 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44269': TLS handshake failed with remote 'tls://127.0.0.1:39358': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:40:14,832 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:40:15,837 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:40:15,844 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39681 8450s 2024-11-23 22:40:15,844 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35565/status 8450s 2024-11-23 22:40:15,844 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:40:15,856 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41135 8450s 2024-11-23 22:40:15,857 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41135 8450s 2024-11-23 22:40:15,857 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:40:15,857 - distributed.worker - INFO - dashboard at: 127.0.0.1:37961 8450s 2024-11-23 22:40:15,857 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39681 8450s 2024-11-23 22:40:15,857 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:40:15,857 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:40:15,857 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:40:15,857 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-di6i490w 8450s 2024-11-23 22:40:15,857 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:40:15,859 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46351 8450s 2024-11-23 22:40:15,859 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46351 8450s 2024-11-23 22:40:15,859 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:40:15,859 - distributed.worker - INFO - dashboard at: 127.0.0.1:35461 8450s 2024-11-23 22:40:15,859 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39681 8450s 2024-11-23 22:40:15,859 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:40:15,859 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:40:15,859 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:40:15,859 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-hj0z44p6 8450s 2024-11-23 22:40:15,859 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:40:15,860 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41135. Reason: failure-to-start- 8450s 2024-11-23 22:40:15,860 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:40:15,861 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46351. Reason: failure-to-start- 8450s 2024-11-23 22:40:15,861 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:40:15,862 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39681': TLS handshake failed with remote 'tls://127.0.0.1:37310': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:40:15,862 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39681': TLS handshake failed with remote 'tls://127.0.0.1:37312': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:40:15,863 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:40:16,869 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:40:16,876 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38635 8450s 2024-11-23 22:40:16,876 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36063/status 8450s 2024-11-23 22:40:16,876 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:40:16,892 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42649 8450s 2024-11-23 22:40:16,892 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42649 8450s 2024-11-23 22:40:16,892 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:40:16,892 - distributed.worker - INFO - dashboard at: 127.0.0.1:38759 8450s 2024-11-23 22:40:16,892 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38635 8450s 2024-11-23 22:40:16,892 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:40:16,892 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:40:16,892 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:40:16,892 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-3czm27on 8450s 2024-11-23 22:40:16,892 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:40:16,894 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41687 8450s 2024-11-23 22:40:16,895 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41687 8450s 2024-11-23 22:40:16,895 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:40:16,895 - distributed.worker - INFO - dashboard at: 127.0.0.1:33423 8450s 2024-11-23 22:40:16,895 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38635 8450s 2024-11-23 22:40:16,895 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:40:16,895 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:40:16,895 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:40:16,895 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-yrpdfs4b 8450s 2024-11-23 22:40:16,895 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:40:16,896 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42649. Reason: failure-to-start- 8450s 2024-11-23 22:40:16,896 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:40:16,896 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41687. Reason: failure-to-start- 8450s 2024-11-23 22:40:16,897 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:40:16,898 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38635': TLS handshake failed with remote 'tls://127.0.0.1:59108': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:40:16,898 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38635': TLS handshake failed with remote 'tls://127.0.0.1:59116': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:40:16,899 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:40:17,905 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:40:17,911 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42317 8450s 2024-11-23 22:40:17,912 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36199/status 8450s 2024-11-23 22:40:17,912 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:40:17,926 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44581 8450s 2024-11-23 22:40:17,926 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44581 8450s 2024-11-23 22:40:17,926 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:40:17,926 - distributed.worker - INFO - dashboard at: 127.0.0.1:33813 8450s 2024-11-23 22:40:17,926 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42317 8450s 2024-11-23 22:40:17,926 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:40:17,926 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:40:17,927 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:40:17,927 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-wdlv6b9f 8450s 2024-11-23 22:40:17,927 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:40:17,928 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38665 8450s 2024-11-23 22:40:17,929 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38665 8450s 2024-11-23 22:40:17,929 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:40:17,929 - distributed.worker - INFO - dashboard at: 127.0.0.1:37889 8450s 2024-11-23 22:40:17,929 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42317 8450s 2024-11-23 22:40:17,929 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:40:17,929 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:40:17,929 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:40:17,929 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-fskk5tsw 8450s 2024-11-23 22:40:17,929 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:40:17,930 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44581. Reason: failure-to-start- 8450s 2024-11-23 22:40:17,930 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:40:17,930 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38665. Reason: failure-to-start- 8450s 2024-11-23 22:40:17,931 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:40:17,932 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42317': TLS handshake failed with remote 'tls://127.0.0.1:38560': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:40:17,932 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42317': TLS handshake failed with remote 'tls://127.0.0.1:38576': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:40:17,933 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:40:18,940 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:40:18,948 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39131 8450s 2024-11-23 22:40:18,948 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41583/status 8450s 2024-11-23 22:40:18,948 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:40:18,962 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42921 8450s 2024-11-23 22:40:18,962 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42921 8450s 2024-11-23 22:40:18,962 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:40:18,962 - distributed.worker - INFO - dashboard at: 127.0.0.1:44797 8450s 2024-11-23 22:40:18,962 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39131 8450s 2024-11-23 22:40:18,962 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:40:18,962 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:40:18,962 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:40:18,962 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-xvhxjz1i 8450s 2024-11-23 22:40:18,962 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:40:18,964 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41151 8450s 2024-11-23 22:40:18,964 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41151 8450s 2024-11-23 22:40:18,965 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:40:18,965 - distributed.worker - INFO - dashboard at: 127.0.0.1:45891 8450s 2024-11-23 22:40:18,965 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39131 8450s 2024-11-23 22:40:18,965 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:40:18,965 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:40:18,965 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:40:18,965 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-l4czf9b9 8450s 2024-11-23 22:40:18,965 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:40:18,966 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42921. Reason: failure-to-start- 8450s 2024-11-23 22:40:18,966 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:40:18,967 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41151. Reason: failure-to-start- 8450s 2024-11-23 22:40:18,968 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:40:18,969 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39131': TLS handshake failed with remote 'tls://127.0.0.1:44924': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:40:18,969 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39131': TLS handshake failed with remote 'tls://127.0.0.1:44930': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:40:18,970 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:40:19,976 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:40:19,982 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45091 8450s 2024-11-23 22:40:19,983 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45279/status 8450s 2024-11-23 22:40:19,983 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:40:19,998 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37543 8450s 2024-11-23 22:40:19,998 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37543 8450s 2024-11-23 22:40:19,998 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:40:19,998 - distributed.worker - INFO - dashboard at: 127.0.0.1:33783 8450s 2024-11-23 22:40:19,998 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45091 8450s 2024-11-23 22:40:19,998 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:40:19,998 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:40:19,998 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:40:19,998 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-q_ocp0kr 8450s 2024-11-23 22:40:19,999 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:40:20,000 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42723 8450s 2024-11-23 22:40:20,001 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42723 8450s 2024-11-23 22:40:20,001 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:40:20,001 - distributed.worker - INFO - dashboard at: 127.0.0.1:34005 8450s 2024-11-23 22:40:20,001 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45091 8450s 2024-11-23 22:40:20,001 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:40:20,001 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:40:20,001 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:40:20,001 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-giq3sdbw 8450s 2024-11-23 22:40:20,001 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:40:20,002 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37543. Reason: failure-to-start- 8450s 2024-11-23 22:40:20,002 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:40:20,003 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42723. Reason: failure-to-start- 8450s 2024-11-23 22:40:20,003 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:40:20,004 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45091': TLS handshake failed with remote 'tls://127.0.0.1:45356': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:40:20,004 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45091': TLS handshake failed with remote 'tls://127.0.0.1:45362': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:40:20,006 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:40:21,011 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:40:21,019 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45197 8450s 2024-11-23 22:40:21,019 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44663/status 8450s 2024-11-23 22:40:21,020 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:40:21,033 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42253 8450s 2024-11-23 22:40:21,033 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42253 8450s 2024-11-23 22:40:21,033 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:40:21,033 - distributed.worker - INFO - dashboard at: 127.0.0.1:34683 8450s 2024-11-23 22:40:21,033 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45197 8450s 2024-11-23 22:40:21,033 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:40:21,033 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:40:21,033 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:40:21,033 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ov4qjtn9 8450s 2024-11-23 22:40:21,033 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:40:21,035 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39071 8450s 2024-11-23 22:40:21,035 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39071 8450s 2024-11-23 22:40:21,036 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:40:21,036 - distributed.worker - INFO - dashboard at: 127.0.0.1:44775 8450s 2024-11-23 22:40:21,036 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45197 8450s 2024-11-23 22:40:21,036 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:40:21,036 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:40:21,036 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:40:21,036 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-wzcgsbbw 8450s 2024-11-23 22:40:21,036 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:40:21,037 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42253. Reason: failure-to-start- 8450s 2024-11-23 22:40:21,037 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:40:21,037 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39071. Reason: failure-to-start- 8450s 2024-11-23 22:40:21,038 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:40:21,039 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45197': TLS handshake failed with remote 'tls://127.0.0.1:52036': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:40:21,039 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45197': TLS handshake failed with remote 'tls://127.0.0.1:52042': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:40:21,040 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:40:22,046 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:40:22,053 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40129 8450s 2024-11-23 22:40:22,054 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38037/status 8450s 2024-11-23 22:40:22,054 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:40:22,070 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35845 8450s 2024-11-23 22:40:22,070 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35845 8450s 2024-11-23 22:40:22,070 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:40:22,070 - distributed.worker - INFO - dashboard at: 127.0.0.1:46503 8450s 2024-11-23 22:40:22,070 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40129 8450s 2024-11-23 22:40:22,070 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:40:22,070 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:40:22,070 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:40:22,071 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-me9299r7 8450s 2024-11-23 22:40:22,071 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:40:22,073 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33047 8450s 2024-11-23 22:40:22,073 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33047 8450s 2024-11-23 22:40:22,073 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:40:22,073 - distributed.worker - INFO - dashboard at: 127.0.0.1:38385 8450s 2024-11-23 22:40:22,073 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40129 8450s 2024-11-23 22:40:22,073 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:40:22,073 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:40:22,073 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:40:22,073 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-gj0fv1x1 8450s 2024-11-23 22:40:22,073 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:40:22,074 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35845. Reason: failure-to-start- 8450s 2024-11-23 22:40:22,074 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:40:22,075 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33047. Reason: failure-to-start- 8450s 2024-11-23 22:40:22,075 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:40:22,076 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40129': TLS handshake failed with remote 'tls://127.0.0.1:37758': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:40:22,076 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40129': TLS handshake failed with remote 'tls://127.0.0.1:37760': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:40:22,078 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:40:23,087 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:40:23,095 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34881 8450s 2024-11-23 22:40:23,096 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40683/status 8450s 2024-11-23 22:40:23,096 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:40:23,110 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41647 8450s 2024-11-23 22:40:23,111 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41647 8450s 2024-11-23 22:40:23,111 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:40:23,111 - distributed.worker - INFO - dashboard at: 127.0.0.1:34855 8450s 2024-11-23 22:40:23,111 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34881 8450s 2024-11-23 22:40:23,111 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:40:23,111 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:40:23,111 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:40:23,111 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-jcxzt3xr 8450s 2024-11-23 22:40:23,111 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:40:23,113 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34425 8450s 2024-11-23 22:40:23,113 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34425 8450s 2024-11-23 22:40:23,113 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:40:23,113 - distributed.worker - INFO - dashboard at: 127.0.0.1:43015 8450s 2024-11-23 22:40:23,113 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34881 8450s 2024-11-23 22:40:23,113 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:40:23,113 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:40:23,113 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:40:23,114 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-fbmc4fqw 8450s 2024-11-23 22:40:23,114 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:40:23,115 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41647. Reason: failure-to-start- 8450s 2024-11-23 22:40:23,116 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:40:23,116 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34425. Reason: failure-to-start- 8450s 2024-11-23 22:40:23,116 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:40:23,118 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34881': TLS handshake failed with remote 'tls://127.0.0.1:45998': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:40:23,118 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34881': TLS handshake failed with remote 'tls://127.0.0.1:46004': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:40:23,119 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:40:24,131 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:40:24,141 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42099 8450s 2024-11-23 22:40:24,142 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:32799/status 8450s 2024-11-23 22:40:24,142 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:40:24,159 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45125 8450s 2024-11-23 22:40:24,159 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45125 8450s 2024-11-23 22:40:24,159 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:40:24,159 - distributed.worker - INFO - dashboard at: 127.0.0.1:46315 8450s 2024-11-23 22:40:24,159 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42099 8450s 2024-11-23 22:40:24,159 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:40:24,159 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:40:24,160 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:40:24,160 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-l8d9csxy 8450s 2024-11-23 22:40:24,160 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:40:24,162 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37629 8450s 2024-11-23 22:40:24,162 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37629 8450s 2024-11-23 22:40:24,162 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:40:24,162 - distributed.worker - INFO - dashboard at: 127.0.0.1:36609 8450s 2024-11-23 22:40:24,162 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42099 8450s 2024-11-23 22:40:24,162 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:40:24,162 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:40:24,162 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:40:24,162 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-h90ewg2c 8450s 2024-11-23 22:40:24,162 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:40:24,164 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45125. Reason: failure-to-start- 8450s 2024-11-23 22:40:24,164 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:40:24,164 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37629. Reason: failure-to-start- 8450s 2024-11-23 22:40:24,165 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:40:24,168 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42099': TLS handshake failed with remote 'tls://127.0.0.1:33540': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:40:24,168 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42099': TLS handshake failed with remote 'tls://127.0.0.1:33554': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:40:24,170 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:40:25,178 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:40:25,186 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45399 8450s 2024-11-23 22:40:25,186 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41123/status 8450s 2024-11-23 22:40:25,186 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:40:25,201 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41113 8450s 2024-11-23 22:40:25,201 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41113 8450s 2024-11-23 22:40:25,201 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:40:25,201 - distributed.worker - INFO - dashboard at: 127.0.0.1:39821 8450s 2024-11-23 22:40:25,201 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45399 8450s 2024-11-23 22:40:25,201 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:40:25,201 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:40:25,201 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:40:25,201 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-j68brhu_ 8450s 2024-11-23 22:40:25,201 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:40:25,203 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43777 8450s 2024-11-23 22:40:25,203 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43777 8450s 2024-11-23 22:40:25,203 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:40:25,204 - distributed.worker - INFO - dashboard at: 127.0.0.1:36295 8450s 2024-11-23 22:40:25,204 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45399 8450s 2024-11-23 22:40:25,204 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:40:25,204 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:40:25,204 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:40:25,204 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-5k1v45er 8450s 2024-11-23 22:40:25,204 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:40:25,205 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41113. Reason: failure-to-start- 8450s 2024-11-23 22:40:25,205 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:40:25,206 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43777. Reason: failure-to-start- 8450s 2024-11-23 22:40:25,206 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:40:25,209 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45399': TLS handshake failed with remote 'tls://127.0.0.1:56238': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:40:25,210 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45399': TLS handshake failed with remote 'tls://127.0.0.1:56246': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:40:25,211 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:40:26,217 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:40:26,224 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34665 8450s 2024-11-23 22:40:26,224 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35725/status 8450s 2024-11-23 22:40:26,225 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:40:26,239 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38039 8450s 2024-11-23 22:40:26,239 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38039 8450s 2024-11-23 22:40:26,239 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:40:26,239 - distributed.worker - INFO - dashboard at: 127.0.0.1:39799 8450s 2024-11-23 22:40:26,240 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34665 8450s 2024-11-23 22:40:26,240 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:40:26,240 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:40:26,240 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:40:26,240 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-cd2u_ek0 8450s 2024-11-23 22:40:26,240 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:40:26,242 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36013 8450s 2024-11-23 22:40:26,242 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36013 8450s 2024-11-23 22:40:26,242 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:40:26,242 - distributed.worker - INFO - dashboard at: 127.0.0.1:36805 8450s 2024-11-23 22:40:26,242 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34665 8450s 2024-11-23 22:40:26,242 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:40:26,242 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:40:26,242 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:40:26,242 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-w6fl_fz5 8450s 2024-11-23 22:40:26,242 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:40:26,244 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38039. Reason: failure-to-start- 8450s 2024-11-23 22:40:26,244 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:40:26,244 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36013. Reason: failure-to-start- 8450s 2024-11-23 22:40:26,244 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:40:26,249 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34665': TLS handshake failed with remote 'tls://127.0.0.1:45118': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:40:26,249 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34665': TLS handshake failed with remote 'tls://127.0.0.1:45134': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:40:26,250 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:40:27,256 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:40:27,263 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43215 8450s 2024-11-23 22:40:27,263 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34047/status 8450s 2024-11-23 22:40:27,264 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:40:27,277 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38537 8450s 2024-11-23 22:40:27,277 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38537 8450s 2024-11-23 22:40:27,277 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:40:27,277 - distributed.worker - INFO - dashboard at: 127.0.0.1:42821 8450s 2024-11-23 22:40:27,277 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43215 8450s 2024-11-23 22:40:27,277 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:40:27,277 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:40:27,277 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:40:27,278 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-tx2xi35f 8450s 2024-11-23 22:40:27,278 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:40:27,279 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45267 8450s 2024-11-23 22:40:27,279 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45267 8450s 2024-11-23 22:40:27,280 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:40:27,280 - distributed.worker - INFO - dashboard at: 127.0.0.1:36371 8450s 2024-11-23 22:40:27,280 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43215 8450s 2024-11-23 22:40:27,280 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:40:27,280 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:40:27,280 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:40:27,280 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-yj2tbl5j 8450s 2024-11-23 22:40:27,280 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:40:27,283 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38537. Reason: failure-to-start- 8450s 2024-11-23 22:40:27,283 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:40:27,284 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45267. Reason: failure-to-start- 8450s 2024-11-23 22:40:27,284 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:40:27,286 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43215': TLS handshake failed with remote 'tls://127.0.0.1:37854': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:40:27,286 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43215': TLS handshake failed with remote 'tls://127.0.0.1:37866': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:40:27,288 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:40:28,293 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:40:28,299 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38857 8450s 2024-11-23 22:40:28,300 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33777/status 8450s 2024-11-23 22:40:28,300 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:40:28,312 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37861 8450s 2024-11-23 22:40:28,313 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37861 8450s 2024-11-23 22:40:28,313 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:40:28,313 - distributed.worker - INFO - dashboard at: 127.0.0.1:36235 8450s 2024-11-23 22:40:28,313 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38857 8450s 2024-11-23 22:40:28,313 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:40:28,313 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:40:28,313 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:40:28,313 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-msfhxkaf 8450s 2024-11-23 22:40:28,313 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:40:28,315 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39935 8450s 2024-11-23 22:40:28,315 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39935 8450s 2024-11-23 22:40:28,315 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:40:28,315 - distributed.worker - INFO - dashboard at: 127.0.0.1:34135 8450s 2024-11-23 22:40:28,315 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38857 8450s 2024-11-23 22:40:28,315 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:40:28,315 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:40:28,315 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:40:28,315 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-8repa5lw 8450s 2024-11-23 22:40:28,316 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:40:28,320 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37861. Reason: failure-to-start- 8450s 2024-11-23 22:40:28,320 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:40:28,321 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39935. Reason: failure-to-start- 8450s 2024-11-23 22:40:28,321 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:40:28,322 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38857': TLS handshake failed with remote 'tls://127.0.0.1:60794': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:40:28,322 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38857': TLS handshake failed with remote 'tls://127.0.0.1:60798': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:40:28,324 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:40:29,329 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:40:29,335 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40559 8450s 2024-11-23 22:40:29,335 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:32923/status 8450s 2024-11-23 22:40:29,335 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:40:29,348 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39285 8450s 2024-11-23 22:40:29,348 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39285 8450s 2024-11-23 22:40:29,348 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:40:29,348 - distributed.worker - INFO - dashboard at: 127.0.0.1:40363 8450s 2024-11-23 22:40:29,348 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40559 8450s 2024-11-23 22:40:29,348 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:40:29,348 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:40:29,348 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:40:29,348 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-8g6juskk 8450s 2024-11-23 22:40:29,349 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:40:29,350 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41519 8450s 2024-11-23 22:40:29,351 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41519 8450s 2024-11-23 22:40:29,351 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:40:29,351 - distributed.worker - INFO - dashboard at: 127.0.0.1:43813 8450s 2024-11-23 22:40:29,351 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40559 8450s 2024-11-23 22:40:29,351 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:40:29,351 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:40:29,351 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:40:29,351 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-hjieg641 8450s 2024-11-23 22:40:29,351 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:40:29,354 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39285. Reason: failure-to-start- 8450s 2024-11-23 22:40:29,354 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:40:29,355 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41519. Reason: failure-to-start- 8450s 2024-11-23 22:40:29,355 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:40:29,356 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40559': TLS handshake failed with remote 'tls://127.0.0.1:51710': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:40:29,357 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40559': TLS handshake failed with remote 'tls://127.0.0.1:51724': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:40:29,358 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:40:30,365 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:40:30,372 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42761 8450s 2024-11-23 22:40:30,372 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45183/status 8450s 2024-11-23 22:40:30,372 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:40:30,385 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36489 8450s 2024-11-23 22:40:30,385 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36489 8450s 2024-11-23 22:40:30,385 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:40:30,385 - distributed.worker - INFO - dashboard at: 127.0.0.1:36263 8450s 2024-11-23 22:40:30,385 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42761 8450s 2024-11-23 22:40:30,385 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:40:30,385 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:40:30,385 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:40:30,385 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-x6fgbiiy 8450s 2024-11-23 22:40:30,385 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:40:30,387 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39383 8450s 2024-11-23 22:40:30,387 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39383 8450s 2024-11-23 22:40:30,387 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:40:30,387 - distributed.worker - INFO - dashboard at: 127.0.0.1:36867 8450s 2024-11-23 22:40:30,387 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42761 8450s 2024-11-23 22:40:30,388 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:40:30,388 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:40:30,388 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:40:30,388 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-rvmkpztc 8450s 2024-11-23 22:40:30,388 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:40:30,391 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36489. Reason: failure-to-start- 8450s 2024-11-23 22:40:30,391 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:40:30,392 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39383. Reason: failure-to-start- 8450s 2024-11-23 22:40:30,392 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:40:30,393 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42761': TLS handshake failed with remote 'tls://127.0.0.1:46340': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:40:30,393 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42761': TLS handshake failed with remote 'tls://127.0.0.1:46348': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:40:30,395 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:40:31,401 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:40:31,408 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33717 8450s 2024-11-23 22:40:31,408 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40849/status 8450s 2024-11-23 22:40:31,408 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:40:31,434 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46587 8450s 2024-11-23 22:40:31,435 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46587 8450s 2024-11-23 22:40:31,435 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:40:31,435 - distributed.worker - INFO - dashboard at: 127.0.0.1:37431 8450s 2024-11-23 22:40:31,435 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33717 8450s 2024-11-23 22:40:31,435 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:40:31,435 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:40:31,435 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:40:31,435 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-g_yg7_qk 8450s 2024-11-23 22:40:31,435 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:40:31,437 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33657 8450s 2024-11-23 22:40:31,437 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33657 8450s 2024-11-23 22:40:31,437 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:40:31,437 - distributed.worker - INFO - dashboard at: 127.0.0.1:34649 8450s 2024-11-23 22:40:31,437 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33717 8450s 2024-11-23 22:40:31,437 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:40:31,438 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:40:31,438 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:40:31,438 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-tyenachx 8450s 2024-11-23 22:40:31,438 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:40:31,441 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46587. Reason: failure-to-start- 8450s 2024-11-23 22:40:31,441 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:40:31,442 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33657. Reason: failure-to-start- 8450s 2024-11-23 22:40:31,442 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:40:31,443 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33717': TLS handshake failed with remote 'tls://127.0.0.1:54944': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:40:31,444 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33717': TLS handshake failed with remote 'tls://127.0.0.1:54946': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:40:31,445 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:40:32,456 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:40:32,464 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35799 8450s 2024-11-23 22:40:32,465 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36575/status 8450s 2024-11-23 22:40:32,465 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:40:32,481 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45531 8450s 2024-11-23 22:40:32,481 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45531 8450s 2024-11-23 22:40:32,481 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:40:32,481 - distributed.worker - INFO - dashboard at: 127.0.0.1:36517 8450s 2024-11-23 22:40:32,481 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35799 8450s 2024-11-23 22:40:32,481 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:40:32,481 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:40:32,481 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:40:32,482 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-rabo480_ 8450s 2024-11-23 22:40:32,482 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:40:32,485 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35879 8450s 2024-11-23 22:40:32,485 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35879 8450s 2024-11-23 22:40:32,485 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:40:32,485 - distributed.worker - INFO - dashboard at: 127.0.0.1:36917 8450s 2024-11-23 22:40:32,485 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35799 8450s 2024-11-23 22:40:32,485 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:40:32,485 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:40:32,485 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:40:32,485 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-d0yrxeil 8450s 2024-11-23 22:40:32,485 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:40:32,487 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45531. Reason: failure-to-start- 8450s 2024-11-23 22:40:32,487 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:40:32,487 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35879. Reason: failure-to-start- 8450s 2024-11-23 22:40:32,488 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:40:32,491 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35799': TLS handshake failed with remote 'tls://127.0.0.1:47516': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:40:32,492 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35799': TLS handshake failed with remote 'tls://127.0.0.1:47520': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:40:32,493 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:40:33,499 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:40:33,506 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44367 8450s 2024-11-23 22:40:33,506 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43585/status 8450s 2024-11-23 22:40:33,507 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:40:33,520 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45849 8450s 2024-11-23 22:40:33,520 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45849 8450s 2024-11-23 22:40:33,520 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:40:33,520 - distributed.worker - INFO - dashboard at: 127.0.0.1:40931 8450s 2024-11-23 22:40:33,521 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44367 8450s 2024-11-23 22:40:33,521 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:40:33,521 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:40:33,521 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:40:33,521 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-qc2ezx4_ 8450s 2024-11-23 22:40:33,521 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:40:33,523 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40249 8450s 2024-11-23 22:40:33,523 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40249 8450s 2024-11-23 22:40:33,523 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:40:33,523 - distributed.worker - INFO - dashboard at: 127.0.0.1:35429 8450s 2024-11-23 22:40:33,523 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44367 8450s 2024-11-23 22:40:33,523 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:40:33,523 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:40:33,523 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:40:33,523 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-uts75nkr 8450s 2024-11-23 22:40:33,523 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:40:33,525 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45849. Reason: failure-to-start- 8450s 2024-11-23 22:40:33,525 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:40:33,525 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40249. Reason: failure-to-start- 8450s 2024-11-23 22:40:33,525 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:40:33,529 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44367': TLS handshake failed with remote 'tls://127.0.0.1:38536': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:40:33,529 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44367': TLS handshake failed with remote 'tls://127.0.0.1:38538': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:40:33,531 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:40:34,536 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:40:34,545 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38875 8450s 2024-11-23 22:40:34,545 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45491/status 8450s 2024-11-23 22:40:34,545 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:40:34,560 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41385 8450s 2024-11-23 22:40:34,560 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41385 8450s 2024-11-23 22:40:34,560 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:40:34,560 - distributed.worker - INFO - dashboard at: 127.0.0.1:38769 8450s 2024-11-23 22:40:34,560 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38875 8450s 2024-11-23 22:40:34,560 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:40:34,560 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:40:34,560 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:40:34,560 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-zh2utrh3 8450s 2024-11-23 22:40:34,560 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:40:34,562 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33741 8450s 2024-11-23 22:40:34,562 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33741 8450s 2024-11-23 22:40:34,562 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:40:34,563 - distributed.worker - INFO - dashboard at: 127.0.0.1:39095 8450s 2024-11-23 22:40:34,563 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38875 8450s 2024-11-23 22:40:34,563 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:40:34,563 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:40:34,563 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:40:34,563 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-rf0km8i9 8450s 2024-11-23 22:40:34,563 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:40:34,566 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41385. Reason: failure-to-start- 8450s 2024-11-23 22:40:34,567 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:40:34,567 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33741. Reason: failure-to-start- 8450s 2024-11-23 22:40:34,567 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:40:34,569 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38875': TLS handshake failed with remote 'tls://127.0.0.1:60748': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:40:34,569 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38875': TLS handshake failed with remote 'tls://127.0.0.1:60760': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:40:34,570 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:40:35,576 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:40:35,582 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46667 8450s 2024-11-23 22:40:35,583 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40437/status 8450s 2024-11-23 22:40:35,583 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:40:35,598 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41449 8450s 2024-11-23 22:40:35,598 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41449 8450s 2024-11-23 22:40:35,598 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:40:35,598 - distributed.worker - INFO - dashboard at: 127.0.0.1:45507 8450s 2024-11-23 22:40:35,598 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46667 8450s 2024-11-23 22:40:35,598 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:40:35,598 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:40:35,598 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:40:35,598 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-hk423vdr 8450s 2024-11-23 22:40:35,598 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:40:35,600 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37193 8450s 2024-11-23 22:40:35,600 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37193 8450s 2024-11-23 22:40:35,600 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:40:35,600 - distributed.worker - INFO - dashboard at: 127.0.0.1:44579 8450s 2024-11-23 22:40:35,600 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46667 8450s 2024-11-23 22:40:35,600 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:40:35,600 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:40:35,600 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:40:35,600 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-is58306g 8450s 2024-11-23 22:40:35,600 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:40:35,602 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41449. Reason: failure-to-start- 8450s 2024-11-23 22:40:35,602 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:40:35,602 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37193. Reason: failure-to-start- 8450s 2024-11-23 22:40:35,602 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:40:35,606 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46667': TLS handshake failed with remote 'tls://127.0.0.1:50154': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:40:35,606 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46667': TLS handshake failed with remote 'tls://127.0.0.1:50170': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:40:35,608 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:40:36,613 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:40:36,620 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40873 8450s 2024-11-23 22:40:36,620 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44665/status 8450s 2024-11-23 22:40:36,621 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:40:36,634 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45993 8450s 2024-11-23 22:40:36,634 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45993 8450s 2024-11-23 22:40:36,634 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:40:36,634 - distributed.worker - INFO - dashboard at: 127.0.0.1:36555 8450s 2024-11-23 22:40:36,634 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40873 8450s 2024-11-23 22:40:36,634 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:40:36,634 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:40:36,634 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:40:36,635 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ri5dqaj3 8450s 2024-11-23 22:40:36,635 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:40:36,636 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41147 8450s 2024-11-23 22:40:36,637 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41147 8450s 2024-11-23 22:40:36,637 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:40:36,637 - distributed.worker - INFO - dashboard at: 127.0.0.1:37727 8450s 2024-11-23 22:40:36,637 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40873 8450s 2024-11-23 22:40:36,638 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:40:36,638 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:40:36,638 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:40:36,638 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-0pyqzax4 8450s 2024-11-23 22:40:36,638 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:40:36,642 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45993. Reason: failure-to-start- 8450s 2024-11-23 22:40:36,642 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:40:36,642 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41147. Reason: failure-to-start- 8450s 2024-11-23 22:40:36,642 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:40:36,644 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40873': TLS handshake failed with remote 'tls://127.0.0.1:48634': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:40:36,644 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40873': TLS handshake failed with remote 'tls://127.0.0.1:48642': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:40:36,648 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:40:37,655 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:40:37,662 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34433 8450s 2024-11-23 22:40:37,662 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41113/status 8450s 2024-11-23 22:40:37,663 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:40:37,679 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37541 8450s 2024-11-23 22:40:37,679 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37541 8450s 2024-11-23 22:40:37,679 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:40:37,679 - distributed.worker - INFO - dashboard at: 127.0.0.1:43481 8450s 2024-11-23 22:40:37,679 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34433 8450s 2024-11-23 22:40:37,679 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:40:37,679 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:40:37,679 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:40:37,679 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-wsv8j45z 8450s 2024-11-23 22:40:37,679 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:40:37,681 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46783 8450s 2024-11-23 22:40:37,682 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46783 8450s 2024-11-23 22:40:37,682 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:40:37,682 - distributed.worker - INFO - dashboard at: 127.0.0.1:45639 8450s 2024-11-23 22:40:37,682 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34433 8450s 2024-11-23 22:40:37,682 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:40:37,682 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:40:37,682 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:40:37,682 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-5ewclafc 8450s 2024-11-23 22:40:37,682 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:40:37,683 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37541. Reason: failure-to-start- 8450s 2024-11-23 22:40:37,683 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:40:37,683 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46783. Reason: failure-to-start- 8450s 2024-11-23 22:40:37,684 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:40:37,685 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34433': TLS handshake failed with remote 'tls://127.0.0.1:38256': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:40:37,685 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34433': TLS handshake failed with remote 'tls://127.0.0.1:38272': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:40:37,687 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:40:38,692 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:40:38,700 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35407 8450s 2024-11-23 22:40:38,701 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35455/status 8450s 2024-11-23 22:40:38,701 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:40:38,717 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42391 8450s 2024-11-23 22:40:38,717 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42391 8450s 2024-11-23 22:40:38,717 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:40:38,717 - distributed.worker - INFO - dashboard at: 127.0.0.1:35855 8450s 2024-11-23 22:40:38,717 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35407 8450s 2024-11-23 22:40:38,718 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:40:38,718 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:40:38,718 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:40:38,718 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-6_cqdqlh 8450s 2024-11-23 22:40:38,718 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:40:38,720 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36975 8450s 2024-11-23 22:40:38,720 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36975 8450s 2024-11-23 22:40:38,720 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:40:38,720 - distributed.worker - INFO - dashboard at: 127.0.0.1:36333 8450s 2024-11-23 22:40:38,720 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35407 8450s 2024-11-23 22:40:38,720 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:40:38,720 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:40:38,720 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:40:38,720 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-uklei8zi 8450s 2024-11-23 22:40:38,720 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:40:38,721 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42391. Reason: failure-to-start- 8450s 2024-11-23 22:40:38,722 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:40:38,722 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36975. Reason: failure-to-start- 8450s 2024-11-23 22:40:38,722 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:40:38,724 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35407': TLS handshake failed with remote 'tls://127.0.0.1:36054': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:40:38,724 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35407': TLS handshake failed with remote 'tls://127.0.0.1:36070': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:40:38,725 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:40:39,731 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:40:39,737 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38591 8450s 2024-11-23 22:40:39,737 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45339/status 8450s 2024-11-23 22:40:39,738 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:40:39,754 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43945 8450s 2024-11-23 22:40:39,755 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43945 8450s 2024-11-23 22:40:39,755 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:40:39,755 - distributed.worker - INFO - dashboard at: 127.0.0.1:40735 8450s 2024-11-23 22:40:39,755 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38591 8450s 2024-11-23 22:40:39,755 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:40:39,755 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:40:39,755 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:40:39,755 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-j5t4drk3 8450s 2024-11-23 22:40:39,755 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:40:39,757 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46489 8450s 2024-11-23 22:40:39,757 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46489 8450s 2024-11-23 22:40:39,757 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:40:39,757 - distributed.worker - INFO - dashboard at: 127.0.0.1:42581 8450s 2024-11-23 22:40:39,757 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38591 8450s 2024-11-23 22:40:39,757 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:40:39,757 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:40:39,758 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:40:39,758 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-rnos3yhe 8450s 2024-11-23 22:40:39,758 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:40:39,763 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43945. Reason: failure-to-start- 8450s 2024-11-23 22:40:39,763 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:40:39,764 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46489. Reason: failure-to-start- 8450s 2024-11-23 22:40:39,764 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:40:39,766 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38591': TLS handshake failed with remote 'tls://127.0.0.1:56350': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:40:39,766 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38591': TLS handshake failed with remote 'tls://127.0.0.1:56366': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:40:39,770 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:40:40,778 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:40:40,786 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45485 8450s 2024-11-23 22:40:40,786 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39901/status 8450s 2024-11-23 22:40:40,787 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:40:40,800 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45249 8450s 2024-11-23 22:40:40,800 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45249 8450s 2024-11-23 22:40:40,800 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:40:40,801 - distributed.worker - INFO - dashboard at: 127.0.0.1:34459 8450s 2024-11-23 22:40:40,801 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45485 8450s 2024-11-23 22:40:40,801 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:40:40,801 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:40:40,801 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:40:40,801 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ye85zjku 8450s 2024-11-23 22:40:40,802 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:40:40,804 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41751 8450s 2024-11-23 22:40:40,805 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41751 8450s 2024-11-23 22:40:40,805 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:40:40,805 - distributed.worker - INFO - dashboard at: 127.0.0.1:34819 8450s 2024-11-23 22:40:40,806 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45485 8450s 2024-11-23 22:40:40,806 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:40:40,806 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:40:40,806 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:40:40,806 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-pjri_h2q 8450s 2024-11-23 22:40:40,806 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:40:40,807 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45249. Reason: failure-to-start- 8450s 2024-11-23 22:40:40,807 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:40:40,809 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41751. Reason: failure-to-start- 8450s 2024-11-23 22:40:40,809 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:40:40,814 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45485': TLS handshake failed with remote 'tls://127.0.0.1:60258': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:40:40,814 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45485': TLS handshake failed with remote 'tls://127.0.0.1:60268': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:40:40,816 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s ______________________________ test_client_submit ______________________________ 8450s 8450s fut = , timeout = 0 8450s 8450s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 8450s async with asyncio.timeout(timeout): 8450s > return await fut 8450s 8450s /usr/lib/python3/dist-packages/distributed/utils.py:1960: 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s /usr/lib/python3/dist-packages/distributed/worker.py:1480: in start_unsafe 8450s await self._register_with_scheduler() 8450s /usr/lib/python3/dist-packages/distributed/worker.py:1179: in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s /usr/lib/python3/dist-packages/distributed/comm/core.py:342: in connect 8450s comm = await wait_for( 8450s /usr/lib/python3/dist-packages/distributed/utils.py:1960: in wait_for 8450s return await fut 8450s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:546: in connect 8450s stream = await self.client.connect( 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s 8450s self = , host = '127.0.0.1' 8450s port = 34989, af = 8450s ssl_options = 8450s max_buffer_size = 8364507136.0, source_ip = None, source_port = None 8450s timeout = None 8450s 8450s async def connect( 8450s self, 8450s host: str, 8450s port: int, 8450s af: socket.AddressFamily = socket.AF_UNSPEC, 8450s ssl_options: Optional[Union[Dict[str, Any], ssl.SSLContext]] = None, 8450s max_buffer_size: Optional[int] = None, 8450s source_ip: Optional[str] = None, 8450s source_port: Optional[int] = None, 8450s timeout: Optional[Union[float, datetime.timedelta]] = None, 8450s ) -> IOStream: 8450s """Connect to the given host and port. 8450s 8450s Asynchronously returns an `.IOStream` (or `.SSLIOStream` if 8450s ``ssl_options`` is not None). 8450s 8450s Using the ``source_ip`` kwarg, one can specify the source 8450s IP address to use when establishing the connection. 8450s In case the user needs to resolve and 8450s use a specific interface, it has to be handled outside 8450s of Tornado as this depends very much on the platform. 8450s 8450s Raises `TimeoutError` if the input future does not complete before 8450s ``timeout``, which may be specified in any form allowed by 8450s `.IOLoop.add_timeout` (i.e. a `datetime.timedelta` or an absolute time 8450s relative to `.IOLoop.time`) 8450s 8450s Similarly, when the user requires a certain source port, it can 8450s be specified using the ``source_port`` arg. 8450s 8450s .. versionchanged:: 4.5 8450s Added the ``source_ip`` and ``source_port`` arguments. 8450s 8450s .. versionchanged:: 5.0 8450s Added the ``timeout`` argument. 8450s """ 8450s if timeout is not None: 8450s if isinstance(timeout, numbers.Real): 8450s timeout = IOLoop.current().time() + timeout 8450s elif isinstance(timeout, datetime.timedelta): 8450s timeout = IOLoop.current().time() + timeout.total_seconds() 8450s else: 8450s raise TypeError("Unsupported timeout %r" % timeout) 8450s if timeout is not None: 8450s addrinfo = await gen.with_timeout( 8450s timeout, self.resolver.resolve(host, port, af) 8450s ) 8450s else: 8450s addrinfo = await self.resolver.resolve(host, port, af) 8450s connector = _Connector( 8450s addrinfo, 8450s functools.partial( 8450s self._create_stream, 8450s max_buffer_size, 8450s source_ip=source_ip, 8450s source_port=source_port, 8450s ), 8450s ) 8450s > af, addr, stream = await connector.start(connect_timeout=timeout) 8450s E asyncio.exceptions.CancelledError 8450s 8450s /usr/lib/python3/dist-packages/tornado/tcpclient.py:279: CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s self = 8450s 8450s @final 8450s async def start(self): 8450s async with self._startup_lock: 8450s if self.status == Status.failed: 8450s assert self.__startup_exc is not None 8450s raise self.__startup_exc 8450s elif self.status != Status.init: 8450s return self 8450s timeout = getattr(self, "death_timeout", None) 8450s 8450s async def _close_on_failure(exc: Exception) -> None: 8450s await self.close(reason=f"failure-to-start-{str(type(exc))}") 8450s self.status = Status.failed 8450s self.__startup_exc = exc 8450s 8450s try: 8450s > await wait_for(self.start_unsafe(), timeout=timeout) 8450s 8450s /usr/lib/python3/dist-packages/distributed/core.py:664: 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 8450s async with asyncio.timeout(timeout): 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s 8450s self = 8450s exc_type = 8450s exc_val = CancelledError(), exc_tb = 8450s 8450s async def __aexit__( 8450s self, 8450s exc_type: Optional[Type[BaseException]], 8450s exc_val: Optional[BaseException], 8450s exc_tb: Optional[TracebackType], 8450s ) -> Optional[bool]: 8450s assert self._state in (_State.ENTERED, _State.EXPIRING) 8450s 8450s if self._timeout_handler is not None: 8450s self._timeout_handler.cancel() 8450s self._timeout_handler = None 8450s 8450s if self._state is _State.EXPIRING: 8450s self._state = _State.EXPIRED 8450s 8450s if self._task.uncancel() <= self._cancelling and exc_type is not None: 8450s # Since there are no new cancel requests, we're 8450s # handling this. 8450s if issubclass(exc_type, exceptions.CancelledError): 8450s > raise TimeoutError from exc_val 8450s E TimeoutError 8450s 8450s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s @contextlib.asynccontextmanager 8450s async def _cluster_factory(): 8450s workers = [] 8450s s = None 8450s try: 8450s for _ in range(60): 8450s try: 8450s > s, ws = await start_cluster( 8450s nthreads, 8450s scheduler, 8450s security=security, 8450s Worker=Worker, 8450s scheduler_kwargs=scheduler_kwargs, 8450s worker_kwargs=merge( 8450s {"death_timeout": min(15, int(deadline.remaining))}, 8450s worker_kwargs, 8450s ), 8450s ) 8450s 8450s /usr/lib/python3/dist-packages/distributed/utils_test.py:966: 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s /usr/lib/python3/dist-packages/distributed/utils_test.py:789: in start_cluster 8450s await asyncio.gather(*workers) 8450s /usr/lib/python3.13/asyncio/tasks.py:737: in _wrap_awaitable 8450s return await awaitable 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s 8450s self = 8450s 8450s @final 8450s async def start(self): 8450s async with self._startup_lock: 8450s if self.status == Status.failed: 8450s assert self.__startup_exc is not None 8450s raise self.__startup_exc 8450s elif self.status != Status.init: 8450s return self 8450s timeout = getattr(self, "death_timeout", None) 8450s 8450s async def _close_on_failure(exc: Exception) -> None: 8450s await self.close(reason=f"failure-to-start-{str(type(exc))}") 8450s self.status = Status.failed 8450s self.__startup_exc = exc 8450s 8450s try: 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s except asyncio.TimeoutError as exc: 8450s await _close_on_failure(exc) 8450s > raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s E TimeoutError: Worker start timed out after 0s. 8450s 8450s /usr/lib/python3/dist-packages/distributed/core.py:667: TimeoutError 8450s 8450s During handling of the above exception, another exception occurred: 8450s 8450s fut = ._..test_func..async_fn at 0xe8325a20> 8450s timeout = 60 8450s 8450s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 8450s async with asyncio.timeout(timeout): 8450s > return await fut 8450s 8450s /usr/lib/python3/dist-packages/distributed/utils.py:1960: 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s /usr/lib/python3/dist-packages/distributed/utils_test.py:999: in async_fn 8450s _cluster_factory() as (s, workers), 8450s /usr/lib/python3.13/contextlib.py:214: in __aenter__ 8450s return await anext(self.gen) 8450s /usr/lib/python3/dist-packages/distributed/utils_test.py:983: in _cluster_factory 8450s await asyncio.sleep(1) 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s 8450s delay = 1, result = None 8450s 8450s async def sleep(delay, result=None): 8450s """Coroutine that completes after a given time (in seconds).""" 8450s if delay <= 0: 8450s await __sleep0() 8450s return result 8450s 8450s if math.isnan(delay): 8450s raise ValueError("Invalid delay: NaN (not a number)") 8450s 8450s loop = events.get_running_loop() 8450s future = loop.create_future() 8450s h = loop.call_later(delay, 8450s futures._set_result_unless_cancelled, 8450s future, result) 8450s try: 8450s > return await future 8450s E asyncio.exceptions.CancelledError 8450s 8450s /usr/lib/python3.13/asyncio/tasks.py:718: CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s args = (), kwds = {} 8450s 8450s @wraps(func) 8450s def inner(*args, **kwds): 8450s with self._recreate_cm(): 8450s > return func(*args, **kwds) 8450s 8450s /usr/lib/python3.13/contextlib.py:85: 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s /usr/lib/python3.13/contextlib.py:85: in inner 8450s return func(*args, **kwds) 8450s /usr/lib/python3/dist-packages/distributed/utils_test.py:1102: in test_func 8450s return _run_and_close_tornado(async_fn_outer) 8450s /usr/lib/python3/dist-packages/distributed/utils_test.py:378: in _run_and_close_tornado 8450s return asyncio_run(inner_fn(), loop_factory=get_loop_factory()) 8450s /usr/lib/python3.13/asyncio/runners.py:194: in run 8450s return runner.run(main) 8450s /usr/lib/python3.13/asyncio/runners.py:118: in run 8450s return self._loop.run_until_complete(task) 8450s /usr/lib/python3.13/asyncio/base_events.py:720: in run_until_complete 8450s return future.result() 8450s /usr/lib/python3/dist-packages/distributed/utils_test.py:375: in inner_fn 8450s return await async_fn(*args, **kwargs) 8450s /usr/lib/python3/dist-packages/distributed/utils_test.py:1099: in async_fn_outer 8450s return await utils_wait_for(async_fn(), timeout=timeout * 2) 8450s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 8450s async with asyncio.timeout(timeout): 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s 8450s self = 8450s exc_type = 8450s exc_val = CancelledError(), exc_tb = 8450s 8450s async def __aexit__( 8450s self, 8450s exc_type: Optional[Type[BaseException]], 8450s exc_val: Optional[BaseException], 8450s exc_tb: Optional[TracebackType], 8450s ) -> Optional[bool]: 8450s assert self._state in (_State.ENTERED, _State.EXPIRING) 8450s 8450s if self._timeout_handler is not None: 8450s self._timeout_handler.cancel() 8450s self._timeout_handler = None 8450s 8450s if self._state is _State.EXPIRING: 8450s self._state = _State.EXPIRED 8450s 8450s if self._task.uncancel() <= self._cancelling and exc_type is not None: 8450s # Since there are no new cancel requests, we're 8450s # handling this. 8450s if issubclass(exc_type, exceptions.CancelledError): 8450s > raise TimeoutError from exc_val 8450s E TimeoutError 8450s 8450s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 8450s ----------------------------- Captured stderr call ----------------------------- 8450s 2024-11-23 22:40:42,128 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:40:42,135 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:42,136 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39413/status 8450s 2024-11-23 22:40:42,136 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:40:42,149 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37797 8450s 2024-11-23 22:40:42,149 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37797 8450s 2024-11-23 22:40:42,149 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:40:42,149 - distributed.worker - INFO - dashboard at: 127.0.0.1:38695 8450s 2024-11-23 22:40:42,149 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:42,150 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:40:42,150 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:40:42,150 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:40:42,150 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-pzz8_fjr 8450s 2024-11-23 22:40:42,150 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:40:42,152 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35565 8450s 2024-11-23 22:40:42,152 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35565 8450s 2024-11-23 22:40:42,152 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:40:42,152 - distributed.worker - INFO - dashboard at: 127.0.0.1:35777 8450s 2024-11-23 22:40:42,152 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:42,152 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:40:42,152 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:40:42,152 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:40:42,152 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-efbtdihd 8450s 2024-11-23 22:40:42,152 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:40:42,165 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:42,165 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:42,165 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:35710': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:42,165 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:35718': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:42,277 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:42,277 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:42,277 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:35722': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:42,277 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:35726': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:42,390 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:42,390 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:42,391 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:35736': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:42,391 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:35748': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:42,503 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:42,504 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:42,504 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:35762': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:42,504 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:35766': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:42,616 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:42,616 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:42,616 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:35778': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:42,616 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:35782': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:42,728 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:42,728 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:42,729 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:35786': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:42,729 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:35790': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:42,841 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:42,841 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:42,842 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:35792': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:42,842 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:35798': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:42,953 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:42,954 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:42,954 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:35806': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:42,954 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:35816': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:43,065 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:43,066 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:43,066 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:35818': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:43,066 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:35826': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:43,177 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:43,178 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:43,178 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:35830': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:43,178 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:35842': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:43,290 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:43,291 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:43,291 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:35848': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:43,291 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:35854': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:43,403 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:43,403 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:43,403 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:35856': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:43,404 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:35872': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:43,515 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:43,515 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:43,516 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:35878': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:43,516 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:35882': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:43,628 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:43,628 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:43,629 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:35886': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:43,629 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:35902': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:43,741 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:43,741 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:43,741 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:35906': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:43,741 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:35912': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:43,854 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:43,854 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:43,854 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:35920': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:43,854 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:35928': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:43,966 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:43,967 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:43,967 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:35938': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:43,967 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:35940': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:44,078 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:44,079 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:44,079 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:35956': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:44,079 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:35964': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:44,192 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:44,193 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:44,193 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:35978': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:44,193 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:35990': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:44,305 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:44,306 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:44,306 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:35992': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:44,306 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:36008': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:44,419 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:44,419 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:44,419 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:36014': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:44,419 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:36030': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:44,532 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:44,532 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:44,533 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:36038': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:44,533 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:36048': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:44,645 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:44,645 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:44,649 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:36060': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:44,649 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:36076': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:44,757 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:44,757 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:44,758 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:36086': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:44,758 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:36094': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:44,870 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:44,870 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:44,870 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:36096': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:44,871 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:36102': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:44,982 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:44,982 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:44,983 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:36112': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:44,983 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:36122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:45,095 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:45,095 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:45,096 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:36128': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:45,096 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:36132': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:45,208 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:45,208 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:45,208 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:36144': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:45,208 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:36146': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:45,321 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:45,321 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:45,322 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:36162': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:45,322 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:36176': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:45,433 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:45,434 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:45,434 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:36188': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:45,434 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:36198': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:45,546 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:45,547 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:45,547 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:36210': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:45,547 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:36226': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:45,659 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:45,659 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:45,659 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:36230': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:45,659 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:36234': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:45,772 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:45,772 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:45,773 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:36238': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:45,773 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:36240': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:45,886 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:45,886 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:45,887 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:36252': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:45,887 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:36256': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:45,999 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:45,999 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:45,999 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:36268': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:46,000 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:36272': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:46,112 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:46,112 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:46,112 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:36276': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:46,112 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:36292': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:46,225 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:46,225 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:46,226 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:36298': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:46,226 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:36310': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:46,338 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:46,338 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:46,338 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:36314': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:46,338 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:36326': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:46,450 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:46,451 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:46,451 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:36328': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:46,451 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:36338': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:46,563 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:46,563 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:46,564 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:36340': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:46,564 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:36354': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:46,677 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:46,677 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:46,677 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:36366': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:46,677 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:36376': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:46,790 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:46,790 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:46,790 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:36378': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:46,790 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:36394': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:46,902 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:46,902 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:46,902 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:36406': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:46,903 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:36412': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:47,014 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:47,014 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:47,014 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:36416': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:47,015 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:36424': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:47,126 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:47,126 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:47,126 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:36440': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:47,127 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:36444': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:47,238 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:47,238 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:47,239 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:36458': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:47,239 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:36472': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:47,350 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:47,350 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:47,351 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:36474': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:47,351 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:36480': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:47,463 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:47,463 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:47,463 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:36484': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:47,463 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:36486': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:47,576 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:47,577 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:47,577 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:36490': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:47,577 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:36504': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:47,690 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:47,690 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:47,690 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:36512': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:47,691 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:36514': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:47,814 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:47,815 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:47,816 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:36524': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:47,816 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:36532': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:47,928 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:47,929 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:47,929 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:36544': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:47,929 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:36554': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:48,041 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:48,041 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:48,042 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:36558': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:48,042 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:36570': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:48,154 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:48,154 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:48,154 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:36576': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:48,154 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:36584': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:48,266 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:48,266 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:48,267 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:36590': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:48,267 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:36598': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:48,378 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:48,379 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:48,379 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:36604': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:48,379 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:36610': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:48,491 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:48,491 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:48,491 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:36622': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:48,491 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:36626': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:48,603 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:48,604 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:48,604 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:36638': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:48,604 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:36654': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:48,716 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:48,716 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:48,717 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:36660': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:48,717 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:36662': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:48,829 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:48,830 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:48,830 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:36666': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:48,830 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:36672': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:48,942 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:48,942 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:48,943 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:36676': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:48,943 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:36680': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:49,054 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:49,054 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:49,055 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:36692': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:49,055 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:36698': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:49,166 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:49,166 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:49,167 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:36700': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:49,167 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:36702': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:49,279 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:49,279 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:49,280 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:36712': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:49,280 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:36724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:49,393 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:49,393 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:49,394 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:36726': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:49,394 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:36736': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:49,506 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:49,506 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:49,506 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:36750': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:49,506 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:36766': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:49,620 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:49,620 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:49,621 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:36770': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:49,621 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:36786': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:49,733 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:49,733 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:49,733 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:36788': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:49,733 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:36800': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:49,846 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:49,846 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:49,846 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:36802': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:49,846 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:36816': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:49,960 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:49,960 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:49,960 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:36832': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:49,960 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:36838': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:50,072 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:50,073 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:50,073 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:36852': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:50,073 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:36868': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:50,185 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:50,185 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:50,186 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:36878': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:50,186 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:36886': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:50,298 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:50,298 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:50,299 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:36900': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:50,299 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:36902': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:50,410 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:50,411 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:50,411 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:36910': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:50,411 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:36924': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:50,524 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:50,524 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:50,524 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:36938': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:50,524 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:36940': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:50,637 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:50,637 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:50,638 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:36952': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:50,638 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:36958': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:50,749 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:50,750 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:50,750 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:36968': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:50,750 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:36984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:50,863 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:50,863 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:50,863 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:36988': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:50,863 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:36994': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:50,981 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:50,982 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:50,982 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:37010': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:50,982 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:37026': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:51,094 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:51,094 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:51,094 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:37042': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:51,094 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:37054': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:51,207 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:51,207 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:51,208 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:37070': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:51,208 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:37074': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:51,320 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:51,320 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:51,320 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:37090': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:51,320 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:37098': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:51,434 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:51,434 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:51,434 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:37100': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:51,434 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:37104': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:51,546 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:51,547 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:51,547 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:60738': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:51,547 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:60750': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:51,659 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:51,659 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:51,659 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:60766': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:51,659 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:60774': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:51,771 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:51,771 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:51,771 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:60776': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:51,771 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:60786': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:51,883 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:51,883 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:51,884 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:60790': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:51,884 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:60792': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:51,995 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:51,996 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:51,996 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:60806': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:51,996 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:60810': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:52,110 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:52,110 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:52,111 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:60820': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:52,111 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:60834': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:52,223 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:52,224 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:52,224 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:60844': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:52,224 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:60848': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:52,336 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:52,336 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:52,337 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:60858': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:52,337 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:60872': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:52,448 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:52,449 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:52,449 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:60878': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:52,449 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:60894': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:52,561 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:52,561 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:52,561 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:60908': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:52,562 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:60914': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:52,673 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:52,674 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:52,674 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:60926': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:52,674 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:60942': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:52,788 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:52,788 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:52,789 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:60956': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:52,789 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:60970': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:52,900 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:52,901 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:52,901 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:60976': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:52,901 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:60986': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:53,014 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:53,014 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:53,015 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:60998': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:53,015 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:32780': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:53,127 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:53,128 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:53,128 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:32796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:53,128 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:32800': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:53,240 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:53,240 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:53,241 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:32812': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:53,241 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:32828': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:53,352 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:53,352 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:53,353 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:32840': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:53,353 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:32846': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:53,464 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:53,465 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:53,465 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:32852': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:53,465 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:32854': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:53,578 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:53,578 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:53,578 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:32860': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:53,578 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:32866': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:53,690 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:53,691 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:53,691 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:32872': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:53,691 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:32878': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:53,803 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:53,803 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:53,803 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:32886': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:53,803 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:32894': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:53,915 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:53,916 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:53,916 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:32906': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:53,916 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:32914': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:54,027 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:54,028 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:54,028 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:32918': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:54,028 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:32924': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:54,141 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:54,141 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:54,145 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:32928': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:54,145 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:32940': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:54,253 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:54,254 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:54,254 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:32948': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:54,254 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:32964': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:54,365 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:54,366 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:54,366 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:32974': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:54,366 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:32980': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:54,478 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:54,478 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:54,479 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:32996': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:54,479 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:32998': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:54,590 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:54,590 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:54,591 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:33006': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:54,591 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:33016': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:54,703 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:54,703 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:54,703 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:33018': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:54,704 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:33034': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:54,818 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:54,818 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:54,818 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:33046': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:54,818 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:33050': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:54,931 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:54,932 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:54,932 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:33060': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:54,932 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:33062': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:55,044 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:55,045 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:55,045 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:33066': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:55,045 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:33076': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:55,156 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:55,157 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:55,157 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:33084': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:55,157 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:33090': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:55,269 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:55,270 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:55,270 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:33106': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:55,270 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:33114': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:55,382 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:55,382 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:55,382 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:33130': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:55,382 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:33144': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:55,494 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:55,494 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:55,494 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:33156': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:55,495 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:33172': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:55,607 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:55,607 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:55,608 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:33174': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:55,608 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:33182': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:55,720 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:55,720 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:55,720 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:33184': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:55,720 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:33198': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:55,833 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:55,833 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:55,833 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:33206': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:55,834 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:33210': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:55,945 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:55,945 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:55,946 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:33212': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:55,946 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:33228': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:56,057 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:56,057 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:56,058 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:33244': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:56,058 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:33258': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:56,169 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:56,170 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:56,170 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:33264': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:56,170 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:33270': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:56,282 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:56,282 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:56,282 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:33284': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:56,282 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:33288': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:56,394 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:56,394 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:56,394 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:33302': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:56,395 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:33318': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:56,505 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:56,506 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:56,506 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:33326': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:56,506 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:33334': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:56,614 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:56,619 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:33336': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:56,620 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:56,620 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:33340': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:56,721 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:56,722 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:33342': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:56,727 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:56,727 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:33348': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:56,828 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:56,829 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:33362': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:56,834 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:56,835 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:33374': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:56,936 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:56,937 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:33390': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:56,942 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:56,943 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:33394': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:57,044 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:57,044 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:33406': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:57,050 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45037 8450s 2024-11-23 22:40:57,050 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:33422': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:57,151 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37797. Reason: failure-to-start- 8450s 2024-11-23 22:40:57,151 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:40:57,153 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45037': TLS handshake failed with remote 'tls://127.0.0.1:33438': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:57,153 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35565. Reason: failure-to-start- 8450s 2024-11-23 22:40:57,153 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:40:57,157 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 15s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 8450s stream = await stream.start_tls( 8450s ^^^^^^^^^^^^^^^^^^^^^^^ 8450s False, ssl_options=ssl_options, server_hostname=host 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 15s. 8450s 2024-11-23 22:40:58,164 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:40:58,172 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41779 8450s 2024-11-23 22:40:58,173 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35185/status 8450s 2024-11-23 22:40:58,173 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:40:58,186 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41985 8450s 2024-11-23 22:40:58,186 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41985 8450s 2024-11-23 22:40:58,186 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:40:58,186 - distributed.worker - INFO - dashboard at: 127.0.0.1:37991 8450s 2024-11-23 22:40:58,187 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:40:58,187 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:40:58,187 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:40:58,187 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:40:58,187 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-lvdljdli 8450s 2024-11-23 22:40:58,187 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:40:58,189 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38089 8450s 2024-11-23 22:40:58,189 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38089 8450s 2024-11-23 22:40:58,189 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:40:58,189 - distributed.worker - INFO - dashboard at: 127.0.0.1:35855 8450s 2024-11-23 22:40:58,189 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:40:58,189 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:40:58,189 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:40:58,189 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:40:58,189 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-uta3cmhg 8450s 2024-11-23 22:40:58,189 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:40:58,202 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:40:58,202 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:40:58,203 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:49150': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:58,203 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:49156': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:58,314 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:40:58,315 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:40:58,315 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:49162': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:58,315 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:49178': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:58,426 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:40:58,427 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:40:58,427 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:49190': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:58,427 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:49202': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:58,539 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:40:58,540 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:40:58,540 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:49208': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:58,540 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:49214': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:58,647 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:40:58,651 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:49224': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:58,652 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:40:58,653 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:49230': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:58,755 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:40:58,755 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:49236': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:58,761 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:40:58,761 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:49238': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:58,863 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:40:58,863 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:49242': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:58,869 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:40:58,869 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:49258': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:58,970 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:40:58,971 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:49274': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:58,977 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:40:58,977 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:49282': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:59,077 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:40:59,078 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:49294': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:59,084 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:40:59,084 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:49302': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:59,185 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:40:59,185 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:49304': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:59,191 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:40:59,191 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:49308': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:59,291 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:40:59,292 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:49312': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:59,298 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:40:59,298 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:49314': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:59,398 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:40:59,399 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:49322': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:59,405 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:40:59,405 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:49332': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:59,506 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:40:59,506 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:49346': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:59,512 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:40:59,512 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:49352': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:59,614 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:40:59,614 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:49364': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:59,620 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:40:59,620 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:49380': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:59,721 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:40:59,721 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:49386': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:59,728 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:40:59,729 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:49392': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:59,828 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:40:59,828 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:49394': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:59,834 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:40:59,835 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:49398': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:59,937 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:40:59,937 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:49400': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:40:59,943 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:40:59,944 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:49412': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:00,044 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:00,044 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:49416': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:00,050 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:00,051 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:49418': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:00,151 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:00,152 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:49428': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:00,158 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:00,158 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:49444': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:00,258 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:00,259 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:49456': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:00,265 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:00,265 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:49458': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:00,365 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:00,366 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:49474': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:00,372 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:00,372 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:49476': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:00,473 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:00,474 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:49488': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:00,480 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:00,480 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:49504': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:00,581 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:00,582 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:49516': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:00,588 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:00,588 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:49532': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:00,688 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:00,689 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:49546': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:00,695 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:00,695 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:49554': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:00,796 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:00,797 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:49570': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:00,803 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:00,803 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:49574': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:00,904 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:00,905 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:49588': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:00,910 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:00,911 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:49594': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:01,012 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:01,012 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:49610': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:01,018 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:01,019 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:49618': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:01,119 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:01,119 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:49628': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:01,125 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:01,126 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:49638': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:01,226 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:01,227 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:49650': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:01,233 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:01,233 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:49656': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:01,333 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:01,334 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:49670': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:01,340 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:01,340 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:49684': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:01,442 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:01,442 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:49686': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:01,448 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:01,449 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:49698': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:01,549 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:01,550 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:51944': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:01,556 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:01,556 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:51954': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:01,658 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:01,659 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:51968': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:01,664 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:01,665 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:51980': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:01,765 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:01,766 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:51982': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:01,772 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:01,772 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:51994': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:01,873 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:01,873 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:51998': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:01,879 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:01,879 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:52004': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:01,980 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:01,981 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:52014': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:01,987 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:01,987 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:52024': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:02,087 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:02,088 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:52030': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:02,094 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:02,094 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:52046': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:02,195 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:02,195 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:52050': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:02,201 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:02,202 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:52056': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:02,303 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:02,304 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:52064': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:02,309 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:02,310 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:52068': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:02,410 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:02,410 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:52070': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:02,416 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:02,417 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:52086': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:02,517 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:02,518 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:52098': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:02,524 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:02,524 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:52106': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:02,625 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:02,625 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:52116': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:02,631 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:02,632 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:52128': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:02,732 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:02,733 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:52138': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:02,739 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:02,739 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:52144': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:02,841 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:02,842 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:52150': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:02,848 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:02,848 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:52160': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:02,948 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:02,949 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:52162': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:02,955 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:02,955 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:52178': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:03,056 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:03,056 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:52188': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:03,063 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:03,064 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:52194': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:03,163 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:03,164 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:52200': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:03,170 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:03,170 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:52210': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:03,270 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:03,271 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:52214': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:03,277 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:03,277 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:52220': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:03,378 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:03,379 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:52232': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:03,385 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:03,386 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:52246': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:03,486 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:03,486 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:52254': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:03,492 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:03,493 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:52256': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:03,593 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:03,593 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:52272': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:03,600 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:03,600 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:52288': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:03,702 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:03,703 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:52304': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:03,708 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:03,709 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:52312': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:03,809 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:03,810 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:52324': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:03,816 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:03,816 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:52326': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:03,917 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:03,918 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:52328': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:03,923 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:03,924 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:52344': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:04,024 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:04,025 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:52360': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:04,031 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:04,031 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:52374': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:04,131 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:04,132 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:52376': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:04,138 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:04,142 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:52388': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:04,239 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:04,239 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:52396': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:04,245 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:04,246 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:52408': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:04,346 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:04,346 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:52416': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:04,352 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:04,353 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:52430': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:04,453 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:04,454 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:52432': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:04,460 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:04,460 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:52438': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:04,560 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:04,561 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:52450': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:04,567 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:04,567 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:52454': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:04,668 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:04,668 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:52470': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:04,676 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:04,679 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:52474': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:04,776 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:04,776 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:52480': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:04,782 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:04,783 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:52490': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:04,883 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:04,883 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:52500': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:04,890 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:04,890 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:52508': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:04,991 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:04,992 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:52510': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:04,997 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:04,998 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:52522': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:05,099 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:05,100 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:52534': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:05,105 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:05,106 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:52538': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:05,207 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:05,208 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:52540': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:05,213 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:05,214 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:52542': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:05,314 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:05,314 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:52544': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:05,320 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:05,321 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:52550': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:05,421 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:05,422 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:52560': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:05,428 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:05,428 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:52564': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:05,529 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:05,529 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:52566': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:05,535 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:05,536 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:52582': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:05,636 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:05,636 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:52596': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:05,646 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:05,646 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:52602': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:05,744 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:05,744 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:52608': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:05,753 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:05,753 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:52614': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:05,851 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:05,851 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:52630': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:05,860 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:05,860 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:52636': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:05,959 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:05,960 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:52640': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:05,966 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:05,966 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:52652': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:06,067 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:06,068 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:52664': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:06,074 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:06,074 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:52672': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:06,175 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:06,180 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:52682': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:06,186 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:06,186 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:52690': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:06,283 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:06,283 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:52700': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:06,292 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:06,293 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:52706': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:06,393 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:06,393 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:52710': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:06,399 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:06,400 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:52724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:06,501 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:06,502 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:52738': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:06,508 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:06,508 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:52752': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:06,609 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:06,610 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:52758': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:06,615 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:06,616 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:52774': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:06,717 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:06,718 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:52784': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:06,723 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:06,724 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:52786': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:06,825 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:06,826 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:52796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:06,832 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:06,832 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:52810': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:06,932 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:06,933 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:52822': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:06,939 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:06,939 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:52830': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:07,054 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:07,055 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:52834': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:07,061 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:07,061 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:52840': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:07,161 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:07,162 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:52848': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:07,168 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:07,168 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:52862': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:07,269 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:07,270 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:52864': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:07,275 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:07,276 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:52868': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:07,394 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:07,398 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:52880': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:07,399 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:07,399 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:52884': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:07,501 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:07,502 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:52898': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:07,508 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:07,508 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:52910': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:07,608 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:07,609 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:52914': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:07,615 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:07,615 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:52924': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:07,715 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:07,716 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:52926': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:07,722 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:07,722 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:52938': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:07,823 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:07,823 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:52950': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:07,829 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:07,829 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:52956': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:07,930 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:07,930 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:52964': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:07,936 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:07,937 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:52970': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:08,037 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:08,037 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:52984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:08,045 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:08,045 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:52990': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:08,147 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:08,148 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:52992': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:08,154 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:08,154 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:52996': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:08,255 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:08,256 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:53006': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:08,262 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:08,262 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:53018': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:08,363 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:08,364 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:53034': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:08,370 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:08,370 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:53036': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:08,470 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:08,471 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:53044': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:08,477 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:08,477 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:53048': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:08,579 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:08,580 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:53050': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:08,586 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:08,586 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:53056': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:08,686 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:08,687 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:53058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:08,693 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:08,693 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:53060': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:08,795 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:08,796 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:53064': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:08,801 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:08,802 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:53066': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:08,903 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:08,904 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:53068': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:08,910 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:08,910 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:53084': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:09,010 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:09,011 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:53098': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:09,017 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:09,017 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:53106': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:09,118 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:09,119 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:53108': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:09,125 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:09,125 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:53120': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:09,226 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:09,226 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:53122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:09,232 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:09,233 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:53130': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:09,334 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:09,335 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:53134': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:09,341 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:09,342 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:53136': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:09,442 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:09,443 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:53152': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:09,449 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:09,449 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:53166': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:09,550 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:09,551 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:53180': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:09,557 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:09,557 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:53194': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:09,658 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:09,659 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:53196': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:09,665 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:09,666 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:53210': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:09,766 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:09,767 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:53226': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:09,772 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:09,773 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:53242': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:09,873 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:09,874 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:53248': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:09,880 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:09,880 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:53252': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:09,980 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:09,981 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:53264': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:09,987 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:09,987 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:53270': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:10,088 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:10,089 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:53276': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:10,094 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:10,095 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:53292': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:10,195 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:10,196 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:53298': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:10,202 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:10,202 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:53314': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:10,304 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:10,305 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:53316': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:10,310 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:10,311 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:53322': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:10,411 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:10,411 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:53326': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:10,417 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:10,418 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:53342': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:10,519 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:10,520 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:53352': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:10,525 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:10,526 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:53354': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:10,626 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:10,627 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:53356': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:10,633 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:10,633 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:53362': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:10,734 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:10,735 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:53366': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:10,741 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:10,742 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:53380': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:10,842 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:10,851 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:53390': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:10,859 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:10,861 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:53404': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:10,950 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:10,950 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:53414': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:10,968 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:10,968 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:53416': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:11,058 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:11,058 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:53428': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:11,075 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:11,076 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:53438': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:11,166 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:11,167 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:53450': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:11,183 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41779 8450s 2024-11-23 22:41:11,184 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41779': TLS handshake failed with remote 'tls://127.0.0.1:53464': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:11,185 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41985. Reason: failure-to-start- 8450s 2024-11-23 22:41:11,185 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:41:11,189 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 13s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 8450s stream = await stream.start_tls( 8450s ^^^^^^^^^^^^^^^^^^^^^^^ 8450s False, ssl_options=ssl_options, server_hostname=host 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 8450s self.socket.do_handshake() 8450s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 8450s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 8450s self._sslobj.do_handshake() 8450s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 8450s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 8450s raise FatalCommClosedError( 8450s ...<2 lines>... 8450s ) from err 8450s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 8450s 8450s During handling of the above exception, another exception occurred: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1218, in _register_with_scheduler 8450s await asyncio.sleep(0.1) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 718, in sleep 8450s return await future 8450s ^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 13s. 8450s 2024-11-23 22:41:11,194 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38089. Reason: failure-to-start- 8450s 2024-11-23 22:41:11,194 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:41:12,200 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:41:12,209 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37261 8450s 2024-11-23 22:41:12,209 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36731/status 8450s 2024-11-23 22:41:12,209 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:41:12,225 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35073 8450s 2024-11-23 22:41:12,225 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35073 8450s 2024-11-23 22:41:12,225 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:41:12,225 - distributed.worker - INFO - dashboard at: 127.0.0.1:33691 8450s 2024-11-23 22:41:12,225 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37261 8450s 2024-11-23 22:41:12,225 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:41:12,225 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:41:12,225 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:41:12,225 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-4hdtl5nk 8450s 2024-11-23 22:41:12,225 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:41:12,227 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34033 8450s 2024-11-23 22:41:12,227 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34033 8450s 2024-11-23 22:41:12,227 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:41:12,228 - distributed.worker - INFO - dashboard at: 127.0.0.1:36395 8450s 2024-11-23 22:41:12,228 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37261 8450s 2024-11-23 22:41:12,228 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:41:12,228 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:41:12,228 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:41:12,228 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-h3de1d4u 8450s 2024-11-23 22:41:12,228 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:41:12,230 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35073. Reason: failure-to-start- 8450s 2024-11-23 22:41:12,230 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:41:12,230 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34033. Reason: failure-to-start- 8450s 2024-11-23 22:41:12,230 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:41:12,232 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37261': TLS handshake failed with remote 'tls://127.0.0.1:36888': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:41:12,232 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37261': TLS handshake failed with remote 'tls://127.0.0.1:36904': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:41:12,233 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:41:13,238 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:41:13,246 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38825 8450s 2024-11-23 22:41:13,246 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41689/status 8450s 2024-11-23 22:41:13,246 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:41:13,264 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37715 8450s 2024-11-23 22:41:13,264 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37715 8450s 2024-11-23 22:41:13,264 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:41:13,265 - distributed.worker - INFO - dashboard at: 127.0.0.1:37087 8450s 2024-11-23 22:41:13,265 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38825 8450s 2024-11-23 22:41:13,265 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:41:13,265 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:41:13,265 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:41:13,265 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-5ztp5kev 8450s 2024-11-23 22:41:13,265 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:41:13,267 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36871 8450s 2024-11-23 22:41:13,267 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36871 8450s 2024-11-23 22:41:13,267 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:41:13,267 - distributed.worker - INFO - dashboard at: 127.0.0.1:35437 8450s 2024-11-23 22:41:13,267 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38825 8450s 2024-11-23 22:41:13,267 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:41:13,267 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:41:13,267 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:41:13,267 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-331g68vw 8450s 2024-11-23 22:41:13,267 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:41:13,268 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37715. Reason: failure-to-start- 8450s 2024-11-23 22:41:13,268 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:41:13,269 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36871. Reason: failure-to-start- 8450s 2024-11-23 22:41:13,269 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:41:13,270 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38825': TLS handshake failed with remote 'tls://127.0.0.1:49654': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:41:13,270 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38825': TLS handshake failed with remote 'tls://127.0.0.1:49656': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:41:13,272 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:41:14,276 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:41:14,284 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39347 8450s 2024-11-23 22:41:14,284 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46127/status 8450s 2024-11-23 22:41:14,284 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:41:14,298 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42829 8450s 2024-11-23 22:41:14,298 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42829 8450s 2024-11-23 22:41:14,298 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:41:14,299 - distributed.worker - INFO - dashboard at: 127.0.0.1:35027 8450s 2024-11-23 22:41:14,299 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39347 8450s 2024-11-23 22:41:14,299 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:41:14,299 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:41:14,299 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:41:14,299 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-4optgo7g 8450s 2024-11-23 22:41:14,299 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:41:14,301 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44193 8450s 2024-11-23 22:41:14,301 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44193 8450s 2024-11-23 22:41:14,301 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:41:14,301 - distributed.worker - INFO - dashboard at: 127.0.0.1:34437 8450s 2024-11-23 22:41:14,301 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39347 8450s 2024-11-23 22:41:14,301 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:41:14,301 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:41:14,301 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:41:14,301 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-y9vslx61 8450s 2024-11-23 22:41:14,301 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:41:14,303 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42829. Reason: failure-to-start- 8450s 2024-11-23 22:41:14,303 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:41:14,304 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44193. Reason: failure-to-start- 8450s 2024-11-23 22:41:14,304 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:41:14,305 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39347': TLS handshake failed with remote 'tls://127.0.0.1:37844': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:41:14,305 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39347': TLS handshake failed with remote 'tls://127.0.0.1:37852': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:41:14,307 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:41:15,312 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:41:15,319 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39467 8450s 2024-11-23 22:41:15,320 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41563/status 8450s 2024-11-23 22:41:15,320 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:41:15,334 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38531 8450s 2024-11-23 22:41:15,334 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38531 8450s 2024-11-23 22:41:15,334 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:41:15,334 - distributed.worker - INFO - dashboard at: 127.0.0.1:34113 8450s 2024-11-23 22:41:15,335 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39467 8450s 2024-11-23 22:41:15,335 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:41:15,335 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:41:15,335 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:41:15,335 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-015t4zjf 8450s 2024-11-23 22:41:15,335 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:41:15,337 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33625 8450s 2024-11-23 22:41:15,337 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33625 8450s 2024-11-23 22:41:15,337 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:41:15,337 - distributed.worker - INFO - dashboard at: 127.0.0.1:46293 8450s 2024-11-23 22:41:15,337 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39467 8450s 2024-11-23 22:41:15,337 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:41:15,337 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:41:15,337 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:41:15,337 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-tq3o5_wi 8450s 2024-11-23 22:41:15,338 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:41:15,338 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38531. Reason: failure-to-start- 8450s 2024-11-23 22:41:15,339 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:41:15,339 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33625. Reason: failure-to-start- 8450s 2024-11-23 22:41:15,339 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:41:15,340 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39467': TLS handshake failed with remote 'tls://127.0.0.1:52448': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:41:15,341 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39467': TLS handshake failed with remote 'tls://127.0.0.1:52450': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:41:15,342 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:41:16,348 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:41:16,356 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39685 8450s 2024-11-23 22:41:16,356 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34703/status 8450s 2024-11-23 22:41:16,357 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:41:16,370 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37097 8450s 2024-11-23 22:41:16,370 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37097 8450s 2024-11-23 22:41:16,371 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:41:16,371 - distributed.worker - INFO - dashboard at: 127.0.0.1:38267 8450s 2024-11-23 22:41:16,371 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39685 8450s 2024-11-23 22:41:16,371 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:41:16,371 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:41:16,371 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:41:16,371 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-sg9xavqt 8450s 2024-11-23 22:41:16,371 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:41:16,373 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33181 8450s 2024-11-23 22:41:16,373 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33181 8450s 2024-11-23 22:41:16,373 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:41:16,373 - distributed.worker - INFO - dashboard at: 127.0.0.1:45715 8450s 2024-11-23 22:41:16,373 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39685 8450s 2024-11-23 22:41:16,373 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:41:16,373 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:41:16,373 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:41:16,373 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-6m3kgv0m 8450s 2024-11-23 22:41:16,373 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:41:16,374 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37097. Reason: failure-to-start- 8450s 2024-11-23 22:41:16,375 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:41:16,375 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33181. Reason: failure-to-start- 8450s 2024-11-23 22:41:16,375 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:41:16,376 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39685': TLS handshake failed with remote 'tls://127.0.0.1:36700': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:41:16,377 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39685': TLS handshake failed with remote 'tls://127.0.0.1:36712': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:41:16,378 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:41:17,384 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:41:17,391 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36701 8450s 2024-11-23 22:41:17,391 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43239/status 8450s 2024-11-23 22:41:17,392 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:41:17,407 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37569 8450s 2024-11-23 22:41:17,408 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37569 8450s 2024-11-23 22:41:17,408 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:41:17,408 - distributed.worker - INFO - dashboard at: 127.0.0.1:36541 8450s 2024-11-23 22:41:17,408 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36701 8450s 2024-11-23 22:41:17,408 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:41:17,408 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:41:17,408 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:41:17,408 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-60ig3hai 8450s 2024-11-23 22:41:17,408 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:41:17,410 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36869 8450s 2024-11-23 22:41:17,410 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36869 8450s 2024-11-23 22:41:17,410 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:41:17,410 - distributed.worker - INFO - dashboard at: 127.0.0.1:42937 8450s 2024-11-23 22:41:17,410 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36701 8450s 2024-11-23 22:41:17,410 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:41:17,411 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:41:17,411 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:41:17,411 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-pdhwndf6 8450s 2024-11-23 22:41:17,411 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:41:17,412 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37569. Reason: failure-to-start- 8450s 2024-11-23 22:41:17,412 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:41:17,412 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36869. Reason: failure-to-start- 8450s 2024-11-23 22:41:17,412 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:41:17,414 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36701': TLS handshake failed with remote 'tls://127.0.0.1:49696': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:41:17,414 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36701': TLS handshake failed with remote 'tls://127.0.0.1:49700': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:41:17,415 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:41:18,420 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:41:18,428 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38353 8450s 2024-11-23 22:41:18,429 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33543/status 8450s 2024-11-23 22:41:18,429 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:41:18,444 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45187 8450s 2024-11-23 22:41:18,444 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45187 8450s 2024-11-23 22:41:18,444 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:41:18,444 - distributed.worker - INFO - dashboard at: 127.0.0.1:41323 8450s 2024-11-23 22:41:18,444 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38353 8450s 2024-11-23 22:41:18,444 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:41:18,444 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:41:18,444 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:41:18,444 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ffbm9mdh 8450s 2024-11-23 22:41:18,444 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:41:18,446 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38969 8450s 2024-11-23 22:41:18,447 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38969 8450s 2024-11-23 22:41:18,447 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:41:18,447 - distributed.worker - INFO - dashboard at: 127.0.0.1:41479 8450s 2024-11-23 22:41:18,447 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38353 8450s 2024-11-23 22:41:18,447 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:41:18,447 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:41:18,447 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:41:18,447 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-pyql14ke 8450s 2024-11-23 22:41:18,447 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:41:18,449 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45187. Reason: failure-to-start- 8450s 2024-11-23 22:41:18,449 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:41:18,450 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38969. Reason: failure-to-start- 8450s 2024-11-23 22:41:18,450 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:41:18,451 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38353': TLS handshake failed with remote 'tls://127.0.0.1:37582': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:41:18,451 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38353': TLS handshake failed with remote 'tls://127.0.0.1:37594': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:41:18,453 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:41:19,463 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:41:19,475 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44473 8450s 2024-11-23 22:41:19,475 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34899/status 8450s 2024-11-23 22:41:19,475 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:41:19,491 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42921 8450s 2024-11-23 22:41:19,491 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42921 8450s 2024-11-23 22:41:19,492 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:41:19,492 - distributed.worker - INFO - dashboard at: 127.0.0.1:33877 8450s 2024-11-23 22:41:19,492 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44473 8450s 2024-11-23 22:41:19,492 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:41:19,492 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:41:19,492 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:41:19,492 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-zrpk_u6j 8450s 2024-11-23 22:41:19,492 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:41:19,494 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36747 8450s 2024-11-23 22:41:19,494 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36747 8450s 2024-11-23 22:41:19,494 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:41:19,494 - distributed.worker - INFO - dashboard at: 127.0.0.1:41249 8450s 2024-11-23 22:41:19,494 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44473 8450s 2024-11-23 22:41:19,494 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:41:19,494 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:41:19,494 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:41:19,494 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-f8wdnh3l 8450s 2024-11-23 22:41:19,495 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:41:19,496 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42921. Reason: failure-to-start- 8450s 2024-11-23 22:41:19,496 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:41:19,496 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36747. Reason: failure-to-start- 8450s 2024-11-23 22:41:19,496 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:41:19,498 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44473': TLS handshake failed with remote 'tls://127.0.0.1:60608': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:41:19,498 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44473': TLS handshake failed with remote 'tls://127.0.0.1:60612': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:41:19,499 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:41:20,505 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:41:20,513 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44403 8450s 2024-11-23 22:41:20,513 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43895/status 8450s 2024-11-23 22:41:20,514 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:41:20,527 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34425 8450s 2024-11-23 22:41:20,528 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34425 8450s 2024-11-23 22:41:20,528 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:41:20,528 - distributed.worker - INFO - dashboard at: 127.0.0.1:44057 8450s 2024-11-23 22:41:20,528 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44403 8450s 2024-11-23 22:41:20,528 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:41:20,528 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:41:20,528 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:41:20,528 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-uu7frgbe 8450s 2024-11-23 22:41:20,528 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:41:20,531 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37473 8450s 2024-11-23 22:41:20,531 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37473 8450s 2024-11-23 22:41:20,531 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:41:20,531 - distributed.worker - INFO - dashboard at: 127.0.0.1:33993 8450s 2024-11-23 22:41:20,531 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44403 8450s 2024-11-23 22:41:20,531 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:41:20,531 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:41:20,531 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:41:20,531 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-1c59qeed 8450s 2024-11-23 22:41:20,531 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:41:20,532 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34425. Reason: failure-to-start- 8450s 2024-11-23 22:41:20,533 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:41:20,533 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37473. Reason: failure-to-start- 8450s 2024-11-23 22:41:20,533 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:41:20,534 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44403': TLS handshake failed with remote 'tls://127.0.0.1:57782': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:41:20,535 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44403': TLS handshake failed with remote 'tls://127.0.0.1:57788': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:41:20,536 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:41:21,544 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:41:21,552 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42593 8450s 2024-11-23 22:41:21,552 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40875/status 8450s 2024-11-23 22:41:21,553 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:41:21,568 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37691 8450s 2024-11-23 22:41:21,569 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37691 8450s 2024-11-23 22:41:21,569 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:41:21,569 - distributed.worker - INFO - dashboard at: 127.0.0.1:46317 8450s 2024-11-23 22:41:21,569 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42593 8450s 2024-11-23 22:41:21,569 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:41:21,569 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:41:21,569 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:41:21,569 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-g2wy6nhh 8450s 2024-11-23 22:41:21,569 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:41:21,571 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37037 8450s 2024-11-23 22:41:21,571 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37037 8450s 2024-11-23 22:41:21,571 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:41:21,571 - distributed.worker - INFO - dashboard at: 127.0.0.1:34293 8450s 2024-11-23 22:41:21,571 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42593 8450s 2024-11-23 22:41:21,572 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:41:21,572 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:41:21,572 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:41:21,572 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-u98d4aif 8450s 2024-11-23 22:41:21,572 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:41:21,573 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37691. Reason: failure-to-start- 8450s 2024-11-23 22:41:21,573 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:41:21,573 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37037. Reason: failure-to-start- 8450s 2024-11-23 22:41:21,573 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:41:21,575 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42593': TLS handshake failed with remote 'tls://127.0.0.1:59434': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:41:21,575 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42593': TLS handshake failed with remote 'tls://127.0.0.1:59444': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:41:21,577 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:41:22,582 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:41:22,590 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40151 8450s 2024-11-23 22:41:22,590 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44333/status 8450s 2024-11-23 22:41:22,590 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:41:22,604 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34053 8450s 2024-11-23 22:41:22,604 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34053 8450s 2024-11-23 22:41:22,604 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:41:22,604 - distributed.worker - INFO - dashboard at: 127.0.0.1:40147 8450s 2024-11-23 22:41:22,604 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40151 8450s 2024-11-23 22:41:22,605 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:41:22,605 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:41:22,605 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:41:22,605 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-5z2ovti2 8450s 2024-11-23 22:41:22,605 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:41:22,607 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34561 8450s 2024-11-23 22:41:22,607 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34561 8450s 2024-11-23 22:41:22,607 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:41:22,607 - distributed.worker - INFO - dashboard at: 127.0.0.1:44601 8450s 2024-11-23 22:41:22,607 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40151 8450s 2024-11-23 22:41:22,607 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:41:22,607 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:41:22,607 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:41:22,607 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-_u4q0rjm 8450s 2024-11-23 22:41:22,607 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:41:22,609 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34053. Reason: failure-to-start- 8450s 2024-11-23 22:41:22,609 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:41:22,610 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34561. Reason: failure-to-start- 8450s 2024-11-23 22:41:22,610 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:41:22,612 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40151': TLS handshake failed with remote 'tls://127.0.0.1:52760': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:41:22,612 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40151': TLS handshake failed with remote 'tls://127.0.0.1:52768': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:41:22,613 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:41:23,620 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:41:23,633 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36497 8450s 2024-11-23 22:41:23,634 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44489/status 8450s 2024-11-23 22:41:23,634 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:41:23,659 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34973 8450s 2024-11-23 22:41:23,659 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34973 8450s 2024-11-23 22:41:23,659 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:41:23,659 - distributed.worker - INFO - dashboard at: 127.0.0.1:46203 8450s 2024-11-23 22:41:23,660 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36497 8450s 2024-11-23 22:41:23,660 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:41:23,660 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:41:23,660 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:41:23,660 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-3n76f853 8450s 2024-11-23 22:41:23,660 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:41:23,664 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44955 8450s 2024-11-23 22:41:23,664 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44955 8450s 2024-11-23 22:41:23,664 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:41:23,664 - distributed.worker - INFO - dashboard at: 127.0.0.1:37845 8450s 2024-11-23 22:41:23,664 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36497 8450s 2024-11-23 22:41:23,665 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:41:23,665 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:41:23,665 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:41:23,665 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-k0tjfutq 8450s 2024-11-23 22:41:23,665 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:41:23,671 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34973. Reason: failure-to-start- 8450s 2024-11-23 22:41:23,672 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:41:23,673 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44955. Reason: failure-to-start- 8450s 2024-11-23 22:41:23,673 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:41:23,675 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36497': TLS handshake failed with remote 'tls://127.0.0.1:44996': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:41:23,675 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36497': TLS handshake failed with remote 'tls://127.0.0.1:45008': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:41:23,682 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:41:24,689 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:41:24,704 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38195 8450s 2024-11-23 22:41:24,704 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38981/status 8450s 2024-11-23 22:41:24,705 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:41:24,728 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37543 8450s 2024-11-23 22:41:24,729 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37543 8450s 2024-11-23 22:41:24,729 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:41:24,729 - distributed.worker - INFO - dashboard at: 127.0.0.1:42735 8450s 2024-11-23 22:41:24,729 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38195 8450s 2024-11-23 22:41:24,729 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:41:24,729 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:41:24,729 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:41:24,729 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-wbtp_j8o 8450s 2024-11-23 22:41:24,729 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:41:24,733 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46049 8450s 2024-11-23 22:41:24,734 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46049 8450s 2024-11-23 22:41:24,734 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:41:24,734 - distributed.worker - INFO - dashboard at: 127.0.0.1:45335 8450s 2024-11-23 22:41:24,734 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38195 8450s 2024-11-23 22:41:24,734 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:41:24,734 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:41:24,734 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:41:24,734 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-d5a3p7js 8450s 2024-11-23 22:41:24,734 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:41:24,740 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37543. Reason: failure-to-start- 8450s 2024-11-23 22:41:24,741 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:41:24,741 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46049. Reason: failure-to-start- 8450s 2024-11-23 22:41:24,742 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:41:24,744 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38195': TLS handshake failed with remote 'tls://127.0.0.1:50108': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:41:24,744 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38195': TLS handshake failed with remote 'tls://127.0.0.1:50112': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:41:24,747 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:41:25,755 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:41:25,767 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44745 8450s 2024-11-23 22:41:25,767 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33969/status 8450s 2024-11-23 22:41:25,768 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:41:25,795 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:32771 8450s 2024-11-23 22:41:25,796 - distributed.worker - INFO - Listening to: tls://127.0.0.1:32771 8450s 2024-11-23 22:41:25,796 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:41:25,796 - distributed.worker - INFO - dashboard at: 127.0.0.1:40153 8450s 2024-11-23 22:41:25,796 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44745 8450s 2024-11-23 22:41:25,796 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:41:25,796 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:41:25,796 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:41:25,796 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-nm8tx51g 8450s 2024-11-23 22:41:25,796 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:41:25,800 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43495 8450s 2024-11-23 22:41:25,800 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43495 8450s 2024-11-23 22:41:25,801 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:41:25,801 - distributed.worker - INFO - dashboard at: 127.0.0.1:42905 8450s 2024-11-23 22:41:25,801 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44745 8450s 2024-11-23 22:41:25,801 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:41:25,801 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:41:25,801 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:41:25,801 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-4s69kz33 8450s 2024-11-23 22:41:25,801 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:41:25,808 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:32771. Reason: failure-to-start- 8450s 2024-11-23 22:41:25,809 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:41:25,810 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43495. Reason: failure-to-start- 8450s 2024-11-23 22:41:25,810 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:41:25,812 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44745': TLS handshake failed with remote 'tls://127.0.0.1:42162': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:41:25,813 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44745': TLS handshake failed with remote 'tls://127.0.0.1:42164': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:41:25,815 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:41:26,823 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:41:26,835 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44881 8450s 2024-11-23 22:41:26,835 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42129/status 8450s 2024-11-23 22:41:26,836 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:41:26,863 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45733 8450s 2024-11-23 22:41:26,864 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45733 8450s 2024-11-23 22:41:26,864 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:41:26,864 - distributed.worker - INFO - dashboard at: 127.0.0.1:34519 8450s 2024-11-23 22:41:26,864 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44881 8450s 2024-11-23 22:41:26,864 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:41:26,864 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:41:26,864 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:41:26,864 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-8ggbkdo0 8450s 2024-11-23 22:41:26,864 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:41:26,870 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42311 8450s 2024-11-23 22:41:26,871 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42311 8450s 2024-11-23 22:41:26,871 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:41:26,871 - distributed.worker - INFO - dashboard at: 127.0.0.1:33479 8450s 2024-11-23 22:41:26,871 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44881 8450s 2024-11-23 22:41:26,871 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:41:26,871 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:41:26,871 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:41:26,871 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-jsmj8x48 8450s 2024-11-23 22:41:26,871 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:41:26,877 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45733. Reason: failure-to-start- 8450s 2024-11-23 22:41:26,877 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:41:26,878 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42311. Reason: failure-to-start- 8450s 2024-11-23 22:41:26,879 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:41:26,881 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44881': TLS handshake failed with remote 'tls://127.0.0.1:48102': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:41:26,881 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44881': TLS handshake failed with remote 'tls://127.0.0.1:48118': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:41:26,884 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:41:27,893 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:41:27,907 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34663 8450s 2024-11-23 22:41:27,907 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44087/status 8450s 2024-11-23 22:41:27,908 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:41:27,935 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34979 8450s 2024-11-23 22:41:27,935 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34979 8450s 2024-11-23 22:41:27,935 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:41:27,935 - distributed.worker - INFO - dashboard at: 127.0.0.1:36295 8450s 2024-11-23 22:41:27,936 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34663 8450s 2024-11-23 22:41:27,936 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:41:27,936 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:41:27,936 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:41:27,936 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-r6my3a55 8450s 2024-11-23 22:41:27,936 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:41:27,940 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41909 8450s 2024-11-23 22:41:27,941 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41909 8450s 2024-11-23 22:41:27,941 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:41:27,941 - distributed.worker - INFO - dashboard at: 127.0.0.1:36009 8450s 2024-11-23 22:41:27,941 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34663 8450s 2024-11-23 22:41:27,941 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:41:27,941 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:41:27,941 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:41:27,941 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-fh9ij4dl 8450s 2024-11-23 22:41:27,941 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:41:27,949 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34979. Reason: failure-to-start- 8450s 2024-11-23 22:41:27,950 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:41:27,951 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41909. Reason: failure-to-start- 8450s 2024-11-23 22:41:27,951 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:41:27,953 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34663': TLS handshake failed with remote 'tls://127.0.0.1:55808': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:41:27,954 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34663': TLS handshake failed with remote 'tls://127.0.0.1:55814': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:41:27,956 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:41:28,965 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:41:28,976 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42975 8450s 2024-11-23 22:41:28,977 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33759/status 8450s 2024-11-23 22:41:28,977 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:41:29,001 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35721 8450s 2024-11-23 22:41:29,001 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35721 8450s 2024-11-23 22:41:29,001 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:41:29,001 - distributed.worker - INFO - dashboard at: 127.0.0.1:35063 8450s 2024-11-23 22:41:29,001 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42975 8450s 2024-11-23 22:41:29,001 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:41:29,001 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:41:29,001 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:41:29,001 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-n7xwanna 8450s 2024-11-23 22:41:29,001 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:41:29,003 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33145 8450s 2024-11-23 22:41:29,004 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33145 8450s 2024-11-23 22:41:29,004 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:41:29,004 - distributed.worker - INFO - dashboard at: 127.0.0.1:40803 8450s 2024-11-23 22:41:29,004 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42975 8450s 2024-11-23 22:41:29,004 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:41:29,004 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:41:29,004 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:41:29,004 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-z_8ixxto 8450s 2024-11-23 22:41:29,004 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:41:29,005 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35721. Reason: failure-to-start- 8450s 2024-11-23 22:41:29,005 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:41:29,006 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33145. Reason: failure-to-start- 8450s 2024-11-23 22:41:29,006 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:41:29,007 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42975': TLS handshake failed with remote 'tls://127.0.0.1:35844': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:41:29,007 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42975': TLS handshake failed with remote 'tls://127.0.0.1:35854': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:41:29,008 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:41:30,016 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:41:30,057 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43097 8450s 2024-11-23 22:41:30,057 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42199/status 8450s 2024-11-23 22:41:30,058 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:41:30,091 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39201 8450s 2024-11-23 22:41:30,091 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39201 8450s 2024-11-23 22:41:30,092 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:41:30,092 - distributed.worker - INFO - dashboard at: 127.0.0.1:44261 8450s 2024-11-23 22:41:30,092 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43097 8450s 2024-11-23 22:41:30,092 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:41:30,092 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:41:30,092 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:41:30,092 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-jsfsztuf 8450s 2024-11-23 22:41:30,092 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:41:30,096 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40209 8450s 2024-11-23 22:41:30,097 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40209 8450s 2024-11-23 22:41:30,097 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:41:30,097 - distributed.worker - INFO - dashboard at: 127.0.0.1:33913 8450s 2024-11-23 22:41:30,097 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43097 8450s 2024-11-23 22:41:30,097 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:41:30,097 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:41:30,097 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:41:30,097 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-mcoy25n3 8450s 2024-11-23 22:41:30,097 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:41:30,100 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39201. Reason: failure-to-start- 8450s 2024-11-23 22:41:30,100 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:41:30,101 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40209. Reason: failure-to-start- 8450s 2024-11-23 22:41:30,101 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:41:30,108 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43097': TLS handshake failed with remote 'tls://127.0.0.1:35978': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:41:30,109 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43097': TLS handshake failed with remote 'tls://127.0.0.1:35980': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:41:30,112 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:41:31,124 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:41:31,138 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41507 8450s 2024-11-23 22:41:31,139 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41525/status 8450s 2024-11-23 22:41:31,140 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:41:31,741 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44899 8450s 2024-11-23 22:41:31,741 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44899 8450s 2024-11-23 22:41:31,741 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:41:31,741 - distributed.worker - INFO - dashboard at: 127.0.0.1:34773 8450s 2024-11-23 22:41:31,741 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 8450s 2024-11-23 22:41:31,741 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:41:31,741 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:41:31,741 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:41:31,741 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-t5oeajo4 8450s 2024-11-23 22:41:31,741 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:41:31,746 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36147 8450s 2024-11-23 22:41:31,746 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36147 8450s 2024-11-23 22:41:31,746 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:41:31,746 - distributed.worker - INFO - dashboard at: 127.0.0.1:36521 8450s 2024-11-23 22:41:31,746 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41507 8450s 2024-11-23 22:41:31,746 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:41:31,746 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:41:31,746 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:41:31,746 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-bsbfofxb 8450s 2024-11-23 22:41:31,746 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:41:31,809 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44899. Reason: failure-to-start- 8450s 2024-11-23 22:41:31,810 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:41:31,810 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36147. Reason: failure-to-start- 8450s 2024-11-23 22:41:31,811 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:41:31,814 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:35334': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:41:31,814 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41507': TLS handshake failed with remote 'tls://127.0.0.1:35336': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:41:31,827 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:41:32,834 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:41:32,840 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44983 8450s 2024-11-23 22:41:32,840 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41607/status 8450s 2024-11-23 22:41:32,841 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:41:32,856 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41533 8450s 2024-11-23 22:41:32,856 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41533 8450s 2024-11-23 22:41:32,856 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:41:32,857 - distributed.worker - INFO - dashboard at: 127.0.0.1:37469 8450s 2024-11-23 22:41:32,857 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44983 8450s 2024-11-23 22:41:32,857 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:41:32,857 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:41:32,857 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:41:32,857 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-841xru5i 8450s 2024-11-23 22:41:32,857 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:41:32,858 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45447 8450s 2024-11-23 22:41:32,859 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45447 8450s 2024-11-23 22:41:32,859 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:41:32,859 - distributed.worker - INFO - dashboard at: 127.0.0.1:38279 8450s 2024-11-23 22:41:32,859 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44983 8450s 2024-11-23 22:41:32,859 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:41:32,859 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:41:32,859 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:41:32,859 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-4_cu_3e8 8450s 2024-11-23 22:41:32,859 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:41:32,860 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41533. Reason: failure-to-start- 8450s 2024-11-23 22:41:32,860 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:41:32,860 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45447. Reason: failure-to-start- 8450s 2024-11-23 22:41:32,861 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:41:32,863 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44983': TLS handshake failed with remote 'tls://127.0.0.1:58984': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:41:32,864 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44983': TLS handshake failed with remote 'tls://127.0.0.1:58986': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:41:32,865 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:41:33,872 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:41:33,880 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44249 8450s 2024-11-23 22:41:33,881 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43465/status 8450s 2024-11-23 22:41:33,881 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:41:33,894 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38175 8450s 2024-11-23 22:41:33,894 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38175 8450s 2024-11-23 22:41:33,894 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:41:33,894 - distributed.worker - INFO - dashboard at: 127.0.0.1:44241 8450s 2024-11-23 22:41:33,894 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44249 8450s 2024-11-23 22:41:33,894 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:41:33,894 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:41:33,894 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:41:33,894 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ygsrvtnx 8450s 2024-11-23 22:41:33,894 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:41:33,896 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35635 8450s 2024-11-23 22:41:33,896 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35635 8450s 2024-11-23 22:41:33,896 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:41:33,896 - distributed.worker - INFO - dashboard at: 127.0.0.1:36127 8450s 2024-11-23 22:41:33,896 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44249 8450s 2024-11-23 22:41:33,896 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:41:33,896 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:41:33,896 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:41:33,896 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ogaiemxv 8450s 2024-11-23 22:41:33,896 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:41:33,898 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38175. Reason: failure-to-start- 8450s 2024-11-23 22:41:33,898 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:41:33,898 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35635. Reason: failure-to-start- 8450s 2024-11-23 22:41:33,898 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:41:33,901 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44249': TLS handshake failed with remote 'tls://127.0.0.1:41076': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:41:33,901 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44249': TLS handshake failed with remote 'tls://127.0.0.1:41084': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:41:33,903 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:41:34,911 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:41:34,919 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44459 8450s 2024-11-23 22:41:34,919 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:32817/status 8450s 2024-11-23 22:41:34,920 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:41:34,938 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41703 8450s 2024-11-23 22:41:34,938 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41703 8450s 2024-11-23 22:41:34,938 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:41:34,938 - distributed.worker - INFO - dashboard at: 127.0.0.1:38823 8450s 2024-11-23 22:41:34,938 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44459 8450s 2024-11-23 22:41:34,938 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:41:34,938 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:41:34,938 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:41:34,938 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-f4_c_jz2 8450s 2024-11-23 22:41:34,938 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:41:34,940 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44495 8450s 2024-11-23 22:41:34,940 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44495 8450s 2024-11-23 22:41:34,940 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:41:34,940 - distributed.worker - INFO - dashboard at: 127.0.0.1:33651 8450s 2024-11-23 22:41:34,940 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44459 8450s 2024-11-23 22:41:34,940 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:41:34,940 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:41:34,940 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:41:34,940 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-pik79ecl 8450s 2024-11-23 22:41:34,940 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:41:34,944 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41703. Reason: failure-to-start- 8450s 2024-11-23 22:41:34,944 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:41:34,944 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44495. Reason: failure-to-start- 8450s 2024-11-23 22:41:34,944 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:41:34,946 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44459': TLS handshake failed with remote 'tls://127.0.0.1:34444': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:41:34,946 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44459': TLS handshake failed with remote 'tls://127.0.0.1:34460': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:41:34,947 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:41:35,953 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:41:35,960 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36615 8450s 2024-11-23 22:41:35,961 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34897/status 8450s 2024-11-23 22:41:35,961 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:41:35,976 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:32861 8450s 2024-11-23 22:41:35,976 - distributed.worker - INFO - Listening to: tls://127.0.0.1:32861 8450s 2024-11-23 22:41:35,976 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:41:35,976 - distributed.worker - INFO - dashboard at: 127.0.0.1:36193 8450s 2024-11-23 22:41:35,976 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36615 8450s 2024-11-23 22:41:35,976 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:41:35,976 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:41:35,976 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:41:35,976 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-r_h9c1qn 8450s 2024-11-23 22:41:35,976 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:41:35,978 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39215 8450s 2024-11-23 22:41:35,978 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39215 8450s 2024-11-23 22:41:35,978 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:41:35,978 - distributed.worker - INFO - dashboard at: 127.0.0.1:42973 8450s 2024-11-23 22:41:35,978 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36615 8450s 2024-11-23 22:41:35,978 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:41:35,978 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:41:35,978 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:41:35,978 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-xfykk23h 8450s 2024-11-23 22:41:35,978 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:41:35,981 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:32861. Reason: failure-to-start- 8450s 2024-11-23 22:41:35,981 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:41:35,981 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39215. Reason: failure-to-start- 8450s 2024-11-23 22:41:35,981 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:41:35,985 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36615': TLS handshake failed with remote 'tls://127.0.0.1:38598': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:41:35,985 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36615': TLS handshake failed with remote 'tls://127.0.0.1:38600': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:41:35,989 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:41:36,994 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:41:37,000 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35161 8450s 2024-11-23 22:41:37,000 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42097/status 8450s 2024-11-23 22:41:37,000 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:41:37,014 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34521 8450s 2024-11-23 22:41:37,014 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34521 8450s 2024-11-23 22:41:37,014 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:41:37,014 - distributed.worker - INFO - dashboard at: 127.0.0.1:45187 8450s 2024-11-23 22:41:37,014 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35161 8450s 2024-11-23 22:41:37,014 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:41:37,014 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:41:37,015 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:41:37,015 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-3z7qizep 8450s 2024-11-23 22:41:37,015 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:41:37,016 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45165 8450s 2024-11-23 22:41:37,016 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45165 8450s 2024-11-23 22:41:37,017 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:41:37,017 - distributed.worker - INFO - dashboard at: 127.0.0.1:34183 8450s 2024-11-23 22:41:37,017 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35161 8450s 2024-11-23 22:41:37,017 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:41:37,017 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:41:37,017 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:41:37,017 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-smontbc5 8450s 2024-11-23 22:41:37,017 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:41:37,018 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34521. Reason: failure-to-start- 8450s 2024-11-23 22:41:37,018 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:41:37,018 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45165. Reason: failure-to-start- 8450s 2024-11-23 22:41:37,018 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:41:37,021 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35161': TLS handshake failed with remote 'tls://127.0.0.1:51484': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:41:37,022 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35161': TLS handshake failed with remote 'tls://127.0.0.1:51488': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:41:37,023 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:41:38,030 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:41:38,039 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45595 8450s 2024-11-23 22:41:38,039 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38285/status 8450s 2024-11-23 22:41:38,040 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:41:38,054 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35813 8450s 2024-11-23 22:41:38,054 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35813 8450s 2024-11-23 22:41:38,054 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:41:38,054 - distributed.worker - INFO - dashboard at: 127.0.0.1:39285 8450s 2024-11-23 22:41:38,054 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45595 8450s 2024-11-23 22:41:38,054 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:41:38,055 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:41:38,055 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:41:38,055 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-yztnh4q7 8450s 2024-11-23 22:41:38,055 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:41:38,057 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43703 8450s 2024-11-23 22:41:38,057 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43703 8450s 2024-11-23 22:41:38,057 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:41:38,057 - distributed.worker - INFO - dashboard at: 127.0.0.1:45911 8450s 2024-11-23 22:41:38,057 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45595 8450s 2024-11-23 22:41:38,057 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:41:38,057 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:41:38,057 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:41:38,057 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-lyr6u3xu 8450s 2024-11-23 22:41:38,057 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:41:38,058 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35813. Reason: failure-to-start- 8450s 2024-11-23 22:41:38,059 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:41:38,059 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43703. Reason: failure-to-start- 8450s 2024-11-23 22:41:38,059 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:41:38,063 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45595': TLS handshake failed with remote 'tls://127.0.0.1:36340': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:41:38,063 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45595': TLS handshake failed with remote 'tls://127.0.0.1:36346': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:41:38,064 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:41:39,072 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:41:39,079 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45843 8450s 2024-11-23 22:41:39,079 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42141/status 8450s 2024-11-23 22:41:39,080 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:41:39,097 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42721 8450s 2024-11-23 22:41:39,097 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42721 8450s 2024-11-23 22:41:39,097 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:41:39,097 - distributed.worker - INFO - dashboard at: 127.0.0.1:38431 8450s 2024-11-23 22:41:39,097 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45843 8450s 2024-11-23 22:41:39,097 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:41:39,097 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:41:39,097 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:41:39,097 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-mz9bvm4v 8450s 2024-11-23 22:41:39,097 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:41:39,099 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44195 8450s 2024-11-23 22:41:39,099 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44195 8450s 2024-11-23 22:41:39,099 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:41:39,099 - distributed.worker - INFO - dashboard at: 127.0.0.1:38803 8450s 2024-11-23 22:41:39,099 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45843 8450s 2024-11-23 22:41:39,099 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:41:39,100 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:41:39,100 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:41:39,100 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-iadg4djv 8450s 2024-11-23 22:41:39,100 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:41:39,104 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42721. Reason: failure-to-start- 8450s 2024-11-23 22:41:39,104 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:41:39,104 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44195. Reason: failure-to-start- 8450s 2024-11-23 22:41:39,104 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:41:39,106 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45843': TLS handshake failed with remote 'tls://127.0.0.1:58484': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:41:39,106 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45843': TLS handshake failed with remote 'tls://127.0.0.1:58494': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:41:39,107 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:41:40,113 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:41:40,121 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35713 8450s 2024-11-23 22:41:40,122 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43213/status 8450s 2024-11-23 22:41:40,122 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:41:40,138 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45873 8450s 2024-11-23 22:41:40,138 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45873 8450s 2024-11-23 22:41:40,138 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:41:40,138 - distributed.worker - INFO - dashboard at: 127.0.0.1:34045 8450s 2024-11-23 22:41:40,138 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35713 8450s 2024-11-23 22:41:40,138 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:41:40,138 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:41:40,138 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:41:40,138 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-zqj6eab0 8450s 2024-11-23 22:41:40,138 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:41:40,141 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36145 8450s 2024-11-23 22:41:40,141 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36145 8450s 2024-11-23 22:41:40,141 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:41:40,142 - distributed.worker - INFO - dashboard at: 127.0.0.1:45231 8450s 2024-11-23 22:41:40,142 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35713 8450s 2024-11-23 22:41:40,142 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:41:40,142 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:41:40,142 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:41:40,142 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-c1q6s3p2 8450s 2024-11-23 22:41:40,142 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:41:40,147 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45873. Reason: failure-to-start- 8450s 2024-11-23 22:41:40,147 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:41:40,147 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36145. Reason: failure-to-start- 8450s 2024-11-23 22:41:40,147 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:41:40,151 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35713': TLS handshake failed with remote 'tls://127.0.0.1:49118': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:41:40,151 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35713': TLS handshake failed with remote 'tls://127.0.0.1:49128': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:41:40,156 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:41:41,161 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:41:41,168 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34989 8450s 2024-11-23 22:41:41,169 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34205/status 8450s 2024-11-23 22:41:41,169 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:41:41,184 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43793 8450s 2024-11-23 22:41:41,184 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43793 8450s 2024-11-23 22:41:41,184 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:41:41,184 - distributed.worker - INFO - dashboard at: 127.0.0.1:35723 8450s 2024-11-23 22:41:41,184 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34989 8450s 2024-11-23 22:41:41,184 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:41:41,184 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:41:41,184 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:41:41,184 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-6_6k6cxv 8450s 2024-11-23 22:41:41,184 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:41:41,186 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38225 8450s 2024-11-23 22:41:41,186 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38225 8450s 2024-11-23 22:41:41,195 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:41:41,197 - distributed.worker - INFO - dashboard at: 127.0.0.1:39785 8450s 2024-11-23 22:41:41,197 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34989 8450s 2024-11-23 22:41:41,197 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:41:41,197 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:41:41,197 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:41:41,197 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-7jkwr10z 8450s 2024-11-23 22:41:41,197 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:41:41,205 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43793. Reason: failure-to-start- 8450s 2024-11-23 22:41:41,205 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:41:41,207 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38225. Reason: failure-to-start- 8450s 2024-11-23 22:41:41,207 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:41:41,209 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34989': TLS handshake failed with remote 'tls://127.0.0.1:56354': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:41:41,209 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34989': TLS handshake failed with remote 'tls://127.0.0.1:56370': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:41:41,214 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s _________________________________ test_gather __________________________________ 8450s 8450s fut = , timeout = 0 8450s 8450s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 8450s async with asyncio.timeout(timeout): 8450s > return await fut 8450s 8450s /usr/lib/python3/dist-packages/distributed/utils.py:1960: 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s /usr/lib/python3/dist-packages/distributed/worker.py:1480: in start_unsafe 8450s await self._register_with_scheduler() 8450s /usr/lib/python3/dist-packages/distributed/worker.py:1179: in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s /usr/lib/python3/dist-packages/distributed/comm/core.py:342: in connect 8450s comm = await wait_for( 8450s /usr/lib/python3/dist-packages/distributed/utils.py:1960: in wait_for 8450s return await fut 8450s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:546: in connect 8450s stream = await self.client.connect( 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s 8450s self = , host = '127.0.0.1' 8450s port = 36339, af = 8450s ssl_options = 8450s max_buffer_size = 8364507136.0, source_ip = None, source_port = None 8450s timeout = None 8450s 8450s async def connect( 8450s self, 8450s host: str, 8450s port: int, 8450s af: socket.AddressFamily = socket.AF_UNSPEC, 8450s ssl_options: Optional[Union[Dict[str, Any], ssl.SSLContext]] = None, 8450s max_buffer_size: Optional[int] = None, 8450s source_ip: Optional[str] = None, 8450s source_port: Optional[int] = None, 8450s timeout: Optional[Union[float, datetime.timedelta]] = None, 8450s ) -> IOStream: 8450s """Connect to the given host and port. 8450s 8450s Asynchronously returns an `.IOStream` (or `.SSLIOStream` if 8450s ``ssl_options`` is not None). 8450s 8450s Using the ``source_ip`` kwarg, one can specify the source 8450s IP address to use when establishing the connection. 8450s In case the user needs to resolve and 8450s use a specific interface, it has to be handled outside 8450s of Tornado as this depends very much on the platform. 8450s 8450s Raises `TimeoutError` if the input future does not complete before 8450s ``timeout``, which may be specified in any form allowed by 8450s `.IOLoop.add_timeout` (i.e. a `datetime.timedelta` or an absolute time 8450s relative to `.IOLoop.time`) 8450s 8450s Similarly, when the user requires a certain source port, it can 8450s be specified using the ``source_port`` arg. 8450s 8450s .. versionchanged:: 4.5 8450s Added the ``source_ip`` and ``source_port`` arguments. 8450s 8450s .. versionchanged:: 5.0 8450s Added the ``timeout`` argument. 8450s """ 8450s if timeout is not None: 8450s if isinstance(timeout, numbers.Real): 8450s timeout = IOLoop.current().time() + timeout 8450s elif isinstance(timeout, datetime.timedelta): 8450s timeout = IOLoop.current().time() + timeout.total_seconds() 8450s else: 8450s raise TypeError("Unsupported timeout %r" % timeout) 8450s if timeout is not None: 8450s addrinfo = await gen.with_timeout( 8450s timeout, self.resolver.resolve(host, port, af) 8450s ) 8450s else: 8450s addrinfo = await self.resolver.resolve(host, port, af) 8450s connector = _Connector( 8450s addrinfo, 8450s functools.partial( 8450s self._create_stream, 8450s max_buffer_size, 8450s source_ip=source_ip, 8450s source_port=source_port, 8450s ), 8450s ) 8450s > af, addr, stream = await connector.start(connect_timeout=timeout) 8450s E asyncio.exceptions.CancelledError 8450s 8450s /usr/lib/python3/dist-packages/tornado/tcpclient.py:279: CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s self = 8450s 8450s @final 8450s async def start(self): 8450s async with self._startup_lock: 8450s if self.status == Status.failed: 8450s assert self.__startup_exc is not None 8450s raise self.__startup_exc 8450s elif self.status != Status.init: 8450s return self 8450s timeout = getattr(self, "death_timeout", None) 8450s 8450s async def _close_on_failure(exc: Exception) -> None: 8450s await self.close(reason=f"failure-to-start-{str(type(exc))}") 8450s self.status = Status.failed 8450s self.__startup_exc = exc 8450s 8450s try: 8450s > await wait_for(self.start_unsafe(), timeout=timeout) 8450s 8450s /usr/lib/python3/dist-packages/distributed/core.py:664: 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 8450s async with asyncio.timeout(timeout): 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s 8450s self = 8450s exc_type = 8450s exc_val = CancelledError(), exc_tb = 8450s 8450s async def __aexit__( 8450s self, 8450s exc_type: Optional[Type[BaseException]], 8450s exc_val: Optional[BaseException], 8450s exc_tb: Optional[TracebackType], 8450s ) -> Optional[bool]: 8450s assert self._state in (_State.ENTERED, _State.EXPIRING) 8450s 8450s if self._timeout_handler is not None: 8450s self._timeout_handler.cancel() 8450s self._timeout_handler = None 8450s 8450s if self._state is _State.EXPIRING: 8450s self._state = _State.EXPIRED 8450s 8450s if self._task.uncancel() <= self._cancelling and exc_type is not None: 8450s # Since there are no new cancel requests, we're 8450s # handling this. 8450s if issubclass(exc_type, exceptions.CancelledError): 8450s > raise TimeoutError from exc_val 8450s E TimeoutError 8450s 8450s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s @contextlib.asynccontextmanager 8450s async def _cluster_factory(): 8450s workers = [] 8450s s = None 8450s try: 8450s for _ in range(60): 8450s try: 8450s > s, ws = await start_cluster( 8450s nthreads, 8450s scheduler, 8450s security=security, 8450s Worker=Worker, 8450s scheduler_kwargs=scheduler_kwargs, 8450s worker_kwargs=merge( 8450s {"death_timeout": min(15, int(deadline.remaining))}, 8450s worker_kwargs, 8450s ), 8450s ) 8450s 8450s /usr/lib/python3/dist-packages/distributed/utils_test.py:966: 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s /usr/lib/python3/dist-packages/distributed/utils_test.py:789: in start_cluster 8450s await asyncio.gather(*workers) 8450s /usr/lib/python3.13/asyncio/tasks.py:737: in _wrap_awaitable 8450s return await awaitable 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s 8450s self = 8450s 8450s @final 8450s async def start(self): 8450s async with self._startup_lock: 8450s if self.status == Status.failed: 8450s assert self.__startup_exc is not None 8450s raise self.__startup_exc 8450s elif self.status != Status.init: 8450s return self 8450s timeout = getattr(self, "death_timeout", None) 8450s 8450s async def _close_on_failure(exc: Exception) -> None: 8450s await self.close(reason=f"failure-to-start-{str(type(exc))}") 8450s self.status = Status.failed 8450s self.__startup_exc = exc 8450s 8450s try: 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s except asyncio.TimeoutError as exc: 8450s await _close_on_failure(exc) 8450s > raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s E TimeoutError: Worker start timed out after 0s. 8450s 8450s /usr/lib/python3/dist-packages/distributed/core.py:667: TimeoutError 8450s 8450s During handling of the above exception, another exception occurred: 8450s 8450s fut = ._..test_func..async_fn at 0xe8325b08> 8450s timeout = 60 8450s 8450s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 8450s async with asyncio.timeout(timeout): 8450s > return await fut 8450s 8450s /usr/lib/python3/dist-packages/distributed/utils.py:1960: 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s /usr/lib/python3/dist-packages/distributed/utils_test.py:999: in async_fn 8450s _cluster_factory() as (s, workers), 8450s /usr/lib/python3.13/contextlib.py:214: in __aenter__ 8450s return await anext(self.gen) 8450s /usr/lib/python3/dist-packages/distributed/utils_test.py:983: in _cluster_factory 8450s await asyncio.sleep(1) 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s 8450s delay = 1, result = None 8450s 8450s async def sleep(delay, result=None): 8450s """Coroutine that completes after a given time (in seconds).""" 8450s if delay <= 0: 8450s await __sleep0() 8450s return result 8450s 8450s if math.isnan(delay): 8450s raise ValueError("Invalid delay: NaN (not a number)") 8450s 8450s loop = events.get_running_loop() 8450s future = loop.create_future() 8450s h = loop.call_later(delay, 8450s futures._set_result_unless_cancelled, 8450s future, result) 8450s try: 8450s > return await future 8450s E asyncio.exceptions.CancelledError 8450s 8450s /usr/lib/python3.13/asyncio/tasks.py:718: CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s args = (), kwds = {} 8450s 8450s @wraps(func) 8450s def inner(*args, **kwds): 8450s with self._recreate_cm(): 8450s > return func(*args, **kwds) 8450s 8450s /usr/lib/python3.13/contextlib.py:85: 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s /usr/lib/python3.13/contextlib.py:85: in inner 8450s return func(*args, **kwds) 8450s /usr/lib/python3/dist-packages/distributed/utils_test.py:1102: in test_func 8450s return _run_and_close_tornado(async_fn_outer) 8450s /usr/lib/python3/dist-packages/distributed/utils_test.py:378: in _run_and_close_tornado 8450s return asyncio_run(inner_fn(), loop_factory=get_loop_factory()) 8450s /usr/lib/python3.13/asyncio/runners.py:194: in run 8450s return runner.run(main) 8450s /usr/lib/python3.13/asyncio/runners.py:118: in run 8450s return self._loop.run_until_complete(task) 8450s /usr/lib/python3.13/asyncio/base_events.py:720: in run_until_complete 8450s return future.result() 8450s /usr/lib/python3/dist-packages/distributed/utils_test.py:375: in inner_fn 8450s return await async_fn(*args, **kwargs) 8450s /usr/lib/python3/dist-packages/distributed/utils_test.py:1099: in async_fn_outer 8450s return await utils_wait_for(async_fn(), timeout=timeout * 2) 8450s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 8450s async with asyncio.timeout(timeout): 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s 8450s self = 8450s exc_type = 8450s exc_val = CancelledError(), exc_tb = 8450s 8450s async def __aexit__( 8450s self, 8450s exc_type: Optional[Type[BaseException]], 8450s exc_val: Optional[BaseException], 8450s exc_tb: Optional[TracebackType], 8450s ) -> Optional[bool]: 8450s assert self._state in (_State.ENTERED, _State.EXPIRING) 8450s 8450s if self._timeout_handler is not None: 8450s self._timeout_handler.cancel() 8450s self._timeout_handler = None 8450s 8450s if self._state is _State.EXPIRING: 8450s self._state = _State.EXPIRED 8450s 8450s if self._task.uncancel() <= self._cancelling and exc_type is not None: 8450s # Since there are no new cancel requests, we're 8450s # handling this. 8450s if issubclass(exc_type, exceptions.CancelledError): 8450s > raise TimeoutError from exc_val 8450s E TimeoutError 8450s 8450s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 8450s ----------------------------- Captured stderr call ----------------------------- 8450s 2024-11-23 22:41:42,629 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:41:42,637 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:42,637 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:32877/status 8450s 2024-11-23 22:41:42,637 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:41:42,651 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40283 8450s 2024-11-23 22:41:42,651 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40283 8450s 2024-11-23 22:41:42,651 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:41:42,651 - distributed.worker - INFO - dashboard at: 127.0.0.1:33583 8450s 2024-11-23 22:41:42,651 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:42,651 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:41:42,651 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:41:42,651 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:41:42,651 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-n898c20h 8450s 2024-11-23 22:41:42,651 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:41:42,653 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42333 8450s 2024-11-23 22:41:42,653 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42333 8450s 2024-11-23 22:41:42,653 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:41:42,653 - distributed.worker - INFO - dashboard at: 127.0.0.1:41097 8450s 2024-11-23 22:41:42,653 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:42,653 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:41:42,653 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:41:42,653 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:41:42,653 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-y47t744k 8450s 2024-11-23 22:41:42,654 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:41:42,666 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:42,666 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:42,666 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:60892': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:42,666 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:60908': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:42,779 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:42,779 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:42,779 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:60910': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:42,779 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:60922': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:42,892 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:42,893 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:42,893 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:60928': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:42,893 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:60934': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:43,005 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:43,005 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:43,005 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:60936': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:43,005 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:60946': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:43,119 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:43,119 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:43,119 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:60958': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:43,119 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:60974': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:43,231 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:43,231 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:43,231 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:60986': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:43,232 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:60998': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:43,344 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:43,344 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:43,344 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:32772': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:43,344 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:32788': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:43,456 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:43,456 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:43,457 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:32794': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:43,457 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:32808': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:43,569 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:43,569 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:43,569 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:32814': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:43,569 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:32826': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:43,681 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:43,681 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:43,682 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:32832': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:43,682 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:32840': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:43,793 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:43,793 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:43,794 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:32852': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:43,794 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:32866': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:43,906 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:43,906 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:43,906 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:32876': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:43,906 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:32880': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:44,019 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:44,019 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:44,019 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:32896': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:44,019 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:32904': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:44,145 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:44,146 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:44,151 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:32910': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:44,151 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:32914': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:44,259 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:44,259 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:44,260 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:32920': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:44,260 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:32930': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:44,371 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:44,371 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:44,372 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:32936': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:44,372 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:32942': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:44,485 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:44,485 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:44,486 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:32948': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:44,486 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:32962': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:44,598 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:44,599 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:44,599 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:32978': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:44,599 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:32992': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:44,711 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:44,711 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:44,711 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:33004': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:44,711 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:33006': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:44,823 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:44,824 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:44,824 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:33022': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:44,824 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:33028': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:44,936 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:44,936 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:44,936 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:33040': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:44,936 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:33044': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:45,049 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:45,049 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:45,049 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:33050': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:45,050 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:33052': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:45,161 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:45,161 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:45,161 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:33058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:45,161 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:33072': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:45,274 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:45,274 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:45,274 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:33088': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:45,274 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:33096': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:45,388 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:45,388 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:45,388 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:33112': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:45,388 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:33120': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:45,499 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:45,500 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:45,500 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:33126': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:45,500 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:33142': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:45,613 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:45,613 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:45,613 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:33152': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:45,613 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:33166': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:45,727 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:45,727 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:45,727 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:33178': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:45,727 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:33186': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:45,840 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:45,840 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:45,840 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:33202': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:45,840 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:33204': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:45,952 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:45,952 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:45,953 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:33220': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:45,953 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:33228': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:46,064 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:46,065 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:46,065 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:33232': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:46,065 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:33238': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:46,177 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:46,177 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:46,177 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:33248': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:46,177 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:33252': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:46,290 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:46,291 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:46,291 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:33260': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:46,291 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:33270': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:46,402 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:46,403 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:46,403 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:33274': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:46,403 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:33278': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:46,516 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:46,516 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:46,516 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:33286': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:46,516 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:33296': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:46,628 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:46,629 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:46,629 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:33300': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:46,629 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:33304': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:46,742 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:46,742 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:46,742 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:33318': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:46,742 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:33334': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:46,854 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:46,854 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:46,854 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:33348': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:46,854 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:33362': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:46,966 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:46,967 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:46,967 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:33378': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:46,967 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:33386': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:47,080 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:47,080 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:47,080 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:33392': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:47,080 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:33394': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:47,192 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:47,192 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:47,192 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:33410': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:47,192 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:33424': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:47,305 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:47,305 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:47,305 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:33436': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:47,305 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:33438': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:47,417 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:47,417 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:47,417 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:33452': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:47,417 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:33466': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:47,530 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:47,530 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:47,530 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:33474': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:47,530 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:33490': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:47,642 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:47,643 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:47,647 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:33492': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:47,647 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:33498': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:47,755 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:47,755 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:47,755 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:33510': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:47,756 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:33514': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:47,867 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:47,867 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:47,868 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:33524': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:47,868 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:33534': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:47,980 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:47,980 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:47,980 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:33544': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:47,980 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:33560': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:48,093 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:48,094 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:48,094 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:33564': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:48,094 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:33570': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:48,206 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:48,206 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:48,207 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:33578': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:48,207 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:33584': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:48,318 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:48,318 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:48,319 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:33598': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:48,319 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:33604': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:48,430 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:48,431 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:48,431 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:33614': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:48,431 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:33618': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:48,543 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:48,544 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:48,544 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:33634': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:48,544 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:33648': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:48,656 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:48,656 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:48,657 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:33662': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:48,657 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:33670': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:48,769 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:48,769 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:48,769 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:33674': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:48,769 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:33676': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:48,882 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:48,882 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:48,882 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:33690': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:48,882 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:33700': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:48,994 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:48,994 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:48,994 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:33704': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:48,994 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:33710': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:49,107 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:49,107 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:49,107 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:33714': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:49,107 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:33720': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:49,221 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:49,221 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:49,221 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:33736': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:49,222 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:33748': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:49,335 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:49,335 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:49,336 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:33758': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:49,336 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:33770': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:49,447 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:49,447 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:49,448 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:33784': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:49,448 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:33790': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:49,560 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:49,560 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:49,560 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:33802': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:49,560 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:33812': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:49,673 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:49,673 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:49,673 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:33828': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:49,673 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:33836': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:49,785 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:49,785 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:49,785 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:33844': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:49,785 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:33848': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:49,898 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:49,899 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:49,899 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:33864': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:49,899 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:33872': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:50,011 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:50,011 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:50,012 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:33878': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:50,012 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:33884': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:50,124 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:50,124 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:50,124 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:33892': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:50,124 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:33894': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:50,236 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:50,236 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:50,236 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:33898': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:50,236 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:33906': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:50,349 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:50,349 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:50,349 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:33910': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:50,349 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:33916': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:50,461 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:50,461 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:50,461 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:33918': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:50,461 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:33920': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:50,573 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:50,574 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:50,574 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:33924': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:50,574 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:33938': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:50,685 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:50,686 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:50,686 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:33952': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:50,686 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:33960': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:50,798 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:50,799 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:50,799 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:33972': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:50,799 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:33976': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:50,911 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:50,911 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:50,914 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:33980': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:50,915 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:33996': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:51,024 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:51,024 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:51,024 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:34004': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:51,024 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:34012': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:51,136 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:51,137 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:51,137 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:34022': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:51,137 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:34028': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:51,249 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:51,250 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:51,250 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:34036': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:51,250 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:34044': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:51,362 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:51,363 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:51,363 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:34058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:51,363 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:34066': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:51,474 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:51,474 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:51,475 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:34076': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:51,475 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:34084': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:51,588 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:51,588 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:51,588 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:37276': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:51,588 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:37288': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:51,713 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:51,713 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:51,714 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:37290': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:51,714 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:37292': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:51,828 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:51,829 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:51,829 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:37304': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:51,829 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:37316': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:51,941 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:51,941 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:51,941 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:37328': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:51,941 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:37334': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:52,053 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:52,053 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:52,054 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:37338': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:52,054 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:37352': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:52,165 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:52,165 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:52,165 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:37368': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:52,165 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:37378': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:52,278 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:52,278 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:52,278 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:37388': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:52,278 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:37394': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:52,390 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:52,391 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:52,391 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:37404': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:52,391 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:37410': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:52,504 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:52,504 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:52,504 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:37414': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:52,504 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:37420': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:52,618 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:52,618 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:52,618 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:37434': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:52,618 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:37448': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:52,732 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:52,732 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:52,732 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:37452': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:52,732 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:37456': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:52,845 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:52,845 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:52,845 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:37470': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:52,846 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:37486': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:52,958 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:52,958 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:52,958 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:37490': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:52,958 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:37494': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:53,070 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:53,070 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:53,070 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:37502': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:53,070 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:37516': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:53,183 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:53,183 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:53,183 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:37528': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:53,183 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:37530': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:53,295 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:53,296 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:53,296 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:37540': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:53,296 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:37552': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:53,408 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:53,408 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:53,408 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:37564': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:53,408 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:37566': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:53,521 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:53,522 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:53,522 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:37580': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:53,522 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:37592': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:53,635 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:53,635 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:53,635 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:37594': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:53,635 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:37596': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:53,748 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:53,748 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:53,748 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:37602': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:53,748 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:37608': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:53,861 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:53,861 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:53,861 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:37622': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:53,861 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:37630': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:53,973 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:53,973 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:53,973 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:37640': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:53,973 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:37650': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:54,085 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:54,085 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:54,085 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:37658': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:54,085 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:37664': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:54,198 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:54,199 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:54,199 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:37676': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:54,199 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:37680': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:54,312 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:54,312 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:54,312 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:37684': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:54,312 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:37694': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:54,424 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:54,424 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:54,424 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:37698': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:54,424 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:37708': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:54,537 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:54,537 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:54,537 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:37724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:54,537 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:37726': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:54,652 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:54,652 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:54,653 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:37730': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:54,653 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:37732': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:54,764 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:54,764 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:54,764 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:37746': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:54,765 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:37748': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:54,877 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:54,877 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:54,878 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:37752': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:54,878 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:37764': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:54,989 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:54,990 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:54,990 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:37776': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:54,990 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:37790': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:55,104 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:55,104 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:55,104 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:37804': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:55,104 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:37808': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:55,216 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:55,216 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:55,216 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:37816': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:55,217 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:37830': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:55,329 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:55,329 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:55,329 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:37842': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:55,330 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:37848': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:55,441 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:55,441 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:55,442 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:37856': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:55,442 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:37860': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:55,553 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:55,553 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:55,554 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:37876': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:55,554 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:37886': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:55,666 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:55,667 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:55,667 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:37890': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:55,667 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:37902': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:55,779 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:55,779 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:55,779 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:37912': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:55,779 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:37914': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:55,892 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:55,892 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:55,893 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:37916': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:55,893 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:37924': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:56,004 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:56,004 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:56,005 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:37940': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:56,005 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:37954': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:56,118 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:56,118 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:56,118 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:37960': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:56,118 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:37962': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:56,231 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:56,231 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:56,231 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:37974': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:56,231 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:37980': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:56,343 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:56,344 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:56,344 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:37994': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:56,344 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:38002': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:56,456 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:56,456 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:56,456 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:38016': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:56,456 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:38032': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:56,568 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:56,568 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:56,568 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:38046': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:56,568 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:38058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:56,680 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:56,680 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:56,680 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:38062': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:56,681 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:38076': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:56,793 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:56,793 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:56,793 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:38080': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:56,794 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:38088': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:56,905 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:56,906 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:56,906 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:38098': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:56,906 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:38108': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:57,018 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:57,018 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:57,019 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:38124': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:57,019 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:38138': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:57,132 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:57,132 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:57,133 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:38146': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:57,133 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:38162': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:57,245 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:57,245 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:57,245 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:38176': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:57,245 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:38178': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:57,358 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:57,358 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:57,358 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:38180': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:57,358 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:38184': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:57,471 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:57,471 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:57,471 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:38192': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:57,471 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:38206': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:57,584 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:57,584 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:41:57,584 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:38208': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:57,584 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:38224': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:57,650 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40283. Reason: failure-to-start- 8450s 2024-11-23 22:41:57,650 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:41:57,652 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42333. Reason: failure-to-start- 8450s 2024-11-23 22:41:57,652 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:41:57,654 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 15s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 8450s stream = await stream.start_tls( 8450s ^^^^^^^^^^^^^^^^^^^^^^^ 8450s False, ssl_options=ssl_options, server_hostname=host 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 8450s self.socket.do_handshake() 8450s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 8450s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 8450s self._sslobj.do_handshake() 8450s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 8450s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 8450s raise FatalCommClosedError( 8450s ...<2 lines>... 8450s ) from err 8450s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 8450s 8450s During handling of the above exception, another exception occurred: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1218, in _register_with_scheduler 8450s await asyncio.sleep(0.1) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 718, in sleep 8450s return await future 8450s ^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 15s. 8450s 2024-11-23 22:41:58,662 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:41:58,669 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40359 8450s 2024-11-23 22:41:58,669 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37143/status 8450s 2024-11-23 22:41:58,669 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:41:58,682 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43623 8450s 2024-11-23 22:41:58,682 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43623 8450s 2024-11-23 22:41:58,682 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:41:58,682 - distributed.worker - INFO - dashboard at: 127.0.0.1:33885 8450s 2024-11-23 22:41:58,682 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:41:58,682 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:41:58,682 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:41:58,682 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:41:58,682 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-q6gs5tvi 8450s 2024-11-23 22:41:58,682 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:41:58,684 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35795 8450s 2024-11-23 22:41:58,684 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35795 8450s 2024-11-23 22:41:58,684 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:41:58,684 - distributed.worker - INFO - dashboard at: 127.0.0.1:39907 8450s 2024-11-23 22:41:58,684 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:41:58,684 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:41:58,684 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:41:58,685 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:41:58,685 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-z8rpb01n 8450s 2024-11-23 22:41:58,685 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:41:58,698 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:41:58,698 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:41:58,698 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:47140': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:58,698 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:47144': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:58,810 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:41:58,810 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:41:58,810 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:47152': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:58,811 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:47166': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:58,923 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:41:58,923 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:41:58,924 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:47172': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:58,924 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:47176': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:59,036 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:41:59,036 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:41:59,037 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:47192': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:59,037 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:47198': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:59,151 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:41:59,151 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:41:59,152 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:47206': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:59,152 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:47220': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:59,264 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:41:59,264 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:41:59,265 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:47224': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:59,265 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:47238': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:59,377 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:41:59,377 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:41:59,378 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:47242': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:59,378 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:47258': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:59,489 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:41:59,490 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:41:59,490 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:47264': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:59,490 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:47266': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:59,615 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:41:59,615 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:41:59,615 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:47282': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:59,615 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:47294': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:59,728 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:41:59,728 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:41:59,728 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:47308': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:59,729 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:47314': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:59,840 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:41:59,840 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:41:59,841 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:47320': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:59,841 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:47334': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:59,953 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:41:59,953 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:41:59,954 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:47344': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:41:59,954 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:47354': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:00,065 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:00,065 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:00,065 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:47370': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:00,066 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:47376': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:00,178 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:00,178 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:00,181 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:47382': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:00,181 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:47390': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:00,290 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:00,290 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:00,290 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:47400': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:00,290 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:47416': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:00,402 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:00,403 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:00,403 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:47428': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:00,403 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:47442': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:00,516 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:00,517 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:00,518 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:47448': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:00,518 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:47460': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:00,624 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:00,628 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:47468': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:00,629 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:00,630 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:47478': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:00,732 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:00,732 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:47490': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:00,738 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:00,738 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:47502': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:00,839 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:00,840 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:47508': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:00,846 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:00,846 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:47516': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:00,946 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:00,947 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:47532': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:00,953 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:00,953 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:47540': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:01,053 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:01,054 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:47550': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:01,060 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:01,060 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:47560': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:01,160 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:01,161 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:47570': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:01,167 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:01,167 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:47586': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:01,267 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:01,268 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:47598': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:01,274 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:01,274 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:47614': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:01,374 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:01,375 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:47624': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:01,380 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:01,381 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:47628': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:01,481 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:01,482 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:47638': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:01,488 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:01,488 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:47646': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:01,588 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:01,589 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:41884': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:01,594 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:01,595 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:41894': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:01,696 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:01,696 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:41910': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:01,702 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:01,702 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:41914': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:01,804 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:01,804 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:41916': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:01,810 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:01,810 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:41928': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:01,911 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:01,912 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:41944': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:01,918 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:01,918 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:41946': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:02,019 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:02,020 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:41958': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:02,026 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:02,026 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:41972': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:02,128 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:02,128 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:41978': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:02,134 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:02,135 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:41980': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:02,236 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:02,237 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:41984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:02,243 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:02,243 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:41994': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:02,343 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:02,344 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:41996': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:02,350 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:02,350 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:42010': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:02,450 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:02,450 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:42024': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:02,456 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:02,457 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:42030': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:02,557 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:02,558 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:42042': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:02,564 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:02,564 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:42044': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:02,666 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:02,667 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:42046': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:02,673 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:02,676 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:42052': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:02,774 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:02,775 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:42066': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:02,781 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:02,781 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:42080': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:02,882 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:02,882 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:42090': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:02,888 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:02,888 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:42100': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:02,989 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:02,989 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:42110': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:02,995 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:02,995 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:42116': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:03,096 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:03,096 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:42132': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:03,102 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:03,103 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:42144': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:03,203 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:03,204 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:42154': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:03,209 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:03,210 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:42158': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:03,310 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:03,310 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:42160': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:03,316 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:03,317 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:42172': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:03,417 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:03,418 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:42182': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:03,424 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:03,424 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:42194': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:03,525 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:03,526 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:42202': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:03,531 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:03,531 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:42216': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:03,632 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:03,633 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:42230': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:03,640 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:03,644 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:42232': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:03,741 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:03,742 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:42240': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:03,747 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:03,748 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:42256': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:03,848 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:03,849 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:42262': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:03,855 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:03,855 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:42274': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:03,956 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:03,957 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:42284': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:03,963 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:03,963 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:42290': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:04,064 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:04,065 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:42296': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:04,071 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:04,071 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:42298': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:04,172 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:04,176 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:42308': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:04,182 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:04,182 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:42316': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:04,279 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:04,279 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:42330': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:04,289 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:04,289 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:42346': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:04,387 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:04,387 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:42360': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:04,396 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:04,396 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:42366': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:04,494 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:04,494 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:42380': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:04,502 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:04,503 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:42382': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:04,601 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:04,601 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:42398': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:04,609 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:04,610 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:42400': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:04,708 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:04,708 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:42404': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:04,717 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:04,717 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:42418': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:04,815 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:04,816 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:42430': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:04,824 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:04,824 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:42444': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:04,923 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:04,924 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:42452': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:04,931 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:04,931 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:42456': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:05,031 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:05,031 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:42460': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:05,037 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:05,038 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:42476': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:05,138 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:05,138 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:42486': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:05,147 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:05,148 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:42500': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:05,245 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:05,245 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:42502': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:05,255 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:05,255 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:42514': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:05,353 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:05,353 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:42518': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:05,362 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:05,362 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:42520': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:05,460 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:05,460 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:42530': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:05,469 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:05,469 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:42540': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:05,567 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:05,568 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:42554': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:05,576 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:05,576 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:42562': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:05,680 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:05,681 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:42570': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:05,686 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:05,687 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:42574': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:05,787 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:05,788 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:42578': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:05,794 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:05,794 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:42586': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:05,895 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:05,895 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:42590': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:05,915 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:05,917 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:42596': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:06,002 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:06,003 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:42598': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:06,023 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:06,023 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:42606': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:06,110 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:06,110 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:42612': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:06,131 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:06,131 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:42620': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:06,217 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:06,217 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:42622': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:06,238 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:06,238 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:42630': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:06,324 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:06,325 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:42638': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:06,345 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:06,346 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:42640': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:06,432 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:06,432 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:42644': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:06,453 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:06,453 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:42646': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:06,539 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:06,540 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:42654': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:06,560 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:06,561 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:42666': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:06,647 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:06,648 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:42670': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:06,668 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:06,669 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:42674': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:06,755 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:06,755 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:42682': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:06,776 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:06,776 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:42684': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:06,862 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:06,862 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:42694': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:06,883 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:06,883 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:42704': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:06,969 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:06,969 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:42716': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:06,990 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:06,990 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:42722': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:07,076 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:07,076 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:42728': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:07,097 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:07,097 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:42744': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:07,183 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:07,184 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:42756': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:07,204 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:07,204 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:42772': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:07,291 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:07,291 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:42774': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:07,312 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:07,312 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:42786': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:07,399 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:07,399 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:42796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:07,420 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:07,420 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:42812': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:07,507 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:07,507 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:42814': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:07,527 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:07,528 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:42828': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:07,614 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:07,615 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:42840': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:07,635 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:07,635 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:42852': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:07,721 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:07,721 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:42858': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:07,744 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:07,745 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:42862': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:07,828 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:07,828 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:42866': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:07,851 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:07,852 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:42882': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:07,935 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:07,935 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:42892': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:07,959 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:07,959 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:42894': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:08,043 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:08,043 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:42910': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:08,065 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:08,066 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:42914': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:08,150 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:08,150 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:42928': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:08,173 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:08,176 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:42934': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:08,256 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:08,257 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:42938': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:08,281 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:08,281 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:42954': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:08,364 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:08,365 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:42968': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:08,388 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:08,388 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:42972': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:08,472 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:08,472 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:42976': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:08,495 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:08,495 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:42986': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:08,579 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:08,579 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:42998': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:08,603 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:08,603 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:43006': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:08,687 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:08,687 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:43020': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:08,710 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:08,711 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:43036': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:08,794 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:08,795 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:43052': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:08,817 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:08,818 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:43056': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:08,902 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:08,902 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:43062': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:08,925 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:08,925 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:43068': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:09,009 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:09,009 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:43072': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:09,032 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:09,032 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:43076': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:09,117 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:09,117 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:43092': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:09,139 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:09,143 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:43102': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:09,224 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:09,224 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:43104': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:09,247 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:09,247 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:43114': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:09,331 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:09,332 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:43116': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:09,354 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:09,355 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:43132': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:09,438 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:09,439 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:43142': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:09,461 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:09,462 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:43144': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:09,545 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:09,545 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:43160': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:09,569 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:09,569 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:43172': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:09,652 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:09,653 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:43180': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:09,678 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:09,679 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:43190': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:09,760 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:09,760 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:43202': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:09,785 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:09,786 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:43218': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:09,867 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:09,867 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:43220': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:09,892 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:09,893 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:43222': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:09,974 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:09,974 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:43234': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:10,000 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:10,000 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:43244': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:10,081 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:10,082 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:43260': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:10,107 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:10,107 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:43266': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:10,190 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:10,190 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:43268': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:10,216 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:10,216 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:43282': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:10,296 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:10,297 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:43284': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:10,323 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:10,324 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:43288': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:10,403 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:10,404 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:43300': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:10,430 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:10,430 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:43304': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:10,510 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:10,511 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:43306': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:10,537 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:10,538 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:43312': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:10,617 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:10,618 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:43318': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:10,648 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:10,648 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:43322': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:10,725 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:10,725 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:43332': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:10,754 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:10,755 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:43336': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:10,833 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:10,834 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:43352': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:10,862 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:10,862 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:43368': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:10,941 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:10,942 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:43384': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:10,969 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:10,969 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:43398': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:11,048 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:11,048 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:43406': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:11,076 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:11,076 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:43410': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:11,155 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:11,155 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:43414': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:11,184 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:11,184 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:43416': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:11,262 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:11,262 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:43426': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:11,291 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:11,292 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:43440': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:11,370 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:11,370 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:43452': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:11,398 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:11,399 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:43468': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:11,476 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:11,477 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:43478': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:11,505 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:11,506 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:43492': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:11,584 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:11,585 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:42594': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:11,612 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40359 8450s 2024-11-23 22:42:11,613 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40359': TLS handshake failed with remote 'tls://127.0.0.1:42604': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:11,682 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43623. Reason: failure-to-start- 8450s 2024-11-23 22:42:11,682 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:42:11,684 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35795. Reason: failure-to-start- 8450s 2024-11-23 22:42:11,684 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:42:11,688 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 13s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 8450s stream = await stream.start_tls( 8450s ^^^^^^^^^^^^^^^^^^^^^^^ 8450s False, ssl_options=ssl_options, server_hostname=host 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 8450s self.socket.do_handshake() 8450s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 8450s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 8450s self._sslobj.do_handshake() 8450s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 8450s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 8450s raise FatalCommClosedError( 8450s ...<2 lines>... 8450s ) from err 8450s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 8450s 8450s During handling of the above exception, another exception occurred: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1218, in _register_with_scheduler 8450s await asyncio.sleep(0.1) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 718, in sleep 8450s return await future 8450s ^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 13s. 8450s 2024-11-23 22:42:12,705 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:42:12,716 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37307 8450s 2024-11-23 22:42:12,717 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38285/status 8450s 2024-11-23 22:42:12,717 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:42:12,731 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43857 8450s 2024-11-23 22:42:12,731 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43857 8450s 2024-11-23 22:42:12,731 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:42:12,731 - distributed.worker - INFO - dashboard at: 127.0.0.1:38837 8450s 2024-11-23 22:42:12,731 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37307 8450s 2024-11-23 22:42:12,731 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:42:12,731 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:42:12,731 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:42:12,731 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-g3b9vjb9 8450s 2024-11-23 22:42:12,731 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:42:12,733 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39867 8450s 2024-11-23 22:42:12,733 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39867 8450s 2024-11-23 22:42:12,733 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:42:12,733 - distributed.worker - INFO - dashboard at: 127.0.0.1:37979 8450s 2024-11-23 22:42:12,733 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37307 8450s 2024-11-23 22:42:12,733 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:42:12,733 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:42:12,734 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:42:12,734 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-b79s75px 8450s 2024-11-23 22:42:12,734 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:42:12,734 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43857. Reason: failure-to-start- 8450s 2024-11-23 22:42:12,735 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:42:12,735 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39867. Reason: failure-to-start- 8450s 2024-11-23 22:42:12,735 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:42:12,737 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37307': TLS handshake failed with remote 'tls://127.0.0.1:44488': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:42:12,737 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37307': TLS handshake failed with remote 'tls://127.0.0.1:44496': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:42:12,738 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:42:13,745 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:42:13,752 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45951 8450s 2024-11-23 22:42:13,752 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35357/status 8450s 2024-11-23 22:42:13,753 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:42:13,768 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35577 8450s 2024-11-23 22:42:13,768 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35577 8450s 2024-11-23 22:42:13,768 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:42:13,768 - distributed.worker - INFO - dashboard at: 127.0.0.1:32833 8450s 2024-11-23 22:42:13,768 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45951 8450s 2024-11-23 22:42:13,768 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:42:13,768 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:42:13,768 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:42:13,768 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-zaaiyha9 8450s 2024-11-23 22:42:13,768 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:42:13,770 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45023 8450s 2024-11-23 22:42:13,770 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45023 8450s 2024-11-23 22:42:13,770 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:42:13,770 - distributed.worker - INFO - dashboard at: 127.0.0.1:39357 8450s 2024-11-23 22:42:13,770 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45951 8450s 2024-11-23 22:42:13,771 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:42:13,771 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:42:13,771 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:42:13,771 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-1lgj700d 8450s 2024-11-23 22:42:13,771 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:42:13,772 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35577. Reason: failure-to-start- 8450s 2024-11-23 22:42:13,772 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:42:13,772 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45023. Reason: failure-to-start- 8450s 2024-11-23 22:42:13,772 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:42:13,774 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45951': TLS handshake failed with remote 'tls://127.0.0.1:44586': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:42:13,774 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45951': TLS handshake failed with remote 'tls://127.0.0.1:44602': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:42:13,775 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:42:14,781 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:42:14,788 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33917 8450s 2024-11-23 22:42:14,788 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42385/status 8450s 2024-11-23 22:42:14,788 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:42:14,801 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33037 8450s 2024-11-23 22:42:14,801 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33037 8450s 2024-11-23 22:42:14,801 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:42:14,802 - distributed.worker - INFO - dashboard at: 127.0.0.1:38235 8450s 2024-11-23 22:42:14,802 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33917 8450s 2024-11-23 22:42:14,802 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:42:14,802 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:42:14,802 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:42:14,802 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-bcdy4msr 8450s 2024-11-23 22:42:14,802 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:42:14,804 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42395 8450s 2024-11-23 22:42:14,805 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42395 8450s 2024-11-23 22:42:14,805 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:42:14,805 - distributed.worker - INFO - dashboard at: 127.0.0.1:39379 8450s 2024-11-23 22:42:14,805 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33917 8450s 2024-11-23 22:42:14,805 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:42:14,805 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:42:14,805 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:42:14,805 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-r4nz_u2p 8450s 2024-11-23 22:42:14,805 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:42:14,807 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33037. Reason: failure-to-start- 8450s 2024-11-23 22:42:14,807 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:42:14,807 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42395. Reason: failure-to-start- 8450s 2024-11-23 22:42:14,807 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:42:14,808 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33917': TLS handshake failed with remote 'tls://127.0.0.1:46736': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:42:14,808 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33917': TLS handshake failed with remote 'tls://127.0.0.1:46752': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:42:14,810 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:42:15,815 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:42:15,822 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42499 8450s 2024-11-23 22:42:15,822 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41581/status 8450s 2024-11-23 22:42:15,822 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:42:15,835 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33503 8450s 2024-11-23 22:42:15,835 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33503 8450s 2024-11-23 22:42:15,835 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:42:15,835 - distributed.worker - INFO - dashboard at: 127.0.0.1:39851 8450s 2024-11-23 22:42:15,835 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42499 8450s 2024-11-23 22:42:15,835 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:42:15,835 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:42:15,835 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:42:15,835 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-48q87uuw 8450s 2024-11-23 22:42:15,835 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:42:15,838 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36341 8450s 2024-11-23 22:42:15,838 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36341 8450s 2024-11-23 22:42:15,838 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:42:15,838 - distributed.worker - INFO - dashboard at: 127.0.0.1:38145 8450s 2024-11-23 22:42:15,838 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42499 8450s 2024-11-23 22:42:15,838 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:42:15,838 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:42:15,838 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:42:15,838 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-m_hf2c11 8450s 2024-11-23 22:42:15,838 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:42:15,839 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33503. Reason: failure-to-start- 8450s 2024-11-23 22:42:15,839 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:42:15,840 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36341. Reason: failure-to-start- 8450s 2024-11-23 22:42:15,840 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:42:15,841 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42499': TLS handshake failed with remote 'tls://127.0.0.1:53492': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:42:15,841 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42499': TLS handshake failed with remote 'tls://127.0.0.1:53498': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:42:15,843 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:42:16,849 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:42:16,881 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38519 8450s 2024-11-23 22:42:16,882 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39859/status 8450s 2024-11-23 22:42:16,883 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:42:16,899 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46751 8450s 2024-11-23 22:42:16,899 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46751 8450s 2024-11-23 22:42:16,899 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:42:16,899 - distributed.worker - INFO - dashboard at: 127.0.0.1:35513 8450s 2024-11-23 22:42:16,899 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38519 8450s 2024-11-23 22:42:16,899 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:42:16,899 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:42:16,899 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:42:16,900 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-nof27zu_ 8450s 2024-11-23 22:42:16,900 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:42:16,902 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42327 8450s 2024-11-23 22:42:16,902 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42327 8450s 2024-11-23 22:42:16,902 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:42:16,902 - distributed.worker - INFO - dashboard at: 127.0.0.1:39873 8450s 2024-11-23 22:42:16,902 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38519 8450s 2024-11-23 22:42:16,902 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:42:16,902 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:42:16,902 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:42:16,902 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-0c1uqa_5 8450s 2024-11-23 22:42:16,902 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:42:16,903 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46751. Reason: failure-to-start- 8450s 2024-11-23 22:42:16,903 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:42:16,904 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42327. Reason: failure-to-start- 8450s 2024-11-23 22:42:16,904 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:42:16,905 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38519': TLS handshake failed with remote 'tls://127.0.0.1:43122': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:42:16,905 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38519': TLS handshake failed with remote 'tls://127.0.0.1:43134': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:42:16,907 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:42:17,912 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:42:17,919 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38823 8450s 2024-11-23 22:42:17,920 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36329/status 8450s 2024-11-23 22:42:17,920 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:42:17,934 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37235 8450s 2024-11-23 22:42:17,934 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37235 8450s 2024-11-23 22:42:17,935 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:42:17,935 - distributed.worker - INFO - dashboard at: 127.0.0.1:39297 8450s 2024-11-23 22:42:17,935 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38823 8450s 2024-11-23 22:42:17,935 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:42:17,935 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:42:17,935 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:42:17,935 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ds_h50i7 8450s 2024-11-23 22:42:17,935 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:42:17,937 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43631 8450s 2024-11-23 22:42:17,937 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43631 8450s 2024-11-23 22:42:17,937 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:42:17,937 - distributed.worker - INFO - dashboard at: 127.0.0.1:39451 8450s 2024-11-23 22:42:17,937 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38823 8450s 2024-11-23 22:42:17,937 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:42:17,937 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:42:17,937 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:42:17,937 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-eaj10xt7 8450s 2024-11-23 22:42:17,937 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:42:17,938 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37235. Reason: failure-to-start- 8450s 2024-11-23 22:42:17,938 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:42:17,939 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43631. Reason: failure-to-start- 8450s 2024-11-23 22:42:17,939 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:42:17,940 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38823': TLS handshake failed with remote 'tls://127.0.0.1:56372': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:42:17,940 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38823': TLS handshake failed with remote 'tls://127.0.0.1:56374': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:42:17,942 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:42:18,946 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:42:18,953 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39499 8450s 2024-11-23 22:42:18,954 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35191/status 8450s 2024-11-23 22:42:18,954 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:42:18,968 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33493 8450s 2024-11-23 22:42:18,968 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33493 8450s 2024-11-23 22:42:18,968 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:42:18,968 - distributed.worker - INFO - dashboard at: 127.0.0.1:32985 8450s 2024-11-23 22:42:18,968 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39499 8450s 2024-11-23 22:42:18,968 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:42:18,968 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:42:18,968 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:42:18,968 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-mpvqiwti 8450s 2024-11-23 22:42:18,968 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:42:18,970 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44631 8450s 2024-11-23 22:42:18,970 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44631 8450s 2024-11-23 22:42:18,970 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:42:18,970 - distributed.worker - INFO - dashboard at: 127.0.0.1:41219 8450s 2024-11-23 22:42:18,970 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39499 8450s 2024-11-23 22:42:18,970 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:42:18,970 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:42:18,970 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:42:18,971 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ih9e7__a 8450s 2024-11-23 22:42:18,971 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:42:18,972 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33493. Reason: failure-to-start- 8450s 2024-11-23 22:42:18,972 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:42:18,973 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44631. Reason: failure-to-start- 8450s 2024-11-23 22:42:18,973 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:42:18,974 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39499': TLS handshake failed with remote 'tls://127.0.0.1:55236': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:42:18,974 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39499': TLS handshake failed with remote 'tls://127.0.0.1:55250': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:42:18,976 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:42:19,981 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:42:19,987 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34675 8450s 2024-11-23 22:42:19,987 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42893/status 8450s 2024-11-23 22:42:19,987 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:42:20,000 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34983 8450s 2024-11-23 22:42:20,000 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34983 8450s 2024-11-23 22:42:20,000 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:42:20,000 - distributed.worker - INFO - dashboard at: 127.0.0.1:40177 8450s 2024-11-23 22:42:20,000 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34675 8450s 2024-11-23 22:42:20,000 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:42:20,000 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:42:20,000 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:42:20,000 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-43i3_n98 8450s 2024-11-23 22:42:20,000 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:42:20,002 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39153 8450s 2024-11-23 22:42:20,002 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39153 8450s 2024-11-23 22:42:20,002 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:42:20,002 - distributed.worker - INFO - dashboard at: 127.0.0.1:38131 8450s 2024-11-23 22:42:20,002 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34675 8450s 2024-11-23 22:42:20,002 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:42:20,003 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:42:20,003 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:42:20,003 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-e6gmtxv6 8450s 2024-11-23 22:42:20,003 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:42:20,004 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34983. Reason: failure-to-start- 8450s 2024-11-23 22:42:20,004 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:42:20,004 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39153. Reason: failure-to-start- 8450s 2024-11-23 22:42:20,004 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:42:20,006 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34675': TLS handshake failed with remote 'tls://127.0.0.1:37710': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:42:20,006 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34675': TLS handshake failed with remote 'tls://127.0.0.1:37714': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:42:20,007 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:42:21,015 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:42:21,025 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42861 8450s 2024-11-23 22:42:21,025 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46715/status 8450s 2024-11-23 22:42:21,025 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:42:21,038 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38187 8450s 2024-11-23 22:42:21,038 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38187 8450s 2024-11-23 22:42:21,038 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:42:21,038 - distributed.worker - INFO - dashboard at: 127.0.0.1:38515 8450s 2024-11-23 22:42:21,038 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42861 8450s 2024-11-23 22:42:21,038 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:42:21,038 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:42:21,039 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:42:21,039 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-3yytt8gt 8450s 2024-11-23 22:42:21,039 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:42:21,040 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45649 8450s 2024-11-23 22:42:21,041 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45649 8450s 2024-11-23 22:42:21,041 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:42:21,041 - distributed.worker - INFO - dashboard at: 127.0.0.1:38631 8450s 2024-11-23 22:42:21,041 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42861 8450s 2024-11-23 22:42:21,041 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:42:21,041 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:42:21,041 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:42:21,041 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-tjmjexv1 8450s 2024-11-23 22:42:21,042 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:42:21,043 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38187. Reason: failure-to-start- 8450s 2024-11-23 22:42:21,043 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:42:21,043 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45649. Reason: failure-to-start- 8450s 2024-11-23 22:42:21,043 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:42:21,045 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42861': TLS handshake failed with remote 'tls://127.0.0.1:56312': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:42:21,045 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42861': TLS handshake failed with remote 'tls://127.0.0.1:56322': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:42:21,046 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:42:22,057 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:42:22,065 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45757 8450s 2024-11-23 22:42:22,066 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42103/status 8450s 2024-11-23 22:42:22,066 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:42:22,080 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42207 8450s 2024-11-23 22:42:22,081 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42207 8450s 2024-11-23 22:42:22,081 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:42:22,081 - distributed.worker - INFO - dashboard at: 127.0.0.1:36877 8450s 2024-11-23 22:42:22,081 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45757 8450s 2024-11-23 22:42:22,081 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:42:22,081 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:42:22,081 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:42:22,081 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-3qnogbsc 8450s 2024-11-23 22:42:22,081 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:42:22,083 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40057 8450s 2024-11-23 22:42:22,083 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40057 8450s 2024-11-23 22:42:22,083 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:42:22,083 - distributed.worker - INFO - dashboard at: 127.0.0.1:44621 8450s 2024-11-23 22:42:22,083 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45757 8450s 2024-11-23 22:42:22,083 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:42:22,083 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:42:22,083 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:42:22,083 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-008i1h8_ 8450s 2024-11-23 22:42:22,083 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:42:22,084 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42207. Reason: failure-to-start- 8450s 2024-11-23 22:42:22,084 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:42:22,085 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40057. Reason: failure-to-start- 8450s 2024-11-23 22:42:22,085 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:42:22,087 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45757': TLS handshake failed with remote 'tls://127.0.0.1:46030': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:42:22,087 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45757': TLS handshake failed with remote 'tls://127.0.0.1:46044': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:42:22,089 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:42:23,094 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:42:23,100 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44043 8450s 2024-11-23 22:42:23,100 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33895/status 8450s 2024-11-23 22:42:23,101 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:42:23,112 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45713 8450s 2024-11-23 22:42:23,112 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45713 8450s 2024-11-23 22:42:23,113 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:42:23,113 - distributed.worker - INFO - dashboard at: 127.0.0.1:42577 8450s 2024-11-23 22:42:23,113 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44043 8450s 2024-11-23 22:42:23,113 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:42:23,113 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:42:23,113 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:42:23,113 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-k15yif0j 8450s 2024-11-23 22:42:23,113 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:42:23,115 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45465 8450s 2024-11-23 22:42:23,115 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45465 8450s 2024-11-23 22:42:23,115 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:42:23,115 - distributed.worker - INFO - dashboard at: 127.0.0.1:46843 8450s 2024-11-23 22:42:23,116 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44043 8450s 2024-11-23 22:42:23,116 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:42:23,116 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:42:23,116 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:42:23,116 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-gnecskha 8450s 2024-11-23 22:42:23,116 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:42:23,117 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45713. Reason: failure-to-start- 8450s 2024-11-23 22:42:23,117 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:42:23,117 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45465. Reason: failure-to-start- 8450s 2024-11-23 22:42:23,117 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:42:23,118 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44043': TLS handshake failed with remote 'tls://127.0.0.1:44136': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:42:23,119 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44043': TLS handshake failed with remote 'tls://127.0.0.1:44140': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:42:23,120 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:42:24,125 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:42:24,131 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34045 8450s 2024-11-23 22:42:24,131 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35899/status 8450s 2024-11-23 22:42:24,131 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:42:24,143 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38579 8450s 2024-11-23 22:42:24,143 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38579 8450s 2024-11-23 22:42:24,143 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:42:24,143 - distributed.worker - INFO - dashboard at: 127.0.0.1:43379 8450s 2024-11-23 22:42:24,143 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34045 8450s 2024-11-23 22:42:24,143 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:42:24,143 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:42:24,144 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:42:24,144 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-853ke_1k 8450s 2024-11-23 22:42:24,144 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:42:24,145 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44723 8450s 2024-11-23 22:42:24,145 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44723 8450s 2024-11-23 22:42:24,146 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:42:24,146 - distributed.worker - INFO - dashboard at: 127.0.0.1:33291 8450s 2024-11-23 22:42:24,146 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34045 8450s 2024-11-23 22:42:24,146 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:42:24,146 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:42:24,146 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:42:24,146 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-y5v0uqgx 8450s 2024-11-23 22:42:24,146 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:42:24,149 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38579. Reason: failure-to-start- 8450s 2024-11-23 22:42:24,149 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:42:24,149 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44723. Reason: failure-to-start- 8450s 2024-11-23 22:42:24,149 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:42:24,150 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34045': TLS handshake failed with remote 'tls://127.0.0.1:39320': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:42:24,150 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34045': TLS handshake failed with remote 'tls://127.0.0.1:39322': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:42:24,152 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:42:25,158 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:42:25,164 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37625 8450s 2024-11-23 22:42:25,164 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35653/status 8450s 2024-11-23 22:42:25,164 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:42:25,176 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37081 8450s 2024-11-23 22:42:25,176 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37081 8450s 2024-11-23 22:42:25,176 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:42:25,176 - distributed.worker - INFO - dashboard at: 127.0.0.1:38031 8450s 2024-11-23 22:42:25,176 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37625 8450s 2024-11-23 22:42:25,176 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:42:25,176 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:42:25,176 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:42:25,176 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-3qmbwkqn 8450s 2024-11-23 22:42:25,176 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:42:25,178 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46021 8450s 2024-11-23 22:42:25,178 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46021 8450s 2024-11-23 22:42:25,178 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:42:25,178 - distributed.worker - INFO - dashboard at: 127.0.0.1:35013 8450s 2024-11-23 22:42:25,178 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37625 8450s 2024-11-23 22:42:25,178 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:42:25,178 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:42:25,178 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:42:25,178 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-egcpj8oa 8450s 2024-11-23 22:42:25,179 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:42:25,181 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37081. Reason: failure-to-start- 8450s 2024-11-23 22:42:25,181 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:42:25,182 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46021. Reason: failure-to-start- 8450s 2024-11-23 22:42:25,182 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:42:25,183 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37625': TLS handshake failed with remote 'tls://127.0.0.1:37426': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:42:25,183 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37625': TLS handshake failed with remote 'tls://127.0.0.1:37430': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:42:25,184 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:42:26,191 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:42:26,203 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:32857 8450s 2024-11-23 22:42:26,203 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38027/status 8450s 2024-11-23 22:42:26,204 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:42:26,231 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38973 8450s 2024-11-23 22:42:26,232 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38973 8450s 2024-11-23 22:42:26,232 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:42:26,232 - distributed.worker - INFO - dashboard at: 127.0.0.1:43279 8450s 2024-11-23 22:42:26,232 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:32857 8450s 2024-11-23 22:42:26,232 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:42:26,232 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:42:26,233 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:42:26,233 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-71f9xx8g 8450s 2024-11-23 22:42:26,233 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:42:26,236 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37681 8450s 2024-11-23 22:42:26,237 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37681 8450s 2024-11-23 22:42:26,237 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:42:26,237 - distributed.worker - INFO - dashboard at: 127.0.0.1:44601 8450s 2024-11-23 22:42:26,237 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:32857 8450s 2024-11-23 22:42:26,237 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:42:26,237 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:42:26,237 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:42:26,237 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-fcw5oto0 8450s 2024-11-23 22:42:26,237 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:42:26,244 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38973. Reason: failure-to-start- 8450s 2024-11-23 22:42:26,244 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:42:26,245 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37681. Reason: failure-to-start- 8450s 2024-11-23 22:42:26,246 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:42:26,248 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:32857': TLS handshake failed with remote 'tls://127.0.0.1:55388': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:42:26,249 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:32857': TLS handshake failed with remote 'tls://127.0.0.1:55402': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:42:26,251 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:42:27,264 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:42:27,276 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36469 8450s 2024-11-23 22:42:27,276 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39929/status 8450s 2024-11-23 22:42:27,277 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:42:27,327 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38233 8450s 2024-11-23 22:42:27,327 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38233 8450s 2024-11-23 22:42:27,328 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:42:27,328 - distributed.worker - INFO - dashboard at: 127.0.0.1:40103 8450s 2024-11-23 22:42:27,328 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36469 8450s 2024-11-23 22:42:27,328 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:42:27,328 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:42:27,328 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:42:27,328 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-fsks3dcj 8450s 2024-11-23 22:42:27,328 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:42:27,332 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43945 8450s 2024-11-23 22:42:27,333 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43945 8450s 2024-11-23 22:42:27,333 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:42:27,333 - distributed.worker - INFO - dashboard at: 127.0.0.1:34677 8450s 2024-11-23 22:42:27,333 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36469 8450s 2024-11-23 22:42:27,333 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:42:27,333 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:42:27,333 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:42:27,333 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-gisfx_zk 8450s 2024-11-23 22:42:27,333 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:42:27,343 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38233. Reason: failure-to-start- 8450s 2024-11-23 22:42:27,343 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:42:27,344 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43945. Reason: failure-to-start- 8450s 2024-11-23 22:42:27,344 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:42:27,347 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36469': TLS handshake failed with remote 'tls://127.0.0.1:41892': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:42:27,347 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36469': TLS handshake failed with remote 'tls://127.0.0.1:41894': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:42:27,350 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:42:28,358 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:42:28,369 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33135 8450s 2024-11-23 22:42:28,369 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36067/status 8450s 2024-11-23 22:42:28,370 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:42:28,394 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43871 8450s 2024-11-23 22:42:28,394 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43871 8450s 2024-11-23 22:42:28,394 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:42:28,394 - distributed.worker - INFO - dashboard at: 127.0.0.1:43031 8450s 2024-11-23 22:42:28,394 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33135 8450s 2024-11-23 22:42:28,394 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:42:28,394 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:42:28,394 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:42:28,394 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-dpbpvvkp 8450s 2024-11-23 22:42:28,395 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:42:28,398 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46247 8450s 2024-11-23 22:42:28,399 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46247 8450s 2024-11-23 22:42:28,399 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:42:28,399 - distributed.worker - INFO - dashboard at: 127.0.0.1:34529 8450s 2024-11-23 22:42:28,399 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33135 8450s 2024-11-23 22:42:28,399 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:42:28,399 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:42:28,399 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:42:28,399 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-blmyv4fz 8450s 2024-11-23 22:42:28,399 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:42:28,405 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43871. Reason: failure-to-start- 8450s 2024-11-23 22:42:28,406 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:42:28,406 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46247. Reason: failure-to-start- 8450s 2024-11-23 22:42:28,408 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:42:28,411 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33135': TLS handshake failed with remote 'tls://127.0.0.1:44810': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:42:28,411 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33135': TLS handshake failed with remote 'tls://127.0.0.1:44812': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:42:28,414 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:42:29,421 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:42:29,433 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45059 8450s 2024-11-23 22:42:29,433 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43793/status 8450s 2024-11-23 22:42:29,434 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:42:29,462 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45817 8450s 2024-11-23 22:42:29,462 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45817 8450s 2024-11-23 22:42:29,462 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:42:29,462 - distributed.worker - INFO - dashboard at: 127.0.0.1:39109 8450s 2024-11-23 22:42:29,462 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45059 8450s 2024-11-23 22:42:29,462 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:42:29,463 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:42:29,463 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:42:29,463 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-5bc99pla 8450s 2024-11-23 22:42:29,463 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:42:29,467 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44411 8450s 2024-11-23 22:42:29,467 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44411 8450s 2024-11-23 22:42:29,467 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:42:29,467 - distributed.worker - INFO - dashboard at: 127.0.0.1:41339 8450s 2024-11-23 22:42:29,467 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45059 8450s 2024-11-23 22:42:29,467 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:42:29,468 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:42:29,468 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:42:29,468 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ebx3scv_ 8450s 2024-11-23 22:42:29,468 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:42:29,474 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45817. Reason: failure-to-start- 8450s 2024-11-23 22:42:29,474 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:42:29,475 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44411. Reason: failure-to-start- 8450s 2024-11-23 22:42:29,476 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:42:29,478 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45059': TLS handshake failed with remote 'tls://127.0.0.1:57142': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:42:29,479 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45059': TLS handshake failed with remote 'tls://127.0.0.1:57154': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:42:29,481 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:42:30,490 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:42:30,505 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42097 8450s 2024-11-23 22:42:30,506 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43795/status 8450s 2024-11-23 22:42:30,506 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:42:30,535 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35409 8450s 2024-11-23 22:42:30,535 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35409 8450s 2024-11-23 22:42:30,536 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:42:30,536 - distributed.worker - INFO - dashboard at: 127.0.0.1:43441 8450s 2024-11-23 22:42:30,536 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42097 8450s 2024-11-23 22:42:30,536 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:42:30,536 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:42:30,536 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:42:30,536 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-iwc6c0f8 8450s 2024-11-23 22:42:30,536 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:42:30,540 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39493 8450s 2024-11-23 22:42:30,540 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39493 8450s 2024-11-23 22:42:30,540 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:42:30,540 - distributed.worker - INFO - dashboard at: 127.0.0.1:41671 8450s 2024-11-23 22:42:30,541 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42097 8450s 2024-11-23 22:42:30,541 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:42:30,541 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:42:30,541 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:42:30,541 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-xds3u5lb 8450s 2024-11-23 22:42:30,541 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:42:30,547 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35409. Reason: failure-to-start- 8450s 2024-11-23 22:42:30,547 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:42:30,548 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39493. Reason: failure-to-start- 8450s 2024-11-23 22:42:30,548 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:42:30,551 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42097': TLS handshake failed with remote 'tls://127.0.0.1:57610': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:42:30,551 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42097': TLS handshake failed with remote 'tls://127.0.0.1:57620': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:42:30,554 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:42:31,563 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:42:31,576 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34905 8450s 2024-11-23 22:42:31,577 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41815/status 8450s 2024-11-23 22:42:31,578 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:42:31,610 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44289 8450s 2024-11-23 22:42:31,611 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44289 8450s 2024-11-23 22:42:31,611 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:42:31,611 - distributed.worker - INFO - dashboard at: 127.0.0.1:46329 8450s 2024-11-23 22:42:31,611 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34905 8450s 2024-11-23 22:42:31,611 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:42:31,611 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:42:31,611 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:42:31,611 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-vw6p9_iu 8450s 2024-11-23 22:42:31,612 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:42:31,616 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40001 8450s 2024-11-23 22:42:31,616 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40001 8450s 2024-11-23 22:42:31,616 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:42:31,617 - distributed.worker - INFO - dashboard at: 127.0.0.1:34177 8450s 2024-11-23 22:42:31,617 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34905 8450s 2024-11-23 22:42:31,617 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:42:31,617 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:42:31,617 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:42:31,617 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-7bgn381q 8450s 2024-11-23 22:42:31,617 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:42:31,623 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44289. Reason: failure-to-start- 8450s 2024-11-23 22:42:31,623 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:42:31,624 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40001. Reason: failure-to-start- 8450s 2024-11-23 22:42:31,625 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:42:31,627 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34905': TLS handshake failed with remote 'tls://127.0.0.1:34738': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:42:31,628 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34905': TLS handshake failed with remote 'tls://127.0.0.1:34748': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:42:31,631 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:42:32,641 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:42:32,652 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41101 8450s 2024-11-23 22:42:32,653 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33861/status 8450s 2024-11-23 22:42:32,653 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:42:32,681 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44397 8450s 2024-11-23 22:42:32,681 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44397 8450s 2024-11-23 22:42:32,681 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:42:32,682 - distributed.worker - INFO - dashboard at: 127.0.0.1:32827 8450s 2024-11-23 22:42:32,682 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41101 8450s 2024-11-23 22:42:32,682 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:42:32,682 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:42:32,682 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:42:32,682 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-mx_qfojt 8450s 2024-11-23 22:42:32,682 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:42:32,689 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45775 8450s 2024-11-23 22:42:32,689 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45775 8450s 2024-11-23 22:42:32,689 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:42:32,689 - distributed.worker - INFO - dashboard at: 127.0.0.1:39153 8450s 2024-11-23 22:42:32,689 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41101 8450s 2024-11-23 22:42:32,689 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:42:32,689 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:42:32,689 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:42:32,689 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-uc_1jdom 8450s 2024-11-23 22:42:32,690 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:42:32,699 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44397. Reason: failure-to-start- 8450s 2024-11-23 22:42:32,699 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:42:32,700 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45775. Reason: failure-to-start- 8450s 2024-11-23 22:42:32,701 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:42:32,704 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41101': TLS handshake failed with remote 'tls://127.0.0.1:39258': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:42:32,704 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41101': TLS handshake failed with remote 'tls://127.0.0.1:39268': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:42:32,711 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:42:33,719 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:42:33,731 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38713 8450s 2024-11-23 22:42:33,732 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41507/status 8450s 2024-11-23 22:42:33,733 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:42:33,761 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35651 8450s 2024-11-23 22:42:33,762 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35651 8450s 2024-11-23 22:42:33,762 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:42:33,762 - distributed.worker - INFO - dashboard at: 127.0.0.1:39925 8450s 2024-11-23 22:42:33,762 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38713 8450s 2024-11-23 22:42:33,762 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:42:33,762 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:42:33,762 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:42:33,762 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-gwj85nt1 8450s 2024-11-23 22:42:33,762 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:42:33,766 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41727 8450s 2024-11-23 22:42:33,767 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41727 8450s 2024-11-23 22:42:33,767 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:42:33,767 - distributed.worker - INFO - dashboard at: 127.0.0.1:33319 8450s 2024-11-23 22:42:33,767 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38713 8450s 2024-11-23 22:42:33,767 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:42:33,767 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:42:33,767 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:42:33,767 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-4kttn_4_ 8450s 2024-11-23 22:42:33,768 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:42:33,776 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35651. Reason: failure-to-start- 8450s 2024-11-23 22:42:33,776 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:42:33,777 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41727. Reason: failure-to-start- 8450s 2024-11-23 22:42:33,778 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:42:33,781 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38713': TLS handshake failed with remote 'tls://127.0.0.1:53026': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:42:33,781 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38713': TLS handshake failed with remote 'tls://127.0.0.1:53028': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:42:33,788 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:42:34,796 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:42:34,807 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41565 8450s 2024-11-23 22:42:34,807 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43649/status 8450s 2024-11-23 22:42:34,808 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:42:34,831 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33951 8450s 2024-11-23 22:42:34,831 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33951 8450s 2024-11-23 22:42:34,831 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:42:34,832 - distributed.worker - INFO - dashboard at: 127.0.0.1:39421 8450s 2024-11-23 22:42:34,832 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41565 8450s 2024-11-23 22:42:34,832 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:42:34,832 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:42:34,832 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:42:34,832 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-i_h8mbxg 8450s 2024-11-23 22:42:34,832 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:42:34,836 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36715 8450s 2024-11-23 22:42:34,836 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36715 8450s 2024-11-23 22:42:34,837 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:42:34,837 - distributed.worker - INFO - dashboard at: 127.0.0.1:39369 8450s 2024-11-23 22:42:34,837 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41565 8450s 2024-11-23 22:42:34,837 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:42:34,837 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:42:34,837 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:42:34,837 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-8cvmw1ss 8450s 2024-11-23 22:42:34,837 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:42:34,843 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33951. Reason: failure-to-start- 8450s 2024-11-23 22:42:34,843 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:42:34,844 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36715. Reason: failure-to-start- 8450s 2024-11-23 22:42:34,845 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:42:34,847 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41565': TLS handshake failed with remote 'tls://127.0.0.1:42970': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:42:34,848 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41565': TLS handshake failed with remote 'tls://127.0.0.1:42974': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:42:34,850 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:42:35,861 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:42:35,874 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46557 8450s 2024-11-23 22:42:35,874 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36539/status 8450s 2024-11-23 22:42:35,875 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:42:35,904 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40187 8450s 2024-11-23 22:42:35,904 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40187 8450s 2024-11-23 22:42:35,904 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:42:35,904 - distributed.worker - INFO - dashboard at: 127.0.0.1:36641 8450s 2024-11-23 22:42:35,904 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46557 8450s 2024-11-23 22:42:35,904 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:42:35,904 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:42:35,905 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:42:35,905 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-dc4jpci7 8450s 2024-11-23 22:42:35,905 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:42:35,909 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41269 8450s 2024-11-23 22:42:35,909 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41269 8450s 2024-11-23 22:42:35,909 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:42:35,909 - distributed.worker - INFO - dashboard at: 127.0.0.1:42599 8450s 2024-11-23 22:42:35,909 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46557 8450s 2024-11-23 22:42:35,909 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:42:35,909 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:42:35,909 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:42:35,909 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-wpie671l 8450s 2024-11-23 22:42:35,909 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:42:35,916 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40187. Reason: failure-to-start- 8450s 2024-11-23 22:42:35,917 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:42:35,918 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41269. Reason: failure-to-start- 8450s 2024-11-23 22:42:35,918 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:42:35,921 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46557': TLS handshake failed with remote 'tls://127.0.0.1:60836': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:42:35,921 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46557': TLS handshake failed with remote 'tls://127.0.0.1:60848': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:42:35,929 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:42:36,937 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:42:36,949 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43251 8450s 2024-11-23 22:42:36,949 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37373/status 8450s 2024-11-23 22:42:36,950 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:42:36,981 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41347 8450s 2024-11-23 22:42:36,981 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41347 8450s 2024-11-23 22:42:36,981 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:42:36,982 - distributed.worker - INFO - dashboard at: 127.0.0.1:46735 8450s 2024-11-23 22:42:36,982 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43251 8450s 2024-11-23 22:42:36,982 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:42:36,982 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:42:36,982 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:42:36,982 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-nuh2_n30 8450s 2024-11-23 22:42:36,982 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:42:36,986 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40977 8450s 2024-11-23 22:42:36,986 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40977 8450s 2024-11-23 22:42:36,986 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:42:36,986 - distributed.worker - INFO - dashboard at: 127.0.0.1:43085 8450s 2024-11-23 22:42:36,986 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43251 8450s 2024-11-23 22:42:36,986 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:42:36,987 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:42:36,987 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:42:36,987 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-wcowpz6b 8450s 2024-11-23 22:42:36,987 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:42:36,994 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41347. Reason: failure-to-start- 8450s 2024-11-23 22:42:36,994 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:42:36,995 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40977. Reason: failure-to-start- 8450s 2024-11-23 22:42:36,996 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:42:37,002 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43251': TLS handshake failed with remote 'tls://127.0.0.1:56154': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:42:37,002 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43251': TLS handshake failed with remote 'tls://127.0.0.1:56170': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:42:37,005 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:42:38,011 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:42:38,018 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36553 8450s 2024-11-23 22:42:38,018 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41955/status 8450s 2024-11-23 22:42:38,019 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:42:38,046 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35731 8450s 2024-11-23 22:42:38,046 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35731 8450s 2024-11-23 22:42:38,046 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:42:38,047 - distributed.worker - INFO - dashboard at: 127.0.0.1:34219 8450s 2024-11-23 22:42:38,047 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36553 8450s 2024-11-23 22:42:38,047 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:42:38,047 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:42:38,047 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:42:38,047 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-4_eykdrb 8450s 2024-11-23 22:42:38,047 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:42:38,051 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46775 8450s 2024-11-23 22:42:38,051 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46775 8450s 2024-11-23 22:42:38,051 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:42:38,051 - distributed.worker - INFO - dashboard at: 127.0.0.1:33457 8450s 2024-11-23 22:42:38,052 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36553 8450s 2024-11-23 22:42:38,052 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:42:38,052 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:42:38,052 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:42:38,052 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-yw_m7rtv 8450s 2024-11-23 22:42:38,052 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:42:38,059 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35731. Reason: failure-to-start- 8450s 2024-11-23 22:42:38,059 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:42:38,060 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46775. Reason: failure-to-start- 8450s 2024-11-23 22:42:38,060 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:42:38,063 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36553': TLS handshake failed with remote 'tls://127.0.0.1:46406': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:42:38,063 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36553': TLS handshake failed with remote 'tls://127.0.0.1:46414': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:42:38,067 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:42:39,075 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:42:39,086 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43639 8450s 2024-11-23 22:42:39,087 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34699/status 8450s 2024-11-23 22:42:39,087 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:42:39,115 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45553 8450s 2024-11-23 22:42:39,116 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45553 8450s 2024-11-23 22:42:39,116 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:42:39,116 - distributed.worker - INFO - dashboard at: 127.0.0.1:37847 8450s 2024-11-23 22:42:39,116 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43639 8450s 2024-11-23 22:42:39,116 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:42:39,116 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:42:39,116 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:42:39,116 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-emv92mo3 8450s 2024-11-23 22:42:39,116 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:42:39,120 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45255 8450s 2024-11-23 22:42:39,120 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45255 8450s 2024-11-23 22:42:39,121 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:42:39,121 - distributed.worker - INFO - dashboard at: 127.0.0.1:40145 8450s 2024-11-23 22:42:39,121 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43639 8450s 2024-11-23 22:42:39,121 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:42:39,121 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:42:39,121 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:42:39,121 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-8y7jqz5s 8450s 2024-11-23 22:42:39,121 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:42:39,130 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45553. Reason: failure-to-start- 8450s 2024-11-23 22:42:39,130 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:42:39,131 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45255. Reason: failure-to-start- 8450s 2024-11-23 22:42:39,131 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:42:39,134 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43639': TLS handshake failed with remote 'tls://127.0.0.1:44326': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:42:39,134 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43639': TLS handshake failed with remote 'tls://127.0.0.1:44334': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:42:39,144 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:42:40,152 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:42:40,163 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44263 8450s 2024-11-23 22:42:40,164 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41123/status 8450s 2024-11-23 22:42:40,164 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:42:40,193 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35459 8450s 2024-11-23 22:42:40,194 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35459 8450s 2024-11-23 22:42:40,194 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:42:40,194 - distributed.worker - INFO - dashboard at: 127.0.0.1:43617 8450s 2024-11-23 22:42:40,194 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44263 8450s 2024-11-23 22:42:40,194 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:42:40,194 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:42:40,194 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:42:40,194 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-q1su3x4w 8450s 2024-11-23 22:42:40,194 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:42:40,198 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44515 8450s 2024-11-23 22:42:40,198 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44515 8450s 2024-11-23 22:42:40,198 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:42:40,198 - distributed.worker - INFO - dashboard at: 127.0.0.1:44081 8450s 2024-11-23 22:42:40,198 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44263 8450s 2024-11-23 22:42:40,198 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:42:40,199 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:42:40,199 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:42:40,199 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-097vv_b9 8450s 2024-11-23 22:42:40,199 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:42:40,207 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35459. Reason: failure-to-start- 8450s 2024-11-23 22:42:40,208 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:42:40,209 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44515. Reason: failure-to-start- 8450s 2024-11-23 22:42:40,209 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:42:40,212 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44263': TLS handshake failed with remote 'tls://127.0.0.1:33674': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:42:40,212 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44263': TLS handshake failed with remote 'tls://127.0.0.1:33688': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:42:40,218 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:42:41,226 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:42:41,236 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42255 8450s 2024-11-23 22:42:41,237 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36921/status 8450s 2024-11-23 22:42:41,237 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:42:41,265 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45571 8450s 2024-11-23 22:42:41,265 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45571 8450s 2024-11-23 22:42:41,266 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:42:41,266 - distributed.worker - INFO - dashboard at: 127.0.0.1:37851 8450s 2024-11-23 22:42:41,266 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42255 8450s 2024-11-23 22:42:41,266 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:42:41,266 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:42:41,266 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:42:41,266 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-5yj_5mzt 8450s 2024-11-23 22:42:41,266 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:42:41,270 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39857 8450s 2024-11-23 22:42:41,270 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39857 8450s 2024-11-23 22:42:41,271 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:42:41,271 - distributed.worker - INFO - dashboard at: 127.0.0.1:38615 8450s 2024-11-23 22:42:41,271 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42255 8450s 2024-11-23 22:42:41,271 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:42:41,271 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:42:41,271 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:42:41,271 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-qha_inei 8450s 2024-11-23 22:42:41,271 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:42:41,278 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45571. Reason: failure-to-start- 8450s 2024-11-23 22:42:41,278 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:42:41,279 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39857. Reason: failure-to-start- 8450s 2024-11-23 22:42:41,279 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:42:41,283 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42255': TLS handshake failed with remote 'tls://127.0.0.1:45202': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:42:41,283 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42255': TLS handshake failed with remote 'tls://127.0.0.1:45204': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:42:41,290 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:42:42,301 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:42:42,313 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36339 8450s 2024-11-23 22:42:42,314 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36625/status 8450s 2024-11-23 22:42:42,315 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:42:42,343 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41385 8450s 2024-11-23 22:42:42,344 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41385 8450s 2024-11-23 22:42:42,344 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:42:42,344 - distributed.worker - INFO - dashboard at: 127.0.0.1:43621 8450s 2024-11-23 22:42:42,344 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36339 8450s 2024-11-23 22:42:42,344 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:42:42,344 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:42:42,344 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:42:42,344 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-won6kor0 8450s 2024-11-23 22:42:42,345 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:42:42,348 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45641 8450s 2024-11-23 22:42:42,349 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45641 8450s 2024-11-23 22:42:42,349 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:42:42,349 - distributed.worker - INFO - dashboard at: 127.0.0.1:42775 8450s 2024-11-23 22:42:42,349 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36339 8450s 2024-11-23 22:42:42,349 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:42:42,349 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:42:42,349 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:42:42,349 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-luk1g0t0 8450s 2024-11-23 22:42:42,349 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:42:42,356 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41385. Reason: failure-to-start- 8450s 2024-11-23 22:42:42,356 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:42:42,357 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45641. Reason: failure-to-start- 8450s 2024-11-23 22:42:42,358 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:42:42,360 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36339': TLS handshake failed with remote 'tls://127.0.0.1:39730': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:42:42,361 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36339': TLS handshake failed with remote 'tls://127.0.0.1:39732': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:42:42,364 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s _________________________________ test_scatter _________________________________ 8450s 8450s fut = , timeout = 0 8450s 8450s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 8450s async with asyncio.timeout(timeout): 8450s > return await fut 8450s 8450s /usr/lib/python3/dist-packages/distributed/utils.py:1960: 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s /usr/lib/python3/dist-packages/distributed/worker.py:1480: in start_unsafe 8450s await self._register_with_scheduler() 8450s /usr/lib/python3/dist-packages/distributed/worker.py:1179: in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s /usr/lib/python3/dist-packages/distributed/comm/core.py:342: in connect 8450s comm = await wait_for( 8450s /usr/lib/python3/dist-packages/distributed/utils.py:1960: in wait_for 8450s return await fut 8450s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:546: in connect 8450s stream = await self.client.connect( 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s 8450s self = , host = '127.0.0.1' 8450s port = 35283, af = 8450s ssl_options = 8450s max_buffer_size = 8364507136.0, source_ip = None, source_port = None 8450s timeout = None 8450s 8450s async def connect( 8450s self, 8450s host: str, 8450s port: int, 8450s af: socket.AddressFamily = socket.AF_UNSPEC, 8450s ssl_options: Optional[Union[Dict[str, Any], ssl.SSLContext]] = None, 8450s max_buffer_size: Optional[int] = None, 8450s source_ip: Optional[str] = None, 8450s source_port: Optional[int] = None, 8450s timeout: Optional[Union[float, datetime.timedelta]] = None, 8450s ) -> IOStream: 8450s """Connect to the given host and port. 8450s 8450s Asynchronously returns an `.IOStream` (or `.SSLIOStream` if 8450s ``ssl_options`` is not None). 8450s 8450s Using the ``source_ip`` kwarg, one can specify the source 8450s IP address to use when establishing the connection. 8450s In case the user needs to resolve and 8450s use a specific interface, it has to be handled outside 8450s of Tornado as this depends very much on the platform. 8450s 8450s Raises `TimeoutError` if the input future does not complete before 8450s ``timeout``, which may be specified in any form allowed by 8450s `.IOLoop.add_timeout` (i.e. a `datetime.timedelta` or an absolute time 8450s relative to `.IOLoop.time`) 8450s 8450s Similarly, when the user requires a certain source port, it can 8450s be specified using the ``source_port`` arg. 8450s 8450s .. versionchanged:: 4.5 8450s Added the ``source_ip`` and ``source_port`` arguments. 8450s 8450s .. versionchanged:: 5.0 8450s Added the ``timeout`` argument. 8450s """ 8450s if timeout is not None: 8450s if isinstance(timeout, numbers.Real): 8450s timeout = IOLoop.current().time() + timeout 8450s elif isinstance(timeout, datetime.timedelta): 8450s timeout = IOLoop.current().time() + timeout.total_seconds() 8450s else: 8450s raise TypeError("Unsupported timeout %r" % timeout) 8450s if timeout is not None: 8450s addrinfo = await gen.with_timeout( 8450s timeout, self.resolver.resolve(host, port, af) 8450s ) 8450s else: 8450s addrinfo = await self.resolver.resolve(host, port, af) 8450s connector = _Connector( 8450s addrinfo, 8450s functools.partial( 8450s self._create_stream, 8450s max_buffer_size, 8450s source_ip=source_ip, 8450s source_port=source_port, 8450s ), 8450s ) 8450s > af, addr, stream = await connector.start(connect_timeout=timeout) 8450s E asyncio.exceptions.CancelledError 8450s 8450s /usr/lib/python3/dist-packages/tornado/tcpclient.py:279: CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s self = 8450s 8450s @final 8450s async def start(self): 8450s async with self._startup_lock: 8450s if self.status == Status.failed: 8450s assert self.__startup_exc is not None 8450s raise self.__startup_exc 8450s elif self.status != Status.init: 8450s return self 8450s timeout = getattr(self, "death_timeout", None) 8450s 8450s async def _close_on_failure(exc: Exception) -> None: 8450s await self.close(reason=f"failure-to-start-{str(type(exc))}") 8450s self.status = Status.failed 8450s self.__startup_exc = exc 8450s 8450s try: 8450s > await wait_for(self.start_unsafe(), timeout=timeout) 8450s 8450s /usr/lib/python3/dist-packages/distributed/core.py:664: 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 8450s async with asyncio.timeout(timeout): 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s 8450s self = 8450s exc_type = 8450s exc_val = CancelledError(), exc_tb = 8450s 8450s async def __aexit__( 8450s self, 8450s exc_type: Optional[Type[BaseException]], 8450s exc_val: Optional[BaseException], 8450s exc_tb: Optional[TracebackType], 8450s ) -> Optional[bool]: 8450s assert self._state in (_State.ENTERED, _State.EXPIRING) 8450s 8450s if self._timeout_handler is not None: 8450s self._timeout_handler.cancel() 8450s self._timeout_handler = None 8450s 8450s if self._state is _State.EXPIRING: 8450s self._state = _State.EXPIRED 8450s 8450s if self._task.uncancel() <= self._cancelling and exc_type is not None: 8450s # Since there are no new cancel requests, we're 8450s # handling this. 8450s if issubclass(exc_type, exceptions.CancelledError): 8450s > raise TimeoutError from exc_val 8450s E TimeoutError 8450s 8450s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s @contextlib.asynccontextmanager 8450s async def _cluster_factory(): 8450s workers = [] 8450s s = None 8450s try: 8450s for _ in range(60): 8450s try: 8450s > s, ws = await start_cluster( 8450s nthreads, 8450s scheduler, 8450s security=security, 8450s Worker=Worker, 8450s scheduler_kwargs=scheduler_kwargs, 8450s worker_kwargs=merge( 8450s {"death_timeout": min(15, int(deadline.remaining))}, 8450s worker_kwargs, 8450s ), 8450s ) 8450s 8450s /usr/lib/python3/dist-packages/distributed/utils_test.py:966: 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s /usr/lib/python3/dist-packages/distributed/utils_test.py:789: in start_cluster 8450s await asyncio.gather(*workers) 8450s /usr/lib/python3.13/asyncio/tasks.py:737: in _wrap_awaitable 8450s return await awaitable 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s 8450s self = 8450s 8450s @final 8450s async def start(self): 8450s async with self._startup_lock: 8450s if self.status == Status.failed: 8450s assert self.__startup_exc is not None 8450s raise self.__startup_exc 8450s elif self.status != Status.init: 8450s return self 8450s timeout = getattr(self, "death_timeout", None) 8450s 8450s async def _close_on_failure(exc: Exception) -> None: 8450s await self.close(reason=f"failure-to-start-{str(type(exc))}") 8450s self.status = Status.failed 8450s self.__startup_exc = exc 8450s 8450s try: 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s except asyncio.TimeoutError as exc: 8450s await _close_on_failure(exc) 8450s > raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s E TimeoutError: Worker start timed out after 0s. 8450s 8450s /usr/lib/python3/dist-packages/distributed/core.py:667: TimeoutError 8450s 8450s During handling of the above exception, another exception occurred: 8450s 8450s fut = ._..test_func..async_fn at 0xe8325cd8> 8450s timeout = 60 8450s 8450s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 8450s async with asyncio.timeout(timeout): 8450s > return await fut 8450s 8450s /usr/lib/python3/dist-packages/distributed/utils.py:1960: 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s /usr/lib/python3/dist-packages/distributed/utils_test.py:999: in async_fn 8450s _cluster_factory() as (s, workers), 8450s /usr/lib/python3.13/contextlib.py:214: in __aenter__ 8450s return await anext(self.gen) 8450s /usr/lib/python3/dist-packages/distributed/utils_test.py:983: in _cluster_factory 8450s await asyncio.sleep(1) 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s 8450s delay = 1, result = None 8450s 8450s async def sleep(delay, result=None): 8450s """Coroutine that completes after a given time (in seconds).""" 8450s if delay <= 0: 8450s await __sleep0() 8450s return result 8450s 8450s if math.isnan(delay): 8450s raise ValueError("Invalid delay: NaN (not a number)") 8450s 8450s loop = events.get_running_loop() 8450s future = loop.create_future() 8450s h = loop.call_later(delay, 8450s futures._set_result_unless_cancelled, 8450s future, result) 8450s try: 8450s > return await future 8450s E asyncio.exceptions.CancelledError 8450s 8450s /usr/lib/python3.13/asyncio/tasks.py:718: CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s args = (), kwds = {} 8450s 8450s @wraps(func) 8450s def inner(*args, **kwds): 8450s with self._recreate_cm(): 8450s > return func(*args, **kwds) 8450s 8450s /usr/lib/python3.13/contextlib.py:85: 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s /usr/lib/python3.13/contextlib.py:85: in inner 8450s return func(*args, **kwds) 8450s /usr/lib/python3/dist-packages/distributed/utils_test.py:1102: in test_func 8450s return _run_and_close_tornado(async_fn_outer) 8450s /usr/lib/python3/dist-packages/distributed/utils_test.py:378: in _run_and_close_tornado 8450s return asyncio_run(inner_fn(), loop_factory=get_loop_factory()) 8450s /usr/lib/python3.13/asyncio/runners.py:194: in run 8450s return runner.run(main) 8450s /usr/lib/python3.13/asyncio/runners.py:118: in run 8450s return self._loop.run_until_complete(task) 8450s /usr/lib/python3.13/asyncio/base_events.py:720: in run_until_complete 8450s return future.result() 8450s /usr/lib/python3/dist-packages/distributed/utils_test.py:375: in inner_fn 8450s return await async_fn(*args, **kwargs) 8450s /usr/lib/python3/dist-packages/distributed/utils_test.py:1099: in async_fn_outer 8450s return await utils_wait_for(async_fn(), timeout=timeout * 2) 8450s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 8450s async with asyncio.timeout(timeout): 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s 8450s self = 8450s exc_type = 8450s exc_val = CancelledError(), exc_tb = 8450s 8450s async def __aexit__( 8450s self, 8450s exc_type: Optional[Type[BaseException]], 8450s exc_val: Optional[BaseException], 8450s exc_tb: Optional[TracebackType], 8450s ) -> Optional[bool]: 8450s assert self._state in (_State.ENTERED, _State.EXPIRING) 8450s 8450s if self._timeout_handler is not None: 8450s self._timeout_handler.cancel() 8450s self._timeout_handler = None 8450s 8450s if self._state is _State.EXPIRING: 8450s self._state = _State.EXPIRED 8450s 8450s if self._task.uncancel() <= self._cancelling and exc_type is not None: 8450s # Since there are no new cancel requests, we're 8450s # handling this. 8450s if issubclass(exc_type, exceptions.CancelledError): 8450s > raise TimeoutError from exc_val 8450s E TimeoutError 8450s 8450s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 8450s ----------------------------- Captured stderr call ----------------------------- 8450s 2024-11-23 22:42:43,347 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:42:43,359 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:43,360 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37143/status 8450s 2024-11-23 22:42:43,360 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:42:43,383 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35979 8450s 2024-11-23 22:42:43,384 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35979 8450s 2024-11-23 22:42:43,384 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:42:43,384 - distributed.worker - INFO - dashboard at: 127.0.0.1:43633 8450s 2024-11-23 22:42:43,384 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:43,384 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:42:43,384 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:42:43,384 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:42:43,384 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-4v5udbf6 8450s 2024-11-23 22:42:43,384 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:42:43,388 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40601 8450s 2024-11-23 22:42:43,388 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40601 8450s 2024-11-23 22:42:43,388 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:42:43,388 - distributed.worker - INFO - dashboard at: 127.0.0.1:41501 8450s 2024-11-23 22:42:43,388 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:43,388 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:42:43,388 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:42:43,389 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:42:43,389 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-3hzw960e 8450s 2024-11-23 22:42:43,389 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:42:43,406 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:43,406 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:43,407 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:48002': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:43,407 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:48004': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:43,523 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:43,523 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:43,524 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:48016': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:43,524 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:48022': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:43,640 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:43,640 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:43,641 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:48024': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:43,641 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:48040': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:43,759 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:43,759 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:43,760 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:48056': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:43,760 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:48072': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:43,881 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:43,881 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:43,882 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:48074': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:43,882 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:48082': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:43,997 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:43,998 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:43,999 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:48092': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:43,999 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:48104': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:44,114 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:44,115 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:44,116 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:48112': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:44,116 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:48116': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:44,232 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:44,232 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:44,233 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:48130': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:44,233 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:48132': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:44,350 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:44,351 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:44,352 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:48140': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:44,352 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:48148': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:44,468 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:44,468 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:44,469 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:48156': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:44,469 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:48158': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:44,584 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:44,584 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:44,585 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:48162': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:44,585 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:48164': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:44,700 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:44,701 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:44,702 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:48166': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:44,702 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:48182': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:44,817 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:44,818 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:44,818 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:48194': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:44,818 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:48210': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:44,935 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:44,935 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:44,936 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:48220': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:44,936 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:48230': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:45,051 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:45,052 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:45,052 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:48238': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:45,053 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:48242': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:45,168 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:45,168 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:45,169 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:48250': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:45,169 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:48264': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:45,285 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:45,286 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:45,286 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:48268': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:45,286 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:48280': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:45,402 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:45,402 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:45,403 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:48288': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:45,403 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:48296': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:45,520 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:45,521 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:45,521 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:48312': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:45,522 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:48314': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:45,638 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:45,638 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:45,639 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:48316': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:45,639 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:48330': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:45,755 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:45,755 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:45,756 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:48336': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:45,756 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:48340': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:45,872 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:45,873 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:45,877 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:48342': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:45,877 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:48350': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:45,989 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:45,990 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:45,990 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:48364': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:45,991 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:48368': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:46,106 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:46,107 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:46,107 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:48382': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:46,108 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:48392': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:46,222 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:46,222 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:46,223 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:48404': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:46,223 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:48406': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:46,338 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:46,338 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:46,339 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:48418': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:46,339 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:48430': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:46,454 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:46,454 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:46,455 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:48440': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:46,455 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:48456': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:46,570 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:46,570 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:46,571 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:48470': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:46,571 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:48474': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:46,685 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:46,686 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:46,686 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:48480': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:46,687 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:48492': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:46,802 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:46,802 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:46,803 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:48502': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:46,803 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:48516': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:46,918 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:46,918 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:46,919 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:48530': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:46,919 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:48532': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:47,034 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:47,034 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:47,035 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:48544': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:47,035 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:48558': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:47,151 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:47,152 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:47,153 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:48572': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:47,153 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:48580': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:47,269 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:47,269 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:47,270 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:48586': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:47,271 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:48596': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:47,386 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:47,386 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:47,387 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:48600': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:47,387 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:48604': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:47,503 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:47,503 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:47,504 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:48616': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:47,504 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:48624': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:47,619 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:47,620 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:47,621 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:48626': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:47,621 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:48642': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:47,738 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:47,738 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:47,739 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:48654': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:47,739 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:48656': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:47,854 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:47,855 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:47,855 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:48658': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:47,856 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:48664': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:47,971 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:47,972 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:47,972 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:48680': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:47,973 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:48688': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:48,088 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:48,089 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:48,089 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:48694': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:48,090 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:48698': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:48,205 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:48,206 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:48,207 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:48706': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:48,207 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:48720': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:48,322 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:48,323 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:48,324 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:48732': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:48,324 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:48736': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:48,439 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:48,440 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:48,441 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:48738': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:48,441 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:48742': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:48,557 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:48,558 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:48,558 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:48758': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:48,558 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:48770': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:48,672 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:48,675 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:48,675 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:48778': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:48,676 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:48788': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:48,784 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:48,786 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:48794': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:48,792 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:48,793 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:48798': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:48,894 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:48,896 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:48810': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:48,904 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:48,904 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:48824': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:49,005 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:49,006 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:48838': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:49,015 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:49,015 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:48840': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:49,115 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:49,117 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:48850': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:49,127 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:49,128 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:48864': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:49,225 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:49,226 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:48872': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:49,237 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:49,238 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:48884': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:49,335 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:49,336 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:48890': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:49,346 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:49,347 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:48892': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:49,447 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:49,448 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:48900': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:49,456 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:49,457 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:48912': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:49,557 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:49,558 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:48926': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:49,566 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:49,567 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:48938': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:49,667 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:49,668 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:48942': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:49,677 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:49,678 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:48950': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:49,777 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:49,778 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:48956': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:49,787 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:49,788 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:48972': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:49,888 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:49,889 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:48986': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:49,897 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:49,898 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:48998': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:49,998 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:49,999 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:49002': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:50,008 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:50,009 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:49016': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:50,108 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:50,109 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:49026': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:50,118 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:50,119 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:49032': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:50,218 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:50,219 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:49040': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:50,228 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:50,229 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:49056': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:50,329 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:50,330 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:49066': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:50,338 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:50,339 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:49072': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:50,439 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:50,440 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:49086': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:50,448 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:50,449 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:49092': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:50,548 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:50,549 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:49104': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:50,557 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:50,558 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:49110': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:50,660 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:50,661 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:49118': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:50,670 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:50,671 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:49122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:50,772 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:50,773 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:49138': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:50,781 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:50,782 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:49140': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:50,882 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:50,883 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:49150': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:50,891 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:50,892 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:49164': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:50,993 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:50,993 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:49170': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:51,002 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:51,003 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:49182': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:51,102 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:51,103 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:49194': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:51,112 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:51,113 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:49206': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:51,212 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:51,213 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:49212': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:51,222 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:51,223 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:49224': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:51,324 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:51,325 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:49234': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:51,333 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:51,334 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:49244': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:51,435 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:51,435 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:49250': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:51,444 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:51,445 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:49264': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:51,545 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:51,546 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:57644': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:51,554 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:51,555 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:57660': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:51,654 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:51,655 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:57674': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:51,664 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:51,665 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:57678': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:51,764 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:51,765 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:57684': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:51,774 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:51,775 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:57688': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:51,874 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:51,875 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:57696': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:51,884 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:51,885 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:57704': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:51,985 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:51,985 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:57712': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:51,994 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:51,995 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:57718': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:52,095 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:52,096 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:57732': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:52,104 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:52,105 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:57738': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:52,204 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:52,205 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:57748': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:52,214 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:52,215 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:57762': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:52,315 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:52,316 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:57766': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:52,324 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:52,325 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:57776': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:52,425 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:52,426 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:57778': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:52,435 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:52,436 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:57788': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:52,536 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:52,539 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:57804': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:52,548 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:52,549 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:57808': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:52,649 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:52,649 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:57814': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:52,658 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:52,659 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:57826': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:52,759 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:52,760 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:57840': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:52,768 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:52,769 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:57850': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:52,873 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:52,875 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:57866': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:52,883 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:52,884 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:57876': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:52,982 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:52,983 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:57882': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:52,992 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:52,993 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:57890': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:53,093 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:53,093 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:57894': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:53,102 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:53,103 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:57906': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:53,202 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:53,203 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:57922': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:53,211 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:53,212 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:57932': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:53,312 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:53,313 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:57942': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:53,322 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:53,322 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:57954': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:53,422 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:53,423 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:57958': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:53,432 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:53,433 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:57960': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:53,533 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:53,534 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:57966': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:53,542 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:53,543 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:57974': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:53,643 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:53,644 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:57980': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:53,653 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:53,654 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:57988': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:53,753 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:53,754 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:57996': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:53,764 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:53,765 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:57998': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:53,864 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:53,869 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:58014': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:53,878 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:53,879 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:58020': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:53,975 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:53,976 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:58022': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:53,988 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:53,988 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:58024': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:54,086 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:54,086 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:58040': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:54,098 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:54,098 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:58046': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:54,196 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:54,197 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:58058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:54,207 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:54,208 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:58064': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:54,307 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:54,308 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:58074': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:54,317 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:54,318 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:58086': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:54,418 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:54,419 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:58100': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:54,427 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:54,428 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:58104': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:54,528 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:54,529 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:58116': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:54,537 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:54,538 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:58128': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:54,638 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:54,639 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:58134': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:54,648 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:54,648 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:58136': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:54,749 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:54,750 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:58138': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:54,758 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:54,759 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:58150': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:54,859 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:54,860 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:58164': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:54,873 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:54,874 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:58168': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:54,969 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:54,970 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:58180': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:54,982 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:54,983 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:58194': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:55,079 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:55,080 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:58208': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:55,092 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:55,093 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:58222': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:55,190 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:55,191 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:58228': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:55,201 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:55,202 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:58232': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:55,300 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:55,301 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:58236': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:55,311 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:55,311 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:58244': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:55,411 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:55,412 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:58252': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:55,421 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:55,422 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:58258': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:55,521 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:55,522 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:58262': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:55,530 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:55,531 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:58272': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:55,631 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:55,632 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:58280': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:55,640 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:55,641 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:58290': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:55,742 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:55,744 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:58292': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:55,751 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:55,752 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:58294': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:55,852 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:55,852 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:58304': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:55,861 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:55,861 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:58308': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:55,962 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:55,963 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:58314': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:55,971 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:55,972 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:58324': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:56,072 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:56,073 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:58326': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:56,082 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:56,083 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:58330': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:56,182 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:56,183 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:58344': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:56,192 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:56,193 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:58350': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:56,292 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:56,293 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:58360': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:56,302 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:56,303 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:58374': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:56,402 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:56,403 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:58382': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:56,412 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:56,413 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:58384': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:56,513 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:56,513 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:58388': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:56,522 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:56,523 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:58402': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:56,622 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:56,623 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:58414': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:56,632 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:56,632 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:58428': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:56,732 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:56,733 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:58444': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:56,741 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:56,742 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:58452': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:56,843 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:56,844 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:58460': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:56,853 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:56,853 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:58462': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:56,953 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:56,954 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:58466': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:56,963 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:56,964 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:58480': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:57,064 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:57,065 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:58490': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:57,073 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:57,074 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:58504': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:57,174 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:57,175 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:58512': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:57,184 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:57,184 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:58518': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:57,284 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:57,285 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:58524': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:57,294 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:57,295 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:58526': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:57,394 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:57,395 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:58542': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:57,404 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:57,405 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:58558': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:57,504 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:57,505 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:58574': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:57,514 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:57,515 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:58588': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:57,617 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:57,618 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:58592': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:57,627 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:57,628 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:58604': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:57,727 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:57,728 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:58606': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:57,737 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:57,738 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:58616': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:57,838 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:57,839 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:58618': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:57,848 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:57,849 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:58630': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:57,949 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:57,949 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:58638': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:57,958 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:57,959 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:58652': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:58,058 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:58,059 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:58664': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:58,068 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:58,069 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:58674': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:58,169 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:58,170 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:58678': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:58,178 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:58,179 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:58694': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:58,279 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:58,280 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:58704': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:58,288 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45395 8450s 2024-11-23 22:42:58,289 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45395': TLS handshake failed with remote 'tls://127.0.0.1:58716': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:58,381 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35979. Reason: failure-to-start- 8450s 2024-11-23 22:42:58,382 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:42:58,386 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 15s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 8450s stream = await stream.start_tls( 8450s ^^^^^^^^^^^^^^^^^^^^^^^ 8450s False, ssl_options=ssl_options, server_hostname=host 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 8450s self.socket.do_handshake() 8450s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 8450s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 8450s self._sslobj.do_handshake() 8450s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 8450s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 8450s raise FatalCommClosedError( 8450s ...<2 lines>... 8450s ) from err 8450s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 8450s 8450s During handling of the above exception, another exception occurred: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1218, in _register_with_scheduler 8450s await asyncio.sleep(0.1) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 718, in sleep 8450s return await future 8450s ^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 15s. 8450s 2024-11-23 22:42:58,390 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40601. Reason: failure-to-start- 8450s 2024-11-23 22:42:58,391 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:42:59,395 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:42:59,406 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46337 8450s 2024-11-23 22:42:59,406 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41245/status 8450s 2024-11-23 22:42:59,407 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:42:59,430 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36163 8450s 2024-11-23 22:42:59,431 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36163 8450s 2024-11-23 22:42:59,431 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:42:59,431 - distributed.worker - INFO - dashboard at: 127.0.0.1:44921 8450s 2024-11-23 22:42:59,431 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:42:59,431 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:42:59,431 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:42:59,431 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:42:59,431 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-oxr18jwk 8450s 2024-11-23 22:42:59,431 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:42:59,435 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34019 8450s 2024-11-23 22:42:59,436 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34019 8450s 2024-11-23 22:42:59,436 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:42:59,436 - distributed.worker - INFO - dashboard at: 127.0.0.1:39425 8450s 2024-11-23 22:42:59,436 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:42:59,436 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:42:59,436 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:42:59,436 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:42:59,436 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-q7en_rob 8450s 2024-11-23 22:42:59,436 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:42:59,452 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:42:59,452 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:42:59,453 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:52128': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:59,453 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:52136': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:59,568 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:42:59,569 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:42:59,570 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:52146': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:59,570 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:52162': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:59,685 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:42:59,686 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:42:59,687 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:52170': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:59,687 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:52178': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:59,803 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:42:59,803 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:42:59,804 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:52190': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:59,804 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:52198': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:59,924 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:42:59,925 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:42:59,925 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:52212': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:42:59,925 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:52228': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:00,041 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:00,041 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:00,042 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:52230': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:00,042 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:52246': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:00,157 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:00,158 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:00,158 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:52254': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:00,158 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:52262': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:00,274 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:00,274 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:00,275 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:52272': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:00,275 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:52288': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:00,391 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:00,392 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:00,392 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:52298': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:00,393 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:52300': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:00,508 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:00,509 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:00,510 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:52302': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:00,510 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:52312': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:00,625 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:00,626 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:00,626 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:52324': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:00,627 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:52328': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:00,743 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:00,743 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:00,744 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:52344': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:00,744 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:52356': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:00,859 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:00,859 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:00,860 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:52364': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:00,860 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:52372': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:00,978 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:00,978 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:00,979 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:52384': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:00,979 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:52390': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:01,094 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:01,095 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:01,095 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:52396': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:01,096 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:52404': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:01,212 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:01,212 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:01,213 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:52418': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:01,213 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:52424': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:01,329 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:01,329 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:01,330 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:52428': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:01,330 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:52430': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:01,447 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:01,447 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:01,448 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:52438': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:01,448 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:52452': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:01,564 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:01,564 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:01,565 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:55376': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:01,565 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:55382': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:01,680 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:01,681 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:01,682 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:55388': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:01,682 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:55396': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:01,797 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:01,797 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:01,798 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:55400': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:01,798 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:55408': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:01,914 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:01,915 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:01,919 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:55410': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:01,919 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:55414': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:02,030 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:02,031 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:02,031 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:55424': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:02,032 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:55436': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:02,147 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:02,147 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:02,148 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:55452': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:02,148 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:55454': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:02,263 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:02,264 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:02,264 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:55468': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:02,265 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:55482': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:02,381 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:02,381 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:02,382 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:55486': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:02,382 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:55490': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:02,498 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:02,498 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:02,499 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:55498': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:02,499 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:55500': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:02,615 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:02,616 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:02,617 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:55514': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:02,617 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:55520': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:02,732 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:02,733 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:02,733 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:55526': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:02,733 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:55528': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:02,851 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:02,852 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:02,852 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:55538': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:02,853 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:55544': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:02,968 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:02,969 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:02,969 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:55558': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:02,970 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:55562': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:03,085 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:03,085 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:03,086 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:55570': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:03,087 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:55586': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:03,203 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:03,204 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:03,205 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:55598': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:03,205 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:55606': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:03,321 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:03,321 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:03,322 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:55610': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:03,322 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:55614': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:03,437 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:03,437 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:03,438 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:55628': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:03,438 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:55636': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:03,554 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:03,555 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:03,555 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:55648': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:03,555 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:55658': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:03,671 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:03,672 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:03,672 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:55668': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:03,673 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:55676': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:03,787 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:03,788 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:03,789 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:55682': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:03,789 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:55688': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:03,899 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:03,904 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:55698': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:03,906 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:03,907 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:55708': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:04,009 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:04,011 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:55714': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:04,019 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:04,020 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:55716': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:04,119 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:04,120 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:55718': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:04,129 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:04,130 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:55720': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:04,231 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:04,233 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:55726': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:04,240 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:04,241 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:55742': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:04,342 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:04,343 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:55746': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:04,351 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:04,352 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:55750': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:04,451 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:04,452 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:55752': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:04,460 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:04,461 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:55768': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:04,561 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:04,562 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:55772': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:04,573 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:04,574 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:55774': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:04,671 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:04,672 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:55790': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:04,683 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:04,684 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:55800': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:04,781 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:04,782 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:55810': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:04,793 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:04,794 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:55822': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:04,892 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:04,892 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:55828': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:04,902 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:04,903 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:55840': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:05,003 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:05,003 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:55848': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:05,012 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:05,013 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:55852': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:05,114 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:05,115 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:55868': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:05,123 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:05,124 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:55870': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:05,223 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:05,224 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:55880': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:05,233 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:05,233 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:55884': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:05,333 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:05,334 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:55890': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:05,342 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:05,343 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:55898': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:05,443 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:05,443 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:55914': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:05,452 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:05,453 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:55920': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:05,554 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:05,555 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:55936': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:05,563 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:05,564 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:55950': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:05,664 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:05,665 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:55958': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:05,674 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:05,674 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:55972': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:05,774 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:05,774 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:55984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:05,783 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:05,784 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:55990': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:05,885 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:05,886 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:55994': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:05,895 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:05,895 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:55996': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:05,995 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:05,996 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:56002': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:06,005 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:06,005 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:56014': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:06,105 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:06,106 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:56024': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:06,115 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:06,116 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:56026': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:06,216 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:06,217 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:56032': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:06,225 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:06,226 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:56036': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:06,329 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:06,331 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:56050': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:06,339 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:06,340 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:56054': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:06,441 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:06,441 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:56062': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:06,450 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:06,451 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:56064': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:06,550 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:06,551 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:56080': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:06,560 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:06,560 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:56092': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:06,660 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:06,661 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:56100': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:06,670 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:06,671 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:56114': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:06,772 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:06,773 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:56130': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:06,782 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:06,783 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:56142': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:06,882 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:06,883 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:56156': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:06,892 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:06,893 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:56164': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:06,992 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:06,993 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:56176': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:07,002 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:07,003 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:56186': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:07,103 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:07,104 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:56196': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:07,113 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:07,114 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:56212': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:07,214 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:07,215 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:56220': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:07,223 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:07,224 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:56232': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:07,324 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:07,325 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:56240': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:07,334 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:07,334 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:56242': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:07,435 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:07,436 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:56256': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:07,445 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:07,446 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:56266': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:07,545 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:07,546 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:56278': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:07,555 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:07,556 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:56280': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:07,655 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:07,656 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:56292': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:07,665 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:07,666 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:56294': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:07,766 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:07,767 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:56298': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:07,776 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:07,777 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:56314': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:07,876 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:07,877 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:56322': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:07,886 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:07,887 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:56332': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:07,986 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:07,994 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:56344': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:08,003 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:08,004 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:56354': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:08,096 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:08,097 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:56364': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:08,114 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:08,115 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:56366': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:08,208 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:08,209 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:56380': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:08,225 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:08,225 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:56386': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:08,318 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:08,319 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:56392': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:08,335 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:08,336 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:56400': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:08,428 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:08,429 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:56410': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:08,445 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:08,446 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:56420': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:08,539 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:08,540 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:56424': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:08,555 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:08,556 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:56430': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:08,649 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:08,650 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:56436': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:08,666 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:08,667 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:56450': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:08,760 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:08,761 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:56454': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:08,776 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:08,777 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:56460': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:08,875 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:08,876 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:56466': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:08,886 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:08,887 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:56480': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:08,985 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:08,986 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:56492': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:08,995 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:08,996 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:56496': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:09,095 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:09,096 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:56502': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:09,105 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:09,106 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:56506': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:09,205 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:09,206 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:56516': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:09,215 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:09,216 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:56528': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:09,315 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:09,316 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:56532': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:09,325 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:09,326 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:56544': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:09,425 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:09,426 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:56554': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:09,435 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:09,435 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:56568': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:09,536 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:09,537 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:56584': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:09,546 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:09,546 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:56598': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:09,646 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:09,647 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:56610': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:09,658 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:09,660 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:56612': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:09,756 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:09,757 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:56616': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:09,768 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:09,769 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:56624': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:09,867 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:09,872 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:56640': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:09,881 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:09,882 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:56652': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:09,976 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:09,977 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:56662': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:09,991 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:09,992 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:56672': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:10,087 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:10,088 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:56688': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:10,100 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:10,101 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:56700': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:10,198 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:10,199 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:56702': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:10,210 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:10,211 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:56714': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:10,309 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:10,310 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:56724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:10,319 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:10,320 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:56734': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:10,421 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:10,421 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:56750': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:10,430 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:10,431 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:56766': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:10,531 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:10,532 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:56770': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:10,541 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:10,542 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:56772': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:10,641 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:10,642 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:56776': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:10,651 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:10,652 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:56784': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:10,751 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:10,752 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:56792': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:10,761 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:10,762 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:56794': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:10,861 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:10,862 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:56796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:10,875 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:10,876 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:56802': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:10,972 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:10,973 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:56816': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:10,985 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:10,986 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:56832': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:11,082 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:11,083 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:56834': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:11,095 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:11,095 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:56838': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:11,193 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:11,194 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:56848': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:11,205 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:11,206 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:56858': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:11,303 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:11,304 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:56872': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:11,315 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:11,316 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:56882': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:11,413 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:11,418 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:56884': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:11,427 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:11,428 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:56892': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:11,523 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:11,524 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:56902': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:11,537 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:11,538 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:56980': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:11,633 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:11,634 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:56994': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:11,647 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:11,648 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:57010': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:11,744 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:11,745 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:57014': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:11,757 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:11,758 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:57028': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:11,854 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:11,855 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:57034': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:11,872 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:11,873 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:57048': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:11,965 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:11,966 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:57052': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:11,982 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:11,983 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:57064': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:12,076 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:12,077 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:57068': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:12,092 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:12,093 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:57076': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:12,186 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:12,187 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:57084': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:12,202 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:12,203 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:57098': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:12,298 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:12,299 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:57100': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:12,313 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:12,314 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:57114': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:12,408 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:12,409 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:57122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:12,423 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46337 8450s 2024-11-23 22:43:12,424 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46337': TLS handshake failed with remote 'tls://127.0.0.1:57124': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:12,426 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36163. Reason: failure-to-start- 8450s 2024-11-23 22:43:12,426 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:43:12,429 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 13s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 8450s stream = await stream.start_tls( 8450s ^^^^^^^^^^^^^^^^^^^^^^^ 8450s False, ssl_options=ssl_options, server_hostname=host 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 8450s self.socket.do_handshake() 8450s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 8450s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 8450s self._sslobj.do_handshake() 8450s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 8450s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 8450s raise FatalCommClosedError( 8450s ...<2 lines>... 8450s ) from err 8450s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 8450s 8450s During handling of the above exception, another exception occurred: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1218, in _register_with_scheduler 8450s await asyncio.sleep(0.1) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 718, in sleep 8450s return await future 8450s ^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 13s. 8450s 2024-11-23 22:43:12,434 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34019. Reason: failure-to-start- 8450s 2024-11-23 22:43:12,434 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:43:13,438 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:43:13,449 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37237 8450s 2024-11-23 22:43:13,450 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44971/status 8450s 2024-11-23 22:43:13,450 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:43:13,476 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33075 8450s 2024-11-23 22:43:13,477 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33075 8450s 2024-11-23 22:43:13,477 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:43:13,477 - distributed.worker - INFO - dashboard at: 127.0.0.1:36637 8450s 2024-11-23 22:43:13,477 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37237 8450s 2024-11-23 22:43:13,477 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:43:13,477 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:43:13,477 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:43:13,477 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-5njpy9ly 8450s 2024-11-23 22:43:13,477 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:43:13,481 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43793 8450s 2024-11-23 22:43:13,481 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43793 8450s 2024-11-23 22:43:13,482 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:43:13,482 - distributed.worker - INFO - dashboard at: 127.0.0.1:37869 8450s 2024-11-23 22:43:13,482 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37237 8450s 2024-11-23 22:43:13,482 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:43:13,482 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:43:13,482 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:43:13,482 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-0x2elaly 8450s 2024-11-23 22:43:13,482 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:43:13,484 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33075. Reason: failure-to-start- 8450s 2024-11-23 22:43:13,484 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:43:13,485 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43793. Reason: failure-to-start- 8450s 2024-11-23 22:43:13,486 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:43:13,488 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37237': TLS handshake failed with remote 'tls://127.0.0.1:51898': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:43:13,488 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37237': TLS handshake failed with remote 'tls://127.0.0.1:51908': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:43:13,491 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:43:14,500 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:43:14,512 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39713 8450s 2024-11-23 22:43:14,512 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45013/status 8450s 2024-11-23 22:43:14,513 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:43:14,535 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43465 8450s 2024-11-23 22:43:14,536 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43465 8450s 2024-11-23 22:43:14,536 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:43:14,536 - distributed.worker - INFO - dashboard at: 127.0.0.1:34859 8450s 2024-11-23 22:43:14,536 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39713 8450s 2024-11-23 22:43:14,536 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:43:14,536 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:43:14,536 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:43:14,536 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-irb0cfdi 8450s 2024-11-23 22:43:14,538 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:43:14,542 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44039 8450s 2024-11-23 22:43:14,542 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44039 8450s 2024-11-23 22:43:14,542 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:43:14,542 - distributed.worker - INFO - dashboard at: 127.0.0.1:45115 8450s 2024-11-23 22:43:14,542 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39713 8450s 2024-11-23 22:43:14,542 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:43:14,543 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:43:14,543 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:43:14,543 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-hzndk1jq 8450s 2024-11-23 22:43:14,543 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:43:14,545 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43465. Reason: failure-to-start- 8450s 2024-11-23 22:43:14,545 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:43:14,546 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44039. Reason: failure-to-start- 8450s 2024-11-23 22:43:14,546 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:43:14,548 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39713': TLS handshake failed with remote 'tls://127.0.0.1:60168': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:43:14,548 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39713': TLS handshake failed with remote 'tls://127.0.0.1:60176': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:43:14,551 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:43:15,558 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:43:15,569 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45703 8450s 2024-11-23 22:43:15,569 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40755/status 8450s 2024-11-23 22:43:15,570 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:43:15,592 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45185 8450s 2024-11-23 22:43:15,592 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45185 8450s 2024-11-23 22:43:15,592 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:43:15,592 - distributed.worker - INFO - dashboard at: 127.0.0.1:38915 8450s 2024-11-23 22:43:15,592 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45703 8450s 2024-11-23 22:43:15,592 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:43:15,593 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:43:15,593 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:43:15,593 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-6jtvnfq4 8450s 2024-11-23 22:43:15,593 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:43:15,596 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36841 8450s 2024-11-23 22:43:15,597 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36841 8450s 2024-11-23 22:43:15,597 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:43:15,597 - distributed.worker - INFO - dashboard at: 127.0.0.1:38371 8450s 2024-11-23 22:43:15,597 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45703 8450s 2024-11-23 22:43:15,597 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:43:15,597 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:43:15,597 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:43:15,597 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-c7nwyy28 8450s 2024-11-23 22:43:15,598 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:43:15,599 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45185. Reason: failure-to-start- 8450s 2024-11-23 22:43:15,600 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:43:15,601 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36841. Reason: failure-to-start- 8450s 2024-11-23 22:43:15,601 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:43:15,603 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45703': TLS handshake failed with remote 'tls://127.0.0.1:55260': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:43:15,603 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45703': TLS handshake failed with remote 'tls://127.0.0.1:55270': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:43:15,606 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:43:16,617 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:43:16,628 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43511 8450s 2024-11-23 22:43:16,629 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33695/status 8450s 2024-11-23 22:43:16,629 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:43:16,652 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44263 8450s 2024-11-23 22:43:16,653 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44263 8450s 2024-11-23 22:43:16,653 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:43:16,653 - distributed.worker - INFO - dashboard at: 127.0.0.1:38201 8450s 2024-11-23 22:43:16,653 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43511 8450s 2024-11-23 22:43:16,653 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:43:16,653 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:43:16,653 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:43:16,653 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-tyamiodq 8450s 2024-11-23 22:43:16,653 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:43:16,657 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37447 8450s 2024-11-23 22:43:16,657 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37447 8450s 2024-11-23 22:43:16,657 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:43:16,658 - distributed.worker - INFO - dashboard at: 127.0.0.1:35917 8450s 2024-11-23 22:43:16,658 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43511 8450s 2024-11-23 22:43:16,658 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:43:16,658 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:43:16,658 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:43:16,658 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-4yadx7oi 8450s 2024-11-23 22:43:16,658 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:43:16,660 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44263. Reason: failure-to-start- 8450s 2024-11-23 22:43:16,660 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:43:16,661 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37447. Reason: failure-to-start- 8450s 2024-11-23 22:43:16,661 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:43:16,664 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43511': TLS handshake failed with remote 'tls://127.0.0.1:48122': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:43:16,664 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43511': TLS handshake failed with remote 'tls://127.0.0.1:48130': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:43:16,667 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:43:17,675 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:43:17,686 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42055 8450s 2024-11-23 22:43:17,686 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33685/status 8450s 2024-11-23 22:43:17,687 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:43:17,712 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43429 8450s 2024-11-23 22:43:17,712 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43429 8450s 2024-11-23 22:43:17,712 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:43:17,712 - distributed.worker - INFO - dashboard at: 127.0.0.1:36533 8450s 2024-11-23 22:43:17,712 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42055 8450s 2024-11-23 22:43:17,713 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:43:17,713 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:43:17,713 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:43:17,713 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-7xwpvf_m 8450s 2024-11-23 22:43:17,713 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:43:17,717 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39931 8450s 2024-11-23 22:43:17,717 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39931 8450s 2024-11-23 22:43:17,717 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:43:17,717 - distributed.worker - INFO - dashboard at: 127.0.0.1:38495 8450s 2024-11-23 22:43:17,717 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42055 8450s 2024-11-23 22:43:17,717 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:43:17,717 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:43:17,717 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:43:17,718 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-oy612sdv 8450s 2024-11-23 22:43:17,718 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:43:17,720 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43429. Reason: failure-to-start- 8450s 2024-11-23 22:43:17,720 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:43:17,721 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39931. Reason: failure-to-start- 8450s 2024-11-23 22:43:17,722 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:43:17,724 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42055': TLS handshake failed with remote 'tls://127.0.0.1:54078': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:43:17,724 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42055': TLS handshake failed with remote 'tls://127.0.0.1:54084': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:43:17,727 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:43:18,736 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:43:18,746 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44159 8450s 2024-11-23 22:43:18,747 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35351/status 8450s 2024-11-23 22:43:18,748 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:43:18,771 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41387 8450s 2024-11-23 22:43:18,771 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41387 8450s 2024-11-23 22:43:18,771 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:43:18,771 - distributed.worker - INFO - dashboard at: 127.0.0.1:42477 8450s 2024-11-23 22:43:18,771 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44159 8450s 2024-11-23 22:43:18,771 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:43:18,771 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:43:18,771 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:43:18,771 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-mwqg283r 8450s 2024-11-23 22:43:18,772 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:43:18,777 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36837 8450s 2024-11-23 22:43:18,778 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36837 8450s 2024-11-23 22:43:18,778 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:43:18,778 - distributed.worker - INFO - dashboard at: 127.0.0.1:41029 8450s 2024-11-23 22:43:18,778 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44159 8450s 2024-11-23 22:43:18,778 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:43:18,778 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:43:18,778 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:43:18,778 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-78k314nr 8450s 2024-11-23 22:43:18,778 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:43:18,781 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41387. Reason: failure-to-start- 8450s 2024-11-23 22:43:18,781 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:43:18,782 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36837. Reason: failure-to-start- 8450s 2024-11-23 22:43:18,782 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:43:18,785 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44159': TLS handshake failed with remote 'tls://127.0.0.1:46914': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:43:18,785 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44159': TLS handshake failed with remote 'tls://127.0.0.1:46916': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:43:18,788 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:43:19,795 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:43:19,806 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38463 8450s 2024-11-23 22:43:19,807 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42667/status 8450s 2024-11-23 22:43:19,808 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:43:19,830 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39317 8450s 2024-11-23 22:43:19,830 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39317 8450s 2024-11-23 22:43:19,831 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:43:19,831 - distributed.worker - INFO - dashboard at: 127.0.0.1:45671 8450s 2024-11-23 22:43:19,831 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38463 8450s 2024-11-23 22:43:19,831 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:43:19,831 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:43:19,831 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:43:19,831 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-9ipwnr9n 8450s 2024-11-23 22:43:19,831 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:43:19,835 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44237 8450s 2024-11-23 22:43:19,835 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44237 8450s 2024-11-23 22:43:19,836 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:43:19,836 - distributed.worker - INFO - dashboard at: 127.0.0.1:35441 8450s 2024-11-23 22:43:19,836 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38463 8450s 2024-11-23 22:43:19,836 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:43:19,836 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:43:19,836 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:43:19,836 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-gwswo7x9 8450s 2024-11-23 22:43:19,836 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:43:19,838 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39317. Reason: failure-to-start- 8450s 2024-11-23 22:43:19,839 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:43:19,840 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44237. Reason: failure-to-start- 8450s 2024-11-23 22:43:19,840 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:43:19,843 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38463': TLS handshake failed with remote 'tls://127.0.0.1:37362': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:43:19,843 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38463': TLS handshake failed with remote 'tls://127.0.0.1:37370': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:43:19,845 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:43:20,853 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:43:20,867 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38963 8450s 2024-11-23 22:43:20,868 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45779/status 8450s 2024-11-23 22:43:20,868 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:43:20,893 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43181 8450s 2024-11-23 22:43:20,894 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43181 8450s 2024-11-23 22:43:20,894 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:43:20,894 - distributed.worker - INFO - dashboard at: 127.0.0.1:44491 8450s 2024-11-23 22:43:20,894 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38963 8450s 2024-11-23 22:43:20,894 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:43:20,894 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:43:20,894 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:43:20,894 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-dyjb2x43 8450s 2024-11-23 22:43:20,894 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:43:20,898 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38415 8450s 2024-11-23 22:43:20,899 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38415 8450s 2024-11-23 22:43:20,899 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:43:20,899 - distributed.worker - INFO - dashboard at: 127.0.0.1:44967 8450s 2024-11-23 22:43:20,899 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38963 8450s 2024-11-23 22:43:20,899 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:43:20,899 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:43:20,899 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:43:20,899 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-jouqkhm9 8450s 2024-11-23 22:43:20,899 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:43:20,902 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43181. Reason: failure-to-start- 8450s 2024-11-23 22:43:20,902 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:43:20,903 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38415. Reason: failure-to-start- 8450s 2024-11-23 22:43:20,903 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:43:20,906 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38963': TLS handshake failed with remote 'tls://127.0.0.1:38546': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:43:20,906 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38963': TLS handshake failed with remote 'tls://127.0.0.1:38558': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:43:20,909 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:43:21,916 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:43:21,927 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40389 8450s 2024-11-23 22:43:21,928 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44025/status 8450s 2024-11-23 22:43:21,928 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:43:21,953 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44039 8450s 2024-11-23 22:43:21,953 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44039 8450s 2024-11-23 22:43:21,953 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:43:21,953 - distributed.worker - INFO - dashboard at: 127.0.0.1:43771 8450s 2024-11-23 22:43:21,954 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40389 8450s 2024-11-23 22:43:21,954 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:43:21,954 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:43:21,954 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:43:21,954 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-8niauy98 8450s 2024-11-23 22:43:21,954 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:43:21,958 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43267 8450s 2024-11-23 22:43:21,958 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43267 8450s 2024-11-23 22:43:21,958 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:43:21,958 - distributed.worker - INFO - dashboard at: 127.0.0.1:42757 8450s 2024-11-23 22:43:21,958 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40389 8450s 2024-11-23 22:43:21,959 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:43:21,959 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:43:21,959 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:43:21,959 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-2te651r3 8450s 2024-11-23 22:43:21,959 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:43:21,961 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44039. Reason: failure-to-start- 8450s 2024-11-23 22:43:21,961 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:43:21,962 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43267. Reason: failure-to-start- 8450s 2024-11-23 22:43:21,963 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:43:21,969 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40389': TLS handshake failed with remote 'tls://127.0.0.1:42342': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:43:21,969 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40389': TLS handshake failed with remote 'tls://127.0.0.1:42348': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:43:21,972 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:43:22,980 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:43:22,992 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33485 8450s 2024-11-23 22:43:22,992 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45081/status 8450s 2024-11-23 22:43:22,993 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:43:23,015 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42121 8450s 2024-11-23 22:43:23,015 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42121 8450s 2024-11-23 22:43:23,016 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:43:23,016 - distributed.worker - INFO - dashboard at: 127.0.0.1:44101 8450s 2024-11-23 22:43:23,016 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33485 8450s 2024-11-23 22:43:23,016 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:43:23,016 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:43:23,016 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:43:23,016 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-gmkdwgwn 8450s 2024-11-23 22:43:23,016 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:43:23,020 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38283 8450s 2024-11-23 22:43:23,020 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38283 8450s 2024-11-23 22:43:23,020 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:43:23,020 - distributed.worker - INFO - dashboard at: 127.0.0.1:35441 8450s 2024-11-23 22:43:23,020 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33485 8450s 2024-11-23 22:43:23,020 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:43:23,020 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:43:23,020 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:43:23,021 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-vja66vjp 8450s 2024-11-23 22:43:23,021 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:43:23,025 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42121. Reason: failure-to-start- 8450s 2024-11-23 22:43:23,025 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:43:23,026 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38283. Reason: failure-to-start- 8450s 2024-11-23 22:43:23,026 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:43:23,032 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33485': TLS handshake failed with remote 'tls://127.0.0.1:44840': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:43:23,032 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33485': TLS handshake failed with remote 'tls://127.0.0.1:44844': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:43:23,035 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:43:24,044 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:43:24,055 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37253 8450s 2024-11-23 22:43:24,056 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37753/status 8450s 2024-11-23 22:43:24,056 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:43:24,080 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40193 8450s 2024-11-23 22:43:24,081 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40193 8450s 2024-11-23 22:43:24,081 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:43:24,081 - distributed.worker - INFO - dashboard at: 127.0.0.1:46343 8450s 2024-11-23 22:43:24,081 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37253 8450s 2024-11-23 22:43:24,081 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:43:24,081 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:43:24,081 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:43:24,081 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-01jtqprr 8450s 2024-11-23 22:43:24,081 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:43:24,085 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35893 8450s 2024-11-23 22:43:24,086 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35893 8450s 2024-11-23 22:43:24,086 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:43:24,086 - distributed.worker - INFO - dashboard at: 127.0.0.1:36985 8450s 2024-11-23 22:43:24,086 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37253 8450s 2024-11-23 22:43:24,086 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:43:24,086 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:43:24,086 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:43:24,086 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-6bqpca6p 8450s 2024-11-23 22:43:24,087 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:43:24,093 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40193. Reason: failure-to-start- 8450s 2024-11-23 22:43:24,093 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:43:24,094 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35893. Reason: failure-to-start- 8450s 2024-11-23 22:43:24,095 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:43:24,097 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37253': TLS handshake failed with remote 'tls://127.0.0.1:34216': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:43:24,097 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37253': TLS handshake failed with remote 'tls://127.0.0.1:34220': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:43:24,100 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:43:25,108 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:43:25,121 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36247 8450s 2024-11-23 22:43:25,122 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40263/status 8450s 2024-11-23 22:43:25,122 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:43:25,146 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41247 8450s 2024-11-23 22:43:25,147 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41247 8450s 2024-11-23 22:43:25,147 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:43:25,147 - distributed.worker - INFO - dashboard at: 127.0.0.1:40573 8450s 2024-11-23 22:43:25,147 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36247 8450s 2024-11-23 22:43:25,147 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:43:25,147 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:43:25,147 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:43:25,147 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-s4wa_jo9 8450s 2024-11-23 22:43:25,147 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:43:25,151 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44095 8450s 2024-11-23 22:43:25,152 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44095 8450s 2024-11-23 22:43:25,152 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:43:25,152 - distributed.worker - INFO - dashboard at: 127.0.0.1:44229 8450s 2024-11-23 22:43:25,152 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36247 8450s 2024-11-23 22:43:25,152 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:43:25,152 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:43:25,152 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:43:25,152 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-osxc1e0x 8450s 2024-11-23 22:43:25,152 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:43:25,158 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41247. Reason: failure-to-start- 8450s 2024-11-23 22:43:25,159 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:43:25,160 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44095. Reason: failure-to-start- 8450s 2024-11-23 22:43:25,160 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:43:25,163 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36247': TLS handshake failed with remote 'tls://127.0.0.1:49998': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:43:25,163 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36247': TLS handshake failed with remote 'tls://127.0.0.1:50014': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:43:25,166 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:43:26,175 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:43:26,185 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42679 8450s 2024-11-23 22:43:26,186 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40693/status 8450s 2024-11-23 22:43:26,187 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:43:26,234 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35741 8450s 2024-11-23 22:43:26,234 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35741 8450s 2024-11-23 22:43:26,234 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:43:26,235 - distributed.worker - INFO - dashboard at: 127.0.0.1:42037 8450s 2024-11-23 22:43:26,235 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42679 8450s 2024-11-23 22:43:26,235 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:43:26,235 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:43:26,235 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:43:26,235 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-7803y4b8 8450s 2024-11-23 22:43:26,235 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:43:26,239 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43253 8450s 2024-11-23 22:43:26,239 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43253 8450s 2024-11-23 22:43:26,239 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:43:26,239 - distributed.worker - INFO - dashboard at: 127.0.0.1:36067 8450s 2024-11-23 22:43:26,239 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42679 8450s 2024-11-23 22:43:26,239 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:43:26,240 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:43:26,240 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:43:26,240 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-skisusa1 8450s 2024-11-23 22:43:26,240 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:43:26,246 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35741. Reason: failure-to-start- 8450s 2024-11-23 22:43:26,246 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:43:26,247 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43253. Reason: failure-to-start- 8450s 2024-11-23 22:43:26,247 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:43:26,250 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42679': TLS handshake failed with remote 'tls://127.0.0.1:34780': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:43:26,250 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42679': TLS handshake failed with remote 'tls://127.0.0.1:34794': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:43:26,257 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:43:27,265 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:43:27,277 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43675 8450s 2024-11-23 22:43:27,277 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46699/status 8450s 2024-11-23 22:43:27,278 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:43:27,302 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37943 8450s 2024-11-23 22:43:27,302 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37943 8450s 2024-11-23 22:43:27,302 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:43:27,302 - distributed.worker - INFO - dashboard at: 127.0.0.1:40203 8450s 2024-11-23 22:43:27,302 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43675 8450s 2024-11-23 22:43:27,302 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:43:27,302 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:43:27,302 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:43:27,302 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-v9akyvse 8450s 2024-11-23 22:43:27,303 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:43:27,306 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42039 8450s 2024-11-23 22:43:27,307 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42039 8450s 2024-11-23 22:43:27,307 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:43:27,307 - distributed.worker - INFO - dashboard at: 127.0.0.1:39487 8450s 2024-11-23 22:43:27,307 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43675 8450s 2024-11-23 22:43:27,307 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:43:27,307 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:43:27,307 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:43:27,307 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-lacox82c 8450s 2024-11-23 22:43:27,307 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:43:27,312 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37943. Reason: failure-to-start- 8450s 2024-11-23 22:43:27,313 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:43:27,313 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42039. Reason: failure-to-start- 8450s 2024-11-23 22:43:27,314 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:43:27,320 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43675': TLS handshake failed with remote 'tls://127.0.0.1:45388': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:43:27,320 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43675': TLS handshake failed with remote 'tls://127.0.0.1:45390': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:43:27,323 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:43:28,331 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:43:28,343 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36471 8450s 2024-11-23 22:43:28,344 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35441/status 8450s 2024-11-23 22:43:28,345 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:43:28,370 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45807 8450s 2024-11-23 22:43:28,370 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45807 8450s 2024-11-23 22:43:28,370 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:43:28,370 - distributed.worker - INFO - dashboard at: 127.0.0.1:37517 8450s 2024-11-23 22:43:28,371 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36471 8450s 2024-11-23 22:43:28,371 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:43:28,371 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:43:28,371 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:43:28,371 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-srfrdgr6 8450s 2024-11-23 22:43:28,371 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:43:28,375 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34115 8450s 2024-11-23 22:43:28,375 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34115 8450s 2024-11-23 22:43:28,375 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:43:28,375 - distributed.worker - INFO - dashboard at: 127.0.0.1:35955 8450s 2024-11-23 22:43:28,376 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36471 8450s 2024-11-23 22:43:28,376 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:43:28,376 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:43:28,376 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:43:28,376 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-5c0g6g6q 8450s 2024-11-23 22:43:28,376 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:43:28,382 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45807. Reason: failure-to-start- 8450s 2024-11-23 22:43:28,383 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:43:28,384 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34115. Reason: failure-to-start- 8450s 2024-11-23 22:43:28,384 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:43:28,390 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36471': TLS handshake failed with remote 'tls://127.0.0.1:35312': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:43:28,391 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36471': TLS handshake failed with remote 'tls://127.0.0.1:35320': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:43:28,394 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:43:29,402 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:43:29,417 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45039 8450s 2024-11-23 22:43:29,417 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43505/status 8450s 2024-11-23 22:43:29,418 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:43:29,446 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34287 8450s 2024-11-23 22:43:29,446 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34287 8450s 2024-11-23 22:43:29,446 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:43:29,446 - distributed.worker - INFO - dashboard at: 127.0.0.1:46053 8450s 2024-11-23 22:43:29,447 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45039 8450s 2024-11-23 22:43:29,447 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:43:29,447 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:43:29,447 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:43:29,447 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ghrbh2pu 8450s 2024-11-23 22:43:29,447 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:43:29,451 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33521 8450s 2024-11-23 22:43:29,451 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33521 8450s 2024-11-23 22:43:29,451 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:43:29,451 - distributed.worker - INFO - dashboard at: 127.0.0.1:38659 8450s 2024-11-23 22:43:29,451 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45039 8450s 2024-11-23 22:43:29,451 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:43:29,452 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:43:29,452 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:43:29,452 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-sltnylf_ 8450s 2024-11-23 22:43:29,452 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:43:29,458 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34287. Reason: failure-to-start- 8450s 2024-11-23 22:43:29,459 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:43:29,459 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33521. Reason: failure-to-start- 8450s 2024-11-23 22:43:29,460 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:43:29,466 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45039': TLS handshake failed with remote 'tls://127.0.0.1:53896': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:43:29,466 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45039': TLS handshake failed with remote 'tls://127.0.0.1:53902': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:43:29,469 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:43:30,477 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:43:30,488 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39265 8450s 2024-11-23 22:43:30,489 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46247/status 8450s 2024-11-23 22:43:30,489 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:43:30,517 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45149 8450s 2024-11-23 22:43:30,518 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45149 8450s 2024-11-23 22:43:30,518 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:43:30,518 - distributed.worker - INFO - dashboard at: 127.0.0.1:38789 8450s 2024-11-23 22:43:30,518 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39265 8450s 2024-11-23 22:43:30,518 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:43:30,518 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:43:30,518 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:43:30,518 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-6iw5uhu8 8450s 2024-11-23 22:43:30,518 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:43:30,522 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40553 8450s 2024-11-23 22:43:30,523 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40553 8450s 2024-11-23 22:43:30,523 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:43:30,523 - distributed.worker - INFO - dashboard at: 127.0.0.1:43331 8450s 2024-11-23 22:43:30,523 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39265 8450s 2024-11-23 22:43:30,523 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:43:30,523 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:43:30,523 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:43:30,523 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-4d50dli4 8450s 2024-11-23 22:43:30,523 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:43:30,529 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45149. Reason: failure-to-start- 8450s 2024-11-23 22:43:30,530 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:43:30,531 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40553. Reason: failure-to-start- 8450s 2024-11-23 22:43:30,531 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:43:30,537 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39265': TLS handshake failed with remote 'tls://127.0.0.1:60788': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:43:30,537 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39265': TLS handshake failed with remote 'tls://127.0.0.1:60804': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:43:30,540 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:43:31,549 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:43:31,560 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45539 8450s 2024-11-23 22:43:31,561 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40827/status 8450s 2024-11-23 22:43:31,562 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:43:31,590 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37871 8450s 2024-11-23 22:43:31,590 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37871 8450s 2024-11-23 22:43:31,590 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:43:31,590 - distributed.worker - INFO - dashboard at: 127.0.0.1:38851 8450s 2024-11-23 22:43:31,590 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45539 8450s 2024-11-23 22:43:31,590 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:43:31,591 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:43:31,591 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:43:31,591 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-6ji_3ful 8450s 2024-11-23 22:43:31,591 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:43:31,595 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34977 8450s 2024-11-23 22:43:31,595 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34977 8450s 2024-11-23 22:43:31,595 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:43:31,595 - distributed.worker - INFO - dashboard at: 127.0.0.1:36299 8450s 2024-11-23 22:43:31,595 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45539 8450s 2024-11-23 22:43:31,596 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:43:31,596 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:43:31,596 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:43:31,596 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-47ttcfn7 8450s 2024-11-23 22:43:31,596 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:43:31,604 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37871. Reason: failure-to-start- 8450s 2024-11-23 22:43:31,605 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:43:31,606 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34977. Reason: failure-to-start- 8450s 2024-11-23 22:43:31,606 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:43:31,609 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45539': TLS handshake failed with remote 'tls://127.0.0.1:36722': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:43:31,609 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45539': TLS handshake failed with remote 'tls://127.0.0.1:36728': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:43:31,612 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:43:32,620 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:43:32,632 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43953 8450s 2024-11-23 22:43:32,633 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46015/status 8450s 2024-11-23 22:43:32,633 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:43:32,663 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34995 8450s 2024-11-23 22:43:32,663 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34995 8450s 2024-11-23 22:43:32,663 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:43:32,663 - distributed.worker - INFO - dashboard at: 127.0.0.1:34035 8450s 2024-11-23 22:43:32,663 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43953 8450s 2024-11-23 22:43:32,663 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:43:32,663 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:43:32,664 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:43:32,664 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-qaah3nri 8450s 2024-11-23 22:43:32,664 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:43:32,667 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44709 8450s 2024-11-23 22:43:32,668 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44709 8450s 2024-11-23 22:43:32,668 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:43:32,668 - distributed.worker - INFO - dashboard at: 127.0.0.1:33143 8450s 2024-11-23 22:43:32,668 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43953 8450s 2024-11-23 22:43:32,668 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:43:32,668 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:43:32,668 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:43:32,668 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-x0611fg7 8450s 2024-11-23 22:43:32,669 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:43:32,671 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34995. Reason: failure-to-start- 8450s 2024-11-23 22:43:32,672 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:43:32,672 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44709. Reason: failure-to-start- 8450s 2024-11-23 22:43:32,673 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:43:32,676 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43953': TLS handshake failed with remote 'tls://127.0.0.1:44684': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:43:32,676 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43953': TLS handshake failed with remote 'tls://127.0.0.1:44686': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:43:32,679 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:43:33,687 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:43:33,701 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43993 8450s 2024-11-23 22:43:33,702 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42903/status 8450s 2024-11-23 22:43:33,702 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:43:33,733 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41015 8450s 2024-11-23 22:43:33,734 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41015 8450s 2024-11-23 22:43:33,734 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:43:33,734 - distributed.worker - INFO - dashboard at: 127.0.0.1:39299 8450s 2024-11-23 22:43:33,734 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:43:33,734 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:43:33,734 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:43:33,734 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:43:33,734 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-yfcayxsq 8450s 2024-11-23 22:43:33,734 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:43:33,738 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36511 8450s 2024-11-23 22:43:33,739 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36511 8450s 2024-11-23 22:43:33,739 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:43:33,739 - distributed.worker - INFO - dashboard at: 127.0.0.1:34299 8450s 2024-11-23 22:43:33,739 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43993 8450s 2024-11-23 22:43:33,739 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:43:33,739 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:43:33,739 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:43:33,739 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-yobnqm4_ 8450s 2024-11-23 22:43:33,739 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:43:33,742 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41015. Reason: failure-to-start- 8450s 2024-11-23 22:43:33,742 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:43:33,743 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36511. Reason: failure-to-start- 8450s 2024-11-23 22:43:33,743 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:43:33,746 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:44060': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:43:33,746 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43993': TLS handshake failed with remote 'tls://127.0.0.1:44064': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:43:33,749 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:43:34,758 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:43:34,769 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42719 8450s 2024-11-23 22:43:34,770 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42225/status 8450s 2024-11-23 22:43:34,770 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:43:34,797 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43981 8450s 2024-11-23 22:43:34,798 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43981 8450s 2024-11-23 22:43:34,798 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:43:34,798 - distributed.worker - INFO - dashboard at: 127.0.0.1:45777 8450s 2024-11-23 22:43:34,798 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42719 8450s 2024-11-23 22:43:34,798 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:43:34,798 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:43:34,798 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:43:34,798 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-esij_l7v 8450s 2024-11-23 22:43:34,798 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:43:34,802 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33127 8450s 2024-11-23 22:43:34,803 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33127 8450s 2024-11-23 22:43:34,803 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:43:34,803 - distributed.worker - INFO - dashboard at: 127.0.0.1:35751 8450s 2024-11-23 22:43:34,803 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42719 8450s 2024-11-23 22:43:34,803 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:43:34,803 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:43:34,803 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:43:34,803 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-0vn4_qe0 8450s 2024-11-23 22:43:34,803 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:43:34,809 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43981. Reason: failure-to-start- 8450s 2024-11-23 22:43:34,809 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:43:34,810 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33127. Reason: failure-to-start- 8450s 2024-11-23 22:43:34,811 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:43:34,813 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42719': TLS handshake failed with remote 'tls://127.0.0.1:34376': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:43:34,814 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42719': TLS handshake failed with remote 'tls://127.0.0.1:34380': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:43:34,820 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:43:35,828 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:43:35,840 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44119 8450s 2024-11-23 22:43:35,841 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36863/status 8450s 2024-11-23 22:43:35,841 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:43:35,866 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37487 8450s 2024-11-23 22:43:35,866 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37487 8450s 2024-11-23 22:43:35,866 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:43:35,866 - distributed.worker - INFO - dashboard at: 127.0.0.1:37989 8450s 2024-11-23 22:43:35,866 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44119 8450s 2024-11-23 22:43:35,867 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:43:35,867 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:43:35,867 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:43:35,867 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-imt4seyr 8450s 2024-11-23 22:43:35,867 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:43:35,871 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42665 8450s 2024-11-23 22:43:35,871 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42665 8450s 2024-11-23 22:43:35,871 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:43:35,871 - distributed.worker - INFO - dashboard at: 127.0.0.1:36289 8450s 2024-11-23 22:43:35,872 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44119 8450s 2024-11-23 22:43:35,872 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:43:35,872 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:43:35,872 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:43:35,872 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-x98s6pb8 8450s 2024-11-23 22:43:35,872 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:43:35,884 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37487. Reason: failure-to-start- 8450s 2024-11-23 22:43:35,884 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:43:35,885 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42665. Reason: failure-to-start- 8450s 2024-11-23 22:43:35,886 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:43:35,892 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44119': TLS handshake failed with remote 'tls://127.0.0.1:35410': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:43:35,892 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44119': TLS handshake failed with remote 'tls://127.0.0.1:35424': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:43:35,895 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:43:36,903 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:43:36,915 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38795 8450s 2024-11-23 22:43:36,916 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39087/status 8450s 2024-11-23 22:43:36,916 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:43:36,944 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43921 8450s 2024-11-23 22:43:36,945 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43921 8450s 2024-11-23 22:43:36,945 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:43:36,945 - distributed.worker - INFO - dashboard at: 127.0.0.1:40807 8450s 2024-11-23 22:43:36,945 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38795 8450s 2024-11-23 22:43:36,945 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:43:36,945 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:43:36,945 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:43:36,945 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-notls89v 8450s 2024-11-23 22:43:36,945 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:43:36,949 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45483 8450s 2024-11-23 22:43:36,950 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45483 8450s 2024-11-23 22:43:36,950 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:43:36,950 - distributed.worker - INFO - dashboard at: 127.0.0.1:33275 8450s 2024-11-23 22:43:36,950 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38795 8450s 2024-11-23 22:43:36,950 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:43:36,950 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:43:36,950 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:43:36,951 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-jzbhhq37 8450s 2024-11-23 22:43:36,951 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:43:36,962 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43921. Reason: failure-to-start- 8450s 2024-11-23 22:43:36,963 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:43:36,964 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45483. Reason: failure-to-start- 8450s 2024-11-23 22:43:36,964 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:43:36,971 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38795': TLS handshake failed with remote 'tls://127.0.0.1:58828': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:43:36,971 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38795': TLS handshake failed with remote 'tls://127.0.0.1:58834': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:43:36,974 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:43:37,983 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:43:37,994 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35163 8450s 2024-11-23 22:43:37,995 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33259/status 8450s 2024-11-23 22:43:37,995 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:43:38,026 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39591 8450s 2024-11-23 22:43:38,027 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39591 8450s 2024-11-23 22:43:38,027 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:43:38,027 - distributed.worker - INFO - dashboard at: 127.0.0.1:36311 8450s 2024-11-23 22:43:38,027 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35163 8450s 2024-11-23 22:43:38,027 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:43:38,027 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:43:38,027 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:43:38,028 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-fu1lq0si 8450s 2024-11-23 22:43:38,028 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:43:38,032 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35715 8450s 2024-11-23 22:43:38,032 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35715 8450s 2024-11-23 22:43:38,032 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:43:38,032 - distributed.worker - INFO - dashboard at: 127.0.0.1:39019 8450s 2024-11-23 22:43:38,032 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35163 8450s 2024-11-23 22:43:38,032 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:43:38,032 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:43:38,032 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:43:38,033 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-9yglx_48 8450s 2024-11-23 22:43:38,033 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:43:38,039 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39591. Reason: failure-to-start- 8450s 2024-11-23 22:43:38,039 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:43:38,040 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35715. Reason: failure-to-start- 8450s 2024-11-23 22:43:38,041 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:43:38,044 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35163': TLS handshake failed with remote 'tls://127.0.0.1:52642': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:43:38,044 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35163': TLS handshake failed with remote 'tls://127.0.0.1:52652': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:43:38,047 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:43:39,054 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:43:39,071 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41419 8450s 2024-11-23 22:43:39,072 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33693/status 8450s 2024-11-23 22:43:39,073 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:43:39,106 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38051 8450s 2024-11-23 22:43:39,106 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38051 8450s 2024-11-23 22:43:39,106 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:43:39,106 - distributed.worker - INFO - dashboard at: 127.0.0.1:43573 8450s 2024-11-23 22:43:39,106 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41419 8450s 2024-11-23 22:43:39,106 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:43:39,106 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:43:39,106 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:43:39,107 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-3i8hma9n 8450s 2024-11-23 22:43:39,107 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:43:39,110 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40957 8450s 2024-11-23 22:43:39,111 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40957 8450s 2024-11-23 22:43:39,111 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:43:39,111 - distributed.worker - INFO - dashboard at: 127.0.0.1:36327 8450s 2024-11-23 22:43:39,111 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41419 8450s 2024-11-23 22:43:39,111 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:43:39,111 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:43:39,111 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:43:39,111 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-9rt2hka8 8450s 2024-11-23 22:43:39,111 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:43:39,114 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38051. Reason: failure-to-start- 8450s 2024-11-23 22:43:39,114 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:43:39,115 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40957. Reason: failure-to-start- 8450s 2024-11-23 22:43:39,116 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:43:39,118 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41419': TLS handshake failed with remote 'tls://127.0.0.1:34480': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:43:39,119 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41419': TLS handshake failed with remote 'tls://127.0.0.1:34488': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:43:39,121 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:43:40,132 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:43:40,143 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38121 8450s 2024-11-23 22:43:40,144 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:32855/status 8450s 2024-11-23 22:43:40,144 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:43:40,178 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:32837 8450s 2024-11-23 22:43:40,179 - distributed.worker - INFO - Listening to: tls://127.0.0.1:32837 8450s 2024-11-23 22:43:40,179 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:43:40,179 - distributed.worker - INFO - dashboard at: 127.0.0.1:40249 8450s 2024-11-23 22:43:40,179 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38121 8450s 2024-11-23 22:43:40,179 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:43:40,179 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:43:40,179 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:43:40,180 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-00z48tdy 8450s 2024-11-23 22:43:40,180 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:43:40,183 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38471 8450s 2024-11-23 22:43:40,184 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38471 8450s 2024-11-23 22:43:40,184 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:43:40,184 - distributed.worker - INFO - dashboard at: 127.0.0.1:34401 8450s 2024-11-23 22:43:40,184 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38121 8450s 2024-11-23 22:43:40,184 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:43:40,184 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:43:40,185 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:43:40,185 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-i6qx6chj 8450s 2024-11-23 22:43:40,185 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:43:40,188 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:32837. Reason: failure-to-start- 8450s 2024-11-23 22:43:40,188 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:43:40,189 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38471. Reason: failure-to-start- 8450s 2024-11-23 22:43:40,189 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:43:40,192 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38121': TLS handshake failed with remote 'tls://127.0.0.1:39564': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:43:40,193 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38121': TLS handshake failed with remote 'tls://127.0.0.1:39578': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:43:40,203 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:43:41,211 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:43:41,224 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43501 8450s 2024-11-23 22:43:41,225 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41527/status 8450s 2024-11-23 22:43:41,226 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:43:41,255 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33269 8450s 2024-11-23 22:43:41,255 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33269 8450s 2024-11-23 22:43:41,255 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:43:41,255 - distributed.worker - INFO - dashboard at: 127.0.0.1:40921 8450s 2024-11-23 22:43:41,256 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43501 8450s 2024-11-23 22:43:41,256 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:43:41,256 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:43:41,256 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:43:41,256 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-lnyd2c4j 8450s 2024-11-23 22:43:41,256 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:43:41,260 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46631 8450s 2024-11-23 22:43:41,263 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46631 8450s 2024-11-23 22:43:41,263 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:43:41,263 - distributed.worker - INFO - dashboard at: 127.0.0.1:40761 8450s 2024-11-23 22:43:41,263 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43501 8450s 2024-11-23 22:43:41,263 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:43:41,263 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:43:41,263 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:43:41,264 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-02p7iozp 8450s 2024-11-23 22:43:41,264 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:43:41,271 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33269. Reason: failure-to-start- 8450s 2024-11-23 22:43:41,271 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:43:41,272 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46631. Reason: failure-to-start- 8450s 2024-11-23 22:43:41,272 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:43:41,276 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43501': TLS handshake failed with remote 'tls://127.0.0.1:50732': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:43:41,276 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43501': TLS handshake failed with remote 'tls://127.0.0.1:50736': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:43:41,287 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:43:42,295 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:43:42,307 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35283 8450s 2024-11-23 22:43:42,308 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35559/status 8450s 2024-11-23 22:43:42,308 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:43:42,337 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43219 8450s 2024-11-23 22:43:42,337 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43219 8450s 2024-11-23 22:43:42,338 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:43:42,338 - distributed.worker - INFO - dashboard at: 127.0.0.1:40465 8450s 2024-11-23 22:43:42,338 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35283 8450s 2024-11-23 22:43:42,338 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:43:42,338 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:43:42,338 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:43:42,338 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-6vfduzn3 8450s 2024-11-23 22:43:42,338 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:43:42,342 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36097 8450s 2024-11-23 22:43:42,342 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36097 8450s 2024-11-23 22:43:42,342 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:43:42,342 - distributed.worker - INFO - dashboard at: 127.0.0.1:34395 8450s 2024-11-23 22:43:42,343 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35283 8450s 2024-11-23 22:43:42,343 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:43:42,343 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:43:42,343 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:43:42,343 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-e79qoc56 8450s 2024-11-23 22:43:42,343 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:43:42,374 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43219. Reason: failure-to-start- 8450s 2024-11-23 22:43:42,375 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:43:42,376 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36097. Reason: failure-to-start- 8450s 2024-11-23 22:43:42,376 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:43:42,383 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35283': TLS handshake failed with remote 'tls://127.0.0.1:45430': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:43:42,384 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35283': TLS handshake failed with remote 'tls://127.0.0.1:45432': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:43:42,398 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s __________________________________ test_nanny __________________________________ 8450s 8450s fut = , timeout = 0 8450s 8450s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 8450s async with asyncio.timeout(timeout): 8450s > return await fut 8450s 8450s /usr/lib/python3/dist-packages/distributed/utils.py:1960: 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s /usr/lib/python3/dist-packages/distributed/nanny.py:358: in start_unsafe 8450s comm = await self.rpc.connect(saddr) 8450s /usr/lib/python3/dist-packages/distributed/core.py:1620: in connect 8450s return await self._connect(addr=addr, timeout=timeout) 8450s /usr/lib/python3/dist-packages/distributed/core.py:1564: in _connect 8450s comm = await connect( 8450s /usr/lib/python3/dist-packages/distributed/comm/core.py:342: in connect 8450s comm = await wait_for( 8450s /usr/lib/python3/dist-packages/distributed/utils.py:1960: in wait_for 8450s return await fut 8450s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:546: in connect 8450s stream = await self.client.connect( 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s 8450s self = , host = '127.0.0.1' 8450s port = 37435, af = 8450s ssl_options = 8450s max_buffer_size = 8364507136.0, source_ip = None, source_port = None 8450s timeout = None 8450s 8450s async def connect( 8450s self, 8450s host: str, 8450s port: int, 8450s af: socket.AddressFamily = socket.AF_UNSPEC, 8450s ssl_options: Optional[Union[Dict[str, Any], ssl.SSLContext]] = None, 8450s max_buffer_size: Optional[int] = None, 8450s source_ip: Optional[str] = None, 8450s source_port: Optional[int] = None, 8450s timeout: Optional[Union[float, datetime.timedelta]] = None, 8450s ) -> IOStream: 8450s """Connect to the given host and port. 8450s 8450s Asynchronously returns an `.IOStream` (or `.SSLIOStream` if 8450s ``ssl_options`` is not None). 8450s 8450s Using the ``source_ip`` kwarg, one can specify the source 8450s IP address to use when establishing the connection. 8450s In case the user needs to resolve and 8450s use a specific interface, it has to be handled outside 8450s of Tornado as this depends very much on the platform. 8450s 8450s Raises `TimeoutError` if the input future does not complete before 8450s ``timeout``, which may be specified in any form allowed by 8450s `.IOLoop.add_timeout` (i.e. a `datetime.timedelta` or an absolute time 8450s relative to `.IOLoop.time`) 8450s 8450s Similarly, when the user requires a certain source port, it can 8450s be specified using the ``source_port`` arg. 8450s 8450s .. versionchanged:: 4.5 8450s Added the ``source_ip`` and ``source_port`` arguments. 8450s 8450s .. versionchanged:: 5.0 8450s Added the ``timeout`` argument. 8450s """ 8450s if timeout is not None: 8450s if isinstance(timeout, numbers.Real): 8450s timeout = IOLoop.current().time() + timeout 8450s elif isinstance(timeout, datetime.timedelta): 8450s timeout = IOLoop.current().time() + timeout.total_seconds() 8450s else: 8450s raise TypeError("Unsupported timeout %r" % timeout) 8450s if timeout is not None: 8450s addrinfo = await gen.with_timeout( 8450s timeout, self.resolver.resolve(host, port, af) 8450s ) 8450s else: 8450s addrinfo = await self.resolver.resolve(host, port, af) 8450s connector = _Connector( 8450s addrinfo, 8450s functools.partial( 8450s self._create_stream, 8450s max_buffer_size, 8450s source_ip=source_ip, 8450s source_port=source_port, 8450s ), 8450s ) 8450s > af, addr, stream = await connector.start(connect_timeout=timeout) 8450s E asyncio.exceptions.CancelledError 8450s 8450s /usr/lib/python3/dist-packages/tornado/tcpclient.py:279: CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s self = 8450s 8450s @final 8450s async def start(self): 8450s async with self._startup_lock: 8450s if self.status == Status.failed: 8450s assert self.__startup_exc is not None 8450s raise self.__startup_exc 8450s elif self.status != Status.init: 8450s return self 8450s timeout = getattr(self, "death_timeout", None) 8450s 8450s async def _close_on_failure(exc: Exception) -> None: 8450s await self.close(reason=f"failure-to-start-{str(type(exc))}") 8450s self.status = Status.failed 8450s self.__startup_exc = exc 8450s 8450s try: 8450s > await wait_for(self.start_unsafe(), timeout=timeout) 8450s 8450s /usr/lib/python3/dist-packages/distributed/core.py:664: 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 8450s async with asyncio.timeout(timeout): 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s 8450s self = 8450s exc_type = 8450s exc_val = CancelledError(), exc_tb = 8450s 8450s async def __aexit__( 8450s self, 8450s exc_type: Optional[Type[BaseException]], 8450s exc_val: Optional[BaseException], 8450s exc_tb: Optional[TracebackType], 8450s ) -> Optional[bool]: 8450s assert self._state in (_State.ENTERED, _State.EXPIRING) 8450s 8450s if self._timeout_handler is not None: 8450s self._timeout_handler.cancel() 8450s self._timeout_handler = None 8450s 8450s if self._state is _State.EXPIRING: 8450s self._state = _State.EXPIRED 8450s 8450s if self._task.uncancel() <= self._cancelling and exc_type is not None: 8450s # Since there are no new cancel requests, we're 8450s # handling this. 8450s if issubclass(exc_type, exceptions.CancelledError): 8450s > raise TimeoutError from exc_val 8450s E TimeoutError 8450s 8450s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s @contextlib.asynccontextmanager 8450s async def _cluster_factory(): 8450s workers = [] 8450s s = None 8450s try: 8450s for _ in range(60): 8450s try: 8450s > s, ws = await start_cluster( 8450s nthreads, 8450s scheduler, 8450s security=security, 8450s Worker=Worker, 8450s scheduler_kwargs=scheduler_kwargs, 8450s worker_kwargs=merge( 8450s {"death_timeout": min(15, int(deadline.remaining))}, 8450s worker_kwargs, 8450s ), 8450s ) 8450s 8450s /usr/lib/python3/dist-packages/distributed/utils_test.py:966: 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s /usr/lib/python3/dist-packages/distributed/utils_test.py:789: in start_cluster 8450s await asyncio.gather(*workers) 8450s /usr/lib/python3.13/asyncio/tasks.py:737: in _wrap_awaitable 8450s return await awaitable 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s 8450s self = 8450s 8450s @final 8450s async def start(self): 8450s async with self._startup_lock: 8450s if self.status == Status.failed: 8450s assert self.__startup_exc is not None 8450s raise self.__startup_exc 8450s elif self.status != Status.init: 8450s return self 8450s timeout = getattr(self, "death_timeout", None) 8450s 8450s async def _close_on_failure(exc: Exception) -> None: 8450s await self.close(reason=f"failure-to-start-{str(type(exc))}") 8450s self.status = Status.failed 8450s self.__startup_exc = exc 8450s 8450s try: 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s except asyncio.TimeoutError as exc: 8450s await _close_on_failure(exc) 8450s > raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s E TimeoutError: Nanny start timed out after 0s. 8450s 8450s /usr/lib/python3/dist-packages/distributed/core.py:667: TimeoutError 8450s 8450s During handling of the above exception, another exception occurred: 8450s 8450s fut = ._..test_func..async_fn at 0xe8325938> 8450s timeout = 60 8450s 8450s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 8450s async with asyncio.timeout(timeout): 8450s > return await fut 8450s 8450s /usr/lib/python3/dist-packages/distributed/utils.py:1960: 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s /usr/lib/python3/dist-packages/distributed/utils_test.py:999: in async_fn 8450s _cluster_factory() as (s, workers), 8450s /usr/lib/python3.13/contextlib.py:214: in __aenter__ 8450s return await anext(self.gen) 8450s /usr/lib/python3/dist-packages/distributed/utils_test.py:983: in _cluster_factory 8450s await asyncio.sleep(1) 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s 8450s delay = 1, result = None 8450s 8450s async def sleep(delay, result=None): 8450s """Coroutine that completes after a given time (in seconds).""" 8450s if delay <= 0: 8450s await __sleep0() 8450s return result 8450s 8450s if math.isnan(delay): 8450s raise ValueError("Invalid delay: NaN (not a number)") 8450s 8450s loop = events.get_running_loop() 8450s future = loop.create_future() 8450s h = loop.call_later(delay, 8450s futures._set_result_unless_cancelled, 8450s future, result) 8450s try: 8450s > return await future 8450s E asyncio.exceptions.CancelledError 8450s 8450s /usr/lib/python3.13/asyncio/tasks.py:718: CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s args = (), kwds = {} 8450s 8450s @wraps(func) 8450s def inner(*args, **kwds): 8450s with self._recreate_cm(): 8450s > return func(*args, **kwds) 8450s 8450s /usr/lib/python3.13/contextlib.py:85: 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s /usr/lib/python3.13/contextlib.py:85: in inner 8450s return func(*args, **kwds) 8450s /usr/lib/python3/dist-packages/distributed/utils_test.py:1102: in test_func 8450s return _run_and_close_tornado(async_fn_outer) 8450s /usr/lib/python3/dist-packages/distributed/utils_test.py:378: in _run_and_close_tornado 8450s return asyncio_run(inner_fn(), loop_factory=get_loop_factory()) 8450s /usr/lib/python3.13/asyncio/runners.py:194: in run 8450s return runner.run(main) 8450s /usr/lib/python3.13/asyncio/runners.py:118: in run 8450s return self._loop.run_until_complete(task) 8450s /usr/lib/python3.13/asyncio/base_events.py:720: in run_until_complete 8450s return future.result() 8450s /usr/lib/python3/dist-packages/distributed/utils_test.py:375: in inner_fn 8450s return await async_fn(*args, **kwargs) 8450s /usr/lib/python3/dist-packages/distributed/utils_test.py:1099: in async_fn_outer 8450s return await utils_wait_for(async_fn(), timeout=timeout * 2) 8450s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 8450s async with asyncio.timeout(timeout): 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s 8450s self = 8450s exc_type = 8450s exc_val = CancelledError(), exc_tb = 8450s 8450s async def __aexit__( 8450s self, 8450s exc_type: Optional[Type[BaseException]], 8450s exc_val: Optional[BaseException], 8450s exc_tb: Optional[TracebackType], 8450s ) -> Optional[bool]: 8450s assert self._state in (_State.ENTERED, _State.EXPIRING) 8450s 8450s if self._timeout_handler is not None: 8450s self._timeout_handler.cancel() 8450s self._timeout_handler = None 8450s 8450s if self._state is _State.EXPIRING: 8450s self._state = _State.EXPIRED 8450s 8450s if self._task.uncancel() <= self._cancelling and exc_type is not None: 8450s # Since there are no new cancel requests, we're 8450s # handling this. 8450s if issubclass(exc_type, exceptions.CancelledError): 8450s > raise TimeoutError from exc_val 8450s E TimeoutError 8450s 8450s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 8450s ----------------------------- Captured stderr call ----------------------------- 8450s 2024-11-23 22:43:44,000 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:43:44,013 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34213 8450s 2024-11-23 22:43:44,014 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44069/status 8450s 2024-11-23 22:43:44,015 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:43:44,053 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:42333'. Reason: failure-to-start- 8450s 2024-11-23 22:43:44,054 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:46741'. Reason: failure-to-start- 8450s 2024-11-23 22:43:44,055 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34213': TLS handshake failed with remote 'tls://127.0.0.1:33090': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:44,055 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34213': TLS handshake failed with remote 'tls://127.0.0.1:33096': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:44,055 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 8450s stream = await stream.start_tls( 8450s ^^^^^^^^^^^^^^^^^^^^^^^ 8450s False, ssl_options=ssl_options, server_hostname=host 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 8450s self.socket.do_handshake() 8450s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 8450s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 8450s self._sslobj.do_handshake() 8450s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 8450s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 8450s comm = await self.rpc.connect(saddr) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 8450s return await self._connect(addr=addr, timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 8450s comm = await connect( 8450s ^^^^^^^^^^^^^^ 8450s ...<4 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 8450s raise FatalCommClosedError( 8450s ...<2 lines>... 8450s ) from err 8450s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 8450s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 8450s RuntimeError: Nanny failed to start. 8450s 2024-11-23 22:43:45,065 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:43:45,078 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39177 8450s 2024-11-23 22:43:45,078 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36895/status 8450s 2024-11-23 22:43:45,079 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:43:45,118 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:36451'. Reason: failure-to-start- 8450s 2024-11-23 22:43:45,119 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:33141'. Reason: failure-to-start- 8450s 2024-11-23 22:43:45,120 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39177': TLS handshake failed with remote 'tls://127.0.0.1:41186': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:45,120 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39177': TLS handshake failed with remote 'tls://127.0.0.1:41194': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:45,121 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 8450s stream = await stream.start_tls( 8450s ^^^^^^^^^^^^^^^^^^^^^^^ 8450s False, ssl_options=ssl_options, server_hostname=host 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 8450s self.socket.do_handshake() 8450s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 8450s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 8450s self._sslobj.do_handshake() 8450s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 8450s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 8450s comm = await self.rpc.connect(saddr) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 8450s return await self._connect(addr=addr, timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 8450s comm = await connect( 8450s ^^^^^^^^^^^^^^ 8450s ...<4 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 8450s raise FatalCommClosedError( 8450s ...<2 lines>... 8450s ) from err 8450s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 8450s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 8450s RuntimeError: Nanny failed to start. 8450s 2024-11-23 22:43:46,129 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:43:46,141 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39675 8450s 2024-11-23 22:43:46,142 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43005/status 8450s 2024-11-23 22:43:46,143 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:43:46,180 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:44649'. Reason: failure-to-start- 8450s 2024-11-23 22:43:46,180 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:35237'. Reason: failure-to-start- 8450s 2024-11-23 22:43:46,181 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39675': TLS handshake failed with remote 'tls://127.0.0.1:48322': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:46,182 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39675': TLS handshake failed with remote 'tls://127.0.0.1:48332': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:46,182 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 8450s stream = await stream.start_tls( 8450s ^^^^^^^^^^^^^^^^^^^^^^^ 8450s False, ssl_options=ssl_options, server_hostname=host 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 8450s self.socket.do_handshake() 8450s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 8450s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 8450s self._sslobj.do_handshake() 8450s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 8450s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 8450s comm = await self.rpc.connect(saddr) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 8450s return await self._connect(addr=addr, timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 8450s comm = await connect( 8450s ^^^^^^^^^^^^^^ 8450s ...<4 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 8450s raise FatalCommClosedError( 8450s ...<2 lines>... 8450s ) from err 8450s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 8450s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 8450s RuntimeError: Nanny failed to start. 8450s 2024-11-23 22:43:47,190 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:43:47,202 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45291 8450s 2024-11-23 22:43:47,203 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:32827/status 8450s 2024-11-23 22:43:47,203 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:43:47,247 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:38841'. Reason: failure-to-start- 8450s 2024-11-23 22:43:47,248 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:43671'. Reason: failure-to-start- 8450s 2024-11-23 22:43:47,249 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45291': TLS handshake failed with remote 'tls://127.0.0.1:46992': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:47,250 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45291': TLS handshake failed with remote 'tls://127.0.0.1:46994': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:47,250 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 8450s stream = await stream.start_tls( 8450s ^^^^^^^^^^^^^^^^^^^^^^^ 8450s False, ssl_options=ssl_options, server_hostname=host 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 8450s self.socket.do_handshake() 8450s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 8450s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 8450s self._sslobj.do_handshake() 8450s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 8450s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 8450s comm = await self.rpc.connect(saddr) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 8450s return await self._connect(addr=addr, timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 8450s comm = await connect( 8450s ^^^^^^^^^^^^^^ 8450s ...<4 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 8450s raise FatalCommClosedError( 8450s ...<2 lines>... 8450s ) from err 8450s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 8450s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 8450s RuntimeError: Nanny failed to start. 8450s 2024-11-23 22:43:48,258 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:43:48,271 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34409 8450s 2024-11-23 22:43:48,272 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35123/status 8450s 2024-11-23 22:43:48,272 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:43:48,309 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:41481'. Reason: failure-to-start- 8450s 2024-11-23 22:43:48,310 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:33615'. Reason: failure-to-start- 8450s 2024-11-23 22:43:48,311 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34409': TLS handshake failed with remote 'tls://127.0.0.1:50524': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:48,311 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34409': TLS handshake failed with remote 'tls://127.0.0.1:50540': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:48,311 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 8450s stream = await stream.start_tls( 8450s ^^^^^^^^^^^^^^^^^^^^^^^ 8450s False, ssl_options=ssl_options, server_hostname=host 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 8450s self.socket.do_handshake() 8450s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 8450s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 8450s self._sslobj.do_handshake() 8450s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 8450s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 8450s comm = await self.rpc.connect(saddr) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 8450s return await self._connect(addr=addr, timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 8450s comm = await connect( 8450s ^^^^^^^^^^^^^^ 8450s ...<4 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 8450s raise FatalCommClosedError( 8450s ...<2 lines>... 8450s ) from err 8450s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 8450s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 8450s RuntimeError: Nanny failed to start. 8450s 2024-11-23 22:43:49,320 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:43:49,332 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45021 8450s 2024-11-23 22:43:49,333 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36949/status 8450s 2024-11-23 22:43:49,333 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:43:49,371 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:41165'. Reason: failure-to-start- 8450s 2024-11-23 22:43:49,372 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:34995'. Reason: failure-to-start- 8450s 2024-11-23 22:43:49,373 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45021': TLS handshake failed with remote 'tls://127.0.0.1:37608': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:49,374 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45021': TLS handshake failed with remote 'tls://127.0.0.1:37616': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:49,374 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 8450s stream = await stream.start_tls( 8450s ^^^^^^^^^^^^^^^^^^^^^^^ 8450s False, ssl_options=ssl_options, server_hostname=host 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 8450s self.socket.do_handshake() 8450s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 8450s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 8450s self._sslobj.do_handshake() 8450s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 8450s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 8450s comm = await self.rpc.connect(saddr) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 8450s return await self._connect(addr=addr, timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 8450s comm = await connect( 8450s ^^^^^^^^^^^^^^ 8450s ...<4 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 8450s raise FatalCommClosedError( 8450s ...<2 lines>... 8450s ) from err 8450s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 8450s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 8450s RuntimeError: Nanny failed to start. 8450s 2024-11-23 22:43:50,382 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:43:50,394 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37673 8450s 2024-11-23 22:43:50,395 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43417/status 8450s 2024-11-23 22:43:50,395 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:43:50,431 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:42407'. Reason: failure-to-start- 8450s 2024-11-23 22:43:50,432 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:43373'. Reason: failure-to-start- 8450s 2024-11-23 22:43:50,432 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37673': TLS handshake failed with remote 'tls://127.0.0.1:59830': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:50,433 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37673': TLS handshake failed with remote 'tls://127.0.0.1:59832': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:50,433 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 8450s stream = await stream.start_tls( 8450s ^^^^^^^^^^^^^^^^^^^^^^^ 8450s False, ssl_options=ssl_options, server_hostname=host 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 8450s self.socket.do_handshake() 8450s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 8450s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 8450s self._sslobj.do_handshake() 8450s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 8450s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 8450s comm = await self.rpc.connect(saddr) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 8450s return await self._connect(addr=addr, timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 8450s comm = await connect( 8450s ^^^^^^^^^^^^^^ 8450s ...<4 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 8450s raise FatalCommClosedError( 8450s ...<2 lines>... 8450s ) from err 8450s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 8450s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 8450s RuntimeError: Nanny failed to start. 8450s 2024-11-23 22:43:51,441 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:43:51,454 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44629 8450s 2024-11-23 22:43:51,454 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39439/status 8450s 2024-11-23 22:43:51,455 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:43:51,492 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:38513'. Reason: failure-to-start- 8450s 2024-11-23 22:43:51,493 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:33211'. Reason: failure-to-start- 8450s 2024-11-23 22:43:51,494 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44629': TLS handshake failed with remote 'tls://127.0.0.1:49036': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:51,494 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44629': TLS handshake failed with remote 'tls://127.0.0.1:49046': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:51,495 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 8450s stream = await stream.start_tls( 8450s ^^^^^^^^^^^^^^^^^^^^^^^ 8450s False, ssl_options=ssl_options, server_hostname=host 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 8450s self.socket.do_handshake() 8450s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 8450s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 8450s self._sslobj.do_handshake() 8450s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 8450s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 8450s comm = await self.rpc.connect(saddr) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 8450s return await self._connect(addr=addr, timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 8450s comm = await connect( 8450s ^^^^^^^^^^^^^^ 8450s ...<4 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 8450s raise FatalCommClosedError( 8450s ...<2 lines>... 8450s ) from err 8450s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 8450s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 8450s RuntimeError: Nanny failed to start. 8450s 2024-11-23 22:43:52,506 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:43:52,520 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39763 8450s 2024-11-23 22:43:52,521 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37687/status 8450s 2024-11-23 22:43:52,521 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:43:52,565 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:42873'. Reason: failure-to-start- 8450s 2024-11-23 22:43:52,566 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:44401'. Reason: failure-to-start- 8450s 2024-11-23 22:43:52,567 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39763': TLS handshake failed with remote 'tls://127.0.0.1:42690': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:52,567 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39763': TLS handshake failed with remote 'tls://127.0.0.1:42698': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:52,567 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 8450s stream = await stream.start_tls( 8450s ^^^^^^^^^^^^^^^^^^^^^^^ 8450s False, ssl_options=ssl_options, server_hostname=host 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 8450s self.socket.do_handshake() 8450s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 8450s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 8450s self._sslobj.do_handshake() 8450s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 8450s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 8450s comm = await self.rpc.connect(saddr) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 8450s return await self._connect(addr=addr, timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 8450s comm = await connect( 8450s ^^^^^^^^^^^^^^ 8450s ...<4 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 8450s raise FatalCommClosedError( 8450s ...<2 lines>... 8450s ) from err 8450s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 8450s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 8450s RuntimeError: Nanny failed to start. 8450s 2024-11-23 22:43:53,576 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:43:53,589 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33195 8450s 2024-11-23 22:43:53,589 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42533/status 8450s 2024-11-23 22:43:53,590 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:43:53,635 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:36941'. Reason: failure-to-start- 8450s 2024-11-23 22:43:53,635 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:37989'. Reason: failure-to-start- 8450s 2024-11-23 22:43:53,637 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33195': TLS handshake failed with remote 'tls://127.0.0.1:42452': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:53,637 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33195': TLS handshake failed with remote 'tls://127.0.0.1:42468': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:53,637 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 8450s stream = await stream.start_tls( 8450s ^^^^^^^^^^^^^^^^^^^^^^^ 8450s False, ssl_options=ssl_options, server_hostname=host 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 8450s self.socket.do_handshake() 8450s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 8450s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 8450s self._sslobj.do_handshake() 8450s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 8450s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 8450s comm = await self.rpc.connect(saddr) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 8450s return await self._connect(addr=addr, timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 8450s comm = await connect( 8450s ^^^^^^^^^^^^^^ 8450s ...<4 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 8450s raise FatalCommClosedError( 8450s ...<2 lines>... 8450s ) from err 8450s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 8450s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 8450s RuntimeError: Nanny failed to start. 8450s 2024-11-23 22:43:54,645 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:43:54,657 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34469 8450s 2024-11-23 22:43:54,658 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44031/status 8450s 2024-11-23 22:43:54,658 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:43:54,700 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:39805'. Reason: failure-to-start- 8450s 2024-11-23 22:43:54,700 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:45603'. Reason: failure-to-start- 8450s 2024-11-23 22:43:54,701 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34469': TLS handshake failed with remote 'tls://127.0.0.1:55856': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:54,702 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34469': TLS handshake failed with remote 'tls://127.0.0.1:55862': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:54,702 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 8450s stream = await stream.start_tls( 8450s ^^^^^^^^^^^^^^^^^^^^^^^ 8450s False, ssl_options=ssl_options, server_hostname=host 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 8450s self.socket.do_handshake() 8450s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 8450s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 8450s self._sslobj.do_handshake() 8450s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 8450s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 8450s comm = await self.rpc.connect(saddr) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 8450s return await self._connect(addr=addr, timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 8450s comm = await connect( 8450s ^^^^^^^^^^^^^^ 8450s ...<4 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 8450s raise FatalCommClosedError( 8450s ...<2 lines>... 8450s ) from err 8450s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 8450s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 8450s RuntimeError: Nanny failed to start. 8450s 2024-11-23 22:43:55,713 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:43:55,725 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39067 8450s 2024-11-23 22:43:55,726 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33735/status 8450s 2024-11-23 22:43:55,726 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:43:55,768 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:33511'. Reason: failure-to-start- 8450s 2024-11-23 22:43:55,768 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:36909'. Reason: failure-to-start- 8450s 2024-11-23 22:43:55,770 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39067': TLS handshake failed with remote 'tls://127.0.0.1:34846': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:55,770 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39067': TLS handshake failed with remote 'tls://127.0.0.1:34860': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:55,770 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 8450s stream = await stream.start_tls( 8450s ^^^^^^^^^^^^^^^^^^^^^^^ 8450s False, ssl_options=ssl_options, server_hostname=host 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 8450s self.socket.do_handshake() 8450s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 8450s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 8450s self._sslobj.do_handshake() 8450s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 8450s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 8450s comm = await self.rpc.connect(saddr) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 8450s return await self._connect(addr=addr, timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 8450s comm = await connect( 8450s ^^^^^^^^^^^^^^ 8450s ...<4 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 8450s raise FatalCommClosedError( 8450s ...<2 lines>... 8450s ) from err 8450s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 8450s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 8450s RuntimeError: Nanny failed to start. 8450s 2024-11-23 22:43:56,781 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:43:56,792 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39499 8450s 2024-11-23 22:43:56,793 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39173/status 8450s 2024-11-23 22:43:56,793 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:43:56,830 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:40659'. Reason: failure-to-start- 8450s 2024-11-23 22:43:56,831 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:34375'. Reason: failure-to-start- 8450s 2024-11-23 22:43:56,832 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39499': TLS handshake failed with remote 'tls://127.0.0.1:35388': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:56,833 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39499': TLS handshake failed with remote 'tls://127.0.0.1:35404': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:56,833 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 8450s stream = await stream.start_tls( 8450s ^^^^^^^^^^^^^^^^^^^^^^^ 8450s False, ssl_options=ssl_options, server_hostname=host 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 8450s self.socket.do_handshake() 8450s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 8450s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 8450s self._sslobj.do_handshake() 8450s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 8450s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 8450s comm = await self.rpc.connect(saddr) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 8450s return await self._connect(addr=addr, timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 8450s comm = await connect( 8450s ^^^^^^^^^^^^^^ 8450s ...<4 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 8450s raise FatalCommClosedError( 8450s ...<2 lines>... 8450s ) from err 8450s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 8450s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 8450s RuntimeError: Nanny failed to start. 8450s 2024-11-23 22:43:57,842 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:43:57,853 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37811 8450s 2024-11-23 22:43:57,854 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39199/status 8450s 2024-11-23 22:43:57,854 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:43:57,892 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:37085'. Reason: failure-to-start- 8450s 2024-11-23 22:43:57,893 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:36505'. Reason: failure-to-start- 8450s 2024-11-23 22:43:57,894 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37811': TLS handshake failed with remote 'tls://127.0.0.1:56498': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:57,894 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37811': TLS handshake failed with remote 'tls://127.0.0.1:56502': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:57,895 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 8450s stream = await stream.start_tls( 8450s ^^^^^^^^^^^^^^^^^^^^^^^ 8450s False, ssl_options=ssl_options, server_hostname=host 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 8450s self.socket.do_handshake() 8450s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 8450s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 8450s self._sslobj.do_handshake() 8450s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 8450s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 8450s comm = await self.rpc.connect(saddr) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 8450s return await self._connect(addr=addr, timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 8450s comm = await connect( 8450s ^^^^^^^^^^^^^^ 8450s ...<4 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 8450s raise FatalCommClosedError( 8450s ...<2 lines>... 8450s ) from err 8450s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 8450s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 8450s RuntimeError: Nanny failed to start. 8450s 2024-11-23 22:43:58,904 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:43:58,916 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43137 8450s 2024-11-23 22:43:58,916 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38147/status 8450s 2024-11-23 22:43:58,917 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:43:58,953 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:43225'. Reason: failure-to-start- 8450s 2024-11-23 22:43:58,954 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:38223'. Reason: failure-to-start- 8450s 2024-11-23 22:43:58,955 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43137': TLS handshake failed with remote 'tls://127.0.0.1:38254': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:58,955 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43137': TLS handshake failed with remote 'tls://127.0.0.1:38256': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:43:58,955 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 8450s stream = await stream.start_tls( 8450s ^^^^^^^^^^^^^^^^^^^^^^^ 8450s False, ssl_options=ssl_options, server_hostname=host 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 8450s self.socket.do_handshake() 8450s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 8450s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 8450s self._sslobj.do_handshake() 8450s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 8450s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 8450s comm = await self.rpc.connect(saddr) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 8450s return await self._connect(addr=addr, timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 8450s comm = await connect( 8450s ^^^^^^^^^^^^^^ 8450s ...<4 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 8450s raise FatalCommClosedError( 8450s ...<2 lines>... 8450s ) from err 8450s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 8450s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 8450s RuntimeError: Nanny failed to start. 8450s 2024-11-23 22:43:59,964 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:43:59,976 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41469 8450s 2024-11-23 22:43:59,977 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45199/status 8450s 2024-11-23 22:43:59,978 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:44:00,019 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:37447'. Reason: failure-to-start- 8450s 2024-11-23 22:44:00,020 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:43129'. Reason: failure-to-start- 8450s 2024-11-23 22:44:00,026 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41469': TLS handshake failed with remote 'tls://127.0.0.1:52866': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:00,026 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41469': TLS handshake failed with remote 'tls://127.0.0.1:52876': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:00,027 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 8450s stream = await stream.start_tls( 8450s ^^^^^^^^^^^^^^^^^^^^^^^ 8450s False, ssl_options=ssl_options, server_hostname=host 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 8450s self.socket.do_handshake() 8450s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 8450s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 8450s self._sslobj.do_handshake() 8450s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 8450s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 8450s comm = await self.rpc.connect(saddr) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 8450s return await self._connect(addr=addr, timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 8450s comm = await connect( 8450s ^^^^^^^^^^^^^^ 8450s ...<4 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 8450s raise FatalCommClosedError( 8450s ...<2 lines>... 8450s ) from err 8450s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 8450s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 8450s RuntimeError: Nanny failed to start. 8450s 2024-11-23 22:44:01,035 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:44:01,047 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35563 8450s 2024-11-23 22:44:01,047 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37169/status 8450s 2024-11-23 22:44:01,048 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:44:01,087 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:38155'. Reason: failure-to-start- 8450s 2024-11-23 22:44:01,088 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:45597'. Reason: failure-to-start- 8450s 2024-11-23 22:44:01,093 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35563': TLS handshake failed with remote 'tls://127.0.0.1:35720': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:01,093 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35563': TLS handshake failed with remote 'tls://127.0.0.1:35736': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:01,093 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 8450s stream = await stream.start_tls( 8450s ^^^^^^^^^^^^^^^^^^^^^^^ 8450s False, ssl_options=ssl_options, server_hostname=host 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 8450s self.socket.do_handshake() 8450s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 8450s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 8450s self._sslobj.do_handshake() 8450s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 8450s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 8450s comm = await self.rpc.connect(saddr) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 8450s return await self._connect(addr=addr, timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 8450s comm = await connect( 8450s ^^^^^^^^^^^^^^ 8450s ...<4 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 8450s raise FatalCommClosedError( 8450s ...<2 lines>... 8450s ) from err 8450s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 8450s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 8450s RuntimeError: Nanny failed to start. 8450s 2024-11-23 22:44:02,103 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:44:02,115 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39441 8450s 2024-11-23 22:44:02,116 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44173/status 8450s 2024-11-23 22:44:02,117 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:44:02,161 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:45059'. Reason: failure-to-start- 8450s 2024-11-23 22:44:02,162 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:36863'. Reason: failure-to-start- 8450s 2024-11-23 22:44:02,163 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39441': TLS handshake failed with remote 'tls://127.0.0.1:50430': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:02,164 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39441': TLS handshake failed with remote 'tls://127.0.0.1:50440': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:02,164 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 8450s stream = await stream.start_tls( 8450s ^^^^^^^^^^^^^^^^^^^^^^^ 8450s False, ssl_options=ssl_options, server_hostname=host 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 8450s self.socket.do_handshake() 8450s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 8450s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 8450s self._sslobj.do_handshake() 8450s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 8450s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 8450s comm = await self.rpc.connect(saddr) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 8450s return await self._connect(addr=addr, timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 8450s comm = await connect( 8450s ^^^^^^^^^^^^^^ 8450s ...<4 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 8450s raise FatalCommClosedError( 8450s ...<2 lines>... 8450s ) from err 8450s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 8450s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 8450s RuntimeError: Nanny failed to start. 8450s 2024-11-23 22:44:03,172 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:44:03,184 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42591 8450s 2024-11-23 22:44:03,185 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35993/status 8450s 2024-11-23 22:44:03,186 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:44:03,228 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:42107'. Reason: failure-to-start- 8450s 2024-11-23 22:44:03,228 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:38441'. Reason: failure-to-start- 8450s 2024-11-23 22:44:03,230 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42591': TLS handshake failed with remote 'tls://127.0.0.1:47296': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:03,230 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42591': TLS handshake failed with remote 'tls://127.0.0.1:47308': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:03,234 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 8450s stream = await stream.start_tls( 8450s ^^^^^^^^^^^^^^^^^^^^^^^ 8450s False, ssl_options=ssl_options, server_hostname=host 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 8450s self.socket.do_handshake() 8450s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 8450s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 8450s self._sslobj.do_handshake() 8450s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 8450s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 8450s comm = await self.rpc.connect(saddr) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 8450s return await self._connect(addr=addr, timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 8450s comm = await connect( 8450s ^^^^^^^^^^^^^^ 8450s ...<4 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 8450s raise FatalCommClosedError( 8450s ...<2 lines>... 8450s ) from err 8450s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 8450s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 8450s RuntimeError: Nanny failed to start. 8450s 2024-11-23 22:44:04,240 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:44:04,247 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33823 8450s 2024-11-23 22:44:04,248 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36917/status 8450s 2024-11-23 22:44:04,248 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:44:04,274 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:37335'. Reason: failure-to-start- 8450s 2024-11-23 22:44:04,275 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:46823'. Reason: failure-to-start- 8450s 2024-11-23 22:44:04,275 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33823': TLS handshake failed with remote 'tls://127.0.0.1:59104': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:04,275 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33823': TLS handshake failed with remote 'tls://127.0.0.1:59114': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:04,278 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 8450s stream = await stream.start_tls( 8450s ^^^^^^^^^^^^^^^^^^^^^^^ 8450s False, ssl_options=ssl_options, server_hostname=host 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 8450s self.socket.do_handshake() 8450s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 8450s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 8450s self._sslobj.do_handshake() 8450s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 8450s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 8450s comm = await self.rpc.connect(saddr) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 8450s return await self._connect(addr=addr, timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 8450s comm = await connect( 8450s ^^^^^^^^^^^^^^ 8450s ...<4 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 8450s raise FatalCommClosedError( 8450s ...<2 lines>... 8450s ) from err 8450s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 8450s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 8450s RuntimeError: Nanny failed to start. 8450s 2024-11-23 22:44:05,283 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:44:05,290 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42895 8450s 2024-11-23 22:44:05,291 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46319/status 8450s 2024-11-23 22:44:05,291 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:44:05,317 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:33665'. Reason: failure-to-start- 8450s 2024-11-23 22:44:05,317 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:33927'. Reason: failure-to-start- 8450s 2024-11-23 22:44:05,318 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42895': TLS handshake failed with remote 'tls://127.0.0.1:51770': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:05,318 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42895': TLS handshake failed with remote 'tls://127.0.0.1:51776': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:05,318 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 8450s stream = await stream.start_tls( 8450s ^^^^^^^^^^^^^^^^^^^^^^^ 8450s False, ssl_options=ssl_options, server_hostname=host 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 8450s self.socket.do_handshake() 8450s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 8450s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 8450s self._sslobj.do_handshake() 8450s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 8450s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 8450s comm = await self.rpc.connect(saddr) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 8450s return await self._connect(addr=addr, timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 8450s comm = await connect( 8450s ^^^^^^^^^^^^^^ 8450s ...<4 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 8450s raise FatalCommClosedError( 8450s ...<2 lines>... 8450s ) from err 8450s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 8450s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 8450s RuntimeError: Nanny failed to start. 8450s 2024-11-23 22:44:06,323 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:44:06,331 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45069 8450s 2024-11-23 22:44:06,331 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42613/status 8450s 2024-11-23 22:44:06,332 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:44:06,362 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:39685'. Reason: failure-to-start- 8450s 2024-11-23 22:44:06,362 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:34313'. Reason: failure-to-start- 8450s 2024-11-23 22:44:06,365 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45069': TLS handshake failed with remote 'tls://127.0.0.1:42710': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:06,365 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45069': TLS handshake failed with remote 'tls://127.0.0.1:42712': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:06,366 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 8450s stream = await stream.start_tls( 8450s ^^^^^^^^^^^^^^^^^^^^^^^ 8450s False, ssl_options=ssl_options, server_hostname=host 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 8450s self.socket.do_handshake() 8450s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 8450s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 8450s self._sslobj.do_handshake() 8450s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 8450s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 8450s comm = await self.rpc.connect(saddr) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 8450s return await self._connect(addr=addr, timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 8450s comm = await connect( 8450s ^^^^^^^^^^^^^^ 8450s ...<4 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 8450s raise FatalCommClosedError( 8450s ...<2 lines>... 8450s ) from err 8450s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 8450s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 8450s RuntimeError: Nanny failed to start. 8450s 2024-11-23 22:44:07,372 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:44:07,380 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34655 8450s 2024-11-23 22:44:07,380 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45931/status 8450s 2024-11-23 22:44:07,380 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:44:07,406 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:44483'. Reason: failure-to-start- 8450s 2024-11-23 22:44:07,406 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:33181'. Reason: failure-to-start- 8450s 2024-11-23 22:44:07,410 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34655': TLS handshake failed with remote 'tls://127.0.0.1:51050': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:07,410 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34655': TLS handshake failed with remote 'tls://127.0.0.1:51054': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:07,410 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 8450s stream = await stream.start_tls( 8450s ^^^^^^^^^^^^^^^^^^^^^^^ 8450s False, ssl_options=ssl_options, server_hostname=host 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 8450s self.socket.do_handshake() 8450s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 8450s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 8450s self._sslobj.do_handshake() 8450s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 8450s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 8450s comm = await self.rpc.connect(saddr) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 8450s return await self._connect(addr=addr, timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 8450s comm = await connect( 8450s ^^^^^^^^^^^^^^ 8450s ...<4 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 8450s raise FatalCommClosedError( 8450s ...<2 lines>... 8450s ) from err 8450s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 8450s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 8450s RuntimeError: Nanny failed to start. 8450s 2024-11-23 22:44:08,415 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:44:08,422 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35605 8450s 2024-11-23 22:44:08,422 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40317/status 8450s 2024-11-23 22:44:08,423 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:44:08,450 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:40477'. Reason: failure-to-start- 8450s 2024-11-23 22:44:08,450 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:45487'. Reason: failure-to-start- 8450s 2024-11-23 22:44:08,451 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:36142': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:08,451 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35605': TLS handshake failed with remote 'tls://127.0.0.1:36156': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:08,451 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 8450s stream = await stream.start_tls( 8450s ^^^^^^^^^^^^^^^^^^^^^^^ 8450s False, ssl_options=ssl_options, server_hostname=host 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 8450s self.socket.do_handshake() 8450s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 8450s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 8450s self._sslobj.do_handshake() 8450s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 8450s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 8450s comm = await self.rpc.connect(saddr) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 8450s return await self._connect(addr=addr, timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 8450s comm = await connect( 8450s ^^^^^^^^^^^^^^ 8450s ...<4 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 8450s raise FatalCommClosedError( 8450s ...<2 lines>... 8450s ) from err 8450s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 8450s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 8450s RuntimeError: Nanny failed to start. 8450s 2024-11-23 22:44:09,456 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:44:09,463 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:32977 8450s 2024-11-23 22:44:09,463 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43937/status 8450s 2024-11-23 22:44:09,463 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:44:09,493 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:46877'. Reason: failure-to-start- 8450s 2024-11-23 22:44:09,494 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:38417'. Reason: failure-to-start- 8450s 2024-11-23 22:44:09,494 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:32977': TLS handshake failed with remote 'tls://127.0.0.1:40910': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:09,494 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:32977': TLS handshake failed with remote 'tls://127.0.0.1:40926': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:09,494 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 8450s stream = await stream.start_tls( 8450s ^^^^^^^^^^^^^^^^^^^^^^^ 8450s False, ssl_options=ssl_options, server_hostname=host 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 8450s self.socket.do_handshake() 8450s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 8450s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 8450s self._sslobj.do_handshake() 8450s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 8450s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 8450s comm = await self.rpc.connect(saddr) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 8450s return await self._connect(addr=addr, timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 8450s comm = await connect( 8450s ^^^^^^^^^^^^^^ 8450s ...<4 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 8450s raise FatalCommClosedError( 8450s ...<2 lines>... 8450s ) from err 8450s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 8450s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 8450s RuntimeError: Nanny failed to start. 8450s 2024-11-23 22:44:10,499 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:44:10,507 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41341 8450s 2024-11-23 22:44:10,507 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43761/status 8450s 2024-11-23 22:44:10,508 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:44:10,540 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:46223'. Reason: failure-to-start- 8450s 2024-11-23 22:44:10,540 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:40641'. Reason: failure-to-start- 8450s 2024-11-23 22:44:10,541 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41341': TLS handshake failed with remote 'tls://127.0.0.1:48150': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:10,541 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41341': TLS handshake failed with remote 'tls://127.0.0.1:48158': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:10,541 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 8450s stream = await stream.start_tls( 8450s ^^^^^^^^^^^^^^^^^^^^^^^ 8450s False, ssl_options=ssl_options, server_hostname=host 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 8450s self.socket.do_handshake() 8450s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 8450s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 8450s self._sslobj.do_handshake() 8450s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 8450s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 8450s comm = await self.rpc.connect(saddr) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 8450s return await self._connect(addr=addr, timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 8450s comm = await connect( 8450s ^^^^^^^^^^^^^^ 8450s ...<4 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 8450s raise FatalCommClosedError( 8450s ...<2 lines>... 8450s ) from err 8450s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 8450s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 8450s RuntimeError: Nanny failed to start. 8450s 2024-11-23 22:44:11,546 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:44:11,554 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37369 8450s 2024-11-23 22:44:11,554 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39469/status 8450s 2024-11-23 22:44:11,554 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:44:11,583 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:41447'. Reason: failure-to-start- 8450s 2024-11-23 22:44:11,583 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:45965'. Reason: failure-to-start- 8450s 2024-11-23 22:44:11,587 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37369': TLS handshake failed with remote 'tls://127.0.0.1:46742': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:11,587 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37369': TLS handshake failed with remote 'tls://127.0.0.1:46744': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:11,587 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 8450s stream = await stream.start_tls( 8450s ^^^^^^^^^^^^^^^^^^^^^^^ 8450s False, ssl_options=ssl_options, server_hostname=host 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 8450s self.socket.do_handshake() 8450s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 8450s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 8450s self._sslobj.do_handshake() 8450s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 8450s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 8450s comm = await self.rpc.connect(saddr) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 8450s return await self._connect(addr=addr, timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 8450s comm = await connect( 8450s ^^^^^^^^^^^^^^ 8450s ...<4 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 8450s raise FatalCommClosedError( 8450s ...<2 lines>... 8450s ) from err 8450s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 8450s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 8450s RuntimeError: Nanny failed to start. 8450s 2024-11-23 22:44:12,592 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:44:12,609 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35053 8450s 2024-11-23 22:44:12,610 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35311/status 8450s 2024-11-23 22:44:12,610 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:44:12,641 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:35643'. Reason: failure-to-start- 8450s 2024-11-23 22:44:12,642 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:38799'. Reason: failure-to-start- 8450s 2024-11-23 22:44:12,642 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35053': TLS handshake failed with remote 'tls://127.0.0.1:52354': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:12,642 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35053': TLS handshake failed with remote 'tls://127.0.0.1:52356': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:12,642 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 8450s stream = await stream.start_tls( 8450s ^^^^^^^^^^^^^^^^^^^^^^^ 8450s False, ssl_options=ssl_options, server_hostname=host 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 8450s self.socket.do_handshake() 8450s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 8450s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 8450s self._sslobj.do_handshake() 8450s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 8450s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 8450s comm = await self.rpc.connect(saddr) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 8450s return await self._connect(addr=addr, timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 8450s comm = await connect( 8450s ^^^^^^^^^^^^^^ 8450s ...<4 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 8450s raise FatalCommClosedError( 8450s ...<2 lines>... 8450s ) from err 8450s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 8450s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 8450s RuntimeError: Nanny failed to start. 8450s 2024-11-23 22:44:13,650 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:44:13,658 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40557 8450s 2024-11-23 22:44:13,659 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42327/status 8450s 2024-11-23 22:44:13,659 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:44:13,676 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:43223'. Reason: failure-to-start- 8450s 2024-11-23 22:44:13,677 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:45895'. Reason: failure-to-start- 8450s 2024-11-23 22:44:13,678 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40557': TLS handshake failed with remote 'tls://127.0.0.1:48892': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:44:13,678 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40557': TLS handshake failed with remote 'tls://127.0.0.1:48902': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:44:13,678 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 8450s comm = await self.rpc.connect(saddr) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 8450s return await self._connect(addr=addr, timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 8450s comm = await connect( 8450s ^^^^^^^^^^^^^^ 8450s ...<4 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Nanny start timed out after 0s. 8450s 2024-11-23 22:44:14,683 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:44:14,691 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39985 8450s 2024-11-23 22:44:14,692 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45813/status 8450s 2024-11-23 22:44:14,692 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:44:14,980 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:42429'. Reason: failure-to-start- 8450s 2024-11-23 22:44:14,980 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:38089'. Reason: failure-to-start- 8450s 2024-11-23 22:44:14,981 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39985': TLS handshake failed with remote 'tls://127.0.0.1:52206': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:44:14,981 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39985': TLS handshake failed with remote 'tls://127.0.0.1:52216': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:44:14,988 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 8450s comm = await self.rpc.connect(saddr) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 8450s return await self._connect(addr=addr, timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 8450s comm = await connect( 8450s ^^^^^^^^^^^^^^ 8450s ...<4 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Nanny start timed out after 0s. 8450s 2024-11-23 22:44:15,993 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:44:16,001 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39165 8450s 2024-11-23 22:44:16,001 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41899/status 8450s 2024-11-23 22:44:16,001 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:44:16,017 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:36425'. Reason: failure-to-start- 8450s 2024-11-23 22:44:16,017 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:38651'. Reason: failure-to-start- 8450s 2024-11-23 22:44:16,018 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39165': TLS handshake failed with remote 'tls://127.0.0.1:50214': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:44:16,018 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39165': TLS handshake failed with remote 'tls://127.0.0.1:50224': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:44:16,021 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 8450s comm = await self.rpc.connect(saddr) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 8450s return await self._connect(addr=addr, timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 8450s comm = await connect( 8450s ^^^^^^^^^^^^^^ 8450s ...<4 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Nanny start timed out after 0s. 8450s 2024-11-23 22:44:17,026 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:44:17,033 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43377 8450s 2024-11-23 22:44:17,033 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39287/status 8450s 2024-11-23 22:44:17,033 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:44:17,050 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:41051'. Reason: failure-to-start- 8450s 2024-11-23 22:44:17,050 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:46161'. Reason: failure-to-start- 8450s 2024-11-23 22:44:17,054 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43377': TLS handshake failed with remote 'tls://127.0.0.1:50144': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:44:17,054 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43377': TLS handshake failed with remote 'tls://127.0.0.1:50148': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:44:17,054 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 8450s comm = await self.rpc.connect(saddr) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 8450s return await self._connect(addr=addr, timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 8450s comm = await connect( 8450s ^^^^^^^^^^^^^^ 8450s ...<4 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Nanny start timed out after 0s. 8450s 2024-11-23 22:44:18,059 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:44:18,066 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44219 8450s 2024-11-23 22:44:18,066 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46349/status 8450s 2024-11-23 22:44:18,069 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:44:18,082 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:45323'. Reason: failure-to-start- 8450s 2024-11-23 22:44:18,082 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:46747'. Reason: failure-to-start- 8450s 2024-11-23 22:44:18,085 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44219': TLS handshake failed with remote 'tls://127.0.0.1:44312': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:44:18,085 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44219': TLS handshake failed with remote 'tls://127.0.0.1:44326': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:44:18,086 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 8450s comm = await self.rpc.connect(saddr) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 8450s return await self._connect(addr=addr, timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 8450s comm = await connect( 8450s ^^^^^^^^^^^^^^ 8450s ...<4 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Nanny start timed out after 0s. 8450s 2024-11-23 22:44:19,090 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:44:19,098 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35037 8450s 2024-11-23 22:44:19,098 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44319/status 8450s 2024-11-23 22:44:19,098 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:44:19,120 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:43489'. Reason: failure-to-start- 8450s 2024-11-23 22:44:19,121 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:36625'. Reason: failure-to-start- 8450s 2024-11-23 22:44:19,121 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35037': TLS handshake failed with remote 'tls://127.0.0.1:58730': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:44:19,121 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35037': TLS handshake failed with remote 'tls://127.0.0.1:58744': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:44:19,124 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 8450s comm = await self.rpc.connect(saddr) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 8450s return await self._connect(addr=addr, timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 8450s comm = await connect( 8450s ^^^^^^^^^^^^^^ 8450s ...<4 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Nanny start timed out after 0s. 8450s 2024-11-23 22:44:20,129 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:44:20,137 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40401 8450s 2024-11-23 22:44:20,137 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45183/status 8450s 2024-11-23 22:44:20,137 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:44:20,155 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:34471'. Reason: failure-to-start- 8450s 2024-11-23 22:44:20,155 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:44321'. Reason: failure-to-start- 8450s 2024-11-23 22:44:20,156 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40401': TLS handshake failed with remote 'tls://127.0.0.1:47840': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:44:20,156 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40401': TLS handshake failed with remote 'tls://127.0.0.1:47846': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:44:20,156 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 8450s comm = await self.rpc.connect(saddr) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 8450s return await self._connect(addr=addr, timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 8450s comm = await connect( 8450s ^^^^^^^^^^^^^^ 8450s ...<4 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Nanny start timed out after 0s. 8450s 2024-11-23 22:44:21,161 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:44:21,169 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34963 8450s 2024-11-23 22:44:21,170 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37855/status 8450s 2024-11-23 22:44:21,170 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:44:21,195 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:38665'. Reason: failure-to-start- 8450s 2024-11-23 22:44:21,195 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:36845'. Reason: failure-to-start- 8450s 2024-11-23 22:44:21,196 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34963': TLS handshake failed with remote 'tls://127.0.0.1:34486': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:44:21,196 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34963': TLS handshake failed with remote 'tls://127.0.0.1:34488': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:44:21,196 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 8450s comm = await self.rpc.connect(saddr) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 8450s return await self._connect(addr=addr, timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 8450s comm = await connect( 8450s ^^^^^^^^^^^^^^ 8450s ...<4 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Nanny start timed out after 0s. 8450s 2024-11-23 22:44:22,201 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:44:22,208 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34103 8450s 2024-11-23 22:44:22,208 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45423/status 8450s 2024-11-23 22:44:22,209 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:44:22,226 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:46747'. Reason: failure-to-start- 8450s 2024-11-23 22:44:22,226 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:41379'. Reason: failure-to-start- 8450s 2024-11-23 22:44:22,227 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34103': TLS handshake failed with remote 'tls://127.0.0.1:54876': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:44:22,227 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34103': TLS handshake failed with remote 'tls://127.0.0.1:54886': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:44:22,227 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 8450s comm = await self.rpc.connect(saddr) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 8450s return await self._connect(addr=addr, timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 8450s comm = await connect( 8450s ^^^^^^^^^^^^^^ 8450s ...<4 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Nanny start timed out after 0s. 8450s 2024-11-23 22:44:23,232 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:44:23,238 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45239 8450s 2024-11-23 22:44:23,239 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45197/status 8450s 2024-11-23 22:44:23,239 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:44:23,257 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:44215'. Reason: failure-to-start- 8450s 2024-11-23 22:44:23,257 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:36619'. Reason: failure-to-start- 8450s 2024-11-23 22:44:23,258 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45239': TLS handshake failed with remote 'tls://127.0.0.1:45832': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:44:23,258 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45239': TLS handshake failed with remote 'tls://127.0.0.1:45844': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:44:23,258 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 8450s comm = await self.rpc.connect(saddr) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 8450s return await self._connect(addr=addr, timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 8450s comm = await connect( 8450s ^^^^^^^^^^^^^^ 8450s ...<4 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Nanny start timed out after 0s. 8450s 2024-11-23 22:44:24,263 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:44:24,269 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46773 8450s 2024-11-23 22:44:24,270 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42449/status 8450s 2024-11-23 22:44:24,270 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:44:24,285 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:34005'. Reason: failure-to-start- 8450s 2024-11-23 22:44:24,285 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:34557'. Reason: failure-to-start- 8450s 2024-11-23 22:44:24,286 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46773': TLS handshake failed with remote 'tls://127.0.0.1:35620': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:44:24,286 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46773': TLS handshake failed with remote 'tls://127.0.0.1:35634': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:44:24,286 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 8450s comm = await self.rpc.connect(saddr) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 8450s return await self._connect(addr=addr, timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 8450s comm = await connect( 8450s ^^^^^^^^^^^^^^ 8450s ...<4 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Nanny start timed out after 0s. 8450s 2024-11-23 22:44:25,293 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:44:25,306 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35537 8450s 2024-11-23 22:44:25,307 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43271/status 8450s 2024-11-23 22:44:25,307 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:44:25,326 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:40441'. Reason: failure-to-start- 8450s 2024-11-23 22:44:25,326 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:39503'. Reason: failure-to-start- 8450s 2024-11-23 22:44:25,327 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35537': TLS handshake failed with remote 'tls://127.0.0.1:54478': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:44:25,327 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35537': TLS handshake failed with remote 'tls://127.0.0.1:54488': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:44:25,327 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 8450s comm = await self.rpc.connect(saddr) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 8450s return await self._connect(addr=addr, timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 8450s comm = await connect( 8450s ^^^^^^^^^^^^^^ 8450s ...<4 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Nanny start timed out after 0s. 8450s 2024-11-23 22:44:26,333 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:44:26,340 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39479 8450s 2024-11-23 22:44:26,340 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33181/status 8450s 2024-11-23 22:44:26,340 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:44:26,357 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:45767'. Reason: failure-to-start- 8450s 2024-11-23 22:44:26,358 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:41391'. Reason: failure-to-start- 8450s 2024-11-23 22:44:26,360 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39479': TLS handshake failed with remote 'tls://127.0.0.1:60698': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:44:26,361 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39479': TLS handshake failed with remote 'tls://127.0.0.1:60706': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:44:26,361 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 8450s comm = await self.rpc.connect(saddr) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 8450s return await self._connect(addr=addr, timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 8450s comm = await connect( 8450s ^^^^^^^^^^^^^^ 8450s ...<4 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Nanny start timed out after 0s. 8450s 2024-11-23 22:44:27,365 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:44:27,375 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33515 8450s 2024-11-23 22:44:27,375 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33241/status 8450s 2024-11-23 22:44:27,375 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:44:27,393 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:40951'. Reason: failure-to-start- 8450s 2024-11-23 22:44:27,393 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:37523'. Reason: failure-to-start- 8450s 2024-11-23 22:44:27,394 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33515': TLS handshake failed with remote 'tls://127.0.0.1:33532': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:44:27,394 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33515': TLS handshake failed with remote 'tls://127.0.0.1:33548': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:44:27,394 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 8450s comm = await self.rpc.connect(saddr) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 8450s return await self._connect(addr=addr, timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 8450s comm = await connect( 8450s ^^^^^^^^^^^^^^ 8450s ...<4 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Nanny start timed out after 0s. 8450s 2024-11-23 22:44:28,401 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:44:28,408 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36905 8450s 2024-11-23 22:44:28,408 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37093/status 8450s 2024-11-23 22:44:28,408 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:44:28,425 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:34295'. Reason: failure-to-start- 8450s 2024-11-23 22:44:28,425 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:43029'. Reason: failure-to-start- 8450s 2024-11-23 22:44:28,426 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36905': TLS handshake failed with remote 'tls://127.0.0.1:40710': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:44:28,426 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36905': TLS handshake failed with remote 'tls://127.0.0.1:40714': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:44:28,426 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 8450s comm = await self.rpc.connect(saddr) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 8450s return await self._connect(addr=addr, timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 8450s comm = await connect( 8450s ^^^^^^^^^^^^^^ 8450s ...<4 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Nanny start timed out after 0s. 8450s 2024-11-23 22:44:29,433 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:44:29,441 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42549 8450s 2024-11-23 22:44:29,441 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33723/status 8450s 2024-11-23 22:44:29,441 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:44:29,456 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:45099'. Reason: failure-to-start- 8450s 2024-11-23 22:44:29,456 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:41627'. Reason: failure-to-start- 8450s 2024-11-23 22:44:29,457 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42549': TLS handshake failed with remote 'tls://127.0.0.1:51316': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:44:29,457 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42549': TLS handshake failed with remote 'tls://127.0.0.1:51318': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:44:29,457 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 8450s comm = await self.rpc.connect(saddr) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 8450s return await self._connect(addr=addr, timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 8450s comm = await connect( 8450s ^^^^^^^^^^^^^^ 8450s ...<4 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Nanny start timed out after 0s. 8450s 2024-11-23 22:44:30,462 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:44:30,469 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44683 8450s 2024-11-23 22:44:30,469 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40249/status 8450s 2024-11-23 22:44:30,469 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:44:30,487 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:39107'. Reason: failure-to-start- 8450s 2024-11-23 22:44:30,487 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:45061'. Reason: failure-to-start- 8450s 2024-11-23 22:44:30,488 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44683': TLS handshake failed with remote 'tls://127.0.0.1:34454': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:44:30,488 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44683': TLS handshake failed with remote 'tls://127.0.0.1:34464': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:44:30,488 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 8450s comm = await self.rpc.connect(saddr) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 8450s return await self._connect(addr=addr, timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 8450s comm = await connect( 8450s ^^^^^^^^^^^^^^ 8450s ...<4 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Nanny start timed out after 0s. 8450s 2024-11-23 22:44:31,496 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:44:31,503 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37781 8450s 2024-11-23 22:44:31,504 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46875/status 8450s 2024-11-23 22:44:31,504 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:44:31,525 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:42043'. Reason: failure-to-start- 8450s 2024-11-23 22:44:31,525 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:33363'. Reason: failure-to-start- 8450s 2024-11-23 22:44:31,526 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37781': TLS handshake failed with remote 'tls://127.0.0.1:57810': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:44:31,526 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37781': TLS handshake failed with remote 'tls://127.0.0.1:57818': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:44:31,527 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 8450s comm = await self.rpc.connect(saddr) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 8450s return await self._connect(addr=addr, timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 8450s comm = await connect( 8450s ^^^^^^^^^^^^^^ 8450s ...<4 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Nanny start timed out after 0s. 8450s 2024-11-23 22:44:32,535 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:44:32,547 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33205 8450s 2024-11-23 22:44:32,548 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42301/status 8450s 2024-11-23 22:44:32,549 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:44:32,596 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:44063'. Reason: failure-to-start- 8450s 2024-11-23 22:44:32,597 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:43307'. Reason: failure-to-start- 8450s 2024-11-23 22:44:32,603 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33205': TLS handshake failed with remote 'tls://127.0.0.1:35064': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:44:32,603 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33205': TLS handshake failed with remote 'tls://127.0.0.1:35072': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:44:32,608 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 8450s comm = await self.rpc.connect(saddr) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 8450s return await self._connect(addr=addr, timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 8450s comm = await connect( 8450s ^^^^^^^^^^^^^^ 8450s ...<4 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Nanny start timed out after 0s. 8450s 2024-11-23 22:44:33,617 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:44:33,630 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35433 8450s 2024-11-23 22:44:33,631 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45107/status 8450s 2024-11-23 22:44:33,631 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:44:33,680 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:32981'. Reason: failure-to-start- 8450s 2024-11-23 22:44:33,680 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:33517'. Reason: failure-to-start- 8450s 2024-11-23 22:44:33,687 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35433': TLS handshake failed with remote 'tls://127.0.0.1:36500': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:44:33,688 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35433': TLS handshake failed with remote 'tls://127.0.0.1:36508': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:44:33,693 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 8450s comm = await self.rpc.connect(saddr) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 8450s return await self._connect(addr=addr, timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 8450s comm = await connect( 8450s ^^^^^^^^^^^^^^ 8450s ...<4 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Nanny start timed out after 0s. 8450s 2024-11-23 22:44:34,701 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:44:34,709 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46387 8450s 2024-11-23 22:44:34,709 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42551/status 8450s 2024-11-23 22:44:34,709 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:44:34,736 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:42751'. Reason: failure-to-start- 8450s 2024-11-23 22:44:34,737 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:36229'. Reason: failure-to-start- 8450s 2024-11-23 22:44:34,738 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46387': TLS handshake failed with remote 'tls://127.0.0.1:49020': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:44:34,738 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46387': TLS handshake failed with remote 'tls://127.0.0.1:49030': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:44:34,738 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 8450s comm = await self.rpc.connect(saddr) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 8450s return await self._connect(addr=addr, timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 8450s comm = await connect( 8450s ^^^^^^^^^^^^^^ 8450s ...<4 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Nanny start timed out after 0s. 8450s 2024-11-23 22:44:35,745 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:44:35,752 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38219 8450s 2024-11-23 22:44:35,752 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33593/status 8450s 2024-11-23 22:44:35,753 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:44:35,771 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:41611'. Reason: failure-to-start- 8450s 2024-11-23 22:44:35,771 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:42629'. Reason: failure-to-start- 8450s 2024-11-23 22:44:35,772 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38219': TLS handshake failed with remote 'tls://127.0.0.1:37184': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:44:35,772 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38219': TLS handshake failed with remote 'tls://127.0.0.1:37194': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:44:35,774 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 8450s comm = await self.rpc.connect(saddr) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 8450s return await self._connect(addr=addr, timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 8450s comm = await connect( 8450s ^^^^^^^^^^^^^^ 8450s ...<4 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Nanny start timed out after 0s. 8450s 2024-11-23 22:44:36,779 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:44:36,787 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42299 8450s 2024-11-23 22:44:36,787 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42423/status 8450s 2024-11-23 22:44:36,797 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:44:36,820 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:34255'. Reason: failure-to-start- 8450s 2024-11-23 22:44:36,821 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:45809'. Reason: failure-to-start- 8450s 2024-11-23 22:44:36,822 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42299': TLS handshake failed with remote 'tls://127.0.0.1:55736': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:44:36,822 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42299': TLS handshake failed with remote 'tls://127.0.0.1:55750': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:44:36,822 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 8450s comm = await self.rpc.connect(saddr) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 8450s return await self._connect(addr=addr, timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 8450s comm = await connect( 8450s ^^^^^^^^^^^^^^ 8450s ...<4 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Nanny start timed out after 0s. 8450s 2024-11-23 22:44:37,827 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:44:37,835 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35471 8450s 2024-11-23 22:44:37,836 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39443/status 8450s 2024-11-23 22:44:37,836 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:44:37,860 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:35707'. Reason: failure-to-start- 8450s 2024-11-23 22:44:37,860 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:45035'. Reason: failure-to-start- 8450s 2024-11-23 22:44:37,863 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35471': TLS handshake failed with remote 'tls://127.0.0.1:54374': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:44:37,863 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35471': TLS handshake failed with remote 'tls://127.0.0.1:54380': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:44:37,863 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 8450s comm = await self.rpc.connect(saddr) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 8450s return await self._connect(addr=addr, timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 8450s comm = await connect( 8450s ^^^^^^^^^^^^^^ 8450s ...<4 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Nanny start timed out after 0s. 8450s 2024-11-23 22:44:38,869 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:44:38,878 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35869 8450s 2024-11-23 22:44:38,878 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36097/status 8450s 2024-11-23 22:44:38,879 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:44:38,896 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:35253'. Reason: failure-to-start- 8450s 2024-11-23 22:44:38,897 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:38193'. Reason: failure-to-start- 8450s 2024-11-23 22:44:38,897 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35869': TLS handshake failed with remote 'tls://127.0.0.1:40600': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:44:38,898 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35869': TLS handshake failed with remote 'tls://127.0.0.1:40608': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:44:38,900 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 8450s comm = await self.rpc.connect(saddr) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 8450s return await self._connect(addr=addr, timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 8450s comm = await connect( 8450s ^^^^^^^^^^^^^^ 8450s ...<4 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Nanny start timed out after 0s. 8450s 2024-11-23 22:44:39,905 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:44:39,912 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45171 8450s 2024-11-23 22:44:39,912 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45879/status 8450s 2024-11-23 22:44:39,913 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:44:39,930 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:38657'. Reason: failure-to-start- 8450s 2024-11-23 22:44:39,930 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:38865'. Reason: failure-to-start- 8450s 2024-11-23 22:44:39,933 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45171': TLS handshake failed with remote 'tls://127.0.0.1:60538': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:44:39,933 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45171': TLS handshake failed with remote 'tls://127.0.0.1:60544': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:44:39,933 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 8450s comm = await self.rpc.connect(saddr) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 8450s return await self._connect(addr=addr, timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 8450s comm = await connect( 8450s ^^^^^^^^^^^^^^ 8450s ...<4 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Nanny start timed out after 0s. 8450s 2024-11-23 22:44:40,938 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:44:40,946 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45651 8450s 2024-11-23 22:44:40,946 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41689/status 8450s 2024-11-23 22:44:40,946 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:44:40,970 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:37179'. Reason: failure-to-start- 8450s 2024-11-23 22:44:40,970 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:45565'. Reason: failure-to-start- 8450s 2024-11-23 22:44:40,971 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45651': TLS handshake failed with remote 'tls://127.0.0.1:58404': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:44:40,971 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45651': TLS handshake failed with remote 'tls://127.0.0.1:58406': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:44:40,973 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 8450s comm = await self.rpc.connect(saddr) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 8450s return await self._connect(addr=addr, timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 8450s comm = await connect( 8450s ^^^^^^^^^^^^^^ 8450s ...<4 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Nanny start timed out after 0s. 8450s 2024-11-23 22:44:41,978 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:44:41,985 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36889 8450s 2024-11-23 22:44:41,985 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37313/status 8450s 2024-11-23 22:44:41,986 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:44:42,002 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:43121'. Reason: failure-to-start- 8450s 2024-11-23 22:44:42,002 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:38535'. Reason: failure-to-start- 8450s 2024-11-23 22:44:42,003 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36889': TLS handshake failed with remote 'tls://127.0.0.1:37108': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:44:42,003 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36889': TLS handshake failed with remote 'tls://127.0.0.1:37122': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:44:42,006 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 8450s comm = await self.rpc.connect(saddr) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 8450s return await self._connect(addr=addr, timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 8450s comm = await connect( 8450s ^^^^^^^^^^^^^^ 8450s ...<4 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Nanny start timed out after 0s. 8450s 2024-11-23 22:44:43,012 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:44:43,021 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37435 8450s 2024-11-23 22:44:43,021 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34941/status 8450s 2024-11-23 22:44:43,027 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:44:43,052 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:38227'. Reason: failure-to-start- 8450s 2024-11-23 22:44:43,052 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:34627'. Reason: failure-to-start- 8450s 2024-11-23 22:44:43,053 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37435': TLS handshake failed with remote 'tls://127.0.0.1:49180': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:44:43,053 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37435': TLS handshake failed with remote 'tls://127.0.0.1:49192': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:44:43,056 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 8450s comm = await self.rpc.connect(saddr) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 8450s return await self._connect(addr=addr, timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 8450s comm = await connect( 8450s ^^^^^^^^^^^^^^ 8450s ...<4 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Nanny start timed out after 0s. 8450s ________________________________ test_rebalance ________________________________ 8450s 8450s fut = , timeout = 0 8450s 8450s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 8450s async with asyncio.timeout(timeout): 8450s > return await fut 8450s 8450s /usr/lib/python3/dist-packages/distributed/utils.py:1960: 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s /usr/lib/python3/dist-packages/distributed/worker.py:1480: in start_unsafe 8450s await self._register_with_scheduler() 8450s /usr/lib/python3/dist-packages/distributed/worker.py:1179: in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s /usr/lib/python3/dist-packages/distributed/comm/core.py:342: in connect 8450s comm = await wait_for( 8450s /usr/lib/python3/dist-packages/distributed/utils.py:1960: in wait_for 8450s return await fut 8450s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:546: in connect 8450s stream = await self.client.connect( 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s 8450s self = , host = '127.0.0.1' 8450s port = 34711, af = 8450s ssl_options = 8450s max_buffer_size = 8364507136.0, source_ip = None, source_port = None 8450s timeout = None 8450s 8450s async def connect( 8450s self, 8450s host: str, 8450s port: int, 8450s af: socket.AddressFamily = socket.AF_UNSPEC, 8450s ssl_options: Optional[Union[Dict[str, Any], ssl.SSLContext]] = None, 8450s max_buffer_size: Optional[int] = None, 8450s source_ip: Optional[str] = None, 8450s source_port: Optional[int] = None, 8450s timeout: Optional[Union[float, datetime.timedelta]] = None, 8450s ) -> IOStream: 8450s """Connect to the given host and port. 8450s 8450s Asynchronously returns an `.IOStream` (or `.SSLIOStream` if 8450s ``ssl_options`` is not None). 8450s 8450s Using the ``source_ip`` kwarg, one can specify the source 8450s IP address to use when establishing the connection. 8450s In case the user needs to resolve and 8450s use a specific interface, it has to be handled outside 8450s of Tornado as this depends very much on the platform. 8450s 8450s Raises `TimeoutError` if the input future does not complete before 8450s ``timeout``, which may be specified in any form allowed by 8450s `.IOLoop.add_timeout` (i.e. a `datetime.timedelta` or an absolute time 8450s relative to `.IOLoop.time`) 8450s 8450s Similarly, when the user requires a certain source port, it can 8450s be specified using the ``source_port`` arg. 8450s 8450s .. versionchanged:: 4.5 8450s Added the ``source_ip`` and ``source_port`` arguments. 8450s 8450s .. versionchanged:: 5.0 8450s Added the ``timeout`` argument. 8450s """ 8450s if timeout is not None: 8450s if isinstance(timeout, numbers.Real): 8450s timeout = IOLoop.current().time() + timeout 8450s elif isinstance(timeout, datetime.timedelta): 8450s timeout = IOLoop.current().time() + timeout.total_seconds() 8450s else: 8450s raise TypeError("Unsupported timeout %r" % timeout) 8450s if timeout is not None: 8450s addrinfo = await gen.with_timeout( 8450s timeout, self.resolver.resolve(host, port, af) 8450s ) 8450s else: 8450s addrinfo = await self.resolver.resolve(host, port, af) 8450s connector = _Connector( 8450s addrinfo, 8450s functools.partial( 8450s self._create_stream, 8450s max_buffer_size, 8450s source_ip=source_ip, 8450s source_port=source_port, 8450s ), 8450s ) 8450s > af, addr, stream = await connector.start(connect_timeout=timeout) 8450s E asyncio.exceptions.CancelledError 8450s 8450s /usr/lib/python3/dist-packages/tornado/tcpclient.py:279: CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s self = 8450s 8450s @final 8450s async def start(self): 8450s async with self._startup_lock: 8450s if self.status == Status.failed: 8450s assert self.__startup_exc is not None 8450s raise self.__startup_exc 8450s elif self.status != Status.init: 8450s return self 8450s timeout = getattr(self, "death_timeout", None) 8450s 8450s async def _close_on_failure(exc: Exception) -> None: 8450s await self.close(reason=f"failure-to-start-{str(type(exc))}") 8450s self.status = Status.failed 8450s self.__startup_exc = exc 8450s 8450s try: 8450s > await wait_for(self.start_unsafe(), timeout=timeout) 8450s 8450s /usr/lib/python3/dist-packages/distributed/core.py:664: 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 8450s async with asyncio.timeout(timeout): 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s 8450s self = 8450s exc_type = 8450s exc_val = CancelledError(), exc_tb = 8450s 8450s async def __aexit__( 8450s self, 8450s exc_type: Optional[Type[BaseException]], 8450s exc_val: Optional[BaseException], 8450s exc_tb: Optional[TracebackType], 8450s ) -> Optional[bool]: 8450s assert self._state in (_State.ENTERED, _State.EXPIRING) 8450s 8450s if self._timeout_handler is not None: 8450s self._timeout_handler.cancel() 8450s self._timeout_handler = None 8450s 8450s if self._state is _State.EXPIRING: 8450s self._state = _State.EXPIRED 8450s 8450s if self._task.uncancel() <= self._cancelling and exc_type is not None: 8450s # Since there are no new cancel requests, we're 8450s # handling this. 8450s if issubclass(exc_type, exceptions.CancelledError): 8450s > raise TimeoutError from exc_val 8450s E TimeoutError 8450s 8450s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s @contextlib.asynccontextmanager 8450s async def _cluster_factory(): 8450s workers = [] 8450s s = None 8450s try: 8450s for _ in range(60): 8450s try: 8450s > s, ws = await start_cluster( 8450s nthreads, 8450s scheduler, 8450s security=security, 8450s Worker=Worker, 8450s scheduler_kwargs=scheduler_kwargs, 8450s worker_kwargs=merge( 8450s {"death_timeout": min(15, int(deadline.remaining))}, 8450s worker_kwargs, 8450s ), 8450s ) 8450s 8450s /usr/lib/python3/dist-packages/distributed/utils_test.py:966: 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s /usr/lib/python3/dist-packages/distributed/utils_test.py:789: in start_cluster 8450s await asyncio.gather(*workers) 8450s /usr/lib/python3.13/asyncio/tasks.py:737: in _wrap_awaitable 8450s return await awaitable 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s 8450s self = 8450s 8450s @final 8450s async def start(self): 8450s async with self._startup_lock: 8450s if self.status == Status.failed: 8450s assert self.__startup_exc is not None 8450s raise self.__startup_exc 8450s elif self.status != Status.init: 8450s return self 8450s timeout = getattr(self, "death_timeout", None) 8450s 8450s async def _close_on_failure(exc: Exception) -> None: 8450s await self.close(reason=f"failure-to-start-{str(type(exc))}") 8450s self.status = Status.failed 8450s self.__startup_exc = exc 8450s 8450s try: 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s except asyncio.TimeoutError as exc: 8450s await _close_on_failure(exc) 8450s > raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s E TimeoutError: Worker start timed out after 0s. 8450s 8450s /usr/lib/python3/dist-packages/distributed/core.py:667: TimeoutError 8450s 8450s During handling of the above exception, another exception occurred: 8450s 8450s fut = ._..test_func..async_fn at 0xe8325a20> 8450s timeout = 60 8450s 8450s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 8450s async with asyncio.timeout(timeout): 8450s > return await fut 8450s 8450s /usr/lib/python3/dist-packages/distributed/utils.py:1960: 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s /usr/lib/python3/dist-packages/distributed/utils_test.py:999: in async_fn 8450s _cluster_factory() as (s, workers), 8450s /usr/lib/python3.13/contextlib.py:214: in __aenter__ 8450s return await anext(self.gen) 8450s /usr/lib/python3/dist-packages/distributed/utils_test.py:983: in _cluster_factory 8450s await asyncio.sleep(1) 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s 8450s delay = 1, result = None 8450s 8450s async def sleep(delay, result=None): 8450s """Coroutine that completes after a given time (in seconds).""" 8450s if delay <= 0: 8450s await __sleep0() 8450s return result 8450s 8450s if math.isnan(delay): 8450s raise ValueError("Invalid delay: NaN (not a number)") 8450s 8450s loop = events.get_running_loop() 8450s future = loop.create_future() 8450s h = loop.call_later(delay, 8450s futures._set_result_unless_cancelled, 8450s future, result) 8450s try: 8450s > return await future 8450s E asyncio.exceptions.CancelledError 8450s 8450s /usr/lib/python3.13/asyncio/tasks.py:718: CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s args = (), kwds = {} 8450s 8450s @wraps(func) 8450s def inner(*args, **kwds): 8450s with self._recreate_cm(): 8450s > return func(*args, **kwds) 8450s 8450s /usr/lib/python3.13/contextlib.py:85: 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s /usr/lib/python3.13/contextlib.py:85: in inner 8450s return func(*args, **kwds) 8450s /usr/lib/python3/dist-packages/distributed/utils_test.py:1102: in test_func 8450s return _run_and_close_tornado(async_fn_outer) 8450s /usr/lib/python3/dist-packages/distributed/utils_test.py:378: in _run_and_close_tornado 8450s return asyncio_run(inner_fn(), loop_factory=get_loop_factory()) 8450s /usr/lib/python3.13/asyncio/runners.py:194: in run 8450s return runner.run(main) 8450s /usr/lib/python3.13/asyncio/runners.py:118: in run 8450s return self._loop.run_until_complete(task) 8450s /usr/lib/python3.13/asyncio/base_events.py:720: in run_until_complete 8450s return future.result() 8450s /usr/lib/python3/dist-packages/distributed/utils_test.py:375: in inner_fn 8450s return await async_fn(*args, **kwargs) 8450s /usr/lib/python3/dist-packages/distributed/utils_test.py:1099: in async_fn_outer 8450s return await utils_wait_for(async_fn(), timeout=timeout * 2) 8450s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 8450s async with asyncio.timeout(timeout): 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s 8450s self = 8450s exc_type = 8450s exc_val = CancelledError(), exc_tb = 8450s 8450s async def __aexit__( 8450s self, 8450s exc_type: Optional[Type[BaseException]], 8450s exc_val: Optional[BaseException], 8450s exc_tb: Optional[TracebackType], 8450s ) -> Optional[bool]: 8450s assert self._state in (_State.ENTERED, _State.EXPIRING) 8450s 8450s if self._timeout_handler is not None: 8450s self._timeout_handler.cancel() 8450s self._timeout_handler = None 8450s 8450s if self._state is _State.EXPIRING: 8450s self._state = _State.EXPIRED 8450s 8450s if self._task.uncancel() <= self._cancelling and exc_type is not None: 8450s # Since there are no new cancel requests, we're 8450s # handling this. 8450s if issubclass(exc_type, exceptions.CancelledError): 8450s > raise TimeoutError from exc_val 8450s E TimeoutError 8450s 8450s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 8450s ----------------------------- Captured stderr call ----------------------------- 8450s 2024-11-23 22:44:44,454 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:44:44,464 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:44,465 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41485/status 8450s 2024-11-23 22:44:44,465 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:44:44,480 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43023 8450s 2024-11-23 22:44:44,480 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43023 8450s 2024-11-23 22:44:44,480 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:44:44,480 - distributed.worker - INFO - dashboard at: 127.0.0.1:41557 8450s 2024-11-23 22:44:44,480 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:44,480 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:44:44,480 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:44:44,480 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:44:44,480 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-_8p49bru 8450s 2024-11-23 22:44:44,481 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:44:44,482 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41305 8450s 2024-11-23 22:44:44,482 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41305 8450s 2024-11-23 22:44:44,482 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:44:44,482 - distributed.worker - INFO - dashboard at: 127.0.0.1:32977 8450s 2024-11-23 22:44:44,482 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:44,483 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:44:44,483 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:44:44,483 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:44:44,483 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-s4hn4gti 8450s 2024-11-23 22:44:44,483 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:44:44,495 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:44,495 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:44,495 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:33690': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:44,496 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:33698': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:44,607 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:44,607 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:44,608 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:33708': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:44,608 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:33722': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:44,721 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:44,721 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:44,722 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:33726': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:44,722 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:33742': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:44,833 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:44,834 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:44,834 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:33754': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:44,834 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:33756': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:44,946 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:44,946 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:44,946 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:33772': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:44,946 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:33778': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:45,058 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:45,058 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:45,059 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:33794': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:45,059 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:33798': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:45,171 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:45,172 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:45,172 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:33800': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:45,172 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:33804': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:45,284 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:45,284 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:45,284 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:33812': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:45,284 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:33816': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:45,396 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:45,397 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:45,397 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:33818': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:45,397 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:33834': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:45,509 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:45,509 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:45,510 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:33838': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:45,510 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:33854': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:45,622 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:45,622 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:45,623 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:33866': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:45,623 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:33870': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:45,734 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:45,734 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:45,735 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:33872': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:45,735 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:33884': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:45,847 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:45,847 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:45,848 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:33892': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:45,848 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:33908': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:45,960 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:45,960 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:45,960 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:33918': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:45,960 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:33920': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:46,073 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:46,073 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:46,073 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:33928': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:46,073 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:33944': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:46,185 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:46,185 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:46,185 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:33954': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:46,185 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:33966': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:46,299 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:46,299 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:46,299 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:33970': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:46,299 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:33978': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:46,411 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:46,411 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:46,412 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:33988': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:46,412 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:33998': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:46,524 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:46,524 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:46,524 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:34010': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:46,524 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:34026': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:46,636 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:46,636 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:46,636 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:34028': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:46,637 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:34036': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:46,749 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:46,749 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:46,749 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:34044': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:46,749 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:34058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:46,861 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:46,861 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:46,861 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:34064': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:46,861 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:34070': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:46,974 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:46,974 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:46,979 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:34078': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:46,979 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:34080': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:47,086 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:47,086 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:47,086 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:34096': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:47,086 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:34108': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:47,198 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:47,199 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:47,199 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:34116': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:47,199 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:34128': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:47,311 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:47,311 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:47,312 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:34130': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:47,312 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:34144': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:47,423 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:47,423 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:47,424 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:34154': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:47,424 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:34164': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:47,535 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:47,536 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:47,536 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:34170': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:47,536 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:34180': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:47,649 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:47,649 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:47,650 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:34192': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:47,650 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:34202': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:47,762 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:47,762 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:47,763 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:34210': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:47,763 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:34226': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:47,875 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:47,875 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:47,876 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:34234': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:47,876 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:34240': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:47,987 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:47,987 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:47,988 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:34254': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:47,988 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:34256': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:48,101 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:48,101 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:48,101 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:34268': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:48,102 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:34270': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:48,215 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:48,215 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:48,215 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:34272': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:48,215 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:34282': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:48,328 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:48,328 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:48,328 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:34284': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:48,328 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:34300': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:48,441 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:48,441 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:48,441 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:34316': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:48,441 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:34320': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:48,554 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:48,554 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:48,555 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:34328': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:48,555 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:34344': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:48,667 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:48,667 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:48,668 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:34348': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:48,668 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:34364': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:48,780 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:48,780 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:48,780 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:34378': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:48,780 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:34390': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:48,893 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:48,893 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:48,893 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:34394': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:48,893 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:34396': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:49,005 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:49,005 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:49,006 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:34398': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:49,006 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:34406': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:49,118 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:49,118 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:49,118 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:34408': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:49,119 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:34420': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:49,230 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:49,231 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:49,231 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:34426': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:49,231 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:34440': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:49,343 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:49,343 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:49,344 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:34444': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:49,344 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:34460': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:49,456 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:49,457 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:49,457 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:34464': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:49,457 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:34474': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:49,569 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:49,569 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:49,570 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:34488': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:49,570 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:34494': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:49,681 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:49,681 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:49,681 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:34500': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:49,681 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:34506': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:49,793 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:49,793 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:49,794 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:34510': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:49,794 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:34512': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:49,907 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:49,907 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:49,908 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:34514': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:49,908 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:34528': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:50,019 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:50,020 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:50,020 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:34530': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:50,020 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:34534': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:50,132 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:50,132 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:50,133 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:34536': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:50,133 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:34542': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:50,244 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:50,244 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:50,245 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:34550': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:50,245 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:34564': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:50,357 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:50,357 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:50,357 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:34578': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:50,357 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:34594': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:50,470 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:50,470 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:50,475 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:34610': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:50,475 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:34620': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:50,583 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:50,583 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:50,583 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:34632': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:50,583 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:34648': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:50,696 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:50,696 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:50,697 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:34656': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:50,697 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:34664': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:50,808 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:50,809 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:50,809 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:34678': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:50,809 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:34688': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:50,921 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:50,922 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:50,922 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:34690': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:50,922 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:34692': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:51,034 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:51,035 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:51,035 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:34698': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:51,035 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:34712': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:51,148 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:51,148 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:51,149 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:34714': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:51,149 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:34724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:51,260 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:51,261 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:51,261 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:34732': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:51,261 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:34738': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:51,373 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:51,373 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:51,374 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:34744': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:51,374 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:34746': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:51,485 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:51,485 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:51,485 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:34762': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:51,485 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:34764': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:51,598 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:51,598 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:51,598 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:40364': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:51,598 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:40378': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:51,711 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:51,712 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:51,712 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:40382': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:51,712 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:40384': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:51,823 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:51,824 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:51,824 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:40398': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:51,824 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:40408': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:51,937 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:51,937 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:51,938 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:40412': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:51,938 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:40418': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:52,050 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:52,050 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:52,051 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:40422': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:52,051 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:40432': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:52,163 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:52,163 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:52,163 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:40436': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:52,163 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:40452': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:52,275 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:52,275 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:52,276 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:40456': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:52,276 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:40470': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:52,388 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:52,388 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:52,389 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:40476': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:52,389 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:40492': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:52,502 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:52,502 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:52,502 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:40494': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:52,503 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:40498': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:52,615 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:52,615 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:52,615 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:40502': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:52,615 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:40512': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:52,729 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:52,729 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:52,730 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:40520': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:52,730 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:40532': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:52,842 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:52,842 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:52,842 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:40546': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:52,842 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:40562': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:52,955 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:52,955 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:52,955 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:40574': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:52,955 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:40578': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:53,067 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:53,067 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:53,067 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:40584': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:53,068 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:40598': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:53,180 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:53,180 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:53,180 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:40604': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:53,180 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:40608': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:53,292 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:53,292 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:53,292 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:40624': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:53,293 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:40636': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:53,405 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:53,405 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:53,406 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:40646': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:53,406 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:40658': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:53,519 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:53,519 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:53,519 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:40672': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:53,519 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:40686': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:53,631 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:53,632 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:53,632 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:40696': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:53,632 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:40706': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:53,744 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:53,744 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:53,744 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:40722': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:53,744 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:40724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:53,857 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:53,857 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:53,857 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:40736': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:53,857 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:40740': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:53,970 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:53,970 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:53,975 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:40756': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:53,975 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:40772': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:54,082 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:54,082 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:54,082 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:40774': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:54,082 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:40778': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:54,194 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:54,195 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:54,195 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:40792': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:54,195 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:40802': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:54,307 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:54,307 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:54,307 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:40816': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:54,307 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:40818': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:54,421 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:54,421 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:54,421 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:40826': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:54,421 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:40836': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:54,533 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:54,533 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:54,534 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:40846': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:54,534 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:40850': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:54,646 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:54,646 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:54,647 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:40860': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:54,647 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:40876': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:54,759 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:54,759 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:54,759 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:40880': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:54,759 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:40886': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:54,872 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:54,872 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:54,873 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:40902': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:54,873 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:40908': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:54,985 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:54,985 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:54,985 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:40910': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:54,985 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:40916': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:55,098 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:55,098 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:55,098 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:40928': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:55,098 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:40940': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:55,211 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:55,211 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:55,211 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:40942': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:55,211 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:40946': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:55,324 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:55,324 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:55,324 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:40950': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:55,324 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:40954': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:55,438 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:55,438 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:55,438 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:40958': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:55,438 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:40966': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:55,551 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:55,551 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:55,551 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:40970': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:55,551 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:40974': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:55,663 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:55,664 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:55,664 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:40980': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:55,664 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:40990': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:55,776 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:55,776 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:55,776 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:41000': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:55,776 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:41008': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:55,888 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:55,888 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:55,888 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:41022': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:55,889 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:41032': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:56,002 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:56,003 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:56,003 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:41044': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:56,003 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:41054': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:56,115 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:56,115 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:56,116 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:41064': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:56,116 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:41070': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:56,223 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:56,227 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:41072': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:56,228 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:56,228 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:41086': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:56,330 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:56,330 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:41102': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:56,336 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:56,336 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:41106': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:56,437 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:56,438 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:41112': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:56,444 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:56,444 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:41120': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:56,545 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:56,545 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:41124': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:56,551 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:56,551 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:41132': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:56,652 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:56,653 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:41140': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:56,658 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:56,659 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:41144': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:56,760 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:56,761 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:41156': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:56,766 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:56,767 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:41170': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:56,868 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:56,868 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:41172': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:56,874 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:56,874 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:41178': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:56,976 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:56,977 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:41182': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:56,983 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:56,983 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:41196': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:57,084 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:57,085 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:41198': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:57,091 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:57,091 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:41208': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:57,191 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:57,192 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:41220': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:57,198 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:57,198 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:41232': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:57,299 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:57,300 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:41242': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:57,305 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:57,306 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:41246': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:57,407 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:57,408 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:41248': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:57,413 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:57,414 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:41264': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:57,515 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:57,516 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:41276': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:57,523 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:57,523 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:41284': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:57,622 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:57,623 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:41286': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:57,630 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:57,630 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:41298': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:57,729 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:57,730 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:41300': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:57,737 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:57,737 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:41314': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:57,836 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:57,836 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:41320': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:57,843 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:57,844 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:41324': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:57,943 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:57,943 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:41340': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:57,950 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:57,951 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:41342': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:58,050 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:58,051 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:41344': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:58,057 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:58,057 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:41348': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:58,157 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:58,157 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:41358': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:58,164 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:58,164 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:41364': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:58,264 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:58,264 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:41378': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:58,270 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:58,271 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:41388': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:58,372 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:58,372 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:41396': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:58,378 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:58,378 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:41410': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:58,479 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:58,480 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:41422': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:58,485 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:58,486 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:41436': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:58,587 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:58,588 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:41438': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:58,593 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:58,594 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:41454': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:58,694 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:58,695 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:41466': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:58,701 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:58,701 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:41468': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:58,802 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:58,803 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:41480': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:58,809 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:58,809 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:41486': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:58,909 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:58,910 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:41490': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:58,916 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:58,916 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:41496': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:59,017 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:59,018 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:41510': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:59,023 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:59,025 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:41522': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:59,126 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:59,127 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:41536': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:59,132 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:59,132 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:41548': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:59,233 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:59,234 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:41558': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:59,239 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:59,240 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:41568': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:59,342 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:59,342 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:41582': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:59,348 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:59,348 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:41586': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:59,450 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:59,450 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:41596': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:59,456 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36565 8450s 2024-11-23 22:44:59,456 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36565': TLS handshake failed with remote 'tls://127.0.0.1:41598': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:44:59,479 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43023. Reason: failure-to-start- 8450s 2024-11-23 22:44:59,480 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:44:59,482 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41305. Reason: failure-to-start- 8450s 2024-11-23 22:44:59,482 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:44:59,482 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 15s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 8450s stream = await stream.start_tls( 8450s ^^^^^^^^^^^^^^^^^^^^^^^ 8450s False, ssl_options=ssl_options, server_hostname=host 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 8450s self.socket.do_handshake() 8450s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 8450s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 8450s self._sslobj.do_handshake() 8450s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 8450s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 8450s raise FatalCommClosedError( 8450s ...<2 lines>... 8450s ) from err 8450s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 8450s 8450s During handling of the above exception, another exception occurred: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1218, in _register_with_scheduler 8450s await asyncio.sleep(0.1) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 718, in sleep 8450s return await future 8450s ^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 15s. 8450s 2024-11-23 22:45:00,489 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:45:00,496 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:00,497 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38597/status 8450s 2024-11-23 22:45:00,497 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:45:00,513 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46347 8450s 2024-11-23 22:45:00,513 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46347 8450s 2024-11-23 22:45:00,513 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:45:00,513 - distributed.worker - INFO - dashboard at: 127.0.0.1:42545 8450s 2024-11-23 22:45:00,513 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:00,513 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:45:00,513 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:45:00,513 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:45:00,513 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-1hjyrqlb 8450s 2024-11-23 22:45:00,513 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:45:00,515 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39391 8450s 2024-11-23 22:45:00,515 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39391 8450s 2024-11-23 22:45:00,515 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:45:00,515 - distributed.worker - INFO - dashboard at: 127.0.0.1:45387 8450s 2024-11-23 22:45:00,515 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:00,515 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:45:00,516 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:45:00,516 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:45:00,516 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-om73doks 8450s 2024-11-23 22:45:00,516 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:45:00,531 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:00,531 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:00,532 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:36962': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:00,532 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:36968': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:00,643 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:00,643 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:00,644 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:36980': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:00,644 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:36994': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:00,756 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:00,756 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:00,756 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:36996': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:00,757 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:36998': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:00,869 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:00,869 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:00,869 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:37008': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:00,869 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:37016': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:00,982 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:00,982 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:00,982 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:37022': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:00,982 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:37026': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:01,095 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:01,095 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:01,095 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:37032': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:01,095 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:37042': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:01,207 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:01,207 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:01,208 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:37054': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:01,208 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:37068': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:01,320 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:01,320 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:01,321 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:37074': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:01,321 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:37080': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:01,433 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:01,433 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:01,433 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:37094': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:01,433 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:37098': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:01,546 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:01,546 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:01,546 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:35114': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:01,546 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:35126': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:01,658 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:01,659 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:01,659 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:35140': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:01,659 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:35154': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:01,770 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:01,771 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:01,771 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:35160': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:01,771 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:35166': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:01,883 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:01,883 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:01,884 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:35174': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:01,884 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:35184': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:01,996 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:01,996 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:01,997 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:35186': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:01,997 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:35198': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:02,108 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:02,109 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:02,110 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:35204': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:02,110 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:35206': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:02,216 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:02,217 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:35218': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:02,222 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:02,222 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:35228': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:02,325 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:02,325 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:35232': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:02,331 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:02,331 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:35236': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:02,432 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:02,432 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:35240': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:02,438 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:02,439 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:35246': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:02,539 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:02,539 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:35262': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:02,545 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:02,545 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:35270': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:02,646 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:02,646 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:35272': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:02,652 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:02,652 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:35288': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:02,753 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:02,753 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:35296': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:02,759 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:02,759 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:35304': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:02,860 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:02,861 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:35312': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:02,866 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:02,867 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:35324': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:02,968 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:02,972 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:35330': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:02,978 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:02,978 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:35346': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:03,075 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:03,075 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:35360': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:03,085 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:03,085 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:35376': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:03,182 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:03,182 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:35386': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:03,191 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:03,192 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:35398': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:03,289 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:03,290 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:35402': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:03,298 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:03,298 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:35414': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:03,396 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:03,397 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:35420': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:03,404 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:03,404 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:35436': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:03,508 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:03,509 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:35442': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:03,515 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:03,515 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:35446': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:03,615 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:03,616 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:35456': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:03,622 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:03,622 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:35470': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:03,723 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:03,725 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:35476': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:03,731 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:03,731 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:35478': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:03,832 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:03,833 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:35488': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:03,839 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:03,839 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:35496': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:03,940 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:03,940 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:35498': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:03,946 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:03,946 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:35508': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:04,048 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:04,049 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:35522': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:04,055 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:04,055 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:35538': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:04,156 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:04,156 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:35546': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:04,162 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:04,162 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:35556': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:04,263 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:04,264 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:35566': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:04,269 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:04,270 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:35572': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:04,370 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:04,371 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:35588': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:04,376 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:04,377 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:35594': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:04,477 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:04,478 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:35610': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:04,484 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:04,484 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:35622': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:04,584 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:04,584 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:35626': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:04,590 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:04,591 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:35636': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:04,692 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:04,693 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:35642': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:04,698 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:04,699 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:35656': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:04,799 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:04,800 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:35658': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:04,806 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:04,806 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:35672': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:04,906 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:04,906 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:35680': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:04,912 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:04,912 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:35686': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:05,013 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:05,013 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:35688': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:05,019 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:05,020 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:35692': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:05,120 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:05,121 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:35698': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:05,127 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:05,127 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:35700': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:05,228 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:05,229 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:35710': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:05,234 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:05,235 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:35726': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:05,336 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:05,336 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:35730': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:05,342 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:05,342 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:35734': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:05,444 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:05,445 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:35748': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:05,451 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:05,451 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:35752': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:05,551 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:05,551 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:35766': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:05,557 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:05,558 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:35782': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:05,658 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:05,659 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:35788': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:05,665 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:05,665 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:35796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:05,767 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:05,767 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:35810': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:05,773 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:05,773 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:35814': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:05,874 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:05,874 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:35820': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:05,880 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:05,881 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:35836': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:05,981 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:05,981 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:35852': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:05,987 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:05,987 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:35868': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:06,088 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:06,088 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:35870': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:06,094 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:06,095 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:35886': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:06,195 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:06,195 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:35890': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:06,201 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:06,202 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:35900': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:06,303 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:06,304 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:35910': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:06,309 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:06,310 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:35922': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:06,410 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:06,411 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:35938': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:06,417 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:06,417 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:35954': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:06,519 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:06,520 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:35956': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:06,525 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:06,525 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:35966': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:06,626 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:06,626 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:35978': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:06,632 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:06,633 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:35992': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:06,733 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:06,734 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:36004': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:06,740 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:06,740 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:36010': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:06,842 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:06,842 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:36022': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:06,848 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:06,848 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:36028': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:06,949 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:06,949 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:36042': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:06,955 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:06,955 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:36056': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:07,056 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:07,056 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:36058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:07,064 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:07,064 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:36066': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:07,164 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:07,165 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:36080': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:07,171 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:07,171 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:36082': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:07,272 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:07,272 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:36094': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:07,278 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:07,278 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:36110': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:07,378 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:07,379 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:36122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:07,385 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:07,385 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:36138': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:07,486 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:07,487 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:36146': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:07,493 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:07,493 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:36160': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:07,594 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:07,595 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:36174': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:07,600 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:07,601 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:36180': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:07,701 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:07,702 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:36190': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:07,708 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:07,708 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:36192': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:07,808 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:07,809 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:36196': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:07,814 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:07,815 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:36204': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:07,915 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:07,916 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:36218': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:07,922 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:07,922 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:36222': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:08,022 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:08,022 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:36224': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:08,028 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:08,028 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:36240': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:08,129 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:08,130 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:36252': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:08,136 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:08,136 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:36264': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:08,238 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:08,238 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:36274': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:08,244 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:08,244 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:36288': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:08,345 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:08,345 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:36298': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:08,351 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:08,351 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:36308': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:08,452 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:08,452 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:36316': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:08,458 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:08,458 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:36318': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:08,559 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:08,560 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:36320': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:08,566 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:08,566 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:36330': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:08,667 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:08,668 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:36338': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:08,674 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:08,674 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:36348': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:08,776 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:08,776 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:36362': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:08,782 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:08,782 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:36376': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:08,883 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:08,883 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:36388': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:08,889 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:08,889 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:36392': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:08,991 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:08,991 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:36406': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:08,997 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:08,997 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:36422': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:09,098 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:09,098 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:36428': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:09,104 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:09,105 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:36434': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:09,206 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:09,207 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:36438': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:09,212 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:09,212 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:36444': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:09,314 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:09,315 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:36452': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:09,321 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:09,321 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:36466': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:09,422 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:09,422 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:36478': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:09,428 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:09,428 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:36490': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:09,529 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:09,529 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:36504': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:09,535 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:09,535 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:36520': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:09,635 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:09,636 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:36524': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:09,642 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:09,642 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:36538': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:09,743 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:09,743 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:36540': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:09,749 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:09,750 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:36542': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:09,850 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:09,850 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:36554': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:09,856 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:09,856 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:36556': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:09,958 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:09,959 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:36562': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:09,964 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:09,964 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:36564': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:10,065 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:10,066 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:36566': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:10,071 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:10,072 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:36580': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:10,172 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:10,172 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:36582': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:10,178 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:10,179 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:36584': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:10,279 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:10,280 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:36590': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:10,286 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:10,286 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:36594': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:10,387 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:10,387 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:36602': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:10,393 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:10,395 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:36610': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:10,494 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:10,494 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:36622': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:10,501 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:10,506 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:36636': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:10,601 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:10,601 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:36642': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:10,608 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:10,609 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:36648': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:10,708 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:10,708 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:36652': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:10,714 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:10,715 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:36660': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:10,816 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:10,817 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:36662': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:10,822 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:10,822 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:36676': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:10,925 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:10,926 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:36692': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:10,931 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:10,932 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:36694': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:11,033 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:11,033 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:36708': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:11,039 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:11,039 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:36710': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:11,140 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:11,140 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:36726': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:11,146 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:11,147 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:36732': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:11,247 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:11,247 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:36736': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:11,254 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:11,254 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:36742': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:11,354 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:11,354 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:36748': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:11,360 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:11,360 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:36750': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:11,461 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:11,461 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:36754': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:11,467 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:11,472 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:36756': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:11,568 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:11,568 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:41120': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:11,574 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:11,574 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:41122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:11,675 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:11,675 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:41128': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:11,681 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:11,681 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:41138': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:11,782 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:11,783 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:41142': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:11,788 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:11,789 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:41158': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:11,889 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:11,890 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:41162': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:11,896 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:11,896 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:41166': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:11,997 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:11,997 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:41180': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:12,007 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:12,008 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:41192': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:12,104 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:12,105 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:41194': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:12,115 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:12,115 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:41206': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:12,212 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:12,212 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:41212': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:12,222 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:12,222 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:41226': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:12,319 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:12,319 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:41228': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:12,328 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:12,329 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:41230': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:12,426 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:12,426 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:41238': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:12,436 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:12,436 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:41246': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:12,534 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:12,535 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:41250': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:12,542 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:12,542 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:41262': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:12,642 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:12,643 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:41278': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:12,649 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:12,649 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:41288': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:12,751 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:12,751 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:41296': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:12,757 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:12,757 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:41298': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:12,858 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:12,858 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:41306': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:12,864 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:12,864 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:41318': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:12,965 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:12,965 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:41332': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:12,976 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:12,976 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:41346': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:13,072 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:13,073 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:41362': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:13,083 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:13,083 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:41372': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:13,179 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:13,180 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:41380': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:13,190 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:13,190 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:41384': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:13,287 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:13,287 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:41386': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:13,296 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:13,297 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:41392': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:13,394 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:13,394 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:41404': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:13,403 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:13,404 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:41420': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:13,501 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:13,505 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:41434': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:13,511 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43143 8450s 2024-11-23 22:45:13,512 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43143': TLS handshake failed with remote 'tls://127.0.0.1:41440': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:13,512 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46347. Reason: failure-to-start- 8450s 2024-11-23 22:45:13,512 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:45:13,513 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 13s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 8450s stream = await stream.start_tls( 8450s ^^^^^^^^^^^^^^^^^^^^^^^ 8450s False, ssl_options=ssl_options, server_hostname=host 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 8450s self.socket.do_handshake() 8450s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 8450s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 8450s self._sslobj.do_handshake() 8450s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 8450s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 8450s raise FatalCommClosedError( 8450s ...<2 lines>... 8450s ) from err 8450s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 8450s 8450s During handling of the above exception, another exception occurred: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1218, in _register_with_scheduler 8450s await asyncio.sleep(0.1) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 718, in sleep 8450s return await future 8450s ^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 13s. 8450s 2024-11-23 22:45:13,517 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39391. Reason: failure-to-start- 8450s 2024-11-23 22:45:13,517 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:45:14,519 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:45:14,529 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41605 8450s 2024-11-23 22:45:14,530 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35799/status 8450s 2024-11-23 22:45:14,530 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:45:14,545 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46625 8450s 2024-11-23 22:45:14,545 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46625 8450s 2024-11-23 22:45:14,545 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:45:14,546 - distributed.worker - INFO - dashboard at: 127.0.0.1:40155 8450s 2024-11-23 22:45:14,546 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41605 8450s 2024-11-23 22:45:14,546 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:45:14,546 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:45:14,546 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:45:14,546 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-uav4ezch 8450s 2024-11-23 22:45:14,546 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:45:14,548 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39467 8450s 2024-11-23 22:45:14,548 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39467 8450s 2024-11-23 22:45:14,548 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:45:14,548 - distributed.worker - INFO - dashboard at: 127.0.0.1:42765 8450s 2024-11-23 22:45:14,548 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41605 8450s 2024-11-23 22:45:14,548 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:45:14,548 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:45:14,548 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:45:14,548 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-4sui_jgs 8450s 2024-11-23 22:45:14,548 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:45:14,549 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46625. Reason: failure-to-start- 8450s 2024-11-23 22:45:14,549 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:45:14,550 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39467. Reason: failure-to-start- 8450s 2024-11-23 22:45:14,550 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:45:14,551 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41605': TLS handshake failed with remote 'tls://127.0.0.1:42528': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:45:14,551 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41605': TLS handshake failed with remote 'tls://127.0.0.1:42534': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:45:14,552 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:45:15,557 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:45:15,565 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36375 8450s 2024-11-23 22:45:15,566 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38815/status 8450s 2024-11-23 22:45:15,566 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:45:15,581 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40599 8450s 2024-11-23 22:45:15,581 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40599 8450s 2024-11-23 22:45:15,581 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:45:15,582 - distributed.worker - INFO - dashboard at: 127.0.0.1:33731 8450s 2024-11-23 22:45:15,582 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36375 8450s 2024-11-23 22:45:15,582 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:45:15,582 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:45:15,582 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:45:15,582 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-1_0_fagm 8450s 2024-11-23 22:45:15,582 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:45:15,584 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43713 8450s 2024-11-23 22:45:15,584 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43713 8450s 2024-11-23 22:45:15,584 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:45:15,584 - distributed.worker - INFO - dashboard at: 127.0.0.1:35967 8450s 2024-11-23 22:45:15,584 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36375 8450s 2024-11-23 22:45:15,584 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:45:15,584 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:45:15,584 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:45:15,584 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-5gcy6c45 8450s 2024-11-23 22:45:15,584 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:45:15,585 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40599. Reason: failure-to-start- 8450s 2024-11-23 22:45:15,585 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:45:15,585 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43713. Reason: failure-to-start- 8450s 2024-11-23 22:45:15,585 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:45:15,586 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36375': TLS handshake failed with remote 'tls://127.0.0.1:42486': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:45:15,587 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36375': TLS handshake failed with remote 'tls://127.0.0.1:42498': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:45:15,588 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:45:16,593 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:45:16,601 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44969 8450s 2024-11-23 22:45:16,602 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41547/status 8450s 2024-11-23 22:45:16,602 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:45:16,616 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39219 8450s 2024-11-23 22:45:16,616 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39219 8450s 2024-11-23 22:45:16,616 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:45:16,616 - distributed.worker - INFO - dashboard at: 127.0.0.1:40951 8450s 2024-11-23 22:45:16,616 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44969 8450s 2024-11-23 22:45:16,616 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:45:16,616 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:45:16,616 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:45:16,616 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-aevr0td1 8450s 2024-11-23 22:45:16,616 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:45:16,618 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37973 8450s 2024-11-23 22:45:16,618 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37973 8450s 2024-11-23 22:45:16,618 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:45:16,618 - distributed.worker - INFO - dashboard at: 127.0.0.1:41845 8450s 2024-11-23 22:45:16,618 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44969 8450s 2024-11-23 22:45:16,618 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:45:16,618 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:45:16,618 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:45:16,618 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-8bpax3ua 8450s 2024-11-23 22:45:16,618 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:45:16,620 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39219. Reason: failure-to-start- 8450s 2024-11-23 22:45:16,620 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:45:16,620 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37973. Reason: failure-to-start- 8450s 2024-11-23 22:45:16,620 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:45:16,621 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44969': TLS handshake failed with remote 'tls://127.0.0.1:48916': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:45:16,622 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44969': TLS handshake failed with remote 'tls://127.0.0.1:48924': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:45:16,623 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:45:17,628 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:45:17,636 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39227 8450s 2024-11-23 22:45:17,636 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39097/status 8450s 2024-11-23 22:45:17,636 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:45:17,651 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35529 8450s 2024-11-23 22:45:17,651 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35529 8450s 2024-11-23 22:45:17,651 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:45:17,651 - distributed.worker - INFO - dashboard at: 127.0.0.1:38229 8450s 2024-11-23 22:45:17,651 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39227 8450s 2024-11-23 22:45:17,651 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:45:17,651 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:45:17,651 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:45:17,651 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-cg3qe8dy 8450s 2024-11-23 22:45:17,651 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:45:17,653 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45413 8450s 2024-11-23 22:45:17,653 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45413 8450s 2024-11-23 22:45:17,653 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:45:17,653 - distributed.worker - INFO - dashboard at: 127.0.0.1:46123 8450s 2024-11-23 22:45:17,653 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39227 8450s 2024-11-23 22:45:17,653 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:45:17,653 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:45:17,653 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:45:17,653 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-xt4uh08o 8450s 2024-11-23 22:45:17,653 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:45:17,654 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35529. Reason: failure-to-start- 8450s 2024-11-23 22:45:17,654 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:45:17,655 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45413. Reason: failure-to-start- 8450s 2024-11-23 22:45:17,655 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:45:17,656 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39227': TLS handshake failed with remote 'tls://127.0.0.1:51900': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:45:17,656 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39227': TLS handshake failed with remote 'tls://127.0.0.1:51914': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:45:17,657 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:45:18,663 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:45:18,673 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40197 8450s 2024-11-23 22:45:18,673 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39587/status 8450s 2024-11-23 22:45:18,674 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:45:18,689 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42565 8450s 2024-11-23 22:45:18,689 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42565 8450s 2024-11-23 22:45:18,689 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:45:18,689 - distributed.worker - INFO - dashboard at: 127.0.0.1:42527 8450s 2024-11-23 22:45:18,689 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40197 8450s 2024-11-23 22:45:18,689 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:45:18,689 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:45:18,689 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:45:18,689 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-pamwdl_d 8450s 2024-11-23 22:45:18,689 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:45:18,691 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34027 8450s 2024-11-23 22:45:18,691 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34027 8450s 2024-11-23 22:45:18,691 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:45:18,691 - distributed.worker - INFO - dashboard at: 127.0.0.1:33517 8450s 2024-11-23 22:45:18,691 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40197 8450s 2024-11-23 22:45:18,691 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:45:18,691 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:45:18,691 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:45:18,691 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-t8x273dl 8450s 2024-11-23 22:45:18,691 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:45:18,692 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42565. Reason: failure-to-start- 8450s 2024-11-23 22:45:18,692 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:45:18,693 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34027. Reason: failure-to-start- 8450s 2024-11-23 22:45:18,693 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:45:18,694 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40197': TLS handshake failed with remote 'tls://127.0.0.1:59910': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:45:18,694 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40197': TLS handshake failed with remote 'tls://127.0.0.1:59922': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:45:18,695 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:45:19,701 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:45:19,708 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42085 8450s 2024-11-23 22:45:19,709 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44747/status 8450s 2024-11-23 22:45:19,709 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:45:19,728 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41681 8450s 2024-11-23 22:45:19,728 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41681 8450s 2024-11-23 22:45:19,728 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:45:19,728 - distributed.worker - INFO - dashboard at: 127.0.0.1:43117 8450s 2024-11-23 22:45:19,728 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42085 8450s 2024-11-23 22:45:19,728 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:45:19,729 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:45:19,729 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:45:19,729 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-rwz0c2zg 8450s 2024-11-23 22:45:19,729 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:45:19,731 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46125 8450s 2024-11-23 22:45:19,731 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46125 8450s 2024-11-23 22:45:19,731 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:45:19,731 - distributed.worker - INFO - dashboard at: 127.0.0.1:40913 8450s 2024-11-23 22:45:19,731 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42085 8450s 2024-11-23 22:45:19,731 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:45:19,731 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:45:19,731 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:45:19,731 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-kir7thxq 8450s 2024-11-23 22:45:19,731 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:45:19,732 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41681. Reason: failure-to-start- 8450s 2024-11-23 22:45:19,732 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:45:19,732 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46125. Reason: failure-to-start- 8450s 2024-11-23 22:45:19,733 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:45:19,734 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42085': TLS handshake failed with remote 'tls://127.0.0.1:48410': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:45:19,734 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42085': TLS handshake failed with remote 'tls://127.0.0.1:48416': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:45:19,735 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:45:20,740 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:45:20,748 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34327 8450s 2024-11-23 22:45:20,749 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34303/status 8450s 2024-11-23 22:45:20,749 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:45:20,763 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42051 8450s 2024-11-23 22:45:20,763 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42051 8450s 2024-11-23 22:45:20,763 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:45:20,764 - distributed.worker - INFO - dashboard at: 127.0.0.1:40787 8450s 2024-11-23 22:45:20,764 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34327 8450s 2024-11-23 22:45:20,764 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:45:20,764 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:45:20,764 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:45:20,764 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-iypm0p8l 8450s 2024-11-23 22:45:20,764 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:45:20,766 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43609 8450s 2024-11-23 22:45:20,766 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43609 8450s 2024-11-23 22:45:20,766 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:45:20,766 - distributed.worker - INFO - dashboard at: 127.0.0.1:45093 8450s 2024-11-23 22:45:20,766 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34327 8450s 2024-11-23 22:45:20,766 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:45:20,766 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:45:20,766 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:45:20,766 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-9qfg_mxr 8450s 2024-11-23 22:45:20,766 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:45:20,767 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42051. Reason: failure-to-start- 8450s 2024-11-23 22:45:20,767 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:45:20,767 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43609. Reason: failure-to-start- 8450s 2024-11-23 22:45:20,767 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:45:20,769 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34327': TLS handshake failed with remote 'tls://127.0.0.1:59868': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:45:20,769 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34327': TLS handshake failed with remote 'tls://127.0.0.1:59882': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:45:20,770 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:45:21,776 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:45:21,784 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34839 8450s 2024-11-23 22:45:21,784 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39687/status 8450s 2024-11-23 22:45:21,785 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:45:21,798 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45813 8450s 2024-11-23 22:45:21,798 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45813 8450s 2024-11-23 22:45:21,798 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:45:21,798 - distributed.worker - INFO - dashboard at: 127.0.0.1:43835 8450s 2024-11-23 22:45:21,798 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34839 8450s 2024-11-23 22:45:21,798 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:45:21,798 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:45:21,798 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:45:21,798 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-e90yic0h 8450s 2024-11-23 22:45:21,798 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:45:21,800 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:32857 8450s 2024-11-23 22:45:21,800 - distributed.worker - INFO - Listening to: tls://127.0.0.1:32857 8450s 2024-11-23 22:45:21,800 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:45:21,800 - distributed.worker - INFO - dashboard at: 127.0.0.1:45163 8450s 2024-11-23 22:45:21,800 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34839 8450s 2024-11-23 22:45:21,800 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:45:21,800 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:45:21,800 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:45:21,800 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-45b1kkme 8450s 2024-11-23 22:45:21,800 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:45:21,801 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45813. Reason: failure-to-start- 8450s 2024-11-23 22:45:21,801 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:45:21,801 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:32857. Reason: failure-to-start- 8450s 2024-11-23 22:45:21,801 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:45:21,802 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34839': TLS handshake failed with remote 'tls://127.0.0.1:58020': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:45:21,803 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34839': TLS handshake failed with remote 'tls://127.0.0.1:58036': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:45:21,804 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:45:22,809 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:45:22,818 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42201 8450s 2024-11-23 22:45:22,818 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35461/status 8450s 2024-11-23 22:45:22,818 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:45:22,833 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46197 8450s 2024-11-23 22:45:22,833 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46197 8450s 2024-11-23 22:45:22,833 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:45:22,833 - distributed.worker - INFO - dashboard at: 127.0.0.1:42165 8450s 2024-11-23 22:45:22,833 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42201 8450s 2024-11-23 22:45:22,834 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:45:22,834 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:45:22,834 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:45:22,834 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-f0gdp4uc 8450s 2024-11-23 22:45:22,834 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:45:22,835 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42703 8450s 2024-11-23 22:45:22,836 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42703 8450s 2024-11-23 22:45:22,836 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:45:22,836 - distributed.worker - INFO - dashboard at: 127.0.0.1:41565 8450s 2024-11-23 22:45:22,836 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42201 8450s 2024-11-23 22:45:22,836 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:45:22,836 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:45:22,836 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:45:22,836 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-cwr9yktf 8450s 2024-11-23 22:45:22,836 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:45:22,837 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46197. Reason: failure-to-start- 8450s 2024-11-23 22:45:22,837 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:45:22,837 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42703. Reason: failure-to-start- 8450s 2024-11-23 22:45:22,837 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:45:22,838 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42201': TLS handshake failed with remote 'tls://127.0.0.1:37368': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:45:22,838 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42201': TLS handshake failed with remote 'tls://127.0.0.1:37372': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:45:22,840 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:45:23,845 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:45:23,853 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33063 8450s 2024-11-23 22:45:23,853 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40765/status 8450s 2024-11-23 22:45:23,854 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:45:23,868 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38911 8450s 2024-11-23 22:45:23,868 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38911 8450s 2024-11-23 22:45:23,868 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:45:23,868 - distributed.worker - INFO - dashboard at: 127.0.0.1:34439 8450s 2024-11-23 22:45:23,868 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33063 8450s 2024-11-23 22:45:23,868 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:45:23,868 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:45:23,869 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:45:23,869 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-sfgjzo54 8450s 2024-11-23 22:45:23,869 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:45:23,871 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40669 8450s 2024-11-23 22:45:23,871 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40669 8450s 2024-11-23 22:45:23,871 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:45:23,871 - distributed.worker - INFO - dashboard at: 127.0.0.1:44791 8450s 2024-11-23 22:45:23,871 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33063 8450s 2024-11-23 22:45:23,871 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:45:23,871 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:45:23,871 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:45:23,871 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-s_rco2hs 8450s 2024-11-23 22:45:23,871 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:45:23,872 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38911. Reason: failure-to-start- 8450s 2024-11-23 22:45:23,872 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:45:23,873 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40669. Reason: failure-to-start- 8450s 2024-11-23 22:45:23,873 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:45:23,874 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33063': TLS handshake failed with remote 'tls://127.0.0.1:60846': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:45:23,874 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33063': TLS handshake failed with remote 'tls://127.0.0.1:60848': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:45:23,875 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:45:24,881 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:45:24,889 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45795 8450s 2024-11-23 22:45:24,890 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43235/status 8450s 2024-11-23 22:45:24,890 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:45:24,906 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33965 8450s 2024-11-23 22:45:24,906 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33965 8450s 2024-11-23 22:45:24,906 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:45:24,906 - distributed.worker - INFO - dashboard at: 127.0.0.1:41583 8450s 2024-11-23 22:45:24,907 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45795 8450s 2024-11-23 22:45:24,907 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:45:24,907 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:45:24,907 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:45:24,907 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-x5rtwox9 8450s 2024-11-23 22:45:24,907 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:45:24,908 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36173 8450s 2024-11-23 22:45:24,909 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36173 8450s 2024-11-23 22:45:24,909 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:45:24,909 - distributed.worker - INFO - dashboard at: 127.0.0.1:39507 8450s 2024-11-23 22:45:24,909 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45795 8450s 2024-11-23 22:45:24,909 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:45:24,909 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:45:24,909 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:45:24,909 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-pkcxynng 8450s 2024-11-23 22:45:24,909 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:45:24,910 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33965. Reason: failure-to-start- 8450s 2024-11-23 22:45:24,910 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:45:24,910 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36173. Reason: failure-to-start- 8450s 2024-11-23 22:45:24,911 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:45:24,912 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45795': TLS handshake failed with remote 'tls://127.0.0.1:53790': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:45:24,912 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45795': TLS handshake failed with remote 'tls://127.0.0.1:53806': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:45:24,913 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:45:25,920 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:45:25,928 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46383 8450s 2024-11-23 22:45:25,928 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44223/status 8450s 2024-11-23 22:45:25,928 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:45:25,943 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40973 8450s 2024-11-23 22:45:25,944 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40973 8450s 2024-11-23 22:45:25,944 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:45:25,944 - distributed.worker - INFO - dashboard at: 127.0.0.1:38319 8450s 2024-11-23 22:45:25,944 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46383 8450s 2024-11-23 22:45:25,944 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:45:25,944 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:45:25,944 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:45:25,944 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-4oe6pkhh 8450s 2024-11-23 22:45:25,944 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:45:25,946 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42499 8450s 2024-11-23 22:45:25,946 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42499 8450s 2024-11-23 22:45:25,946 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:45:25,946 - distributed.worker - INFO - dashboard at: 127.0.0.1:39173 8450s 2024-11-23 22:45:25,946 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46383 8450s 2024-11-23 22:45:25,946 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:45:25,946 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:45:25,946 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:45:25,946 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-mirb77h0 8450s 2024-11-23 22:45:25,946 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:45:25,947 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40973. Reason: failure-to-start- 8450s 2024-11-23 22:45:25,947 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:45:25,948 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42499. Reason: failure-to-start- 8450s 2024-11-23 22:45:25,948 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:45:25,949 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46383': TLS handshake failed with remote 'tls://127.0.0.1:59728': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:45:25,949 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46383': TLS handshake failed with remote 'tls://127.0.0.1:59738': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:45:25,951 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:45:26,956 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:45:26,964 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45347 8450s 2024-11-23 22:45:26,964 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41651/status 8450s 2024-11-23 22:45:26,964 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:45:26,980 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36577 8450s 2024-11-23 22:45:26,980 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36577 8450s 2024-11-23 22:45:26,980 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:45:26,980 - distributed.worker - INFO - dashboard at: 127.0.0.1:44943 8450s 2024-11-23 22:45:26,980 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 8450s 2024-11-23 22:45:26,980 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:45:26,980 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:45:26,980 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:45:26,980 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-h2nocgwc 8450s 2024-11-23 22:45:26,980 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:45:26,982 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44315 8450s 2024-11-23 22:45:26,982 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44315 8450s 2024-11-23 22:45:26,982 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:45:26,982 - distributed.worker - INFO - dashboard at: 127.0.0.1:42851 8450s 2024-11-23 22:45:26,982 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45347 8450s 2024-11-23 22:45:26,982 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:45:26,982 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:45:26,982 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:45:26,982 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-9wlu1xec 8450s 2024-11-23 22:45:26,982 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:45:26,986 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36577. Reason: failure-to-start- 8450s 2024-11-23 22:45:26,986 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:45:26,986 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44315. Reason: failure-to-start- 8450s 2024-11-23 22:45:26,986 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:45:26,987 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:51218': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:45:26,987 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45347': TLS handshake failed with remote 'tls://127.0.0.1:51224': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:45:26,989 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:45:27,994 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:45:28,002 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34747 8450s 2024-11-23 22:45:28,002 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37699/status 8450s 2024-11-23 22:45:28,002 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:45:28,019 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35459 8450s 2024-11-23 22:45:28,019 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35459 8450s 2024-11-23 22:45:28,019 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:45:28,019 - distributed.worker - INFO - dashboard at: 127.0.0.1:40289 8450s 2024-11-23 22:45:28,019 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34747 8450s 2024-11-23 22:45:28,019 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:45:28,019 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:45:28,019 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:45:28,019 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-iem60xgm 8450s 2024-11-23 22:45:28,019 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:45:28,022 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33257 8450s 2024-11-23 22:45:28,022 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33257 8450s 2024-11-23 22:45:28,022 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:45:28,022 - distributed.worker - INFO - dashboard at: 127.0.0.1:46573 8450s 2024-11-23 22:45:28,022 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34747 8450s 2024-11-23 22:45:28,022 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:45:28,022 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:45:28,022 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:45:28,022 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-xpjgmw7c 8450s 2024-11-23 22:45:28,022 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:45:28,023 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35459. Reason: failure-to-start- 8450s 2024-11-23 22:45:28,023 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:45:28,024 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33257. Reason: failure-to-start- 8450s 2024-11-23 22:45:28,024 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:45:28,025 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34747': TLS handshake failed with remote 'tls://127.0.0.1:48464': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:45:28,025 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34747': TLS handshake failed with remote 'tls://127.0.0.1:48478': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:45:28,027 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:45:29,033 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:45:29,040 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45553 8450s 2024-11-23 22:45:29,040 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44293/status 8450s 2024-11-23 22:45:29,043 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:45:29,056 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44535 8450s 2024-11-23 22:45:29,056 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44535 8450s 2024-11-23 22:45:29,057 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:45:29,057 - distributed.worker - INFO - dashboard at: 127.0.0.1:37701 8450s 2024-11-23 22:45:29,057 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45553 8450s 2024-11-23 22:45:29,057 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:45:29,057 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:45:29,057 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:45:29,057 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-tykuxntw 8450s 2024-11-23 22:45:29,057 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:45:29,059 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45413 8450s 2024-11-23 22:45:29,059 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45413 8450s 2024-11-23 22:45:29,059 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:45:29,059 - distributed.worker - INFO - dashboard at: 127.0.0.1:35437 8450s 2024-11-23 22:45:29,059 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45553 8450s 2024-11-23 22:45:29,059 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:45:29,059 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:45:29,059 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:45:29,059 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-597ki10b 8450s 2024-11-23 22:45:29,059 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:45:29,060 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44535. Reason: failure-to-start- 8450s 2024-11-23 22:45:29,060 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:45:29,060 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45413. Reason: failure-to-start- 8450s 2024-11-23 22:45:29,061 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:45:29,062 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45553': TLS handshake failed with remote 'tls://127.0.0.1:57698': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:45:29,062 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45553': TLS handshake failed with remote 'tls://127.0.0.1:57704': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:45:29,063 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:45:30,068 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:45:30,076 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42603 8450s 2024-11-23 22:45:30,076 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37463/status 8450s 2024-11-23 22:45:30,077 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:45:30,092 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43979 8450s 2024-11-23 22:45:30,093 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43979 8450s 2024-11-23 22:45:30,093 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:45:30,093 - distributed.worker - INFO - dashboard at: 127.0.0.1:35657 8450s 2024-11-23 22:45:30,093 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42603 8450s 2024-11-23 22:45:30,093 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:45:30,093 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:45:30,093 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:45:30,093 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-4001lotg 8450s 2024-11-23 22:45:30,093 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:45:30,095 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33907 8450s 2024-11-23 22:45:30,095 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33907 8450s 2024-11-23 22:45:30,095 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:45:30,095 - distributed.worker - INFO - dashboard at: 127.0.0.1:42661 8450s 2024-11-23 22:45:30,095 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42603 8450s 2024-11-23 22:45:30,095 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:45:30,095 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:45:30,095 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:45:30,095 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-uq3fsnjf 8450s 2024-11-23 22:45:30,095 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:45:30,096 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43979. Reason: failure-to-start- 8450s 2024-11-23 22:45:30,096 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:45:30,096 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33907. Reason: failure-to-start- 8450s 2024-11-23 22:45:30,097 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:45:30,098 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42603': TLS handshake failed with remote 'tls://127.0.0.1:60808': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:45:30,098 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42603': TLS handshake failed with remote 'tls://127.0.0.1:60818': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:45:30,099 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:45:31,105 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:45:31,111 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44717 8450s 2024-11-23 22:45:31,112 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39129/status 8450s 2024-11-23 22:45:31,115 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:45:31,129 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37055 8450s 2024-11-23 22:45:31,130 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37055 8450s 2024-11-23 22:45:31,130 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:45:31,130 - distributed.worker - INFO - dashboard at: 127.0.0.1:38059 8450s 2024-11-23 22:45:31,130 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44717 8450s 2024-11-23 22:45:31,130 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:45:31,130 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:45:31,130 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:45:31,130 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-b4b94g6n 8450s 2024-11-23 22:45:31,130 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:45:31,132 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35671 8450s 2024-11-23 22:45:31,132 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35671 8450s 2024-11-23 22:45:31,132 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:45:31,132 - distributed.worker - INFO - dashboard at: 127.0.0.1:34067 8450s 2024-11-23 22:45:31,132 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44717 8450s 2024-11-23 22:45:31,132 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:45:31,132 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:45:31,132 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:45:31,132 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-8u2bxh5g 8450s 2024-11-23 22:45:31,132 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:45:31,133 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37055. Reason: failure-to-start- 8450s 2024-11-23 22:45:31,133 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:45:31,134 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35671. Reason: failure-to-start- 8450s 2024-11-23 22:45:31,134 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:45:31,135 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44717': TLS handshake failed with remote 'tls://127.0.0.1:40912': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:45:31,135 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44717': TLS handshake failed with remote 'tls://127.0.0.1:40920': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:45:31,136 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:45:32,142 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:45:32,149 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39845 8450s 2024-11-23 22:45:32,149 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34311/status 8450s 2024-11-23 22:45:32,150 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:45:32,163 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46649 8450s 2024-11-23 22:45:32,163 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46649 8450s 2024-11-23 22:45:32,163 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:45:32,163 - distributed.worker - INFO - dashboard at: 127.0.0.1:44495 8450s 2024-11-23 22:45:32,163 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39845 8450s 2024-11-23 22:45:32,163 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:45:32,163 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:45:32,163 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:45:32,164 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-p7s0aeeu 8450s 2024-11-23 22:45:32,164 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:45:32,165 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42371 8450s 2024-11-23 22:45:32,165 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42371 8450s 2024-11-23 22:45:32,165 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:45:32,166 - distributed.worker - INFO - dashboard at: 127.0.0.1:40509 8450s 2024-11-23 22:45:32,166 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39845 8450s 2024-11-23 22:45:32,166 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:45:32,166 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:45:32,166 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:45:32,166 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-q8g2j80c 8450s 2024-11-23 22:45:32,166 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:45:32,168 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46649. Reason: failure-to-start- 8450s 2024-11-23 22:45:32,168 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:45:32,168 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42371. Reason: failure-to-start- 8450s 2024-11-23 22:45:32,168 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:45:32,169 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39845': TLS handshake failed with remote 'tls://127.0.0.1:45316': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:45:32,169 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39845': TLS handshake failed with remote 'tls://127.0.0.1:45324': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:45:32,171 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:45:33,176 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:45:33,183 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43335 8450s 2024-11-23 22:45:33,184 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37173/status 8450s 2024-11-23 22:45:33,186 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:45:33,200 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38489 8450s 2024-11-23 22:45:33,201 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38489 8450s 2024-11-23 22:45:33,201 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:45:33,201 - distributed.worker - INFO - dashboard at: 127.0.0.1:46255 8450s 2024-11-23 22:45:33,201 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43335 8450s 2024-11-23 22:45:33,201 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:45:33,201 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:45:33,201 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:45:33,201 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-_doh3wz_ 8450s 2024-11-23 22:45:33,201 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:45:33,203 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43967 8450s 2024-11-23 22:45:33,203 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43967 8450s 2024-11-23 22:45:33,203 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:45:33,203 - distributed.worker - INFO - dashboard at: 127.0.0.1:41347 8450s 2024-11-23 22:45:33,203 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43335 8450s 2024-11-23 22:45:33,203 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:45:33,203 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:45:33,203 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:45:33,203 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-kyrptit5 8450s 2024-11-23 22:45:33,203 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:45:33,204 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38489. Reason: failure-to-start- 8450s 2024-11-23 22:45:33,204 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:45:33,205 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43967. Reason: failure-to-start- 8450s 2024-11-23 22:45:33,205 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:45:33,206 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43335': TLS handshake failed with remote 'tls://127.0.0.1:54402': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:45:33,206 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43335': TLS handshake failed with remote 'tls://127.0.0.1:54408': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:45:33,207 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:45:34,216 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:45:34,223 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33841 8450s 2024-11-23 22:45:34,223 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44291/status 8450s 2024-11-23 22:45:34,223 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:45:34,237 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42459 8450s 2024-11-23 22:45:34,237 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42459 8450s 2024-11-23 22:45:34,238 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:45:34,238 - distributed.worker - INFO - dashboard at: 127.0.0.1:39633 8450s 2024-11-23 22:45:34,238 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33841 8450s 2024-11-23 22:45:34,238 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:45:34,238 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:45:34,238 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:45:34,238 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-sqs28qlx 8450s 2024-11-23 22:45:34,238 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:45:34,240 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39503 8450s 2024-11-23 22:45:34,240 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39503 8450s 2024-11-23 22:45:34,240 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:45:34,240 - distributed.worker - INFO - dashboard at: 127.0.0.1:43417 8450s 2024-11-23 22:45:34,240 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33841 8450s 2024-11-23 22:45:34,240 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:45:34,240 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:45:34,240 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:45:34,240 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-0h6_6prx 8450s 2024-11-23 22:45:34,240 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:45:34,241 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42459. Reason: failure-to-start- 8450s 2024-11-23 22:45:34,241 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:45:34,241 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39503. Reason: failure-to-start- 8450s 2024-11-23 22:45:34,242 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:45:34,243 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33841': TLS handshake failed with remote 'tls://127.0.0.1:42240': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:45:34,243 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33841': TLS handshake failed with remote 'tls://127.0.0.1:42254': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:45:34,244 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:45:35,249 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:45:35,256 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35825 8450s 2024-11-23 22:45:35,257 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45637/status 8450s 2024-11-23 22:45:35,257 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:45:35,276 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39201 8450s 2024-11-23 22:45:35,276 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39201 8450s 2024-11-23 22:45:35,276 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:45:35,276 - distributed.worker - INFO - dashboard at: 127.0.0.1:36423 8450s 2024-11-23 22:45:35,276 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35825 8450s 2024-11-23 22:45:35,276 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:45:35,276 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:45:35,276 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:45:35,276 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-w4gtj8mz 8450s 2024-11-23 22:45:35,276 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:45:35,278 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41481 8450s 2024-11-23 22:45:35,278 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41481 8450s 2024-11-23 22:45:35,279 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:45:35,279 - distributed.worker - INFO - dashboard at: 127.0.0.1:45125 8450s 2024-11-23 22:45:35,279 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35825 8450s 2024-11-23 22:45:35,279 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:45:35,279 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:45:35,279 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:45:35,279 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ewfvhhg7 8450s 2024-11-23 22:45:35,279 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:45:35,280 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39201. Reason: failure-to-start- 8450s 2024-11-23 22:45:35,280 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:45:35,280 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41481. Reason: failure-to-start- 8450s 2024-11-23 22:45:35,281 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:45:35,282 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35825': TLS handshake failed with remote 'tls://127.0.0.1:48182': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:45:35,282 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35825': TLS handshake failed with remote 'tls://127.0.0.1:48198': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:45:35,283 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:45:36,290 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:45:36,298 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44803 8450s 2024-11-23 22:45:36,298 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40291/status 8450s 2024-11-23 22:45:36,298 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:45:36,313 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37785 8450s 2024-11-23 22:45:36,313 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37785 8450s 2024-11-23 22:45:36,313 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:45:36,313 - distributed.worker - INFO - dashboard at: 127.0.0.1:33281 8450s 2024-11-23 22:45:36,313 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44803 8450s 2024-11-23 22:45:36,313 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:45:36,313 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:45:36,313 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:45:36,314 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-36vszdwg 8450s 2024-11-23 22:45:36,314 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:45:36,325 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42963 8450s 2024-11-23 22:45:36,325 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42963 8450s 2024-11-23 22:45:36,325 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:45:36,325 - distributed.worker - INFO - dashboard at: 127.0.0.1:43765 8450s 2024-11-23 22:45:36,325 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44803 8450s 2024-11-23 22:45:36,325 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:45:36,325 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:45:36,325 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:45:36,325 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-s4unu54u 8450s 2024-11-23 22:45:36,325 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:45:36,326 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37785. Reason: failure-to-start- 8450s 2024-11-23 22:45:36,327 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:45:36,327 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42963. Reason: failure-to-start- 8450s 2024-11-23 22:45:36,327 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:45:36,332 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44803': TLS handshake failed with remote 'tls://127.0.0.1:59290': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:45:36,332 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44803': TLS handshake failed with remote 'tls://127.0.0.1:59294': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:45:36,333 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:45:37,339 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:45:37,346 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36257 8450s 2024-11-23 22:45:37,347 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43625/status 8450s 2024-11-23 22:45:37,347 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:45:37,362 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45839 8450s 2024-11-23 22:45:37,362 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45839 8450s 2024-11-23 22:45:37,362 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:45:37,362 - distributed.worker - INFO - dashboard at: 127.0.0.1:39033 8450s 2024-11-23 22:45:37,362 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36257 8450s 2024-11-23 22:45:37,362 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:45:37,362 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:45:37,362 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:45:37,362 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-1c2lv1zz 8450s 2024-11-23 22:45:37,363 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:45:37,364 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38163 8450s 2024-11-23 22:45:37,364 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38163 8450s 2024-11-23 22:45:37,364 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:45:37,364 - distributed.worker - INFO - dashboard at: 127.0.0.1:45791 8450s 2024-11-23 22:45:37,365 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36257 8450s 2024-11-23 22:45:37,365 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:45:37,365 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:45:37,365 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:45:37,365 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-mx7668lp 8450s 2024-11-23 22:45:37,365 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:45:37,369 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45839. Reason: failure-to-start- 8450s 2024-11-23 22:45:37,369 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:45:37,369 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38163. Reason: failure-to-start- 8450s 2024-11-23 22:45:37,369 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:45:37,371 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36257': TLS handshake failed with remote 'tls://127.0.0.1:47456': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:45:37,371 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36257': TLS handshake failed with remote 'tls://127.0.0.1:47464': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:45:37,372 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:45:38,378 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:45:38,386 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41375 8450s 2024-11-23 22:45:38,387 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44279/status 8450s 2024-11-23 22:45:38,387 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:45:38,402 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33779 8450s 2024-11-23 22:45:38,403 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33779 8450s 2024-11-23 22:45:38,403 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:45:38,403 - distributed.worker - INFO - dashboard at: 127.0.0.1:40193 8450s 2024-11-23 22:45:38,403 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41375 8450s 2024-11-23 22:45:38,403 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:45:38,403 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:45:38,403 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:45:38,403 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-fpzqr469 8450s 2024-11-23 22:45:38,403 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:45:38,405 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43347 8450s 2024-11-23 22:45:38,405 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43347 8450s 2024-11-23 22:45:38,405 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:45:38,405 - distributed.worker - INFO - dashboard at: 127.0.0.1:36207 8450s 2024-11-23 22:45:38,405 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41375 8450s 2024-11-23 22:45:38,405 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:45:38,405 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:45:38,405 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:45:38,405 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-a328qnf5 8450s 2024-11-23 22:45:38,405 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:45:38,409 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33779. Reason: failure-to-start- 8450s 2024-11-23 22:45:38,409 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:45:38,409 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43347. Reason: failure-to-start- 8450s 2024-11-23 22:45:38,409 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:45:38,411 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41375': TLS handshake failed with remote 'tls://127.0.0.1:50950': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:45:38,411 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41375': TLS handshake failed with remote 'tls://127.0.0.1:50956': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:45:38,412 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:45:39,418 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:45:39,425 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39743 8450s 2024-11-23 22:45:39,426 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35257/status 8450s 2024-11-23 22:45:39,426 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:45:39,443 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38213 8450s 2024-11-23 22:45:39,443 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38213 8450s 2024-11-23 22:45:39,443 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:45:39,443 - distributed.worker - INFO - dashboard at: 127.0.0.1:34431 8450s 2024-11-23 22:45:39,443 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39743 8450s 2024-11-23 22:45:39,443 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:45:39,443 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:45:39,443 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:45:39,443 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-rghna7zm 8450s 2024-11-23 22:45:39,443 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:45:39,445 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40009 8450s 2024-11-23 22:45:39,445 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40009 8450s 2024-11-23 22:45:39,445 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:45:39,445 - distributed.worker - INFO - dashboard at: 127.0.0.1:36679 8450s 2024-11-23 22:45:39,445 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39743 8450s 2024-11-23 22:45:39,446 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:45:39,446 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:45:39,446 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:45:39,446 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-t5d2jry4 8450s 2024-11-23 22:45:39,446 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:45:39,450 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38213. Reason: failure-to-start- 8450s 2024-11-23 22:45:39,450 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:45:39,450 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40009. Reason: failure-to-start- 8450s 2024-11-23 22:45:39,450 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:45:39,451 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39743': TLS handshake failed with remote 'tls://127.0.0.1:58924': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:45:39,451 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39743': TLS handshake failed with remote 'tls://127.0.0.1:58940': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:45:39,453 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:45:40,458 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:45:40,466 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33109 8450s 2024-11-23 22:45:40,466 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42495/status 8450s 2024-11-23 22:45:40,467 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:45:40,487 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42873 8450s 2024-11-23 22:45:40,487 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42873 8450s 2024-11-23 22:45:40,487 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:45:40,487 - distributed.worker - INFO - dashboard at: 127.0.0.1:36529 8450s 2024-11-23 22:45:40,487 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33109 8450s 2024-11-23 22:45:40,487 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:45:40,487 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:45:40,487 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:45:40,487 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-2napbsu7 8450s 2024-11-23 22:45:40,487 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:45:40,489 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35453 8450s 2024-11-23 22:45:40,489 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35453 8450s 2024-11-23 22:45:40,489 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:45:40,489 - distributed.worker - INFO - dashboard at: 127.0.0.1:45209 8450s 2024-11-23 22:45:40,489 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33109 8450s 2024-11-23 22:45:40,489 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:45:40,489 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:45:40,489 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:45:40,489 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-7_37qa6s 8450s 2024-11-23 22:45:40,489 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:45:40,490 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42873. Reason: failure-to-start- 8450s 2024-11-23 22:45:40,490 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:45:40,491 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35453. Reason: failure-to-start- 8450s 2024-11-23 22:45:40,491 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:45:40,492 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33109': TLS handshake failed with remote 'tls://127.0.0.1:56200': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:45:40,492 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33109': TLS handshake failed with remote 'tls://127.0.0.1:56208': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:45:40,493 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:45:41,500 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:45:41,508 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43023 8450s 2024-11-23 22:45:41,508 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36623/status 8450s 2024-11-23 22:45:41,508 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:45:41,529 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34705 8450s 2024-11-23 22:45:41,530 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34705 8450s 2024-11-23 22:45:41,530 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:45:41,530 - distributed.worker - INFO - dashboard at: 127.0.0.1:38043 8450s 2024-11-23 22:45:41,530 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43023 8450s 2024-11-23 22:45:41,530 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:45:41,530 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:45:41,530 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:45:41,530 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-epguqkuz 8450s 2024-11-23 22:45:41,530 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:45:41,532 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43655 8450s 2024-11-23 22:45:41,532 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43655 8450s 2024-11-23 22:45:41,532 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:45:41,532 - distributed.worker - INFO - dashboard at: 127.0.0.1:41161 8450s 2024-11-23 22:45:41,532 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43023 8450s 2024-11-23 22:45:41,532 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:45:41,532 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:45:41,532 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:45:41,532 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-sg3s97sc 8450s 2024-11-23 22:45:41,532 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:45:41,533 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34705. Reason: failure-to-start- 8450s 2024-11-23 22:45:41,533 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:45:41,534 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43655. Reason: failure-to-start- 8450s 2024-11-23 22:45:41,534 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:45:41,539 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43023': TLS handshake failed with remote 'tls://127.0.0.1:45454': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:45:41,539 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43023': TLS handshake failed with remote 'tls://127.0.0.1:45464': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:45:41,540 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:45:42,546 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:45:42,554 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43787 8450s 2024-11-23 22:45:42,554 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38881/status 8450s 2024-11-23 22:45:42,557 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:45:42,575 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42069 8450s 2024-11-23 22:45:42,575 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42069 8450s 2024-11-23 22:45:42,575 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:45:42,575 - distributed.worker - INFO - dashboard at: 127.0.0.1:37447 8450s 2024-11-23 22:45:42,575 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43787 8450s 2024-11-23 22:45:42,575 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:45:42,575 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:45:42,575 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:45:42,575 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-xwpfb7cq 8450s 2024-11-23 22:45:42,575 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:45:42,577 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45893 8450s 2024-11-23 22:45:42,577 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45893 8450s 2024-11-23 22:45:42,577 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:45:42,577 - distributed.worker - INFO - dashboard at: 127.0.0.1:43613 8450s 2024-11-23 22:45:42,577 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43787 8450s 2024-11-23 22:45:42,577 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:45:42,577 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:45:42,577 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:45:42,577 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-zaxpy9yw 8450s 2024-11-23 22:45:42,577 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:45:42,581 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42069. Reason: failure-to-start- 8450s 2024-11-23 22:45:42,581 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:45:42,582 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45893. Reason: failure-to-start- 8450s 2024-11-23 22:45:42,582 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:45:42,583 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43787': TLS handshake failed with remote 'tls://127.0.0.1:40900': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:45:42,583 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43787': TLS handshake failed with remote 'tls://127.0.0.1:40916': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:45:42,587 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:45:43,593 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:45:43,600 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34711 8450s 2024-11-23 22:45:43,601 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36545/status 8450s 2024-11-23 22:45:43,601 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:45:43,615 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38895 8450s 2024-11-23 22:45:43,616 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38895 8450s 2024-11-23 22:45:43,616 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:45:43,616 - distributed.worker - INFO - dashboard at: 127.0.0.1:37545 8450s 2024-11-23 22:45:43,616 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34711 8450s 2024-11-23 22:45:43,616 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:45:43,616 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:45:43,616 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:45:43,616 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-qrqxjbh4 8450s 2024-11-23 22:45:43,616 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:45:43,619 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37865 8450s 2024-11-23 22:45:43,619 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37865 8450s 2024-11-23 22:45:43,619 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:45:43,619 - distributed.worker - INFO - dashboard at: 127.0.0.1:34911 8450s 2024-11-23 22:45:43,619 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34711 8450s 2024-11-23 22:45:43,619 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:45:43,619 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:45:43,619 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:45:43,619 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-s8ve4ljs 8450s 2024-11-23 22:45:43,619 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:45:43,623 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38895. Reason: failure-to-start- 8450s 2024-11-23 22:45:43,623 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:45:43,623 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37865. Reason: failure-to-start- 8450s 2024-11-23 22:45:43,623 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:45:43,627 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34711': TLS handshake failed with remote 'tls://127.0.0.1:58818': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:45:43,627 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34711': TLS handshake failed with remote 'tls://127.0.0.1:58822': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:45:43,628 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s ______________________________ test_work_stealing ______________________________ 8450s 8450s fut = , timeout = 0 8450s 8450s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 8450s async with asyncio.timeout(timeout): 8450s > return await fut 8450s 8450s /usr/lib/python3/dist-packages/distributed/utils.py:1960: 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s /usr/lib/python3/dist-packages/distributed/worker.py:1480: in start_unsafe 8450s await self._register_with_scheduler() 8450s /usr/lib/python3/dist-packages/distributed/worker.py:1179: in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s /usr/lib/python3/dist-packages/distributed/comm/core.py:342: in connect 8450s comm = await wait_for( 8450s /usr/lib/python3/dist-packages/distributed/utils.py:1960: in wait_for 8450s return await fut 8450s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:546: in connect 8450s stream = await self.client.connect( 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s 8450s self = , host = '127.0.0.1' 8450s port = 33195, af = 8450s ssl_options = 8450s max_buffer_size = 8364507136.0, source_ip = None, source_port = None 8450s timeout = None 8450s 8450s async def connect( 8450s self, 8450s host: str, 8450s port: int, 8450s af: socket.AddressFamily = socket.AF_UNSPEC, 8450s ssl_options: Optional[Union[Dict[str, Any], ssl.SSLContext]] = None, 8450s max_buffer_size: Optional[int] = None, 8450s source_ip: Optional[str] = None, 8450s source_port: Optional[int] = None, 8450s timeout: Optional[Union[float, datetime.timedelta]] = None, 8450s ) -> IOStream: 8450s """Connect to the given host and port. 8450s 8450s Asynchronously returns an `.IOStream` (or `.SSLIOStream` if 8450s ``ssl_options`` is not None). 8450s 8450s Using the ``source_ip`` kwarg, one can specify the source 8450s IP address to use when establishing the connection. 8450s In case the user needs to resolve and 8450s use a specific interface, it has to be handled outside 8450s of Tornado as this depends very much on the platform. 8450s 8450s Raises `TimeoutError` if the input future does not complete before 8450s ``timeout``, which may be specified in any form allowed by 8450s `.IOLoop.add_timeout` (i.e. a `datetime.timedelta` or an absolute time 8450s relative to `.IOLoop.time`) 8450s 8450s Similarly, when the user requires a certain source port, it can 8450s be specified using the ``source_port`` arg. 8450s 8450s .. versionchanged:: 4.5 8450s Added the ``source_ip`` and ``source_port`` arguments. 8450s 8450s .. versionchanged:: 5.0 8450s Added the ``timeout`` argument. 8450s """ 8450s if timeout is not None: 8450s if isinstance(timeout, numbers.Real): 8450s timeout = IOLoop.current().time() + timeout 8450s elif isinstance(timeout, datetime.timedelta): 8450s timeout = IOLoop.current().time() + timeout.total_seconds() 8450s else: 8450s raise TypeError("Unsupported timeout %r" % timeout) 8450s if timeout is not None: 8450s addrinfo = await gen.with_timeout( 8450s timeout, self.resolver.resolve(host, port, af) 8450s ) 8450s else: 8450s addrinfo = await self.resolver.resolve(host, port, af) 8450s connector = _Connector( 8450s addrinfo, 8450s functools.partial( 8450s self._create_stream, 8450s max_buffer_size, 8450s source_ip=source_ip, 8450s source_port=source_port, 8450s ), 8450s ) 8450s > af, addr, stream = await connector.start(connect_timeout=timeout) 8450s E asyncio.exceptions.CancelledError 8450s 8450s /usr/lib/python3/dist-packages/tornado/tcpclient.py:279: CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s self = 8450s 8450s @final 8450s async def start(self): 8450s async with self._startup_lock: 8450s if self.status == Status.failed: 8450s assert self.__startup_exc is not None 8450s raise self.__startup_exc 8450s elif self.status != Status.init: 8450s return self 8450s timeout = getattr(self, "death_timeout", None) 8450s 8450s async def _close_on_failure(exc: Exception) -> None: 8450s await self.close(reason=f"failure-to-start-{str(type(exc))}") 8450s self.status = Status.failed 8450s self.__startup_exc = exc 8450s 8450s try: 8450s > await wait_for(self.start_unsafe(), timeout=timeout) 8450s 8450s /usr/lib/python3/dist-packages/distributed/core.py:664: 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 8450s async with asyncio.timeout(timeout): 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s 8450s self = 8450s exc_type = 8450s exc_val = CancelledError(), exc_tb = 8450s 8450s async def __aexit__( 8450s self, 8450s exc_type: Optional[Type[BaseException]], 8450s exc_val: Optional[BaseException], 8450s exc_tb: Optional[TracebackType], 8450s ) -> Optional[bool]: 8450s assert self._state in (_State.ENTERED, _State.EXPIRING) 8450s 8450s if self._timeout_handler is not None: 8450s self._timeout_handler.cancel() 8450s self._timeout_handler = None 8450s 8450s if self._state is _State.EXPIRING: 8450s self._state = _State.EXPIRED 8450s 8450s if self._task.uncancel() <= self._cancelling and exc_type is not None: 8450s # Since there are no new cancel requests, we're 8450s # handling this. 8450s if issubclass(exc_type, exceptions.CancelledError): 8450s > raise TimeoutError from exc_val 8450s E TimeoutError 8450s 8450s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s @contextlib.asynccontextmanager 8450s async def _cluster_factory(): 8450s workers = [] 8450s s = None 8450s try: 8450s for _ in range(60): 8450s try: 8450s > s, ws = await start_cluster( 8450s nthreads, 8450s scheduler, 8450s security=security, 8450s Worker=Worker, 8450s scheduler_kwargs=scheduler_kwargs, 8450s worker_kwargs=merge( 8450s {"death_timeout": min(15, int(deadline.remaining))}, 8450s worker_kwargs, 8450s ), 8450s ) 8450s 8450s /usr/lib/python3/dist-packages/distributed/utils_test.py:966: 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s /usr/lib/python3/dist-packages/distributed/utils_test.py:789: in start_cluster 8450s await asyncio.gather(*workers) 8450s /usr/lib/python3.13/asyncio/tasks.py:737: in _wrap_awaitable 8450s return await awaitable 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s 8450s self = 8450s 8450s @final 8450s async def start(self): 8450s async with self._startup_lock: 8450s if self.status == Status.failed: 8450s assert self.__startup_exc is not None 8450s raise self.__startup_exc 8450s elif self.status != Status.init: 8450s return self 8450s timeout = getattr(self, "death_timeout", None) 8450s 8450s async def _close_on_failure(exc: Exception) -> None: 8450s await self.close(reason=f"failure-to-start-{str(type(exc))}") 8450s self.status = Status.failed 8450s self.__startup_exc = exc 8450s 8450s try: 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s except asyncio.TimeoutError as exc: 8450s await _close_on_failure(exc) 8450s > raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s E TimeoutError: Worker start timed out after 0s. 8450s 8450s /usr/lib/python3/dist-packages/distributed/core.py:667: TimeoutError 8450s 8450s During handling of the above exception, another exception occurred: 8450s 8450s fut = ._..test_func..async_fn at 0xe8325dc0> 8450s timeout = 60 8450s 8450s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 8450s async with asyncio.timeout(timeout): 8450s > return await fut 8450s 8450s /usr/lib/python3/dist-packages/distributed/utils.py:1960: 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s /usr/lib/python3/dist-packages/distributed/utils_test.py:999: in async_fn 8450s _cluster_factory() as (s, workers), 8450s /usr/lib/python3.13/contextlib.py:214: in __aenter__ 8450s return await anext(self.gen) 8450s /usr/lib/python3/dist-packages/distributed/utils_test.py:983: in _cluster_factory 8450s await asyncio.sleep(1) 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s 8450s delay = 1, result = None 8450s 8450s async def sleep(delay, result=None): 8450s """Coroutine that completes after a given time (in seconds).""" 8450s if delay <= 0: 8450s await __sleep0() 8450s return result 8450s 8450s if math.isnan(delay): 8450s raise ValueError("Invalid delay: NaN (not a number)") 8450s 8450s loop = events.get_running_loop() 8450s future = loop.create_future() 8450s h = loop.call_later(delay, 8450s futures._set_result_unless_cancelled, 8450s future, result) 8450s try: 8450s > return await future 8450s E asyncio.exceptions.CancelledError 8450s 8450s /usr/lib/python3.13/asyncio/tasks.py:718: CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s args = (), kwds = {} 8450s 8450s @wraps(func) 8450s def inner(*args, **kwds): 8450s with self._recreate_cm(): 8450s > return func(*args, **kwds) 8450s 8450s /usr/lib/python3.13/contextlib.py:85: 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s /usr/lib/python3.13/contextlib.py:85: in inner 8450s return func(*args, **kwds) 8450s /usr/lib/python3/dist-packages/distributed/utils_test.py:1102: in test_func 8450s return _run_and_close_tornado(async_fn_outer) 8450s /usr/lib/python3/dist-packages/distributed/utils_test.py:378: in _run_and_close_tornado 8450s return asyncio_run(inner_fn(), loop_factory=get_loop_factory()) 8450s /usr/lib/python3.13/asyncio/runners.py:194: in run 8450s return runner.run(main) 8450s /usr/lib/python3.13/asyncio/runners.py:118: in run 8450s return self._loop.run_until_complete(task) 8450s /usr/lib/python3.13/asyncio/base_events.py:720: in run_until_complete 8450s return future.result() 8450s /usr/lib/python3/dist-packages/distributed/utils_test.py:375: in inner_fn 8450s return await async_fn(*args, **kwargs) 8450s /usr/lib/python3/dist-packages/distributed/utils_test.py:1099: in async_fn_outer 8450s return await utils_wait_for(async_fn(), timeout=timeout * 2) 8450s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 8450s async with asyncio.timeout(timeout): 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s 8450s self = 8450s exc_type = 8450s exc_val = CancelledError(), exc_tb = 8450s 8450s async def __aexit__( 8450s self, 8450s exc_type: Optional[Type[BaseException]], 8450s exc_val: Optional[BaseException], 8450s exc_tb: Optional[TracebackType], 8450s ) -> Optional[bool]: 8450s assert self._state in (_State.ENTERED, _State.EXPIRING) 8450s 8450s if self._timeout_handler is not None: 8450s self._timeout_handler.cancel() 8450s self._timeout_handler = None 8450s 8450s if self._state is _State.EXPIRING: 8450s self._state = _State.EXPIRED 8450s 8450s if self._task.uncancel() <= self._cancelling and exc_type is not None: 8450s # Since there are no new cancel requests, we're 8450s # handling this. 8450s if issubclass(exc_type, exceptions.CancelledError): 8450s > raise TimeoutError from exc_val 8450s E TimeoutError 8450s 8450s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 8450s ----------------------------- Captured stderr call ----------------------------- 8450s 2024-11-23 22:45:44,924 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:45:44,933 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:44,933 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45913/status 8450s 2024-11-23 22:45:44,933 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:45:44,948 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40885 8450s 2024-11-23 22:45:44,948 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40885 8450s 2024-11-23 22:45:44,948 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:45:44,948 - distributed.worker - INFO - dashboard at: 127.0.0.1:34233 8450s 2024-11-23 22:45:44,948 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:44,948 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:45:44,948 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:45:44,948 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:45:44,948 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-51mm6eut 8450s 2024-11-23 22:45:44,948 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:45:44,950 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33099 8450s 2024-11-23 22:45:44,950 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33099 8450s 2024-11-23 22:45:44,950 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:45:44,950 - distributed.worker - INFO - dashboard at: 127.0.0.1:33751 8450s 2024-11-23 22:45:44,950 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:44,950 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:45:44,950 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:45:44,950 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:45:44,950 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-w4tmzds0 8450s 2024-11-23 22:45:44,950 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:45:44,962 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:44,962 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:44,963 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:38930': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:44,963 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:38940': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:45,074 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:45,075 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:45,075 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:38944': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:45,075 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:38958': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:45,187 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:45,187 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:45,188 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:38968': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:45,188 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:38976': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:45,299 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:45,300 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:45,300 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:38982': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:45,300 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:38984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:45,412 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:45,412 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:45,413 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:38992': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:45,413 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:39002': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:45,525 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:45,525 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:45,525 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:39014': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:45,525 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:39030': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:45,637 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:45,638 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:45,638 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:39046': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:45,638 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:39060': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:45,749 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:45,749 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:45,750 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:39076': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:45,750 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:39086': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:45,862 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:45,862 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:45,862 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:39092': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:45,863 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:39106': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:45,974 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:45,974 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:45,974 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:39114': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:45,975 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:39122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:46,087 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:46,087 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:46,087 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:39132': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:46,087 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:39136': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:46,199 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:46,199 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:46,199 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:39146': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:46,199 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:39150': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:46,311 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:46,311 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:46,312 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:39152': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:46,312 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:39154': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:46,423 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:46,424 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:46,424 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:39170': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:46,424 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:39182': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:46,536 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:46,536 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:46,537 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:39192': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:46,537 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:39202': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:46,648 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:46,649 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:46,649 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:39204': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:46,649 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:39218': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:46,761 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:46,761 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:46,761 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:39230': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:46,762 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:39238': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:46,874 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:46,874 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:46,874 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:39242': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:46,874 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:39256': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:46,988 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:46,989 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:46,989 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:39268': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:46,989 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:39272': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:47,101 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:47,101 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:47,101 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:39286': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:47,101 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:39296': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:47,213 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:47,213 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:47,213 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:39308': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:47,213 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:39322': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:47,325 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:47,326 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:47,326 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:39336': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:47,326 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:39346': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:47,438 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:47,438 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:47,442 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:39352': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:47,442 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:39366': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:47,550 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:47,550 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:47,551 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:39382': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:47,551 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:39394': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:47,663 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:47,663 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:47,664 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:39402': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:47,664 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:39410': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:47,775 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:47,775 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:47,775 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:39420': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:47,776 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:39428': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:47,887 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:47,888 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:47,888 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:39440': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:47,888 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:39452': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:47,999 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:48,000 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:48,000 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:39460': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:48,000 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:39476': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:48,112 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:48,112 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:48,112 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:39492': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:48,112 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:39496': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:48,223 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:48,224 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:48,224 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:39506': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:48,224 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:39522': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:48,336 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:48,336 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:48,337 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:39526': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:48,337 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:39532': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:48,450 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:48,450 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:48,451 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:39548': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:48,451 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:39558': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:48,564 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:48,564 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:48,564 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:39574': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:48,564 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:39576': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:48,676 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:48,677 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:48,677 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:39586': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:48,677 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:39598': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:48,789 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:48,790 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:48,790 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:39602': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:48,790 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:39616': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:48,902 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:48,902 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:48,902 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:39618': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:48,902 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:39634': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:49,014 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:49,015 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:49,015 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:39644': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:49,015 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:39646': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:49,127 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:49,127 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:49,127 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:39662': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:49,127 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:39664': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:49,238 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:49,239 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:49,239 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:39678': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:49,239 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:39688': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:49,350 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:49,350 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:49,350 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:39694': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:49,351 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:39700': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:49,462 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:49,462 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:49,463 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:39714': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:49,463 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:39724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:49,575 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:49,575 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:49,575 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:39740': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:49,575 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:39748': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:49,687 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:49,687 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:49,688 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:39756': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:49,688 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:39760': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:49,800 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:49,800 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:49,800 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:39774': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:49,800 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:39784': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:49,913 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:49,913 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:49,914 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:39796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:49,914 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:39808': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:50,025 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:50,025 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:50,026 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:39822': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:50,026 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:39824': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:50,137 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:50,138 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:50,138 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:39840': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:50,138 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:39850': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:50,249 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:50,249 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:50,249 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:39852': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:50,250 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:39860': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:50,362 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:50,362 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:50,363 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:39876': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:50,363 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:39890': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:50,474 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:50,475 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:50,475 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:39906': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:50,475 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:39908': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:50,587 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:50,588 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:50,588 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:39920': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:50,588 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:39924': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:50,699 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:50,699 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:50,700 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:39932': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:50,700 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:39948': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:50,812 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:50,812 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:50,812 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:39962': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:50,812 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:39974': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:50,924 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:50,924 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:50,925 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:39984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:50,925 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:39994': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:51,037 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:51,038 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:51,038 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:40008': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:51,038 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:40010': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:51,149 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:51,149 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:51,150 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:40014': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:51,150 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:40018': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:51,261 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:51,261 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:51,262 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:40032': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:51,262 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:40042': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:51,374 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:51,374 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:51,374 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:40052': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:51,374 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:40064': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:51,487 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:51,487 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:51,487 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:40076': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:51,488 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:40078': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:51,600 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:51,600 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:51,600 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:51322': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:51,600 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:51324': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:51,711 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:51,712 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:51,712 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:51338': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:51,712 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:51354': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:51,824 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:51,824 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:51,824 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:51360': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:51,825 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:51372': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:51,936 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:51,937 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:51,941 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:51384': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:51,941 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:51386': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:52,048 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:52,049 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:52,049 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:51400': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:52,049 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:51414': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:52,162 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:52,162 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:52,162 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:51430': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:52,162 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:51442': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:52,273 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:52,274 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:52,274 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:51452': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:52,274 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:51464': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:52,387 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:52,387 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:52,387 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:51466': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:52,388 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:51478': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:52,499 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:52,499 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:52,499 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:51486': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:52,499 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:51498': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:52,611 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:52,612 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:52,612 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:51506': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:52,612 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:51514': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:52,723 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:52,724 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:52,724 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:51530': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:52,724 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:51532': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:52,836 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:52,836 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:52,836 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:51538': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:52,836 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:51554': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:52,949 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:52,950 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:52,950 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:51564': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:52,950 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:51578': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:53,062 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:53,062 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:53,062 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:51586': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:53,062 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:51598': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:53,175 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:53,175 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:53,175 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:51614': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:53,175 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:51624': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:53,287 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:53,287 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:53,287 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:51626': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:53,287 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:51636': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:53,399 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:53,399 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:53,399 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:51644': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:53,400 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:51650': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:53,511 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:53,511 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:53,512 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:51652': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:53,512 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:51656': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:53,624 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:53,624 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:53,624 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:51660': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:53,624 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:51668': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:53,736 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:53,736 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:53,736 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:51672': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:53,736 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:51676': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:53,847 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:53,848 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:53,848 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:51682': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:53,848 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:51692': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:53,961 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:53,961 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:53,961 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:51698': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:53,961 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:51704': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:54,074 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:54,075 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:54,075 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:51714': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:54,075 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:51718': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:54,187 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:54,187 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:54,188 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:51720': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:54,188 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:51722': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:54,300 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:54,300 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:54,300 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:51724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:54,300 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:51726': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:54,412 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:54,412 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:54,413 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:51736': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:54,413 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:51738': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:54,524 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:54,525 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:54,525 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:51750': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:54,525 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:51752': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:54,637 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:54,637 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:54,638 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:51758': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:54,638 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:51768': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:54,749 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:54,749 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:54,749 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:51782': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:54,749 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:51796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:54,861 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:54,861 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:54,862 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:51798': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:54,862 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:51806': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:54,974 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:54,974 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:54,974 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:51822': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:54,974 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:51838': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:55,086 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:55,086 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:55,087 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:51848': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:55,087 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:51850': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:55,198 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:55,198 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:55,198 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:51858': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:55,198 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:51872': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:55,310 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:55,311 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:55,311 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:51888': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:55,311 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:51890': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:55,423 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:55,423 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:55,423 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:51892': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:55,424 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:51900': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:55,535 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:55,535 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:55,536 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:51912': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:55,536 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:51920': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:55,648 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:55,648 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:55,648 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:51932': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:55,648 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:51946': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:55,760 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:55,760 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:55,761 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:51952': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:55,761 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:51960': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:55,873 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:55,874 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:55,874 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:51976': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:55,874 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:51980': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:55,985 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:55,986 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:55,986 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:51982': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:55,986 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:51994': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:56,099 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:56,099 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:56,099 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:52010': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:56,099 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:52026': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:56,211 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:56,211 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:56,211 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:52038': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:56,211 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:52040': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:56,323 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:56,324 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:56,324 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:52054': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:56,324 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:52060': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:56,436 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:56,436 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:56,440 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:52064': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:56,440 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:52076': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:56,548 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:56,549 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:56,549 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:52088': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:56,549 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:52090': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:56,661 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:56,661 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:56,661 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:52106': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:56,662 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:52110': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:56,774 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:56,774 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:56,774 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:52122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:56,774 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:52132': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:56,886 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:56,886 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:56,887 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:52134': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:56,887 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:52136': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:56,998 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:56,998 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:56,999 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:52144': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:56,999 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:52154': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:57,111 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:57,111 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:57,111 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:52166': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:57,111 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:52174': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:57,222 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:57,223 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:57,223 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:52182': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:57,223 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:52198': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:57,335 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:57,335 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:57,335 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:52214': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:57,335 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:52224': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:57,449 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:57,449 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:57,450 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:52234': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:57,450 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:52246': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:57,562 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:57,562 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:57,563 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:52258': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:57,563 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:52262': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:57,676 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:57,676 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:57,676 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:52278': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:57,676 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:52282': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:57,788 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:57,789 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:57,789 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:52286': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:57,789 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:52300': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:57,901 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:57,901 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:57,901 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:52312': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:57,901 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:52322': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:58,014 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:58,014 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:58,014 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:52332': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:58,014 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:52348': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:58,126 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:58,126 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:58,126 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:52350': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:58,126 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:52360': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:58,238 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:58,239 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:58,239 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:52364': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:58,239 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:52372': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:58,350 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:58,350 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:58,350 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:52374': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:58,350 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:52388': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:58,462 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:58,462 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:58,462 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:52392': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:58,462 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:52396': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:58,575 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:58,575 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:58,575 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:52402': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:58,575 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:52416': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:58,687 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:58,687 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:58,688 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:52432': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:58,688 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:52448': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:58,799 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:58,800 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:58,800 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:52452': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:58,800 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:52468': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:58,912 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:58,912 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:58,912 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:52478': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:58,912 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:52480': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:59,024 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:59,024 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:59,025 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:52488': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:59,025 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:52494': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:59,136 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:59,137 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:59,137 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:52496': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:59,137 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:52506': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:59,248 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:59,249 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:59,249 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:52522': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:59,249 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:52538': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:59,361 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:59,361 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:59,362 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:52544': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:59,362 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:52550': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:59,473 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:59,473 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:59,474 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:52562': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:59,474 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:52576': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:59,586 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:59,586 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:59,586 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:52582': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:59,586 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:52590': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:59,698 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:59,698 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:59,698 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:52600': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:59,698 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:52608': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:59,810 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:59,810 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:59,811 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:52624': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:59,811 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:52632': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:59,923 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:59,923 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46833 8450s 2024-11-23 22:45:59,923 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:52640': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:59,923 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46833': TLS handshake failed with remote 'tls://127.0.0.1:52654': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:45:59,947 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40885. Reason: failure-to-start- 8450s 2024-11-23 22:45:59,947 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:45:59,949 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 15s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 8450s stream = await stream.start_tls( 8450s ^^^^^^^^^^^^^^^^^^^^^^^ 8450s False, ssl_options=ssl_options, server_hostname=host 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 8450s self.socket.do_handshake() 8450s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 8450s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 8450s self._sslobj.do_handshake() 8450s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 8450s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 8450s raise FatalCommClosedError( 8450s ...<2 lines>... 8450s ) from err 8450s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 8450s 8450s During handling of the above exception, another exception occurred: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1218, in _register_with_scheduler 8450s await asyncio.sleep(0.1) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 718, in sleep 8450s return await future 8450s ^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 15s. 8450s 2024-11-23 22:45:59,952 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33099. Reason: failure-to-start- 8450s 2024-11-23 22:45:59,952 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:46:00,955 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:46:00,963 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:00,963 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40909/status 8450s 2024-11-23 22:46:00,964 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:46:00,978 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36699 8450s 2024-11-23 22:46:00,978 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36699 8450s 2024-11-23 22:46:00,978 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:46:00,978 - distributed.worker - INFO - dashboard at: 127.0.0.1:43225 8450s 2024-11-23 22:46:00,978 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:00,978 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:46:00,978 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:46:00,978 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:46:00,978 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-33htv6nl 8450s 2024-11-23 22:46:00,978 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:46:00,981 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38539 8450s 2024-11-23 22:46:00,981 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38539 8450s 2024-11-23 22:46:00,981 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:46:00,981 - distributed.worker - INFO - dashboard at: 127.0.0.1:45475 8450s 2024-11-23 22:46:00,981 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:00,981 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:46:00,981 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:46:00,981 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:46:00,981 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-2tchkx6t 8450s 2024-11-23 22:46:00,981 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:46:00,993 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:00,993 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:00,993 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:42950': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:00,993 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:42954': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:01,105 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:01,105 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:01,105 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:42962': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:01,105 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:42968': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:01,217 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:01,217 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:01,217 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:42980': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:01,217 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:42994': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:01,328 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:01,329 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:01,329 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:43002': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:01,329 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:43006': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:01,440 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:01,441 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:01,445 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:43022': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:01,445 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:43024': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:01,552 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:01,553 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:01,553 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:35406': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:01,553 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:35410': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:01,665 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:01,665 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:01,666 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:35420': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:01,666 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:35426': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:01,778 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:01,778 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:01,778 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:35436': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:01,778 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:35438': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:01,890 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:01,891 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:01,891 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:35442': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:01,891 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:35444': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:02,002 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:02,002 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:02,002 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:35450': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:02,003 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:35452': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:02,113 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:02,114 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:02,114 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:35458': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:02,114 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:35474': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:02,225 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:02,226 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:02,226 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:35488': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:02,226 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:35504': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:02,338 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:02,338 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:02,339 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:35508': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:02,339 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:35514': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:02,450 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:02,451 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:02,451 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:35524': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:02,451 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:35526': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:02,563 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:02,563 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:02,564 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:35538': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:02,564 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:35546': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:02,675 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:02,675 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:02,675 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:35558': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:02,675 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:35568': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:02,788 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:02,788 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:02,788 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:35574': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:02,788 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:35586': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:02,899 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:02,899 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:02,900 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:35602': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:02,900 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:35614': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:03,011 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:03,012 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:03,012 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:35628': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:03,012 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:35644': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:03,123 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:03,123 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:03,123 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:35654': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:03,123 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:35658': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:03,236 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:03,236 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:03,237 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:35662': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:03,237 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:35676': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:03,348 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:03,348 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:03,349 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:35688': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:03,349 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:35698': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:03,460 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:03,461 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:03,461 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:35714': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:03,461 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:35716': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:03,573 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:03,573 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:03,573 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:35728': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:03,573 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:35732': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:03,686 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:03,686 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:03,686 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:35744': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:03,686 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:35756': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:03,798 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:03,798 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:03,798 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:35768': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:03,798 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:35776': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:03,909 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:03,910 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:03,910 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:35778': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:03,910 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:35792': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:04,021 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:04,021 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:04,022 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:35806': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:04,022 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:35818': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:04,133 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:04,133 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:04,133 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:35834': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:04,133 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:35850': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:04,245 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:04,246 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:04,246 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:35864': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:04,246 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:35880': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:04,358 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:04,359 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:04,359 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:35888': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:04,359 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:35894': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:04,471 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:04,471 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:04,475 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:35900': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:04,475 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:35912': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:04,583 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:04,584 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:04,584 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:35920': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:04,584 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:35928': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:04,695 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:04,695 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:04,696 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:35944': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:04,696 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:35952': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:04,807 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:04,807 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:04,808 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:35962': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:04,808 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:35972': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:04,919 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:04,919 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:04,920 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:35974': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:04,920 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:35980': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:05,031 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:05,031 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:05,032 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:35996': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:05,032 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:36000': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:05,144 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:05,144 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:05,145 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:36006': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:05,145 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:36022': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:05,256 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:05,256 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:05,257 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:36036': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:05,257 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:36044': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:05,369 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:05,369 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:05,369 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:36052': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:05,369 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:36058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:05,480 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:05,480 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:05,481 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:36060': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:05,481 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:36072': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:05,592 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:05,592 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:05,592 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:36078': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:05,592 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:36092': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:05,704 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:05,704 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:05,704 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:36106': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:05,705 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:36116': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:05,816 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:05,816 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:05,816 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:36124': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:05,816 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:36138': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:05,927 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:05,927 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:05,928 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:36140': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:05,928 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:36146': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:06,041 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:06,041 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:06,042 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:36150': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:06,043 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:36164': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:06,153 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:06,153 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:06,153 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:36178': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:06,153 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:36184': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:06,265 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:06,265 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:06,266 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:36192': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:06,266 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:36202': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:06,377 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:06,378 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:06,378 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:36210': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:06,378 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:36218': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:06,489 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:06,489 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:06,490 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:36224': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:06,490 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:36232': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:06,601 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:06,601 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:06,602 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:36234': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:06,602 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:36236': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:06,713 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:06,714 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:06,714 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:36238': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:06,714 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:36252': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:06,825 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:06,826 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:06,826 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:36258': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:06,826 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:36270': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:06,938 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:06,938 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:06,942 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:36278': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:06,942 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:36280': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:07,050 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:07,050 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:07,051 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:36284': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:07,051 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:36294': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:07,162 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:07,162 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:07,162 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:36306': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:07,162 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:36314': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:07,274 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:07,274 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:07,274 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:36320': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:07,274 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:36336': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:07,386 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:07,386 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:07,386 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:36340': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:07,386 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:36342': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:07,498 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:07,498 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:07,498 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:36350': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:07,498 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:36360': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:07,611 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:07,611 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:07,611 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:36372': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:07,611 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:36376': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:07,725 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:07,725 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:07,725 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:36384': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:07,725 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:36396': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:07,839 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:07,839 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:07,840 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:36406': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:07,840 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:36408': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:07,951 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:07,951 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:07,951 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:36410': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:07,951 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:36422': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:08,063 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:08,064 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:08,064 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:36434': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:08,064 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:36440': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:08,176 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:08,176 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:08,177 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:36450': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:08,177 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:36464': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:08,288 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:08,289 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:08,289 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:36476': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:08,289 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:36478': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:08,400 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:08,401 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:08,401 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:36488': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:08,401 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:36490': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:08,512 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:08,513 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:08,513 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:36506': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:08,513 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:36518': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:08,626 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:08,626 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:08,626 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:36534': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:08,626 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:36540': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:08,738 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:08,739 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:08,739 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:36546': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:08,739 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:36552': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:08,850 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:08,850 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:08,851 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:36554': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:08,851 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:36562': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:08,963 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:08,963 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:08,964 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:36572': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:08,964 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:36586': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:09,075 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:09,075 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:09,076 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:36590': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:09,076 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:36598': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:09,187 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:09,187 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:09,188 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:36610': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:09,188 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:36626': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:09,299 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:09,299 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:09,300 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:36642': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:09,300 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:36658': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:09,413 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:09,413 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:09,413 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:36670': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:09,413 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:36682': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:09,525 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:09,526 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:09,526 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:36690': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:09,526 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:36704': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:09,640 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:09,640 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:09,640 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:36718': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:09,640 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:36734': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:09,751 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:09,752 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:09,752 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:36744': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:09,752 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:36758': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:09,863 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:09,863 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:09,864 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:36760': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:09,864 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:36772': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:09,979 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:09,979 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:09,980 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:36784': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:09,980 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:36790': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:10,091 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:10,091 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:10,091 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:36792': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:10,092 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:36806': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:10,203 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:10,203 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:10,204 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:36812': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:10,204 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:36822': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:10,315 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:10,315 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:10,316 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:36828': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:10,316 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:36832': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:10,427 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:10,427 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:10,427 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:36836': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:10,427 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:36842': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:10,540 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:10,540 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:10,541 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:36844': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:10,541 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:36846': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:10,652 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:10,652 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:10,652 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:36862': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:10,653 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:36874': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:10,764 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:10,764 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:10,764 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:36890': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:10,765 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:36898': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:10,875 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:10,876 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:10,876 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:36912': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:10,876 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:36928': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:10,982 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:10,983 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:36934': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:10,987 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:10,988 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:36944': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:11,090 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:11,091 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:36946': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:11,096 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:11,097 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:36954': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:11,197 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:11,197 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:36964': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:11,203 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:11,203 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:36976': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:11,304 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:11,305 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:36986': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:11,310 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:11,311 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:36988': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:11,413 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:11,413 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:37000': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:11,419 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:11,419 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:37016': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:11,520 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:11,520 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:37026': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:11,526 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:11,526 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:37028': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:11,627 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:11,628 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:52530': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:11,633 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:11,634 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:52546': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:11,736 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:11,737 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:52556': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:11,742 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:11,742 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:52566': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:11,842 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:11,843 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:52576': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:11,848 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:11,849 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:52590': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:11,950 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:11,950 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:52604': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:11,955 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:11,956 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:52612': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:12,057 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:12,057 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:52628': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:12,063 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:12,063 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:52636': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:12,164 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:12,165 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:52650': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:12,170 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:12,170 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:52654': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:12,270 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:12,271 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:52660': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:12,276 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:12,277 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:52664': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:12,377 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:12,377 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:52678': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:12,383 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:12,383 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:52688': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:12,485 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:12,486 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:52692': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:12,491 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:12,491 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:52698': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:12,591 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:12,592 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:52702': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:12,597 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:12,598 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:52716': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:12,698 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:12,699 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:52724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:12,704 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:12,705 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:52736': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:12,805 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:12,805 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:52748': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:12,811 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:12,811 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:52754': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:12,913 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:12,913 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:52770': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:12,919 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:12,919 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:52786': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:13,020 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:13,021 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:52802': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:13,026 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:13,026 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:52818': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:13,127 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:13,127 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:52826': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:13,133 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:13,133 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:52836': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:13,235 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:13,236 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:52846': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:13,241 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:13,242 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:52852': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:13,342 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:13,342 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:52858': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:13,348 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:13,348 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:52866': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:13,449 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:13,450 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:52878': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:13,455 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:13,456 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:52890': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:13,556 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:13,557 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:52904': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:13,562 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:13,563 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:52914': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:13,664 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:13,664 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:52916': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:13,670 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:13,670 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:52922': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:13,770 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:13,771 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:52930': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:13,776 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:13,777 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:52936': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:13,878 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:13,878 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:52952': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:13,884 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43315 8450s 2024-11-23 22:46:13,884 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43315': TLS handshake failed with remote 'tls://127.0.0.1:52960': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:13,978 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36699. Reason: failure-to-start- 8450s 2024-11-23 22:46:13,978 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:46:13,979 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 13s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 8450s stream = await stream.start_tls( 8450s ^^^^^^^^^^^^^^^^^^^^^^^ 8450s False, ssl_options=ssl_options, server_hostname=host 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 8450s self.socket.do_handshake() 8450s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 8450s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 8450s self._sslobj.do_handshake() 8450s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 8450s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 8450s raise FatalCommClosedError( 8450s ...<2 lines>... 8450s ) from err 8450s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 8450s 8450s During handling of the above exception, another exception occurred: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1218, in _register_with_scheduler 8450s await asyncio.sleep(0.1) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 718, in sleep 8450s return await future 8450s ^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 13s. 8450s 2024-11-23 22:46:13,983 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38539. Reason: failure-to-start- 8450s 2024-11-23 22:46:13,983 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:46:14,985 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:46:14,993 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40743 8450s 2024-11-23 22:46:14,993 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34277/status 8450s 2024-11-23 22:46:14,993 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:46:15,009 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37921 8450s 2024-11-23 22:46:15,009 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37921 8450s 2024-11-23 22:46:15,009 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:46:15,009 - distributed.worker - INFO - dashboard at: 127.0.0.1:36753 8450s 2024-11-23 22:46:15,009 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40743 8450s 2024-11-23 22:46:15,009 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:46:15,009 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:46:15,009 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:46:15,009 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-oliex4is 8450s 2024-11-23 22:46:15,009 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:46:15,011 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35167 8450s 2024-11-23 22:46:15,011 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35167 8450s 2024-11-23 22:46:15,011 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:46:15,011 - distributed.worker - INFO - dashboard at: 127.0.0.1:44679 8450s 2024-11-23 22:46:15,011 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40743 8450s 2024-11-23 22:46:15,011 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:46:15,011 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:46:15,011 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:46:15,011 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-d7rjxwew 8450s 2024-11-23 22:46:15,011 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:46:15,012 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37921. Reason: failure-to-start- 8450s 2024-11-23 22:46:15,012 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:46:15,012 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35167. Reason: failure-to-start- 8450s 2024-11-23 22:46:15,012 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:46:15,013 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40743': TLS handshake failed with remote 'tls://127.0.0.1:40622': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:46:15,013 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40743': TLS handshake failed with remote 'tls://127.0.0.1:40630': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:46:15,015 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:46:16,021 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:46:16,028 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33025 8450s 2024-11-23 22:46:16,028 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37209/status 8450s 2024-11-23 22:46:16,029 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:46:16,043 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46851 8450s 2024-11-23 22:46:16,043 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46851 8450s 2024-11-23 22:46:16,043 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:46:16,043 - distributed.worker - INFO - dashboard at: 127.0.0.1:41407 8450s 2024-11-23 22:46:16,043 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33025 8450s 2024-11-23 22:46:16,043 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:46:16,043 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:46:16,043 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:46:16,043 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-g5hdt5pb 8450s 2024-11-23 22:46:16,043 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:46:16,045 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37533 8450s 2024-11-23 22:46:16,045 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37533 8450s 2024-11-23 22:46:16,045 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:46:16,045 - distributed.worker - INFO - dashboard at: 127.0.0.1:43989 8450s 2024-11-23 22:46:16,045 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33025 8450s 2024-11-23 22:46:16,045 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:46:16,046 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:46:16,046 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:46:16,046 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-0ak312aq 8450s 2024-11-23 22:46:16,046 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:46:16,047 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46851. Reason: failure-to-start- 8450s 2024-11-23 22:46:16,047 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:46:16,048 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37533. Reason: failure-to-start- 8450s 2024-11-23 22:46:16,048 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:46:16,049 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33025': TLS handshake failed with remote 'tls://127.0.0.1:46954': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:46:16,049 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33025': TLS handshake failed with remote 'tls://127.0.0.1:46958': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:46:16,050 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:46:17,055 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:46:17,064 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41283 8450s 2024-11-23 22:46:17,064 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45489/status 8450s 2024-11-23 22:46:17,064 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:46:17,078 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43827 8450s 2024-11-23 22:46:17,079 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43827 8450s 2024-11-23 22:46:17,079 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:46:17,079 - distributed.worker - INFO - dashboard at: 127.0.0.1:41265 8450s 2024-11-23 22:46:17,079 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41283 8450s 2024-11-23 22:46:17,079 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:46:17,079 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:46:17,079 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:46:17,079 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-gs3ovypl 8450s 2024-11-23 22:46:17,079 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:46:17,081 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39251 8450s 2024-11-23 22:46:17,081 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39251 8450s 2024-11-23 22:46:17,081 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:46:17,081 - distributed.worker - INFO - dashboard at: 127.0.0.1:46165 8450s 2024-11-23 22:46:17,081 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41283 8450s 2024-11-23 22:46:17,081 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:46:17,081 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:46:17,081 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:46:17,081 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-gbvbokv7 8450s 2024-11-23 22:46:17,081 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:46:17,082 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43827. Reason: failure-to-start- 8450s 2024-11-23 22:46:17,082 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:46:17,082 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39251. Reason: failure-to-start- 8450s 2024-11-23 22:46:17,082 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:46:17,083 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41283': TLS handshake failed with remote 'tls://127.0.0.1:48040': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:46:17,083 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41283': TLS handshake failed with remote 'tls://127.0.0.1:48048': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:46:17,084 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:46:18,090 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:46:18,098 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46185 8450s 2024-11-23 22:46:18,098 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45191/status 8450s 2024-11-23 22:46:18,099 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:46:18,113 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35513 8450s 2024-11-23 22:46:18,113 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35513 8450s 2024-11-23 22:46:18,113 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:46:18,113 - distributed.worker - INFO - dashboard at: 127.0.0.1:45711 8450s 2024-11-23 22:46:18,113 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46185 8450s 2024-11-23 22:46:18,113 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:46:18,113 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:46:18,113 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:46:18,113 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-zww8q7bl 8450s 2024-11-23 22:46:18,113 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:46:18,115 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45719 8450s 2024-11-23 22:46:18,115 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45719 8450s 2024-11-23 22:46:18,115 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:46:18,115 - distributed.worker - INFO - dashboard at: 127.0.0.1:44261 8450s 2024-11-23 22:46:18,115 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46185 8450s 2024-11-23 22:46:18,115 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:46:18,115 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:46:18,115 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:46:18,115 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-q2ix_hve 8450s 2024-11-23 22:46:18,115 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:46:18,116 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35513. Reason: failure-to-start- 8450s 2024-11-23 22:46:18,116 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:46:18,116 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45719. Reason: failure-to-start- 8450s 2024-11-23 22:46:18,117 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:46:18,117 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46185': TLS handshake failed with remote 'tls://127.0.0.1:45596': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:46:18,118 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46185': TLS handshake failed with remote 'tls://127.0.0.1:45604': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:46:18,119 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:46:19,124 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:46:19,133 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:32905 8450s 2024-11-23 22:46:19,133 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34197/status 8450s 2024-11-23 22:46:19,133 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:46:19,152 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45317 8450s 2024-11-23 22:46:19,153 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45317 8450s 2024-11-23 22:46:19,153 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:46:19,153 - distributed.worker - INFO - dashboard at: 127.0.0.1:39635 8450s 2024-11-23 22:46:19,153 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:32905 8450s 2024-11-23 22:46:19,153 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:46:19,153 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:46:19,153 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:46:19,153 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-7xp1e7rl 8450s 2024-11-23 22:46:19,153 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:46:19,155 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39307 8450s 2024-11-23 22:46:19,155 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39307 8450s 2024-11-23 22:46:19,155 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:46:19,155 - distributed.worker - INFO - dashboard at: 127.0.0.1:46007 8450s 2024-11-23 22:46:19,155 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:32905 8450s 2024-11-23 22:46:19,155 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:46:19,155 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:46:19,155 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:46:19,155 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-1tycrogc 8450s 2024-11-23 22:46:19,155 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:46:19,156 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45317. Reason: failure-to-start- 8450s 2024-11-23 22:46:19,156 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:46:19,156 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39307. Reason: failure-to-start- 8450s 2024-11-23 22:46:19,156 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:46:19,157 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:32905': TLS handshake failed with remote 'tls://127.0.0.1:34078': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:46:19,157 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:32905': TLS handshake failed with remote 'tls://127.0.0.1:34082': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:46:19,159 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:46:20,164 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:46:20,172 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41373 8450s 2024-11-23 22:46:20,172 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37853/status 8450s 2024-11-23 22:46:20,173 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:46:20,187 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34061 8450s 2024-11-23 22:46:20,187 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34061 8450s 2024-11-23 22:46:20,187 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:46:20,187 - distributed.worker - INFO - dashboard at: 127.0.0.1:32891 8450s 2024-11-23 22:46:20,187 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41373 8450s 2024-11-23 22:46:20,187 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:46:20,187 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:46:20,187 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:46:20,187 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-g84d84np 8450s 2024-11-23 22:46:20,187 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:46:20,189 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43923 8450s 2024-11-23 22:46:20,189 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43923 8450s 2024-11-23 22:46:20,189 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:46:20,189 - distributed.worker - INFO - dashboard at: 127.0.0.1:36223 8450s 2024-11-23 22:46:20,189 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41373 8450s 2024-11-23 22:46:20,189 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:46:20,189 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:46:20,190 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:46:20,190 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ui6logd4 8450s 2024-11-23 22:46:20,190 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:46:20,191 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34061. Reason: failure-to-start- 8450s 2024-11-23 22:46:20,191 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:46:20,192 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43923. Reason: failure-to-start- 8450s 2024-11-23 22:46:20,192 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:46:20,193 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41373': TLS handshake failed with remote 'tls://127.0.0.1:53926': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:46:20,193 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41373': TLS handshake failed with remote 'tls://127.0.0.1:53936': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:46:20,194 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:46:21,199 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:46:21,207 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35591 8450s 2024-11-23 22:46:21,207 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35145/status 8450s 2024-11-23 22:46:21,207 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:46:21,222 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34507 8450s 2024-11-23 22:46:21,222 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34507 8450s 2024-11-23 22:46:21,222 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:46:21,222 - distributed.worker - INFO - dashboard at: 127.0.0.1:36431 8450s 2024-11-23 22:46:21,222 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35591 8450s 2024-11-23 22:46:21,222 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:46:21,222 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:46:21,222 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:46:21,222 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-pkz_aqdl 8450s 2024-11-23 22:46:21,222 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:46:21,224 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37623 8450s 2024-11-23 22:46:21,224 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37623 8450s 2024-11-23 22:46:21,224 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:46:21,224 - distributed.worker - INFO - dashboard at: 127.0.0.1:40907 8450s 2024-11-23 22:46:21,224 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35591 8450s 2024-11-23 22:46:21,224 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:46:21,224 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:46:21,224 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:46:21,224 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-wqrg47v0 8450s 2024-11-23 22:46:21,224 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:46:21,225 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34507. Reason: failure-to-start- 8450s 2024-11-23 22:46:21,225 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:46:21,226 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37623. Reason: failure-to-start- 8450s 2024-11-23 22:46:21,226 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:46:21,227 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35591': TLS handshake failed with remote 'tls://127.0.0.1:33378': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:46:21,227 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35591': TLS handshake failed with remote 'tls://127.0.0.1:33382': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:46:21,228 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:46:22,233 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:46:22,242 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37661 8450s 2024-11-23 22:46:22,243 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44853/status 8450s 2024-11-23 22:46:22,243 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:46:22,258 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33047 8450s 2024-11-23 22:46:22,258 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33047 8450s 2024-11-23 22:46:22,258 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:46:22,258 - distributed.worker - INFO - dashboard at: 127.0.0.1:40859 8450s 2024-11-23 22:46:22,258 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37661 8450s 2024-11-23 22:46:22,258 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:46:22,258 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:46:22,259 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:46:22,259 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ln7mih3h 8450s 2024-11-23 22:46:22,259 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:46:22,260 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41589 8450s 2024-11-23 22:46:22,260 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41589 8450s 2024-11-23 22:46:22,260 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:46:22,260 - distributed.worker - INFO - dashboard at: 127.0.0.1:36707 8450s 2024-11-23 22:46:22,260 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37661 8450s 2024-11-23 22:46:22,261 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:46:22,261 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:46:22,261 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:46:22,261 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ztge_plo 8450s 2024-11-23 22:46:22,261 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:46:22,262 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33047. Reason: failure-to-start- 8450s 2024-11-23 22:46:22,262 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:46:22,262 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41589. Reason: failure-to-start- 8450s 2024-11-23 22:46:22,262 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:46:22,263 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37661': TLS handshake failed with remote 'tls://127.0.0.1:34148': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:46:22,263 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37661': TLS handshake failed with remote 'tls://127.0.0.1:34152': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:46:22,264 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:46:23,269 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:46:23,277 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42161 8450s 2024-11-23 22:46:23,278 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33927/status 8450s 2024-11-23 22:46:23,278 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:46:23,294 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36575 8450s 2024-11-23 22:46:23,294 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36575 8450s 2024-11-23 22:46:23,294 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:46:23,294 - distributed.worker - INFO - dashboard at: 127.0.0.1:40673 8450s 2024-11-23 22:46:23,295 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42161 8450s 2024-11-23 22:46:23,295 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:46:23,295 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:46:23,295 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:46:23,295 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-6buauxev 8450s 2024-11-23 22:46:23,295 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:46:23,297 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44199 8450s 2024-11-23 22:46:23,297 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44199 8450s 2024-11-23 22:46:23,297 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:46:23,297 - distributed.worker - INFO - dashboard at: 127.0.0.1:40919 8450s 2024-11-23 22:46:23,297 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42161 8450s 2024-11-23 22:46:23,297 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:46:23,297 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:46:23,297 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:46:23,297 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-wjj_4zg1 8450s 2024-11-23 22:46:23,297 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:46:23,298 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36575. Reason: failure-to-start- 8450s 2024-11-23 22:46:23,298 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:46:23,299 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44199. Reason: failure-to-start- 8450s 2024-11-23 22:46:23,299 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:46:23,300 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42161': TLS handshake failed with remote 'tls://127.0.0.1:57744': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:46:23,300 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42161': TLS handshake failed with remote 'tls://127.0.0.1:57750': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:46:23,302 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:46:24,307 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:46:24,316 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43085 8450s 2024-11-23 22:46:24,316 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43153/status 8450s 2024-11-23 22:46:24,316 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:46:24,332 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42229 8450s 2024-11-23 22:46:24,332 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42229 8450s 2024-11-23 22:46:24,332 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:46:24,332 - distributed.worker - INFO - dashboard at: 127.0.0.1:41387 8450s 2024-11-23 22:46:24,332 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43085 8450s 2024-11-23 22:46:24,332 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:46:24,332 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:46:24,332 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:46:24,332 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-j6b43gdb 8450s 2024-11-23 22:46:24,332 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:46:24,334 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41621 8450s 2024-11-23 22:46:24,334 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41621 8450s 2024-11-23 22:46:24,334 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:46:24,334 - distributed.worker - INFO - dashboard at: 127.0.0.1:35365 8450s 2024-11-23 22:46:24,334 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43085 8450s 2024-11-23 22:46:24,334 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:46:24,334 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:46:24,334 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:46:24,335 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-7a22isdd 8450s 2024-11-23 22:46:24,335 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:46:24,336 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42229. Reason: failure-to-start- 8450s 2024-11-23 22:46:24,336 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:46:24,337 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41621. Reason: failure-to-start- 8450s 2024-11-23 22:46:24,337 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:46:24,338 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43085': TLS handshake failed with remote 'tls://127.0.0.1:45046': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:46:24,338 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43085': TLS handshake failed with remote 'tls://127.0.0.1:45058': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:46:24,339 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:46:25,345 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:46:25,354 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34559 8450s 2024-11-23 22:46:25,354 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38355/status 8450s 2024-11-23 22:46:25,355 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:46:25,370 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41737 8450s 2024-11-23 22:46:25,371 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41737 8450s 2024-11-23 22:46:25,371 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:46:25,371 - distributed.worker - INFO - dashboard at: 127.0.0.1:33607 8450s 2024-11-23 22:46:25,371 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34559 8450s 2024-11-23 22:46:25,371 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:46:25,371 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:46:25,371 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:46:25,371 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-hz0yf3uc 8450s 2024-11-23 22:46:25,371 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:46:25,373 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35541 8450s 2024-11-23 22:46:25,373 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35541 8450s 2024-11-23 22:46:25,373 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:46:25,373 - distributed.worker - INFO - dashboard at: 127.0.0.1:35451 8450s 2024-11-23 22:46:25,373 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34559 8450s 2024-11-23 22:46:25,373 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:46:25,373 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:46:25,373 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:46:25,373 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-p9frrdw7 8450s 2024-11-23 22:46:25,373 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:46:25,374 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41737. Reason: failure-to-start- 8450s 2024-11-23 22:46:25,374 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:46:25,375 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35541. Reason: failure-to-start- 8450s 2024-11-23 22:46:25,375 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:46:25,376 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34559': TLS handshake failed with remote 'tls://127.0.0.1:39802': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:46:25,376 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34559': TLS handshake failed with remote 'tls://127.0.0.1:39806': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:46:25,377 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:46:26,382 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:46:26,392 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38323 8450s 2024-11-23 22:46:26,392 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38379/status 8450s 2024-11-23 22:46:26,393 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:46:26,408 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37825 8450s 2024-11-23 22:46:26,408 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37825 8450s 2024-11-23 22:46:26,408 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:46:26,408 - distributed.worker - INFO - dashboard at: 127.0.0.1:45695 8450s 2024-11-23 22:46:26,408 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38323 8450s 2024-11-23 22:46:26,409 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:46:26,409 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:46:26,409 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:46:26,409 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-r6zt98k6 8450s 2024-11-23 22:46:26,409 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:46:26,410 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45537 8450s 2024-11-23 22:46:26,411 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45537 8450s 2024-11-23 22:46:26,411 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:46:26,411 - distributed.worker - INFO - dashboard at: 127.0.0.1:38623 8450s 2024-11-23 22:46:26,411 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38323 8450s 2024-11-23 22:46:26,411 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:46:26,411 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:46:26,411 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:46:26,411 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-4ql4b57d 8450s 2024-11-23 22:46:26,411 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:46:26,412 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37825. Reason: failure-to-start- 8450s 2024-11-23 22:46:26,412 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:46:26,412 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45537. Reason: failure-to-start- 8450s 2024-11-23 22:46:26,413 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:46:26,414 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38323': TLS handshake failed with remote 'tls://127.0.0.1:45564': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:46:26,414 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38323': TLS handshake failed with remote 'tls://127.0.0.1:45574': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:46:26,415 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:46:27,420 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:46:27,429 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33447 8450s 2024-11-23 22:46:27,429 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35375/status 8450s 2024-11-23 22:46:27,429 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:46:27,447 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42689 8450s 2024-11-23 22:46:27,447 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42689 8450s 2024-11-23 22:46:27,447 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:46:27,447 - distributed.worker - INFO - dashboard at: 127.0.0.1:38391 8450s 2024-11-23 22:46:27,447 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33447 8450s 2024-11-23 22:46:27,447 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:46:27,447 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:46:27,447 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:46:27,447 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-3sgd86bm 8450s 2024-11-23 22:46:27,447 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:46:27,449 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41623 8450s 2024-11-23 22:46:27,449 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41623 8450s 2024-11-23 22:46:27,449 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:46:27,449 - distributed.worker - INFO - dashboard at: 127.0.0.1:32871 8450s 2024-11-23 22:46:27,449 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33447 8450s 2024-11-23 22:46:27,450 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:46:27,450 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:46:27,450 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:46:27,450 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-radiie5h 8450s 2024-11-23 22:46:27,450 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:46:27,453 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42689. Reason: failure-to-start- 8450s 2024-11-23 22:46:27,453 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:46:27,454 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41623. Reason: failure-to-start- 8450s 2024-11-23 22:46:27,454 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:46:27,455 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33447': TLS handshake failed with remote 'tls://127.0.0.1:50684': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:46:27,455 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33447': TLS handshake failed with remote 'tls://127.0.0.1:50690': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:46:27,457 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:46:28,462 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:46:28,470 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39601 8450s 2024-11-23 22:46:28,471 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46221/status 8450s 2024-11-23 22:46:28,471 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:46:28,490 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34969 8450s 2024-11-23 22:46:28,490 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34969 8450s 2024-11-23 22:46:28,490 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:46:28,490 - distributed.worker - INFO - dashboard at: 127.0.0.1:39821 8450s 2024-11-23 22:46:28,490 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39601 8450s 2024-11-23 22:46:28,490 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:46:28,490 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:46:28,490 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:46:28,490 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-1oat71ni 8450s 2024-11-23 22:46:28,490 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:46:28,493 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36951 8450s 2024-11-23 22:46:28,493 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36951 8450s 2024-11-23 22:46:28,493 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:46:28,493 - distributed.worker - INFO - dashboard at: 127.0.0.1:45095 8450s 2024-11-23 22:46:28,493 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39601 8450s 2024-11-23 22:46:28,493 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:46:28,493 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:46:28,493 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:46:28,493 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-0dgmacyl 8450s 2024-11-23 22:46:28,493 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:46:28,495 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34969. Reason: failure-to-start- 8450s 2024-11-23 22:46:28,495 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:46:28,495 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36951. Reason: failure-to-start- 8450s 2024-11-23 22:46:28,495 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:46:28,499 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39601': TLS handshake failed with remote 'tls://127.0.0.1:56720': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:46:28,499 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39601': TLS handshake failed with remote 'tls://127.0.0.1:56726': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:46:28,500 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:46:29,505 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:46:29,514 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34875 8450s 2024-11-23 22:46:29,514 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41165/status 8450s 2024-11-23 22:46:29,514 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:46:29,531 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38975 8450s 2024-11-23 22:46:29,531 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38975 8450s 2024-11-23 22:46:29,531 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:46:29,531 - distributed.worker - INFO - dashboard at: 127.0.0.1:42401 8450s 2024-11-23 22:46:29,531 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34875 8450s 2024-11-23 22:46:29,531 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:46:29,531 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:46:29,531 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:46:29,531 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-iq6cqj7b 8450s 2024-11-23 22:46:29,531 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:46:29,533 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35191 8450s 2024-11-23 22:46:29,533 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35191 8450s 2024-11-23 22:46:29,533 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:46:29,533 - distributed.worker - INFO - dashboard at: 127.0.0.1:41839 8450s 2024-11-23 22:46:29,534 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34875 8450s 2024-11-23 22:46:29,534 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:46:29,534 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:46:29,534 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:46:29,534 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-p45lo6gd 8450s 2024-11-23 22:46:29,534 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:46:29,537 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38975. Reason: failure-to-start- 8450s 2024-11-23 22:46:29,538 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:46:29,539 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35191. Reason: failure-to-start- 8450s 2024-11-23 22:46:29,539 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:46:29,540 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34875': TLS handshake failed with remote 'tls://127.0.0.1:35258': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:46:29,540 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34875': TLS handshake failed with remote 'tls://127.0.0.1:35272': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:46:29,541 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:46:30,546 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:46:30,555 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33011 8450s 2024-11-23 22:46:30,556 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40965/status 8450s 2024-11-23 22:46:30,556 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:46:30,572 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33759 8450s 2024-11-23 22:46:30,572 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33759 8450s 2024-11-23 22:46:30,572 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:46:30,572 - distributed.worker - INFO - dashboard at: 127.0.0.1:43375 8450s 2024-11-23 22:46:30,572 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33011 8450s 2024-11-23 22:46:30,572 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:46:30,573 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:46:30,573 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:46:30,573 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-lzwjtnfr 8450s 2024-11-23 22:46:30,573 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:46:30,575 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39333 8450s 2024-11-23 22:46:30,575 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39333 8450s 2024-11-23 22:46:30,575 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:46:30,575 - distributed.worker - INFO - dashboard at: 127.0.0.1:42383 8450s 2024-11-23 22:46:30,575 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33011 8450s 2024-11-23 22:46:30,575 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:46:30,575 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:46:30,575 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:46:30,575 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-a_cy6pt0 8450s 2024-11-23 22:46:30,575 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:46:30,579 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33759. Reason: failure-to-start- 8450s 2024-11-23 22:46:30,579 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:46:30,579 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39333. Reason: failure-to-start- 8450s 2024-11-23 22:46:30,580 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:46:30,581 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33011': TLS handshake failed with remote 'tls://127.0.0.1:40482': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:46:30,581 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33011': TLS handshake failed with remote 'tls://127.0.0.1:40490': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:46:30,582 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:46:31,588 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:46:31,597 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39431 8450s 2024-11-23 22:46:31,597 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41333/status 8450s 2024-11-23 22:46:31,598 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:46:31,613 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38545 8450s 2024-11-23 22:46:31,613 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38545 8450s 2024-11-23 22:46:31,613 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:46:31,613 - distributed.worker - INFO - dashboard at: 127.0.0.1:38235 8450s 2024-11-23 22:46:31,613 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39431 8450s 2024-11-23 22:46:31,613 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:46:31,613 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:46:31,613 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:46:31,614 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-koevatyc 8450s 2024-11-23 22:46:31,614 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:46:31,615 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38517 8450s 2024-11-23 22:46:31,616 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38517 8450s 2024-11-23 22:46:31,616 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:46:31,616 - distributed.worker - INFO - dashboard at: 127.0.0.1:40101 8450s 2024-11-23 22:46:31,616 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39431 8450s 2024-11-23 22:46:31,616 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:46:31,616 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:46:31,616 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:46:31,616 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-430u5675 8450s 2024-11-23 22:46:31,616 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:46:31,620 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38545. Reason: failure-to-start- 8450s 2024-11-23 22:46:31,620 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:46:31,620 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38517. Reason: failure-to-start- 8450s 2024-11-23 22:46:31,620 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:46:31,622 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39431': TLS handshake failed with remote 'tls://127.0.0.1:39990': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:46:31,622 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39431': TLS handshake failed with remote 'tls://127.0.0.1:39998': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:46:31,623 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:46:32,629 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:46:32,638 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46007 8450s 2024-11-23 22:46:32,638 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44309/status 8450s 2024-11-23 22:46:32,639 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:46:32,656 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40881 8450s 2024-11-23 22:46:32,656 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40881 8450s 2024-11-23 22:46:32,656 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:46:32,657 - distributed.worker - INFO - dashboard at: 127.0.0.1:34211 8450s 2024-11-23 22:46:32,657 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46007 8450s 2024-11-23 22:46:32,657 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:46:32,657 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:46:32,657 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:46:32,657 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-axlt8x6a 8450s 2024-11-23 22:46:32,657 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:46:32,658 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44115 8450s 2024-11-23 22:46:32,659 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44115 8450s 2024-11-23 22:46:32,659 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:46:32,659 - distributed.worker - INFO - dashboard at: 127.0.0.1:45487 8450s 2024-11-23 22:46:32,659 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46007 8450s 2024-11-23 22:46:32,659 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:46:32,659 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:46:32,659 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:46:32,659 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-cht0dmcl 8450s 2024-11-23 22:46:32,659 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:46:32,660 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40881. Reason: failure-to-start- 8450s 2024-11-23 22:46:32,660 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:46:32,660 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44115. Reason: failure-to-start- 8450s 2024-11-23 22:46:32,660 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:46:32,662 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46007': TLS handshake failed with remote 'tls://127.0.0.1:47306': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:46:32,662 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46007': TLS handshake failed with remote 'tls://127.0.0.1:47310': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:46:32,663 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:46:33,668 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:46:33,676 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34727 8450s 2024-11-23 22:46:33,676 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39079/status 8450s 2024-11-23 22:46:33,676 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:46:33,692 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42407 8450s 2024-11-23 22:46:33,692 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42407 8450s 2024-11-23 22:46:33,693 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:46:33,693 - distributed.worker - INFO - dashboard at: 127.0.0.1:43757 8450s 2024-11-23 22:46:33,693 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34727 8450s 2024-11-23 22:46:33,693 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:46:33,693 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:46:33,693 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:46:33,693 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-dzm_rnrp 8450s 2024-11-23 22:46:33,693 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:46:33,695 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46429 8450s 2024-11-23 22:46:33,696 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46429 8450s 2024-11-23 22:46:33,696 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:46:33,696 - distributed.worker - INFO - dashboard at: 127.0.0.1:40891 8450s 2024-11-23 22:46:33,696 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34727 8450s 2024-11-23 22:46:33,696 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:46:33,696 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:46:33,696 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:46:33,696 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-pf28o1cc 8450s 2024-11-23 22:46:33,696 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:46:33,697 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42407. Reason: failure-to-start- 8450s 2024-11-23 22:46:33,697 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:46:33,698 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46429. Reason: failure-to-start- 8450s 2024-11-23 22:46:33,698 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:46:33,699 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34727': TLS handshake failed with remote 'tls://127.0.0.1:43688': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:46:33,699 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34727': TLS handshake failed with remote 'tls://127.0.0.1:43702': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:46:33,701 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:46:34,706 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:46:34,713 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33557 8450s 2024-11-23 22:46:34,714 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34385/status 8450s 2024-11-23 22:46:34,714 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:46:34,731 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41429 8450s 2024-11-23 22:46:34,731 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41429 8450s 2024-11-23 22:46:34,731 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:46:34,731 - distributed.worker - INFO - dashboard at: 127.0.0.1:35433 8450s 2024-11-23 22:46:34,731 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33557 8450s 2024-11-23 22:46:34,731 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:46:34,731 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:46:34,731 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:46:34,732 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-h82ieooo 8450s 2024-11-23 22:46:34,732 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:46:34,733 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33791 8450s 2024-11-23 22:46:34,733 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33791 8450s 2024-11-23 22:46:34,734 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:46:34,734 - distributed.worker - INFO - dashboard at: 127.0.0.1:40151 8450s 2024-11-23 22:46:34,734 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33557 8450s 2024-11-23 22:46:34,734 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:46:34,734 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:46:34,734 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:46:34,734 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-u9blvomj 8450s 2024-11-23 22:46:34,734 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:46:34,735 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41429. Reason: failure-to-start- 8450s 2024-11-23 22:46:34,735 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:46:34,736 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33791. Reason: failure-to-start- 8450s 2024-11-23 22:46:34,736 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:46:34,737 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33557': TLS handshake failed with remote 'tls://127.0.0.1:47846': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:46:34,737 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33557': TLS handshake failed with remote 'tls://127.0.0.1:47856': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:46:34,738 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:46:35,753 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:46:35,761 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40265 8450s 2024-11-23 22:46:35,762 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40201/status 8450s 2024-11-23 22:46:35,762 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:46:35,780 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39825 8450s 2024-11-23 22:46:35,780 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39825 8450s 2024-11-23 22:46:35,780 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:46:35,780 - distributed.worker - INFO - dashboard at: 127.0.0.1:46811 8450s 2024-11-23 22:46:35,780 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40265 8450s 2024-11-23 22:46:35,780 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:46:35,780 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:46:35,780 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:46:35,780 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-2bmg6tqc 8450s 2024-11-23 22:46:35,780 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:46:35,782 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46347 8450s 2024-11-23 22:46:35,782 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46347 8450s 2024-11-23 22:46:35,782 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:46:35,782 - distributed.worker - INFO - dashboard at: 127.0.0.1:46129 8450s 2024-11-23 22:46:35,782 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40265 8450s 2024-11-23 22:46:35,782 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:46:35,782 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:46:35,782 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:46:35,782 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-i8lxgo32 8450s 2024-11-23 22:46:35,782 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:46:35,784 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39825. Reason: failure-to-start- 8450s 2024-11-23 22:46:35,784 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:46:35,784 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46347. Reason: failure-to-start- 8450s 2024-11-23 22:46:35,784 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:46:35,788 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40265': TLS handshake failed with remote 'tls://127.0.0.1:33960': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:46:35,788 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40265': TLS handshake failed with remote 'tls://127.0.0.1:33970': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:46:35,790 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:46:36,795 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:46:36,804 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40991 8450s 2024-11-23 22:46:36,804 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45893/status 8450s 2024-11-23 22:46:36,805 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:46:36,821 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43385 8450s 2024-11-23 22:46:36,821 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43385 8450s 2024-11-23 22:46:36,821 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:46:36,821 - distributed.worker - INFO - dashboard at: 127.0.0.1:44341 8450s 2024-11-23 22:46:36,821 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40991 8450s 2024-11-23 22:46:36,821 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:46:36,821 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:46:36,821 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:46:36,821 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-n390jjtu 8450s 2024-11-23 22:46:36,821 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:46:36,823 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41593 8450s 2024-11-23 22:46:36,823 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41593 8450s 2024-11-23 22:46:36,823 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:46:36,823 - distributed.worker - INFO - dashboard at: 127.0.0.1:33537 8450s 2024-11-23 22:46:36,823 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40991 8450s 2024-11-23 22:46:36,823 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:46:36,823 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:46:36,823 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:46:36,823 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-t06x7l3r 8450s 2024-11-23 22:46:36,824 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:46:36,828 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43385. Reason: failure-to-start- 8450s 2024-11-23 22:46:36,828 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:46:36,828 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41593. Reason: failure-to-start- 8450s 2024-11-23 22:46:36,828 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:46:36,829 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40991': TLS handshake failed with remote 'tls://127.0.0.1:39684': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:46:36,829 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40991': TLS handshake failed with remote 'tls://127.0.0.1:39700': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:46:36,831 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:46:37,836 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:46:37,844 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44995 8450s 2024-11-23 22:46:37,844 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36801/status 8450s 2024-11-23 22:46:37,845 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:46:37,859 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38799 8450s 2024-11-23 22:46:37,859 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38799 8450s 2024-11-23 22:46:37,859 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:46:37,859 - distributed.worker - INFO - dashboard at: 127.0.0.1:34583 8450s 2024-11-23 22:46:37,859 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44995 8450s 2024-11-23 22:46:37,859 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:46:37,859 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:46:37,860 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:46:37,860 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-wtqpo8k7 8450s 2024-11-23 22:46:37,860 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:46:37,861 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39399 8450s 2024-11-23 22:46:37,861 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39399 8450s 2024-11-23 22:46:37,861 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:46:37,861 - distributed.worker - INFO - dashboard at: 127.0.0.1:44765 8450s 2024-11-23 22:46:37,861 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44995 8450s 2024-11-23 22:46:37,862 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:46:37,862 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:46:37,862 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:46:37,862 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-9ymxwyuw 8450s 2024-11-23 22:46:37,862 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:46:37,866 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38799. Reason: failure-to-start- 8450s 2024-11-23 22:46:37,866 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:46:37,866 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39399. Reason: failure-to-start- 8450s 2024-11-23 22:46:37,867 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:46:37,868 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44995': TLS handshake failed with remote 'tls://127.0.0.1:41640': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:46:37,868 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44995': TLS handshake failed with remote 'tls://127.0.0.1:41656': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:46:37,869 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:46:38,874 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:46:38,882 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38933 8450s 2024-11-23 22:46:38,883 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36907/status 8450s 2024-11-23 22:46:38,883 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:46:38,899 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41085 8450s 2024-11-23 22:46:38,899 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41085 8450s 2024-11-23 22:46:38,899 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:46:38,899 - distributed.worker - INFO - dashboard at: 127.0.0.1:42317 8450s 2024-11-23 22:46:38,899 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38933 8450s 2024-11-23 22:46:38,899 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:46:38,899 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:46:38,899 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:46:38,900 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ttdg7hjn 8450s 2024-11-23 22:46:38,900 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:46:38,901 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43445 8450s 2024-11-23 22:46:38,901 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43445 8450s 2024-11-23 22:46:38,902 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:46:38,902 - distributed.worker - INFO - dashboard at: 127.0.0.1:35645 8450s 2024-11-23 22:46:38,902 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38933 8450s 2024-11-23 22:46:38,902 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:46:38,902 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:46:38,902 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:46:38,902 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-i4v1qt7x 8450s 2024-11-23 22:46:38,902 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:46:38,905 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41085. Reason: failure-to-start- 8450s 2024-11-23 22:46:38,905 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:46:38,906 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43445. Reason: failure-to-start- 8450s 2024-11-23 22:46:38,906 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:46:38,907 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38933': TLS handshake failed with remote 'tls://127.0.0.1:39840': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:46:38,907 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38933': TLS handshake failed with remote 'tls://127.0.0.1:39842': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:46:38,909 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:46:39,914 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:46:39,923 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41033 8450s 2024-11-23 22:46:39,923 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37113/status 8450s 2024-11-23 22:46:39,923 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:46:39,940 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:32873 8450s 2024-11-23 22:46:39,940 - distributed.worker - INFO - Listening to: tls://127.0.0.1:32873 8450s 2024-11-23 22:46:39,940 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:46:39,940 - distributed.worker - INFO - dashboard at: 127.0.0.1:39499 8450s 2024-11-23 22:46:39,940 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41033 8450s 2024-11-23 22:46:39,940 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:46:39,940 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:46:39,940 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:46:39,941 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-38mlj45m 8450s 2024-11-23 22:46:39,941 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:46:39,942 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37041 8450s 2024-11-23 22:46:39,942 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37041 8450s 2024-11-23 22:46:39,942 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:46:39,943 - distributed.worker - INFO - dashboard at: 127.0.0.1:46263 8450s 2024-11-23 22:46:39,943 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41033 8450s 2024-11-23 22:46:39,943 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:46:39,943 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:46:39,943 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:46:39,943 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-591voh55 8450s 2024-11-23 22:46:39,943 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:46:39,949 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:32873. Reason: failure-to-start- 8450s 2024-11-23 22:46:39,949 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:46:39,949 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37041. Reason: failure-to-start- 8450s 2024-11-23 22:46:39,950 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:46:39,951 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41033': TLS handshake failed with remote 'tls://127.0.0.1:58224': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:46:39,951 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41033': TLS handshake failed with remote 'tls://127.0.0.1:58238': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:46:39,952 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:46:40,958 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:46:40,966 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37135 8450s 2024-11-23 22:46:40,966 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42129/status 8450s 2024-11-23 22:46:40,967 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:46:40,986 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36507 8450s 2024-11-23 22:46:40,986 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36507 8450s 2024-11-23 22:46:40,986 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:46:40,986 - distributed.worker - INFO - dashboard at: 127.0.0.1:39743 8450s 2024-11-23 22:46:40,986 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37135 8450s 2024-11-23 22:46:40,986 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:46:40,986 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:46:40,986 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:46:40,986 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-1nximvvk 8450s 2024-11-23 22:46:40,986 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:46:40,988 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33383 8450s 2024-11-23 22:46:40,988 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33383 8450s 2024-11-23 22:46:40,988 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:46:40,988 - distributed.worker - INFO - dashboard at: 127.0.0.1:33827 8450s 2024-11-23 22:46:40,988 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37135 8450s 2024-11-23 22:46:40,988 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:46:40,988 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:46:40,988 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:46:40,988 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-qblatn9j 8450s 2024-11-23 22:46:40,988 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:46:40,992 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36507. Reason: failure-to-start- 8450s 2024-11-23 22:46:40,992 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:46:40,992 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33383. Reason: failure-to-start- 8450s 2024-11-23 22:46:40,993 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:46:40,994 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37135': TLS handshake failed with remote 'tls://127.0.0.1:41840': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:46:40,994 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37135': TLS handshake failed with remote 'tls://127.0.0.1:41850': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:46:40,998 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:46:42,003 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:46:42,011 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44495 8450s 2024-11-23 22:46:42,011 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39619/status 8450s 2024-11-23 22:46:42,011 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:46:42,027 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41975 8450s 2024-11-23 22:46:42,028 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41975 8450s 2024-11-23 22:46:42,028 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:46:42,028 - distributed.worker - INFO - dashboard at: 127.0.0.1:36969 8450s 2024-11-23 22:46:42,028 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44495 8450s 2024-11-23 22:46:42,028 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:46:42,028 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:46:42,028 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:46:42,028 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-nds0owp6 8450s 2024-11-23 22:46:42,028 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:46:42,030 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:32807 8450s 2024-11-23 22:46:42,030 - distributed.worker - INFO - Listening to: tls://127.0.0.1:32807 8450s 2024-11-23 22:46:42,030 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:46:42,030 - distributed.worker - INFO - dashboard at: 127.0.0.1:37253 8450s 2024-11-23 22:46:42,030 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44495 8450s 2024-11-23 22:46:42,030 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:46:42,030 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:46:42,030 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:46:42,030 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-vjw7v8lp 8450s 2024-11-23 22:46:42,030 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:46:42,035 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41975. Reason: failure-to-start- 8450s 2024-11-23 22:46:42,035 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:46:42,035 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:32807. Reason: failure-to-start- 8450s 2024-11-23 22:46:42,036 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:46:42,040 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44495': TLS handshake failed with remote 'tls://127.0.0.1:60186': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:46:42,040 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44495': TLS handshake failed with remote 'tls://127.0.0.1:60192': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:46:42,041 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:46:43,046 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:46:43,054 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39881 8450s 2024-11-23 22:46:43,055 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40505/status 8450s 2024-11-23 22:46:43,055 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:46:43,071 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40175 8450s 2024-11-23 22:46:43,071 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40175 8450s 2024-11-23 22:46:43,071 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:46:43,071 - distributed.worker - INFO - dashboard at: 127.0.0.1:46311 8450s 2024-11-23 22:46:43,071 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39881 8450s 2024-11-23 22:46:43,071 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:46:43,071 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:46:43,071 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:46:43,071 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-1fxi2ttb 8450s 2024-11-23 22:46:43,071 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:46:43,073 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39029 8450s 2024-11-23 22:46:43,073 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39029 8450s 2024-11-23 22:46:43,073 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:46:43,073 - distributed.worker - INFO - dashboard at: 127.0.0.1:39085 8450s 2024-11-23 22:46:43,073 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39881 8450s 2024-11-23 22:46:43,073 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:46:43,073 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:46:43,073 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:46:43,073 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-1yq1z_vx 8450s 2024-11-23 22:46:43,074 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:46:43,079 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40175. Reason: failure-to-start- 8450s 2024-11-23 22:46:43,079 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:46:43,080 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39029. Reason: failure-to-start- 8450s 2024-11-23 22:46:43,080 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:46:43,081 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39881': TLS handshake failed with remote 'tls://127.0.0.1:37612': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:46:43,081 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39881': TLS handshake failed with remote 'tls://127.0.0.1:37614': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:46:43,083 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:46:44,087 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:46:44,096 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33195 8450s 2024-11-23 22:46:44,097 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41487/status 8450s 2024-11-23 22:46:44,097 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:46:44,113 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42891 8450s 2024-11-23 22:46:44,113 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42891 8450s 2024-11-23 22:46:44,113 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:46:44,114 - distributed.worker - INFO - dashboard at: 127.0.0.1:34729 8450s 2024-11-23 22:46:44,114 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33195 8450s 2024-11-23 22:46:44,114 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:46:44,114 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:46:44,114 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:46:44,114 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ilmwfi1o 8450s 2024-11-23 22:46:44,114 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:46:44,116 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39053 8450s 2024-11-23 22:46:44,116 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39053 8450s 2024-11-23 22:46:44,116 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:46:44,116 - distributed.worker - INFO - dashboard at: 127.0.0.1:43669 8450s 2024-11-23 22:46:44,116 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33195 8450s 2024-11-23 22:46:44,116 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:46:44,116 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:46:44,116 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:46:44,116 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-79l3x3yz 8450s 2024-11-23 22:46:44,116 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:46:44,122 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42891. Reason: failure-to-start- 8450s 2024-11-23 22:46:44,122 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:46:44,123 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39053. Reason: failure-to-start- 8450s 2024-11-23 22:46:44,123 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:46:44,124 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33195': TLS handshake failed with remote 'tls://127.0.0.1:35470': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:46:44,124 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33195': TLS handshake failed with remote 'tls://127.0.0.1:35484': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:46:44,126 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s ______________________________ test_worker_client ______________________________ 8450s 8450s fut = , timeout = 0 8450s 8450s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 8450s async with asyncio.timeout(timeout): 8450s > return await fut 8450s 8450s /usr/lib/python3/dist-packages/distributed/utils.py:1960: 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s /usr/lib/python3/dist-packages/distributed/worker.py:1480: in start_unsafe 8450s await self._register_with_scheduler() 8450s /usr/lib/python3/dist-packages/distributed/worker.py:1179: in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s /usr/lib/python3/dist-packages/distributed/comm/core.py:342: in connect 8450s comm = await wait_for( 8450s /usr/lib/python3/dist-packages/distributed/utils.py:1960: in wait_for 8450s return await fut 8450s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:546: in connect 8450s stream = await self.client.connect( 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s 8450s self = , host = '127.0.0.1' 8450s port = 43241, af = 8450s ssl_options = 8450s max_buffer_size = 8364507136.0, source_ip = None, source_port = None 8450s timeout = None 8450s 8450s async def connect( 8450s self, 8450s host: str, 8450s port: int, 8450s af: socket.AddressFamily = socket.AF_UNSPEC, 8450s ssl_options: Optional[Union[Dict[str, Any], ssl.SSLContext]] = None, 8450s max_buffer_size: Optional[int] = None, 8450s source_ip: Optional[str] = None, 8450s source_port: Optional[int] = None, 8450s timeout: Optional[Union[float, datetime.timedelta]] = None, 8450s ) -> IOStream: 8450s """Connect to the given host and port. 8450s 8450s Asynchronously returns an `.IOStream` (or `.SSLIOStream` if 8450s ``ssl_options`` is not None). 8450s 8450s Using the ``source_ip`` kwarg, one can specify the source 8450s IP address to use when establishing the connection. 8450s In case the user needs to resolve and 8450s use a specific interface, it has to be handled outside 8450s of Tornado as this depends very much on the platform. 8450s 8450s Raises `TimeoutError` if the input future does not complete before 8450s ``timeout``, which may be specified in any form allowed by 8450s `.IOLoop.add_timeout` (i.e. a `datetime.timedelta` or an absolute time 8450s relative to `.IOLoop.time`) 8450s 8450s Similarly, when the user requires a certain source port, it can 8450s be specified using the ``source_port`` arg. 8450s 8450s .. versionchanged:: 4.5 8450s Added the ``source_ip`` and ``source_port`` arguments. 8450s 8450s .. versionchanged:: 5.0 8450s Added the ``timeout`` argument. 8450s """ 8450s if timeout is not None: 8450s if isinstance(timeout, numbers.Real): 8450s timeout = IOLoop.current().time() + timeout 8450s elif isinstance(timeout, datetime.timedelta): 8450s timeout = IOLoop.current().time() + timeout.total_seconds() 8450s else: 8450s raise TypeError("Unsupported timeout %r" % timeout) 8450s if timeout is not None: 8450s addrinfo = await gen.with_timeout( 8450s timeout, self.resolver.resolve(host, port, af) 8450s ) 8450s else: 8450s addrinfo = await self.resolver.resolve(host, port, af) 8450s connector = _Connector( 8450s addrinfo, 8450s functools.partial( 8450s self._create_stream, 8450s max_buffer_size, 8450s source_ip=source_ip, 8450s source_port=source_port, 8450s ), 8450s ) 8450s > af, addr, stream = await connector.start(connect_timeout=timeout) 8450s E asyncio.exceptions.CancelledError 8450s 8450s /usr/lib/python3/dist-packages/tornado/tcpclient.py:279: CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s self = 8450s 8450s @final 8450s async def start(self): 8450s async with self._startup_lock: 8450s if self.status == Status.failed: 8450s assert self.__startup_exc is not None 8450s raise self.__startup_exc 8450s elif self.status != Status.init: 8450s return self 8450s timeout = getattr(self, "death_timeout", None) 8450s 8450s async def _close_on_failure(exc: Exception) -> None: 8450s await self.close(reason=f"failure-to-start-{str(type(exc))}") 8450s self.status = Status.failed 8450s self.__startup_exc = exc 8450s 8450s try: 8450s > await wait_for(self.start_unsafe(), timeout=timeout) 8450s 8450s /usr/lib/python3/dist-packages/distributed/core.py:664: 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 8450s async with asyncio.timeout(timeout): 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s 8450s self = 8450s exc_type = 8450s exc_val = CancelledError(), exc_tb = 8450s 8450s async def __aexit__( 8450s self, 8450s exc_type: Optional[Type[BaseException]], 8450s exc_val: Optional[BaseException], 8450s exc_tb: Optional[TracebackType], 8450s ) -> Optional[bool]: 8450s assert self._state in (_State.ENTERED, _State.EXPIRING) 8450s 8450s if self._timeout_handler is not None: 8450s self._timeout_handler.cancel() 8450s self._timeout_handler = None 8450s 8450s if self._state is _State.EXPIRING: 8450s self._state = _State.EXPIRED 8450s 8450s if self._task.uncancel() <= self._cancelling and exc_type is not None: 8450s # Since there are no new cancel requests, we're 8450s # handling this. 8450s if issubclass(exc_type, exceptions.CancelledError): 8450s > raise TimeoutError from exc_val 8450s E TimeoutError 8450s 8450s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s @contextlib.asynccontextmanager 8450s async def _cluster_factory(): 8450s workers = [] 8450s s = None 8450s try: 8450s for _ in range(60): 8450s try: 8450s > s, ws = await start_cluster( 8450s nthreads, 8450s scheduler, 8450s security=security, 8450s Worker=Worker, 8450s scheduler_kwargs=scheduler_kwargs, 8450s worker_kwargs=merge( 8450s {"death_timeout": min(15, int(deadline.remaining))}, 8450s worker_kwargs, 8450s ), 8450s ) 8450s 8450s /usr/lib/python3/dist-packages/distributed/utils_test.py:966: 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s /usr/lib/python3/dist-packages/distributed/utils_test.py:789: in start_cluster 8450s await asyncio.gather(*workers) 8450s /usr/lib/python3.13/asyncio/tasks.py:737: in _wrap_awaitable 8450s return await awaitable 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s 8450s self = 8450s 8450s @final 8450s async def start(self): 8450s async with self._startup_lock: 8450s if self.status == Status.failed: 8450s assert self.__startup_exc is not None 8450s raise self.__startup_exc 8450s elif self.status != Status.init: 8450s return self 8450s timeout = getattr(self, "death_timeout", None) 8450s 8450s async def _close_on_failure(exc: Exception) -> None: 8450s await self.close(reason=f"failure-to-start-{str(type(exc))}") 8450s self.status = Status.failed 8450s self.__startup_exc = exc 8450s 8450s try: 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s except asyncio.TimeoutError as exc: 8450s await _close_on_failure(exc) 8450s > raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s E TimeoutError: Worker start timed out after 0s. 8450s 8450s /usr/lib/python3/dist-packages/distributed/core.py:667: TimeoutError 8450s 8450s During handling of the above exception, another exception occurred: 8450s 8450s fut = ._..test_func..async_fn at 0xe8325bf0> 8450s timeout = 60 8450s 8450s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 8450s async with asyncio.timeout(timeout): 8450s > return await fut 8450s 8450s /usr/lib/python3/dist-packages/distributed/utils.py:1960: 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s /usr/lib/python3/dist-packages/distributed/utils_test.py:999: in async_fn 8450s _cluster_factory() as (s, workers), 8450s /usr/lib/python3.13/contextlib.py:214: in __aenter__ 8450s return await anext(self.gen) 8450s /usr/lib/python3/dist-packages/distributed/utils_test.py:983: in _cluster_factory 8450s await asyncio.sleep(1) 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s 8450s delay = 1, result = None 8450s 8450s async def sleep(delay, result=None): 8450s """Coroutine that completes after a given time (in seconds).""" 8450s if delay <= 0: 8450s await __sleep0() 8450s return result 8450s 8450s if math.isnan(delay): 8450s raise ValueError("Invalid delay: NaN (not a number)") 8450s 8450s loop = events.get_running_loop() 8450s future = loop.create_future() 8450s h = loop.call_later(delay, 8450s futures._set_result_unless_cancelled, 8450s future, result) 8450s try: 8450s > return await future 8450s E asyncio.exceptions.CancelledError 8450s 8450s /usr/lib/python3.13/asyncio/tasks.py:718: CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s args = (), kwds = {} 8450s 8450s @wraps(func) 8450s def inner(*args, **kwds): 8450s with self._recreate_cm(): 8450s > return func(*args, **kwds) 8450s 8450s /usr/lib/python3.13/contextlib.py:85: 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s /usr/lib/python3.13/contextlib.py:85: in inner 8450s return func(*args, **kwds) 8450s /usr/lib/python3/dist-packages/distributed/utils_test.py:1102: in test_func 8450s return _run_and_close_tornado(async_fn_outer) 8450s /usr/lib/python3/dist-packages/distributed/utils_test.py:378: in _run_and_close_tornado 8450s return asyncio_run(inner_fn(), loop_factory=get_loop_factory()) 8450s /usr/lib/python3.13/asyncio/runners.py:194: in run 8450s return runner.run(main) 8450s /usr/lib/python3.13/asyncio/runners.py:118: in run 8450s return self._loop.run_until_complete(task) 8450s /usr/lib/python3.13/asyncio/base_events.py:720: in run_until_complete 8450s return future.result() 8450s /usr/lib/python3/dist-packages/distributed/utils_test.py:375: in inner_fn 8450s return await async_fn(*args, **kwargs) 8450s /usr/lib/python3/dist-packages/distributed/utils_test.py:1099: in async_fn_outer 8450s return await utils_wait_for(async_fn(), timeout=timeout * 2) 8450s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 8450s async with asyncio.timeout(timeout): 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s 8450s self = 8450s exc_type = 8450s exc_val = CancelledError(), exc_tb = 8450s 8450s async def __aexit__( 8450s self, 8450s exc_type: Optional[Type[BaseException]], 8450s exc_val: Optional[BaseException], 8450s exc_tb: Optional[TracebackType], 8450s ) -> Optional[bool]: 8450s assert self._state in (_State.ENTERED, _State.EXPIRING) 8450s 8450s if self._timeout_handler is not None: 8450s self._timeout_handler.cancel() 8450s self._timeout_handler = None 8450s 8450s if self._state is _State.EXPIRING: 8450s self._state = _State.EXPIRED 8450s 8450s if self._task.uncancel() <= self._cancelling and exc_type is not None: 8450s # Since there are no new cancel requests, we're 8450s # handling this. 8450s if issubclass(exc_type, exceptions.CancelledError): 8450s > raise TimeoutError from exc_val 8450s E TimeoutError 8450s 8450s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 8450s ----------------------------- Captured stderr call ----------------------------- 8450s 2024-11-23 22:46:45,403 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:46:45,414 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:45,414 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45021/status 8450s 2024-11-23 22:46:45,415 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:46:45,432 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35341 8450s 2024-11-23 22:46:45,432 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35341 8450s 2024-11-23 22:46:45,433 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:46:45,433 - distributed.worker - INFO - dashboard at: 127.0.0.1:39839 8450s 2024-11-23 22:46:45,433 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:45,433 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:46:45,433 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:46:45,433 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:46:45,433 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-xcktuuqz 8450s 2024-11-23 22:46:45,433 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:46:45,435 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38695 8450s 2024-11-23 22:46:45,435 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38695 8450s 2024-11-23 22:46:45,435 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:46:45,435 - distributed.worker - INFO - dashboard at: 127.0.0.1:38585 8450s 2024-11-23 22:46:45,435 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:45,435 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:46:45,435 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:46:45,435 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:46:45,435 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-_fa2fd_t 8450s 2024-11-23 22:46:45,435 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:46:45,447 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:45,448 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:45,448 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:58662': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:45,448 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:58678': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:45,560 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:45,560 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:45,561 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:58682': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:45,561 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:58692': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:45,672 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:45,672 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:45,673 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:58700': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:45,673 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:58708': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:45,785 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:45,785 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:45,785 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:58712': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:45,785 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:58724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:45,897 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:45,898 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:45,898 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:58732': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:45,898 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:58742': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:46,009 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:46,009 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:46,010 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:58744': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:46,010 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:58758': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:46,122 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:46,122 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:46,122 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:58766': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:46,122 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:58774': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:46,233 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:46,233 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:46,234 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:58780': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:46,234 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:58792': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:46,346 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:46,347 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:46,347 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:58804': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:46,347 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:58806': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:46,459 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:46,459 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:46,460 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:58814': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:46,460 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:58822': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:46,572 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:46,572 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:46,572 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:58834': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:46,572 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:58842': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:46,684 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:46,684 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:46,684 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:58856': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:46,684 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:58864': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:46,796 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:46,796 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:46,797 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:58872': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:46,797 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:58876': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:46,909 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:46,909 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:46,909 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:58882': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:46,909 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:58898': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:47,021 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:47,022 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:47,022 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:58908': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:47,022 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:58914': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:47,133 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:47,133 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:47,134 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:58918': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:47,134 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:58930': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:47,246 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:47,247 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:47,247 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:58940': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:47,247 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:58946': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:47,359 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:47,359 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:47,360 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:58948': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:47,360 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:58958': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:47,473 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:47,473 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:47,473 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:58968': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:47,473 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:58980': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:47,585 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:47,585 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:47,586 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:58984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:47,586 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:58996': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:47,697 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:47,697 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:47,698 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:59002': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:47,698 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:59018': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:47,810 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:47,810 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:47,811 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:59030': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:47,811 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:59036': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:47,923 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:47,923 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:47,928 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:59046': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:47,928 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:59050': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:48,035 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:48,035 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:48,036 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:59064': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:48,036 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:59076': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:48,147 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:48,147 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:48,147 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:59090': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:48,147 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:59104': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:48,259 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:48,259 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:48,259 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:59118': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:48,259 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:59122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:48,371 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:48,372 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:48,372 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:59130': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:48,372 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:59134': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:48,485 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:48,485 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:48,485 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:59138': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:48,485 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:59146': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:48,598 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:48,598 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:48,598 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:59156': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:48,598 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:59164': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:48,709 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:48,710 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:48,710 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:59180': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:48,710 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:59190': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:48,822 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:48,822 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:48,823 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:59206': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:48,823 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:59220': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:48,934 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:48,935 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:48,935 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:59236': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:48,935 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:59250': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:49,048 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:49,048 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:49,049 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:59260': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:49,049 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:59274': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:49,160 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:49,161 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:49,161 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:59284': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:49,161 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:59298': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:49,274 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:49,274 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:49,274 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:59304': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:49,274 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:59316': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:49,387 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:49,387 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:49,388 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:59328': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:49,388 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:59336': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:49,499 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:49,499 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:49,500 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:59340': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:49,500 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:59350': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:49,612 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:49,612 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:49,613 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:59356': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:49,613 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:59368': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:49,724 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:49,724 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:49,724 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:59376': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:49,724 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:59380': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:49,836 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:49,836 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:49,836 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:59390': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:49,836 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:59398': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:49,947 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:49,948 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:49,948 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:59404': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:49,948 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:59416': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:50,060 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:50,060 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:50,061 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:59428': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:50,061 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:59444': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:50,173 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:50,173 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:50,174 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:59452': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:50,174 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:59466': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:50,285 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:50,285 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:50,285 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:59476': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:50,285 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:59492': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:50,397 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:50,397 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:50,398 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:59504': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:50,398 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:59506': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:50,510 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:50,510 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:50,510 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:59510': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:50,510 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:59524': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:50,623 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:50,623 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:50,624 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:59532': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:50,624 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:59536': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:50,736 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:50,736 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:50,736 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:59542': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:50,736 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:59548': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:50,848 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:50,848 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:50,849 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:59552': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:50,849 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:59560': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:50,961 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:50,961 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:50,961 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:59568': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:50,962 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:59574': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:51,074 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:51,075 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:51,075 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:59576': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:51,075 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:59584': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:51,188 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:51,188 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:51,188 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:59588': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:51,188 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:59602': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:51,301 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:51,301 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:51,301 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:59612': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:51,301 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:59626': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:51,414 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:51,414 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:51,414 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:59632': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:51,414 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:59648': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:51,526 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:51,527 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:51,527 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:59656': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:51,527 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:59662': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:51,639 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:51,639 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:51,639 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:38374': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:51,639 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:38382': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:51,751 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:51,751 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:51,752 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:38394': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:51,752 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:38402': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:51,864 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:51,864 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:51,865 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:38412': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:51,865 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:38426': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:51,976 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:51,977 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:51,977 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:38440': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:51,977 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:38454': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:52,089 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:52,089 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:52,090 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:38470': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:52,090 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:38474': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:52,202 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:52,202 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:52,202 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:38484': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:52,202 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:38488': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:52,314 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:52,314 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:52,315 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:38504': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:52,315 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:38508': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:52,432 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:52,432 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:52,433 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:38522': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:52,433 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:38528': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:52,544 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:52,545 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:52,545 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:38534': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:52,545 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:38536': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:52,658 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:52,658 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:52,659 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:38546': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:52,659 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:38552': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:52,771 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:52,771 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:52,771 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:38560': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:52,771 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:38564': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:52,885 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:52,885 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:52,885 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:38572': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:52,886 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:38576': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:52,998 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:52,998 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:52,999 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:38578': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:52,999 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:38590': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:53,111 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:53,111 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:53,111 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:38598': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:53,112 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:38606': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:53,224 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:53,225 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:53,225 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:38608': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:53,225 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:38614': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:53,338 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:53,338 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:53,338 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:38616': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:53,338 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:38622': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:53,450 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:53,450 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:53,451 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:38632': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:53,451 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:38644': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:53,562 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:53,562 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:53,563 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:38654': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:53,563 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:38670': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:53,675 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:53,676 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:53,676 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:38676': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:53,676 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:38692': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:53,788 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:53,789 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:53,789 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:38696': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:53,789 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:38708': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:53,902 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:53,902 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:53,902 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:38724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:53,902 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:38738': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:54,014 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:54,015 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:54,015 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:38746': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:54,015 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:38748': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:54,127 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:54,127 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:54,128 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:38754': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:54,128 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:38756': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:54,239 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:54,240 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:54,240 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:38760': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:54,240 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:38766': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:54,352 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:54,352 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:54,352 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:38780': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:54,352 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:38788': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:54,465 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:54,465 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:54,466 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:38800': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:54,466 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:38802': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:54,578 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:54,578 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:54,578 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:38808': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:54,578 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:38812': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:54,691 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:54,691 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:54,692 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:38828': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:54,692 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:38836': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:54,804 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:54,804 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:54,805 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:38844': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:54,805 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:38850': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:54,917 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:54,918 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:54,922 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:38856': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:54,922 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:38868': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:55,031 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:55,031 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:55,031 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:38872': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:55,031 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:38880': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:55,143 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:55,143 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:55,143 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:38882': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:55,143 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:38890': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:55,255 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:55,255 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:55,255 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:38902': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:55,256 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:38910': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:55,368 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:55,368 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:55,368 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:38914': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:55,368 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:38922': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:55,480 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:55,480 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:55,481 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:38936': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:55,481 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:38942': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:55,593 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:55,593 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:55,594 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:38948': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:55,594 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:38954': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:55,706 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:55,706 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:55,706 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:38956': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:55,706 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:38964': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:55,819 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:55,819 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:55,819 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:38978': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:55,819 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:38982': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:55,932 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:55,932 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:55,932 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:38984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:55,932 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:38988': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:56,044 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:56,045 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:56,045 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:38994': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:56,045 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:38996': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:56,157 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:56,158 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:56,158 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:39010': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:56,158 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:39024': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:56,270 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:56,270 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:56,271 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:39028': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:56,271 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:39034': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:56,382 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:56,382 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:56,382 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:39040': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:56,383 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:39048': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:56,495 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:56,495 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:56,495 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:39058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:56,495 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:39074': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:56,607 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:56,607 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:56,608 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:39084': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:56,608 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:39088': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:56,719 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:56,719 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:56,720 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:39094': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:56,720 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:39108': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:56,831 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:56,831 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:56,831 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:39120': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:56,831 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:39122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:56,943 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:56,943 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:56,944 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:39130': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:56,944 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:39140': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:57,056 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:57,056 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:57,056 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:39146': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:57,056 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:39158': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:57,168 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:57,168 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:57,169 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:39164': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:57,169 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:39180': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:57,281 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:57,281 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:57,281 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:39196': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:57,282 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:39198': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:57,393 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:57,393 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:57,394 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:39212': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:57,394 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:39216': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:57,506 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:57,507 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:57,507 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:39226': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:57,507 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:39240': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:57,620 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:57,620 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:57,620 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:39256': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:57,620 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:39264': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:57,732 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:57,732 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:57,732 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:39268': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:57,732 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:39280': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:57,843 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:57,844 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:57,844 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:39288': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:57,844 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:39294': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:57,956 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:57,957 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:57,957 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:39298': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:57,957 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:39310': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:58,069 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:58,069 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:58,070 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:39318': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:58,070 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:39320': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:58,184 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:58,184 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:58,184 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:39322': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:58,184 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:39338': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:58,296 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:58,297 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:58,297 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:39348': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:58,297 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:39354': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:58,409 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:58,410 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:58,410 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:39362': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:58,410 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:39374': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:58,522 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:58,522 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:58,523 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:39390': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:58,523 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:39404': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:58,634 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:58,634 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:58,634 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:39410': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:58,634 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:39420': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:58,746 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:58,746 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:58,746 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:39434': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:58,747 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:39450': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:58,859 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:58,859 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:58,859 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:39454': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:58,859 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:39464': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:58,971 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:58,971 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:58,972 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:39472': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:58,972 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:39480': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:59,084 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:59,084 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:59,084 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:39486': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:59,085 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:39498': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:59,196 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:59,196 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:59,197 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:39512': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:59,197 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:39524': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:59,309 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:59,309 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:59,309 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:39540': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:59,309 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:39546': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:59,422 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:59,422 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:59,427 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:39552': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:59,427 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:39568': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:59,534 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:59,534 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:59,535 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:39582': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:59,535 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:39586': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:59,646 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:59,646 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:59,647 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:39600': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:59,647 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:39610': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:59,758 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:59,758 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:59,759 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:39614': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:59,759 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:39618': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:59,871 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:59,871 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:46:59,871 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:39624': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:46:59,871 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:39636': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:00,194 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:47:00,194 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:47:00,194 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:39650': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:00,194 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:39662': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:00,307 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:47:00,307 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:47:00,307 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:39672': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:00,307 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:39678': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:00,420 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:47:00,420 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39481 8450s 2024-11-23 22:47:00,424 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:39682': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:00,425 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39481': TLS handshake failed with remote 'tls://127.0.0.1:39696': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:00,432 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35341. Reason: failure-to-start- 8450s 2024-11-23 22:47:00,432 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:47:00,434 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 15s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 8450s stream = await stream.start_tls( 8450s ^^^^^^^^^^^^^^^^^^^^^^^ 8450s False, ssl_options=ssl_options, server_hostname=host 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 8450s self.socket.do_handshake() 8450s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 8450s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 8450s self._sslobj.do_handshake() 8450s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 8450s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 8450s raise FatalCommClosedError( 8450s ...<2 lines>... 8450s ) from err 8450s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 8450s 8450s During handling of the above exception, another exception occurred: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1218, in _register_with_scheduler 8450s await asyncio.sleep(0.1) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 718, in sleep 8450s return await future 8450s ^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 15s. 8450s 2024-11-23 22:47:00,437 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38695. Reason: failure-to-start- 8450s 2024-11-23 22:47:00,437 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:47:01,440 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:47:01,447 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:01,447 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41721/status 8450s 2024-11-23 22:47:01,447 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:47:01,461 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40331 8450s 2024-11-23 22:47:01,462 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40331 8450s 2024-11-23 22:47:01,462 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:47:01,462 - distributed.worker - INFO - dashboard at: 127.0.0.1:43403 8450s 2024-11-23 22:47:01,462 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:01,462 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:47:01,462 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:47:01,462 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:47:01,462 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-f9pizfwz 8450s 2024-11-23 22:47:01,462 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:47:01,465 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35497 8450s 2024-11-23 22:47:01,465 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35497 8450s 2024-11-23 22:47:01,465 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:47:01,465 - distributed.worker - INFO - dashboard at: 127.0.0.1:35121 8450s 2024-11-23 22:47:01,465 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:01,465 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:47:01,465 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:47:01,465 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:47:01,465 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-_el4pqdi 8450s 2024-11-23 22:47:01,465 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:47:01,477 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:01,478 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:01,478 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:38520': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:01,478 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:38522': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:01,589 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:01,590 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:01,590 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:51708': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:01,590 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:51716': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:01,702 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:01,702 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:01,703 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:51724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:01,703 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:51736': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:01,814 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:01,814 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:01,815 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:51740': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:01,815 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:51756': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:01,930 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:01,930 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:01,930 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:51764': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:01,930 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:51776': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:02,042 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:02,043 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:02,043 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:51790': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:02,043 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:51792': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:02,155 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:02,156 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:02,156 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:51804': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:02,156 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:51816': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:02,268 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:02,268 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:02,268 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:51822': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:02,268 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:51824': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:02,379 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:02,380 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:02,380 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:51838': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:02,380 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:51840': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:02,492 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:02,493 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:02,493 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:51856': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:02,493 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:51858': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:02,604 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:02,605 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:02,605 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:51862': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:02,605 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:51872': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:02,718 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:02,718 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:02,719 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:51884': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:02,719 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:51886': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:02,831 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:02,831 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:02,831 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:51898': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:02,831 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:51904': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:02,943 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:02,943 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:02,943 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:51916': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:02,943 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:51920': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:03,056 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:03,056 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:03,056 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:51936': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:03,057 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:51944': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:03,168 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:03,169 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:03,169 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:51954': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:03,169 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:51956': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:03,282 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:03,283 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:03,283 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:51964': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:03,283 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:51978': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:03,395 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:03,395 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:03,395 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:51986': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:03,395 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:51996': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:03,508 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:03,508 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:03,508 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:52006': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:03,508 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:52008': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:03,620 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:03,620 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:03,621 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:52020': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:03,621 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:52028': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:03,732 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:03,732 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:03,733 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:52030': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:03,733 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:52042': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:03,844 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:03,844 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:03,845 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:52050': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:03,845 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:52064': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:03,961 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:03,961 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:03,962 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:52078': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:03,962 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:52092': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:04,074 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:04,075 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:04,075 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:52102': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:04,075 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:52116': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:04,188 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:04,188 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:04,188 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:52118': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:04,188 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:52130': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:04,301 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:04,302 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:04,302 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:52138': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:04,302 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:52146': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:04,414 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:04,414 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:04,414 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:52154': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:04,415 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:52170': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:04,527 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:04,527 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:04,527 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:52184': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:04,527 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:52190': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:04,639 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:04,639 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:04,639 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:52194': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:04,639 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:52196': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:04,752 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:04,752 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:04,752 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:52198': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:04,752 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:52200': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:04,864 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:04,864 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:04,865 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:52202': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:04,865 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:52216': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:04,977 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:04,978 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:04,978 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:52218': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:04,978 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:52222': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:05,090 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:05,091 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:05,091 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:52234': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:05,091 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:52250': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:05,204 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:05,204 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:05,205 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:52266': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:05,205 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:52270': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:05,317 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:05,317 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:05,317 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:52276': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:05,317 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:52290': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:05,430 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:05,431 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:05,431 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:52298': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:05,431 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:52314': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:05,543 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:05,543 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:05,544 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:52326': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:05,544 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:52342': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:05,656 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:05,656 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:05,656 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:52352': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:05,656 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:52368': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:05,768 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:05,768 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:05,768 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:52378': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:05,768 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:52380': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:05,880 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:05,880 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:05,881 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:52392': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:05,882 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:52408': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:05,993 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:05,993 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:05,993 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:52410': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:05,993 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:52416': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:06,105 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:06,105 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:06,105 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:52430': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:06,105 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:52446': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:06,217 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:06,218 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:06,218 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:52452': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:06,218 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:52464': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:06,330 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:06,330 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:06,330 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:52476': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:06,330 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:52478': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:06,442 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:06,443 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:06,443 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:52490': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:06,443 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:52496': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:06,555 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:06,555 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:06,555 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:52506': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:06,555 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:52514': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:06,666 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:06,667 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:06,667 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:52522': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:06,667 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:52534': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:06,778 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:06,778 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:06,779 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:52540': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:06,779 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:52542': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:06,892 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:06,892 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:06,892 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:52550': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:06,892 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:52560': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:07,004 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:07,004 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:07,004 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:52572': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:07,004 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:52578': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:07,116 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:07,116 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:07,116 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:52580': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:07,116 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:52592': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:07,228 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:07,228 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:07,228 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:52602': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:07,228 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:52608': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:07,341 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:07,341 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:07,342 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:52612': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:07,342 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:52618': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:07,454 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:07,454 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:07,459 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:52628': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:07,459 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:52634': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:07,567 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:07,567 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:07,567 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:52640': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:07,567 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:52656': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:07,679 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:07,679 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:07,680 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:52666': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:07,680 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:52676': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:07,792 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:07,792 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:07,792 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:52682': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:07,793 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:52696': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:07,904 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:07,904 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:07,905 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:52706': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:07,905 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:52712': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:08,016 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:08,017 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:08,017 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:52714': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:08,017 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:52730': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:08,129 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:08,129 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:08,129 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:52738': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:08,129 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:52752': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:08,241 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:08,242 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:08,242 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:52768': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:08,242 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:52770': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:08,355 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:08,356 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:08,356 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:52780': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:08,356 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:52782': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:08,467 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:08,467 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:08,468 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:52784': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:08,468 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:52800': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:08,579 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:08,579 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:08,579 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:52810': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:08,580 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:52812': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:08,692 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:08,692 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:08,692 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:52824': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:08,692 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:52830': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:08,803 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:08,803 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:08,804 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:52832': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:08,804 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:52848': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:08,915 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:08,915 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:08,916 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:52864': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:08,916 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:52874': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:09,027 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:09,027 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:09,028 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:52886': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:09,028 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:52896': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:09,140 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:09,140 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:09,141 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:52904': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:09,141 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:52912': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:09,254 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:09,254 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:09,255 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:52926': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:09,255 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:52942': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:09,366 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:09,366 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:09,367 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:52952': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:09,367 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:52960': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:09,479 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:09,479 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:09,479 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:52966': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:09,479 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:52980': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:09,591 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:09,591 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:09,591 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:52992': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:09,592 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:53000': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:09,705 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:09,705 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:09,705 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:53010': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:09,705 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:53022': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:09,816 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:09,817 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:09,817 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:53030': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:09,817 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:53046': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:09,931 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:09,932 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:09,932 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:53056': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:09,932 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:53064': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:10,044 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:10,044 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:10,044 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:53080': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:10,044 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:53096': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:10,156 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:10,156 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:10,157 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:53106': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:10,157 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:53112': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:10,269 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:10,270 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:10,270 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:53126': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:10,270 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:53130': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:10,381 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:10,382 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:10,382 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:53136': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:10,382 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:53150': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:10,495 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:10,495 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:10,496 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:53156': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:10,496 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:53158': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:10,607 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:10,608 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:10,608 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:53166': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:10,608 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:53168': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:10,721 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:10,722 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:10,722 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:53184': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:10,722 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:53190': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:10,833 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:10,834 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:10,834 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:53196': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:10,834 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:53204': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:10,946 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:10,947 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:10,947 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:53206': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:10,947 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:53208': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:11,058 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:11,059 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:11,059 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:53220': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:11,059 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:53234': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:11,171 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:11,171 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:11,171 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:53242': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:11,171 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:53244': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:11,283 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:11,283 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:11,284 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:53258': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:11,284 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:53266': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:11,395 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:11,395 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:11,396 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:53274': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:11,396 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:53290': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:11,507 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:11,508 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:11,508 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:53296': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:11,508 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:53300': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:11,621 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:11,621 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:11,621 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:44772': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:11,621 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:44784': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:11,732 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:11,732 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:11,733 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:44794': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:11,733 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:44796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:11,844 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:11,844 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:11,845 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:44812': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:11,845 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:44820': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:11,960 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:11,961 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:11,961 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:44834': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:11,961 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:44836': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:12,072 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:12,073 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:12,073 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:44842': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:12,073 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:44856': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:12,184 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:12,185 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:12,185 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:44862': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:12,185 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:44876': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:12,298 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:12,299 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:12,299 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:44892': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:12,299 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:44904': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:12,410 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:12,410 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:12,411 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:44910': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:12,411 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:44922': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:12,523 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:12,523 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:12,523 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:44932': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:12,523 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:44946': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:12,635 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:12,635 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:12,635 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:44950': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:12,635 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:44958': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:12,747 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:12,747 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:12,747 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:44966': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:12,748 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:44982': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:12,860 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:12,860 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:12,860 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:44998': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:12,860 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:45010': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:12,973 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:12,973 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:12,973 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:45024': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:12,973 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:45040': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:13,086 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:13,087 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:13,087 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:45048': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:13,087 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:45062': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:13,199 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:13,199 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:13,199 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:45068': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:13,199 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:45080': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:13,311 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:13,311 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:13,311 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:45094': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:13,311 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:45100': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:13,424 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:13,424 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:13,428 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:45104': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:13,428 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:45106': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:13,537 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:13,538 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:13,538 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:45110': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:13,538 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:45114': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:13,649 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:13,650 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:13,650 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:45122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:13,650 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:45134': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:13,762 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:13,762 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:13,762 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:45148': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:13,762 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:45158': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:13,874 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:13,874 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:13,874 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:45174': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:13,874 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:45176': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:13,986 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:13,986 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:13,986 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:45180': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:13,986 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:45188': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:14,099 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:14,099 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:14,100 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:45204': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:14,100 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:45216': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:14,212 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:14,212 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:14,212 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:45230': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:14,212 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:45234': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:14,324 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:14,325 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:14,325 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:45240': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:14,325 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:45246': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:14,436 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:14,437 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35167 8450s 2024-11-23 22:47:14,437 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:45256': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:14,437 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35167': TLS handshake failed with remote 'tls://127.0.0.1:45260': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:14,461 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40331. Reason: failure-to-start- 8450s 2024-11-23 22:47:14,461 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:47:14,462 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 13s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 8450s stream = await stream.start_tls( 8450s ^^^^^^^^^^^^^^^^^^^^^^^ 8450s False, ssl_options=ssl_options, server_hostname=host 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 8450s self.socket.do_handshake() 8450s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 8450s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 8450s self._sslobj.do_handshake() 8450s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 8450s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 8450s raise FatalCommClosedError( 8450s ...<2 lines>... 8450s ) from err 8450s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 8450s 8450s During handling of the above exception, another exception occurred: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1218, in _register_with_scheduler 8450s await asyncio.sleep(0.1) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 718, in sleep 8450s return await future 8450s ^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 13s. 8450s 2024-11-23 22:47:14,466 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35497. Reason: failure-to-start- 8450s 2024-11-23 22:47:14,466 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:47:15,468 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:47:15,474 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42145 8450s 2024-11-23 22:47:15,475 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43459/status 8450s 2024-11-23 22:47:15,475 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:47:15,487 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33261 8450s 2024-11-23 22:47:15,487 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33261 8450s 2024-11-23 22:47:15,487 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:47:15,487 - distributed.worker - INFO - dashboard at: 127.0.0.1:38573 8450s 2024-11-23 22:47:15,487 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42145 8450s 2024-11-23 22:47:15,487 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:47:15,487 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:47:15,487 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:47:15,487 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-xsg6mi7w 8450s 2024-11-23 22:47:15,488 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:47:15,490 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46637 8450s 2024-11-23 22:47:15,490 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46637 8450s 2024-11-23 22:47:15,490 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:47:15,490 - distributed.worker - INFO - dashboard at: 127.0.0.1:41061 8450s 2024-11-23 22:47:15,490 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42145 8450s 2024-11-23 22:47:15,490 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:47:15,490 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:47:15,490 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:47:15,490 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ovs2nkzb 8450s 2024-11-23 22:47:15,490 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:47:15,491 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33261. Reason: failure-to-start- 8450s 2024-11-23 22:47:15,491 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:47:15,492 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46637. Reason: failure-to-start- 8450s 2024-11-23 22:47:15,492 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:47:15,493 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42145': TLS handshake failed with remote 'tls://127.0.0.1:41618': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:47:15,493 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42145': TLS handshake failed with remote 'tls://127.0.0.1:41632': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:47:15,494 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:47:16,499 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:47:16,505 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39609 8450s 2024-11-23 22:47:16,505 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39139/status 8450s 2024-11-23 22:47:16,505 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:47:16,519 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44517 8450s 2024-11-23 22:47:16,519 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44517 8450s 2024-11-23 22:47:16,519 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:47:16,519 - distributed.worker - INFO - dashboard at: 127.0.0.1:34985 8450s 2024-11-23 22:47:16,519 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39609 8450s 2024-11-23 22:47:16,519 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:47:16,519 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:47:16,519 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:47:16,519 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-nggtrn09 8450s 2024-11-23 22:47:16,519 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:47:16,521 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42087 8450s 2024-11-23 22:47:16,521 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42087 8450s 2024-11-23 22:47:16,521 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:47:16,521 - distributed.worker - INFO - dashboard at: 127.0.0.1:41159 8450s 2024-11-23 22:47:16,521 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39609 8450s 2024-11-23 22:47:16,521 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:47:16,521 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:47:16,521 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:47:16,521 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-3u74i5a9 8450s 2024-11-23 22:47:16,522 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:47:16,522 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44517. Reason: failure-to-start- 8450s 2024-11-23 22:47:16,523 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:47:16,523 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42087. Reason: failure-to-start- 8450s 2024-11-23 22:47:16,523 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:47:16,524 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39609': TLS handshake failed with remote 'tls://127.0.0.1:42538': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:47:16,524 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39609': TLS handshake failed with remote 'tls://127.0.0.1:42544': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:47:16,525 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:47:17,530 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:47:17,538 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37787 8450s 2024-11-23 22:47:17,538 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41173/status 8450s 2024-11-23 22:47:17,538 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:47:17,551 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44051 8450s 2024-11-23 22:47:17,551 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44051 8450s 2024-11-23 22:47:17,551 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:47:17,552 - distributed.worker - INFO - dashboard at: 127.0.0.1:36221 8450s 2024-11-23 22:47:17,552 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37787 8450s 2024-11-23 22:47:17,552 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:47:17,552 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:47:17,552 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:47:17,552 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-u4iol67f 8450s 2024-11-23 22:47:17,552 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:47:17,553 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39249 8450s 2024-11-23 22:47:17,554 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39249 8450s 2024-11-23 22:47:17,554 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:47:17,554 - distributed.worker - INFO - dashboard at: 127.0.0.1:39053 8450s 2024-11-23 22:47:17,554 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37787 8450s 2024-11-23 22:47:17,554 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:47:17,554 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:47:17,554 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:47:17,554 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-xz2_7l3a 8450s 2024-11-23 22:47:17,554 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:47:17,555 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44051. Reason: failure-to-start- 8450s 2024-11-23 22:47:17,555 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:47:17,555 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39249. Reason: failure-to-start- 8450s 2024-11-23 22:47:17,555 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:47:17,556 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37787': TLS handshake failed with remote 'tls://127.0.0.1:41140': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:47:17,556 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37787': TLS handshake failed with remote 'tls://127.0.0.1:41150': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:47:17,557 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:47:18,562 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:47:18,568 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38217 8450s 2024-11-23 22:47:18,569 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36079/status 8450s 2024-11-23 22:47:18,569 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:47:18,587 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45289 8450s 2024-11-23 22:47:18,587 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45289 8450s 2024-11-23 22:47:18,587 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:47:18,587 - distributed.worker - INFO - dashboard at: 127.0.0.1:39467 8450s 2024-11-23 22:47:18,587 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38217 8450s 2024-11-23 22:47:18,587 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:47:18,587 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:47:18,587 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:47:18,587 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-qfqte6u4 8450s 2024-11-23 22:47:18,587 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:47:18,589 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38427 8450s 2024-11-23 22:47:18,589 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38427 8450s 2024-11-23 22:47:18,589 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:47:18,589 - distributed.worker - INFO - dashboard at: 127.0.0.1:46365 8450s 2024-11-23 22:47:18,589 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38217 8450s 2024-11-23 22:47:18,589 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:47:18,589 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:47:18,589 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:47:18,590 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-4e8khk83 8450s 2024-11-23 22:47:18,590 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:47:18,590 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45289. Reason: failure-to-start- 8450s 2024-11-23 22:47:18,591 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:47:18,591 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38427. Reason: failure-to-start- 8450s 2024-11-23 22:47:18,591 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:47:18,592 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38217': TLS handshake failed with remote 'tls://127.0.0.1:48522': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:47:18,592 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38217': TLS handshake failed with remote 'tls://127.0.0.1:48524': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:47:18,593 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:47:19,598 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:47:19,605 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34853 8450s 2024-11-23 22:47:19,605 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40767/status 8450s 2024-11-23 22:47:19,605 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:47:19,620 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36913 8450s 2024-11-23 22:47:19,620 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36913 8450s 2024-11-23 22:47:19,620 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:47:19,620 - distributed.worker - INFO - dashboard at: 127.0.0.1:46579 8450s 2024-11-23 22:47:19,620 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34853 8450s 2024-11-23 22:47:19,620 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:47:19,620 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:47:19,620 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:47:19,620 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-3gsx8idn 8450s 2024-11-23 22:47:19,620 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:47:19,622 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35201 8450s 2024-11-23 22:47:19,622 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35201 8450s 2024-11-23 22:47:19,622 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:47:19,622 - distributed.worker - INFO - dashboard at: 127.0.0.1:43405 8450s 2024-11-23 22:47:19,622 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34853 8450s 2024-11-23 22:47:19,622 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:47:19,622 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:47:19,622 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:47:19,622 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-viydgszo 8450s 2024-11-23 22:47:19,622 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:47:19,624 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36913. Reason: failure-to-start- 8450s 2024-11-23 22:47:19,624 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:47:19,624 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35201. Reason: failure-to-start- 8450s 2024-11-23 22:47:19,624 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:47:19,625 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34853': TLS handshake failed with remote 'tls://127.0.0.1:41548': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:47:19,625 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34853': TLS handshake failed with remote 'tls://127.0.0.1:41552': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:47:19,626 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:47:20,632 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:47:20,638 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42391 8450s 2024-11-23 22:47:20,639 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46877/status 8450s 2024-11-23 22:47:20,639 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:47:20,652 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40475 8450s 2024-11-23 22:47:20,653 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40475 8450s 2024-11-23 22:47:20,653 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:47:20,653 - distributed.worker - INFO - dashboard at: 127.0.0.1:40541 8450s 2024-11-23 22:47:20,653 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42391 8450s 2024-11-23 22:47:20,653 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:47:20,653 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:47:20,653 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:47:20,653 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-uymxy0ex 8450s 2024-11-23 22:47:20,653 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:47:20,655 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34919 8450s 2024-11-23 22:47:20,655 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34919 8450s 2024-11-23 22:47:20,655 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:47:20,655 - distributed.worker - INFO - dashboard at: 127.0.0.1:35245 8450s 2024-11-23 22:47:20,655 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42391 8450s 2024-11-23 22:47:20,655 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:47:20,655 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:47:20,655 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:47:20,655 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-h_khm9iv 8450s 2024-11-23 22:47:20,655 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:47:20,656 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40475. Reason: failure-to-start- 8450s 2024-11-23 22:47:20,656 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:47:20,657 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34919. Reason: failure-to-start- 8450s 2024-11-23 22:47:20,657 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:47:20,658 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42391': TLS handshake failed with remote 'tls://127.0.0.1:46016': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:47:20,658 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42391': TLS handshake failed with remote 'tls://127.0.0.1:46024': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:47:20,659 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:47:21,664 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:47:21,673 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38531 8450s 2024-11-23 22:47:21,673 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37695/status 8450s 2024-11-23 22:47:21,673 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:47:21,691 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41789 8450s 2024-11-23 22:47:21,691 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41789 8450s 2024-11-23 22:47:21,691 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:47:21,691 - distributed.worker - INFO - dashboard at: 127.0.0.1:42681 8450s 2024-11-23 22:47:21,691 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38531 8450s 2024-11-23 22:47:21,691 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:47:21,691 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:47:21,691 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:47:21,691 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ffhlbxim 8450s 2024-11-23 22:47:21,691 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:47:21,693 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45705 8450s 2024-11-23 22:47:21,693 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45705 8450s 2024-11-23 22:47:21,693 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:47:21,693 - distributed.worker - INFO - dashboard at: 127.0.0.1:41489 8450s 2024-11-23 22:47:21,693 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38531 8450s 2024-11-23 22:47:21,693 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:47:21,693 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:47:21,694 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:47:21,694 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ljyszmjd 8450s 2024-11-23 22:47:21,694 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:47:21,695 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41789. Reason: failure-to-start- 8450s 2024-11-23 22:47:21,695 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:47:21,695 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45705. Reason: failure-to-start- 8450s 2024-11-23 22:47:21,695 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:47:21,696 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38531': TLS handshake failed with remote 'tls://127.0.0.1:59724': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:47:21,697 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38531': TLS handshake failed with remote 'tls://127.0.0.1:59736': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:47:21,698 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:47:22,703 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:47:22,710 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45607 8450s 2024-11-23 22:47:22,711 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41831/status 8450s 2024-11-23 22:47:22,711 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:47:22,726 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36591 8450s 2024-11-23 22:47:22,726 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36591 8450s 2024-11-23 22:47:22,726 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:47:22,726 - distributed.worker - INFO - dashboard at: 127.0.0.1:39377 8450s 2024-11-23 22:47:22,726 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45607 8450s 2024-11-23 22:47:22,726 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:47:22,726 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:47:22,726 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:47:22,727 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-1v090oqw 8450s 2024-11-23 22:47:22,727 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:47:22,728 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34913 8450s 2024-11-23 22:47:22,729 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34913 8450s 2024-11-23 22:47:22,729 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:47:22,729 - distributed.worker - INFO - dashboard at: 127.0.0.1:43665 8450s 2024-11-23 22:47:22,729 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45607 8450s 2024-11-23 22:47:22,729 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:47:22,729 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:47:22,729 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:47:22,729 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-7mhlolvl 8450s 2024-11-23 22:47:22,729 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:47:22,730 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36591. Reason: failure-to-start- 8450s 2024-11-23 22:47:22,730 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:47:22,730 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34913. Reason: failure-to-start- 8450s 2024-11-23 22:47:22,730 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:47:22,731 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45607': TLS handshake failed with remote 'tls://127.0.0.1:58014': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:47:22,731 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45607': TLS handshake failed with remote 'tls://127.0.0.1:58030': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:47:22,733 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:47:23,738 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:47:23,747 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33469 8450s 2024-11-23 22:47:23,747 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34691/status 8450s 2024-11-23 22:47:23,748 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:47:23,761 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45301 8450s 2024-11-23 22:47:23,761 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45301 8450s 2024-11-23 22:47:23,761 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:47:23,761 - distributed.worker - INFO - dashboard at: 127.0.0.1:40743 8450s 2024-11-23 22:47:23,762 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33469 8450s 2024-11-23 22:47:23,762 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:47:23,762 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:47:23,762 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:47:23,762 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-uo9a1ac5 8450s 2024-11-23 22:47:23,762 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:47:23,764 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42211 8450s 2024-11-23 22:47:23,764 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42211 8450s 2024-11-23 22:47:23,764 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:47:23,764 - distributed.worker - INFO - dashboard at: 127.0.0.1:43149 8450s 2024-11-23 22:47:23,764 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33469 8450s 2024-11-23 22:47:23,764 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:47:23,764 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:47:23,764 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:47:23,765 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-1jq32s3a 8450s 2024-11-23 22:47:23,765 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:47:23,765 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45301. Reason: failure-to-start- 8450s 2024-11-23 22:47:23,766 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:47:23,766 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42211. Reason: failure-to-start- 8450s 2024-11-23 22:47:23,766 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:47:23,767 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33469': TLS handshake failed with remote 'tls://127.0.0.1:43798': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:47:23,767 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33469': TLS handshake failed with remote 'tls://127.0.0.1:43810': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:47:23,768 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:47:24,773 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:47:24,780 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46865 8450s 2024-11-23 22:47:24,780 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35201/status 8450s 2024-11-23 22:47:24,780 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:47:24,794 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33731 8450s 2024-11-23 22:47:24,794 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33731 8450s 2024-11-23 22:47:24,795 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:47:24,795 - distributed.worker - INFO - dashboard at: 127.0.0.1:34437 8450s 2024-11-23 22:47:24,795 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46865 8450s 2024-11-23 22:47:24,795 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:47:24,795 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:47:24,795 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:47:24,795 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-nf9jckmr 8450s 2024-11-23 22:47:24,795 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:47:24,797 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46775 8450s 2024-11-23 22:47:24,797 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46775 8450s 2024-11-23 22:47:24,797 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:47:24,797 - distributed.worker - INFO - dashboard at: 127.0.0.1:36753 8450s 2024-11-23 22:47:24,797 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46865 8450s 2024-11-23 22:47:24,797 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:47:24,797 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:47:24,797 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:47:24,797 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-squu57i2 8450s 2024-11-23 22:47:24,797 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:47:24,798 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33731. Reason: failure-to-start- 8450s 2024-11-23 22:47:24,798 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:47:24,798 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46775. Reason: failure-to-start- 8450s 2024-11-23 22:47:24,798 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:47:24,799 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46865': TLS handshake failed with remote 'tls://127.0.0.1:42314': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:47:24,800 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46865': TLS handshake failed with remote 'tls://127.0.0.1:42316': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:47:24,801 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:47:25,807 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:47:25,815 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37531 8450s 2024-11-23 22:47:25,815 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33475/status 8450s 2024-11-23 22:47:25,815 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:47:25,828 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35527 8450s 2024-11-23 22:47:25,828 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35527 8450s 2024-11-23 22:47:25,828 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:47:25,828 - distributed.worker - INFO - dashboard at: 127.0.0.1:43577 8450s 2024-11-23 22:47:25,828 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37531 8450s 2024-11-23 22:47:25,828 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:47:25,828 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:47:25,828 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:47:25,828 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-2vaed44q 8450s 2024-11-23 22:47:25,828 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:47:25,830 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42263 8450s 2024-11-23 22:47:25,830 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42263 8450s 2024-11-23 22:47:25,830 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:47:25,830 - distributed.worker - INFO - dashboard at: 127.0.0.1:39939 8450s 2024-11-23 22:47:25,830 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37531 8450s 2024-11-23 22:47:25,830 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:47:25,830 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:47:25,830 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:47:25,830 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-c1ctm18i 8450s 2024-11-23 22:47:25,830 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:47:25,831 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35527. Reason: failure-to-start- 8450s 2024-11-23 22:47:25,831 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:47:25,832 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42263. Reason: failure-to-start- 8450s 2024-11-23 22:47:25,832 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:47:25,833 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37531': TLS handshake failed with remote 'tls://127.0.0.1:44434': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:47:25,833 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37531': TLS handshake failed with remote 'tls://127.0.0.1:44440': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:47:25,834 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:47:26,838 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:47:26,846 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35795 8450s 2024-11-23 22:47:26,847 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45735/status 8450s 2024-11-23 22:47:26,847 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:47:26,860 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35327 8450s 2024-11-23 22:47:26,861 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35327 8450s 2024-11-23 22:47:26,861 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:47:26,861 - distributed.worker - INFO - dashboard at: 127.0.0.1:42655 8450s 2024-11-23 22:47:26,861 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35795 8450s 2024-11-23 22:47:26,861 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:47:26,861 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:47:26,861 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:47:26,861 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-f2607dhi 8450s 2024-11-23 22:47:26,861 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:47:26,863 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33411 8450s 2024-11-23 22:47:26,863 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33411 8450s 2024-11-23 22:47:26,863 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:47:26,863 - distributed.worker - INFO - dashboard at: 127.0.0.1:35521 8450s 2024-11-23 22:47:26,863 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35795 8450s 2024-11-23 22:47:26,863 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:47:26,863 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:47:26,863 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:47:26,863 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-7mb4sizo 8450s 2024-11-23 22:47:26,863 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:47:26,864 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35327. Reason: failure-to-start- 8450s 2024-11-23 22:47:26,864 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:47:26,865 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33411. Reason: failure-to-start- 8450s 2024-11-23 22:47:26,865 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:47:26,866 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35795': TLS handshake failed with remote 'tls://127.0.0.1:40744': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:47:26,866 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35795': TLS handshake failed with remote 'tls://127.0.0.1:40756': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:47:26,867 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:47:27,872 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:47:27,879 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38749 8450s 2024-11-23 22:47:27,880 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45955/status 8450s 2024-11-23 22:47:27,880 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:47:27,894 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39351 8450s 2024-11-23 22:47:27,894 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39351 8450s 2024-11-23 22:47:27,894 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:47:27,894 - distributed.worker - INFO - dashboard at: 127.0.0.1:38089 8450s 2024-11-23 22:47:27,895 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38749 8450s 2024-11-23 22:47:27,895 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:47:27,895 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:47:27,895 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:47:27,895 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-bn5wr2bj 8450s 2024-11-23 22:47:27,895 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:47:27,897 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35477 8450s 2024-11-23 22:47:27,897 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35477 8450s 2024-11-23 22:47:27,897 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:47:27,897 - distributed.worker - INFO - dashboard at: 127.0.0.1:43181 8450s 2024-11-23 22:47:27,897 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38749 8450s 2024-11-23 22:47:27,897 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:47:27,897 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:47:27,897 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:47:27,897 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-y1fkresw 8450s 2024-11-23 22:47:27,897 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:47:27,898 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39351. Reason: failure-to-start- 8450s 2024-11-23 22:47:27,898 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:47:27,898 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35477. Reason: failure-to-start- 8450s 2024-11-23 22:47:27,898 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:47:27,899 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38749': TLS handshake failed with remote 'tls://127.0.0.1:35694': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:47:27,899 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38749': TLS handshake failed with remote 'tls://127.0.0.1:35704': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:47:27,901 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:47:28,906 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:47:28,914 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39995 8450s 2024-11-23 22:47:28,914 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40911/status 8450s 2024-11-23 22:47:28,914 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:47:28,927 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43265 8450s 2024-11-23 22:47:28,927 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43265 8450s 2024-11-23 22:47:28,927 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:47:28,928 - distributed.worker - INFO - dashboard at: 127.0.0.1:34897 8450s 2024-11-23 22:47:28,928 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39995 8450s 2024-11-23 22:47:28,928 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:47:28,928 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:47:28,928 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:47:28,928 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-t1ytvmx5 8450s 2024-11-23 22:47:28,928 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:47:28,930 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35693 8450s 2024-11-23 22:47:28,930 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35693 8450s 2024-11-23 22:47:28,930 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:47:28,930 - distributed.worker - INFO - dashboard at: 127.0.0.1:35327 8450s 2024-11-23 22:47:28,931 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39995 8450s 2024-11-23 22:47:28,931 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:47:28,931 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:47:28,931 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:47:28,931 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-gllrxv1m 8450s 2024-11-23 22:47:28,931 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:47:28,934 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43265. Reason: failure-to-start- 8450s 2024-11-23 22:47:28,934 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:47:28,935 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35693. Reason: failure-to-start- 8450s 2024-11-23 22:47:28,935 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:47:28,936 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39995': TLS handshake failed with remote 'tls://127.0.0.1:48486': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:47:28,936 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39995': TLS handshake failed with remote 'tls://127.0.0.1:48494': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:47:28,937 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:47:29,942 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:47:29,949 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40721 8450s 2024-11-23 22:47:29,950 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46773/status 8450s 2024-11-23 22:47:29,950 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:47:29,965 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45883 8450s 2024-11-23 22:47:29,965 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45883 8450s 2024-11-23 22:47:29,965 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:47:29,965 - distributed.worker - INFO - dashboard at: 127.0.0.1:40727 8450s 2024-11-23 22:47:29,965 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40721 8450s 2024-11-23 22:47:29,965 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:47:29,965 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:47:29,965 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:47:29,965 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-y1upx29r 8450s 2024-11-23 22:47:29,965 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:47:29,967 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40493 8450s 2024-11-23 22:47:29,967 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40493 8450s 2024-11-23 22:47:29,967 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:47:29,967 - distributed.worker - INFO - dashboard at: 127.0.0.1:45853 8450s 2024-11-23 22:47:29,967 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40721 8450s 2024-11-23 22:47:29,967 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:47:29,967 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:47:29,967 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:47:29,968 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-wfiaq71l 8450s 2024-11-23 22:47:29,968 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:47:29,968 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45883. Reason: failure-to-start- 8450s 2024-11-23 22:47:29,969 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:47:29,969 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40493. Reason: failure-to-start- 8450s 2024-11-23 22:47:29,969 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:47:29,970 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40721': TLS handshake failed with remote 'tls://127.0.0.1:59222': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:47:29,970 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40721': TLS handshake failed with remote 'tls://127.0.0.1:59224': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:47:29,971 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:47:30,977 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:47:30,984 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43187 8450s 2024-11-23 22:47:30,984 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43839/status 8450s 2024-11-23 22:47:30,984 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:47:31,000 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43545 8450s 2024-11-23 22:47:31,000 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43545 8450s 2024-11-23 22:47:31,000 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:47:31,000 - distributed.worker - INFO - dashboard at: 127.0.0.1:43255 8450s 2024-11-23 22:47:31,000 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43187 8450s 2024-11-23 22:47:31,000 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:47:31,000 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:47:31,000 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:47:31,000 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-p01jadgz 8450s 2024-11-23 22:47:31,001 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:47:31,002 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36885 8450s 2024-11-23 22:47:31,002 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36885 8450s 2024-11-23 22:47:31,002 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:47:31,002 - distributed.worker - INFO - dashboard at: 127.0.0.1:37727 8450s 2024-11-23 22:47:31,003 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43187 8450s 2024-11-23 22:47:31,003 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:47:31,003 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:47:31,003 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:47:31,003 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-yjjy7wla 8450s 2024-11-23 22:47:31,003 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:47:31,004 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43545. Reason: failure-to-start- 8450s 2024-11-23 22:47:31,004 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:47:31,004 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36885. Reason: failure-to-start- 8450s 2024-11-23 22:47:31,005 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:47:31,005 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43187': TLS handshake failed with remote 'tls://127.0.0.1:57456': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:47:31,006 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43187': TLS handshake failed with remote 'tls://127.0.0.1:57470': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:47:31,009 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:47:32,014 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:47:32,023 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45403 8450s 2024-11-23 22:47:32,023 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42539/status 8450s 2024-11-23 22:47:32,023 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:47:32,037 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44469 8450s 2024-11-23 22:47:32,037 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44469 8450s 2024-11-23 22:47:32,037 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:47:32,037 - distributed.worker - INFO - dashboard at: 127.0.0.1:33531 8450s 2024-11-23 22:47:32,037 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45403 8450s 2024-11-23 22:47:32,037 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:47:32,037 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:47:32,037 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:47:32,037 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-7stozy90 8450s 2024-11-23 22:47:32,037 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:47:32,039 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34613 8450s 2024-11-23 22:47:32,039 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34613 8450s 2024-11-23 22:47:32,039 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:47:32,039 - distributed.worker - INFO - dashboard at: 127.0.0.1:39971 8450s 2024-11-23 22:47:32,039 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45403 8450s 2024-11-23 22:47:32,039 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:47:32,039 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:47:32,039 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:47:32,039 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-gtmyq8tf 8450s 2024-11-23 22:47:32,039 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:47:32,040 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44469. Reason: failure-to-start- 8450s 2024-11-23 22:47:32,040 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:47:32,041 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34613. Reason: failure-to-start- 8450s 2024-11-23 22:47:32,041 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:47:32,044 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45403': TLS handshake failed with remote 'tls://127.0.0.1:48160': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:47:32,044 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45403': TLS handshake failed with remote 'tls://127.0.0.1:48162': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:47:32,046 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:47:33,051 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:47:33,058 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42727 8450s 2024-11-23 22:47:33,058 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33479/status 8450s 2024-11-23 22:47:33,058 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:47:33,073 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45983 8450s 2024-11-23 22:47:33,073 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45983 8450s 2024-11-23 22:47:33,073 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:47:33,073 - distributed.worker - INFO - dashboard at: 127.0.0.1:38985 8450s 2024-11-23 22:47:33,073 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42727 8450s 2024-11-23 22:47:33,073 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:47:33,073 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:47:33,073 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:47:33,073 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-xqqx4bn4 8450s 2024-11-23 22:47:33,073 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:47:33,075 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44439 8450s 2024-11-23 22:47:33,075 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44439 8450s 2024-11-23 22:47:33,075 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:47:33,075 - distributed.worker - INFO - dashboard at: 127.0.0.1:35855 8450s 2024-11-23 22:47:33,075 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42727 8450s 2024-11-23 22:47:33,075 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:47:33,075 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:47:33,076 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:47:33,076 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-zj007har 8450s 2024-11-23 22:47:33,076 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:47:33,079 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45983. Reason: failure-to-start- 8450s 2024-11-23 22:47:33,079 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:47:33,080 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44439. Reason: failure-to-start- 8450s 2024-11-23 22:47:33,080 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:47:33,081 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42727': TLS handshake failed with remote 'tls://127.0.0.1:50904': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:47:33,081 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42727': TLS handshake failed with remote 'tls://127.0.0.1:50920': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:47:33,082 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:47:34,087 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:47:34,094 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45865 8450s 2024-11-23 22:47:34,094 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44795/status 8450s 2024-11-23 22:47:34,094 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:47:34,107 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35693 8450s 2024-11-23 22:47:34,107 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35693 8450s 2024-11-23 22:47:34,107 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:47:34,108 - distributed.worker - INFO - dashboard at: 127.0.0.1:42077 8450s 2024-11-23 22:47:34,108 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45865 8450s 2024-11-23 22:47:34,108 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:47:34,108 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:47:34,108 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:47:34,108 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-qbqr_5tz 8450s 2024-11-23 22:47:34,108 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:47:34,120 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43085 8450s 2024-11-23 22:47:34,120 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43085 8450s 2024-11-23 22:47:34,120 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:47:34,120 - distributed.worker - INFO - dashboard at: 127.0.0.1:36763 8450s 2024-11-23 22:47:34,120 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45865 8450s 2024-11-23 22:47:34,120 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:47:34,120 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:47:34,120 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:47:34,120 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-37kh_ys9 8450s 2024-11-23 22:47:34,120 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:47:34,124 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35693. Reason: failure-to-start- 8450s 2024-11-23 22:47:34,124 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:47:34,124 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43085. Reason: failure-to-start- 8450s 2024-11-23 22:47:34,124 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:47:34,125 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45865': TLS handshake failed with remote 'tls://127.0.0.1:57390': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:47:34,126 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45865': TLS handshake failed with remote 'tls://127.0.0.1:57398': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:47:34,127 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:47:35,132 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:47:35,140 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39849 8450s 2024-11-23 22:47:35,140 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37223/status 8450s 2024-11-23 22:47:35,140 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:47:35,156 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45511 8450s 2024-11-23 22:47:35,156 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45511 8450s 2024-11-23 22:47:35,156 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:47:35,156 - distributed.worker - INFO - dashboard at: 127.0.0.1:40471 8450s 2024-11-23 22:47:35,156 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39849 8450s 2024-11-23 22:47:35,156 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:47:35,156 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:47:35,156 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:47:35,156 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-y7vflrd9 8450s 2024-11-23 22:47:35,157 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:47:35,158 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36257 8450s 2024-11-23 22:47:35,158 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36257 8450s 2024-11-23 22:47:35,158 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:47:35,158 - distributed.worker - INFO - dashboard at: 127.0.0.1:38741 8450s 2024-11-23 22:47:35,158 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39849 8450s 2024-11-23 22:47:35,158 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:47:35,158 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:47:35,159 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:47:35,159 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-z7dqaftq 8450s 2024-11-23 22:47:35,159 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:47:35,160 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45511. Reason: failure-to-start- 8450s 2024-11-23 22:47:35,160 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:47:35,160 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36257. Reason: failure-to-start- 8450s 2024-11-23 22:47:35,160 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:47:35,161 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39849': TLS handshake failed with remote 'tls://127.0.0.1:34432': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:47:35,161 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39849': TLS handshake failed with remote 'tls://127.0.0.1:34434': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:47:35,162 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:47:36,167 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:47:36,176 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40391 8450s 2024-11-23 22:47:36,177 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41117/status 8450s 2024-11-23 22:47:36,177 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:47:36,193 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45929 8450s 2024-11-23 22:47:36,193 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45929 8450s 2024-11-23 22:47:36,193 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:47:36,193 - distributed.worker - INFO - dashboard at: 127.0.0.1:38469 8450s 2024-11-23 22:47:36,193 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40391 8450s 2024-11-23 22:47:36,193 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:47:36,193 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:47:36,193 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:47:36,193 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-jutahx41 8450s 2024-11-23 22:47:36,193 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:47:36,195 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40025 8450s 2024-11-23 22:47:36,195 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40025 8450s 2024-11-23 22:47:36,195 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:47:36,195 - distributed.worker - INFO - dashboard at: 127.0.0.1:46741 8450s 2024-11-23 22:47:36,195 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40391 8450s 2024-11-23 22:47:36,195 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:47:36,195 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:47:36,195 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:47:36,195 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-toosi3ks 8450s 2024-11-23 22:47:36,195 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:47:36,196 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45929. Reason: failure-to-start- 8450s 2024-11-23 22:47:36,197 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:47:36,197 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40025. Reason: failure-to-start- 8450s 2024-11-23 22:47:36,197 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:47:36,198 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40391': TLS handshake failed with remote 'tls://127.0.0.1:33046': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:47:36,198 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40391': TLS handshake failed with remote 'tls://127.0.0.1:33054': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:47:36,200 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:47:37,206 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:47:37,214 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39411 8450s 2024-11-23 22:47:37,214 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44719/status 8450s 2024-11-23 22:47:37,214 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:47:37,233 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35731 8450s 2024-11-23 22:47:37,233 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35731 8450s 2024-11-23 22:47:37,233 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:47:37,233 - distributed.worker - INFO - dashboard at: 127.0.0.1:45689 8450s 2024-11-23 22:47:37,233 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39411 8450s 2024-11-23 22:47:37,233 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:47:37,233 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:47:37,233 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:47:37,233 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-xppwv4gk 8450s 2024-11-23 22:47:37,233 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:47:37,235 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44071 8450s 2024-11-23 22:47:37,235 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44071 8450s 2024-11-23 22:47:37,235 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:47:37,235 - distributed.worker - INFO - dashboard at: 127.0.0.1:39357 8450s 2024-11-23 22:47:37,235 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39411 8450s 2024-11-23 22:47:37,235 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:47:37,235 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:47:37,235 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:47:37,235 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-65o1lf4k 8450s 2024-11-23 22:47:37,235 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:47:37,236 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35731. Reason: failure-to-start- 8450s 2024-11-23 22:47:37,237 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:47:37,237 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44071. Reason: failure-to-start- 8450s 2024-11-23 22:47:37,237 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:47:37,238 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39411': TLS handshake failed with remote 'tls://127.0.0.1:59992': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:47:37,238 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39411': TLS handshake failed with remote 'tls://127.0.0.1:59998': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:47:37,240 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:47:38,245 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:47:38,253 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41165 8450s 2024-11-23 22:47:38,253 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40987/status 8450s 2024-11-23 22:47:38,253 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:47:38,269 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41301 8450s 2024-11-23 22:47:38,270 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41301 8450s 2024-11-23 22:47:38,270 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:47:38,270 - distributed.worker - INFO - dashboard at: 127.0.0.1:44443 8450s 2024-11-23 22:47:38,270 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41165 8450s 2024-11-23 22:47:38,270 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:47:38,270 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:47:38,270 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:47:38,270 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-7_amzon5 8450s 2024-11-23 22:47:38,270 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:47:38,273 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45047 8450s 2024-11-23 22:47:38,273 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45047 8450s 2024-11-23 22:47:38,273 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:47:38,273 - distributed.worker - INFO - dashboard at: 127.0.0.1:38459 8450s 2024-11-23 22:47:38,273 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41165 8450s 2024-11-23 22:47:38,273 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:47:38,273 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:47:38,273 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:47:38,273 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-vav6c65f 8450s 2024-11-23 22:47:38,273 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:47:38,274 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41301. Reason: failure-to-start- 8450s 2024-11-23 22:47:38,274 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:47:38,275 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45047. Reason: failure-to-start- 8450s 2024-11-23 22:47:38,275 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:47:38,276 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41165': TLS handshake failed with remote 'tls://127.0.0.1:37066': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:47:38,276 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41165': TLS handshake failed with remote 'tls://127.0.0.1:37080': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:47:38,278 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:47:39,283 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:47:39,292 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46671 8450s 2024-11-23 22:47:39,292 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37405/status 8450s 2024-11-23 22:47:39,295 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:47:39,309 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41763 8450s 2024-11-23 22:47:39,309 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41763 8450s 2024-11-23 22:47:39,309 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:47:39,309 - distributed.worker - INFO - dashboard at: 127.0.0.1:34123 8450s 2024-11-23 22:47:39,309 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46671 8450s 2024-11-23 22:47:39,309 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:47:39,309 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:47:39,309 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:47:39,309 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-7vijlfp6 8450s 2024-11-23 22:47:39,309 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:47:39,311 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37901 8450s 2024-11-23 22:47:39,311 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37901 8450s 2024-11-23 22:47:39,311 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:47:39,311 - distributed.worker - INFO - dashboard at: 127.0.0.1:42227 8450s 2024-11-23 22:47:39,311 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46671 8450s 2024-11-23 22:47:39,311 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:47:39,311 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:47:39,311 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:47:39,311 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-_eicqwit 8450s 2024-11-23 22:47:39,311 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:47:39,312 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41763. Reason: failure-to-start- 8450s 2024-11-23 22:47:39,312 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:47:39,313 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37901. Reason: failure-to-start- 8450s 2024-11-23 22:47:39,313 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:47:39,314 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46671': TLS handshake failed with remote 'tls://127.0.0.1:38736': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:47:39,314 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46671': TLS handshake failed with remote 'tls://127.0.0.1:38742': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:47:39,316 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:47:40,323 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:47:40,330 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:32973 8450s 2024-11-23 22:47:40,330 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44619/status 8450s 2024-11-23 22:47:40,331 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:47:40,345 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39085 8450s 2024-11-23 22:47:40,345 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39085 8450s 2024-11-23 22:47:40,345 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:47:40,345 - distributed.worker - INFO - dashboard at: 127.0.0.1:39727 8450s 2024-11-23 22:47:40,345 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:32973 8450s 2024-11-23 22:47:40,345 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:47:40,345 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:47:40,345 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:47:40,345 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-gxm2osvr 8450s 2024-11-23 22:47:40,345 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:47:40,347 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34147 8450s 2024-11-23 22:47:40,347 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34147 8450s 2024-11-23 22:47:40,347 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:47:40,347 - distributed.worker - INFO - dashboard at: 127.0.0.1:32845 8450s 2024-11-23 22:47:40,347 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:32973 8450s 2024-11-23 22:47:40,347 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:47:40,347 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:47:40,347 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:47:40,347 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-nssp0lv2 8450s 2024-11-23 22:47:40,347 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:47:40,348 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39085. Reason: failure-to-start- 8450s 2024-11-23 22:47:40,348 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:47:40,349 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34147. Reason: failure-to-start- 8450s 2024-11-23 22:47:40,349 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:47:40,353 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:32973': TLS handshake failed with remote 'tls://127.0.0.1:54944': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:47:40,353 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:32973': TLS handshake failed with remote 'tls://127.0.0.1:54956': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:47:40,355 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:47:41,361 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:47:41,368 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35061 8450s 2024-11-23 22:47:41,368 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40201/status 8450s 2024-11-23 22:47:41,368 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:47:41,384 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46235 8450s 2024-11-23 22:47:41,384 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46235 8450s 2024-11-23 22:47:41,384 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:47:41,384 - distributed.worker - INFO - dashboard at: 127.0.0.1:34103 8450s 2024-11-23 22:47:41,384 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35061 8450s 2024-11-23 22:47:41,384 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:47:41,384 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:47:41,384 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:47:41,384 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-pccfuf0c 8450s 2024-11-23 22:47:41,384 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:47:41,386 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44403 8450s 2024-11-23 22:47:41,386 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44403 8450s 2024-11-23 22:47:41,386 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:47:41,386 - distributed.worker - INFO - dashboard at: 127.0.0.1:36189 8450s 2024-11-23 22:47:41,386 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35061 8450s 2024-11-23 22:47:41,386 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:47:41,386 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:47:41,386 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:47:41,386 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-owz413kl 8450s 2024-11-23 22:47:41,387 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:47:41,391 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46235. Reason: failure-to-start- 8450s 2024-11-23 22:47:41,391 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:47:41,391 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44403. Reason: failure-to-start- 8450s 2024-11-23 22:47:41,391 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:47:41,393 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35061': TLS handshake failed with remote 'tls://127.0.0.1:33962': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:47:41,393 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35061': TLS handshake failed with remote 'tls://127.0.0.1:33966': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:47:41,395 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:47:42,399 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:47:42,407 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35333 8450s 2024-11-23 22:47:42,407 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45849/status 8450s 2024-11-23 22:47:42,407 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:47:42,423 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46623 8450s 2024-11-23 22:47:42,423 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46623 8450s 2024-11-23 22:47:42,423 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:47:42,423 - distributed.worker - INFO - dashboard at: 127.0.0.1:43181 8450s 2024-11-23 22:47:42,423 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35333 8450s 2024-11-23 22:47:42,423 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:47:42,423 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:47:42,423 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:47:42,423 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-0tlkwd06 8450s 2024-11-23 22:47:42,423 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:47:42,425 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44083 8450s 2024-11-23 22:47:42,425 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44083 8450s 2024-11-23 22:47:42,425 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:47:42,425 - distributed.worker - INFO - dashboard at: 127.0.0.1:43415 8450s 2024-11-23 22:47:42,425 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35333 8450s 2024-11-23 22:47:42,425 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:47:42,425 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:47:42,426 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:47:42,426 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-g0bcipex 8450s 2024-11-23 22:47:42,426 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:47:42,431 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46623. Reason: failure-to-start- 8450s 2024-11-23 22:47:42,432 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:47:42,432 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44083. Reason: failure-to-start- 8450s 2024-11-23 22:47:42,432 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:47:42,434 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35333': TLS handshake failed with remote 'tls://127.0.0.1:36886': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:47:42,434 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35333': TLS handshake failed with remote 'tls://127.0.0.1:36902': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:47:42,435 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:47:43,440 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:47:43,447 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35269 8450s 2024-11-23 22:47:43,448 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40949/status 8450s 2024-11-23 22:47:43,448 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:47:43,465 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34799 8450s 2024-11-23 22:47:43,466 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34799 8450s 2024-11-23 22:47:43,466 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:47:43,466 - distributed.worker - INFO - dashboard at: 127.0.0.1:36913 8450s 2024-11-23 22:47:43,466 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35269 8450s 2024-11-23 22:47:43,466 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:47:43,466 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:47:43,466 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:47:43,466 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-h0ib0o9y 8450s 2024-11-23 22:47:43,466 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:47:43,468 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42963 8450s 2024-11-23 22:47:43,468 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42963 8450s 2024-11-23 22:47:43,468 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:47:43,468 - distributed.worker - INFO - dashboard at: 127.0.0.1:45719 8450s 2024-11-23 22:47:43,469 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35269 8450s 2024-11-23 22:47:43,469 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:47:43,469 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:47:43,469 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:47:43,469 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-lcltv0jb 8450s 2024-11-23 22:47:43,469 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:47:43,472 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34799. Reason: failure-to-start- 8450s 2024-11-23 22:47:43,473 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:47:43,473 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42963. Reason: failure-to-start- 8450s 2024-11-23 22:47:43,473 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:47:43,474 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35269': TLS handshake failed with remote 'tls://127.0.0.1:47800': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:47:43,475 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35269': TLS handshake failed with remote 'tls://127.0.0.1:47816': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:47:43,479 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:47:44,484 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:47:44,491 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43241 8450s 2024-11-23 22:47:44,491 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41073/status 8450s 2024-11-23 22:47:44,492 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:47:44,509 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37707 8450s 2024-11-23 22:47:44,509 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37707 8450s 2024-11-23 22:47:44,509 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:47:44,509 - distributed.worker - INFO - dashboard at: 127.0.0.1:45811 8450s 2024-11-23 22:47:44,509 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43241 8450s 2024-11-23 22:47:44,509 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:47:44,510 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:47:44,510 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:47:44,510 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-qqanporz 8450s 2024-11-23 22:47:44,510 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:47:44,511 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42865 8450s 2024-11-23 22:47:44,511 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42865 8450s 2024-11-23 22:47:44,512 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:47:44,512 - distributed.worker - INFO - dashboard at: 127.0.0.1:40079 8450s 2024-11-23 22:47:44,512 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43241 8450s 2024-11-23 22:47:44,512 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:47:44,512 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:47:44,512 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:47:44,512 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-us2k9dl1 8450s 2024-11-23 22:47:44,512 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:47:44,517 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37707. Reason: failure-to-start- 8450s 2024-11-23 22:47:44,517 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:47:44,518 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42865. Reason: failure-to-start- 8450s 2024-11-23 22:47:44,518 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:47:44,519 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43241': TLS handshake failed with remote 'tls://127.0.0.1:37776': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:47:44,520 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43241': TLS handshake failed with remote 'tls://127.0.0.1:37788': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:47:44,521 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s __________________________ test_worker_client_gather ___________________________ 8450s 8450s fut = , timeout = 0 8450s 8450s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 8450s async with asyncio.timeout(timeout): 8450s > return await fut 8450s 8450s /usr/lib/python3/dist-packages/distributed/utils.py:1960: 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s /usr/lib/python3/dist-packages/distributed/worker.py:1480: in start_unsafe 8450s await self._register_with_scheduler() 8450s /usr/lib/python3/dist-packages/distributed/worker.py:1179: in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s /usr/lib/python3/dist-packages/distributed/comm/core.py:342: in connect 8450s comm = await wait_for( 8450s /usr/lib/python3/dist-packages/distributed/utils.py:1960: in wait_for 8450s return await fut 8450s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:546: in connect 8450s stream = await self.client.connect( 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s 8450s self = , host = '127.0.0.1' 8450s port = 37561, af = 8450s ssl_options = 8450s max_buffer_size = 8364507136.0, source_ip = None, source_port = None 8450s timeout = None 8450s 8450s async def connect( 8450s self, 8450s host: str, 8450s port: int, 8450s af: socket.AddressFamily = socket.AF_UNSPEC, 8450s ssl_options: Optional[Union[Dict[str, Any], ssl.SSLContext]] = None, 8450s max_buffer_size: Optional[int] = None, 8450s source_ip: Optional[str] = None, 8450s source_port: Optional[int] = None, 8450s timeout: Optional[Union[float, datetime.timedelta]] = None, 8450s ) -> IOStream: 8450s """Connect to the given host and port. 8450s 8450s Asynchronously returns an `.IOStream` (or `.SSLIOStream` if 8450s ``ssl_options`` is not None). 8450s 8450s Using the ``source_ip`` kwarg, one can specify the source 8450s IP address to use when establishing the connection. 8450s In case the user needs to resolve and 8450s use a specific interface, it has to be handled outside 8450s of Tornado as this depends very much on the platform. 8450s 8450s Raises `TimeoutError` if the input future does not complete before 8450s ``timeout``, which may be specified in any form allowed by 8450s `.IOLoop.add_timeout` (i.e. a `datetime.timedelta` or an absolute time 8450s relative to `.IOLoop.time`) 8450s 8450s Similarly, when the user requires a certain source port, it can 8450s be specified using the ``source_port`` arg. 8450s 8450s .. versionchanged:: 4.5 8450s Added the ``source_ip`` and ``source_port`` arguments. 8450s 8450s .. versionchanged:: 5.0 8450s Added the ``timeout`` argument. 8450s """ 8450s if timeout is not None: 8450s if isinstance(timeout, numbers.Real): 8450s timeout = IOLoop.current().time() + timeout 8450s elif isinstance(timeout, datetime.timedelta): 8450s timeout = IOLoop.current().time() + timeout.total_seconds() 8450s else: 8450s raise TypeError("Unsupported timeout %r" % timeout) 8450s if timeout is not None: 8450s addrinfo = await gen.with_timeout( 8450s timeout, self.resolver.resolve(host, port, af) 8450s ) 8450s else: 8450s addrinfo = await self.resolver.resolve(host, port, af) 8450s connector = _Connector( 8450s addrinfo, 8450s functools.partial( 8450s self._create_stream, 8450s max_buffer_size, 8450s source_ip=source_ip, 8450s source_port=source_port, 8450s ), 8450s ) 8450s > af, addr, stream = await connector.start(connect_timeout=timeout) 8450s E asyncio.exceptions.CancelledError 8450s 8450s /usr/lib/python3/dist-packages/tornado/tcpclient.py:279: CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s self = 8450s 8450s @final 8450s async def start(self): 8450s async with self._startup_lock: 8450s if self.status == Status.failed: 8450s assert self.__startup_exc is not None 8450s raise self.__startup_exc 8450s elif self.status != Status.init: 8450s return self 8450s timeout = getattr(self, "death_timeout", None) 8450s 8450s async def _close_on_failure(exc: Exception) -> None: 8450s await self.close(reason=f"failure-to-start-{str(type(exc))}") 8450s self.status = Status.failed 8450s self.__startup_exc = exc 8450s 8450s try: 8450s > await wait_for(self.start_unsafe(), timeout=timeout) 8450s 8450s /usr/lib/python3/dist-packages/distributed/core.py:664: 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 8450s async with asyncio.timeout(timeout): 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s 8450s self = 8450s exc_type = 8450s exc_val = CancelledError(), exc_tb = 8450s 8450s async def __aexit__( 8450s self, 8450s exc_type: Optional[Type[BaseException]], 8450s exc_val: Optional[BaseException], 8450s exc_tb: Optional[TracebackType], 8450s ) -> Optional[bool]: 8450s assert self._state in (_State.ENTERED, _State.EXPIRING) 8450s 8450s if self._timeout_handler is not None: 8450s self._timeout_handler.cancel() 8450s self._timeout_handler = None 8450s 8450s if self._state is _State.EXPIRING: 8450s self._state = _State.EXPIRED 8450s 8450s if self._task.uncancel() <= self._cancelling and exc_type is not None: 8450s # Since there are no new cancel requests, we're 8450s # handling this. 8450s if issubclass(exc_type, exceptions.CancelledError): 8450s > raise TimeoutError from exc_val 8450s E TimeoutError 8450s 8450s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s @contextlib.asynccontextmanager 8450s async def _cluster_factory(): 8450s workers = [] 8450s s = None 8450s try: 8450s for _ in range(60): 8450s try: 8450s > s, ws = await start_cluster( 8450s nthreads, 8450s scheduler, 8450s security=security, 8450s Worker=Worker, 8450s scheduler_kwargs=scheduler_kwargs, 8450s worker_kwargs=merge( 8450s {"death_timeout": min(15, int(deadline.remaining))}, 8450s worker_kwargs, 8450s ), 8450s ) 8450s 8450s /usr/lib/python3/dist-packages/distributed/utils_test.py:966: 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s /usr/lib/python3/dist-packages/distributed/utils_test.py:789: in start_cluster 8450s await asyncio.gather(*workers) 8450s /usr/lib/python3.13/asyncio/tasks.py:737: in _wrap_awaitable 8450s return await awaitable 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s 8450s self = 8450s 8450s @final 8450s async def start(self): 8450s async with self._startup_lock: 8450s if self.status == Status.failed: 8450s assert self.__startup_exc is not None 8450s raise self.__startup_exc 8450s elif self.status != Status.init: 8450s return self 8450s timeout = getattr(self, "death_timeout", None) 8450s 8450s async def _close_on_failure(exc: Exception) -> None: 8450s await self.close(reason=f"failure-to-start-{str(type(exc))}") 8450s self.status = Status.failed 8450s self.__startup_exc = exc 8450s 8450s try: 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s except asyncio.TimeoutError as exc: 8450s await _close_on_failure(exc) 8450s > raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s E TimeoutError: Worker start timed out after 0s. 8450s 8450s /usr/lib/python3/dist-packages/distributed/core.py:667: TimeoutError 8450s 8450s During handling of the above exception, another exception occurred: 8450s 8450s fut = ._..test_func..async_fn at 0xe8325938> 8450s timeout = 60 8450s 8450s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 8450s async with asyncio.timeout(timeout): 8450s > return await fut 8450s 8450s /usr/lib/python3/dist-packages/distributed/utils.py:1960: 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s /usr/lib/python3/dist-packages/distributed/utils_test.py:999: in async_fn 8450s _cluster_factory() as (s, workers), 8450s /usr/lib/python3.13/contextlib.py:214: in __aenter__ 8450s return await anext(self.gen) 8450s /usr/lib/python3/dist-packages/distributed/utils_test.py:983: in _cluster_factory 8450s await asyncio.sleep(1) 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s 8450s delay = 1, result = None 8450s 8450s async def sleep(delay, result=None): 8450s """Coroutine that completes after a given time (in seconds).""" 8450s if delay <= 0: 8450s await __sleep0() 8450s return result 8450s 8450s if math.isnan(delay): 8450s raise ValueError("Invalid delay: NaN (not a number)") 8450s 8450s loop = events.get_running_loop() 8450s future = loop.create_future() 8450s h = loop.call_later(delay, 8450s futures._set_result_unless_cancelled, 8450s future, result) 8450s try: 8450s > return await future 8450s E asyncio.exceptions.CancelledError 8450s 8450s /usr/lib/python3.13/asyncio/tasks.py:718: CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s args = (), kwds = {} 8450s 8450s @wraps(func) 8450s def inner(*args, **kwds): 8450s with self._recreate_cm(): 8450s > return func(*args, **kwds) 8450s 8450s /usr/lib/python3.13/contextlib.py:85: 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s /usr/lib/python3.13/contextlib.py:85: in inner 8450s return func(*args, **kwds) 8450s /usr/lib/python3/dist-packages/distributed/utils_test.py:1102: in test_func 8450s return _run_and_close_tornado(async_fn_outer) 8450s /usr/lib/python3/dist-packages/distributed/utils_test.py:378: in _run_and_close_tornado 8450s return asyncio_run(inner_fn(), loop_factory=get_loop_factory()) 8450s /usr/lib/python3.13/asyncio/runners.py:194: in run 8450s return runner.run(main) 8450s /usr/lib/python3.13/asyncio/runners.py:118: in run 8450s return self._loop.run_until_complete(task) 8450s /usr/lib/python3.13/asyncio/base_events.py:720: in run_until_complete 8450s return future.result() 8450s /usr/lib/python3/dist-packages/distributed/utils_test.py:375: in inner_fn 8450s return await async_fn(*args, **kwargs) 8450s /usr/lib/python3/dist-packages/distributed/utils_test.py:1099: in async_fn_outer 8450s return await utils_wait_for(async_fn(), timeout=timeout * 2) 8450s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 8450s async with asyncio.timeout(timeout): 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s 8450s self = 8450s exc_type = 8450s exc_val = CancelledError(), exc_tb = 8450s 8450s async def __aexit__( 8450s self, 8450s exc_type: Optional[Type[BaseException]], 8450s exc_val: Optional[BaseException], 8450s exc_tb: Optional[TracebackType], 8450s ) -> Optional[bool]: 8450s assert self._state in (_State.ENTERED, _State.EXPIRING) 8450s 8450s if self._timeout_handler is not None: 8450s self._timeout_handler.cancel() 8450s self._timeout_handler = None 8450s 8450s if self._state is _State.EXPIRING: 8450s self._state = _State.EXPIRED 8450s 8450s if self._task.uncancel() <= self._cancelling and exc_type is not None: 8450s # Since there are no new cancel requests, we're 8450s # handling this. 8450s if issubclass(exc_type, exceptions.CancelledError): 8450s > raise TimeoutError from exc_val 8450s E TimeoutError 8450s 8450s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 8450s ----------------------------- Captured stderr call ----------------------------- 8450s 2024-11-23 22:47:45,877 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:47:45,887 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:45,887 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46859/status 8450s 2024-11-23 22:47:45,887 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:47:45,902 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42897 8450s 2024-11-23 22:47:45,902 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42897 8450s 2024-11-23 22:47:45,902 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:47:45,902 - distributed.worker - INFO - dashboard at: 127.0.0.1:40551 8450s 2024-11-23 22:47:45,902 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:45,902 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:47:45,902 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:47:45,902 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:47:45,902 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ssqkfaij 8450s 2024-11-23 22:47:45,903 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:47:45,904 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34741 8450s 2024-11-23 22:47:45,904 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34741 8450s 2024-11-23 22:47:45,904 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:47:45,904 - distributed.worker - INFO - dashboard at: 127.0.0.1:46625 8450s 2024-11-23 22:47:45,904 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:45,905 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:47:45,905 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:47:45,905 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:47:45,905 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-c7lvvuur 8450s 2024-11-23 22:47:45,905 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:47:45,917 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:45,917 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:45,917 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:47124': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:45,917 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:47128': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:46,029 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:46,029 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:46,029 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:47138': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:46,029 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:47152': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:46,143 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:46,143 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:46,143 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:47168': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:46,143 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:47172': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:46,255 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:46,256 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:46,256 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:47176': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:46,256 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:47188': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:46,368 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:46,369 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:46,369 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:47194': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:46,369 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:47210': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:46,481 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:46,481 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:46,481 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:47224': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:46,482 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:47226': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:46,594 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:46,594 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:46,594 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:47240': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:46,594 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:47246': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:46,706 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:46,706 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:46,707 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:47262': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:46,707 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:47264': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:46,819 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:46,820 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:46,820 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:47268': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:46,820 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:47282': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:46,932 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:46,932 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:46,933 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:47296': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:46,933 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:47312': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:47,045 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:47,045 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:47,046 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:47320': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:47,046 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:47336': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:47,157 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:47,157 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:47,158 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:47346': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:47,158 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:47348': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:47,270 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:47,270 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:47,271 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:47356': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:47,271 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:47370': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:47,382 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:47,382 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:47,383 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:47380': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:47,383 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:47392': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:47,495 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:47,495 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:47,496 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:47400': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:47,496 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:47404': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:47,608 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:47,609 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:47,609 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:47406': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:47,609 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:47408': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:47,723 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:47,723 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:47,723 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:47414': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:47,723 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:47422': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:47,835 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:47,835 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:47,836 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:47426': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:47,836 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:47430': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:47,947 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:47,947 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:47,948 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:47438': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:47,948 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:47450': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:48,060 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:48,060 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:48,060 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:47452': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:48,061 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:47458': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:48,172 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:48,172 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:48,172 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:47462': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:48,173 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:47466': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:48,285 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:48,285 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:48,285 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:47468': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:48,285 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:47470': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:48,402 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:48,402 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:48,403 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:47472': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:48,403 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:47478': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:48,514 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:48,514 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:48,514 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:47494': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:48,515 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:47508': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:48,627 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:48,627 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:48,627 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:47520': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:48,627 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:47522': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:48,739 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:48,739 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:48,739 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:47524': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:48,739 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:47532': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:48,851 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:48,851 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:48,852 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:47536': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:48,852 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:47544': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:48,965 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:48,965 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:48,965 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:47556': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:48,965 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:47572': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:49,078 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:49,078 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:49,078 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:47580': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:49,078 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:47592': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:49,190 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:49,190 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:49,190 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:47594': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:49,190 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:47606': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:49,302 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:49,302 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:49,302 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:47612': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:49,303 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:47614': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:49,415 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:49,415 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:49,416 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:47628': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:49,416 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:47644': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:49,529 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:49,529 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:49,529 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:47658': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:49,529 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:47668': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:49,641 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:49,641 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:49,642 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:47684': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:49,642 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:47700': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:49,754 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:49,754 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:49,754 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:47710': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:49,755 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:47714': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:49,868 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:49,868 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:49,868 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:47716': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:49,868 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:47720': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:49,980 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:49,980 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:49,980 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:47736': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:49,980 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:47752': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:50,093 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:50,093 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:50,093 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:47754': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:50,094 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:47768': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:50,205 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:50,205 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:50,206 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:47776': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:50,206 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:47784': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:50,319 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:50,320 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:50,320 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:47790': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:50,320 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:47798': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:50,431 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:50,432 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:50,432 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:47814': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:50,432 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:47816': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:50,544 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:50,544 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:50,544 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:47830': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:50,544 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:47834': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:50,656 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:50,656 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:50,657 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:47848': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:50,657 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:47850': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:50,769 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:50,769 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:50,769 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:47866': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:50,769 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:47872': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:50,881 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:50,881 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:50,881 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:47878': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:50,881 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:47892': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:50,994 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:50,995 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:50,995 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:47908': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:50,995 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:47916': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:51,107 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:51,107 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:51,107 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:47930': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:51,108 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:47936': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:51,219 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:51,220 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:51,220 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:47942': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:51,220 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:47946': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:51,333 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:51,333 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:51,334 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:47954': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:51,334 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:47970': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:51,446 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:51,446 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:51,446 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:47984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:51,446 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:47990': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:51,558 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:51,558 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:51,558 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:34930': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:51,558 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:34938': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:51,670 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:51,670 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:51,671 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:34944': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:51,671 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:34960': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:51,783 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:51,783 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:51,783 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:34964': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:51,783 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:34966': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:51,896 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:51,896 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:51,901 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:34972': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:51,901 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:34976': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:52,008 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:52,009 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:52,009 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:34992': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:52,009 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:34998': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:52,121 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:52,122 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:52,122 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:35014': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:52,122 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:35016': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:52,234 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:52,234 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:52,234 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:35024': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:52,234 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:35026': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:52,346 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:52,347 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:52,347 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:35042': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:52,347 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:35054': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:52,458 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:52,458 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:52,459 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:35056': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:52,459 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:35064': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:52,572 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:52,572 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:52,572 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:35072': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:52,572 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:35078': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:52,684 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:52,684 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:52,684 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:35094': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:52,684 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:35100': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:52,798 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:52,798 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:52,798 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:35104': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:52,798 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:35118': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:52,910 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:52,910 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:52,911 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:35134': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:52,911 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:35146': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:53,022 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:53,022 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:53,022 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:35158': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:53,022 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:35170': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:53,135 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:53,135 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:53,136 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:35186': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:53,136 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:35192': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:53,248 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:53,248 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:53,248 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:35204': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:53,248 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:35212': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:53,361 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:53,361 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:53,361 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:35218': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:53,361 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:35226': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:53,474 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:53,474 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:53,474 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:35228': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:53,474 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:35232': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:53,587 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:53,587 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:53,587 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:35244': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:53,587 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:35252': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:53,698 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:53,699 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:53,699 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:35256': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:53,699 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:35270': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:53,810 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:53,810 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:53,811 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:35276': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:53,811 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:35280': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:53,924 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:53,924 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:53,924 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:35282': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:53,924 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:35296': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:54,037 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:54,037 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:54,037 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:35312': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:54,038 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:35322': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:54,154 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:54,154 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:54,155 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:35334': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:54,155 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:35350': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:54,272 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:54,273 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:54,273 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:35352': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:54,273 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:35362': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:54,389 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:54,390 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:54,391 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:35378': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:54,391 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:35392': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:54,506 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:54,506 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:54,507 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:35396': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:54,507 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:35406': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:54,630 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:54,631 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:54,631 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:35418': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:54,631 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:35434': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:54,746 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:54,747 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:54,747 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:35442': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:54,748 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:35452': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:54,864 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:54,865 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:54,865 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:35466': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:54,866 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:35472': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:54,983 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:54,983 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:54,984 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:35476': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:54,984 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:35478': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:55,100 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:55,101 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:55,102 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:35492': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:55,102 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:35504': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:55,218 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:55,219 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:55,219 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:35520': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:55,219 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:35526': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:55,335 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:55,336 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:55,337 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:35542': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:55,337 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:35552': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:55,453 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:55,453 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:55,454 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:35560': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:55,454 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:35572': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:55,570 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:55,570 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:55,571 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:35586': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:55,571 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:35600': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:55,686 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:55,687 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:55,688 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:35604': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:55,688 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:35610': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:55,803 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:55,804 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:55,804 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:35622': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:55,805 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:35624': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:55,920 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:55,921 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:55,921 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:35636': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:55,922 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:35644': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:56,037 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:56,038 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:56,039 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:35658': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:56,039 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:35670': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:56,154 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:56,154 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:56,155 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:35684': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:56,155 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:35698': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:56,272 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:56,273 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:56,273 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:35710': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:56,274 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:35724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:56,389 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:56,390 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:56,391 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:35734': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:56,391 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:35738': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:56,506 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:56,506 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:56,507 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:35740': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:56,507 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:35742': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:56,623 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:56,624 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:56,624 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:35758': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:56,625 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:35770': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:56,740 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:56,741 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:56,741 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:35776': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:56,742 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:35782': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:56,858 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:56,858 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:56,859 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:35796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:56,859 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:35804': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:56,974 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:56,975 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:56,975 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:35814': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:56,976 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:35820': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:57,093 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:57,093 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:57,094 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:35826': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:57,094 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:35836': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:57,210 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:57,210 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:57,211 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:35852': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:57,211 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:35858': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:57,327 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:57,327 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:57,328 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:35874': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:57,328 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:35878': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:57,444 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:57,445 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:57,445 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:35894': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:57,445 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:35898': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:57,561 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:57,561 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:57,562 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:35904': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:57,562 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:35906': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:57,677 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:57,678 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:57,679 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:35922': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:57,679 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:35932': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:57,794 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:57,795 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:57,795 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:35936': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:57,796 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:35950': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:57,910 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:57,911 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:57,911 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:35966': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:57,912 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:35976': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:58,027 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:58,028 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:58,028 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:35982': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:58,028 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:35988': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:58,144 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:58,145 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:58,145 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:35992': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:58,146 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:36002': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:58,264 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:58,264 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:58,265 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:36010': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:58,265 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:36022': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:58,381 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:58,382 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:58,382 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:36038': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:58,383 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:36042': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:58,498 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:58,499 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:58,500 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:36044': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:58,500 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:36046': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:58,616 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:58,616 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:58,617 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:36050': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:58,617 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:36064': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:58,733 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:58,734 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:58,734 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:36078': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:58,735 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:36092': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:58,851 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:58,851 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:58,852 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:36094': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:58,852 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:36102': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:58,967 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:58,968 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:58,969 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:36110': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:58,969 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:36118': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:59,085 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:59,085 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:59,086 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:36122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:59,086 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:36134': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:59,201 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:59,202 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:59,202 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:36148': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:59,203 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:36156': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:59,319 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:59,319 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:59,320 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:36160': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:59,320 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:36164': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:59,436 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:59,437 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:59,437 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:36176': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:59,438 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:36182': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:59,555 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:59,555 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:59,556 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:36196': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:59,556 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:36204': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:59,672 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:59,673 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:59,674 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:36212': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:59,674 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:36218': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:59,791 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:59,791 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:59,792 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:36220': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:59,793 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:36234': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:59,910 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:59,911 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:47:59,911 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:36250': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:47:59,912 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:36264': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:00,027 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:48:00,027 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:48:00,028 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:36280': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:00,028 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:36286': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:00,147 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:48:00,148 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:48:00,148 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:36298': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:00,149 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:36308': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:00,265 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:48:00,265 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:48:00,266 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:36322': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:00,266 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:36328': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:00,383 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:48:00,383 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:48:00,384 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:36336': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:00,384 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:36338': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:00,501 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:48:00,502 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:48:00,502 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:36340': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:00,503 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:36346': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:00,620 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:48:00,620 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:48:00,621 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:36350': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:00,621 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:36356': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:00,737 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:48:00,737 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:48:00,738 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:36362': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:00,738 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:36374': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:00,854 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:48:00,855 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43665 8450s 2024-11-23 22:48:00,855 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:36380': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:00,856 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43665': TLS handshake failed with remote 'tls://127.0.0.1:36394': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:00,902 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42897. Reason: failure-to-start- 8450s 2024-11-23 22:48:00,902 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:48:00,904 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34741. Reason: failure-to-start- 8450s 2024-11-23 22:48:00,905 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:48:00,908 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 15s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 8450s stream = await stream.start_tls( 8450s ^^^^^^^^^^^^^^^^^^^^^^^ 8450s False, ssl_options=ssl_options, server_hostname=host 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 8450s self.socket.do_handshake() 8450s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 8450s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 8450s self._sslobj.do_handshake() 8450s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 8450s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 8450s raise FatalCommClosedError( 8450s ...<2 lines>... 8450s ) from err 8450s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 8450s 8450s During handling of the above exception, another exception occurred: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1218, in _register_with_scheduler 8450s await asyncio.sleep(0.1) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 718, in sleep 8450s return await future 8450s ^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 15s. 8450s 2024-11-23 22:48:01,917 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:48:01,929 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:01,930 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33509/status 8450s 2024-11-23 22:48:01,930 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:48:01,957 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44755 8450s 2024-11-23 22:48:01,958 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44755 8450s 2024-11-23 22:48:01,958 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:48:01,958 - distributed.worker - INFO - dashboard at: 127.0.0.1:40821 8450s 2024-11-23 22:48:01,958 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:01,958 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:48:01,958 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:48:01,958 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:48:01,958 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-hihse0t6 8450s 2024-11-23 22:48:01,958 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:48:01,962 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44043 8450s 2024-11-23 22:48:01,963 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44043 8450s 2024-11-23 22:48:01,963 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:48:01,963 - distributed.worker - INFO - dashboard at: 127.0.0.1:38149 8450s 2024-11-23 22:48:01,963 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:01,963 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:48:01,963 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:48:01,963 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:48:01,963 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-x9gjfc28 8450s 2024-11-23 22:48:01,963 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:48:01,980 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:01,980 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:01,981 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:38946': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:01,981 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:38962': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:02,097 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:02,097 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:02,098 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:38978': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:02,098 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:38990': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:02,215 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:02,216 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:02,216 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:38994': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:02,216 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:39000': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:02,332 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:02,332 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:02,333 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:39012': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:02,333 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:39016': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:02,452 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:02,453 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:02,453 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:39026': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:02,454 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:39036': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:02,569 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:02,569 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:02,570 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:39040': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:02,570 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:39056': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:02,686 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:02,687 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:02,688 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:39060': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:02,688 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:39064': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:02,804 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:02,804 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:02,805 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:39076': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:02,805 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:39092': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:02,921 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:02,922 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:02,922 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:39100': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:02,923 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:39110': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:03,037 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:03,039 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:03,040 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:39122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:03,040 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:39126': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:03,149 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:03,151 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:39128': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:03,157 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:03,158 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:39142': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:03,259 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:03,261 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:39150': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:03,269 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:03,270 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:39154': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:03,370 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:03,370 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:39162': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:03,379 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:03,380 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:39166': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:03,480 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:03,481 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:39168': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:03,490 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:03,491 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:39178': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:03,591 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:03,592 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:39180': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:03,601 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:03,601 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:39184': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:03,700 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:03,701 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:39186': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:03,710 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:03,711 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:39194': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:03,813 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:03,814 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:39198': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:03,822 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:03,823 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:39208': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:03,923 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:03,924 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:39210': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:03,933 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:03,939 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:39220': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:04,033 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:04,034 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:39236': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:04,043 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:04,044 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:39246': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:04,143 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:04,145 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:39254': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:04,153 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:04,154 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:39268': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:04,254 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:04,255 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:39284': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:04,264 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:04,265 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:39294': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:04,364 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:04,365 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:39308': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:04,374 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:04,375 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:39324': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:04,475 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:04,475 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:39332': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:04,484 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:04,485 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:39348': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:04,585 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:04,586 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:39364': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:04,595 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:04,595 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:39378': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:04,695 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:04,696 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:39386': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:04,704 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:04,705 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:39388': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:04,805 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:04,806 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:39394': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:04,814 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:04,815 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:39396': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:04,915 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:04,916 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:39400': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:04,925 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:04,926 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:39410': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:05,026 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:05,027 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:39424': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:05,036 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:05,037 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:39434': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:05,139 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:05,141 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:39450': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:05,149 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:05,150 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:39460': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:05,249 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:05,250 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:39464': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:05,258 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:05,259 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:39468': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:05,360 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:05,361 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:39478': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:05,369 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:05,370 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:39492': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:05,471 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:05,472 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:39502': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:05,480 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:05,481 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:39504': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:05,582 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:05,583 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:39512': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:05,592 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:05,593 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:39524': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:05,692 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:05,693 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:39532': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:05,702 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:05,703 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:39548': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:05,803 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:05,804 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:39564': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:05,812 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:05,813 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:39568': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:05,913 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:05,914 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:39576': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:05,922 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:05,923 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:39592': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:06,023 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:06,023 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:39606': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:06,032 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:06,033 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:39618': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:06,133 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:06,134 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:39620': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:06,143 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:06,144 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:39634': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:06,243 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:06,243 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:39648': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:06,252 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:06,253 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:39650': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:06,352 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:06,353 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:39656': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:06,362 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:06,362 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:39660': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:06,464 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:06,465 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:39672': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:06,473 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:06,474 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:39684': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:06,573 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:06,574 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:39690': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:06,583 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:06,583 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:39706': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:06,684 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:06,685 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:39716': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:06,694 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:06,695 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:39718': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:06,796 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:06,797 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:39732': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:06,808 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:06,809 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:39738': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:06,906 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:06,907 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:39742': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:06,917 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:06,918 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:39758': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:07,018 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:07,019 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:39764': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:07,030 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:07,031 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:39766': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:07,128 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:07,129 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:39782': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:07,140 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:07,141 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:39786': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:07,239 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:07,240 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:39792': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:07,250 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:07,251 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:39802': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:07,349 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:07,350 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:39816': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:07,359 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:07,360 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:39824': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:07,460 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:07,461 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:39826': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:07,469 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:07,470 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:39836': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:07,570 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:07,571 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:39848': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:07,580 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:07,581 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:39850': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:07,678 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:07,678 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:39856': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:07,687 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:07,687 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:39858': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:07,785 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:07,785 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:39866': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:07,794 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:07,794 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:39880': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:07,892 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:07,896 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:39896': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:07,902 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:07,903 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:39902': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:07,999 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:07,999 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:39908': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:08,009 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:08,010 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:39910': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:08,106 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:08,107 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:39926': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:08,116 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:08,116 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:39942': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:08,213 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:08,214 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:39956': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:08,223 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:08,223 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:39960': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:08,321 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:08,322 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:39970': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:08,330 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:08,330 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:39984': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:08,428 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:08,428 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:39994': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:08,441 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:08,441 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:40010': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:08,535 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:08,535 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:40016': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:08,547 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:08,548 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:40026': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:08,642 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:08,642 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:40030': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:08,654 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:08,655 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:40040': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:08,748 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:08,749 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:40044': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:08,761 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:08,761 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:40056': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:08,856 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:08,857 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:40072': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:08,868 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:08,868 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:40086': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:08,963 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:08,963 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:40092': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:08,974 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:08,975 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:40104': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:09,071 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:09,071 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:40120': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:09,081 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:09,082 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:40136': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:09,179 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:09,179 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:40140': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:09,187 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:09,188 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:40154': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:09,286 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:09,286 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:40158': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:09,294 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:09,294 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:40164': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:09,396 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:09,397 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:40168': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:09,402 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:09,403 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:40172': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:09,503 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:09,503 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:40174': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:09,509 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:09,509 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:40182': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:09,610 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:09,611 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:40196': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:09,616 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:09,616 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:40202': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:09,717 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:09,718 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:40212': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:09,724 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:09,724 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:40216': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:09,825 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:09,825 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:40224': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:09,831 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:09,831 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:40230': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:09,933 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:09,937 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:40234': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:09,943 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:09,943 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:40238': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:10,040 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:10,040 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:40240': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:10,049 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:10,050 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:40250': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:10,148 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:10,148 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:40264': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:10,156 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:10,156 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:40268': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:10,254 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:10,255 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:40284': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:10,263 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:10,263 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:40296': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:10,361 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:10,361 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:40298': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:10,369 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:10,370 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:40306': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:10,468 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:10,468 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:40322': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:10,475 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:10,476 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:40324': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:10,575 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:10,575 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:40338': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:10,582 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:10,583 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:40340': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:10,682 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:10,683 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:40350': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:10,688 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:10,689 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:40358': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:10,792 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:10,792 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:40362': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:10,798 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:10,798 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:40370': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:10,898 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:10,898 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:40374': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:10,904 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:10,905 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:40380': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:11,006 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:11,006 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:40382': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:11,012 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:11,012 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:40398': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:11,113 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:11,114 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:40414': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:11,119 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:11,120 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:40418': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:11,221 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:11,222 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:40424': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:11,227 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:11,227 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:40428': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:11,329 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:11,329 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:40430': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:11,335 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:11,336 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:40446': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:11,440 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:11,440 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:40450': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:11,446 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:11,446 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:40456': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:11,548 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:11,548 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:40620': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:11,554 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:11,554 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:40626': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:11,655 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:11,655 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:40630': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:11,661 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:11,661 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:40642': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:11,763 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:11,764 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:40652': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:11,769 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:11,770 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:40664': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:11,870 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:11,871 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:40678': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:11,876 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:11,877 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:40694': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:11,978 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:11,978 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:40700': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:11,984 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:11,984 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:40708': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:12,085 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:12,085 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:40712': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:12,091 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:12,091 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:40714': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:12,192 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:12,193 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:40718': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:12,199 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:12,199 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:40722': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:12,300 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:12,300 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:40730': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:12,306 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:12,306 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:40742': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:12,407 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:12,407 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:40744': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:12,413 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:12,413 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:40746': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:12,516 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:12,517 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:40750': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:12,522 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:12,522 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:40758': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:12,623 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:12,624 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:40764': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:12,630 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:12,630 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:40776': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:12,732 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:12,733 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:40780': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:12,738 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:12,738 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:40788': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:12,838 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:12,838 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:40796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:12,844 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:12,845 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:40812': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:12,946 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:12,946 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:40814': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:12,952 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:12,952 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:40818': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:13,052 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:13,053 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:40824': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:13,058 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:13,059 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:40828': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:13,159 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:13,159 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:40834': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:13,165 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:13,166 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:40842': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:13,267 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:13,267 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:40848': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:13,273 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:13,273 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:40860': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:13,375 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:13,376 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:40870': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:13,382 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:13,382 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:40886': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:13,482 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:13,482 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:40890': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:13,488 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:13,488 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:40896': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:13,590 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:13,591 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:40904': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:13,596 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:13,597 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:40912': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:13,697 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:13,697 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:40924': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:13,703 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:13,703 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:40940': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:13,805 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:13,805 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:40944': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:13,811 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:13,811 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:40954': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:13,912 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:13,913 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:40966': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:13,918 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:13,918 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:40970': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:14,019 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:14,019 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:40976': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:14,025 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:14,025 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:40992': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:14,125 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:14,126 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:41002': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:14,131 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:14,132 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:41010': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:14,233 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:14,234 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:41024': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:14,240 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:14,240 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:41032': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:14,340 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:14,340 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:41040': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:14,346 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:14,346 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:41042': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:14,446 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:14,447 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:41046': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:14,453 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:14,453 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:41050': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:14,553 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:14,553 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:41062': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:14,559 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:14,559 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:41078': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:14,660 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:14,660 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:41086': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:14,666 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:14,666 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:41100': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:14,767 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:14,767 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:41114': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:14,773 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:14,773 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:41118': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:14,874 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:14,875 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:41120': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:14,880 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36561 8450s 2024-11-23 22:48:14,881 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36561': TLS handshake failed with remote 'tls://127.0.0.1:41132': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:14,952 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44755. Reason: failure-to-start- 8450s 2024-11-23 22:48:14,952 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:48:14,954 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 13s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 8450s stream = await stream.start_tls( 8450s ^^^^^^^^^^^^^^^^^^^^^^^ 8450s False, ssl_options=ssl_options, server_hostname=host 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 8450s self.socket.do_handshake() 8450s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 8450s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 8450s self._sslobj.do_handshake() 8450s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 8450s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 8450s raise FatalCommClosedError( 8450s ...<2 lines>... 8450s ) from err 8450s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 8450s 8450s During handling of the above exception, another exception occurred: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1218, in _register_with_scheduler 8450s await asyncio.sleep(0.1) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 718, in sleep 8450s return await future 8450s ^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 13s. 8450s 2024-11-23 22:48:14,960 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44043. Reason: failure-to-start- 8450s 2024-11-23 22:48:14,960 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:48:15,963 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:48:15,970 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44839 8450s 2024-11-23 22:48:15,971 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33577/status 8450s 2024-11-23 22:48:15,971 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:48:15,984 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34421 8450s 2024-11-23 22:48:15,985 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34421 8450s 2024-11-23 22:48:15,985 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:48:15,985 - distributed.worker - INFO - dashboard at: 127.0.0.1:44675 8450s 2024-11-23 22:48:15,985 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44839 8450s 2024-11-23 22:48:15,985 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:48:15,985 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:48:15,985 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:48:15,985 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-mg1pyh56 8450s 2024-11-23 22:48:15,985 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:48:15,987 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45571 8450s 2024-11-23 22:48:15,987 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45571 8450s 2024-11-23 22:48:15,987 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:48:15,987 - distributed.worker - INFO - dashboard at: 127.0.0.1:45611 8450s 2024-11-23 22:48:15,987 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44839 8450s 2024-11-23 22:48:15,987 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:48:15,987 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:48:15,987 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:48:15,987 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-r69_vyoh 8450s 2024-11-23 22:48:15,987 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:48:15,988 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34421. Reason: failure-to-start- 8450s 2024-11-23 22:48:15,988 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:48:15,988 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45571. Reason: failure-to-start- 8450s 2024-11-23 22:48:15,988 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:48:15,990 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44839': TLS handshake failed with remote 'tls://127.0.0.1:39008': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:48:15,990 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44839': TLS handshake failed with remote 'tls://127.0.0.1:39024': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:48:15,991 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:48:16,996 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:48:17,003 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44951 8450s 2024-11-23 22:48:17,004 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38187/status 8450s 2024-11-23 22:48:17,004 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:48:17,018 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36519 8450s 2024-11-23 22:48:17,019 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36519 8450s 2024-11-23 22:48:17,019 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:48:17,019 - distributed.worker - INFO - dashboard at: 127.0.0.1:45855 8450s 2024-11-23 22:48:17,019 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44951 8450s 2024-11-23 22:48:17,019 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:48:17,019 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:48:17,019 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:48:17,019 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-gqg3526v 8450s 2024-11-23 22:48:17,019 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:48:17,020 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33675 8450s 2024-11-23 22:48:17,021 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33675 8450s 2024-11-23 22:48:17,021 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:48:17,021 - distributed.worker - INFO - dashboard at: 127.0.0.1:39909 8450s 2024-11-23 22:48:17,021 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44951 8450s 2024-11-23 22:48:17,021 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:48:17,021 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:48:17,021 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:48:17,021 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-pc0225f8 8450s 2024-11-23 22:48:17,021 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:48:17,022 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36519. Reason: failure-to-start- 8450s 2024-11-23 22:48:17,022 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:48:17,022 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33675. Reason: failure-to-start- 8450s 2024-11-23 22:48:17,022 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:48:17,023 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44951': TLS handshake failed with remote 'tls://127.0.0.1:55444': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:48:17,023 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44951': TLS handshake failed with remote 'tls://127.0.0.1:55460': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:48:17,025 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:48:18,030 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:48:18,057 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45359 8450s 2024-11-23 22:48:18,057 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39821/status 8450s 2024-11-23 22:48:18,057 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:48:18,073 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46083 8450s 2024-11-23 22:48:18,073 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46083 8450s 2024-11-23 22:48:18,073 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:48:18,073 - distributed.worker - INFO - dashboard at: 127.0.0.1:41017 8450s 2024-11-23 22:48:18,073 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45359 8450s 2024-11-23 22:48:18,073 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:48:18,073 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:48:18,073 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:48:18,073 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-jr6nq0jt 8450s 2024-11-23 22:48:18,074 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:48:18,076 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36607 8450s 2024-11-23 22:48:18,076 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36607 8450s 2024-11-23 22:48:18,076 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:48:18,076 - distributed.worker - INFO - dashboard at: 127.0.0.1:43651 8450s 2024-11-23 22:48:18,076 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45359 8450s 2024-11-23 22:48:18,076 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:48:18,076 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:48:18,076 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:48:18,077 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-idokqfa9 8450s 2024-11-23 22:48:18,077 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:48:18,077 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46083. Reason: failure-to-start- 8450s 2024-11-23 22:48:18,077 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:48:18,078 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36607. Reason: failure-to-start- 8450s 2024-11-23 22:48:18,078 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:48:18,079 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45359': TLS handshake failed with remote 'tls://127.0.0.1:49794': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:48:18,079 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45359': TLS handshake failed with remote 'tls://127.0.0.1:49796': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:48:18,080 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:48:19,085 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:48:19,092 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46147 8450s 2024-11-23 22:48:19,092 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34547/status 8450s 2024-11-23 22:48:19,092 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:48:19,106 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37327 8450s 2024-11-23 22:48:19,106 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37327 8450s 2024-11-23 22:48:19,106 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:48:19,106 - distributed.worker - INFO - dashboard at: 127.0.0.1:41577 8450s 2024-11-23 22:48:19,106 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46147 8450s 2024-11-23 22:48:19,106 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:48:19,106 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:48:19,106 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:48:19,106 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-dgq88u5c 8450s 2024-11-23 22:48:19,106 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:48:19,108 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42431 8450s 2024-11-23 22:48:19,108 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42431 8450s 2024-11-23 22:48:19,108 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:48:19,108 - distributed.worker - INFO - dashboard at: 127.0.0.1:45409 8450s 2024-11-23 22:48:19,108 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46147 8450s 2024-11-23 22:48:19,108 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:48:19,108 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:48:19,108 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:48:19,108 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ktbr39jo 8450s 2024-11-23 22:48:19,109 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:48:19,109 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37327. Reason: failure-to-start- 8450s 2024-11-23 22:48:19,109 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:48:19,110 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42431. Reason: failure-to-start- 8450s 2024-11-23 22:48:19,110 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:48:19,111 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46147': TLS handshake failed with remote 'tls://127.0.0.1:42902': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:48:19,111 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46147': TLS handshake failed with remote 'tls://127.0.0.1:42916': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:48:19,112 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:48:20,118 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:48:20,126 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40401 8450s 2024-11-23 22:48:20,126 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40531/status 8450s 2024-11-23 22:48:20,126 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:48:20,139 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44217 8450s 2024-11-23 22:48:20,139 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44217 8450s 2024-11-23 22:48:20,139 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:48:20,139 - distributed.worker - INFO - dashboard at: 127.0.0.1:36851 8450s 2024-11-23 22:48:20,139 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40401 8450s 2024-11-23 22:48:20,139 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:48:20,139 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:48:20,140 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:48:20,140 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-7t0yg3zl 8450s 2024-11-23 22:48:20,140 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:48:20,141 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45883 8450s 2024-11-23 22:48:20,141 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45883 8450s 2024-11-23 22:48:20,141 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:48:20,141 - distributed.worker - INFO - dashboard at: 127.0.0.1:39939 8450s 2024-11-23 22:48:20,142 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40401 8450s 2024-11-23 22:48:20,142 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:48:20,142 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:48:20,142 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:48:20,142 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-8clyoeg6 8450s 2024-11-23 22:48:20,142 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:48:20,143 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44217. Reason: failure-to-start- 8450s 2024-11-23 22:48:20,143 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:48:20,143 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45883. Reason: failure-to-start- 8450s 2024-11-23 22:48:20,143 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:48:20,144 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40401': TLS handshake failed with remote 'tls://127.0.0.1:41974': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:48:20,144 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40401': TLS handshake failed with remote 'tls://127.0.0.1:41982': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:48:20,145 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:48:21,151 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:48:21,158 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35883 8450s 2024-11-23 22:48:21,158 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38533/status 8450s 2024-11-23 22:48:21,158 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:48:21,173 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40623 8450s 2024-11-23 22:48:21,173 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40623 8450s 2024-11-23 22:48:21,173 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:48:21,173 - distributed.worker - INFO - dashboard at: 127.0.0.1:41979 8450s 2024-11-23 22:48:21,173 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35883 8450s 2024-11-23 22:48:21,173 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:48:21,173 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:48:21,174 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:48:21,174 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ty6ihlrv 8450s 2024-11-23 22:48:21,174 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:48:21,175 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43807 8450s 2024-11-23 22:48:21,176 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43807 8450s 2024-11-23 22:48:21,176 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:48:21,176 - distributed.worker - INFO - dashboard at: 127.0.0.1:38567 8450s 2024-11-23 22:48:21,176 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35883 8450s 2024-11-23 22:48:21,176 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:48:21,176 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:48:21,176 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:48:21,176 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-mnc8k15v 8450s 2024-11-23 22:48:21,176 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:48:21,177 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40623. Reason: failure-to-start- 8450s 2024-11-23 22:48:21,177 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:48:21,177 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43807. Reason: failure-to-start- 8450s 2024-11-23 22:48:21,177 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:48:21,178 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35883': TLS handshake failed with remote 'tls://127.0.0.1:51496': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:48:21,179 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35883': TLS handshake failed with remote 'tls://127.0.0.1:51502': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:48:21,180 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:48:22,185 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:48:22,191 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46349 8450s 2024-11-23 22:48:22,192 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41815/status 8450s 2024-11-23 22:48:22,192 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:48:22,204 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33539 8450s 2024-11-23 22:48:22,205 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33539 8450s 2024-11-23 22:48:22,205 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:48:22,205 - distributed.worker - INFO - dashboard at: 127.0.0.1:38697 8450s 2024-11-23 22:48:22,205 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46349 8450s 2024-11-23 22:48:22,205 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:48:22,205 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:48:22,205 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:48:22,205 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-h2_6khiw 8450s 2024-11-23 22:48:22,205 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:48:22,207 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39973 8450s 2024-11-23 22:48:22,208 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39973 8450s 2024-11-23 22:48:22,208 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:48:22,208 - distributed.worker - INFO - dashboard at: 127.0.0.1:36767 8450s 2024-11-23 22:48:22,208 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46349 8450s 2024-11-23 22:48:22,208 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:48:22,208 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:48:22,208 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:48:22,208 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-d8ds3hlj 8450s 2024-11-23 22:48:22,208 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:48:22,209 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33539. Reason: failure-to-start- 8450s 2024-11-23 22:48:22,209 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:48:22,209 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39973. Reason: failure-to-start- 8450s 2024-11-23 22:48:22,210 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:48:22,211 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46349': TLS handshake failed with remote 'tls://127.0.0.1:37090': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:48:22,211 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46349': TLS handshake failed with remote 'tls://127.0.0.1:37098': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:48:22,212 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:48:23,216 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:48:23,224 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44255 8450s 2024-11-23 22:48:23,224 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37231/status 8450s 2024-11-23 22:48:23,224 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:48:23,238 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42045 8450s 2024-11-23 22:48:23,238 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42045 8450s 2024-11-23 22:48:23,238 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:48:23,238 - distributed.worker - INFO - dashboard at: 127.0.0.1:44033 8450s 2024-11-23 22:48:23,238 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44255 8450s 2024-11-23 22:48:23,238 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:48:23,238 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:48:23,238 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:48:23,238 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-8idavrv6 8450s 2024-11-23 22:48:23,238 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:48:23,240 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33983 8450s 2024-11-23 22:48:23,240 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33983 8450s 2024-11-23 22:48:23,240 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:48:23,240 - distributed.worker - INFO - dashboard at: 127.0.0.1:45901 8450s 2024-11-23 22:48:23,240 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44255 8450s 2024-11-23 22:48:23,240 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:48:23,240 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:48:23,240 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:48:23,241 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-h_pohpc8 8450s 2024-11-23 22:48:23,241 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:48:23,242 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42045. Reason: failure-to-start- 8450s 2024-11-23 22:48:23,242 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:48:23,243 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33983. Reason: failure-to-start- 8450s 2024-11-23 22:48:23,243 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:48:23,244 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44255': TLS handshake failed with remote 'tls://127.0.0.1:56766': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:48:23,244 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44255': TLS handshake failed with remote 'tls://127.0.0.1:56768': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:48:23,245 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:48:24,250 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:48:24,259 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41947 8450s 2024-11-23 22:48:24,259 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45823/status 8450s 2024-11-23 22:48:24,259 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:48:24,273 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40301 8450s 2024-11-23 22:48:24,273 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40301 8450s 2024-11-23 22:48:24,273 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:48:24,273 - distributed.worker - INFO - dashboard at: 127.0.0.1:39579 8450s 2024-11-23 22:48:24,273 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41947 8450s 2024-11-23 22:48:24,273 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:48:24,273 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:48:24,273 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:48:24,273 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-2xdrjpik 8450s 2024-11-23 22:48:24,273 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:48:24,275 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40083 8450s 2024-11-23 22:48:24,275 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40083 8450s 2024-11-23 22:48:24,275 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:48:24,275 - distributed.worker - INFO - dashboard at: 127.0.0.1:36481 8450s 2024-11-23 22:48:24,275 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41947 8450s 2024-11-23 22:48:24,275 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:48:24,275 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:48:24,275 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:48:24,275 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-0n46462y 8450s 2024-11-23 22:48:24,275 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:48:24,276 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40301. Reason: failure-to-start- 8450s 2024-11-23 22:48:24,276 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:48:24,277 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40083. Reason: failure-to-start- 8450s 2024-11-23 22:48:24,277 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:48:24,278 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41947': TLS handshake failed with remote 'tls://127.0.0.1:43402': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:48:24,278 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41947': TLS handshake failed with remote 'tls://127.0.0.1:43404': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:48:24,279 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:48:25,285 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:48:25,292 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45427 8450s 2024-11-23 22:48:25,292 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34477/status 8450s 2024-11-23 22:48:25,292 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:48:25,307 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37355 8450s 2024-11-23 22:48:25,307 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37355 8450s 2024-11-23 22:48:25,307 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:48:25,307 - distributed.worker - INFO - dashboard at: 127.0.0.1:34169 8450s 2024-11-23 22:48:25,307 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45427 8450s 2024-11-23 22:48:25,307 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:48:25,307 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:48:25,307 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:48:25,307 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-b4qeuc68 8450s 2024-11-23 22:48:25,308 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:48:25,309 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45251 8450s 2024-11-23 22:48:25,309 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45251 8450s 2024-11-23 22:48:25,309 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:48:25,309 - distributed.worker - INFO - dashboard at: 127.0.0.1:46035 8450s 2024-11-23 22:48:25,309 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45427 8450s 2024-11-23 22:48:25,309 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:48:25,310 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:48:25,310 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:48:25,310 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-wufi6c7e 8450s 2024-11-23 22:48:25,310 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:48:25,311 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37355. Reason: failure-to-start- 8450s 2024-11-23 22:48:25,311 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:48:25,311 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45251. Reason: failure-to-start- 8450s 2024-11-23 22:48:25,311 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:48:25,312 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45427': TLS handshake failed with remote 'tls://127.0.0.1:49818': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:48:25,312 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45427': TLS handshake failed with remote 'tls://127.0.0.1:49834': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:48:25,313 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:48:26,318 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:48:26,325 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45875 8450s 2024-11-23 22:48:26,326 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40143/status 8450s 2024-11-23 22:48:26,326 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:48:26,339 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34075 8450s 2024-11-23 22:48:26,340 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34075 8450s 2024-11-23 22:48:26,340 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:48:26,340 - distributed.worker - INFO - dashboard at: 127.0.0.1:41359 8450s 2024-11-23 22:48:26,340 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45875 8450s 2024-11-23 22:48:26,340 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:48:26,340 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:48:26,340 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:48:26,340 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-1rw1lo20 8450s 2024-11-23 22:48:26,340 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:48:26,342 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33761 8450s 2024-11-23 22:48:26,343 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33761 8450s 2024-11-23 22:48:26,343 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:48:26,343 - distributed.worker - INFO - dashboard at: 127.0.0.1:34463 8450s 2024-11-23 22:48:26,343 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45875 8450s 2024-11-23 22:48:26,343 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:48:26,343 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:48:26,343 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:48:26,343 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-jbztn9ht 8450s 2024-11-23 22:48:26,343 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:48:26,344 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34075. Reason: failure-to-start- 8450s 2024-11-23 22:48:26,344 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:48:26,344 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33761. Reason: failure-to-start- 8450s 2024-11-23 22:48:26,345 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:48:26,346 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45875': TLS handshake failed with remote 'tls://127.0.0.1:42750': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:48:26,346 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45875': TLS handshake failed with remote 'tls://127.0.0.1:42766': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:48:26,347 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:48:27,352 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:48:27,359 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34327 8450s 2024-11-23 22:48:27,359 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38677/status 8450s 2024-11-23 22:48:27,359 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:48:27,372 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35417 8450s 2024-11-23 22:48:27,372 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35417 8450s 2024-11-23 22:48:27,372 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:48:27,372 - distributed.worker - INFO - dashboard at: 127.0.0.1:37095 8450s 2024-11-23 22:48:27,372 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34327 8450s 2024-11-23 22:48:27,372 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:48:27,372 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:48:27,372 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:48:27,372 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-9ayzcx2i 8450s 2024-11-23 22:48:27,372 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:48:27,374 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37139 8450s 2024-11-23 22:48:27,374 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37139 8450s 2024-11-23 22:48:27,374 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:48:27,374 - distributed.worker - INFO - dashboard at: 127.0.0.1:33665 8450s 2024-11-23 22:48:27,374 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34327 8450s 2024-11-23 22:48:27,374 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:48:27,375 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:48:27,375 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:48:27,375 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-hlaxyqjt 8450s 2024-11-23 22:48:27,375 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:48:27,375 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35417. Reason: failure-to-start- 8450s 2024-11-23 22:48:27,376 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:48:27,376 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37139. Reason: failure-to-start- 8450s 2024-11-23 22:48:27,376 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:48:27,377 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34327': TLS handshake failed with remote 'tls://127.0.0.1:54756': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:48:27,377 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34327': TLS handshake failed with remote 'tls://127.0.0.1:54760': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:48:27,379 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:48:28,384 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:48:28,391 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44995 8450s 2024-11-23 22:48:28,391 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41733/status 8450s 2024-11-23 22:48:28,391 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:48:28,408 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33309 8450s 2024-11-23 22:48:28,408 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33309 8450s 2024-11-23 22:48:28,408 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:48:28,408 - distributed.worker - INFO - dashboard at: 127.0.0.1:40715 8450s 2024-11-23 22:48:28,408 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44995 8450s 2024-11-23 22:48:28,408 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:48:28,408 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:48:28,408 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:48:28,408 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-qpcyh39d 8450s 2024-11-23 22:48:28,409 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:48:28,410 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45345 8450s 2024-11-23 22:48:28,410 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45345 8450s 2024-11-23 22:48:28,410 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:48:28,410 - distributed.worker - INFO - dashboard at: 127.0.0.1:40033 8450s 2024-11-23 22:48:28,410 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44995 8450s 2024-11-23 22:48:28,410 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:48:28,410 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:48:28,411 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:48:28,411 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-vt8irqi_ 8450s 2024-11-23 22:48:28,411 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:48:28,412 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33309. Reason: failure-to-start- 8450s 2024-11-23 22:48:28,412 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:48:28,412 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45345. Reason: failure-to-start- 8450s 2024-11-23 22:48:28,412 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:48:28,413 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44995': TLS handshake failed with remote 'tls://127.0.0.1:42882': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:48:28,413 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44995': TLS handshake failed with remote 'tls://127.0.0.1:42898': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:48:28,415 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:48:29,419 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:48:29,427 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43627 8450s 2024-11-23 22:48:29,427 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38467/status 8450s 2024-11-23 22:48:29,427 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:48:29,442 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45533 8450s 2024-11-23 22:48:29,442 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45533 8450s 2024-11-23 22:48:29,442 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:48:29,442 - distributed.worker - INFO - dashboard at: 127.0.0.1:39513 8450s 2024-11-23 22:48:29,442 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43627 8450s 2024-11-23 22:48:29,442 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:48:29,442 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:48:29,443 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:48:29,443 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-7cxiq0nq 8450s 2024-11-23 22:48:29,443 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:48:29,444 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36383 8450s 2024-11-23 22:48:29,444 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36383 8450s 2024-11-23 22:48:29,445 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:48:29,445 - distributed.worker - INFO - dashboard at: 127.0.0.1:41529 8450s 2024-11-23 22:48:29,445 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43627 8450s 2024-11-23 22:48:29,445 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:48:29,445 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:48:29,445 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:48:29,445 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-1kou_wtd 8450s 2024-11-23 22:48:29,445 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:48:29,448 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45533. Reason: failure-to-start- 8450s 2024-11-23 22:48:29,448 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:48:29,448 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36383. Reason: failure-to-start- 8450s 2024-11-23 22:48:29,449 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:48:29,450 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43627': TLS handshake failed with remote 'tls://127.0.0.1:43944': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:48:29,450 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43627': TLS handshake failed with remote 'tls://127.0.0.1:43950': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:48:29,451 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:48:30,456 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:48:30,463 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41981 8450s 2024-11-23 22:48:30,463 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46739/status 8450s 2024-11-23 22:48:30,464 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:48:30,478 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36081 8450s 2024-11-23 22:48:30,478 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36081 8450s 2024-11-23 22:48:30,478 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:48:30,479 - distributed.worker - INFO - dashboard at: 127.0.0.1:33273 8450s 2024-11-23 22:48:30,479 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41981 8450s 2024-11-23 22:48:30,479 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:48:30,479 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:48:30,479 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:48:30,479 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-iokf6sv0 8450s 2024-11-23 22:48:30,479 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:48:30,481 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39041 8450s 2024-11-23 22:48:30,481 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39041 8450s 2024-11-23 22:48:30,481 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:48:30,481 - distributed.worker - INFO - dashboard at: 127.0.0.1:42201 8450s 2024-11-23 22:48:30,481 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41981 8450s 2024-11-23 22:48:30,481 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:48:30,481 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:48:30,481 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:48:30,481 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-fu7t6zn8 8450s 2024-11-23 22:48:30,481 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:48:30,484 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36081. Reason: failure-to-start- 8450s 2024-11-23 22:48:30,484 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:48:30,485 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39041. Reason: failure-to-start- 8450s 2024-11-23 22:48:30,485 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:48:30,486 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41981': TLS handshake failed with remote 'tls://127.0.0.1:48400': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:48:30,486 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41981': TLS handshake failed with remote 'tls://127.0.0.1:48416': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:48:30,487 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:48:31,493 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:48:31,500 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37265 8450s 2024-11-23 22:48:31,500 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34245/status 8450s 2024-11-23 22:48:31,500 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:48:31,515 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34491 8450s 2024-11-23 22:48:31,515 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34491 8450s 2024-11-23 22:48:31,515 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:48:31,515 - distributed.worker - INFO - dashboard at: 127.0.0.1:33559 8450s 2024-11-23 22:48:31,515 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37265 8450s 2024-11-23 22:48:31,515 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:48:31,515 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:48:31,515 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:48:31,515 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-5mkdswpq 8450s 2024-11-23 22:48:31,515 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:48:31,517 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35229 8450s 2024-11-23 22:48:31,517 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35229 8450s 2024-11-23 22:48:31,518 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:48:31,518 - distributed.worker - INFO - dashboard at: 127.0.0.1:46281 8450s 2024-11-23 22:48:31,518 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37265 8450s 2024-11-23 22:48:31,518 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:48:31,518 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:48:31,518 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:48:31,518 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-vwfy_mpd 8450s 2024-11-23 22:48:31,518 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:48:31,532 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34491. Reason: failure-to-start- 8450s 2024-11-23 22:48:31,533 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:48:31,533 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35229. Reason: failure-to-start- 8450s 2024-11-23 22:48:31,533 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:48:31,534 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37265': TLS handshake failed with remote 'tls://127.0.0.1:33186': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:48:31,534 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37265': TLS handshake failed with remote 'tls://127.0.0.1:47852': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:48:31,536 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:48:32,540 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:48:32,547 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36627 8450s 2024-11-23 22:48:32,548 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:32785/status 8450s 2024-11-23 22:48:32,548 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:48:32,561 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43615 8450s 2024-11-23 22:48:32,561 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43615 8450s 2024-11-23 22:48:32,561 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:48:32,561 - distributed.worker - INFO - dashboard at: 127.0.0.1:35145 8450s 2024-11-23 22:48:32,561 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36627 8450s 2024-11-23 22:48:32,561 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:48:32,561 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:48:32,561 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:48:32,561 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-d8gy3hxi 8450s 2024-11-23 22:48:32,561 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:48:32,563 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44333 8450s 2024-11-23 22:48:32,563 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44333 8450s 2024-11-23 22:48:32,563 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:48:32,563 - distributed.worker - INFO - dashboard at: 127.0.0.1:46721 8450s 2024-11-23 22:48:32,563 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36627 8450s 2024-11-23 22:48:32,563 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:48:32,563 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:48:32,564 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:48:32,564 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-6aqmamu_ 8450s 2024-11-23 22:48:32,564 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:48:32,567 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43615. Reason: failure-to-start- 8450s 2024-11-23 22:48:32,567 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:48:32,567 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44333. Reason: failure-to-start- 8450s 2024-11-23 22:48:32,567 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:48:32,569 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36627': TLS handshake failed with remote 'tls://127.0.0.1:60100': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:48:32,569 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36627': TLS handshake failed with remote 'tls://127.0.0.1:60112': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:48:32,570 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:48:33,575 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:48:33,584 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40799 8450s 2024-11-23 22:48:33,584 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34355/status 8450s 2024-11-23 22:48:33,584 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:48:33,599 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44447 8450s 2024-11-23 22:48:33,599 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44447 8450s 2024-11-23 22:48:33,599 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:48:33,599 - distributed.worker - INFO - dashboard at: 127.0.0.1:41731 8450s 2024-11-23 22:48:33,599 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40799 8450s 2024-11-23 22:48:33,599 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:48:33,599 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:48:33,599 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:48:33,600 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-xf4apav6 8450s 2024-11-23 22:48:33,600 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:48:33,601 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44361 8450s 2024-11-23 22:48:33,602 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44361 8450s 2024-11-23 22:48:33,602 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:48:33,602 - distributed.worker - INFO - dashboard at: 127.0.0.1:43855 8450s 2024-11-23 22:48:33,602 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40799 8450s 2024-11-23 22:48:33,602 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:48:33,602 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:48:33,602 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:48:33,602 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-zuisblws 8450s 2024-11-23 22:48:33,602 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:48:33,606 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44447. Reason: failure-to-start- 8450s 2024-11-23 22:48:33,606 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:48:33,606 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44361. Reason: failure-to-start- 8450s 2024-11-23 22:48:33,606 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:48:33,607 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40799': TLS handshake failed with remote 'tls://127.0.0.1:54108': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:48:33,608 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40799': TLS handshake failed with remote 'tls://127.0.0.1:54118': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:48:33,609 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:48:34,615 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:48:34,622 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44081 8450s 2024-11-23 22:48:34,622 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36217/status 8450s 2024-11-23 22:48:34,622 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:48:34,638 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46581 8450s 2024-11-23 22:48:34,638 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46581 8450s 2024-11-23 22:48:34,638 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:48:34,638 - distributed.worker - INFO - dashboard at: 127.0.0.1:33419 8450s 2024-11-23 22:48:34,638 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44081 8450s 2024-11-23 22:48:34,638 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:48:34,638 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:48:34,639 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:48:34,639 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-xg_v1lzu 8450s 2024-11-23 22:48:34,639 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:48:34,640 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46811 8450s 2024-11-23 22:48:34,641 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46811 8450s 2024-11-23 22:48:34,641 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:48:34,641 - distributed.worker - INFO - dashboard at: 127.0.0.1:37159 8450s 2024-11-23 22:48:34,641 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44081 8450s 2024-11-23 22:48:34,641 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:48:34,641 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:48:34,641 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:48:34,641 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-nlvv0fy0 8450s 2024-11-23 22:48:34,641 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:48:34,645 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46581. Reason: failure-to-start- 8450s 2024-11-23 22:48:34,645 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:48:34,645 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46811. Reason: failure-to-start- 8450s 2024-11-23 22:48:34,645 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:48:34,647 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44081': TLS handshake failed with remote 'tls://127.0.0.1:33474': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:48:34,647 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44081': TLS handshake failed with remote 'tls://127.0.0.1:33490': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:48:34,648 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:48:35,653 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:48:35,659 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37131 8450s 2024-11-23 22:48:35,660 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34389/status 8450s 2024-11-23 22:48:35,660 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:48:35,677 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40443 8450s 2024-11-23 22:48:35,678 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40443 8450s 2024-11-23 22:48:35,678 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:48:35,678 - distributed.worker - INFO - dashboard at: 127.0.0.1:39961 8450s 2024-11-23 22:48:35,678 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37131 8450s 2024-11-23 22:48:35,678 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:48:35,678 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:48:35,678 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:48:35,678 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-_x914zqc 8450s 2024-11-23 22:48:35,678 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:48:35,680 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46757 8450s 2024-11-23 22:48:35,680 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46757 8450s 2024-11-23 22:48:35,680 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:48:35,680 - distributed.worker - INFO - dashboard at: 127.0.0.1:39455 8450s 2024-11-23 22:48:35,680 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37131 8450s 2024-11-23 22:48:35,680 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:48:35,680 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:48:35,680 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:48:35,680 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-s0c0g0am 8450s 2024-11-23 22:48:35,680 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:48:35,682 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40443. Reason: failure-to-start- 8450s 2024-11-23 22:48:35,682 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:48:35,683 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46757. Reason: failure-to-start- 8450s 2024-11-23 22:48:35,683 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:48:35,684 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37131': TLS handshake failed with remote 'tls://127.0.0.1:42098': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:48:35,684 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37131': TLS handshake failed with remote 'tls://127.0.0.1:42114': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:48:35,685 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:48:36,690 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:48:36,697 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42397 8450s 2024-11-23 22:48:36,697 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45235/status 8450s 2024-11-23 22:48:36,698 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:48:36,714 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40887 8450s 2024-11-23 22:48:36,714 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40887 8450s 2024-11-23 22:48:36,714 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:48:36,714 - distributed.worker - INFO - dashboard at: 127.0.0.1:43099 8450s 2024-11-23 22:48:36,714 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42397 8450s 2024-11-23 22:48:36,714 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:48:36,714 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:48:36,714 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:48:36,714 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-h8o4syhg 8450s 2024-11-23 22:48:36,714 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:48:36,716 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34315 8450s 2024-11-23 22:48:36,716 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34315 8450s 2024-11-23 22:48:36,716 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:48:36,716 - distributed.worker - INFO - dashboard at: 127.0.0.1:45943 8450s 2024-11-23 22:48:36,716 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42397 8450s 2024-11-23 22:48:36,716 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:48:36,716 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:48:36,716 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:48:36,716 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-gwj4wqrq 8450s 2024-11-23 22:48:36,716 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:48:36,717 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40887. Reason: failure-to-start- 8450s 2024-11-23 22:48:36,717 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:48:36,718 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34315. Reason: failure-to-start- 8450s 2024-11-23 22:48:36,718 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:48:36,719 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42397': TLS handshake failed with remote 'tls://127.0.0.1:51980': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:48:36,719 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42397': TLS handshake failed with remote 'tls://127.0.0.1:51994': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:48:36,720 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:48:37,726 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:48:37,734 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37559 8450s 2024-11-23 22:48:37,734 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34989/status 8450s 2024-11-23 22:48:37,734 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:48:37,750 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45073 8450s 2024-11-23 22:48:37,750 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45073 8450s 2024-11-23 22:48:37,751 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:48:37,751 - distributed.worker - INFO - dashboard at: 127.0.0.1:36881 8450s 2024-11-23 22:48:37,751 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37559 8450s 2024-11-23 22:48:37,751 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:48:37,751 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:48:37,751 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:48:37,751 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-mryt5pda 8450s 2024-11-23 22:48:37,751 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:48:37,753 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45051 8450s 2024-11-23 22:48:37,753 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45051 8450s 2024-11-23 22:48:37,753 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:48:37,753 - distributed.worker - INFO - dashboard at: 127.0.0.1:39649 8450s 2024-11-23 22:48:37,753 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37559 8450s 2024-11-23 22:48:37,753 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:48:37,753 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:48:37,753 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:48:37,753 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-aw8d21hl 8450s 2024-11-23 22:48:37,753 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:48:37,754 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45073. Reason: failure-to-start- 8450s 2024-11-23 22:48:37,754 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:48:37,755 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45051. Reason: failure-to-start- 8450s 2024-11-23 22:48:37,755 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:48:37,756 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37559': TLS handshake failed with remote 'tls://127.0.0.1:46068': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:48:37,756 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37559': TLS handshake failed with remote 'tls://127.0.0.1:46074': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:48:37,757 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:48:38,764 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:48:38,770 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39787 8450s 2024-11-23 22:48:38,771 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42515/status 8450s 2024-11-23 22:48:38,771 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:48:38,786 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44539 8450s 2024-11-23 22:48:38,786 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44539 8450s 2024-11-23 22:48:38,786 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:48:38,786 - distributed.worker - INFO - dashboard at: 127.0.0.1:34757 8450s 2024-11-23 22:48:38,786 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 8450s 2024-11-23 22:48:38,786 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:48:38,786 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:48:38,786 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:48:38,786 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-75m_pdq7 8450s 2024-11-23 22:48:38,786 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:48:38,788 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45065 8450s 2024-11-23 22:48:38,788 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45065 8450s 2024-11-23 22:48:38,788 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:48:38,788 - distributed.worker - INFO - dashboard at: 127.0.0.1:41927 8450s 2024-11-23 22:48:38,788 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 8450s 2024-11-23 22:48:38,788 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:48:38,788 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:48:38,788 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:48:38,788 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-lebou_j7 8450s 2024-11-23 22:48:38,788 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:48:38,789 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44539. Reason: failure-to-start- 8450s 2024-11-23 22:48:38,789 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:48:38,790 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45065. Reason: failure-to-start- 8450s 2024-11-23 22:48:38,790 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:48:38,791 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:53496': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:48:38,791 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:53500': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:48:38,792 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:48:39,797 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:48:39,803 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44233 8450s 2024-11-23 22:48:39,804 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46427/status 8450s 2024-11-23 22:48:39,804 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:48:39,817 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35585 8450s 2024-11-23 22:48:39,817 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35585 8450s 2024-11-23 22:48:39,817 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:48:39,817 - distributed.worker - INFO - dashboard at: 127.0.0.1:39289 8450s 2024-11-23 22:48:39,817 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44233 8450s 2024-11-23 22:48:39,818 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:48:39,818 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:48:39,818 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:48:39,818 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-mdh91jax 8450s 2024-11-23 22:48:39,818 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:48:39,820 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40247 8450s 2024-11-23 22:48:39,820 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40247 8450s 2024-11-23 22:48:39,820 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:48:39,821 - distributed.worker - INFO - dashboard at: 127.0.0.1:38695 8450s 2024-11-23 22:48:39,821 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44233 8450s 2024-11-23 22:48:39,821 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:48:39,821 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:48:39,821 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:48:39,821 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ftc_y2l2 8450s 2024-11-23 22:48:39,821 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:48:39,822 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35585. Reason: failure-to-start- 8450s 2024-11-23 22:48:39,822 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:48:39,822 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40247. Reason: failure-to-start- 8450s 2024-11-23 22:48:39,822 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:48:39,823 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44233': TLS handshake failed with remote 'tls://127.0.0.1:43958': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:48:39,823 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44233': TLS handshake failed with remote 'tls://127.0.0.1:43970': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:48:39,825 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:48:40,832 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:48:40,838 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33367 8450s 2024-11-23 22:48:40,839 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40063/status 8450s 2024-11-23 22:48:40,839 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:48:40,853 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41485 8450s 2024-11-23 22:48:40,853 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41485 8450s 2024-11-23 22:48:40,853 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:48:40,853 - distributed.worker - INFO - dashboard at: 127.0.0.1:41311 8450s 2024-11-23 22:48:40,853 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33367 8450s 2024-11-23 22:48:40,853 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:48:40,853 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:48:40,853 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:48:40,853 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-vkexuwqb 8450s 2024-11-23 22:48:40,853 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:48:40,855 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43591 8450s 2024-11-23 22:48:40,855 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43591 8450s 2024-11-23 22:48:40,855 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:48:40,855 - distributed.worker - INFO - dashboard at: 127.0.0.1:40607 8450s 2024-11-23 22:48:40,855 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33367 8450s 2024-11-23 22:48:40,855 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:48:40,856 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:48:40,856 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:48:40,856 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-g9knroxt 8450s 2024-11-23 22:48:40,856 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:48:40,857 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41485. Reason: failure-to-start- 8450s 2024-11-23 22:48:40,857 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:48:40,857 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43591. Reason: failure-to-start- 8450s 2024-11-23 22:48:40,857 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:48:40,858 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33367': TLS handshake failed with remote 'tls://127.0.0.1:37696': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:48:40,858 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33367': TLS handshake failed with remote 'tls://127.0.0.1:37706': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:48:40,860 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:48:41,865 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:48:41,872 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39753 8450s 2024-11-23 22:48:41,872 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41435/status 8450s 2024-11-23 22:48:41,873 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:48:41,887 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33171 8450s 2024-11-23 22:48:41,887 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33171 8450s 2024-11-23 22:48:41,887 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:48:41,887 - distributed.worker - INFO - dashboard at: 127.0.0.1:43871 8450s 2024-11-23 22:48:41,887 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39753 8450s 2024-11-23 22:48:41,887 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:48:41,887 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:48:41,887 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:48:41,887 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-q9hs9c64 8450s 2024-11-23 22:48:41,887 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:48:41,889 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35823 8450s 2024-11-23 22:48:41,889 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35823 8450s 2024-11-23 22:48:41,889 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:48:41,889 - distributed.worker - INFO - dashboard at: 127.0.0.1:36093 8450s 2024-11-23 22:48:41,889 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39753 8450s 2024-11-23 22:48:41,889 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:48:41,889 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:48:41,890 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:48:41,890 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-9v4qf5ie 8450s 2024-11-23 22:48:41,890 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:48:41,891 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33171. Reason: failure-to-start- 8450s 2024-11-23 22:48:41,891 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:48:41,891 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35823. Reason: failure-to-start- 8450s 2024-11-23 22:48:41,891 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:48:41,895 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39753': TLS handshake failed with remote 'tls://127.0.0.1:37498': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:48:41,895 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39753': TLS handshake failed with remote 'tls://127.0.0.1:37500': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:48:41,899 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:48:42,905 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:48:42,911 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39247 8450s 2024-11-23 22:48:42,912 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39169/status 8450s 2024-11-23 22:48:42,912 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:48:42,927 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34205 8450s 2024-11-23 22:48:42,927 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34205 8450s 2024-11-23 22:48:42,927 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:48:42,927 - distributed.worker - INFO - dashboard at: 127.0.0.1:45493 8450s 2024-11-23 22:48:42,927 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39247 8450s 2024-11-23 22:48:42,927 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:48:42,927 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:48:42,927 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:48:42,927 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-z82yg27u 8450s 2024-11-23 22:48:42,928 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:48:42,929 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45141 8450s 2024-11-23 22:48:42,929 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45141 8450s 2024-11-23 22:48:42,929 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:48:42,929 - distributed.worker - INFO - dashboard at: 127.0.0.1:33907 8450s 2024-11-23 22:48:42,929 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39247 8450s 2024-11-23 22:48:42,930 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:48:42,930 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:48:42,930 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:48:42,930 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-vjzfh5xe 8450s 2024-11-23 22:48:42,930 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:48:42,931 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34205. Reason: failure-to-start- 8450s 2024-11-23 22:48:42,931 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:48:42,931 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45141. Reason: failure-to-start- 8450s 2024-11-23 22:48:42,931 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:48:42,935 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39247': TLS handshake failed with remote 'tls://127.0.0.1:47476': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:48:42,935 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39247': TLS handshake failed with remote 'tls://127.0.0.1:47480': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:48:42,939 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:48:43,944 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:48:43,952 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33841 8450s 2024-11-23 22:48:43,952 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40809/status 8450s 2024-11-23 22:48:43,952 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:48:43,968 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44391 8450s 2024-11-23 22:48:43,968 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44391 8450s 2024-11-23 22:48:43,968 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:48:43,968 - distributed.worker - INFO - dashboard at: 127.0.0.1:32883 8450s 2024-11-23 22:48:43,968 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33841 8450s 2024-11-23 22:48:43,968 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:48:43,968 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:48:43,968 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:48:43,968 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-2qamw5i2 8450s 2024-11-23 22:48:43,969 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:48:43,970 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44829 8450s 2024-11-23 22:48:43,970 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44829 8450s 2024-11-23 22:48:43,970 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:48:43,970 - distributed.worker - INFO - dashboard at: 127.0.0.1:41197 8450s 2024-11-23 22:48:43,970 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33841 8450s 2024-11-23 22:48:43,970 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:48:43,970 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:48:43,971 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:48:43,971 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-kd8s18mq 8450s 2024-11-23 22:48:43,971 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:48:43,974 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44391. Reason: failure-to-start- 8450s 2024-11-23 22:48:43,974 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:48:43,975 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44829. Reason: failure-to-start- 8450s 2024-11-23 22:48:43,975 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:48:43,978 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33841': TLS handshake failed with remote 'tls://127.0.0.1:52494': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:48:43,978 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33841': TLS handshake failed with remote 'tls://127.0.0.1:52504': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:48:43,980 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:48:44,985 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:48:44,992 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37561 8450s 2024-11-23 22:48:44,992 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38279/status 8450s 2024-11-23 22:48:44,992 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:48:45,007 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43321 8450s 2024-11-23 22:48:45,007 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43321 8450s 2024-11-23 22:48:45,007 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:48:45,008 - distributed.worker - INFO - dashboard at: 127.0.0.1:46387 8450s 2024-11-23 22:48:45,008 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37561 8450s 2024-11-23 22:48:45,008 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:48:45,008 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:48:45,008 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:48:45,008 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ujjq87zq 8450s 2024-11-23 22:48:45,008 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:48:45,010 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46111 8450s 2024-11-23 22:48:45,010 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46111 8450s 2024-11-23 22:48:45,010 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:48:45,010 - distributed.worker - INFO - dashboard at: 127.0.0.1:43681 8450s 2024-11-23 22:48:45,010 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37561 8450s 2024-11-23 22:48:45,010 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:48:45,010 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:48:45,010 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:48:45,011 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-c3gxv29q 8450s 2024-11-23 22:48:45,011 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:48:45,018 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43321. Reason: failure-to-start- 8450s 2024-11-23 22:48:45,018 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:48:45,019 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46111. Reason: failure-to-start- 8450s 2024-11-23 22:48:45,019 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:48:45,020 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37561': TLS handshake failed with remote 'tls://127.0.0.1:36512': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:48:45,020 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37561': TLS handshake failed with remote 'tls://127.0.0.1:36518': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:48:45,022 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s _________________________ test_worker_client_executor __________________________ 8450s 8450s fut = , timeout = 0 8450s 8450s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 8450s async with asyncio.timeout(timeout): 8450s > return await fut 8450s 8450s /usr/lib/python3/dist-packages/distributed/utils.py:1960: 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s /usr/lib/python3/dist-packages/distributed/worker.py:1480: in start_unsafe 8450s await self._register_with_scheduler() 8450s /usr/lib/python3/dist-packages/distributed/worker.py:1179: in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s /usr/lib/python3/dist-packages/distributed/comm/core.py:342: in connect 8450s comm = await wait_for( 8450s /usr/lib/python3/dist-packages/distributed/utils.py:1960: in wait_for 8450s return await fut 8450s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:546: in connect 8450s stream = await self.client.connect( 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s 8450s self = , host = '127.0.0.1' 8450s port = 34327, af = 8450s ssl_options = 8450s max_buffer_size = 8364507136.0, source_ip = None, source_port = None 8450s timeout = None 8450s 8450s async def connect( 8450s self, 8450s host: str, 8450s port: int, 8450s af: socket.AddressFamily = socket.AF_UNSPEC, 8450s ssl_options: Optional[Union[Dict[str, Any], ssl.SSLContext]] = None, 8450s max_buffer_size: Optional[int] = None, 8450s source_ip: Optional[str] = None, 8450s source_port: Optional[int] = None, 8450s timeout: Optional[Union[float, datetime.timedelta]] = None, 8450s ) -> IOStream: 8450s """Connect to the given host and port. 8450s 8450s Asynchronously returns an `.IOStream` (or `.SSLIOStream` if 8450s ``ssl_options`` is not None). 8450s 8450s Using the ``source_ip`` kwarg, one can specify the source 8450s IP address to use when establishing the connection. 8450s In case the user needs to resolve and 8450s use a specific interface, it has to be handled outside 8450s of Tornado as this depends very much on the platform. 8450s 8450s Raises `TimeoutError` if the input future does not complete before 8450s ``timeout``, which may be specified in any form allowed by 8450s `.IOLoop.add_timeout` (i.e. a `datetime.timedelta` or an absolute time 8450s relative to `.IOLoop.time`) 8450s 8450s Similarly, when the user requires a certain source port, it can 8450s be specified using the ``source_port`` arg. 8450s 8450s .. versionchanged:: 4.5 8450s Added the ``source_ip`` and ``source_port`` arguments. 8450s 8450s .. versionchanged:: 5.0 8450s Added the ``timeout`` argument. 8450s """ 8450s if timeout is not None: 8450s if isinstance(timeout, numbers.Real): 8450s timeout = IOLoop.current().time() + timeout 8450s elif isinstance(timeout, datetime.timedelta): 8450s timeout = IOLoop.current().time() + timeout.total_seconds() 8450s else: 8450s raise TypeError("Unsupported timeout %r" % timeout) 8450s if timeout is not None: 8450s addrinfo = await gen.with_timeout( 8450s timeout, self.resolver.resolve(host, port, af) 8450s ) 8450s else: 8450s addrinfo = await self.resolver.resolve(host, port, af) 8450s connector = _Connector( 8450s addrinfo, 8450s functools.partial( 8450s self._create_stream, 8450s max_buffer_size, 8450s source_ip=source_ip, 8450s source_port=source_port, 8450s ), 8450s ) 8450s > af, addr, stream = await connector.start(connect_timeout=timeout) 8450s E asyncio.exceptions.CancelledError 8450s 8450s /usr/lib/python3/dist-packages/tornado/tcpclient.py:279: CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s self = 8450s 8450s @final 8450s async def start(self): 8450s async with self._startup_lock: 8450s if self.status == Status.failed: 8450s assert self.__startup_exc is not None 8450s raise self.__startup_exc 8450s elif self.status != Status.init: 8450s return self 8450s timeout = getattr(self, "death_timeout", None) 8450s 8450s async def _close_on_failure(exc: Exception) -> None: 8450s await self.close(reason=f"failure-to-start-{str(type(exc))}") 8450s self.status = Status.failed 8450s self.__startup_exc = exc 8450s 8450s try: 8450s > await wait_for(self.start_unsafe(), timeout=timeout) 8450s 8450s /usr/lib/python3/dist-packages/distributed/core.py:664: 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 8450s async with asyncio.timeout(timeout): 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s 8450s self = 8450s exc_type = 8450s exc_val = CancelledError(), exc_tb = 8450s 8450s async def __aexit__( 8450s self, 8450s exc_type: Optional[Type[BaseException]], 8450s exc_val: Optional[BaseException], 8450s exc_tb: Optional[TracebackType], 8450s ) -> Optional[bool]: 8450s assert self._state in (_State.ENTERED, _State.EXPIRING) 8450s 8450s if self._timeout_handler is not None: 8450s self._timeout_handler.cancel() 8450s self._timeout_handler = None 8450s 8450s if self._state is _State.EXPIRING: 8450s self._state = _State.EXPIRED 8450s 8450s if self._task.uncancel() <= self._cancelling and exc_type is not None: 8450s # Since there are no new cancel requests, we're 8450s # handling this. 8450s if issubclass(exc_type, exceptions.CancelledError): 8450s > raise TimeoutError from exc_val 8450s E TimeoutError 8450s 8450s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s @contextlib.asynccontextmanager 8450s async def _cluster_factory(): 8450s workers = [] 8450s s = None 8450s try: 8450s for _ in range(60): 8450s try: 8450s > s, ws = await start_cluster( 8450s nthreads, 8450s scheduler, 8450s security=security, 8450s Worker=Worker, 8450s scheduler_kwargs=scheduler_kwargs, 8450s worker_kwargs=merge( 8450s {"death_timeout": min(15, int(deadline.remaining))}, 8450s worker_kwargs, 8450s ), 8450s ) 8450s 8450s /usr/lib/python3/dist-packages/distributed/utils_test.py:966: 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s /usr/lib/python3/dist-packages/distributed/utils_test.py:789: in start_cluster 8450s await asyncio.gather(*workers) 8450s /usr/lib/python3.13/asyncio/tasks.py:737: in _wrap_awaitable 8450s return await awaitable 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s 8450s self = 8450s 8450s @final 8450s async def start(self): 8450s async with self._startup_lock: 8450s if self.status == Status.failed: 8450s assert self.__startup_exc is not None 8450s raise self.__startup_exc 8450s elif self.status != Status.init: 8450s return self 8450s timeout = getattr(self, "death_timeout", None) 8450s 8450s async def _close_on_failure(exc: Exception) -> None: 8450s await self.close(reason=f"failure-to-start-{str(type(exc))}") 8450s self.status = Status.failed 8450s self.__startup_exc = exc 8450s 8450s try: 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s except asyncio.TimeoutError as exc: 8450s await _close_on_failure(exc) 8450s > raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s E TimeoutError: Worker start timed out after 0s. 8450s 8450s /usr/lib/python3/dist-packages/distributed/core.py:667: TimeoutError 8450s 8450s During handling of the above exception, another exception occurred: 8450s 8450s fut = ._..test_func..async_fn at 0xe8325cd8> 8450s timeout = 60 8450s 8450s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 8450s async with asyncio.timeout(timeout): 8450s > return await fut 8450s 8450s /usr/lib/python3/dist-packages/distributed/utils.py:1960: 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s /usr/lib/python3/dist-packages/distributed/utils_test.py:999: in async_fn 8450s _cluster_factory() as (s, workers), 8450s /usr/lib/python3.13/contextlib.py:214: in __aenter__ 8450s return await anext(self.gen) 8450s /usr/lib/python3/dist-packages/distributed/utils_test.py:983: in _cluster_factory 8450s await asyncio.sleep(1) 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s 8450s delay = 1, result = None 8450s 8450s async def sleep(delay, result=None): 8450s """Coroutine that completes after a given time (in seconds).""" 8450s if delay <= 0: 8450s await __sleep0() 8450s return result 8450s 8450s if math.isnan(delay): 8450s raise ValueError("Invalid delay: NaN (not a number)") 8450s 8450s loop = events.get_running_loop() 8450s future = loop.create_future() 8450s h = loop.call_later(delay, 8450s futures._set_result_unless_cancelled, 8450s future, result) 8450s try: 8450s > return await future 8450s E asyncio.exceptions.CancelledError 8450s 8450s /usr/lib/python3.13/asyncio/tasks.py:718: CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s args = (), kwds = {} 8450s 8450s @wraps(func) 8450s def inner(*args, **kwds): 8450s with self._recreate_cm(): 8450s > return func(*args, **kwds) 8450s 8450s /usr/lib/python3.13/contextlib.py:85: 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s /usr/lib/python3.13/contextlib.py:85: in inner 8450s return func(*args, **kwds) 8450s /usr/lib/python3/dist-packages/distributed/utils_test.py:1102: in test_func 8450s return _run_and_close_tornado(async_fn_outer) 8450s /usr/lib/python3/dist-packages/distributed/utils_test.py:378: in _run_and_close_tornado 8450s return asyncio_run(inner_fn(), loop_factory=get_loop_factory()) 8450s /usr/lib/python3.13/asyncio/runners.py:194: in run 8450s return runner.run(main) 8450s /usr/lib/python3.13/asyncio/runners.py:118: in run 8450s return self._loop.run_until_complete(task) 8450s /usr/lib/python3.13/asyncio/base_events.py:720: in run_until_complete 8450s return future.result() 8450s /usr/lib/python3/dist-packages/distributed/utils_test.py:375: in inner_fn 8450s return await async_fn(*args, **kwargs) 8450s /usr/lib/python3/dist-packages/distributed/utils_test.py:1099: in async_fn_outer 8450s return await utils_wait_for(async_fn(), timeout=timeout * 2) 8450s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 8450s async with asyncio.timeout(timeout): 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s 8450s self = 8450s exc_type = 8450s exc_val = CancelledError(), exc_tb = 8450s 8450s async def __aexit__( 8450s self, 8450s exc_type: Optional[Type[BaseException]], 8450s exc_val: Optional[BaseException], 8450s exc_tb: Optional[TracebackType], 8450s ) -> Optional[bool]: 8450s assert self._state in (_State.ENTERED, _State.EXPIRING) 8450s 8450s if self._timeout_handler is not None: 8450s self._timeout_handler.cancel() 8450s self._timeout_handler = None 8450s 8450s if self._state is _State.EXPIRING: 8450s self._state = _State.EXPIRED 8450s 8450s if self._task.uncancel() <= self._cancelling and exc_type is not None: 8450s # Since there are no new cancel requests, we're 8450s # handling this. 8450s if issubclass(exc_type, exceptions.CancelledError): 8450s > raise TimeoutError from exc_val 8450s E TimeoutError 8450s 8450s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 8450s ----------------------------- Captured stderr call ----------------------------- 8450s 2024-11-23 22:48:46,329 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:48:46,337 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:46,337 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33361/status 8450s 2024-11-23 22:48:46,337 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:48:46,351 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34791 8450s 2024-11-23 22:48:46,351 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34791 8450s 2024-11-23 22:48:46,351 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:48:46,351 - distributed.worker - INFO - dashboard at: 127.0.0.1:37123 8450s 2024-11-23 22:48:46,351 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:46,351 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:48:46,351 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:48:46,351 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:48:46,351 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-udadndwo 8450s 2024-11-23 22:48:46,351 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:48:46,353 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45889 8450s 2024-11-23 22:48:46,353 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45889 8450s 2024-11-23 22:48:46,353 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:48:46,353 - distributed.worker - INFO - dashboard at: 127.0.0.1:40225 8450s 2024-11-23 22:48:46,353 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:46,353 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:48:46,353 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:48:46,353 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:48:46,353 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-po5owmdv 8450s 2024-11-23 22:48:46,354 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:48:46,365 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:46,366 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:46,366 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:58806': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:46,366 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:58818': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:46,478 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:46,478 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:46,478 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:58828': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:46,478 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:58834': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:46,590 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:46,591 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:46,592 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:58842': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:46,592 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:58846': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:46,703 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:46,703 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:46,703 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:58854': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:46,703 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:58856': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:46,815 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:46,816 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:46,816 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:58860': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:46,816 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:58862': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:46,927 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:46,928 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:46,928 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:58872': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:46,928 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:58882': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:47,040 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:47,040 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:47,041 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:58898': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:47,041 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:58904': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:47,152 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:47,152 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:47,152 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:58920': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:47,152 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:58936': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:47,264 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:47,264 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:47,265 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:58946': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:47,265 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:58956': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:47,376 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:47,376 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:47,376 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:58966': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:47,376 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:58968': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:47,489 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:47,489 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:47,489 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:58976': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:47,489 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:58982': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:47,596 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:47,600 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:58988': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:47,601 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:47,601 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:59000': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:47,703 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:47,704 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:59012': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:47,709 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:47,709 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:59018': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:47,810 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:47,811 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:59020': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:47,816 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:47,816 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:59032': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:47,917 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:47,917 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:59048': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:47,923 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:47,923 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:59064': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:48,024 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:48,025 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:59078': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:48,031 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:48,031 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:59086': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:48,133 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:48,133 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:59100': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:48,139 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:48,139 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:59116': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:48,240 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:48,240 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:59130': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:48,247 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:48,247 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:59138': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:48,347 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:48,347 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:59140': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:48,353 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:48,353 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:59152': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:48,455 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:48,456 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:59154': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:48,461 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:48,462 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:59162': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:48,562 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:48,563 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:59168': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:48,569 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:48,569 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:59184': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:48,669 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:48,669 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:59188': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:48,675 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:48,676 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:59192': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:48,776 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:48,777 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:59198': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:48,782 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:48,783 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:59210': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:48,884 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:48,884 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:59216': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:48,890 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:48,890 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:59224': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:48,991 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:48,992 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:59230': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:48,997 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:48,998 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:59246': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:49,098 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:49,098 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:59260': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:49,104 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:49,104 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:59268': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:49,205 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:49,206 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:59280': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:49,211 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:49,211 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:59288': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:49,314 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:49,314 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:59302': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:49,320 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:49,320 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:59310': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:49,422 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:49,422 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:59320': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:49,428 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:49,428 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:59326': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:49,529 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:49,529 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:59328': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:49,535 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:49,535 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:59342': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:49,636 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:49,637 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:59344': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:49,642 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:49,642 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:59360': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:49,743 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:49,743 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:59370': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:49,749 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:49,749 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:59384': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:49,850 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:49,851 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:59396': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:49,856 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:49,856 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:59404': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:49,958 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:49,959 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:59418': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:49,964 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:49,965 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:59434': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:50,065 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:50,066 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:59442': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:50,071 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:50,071 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:59456': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:50,172 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:50,173 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:59458': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:50,178 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:50,178 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:59468': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:50,279 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:50,280 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:59480': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:50,285 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:50,285 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:59484': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:50,386 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:50,387 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:59496': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:50,392 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:50,393 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:59510': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:50,493 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:50,494 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:59512': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:50,500 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:50,500 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:59516': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:50,600 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:50,600 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:59522': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:50,606 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:50,606 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:59530': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:50,707 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:50,708 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:59540': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:50,713 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:50,713 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:59556': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:50,814 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:50,814 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:59570': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:50,820 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:50,821 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:59584': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:50,921 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:50,921 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:59592': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:50,927 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:50,928 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:59600': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:51,028 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:51,028 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:59616': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:51,034 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:51,035 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:59632': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:51,135 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:51,135 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:59642': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:51,141 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:51,141 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:59650': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:51,242 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:51,242 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:59658': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:51,248 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:51,248 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:59664': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:51,349 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:51,349 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:59672': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:51,355 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:51,355 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:59676': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:51,456 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:51,456 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:59690': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:51,462 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:51,462 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:59694': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:51,565 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:51,566 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:42918': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:51,573 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:51,574 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:42920': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:51,671 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:51,672 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:42936': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:51,680 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:51,680 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:42944': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:51,779 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:51,779 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:42958': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:51,787 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:51,787 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:42960': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:51,886 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:51,886 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:42964': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:51,894 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:51,895 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:42972': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:51,993 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:51,993 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:42986': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:52,001 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:52,002 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:42994': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:52,100 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:52,100 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:43002': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:52,109 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:52,109 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:43008': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:52,207 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:52,207 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:43018': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:52,216 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:52,216 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:43028': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:52,314 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:52,314 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:43038': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:52,322 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:52,323 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:43044': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:52,422 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:52,423 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:43048': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:52,428 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:52,429 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:43064': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:52,530 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:52,531 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:43072': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:52,536 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:52,537 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:43086': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:52,637 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:52,638 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:43096': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:52,644 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:52,644 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:43108': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:52,745 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:52,746 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:43114': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:52,751 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:52,752 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:43130': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:52,852 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:52,852 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:43134': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:52,858 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:52,858 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:43138': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:52,959 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:52,960 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:43152': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:52,966 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:52,966 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:43158': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:53,066 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:53,066 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:43172': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:53,072 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:53,072 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:43174': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:53,174 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:53,174 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:43180': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:53,180 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:53,180 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:43190': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:53,284 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:53,285 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:43206': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:53,291 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:53,291 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:43222': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:53,392 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:53,392 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:43224': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:53,398 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:53,398 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:43228': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:53,499 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:53,499 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:43242': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:53,505 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:53,506 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:43244': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:53,607 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:53,607 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:43258': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:53,613 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:53,613 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:43264': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:53,714 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:53,715 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:43272': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:53,721 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:53,721 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:43278': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:53,822 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:53,823 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:43288': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:53,828 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:53,829 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:43302': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:53,929 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:53,930 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:43308': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:53,935 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:53,936 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:43310': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:54,037 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:54,037 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:43324': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:54,043 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:54,043 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:43334': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:54,144 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:54,145 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:43336': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:54,150 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:54,151 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:43346': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:54,251 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:54,252 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:43352': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:54,258 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:54,258 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:43364': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:54,358 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:54,359 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:43378': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:54,364 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:54,365 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:43392': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:54,466 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:54,467 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:43396': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:54,472 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:54,472 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:43406': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:54,573 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:54,574 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:43418': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:54,579 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:54,580 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:43432': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:54,682 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:54,682 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:43434': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:54,688 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:54,688 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:43438': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:54,789 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:54,790 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:43450': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:54,795 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:54,796 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:43456': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:54,896 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:54,897 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:43458': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:54,904 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:54,904 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:43474': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:55,005 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:55,006 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:43490': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:55,011 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:55,012 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:43500': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:55,112 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:55,112 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:43512': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:55,118 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:55,118 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:43514': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:55,219 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:55,220 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:43522': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:55,226 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:55,226 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:43524': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:55,326 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:55,326 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:43534': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:55,332 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:55,333 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:43544': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:55,433 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:55,434 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:43554': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:55,440 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:55,440 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:43556': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:55,541 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:55,542 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:43570': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:55,547 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:55,548 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:43586': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:55,648 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:55,648 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:43594': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:55,654 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:55,654 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:43608': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:55,756 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:55,756 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:43614': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:55,762 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:55,762 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:43628': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:55,863 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:55,864 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:43630': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:55,869 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:55,870 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:43632': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:55,972 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:55,972 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:43646': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:55,978 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:55,978 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:43660': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:56,079 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:56,079 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:43672': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:56,085 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:56,085 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:43688': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:56,186 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:56,187 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:43704': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:56,193 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:56,193 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:43710': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:56,294 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:56,295 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:43712': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:56,300 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:56,300 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:43720': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:56,401 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:56,401 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:43726': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:56,407 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:56,407 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:43728': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:56,508 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:56,508 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:43730': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:56,514 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:56,514 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:43736': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:56,617 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:56,618 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:43746': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:56,623 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:56,623 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:43756': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:56,725 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:56,726 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:43760': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:56,731 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:56,731 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:43774': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:56,833 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:56,834 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:43788': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:56,839 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:56,844 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:43792': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:56,940 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:56,941 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:43794': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:56,946 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:56,947 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:43802': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:57,048 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:57,048 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:43810': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:57,054 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:57,054 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:43822': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:57,154 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:57,155 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:43824': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:57,161 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:57,161 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:43832': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:57,262 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:57,263 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:43848': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:57,268 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:57,268 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:43862': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:57,369 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:57,370 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:43870': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:57,375 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:57,376 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:43884': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:57,477 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:57,477 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:43896': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:57,483 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:57,483 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:43904': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:57,584 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:57,585 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:43912': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:57,590 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:57,590 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:43922': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:57,691 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:57,692 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:43926': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:57,697 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:57,697 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:43936': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:57,798 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:57,799 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:43950': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:57,804 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:57,805 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:43958': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:57,905 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:57,905 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:43974': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:57,911 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:57,911 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:43976': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:58,013 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:58,014 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:43980': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:58,020 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:58,020 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:43990': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:58,120 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:58,121 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:43998': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:58,126 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:58,127 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:44012': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:58,227 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:58,228 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:44014': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:58,235 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:58,235 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:44020': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:58,335 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:58,335 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:44026': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:58,341 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:58,346 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:44036': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:58,443 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:58,444 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:44038': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:58,449 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:58,449 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:44044': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:58,550 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:58,551 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:44054': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:58,556 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:58,557 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:44070': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:58,659 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:58,659 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:44074': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:58,665 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:58,665 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:44076': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:58,766 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:58,767 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:44088': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:58,772 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:58,773 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:44098': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:58,873 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:58,873 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:44102': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:58,879 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:58,879 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:44118': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:58,980 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:58,981 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:44122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:58,986 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:58,986 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:44138': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:59,087 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:59,088 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:44140': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:59,094 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:59,094 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:44150': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:59,196 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:59,196 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:44152': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:59,202 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:59,202 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:44162': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:59,303 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:59,304 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:44174': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:59,309 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:59,309 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:44180': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:59,411 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:59,411 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:44190': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:59,417 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:59,417 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:44196': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:59,518 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:59,519 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:44206': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:59,524 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:59,525 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:44222': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:59,626 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:59,626 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:44232': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:59,632 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:59,632 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:44238': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:59,733 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:59,734 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:44242': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:59,739 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:59,740 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:44244': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:59,840 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:59,844 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:44246': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:59,850 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:59,850 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:44258': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:59,948 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:59,948 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:44270': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:48:59,957 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:48:59,957 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:44280': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:00,055 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:49:00,055 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:44290': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:00,064 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:49:00,064 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:44304': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:00,163 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:49:00,163 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:44308': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:00,170 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:49:00,171 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:44320': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:00,271 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:49:00,271 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:44326': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:00,277 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:49:00,277 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:44334': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:00,378 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:49:00,378 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:44350': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:00,384 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:49:00,384 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:44356': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:00,485 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:49:00,486 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:44358': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:00,491 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:49:00,492 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:44372': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:00,593 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:49:00,594 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:44382': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:00,599 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:49:00,599 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:44384': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:00,700 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:49:00,701 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:44398': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:00,707 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:49:00,707 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:44406': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:00,808 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:49:00,808 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:44412': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:00,814 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:49:00,814 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:44422': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:00,917 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:49:00,919 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:44428': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:00,927 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:49:00,928 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:44430': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:01,028 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:49:01,029 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:44440': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:01,038 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:49:01,039 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:44442': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:01,139 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:49:01,140 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:44444': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:01,148 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:49:01,149 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:44458': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:01,248 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:49:01,249 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:44472': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:01,258 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39079 8450s 2024-11-23 22:49:01,259 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:44482': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:01,351 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34791. Reason: failure-to-start- 8450s 2024-11-23 22:49:01,352 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:49:01,354 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39079': TLS handshake failed with remote 'tls://127.0.0.1:44486': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:49:01,355 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45889. Reason: failure-to-start- 8450s 2024-11-23 22:49:01,355 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:49:01,358 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 15s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 15s. 8450s 2024-11-23 22:49:02,364 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:49:02,373 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:02,373 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45151/status 8450s 2024-11-23 22:49:02,373 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:49:02,387 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44193 8450s 2024-11-23 22:49:02,387 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44193 8450s 2024-11-23 22:49:02,387 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:49:02,387 - distributed.worker - INFO - dashboard at: 127.0.0.1:38921 8450s 2024-11-23 22:49:02,387 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:02,387 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:49:02,387 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:49:02,387 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:49:02,387 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-874d27ug 8450s 2024-11-23 22:49:02,387 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:49:02,389 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41815 8450s 2024-11-23 22:49:02,389 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41815 8450s 2024-11-23 22:49:02,389 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:49:02,389 - distributed.worker - INFO - dashboard at: 127.0.0.1:33299 8450s 2024-11-23 22:49:02,389 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:02,389 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:49:02,389 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:49:02,389 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:49:02,389 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-f_i9gb7x 8450s 2024-11-23 22:49:02,389 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:49:02,402 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:02,402 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:02,402 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:56318': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:02,402 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:56324': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:02,514 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:02,514 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:02,514 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:56338': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:02,515 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:56348': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:02,627 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:02,627 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:02,628 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:56362': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:02,628 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:56370': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:02,740 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:02,740 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:02,740 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:56384': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:02,740 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:56400': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:02,852 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:02,853 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:02,853 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:56410': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:02,853 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:56420': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:02,965 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:02,965 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:02,965 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:56434': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:02,965 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:56438': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:03,077 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:03,077 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:03,078 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:56442': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:03,078 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:56456': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:03,190 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:03,191 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:03,191 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:56458': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:03,191 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:56462': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:03,302 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:03,303 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:03,303 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:56472': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:03,303 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:56478': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:03,416 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:03,416 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:03,416 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:56484': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:03,416 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:56496': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:03,528 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:03,528 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:03,528 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:56504': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:03,528 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:56512': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:03,640 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:03,640 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:03,640 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:56516': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:03,640 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:56530': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:03,752 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:03,752 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:03,752 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:56540': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:03,752 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:56544': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:03,863 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:03,863 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:03,864 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:56554': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:03,864 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:56564': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:03,977 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:03,977 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:03,977 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:56570': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:03,977 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:56574': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:04,089 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:04,089 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:04,089 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:56582': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:04,089 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:56594': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:04,202 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:04,202 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:04,203 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:56600': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:04,203 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:56610': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:04,314 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:04,314 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:04,314 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:56620': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:04,314 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:56630': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:04,426 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:04,426 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:04,426 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:56634': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:04,426 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:56642': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:04,538 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:04,539 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:04,539 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:56650': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:04,539 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:56664': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:04,650 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:04,651 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:04,651 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:56666': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:04,651 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:56668': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:04,762 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:04,762 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:04,763 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:56674': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:04,763 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:56686': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:04,875 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:04,876 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:04,879 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:56690': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:04,879 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:56704': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:04,987 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:04,988 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:04,988 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:56706': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:04,988 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:56710': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:05,100 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:05,100 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:05,100 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:56714': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:05,100 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:56720': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:05,213 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:05,213 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:05,214 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:56734': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:05,214 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:56748': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:05,325 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:05,325 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:05,326 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:56756': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:05,326 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:56766': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:05,437 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:05,437 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:05,438 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:56778': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:05,438 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:56780': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:05,549 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:05,550 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:05,550 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:56786': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:05,550 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:56790': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:05,662 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:05,663 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:05,663 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:56798': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:05,663 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:56804': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:05,774 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:05,775 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:05,775 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:56816': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:05,775 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:56828': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:05,888 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:05,888 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:05,888 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:56842': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:05,888 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:56850': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:06,001 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:06,001 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:06,001 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:56866': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:06,001 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:56882': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:06,114 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:06,114 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:06,114 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:56886': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:06,114 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:56894': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:06,226 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:06,226 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:06,227 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:56900': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:06,227 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:56904': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:06,340 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:06,340 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:06,343 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:56914': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:06,343 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:56930': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:06,452 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:06,452 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:06,452 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:56944': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:06,452 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:56952': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:06,564 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:06,564 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:06,564 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:56960': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:06,564 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:56962': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:06,678 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:06,678 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:06,679 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:56966': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:06,679 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:56982': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:06,790 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:06,790 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:06,791 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:56994': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:06,791 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:57008': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:06,902 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:06,902 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:06,903 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:57020': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:06,903 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:57034': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:07,014 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:07,014 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:07,015 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:57040': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:07,015 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:57056': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:07,126 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:07,127 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:07,127 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:57064': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:07,127 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:57070': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:07,238 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:07,239 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:07,239 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:57082': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:07,239 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:57096': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:07,352 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:07,353 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:07,353 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:57100': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:07,354 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:57108': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:07,460 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:07,464 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:57110': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:07,465 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:07,466 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:57114': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:07,567 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:07,568 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:57120': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:07,574 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:07,574 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:57122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:07,674 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:07,675 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:57138': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:07,680 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:07,681 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:57142': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:07,782 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:07,783 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:57150': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:07,788 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:07,789 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:57162': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:07,889 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:07,889 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:57176': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:07,895 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:07,895 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:57192': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:07,996 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:07,996 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:57198': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:08,002 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:08,002 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:57208': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:08,102 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:08,103 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:57218': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:08,108 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:08,109 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:57220': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:08,210 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:08,211 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:57226': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:08,216 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:08,216 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:57240': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:08,317 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:08,318 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:57244': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:08,325 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:08,325 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:57250': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:08,425 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:08,425 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:57260': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:08,431 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:08,431 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:57276': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:08,532 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:08,532 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:57282': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:08,538 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:08,538 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:57290': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:08,639 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:08,640 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:57294': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:08,645 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:08,645 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:57308': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:08,745 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:08,746 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:57322': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:08,752 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:08,752 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:57332': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:08,852 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:08,852 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:57334': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:08,858 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:08,858 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:57344': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:08,960 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:08,960 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:57360': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:08,966 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:08,966 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:57366': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:09,066 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:09,066 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:57378': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:09,072 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:09,072 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:57390': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:09,174 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:09,174 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:57398': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:09,180 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:09,180 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:57410': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:09,280 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:09,281 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:57426': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:09,286 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:09,287 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:57440': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:09,387 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:09,387 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:57452': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:09,393 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:09,393 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:57460': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:09,495 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:09,496 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:57470': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:09,501 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:09,501 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:57482': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:09,602 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:09,603 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:57488': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:09,608 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:09,608 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:57496': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:09,709 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:09,709 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:57510': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:09,715 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:09,715 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:57522': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:09,817 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:09,818 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:57528': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:09,823 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:09,824 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:57530': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:09,924 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:09,924 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:57540': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:09,930 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:09,930 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:57554': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:10,032 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:10,033 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:57564': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:10,038 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:10,039 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:57574': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:10,141 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:10,142 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:57586': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:10,147 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:10,147 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:57600': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:10,248 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:10,249 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:57602': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:10,254 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:10,255 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:57608': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:10,355 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:10,355 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:57612': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:10,361 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:10,361 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:57618': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:10,462 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:10,462 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:57622': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:10,468 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:10,468 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:57626': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:10,570 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:10,570 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:57636': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:10,576 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:10,576 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:57646': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:10,677 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:10,677 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:57662': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:10,683 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:10,683 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:57664': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:10,784 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:10,784 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:57674': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:10,790 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:10,790 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:57678': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:10,891 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:10,891 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:57680': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:10,897 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:10,897 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:57682': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:10,999 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:11,000 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:57694': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:11,005 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:11,005 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:57698': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:11,106 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:11,106 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:57714': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:11,112 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:11,112 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:57730': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:11,214 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:11,215 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:57738': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:11,220 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:11,221 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:57746': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:11,322 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:11,322 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:57758': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:11,328 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:11,328 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:57764': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:11,429 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:11,430 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:57780': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:11,435 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:11,436 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:57782': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:11,537 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:11,537 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:56454': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:11,543 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:11,543 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:56464': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:11,644 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:11,644 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:56472': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:11,653 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:11,653 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:56478': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:11,751 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:11,751 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:56482': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:11,759 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:11,760 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:56494': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:11,858 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:11,858 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:56502': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:11,866 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:11,866 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:56506': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:11,964 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:11,965 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:56520': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:11,973 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:11,973 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:56536': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:12,072 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:12,072 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:56540': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:12,080 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:12,081 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:56554': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:12,179 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:12,179 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:56558': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:12,187 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:12,188 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:56564': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:12,286 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:12,286 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:56570': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:12,294 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:12,294 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:56572': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:12,392 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:12,393 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:56586': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:12,401 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:12,401 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:56602': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:12,499 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:12,499 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:56604': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:12,507 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:12,508 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:56620': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:12,606 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:12,606 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:56622': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:12,614 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:12,614 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:56634': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:12,713 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:12,713 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:56636': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:12,721 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:12,721 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:56652': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:12,820 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:12,820 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:56660': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:12,827 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:12,827 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:56668': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:12,928 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:12,928 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:56678': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:12,934 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:12,934 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:56680': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:13,035 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:13,036 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:56686': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:13,041 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:13,041 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:56700': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:13,142 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:13,142 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:56716': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:13,148 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:13,148 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:56724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:13,249 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:13,249 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:56736': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:13,255 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:13,255 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:56750': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:13,355 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:13,356 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:56758': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:13,362 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:13,362 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:56768': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:13,464 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:13,464 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:56784': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:13,470 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:13,470 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:56794': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:13,570 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:13,570 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:56804': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:13,576 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:13,577 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:56818': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:13,678 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:13,678 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:56820': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:13,684 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:13,684 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:56828': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:13,785 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:13,785 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:56840': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:13,791 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:13,791 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:56846': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:13,891 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:13,891 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:56862': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:13,897 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:13,897 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:56878': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:13,999 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:14,000 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:56890': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:14,005 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:14,006 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:56898': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:14,106 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:14,106 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:56908': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:14,112 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:14,112 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:56924': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:14,213 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:14,213 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:56930': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:14,219 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:14,219 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:56944': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:14,320 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:14,321 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:56950': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:14,326 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:14,326 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:56960': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:14,427 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:14,428 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:56964': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:14,433 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:14,434 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:56966': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:14,535 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:14,535 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:56976': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:14,541 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:14,541 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:56988': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:14,642 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:14,643 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:56994': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:14,648 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:14,649 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:57002': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:14,750 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:14,750 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:57004': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:14,756 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:14,756 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:57010': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:14,856 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:14,856 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:57022': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:14,862 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:14,862 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:57038': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:14,964 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:14,965 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:57046': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:14,970 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:14,970 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:57050': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:15,072 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:15,072 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:57052': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:15,078 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:15,078 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:57056': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:15,179 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:15,179 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:57064': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:15,185 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:15,185 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:57070': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:15,286 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:15,287 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:57074': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:15,292 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37443 8450s 2024-11-23 22:49:15,292 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37443': TLS handshake failed with remote 'tls://127.0.0.1:57076': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:15,386 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44193. Reason: failure-to-start- 8450s 2024-11-23 22:49:15,386 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:49:15,387 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 13s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 8450s stream = await stream.start_tls( 8450s ^^^^^^^^^^^^^^^^^^^^^^^ 8450s False, ssl_options=ssl_options, server_hostname=host 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 8450s self.socket.do_handshake() 8450s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 8450s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 8450s self._sslobj.do_handshake() 8450s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 8450s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 8450s raise FatalCommClosedError( 8450s ...<2 lines>... 8450s ) from err 8450s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 8450s 8450s During handling of the above exception, another exception occurred: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1218, in _register_with_scheduler 8450s await asyncio.sleep(0.1) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 718, in sleep 8450s return await future 8450s ^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 13s. 8450s 2024-11-23 22:49:15,391 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41815. Reason: failure-to-start- 8450s 2024-11-23 22:49:15,391 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:49:16,393 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:49:16,399 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38603 8450s 2024-11-23 22:49:16,399 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33289/status 8450s 2024-11-23 22:49:16,399 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:49:16,410 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39571 8450s 2024-11-23 22:49:16,410 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39571 8450s 2024-11-23 22:49:16,410 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:49:16,410 - distributed.worker - INFO - dashboard at: 127.0.0.1:34003 8450s 2024-11-23 22:49:16,411 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38603 8450s 2024-11-23 22:49:16,411 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:49:16,411 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:49:16,411 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:49:16,411 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-mo3m0tri 8450s 2024-11-23 22:49:16,411 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:49:16,412 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33259 8450s 2024-11-23 22:49:16,412 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33259 8450s 2024-11-23 22:49:16,412 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:49:16,413 - distributed.worker - INFO - dashboard at: 127.0.0.1:38991 8450s 2024-11-23 22:49:16,413 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38603 8450s 2024-11-23 22:49:16,413 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:49:16,413 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:49:16,413 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:49:16,413 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-m8b_r4nj 8450s 2024-11-23 22:49:16,413 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:49:16,414 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39571. Reason: failure-to-start- 8450s 2024-11-23 22:49:16,414 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:49:16,415 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33259. Reason: failure-to-start- 8450s 2024-11-23 22:49:16,415 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:49:16,416 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38603': TLS handshake failed with remote 'tls://127.0.0.1:54790': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:49:16,416 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38603': TLS handshake failed with remote 'tls://127.0.0.1:54798': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:49:16,417 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:49:17,422 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:49:17,428 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43231 8450s 2024-11-23 22:49:17,428 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42569/status 8450s 2024-11-23 22:49:17,428 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:49:17,440 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42173 8450s 2024-11-23 22:49:17,440 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42173 8450s 2024-11-23 22:49:17,440 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:49:17,440 - distributed.worker - INFO - dashboard at: 127.0.0.1:37653 8450s 2024-11-23 22:49:17,440 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43231 8450s 2024-11-23 22:49:17,441 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:49:17,441 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:49:17,441 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:49:17,441 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-qgzu5tom 8450s 2024-11-23 22:49:17,441 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:49:17,442 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37975 8450s 2024-11-23 22:49:17,442 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37975 8450s 2024-11-23 22:49:17,442 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:49:17,442 - distributed.worker - INFO - dashboard at: 127.0.0.1:39793 8450s 2024-11-23 22:49:17,442 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43231 8450s 2024-11-23 22:49:17,443 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:49:17,443 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:49:17,443 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:49:17,443 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-9kuwyzge 8450s 2024-11-23 22:49:17,443 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:49:17,444 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42173. Reason: failure-to-start- 8450s 2024-11-23 22:49:17,444 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:49:17,444 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37975. Reason: failure-to-start- 8450s 2024-11-23 22:49:17,444 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:49:17,445 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43231': TLS handshake failed with remote 'tls://127.0.0.1:48780': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:49:17,445 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43231': TLS handshake failed with remote 'tls://127.0.0.1:48792': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:49:17,446 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:49:18,451 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:49:18,457 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45991 8450s 2024-11-23 22:49:18,457 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43777/status 8450s 2024-11-23 22:49:18,458 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:49:18,469 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39555 8450s 2024-11-23 22:49:18,469 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39555 8450s 2024-11-23 22:49:18,469 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:49:18,469 - distributed.worker - INFO - dashboard at: 127.0.0.1:35525 8450s 2024-11-23 22:49:18,469 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45991 8450s 2024-11-23 22:49:18,469 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:49:18,469 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:49:18,469 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:49:18,469 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-7xy_sqjm 8450s 2024-11-23 22:49:18,469 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:49:18,471 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37155 8450s 2024-11-23 22:49:18,471 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37155 8450s 2024-11-23 22:49:18,471 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:49:18,471 - distributed.worker - INFO - dashboard at: 127.0.0.1:43983 8450s 2024-11-23 22:49:18,471 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45991 8450s 2024-11-23 22:49:18,471 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:49:18,471 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:49:18,471 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:49:18,471 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-bmjowzbb 8450s 2024-11-23 22:49:18,471 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:49:18,472 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39555. Reason: failure-to-start- 8450s 2024-11-23 22:49:18,472 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:49:18,473 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37155. Reason: failure-to-start- 8450s 2024-11-23 22:49:18,473 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:49:18,474 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45991': TLS handshake failed with remote 'tls://127.0.0.1:52728': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:49:18,474 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45991': TLS handshake failed with remote 'tls://127.0.0.1:52730': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:49:18,475 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:49:19,480 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:49:19,486 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45817 8450s 2024-11-23 22:49:19,486 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36013/status 8450s 2024-11-23 22:49:19,486 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:49:19,499 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38979 8450s 2024-11-23 22:49:19,499 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38979 8450s 2024-11-23 22:49:19,499 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:49:19,499 - distributed.worker - INFO - dashboard at: 127.0.0.1:37037 8450s 2024-11-23 22:49:19,499 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45817 8450s 2024-11-23 22:49:19,499 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:49:19,499 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:49:19,499 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:49:19,499 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ojkpihtc 8450s 2024-11-23 22:49:19,499 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:49:19,501 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40355 8450s 2024-11-23 22:49:19,501 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40355 8450s 2024-11-23 22:49:19,501 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:49:19,501 - distributed.worker - INFO - dashboard at: 127.0.0.1:36329 8450s 2024-11-23 22:49:19,501 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45817 8450s 2024-11-23 22:49:19,501 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:49:19,501 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:49:19,502 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:49:19,502 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-txjs07g0 8450s 2024-11-23 22:49:19,502 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:49:19,502 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38979. Reason: failure-to-start- 8450s 2024-11-23 22:49:19,503 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:49:19,503 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40355. Reason: failure-to-start- 8450s 2024-11-23 22:49:19,503 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:49:19,504 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45817': TLS handshake failed with remote 'tls://127.0.0.1:38134': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:49:19,504 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45817': TLS handshake failed with remote 'tls://127.0.0.1:38146': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:49:19,505 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:49:20,511 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:49:20,517 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45349 8450s 2024-11-23 22:49:20,517 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43387/status 8450s 2024-11-23 22:49:20,517 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:49:20,529 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36069 8450s 2024-11-23 22:49:20,529 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36069 8450s 2024-11-23 22:49:20,529 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:49:20,529 - distributed.worker - INFO - dashboard at: 127.0.0.1:39145 8450s 2024-11-23 22:49:20,529 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45349 8450s 2024-11-23 22:49:20,529 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:49:20,529 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:49:20,529 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:49:20,529 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-opoudjbn 8450s 2024-11-23 22:49:20,529 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:49:20,531 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36473 8450s 2024-11-23 22:49:20,531 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36473 8450s 2024-11-23 22:49:20,531 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:49:20,531 - distributed.worker - INFO - dashboard at: 127.0.0.1:41519 8450s 2024-11-23 22:49:20,531 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45349 8450s 2024-11-23 22:49:20,531 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:49:20,531 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:49:20,531 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:49:20,531 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-8ayernwz 8450s 2024-11-23 22:49:20,531 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:49:20,532 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36069. Reason: failure-to-start- 8450s 2024-11-23 22:49:20,532 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:49:20,533 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36473. Reason: failure-to-start- 8450s 2024-11-23 22:49:20,533 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:49:20,534 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45349': TLS handshake failed with remote 'tls://127.0.0.1:38862': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:49:20,534 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45349': TLS handshake failed with remote 'tls://127.0.0.1:38876': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:49:20,535 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:49:21,541 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:49:21,548 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42457 8450s 2024-11-23 22:49:21,548 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41463/status 8450s 2024-11-23 22:49:21,548 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:49:21,561 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38755 8450s 2024-11-23 22:49:21,561 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38755 8450s 2024-11-23 22:49:21,561 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:49:21,561 - distributed.worker - INFO - dashboard at: 127.0.0.1:43929 8450s 2024-11-23 22:49:21,561 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42457 8450s 2024-11-23 22:49:21,561 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:49:21,561 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:49:21,561 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:49:21,561 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-8l0dwx0z 8450s 2024-11-23 22:49:21,561 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:49:21,563 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39087 8450s 2024-11-23 22:49:21,563 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39087 8450s 2024-11-23 22:49:21,563 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:49:21,563 - distributed.worker - INFO - dashboard at: 127.0.0.1:43061 8450s 2024-11-23 22:49:21,563 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42457 8450s 2024-11-23 22:49:21,563 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:49:21,563 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:49:21,563 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:49:21,563 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-pp_v4_kx 8450s 2024-11-23 22:49:21,563 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:49:21,564 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38755. Reason: failure-to-start- 8450s 2024-11-23 22:49:21,564 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:49:21,565 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39087. Reason: failure-to-start- 8450s 2024-11-23 22:49:21,565 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:49:21,566 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42457': TLS handshake failed with remote 'tls://127.0.0.1:46344': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:49:21,566 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42457': TLS handshake failed with remote 'tls://127.0.0.1:46346': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:49:21,567 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:49:22,572 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:49:22,578 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44661 8450s 2024-11-23 22:49:22,578 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37973/status 8450s 2024-11-23 22:49:22,578 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:49:22,592 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40437 8450s 2024-11-23 22:49:22,592 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40437 8450s 2024-11-23 22:49:22,592 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:49:22,592 - distributed.worker - INFO - dashboard at: 127.0.0.1:44199 8450s 2024-11-23 22:49:22,592 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44661 8450s 2024-11-23 22:49:22,592 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:49:22,592 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:49:22,592 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:49:22,592 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-tewngftr 8450s 2024-11-23 22:49:22,592 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:49:22,594 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40071 8450s 2024-11-23 22:49:22,594 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40071 8450s 2024-11-23 22:49:22,594 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:49:22,594 - distributed.worker - INFO - dashboard at: 127.0.0.1:37765 8450s 2024-11-23 22:49:22,594 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44661 8450s 2024-11-23 22:49:22,594 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:49:22,594 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:49:22,594 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:49:22,595 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-_kgwrwtn 8450s 2024-11-23 22:49:22,595 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:49:22,595 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40437. Reason: failure-to-start- 8450s 2024-11-23 22:49:22,596 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:49:22,596 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40071. Reason: failure-to-start- 8450s 2024-11-23 22:49:22,596 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:49:22,597 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44661': TLS handshake failed with remote 'tls://127.0.0.1:47558': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:49:22,597 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44661': TLS handshake failed with remote 'tls://127.0.0.1:47560': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:49:22,598 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:49:23,604 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:49:23,610 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41681 8450s 2024-11-23 22:49:23,610 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35229/status 8450s 2024-11-23 22:49:23,610 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:49:23,622 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45221 8450s 2024-11-23 22:49:23,622 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45221 8450s 2024-11-23 22:49:23,623 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:49:23,623 - distributed.worker - INFO - dashboard at: 127.0.0.1:45043 8450s 2024-11-23 22:49:23,623 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41681 8450s 2024-11-23 22:49:23,623 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:49:23,623 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:49:23,623 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:49:23,623 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-7vw28vkp 8450s 2024-11-23 22:49:23,623 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:49:23,624 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44471 8450s 2024-11-23 22:49:23,625 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44471 8450s 2024-11-23 22:49:23,625 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:49:23,625 - distributed.worker - INFO - dashboard at: 127.0.0.1:33119 8450s 2024-11-23 22:49:23,625 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41681 8450s 2024-11-23 22:49:23,625 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:49:23,625 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:49:23,625 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:49:23,625 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-9sk2s_j1 8450s 2024-11-23 22:49:23,625 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:49:23,626 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45221. Reason: failure-to-start- 8450s 2024-11-23 22:49:23,626 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:49:23,627 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44471. Reason: failure-to-start- 8450s 2024-11-23 22:49:23,627 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:49:23,628 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41681': TLS handshake failed with remote 'tls://127.0.0.1:46790': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:49:23,628 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41681': TLS handshake failed with remote 'tls://127.0.0.1:46794': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:49:23,629 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:49:24,634 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:49:24,641 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37337 8450s 2024-11-23 22:49:24,642 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36917/status 8450s 2024-11-23 22:49:24,642 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:49:24,655 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46685 8450s 2024-11-23 22:49:24,655 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46685 8450s 2024-11-23 22:49:24,655 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:49:24,656 - distributed.worker - INFO - dashboard at: 127.0.0.1:43505 8450s 2024-11-23 22:49:24,656 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37337 8450s 2024-11-23 22:49:24,656 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:49:24,656 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:49:24,656 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:49:24,656 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-qe5hron5 8450s 2024-11-23 22:49:24,656 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:49:24,658 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46255 8450s 2024-11-23 22:49:24,658 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46255 8450s 2024-11-23 22:49:24,658 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:49:24,658 - distributed.worker - INFO - dashboard at: 127.0.0.1:33811 8450s 2024-11-23 22:49:24,658 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37337 8450s 2024-11-23 22:49:24,658 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:49:24,658 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:49:24,658 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:49:24,658 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-3megtmdv 8450s 2024-11-23 22:49:24,658 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:49:24,659 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46685. Reason: failure-to-start- 8450s 2024-11-23 22:49:24,659 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:49:24,660 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46255. Reason: failure-to-start- 8450s 2024-11-23 22:49:24,660 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:49:24,661 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37337': TLS handshake failed with remote 'tls://127.0.0.1:39738': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:49:24,661 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37337': TLS handshake failed with remote 'tls://127.0.0.1:39742': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:49:24,662 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:49:25,668 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:49:25,675 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38949 8450s 2024-11-23 22:49:25,675 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44447/status 8450s 2024-11-23 22:49:25,675 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:49:25,687 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42669 8450s 2024-11-23 22:49:25,687 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42669 8450s 2024-11-23 22:49:25,687 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:49:25,687 - distributed.worker - INFO - dashboard at: 127.0.0.1:34181 8450s 2024-11-23 22:49:25,687 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38949 8450s 2024-11-23 22:49:25,687 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:49:25,687 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:49:25,687 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:49:25,687 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-n7mf29vh 8450s 2024-11-23 22:49:25,687 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:49:25,689 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33195 8450s 2024-11-23 22:49:25,689 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33195 8450s 2024-11-23 22:49:25,689 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:49:25,689 - distributed.worker - INFO - dashboard at: 127.0.0.1:35709 8450s 2024-11-23 22:49:25,689 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38949 8450s 2024-11-23 22:49:25,689 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:49:25,689 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:49:25,689 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:49:25,690 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-x_d30929 8450s 2024-11-23 22:49:25,690 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:49:25,691 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42669. Reason: failure-to-start- 8450s 2024-11-23 22:49:25,691 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:49:25,691 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33195. Reason: failure-to-start- 8450s 2024-11-23 22:49:25,691 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:49:25,692 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38949': TLS handshake failed with remote 'tls://127.0.0.1:45538': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:49:25,692 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38949': TLS handshake failed with remote 'tls://127.0.0.1:45552': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:49:25,693 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:49:26,699 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:49:26,705 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38367 8450s 2024-11-23 22:49:26,706 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40797/status 8450s 2024-11-23 22:49:26,706 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:49:26,719 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37551 8450s 2024-11-23 22:49:26,720 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37551 8450s 2024-11-23 22:49:26,720 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:49:26,720 - distributed.worker - INFO - dashboard at: 127.0.0.1:43885 8450s 2024-11-23 22:49:26,720 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38367 8450s 2024-11-23 22:49:26,720 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:49:26,720 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:49:26,720 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:49:26,720 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-lt_7fmtp 8450s 2024-11-23 22:49:26,720 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:49:26,722 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37799 8450s 2024-11-23 22:49:26,722 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37799 8450s 2024-11-23 22:49:26,722 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:49:26,722 - distributed.worker - INFO - dashboard at: 127.0.0.1:35537 8450s 2024-11-23 22:49:26,722 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38367 8450s 2024-11-23 22:49:26,722 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:49:26,722 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:49:26,722 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:49:26,722 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-6buxssdk 8450s 2024-11-23 22:49:26,722 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:49:26,724 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37551. Reason: failure-to-start- 8450s 2024-11-23 22:49:26,724 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:49:26,724 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37799. Reason: failure-to-start- 8450s 2024-11-23 22:49:26,724 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:49:26,725 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38367': TLS handshake failed with remote 'tls://127.0.0.1:43546': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:49:26,725 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38367': TLS handshake failed with remote 'tls://127.0.0.1:43556': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:49:26,726 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:49:27,731 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:49:27,737 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33753 8450s 2024-11-23 22:49:27,738 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46163/status 8450s 2024-11-23 22:49:27,738 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:49:27,750 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34249 8450s 2024-11-23 22:49:27,751 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34249 8450s 2024-11-23 22:49:27,751 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:49:27,751 - distributed.worker - INFO - dashboard at: 127.0.0.1:33711 8450s 2024-11-23 22:49:27,751 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33753 8450s 2024-11-23 22:49:27,751 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:49:27,751 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:49:27,751 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:49:27,751 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-sb63kcbg 8450s 2024-11-23 22:49:27,751 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:49:27,753 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42933 8450s 2024-11-23 22:49:27,754 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42933 8450s 2024-11-23 22:49:27,754 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:49:27,754 - distributed.worker - INFO - dashboard at: 127.0.0.1:42305 8450s 2024-11-23 22:49:27,754 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33753 8450s 2024-11-23 22:49:27,754 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:49:27,754 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:49:27,754 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:49:27,754 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-2oobstnp 8450s 2024-11-23 22:49:27,754 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:49:27,755 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34249. Reason: failure-to-start- 8450s 2024-11-23 22:49:27,755 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:49:27,756 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42933. Reason: failure-to-start- 8450s 2024-11-23 22:49:27,756 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:49:27,757 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33753': TLS handshake failed with remote 'tls://127.0.0.1:52544': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:49:27,757 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33753': TLS handshake failed with remote 'tls://127.0.0.1:52558': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:49:27,758 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:49:28,763 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:49:28,769 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39483 8450s 2024-11-23 22:49:28,770 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45129/status 8450s 2024-11-23 22:49:28,770 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:49:28,782 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35381 8450s 2024-11-23 22:49:28,782 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35381 8450s 2024-11-23 22:49:28,782 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:49:28,782 - distributed.worker - INFO - dashboard at: 127.0.0.1:33645 8450s 2024-11-23 22:49:28,783 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39483 8450s 2024-11-23 22:49:28,783 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:49:28,783 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:49:28,783 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:49:28,783 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-o6b_58fk 8450s 2024-11-23 22:49:28,783 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:49:28,784 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34457 8450s 2024-11-23 22:49:28,785 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34457 8450s 2024-11-23 22:49:28,785 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:49:28,785 - distributed.worker - INFO - dashboard at: 127.0.0.1:37329 8450s 2024-11-23 22:49:28,785 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39483 8450s 2024-11-23 22:49:28,785 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:49:28,785 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:49:28,785 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:49:28,785 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-dw_t3cfb 8450s 2024-11-23 22:49:28,785 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:49:28,786 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35381. Reason: failure-to-start- 8450s 2024-11-23 22:49:28,786 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:49:28,787 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34457. Reason: failure-to-start- 8450s 2024-11-23 22:49:28,787 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:49:28,788 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39483': TLS handshake failed with remote 'tls://127.0.0.1:58178': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:49:28,788 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39483': TLS handshake failed with remote 'tls://127.0.0.1:58188': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:49:28,789 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:49:29,801 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:49:29,808 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34093 8450s 2024-11-23 22:49:29,808 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41309/status 8450s 2024-11-23 22:49:29,809 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:49:29,823 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42777 8450s 2024-11-23 22:49:29,823 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42777 8450s 2024-11-23 22:49:29,823 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:49:29,824 - distributed.worker - INFO - dashboard at: 127.0.0.1:40395 8450s 2024-11-23 22:49:29,824 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34093 8450s 2024-11-23 22:49:29,824 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:49:29,824 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:49:29,824 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:49:29,824 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-tk40lamm 8450s 2024-11-23 22:49:29,824 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:49:29,825 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46085 8450s 2024-11-23 22:49:29,826 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46085 8450s 2024-11-23 22:49:29,826 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:49:29,826 - distributed.worker - INFO - dashboard at: 127.0.0.1:43949 8450s 2024-11-23 22:49:29,826 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34093 8450s 2024-11-23 22:49:29,826 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:49:29,826 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:49:29,826 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:49:29,826 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-1tzkrh9v 8450s 2024-11-23 22:49:29,826 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:49:29,827 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42777. Reason: failure-to-start- 8450s 2024-11-23 22:49:29,827 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:49:29,827 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46085. Reason: failure-to-start- 8450s 2024-11-23 22:49:29,827 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:49:29,828 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34093': TLS handshake failed with remote 'tls://127.0.0.1:35550': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:49:29,828 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34093': TLS handshake failed with remote 'tls://127.0.0.1:35562': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:49:29,830 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:49:30,835 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:49:30,842 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43947 8450s 2024-11-23 22:49:30,842 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45685/status 8450s 2024-11-23 22:49:30,842 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:49:30,858 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37747 8450s 2024-11-23 22:49:30,858 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37747 8450s 2024-11-23 22:49:30,858 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:49:30,858 - distributed.worker - INFO - dashboard at: 127.0.0.1:37281 8450s 2024-11-23 22:49:30,858 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43947 8450s 2024-11-23 22:49:30,858 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:49:30,858 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:49:30,858 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:49:30,858 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-smqj9mr3 8450s 2024-11-23 22:49:30,858 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:49:30,860 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45183 8450s 2024-11-23 22:49:30,860 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45183 8450s 2024-11-23 22:49:30,860 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:49:30,860 - distributed.worker - INFO - dashboard at: 127.0.0.1:45275 8450s 2024-11-23 22:49:30,860 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43947 8450s 2024-11-23 22:49:30,860 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:49:30,860 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:49:30,860 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:49:30,860 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-0i2f95bf 8450s 2024-11-23 22:49:30,860 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:49:30,861 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37747. Reason: failure-to-start- 8450s 2024-11-23 22:49:30,861 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:49:30,862 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45183. Reason: failure-to-start- 8450s 2024-11-23 22:49:30,862 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:49:30,863 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43947': TLS handshake failed with remote 'tls://127.0.0.1:48150': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:49:30,863 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43947': TLS handshake failed with remote 'tls://127.0.0.1:48164': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:49:30,864 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:49:31,869 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:49:31,876 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33507 8450s 2024-11-23 22:49:31,876 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34465/status 8450s 2024-11-23 22:49:31,876 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:49:31,890 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33231 8450s 2024-11-23 22:49:31,891 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33231 8450s 2024-11-23 22:49:31,891 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:49:31,891 - distributed.worker - INFO - dashboard at: 127.0.0.1:35013 8450s 2024-11-23 22:49:31,891 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33507 8450s 2024-11-23 22:49:31,891 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:49:31,891 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:49:31,891 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:49:31,891 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-tvk283sx 8450s 2024-11-23 22:49:31,891 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:49:31,893 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34579 8450s 2024-11-23 22:49:31,893 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34579 8450s 2024-11-23 22:49:31,893 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:49:31,893 - distributed.worker - INFO - dashboard at: 127.0.0.1:34141 8450s 2024-11-23 22:49:31,893 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33507 8450s 2024-11-23 22:49:31,893 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:49:31,893 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:49:31,893 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:49:31,893 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-6b109y_l 8450s 2024-11-23 22:49:31,893 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:49:31,895 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33231. Reason: failure-to-start- 8450s 2024-11-23 22:49:31,895 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:49:31,895 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34579. Reason: failure-to-start- 8450s 2024-11-23 22:49:31,896 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:49:31,897 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33507': TLS handshake failed with remote 'tls://127.0.0.1:56730': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:49:31,897 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33507': TLS handshake failed with remote 'tls://127.0.0.1:56740': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:49:31,898 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:49:32,904 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:49:32,910 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41195 8450s 2024-11-23 22:49:32,911 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36651/status 8450s 2024-11-23 22:49:32,911 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:49:32,923 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40135 8450s 2024-11-23 22:49:32,923 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40135 8450s 2024-11-23 22:49:32,923 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:49:32,923 - distributed.worker - INFO - dashboard at: 127.0.0.1:40033 8450s 2024-11-23 22:49:32,924 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41195 8450s 2024-11-23 22:49:32,924 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:49:32,924 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:49:32,924 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:49:32,924 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-594_aook 8450s 2024-11-23 22:49:32,924 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:49:32,925 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37509 8450s 2024-11-23 22:49:32,925 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37509 8450s 2024-11-23 22:49:32,925 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:49:32,926 - distributed.worker - INFO - dashboard at: 127.0.0.1:34627 8450s 2024-11-23 22:49:32,926 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41195 8450s 2024-11-23 22:49:32,926 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:49:32,926 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:49:32,926 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:49:32,926 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-mtmdd254 8450s 2024-11-23 22:49:32,926 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:49:32,927 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40135. Reason: failure-to-start- 8450s 2024-11-23 22:49:32,927 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:49:32,927 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37509. Reason: failure-to-start- 8450s 2024-11-23 22:49:32,928 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:49:32,929 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41195': TLS handshake failed with remote 'tls://127.0.0.1:38728': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:49:32,929 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41195': TLS handshake failed with remote 'tls://127.0.0.1:38730': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:49:32,932 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:49:33,937 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:49:33,944 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43589 8450s 2024-11-23 22:49:33,944 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35103/status 8450s 2024-11-23 22:49:33,944 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:49:33,957 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46613 8450s 2024-11-23 22:49:33,957 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46613 8450s 2024-11-23 22:49:33,957 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:49:33,957 - distributed.worker - INFO - dashboard at: 127.0.0.1:46451 8450s 2024-11-23 22:49:33,957 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43589 8450s 2024-11-23 22:49:33,957 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:49:33,957 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:49:33,957 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:49:33,957 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-y1krrtq7 8450s 2024-11-23 22:49:33,957 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:49:33,959 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44719 8450s 2024-11-23 22:49:33,959 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44719 8450s 2024-11-23 22:49:33,959 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:49:33,959 - distributed.worker - INFO - dashboard at: 127.0.0.1:39547 8450s 2024-11-23 22:49:33,959 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43589 8450s 2024-11-23 22:49:33,959 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:49:33,959 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:49:33,959 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:49:33,959 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-j9f6_idb 8450s 2024-11-23 22:49:33,959 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:49:33,960 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46613. Reason: failure-to-start- 8450s 2024-11-23 22:49:33,960 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:49:33,961 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44719. Reason: failure-to-start- 8450s 2024-11-23 22:49:33,961 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:49:33,964 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43589': TLS handshake failed with remote 'tls://127.0.0.1:37516': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:49:33,964 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43589': TLS handshake failed with remote 'tls://127.0.0.1:37520': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:49:33,965 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:49:34,970 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:49:34,976 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36953 8450s 2024-11-23 22:49:34,977 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46357/status 8450s 2024-11-23 22:49:34,977 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:49:34,991 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33463 8450s 2024-11-23 22:49:34,992 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33463 8450s 2024-11-23 22:49:34,992 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:49:34,992 - distributed.worker - INFO - dashboard at: 127.0.0.1:44875 8450s 2024-11-23 22:49:34,992 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36953 8450s 2024-11-23 22:49:34,992 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:49:34,992 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:49:34,992 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:49:34,992 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-919_qnn4 8450s 2024-11-23 22:49:34,992 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:49:34,994 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34815 8450s 2024-11-23 22:49:34,994 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34815 8450s 2024-11-23 22:49:34,994 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:49:34,994 - distributed.worker - INFO - dashboard at: 127.0.0.1:37965 8450s 2024-11-23 22:49:34,994 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36953 8450s 2024-11-23 22:49:34,994 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:49:34,994 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:49:34,994 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:49:34,994 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-v1keysvu 8450s 2024-11-23 22:49:34,994 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:49:34,997 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33463. Reason: failure-to-start- 8450s 2024-11-23 22:49:34,997 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:49:34,998 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34815. Reason: failure-to-start- 8450s 2024-11-23 22:49:34,998 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:49:34,999 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36953': TLS handshake failed with remote 'tls://127.0.0.1:48500': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:49:34,999 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36953': TLS handshake failed with remote 'tls://127.0.0.1:48506': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:49:35,000 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:49:36,005 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:49:36,011 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39153 8450s 2024-11-23 22:49:36,012 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39007/status 8450s 2024-11-23 22:49:36,012 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:49:36,025 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35971 8450s 2024-11-23 22:49:36,025 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35971 8450s 2024-11-23 22:49:36,025 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:49:36,025 - distributed.worker - INFO - dashboard at: 127.0.0.1:35453 8450s 2024-11-23 22:49:36,025 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39153 8450s 2024-11-23 22:49:36,025 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:49:36,025 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:49:36,026 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:49:36,026 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-xu5fmb6c 8450s 2024-11-23 22:49:36,026 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:49:36,027 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39555 8450s 2024-11-23 22:49:36,027 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39555 8450s 2024-11-23 22:49:36,027 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:49:36,027 - distributed.worker - INFO - dashboard at: 127.0.0.1:34681 8450s 2024-11-23 22:49:36,028 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39153 8450s 2024-11-23 22:49:36,028 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:49:36,028 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:49:36,028 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:49:36,028 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-xq8inq51 8450s 2024-11-23 22:49:36,028 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:49:36,032 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35971. Reason: failure-to-start- 8450s 2024-11-23 22:49:36,032 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:49:36,032 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39555. Reason: failure-to-start- 8450s 2024-11-23 22:49:36,032 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:49:36,034 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39153': TLS handshake failed with remote 'tls://127.0.0.1:37812': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:49:36,034 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39153': TLS handshake failed with remote 'tls://127.0.0.1:37816': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:49:36,035 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:49:37,041 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:49:37,047 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41007 8450s 2024-11-23 22:49:37,048 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43617/status 8450s 2024-11-23 22:49:37,048 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:49:37,060 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41597 8450s 2024-11-23 22:49:37,061 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41597 8450s 2024-11-23 22:49:37,061 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:49:37,061 - distributed.worker - INFO - dashboard at: 127.0.0.1:44025 8450s 2024-11-23 22:49:37,061 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41007 8450s 2024-11-23 22:49:37,061 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:49:37,061 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:49:37,061 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:49:37,061 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-e303mj1t 8450s 2024-11-23 22:49:37,061 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:49:37,063 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44125 8450s 2024-11-23 22:49:37,063 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44125 8450s 2024-11-23 22:49:37,063 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:49:37,063 - distributed.worker - INFO - dashboard at: 127.0.0.1:43193 8450s 2024-11-23 22:49:37,063 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41007 8450s 2024-11-23 22:49:37,063 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:49:37,063 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:49:37,063 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:49:37,063 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-4m69x00e 8450s 2024-11-23 22:49:37,063 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:49:37,066 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41597. Reason: failure-to-start- 8450s 2024-11-23 22:49:37,066 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:49:37,067 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44125. Reason: failure-to-start- 8450s 2024-11-23 22:49:37,067 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:49:37,068 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41007': TLS handshake failed with remote 'tls://127.0.0.1:46334': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:49:37,068 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41007': TLS handshake failed with remote 'tls://127.0.0.1:46338': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:49:37,069 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:49:38,074 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:49:38,082 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36995 8450s 2024-11-23 22:49:38,083 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43939/status 8450s 2024-11-23 22:49:38,083 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:49:38,097 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37493 8450s 2024-11-23 22:49:38,097 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37493 8450s 2024-11-23 22:49:38,097 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:49:38,097 - distributed.worker - INFO - dashboard at: 127.0.0.1:35453 8450s 2024-11-23 22:49:38,097 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36995 8450s 2024-11-23 22:49:38,097 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:49:38,097 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:49:38,097 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:49:38,097 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-hxiio30g 8450s 2024-11-23 22:49:38,097 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:49:38,099 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37649 8450s 2024-11-23 22:49:38,099 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37649 8450s 2024-11-23 22:49:38,099 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:49:38,099 - distributed.worker - INFO - dashboard at: 127.0.0.1:45341 8450s 2024-11-23 22:49:38,099 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36995 8450s 2024-11-23 22:49:38,099 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:49:38,099 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:49:38,099 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:49:38,099 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-2bi2m82k 8450s 2024-11-23 22:49:38,099 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:49:38,100 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37493. Reason: failure-to-start- 8450s 2024-11-23 22:49:38,101 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:49:38,101 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37649. Reason: failure-to-start- 8450s 2024-11-23 22:49:38,101 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:49:38,102 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36995': TLS handshake failed with remote 'tls://127.0.0.1:36610': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:49:38,102 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36995': TLS handshake failed with remote 'tls://127.0.0.1:36612': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:49:38,103 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:49:39,109 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:49:39,116 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37803 8450s 2024-11-23 22:49:39,117 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39481/status 8450s 2024-11-23 22:49:39,117 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:49:39,132 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37703 8450s 2024-11-23 22:49:39,133 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37703 8450s 2024-11-23 22:49:39,133 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:49:39,133 - distributed.worker - INFO - dashboard at: 127.0.0.1:38431 8450s 2024-11-23 22:49:39,133 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37803 8450s 2024-11-23 22:49:39,133 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:49:39,133 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:49:39,133 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:49:39,133 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-68wg3d63 8450s 2024-11-23 22:49:39,133 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:49:39,135 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38819 8450s 2024-11-23 22:49:39,135 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38819 8450s 2024-11-23 22:49:39,135 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:49:39,135 - distributed.worker - INFO - dashboard at: 127.0.0.1:33959 8450s 2024-11-23 22:49:39,135 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37803 8450s 2024-11-23 22:49:39,135 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:49:39,135 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:49:39,135 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:49:39,135 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-cxozpb78 8450s 2024-11-23 22:49:39,135 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:49:39,136 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37703. Reason: failure-to-start- 8450s 2024-11-23 22:49:39,137 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:49:39,137 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38819. Reason: failure-to-start- 8450s 2024-11-23 22:49:39,137 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:49:39,138 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37803': TLS handshake failed with remote 'tls://127.0.0.1:51556': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:49:39,138 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37803': TLS handshake failed with remote 'tls://127.0.0.1:51558': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:49:39,139 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:49:40,144 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:49:40,151 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36321 8450s 2024-11-23 22:49:40,151 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41437/status 8450s 2024-11-23 22:49:40,152 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:49:40,167 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41531 8450s 2024-11-23 22:49:40,167 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41531 8450s 2024-11-23 22:49:40,167 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:49:40,167 - distributed.worker - INFO - dashboard at: 127.0.0.1:39447 8450s 2024-11-23 22:49:40,167 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36321 8450s 2024-11-23 22:49:40,167 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:49:40,167 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:49:40,167 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:49:40,167 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-wj86958t 8450s 2024-11-23 22:49:40,167 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:49:40,170 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39883 8450s 2024-11-23 22:49:40,170 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39883 8450s 2024-11-23 22:49:40,170 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:49:40,170 - distributed.worker - INFO - dashboard at: 127.0.0.1:43491 8450s 2024-11-23 22:49:40,170 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36321 8450s 2024-11-23 22:49:40,170 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:49:40,170 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:49:40,171 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:49:40,171 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-5af72dnc 8450s 2024-11-23 22:49:40,171 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:49:40,172 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41531. Reason: failure-to-start- 8450s 2024-11-23 22:49:40,172 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:49:40,172 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39883. Reason: failure-to-start- 8450s 2024-11-23 22:49:40,172 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:49:40,173 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36321': TLS handshake failed with remote 'tls://127.0.0.1:44992': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:49:40,173 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36321': TLS handshake failed with remote 'tls://127.0.0.1:44994': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:49:40,175 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:49:41,181 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:49:41,187 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34945 8450s 2024-11-23 22:49:41,187 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35361/status 8450s 2024-11-23 22:49:41,188 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:49:41,200 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37777 8450s 2024-11-23 22:49:41,200 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37777 8450s 2024-11-23 22:49:41,200 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:49:41,200 - distributed.worker - INFO - dashboard at: 127.0.0.1:34665 8450s 2024-11-23 22:49:41,200 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34945 8450s 2024-11-23 22:49:41,200 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:49:41,200 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:49:41,201 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:49:41,201 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-7j_rpynf 8450s 2024-11-23 22:49:41,201 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:49:41,202 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41153 8450s 2024-11-23 22:49:41,202 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41153 8450s 2024-11-23 22:49:41,202 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:49:41,202 - distributed.worker - INFO - dashboard at: 127.0.0.1:34201 8450s 2024-11-23 22:49:41,203 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34945 8450s 2024-11-23 22:49:41,203 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:49:41,203 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:49:41,203 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:49:41,203 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-h_emxova 8450s 2024-11-23 22:49:41,203 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:49:41,204 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37777. Reason: failure-to-start- 8450s 2024-11-23 22:49:41,204 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:49:41,204 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41153. Reason: failure-to-start- 8450s 2024-11-23 22:49:41,204 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:49:41,205 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34945': TLS handshake failed with remote 'tls://127.0.0.1:49398': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:49:41,205 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34945': TLS handshake failed with remote 'tls://127.0.0.1:49408': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:49:41,207 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:49:42,211 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:49:42,218 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40477 8450s 2024-11-23 22:49:42,218 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40721/status 8450s 2024-11-23 22:49:42,218 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:49:42,232 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35495 8450s 2024-11-23 22:49:42,232 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35495 8450s 2024-11-23 22:49:42,232 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:49:42,232 - distributed.worker - INFO - dashboard at: 127.0.0.1:42919 8450s 2024-11-23 22:49:42,233 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40477 8450s 2024-11-23 22:49:42,233 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:49:42,233 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:49:42,233 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:49:42,233 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-rcczbh_z 8450s 2024-11-23 22:49:42,233 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:49:42,235 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41011 8450s 2024-11-23 22:49:42,235 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41011 8450s 2024-11-23 22:49:42,235 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:49:42,235 - distributed.worker - INFO - dashboard at: 127.0.0.1:35633 8450s 2024-11-23 22:49:42,235 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:40477 8450s 2024-11-23 22:49:42,235 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:49:42,235 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:49:42,235 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:49:42,235 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-24etk4ky 8450s 2024-11-23 22:49:42,235 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:49:42,236 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35495. Reason: failure-to-start- 8450s 2024-11-23 22:49:42,236 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:49:42,237 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41011. Reason: failure-to-start- 8450s 2024-11-23 22:49:42,237 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:49:42,238 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40477': TLS handshake failed with remote 'tls://127.0.0.1:34692': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:49:42,238 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40477': TLS handshake failed with remote 'tls://127.0.0.1:34696': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:49:42,243 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:49:43,248 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:49:43,256 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39787 8450s 2024-11-23 22:49:43,256 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39629/status 8450s 2024-11-23 22:49:43,256 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:49:43,270 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36667 8450s 2024-11-23 22:49:43,271 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36667 8450s 2024-11-23 22:49:43,271 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:49:43,271 - distributed.worker - INFO - dashboard at: 127.0.0.1:32957 8450s 2024-11-23 22:49:43,271 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 8450s 2024-11-23 22:49:43,271 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:49:43,271 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:49:43,271 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:49:43,271 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-vfhuzfq4 8450s 2024-11-23 22:49:43,271 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:49:43,273 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41937 8450s 2024-11-23 22:49:43,273 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41937 8450s 2024-11-23 22:49:43,273 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:49:43,273 - distributed.worker - INFO - dashboard at: 127.0.0.1:39741 8450s 2024-11-23 22:49:43,273 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39787 8450s 2024-11-23 22:49:43,273 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:49:43,273 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:49:43,273 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:49:43,273 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-_n96cuci 8450s 2024-11-23 22:49:43,273 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:49:43,274 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36667. Reason: failure-to-start- 8450s 2024-11-23 22:49:43,274 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:49:43,275 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41937. Reason: failure-to-start- 8450s 2024-11-23 22:49:43,275 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:49:43,279 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:45500': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:49:43,279 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39787': TLS handshake failed with remote 'tls://127.0.0.1:45508': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:49:43,281 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:49:44,287 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:49:44,295 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44857 8450s 2024-11-23 22:49:44,295 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43761/status 8450s 2024-11-23 22:49:44,296 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:49:44,311 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38023 8450s 2024-11-23 22:49:44,311 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38023 8450s 2024-11-23 22:49:44,311 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:49:44,311 - distributed.worker - INFO - dashboard at: 127.0.0.1:41585 8450s 2024-11-23 22:49:44,311 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44857 8450s 2024-11-23 22:49:44,311 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:49:44,311 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:49:44,311 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:49:44,311 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-gnkwb2nr 8450s 2024-11-23 22:49:44,311 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:49:44,313 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39657 8450s 2024-11-23 22:49:44,313 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39657 8450s 2024-11-23 22:49:44,313 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:49:44,313 - distributed.worker - INFO - dashboard at: 127.0.0.1:43173 8450s 2024-11-23 22:49:44,313 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44857 8450s 2024-11-23 22:49:44,313 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:49:44,314 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:49:44,314 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:49:44,314 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-b7xgjbq1 8450s 2024-11-23 22:49:44,314 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:49:44,317 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38023. Reason: failure-to-start- 8450s 2024-11-23 22:49:44,317 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:49:44,317 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39657. Reason: failure-to-start- 8450s 2024-11-23 22:49:44,318 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:49:44,319 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44857': TLS handshake failed with remote 'tls://127.0.0.1:42960': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:49:44,319 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44857': TLS handshake failed with remote 'tls://127.0.0.1:42964': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:49:44,320 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:49:45,325 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:49:45,331 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34327 8450s 2024-11-23 22:49:45,332 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43487/status 8450s 2024-11-23 22:49:45,332 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:49:45,344 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40791 8450s 2024-11-23 22:49:45,344 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40791 8450s 2024-11-23 22:49:45,344 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:49:45,344 - distributed.worker - INFO - dashboard at: 127.0.0.1:35189 8450s 2024-11-23 22:49:45,344 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34327 8450s 2024-11-23 22:49:45,344 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:49:45,344 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:49:45,344 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:49:45,344 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-4v4c4o8j 8450s 2024-11-23 22:49:45,344 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:49:45,346 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34191 8450s 2024-11-23 22:49:45,346 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34191 8450s 2024-11-23 22:49:45,346 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:49:45,346 - distributed.worker - INFO - dashboard at: 127.0.0.1:37887 8450s 2024-11-23 22:49:45,355 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34327 8450s 2024-11-23 22:49:45,356 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:49:45,356 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:49:45,356 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:49:45,356 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-o29ii8fq 8450s 2024-11-23 22:49:45,356 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:49:45,359 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40791. Reason: failure-to-start- 8450s 2024-11-23 22:49:45,360 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:49:45,360 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34191. Reason: failure-to-start- 8450s 2024-11-23 22:49:45,360 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:49:45,363 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34327': TLS handshake failed with remote 'tls://127.0.0.1:41460': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:49:45,363 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34327': TLS handshake failed with remote 'tls://127.0.0.1:41474': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:49:45,364 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s _____________________________ test_retire_workers ______________________________ 8450s 8450s fut = , timeout = 0 8450s 8450s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 8450s async with asyncio.timeout(timeout): 8450s > return await fut 8450s 8450s /usr/lib/python3/dist-packages/distributed/utils.py:1960: 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s /usr/lib/python3/dist-packages/distributed/nanny.py:358: in start_unsafe 8450s comm = await self.rpc.connect(saddr) 8450s /usr/lib/python3/dist-packages/distributed/core.py:1620: in connect 8450s return await self._connect(addr=addr, timeout=timeout) 8450s /usr/lib/python3/dist-packages/distributed/core.py:1564: in _connect 8450s comm = await connect( 8450s /usr/lib/python3/dist-packages/distributed/comm/core.py:342: in connect 8450s comm = await wait_for( 8450s /usr/lib/python3/dist-packages/distributed/utils.py:1960: in wait_for 8450s return await fut 8450s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:546: in connect 8450s stream = await self.client.connect( 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s 8450s self = , host = '127.0.0.1' 8450s port = 40577, af = 8450s ssl_options = 8450s max_buffer_size = 8364507136.0, source_ip = None, source_port = None 8450s timeout = None 8450s 8450s async def connect( 8450s self, 8450s host: str, 8450s port: int, 8450s af: socket.AddressFamily = socket.AF_UNSPEC, 8450s ssl_options: Optional[Union[Dict[str, Any], ssl.SSLContext]] = None, 8450s max_buffer_size: Optional[int] = None, 8450s source_ip: Optional[str] = None, 8450s source_port: Optional[int] = None, 8450s timeout: Optional[Union[float, datetime.timedelta]] = None, 8450s ) -> IOStream: 8450s """Connect to the given host and port. 8450s 8450s Asynchronously returns an `.IOStream` (or `.SSLIOStream` if 8450s ``ssl_options`` is not None). 8450s 8450s Using the ``source_ip`` kwarg, one can specify the source 8450s IP address to use when establishing the connection. 8450s In case the user needs to resolve and 8450s use a specific interface, it has to be handled outside 8450s of Tornado as this depends very much on the platform. 8450s 8450s Raises `TimeoutError` if the input future does not complete before 8450s ``timeout``, which may be specified in any form allowed by 8450s `.IOLoop.add_timeout` (i.e. a `datetime.timedelta` or an absolute time 8450s relative to `.IOLoop.time`) 8450s 8450s Similarly, when the user requires a certain source port, it can 8450s be specified using the ``source_port`` arg. 8450s 8450s .. versionchanged:: 4.5 8450s Added the ``source_ip`` and ``source_port`` arguments. 8450s 8450s .. versionchanged:: 5.0 8450s Added the ``timeout`` argument. 8450s """ 8450s if timeout is not None: 8450s if isinstance(timeout, numbers.Real): 8450s timeout = IOLoop.current().time() + timeout 8450s elif isinstance(timeout, datetime.timedelta): 8450s timeout = IOLoop.current().time() + timeout.total_seconds() 8450s else: 8450s raise TypeError("Unsupported timeout %r" % timeout) 8450s if timeout is not None: 8450s addrinfo = await gen.with_timeout( 8450s timeout, self.resolver.resolve(host, port, af) 8450s ) 8450s else: 8450s addrinfo = await self.resolver.resolve(host, port, af) 8450s connector = _Connector( 8450s addrinfo, 8450s functools.partial( 8450s self._create_stream, 8450s max_buffer_size, 8450s source_ip=source_ip, 8450s source_port=source_port, 8450s ), 8450s ) 8450s > af, addr, stream = await connector.start(connect_timeout=timeout) 8450s E asyncio.exceptions.CancelledError 8450s 8450s /usr/lib/python3/dist-packages/tornado/tcpclient.py:279: CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s self = 8450s 8450s @final 8450s async def start(self): 8450s async with self._startup_lock: 8450s if self.status == Status.failed: 8450s assert self.__startup_exc is not None 8450s raise self.__startup_exc 8450s elif self.status != Status.init: 8450s return self 8450s timeout = getattr(self, "death_timeout", None) 8450s 8450s async def _close_on_failure(exc: Exception) -> None: 8450s await self.close(reason=f"failure-to-start-{str(type(exc))}") 8450s self.status = Status.failed 8450s self.__startup_exc = exc 8450s 8450s try: 8450s > await wait_for(self.start_unsafe(), timeout=timeout) 8450s 8450s /usr/lib/python3/dist-packages/distributed/core.py:664: 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 8450s async with asyncio.timeout(timeout): 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s 8450s self = 8450s exc_type = 8450s exc_val = CancelledError(), exc_tb = 8450s 8450s async def __aexit__( 8450s self, 8450s exc_type: Optional[Type[BaseException]], 8450s exc_val: Optional[BaseException], 8450s exc_tb: Optional[TracebackType], 8450s ) -> Optional[bool]: 8450s assert self._state in (_State.ENTERED, _State.EXPIRING) 8450s 8450s if self._timeout_handler is not None: 8450s self._timeout_handler.cancel() 8450s self._timeout_handler = None 8450s 8450s if self._state is _State.EXPIRING: 8450s self._state = _State.EXPIRED 8450s 8450s if self._task.uncancel() <= self._cancelling and exc_type is not None: 8450s # Since there are no new cancel requests, we're 8450s # handling this. 8450s if issubclass(exc_type, exceptions.CancelledError): 8450s > raise TimeoutError from exc_val 8450s E TimeoutError 8450s 8450s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s @contextlib.asynccontextmanager 8450s async def _cluster_factory(): 8450s workers = [] 8450s s = None 8450s try: 8450s for _ in range(60): 8450s try: 8450s > s, ws = await start_cluster( 8450s nthreads, 8450s scheduler, 8450s security=security, 8450s Worker=Worker, 8450s scheduler_kwargs=scheduler_kwargs, 8450s worker_kwargs=merge( 8450s {"death_timeout": min(15, int(deadline.remaining))}, 8450s worker_kwargs, 8450s ), 8450s ) 8450s 8450s /usr/lib/python3/dist-packages/distributed/utils_test.py:966: 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s /usr/lib/python3/dist-packages/distributed/utils_test.py:789: in start_cluster 8450s await asyncio.gather(*workers) 8450s /usr/lib/python3.13/asyncio/tasks.py:737: in _wrap_awaitable 8450s return await awaitable 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s 8450s self = 8450s 8450s @final 8450s async def start(self): 8450s async with self._startup_lock: 8450s if self.status == Status.failed: 8450s assert self.__startup_exc is not None 8450s raise self.__startup_exc 8450s elif self.status != Status.init: 8450s return self 8450s timeout = getattr(self, "death_timeout", None) 8450s 8450s async def _close_on_failure(exc: Exception) -> None: 8450s await self.close(reason=f"failure-to-start-{str(type(exc))}") 8450s self.status = Status.failed 8450s self.__startup_exc = exc 8450s 8450s try: 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s except asyncio.TimeoutError as exc: 8450s await _close_on_failure(exc) 8450s > raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s E TimeoutError: Nanny start timed out after 0s. 8450s 8450s /usr/lib/python3/dist-packages/distributed/core.py:667: TimeoutError 8450s 8450s During handling of the above exception, another exception occurred: 8450s 8450s fut = ._..test_func..async_fn at 0xe87982e0> 8450s timeout = 60 8450s 8450s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 8450s async with asyncio.timeout(timeout): 8450s > return await fut 8450s 8450s /usr/lib/python3/dist-packages/distributed/utils.py:1960: 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s /usr/lib/python3/dist-packages/distributed/utils_test.py:999: in async_fn 8450s _cluster_factory() as (s, workers), 8450s /usr/lib/python3.13/contextlib.py:214: in __aenter__ 8450s return await anext(self.gen) 8450s /usr/lib/python3/dist-packages/distributed/utils_test.py:983: in _cluster_factory 8450s await asyncio.sleep(1) 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s 8450s delay = 1, result = None 8450s 8450s async def sleep(delay, result=None): 8450s """Coroutine that completes after a given time (in seconds).""" 8450s if delay <= 0: 8450s await __sleep0() 8450s return result 8450s 8450s if math.isnan(delay): 8450s raise ValueError("Invalid delay: NaN (not a number)") 8450s 8450s loop = events.get_running_loop() 8450s future = loop.create_future() 8450s h = loop.call_later(delay, 8450s futures._set_result_unless_cancelled, 8450s future, result) 8450s try: 8450s > return await future 8450s E asyncio.exceptions.CancelledError 8450s 8450s /usr/lib/python3.13/asyncio/tasks.py:718: CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s args = (), kwds = {} 8450s 8450s @wraps(func) 8450s def inner(*args, **kwds): 8450s with self._recreate_cm(): 8450s > return func(*args, **kwds) 8450s 8450s /usr/lib/python3.13/contextlib.py:85: 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s /usr/lib/python3.13/contextlib.py:85: in inner 8450s return func(*args, **kwds) 8450s /usr/lib/python3/dist-packages/distributed/utils_test.py:1102: in test_func 8450s return _run_and_close_tornado(async_fn_outer) 8450s /usr/lib/python3/dist-packages/distributed/utils_test.py:378: in _run_and_close_tornado 8450s return asyncio_run(inner_fn(), loop_factory=get_loop_factory()) 8450s /usr/lib/python3.13/asyncio/runners.py:194: in run 8450s return runner.run(main) 8450s /usr/lib/python3.13/asyncio/runners.py:118: in run 8450s return self._loop.run_until_complete(task) 8450s /usr/lib/python3.13/asyncio/base_events.py:720: in run_until_complete 8450s return future.result() 8450s /usr/lib/python3/dist-packages/distributed/utils_test.py:375: in inner_fn 8450s return await async_fn(*args, **kwargs) 8450s /usr/lib/python3/dist-packages/distributed/utils_test.py:1099: in async_fn_outer 8450s return await utils_wait_for(async_fn(), timeout=timeout * 2) 8450s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 8450s async with asyncio.timeout(timeout): 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s 8450s self = 8450s exc_type = 8450s exc_val = CancelledError(), exc_tb = 8450s 8450s async def __aexit__( 8450s self, 8450s exc_type: Optional[Type[BaseException]], 8450s exc_val: Optional[BaseException], 8450s exc_tb: Optional[TracebackType], 8450s ) -> Optional[bool]: 8450s assert self._state in (_State.ENTERED, _State.EXPIRING) 8450s 8450s if self._timeout_handler is not None: 8450s self._timeout_handler.cancel() 8450s self._timeout_handler = None 8450s 8450s if self._state is _State.EXPIRING: 8450s self._state = _State.EXPIRED 8450s 8450s if self._task.uncancel() <= self._cancelling and exc_type is not None: 8450s # Since there are no new cancel requests, we're 8450s # handling this. 8450s if issubclass(exc_type, exceptions.CancelledError): 8450s > raise TimeoutError from exc_val 8450s E TimeoutError 8450s 8450s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 8450s ----------------------------- Captured stderr call ----------------------------- 8450s 2024-11-23 22:49:46,974 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:49:46,981 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35061 8450s 2024-11-23 22:49:46,981 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42919/status 8450s 2024-11-23 22:49:46,981 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:49:47,003 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:34153'. Reason: failure-to-start- 8450s 2024-11-23 22:49:47,003 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:35555'. Reason: failure-to-start- 8450s 2024-11-23 22:49:47,004 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35061': TLS handshake failed with remote 'tls://127.0.0.1:45958': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:47,004 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35061': TLS handshake failed with remote 'tls://127.0.0.1:45964': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:47,004 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 8450s stream = await stream.start_tls( 8450s ^^^^^^^^^^^^^^^^^^^^^^^ 8450s False, ssl_options=ssl_options, server_hostname=host 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 8450s self.socket.do_handshake() 8450s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 8450s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 8450s self._sslobj.do_handshake() 8450s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 8450s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 8450s comm = await self.rpc.connect(saddr) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 8450s return await self._connect(addr=addr, timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 8450s comm = await connect( 8450s ^^^^^^^^^^^^^^ 8450s ...<4 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 8450s raise FatalCommClosedError( 8450s ...<2 lines>... 8450s ) from err 8450s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 8450s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 8450s RuntimeError: Nanny failed to start. 8450s 2024-11-23 22:49:48,009 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:49:48,016 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38611 8450s 2024-11-23 22:49:48,016 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46085/status 8450s 2024-11-23 22:49:48,016 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:49:48,039 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:34201'. Reason: failure-to-start- 8450s 2024-11-23 22:49:48,039 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:46877'. Reason: failure-to-start- 8450s 2024-11-23 22:49:48,040 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38611': TLS handshake failed with remote 'tls://127.0.0.1:34192': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:48,040 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38611': TLS handshake failed with remote 'tls://127.0.0.1:34198': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:48,040 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 8450s stream = await stream.start_tls( 8450s ^^^^^^^^^^^^^^^^^^^^^^^ 8450s False, ssl_options=ssl_options, server_hostname=host 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 8450s self.socket.do_handshake() 8450s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 8450s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 8450s self._sslobj.do_handshake() 8450s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 8450s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 8450s comm = await self.rpc.connect(saddr) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 8450s return await self._connect(addr=addr, timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 8450s comm = await connect( 8450s ^^^^^^^^^^^^^^ 8450s ...<4 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 8450s raise FatalCommClosedError( 8450s ...<2 lines>... 8450s ) from err 8450s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 8450s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 8450s RuntimeError: Nanny failed to start. 8450s 2024-11-23 22:49:49,045 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:49:49,051 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40817 8450s 2024-11-23 22:49:49,051 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46615/status 8450s 2024-11-23 22:49:49,051 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:49:49,072 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:44585'. Reason: failure-to-start- 8450s 2024-11-23 22:49:49,073 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:35411'. Reason: failure-to-start- 8450s 2024-11-23 22:49:49,073 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40817': TLS handshake failed with remote 'tls://127.0.0.1:32874': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:49,073 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40817': TLS handshake failed with remote 'tls://127.0.0.1:32880': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:49,073 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 8450s stream = await stream.start_tls( 8450s ^^^^^^^^^^^^^^^^^^^^^^^ 8450s False, ssl_options=ssl_options, server_hostname=host 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 8450s self.socket.do_handshake() 8450s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 8450s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 8450s self._sslobj.do_handshake() 8450s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 8450s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 8450s comm = await self.rpc.connect(saddr) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 8450s return await self._connect(addr=addr, timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 8450s comm = await connect( 8450s ^^^^^^^^^^^^^^ 8450s ...<4 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 8450s raise FatalCommClosedError( 8450s ...<2 lines>... 8450s ) from err 8450s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 8450s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 8450s RuntimeError: Nanny failed to start. 8450s 2024-11-23 22:49:50,079 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:49:50,086 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44077 8450s 2024-11-23 22:49:50,086 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34803/status 8450s 2024-11-23 22:49:50,086 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:49:50,108 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:40809'. Reason: failure-to-start- 8450s 2024-11-23 22:49:50,108 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:46549'. Reason: failure-to-start- 8450s 2024-11-23 22:49:50,108 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44077': TLS handshake failed with remote 'tls://127.0.0.1:50242': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:50,108 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44077': TLS handshake failed with remote 'tls://127.0.0.1:50256': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:50,108 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 8450s stream = await stream.start_tls( 8450s ^^^^^^^^^^^^^^^^^^^^^^^ 8450s False, ssl_options=ssl_options, server_hostname=host 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 8450s self.socket.do_handshake() 8450s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 8450s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 8450s self._sslobj.do_handshake() 8450s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 8450s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 8450s comm = await self.rpc.connect(saddr) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 8450s return await self._connect(addr=addr, timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 8450s comm = await connect( 8450s ^^^^^^^^^^^^^^ 8450s ...<4 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 8450s raise FatalCommClosedError( 8450s ...<2 lines>... 8450s ) from err 8450s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 8450s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 8450s RuntimeError: Nanny failed to start. 8450s 2024-11-23 22:49:51,115 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:49:51,122 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44597 8450s 2024-11-23 22:49:51,122 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45323/status 8450s 2024-11-23 22:49:51,122 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:49:51,144 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:40205'. Reason: failure-to-start- 8450s 2024-11-23 22:49:51,145 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:33873'. Reason: failure-to-start- 8450s 2024-11-23 22:49:51,145 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44597': TLS handshake failed with remote 'tls://127.0.0.1:34672': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:51,145 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44597': TLS handshake failed with remote 'tls://127.0.0.1:34686': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:51,145 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 8450s stream = await stream.start_tls( 8450s ^^^^^^^^^^^^^^^^^^^^^^^ 8450s False, ssl_options=ssl_options, server_hostname=host 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 8450s self.socket.do_handshake() 8450s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 8450s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 8450s self._sslobj.do_handshake() 8450s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 8450s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 8450s comm = await self.rpc.connect(saddr) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 8450s return await self._connect(addr=addr, timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 8450s comm = await connect( 8450s ^^^^^^^^^^^^^^ 8450s ...<4 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 8450s raise FatalCommClosedError( 8450s ...<2 lines>... 8450s ) from err 8450s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 8450s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 8450s RuntimeError: Nanny failed to start. 8450s 2024-11-23 22:49:52,151 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:49:52,161 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45791 8450s 2024-11-23 22:49:52,161 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39425/status 8450s 2024-11-23 22:49:52,161 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:49:52,184 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:44451'. Reason: failure-to-start- 8450s 2024-11-23 22:49:52,184 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:39137'. Reason: failure-to-start- 8450s 2024-11-23 22:49:52,185 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45791': TLS handshake failed with remote 'tls://127.0.0.1:40600': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:52,185 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45791': TLS handshake failed with remote 'tls://127.0.0.1:40614': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:52,185 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 8450s stream = await stream.start_tls( 8450s ^^^^^^^^^^^^^^^^^^^^^^^ 8450s False, ssl_options=ssl_options, server_hostname=host 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 8450s self.socket.do_handshake() 8450s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 8450s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 8450s self._sslobj.do_handshake() 8450s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 8450s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 8450s comm = await self.rpc.connect(saddr) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 8450s return await self._connect(addr=addr, timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 8450s comm = await connect( 8450s ^^^^^^^^^^^^^^ 8450s ...<4 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 8450s raise FatalCommClosedError( 8450s ...<2 lines>... 8450s ) from err 8450s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 8450s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 8450s RuntimeError: Nanny failed to start. 8450s 2024-11-23 22:49:53,190 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:49:53,197 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36759 8450s 2024-11-23 22:49:53,197 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42033/status 8450s 2024-11-23 22:49:53,197 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:49:53,219 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:44921'. Reason: failure-to-start- 8450s 2024-11-23 22:49:53,220 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:34305'. Reason: failure-to-start- 8450s 2024-11-23 22:49:53,220 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:50662': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:53,220 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36759': TLS handshake failed with remote 'tls://127.0.0.1:50664': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:53,220 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 8450s stream = await stream.start_tls( 8450s ^^^^^^^^^^^^^^^^^^^^^^^ 8450s False, ssl_options=ssl_options, server_hostname=host 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 8450s self.socket.do_handshake() 8450s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 8450s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 8450s self._sslobj.do_handshake() 8450s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 8450s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 8450s comm = await self.rpc.connect(saddr) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 8450s return await self._connect(addr=addr, timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 8450s comm = await connect( 8450s ^^^^^^^^^^^^^^ 8450s ...<4 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 8450s raise FatalCommClosedError( 8450s ...<2 lines>... 8450s ) from err 8450s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 8450s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 8450s RuntimeError: Nanny failed to start. 8450s 2024-11-23 22:49:54,225 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:49:54,234 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45297 8450s 2024-11-23 22:49:54,234 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45389/status 8450s 2024-11-23 22:49:54,234 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:49:54,257 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:35337'. Reason: failure-to-start- 8450s 2024-11-23 22:49:54,257 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:43439'. Reason: failure-to-start- 8450s 2024-11-23 22:49:54,257 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45297': TLS handshake failed with remote 'tls://127.0.0.1:47296': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:54,257 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45297': TLS handshake failed with remote 'tls://127.0.0.1:47310': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:54,258 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 8450s stream = await stream.start_tls( 8450s ^^^^^^^^^^^^^^^^^^^^^^^ 8450s False, ssl_options=ssl_options, server_hostname=host 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 8450s self.socket.do_handshake() 8450s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 8450s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 8450s self._sslobj.do_handshake() 8450s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 8450s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 8450s comm = await self.rpc.connect(saddr) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 8450s return await self._connect(addr=addr, timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 8450s comm = await connect( 8450s ^^^^^^^^^^^^^^ 8450s ...<4 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 8450s raise FatalCommClosedError( 8450s ...<2 lines>... 8450s ) from err 8450s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 8450s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 8450s RuntimeError: Nanny failed to start. 8450s 2024-11-23 22:49:55,262 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:49:55,268 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34415 8450s 2024-11-23 22:49:55,269 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44575/status 8450s 2024-11-23 22:49:55,269 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:49:55,291 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:44363'. Reason: failure-to-start- 8450s 2024-11-23 22:49:55,291 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:41625'. Reason: failure-to-start- 8450s 2024-11-23 22:49:55,291 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34415': TLS handshake failed with remote 'tls://127.0.0.1:55192': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:55,291 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34415': TLS handshake failed with remote 'tls://127.0.0.1:55196': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:55,291 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 8450s stream = await stream.start_tls( 8450s ^^^^^^^^^^^^^^^^^^^^^^^ 8450s False, ssl_options=ssl_options, server_hostname=host 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 8450s self.socket.do_handshake() 8450s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 8450s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 8450s self._sslobj.do_handshake() 8450s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 8450s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 8450s comm = await self.rpc.connect(saddr) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 8450s return await self._connect(addr=addr, timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 8450s comm = await connect( 8450s ^^^^^^^^^^^^^^ 8450s ...<4 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 8450s raise FatalCommClosedError( 8450s ...<2 lines>... 8450s ) from err 8450s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 8450s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 8450s RuntimeError: Nanny failed to start. 8450s 2024-11-23 22:49:56,298 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:49:56,305 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45419 8450s 2024-11-23 22:49:56,305 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38245/status 8450s 2024-11-23 22:49:56,305 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:49:56,327 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:34547'. Reason: failure-to-start- 8450s 2024-11-23 22:49:56,328 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:46569'. Reason: failure-to-start- 8450s 2024-11-23 22:49:56,328 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45419': TLS handshake failed with remote 'tls://127.0.0.1:33720': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:56,328 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45419': TLS handshake failed with remote 'tls://127.0.0.1:33722': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:56,328 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 8450s stream = await stream.start_tls( 8450s ^^^^^^^^^^^^^^^^^^^^^^^ 8450s False, ssl_options=ssl_options, server_hostname=host 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 8450s self.socket.do_handshake() 8450s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 8450s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 8450s self._sslobj.do_handshake() 8450s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 8450s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 8450s comm = await self.rpc.connect(saddr) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 8450s return await self._connect(addr=addr, timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 8450s comm = await connect( 8450s ^^^^^^^^^^^^^^ 8450s ...<4 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 8450s raise FatalCommClosedError( 8450s ...<2 lines>... 8450s ) from err 8450s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 8450s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 8450s RuntimeError: Nanny failed to start. 8450s 2024-11-23 22:49:57,334 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:49:57,341 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36833 8450s 2024-11-23 22:49:57,341 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41637/status 8450s 2024-11-23 22:49:57,341 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:49:57,363 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:34575'. Reason: failure-to-start- 8450s 2024-11-23 22:49:57,364 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:34323'. Reason: failure-to-start- 8450s 2024-11-23 22:49:57,364 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36833': TLS handshake failed with remote 'tls://127.0.0.1:46738': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:57,364 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36833': TLS handshake failed with remote 'tls://127.0.0.1:46754': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:57,364 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 8450s stream = await stream.start_tls( 8450s ^^^^^^^^^^^^^^^^^^^^^^^ 8450s False, ssl_options=ssl_options, server_hostname=host 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 8450s self.socket.do_handshake() 8450s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 8450s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 8450s self._sslobj.do_handshake() 8450s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 8450s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 8450s comm = await self.rpc.connect(saddr) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 8450s return await self._connect(addr=addr, timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 8450s comm = await connect( 8450s ^^^^^^^^^^^^^^ 8450s ...<4 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 8450s raise FatalCommClosedError( 8450s ...<2 lines>... 8450s ) from err 8450s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 8450s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 8450s RuntimeError: Nanny failed to start. 8450s 2024-11-23 22:49:58,371 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:49:58,377 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40091 8450s 2024-11-23 22:49:58,378 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33977/status 8450s 2024-11-23 22:49:58,378 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:49:58,401 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:39933'. Reason: failure-to-start- 8450s 2024-11-23 22:49:58,401 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:35753'. Reason: failure-to-start- 8450s 2024-11-23 22:49:58,401 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40091': TLS handshake failed with remote 'tls://127.0.0.1:38038': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:58,401 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40091': TLS handshake failed with remote 'tls://127.0.0.1:38042': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:58,401 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 8450s stream = await stream.start_tls( 8450s ^^^^^^^^^^^^^^^^^^^^^^^ 8450s False, ssl_options=ssl_options, server_hostname=host 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 8450s self.socket.do_handshake() 8450s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 8450s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 8450s self._sslobj.do_handshake() 8450s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 8450s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 8450s comm = await self.rpc.connect(saddr) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 8450s return await self._connect(addr=addr, timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 8450s comm = await connect( 8450s ^^^^^^^^^^^^^^ 8450s ...<4 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 8450s raise FatalCommClosedError( 8450s ...<2 lines>... 8450s ) from err 8450s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 8450s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 8450s RuntimeError: Nanny failed to start. 8450s 2024-11-23 22:49:59,409 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:49:59,416 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46007 8450s 2024-11-23 22:49:59,416 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34191/status 8450s 2024-11-23 22:49:59,417 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:49:59,440 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:35349'. Reason: failure-to-start- 8450s 2024-11-23 22:49:59,441 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:35023'. Reason: failure-to-start- 8450s 2024-11-23 22:49:59,441 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46007': TLS handshake failed with remote 'tls://127.0.0.1:44936': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:59,441 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46007': TLS handshake failed with remote 'tls://127.0.0.1:44938': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:49:59,441 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 8450s stream = await stream.start_tls( 8450s ^^^^^^^^^^^^^^^^^^^^^^^ 8450s False, ssl_options=ssl_options, server_hostname=host 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 8450s self.socket.do_handshake() 8450s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 8450s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 8450s self._sslobj.do_handshake() 8450s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 8450s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 8450s comm = await self.rpc.connect(saddr) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 8450s return await self._connect(addr=addr, timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 8450s comm = await connect( 8450s ^^^^^^^^^^^^^^ 8450s ...<4 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 8450s raise FatalCommClosedError( 8450s ...<2 lines>... 8450s ) from err 8450s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 8450s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 8450s RuntimeError: Nanny failed to start. 8450s 2024-11-23 22:50:00,448 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:50:00,455 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33645 8450s 2024-11-23 22:50:00,456 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38437/status 8450s 2024-11-23 22:50:00,456 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:50:00,478 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:46083'. Reason: failure-to-start- 8450s 2024-11-23 22:50:00,479 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:38143'. Reason: failure-to-start- 8450s 2024-11-23 22:50:00,479 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33645': TLS handshake failed with remote 'tls://127.0.0.1:35190': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:50:00,479 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33645': TLS handshake failed with remote 'tls://127.0.0.1:35206': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:50:00,479 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 8450s stream = await stream.start_tls( 8450s ^^^^^^^^^^^^^^^^^^^^^^^ 8450s False, ssl_options=ssl_options, server_hostname=host 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 8450s self.socket.do_handshake() 8450s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 8450s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 8450s self._sslobj.do_handshake() 8450s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 8450s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 8450s comm = await self.rpc.connect(saddr) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 8450s return await self._connect(addr=addr, timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 8450s comm = await connect( 8450s ^^^^^^^^^^^^^^ 8450s ...<4 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 8450s raise FatalCommClosedError( 8450s ...<2 lines>... 8450s ) from err 8450s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 8450s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 8450s RuntimeError: Nanny failed to start. 8450s 2024-11-23 22:50:01,488 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:50:01,494 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39127 8450s 2024-11-23 22:50:01,494 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46325/status 8450s 2024-11-23 22:50:01,494 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:50:01,518 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:40675'. Reason: failure-to-start- 8450s 2024-11-23 22:50:01,518 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:37263'. Reason: failure-to-start- 8450s 2024-11-23 22:50:01,519 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39127': TLS handshake failed with remote 'tls://127.0.0.1:37674': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:50:01,519 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39127': TLS handshake failed with remote 'tls://127.0.0.1:37678': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:50:01,522 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 8450s stream = await stream.start_tls( 8450s ^^^^^^^^^^^^^^^^^^^^^^^ 8450s False, ssl_options=ssl_options, server_hostname=host 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 8450s self.socket.do_handshake() 8450s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 8450s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 8450s self._sslobj.do_handshake() 8450s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 8450s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 8450s comm = await self.rpc.connect(saddr) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 8450s return await self._connect(addr=addr, timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 8450s comm = await connect( 8450s ^^^^^^^^^^^^^^ 8450s ...<4 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 8450s raise FatalCommClosedError( 8450s ...<2 lines>... 8450s ) from err 8450s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 8450s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 8450s RuntimeError: Nanny failed to start. 8450s 2024-11-23 22:50:02,528 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:50:02,535 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41393 8450s 2024-11-23 22:50:02,535 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33743/status 8450s 2024-11-23 22:50:02,535 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:50:02,558 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:45935'. Reason: failure-to-start- 8450s 2024-11-23 22:50:02,559 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:35907'. Reason: failure-to-start- 8450s 2024-11-23 22:50:02,561 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41393': TLS handshake failed with remote 'tls://127.0.0.1:38282': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:50:02,561 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41393': TLS handshake failed with remote 'tls://127.0.0.1:38292': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:50:02,561 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 8450s stream = await stream.start_tls( 8450s ^^^^^^^^^^^^^^^^^^^^^^^ 8450s False, ssl_options=ssl_options, server_hostname=host 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 8450s self.socket.do_handshake() 8450s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 8450s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 8450s self._sslobj.do_handshake() 8450s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 8450s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 8450s comm = await self.rpc.connect(saddr) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 8450s return await self._connect(addr=addr, timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 8450s comm = await connect( 8450s ^^^^^^^^^^^^^^ 8450s ...<4 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 8450s raise FatalCommClosedError( 8450s ...<2 lines>... 8450s ) from err 8450s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 8450s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 8450s RuntimeError: Nanny failed to start. 8450s 2024-11-23 22:50:03,566 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:50:03,573 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37007 8450s 2024-11-23 22:50:03,573 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38101/status 8450s 2024-11-23 22:50:03,573 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:50:03,599 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:37957'. Reason: failure-to-start- 8450s 2024-11-23 22:50:03,599 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:37759'. Reason: failure-to-start- 8450s 2024-11-23 22:50:03,599 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37007': TLS handshake failed with remote 'tls://127.0.0.1:48624': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:50:03,599 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37007': TLS handshake failed with remote 'tls://127.0.0.1:48628': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:50:03,600 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 8450s stream = await stream.start_tls( 8450s ^^^^^^^^^^^^^^^^^^^^^^^ 8450s False, ssl_options=ssl_options, server_hostname=host 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 8450s self.socket.do_handshake() 8450s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 8450s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 8450s self._sslobj.do_handshake() 8450s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 8450s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 8450s comm = await self.rpc.connect(saddr) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 8450s return await self._connect(addr=addr, timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 8450s comm = await connect( 8450s ^^^^^^^^^^^^^^ 8450s ...<4 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 8450s raise FatalCommClosedError( 8450s ...<2 lines>... 8450s ) from err 8450s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 8450s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 8450s RuntimeError: Nanny failed to start. 8450s 2024-11-23 22:50:04,605 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:50:04,612 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43165 8450s 2024-11-23 22:50:04,612 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39411/status 8450s 2024-11-23 22:50:04,612 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:50:04,638 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:40711'. Reason: failure-to-start- 8450s 2024-11-23 22:50:04,638 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:42901'. Reason: failure-to-start- 8450s 2024-11-23 22:50:04,639 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43165': TLS handshake failed with remote 'tls://127.0.0.1:34104': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:50:04,639 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43165': TLS handshake failed with remote 'tls://127.0.0.1:34114': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:50:04,639 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 8450s stream = await stream.start_tls( 8450s ^^^^^^^^^^^^^^^^^^^^^^^ 8450s False, ssl_options=ssl_options, server_hostname=host 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 8450s self.socket.do_handshake() 8450s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 8450s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 8450s self._sslobj.do_handshake() 8450s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 8450s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 8450s comm = await self.rpc.connect(saddr) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 8450s return await self._connect(addr=addr, timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 8450s comm = await connect( 8450s ^^^^^^^^^^^^^^ 8450s ...<4 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 8450s raise FatalCommClosedError( 8450s ...<2 lines>... 8450s ) from err 8450s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 8450s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 8450s RuntimeError: Nanny failed to start. 8450s 2024-11-23 22:50:05,644 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:50:05,651 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46193 8450s 2024-11-23 22:50:05,651 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40135/status 8450s 2024-11-23 22:50:05,652 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:50:05,684 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:35385'. Reason: failure-to-start- 8450s 2024-11-23 22:50:05,685 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:45767'. Reason: failure-to-start- 8450s 2024-11-23 22:50:05,685 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46193': TLS handshake failed with remote 'tls://127.0.0.1:35498': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:50:05,685 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46193': TLS handshake failed with remote 'tls://127.0.0.1:35510': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:50:05,686 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 8450s stream = await stream.start_tls( 8450s ^^^^^^^^^^^^^^^^^^^^^^^ 8450s False, ssl_options=ssl_options, server_hostname=host 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 8450s self.socket.do_handshake() 8450s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 8450s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 8450s self._sslobj.do_handshake() 8450s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 8450s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 8450s comm = await self.rpc.connect(saddr) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 8450s return await self._connect(addr=addr, timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 8450s comm = await connect( 8450s ^^^^^^^^^^^^^^ 8450s ...<4 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 8450s raise FatalCommClosedError( 8450s ...<2 lines>... 8450s ) from err 8450s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 8450s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 8450s RuntimeError: Nanny failed to start. 8450s 2024-11-23 22:50:06,691 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:50:06,699 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44329 8450s 2024-11-23 22:50:06,699 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33115/status 8450s 2024-11-23 22:50:06,699 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:50:06,724 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:45199'. Reason: failure-to-start- 8450s 2024-11-23 22:50:06,724 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:43881'. Reason: failure-to-start- 8450s 2024-11-23 22:50:06,724 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44329': TLS handshake failed with remote 'tls://127.0.0.1:41386': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:50:06,724 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44329': TLS handshake failed with remote 'tls://127.0.0.1:41400': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:50:06,725 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 8450s stream = await stream.start_tls( 8450s ^^^^^^^^^^^^^^^^^^^^^^^ 8450s False, ssl_options=ssl_options, server_hostname=host 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 8450s self.socket.do_handshake() 8450s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 8450s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 8450s self._sslobj.do_handshake() 8450s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 8450s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 8450s comm = await self.rpc.connect(saddr) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 8450s return await self._connect(addr=addr, timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 8450s comm = await connect( 8450s ^^^^^^^^^^^^^^ 8450s ...<4 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 8450s raise FatalCommClosedError( 8450s ...<2 lines>... 8450s ) from err 8450s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 8450s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 8450s RuntimeError: Nanny failed to start. 8450s 2024-11-23 22:50:07,731 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:50:07,738 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39267 8450s 2024-11-23 22:50:07,738 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41709/status 8450s 2024-11-23 22:50:07,738 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:50:07,763 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:35407'. Reason: failure-to-start- 8450s 2024-11-23 22:50:07,763 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:37629'. Reason: failure-to-start- 8450s 2024-11-23 22:50:07,764 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39267': TLS handshake failed with remote 'tls://127.0.0.1:38500': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:50:07,764 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39267': TLS handshake failed with remote 'tls://127.0.0.1:38516': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:50:07,764 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 8450s stream = await stream.start_tls( 8450s ^^^^^^^^^^^^^^^^^^^^^^^ 8450s False, ssl_options=ssl_options, server_hostname=host 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 8450s self.socket.do_handshake() 8450s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 8450s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 8450s self._sslobj.do_handshake() 8450s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 8450s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 8450s comm = await self.rpc.connect(saddr) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 8450s return await self._connect(addr=addr, timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 8450s comm = await connect( 8450s ^^^^^^^^^^^^^^ 8450s ...<4 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 8450s raise FatalCommClosedError( 8450s ...<2 lines>... 8450s ) from err 8450s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 8450s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 8450s RuntimeError: Nanny failed to start. 8450s 2024-11-23 22:50:08,769 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:50:08,775 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33103 8450s 2024-11-23 22:50:08,776 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37773/status 8450s 2024-11-23 22:50:08,776 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:50:08,801 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:35877'. Reason: failure-to-start- 8450s 2024-11-23 22:50:08,801 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:43231'. Reason: failure-to-start- 8450s 2024-11-23 22:50:08,802 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33103': TLS handshake failed with remote 'tls://127.0.0.1:51028': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:50:08,802 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33103': TLS handshake failed with remote 'tls://127.0.0.1:51034': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:50:08,802 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 8450s stream = await stream.start_tls( 8450s ^^^^^^^^^^^^^^^^^^^^^^^ 8450s False, ssl_options=ssl_options, server_hostname=host 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 8450s self.socket.do_handshake() 8450s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 8450s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 8450s self._sslobj.do_handshake() 8450s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 8450s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 8450s comm = await self.rpc.connect(saddr) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 8450s return await self._connect(addr=addr, timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 8450s comm = await connect( 8450s ^^^^^^^^^^^^^^ 8450s ...<4 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 8450s raise FatalCommClosedError( 8450s ...<2 lines>... 8450s ) from err 8450s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 8450s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 8450s RuntimeError: Nanny failed to start. 8450s 2024-11-23 22:50:09,810 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:50:09,822 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37289 8450s 2024-11-23 22:50:09,823 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33979/status 8450s 2024-11-23 22:50:09,827 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:50:09,869 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:36383'. Reason: failure-to-start- 8450s 2024-11-23 22:50:09,870 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:35049'. Reason: failure-to-start- 8450s 2024-11-23 22:50:09,870 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37289': TLS handshake failed with remote 'tls://127.0.0.1:47166': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:50:09,870 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37289': TLS handshake failed with remote 'tls://127.0.0.1:47176': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:50:09,871 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 8450s stream = await stream.start_tls( 8450s ^^^^^^^^^^^^^^^^^^^^^^^ 8450s False, ssl_options=ssl_options, server_hostname=host 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 8450s self.socket.do_handshake() 8450s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 8450s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 8450s self._sslobj.do_handshake() 8450s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 8450s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 8450s comm = await self.rpc.connect(saddr) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 8450s return await self._connect(addr=addr, timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 8450s comm = await connect( 8450s ^^^^^^^^^^^^^^ 8450s ...<4 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 8450s raise FatalCommClosedError( 8450s ...<2 lines>... 8450s ) from err 8450s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 8450s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 8450s RuntimeError: Nanny failed to start. 8450s 2024-11-23 22:50:10,876 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:50:10,883 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45481 8450s 2024-11-23 22:50:10,883 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41857/status 8450s 2024-11-23 22:50:10,883 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:50:10,910 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:41505'. Reason: failure-to-start- 8450s 2024-11-23 22:50:10,910 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:34171'. Reason: failure-to-start- 8450s 2024-11-23 22:50:10,911 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45481': TLS handshake failed with remote 'tls://127.0.0.1:38042': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:50:10,911 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45481': TLS handshake failed with remote 'tls://127.0.0.1:38054': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:50:10,911 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 8450s stream = await stream.start_tls( 8450s ^^^^^^^^^^^^^^^^^^^^^^^ 8450s False, ssl_options=ssl_options, server_hostname=host 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 8450s self.socket.do_handshake() 8450s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 8450s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 8450s self._sslobj.do_handshake() 8450s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 8450s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 8450s comm = await self.rpc.connect(saddr) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 8450s return await self._connect(addr=addr, timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 8450s comm = await connect( 8450s ^^^^^^^^^^^^^^ 8450s ...<4 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 8450s raise FatalCommClosedError( 8450s ...<2 lines>... 8450s ) from err 8450s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 8450s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 8450s RuntimeError: Nanny failed to start. 8450s 2024-11-23 22:50:11,915 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:50:11,922 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43967 8450s 2024-11-23 22:50:11,922 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42499/status 8450s 2024-11-23 22:50:11,922 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:50:11,957 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:40997'. Reason: failure-to-start- 8450s 2024-11-23 22:50:11,958 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:39017'. Reason: failure-to-start- 8450s 2024-11-23 22:50:11,959 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43967': TLS handshake failed with remote 'tls://127.0.0.1:37386': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:50:11,959 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43967': TLS handshake failed with remote 'tls://127.0.0.1:37400': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:50:11,962 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 8450s stream = await stream.start_tls( 8450s ^^^^^^^^^^^^^^^^^^^^^^^ 8450s False, ssl_options=ssl_options, server_hostname=host 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 8450s self.socket.do_handshake() 8450s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 8450s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 8450s self._sslobj.do_handshake() 8450s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 8450s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 8450s comm = await self.rpc.connect(saddr) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 8450s return await self._connect(addr=addr, timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 8450s comm = await connect( 8450s ^^^^^^^^^^^^^^ 8450s ...<4 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 8450s raise FatalCommClosedError( 8450s ...<2 lines>... 8450s ) from err 8450s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 8450s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 8450s RuntimeError: Nanny failed to start. 8450s 2024-11-23 22:50:12,969 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:50:12,976 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44611 8450s 2024-11-23 22:50:12,977 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38625/status 8450s 2024-11-23 22:50:12,977 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:50:13,005 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:40633'. Reason: failure-to-start- 8450s 2024-11-23 22:50:13,005 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:39383'. Reason: failure-to-start- 8450s 2024-11-23 22:50:13,008 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44611': TLS handshake failed with remote 'tls://127.0.0.1:55210': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:50:13,008 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44611': TLS handshake failed with remote 'tls://127.0.0.1:55218': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:50:13,008 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 8450s stream = await stream.start_tls( 8450s ^^^^^^^^^^^^^^^^^^^^^^^ 8450s False, ssl_options=ssl_options, server_hostname=host 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 8450s self.socket.do_handshake() 8450s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 8450s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 8450s self._sslobj.do_handshake() 8450s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 8450s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 8450s comm = await self.rpc.connect(saddr) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 8450s return await self._connect(addr=addr, timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 8450s comm = await connect( 8450s ^^^^^^^^^^^^^^ 8450s ...<4 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 8450s raise FatalCommClosedError( 8450s ...<2 lines>... 8450s ) from err 8450s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 8450s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 8450s RuntimeError: Nanny failed to start. 8450s 2024-11-23 22:50:14,014 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:50:14,020 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45163 8450s 2024-11-23 22:50:14,020 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42093/status 8450s 2024-11-23 22:50:14,020 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:50:14,045 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:42803'. Reason: failure-to-start- 8450s 2024-11-23 22:50:14,045 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:46339'. Reason: failure-to-start- 8450s 2024-11-23 22:50:14,048 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45163': TLS handshake failed with remote 'tls://127.0.0.1:43942': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:50:14,048 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45163': TLS handshake failed with remote 'tls://127.0.0.1:43950': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:50:14,048 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 8450s stream = await stream.start_tls( 8450s ^^^^^^^^^^^^^^^^^^^^^^^ 8450s False, ssl_options=ssl_options, server_hostname=host 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 8450s self.socket.do_handshake() 8450s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 8450s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 8450s self._sslobj.do_handshake() 8450s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 8450s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 8450s comm = await self.rpc.connect(saddr) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 8450s return await self._connect(addr=addr, timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 8450s comm = await connect( 8450s ^^^^^^^^^^^^^^ 8450s ...<4 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 8450s raise FatalCommClosedError( 8450s ...<2 lines>... 8450s ) from err 8450s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 8450s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 8450s RuntimeError: Nanny failed to start. 8450s 2024-11-23 22:50:15,054 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:50:15,071 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46539 8450s 2024-11-23 22:50:15,071 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37965/status 8450s 2024-11-23 22:50:15,073 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:50:15,103 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:44003'. Reason: failure-to-start- 8450s 2024-11-23 22:50:15,103 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:38097'. Reason: failure-to-start- 8450s 2024-11-23 22:50:15,103 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46539': TLS handshake failed with remote 'tls://127.0.0.1:43070': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:50:15,103 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46539': TLS handshake failed with remote 'tls://127.0.0.1:43074': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:50:15,104 - distributed.utils_test - ERROR - Failed to start gen_cluster: RuntimeError: Nanny failed to start.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 8450s stream = await stream.start_tls( 8450s ^^^^^^^^^^^^^^^^^^^^^^^ 8450s False, ssl_options=ssl_options, server_hostname=host 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 8450s self.socket.do_handshake() 8450s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 8450s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 8450s self._sslobj.do_handshake() 8450s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 8450s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 8450s comm = await self.rpc.connect(saddr) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 8450s return await self._connect(addr=addr, timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 8450s comm = await connect( 8450s ^^^^^^^^^^^^^^ 8450s ...<4 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 8450s raise FatalCommClosedError( 8450s ...<2 lines>... 8450s ) from err 8450s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 672, in start 8450s raise RuntimeError(f"{type(self).__name__} failed to start.") from exc 8450s RuntimeError: Nanny failed to start. 8450s 2024-11-23 22:50:16,109 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:50:16,120 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33615 8450s 2024-11-23 22:50:16,120 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35643/status 8450s 2024-11-23 22:50:16,120 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:50:16,138 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:37305'. Reason: failure-to-start- 8450s 2024-11-23 22:50:16,139 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:43001'. Reason: failure-to-start- 8450s 2024-11-23 22:50:16,140 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33615': TLS handshake failed with remote 'tls://127.0.0.1:38834': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:50:16,140 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33615': TLS handshake failed with remote 'tls://127.0.0.1:38844': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:50:16,140 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 8450s comm = await self.rpc.connect(saddr) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 8450s return await self._connect(addr=addr, timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 8450s comm = await connect( 8450s ^^^^^^^^^^^^^^ 8450s ...<4 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Nanny start timed out after 0s. 8450s 2024-11-23 22:50:17,145 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:50:17,153 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37787 8450s 2024-11-23 22:50:17,153 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40031/status 8450s 2024-11-23 22:50:17,154 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:50:17,170 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:37415'. Reason: failure-to-start- 8450s 2024-11-23 22:50:17,171 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:40971'. Reason: failure-to-start- 8450s 2024-11-23 22:50:17,171 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37787': TLS handshake failed with remote 'tls://127.0.0.1:58312': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:50:17,171 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37787': TLS handshake failed with remote 'tls://127.0.0.1:58324': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:50:17,171 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 8450s comm = await self.rpc.connect(saddr) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 8450s return await self._connect(addr=addr, timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 8450s comm = await connect( 8450s ^^^^^^^^^^^^^^ 8450s ...<4 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Nanny start timed out after 0s. 8450s 2024-11-23 22:50:18,176 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:50:18,183 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35423 8450s 2024-11-23 22:50:18,183 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41259/status 8450s 2024-11-23 22:50:18,184 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:50:18,196 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:41597'. Reason: failure-to-start- 8450s 2024-11-23 22:50:18,196 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:40277'. Reason: failure-to-start- 8450s 2024-11-23 22:50:18,197 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35423': TLS handshake failed with remote 'tls://127.0.0.1:45078': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:50:18,197 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35423': TLS handshake failed with remote 'tls://127.0.0.1:45084': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:50:18,197 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 8450s comm = await self.rpc.connect(saddr) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 8450s return await self._connect(addr=addr, timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 8450s comm = await connect( 8450s ^^^^^^^^^^^^^^ 8450s ...<4 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Nanny start timed out after 0s. 8450s 2024-11-23 22:50:19,202 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:50:19,210 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33711 8450s 2024-11-23 22:50:19,210 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37141/status 8450s 2024-11-23 22:50:19,210 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:50:19,225 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:40395'. Reason: failure-to-start- 8450s 2024-11-23 22:50:19,225 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:44325'. Reason: failure-to-start- 8450s 2024-11-23 22:50:19,226 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33711': TLS handshake failed with remote 'tls://127.0.0.1:50412': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:50:19,226 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33711': TLS handshake failed with remote 'tls://127.0.0.1:50424': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:50:19,226 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 8450s comm = await self.rpc.connect(saddr) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 8450s return await self._connect(addr=addr, timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 8450s comm = await connect( 8450s ^^^^^^^^^^^^^^ 8450s ...<4 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Nanny start timed out after 0s. 8450s 2024-11-23 22:50:20,232 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:50:20,240 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:32947 8450s 2024-11-23 22:50:20,240 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34947/status 8450s 2024-11-23 22:50:20,240 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:50:20,257 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:46603'. Reason: failure-to-start- 8450s 2024-11-23 22:50:20,257 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:46631'. Reason: failure-to-start- 8450s 2024-11-23 22:50:20,258 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:32947': TLS handshake failed with remote 'tls://127.0.0.1:56474': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:50:20,258 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:32947': TLS handshake failed with remote 'tls://127.0.0.1:56490': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:50:20,258 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 8450s comm = await self.rpc.connect(saddr) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 8450s return await self._connect(addr=addr, timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 8450s comm = await connect( 8450s ^^^^^^^^^^^^^^ 8450s ...<4 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Nanny start timed out after 0s. 8450s 2024-11-23 22:50:21,264 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:50:21,270 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46419 8450s 2024-11-23 22:50:21,270 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39843/status 8450s 2024-11-23 22:50:21,271 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:50:21,286 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:38731'. Reason: failure-to-start- 8450s 2024-11-23 22:50:21,286 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:42341'. Reason: failure-to-start- 8450s 2024-11-23 22:50:21,287 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46419': TLS handshake failed with remote 'tls://127.0.0.1:55938': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:50:21,287 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46419': TLS handshake failed with remote 'tls://127.0.0.1:55952': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:50:21,287 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 8450s comm = await self.rpc.connect(saddr) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 8450s return await self._connect(addr=addr, timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 8450s comm = await connect( 8450s ^^^^^^^^^^^^^^ 8450s ...<4 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Nanny start timed out after 0s. 8450s 2024-11-23 22:50:22,294 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:50:22,305 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37359 8450s 2024-11-23 22:50:22,306 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35425/status 8450s 2024-11-23 22:50:22,307 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:50:22,336 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:34177'. Reason: failure-to-start- 8450s 2024-11-23 22:50:22,337 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:44357'. Reason: failure-to-start- 8450s 2024-11-23 22:50:22,342 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37359': TLS handshake failed with remote 'tls://127.0.0.1:56892': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:50:22,342 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37359': TLS handshake failed with remote 'tls://127.0.0.1:56894': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:50:22,343 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 8450s comm = await self.rpc.connect(saddr) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 8450s return await self._connect(addr=addr, timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 8450s comm = await connect( 8450s ^^^^^^^^^^^^^^ 8450s ...<4 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Nanny start timed out after 0s. 8450s 2024-11-23 22:50:23,350 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:50:23,358 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43113 8450s 2024-11-23 22:50:23,358 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39563/status 8450s 2024-11-23 22:50:23,358 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:50:23,369 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:34163'. Reason: failure-to-start- 8450s 2024-11-23 22:50:23,370 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:44111'. Reason: failure-to-start- 8450s 2024-11-23 22:50:23,370 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43113': TLS handshake failed with remote 'tls://127.0.0.1:60478': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:50:23,370 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43113': TLS handshake failed with remote 'tls://127.0.0.1:60494': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:50:23,370 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 8450s comm = await self.rpc.connect(saddr) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 8450s return await self._connect(addr=addr, timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 8450s comm = await connect( 8450s ^^^^^^^^^^^^^^ 8450s ...<4 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Nanny start timed out after 0s. 8450s 2024-11-23 22:50:24,377 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:50:24,384 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37191 8450s 2024-11-23 22:50:24,384 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33349/status 8450s 2024-11-23 22:50:24,384 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:50:24,401 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:46651'. Reason: failure-to-start- 8450s 2024-11-23 22:50:24,401 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:39151'. Reason: failure-to-start- 8450s 2024-11-23 22:50:24,401 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37191': TLS handshake failed with remote 'tls://127.0.0.1:37880': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:50:24,402 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37191': TLS handshake failed with remote 'tls://127.0.0.1:37884': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:50:24,402 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 8450s comm = await self.rpc.connect(saddr) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 8450s return await self._connect(addr=addr, timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 8450s comm = await connect( 8450s ^^^^^^^^^^^^^^ 8450s ...<4 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Nanny start timed out after 0s. 8450s 2024-11-23 22:50:25,407 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:50:25,412 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38297 8450s 2024-11-23 22:50:25,412 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44289/status 8450s 2024-11-23 22:50:25,412 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:50:25,425 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:39857'. Reason: failure-to-start- 8450s 2024-11-23 22:50:25,425 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:35615'. Reason: failure-to-start- 8450s 2024-11-23 22:50:25,426 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38297': TLS handshake failed with remote 'tls://127.0.0.1:54214': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:50:25,426 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38297': TLS handshake failed with remote 'tls://127.0.0.1:54224': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:50:25,427 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 8450s comm = await self.rpc.connect(saddr) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 8450s return await self._connect(addr=addr, timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 8450s comm = await connect( 8450s ^^^^^^^^^^^^^^ 8450s ...<4 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Nanny start timed out after 0s. 8450s 2024-11-23 22:50:26,432 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:50:26,439 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36753 8450s 2024-11-23 22:50:26,439 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35809/status 8450s 2024-11-23 22:50:26,439 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:50:26,450 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:43425'. Reason: failure-to-start- 8450s 2024-11-23 22:50:26,450 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:46291'. Reason: failure-to-start- 8450s 2024-11-23 22:50:26,450 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36753': TLS handshake failed with remote 'tls://127.0.0.1:39710': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:50:26,450 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36753': TLS handshake failed with remote 'tls://127.0.0.1:39714': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:50:26,451 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 8450s comm = await self.rpc.connect(saddr) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 8450s return await self._connect(addr=addr, timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 8450s comm = await connect( 8450s ^^^^^^^^^^^^^^ 8450s ...<4 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Nanny start timed out after 0s. 8450s 2024-11-23 22:50:27,456 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:50:27,463 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44311 8450s 2024-11-23 22:50:27,463 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36009/status 8450s 2024-11-23 22:50:27,464 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:50:27,476 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:43197'. Reason: failure-to-start- 8450s 2024-11-23 22:50:27,476 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:35565'. Reason: failure-to-start- 8450s 2024-11-23 22:50:27,477 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44311': TLS handshake failed with remote 'tls://127.0.0.1:49494': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:50:27,477 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44311': TLS handshake failed with remote 'tls://127.0.0.1:49506': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:50:27,477 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 8450s comm = await self.rpc.connect(saddr) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 8450s return await self._connect(addr=addr, timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 8450s comm = await connect( 8450s ^^^^^^^^^^^^^^ 8450s ...<4 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Nanny start timed out after 0s. 8450s 2024-11-23 22:50:28,482 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:50:28,489 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34145 8450s 2024-11-23 22:50:28,489 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39547/status 8450s 2024-11-23 22:50:28,490 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:50:28,504 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:43929'. Reason: failure-to-start- 8450s 2024-11-23 22:50:28,504 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:34601'. Reason: failure-to-start- 8450s 2024-11-23 22:50:28,505 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34145': TLS handshake failed with remote 'tls://127.0.0.1:55770': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:50:28,505 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34145': TLS handshake failed with remote 'tls://127.0.0.1:55780': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:50:28,505 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 8450s comm = await self.rpc.connect(saddr) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 8450s return await self._connect(addr=addr, timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 8450s comm = await connect( 8450s ^^^^^^^^^^^^^^ 8450s ...<4 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Nanny start timed out after 0s. 8450s 2024-11-23 22:50:29,509 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:50:29,514 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41045 8450s 2024-11-23 22:50:29,515 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33803/status 8450s 2024-11-23 22:50:29,515 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:50:29,528 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:46803'. Reason: failure-to-start- 8450s 2024-11-23 22:50:29,529 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:34467'. Reason: failure-to-start- 8450s 2024-11-23 22:50:29,531 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41045': TLS handshake failed with remote 'tls://127.0.0.1:53868': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:50:29,532 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41045': TLS handshake failed with remote 'tls://127.0.0.1:53872': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:50:29,532 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 8450s comm = await self.rpc.connect(saddr) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 8450s return await self._connect(addr=addr, timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 8450s comm = await connect( 8450s ^^^^^^^^^^^^^^ 8450s ...<4 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Nanny start timed out after 0s. 8450s 2024-11-23 22:50:30,537 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:50:30,544 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38483 8450s 2024-11-23 22:50:30,544 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38835/status 8450s 2024-11-23 22:50:30,545 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:50:30,560 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:34557'. Reason: failure-to-start- 8450s 2024-11-23 22:50:30,560 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:39839'. Reason: failure-to-start- 8450s 2024-11-23 22:50:30,561 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38483': TLS handshake failed with remote 'tls://127.0.0.1:42658': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:50:30,561 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38483': TLS handshake failed with remote 'tls://127.0.0.1:42660': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:50:30,561 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 8450s comm = await self.rpc.connect(saddr) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 8450s return await self._connect(addr=addr, timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 8450s comm = await connect( 8450s ^^^^^^^^^^^^^^ 8450s ...<4 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Nanny start timed out after 0s. 8450s 2024-11-23 22:50:31,567 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:50:31,572 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33149 8450s 2024-11-23 22:50:31,573 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44367/status 8450s 2024-11-23 22:50:31,573 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:50:31,590 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:39525'. Reason: failure-to-start- 8450s 2024-11-23 22:50:31,590 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:35611'. Reason: failure-to-start- 8450s 2024-11-23 22:50:31,593 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33149': TLS handshake failed with remote 'tls://127.0.0.1:39522': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:50:31,593 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33149': TLS handshake failed with remote 'tls://127.0.0.1:39526': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:50:31,593 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 8450s comm = await self.rpc.connect(saddr) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 8450s return await self._connect(addr=addr, timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 8450s comm = await connect( 8450s ^^^^^^^^^^^^^^ 8450s ...<4 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Nanny start timed out after 0s. 8450s 2024-11-23 22:50:32,597 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:50:32,603 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43185 8450s 2024-11-23 22:50:32,604 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45633/status 8450s 2024-11-23 22:50:32,604 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:50:32,619 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:36313'. Reason: failure-to-start- 8450s 2024-11-23 22:50:32,619 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:35363'. Reason: failure-to-start- 8450s 2024-11-23 22:50:32,620 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43185': TLS handshake failed with remote 'tls://127.0.0.1:43526': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:50:32,620 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43185': TLS handshake failed with remote 'tls://127.0.0.1:43532': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:50:32,620 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 8450s comm = await self.rpc.connect(saddr) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 8450s return await self._connect(addr=addr, timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 8450s comm = await connect( 8450s ^^^^^^^^^^^^^^ 8450s ...<4 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Nanny start timed out after 0s. 8450s 2024-11-23 22:50:33,626 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:50:33,633 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43397 8450s 2024-11-23 22:50:33,634 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34359/status 8450s 2024-11-23 22:50:33,638 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:50:33,653 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:33621'. Reason: failure-to-start- 8450s 2024-11-23 22:50:33,654 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:36605'. Reason: failure-to-start- 8450s 2024-11-23 22:50:33,657 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43397': TLS handshake failed with remote 'tls://127.0.0.1:56546': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:50:33,657 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43397': TLS handshake failed with remote 'tls://127.0.0.1:56552': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:50:33,657 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 8450s comm = await self.rpc.connect(saddr) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 8450s return await self._connect(addr=addr, timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 8450s comm = await connect( 8450s ^^^^^^^^^^^^^^ 8450s ...<4 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Nanny start timed out after 0s. 8450s 2024-11-23 22:50:34,662 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:50:34,668 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34709 8450s 2024-11-23 22:50:34,668 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34037/status 8450s 2024-11-23 22:50:34,668 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:50:34,683 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:41001'. Reason: failure-to-start- 8450s 2024-11-23 22:50:34,683 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:40069'. Reason: failure-to-start- 8450s 2024-11-23 22:50:34,684 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34709': TLS handshake failed with remote 'tls://127.0.0.1:53034': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:50:34,684 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34709': TLS handshake failed with remote 'tls://127.0.0.1:53050': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:50:34,684 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 8450s comm = await self.rpc.connect(saddr) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 8450s return await self._connect(addr=addr, timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 8450s comm = await connect( 8450s ^^^^^^^^^^^^^^ 8450s ...<4 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Nanny start timed out after 0s. 8450s 2024-11-23 22:50:35,689 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:50:35,695 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44757 8450s 2024-11-23 22:50:35,695 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40929/status 8450s 2024-11-23 22:50:35,696 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:50:35,736 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:33195'. Reason: failure-to-start- 8450s 2024-11-23 22:50:35,736 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:34071'. Reason: failure-to-start- 8450s 2024-11-23 22:50:35,738 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44757': TLS handshake failed with remote 'tls://127.0.0.1:54984': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:50:35,738 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44757': TLS handshake failed with remote 'tls://127.0.0.1:54996': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:50:35,742 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 8450s comm = await self.rpc.connect(saddr) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 8450s return await self._connect(addr=addr, timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 8450s comm = await connect( 8450s ^^^^^^^^^^^^^^ 8450s ...<4 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Nanny start timed out after 0s. 8450s 2024-11-23 22:50:36,748 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:50:36,755 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38671 8450s 2024-11-23 22:50:36,755 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36117/status 8450s 2024-11-23 22:50:36,755 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:50:36,766 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:38905'. Reason: failure-to-start- 8450s 2024-11-23 22:50:36,766 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:36607'. Reason: failure-to-start- 8450s 2024-11-23 22:50:36,767 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38671': TLS handshake failed with remote 'tls://127.0.0.1:59674': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:50:36,767 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38671': TLS handshake failed with remote 'tls://127.0.0.1:59684': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:50:36,767 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 8450s comm = await self.rpc.connect(saddr) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 8450s return await self._connect(addr=addr, timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 8450s comm = await connect( 8450s ^^^^^^^^^^^^^^ 8450s ...<4 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Nanny start timed out after 0s. 8450s 2024-11-23 22:50:37,774 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:50:37,781 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38949 8450s 2024-11-23 22:50:37,781 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41317/status 8450s 2024-11-23 22:50:37,781 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:50:37,811 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:36429'. Reason: failure-to-start- 8450s 2024-11-23 22:50:37,812 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:42153'. Reason: failure-to-start- 8450s 2024-11-23 22:50:37,812 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38949': TLS handshake failed with remote 'tls://127.0.0.1:57598': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:50:37,813 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38949': TLS handshake failed with remote 'tls://127.0.0.1:57600': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:50:37,815 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 8450s comm = await self.rpc.connect(saddr) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 8450s return await self._connect(addr=addr, timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 8450s comm = await connect( 8450s ^^^^^^^^^^^^^^ 8450s ...<4 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Nanny start timed out after 0s. 8450s 2024-11-23 22:50:38,821 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:50:38,829 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46287 8450s 2024-11-23 22:50:38,829 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42663/status 8450s 2024-11-23 22:50:38,830 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:50:38,850 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:43093'. Reason: failure-to-start- 8450s 2024-11-23 22:50:38,850 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:41843'. Reason: failure-to-start- 8450s 2024-11-23 22:50:38,851 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46287': TLS handshake failed with remote 'tls://127.0.0.1:55762': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:50:38,851 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46287': TLS handshake failed with remote 'tls://127.0.0.1:55764': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:50:38,851 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 8450s comm = await self.rpc.connect(saddr) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 8450s return await self._connect(addr=addr, timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 8450s comm = await connect( 8450s ^^^^^^^^^^^^^^ 8450s ...<4 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Nanny start timed out after 0s. 8450s 2024-11-23 22:50:39,856 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:50:39,863 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37361 8450s 2024-11-23 22:50:39,863 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46659/status 8450s 2024-11-23 22:50:39,864 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:50:39,880 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:38481'. Reason: failure-to-start- 8450s 2024-11-23 22:50:39,880 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:39983'. Reason: failure-to-start- 8450s 2024-11-23 22:50:39,883 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37361': TLS handshake failed with remote 'tls://127.0.0.1:53888': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:50:39,883 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37361': TLS handshake failed with remote 'tls://127.0.0.1:53890': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:50:39,883 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 8450s comm = await self.rpc.connect(saddr) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 8450s return await self._connect(addr=addr, timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 8450s comm = await connect( 8450s ^^^^^^^^^^^^^^ 8450s ...<4 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Nanny start timed out after 0s. 8450s 2024-11-23 22:50:40,890 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:50:40,907 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41531 8450s 2024-11-23 22:50:40,908 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34101/status 8450s 2024-11-23 22:50:40,909 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:50:40,929 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:43791'. Reason: failure-to-start- 8450s 2024-11-23 22:50:40,929 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:43685'. Reason: failure-to-start- 8450s 2024-11-23 22:50:40,932 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41531': TLS handshake failed with remote 'tls://127.0.0.1:44142': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:50:40,932 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41531': TLS handshake failed with remote 'tls://127.0.0.1:44144': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:50:40,933 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 8450s comm = await self.rpc.connect(saddr) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 8450s return await self._connect(addr=addr, timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 8450s comm = await connect( 8450s ^^^^^^^^^^^^^^ 8450s ...<4 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Nanny start timed out after 0s. 8450s 2024-11-23 22:50:41,938 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:50:41,946 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43095 8450s 2024-11-23 22:50:41,946 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41723/status 8450s 2024-11-23 22:50:41,946 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:50:41,965 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:43349'. Reason: failure-to-start- 8450s 2024-11-23 22:50:41,965 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:42653'. Reason: failure-to-start- 8450s 2024-11-23 22:50:41,966 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43095': TLS handshake failed with remote 'tls://127.0.0.1:45758': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:50:41,966 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43095': TLS handshake failed with remote 'tls://127.0.0.1:45770': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:50:41,966 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 8450s comm = await self.rpc.connect(saddr) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 8450s return await self._connect(addr=addr, timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 8450s comm = await connect( 8450s ^^^^^^^^^^^^^^ 8450s ...<4 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Nanny start timed out after 0s. 8450s 2024-11-23 22:50:42,970 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:50:42,976 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43053 8450s 2024-11-23 22:50:42,977 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41993/status 8450s 2024-11-23 22:50:42,977 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:50:42,992 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:40175'. Reason: failure-to-start- 8450s 2024-11-23 22:50:42,992 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:36811'. Reason: failure-to-start- 8450s 2024-11-23 22:50:42,993 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43053': TLS handshake failed with remote 'tls://127.0.0.1:35082': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:50:42,993 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43053': TLS handshake failed with remote 'tls://127.0.0.1:35098': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:50:42,995 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 8450s comm = await self.rpc.connect(saddr) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 8450s return await self._connect(addr=addr, timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 8450s comm = await connect( 8450s ^^^^^^^^^^^^^^ 8450s ...<4 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Nanny start timed out after 0s. 8450s 2024-11-23 22:50:44,001 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:50:44,007 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37323 8450s 2024-11-23 22:50:44,008 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35485/status 8450s 2024-11-23 22:50:44,008 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:50:44,025 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:33031'. Reason: failure-to-start- 8450s 2024-11-23 22:50:44,025 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:40885'. Reason: failure-to-start- 8450s 2024-11-23 22:50:44,026 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37323': TLS handshake failed with remote 'tls://127.0.0.1:38272': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:50:44,026 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37323': TLS handshake failed with remote 'tls://127.0.0.1:38286': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:50:44,028 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 8450s comm = await self.rpc.connect(saddr) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 8450s return await self._connect(addr=addr, timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 8450s comm = await connect( 8450s ^^^^^^^^^^^^^^ 8450s ...<4 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Nanny start timed out after 0s. 8450s 2024-11-23 22:50:45,034 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:50:45,040 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45383 8450s 2024-11-23 22:50:45,041 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38565/status 8450s 2024-11-23 22:50:45,041 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:50:45,058 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:45969'. Reason: failure-to-start- 8450s 2024-11-23 22:50:45,058 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:45123'. Reason: failure-to-start- 8450s 2024-11-23 22:50:45,059 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45383': TLS handshake failed with remote 'tls://127.0.0.1:51904': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:50:45,059 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45383': TLS handshake failed with remote 'tls://127.0.0.1:51910': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:50:45,059 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 8450s comm = await self.rpc.connect(saddr) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 8450s return await self._connect(addr=addr, timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 8450s comm = await connect( 8450s ^^^^^^^^^^^^^^ 8450s ...<4 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Nanny start timed out after 0s. 8450s 2024-11-23 22:50:46,064 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:50:46,071 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40577 8450s 2024-11-23 22:50:46,072 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36851/status 8450s 2024-11-23 22:50:46,072 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:50:46,091 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:33447'. Reason: failure-to-start- 8450s 2024-11-23 22:50:46,091 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:41917'. Reason: failure-to-start- 8450s 2024-11-23 22:50:46,092 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40577': TLS handshake failed with remote 'tls://127.0.0.1:34240': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:50:46,092 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40577': TLS handshake failed with remote 'tls://127.0.0.1:34242': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:50:46,094 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 8450s comm = await self.rpc.connect(saddr) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1620, in connect 8450s return await self._connect(addr=addr, timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1564, in _connect 8450s comm = await connect( 8450s ^^^^^^^^^^^^^^ 8450s ...<4 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Nanny start timed out after 0s. 8450s ___________________________ test_security_dict_input ___________________________ 8450s 8450s self = 8450s address = '127.0.0.1:37779', deserialize = True 8450s connection_args = {'extra_conn_args': {}, 'require_encryption': True, 'ssl_context': } 8450s ip = '127.0.0.1', port = 37779 8450s kwargs = {'ssl_options': } 8450s 8450s async def connect(self, address, deserialize=True, **connection_args): 8450s self._check_encryption(address, connection_args) 8450s ip, port = parse_host_port(address) 8450s kwargs = self._get_connect_args(**connection_args) 8450s 8450s try: 8450s # server_hostname option (for SNI) only works with tornado.iostream.IOStream 8450s if "server_hostname" in kwargs: 8450s stream = await self.client.connect( 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE 8450s ) 8450s stream = await stream.start_tls(False, **kwargs) 8450s else: 8450s > stream = await self.client.connect( 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ) 8450s 8450s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:546: 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s /usr/lib/python3/dist-packages/tornado/tcpclient.py:292: in connect 8450s stream = await stream.start_tls( 8450s /usr/lib/python3/dist-packages/tornado/iostream.py:1367: in _do_ssl_handshake 8450s self.socket.do_handshake() 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s 8450s self = , block = False 8450s 8450s @_sslcopydoc 8450s def do_handshake(self, block=False): 8450s self._check_connected() 8450s timeout = self.gettimeout() 8450s try: 8450s if timeout == 0.0 and block: 8450s self.settimeout(None) 8450s > self._sslobj.do_handshake() 8450s E ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 8450s 8450s /usr/lib/python3.13/ssl.py:1372: SSLCertVerificationError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s self = 8450s 8450s async def _register_with_scheduler(self) -> None: 8450s self.periodic_callbacks["keep-alive"].stop() 8450s self.periodic_callbacks["heartbeat"].stop() 8450s start = time() 8450s if self.contact_address is None: 8450s self.contact_address = self.address 8450s logger.info("-" * 49) 8450s 8450s # Worker reconnection is not supported 8450s assert not self.data 8450s assert not self.state.tasks 8450s 8450s while True: 8450s try: 8450s _start = time() 8450s > comm = await connect(self.scheduler.address, **self.connection_args) 8450s 8450s /usr/lib/python3/dist-packages/distributed/worker.py:1179: 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s /usr/lib/python3/dist-packages/distributed/comm/core.py:342: in connect 8450s comm = await wait_for( 8450s /usr/lib/python3/dist-packages/distributed/utils.py:1960: in wait_for 8450s return await fut 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s 8450s self = 8450s address = '127.0.0.1:37779', deserialize = True 8450s connection_args = {'extra_conn_args': {}, 'require_encryption': True, 'ssl_context': } 8450s ip = '127.0.0.1', port = 37779 8450s kwargs = {'ssl_options': } 8450s 8450s async def connect(self, address, deserialize=True, **connection_args): 8450s self._check_encryption(address, connection_args) 8450s ip, port = parse_host_port(address) 8450s kwargs = self._get_connect_args(**connection_args) 8450s 8450s try: 8450s # server_hostname option (for SNI) only works with tornado.iostream.IOStream 8450s if "server_hostname" in kwargs: 8450s stream = await self.client.connect( 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE 8450s ) 8450s stream = await stream.start_tls(False, **kwargs) 8450s else: 8450s stream = await self.client.connect( 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ) 8450s 8450s # Under certain circumstances tornado will have a closed connection with an 8450s # error and not raise a StreamClosedError. 8450s # 8450s # This occurs with tornado 5.x and openssl 1.1+ 8450s if stream.closed() and stream.error: 8450s raise StreamClosedError(stream.error) 8450s 8450s except StreamClosedError as e: 8450s # The socket connect() call failed 8450s convert_stream_closed_error(self, e) 8450s except SSLCertVerificationError as err: 8450s > raise FatalCommClosedError( 8450s "TLS certificate does not match. Check your security settings. " 8450s "More info at https://distributed.dask.org/en/latest/tls.html" 8450s ) from err 8450s E distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 8450s 8450s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:561: FatalCommClosedError 8450s 8450s During handling of the above exception, another exception occurred: 8450s 8450s @gen_test() 8450s async def test_security_dict_input(): 8450s conf = tls_config() 8450s ca_file = conf["distributed"]["comm"]["tls"]["ca-file"] 8450s client = conf["distributed"]["comm"]["tls"]["client"]["cert"] 8450s worker = conf["distributed"]["comm"]["tls"]["worker"]["cert"] 8450s scheduler = conf["distributed"]["comm"]["tls"]["scheduler"]["cert"] 8450s 8450s async with Scheduler( 8450s host="localhost", 8450s dashboard_address=":0", 8450s security={"tls_ca_file": ca_file, "tls_scheduler_cert": scheduler}, 8450s ) as s: 8450s assert s.address.startswith("tls://") 8450s > async with Worker( 8450s s.address, security={"tls_ca_file": ca_file, "tls_worker_cert": worker} 8450s ) as w: 8450s 8450s /usr/lib/python3/dist-packages/distributed/tests/test_tls_functional.py:225: 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s /usr/lib/python3/dist-packages/distributed/core.py:678: in __aenter__ 8450s await self 8450s /usr/lib/python3/dist-packages/distributed/core.py:664: in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s /usr/lib/python3/dist-packages/distributed/utils.py:1960: in wait_for 8450s return await fut 8450s /usr/lib/python3/dist-packages/distributed/worker.py:1480: in start_unsafe 8450s await self._register_with_scheduler() 8450s /usr/lib/python3/dist-packages/distributed/worker.py:1218: in _register_with_scheduler 8450s await asyncio.sleep(0.1) 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s 8450s delay = 0.1, result = None 8450s 8450s async def sleep(delay, result=None): 8450s """Coroutine that completes after a given time (in seconds).""" 8450s if delay <= 0: 8450s await __sleep0() 8450s return result 8450s 8450s if math.isnan(delay): 8450s raise ValueError("Invalid delay: NaN (not a number)") 8450s 8450s loop = events.get_running_loop() 8450s future = loop.create_future() 8450s h = loop.call_later(delay, 8450s futures._set_result_unless_cancelled, 8450s future, result) 8450s try: 8450s > return await future 8450s E asyncio.exceptions.CancelledError 8450s 8450s /usr/lib/python3.13/asyncio/tasks.py:718: CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s args = (), kwds = {} 8450s 8450s @wraps(func) 8450s def inner(*args, **kwds): 8450s with self._recreate_cm(): 8450s > return func(*args, **kwds) 8450s 8450s /usr/lib/python3.13/contextlib.py:85: 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s /usr/lib/python3.13/contextlib.py:85: in inner 8450s return func(*args, **kwds) 8450s /usr/lib/python3/dist-packages/distributed/utils_test.py:746: in test_func 8450s return _run_and_close_tornado(async_fn_outer, func, *args, **kwargs) 8450s /usr/lib/python3/dist-packages/distributed/utils_test.py:378: in _run_and_close_tornado 8450s return asyncio_run(inner_fn(), loop_factory=get_loop_factory()) 8450s /usr/lib/python3.13/asyncio/runners.py:194: in run 8450s return runner.run(main) 8450s /usr/lib/python3.13/asyncio/runners.py:118: in run 8450s return self._loop.run_until_complete(task) 8450s /usr/lib/python3.13/asyncio/base_events.py:720: in run_until_complete 8450s return future.result() 8450s /usr/lib/python3/dist-packages/distributed/utils_test.py:375: in inner_fn 8450s return await async_fn(*args, **kwargs) 8450s /usr/lib/python3/dist-packages/distributed/utils_test.py:736: in async_fn_outer 8450s return await utils_wait_for(async_fn(*args, **kwargs), timeout) 8450s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 8450s async with asyncio.timeout(timeout): 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s 8450s self = 8450s exc_type = 8450s exc_val = CancelledError(), exc_tb = 8450s 8450s async def __aexit__( 8450s self, 8450s exc_type: Optional[Type[BaseException]], 8450s exc_val: Optional[BaseException], 8450s exc_tb: Optional[TracebackType], 8450s ) -> Optional[bool]: 8450s assert self._state in (_State.ENTERED, _State.EXPIRING) 8450s 8450s if self._timeout_handler is not None: 8450s self._timeout_handler.cancel() 8450s self._timeout_handler = None 8450s 8450s if self._state is _State.EXPIRING: 8450s self._state = _State.EXPIRED 8450s 8450s if self._task.uncancel() <= self._cancelling and exc_type is not None: 8450s # Since there are no new cancel requests, we're 8450s # handling this. 8450s if issubclass(exc_type, exceptions.CancelledError): 8450s > raise TimeoutError from exc_val 8450s E TimeoutError 8450s 8450s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 8450s ----------------------------- Captured stderr call ----------------------------- 8450s 2024-11-23 22:50:47,439 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:50:47,448 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37779 8450s 2024-11-23 22:50:47,449 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42691/status 8450s 2024-11-23 22:50:47,449 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:50:47,456 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34749 8450s 2024-11-23 22:50:47,456 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34749 8450s 2024-11-23 22:50:47,456 - distributed.worker - INFO - dashboard at: 127.0.0.1:38081 8450s 2024-11-23 22:50:47,456 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:50:47,456 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:50:47,456 - distributed.worker - INFO - Threads: 8 8450s 2024-11-23 22:50:47,457 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:50:47,457 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-huf7pc14 8450s 2024-11-23 22:50:47,457 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:50:47,464 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:50:47,464 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:38322': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:50:47,571 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:50:47,571 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:38332': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:50:47,678 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:50:47,678 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:38348': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:50:47,784 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:50:47,785 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:38360': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:50:47,891 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:50:47,892 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:38372': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:50:47,998 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:50:47,998 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:38388': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:50:48,105 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:50:48,105 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:38402': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:50:48,211 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:50:48,213 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:38408': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:50:48,319 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:50:48,320 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:38412': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:50:48,427 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:50:48,428 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:38426': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:50:48,534 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:50:48,534 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:38434': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:50:48,641 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:50:48,641 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:38446': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:50:48,748 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:50:48,749 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:38460': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:50:48,856 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:50:48,856 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:38464': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:50:48,963 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:50:48,963 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:38478': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:50:49,070 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:50:49,070 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:38488': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:50:49,177 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:50:49,177 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:38490': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:50:49,284 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:50:49,285 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:38504': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:50:49,391 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:50:49,392 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:38508': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:50:49,498 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:50:49,498 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:38524': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:50:49,605 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:50:49,605 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:38540': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:50:49,711 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:50:49,712 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:38550': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:50:49,819 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:50:49,819 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:38564': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:50:49,926 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:50:49,926 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:38576': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:50:50,033 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:50:50,033 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:38590': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:50:50,140 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:50:50,140 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:38598': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:50:50,247 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:50:50,247 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:38610': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:50:50,354 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:50:50,354 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:38622': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:50:50,460 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:50:50,461 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:38626': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:50:50,567 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:50:50,568 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:38640': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:50:50,675 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:50:50,676 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:38644': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:50:50,783 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:50:50,783 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:38648': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:50:50,891 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:50:50,891 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:38650': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:50:50,998 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:50:50,998 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:38656': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:50:51,105 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:50:51,105 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:38670': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:50:51,213 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:50:51,214 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:38684': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:50:51,321 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:50:51,321 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:38700': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:50:51,429 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:50:51,429 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:38710': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:50:51,536 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:50:51,536 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:57106': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:50:51,642 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:50:51,643 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:57114': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:50:51,750 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:50:51,751 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:57128': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:50:51,858 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:50:51,858 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:57132': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:50:51,964 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:50:51,964 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:57136': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:50:52,071 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:50:52,071 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:57140': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:50:52,178 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:50:52,179 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:57144': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:50:52,285 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:50:52,285 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:57148': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:50:52,393 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:50:52,394 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:57164': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:50:52,501 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:50:52,501 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:57176': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:50:52,609 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:50:52,609 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:57186': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:50:52,716 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:50:52,716 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:57202': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:50:52,825 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:50:52,825 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:57208': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:50:52,932 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:50:52,932 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:57224': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:50:53,039 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:50:53,039 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:57226': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:50:53,147 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:50:53,147 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:57240': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:50:53,254 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:50:53,254 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:57248': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:50:53,362 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:50:53,362 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:57260': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:50:53,469 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:50:53,470 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:57268': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:50:53,577 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:50:53,577 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:57280': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:50:53,684 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:50:53,684 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:57282': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:50:53,790 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:50:53,791 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:57298': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:50:53,898 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:50:53,898 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:57310': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:50:54,006 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:50:54,006 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:57312': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:50:54,114 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:50:54,114 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:57320': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:50:54,221 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:50:54,221 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:57336': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:50:54,330 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:50:54,330 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:57346': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:50:54,437 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:50:54,438 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:57352': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:50:54,545 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:50:54,545 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:57366': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:50:54,652 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:50:54,652 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:57376': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:50:54,758 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:50:54,759 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:57380': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:50:54,866 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:50:54,867 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:57382': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:50:54,974 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:50:54,974 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:57396': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:50:55,081 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:50:55,081 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:57408': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:50:55,188 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:50:55,188 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:57412': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:50:55,295 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:50:55,295 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:57422': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:50:55,402 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:50:55,402 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:57432': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:50:55,509 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:50:55,509 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:57440': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:50:55,616 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:50:55,617 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:57454': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:50:55,725 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:50:55,725 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:57460': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:50:55,832 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:50:55,832 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:57464': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:50:55,939 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:50:55,940 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:57478': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:50:56,047 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:50:56,048 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:57486': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:50:56,155 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:50:56,155 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:57488': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:50:56,262 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:50:56,262 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:57492': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:50:56,369 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:50:56,369 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:57500': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:50:56,476 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:50:56,476 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:57502': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:50:56,583 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:50:56,583 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:57504': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:50:56,690 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:50:56,690 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:57516': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:50:56,797 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:50:56,798 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:57526': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:50:56,905 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:50:56,905 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:57536': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:50:57,013 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:50:57,013 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:57544': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:50:57,120 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:50:57,120 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:57554': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:50:57,227 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:50:57,228 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:57560': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:50:57,335 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:50:57,335 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:57572': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:50:57,442 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:50:57,443 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:57580': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:50:57,549 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:50:57,549 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:57586': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:50:57,656 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:50:57,656 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:57600': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:50:57,763 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:50:57,764 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:57602': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:50:57,871 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:50:57,871 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:57604': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:50:57,978 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:50:57,979 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:57608': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:50:58,085 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:50:58,086 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:57620': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:50:58,194 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:50:58,194 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:57636': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:50:58,300 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:50:58,300 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:57648': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:50:58,407 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:50:58,407 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:57660': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:50:58,514 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:50:58,514 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:57664': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:50:58,621 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:50:58,621 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:57676': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:50:58,729 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:50:58,729 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:57692': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:50:58,845 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:50:58,845 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:57696': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:50:58,952 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:50:58,957 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:57704': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:50:59,059 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:50:59,059 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:57708': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:50:59,166 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:50:59,167 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:57720': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:50:59,275 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:50:59,275 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:57728': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:50:59,383 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:50:59,383 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:57736': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:50:59,490 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:50:59,491 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:57752': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:50:59,598 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:50:59,598 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:57758': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:50:59,705 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:50:59,705 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:57766': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:50:59,812 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:50:59,812 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:57770': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:50:59,919 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:50:59,919 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:57774': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:00,028 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:51:00,028 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:57778': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:00,135 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:51:00,135 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:57780': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:00,241 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:51:00,242 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:57788': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:00,348 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:51:00,349 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:57790': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:00,460 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:51:00,460 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:57794': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:00,567 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:51:00,568 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:57798': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:00,676 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:51:00,676 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:57812': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:00,783 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:51:00,783 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:57822': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:00,890 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:51:00,890 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:57826': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:00,998 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:51:00,998 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:57830': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:01,105 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:51:01,105 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:57844': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:01,212 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:51:01,212 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:57850': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:01,319 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:51:01,320 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:57854': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:01,426 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:51:01,427 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:57864': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:01,533 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:51:01,534 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:37064': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:01,641 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:51:01,641 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:37072': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:01,747 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:51:01,747 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:37078': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:01,854 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:51:01,854 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:37084': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:01,960 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:51:01,960 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:37096': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:02,067 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:51:02,067 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:37100': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:02,175 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:51:02,175 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:37102': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:02,283 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:51:02,283 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:37106': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:02,393 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:51:02,393 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:37118': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:02,500 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:51:02,500 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:37134': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:02,607 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:51:02,608 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:37150': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:02,716 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:51:02,716 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:37154': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:02,824 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:51:02,824 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:37164': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:02,931 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:51:02,931 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:37178': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:03,038 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:51:03,038 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:37192': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:03,145 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:51:03,145 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:37204': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:03,252 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:51:03,253 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:37206': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:03,359 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:51:03,360 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:37210': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:03,466 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:51:03,466 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:37216': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:03,573 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:51:03,573 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:37224': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:03,680 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:51:03,680 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:37226': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:03,787 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:51:03,787 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:37234': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:03,894 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:51:03,894 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:37240': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:04,001 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:51:04,001 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:37250': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:04,107 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:51:04,108 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:37254': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:04,214 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:51:04,215 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:37264': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:04,321 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:51:04,322 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:37270': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:04,430 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:51:04,430 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:37284': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:04,537 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:51:04,537 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:37290': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:04,645 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:51:04,645 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:37304': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:04,752 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:51:04,752 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:37310': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:04,859 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:51:04,859 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:37322': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:04,966 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:51:04,966 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:37332': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:05,073 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:51:05,073 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:37348': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:05,180 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:51:05,180 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:37356': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:05,287 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:51:05,287 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:37358': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:05,394 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:51:05,394 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:37366': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:05,501 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:51:05,501 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:37382': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:05,609 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:51:05,609 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:37394': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:05,716 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:51:05,716 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:37402': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:05,824 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:51:05,824 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:37408': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:05,931 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:51:05,931 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:37410': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:06,039 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:51:06,039 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:37416': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:06,146 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:51:06,146 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:37422': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:06,253 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:51:06,253 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:37424': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:06,360 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:51:06,360 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:37434': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:06,467 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:51:06,467 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:37448': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:06,575 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:51:06,576 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:37456': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:06,684 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:51:06,684 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:37458': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:06,791 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:51:06,791 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:37466': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:06,898 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:51:06,898 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:37468': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:07,004 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:51:07,005 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:37482': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:07,111 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:51:07,112 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:37486': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:07,219 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:51:07,220 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:37498': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:07,327 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:51:07,327 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:37506': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:07,433 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:51:07,434 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:37518': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:07,540 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:51:07,540 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:37526': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:07,647 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:51:07,648 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:37542': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:07,754 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:51:07,755 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:37544': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:07,861 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:51:07,862 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:37560': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:07,970 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:51:07,970 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:37566': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:08,078 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:51:08,078 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:37582': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:08,185 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:51:08,186 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:37592': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:08,293 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:51:08,293 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:37598': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:08,400 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:51:08,400 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:37608': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:08,507 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:51:08,508 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:37620': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:08,614 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:51:08,615 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:37624': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:08,722 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:51:08,722 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:37640': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:08,829 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:51:08,829 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:37650': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:08,936 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:51:08,936 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:37658': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:09,043 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:51:09,043 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:37664': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:09,150 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:51:09,150 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:37670': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:09,257 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:51:09,258 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:37684': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:09,364 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:51:09,365 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:37692': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:09,473 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:51:09,473 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:37706': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:09,580 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:51:09,580 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:37708': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:09,687 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:51:09,688 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:37722': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:09,795 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:51:09,795 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:37728': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:09,902 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:51:09,902 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:37740': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:10,009 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:51:10,009 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:37754': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:10,116 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:51:10,117 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:37758': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:10,225 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:51:10,225 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:37770': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:10,332 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:51:10,332 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:37786': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:10,439 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:51:10,439 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:37792': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:10,557 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:51:10,558 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:37802': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:10,664 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:51:10,665 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:37810': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:10,772 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:51:10,772 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:37816': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:10,879 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:51:10,879 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:37828': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:10,986 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:51:10,986 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:37840': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:11,093 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:51:11,093 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:37856': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:11,200 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:51:11,201 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:37864': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:11,307 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:51:11,308 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:37880': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:11,415 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:51:11,415 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:37882': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:11,523 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:51:11,523 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:37890': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:11,630 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:51:11,630 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:54284': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:11,738 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:51:11,738 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:54300': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:11,845 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:51:11,845 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:54316': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:11,952 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:51:11,956 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:54330': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:12,059 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:51:12,059 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:54334': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:12,166 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:51:12,166 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:54350': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:12,273 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:51:12,273 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:54366': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:12,380 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:51:12,380 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:54370': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:12,487 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:51:12,488 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:54376': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:12,594 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:51:12,595 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:54390': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:12,702 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:51:12,702 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:54400': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:12,809 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:51:12,809 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:54408': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:12,916 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:51:12,916 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:54412': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:13,023 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:51:13,024 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:54424': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:13,131 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:51:13,131 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:54434': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:13,238 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:51:13,238 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:54442': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:13,345 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:51:13,345 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:54452': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:13,452 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:51:13,456 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:54466': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:13,560 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:51:13,560 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:54478': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:13,667 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:51:13,667 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:54486': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:13,775 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:51:13,776 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:54488': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:13,883 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:51:13,884 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:54502': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:13,991 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:51:13,991 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:54508': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:14,098 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:51:14,098 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:54520': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:14,206 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:51:14,206 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:54536': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:14,312 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:51:14,313 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:54548': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:14,419 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:51:14,420 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:54556': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:14,527 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:51:14,528 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:54570': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:14,634 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:51:14,635 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:54576': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:14,743 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:51:14,743 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:54584': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:14,850 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:51:14,850 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:54594': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:14,960 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:51:14,960 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:54596': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:15,067 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:51:15,067 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:54602': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:15,175 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:51:15,175 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:54616': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:15,283 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:51:15,283 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:54628': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:15,390 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:51:15,391 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:54636': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:15,497 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:51:15,498 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:54648': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:15,605 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:51:15,605 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:54652': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:15,711 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:51:15,711 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:54668': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:15,818 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:51:15,819 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:54670': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:15,925 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:51:15,925 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:54682': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:16,032 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:51:16,033 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:54688': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:16,140 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:51:16,140 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:54694': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:16,246 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:51:16,247 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:54710': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:16,353 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:51:16,354 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:54720': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:16,460 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:51:16,460 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:54722': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:16,567 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:51:16,567 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:54728': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:16,675 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:51:16,676 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:54744': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:16,783 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:51:16,783 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:54752': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:16,890 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:51:16,890 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:54764': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:16,997 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:51:16,997 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:54770': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:17,104 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:51:17,104 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:54786': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:17,210 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:51:17,211 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:54802': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:17,317 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37779 8450s 2024-11-23 22:51:17,318 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37779': TLS handshake failed with remote 'tls://127.0.0.1:54806': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:17,416 - distributed.scheduler - INFO - Scheduler closing due to unknown reason... 8450s 2024-11-23 22:51:17,416 - distributed.scheduler - INFO - Scheduler closing all comms 8450s _____________________________ test_gen_cluster_tls _____________________________ 8450s 8450s fut = , timeout = 0 8450s 8450s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 8450s async with asyncio.timeout(timeout): 8450s > return await fut 8450s 8450s /usr/lib/python3/dist-packages/distributed/utils.py:1960: 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s /usr/lib/python3/dist-packages/distributed/worker.py:1480: in start_unsafe 8450s await self._register_with_scheduler() 8450s /usr/lib/python3/dist-packages/distributed/worker.py:1179: in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s /usr/lib/python3/dist-packages/distributed/comm/core.py:342: in connect 8450s comm = await wait_for( 8450s /usr/lib/python3/dist-packages/distributed/utils.py:1960: in wait_for 8450s return await fut 8450s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:546: in connect 8450s stream = await self.client.connect( 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s 8450s self = , host = '127.0.0.1' 8450s port = 37565, af = 8450s ssl_options = 8450s max_buffer_size = 8364507136.0, source_ip = None, source_port = None 8450s timeout = None 8450s 8450s async def connect( 8450s self, 8450s host: str, 8450s port: int, 8450s af: socket.AddressFamily = socket.AF_UNSPEC, 8450s ssl_options: Optional[Union[Dict[str, Any], ssl.SSLContext]] = None, 8450s max_buffer_size: Optional[int] = None, 8450s source_ip: Optional[str] = None, 8450s source_port: Optional[int] = None, 8450s timeout: Optional[Union[float, datetime.timedelta]] = None, 8450s ) -> IOStream: 8450s """Connect to the given host and port. 8450s 8450s Asynchronously returns an `.IOStream` (or `.SSLIOStream` if 8450s ``ssl_options`` is not None). 8450s 8450s Using the ``source_ip`` kwarg, one can specify the source 8450s IP address to use when establishing the connection. 8450s In case the user needs to resolve and 8450s use a specific interface, it has to be handled outside 8450s of Tornado as this depends very much on the platform. 8450s 8450s Raises `TimeoutError` if the input future does not complete before 8450s ``timeout``, which may be specified in any form allowed by 8450s `.IOLoop.add_timeout` (i.e. a `datetime.timedelta` or an absolute time 8450s relative to `.IOLoop.time`) 8450s 8450s Similarly, when the user requires a certain source port, it can 8450s be specified using the ``source_port`` arg. 8450s 8450s .. versionchanged:: 4.5 8450s Added the ``source_ip`` and ``source_port`` arguments. 8450s 8450s .. versionchanged:: 5.0 8450s Added the ``timeout`` argument. 8450s """ 8450s if timeout is not None: 8450s if isinstance(timeout, numbers.Real): 8450s timeout = IOLoop.current().time() + timeout 8450s elif isinstance(timeout, datetime.timedelta): 8450s timeout = IOLoop.current().time() + timeout.total_seconds() 8450s else: 8450s raise TypeError("Unsupported timeout %r" % timeout) 8450s if timeout is not None: 8450s addrinfo = await gen.with_timeout( 8450s timeout, self.resolver.resolve(host, port, af) 8450s ) 8450s else: 8450s addrinfo = await self.resolver.resolve(host, port, af) 8450s connector = _Connector( 8450s addrinfo, 8450s functools.partial( 8450s self._create_stream, 8450s max_buffer_size, 8450s source_ip=source_ip, 8450s source_port=source_port, 8450s ), 8450s ) 8450s > af, addr, stream = await connector.start(connect_timeout=timeout) 8450s E asyncio.exceptions.CancelledError 8450s 8450s /usr/lib/python3/dist-packages/tornado/tcpclient.py:279: CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s self = 8450s 8450s @final 8450s async def start(self): 8450s async with self._startup_lock: 8450s if self.status == Status.failed: 8450s assert self.__startup_exc is not None 8450s raise self.__startup_exc 8450s elif self.status != Status.init: 8450s return self 8450s timeout = getattr(self, "death_timeout", None) 8450s 8450s async def _close_on_failure(exc: Exception) -> None: 8450s await self.close(reason=f"failure-to-start-{str(type(exc))}") 8450s self.status = Status.failed 8450s self.__startup_exc = exc 8450s 8450s try: 8450s > await wait_for(self.start_unsafe(), timeout=timeout) 8450s 8450s /usr/lib/python3/dist-packages/distributed/core.py:664: 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 8450s async with asyncio.timeout(timeout): 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s 8450s self = 8450s exc_type = 8450s exc_val = CancelledError(), exc_tb = 8450s 8450s async def __aexit__( 8450s self, 8450s exc_type: Optional[Type[BaseException]], 8450s exc_val: Optional[BaseException], 8450s exc_tb: Optional[TracebackType], 8450s ) -> Optional[bool]: 8450s assert self._state in (_State.ENTERED, _State.EXPIRING) 8450s 8450s if self._timeout_handler is not None: 8450s self._timeout_handler.cancel() 8450s self._timeout_handler = None 8450s 8450s if self._state is _State.EXPIRING: 8450s self._state = _State.EXPIRED 8450s 8450s if self._task.uncancel() <= self._cancelling and exc_type is not None: 8450s # Since there are no new cancel requests, we're 8450s # handling this. 8450s if issubclass(exc_type, exceptions.CancelledError): 8450s > raise TimeoutError from exc_val 8450s E TimeoutError 8450s 8450s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s @contextlib.asynccontextmanager 8450s async def _cluster_factory(): 8450s workers = [] 8450s s = None 8450s try: 8450s for _ in range(60): 8450s try: 8450s > s, ws = await start_cluster( 8450s nthreads, 8450s scheduler, 8450s security=security, 8450s Worker=Worker, 8450s scheduler_kwargs=scheduler_kwargs, 8450s worker_kwargs=merge( 8450s {"death_timeout": min(15, int(deadline.remaining))}, 8450s worker_kwargs, 8450s ), 8450s ) 8450s 8450s /usr/lib/python3/dist-packages/distributed/utils_test.py:966: 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s /usr/lib/python3/dist-packages/distributed/utils_test.py:789: in start_cluster 8450s await asyncio.gather(*workers) 8450s /usr/lib/python3.13/asyncio/tasks.py:737: in _wrap_awaitable 8450s return await awaitable 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s 8450s self = 8450s 8450s @final 8450s async def start(self): 8450s async with self._startup_lock: 8450s if self.status == Status.failed: 8450s assert self.__startup_exc is not None 8450s raise self.__startup_exc 8450s elif self.status != Status.init: 8450s return self 8450s timeout = getattr(self, "death_timeout", None) 8450s 8450s async def _close_on_failure(exc: Exception) -> None: 8450s await self.close(reason=f"failure-to-start-{str(type(exc))}") 8450s self.status = Status.failed 8450s self.__startup_exc = exc 8450s 8450s try: 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s except asyncio.TimeoutError as exc: 8450s await _close_on_failure(exc) 8450s > raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s E TimeoutError: Worker start timed out after 0s. 8450s 8450s /usr/lib/python3/dist-packages/distributed/core.py:667: TimeoutError 8450s 8450s During handling of the above exception, another exception occurred: 8450s 8450s fut = ._..test_func..async_fn at 0xe8325dc0> 8450s timeout = 60 8450s 8450s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 8450s async with asyncio.timeout(timeout): 8450s > return await fut 8450s 8450s /usr/lib/python3/dist-packages/distributed/utils.py:1960: 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s /usr/lib/python3/dist-packages/distributed/utils_test.py:999: in async_fn 8450s _cluster_factory() as (s, workers), 8450s /usr/lib/python3.13/contextlib.py:214: in __aenter__ 8450s return await anext(self.gen) 8450s /usr/lib/python3/dist-packages/distributed/utils_test.py:983: in _cluster_factory 8450s await asyncio.sleep(1) 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s 8450s delay = 1, result = None 8450s 8450s async def sleep(delay, result=None): 8450s """Coroutine that completes after a given time (in seconds).""" 8450s if delay <= 0: 8450s await __sleep0() 8450s return result 8450s 8450s if math.isnan(delay): 8450s raise ValueError("Invalid delay: NaN (not a number)") 8450s 8450s loop = events.get_running_loop() 8450s future = loop.create_future() 8450s h = loop.call_later(delay, 8450s futures._set_result_unless_cancelled, 8450s future, result) 8450s try: 8450s > return await future 8450s E asyncio.exceptions.CancelledError 8450s 8450s /usr/lib/python3.13/asyncio/tasks.py:718: CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s args = (), kwds = {} 8450s 8450s @wraps(func) 8450s def inner(*args, **kwds): 8450s with self._recreate_cm(): 8450s > return func(*args, **kwds) 8450s 8450s /usr/lib/python3.13/contextlib.py:85: 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s /usr/lib/python3.13/contextlib.py:85: in inner 8450s return func(*args, **kwds) 8450s /usr/lib/python3/dist-packages/distributed/utils_test.py:1102: in test_func 8450s return _run_and_close_tornado(async_fn_outer) 8450s /usr/lib/python3/dist-packages/distributed/utils_test.py:378: in _run_and_close_tornado 8450s return asyncio_run(inner_fn(), loop_factory=get_loop_factory()) 8450s /usr/lib/python3.13/asyncio/runners.py:194: in run 8450s return runner.run(main) 8450s /usr/lib/python3.13/asyncio/runners.py:118: in run 8450s return self._loop.run_until_complete(task) 8450s /usr/lib/python3.13/asyncio/base_events.py:720: in run_until_complete 8450s return future.result() 8450s /usr/lib/python3/dist-packages/distributed/utils_test.py:375: in inner_fn 8450s return await async_fn(*args, **kwargs) 8450s /usr/lib/python3/dist-packages/distributed/utils_test.py:1099: in async_fn_outer 8450s return await utils_wait_for(async_fn(), timeout=timeout * 2) 8450s /usr/lib/python3/dist-packages/distributed/utils.py:1959: in wait_for 8450s async with asyncio.timeout(timeout): 8450s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 8450s 8450s self = 8450s exc_type = 8450s exc_val = CancelledError(), exc_tb = 8450s 8450s async def __aexit__( 8450s self, 8450s exc_type: Optional[Type[BaseException]], 8450s exc_val: Optional[BaseException], 8450s exc_tb: Optional[TracebackType], 8450s ) -> Optional[bool]: 8450s assert self._state in (_State.ENTERED, _State.EXPIRING) 8450s 8450s if self._timeout_handler is not None: 8450s self._timeout_handler.cancel() 8450s self._timeout_handler = None 8450s 8450s if self._state is _State.EXPIRING: 8450s self._state = _State.EXPIRED 8450s 8450s if self._task.uncancel() <= self._cancelling and exc_type is not None: 8450s # Since there are no new cancel requests, we're 8450s # handling this. 8450s if issubclass(exc_type, exceptions.CancelledError): 8450s > raise TimeoutError from exc_val 8450s E TimeoutError 8450s 8450s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 8450s ----------------------------- Captured stderr call ----------------------------- 8450s 2024-11-23 22:51:17,879 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:51:17,888 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:17,888 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36565/status 8450s 2024-11-23 22:51:17,888 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:51:17,902 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46751 8450s 2024-11-23 22:51:17,902 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46751 8450s 2024-11-23 22:51:17,902 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:51:17,902 - distributed.worker - INFO - dashboard at: 127.0.0.1:33137 8450s 2024-11-23 22:51:17,902 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:17,902 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:51:17,902 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:51:17,903 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:51:17,903 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-hk2w5w64 8450s 2024-11-23 22:51:17,903 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:51:17,904 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40711 8450s 2024-11-23 22:51:17,904 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40711 8450s 2024-11-23 22:51:17,904 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:51:17,904 - distributed.worker - INFO - dashboard at: 127.0.0.1:35609 8450s 2024-11-23 22:51:17,904 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:17,904 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:51:17,904 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:51:17,904 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:51:17,904 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-gvzaqyx4 8450s 2024-11-23 22:51:17,905 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:51:17,916 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:17,917 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:17,917 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:58586': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:17,917 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:58600': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:18,029 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:18,029 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:18,029 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:58616': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:18,029 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:58626': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:18,143 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:18,143 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:18,143 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:58632': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:18,143 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:58648': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:18,254 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:18,254 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:18,255 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:58654': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:18,255 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:58660': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:18,366 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:18,367 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:18,367 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:58670': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:18,367 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:58686': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:18,478 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:18,479 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:18,479 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:58694': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:18,479 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:58708': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:18,590 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:18,591 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:18,591 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:58712': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:18,591 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:58718': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:18,702 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:18,702 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:18,702 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:58720': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:18,702 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:58728': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:18,814 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:18,814 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:18,815 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:58738': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:18,815 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:58752': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:18,926 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:18,926 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:18,926 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:58760': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:18,927 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:58770': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:19,038 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:19,038 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:19,039 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:58782': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:19,039 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:58784': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:19,150 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:19,151 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:19,151 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:58796': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:19,151 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:58802': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:19,263 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:19,263 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:19,263 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:58812': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:19,263 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:58814': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:19,375 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:19,375 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:19,375 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:58816': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:19,375 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:58820': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:19,487 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:19,487 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:19,487 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:58836': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:19,488 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:58838': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:19,599 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:19,599 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:19,600 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:58846': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:19,600 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:58858': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:19,712 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:19,713 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:19,713 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:58868': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:19,713 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:58872': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:19,825 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:19,825 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:19,825 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:58880': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:19,825 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:58884': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:19,937 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:19,937 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:19,938 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:58892': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:19,938 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:58900': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:20,050 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:20,050 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:20,050 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:58902': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:20,050 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:58910': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:20,161 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:20,162 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:20,162 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:58918': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:20,162 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:58930': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:20,274 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:20,274 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:20,274 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:58942': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:20,274 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:58944': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:20,386 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:20,386 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:20,387 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:58960': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:20,387 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:58962': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:20,499 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:20,499 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:20,499 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:58976': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:20,499 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:58992': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:20,613 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:20,614 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:20,614 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:59008': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:20,614 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:59014': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:20,725 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:20,726 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:20,726 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:59026': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:20,726 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:59042': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:20,838 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:20,838 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:20,838 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:59056': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:20,839 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:59058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:20,950 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:20,950 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:20,950 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:59064': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:20,950 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:59070': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:21,062 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:21,062 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:21,062 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:59078': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:21,062 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:59086': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:21,173 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:21,174 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:21,174 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:59096': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:21,174 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:59106': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:21,286 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:21,286 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:21,286 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:59118': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:21,286 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:59124': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:21,401 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:21,402 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:21,402 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:59130': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:21,402 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:59134': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:21,514 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:21,514 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:21,514 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:59140': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:21,515 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:59144': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:21,628 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:21,629 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:21,629 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:59152': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:21,629 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:59162': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:21,741 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:21,741 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:21,741 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:59166': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:21,741 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:59170': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:21,854 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:21,854 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:21,855 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:59172': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:21,855 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:59174': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:21,966 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:21,966 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:21,966 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:59184': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:21,967 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:59186': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:22,078 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:22,079 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:22,079 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:59188': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:22,079 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:59192': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:22,191 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:22,191 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:22,192 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:59208': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:22,192 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:59222': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:22,303 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:22,303 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:22,303 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:59236': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:22,303 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:59250': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:22,415 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:22,415 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:22,415 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:59260': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:22,415 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:59276': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:22,528 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:22,528 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:22,528 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:59280': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:22,529 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:59290': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:22,640 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:22,640 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:22,641 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:59298': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:22,641 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:59302': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:22,752 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:22,752 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:22,752 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:59304': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:22,752 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:59312': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:22,864 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:22,864 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:22,864 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:59320': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:22,865 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:59322': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:22,977 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:22,977 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:22,977 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:59334': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:22,977 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:59336': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:23,090 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:23,090 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:23,090 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:59338': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:23,090 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:59342': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:23,201 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:23,201 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:23,202 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:59346': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:23,202 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:59348': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:23,315 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:23,316 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:23,316 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:59360': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:23,316 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:59374': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:23,427 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:23,428 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:23,428 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:59380': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:23,428 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:59392': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:23,540 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:23,541 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:23,541 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:59406': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:23,541 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:59410': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:23,652 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:23,652 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:23,653 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:59412': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:23,653 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:59414': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:23,765 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:23,765 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:23,765 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:59416': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:23,765 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:59432': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:23,877 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:23,877 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:23,877 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:59440': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:23,877 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:59448': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:23,989 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:23,989 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:23,989 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:59462': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:23,989 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:59478': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:24,101 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:24,101 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:24,101 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:59492': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:24,101 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:59496': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:24,213 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:24,213 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:24,213 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:59498': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:24,213 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:59502': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:24,325 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:24,325 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:24,325 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:59514': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:24,325 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:59522': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:24,437 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:24,437 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:24,437 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:59524': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:24,437 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:59538': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:24,549 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:24,549 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:24,550 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:59554': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:24,550 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:59558': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:24,668 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:24,668 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:24,669 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:59574': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:24,669 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:59586': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:24,780 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:24,780 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:24,780 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:59588': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:24,780 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:59590': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:24,892 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:24,892 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:24,896 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:59604': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:24,896 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:59608': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:25,004 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:25,004 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:25,005 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:59620': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:25,005 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:59628': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:25,119 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:25,119 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:25,119 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:59642': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:25,119 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:59650': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:25,230 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:25,231 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:25,231 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:59666': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:25,231 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:59672': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:25,338 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:25,342 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:59680': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:25,343 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:25,343 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:59682': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:25,444 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:25,445 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:59696': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:25,451 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:25,451 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:59712': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:25,552 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:25,552 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:59720': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:25,557 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:25,558 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:59728': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:25,660 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:25,660 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:59734': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:25,665 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:25,666 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:59748': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:25,767 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:25,768 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:59756': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:25,773 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:25,773 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:59762': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:25,874 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:25,875 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:59776': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:25,880 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:25,880 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:59782': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:25,981 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:25,982 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:59784': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:25,987 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:25,988 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:59790': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:26,088 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:26,089 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:59804': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:26,094 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:26,095 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:59814': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:26,196 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:26,196 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:59830': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:26,202 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:26,202 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:59842': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:26,303 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:26,303 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:59856': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:26,309 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:26,309 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:59866': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:26,409 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:26,410 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:59868': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:26,416 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:26,416 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:59870': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:26,516 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:26,516 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:59876': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:26,523 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:26,523 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:59882': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:26,623 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:26,624 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:59886': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:26,630 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:26,631 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:59902': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:26,731 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:26,731 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:59916': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:26,738 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:26,738 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:59932': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:26,839 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:26,839 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:59934': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:26,845 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:26,845 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:59946': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:26,946 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:26,947 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:59952': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:26,952 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:26,953 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:59964': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:27,053 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:27,054 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:59974': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:27,059 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:27,060 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:59978': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:27,161 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:27,161 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:59994': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:27,167 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:27,167 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:60000': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:27,269 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:27,270 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:60002': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:27,275 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:27,275 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:60014': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:27,376 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:27,377 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:60020': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:27,382 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:27,382 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:60026': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:27,483 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:27,484 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:60038': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:27,490 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:27,490 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:60044': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:27,591 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:27,591 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:60050': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:27,597 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:27,597 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:60064': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:27,698 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:27,698 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:60070': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:27,704 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:27,704 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:60086': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:27,806 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:27,806 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:60096': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:27,812 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:27,812 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:60108': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:27,914 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:27,914 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:60116': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:27,919 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:27,920 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:60128': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:28,021 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:28,021 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:60144': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:28,027 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:28,027 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:60160': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:28,128 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:28,128 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:60174': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:28,134 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:28,134 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:60186': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:28,235 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:28,236 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:60192': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:28,241 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:28,241 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:60202': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:28,342 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:28,343 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:60204': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:28,348 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:28,348 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:60206': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:28,449 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:28,450 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:60208': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:28,455 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:28,455 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:60212': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:28,557 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:28,557 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:60228': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:28,563 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:28,563 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:60230': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:28,665 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:28,665 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:60236': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:28,671 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:28,671 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:60242': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:28,772 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:28,772 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:60244': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:28,778 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:28,778 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:60250': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:28,879 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:28,879 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:60262': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:28,885 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:28,885 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:60270': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:28,987 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:28,987 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:60274': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:28,993 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:28,993 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:60288': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:29,094 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:29,094 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:60302': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:29,100 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:29,100 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:60318': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:29,200 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:29,200 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:60324': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:29,206 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:29,206 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:60328': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:29,307 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:29,307 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:60342': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:29,313 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:29,313 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:60356': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:29,414 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:29,415 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:60370': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:29,420 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:29,420 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:60380': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:29,521 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:29,522 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:60384': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:29,527 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:29,528 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:60400': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:29,628 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:29,629 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:60404': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:29,634 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:29,635 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:60420': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:29,735 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:29,735 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:60430': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:29,741 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:29,741 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:60436': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:29,842 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:29,842 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:60446': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:29,848 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:29,848 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:60454': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:29,949 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:29,950 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:60466': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:29,955 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:29,955 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:60468': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:30,057 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:30,058 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:60484': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:30,064 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:30,064 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:60492': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:30,165 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:30,165 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:60498': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:30,171 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:30,171 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:60506': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:30,272 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:30,273 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:60518': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:30,279 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:30,279 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:60520': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:30,379 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:30,380 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:60526': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:30,385 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:30,386 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:60534': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:30,486 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:30,487 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:60550': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:30,492 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:30,493 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:60560': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:30,593 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:30,594 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:60570': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:30,600 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:30,600 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:60586': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:30,700 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:30,700 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:60590': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:30,706 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:30,706 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:60600': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:30,807 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:30,807 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:60616': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:30,813 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:30,813 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:60618': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:30,914 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:30,914 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:60626': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:30,919 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:30,920 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:60628': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:31,020 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:31,021 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:60636': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:31,026 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:31,027 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:60642': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:31,134 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:31,135 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:60652': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:31,140 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:31,141 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:60662': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:31,242 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:31,242 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:60672': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:31,247 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:31,248 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:60682': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:31,348 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:31,348 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:60698': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:31,354 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:31,354 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:60700': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:31,455 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:31,456 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:60712': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:31,461 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:31,462 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:60718': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:31,564 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:31,564 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:39330': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:31,570 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:31,570 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:39340': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:31,670 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:31,671 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:39344': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:31,677 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:31,677 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:39358': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:31,777 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:31,778 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:39362': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:31,783 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:31,784 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:39366': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:31,885 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:31,885 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:39372': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:31,891 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:31,894 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:39376': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:31,993 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:31,993 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:39380': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:31,999 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:31,999 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:39382': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:32,100 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:32,101 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:39392': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:32,106 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:32,106 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:39396': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:32,207 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:32,208 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:39410': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:32,214 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:32,214 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:39418': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:32,315 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:32,316 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:39432': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:32,321 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:32,321 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:39436': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:32,422 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:32,423 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:39452': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:32,428 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:32,428 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:39456': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:32,529 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:32,529 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:39466': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:32,535 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:32,535 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:39478': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:32,636 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:32,637 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:39480': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:32,642 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:32,642 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:39486': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:32,743 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:32,743 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:39500': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:32,749 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:32,749 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:39514': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:32,852 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:32,853 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:39520': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:32,859 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35113 8450s 2024-11-23 22:51:32,859 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35113': TLS handshake failed with remote 'tls://127.0.0.1:39524': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:32,902 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46751. Reason: failure-to-start- 8450s 2024-11-23 22:51:32,902 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:51:32,905 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40711. Reason: failure-to-start- 8450s 2024-11-23 22:51:32,905 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:51:32,906 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 15s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 8450s stream = await stream.start_tls( 8450s ^^^^^^^^^^^^^^^^^^^^^^^ 8450s False, ssl_options=ssl_options, server_hostname=host 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 8450s self.socket.do_handshake() 8450s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 8450s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 8450s self._sslobj.do_handshake() 8450s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 8450s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 8450s raise FatalCommClosedError( 8450s ...<2 lines>... 8450s ) from err 8450s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 8450s 8450s During handling of the above exception, another exception occurred: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1218, in _register_with_scheduler 8450s await asyncio.sleep(0.1) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 718, in sleep 8450s return await future 8450s ^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 15s. 8450s 2024-11-23 22:51:33,915 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:51:33,922 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:33,923 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46331/status 8450s 2024-11-23 22:51:33,923 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:51:33,936 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36367 8450s 2024-11-23 22:51:33,936 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36367 8450s 2024-11-23 22:51:33,936 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:51:33,936 - distributed.worker - INFO - dashboard at: 127.0.0.1:35479 8450s 2024-11-23 22:51:33,936 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:33,936 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:51:33,936 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:51:33,936 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:51:33,936 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ownbzof5 8450s 2024-11-23 22:51:33,936 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:51:33,938 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38527 8450s 2024-11-23 22:51:33,938 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38527 8450s 2024-11-23 22:51:33,938 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:51:33,938 - distributed.worker - INFO - dashboard at: 127.0.0.1:40309 8450s 2024-11-23 22:51:33,938 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:33,938 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:51:33,938 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:51:33,938 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:51:33,938 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-lxsj12o9 8450s 2024-11-23 22:51:33,938 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:51:33,950 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:33,950 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:33,951 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:33082': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:33,951 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:33092': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:34,063 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:34,063 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:34,063 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:33100': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:34,063 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:33108': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:34,175 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:34,175 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:34,176 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:33122': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:34,176 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:33138': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:34,288 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:34,288 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:34,288 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:33146': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:34,288 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:33162': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:34,404 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:34,404 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:34,405 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:33170': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:34,405 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:33184': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:34,517 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:34,517 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:34,517 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:33190': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:34,517 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:33192': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:34,629 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:34,629 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:34,629 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:33196': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:34,629 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:33210': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:34,741 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:34,741 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:34,742 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:33226': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:34,742 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:33242': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:34,858 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:34,858 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:34,859 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:33248': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:34,859 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:33254': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:34,970 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:34,970 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:34,971 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:33262': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:34,971 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:33278': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:35,082 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:35,082 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:35,083 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:33280': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:35,083 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:33286': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:35,195 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:35,195 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:35,196 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:33302': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:35,196 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:33308': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:35,307 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:35,307 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:35,308 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:33324': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:35,308 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:33336': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:35,419 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:35,419 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:35,419 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:33350': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:35,419 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:33364': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:35,532 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:35,532 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:35,532 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:33370': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:35,532 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:33378': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:35,644 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:35,644 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:35,644 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:33390': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:35,644 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:33396': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:35,757 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:35,757 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:35,757 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:33400': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:35,757 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:33412': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:35,869 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:35,869 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:35,869 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:33428': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:35,870 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:33432': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:35,981 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:35,981 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:35,982 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:33434': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:35,982 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:33444': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:36,095 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:36,095 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:36,095 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:33446': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:36,096 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:33450': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:36,206 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:36,207 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:36,207 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:33452': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:36,207 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:33468': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:36,318 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:36,318 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:36,319 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:33484': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:36,319 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:33490': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:36,432 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:36,432 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:36,435 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:33494': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:36,435 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:33506': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:36,543 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:36,543 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:36,544 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:33520': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:36,544 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:33534': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:36,657 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:36,657 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:36,657 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:33542': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:36,657 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:33550': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:36,769 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:36,769 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:36,769 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:33554': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:36,769 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:33564': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:36,880 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:36,881 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:36,881 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:33566': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:36,881 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:33572': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:36,993 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:36,993 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:36,994 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:33578': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:36,994 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:33592': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:37,105 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:37,105 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:37,106 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:33602': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:37,106 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:33614': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:37,217 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:37,217 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:37,217 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:33624': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:37,218 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:33636': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:37,329 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:37,330 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:37,330 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:33650': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:37,330 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:33652': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:37,442 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:37,442 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:37,442 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:33662': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:37,443 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:33678': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:37,555 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:37,555 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:37,555 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:33680': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:37,555 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:33696': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:37,667 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:37,667 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:37,668 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:33702': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:37,668 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:33704': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:37,780 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:37,780 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:37,780 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:33714': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:37,780 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:33724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:37,892 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:37,892 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:37,895 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:33730': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:37,895 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:33740': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:38,003 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:38,003 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:38,004 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:33746': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:38,004 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:33748': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:38,116 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:38,116 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:38,116 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:33764': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:38,116 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:33770': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:38,229 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:38,229 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:38,230 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:33774': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:38,230 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:33788': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:38,340 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:38,341 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:38,341 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:33800': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:38,341 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:33810': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:38,453 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:38,453 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:38,453 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:33820': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:38,453 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:33836': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:38,565 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:38,565 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:38,565 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:33852': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:38,565 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:33866': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:38,677 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:38,678 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:38,678 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:33876': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:38,678 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:33880': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:38,789 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:38,789 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:38,790 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:33894': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:38,790 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:33910': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:38,903 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:38,904 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:38,904 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:33914': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:38,904 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:33926': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:39,015 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:39,015 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:39,015 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:33932': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:39,015 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:33946': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:39,127 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:39,128 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:39,128 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:33954': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:39,128 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:33968': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:39,239 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:39,240 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:39,240 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:33978': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:39,240 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:33982': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:39,353 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:39,353 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:39,353 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:33992': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:39,353 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:34002': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:39,465 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:39,466 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:39,466 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:34012': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:39,466 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:34018': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:39,578 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:39,578 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:39,578 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:34020': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:39,578 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:34028': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:39,690 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:39,690 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:39,690 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:34030': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:39,690 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:34034': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:39,801 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:39,801 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:39,802 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:34048': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:39,802 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:34054': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:39,913 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:39,913 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:39,913 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:34060': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:39,913 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:34072': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:40,025 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:40,026 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:40,026 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:34074': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:40,026 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:34090': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:40,138 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:40,139 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:40,139 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:34098': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:40,139 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:34112': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:40,250 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:40,250 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:40,251 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:34124': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:40,251 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:34132': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:40,363 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:40,363 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:40,363 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:34138': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:40,363 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:34140': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:40,475 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:40,475 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:40,476 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:34154': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:40,476 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:34162': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:40,588 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:40,588 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:40,588 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:34172': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:40,588 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:34188': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:40,700 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:40,700 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:40,700 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:34204': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:40,700 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:34208': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:40,811 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:40,811 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:40,811 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:34218': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:40,811 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:34226': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:40,922 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:40,923 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:40,923 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:34236': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:40,923 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:34248': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:41,035 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:41,035 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:41,035 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:34264': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:41,035 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:34276': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:41,147 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:41,147 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:41,148 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:34282': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:41,148 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:34294': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:41,259 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:41,259 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:41,259 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:34300': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:41,259 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:34312': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:41,372 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:41,372 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:41,373 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:34322': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:41,373 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:34326': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:41,484 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:41,484 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:41,484 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:34328': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:41,484 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:34342': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:41,597 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:41,597 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:41,597 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:37552': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:41,597 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:37564': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:41,709 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:41,709 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:41,710 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:37576': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:41,710 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:37588': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:41,822 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:41,822 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:41,822 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:37604': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:41,822 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:37618': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:41,937 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:41,937 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:41,937 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:37622': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:41,937 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:37626': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:42,050 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:42,050 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:42,050 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:37640': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:42,050 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:37656': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:42,162 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:42,162 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:42,162 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:37658': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:42,162 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:37672': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:42,273 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:42,274 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:42,274 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:37674': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:42,274 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:37686': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:42,385 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:42,385 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:42,385 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:37700': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:42,385 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:37708': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:42,498 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:42,499 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:42,499 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:37712': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:42,499 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:37724': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:42,611 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:42,611 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:42,611 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:37740': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:42,611 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:37748': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:42,722 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:42,722 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:42,723 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:37750': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:42,723 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:37754': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:42,834 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:42,835 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:42,835 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:37768': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:42,835 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:37778': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:42,948 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:42,948 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:42,949 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:37782': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:42,949 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:37794': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:43,060 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:43,060 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:43,060 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:37802': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:43,060 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:37804': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:43,171 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:43,171 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:43,172 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:37818': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:43,172 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:37834': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:43,283 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:43,283 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:43,283 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:37836': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:43,283 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:37838': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:43,395 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:43,395 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:43,398 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:37846': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:43,399 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:37852': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:43,507 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:43,507 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:43,507 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:37864': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:43,507 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:37866': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:43,620 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:43,621 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:43,621 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:37872': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:43,621 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:37886': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:43,732 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:43,732 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:43,733 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:37890': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:43,733 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:37902': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:43,845 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:43,845 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:43,845 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:37916': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:43,845 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:37922': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:43,956 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:43,956 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:43,957 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:37924': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:43,957 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:37926': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:44,068 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:44,068 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:44,069 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:37936': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:44,069 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:37946': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:44,180 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:44,180 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:44,180 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:37952': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:44,180 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:37964': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:44,291 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:44,292 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:44,292 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:37968': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:44,292 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:37978': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:44,404 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:44,404 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:44,404 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:37986': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:44,404 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:37994': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:44,516 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:44,516 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:44,516 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:37996': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:44,516 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:38004': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:44,627 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:44,627 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:44,628 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:38014': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:44,628 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:38026': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:44,740 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:44,740 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:44,740 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:38032': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:44,740 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:38038': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:44,852 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:44,852 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:44,852 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:38052': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:44,852 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:38058': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:44,965 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:44,965 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:44,965 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:38062': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:44,965 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:38070': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:45,077 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:45,084 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:45,085 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:38084': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:45,085 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:38100': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:45,195 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:45,196 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:45,196 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:38114': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:45,196 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:38116': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:45,303 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:45,307 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:38126': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:45,308 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:45,308 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:38134': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:45,411 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:45,411 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:38138': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:45,417 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:45,417 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:38146': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:45,517 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:45,517 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:38148': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:45,523 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:45,523 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:38158': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:45,624 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:45,625 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:38164': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:45,630 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:45,630 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:38172': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:45,731 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:45,731 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:38180': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:45,737 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:45,737 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:38184': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:45,838 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:45,839 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:38194': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:45,844 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:45,844 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:38208': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:45,944 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:45,945 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:38222': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:45,950 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:45,951 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:38224': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:46,052 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:46,052 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:38226': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:46,058 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:46,058 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:38228': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:46,158 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:46,158 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:38230': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:46,164 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:46,164 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:38238': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:46,265 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:46,266 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:38248': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:46,272 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:46,272 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:38258': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:46,373 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:46,373 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:38260': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:46,379 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:46,379 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:38274': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:46,481 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:46,482 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:38288': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:46,487 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:46,487 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:38294': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:46,588 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:46,589 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:38298': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:46,594 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:46,594 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:38300': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:46,695 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:46,696 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:38308': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:46,701 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:46,701 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:38318': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:46,802 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:46,803 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:38324': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:46,808 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:46,809 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:38336': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:46,910 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:46,910 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:38342': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:46,916 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38499 8450s 2024-11-23 22:51:46,916 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38499': TLS handshake failed with remote 'tls://127.0.0.1:38354': [SSL: SSLV3_ALERT_CERTIFICATE_UNKNOWN] ssl/tls alert certificate unknown (_ssl.c:1020) 8450s 2024-11-23 22:51:46,936 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36367. Reason: failure-to-start- 8450s 2024-11-23 22:51:46,936 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:51:46,938 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38527. Reason: failure-to-start- 8450s 2024-11-23 22:51:46,938 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:51:46,939 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 13s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 292, in connect 8450s stream = await stream.start_tls( 8450s ^^^^^^^^^^^^^^^^^^^^^^^ 8450s False, ssl_options=ssl_options, server_hostname=host 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/iostream.py", line 1367, in _do_ssl_handshake 8450s self.socket.do_handshake() 8450s ~~~~~~~~~~~~~~~~~~~~~~~~^^ 8450s File "/usr/lib/python3.13/ssl.py", line 1372, in do_handshake 8450s self._sslobj.do_handshake() 8450s ~~~~~~~~~~~~~~~~~~~~~~~~~^^ 8450s ssl.SSLCertVerificationError: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: Basic Constraints of CA cert not marked critical (_ssl.c:1020) 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 561, in connect 8450s raise FatalCommClosedError( 8450s ...<2 lines>... 8450s ) from err 8450s distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 8450s 8450s During handling of the above exception, another exception occurred: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1218, in _register_with_scheduler 8450s await asyncio.sleep(0.1) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 718, in sleep 8450s return await future 8450s ^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 13s. 8450s 2024-11-23 22:51:47,945 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:51:47,952 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36237 8450s 2024-11-23 22:51:47,952 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34771/status 8450s 2024-11-23 22:51:47,952 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:51:47,965 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39417 8450s 2024-11-23 22:51:47,965 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39417 8450s 2024-11-23 22:51:47,965 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:51:47,965 - distributed.worker - INFO - dashboard at: 127.0.0.1:34037 8450s 2024-11-23 22:51:47,965 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36237 8450s 2024-11-23 22:51:47,965 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:51:47,965 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:51:47,965 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:51:47,965 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-nnarjh4e 8450s 2024-11-23 22:51:47,966 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:51:47,967 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35613 8450s 2024-11-23 22:51:47,967 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35613 8450s 2024-11-23 22:51:47,967 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:51:47,967 - distributed.worker - INFO - dashboard at: 127.0.0.1:45689 8450s 2024-11-23 22:51:47,967 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36237 8450s 2024-11-23 22:51:47,967 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:51:47,967 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:51:47,967 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:51:47,967 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-cyfkyzh4 8450s 2024-11-23 22:51:47,968 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:51:47,968 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39417. Reason: failure-to-start- 8450s 2024-11-23 22:51:47,968 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:51:47,969 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35613. Reason: failure-to-start- 8450s 2024-11-23 22:51:47,969 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:51:47,970 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36237': TLS handshake failed with remote 'tls://127.0.0.1:47742': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:51:47,970 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36237': TLS handshake failed with remote 'tls://127.0.0.1:47746': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:51:47,971 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:51:48,976 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:51:48,983 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39715 8450s 2024-11-23 22:51:48,983 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44515/status 8450s 2024-11-23 22:51:48,984 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:51:48,997 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35309 8450s 2024-11-23 22:51:48,997 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35309 8450s 2024-11-23 22:51:48,997 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:51:48,997 - distributed.worker - INFO - dashboard at: 127.0.0.1:39113 8450s 2024-11-23 22:51:48,997 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39715 8450s 2024-11-23 22:51:48,997 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:51:48,998 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:51:48,998 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:51:48,998 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-enbt8bub 8450s 2024-11-23 22:51:48,998 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:51:48,999 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43563 8450s 2024-11-23 22:51:48,999 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43563 8450s 2024-11-23 22:51:48,999 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:51:48,999 - distributed.worker - INFO - dashboard at: 127.0.0.1:34395 8450s 2024-11-23 22:51:48,999 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39715 8450s 2024-11-23 22:51:48,999 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:51:49,000 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:51:49,000 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:51:49,000 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-r39i2xe0 8450s 2024-11-23 22:51:49,000 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:51:49,001 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35309. Reason: failure-to-start- 8450s 2024-11-23 22:51:49,001 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:51:49,001 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43563. Reason: failure-to-start- 8450s 2024-11-23 22:51:49,001 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:51:49,002 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39715': TLS handshake failed with remote 'tls://127.0.0.1:35696': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:51:49,002 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39715': TLS handshake failed with remote 'tls://127.0.0.1:35704': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:51:49,003 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:51:50,009 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:51:50,017 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35467 8450s 2024-11-23 22:51:50,017 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41869/status 8450s 2024-11-23 22:51:50,017 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:51:50,030 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38521 8450s 2024-11-23 22:51:50,030 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38521 8450s 2024-11-23 22:51:50,030 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:51:50,030 - distributed.worker - INFO - dashboard at: 127.0.0.1:36215 8450s 2024-11-23 22:51:50,030 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35467 8450s 2024-11-23 22:51:50,030 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:51:50,030 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:51:50,030 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:51:50,030 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-glhl73i1 8450s 2024-11-23 22:51:50,030 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:51:50,032 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44203 8450s 2024-11-23 22:51:50,032 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44203 8450s 2024-11-23 22:51:50,032 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:51:50,032 - distributed.worker - INFO - dashboard at: 127.0.0.1:41953 8450s 2024-11-23 22:51:50,032 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35467 8450s 2024-11-23 22:51:50,032 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:51:50,032 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:51:50,033 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:51:50,033 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-417qmwhw 8450s 2024-11-23 22:51:50,033 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:51:50,033 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38521. Reason: failure-to-start- 8450s 2024-11-23 22:51:50,033 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:51:50,034 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44203. Reason: failure-to-start- 8450s 2024-11-23 22:51:50,034 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:51:50,035 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35467': TLS handshake failed with remote 'tls://127.0.0.1:59682': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:51:50,035 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35467': TLS handshake failed with remote 'tls://127.0.0.1:59688': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:51:50,036 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:51:51,042 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:51:51,048 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36389 8450s 2024-11-23 22:51:51,049 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45315/status 8450s 2024-11-23 22:51:51,049 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:51:51,061 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43691 8450s 2024-11-23 22:51:51,061 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43691 8450s 2024-11-23 22:51:51,061 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:51:51,061 - distributed.worker - INFO - dashboard at: 127.0.0.1:35725 8450s 2024-11-23 22:51:51,061 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36389 8450s 2024-11-23 22:51:51,061 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:51:51,061 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:51:51,061 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:51:51,061 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-fsxvdje7 8450s 2024-11-23 22:51:51,061 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:51:51,063 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34141 8450s 2024-11-23 22:51:51,063 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34141 8450s 2024-11-23 22:51:51,063 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:51:51,063 - distributed.worker - INFO - dashboard at: 127.0.0.1:40165 8450s 2024-11-23 22:51:51,063 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36389 8450s 2024-11-23 22:51:51,063 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:51:51,063 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:51:51,063 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:51:51,063 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-dm2w_6ld 8450s 2024-11-23 22:51:51,063 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:51:51,064 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43691. Reason: failure-to-start- 8450s 2024-11-23 22:51:51,064 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:51:51,064 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34141. Reason: failure-to-start- 8450s 2024-11-23 22:51:51,064 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:51:51,065 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36389': TLS handshake failed with remote 'tls://127.0.0.1:38906': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:51:51,065 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36389': TLS handshake failed with remote 'tls://127.0.0.1:38910': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:51:51,067 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:51:52,072 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:51:52,079 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39223 8450s 2024-11-23 22:51:52,079 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42835/status 8450s 2024-11-23 22:51:52,080 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:51:52,093 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38843 8450s 2024-11-23 22:51:52,093 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38843 8450s 2024-11-23 22:51:52,093 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:51:52,093 - distributed.worker - INFO - dashboard at: 127.0.0.1:33799 8450s 2024-11-23 22:51:52,093 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39223 8450s 2024-11-23 22:51:52,093 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:51:52,093 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:51:52,093 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:51:52,093 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-cz5r4fum 8450s 2024-11-23 22:51:52,093 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:51:52,095 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39437 8450s 2024-11-23 22:51:52,095 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39437 8450s 2024-11-23 22:51:52,095 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:51:52,095 - distributed.worker - INFO - dashboard at: 127.0.0.1:34475 8450s 2024-11-23 22:51:52,095 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39223 8450s 2024-11-23 22:51:52,095 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:51:52,095 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:51:52,095 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:51:52,095 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-verfuk1h 8450s 2024-11-23 22:51:52,095 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:51:52,096 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38843. Reason: failure-to-start- 8450s 2024-11-23 22:51:52,096 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:51:52,096 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39437. Reason: failure-to-start- 8450s 2024-11-23 22:51:52,096 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:51:52,097 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39223': TLS handshake failed with remote 'tls://127.0.0.1:44998': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:51:52,097 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39223': TLS handshake failed with remote 'tls://127.0.0.1:45004': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:51:52,099 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:51:53,103 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:51:53,113 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42253 8450s 2024-11-23 22:51:53,113 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35975/status 8450s 2024-11-23 22:51:53,113 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:51:53,127 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34099 8450s 2024-11-23 22:51:53,128 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34099 8450s 2024-11-23 22:51:53,128 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:51:53,128 - distributed.worker - INFO - dashboard at: 127.0.0.1:36519 8450s 2024-11-23 22:51:53,128 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42253 8450s 2024-11-23 22:51:53,128 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:51:53,128 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:51:53,128 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:51:53,128 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-q_phn9ru 8450s 2024-11-23 22:51:53,128 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:51:53,130 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40113 8450s 2024-11-23 22:51:53,130 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40113 8450s 2024-11-23 22:51:53,130 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:51:53,130 - distributed.worker - INFO - dashboard at: 127.0.0.1:33957 8450s 2024-11-23 22:51:53,130 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42253 8450s 2024-11-23 22:51:53,130 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:51:53,130 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:51:53,130 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:51:53,130 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-c6j6ivuf 8450s 2024-11-23 22:51:53,130 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:51:53,131 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34099. Reason: failure-to-start- 8450s 2024-11-23 22:51:53,131 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:51:53,132 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40113. Reason: failure-to-start- 8450s 2024-11-23 22:51:53,132 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:51:53,133 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42253': TLS handshake failed with remote 'tls://127.0.0.1:39552': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:51:53,133 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42253': TLS handshake failed with remote 'tls://127.0.0.1:39560': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:51:53,134 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:51:54,140 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:51:54,146 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36589 8450s 2024-11-23 22:51:54,146 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39487/status 8450s 2024-11-23 22:51:54,147 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:51:54,159 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40761 8450s 2024-11-23 22:51:54,159 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40761 8450s 2024-11-23 22:51:54,159 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:51:54,159 - distributed.worker - INFO - dashboard at: 127.0.0.1:46621 8450s 2024-11-23 22:51:54,159 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36589 8450s 2024-11-23 22:51:54,159 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:51:54,159 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:51:54,160 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:51:54,160 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-pq2uj13x 8450s 2024-11-23 22:51:54,160 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:51:54,165 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36401 8450s 2024-11-23 22:51:54,165 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36401 8450s 2024-11-23 22:51:54,165 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:51:54,165 - distributed.worker - INFO - dashboard at: 127.0.0.1:44917 8450s 2024-11-23 22:51:54,165 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36589 8450s 2024-11-23 22:51:54,165 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:51:54,165 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:51:54,165 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:51:54,165 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-b6g78jrw 8450s 2024-11-23 22:51:54,165 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:51:54,166 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40761. Reason: failure-to-start- 8450s 2024-11-23 22:51:54,166 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:51:54,167 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36401. Reason: failure-to-start- 8450s 2024-11-23 22:51:54,167 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:51:54,168 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36589': TLS handshake failed with remote 'tls://127.0.0.1:57024': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:51:54,168 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36589': TLS handshake failed with remote 'tls://127.0.0.1:57032': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:51:54,169 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:51:55,175 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:51:55,182 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39087 8450s 2024-11-23 22:51:55,182 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37813/status 8450s 2024-11-23 22:51:55,182 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:51:55,194 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37919 8450s 2024-11-23 22:51:55,194 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37919 8450s 2024-11-23 22:51:55,194 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:51:55,194 - distributed.worker - INFO - dashboard at: 127.0.0.1:46345 8450s 2024-11-23 22:51:55,194 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39087 8450s 2024-11-23 22:51:55,194 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:51:55,194 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:51:55,194 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:51:55,194 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-rxr58vtx 8450s 2024-11-23 22:51:55,194 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:51:55,196 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39597 8450s 2024-11-23 22:51:55,196 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39597 8450s 2024-11-23 22:51:55,196 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:51:55,196 - distributed.worker - INFO - dashboard at: 127.0.0.1:34997 8450s 2024-11-23 22:51:55,196 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39087 8450s 2024-11-23 22:51:55,196 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:51:55,196 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:51:55,196 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:51:55,196 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-qao4brfd 8450s 2024-11-23 22:51:55,196 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:51:55,197 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37919. Reason: failure-to-start- 8450s 2024-11-23 22:51:55,197 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:51:55,198 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39597. Reason: failure-to-start- 8450s 2024-11-23 22:51:55,198 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:51:55,199 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39087': TLS handshake failed with remote 'tls://127.0.0.1:41480': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:51:55,199 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39087': TLS handshake failed with remote 'tls://127.0.0.1:41486': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:51:55,200 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:51:56,208 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:51:56,218 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34349 8450s 2024-11-23 22:51:56,218 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44249/status 8450s 2024-11-23 22:51:56,219 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:51:56,231 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42319 8450s 2024-11-23 22:51:56,231 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42319 8450s 2024-11-23 22:51:56,231 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:51:56,231 - distributed.worker - INFO - dashboard at: 127.0.0.1:41389 8450s 2024-11-23 22:51:56,231 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34349 8450s 2024-11-23 22:51:56,231 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:51:56,231 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:51:56,231 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:51:56,231 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-gvk6b874 8450s 2024-11-23 22:51:56,231 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:51:56,233 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35245 8450s 2024-11-23 22:51:56,233 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35245 8450s 2024-11-23 22:51:56,233 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:51:56,233 - distributed.worker - INFO - dashboard at: 127.0.0.1:33877 8450s 2024-11-23 22:51:56,233 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34349 8450s 2024-11-23 22:51:56,233 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:51:56,233 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:51:56,233 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:51:56,233 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-simhqnra 8450s 2024-11-23 22:51:56,233 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:51:56,234 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42319. Reason: failure-to-start- 8450s 2024-11-23 22:51:56,234 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:51:56,234 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35245. Reason: failure-to-start- 8450s 2024-11-23 22:51:56,235 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:51:56,236 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34349': TLS handshake failed with remote 'tls://127.0.0.1:52234': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:51:56,236 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34349': TLS handshake failed with remote 'tls://127.0.0.1:52242': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:51:56,237 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:51:57,241 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:51:57,248 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35997 8450s 2024-11-23 22:51:57,248 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44787/status 8450s 2024-11-23 22:51:57,248 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:51:57,263 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41795 8450s 2024-11-23 22:51:57,263 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41795 8450s 2024-11-23 22:51:57,263 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:51:57,263 - distributed.worker - INFO - dashboard at: 127.0.0.1:44577 8450s 2024-11-23 22:51:57,263 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35997 8450s 2024-11-23 22:51:57,263 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:51:57,263 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:51:57,263 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:51:57,263 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-c2pjwf12 8450s 2024-11-23 22:51:57,263 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:51:57,265 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35777 8450s 2024-11-23 22:51:57,265 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35777 8450s 2024-11-23 22:51:57,265 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:51:57,265 - distributed.worker - INFO - dashboard at: 127.0.0.1:42819 8450s 2024-11-23 22:51:57,265 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35997 8450s 2024-11-23 22:51:57,265 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:51:57,265 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:51:57,265 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:51:57,265 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-_fcwnldi 8450s 2024-11-23 22:51:57,265 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:51:57,266 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41795. Reason: failure-to-start- 8450s 2024-11-23 22:51:57,266 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:51:57,266 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35777. Reason: failure-to-start- 8450s 2024-11-23 22:51:57,266 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:51:57,268 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35997': TLS handshake failed with remote 'tls://127.0.0.1:43300': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:51:57,268 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35997': TLS handshake failed with remote 'tls://127.0.0.1:43316': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:51:57,269 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:51:58,274 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:51:58,280 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42237 8450s 2024-11-23 22:51:58,280 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38521/status 8450s 2024-11-23 22:51:58,281 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:51:58,292 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:32829 8450s 2024-11-23 22:51:58,293 - distributed.worker - INFO - Listening to: tls://127.0.0.1:32829 8450s 2024-11-23 22:51:58,293 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:51:58,293 - distributed.worker - INFO - dashboard at: 127.0.0.1:41587 8450s 2024-11-23 22:51:58,293 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42237 8450s 2024-11-23 22:51:58,293 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:51:58,293 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:51:58,293 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:51:58,293 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-phnemzyc 8450s 2024-11-23 22:51:58,293 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:51:58,294 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33041 8450s 2024-11-23 22:51:58,295 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33041 8450s 2024-11-23 22:51:58,295 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:51:58,295 - distributed.worker - INFO - dashboard at: 127.0.0.1:42755 8450s 2024-11-23 22:51:58,295 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42237 8450s 2024-11-23 22:51:58,295 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:51:58,295 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:51:58,295 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:51:58,295 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-7vn5iaxp 8450s 2024-11-23 22:51:58,295 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:51:58,296 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:32829. Reason: failure-to-start- 8450s 2024-11-23 22:51:58,297 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:51:58,297 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33041. Reason: failure-to-start- 8450s 2024-11-23 22:51:58,297 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:51:58,298 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42237': TLS handshake failed with remote 'tls://127.0.0.1:39752': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:51:58,298 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42237': TLS handshake failed with remote 'tls://127.0.0.1:39762': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:51:58,299 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:51:59,304 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:51:59,311 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45689 8450s 2024-11-23 22:51:59,311 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43603/status 8450s 2024-11-23 22:51:59,311 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:51:59,325 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40855 8450s 2024-11-23 22:51:59,325 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40855 8450s 2024-11-23 22:51:59,325 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:51:59,325 - distributed.worker - INFO - dashboard at: 127.0.0.1:46033 8450s 2024-11-23 22:51:59,325 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45689 8450s 2024-11-23 22:51:59,325 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:51:59,325 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:51:59,325 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:51:59,325 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-o7dlszci 8450s 2024-11-23 22:51:59,325 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:51:59,327 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44871 8450s 2024-11-23 22:51:59,327 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44871 8450s 2024-11-23 22:51:59,327 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:51:59,327 - distributed.worker - INFO - dashboard at: 127.0.0.1:37241 8450s 2024-11-23 22:51:59,327 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45689 8450s 2024-11-23 22:51:59,327 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:51:59,327 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:51:59,327 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:51:59,327 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-n9u7z420 8450s 2024-11-23 22:51:59,327 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:51:59,328 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40855. Reason: failure-to-start- 8450s 2024-11-23 22:51:59,328 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:51:59,329 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44871. Reason: failure-to-start- 8450s 2024-11-23 22:51:59,329 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:51:59,330 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45689': TLS handshake failed with remote 'tls://127.0.0.1:41658': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:51:59,330 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45689': TLS handshake failed with remote 'tls://127.0.0.1:41672': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:51:59,331 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:52:00,336 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:52:00,344 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35789 8450s 2024-11-23 22:52:00,344 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36595/status 8450s 2024-11-23 22:52:00,345 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:52:00,358 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34301 8450s 2024-11-23 22:52:00,358 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34301 8450s 2024-11-23 22:52:00,358 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:52:00,358 - distributed.worker - INFO - dashboard at: 127.0.0.1:42129 8450s 2024-11-23 22:52:00,358 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35789 8450s 2024-11-23 22:52:00,358 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:52:00,358 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:52:00,359 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:52:00,359 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-51a7s0zy 8450s 2024-11-23 22:52:00,359 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:52:00,360 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34593 8450s 2024-11-23 22:52:00,360 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34593 8450s 2024-11-23 22:52:00,360 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:52:00,360 - distributed.worker - INFO - dashboard at: 127.0.0.1:41815 8450s 2024-11-23 22:52:00,360 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35789 8450s 2024-11-23 22:52:00,361 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:52:00,361 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:52:00,361 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:52:00,361 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-4ugf71xg 8450s 2024-11-23 22:52:00,361 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:52:00,362 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34301. Reason: failure-to-start- 8450s 2024-11-23 22:52:00,362 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:52:00,362 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34593. Reason: failure-to-start- 8450s 2024-11-23 22:52:00,362 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:52:00,363 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35789': TLS handshake failed with remote 'tls://127.0.0.1:44708': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:52:00,363 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35789': TLS handshake failed with remote 'tls://127.0.0.1:44714': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:52:00,364 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:52:01,370 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:52:01,376 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35737 8450s 2024-11-23 22:52:01,377 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46043/status 8450s 2024-11-23 22:52:01,377 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:52:01,391 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40193 8450s 2024-11-23 22:52:01,391 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40193 8450s 2024-11-23 22:52:01,391 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:52:01,391 - distributed.worker - INFO - dashboard at: 127.0.0.1:37869 8450s 2024-11-23 22:52:01,391 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35737 8450s 2024-11-23 22:52:01,391 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:52:01,391 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:52:01,391 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:52:01,391 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ji1p7k4u 8450s 2024-11-23 22:52:01,391 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:52:01,393 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44577 8450s 2024-11-23 22:52:01,393 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44577 8450s 2024-11-23 22:52:01,393 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:52:01,393 - distributed.worker - INFO - dashboard at: 127.0.0.1:45767 8450s 2024-11-23 22:52:01,393 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:35737 8450s 2024-11-23 22:52:01,393 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:52:01,393 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:52:01,393 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:52:01,393 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-dm7tisjb 8450s 2024-11-23 22:52:01,393 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:52:01,396 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40193. Reason: failure-to-start- 8450s 2024-11-23 22:52:01,396 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:52:01,397 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44577. Reason: failure-to-start- 8450s 2024-11-23 22:52:01,397 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:52:01,398 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35737': TLS handshake failed with remote 'tls://127.0.0.1:41730': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:52:01,398 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35737': TLS handshake failed with remote 'tls://127.0.0.1:41742': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:52:01,399 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:52:02,405 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:52:02,412 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42345 8450s 2024-11-23 22:52:02,412 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39525/status 8450s 2024-11-23 22:52:02,413 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:52:02,426 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41353 8450s 2024-11-23 22:52:02,427 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41353 8450s 2024-11-23 22:52:02,427 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:52:02,427 - distributed.worker - INFO - dashboard at: 127.0.0.1:45895 8450s 2024-11-23 22:52:02,427 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42345 8450s 2024-11-23 22:52:02,427 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:52:02,427 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:52:02,427 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:52:02,427 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-p4ht26ec 8450s 2024-11-23 22:52:02,427 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:52:02,429 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:44995 8450s 2024-11-23 22:52:02,430 - distributed.worker - INFO - Listening to: tls://127.0.0.1:44995 8450s 2024-11-23 22:52:02,430 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:52:02,430 - distributed.worker - INFO - dashboard at: 127.0.0.1:42817 8450s 2024-11-23 22:52:02,430 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42345 8450s 2024-11-23 22:52:02,430 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:52:02,430 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:52:02,430 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:52:02,430 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-m7byy1wk 8450s 2024-11-23 22:52:02,430 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:52:02,433 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41353. Reason: failure-to-start- 8450s 2024-11-23 22:52:02,433 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:52:02,433 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:44995. Reason: failure-to-start- 8450s 2024-11-23 22:52:02,434 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:52:02,435 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42345': TLS handshake failed with remote 'tls://127.0.0.1:46970': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:52:02,435 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42345': TLS handshake failed with remote 'tls://127.0.0.1:46976': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:52:02,436 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:52:03,441 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:52:03,448 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44601 8450s 2024-11-23 22:52:03,449 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45187/status 8450s 2024-11-23 22:52:03,449 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:52:03,462 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45889 8450s 2024-11-23 22:52:03,462 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45889 8450s 2024-11-23 22:52:03,462 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:52:03,462 - distributed.worker - INFO - dashboard at: 127.0.0.1:39309 8450s 2024-11-23 22:52:03,462 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44601 8450s 2024-11-23 22:52:03,462 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:52:03,462 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:52:03,463 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:52:03,463 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-11ncv04j 8450s 2024-11-23 22:52:03,463 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:52:03,464 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38431 8450s 2024-11-23 22:52:03,464 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38431 8450s 2024-11-23 22:52:03,465 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:52:03,465 - distributed.worker - INFO - dashboard at: 127.0.0.1:41739 8450s 2024-11-23 22:52:03,465 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:44601 8450s 2024-11-23 22:52:03,465 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:52:03,465 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:52:03,465 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:52:03,465 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-d56xcaut 8450s 2024-11-23 22:52:03,465 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:52:03,468 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45889. Reason: failure-to-start- 8450s 2024-11-23 22:52:03,468 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:52:03,469 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38431. Reason: failure-to-start- 8450s 2024-11-23 22:52:03,469 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:52:03,470 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44601': TLS handshake failed with remote 'tls://127.0.0.1:46692': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:52:03,470 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44601': TLS handshake failed with remote 'tls://127.0.0.1:46704': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:52:03,471 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:52:04,477 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:52:04,484 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36557 8450s 2024-11-23 22:52:04,484 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39719/status 8450s 2024-11-23 22:52:04,484 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:52:04,498 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46403 8450s 2024-11-23 22:52:04,498 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46403 8450s 2024-11-23 22:52:04,498 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:52:04,498 - distributed.worker - INFO - dashboard at: 127.0.0.1:40505 8450s 2024-11-23 22:52:04,498 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36557 8450s 2024-11-23 22:52:04,498 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:52:04,498 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:52:04,498 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:52:04,498 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-yjdrb83s 8450s 2024-11-23 22:52:04,498 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:52:04,500 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41071 8450s 2024-11-23 22:52:04,500 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41071 8450s 2024-11-23 22:52:04,500 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:52:04,500 - distributed.worker - INFO - dashboard at: 127.0.0.1:37473 8450s 2024-11-23 22:52:04,500 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36557 8450s 2024-11-23 22:52:04,501 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:52:04,501 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:52:04,501 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:52:04,501 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-h33fkuo4 8450s 2024-11-23 22:52:04,501 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:52:04,504 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46403. Reason: failure-to-start- 8450s 2024-11-23 22:52:04,504 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:52:04,504 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41071. Reason: failure-to-start- 8450s 2024-11-23 22:52:04,504 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:52:04,506 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36557': TLS handshake failed with remote 'tls://127.0.0.1:50272': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:52:04,506 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36557': TLS handshake failed with remote 'tls://127.0.0.1:50274': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:52:04,507 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:52:05,512 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:52:05,519 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36989 8450s 2024-11-23 22:52:05,520 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43975/status 8450s 2024-11-23 22:52:05,520 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:52:05,538 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37797 8450s 2024-11-23 22:52:05,538 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37797 8450s 2024-11-23 22:52:05,538 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:52:05,538 - distributed.worker - INFO - dashboard at: 127.0.0.1:39013 8450s 2024-11-23 22:52:05,538 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36989 8450s 2024-11-23 22:52:05,538 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:52:05,538 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:52:05,538 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:52:05,539 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-jtdj7iw7 8450s 2024-11-23 22:52:05,539 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:52:05,540 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38381 8450s 2024-11-23 22:52:05,540 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38381 8450s 2024-11-23 22:52:05,540 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:52:05,540 - distributed.worker - INFO - dashboard at: 127.0.0.1:40427 8450s 2024-11-23 22:52:05,541 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36989 8450s 2024-11-23 22:52:05,541 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:52:05,541 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:52:05,541 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:52:05,541 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-tkaon0bw 8450s 2024-11-23 22:52:05,541 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:52:05,542 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37797. Reason: failure-to-start- 8450s 2024-11-23 22:52:05,542 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:52:05,542 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38381. Reason: failure-to-start- 8450s 2024-11-23 22:52:05,542 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:52:05,543 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36989': TLS handshake failed with remote 'tls://127.0.0.1:49112': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:52:05,544 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36989': TLS handshake failed with remote 'tls://127.0.0.1:49124': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:52:05,545 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:52:06,550 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:52:06,557 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46573 8450s 2024-11-23 22:52:06,557 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40317/status 8450s 2024-11-23 22:52:06,558 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:52:06,583 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33365 8450s 2024-11-23 22:52:06,583 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33365 8450s 2024-11-23 22:52:06,583 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:52:06,583 - distributed.worker - INFO - dashboard at: 127.0.0.1:33235 8450s 2024-11-23 22:52:06,583 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46573 8450s 2024-11-23 22:52:06,583 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:52:06,584 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:52:06,584 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:52:06,584 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-sk6o77_k 8450s 2024-11-23 22:52:06,584 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:52:06,587 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36545 8450s 2024-11-23 22:52:06,587 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36545 8450s 2024-11-23 22:52:06,587 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:52:06,587 - distributed.worker - INFO - dashboard at: 127.0.0.1:39165 8450s 2024-11-23 22:52:06,587 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:46573 8450s 2024-11-23 22:52:06,587 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:52:06,587 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:52:06,587 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:52:06,587 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-yimhchaq 8450s 2024-11-23 22:52:06,587 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:52:06,590 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33365. Reason: failure-to-start- 8450s 2024-11-23 22:52:06,591 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:52:06,591 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36545. Reason: failure-to-start- 8450s 2024-11-23 22:52:06,591 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:52:06,592 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46573': TLS handshake failed with remote 'tls://127.0.0.1:56478': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:52:06,592 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46573': TLS handshake failed with remote 'tls://127.0.0.1:56494': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:52:06,594 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:52:07,598 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:52:07,605 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37081 8450s 2024-11-23 22:52:07,606 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43415/status 8450s 2024-11-23 22:52:07,606 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:52:07,619 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40113 8450s 2024-11-23 22:52:07,620 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40113 8450s 2024-11-23 22:52:07,620 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:52:07,620 - distributed.worker - INFO - dashboard at: 127.0.0.1:42119 8450s 2024-11-23 22:52:07,620 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37081 8450s 2024-11-23 22:52:07,620 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:52:07,620 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:52:07,620 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:52:07,620 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-t7wyf9t6 8450s 2024-11-23 22:52:07,620 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:52:07,622 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40795 8450s 2024-11-23 22:52:07,622 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40795 8450s 2024-11-23 22:52:07,622 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:52:07,622 - distributed.worker - INFO - dashboard at: 127.0.0.1:36471 8450s 2024-11-23 22:52:07,622 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37081 8450s 2024-11-23 22:52:07,622 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:52:07,622 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:52:07,622 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:52:07,622 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-4lab553h 8450s 2024-11-23 22:52:07,622 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:52:07,626 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40113. Reason: failure-to-start- 8450s 2024-11-23 22:52:07,627 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:52:07,627 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40795. Reason: failure-to-start- 8450s 2024-11-23 22:52:07,627 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:52:07,628 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37081': TLS handshake failed with remote 'tls://127.0.0.1:52358': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:52:07,628 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37081': TLS handshake failed with remote 'tls://127.0.0.1:52364': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:52:07,630 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:52:08,634 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:52:08,641 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33805 8450s 2024-11-23 22:52:08,641 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43245/status 8450s 2024-11-23 22:52:08,642 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:52:08,656 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:33495 8450s 2024-11-23 22:52:08,656 - distributed.worker - INFO - Listening to: tls://127.0.0.1:33495 8450s 2024-11-23 22:52:08,656 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:52:08,656 - distributed.worker - INFO - dashboard at: 127.0.0.1:41717 8450s 2024-11-23 22:52:08,656 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33805 8450s 2024-11-23 22:52:08,656 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:52:08,656 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:52:08,656 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:52:08,656 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-69mdb0_a 8450s 2024-11-23 22:52:08,656 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:52:08,658 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35033 8450s 2024-11-23 22:52:08,658 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35033 8450s 2024-11-23 22:52:08,658 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:52:08,658 - distributed.worker - INFO - dashboard at: 127.0.0.1:45929 8450s 2024-11-23 22:52:08,658 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33805 8450s 2024-11-23 22:52:08,658 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:52:08,659 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:52:08,659 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:52:08,659 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-f6sw6w93 8450s 2024-11-23 22:52:08,659 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:52:08,662 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:33495. Reason: failure-to-start- 8450s 2024-11-23 22:52:08,663 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:52:08,663 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35033. Reason: failure-to-start- 8450s 2024-11-23 22:52:08,663 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:52:08,664 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33805': TLS handshake failed with remote 'tls://127.0.0.1:35316': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:52:08,664 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33805': TLS handshake failed with remote 'tls://127.0.0.1:35322': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:52:08,666 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:52:09,671 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:52:09,679 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39699 8450s 2024-11-23 22:52:09,679 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38549/status 8450s 2024-11-23 22:52:09,680 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:52:09,694 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39539 8450s 2024-11-23 22:52:09,694 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39539 8450s 2024-11-23 22:52:09,694 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:52:09,694 - distributed.worker - INFO - dashboard at: 127.0.0.1:34341 8450s 2024-11-23 22:52:09,694 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39699 8450s 2024-11-23 22:52:09,694 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:52:09,694 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:52:09,694 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:52:09,694 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-d5x2msi4 8450s 2024-11-23 22:52:09,694 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:52:09,696 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40441 8450s 2024-11-23 22:52:09,696 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40441 8450s 2024-11-23 22:52:09,696 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:52:09,696 - distributed.worker - INFO - dashboard at: 127.0.0.1:38655 8450s 2024-11-23 22:52:09,696 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:39699 8450s 2024-11-23 22:52:09,697 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:52:09,697 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:52:09,697 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:52:09,697 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-4fhnt69m 8450s 2024-11-23 22:52:09,697 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:52:09,700 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39539. Reason: failure-to-start- 8450s 2024-11-23 22:52:09,700 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:52:09,701 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40441. Reason: failure-to-start- 8450s 2024-11-23 22:52:09,701 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:52:09,702 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39699': TLS handshake failed with remote 'tls://127.0.0.1:33052': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:52:09,702 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39699': TLS handshake failed with remote 'tls://127.0.0.1:33060': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:52:09,703 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:52:10,709 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:52:10,716 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45011 8450s 2024-11-23 22:52:10,716 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33981/status 8450s 2024-11-23 22:52:10,716 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:52:10,741 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46775 8450s 2024-11-23 22:52:10,741 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46775 8450s 2024-11-23 22:52:10,741 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:52:10,741 - distributed.worker - INFO - dashboard at: 127.0.0.1:38755 8450s 2024-11-23 22:52:10,741 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45011 8450s 2024-11-23 22:52:10,741 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:52:10,741 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:52:10,741 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:52:10,741 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-q1r7t5ml 8450s 2024-11-23 22:52:10,741 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:52:10,743 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43645 8450s 2024-11-23 22:52:10,743 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43645 8450s 2024-11-23 22:52:10,743 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:52:10,743 - distributed.worker - INFO - dashboard at: 127.0.0.1:39379 8450s 2024-11-23 22:52:10,743 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45011 8450s 2024-11-23 22:52:10,743 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:52:10,744 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:52:10,744 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:52:10,744 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-f74j25u8 8450s 2024-11-23 22:52:10,744 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:52:10,747 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46775. Reason: failure-to-start- 8450s 2024-11-23 22:52:10,747 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:52:10,748 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43645. Reason: failure-to-start- 8450s 2024-11-23 22:52:10,748 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:52:10,749 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45011': TLS handshake failed with remote 'tls://127.0.0.1:33674': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:52:10,749 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45011': TLS handshake failed with remote 'tls://127.0.0.1:33680': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:52:10,753 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:52:11,759 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:52:11,765 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36895 8450s 2024-11-23 22:52:11,766 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33425/status 8450s 2024-11-23 22:52:11,766 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:52:11,781 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45729 8450s 2024-11-23 22:52:11,781 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45729 8450s 2024-11-23 22:52:11,781 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:52:11,781 - distributed.worker - INFO - dashboard at: 127.0.0.1:33223 8450s 2024-11-23 22:52:11,781 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 8450s 2024-11-23 22:52:11,781 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:52:11,781 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:52:11,781 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:52:11,781 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-698159pt 8450s 2024-11-23 22:52:11,781 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:52:11,783 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43935 8450s 2024-11-23 22:52:11,783 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43935 8450s 2024-11-23 22:52:11,783 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:52:11,783 - distributed.worker - INFO - dashboard at: 127.0.0.1:37099 8450s 2024-11-23 22:52:11,783 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:36895 8450s 2024-11-23 22:52:11,783 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:52:11,783 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:52:11,783 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:52:11,783 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-wq4z4uod 8450s 2024-11-23 22:52:11,783 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:52:11,786 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45729. Reason: failure-to-start- 8450s 2024-11-23 22:52:11,786 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:52:11,786 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43935. Reason: failure-to-start- 8450s 2024-11-23 22:52:11,786 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:52:11,790 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:39710': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:52:11,790 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36895': TLS handshake failed with remote 'tls://127.0.0.1:39716': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:52:11,791 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:52:12,796 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:52:12,807 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45405 8450s 2024-11-23 22:52:12,807 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39295/status 8450s 2024-11-23 22:52:12,808 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:52:12,822 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41043 8450s 2024-11-23 22:52:12,823 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41043 8450s 2024-11-23 22:52:12,823 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:52:12,823 - distributed.worker - INFO - dashboard at: 127.0.0.1:45165 8450s 2024-11-23 22:52:12,823 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45405 8450s 2024-11-23 22:52:12,823 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:52:12,823 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:52:12,823 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:52:12,823 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-vfoloe3z 8450s 2024-11-23 22:52:12,823 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:52:12,825 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38241 8450s 2024-11-23 22:52:12,825 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38241 8450s 2024-11-23 22:52:12,825 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:52:12,825 - distributed.worker - INFO - dashboard at: 127.0.0.1:35649 8450s 2024-11-23 22:52:12,825 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:45405 8450s 2024-11-23 22:52:12,825 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:52:12,825 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:52:12,825 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:52:12,825 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-26991gfc 8450s 2024-11-23 22:52:12,825 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:52:12,829 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41043. Reason: failure-to-start- 8450s 2024-11-23 22:52:12,829 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:52:12,830 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38241. Reason: failure-to-start- 8450s 2024-11-23 22:52:12,830 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:52:12,831 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45405': TLS handshake failed with remote 'tls://127.0.0.1:40488': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:52:12,831 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45405': TLS handshake failed with remote 'tls://127.0.0.1:40496': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:52:12,832 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:52:13,838 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:52:13,849 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41571 8450s 2024-11-23 22:52:13,849 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42753/status 8450s 2024-11-23 22:52:13,849 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:52:13,866 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37183 8450s 2024-11-23 22:52:13,866 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37183 8450s 2024-11-23 22:52:13,866 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:52:13,867 - distributed.worker - INFO - dashboard at: 127.0.0.1:35741 8450s 2024-11-23 22:52:13,867 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41571 8450s 2024-11-23 22:52:13,867 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:52:13,867 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:52:13,867 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:52:13,867 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-ngt_y525 8450s 2024-11-23 22:52:13,867 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:52:13,869 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46013 8450s 2024-11-23 22:52:13,869 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46013 8450s 2024-11-23 22:52:13,869 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:52:13,869 - distributed.worker - INFO - dashboard at: 127.0.0.1:33649 8450s 2024-11-23 22:52:13,869 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:41571 8450s 2024-11-23 22:52:13,869 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:52:13,869 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:52:13,869 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:52:13,869 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-7re0bq77 8450s 2024-11-23 22:52:13,869 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:52:13,870 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37183. Reason: failure-to-start- 8450s 2024-11-23 22:52:13,870 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:52:13,871 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46013. Reason: failure-to-start- 8450s 2024-11-23 22:52:13,871 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:52:13,872 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41571': TLS handshake failed with remote 'tls://127.0.0.1:41594': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:52:13,872 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41571': TLS handshake failed with remote 'tls://127.0.0.1:41600': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:52:13,873 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:52:14,880 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:52:14,887 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43695 8450s 2024-11-23 22:52:14,887 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33293/status 8450s 2024-11-23 22:52:14,890 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:52:14,907 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:40507 8450s 2024-11-23 22:52:14,907 - distributed.worker - INFO - Listening to: tls://127.0.0.1:40507 8450s 2024-11-23 22:52:14,907 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:52:14,907 - distributed.worker - INFO - dashboard at: 127.0.0.1:43545 8450s 2024-11-23 22:52:14,908 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43695 8450s 2024-11-23 22:52:14,908 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:52:14,908 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:52:14,908 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:52:14,908 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-j62c_3ko 8450s 2024-11-23 22:52:14,908 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:52:14,909 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:39617 8450s 2024-11-23 22:52:14,910 - distributed.worker - INFO - Listening to: tls://127.0.0.1:39617 8450s 2024-11-23 22:52:14,910 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:52:14,910 - distributed.worker - INFO - dashboard at: 127.0.0.1:40359 8450s 2024-11-23 22:52:14,910 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43695 8450s 2024-11-23 22:52:14,910 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:52:14,910 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:52:14,910 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:52:14,910 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-rjlhf524 8450s 2024-11-23 22:52:14,910 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:52:14,911 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:40507. Reason: failure-to-start- 8450s 2024-11-23 22:52:14,911 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:52:14,912 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:39617. Reason: failure-to-start- 8450s 2024-11-23 22:52:14,912 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:52:14,913 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43695': TLS handshake failed with remote 'tls://127.0.0.1:56926': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:52:14,913 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43695': TLS handshake failed with remote 'tls://127.0.0.1:56936': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:52:14,917 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:52:15,922 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:52:15,930 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42575 8450s 2024-11-23 22:52:15,931 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34193/status 8450s 2024-11-23 22:52:15,931 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:52:15,950 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35993 8450s 2024-11-23 22:52:15,950 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35993 8450s 2024-11-23 22:52:15,950 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:52:15,950 - distributed.worker - INFO - dashboard at: 127.0.0.1:40131 8450s 2024-11-23 22:52:15,950 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42575 8450s 2024-11-23 22:52:15,950 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:52:15,950 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:52:15,950 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:52:15,950 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-c8nlemfs 8450s 2024-11-23 22:52:15,950 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:52:15,952 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:35843 8450s 2024-11-23 22:52:15,952 - distributed.worker - INFO - Listening to: tls://127.0.0.1:35843 8450s 2024-11-23 22:52:15,952 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:52:15,952 - distributed.worker - INFO - dashboard at: 127.0.0.1:46039 8450s 2024-11-23 22:52:15,952 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42575 8450s 2024-11-23 22:52:15,952 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:52:15,952 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:52:15,952 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:52:15,952 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-sum08qhx 8450s 2024-11-23 22:52:15,953 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:52:15,955 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35993. Reason: failure-to-start- 8450s 2024-11-23 22:52:15,955 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:52:15,955 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:35843. Reason: failure-to-start- 8450s 2024-11-23 22:52:15,956 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:52:15,962 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42575': TLS handshake failed with remote 'tls://127.0.0.1:59980': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:52:15,962 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42575': TLS handshake failed with remote 'tls://127.0.0.1:59988': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:52:15,964 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s 2024-11-23 22:52:16,969 - distributed.scheduler - INFO - State start 8450s 2024-11-23 22:52:16,977 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37565 8450s 2024-11-23 22:52:16,977 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45771/status 8450s 2024-11-23 22:52:16,978 - distributed.scheduler - INFO - Registering Worker plugin shuffle 8450s 2024-11-23 22:52:16,992 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41633 8450s 2024-11-23 22:52:16,993 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41633 8450s 2024-11-23 22:52:16,993 - distributed.worker - INFO - Worker name: 0 8450s 2024-11-23 22:52:16,993 - distributed.worker - INFO - dashboard at: 127.0.0.1:43203 8450s 2024-11-23 22:52:16,993 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37565 8450s 2024-11-23 22:52:16,993 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:52:16,993 - distributed.worker - INFO - Threads: 1 8450s 2024-11-23 22:52:16,993 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:52:16,993 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-fzqy8c2u 8450s 2024-11-23 22:52:16,993 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:52:16,994 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37227 8450s 2024-11-23 22:52:16,995 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37227 8450s 2024-11-23 22:52:16,995 - distributed.worker - INFO - Worker name: 1 8450s 2024-11-23 22:52:16,995 - distributed.worker - INFO - dashboard at: 127.0.0.1:46137 8450s 2024-11-23 22:52:16,995 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37565 8450s 2024-11-23 22:52:16,995 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:52:16,995 - distributed.worker - INFO - Threads: 2 8450s 2024-11-23 22:52:16,995 - distributed.worker - INFO - Memory: 15.58 GiB 8450s 2024-11-23 22:52:16,995 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-n28l13wg 8450s 2024-11-23 22:52:16,995 - distributed.worker - INFO - ------------------------------------------------- 8450s 2024-11-23 22:52:17,001 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41633. Reason: failure-to-start- 8450s 2024-11-23 22:52:17,001 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:52:17,001 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37227. Reason: failure-to-start- 8450s 2024-11-23 22:52:17,001 - distributed.worker - INFO - Closed worker has not yet started: Status.init 8450s 2024-11-23 22:52:17,002 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37565': TLS handshake failed with remote 'tls://127.0.0.1:50336': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:52:17,002 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37565': TLS handshake failed with remote 'tls://127.0.0.1:50352': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1020) 8450s 2024-11-23 22:52:17,004 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Worker start timed out after 0s.; retrying 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1480, in start_unsafe 8450s await self._register_with_scheduler() 8450s File "/usr/lib/python3/dist-packages/distributed/worker.py", line 1179, in _register_with_scheduler 8450s comm = await connect(self.scheduler.address, **self.connection_args) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 8450s comm = await wait_for( 8450s ^^^^^^^^^^^^^^^ 8450s ...<2 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1960, in wait_for 8450s return await fut 8450s ^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 8450s stream = await self.client.connect( 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 8450s af, addr, stream = await connector.start(connect_timeout=timeout) 8450s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 8450s asyncio.exceptions.CancelledError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 664, in start 8450s await wait_for(self.start_unsafe(), timeout=timeout) 8450s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1959, in wait_for 8450s async with asyncio.timeout(timeout): 8450s ~~~~~~~~~~~~~~~^^^^^^^^^ 8450s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 8450s raise TimeoutError from exc_val 8450s TimeoutError 8450s 8450s The above exception was the direct cause of the following exception: 8450s 8450s Traceback (most recent call last): 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 966, in _cluster_factory 8450s s, ws = await start_cluster( 8450s ^^^^^^^^^^^^^^^^^^^^ 8450s ...<9 lines>... 8450s ) 8450s ^ 8450s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 789, in start_cluster 8450s await asyncio.gather(*workers) 8450s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 8450s return await awaitable 8450s ^^^^^^^^^^^^^^^ 8450s File "/usr/lib/python3/dist-packages/distributed/core.py", line 667, in start 8450s raise asyncio.TimeoutError( 8450s f"{type(self).__name__} start timed out after {timeout}s." 8450s ) from exc 8450s TimeoutError: Worker start timed out after 0s. 8450s ============================= slowest 20 durations ============================= 8450s 300.01s setup tests/test_utils_test.py::test_tls_cluster 8450s 60.02s call tests/test_tls_functional.py::test_scatter 8450s 60.01s call tests/test_tls_functional.py::test_gather 8450s 60.01s call tests/test_utils_test.py::test_gen_cluster_tls 8450s 60.01s call tests/test_tls_functional.py::test_client_submit 8450s 60.01s call tests/test_tls_functional.py::test_Queue 8450s 60.01s call tests/test_tls_functional.py::test_work_stealing 8450s 60.01s call tests/test_tls_functional.py::test_basic 8450s 60.01s call tests/test_tls_functional.py::test_retire_workers 8450s 60.01s call tests/test_scheduler.py::test_broadcast_tls 8450s 60.01s call tests/test_tls_functional.py::test_worker_client_executor 8450s 60.01s call tests/test_tls_functional.py::test_worker_client 8450s 60.01s call tests/test_tls_functional.py::test_rebalance 8450s 60.01s call tests/test_tls_functional.py::test_nanny 8450s 60.01s call tests/test_tls_functional.py::test_worker_client_gather 8450s 30.01s call tests/test_tls_functional.py::test_security_dict_input 8450s 4.09s call cli/tests/test_tls_cli.py::test_separate_key_cert 8450s 3.43s call cli/tests/test_tls_cli.py::test_nanny 8450s 2.95s call cli/tests/test_dask_scheduler.py::test_multiple_workers_2 8450s 2.82s call cli/tests/test_tls_cli.py::test_basic 8450s =========================== short test summary info ============================ 8450s FAILED cli/tests/test_dask_scheduler.py::test_preload_file - distributed.comm.core.CommClosedError: in : Stream is closed 8450s FAILED cli/tests/test_dask_scheduler.py::test_preload_module - distributed.comm.core.CommClosedError: in : Stream is closed 8450s FAILED cli/tests/test_dask_scheduler.py::test_preload_remote_module - distributed.comm.core.CommClosedError: in : Stream is closed 8450s FAILED cli/tests/test_dask_scheduler.py::test_preload_config - SystemError: no locals found when setting up annotations 8450s FAILED cli/tests/test_dask_scheduler.py::test_preload_command - distributed.comm.core.CommClosedError: in : Stream is closed 8450s FAILED cli/tests/test_dask_scheduler.py::test_preload_command_default - distributed.comm.core.CommClosedError: in : Stream is closed 8450s FAILED cli/tests/test_dask_scheduler.py::test_multiple_workers_2 - SystemError: no locals found when setting up annotations 8450s FAILED cli/tests/test_tls_cli.py::test_basic - distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 8450s FAILED cli/tests/test_tls_cli.py::test_sni - distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 8450s FAILED cli/tests/test_tls_cli.py::test_nanny - distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 8450s FAILED cli/tests/test_tls_cli.py::test_separate_key_cert - distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 8450s FAILED cli/tests/test_tls_cli.py::test_use_config_file - distributed.comm.core.FatalCommClosedError: TLS certificate does not match. Check your security settings. More info at https://distributed.dask.org/en/latest/tls.html 8450s FAILED deploy/tests/test_subprocess.py::test_basic - SystemError: no locals found when setting up annotations 8450s FAILED deploy/tests/test_subprocess.py::test_n_workers - SystemError: no locals found when setting up annotations 8450s FAILED tests/test_client.py::test_upload_file_zip - KeyError: '/tmp/dask-scratch-space/scheduler-w6bmicz4/myfile.zip' 8450s FAILED tests/test_profile.py::test_info_frame_f_lineno[22-4] - TypeError: '<=' not supported between instances of 'int' and 'NoneType' 8450s FAILED tests/test_profile.py::test_info_frame_f_lineno[23-4] - TypeError: '<=' not supported between instances of 'int' and 'NoneType' 8450s FAILED tests/test_profile.py::test_call_stack_f_lineno[22-4] - TypeError: '<=' not supported between instances of 'int' and 'NoneType' 8450s FAILED tests/test_profile.py::test_call_stack_f_lineno[23-4] - TypeError: '<=' not supported between instances of 'int' and 'NoneType' 8450s FAILED tests/test_scheduler.py::test_broadcast_tls - TimeoutError 8450s FAILED tests/test_security.py::test_repr_temp_keys - ImportError: Using `Security.temporary` requires `cryptography`, please install it using either pip or conda 8450s FAILED tests/test_security.py::test_temporary_credentials - ImportError: Using `Security.temporary` requires `cryptography`, please install it using either pip or conda 8450s FAILED tests/test_security.py::test_extra_conn_args_in_temporary_credentials - ImportError: Using `Security.temporary` requires `cryptography`, please install it using either pip or conda 8450s FAILED tests/test_tls_functional.py::test_basic - TimeoutError 8450s FAILED tests/test_tls_functional.py::test_Queue - TimeoutError 8450s FAILED tests/test_tls_functional.py::test_client_submit - TimeoutError 8450s FAILED tests/test_tls_functional.py::test_gather - TimeoutError 8450s FAILED tests/test_tls_functional.py::test_scatter - TimeoutError 8450s FAILED tests/test_tls_functional.py::test_nanny - TimeoutError 8450s FAILED tests/test_tls_functional.py::test_rebalance - TimeoutError 8450s FAILED tests/test_tls_functional.py::test_work_stealing - TimeoutError 8450s FAILED tests/test_tls_functional.py::test_worker_client - TimeoutError 8450s FAILED tests/test_tls_functional.py::test_worker_client_gather - TimeoutError 8450s FAILED tests/test_tls_functional.py::test_worker_client_executor - TimeoutError 8450s FAILED tests/test_tls_functional.py::test_retire_workers - TimeoutError 8450s FAILED tests/test_tls_functional.py::test_security_dict_input - TimeoutError 8450s FAILED tests/test_utils_test.py::test_gen_cluster_tls - TimeoutError 8450s ERROR tests/test_utils_test.py::test_tls_cluster - Failed: Timeout >300.0s 8450s ==== 37 failed, 30 skipped, 3311 deselected, 1 error in 1226.07s (0:20:26) ===== 8450s *** END OF RUN 5: NOT ALL TESTS HAVE YET PASSED/XFAILED *** 8450s *** SOME TESTS FAILED/ERRORED EVERY RUN, ABORTING *** 8450s E: pybuild pybuild:389: test: plugin pyproject failed with: exit code=1: cd /tmp/autopkgtest.1vd31g/autopkgtest_tmp/build; cd {build_dir}; /tmp/autopkgtest.1vd31g/build.jio/src/debian/run-tests /tmp/autopkgtest.1vd31g/build.jio/src/debian/get-test-exclusions rules {interpreter} -m pytest --pyargs distributed --verbose --color=no --timeout-method=signal --timeout=300 -m "not avoid_ci" 8450s I: pybuild pybuild:308: mkdir -pv /tmp/autopkgtest.1vd31g/autopkgtest_tmp/.config && printf '\173 "dataframe": \173 "query-planning": False \175 \175\n' > /tmp/autopkgtest.1vd31g/autopkgtest_tmp/.config/dask 8450s I: pybuild base:311: cd /tmp/autopkgtest.1vd31g/autopkgtest_tmp/build; cd /tmp/autopkgtest.1vd31g/autopkgtest_tmp/build; /tmp/autopkgtest.1vd31g/build.jio/src/debian/run-tests /tmp/autopkgtest.1vd31g/build.jio/src/debian/get-test-exclusions rules python3.12 -m pytest --pyargs distributed --verbose --color=no --timeout-method=signal --timeout=300 -m "not avoid_ci" 8451s *** STARTING RUN 1: python3.12 -m pytest --pyargs distributed --verbose --color=no --timeout-method=signal --timeout=300 -m not avoid_ci -rsfE --ignore=../../../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_comms.py --ignore=../../../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_ws.py --ignore=../../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_adaptive.py --ignore=../../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py --ignore=../../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_slow_adaptive.py --ignore=../../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_spec_cluster.py --deselect=cli/tests/test_dask_scheduler.py::test_no_dashboard --deselect=deploy/tests/test_local.py::test_localcluster_get_client --deselect=deploy/tests/test_old_ssh.py::test_cluster --deselect=deploy/tests/test_old_ssh.py::test_old_ssh_nprocs_renamed_to_n_workers --deselect=deploy/tests/test_old_ssh.py::test_nprocs_attribute_is_deprecated --deselect=deploy/tests/test_ssh.py::test_nprocs_attribute_is_deprecated --deselect=http/tests/test_core.py::test_prometheus_api_doc --deselect=tests/test_init.py::test_git_revision --deselect=tests/test_jupyter.py::test_jupyter_idle_timeout --deselect=tests/test_jupyter.py::test_jupyter_idle_timeout_returned --deselect=tests/test_jupyter.py::test_jupyter_server --deselect=tests/test_jupyter.py::test_shutsdown_cleanly --deselect=tests/test_profile.py::test_stack_overflow --deselect=tests/test_pubsub.py::test_client_worker --deselect=tests/test_queues.py::test_queue_in_task --deselect=tests/test_spill.py::test_spillbuffer_oserror --deselect=tests/test_steal.py::test_steal_twice --deselect=tests/test_utils_test.py::test_cluster --deselect=tests/test_variable.py::test_variable_in_task --deselect=tests/test_worker.py::test_process_executor_kills_process --deselect=tests/test_worker_memory.py::test_fail_to_pickle_execute_1 --deselect=tests/test_worker_state_machine.py::test_task_state_instance_are_garbage_collected --deselect=protocol/tests/test_protocol.py::test_deeply_nested_structures --deselect=protocol/tests/test_serialize.py::test_deeply_nested_structures --deselect=deploy/tests/test_local.py::test_local_cluster_redundant_kwarg --deselect=deploy/tests/test_slow_adaptive.py::test_adaptive --deselect=tests/test_client.py::test_futures_in_subgraphs --deselect=tests/test_dask_collections.py::test_dataframe_groupby_tasks --deselect=tests/test_dask_collections.py::test_dataframes --deselect=tests/test_dask_collections.py::test_rolling_sync --deselect=tests/test_scheduler.py::test_balance_many_workers_2 --deselect=tests/test_scheduler.py::test_default_task_duration_splits --deselect=tests/test_steal.py::test_blocklist_shuffle_split --deselect=cli/tests/test_dask_scheduler.py::test_defaults --deselect=cli/tests/test_dask_scheduler.py::test_hostport --deselect=cli/tests/test_dask_spec.py::test_errors --deselect=cli/tests/test_dask_worker.py::test_scheduler_file --deselect=cli/tests/test_dask_worker.py::test_scheduler_file --deselect=cli/tests/test_dask_worker.py::test_scheduler_file --deselect=dashboard/tests/test_scheduler_bokeh.py::test_counters --deselect=dashboard/tests/test_worker_bokeh.py::test_counters --deselect=deploy/tests/test_local.py::test_adapt_then_manual --deselect=deploy/tests/test_local.py::test_async_with --deselect=deploy/tests/test_local.py::test_close_twice --deselect=deploy/tests/test_local.py::test_cluster_info_sync --deselect=deploy/tests/test_local.py::test_local_tls --deselect=deploy/tests/test_local.py::test_no_dangling_asyncio_tasks --deselect=deploy/tests/test_local.py::test_only_local_access --deselect=deploy/tests/test_local.py::test_remote_access --deselect=diagnostics/tests/test_progress_widgets.py::test_serializers --deselect=diagnostics/tests/test_scheduler_plugin.py::test_lifecycle --deselect=http/scheduler/tests/test_missing_bokeh.py::test_missing_bokeh --deselect=http/scheduler/tests/test_scheduler_http.py::test_metrics_when_prometheus_client_not_installed --deselect=protocol/tests/test_serialize.py::test_errors --deselect=tests/test_batched.py::test_BatchedSend --deselect=tests/test_batched.py::test_close_closed --deselect=tests/test_batched.py::test_close_twice --deselect=tests/test_batched.py::test_send_after_stream_start --deselect=tests/test_batched.py::test_send_before_close --deselect=tests/test_batched.py::test_send_before_start --deselect=tests/test_batched.py::test_sending_traffic_jam --deselect=tests/test_batched.py::test_serializers --deselect=tests/test_client.py::TestClientSecurityLoader::test_security_loader --deselect=tests/test_client.py::TestClientSecurityLoader::test_security_loader_ignored_if_explicit_security_provided --deselect=tests/test_client.py::TestClientSecurityLoader::test_security_loader_ignored_if_returns_none --deselect=tests/test_client.py::test_async_with --deselect=tests/test_client.py::test_client_is_quiet_cluster_close --deselect=tests/test_client.py::test_dashboard_link_cluster --deselect=tests/test_client.py::test_dashboard_link_inproc --deselect=tests/test_client.py::test_file_descriptors_dont_leak --deselect=tests/test_client.py::test_mixing_clients_different_scheduler --deselect=tests/test_client.py::test_quiet_client_close --deselect=tests/test_client.py::test_rebalance_sync --deselect=tests/test_client.py::test_repr_localcluster --deselect=tests/test_client.py::test_security_loader --deselect=tests/test_client.py::test_security_loader_ignored_if_explicit_security_provided --deselect=tests/test_client.py::test_security_loader_ignored_if_returns_none --deselect=tests/test_client.py::test_shutdown --deselect=tests/test_client.py::test_shutdown_is_quiet_with_cluster --deselect=tests/test_client.py::test_shutdown_localcluster --deselect=tests/test_client.py::test_shutdown_stops_callbacks --deselect=tests/test_client_loop.py::test_close_loop_sync_start_new_loop --deselect=tests/test_client_loop.py::test_close_loop_sync_use_running_loop --deselect=tests/test_core.py::test_close_fast_without_active_handlers --deselect=tests/test_core.py::test_close_grace_period_for_handlers --deselect=tests/test_core.py::test_close_properly --deselect=tests/test_core.py::test_compression --deselect=tests/test_core.py::test_connection_pool --deselect=tests/test_core.py::test_connection_pool_close_while_connecting --deselect=tests/test_core.py::test_connection_pool_detects_remote_close --deselect=tests/test_core.py::test_connection_pool_outside_cancellation --deselect=tests/test_core.py::test_connection_pool_remove --deselect=tests/test_core.py::test_connection_pool_respects_limit --deselect=tests/test_core.py::test_connection_pool_tls --deselect=tests/test_core.py::test_counters --deselect=tests/test_core.py::test_deserialize_error --deselect=tests/test_core.py::test_errors --deselect=tests/test_core.py::test_identity_inproc --deselect=tests/test_core.py::test_identity_tcp --deselect=tests/test_core.py::test_large_packets_inproc --deselect=tests/test_core.py::test_messages_are_ordered_bsend --deselect=tests/test_core.py::test_messages_are_ordered_raw --deselect=tests/test_core.py::test_ports --deselect=tests/test_core.py::test_rpc_default --deselect=tests/test_core.py::test_rpc_inproc --deselect=tests/test_core.py::test_rpc_message_lifetime_default --deselect=tests/test_core.py::test_rpc_message_lifetime_inproc --deselect=tests/test_core.py::test_rpc_message_lifetime_tcp --deselect=tests/test_core.py::test_rpc_serialization --deselect=tests/test_core.py::test_rpc_tcp --deselect=tests/test_core.py::test_rpc_tls --deselect=tests/test_core.py::test_rpc_with_many_connections_inproc --deselect=tests/test_core.py::test_rpc_with_many_connections_tcp --deselect=tests/test_core.py::test_send_recv_args --deselect=tests/test_core.py::test_send_recv_cancelled --deselect=tests/test_core.py::test_server --deselect=tests/test_core.py::test_server_comms_mark_active_handlers --deselect=tests/test_core.py::test_server_raises_on_blocked_handlers --deselect=tests/test_jupyter.py::test_jupyter_idle_timeout --deselect=tests/test_jupyter.py::test_jupyter_server --deselect=tests/test_locks.py::test_errors --deselect=tests/test_nanny.py::test_scheduler_file --deselect=tests/test_nanny.py::test_scheduler_file --deselect=tests/test_nanny.py::test_scheduler_file --deselect=tests/test_nanny.py::test_worker_uses_same_host_as_nanny --deselect=tests/test_preload.py::test_failure_doesnt_crash_scheduler --deselect=tests/test_preload.py::test_preload_import_time --deselect=tests/test_preload.py::test_preload_manager_sequence --deselect=tests/test_preload.py::test_worker_preload_text --deselect=tests/test_scheduler.py::test_allowed_failures_config --deselect=tests/test_scheduler.py::test_async_context_manager --deselect=tests/test_scheduler.py::test_dashboard_host --deselect=tests/test_scheduler.py::test_file_descriptors_dont_leak --deselect=tests/test_scheduler.py::test_finished --deselect=tests/test_scheduler.py::test_multiple_listeners --deselect=tests/test_scheduler.py::test_no_dangling_asyncio_tasks --deselect=tests/test_scheduler.py::test_scheduler_file --deselect=tests/test_scheduler.py::test_scheduler_file --deselect=tests/test_scheduler.py::test_scheduler_file --deselect=tests/test_security.py::test_require_encryption --deselect=tests/test_security.py::test_tls_listen_connect --deselect=tests/test_security.py::test_tls_temporary_credentials_functional --deselect=tests/test_semaphore.py::test_threadpoolworkers_pick_correct_ioloop --deselect=tests/test_tls_functional.py::test_security_dict_input_no_security --deselect=tests/test_utils_test.py::test_ensure_no_new_clients --deselect=tests/test_utils_test.py::test_freeze_batched_send --deselect=tests/test_utils_test.py::test_locked_comm_drop_in_replacement --deselect=tests/test_utils_test.py::test_locked_comm_intercept_read --deselect=tests/test_utils_test.py::test_locked_comm_intercept_write --deselect=tests/test_worker.py::test_host_uses_scheduler_protocol --deselect=tests/test_worker.py::test_plugin_exception --deselect=tests/test_worker.py::test_plugin_internal_exception --deselect=tests/test_worker.py::test_plugin_multiple_exceptions --deselect=tests/test_worker.py::test_scheduler_file --deselect=tests/test_worker.py::test_scheduler_file --deselect=tests/test_worker.py::test_scheduler_file --deselect=tests/test_worker_client.py::test_dont_override_default_get 8451s ============================= test session starts ============================== 8451s platform linux -- Python 3.12.7, pytest-8.3.3, pluggy-1.5.0 -- /usr/bin/python3.12 8451s cachedir: .pytest_cache 8451s rootdir: /tmp/autopkgtest.1vd31g/autopkgtest_tmp/build 8451s configfile: pyproject.toml 8451s plugins: typeguard-4.4.1, anyio-4.6.2, rerunfailures-14.0, timeout-2.3.1 8451s timeout: 300.0s 8451s timeout method: signal 8451s timeout func_only: False 8461s collecting ... collected 3349 items / 166 deselected / 30 skipped / 3183 selected 8461s 8461s cli/tests/test_dask_scheduler.py::test_dashboard <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py SKIPPED [ 0%] 8461s cli/tests/test_dask_scheduler.py::test_dashboard_non_standard_ports <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py SKIPPED [ 0%] 8462s cli/tests/test_dask_scheduler.py::test_multiple_protocols <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py PASSED [ 0%] 8462s cli/tests/test_dask_scheduler.py::test_dashboard_allowlist <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py SKIPPED [ 0%] 8464s cli/tests/test_dask_scheduler.py::test_interface <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py PASSED [ 0%] 8467s cli/tests/test_dask_scheduler.py::test_pid_file <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py PASSED [ 0%] 8468s cli/tests/test_dask_scheduler.py::test_scheduler_port_zero <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py PASSED [ 0%] 8468s cli/tests/test_dask_scheduler.py::test_dashboard_port_zero <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py SKIPPED [ 0%] 8469s cli/tests/test_dask_scheduler.py::test_preload_file <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py PASSED [ 0%] 8470s cli/tests/test_dask_scheduler.py::test_preload_module <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py PASSED [ 0%] 8471s cli/tests/test_dask_scheduler.py::test_preload_remote_module <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py PASSED [ 0%] 8472s cli/tests/test_dask_scheduler.py::test_preload_config <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py PASSED [ 0%] 8473s cli/tests/test_dask_scheduler.py::test_preload_command <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py PASSED [ 0%] 8474s cli/tests/test_dask_scheduler.py::test_preload_command_default <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py PASSED [ 0%] 8474s cli/tests/test_dask_scheduler.py::test_version_option <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py PASSED [ 0%] 8474s cli/tests/test_dask_scheduler.py::test_idle_timeout <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py SKIPPED [ 0%] 8474s cli/tests/test_dask_scheduler.py::test_restores_signal_handler <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py SKIPPED [ 0%] 8476s cli/tests/test_dask_scheduler.py::test_multiple_workers_2 <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py PASSED [ 0%] 8479s cli/tests/test_dask_scheduler.py::test_multiple_workers <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py PASSED [ 0%] 8479s cli/tests/test_dask_scheduler.py::test_signal_handling[2] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py SKIPPED [ 0%] 8479s cli/tests/test_dask_scheduler.py::test_signal_handling[15] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py SKIPPED [ 0%] 8480s cli/tests/test_dask_scheduler.py::test_single_executable_deprecated <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py PASSED [ 0%] 8482s cli/tests/test_dask_spec.py::test_text <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_spec.py PASSED [ 0%] 8483s cli/tests/test_dask_spec.py::test_file <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_spec.py PASSED [ 0%] 8485s cli/tests/test_dask_spec.py::test_signal_handling_worker[2-Nanny] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_spec.py PASSED [ 0%] 8486s cli/tests/test_dask_spec.py::test_signal_handling_worker[2-Worker] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_spec.py PASSED [ 0%] 8487s cli/tests/test_dask_spec.py::test_signal_handling_worker[15-Nanny] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_spec.py PASSED [ 0%] 8488s cli/tests/test_dask_spec.py::test_signal_handling_worker[15-Worker] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_spec.py PASSED [ 0%] 8490s cli/tests/test_dask_spec.py::test_signal_handling_scheduler[2] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_spec.py PASSED [ 0%] 8491s cli/tests/test_dask_spec.py::test_signal_handling_scheduler[15] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_spec.py PASSED [ 0%] 8491s cli/tests/test_dask_worker.py::test_apportion_ports[args0-expect0] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 0%] 8491s cli/tests/test_dask_worker.py::test_apportion_ports[args1-expect1] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 8491s cli/tests/test_dask_worker.py::test_apportion_ports[args2-expect2] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 8491s cli/tests/test_dask_worker.py::test_apportion_ports[args3-expect3] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 8491s cli/tests/test_dask_worker.py::test_apportion_ports[args4-expect4] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 8491s cli/tests/test_dask_worker.py::test_apportion_ports[args5-expect5] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 8491s cli/tests/test_dask_worker.py::test_apportion_ports[args6-expect6] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 8491s cli/tests/test_dask_worker.py::test_apportion_ports[args7-expect7] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 8491s cli/tests/test_dask_worker.py::test_apportion_ports[args8-expect8] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 8491s cli/tests/test_dask_worker.py::test_apportion_ports[args9-expect9] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 8491s cli/tests/test_dask_worker.py::test_apportion_ports[args10-expect10] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 8491s cli/tests/test_dask_worker.py::test_apportion_ports[args11-expect11] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 8491s cli/tests/test_dask_worker.py::test_apportion_ports[args12-expect12] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 8491s cli/tests/test_dask_worker.py::test_apportion_ports[args13-expect13] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 8491s cli/tests/test_dask_worker.py::test_apportion_ports[args14-expect14] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 8491s cli/tests/test_dask_worker.py::test_apportion_ports[args15-expect15] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 8491s cli/tests/test_dask_worker.py::test_apportion_ports[args16-expect16] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 8491s cli/tests/test_dask_worker.py::test_apportion_ports[args17-expect17] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 8491s cli/tests/test_dask_worker.py::test_apportion_ports_bad <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 8491s cli/tests/test_dask_worker.py::test_nanny_worker_ports <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 1%] 8491s cli/tests/test_dask_worker.py::test_nanny_worker_port_range <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 1%] 8493s cli/tests/test_dask_worker.py::test_nanny_worker_port_range_too_many_workers_raises <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 8493s cli/tests/test_dask_worker.py::test_memory_limit <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 1%] 8494s cli/tests/test_dask_worker.py::test_no_nanny <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 8494s cli/tests/test_dask_worker.py::test_resources <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 1%] 8494s cli/tests/test_dask_worker.py::test_local_directory[--nanny] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 1%] 8494s cli/tests/test_dask_worker.py::test_local_directory[--no-nanny] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 1%] 8494s cli/tests/test_dask_worker.py::test_scheduler_address_env <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 1%] 8495s cli/tests/test_dask_worker.py::test_nworkers_requires_nanny <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 8495s cli/tests/test_dask_worker.py::test_nworkers_negative <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 1%] 8495s cli/tests/test_dask_worker.py::test_nworkers_auto <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 1%] 8495s cli/tests/test_dask_worker.py::test_nworkers_expands_name <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 1%] 8495s cli/tests/test_dask_worker.py::test_contact_listen_address[tcp://0.0.0.0:---nanny] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 1%] 8495s cli/tests/test_dask_worker.py::test_contact_listen_address[tcp://0.0.0.0:---no-nanny] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 2%] 8495s cli/tests/test_dask_worker.py::test_contact_listen_address[tcp://127.0.0.2:---nanny] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 2%] 8495s cli/tests/test_dask_worker.py::test_contact_listen_address[tcp://127.0.0.2:---no-nanny] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 2%] 8495s cli/tests/test_dask_worker.py::test_listen_address_ipv6[tcp://:---nanny] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 2%] 8495s cli/tests/test_dask_worker.py::test_listen_address_ipv6[tcp://:---no-nanny] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 2%] 8495s cli/tests/test_dask_worker.py::test_listen_address_ipv6[tcp://[::1]:---nanny] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 2%] 8495s cli/tests/test_dask_worker.py::test_listen_address_ipv6[tcp://[::1]:---no-nanny] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 2%] 8495s cli/tests/test_dask_worker.py::test_respect_host_listen_address[127.0.0.2---nanny] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 2%] 8495s cli/tests/test_dask_worker.py::test_respect_host_listen_address[127.0.0.2---no-nanny] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 2%] 8495s cli/tests/test_dask_worker.py::test_respect_host_listen_address[0.0.0.0---nanny] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 2%] 8495s cli/tests/test_dask_worker.py::test_respect_host_listen_address[0.0.0.0---no-nanny] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 2%] 8495s cli/tests/test_dask_worker.py::test_dashboard_non_standard_ports <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 2%] 8495s cli/tests/test_dask_worker.py::test_version_option <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 2%] 8495s cli/tests/test_dask_worker.py::test_worker_timeout[True] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 2%] 8495s cli/tests/test_dask_worker.py::test_worker_timeout[False] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 2%] 8495s cli/tests/test_dask_worker.py::test_integer_names <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 2%] 8495s cli/tests/test_dask_worker.py::test_worker_class[--nanny] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 2%] 8495s cli/tests/test_dask_worker.py::test_worker_class[--no-nanny] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 2%] 8495s cli/tests/test_dask_worker.py::test_preload_config <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 2%] 8495s cli/tests/test_dask_worker.py::test_set_lifetime_stagger_via_env_var <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 2%] 8495s cli/tests/test_dask_worker.py::test_set_lifetime_restart_via_env_var <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 2%] 8495s cli/tests/test_dask_worker.py::test_timeout[--nanny] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 2%] 8495s cli/tests/test_dask_worker.py::test_timeout[--no-nanny] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 2%] 8496s cli/tests/test_dask_worker.py::test_signal_handling[2---nanny] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 2%] 8497s cli/tests/test_dask_worker.py::test_signal_handling[2---no-nanny] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 2%] 8499s cli/tests/test_dask_worker.py::test_signal_handling[15---nanny] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 2%] 8500s cli/tests/test_dask_worker.py::test_signal_handling[15---no-nanny] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 2%] 8505s cli/tests/test_dask_worker.py::test_error_during_startup[--nanny] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 2%] 8509s cli/tests/test_dask_worker.py::test_error_during_startup[--no-nanny] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 2%] 8511s cli/tests/test_dask_worker.py::test_single_executable_deprecated <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 2%] 8511s cli/tests/test_dask_worker.py::test_single_executable_works <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 2%] 8513s cli/tests/test_tls_cli.py::test_basic <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_tls_cli.py PASSED [ 2%] 8515s cli/tests/test_tls_cli.py::test_sni <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_tls_cli.py PASSED [ 3%] 8517s cli/tests/test_tls_cli.py::test_nanny <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_tls_cli.py PASSED [ 3%] 8519s cli/tests/test_tls_cli.py::test_separate_key_cert <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_tls_cli.py PASSED [ 3%] 8521s cli/tests/test_tls_cli.py::test_use_config_file <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_tls_cli.py PASSED [ 3%] 8521s comm/tests/test_tcp.py::test_getaddrinfo_invalid_af <- ../../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_tcp.py PASSED [ 3%] 8521s dashboard/tests/test_bokeh.py::test_old_import <- ../../../../usr/lib/python3/dist-packages/distributed/dashboard/tests/test_bokeh.py PASSED [ 3%] 8521s deploy/tests/test_adaptive_core.py::test_safe_target <- ../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_adaptive_core.py PASSED [ 3%] 8521s deploy/tests/test_adaptive_core.py::test_scale_up <- ../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_adaptive_core.py PASSED [ 3%] 8521s deploy/tests/test_adaptive_core.py::test_scale_down <- ../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_adaptive_core.py PASSED [ 3%] 8521s deploy/tests/test_adaptive_core.py::test_interval <- ../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_adaptive_core.py PASSED [ 3%] 8521s deploy/tests/test_adaptive_core.py::test_adapt_oserror_safe_target <- ../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_adaptive_core.py PASSED [ 3%] 8521s deploy/tests/test_adaptive_core.py::test_adapt_oserror_scale <- ../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_adaptive_core.py PASSED [ 3%] 8521s deploy/tests/test_adaptive_core.py::test_adapt_stop_del <- ../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_adaptive_core.py PASSED [ 3%] 8521s deploy/tests/test_cluster.py::test_eq <- ../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_cluster.py PASSED [ 3%] 8521s deploy/tests/test_cluster.py::test_repr <- ../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_cluster.py PASSED [ 3%] 8523s deploy/tests/test_cluster.py::test_cluster_wait_for_worker <- ../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_cluster.py PASSED [ 3%] 8523s deploy/tests/test_cluster.py::test_deprecated_loop_properties <- ../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_cluster.py PASSED [ 3%] 8523s deploy/tests/test_cluster.py::test_exponential_backoff <- ../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_cluster.py PASSED [ 3%] 8523s deploy/tests/test_cluster.py::test_sync_context_manager_used_with_async_cluster <- ../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_cluster.py PASSED [ 3%] 8523s deploy/tests/test_deploy_utils.py::test_default_process_thread_breakdown <- ../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_deploy_utils.py PASSED [ 3%] 8525s deploy/tests/test_subprocess.py::test_basic <- ../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_subprocess.py PASSED [ 3%] 8527s deploy/tests/test_subprocess.py::test_n_workers <- ../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_subprocess.py PASSED [ 3%] 8529s deploy/tests/test_subprocess.py::test_scale_up_and_down <- ../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_subprocess.py PASSED [ 3%] 8532s deploy/tests/test_subprocess.py::test_raise_if_scheduler_fails_to_start <- ../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_subprocess.py PASSED [ 3%] 8532s deploy/tests/test_subprocess.py::test_subprocess_cluster_does_not_depend_on_logging <- ../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_subprocess.py SKIPPED [ 3%] 8532s deploy/tests/test_subprocess.py::test_raise_on_windows <- ../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_subprocess.py SKIPPED [ 3%] 8534s diagnostics/tests/test_cluster_dump_plugin.py::test_cluster_dump_plugin <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_cluster_dump_plugin.py PASSED [ 3%] 8534s diagnostics/tests/test_eventstream.py::test_eventstream <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_eventstream.py SKIPPED [ 3%] 8534s diagnostics/tests/test_eventstream.py::test_eventstream_remote <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_eventstream.py PASSED [ 3%] 8534s diagnostics/tests/test_graph_layout.py::test_basic <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_graph_layout.py PASSED [ 3%] 8535s diagnostics/tests/test_graph_layout.py::test_construct_after_call <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_graph_layout.py PASSED [ 3%] 8535s diagnostics/tests/test_graph_layout.py::test_states <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_graph_layout.py PASSED [ 3%] 8535s diagnostics/tests/test_graph_layout.py::test_release_tasks <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_graph_layout.py PASSED [ 4%] 8535s diagnostics/tests/test_graph_layout.py::test_forget <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_graph_layout.py PASSED [ 4%] 8535s diagnostics/tests/test_graph_layout.py::test_unique_positions <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_graph_layout.py PASSED [ 4%] 8535s diagnostics/tests/test_graph_layout.py::test_layout_scatter <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_graph_layout.py PASSED [ 4%] 8535s diagnostics/tests/test_install_plugin.py::test_pip_install <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_install_plugin.py PASSED [ 4%] 8535s diagnostics/tests/test_install_plugin.py::test_conda_install <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_install_plugin.py PASSED [ 4%] 8535s diagnostics/tests/test_install_plugin.py::test_pip_install_fails <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_install_plugin.py PASSED [ 4%] 8535s diagnostics/tests/test_install_plugin.py::test_conda_install_fails_when_conda_not_found <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_install_plugin.py PASSED [ 4%] 8535s diagnostics/tests/test_install_plugin.py::test_conda_install_fails_when_conda_raises <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_install_plugin.py PASSED [ 4%] 8535s diagnostics/tests/test_install_plugin.py::test_conda_install_fails_on_returncode <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_install_plugin.py PASSED [ 4%] 8535s diagnostics/tests/test_install_plugin.py::test_package_install_restarts_on_nanny <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_install_plugin.py SKIPPED [ 4%] 8536s diagnostics/tests/test_install_plugin.py::test_package_install_failing_does_not_restart_on_nanny <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_install_plugin.py PASSED [ 4%] 8537s diagnostics/tests/test_memory_sampler.py::test_async <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_memory_sampler.py PASSED [ 4%] 8539s diagnostics/tests/test_memory_sampler.py::test_sync <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_memory_sampler.py PASSED [ 4%] 8540s diagnostics/tests/test_memory_sampler.py::test_at_least_one_sample <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_memory_sampler.py PASSED [ 4%] 8540s diagnostics/tests/test_memory_sampler.py::test_multi_sample <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_memory_sampler.py SKIPPED [ 4%] 8540s diagnostics/tests/test_memory_sampler.py::test_pandas[False] <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_memory_sampler.py SKIPPED [ 4%] 8540s diagnostics/tests/test_memory_sampler.py::test_pandas[True] <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_memory_sampler.py SKIPPED [ 4%] 8540s diagnostics/tests/test_memory_sampler.py::test_pandas_multiseries[False] <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_memory_sampler.py SKIPPED [ 4%] 8540s diagnostics/tests/test_memory_sampler.py::test_pandas_multiseries[True] <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_memory_sampler.py SKIPPED [ 4%] 8541s diagnostics/tests/test_nanny_plugin.py::test_register_worker_plugin_is_deprecated <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_nanny_plugin.py PASSED [ 4%] 8542s diagnostics/tests/test_nanny_plugin.py::test_register_worker_plugin_typing_over_nanny_keyword <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_nanny_plugin.py PASSED [ 4%] 8543s diagnostics/tests/test_nanny_plugin.py::test_duck_typed_register_nanny_plugin_is_deprecated <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_nanny_plugin.py PASSED [ 4%] 8544s diagnostics/tests/test_nanny_plugin.py::test_register_idempotent_plugin <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_nanny_plugin.py PASSED [ 4%] 8545s diagnostics/tests/test_nanny_plugin.py::test_register_non_idempotent_plugin <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_nanny_plugin.py PASSED [ 4%] 8547s diagnostics/tests/test_nanny_plugin.py::test_register_plugin_with_idempotent_keyword_is_deprecated <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_nanny_plugin.py PASSED [ 4%] 8547s diagnostics/tests/test_progress.py::test_many_Progress <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_progress.py PASSED [ 4%] 8547s diagnostics/tests/test_progress.py::test_multiprogress <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_progress.py PASSED [ 4%] 8547s diagnostics/tests/test_progress.py::test_multiprogress_cancel <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_progress.py PASSED [ 4%] 8547s diagnostics/tests/test_progress.py::test_multiprogress_with_spans <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_progress.py PASSED [ 4%] 8547s diagnostics/tests/test_progress.py::test_multiprogress_with_prefix <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_progress.py PASSED [ 4%] 8547s diagnostics/tests/test_progress.py::test_multiprogress_warns <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_progress.py PASSED [ 4%] 8547s diagnostics/tests/test_progress.py::test_robust_to_bad_plugin <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_progress.py PASSED [ 5%] 8551s diagnostics/tests/test_progress.py::test_AllProgress <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_progress.py PASSED [ 5%] 8553s diagnostics/tests/test_progress.py::test_AllProgress_lost_key <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_progress.py PASSED [ 5%] 8558s diagnostics/tests/test_progress.py::test_group_timing <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_progress.py PASSED [ 5%] 8559s diagnostics/tests/test_progressbar.py::test_text_progressbar <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_progressbar.py PASSED [ 5%] 8559s diagnostics/tests/test_progressbar.py::test_TextProgressBar_error <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_progressbar.py PASSED [ 5%] 8559s diagnostics/tests/test_progressbar.py::test_TextProgressBar_empty <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_progressbar.py PASSED [ 5%] 8561s diagnostics/tests/test_progressbar.py::test_progress_function <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_progressbar.py PASSED [ 5%] 8562s diagnostics/tests/test_progressbar.py::test_progress_function_w_kwargs <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_progressbar.py PASSED [ 5%] 8563s diagnostics/tests/test_progressbar.py::test_progress_function_warns <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_progressbar.py PASSED [ 5%] 8563s diagnostics/tests/test_progressbar.py::test_progress_function_raises <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_progressbar.py PASSED [ 5%] 8563s diagnostics/tests/test_progressbar.py::test_deprecated_loop_properties <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_progressbar.py PASSED [ 5%] 8563s diagnostics/tests/test_scheduler_plugin.py::test_simple <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_scheduler_plugin.py PASSED [ 5%] 8563s diagnostics/tests/test_scheduler_plugin.py::test_add_remove_worker <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_scheduler_plugin.py PASSED [ 5%] 8563s diagnostics/tests/test_scheduler_plugin.py::test_remove_worker_renamed_kwargs_allowed <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_scheduler_plugin.py PASSED [ 5%] 8564s diagnostics/tests/test_scheduler_plugin.py::test_remove_worker_without_kwargs_deprecated <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_scheduler_plugin.py PASSED [ 5%] 8564s diagnostics/tests/test_scheduler_plugin.py::test_async_add_remove_worker <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_scheduler_plugin.py PASSED [ 5%] 8564s diagnostics/tests/test_scheduler_plugin.py::test_async_and_sync_add_remove_worker <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_scheduler_plugin.py PASSED [ 5%] 8564s diagnostics/tests/test_scheduler_plugin.py::test_failing_async_add_remove_worker <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_scheduler_plugin.py PASSED [ 5%] 8564s diagnostics/tests/test_scheduler_plugin.py::test_failing_sync_add_remove_worker <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_scheduler_plugin.py PASSED [ 5%] 8564s diagnostics/tests/test_scheduler_plugin.py::test_register_plugin <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_scheduler_plugin.py PASSED [ 5%] 8564s diagnostics/tests/test_scheduler_plugin.py::test_register_scheduler_plugin_deprecated <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_scheduler_plugin.py PASSED [ 5%] 8564s diagnostics/tests/test_scheduler_plugin.py::test_unregister_scheduler_plugin <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_scheduler_plugin.py PASSED [ 5%] 8564s diagnostics/tests/test_scheduler_plugin.py::test_unregister_scheduler_plugin_from_client <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_scheduler_plugin.py PASSED [ 5%] 8564s diagnostics/tests/test_scheduler_plugin.py::test_log_event_plugin <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_scheduler_plugin.py PASSED [ 5%] 8564s diagnostics/tests/test_scheduler_plugin.py::test_register_plugin_on_scheduler <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_scheduler_plugin.py PASSED [ 5%] 8566s diagnostics/tests/test_scheduler_plugin.py::test_closing_errors_ok <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_scheduler_plugin.py PASSED [ 5%] 8566s diagnostics/tests/test_scheduler_plugin.py::test_update_graph_hook_simple <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_scheduler_plugin.py PASSED [ 5%] 8566s diagnostics/tests/test_scheduler_plugin.py::test_update_graph_hook_complex <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_scheduler_plugin.py PASSED [ 5%] 8566s diagnostics/tests/test_scheduler_plugin.py::test_scheduler_plugin_in_register_worker_plugin_overrides <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_scheduler_plugin.py PASSED [ 5%] 8567s diagnostics/tests/test_scheduler_plugin.py::test_scheduler_plugin_in_register_worker_plugin_overrides_nanny <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_scheduler_plugin.py PASSED [ 5%] 8567s diagnostics/tests/test_scheduler_plugin.py::test_register_idempotent_plugin <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_scheduler_plugin.py PASSED [ 6%] 8567s diagnostics/tests/test_scheduler_plugin.py::test_register_non_idempotent_plugin <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_scheduler_plugin.py PASSED [ 6%] 8568s diagnostics/tests/test_scheduler_plugin.py::test_register_plugin_with_idempotent_keyword_is_deprecated <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_scheduler_plugin.py PASSED [ 6%] 8568s diagnostics/tests/test_scheduler_plugin.py::test_register_idempotent_plugins_directly <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_scheduler_plugin.py PASSED [ 6%] 8568s diagnostics/tests/test_scheduler_plugin.py::test_register_non_idempotent_plugins_directly <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_scheduler_plugin.py PASSED [ 6%] 8568s diagnostics/tests/test_task_stream.py::test_TaskStreamPlugin <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_task_stream.py PASSED [ 6%] 8568s diagnostics/tests/test_task_stream.py::test_maxlen <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_task_stream.py PASSED [ 6%] 8568s diagnostics/tests/test_task_stream.py::test_collect <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_task_stream.py PASSED [ 6%] 8568s diagnostics/tests/test_task_stream.py::test_no_startstops <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_task_stream.py PASSED [ 6%] 8569s diagnostics/tests/test_task_stream.py::test_client <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_task_stream.py PASSED [ 6%] 8570s diagnostics/tests/test_task_stream.py::test_client_sync <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_task_stream.py PASSED [ 6%] 8570s diagnostics/tests/test_task_stream.py::test_get_task_stream_plot <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_task_stream.py SKIPPED [ 6%] 8572s diagnostics/tests/test_task_stream.py::test_get_task_stream_save <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_task_stream.py SKIPPED [ 6%] 8572s diagnostics/tests/test_worker_plugin.py::test_create_with_client <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_worker_plugin.py PASSED [ 6%] 8572s diagnostics/tests/test_worker_plugin.py::test_remove_with_client <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_worker_plugin.py PASSED [ 6%] 8572s diagnostics/tests/test_worker_plugin.py::test_remove_with_client_raises <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_worker_plugin.py PASSED [ 6%] 8572s diagnostics/tests/test_worker_plugin.py::test_create_on_construction <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_worker_plugin.py PASSED [ 6%] 8572s diagnostics/tests/test_worker_plugin.py::test_normal_task_transitions_called <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_worker_plugin.py PASSED [ 6%] 8572s diagnostics/tests/test_worker_plugin.py::test_failing_task_transitions_called <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_worker_plugin.py PASSED [ 6%] 8572s diagnostics/tests/test_worker_plugin.py::test_superseding_task_transitions_called <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_worker_plugin.py PASSED [ 6%] 8572s diagnostics/tests/test_worker_plugin.py::test_dependent_tasks <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_worker_plugin.py PASSED [ 6%] 8572s diagnostics/tests/test_worker_plugin.py::test_empty_plugin <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_worker_plugin.py PASSED [ 6%] 8572s diagnostics/tests/test_worker_plugin.py::test_default_name <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_worker_plugin.py PASSED [ 6%] 8572s diagnostics/tests/test_worker_plugin.py::test_assert_no_warning_no_overload <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_worker_plugin.py PASSED [ 6%] 8572s diagnostics/tests/test_worker_plugin.py::test_WorkerPlugin_overwrite <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_worker_plugin.py PASSED [ 6%] 8572s diagnostics/tests/test_worker_plugin.py::test_register_worker_plugin_is_deprecated <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_worker_plugin.py PASSED [ 6%] 8573s diagnostics/tests/test_worker_plugin.py::test_register_worker_plugin_typing_over_nanny_keyword <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_worker_plugin.py PASSED [ 6%] 8573s diagnostics/tests/test_worker_plugin.py::test_duck_typed_register_worker_plugin_is_deprecated <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_worker_plugin.py PASSED [ 6%] 8573s diagnostics/tests/test_worker_plugin.py::test_register_idempotent_plugin <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_worker_plugin.py PASSED [ 6%] 8573s diagnostics/tests/test_worker_plugin.py::test_register_non_idempotent_plugin <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_worker_plugin.py PASSED [ 6%] 8573s diagnostics/tests/test_worker_plugin.py::test_register_plugin_with_idempotent_keyword_is_deprecated <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_worker_plugin.py PASSED [ 6%] 8573s http/scheduler/tests/test_missing_bokeh.py::test_bokeh_version_too_low <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_missing_bokeh.py SKIPPED [ 6%] 8573s http/scheduler/tests/test_missing_bokeh.py::test_bokeh_version_too_high <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_missing_bokeh.py SKIPPED [ 7%] 8573s http/scheduler/tests/test_scheduler_http.py::test_connect <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 7%] 8573s http/scheduler/tests/test_scheduler_http.py::test_worker_404 <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 7%] 8573s http/scheduler/tests/test_scheduler_http.py::test_prefix <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py SKIPPED [ 7%] 8573s http/scheduler/tests/test_scheduler_http.py::test_prometheus <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 7%] 8574s http/scheduler/tests/test_scheduler_http.py::test_prometheus_collect_task_states <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 7%] 8574s http/scheduler/tests/test_scheduler_http.py::test_prometheus_collect_task_prefix_counts <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 7%] 8574s http/scheduler/tests/test_scheduler_http.py::test_prometheus_collect_worker_states <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 7%] 8574s http/scheduler/tests/test_scheduler_http.py::test_health <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py SKIPPED [ 7%] 8574s http/scheduler/tests/test_scheduler_http.py::test_sitemap <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 7%] 8574s http/scheduler/tests/test_scheduler_http.py::test_task_page[1_0] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 7%] 8574s http/scheduler/tests/test_scheduler_http.py::test_task_page[1_1] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 7%] 8574s http/scheduler/tests/test_scheduler_http.py::test_task_page[x] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 7%] 8574s http/scheduler/tests/test_scheduler_http.py::test_task_page[a+b] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 7%] 8574s http/scheduler/tests/test_scheduler_http.py::test_task_page[a b] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 7%] 8574s http/scheduler/tests/test_scheduler_http.py::test_task_page[key5] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 7%] 8575s http/scheduler/tests/test_scheduler_http.py::test_task_page[key6] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 7%] 8575s http/scheduler/tests/test_scheduler_http.py::test_task_page[key7] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 7%] 8575s http/scheduler/tests/test_scheduler_http.py::test_task_page[key8] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 7%] 8575s http/scheduler/tests/test_scheduler_http.py::test_task_page[(] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 7%] 8575s http/scheduler/tests/test_scheduler_http.py::test_task_page[[] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 7%] 8575s http/scheduler/tests/test_scheduler_http.py::test_task_page['] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 7%] 8575s http/scheduler/tests/test_scheduler_http.py::test_task_page["] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 7%] 8575s http/scheduler/tests/test_scheduler_http.py::test_task_page[123] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 7%] 8575s http/scheduler/tests/test_scheduler_http.py::test_task_page[key14] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 7%] 8575s http/scheduler/tests/test_scheduler_http.py::test_task_page[key15] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 7%] 8575s http/scheduler/tests/test_scheduler_http.py::test_task_page[key16] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 7%] 8575s http/scheduler/tests/test_scheduler_http.py::test_task_page[key17] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 7%] 8575s http/scheduler/tests/test_scheduler_http.py::test_task_page[key18] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 7%] 8576s http/scheduler/tests/test_scheduler_http.py::test_call_stack_page[1_0] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 7%] 8576s http/scheduler/tests/test_scheduler_http.py::test_call_stack_page[1_1] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 7%] 8576s http/scheduler/tests/test_scheduler_http.py::test_call_stack_page[x] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 7%] 8576s http/scheduler/tests/test_scheduler_http.py::test_call_stack_page[a+b] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 8%] 8576s http/scheduler/tests/test_scheduler_http.py::test_call_stack_page[a b] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 8%] 8576s http/scheduler/tests/test_scheduler_http.py::test_call_stack_page[key5] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 8%] 8576s http/scheduler/tests/test_scheduler_http.py::test_call_stack_page[key6] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 8%] 8576s http/scheduler/tests/test_scheduler_http.py::test_call_stack_page[key7] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 8%] 8576s http/scheduler/tests/test_scheduler_http.py::test_call_stack_page[key8] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 8%] 8576s http/scheduler/tests/test_scheduler_http.py::test_call_stack_page[(] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 8%] 8576s http/scheduler/tests/test_scheduler_http.py::test_call_stack_page[[] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 8%] 8577s http/scheduler/tests/test_scheduler_http.py::test_call_stack_page['] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 8%] 8577s http/scheduler/tests/test_scheduler_http.py::test_call_stack_page["] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 8%] 8577s http/scheduler/tests/test_scheduler_http.py::test_call_stack_page[123] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 8%] 8577s http/scheduler/tests/test_scheduler_http.py::test_call_stack_page[key14] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 8%] 8577s http/scheduler/tests/test_scheduler_http.py::test_call_stack_page[key15] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 8%] 8577s http/scheduler/tests/test_scheduler_http.py::test_call_stack_page[key16] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 8%] 8577s http/scheduler/tests/test_scheduler_http.py::test_call_stack_page[key17] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 8%] 8577s http/scheduler/tests/test_scheduler_http.py::test_call_stack_page[key18] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 8%] 8577s http/scheduler/tests/test_scheduler_http.py::test_allow_websocket_origin <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py SKIPPED [ 8%] 8577s http/scheduler/tests/test_scheduler_http.py::test_eventstream <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 8%] 8577s http/scheduler/tests/test_scheduler_http.py::test_api_disabled_by_default <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 8%] 8577s http/scheduler/tests/test_scheduler_http.py::test_api <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py SKIPPED [ 8%] 8577s http/scheduler/tests/test_scheduler_http.py::test_retire_workers <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py SKIPPED [ 8%] 8577s http/scheduler/tests/test_scheduler_http.py::test_get_workers <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py SKIPPED [ 8%] 8578s http/scheduler/tests/test_scheduler_http.py::test_adaptive_target <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py SKIPPED [ 8%] 8578s http/scheduler/tests/test_scheduler_http.py::test_check_idle <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py SKIPPED [ 8%] 8578s http/scheduler/tests/test_semaphore_http.py::test_prometheus <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_semaphore_http.py PASSED [ 8%] 8578s http/scheduler/tests/test_semaphore_http.py::test_prometheus_without_semaphore_extension <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_semaphore_http.py PASSED [ 8%] 8578s http/scheduler/tests/test_stealing_http.py::test_prometheus <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_stealing_http.py PASSED [ 8%] 8578s http/scheduler/tests/test_stealing_http.py::test_prometheus_collect_count_total_by_cost_multipliers <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_stealing_http.py PASSED [ 8%] 8579s http/scheduler/tests/test_stealing_http.py::test_prometheus_collect_cost_total_by_cost_multipliers <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_stealing_http.py PASSED [ 8%] 8579s http/scheduler/tests/test_stealing_http.py::test_prometheus_without_stealing_extension <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_stealing_http.py PASSED [ 8%] 8579s http/tests/test_core.py::test_scheduler <- ../../../../usr/lib/python3/dist-packages/distributed/http/tests/test_core.py PASSED [ 8%] 8579s http/tests/test_routing.py::test_basic <- ../../../../usr/lib/python3/dist-packages/distributed/http/tests/test_routing.py PASSED [ 8%] 8579s http/worker/tests/test_worker_http.py::test_prometheus <- ../../../../usr/lib/python3/dist-packages/distributed/http/worker/tests/test_worker_http.py PASSED [ 9%] 8579s http/worker/tests/test_worker_http.py::test_metrics_when_prometheus_client_not_installed <- ../../../../usr/lib/python3/dist-packages/distributed/http/worker/tests/test_worker_http.py PASSED [ 9%] 8579s http/worker/tests/test_worker_http.py::test_prometheus_collect_task_states <- ../../../../usr/lib/python3/dist-packages/distributed/http/worker/tests/test_worker_http.py PASSED [ 9%] 8579s http/worker/tests/test_worker_http.py::test_health <- ../../../../usr/lib/python3/dist-packages/distributed/http/worker/tests/test_worker_http.py SKIPPED [ 9%] 8580s http/worker/tests/test_worker_http.py::test_sitemap <- ../../../../usr/lib/python3/dist-packages/distributed/http/worker/tests/test_worker_http.py SKIPPED [ 9%] 8580s http/worker/tests/test_worker_http.py::test_prometheus_collect_memory_metrics <- ../../../../usr/lib/python3/dist-packages/distributed/http/worker/tests/test_worker_http.py PASSED [ 9%] 8580s http/worker/tests/test_worker_http.py::test_prometheus_collect_memory_metrics_spill_disabled <- ../../../../usr/lib/python3/dist-packages/distributed/http/worker/tests/test_worker_http.py PASSED [ 9%] 8580s http/worker/tests/test_worker_http.py::test_prometheus_collect_memory_metrics_bogus_sizeof <- ../../../../usr/lib/python3/dist-packages/distributed/http/worker/tests/test_worker_http.py SKIPPED [ 9%] 8580s protocol/tests/test_collection.py::test_serialize_collection[y0-dask-tuple] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_collection.py PASSED [ 9%] 8580s protocol/tests/test_collection.py::test_serialize_collection[y0-dask-dict] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_collection.py PASSED [ 9%] 8580s protocol/tests/test_collection.py::test_serialize_collection[y0-dask-list] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_collection.py PASSED [ 9%] 8580s protocol/tests/test_collection.py::test_serialize_collection[y1-pickle-tuple] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_collection.py PASSED [ 9%] 8580s protocol/tests/test_collection.py::test_serialize_collection[y1-pickle-dict] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_collection.py PASSED [ 9%] 8580s protocol/tests/test_collection.py::test_serialize_collection[y1-pickle-list] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_collection.py PASSED [ 9%] 8580s protocol/tests/test_collection.py::test_serialize_collection[None-pickle-tuple] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_collection.py PASSED [ 9%] 8580s protocol/tests/test_collection.py::test_serialize_collection[None-pickle-dict] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_collection.py PASSED [ 9%] 8580s protocol/tests/test_collection.py::test_serialize_collection[None-pickle-list] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_collection.py PASSED [ 9%] 8580s protocol/tests/test_collection.py::test_large_collections_serialize_simply <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_collection.py PASSED [ 9%] 8580s protocol/tests/test_collection.py::test_nested_types <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_collection.py PASSED [ 9%] 8580s protocol/tests/test_collection_cuda.py::test_serialize_cupy[50-cuda-tuple] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_collection_cuda.py SKIPPED [ 9%] 8580s protocol/tests/test_collection_cuda.py::test_serialize_cupy[50-cuda-dict] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_collection_cuda.py SKIPPED [ 9%] 8580s protocol/tests/test_collection_cuda.py::test_serialize_cupy[None-pickle-tuple] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_collection_cuda.py SKIPPED [ 9%] 8580s protocol/tests/test_collection_cuda.py::test_serialize_cupy[None-pickle-dict] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_collection_cuda.py SKIPPED [ 9%] 8580s protocol/tests/test_collection_cuda.py::test_serialize_pandas_pandas[df20-cuda-tuple] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_collection_cuda.py SKIPPED [ 9%] 8580s protocol/tests/test_collection_cuda.py::test_serialize_pandas_pandas[df20-cuda-dict] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_collection_cuda.py SKIPPED [ 9%] 8580s protocol/tests/test_collection_cuda.py::test_serialize_pandas_pandas[None-pickle-tuple] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_collection_cuda.py SKIPPED [ 9%] 8580s protocol/tests/test_collection_cuda.py::test_serialize_pandas_pandas[None-pickle-dict] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_collection_cuda.py SKIPPED [ 9%] 8580s protocol/tests/test_compression.py::test_get_compression_settings <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py PASSED [ 9%] 8580s protocol/tests/test_compression.py::test_auto_compression <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py PASSED [ 9%] 8580s protocol/tests/test_compression.py::test_compression_1 <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py PASSED [ 9%] 8580s protocol/tests/test_compression.py::test_compression_2 <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py PASSED [ 9%] 8580s protocol/tests/test_compression.py::test_compression_3 <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py PASSED [ 9%] 8580s protocol/tests/test_compression.py::test_compression_without_deserialization <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py PASSED [ 10%] 8580s protocol/tests/test_compression.py::test_lz4_decompression_avoids_deep_copy <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py SKIPPED [ 10%] 8580s protocol/tests/test_compression.py::test_maybe_compress[None-bytes] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py PASSED [ 10%] 8580s protocol/tests/test_compression.py::test_maybe_compress[None-memoryview] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py PASSED [ 10%] 8580s protocol/tests/test_compression.py::test_maybe_compress[zlib-bytes] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py PASSED [ 10%] 8580s protocol/tests/test_compression.py::test_maybe_compress[zlib-memoryview] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py PASSED [ 10%] 8580s protocol/tests/test_compression.py::test_maybe_compress[lz4-bytes] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py SKIPPED [ 10%] 8580s protocol/tests/test_compression.py::test_maybe_compress[lz4-memoryview] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py SKIPPED [ 10%] 8580s protocol/tests/test_compression.py::test_maybe_compress[snappy-bytes] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py SKIPPED [ 10%] 8580s protocol/tests/test_compression.py::test_maybe_compress[snappy-memoryview] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py SKIPPED [ 10%] 8580s protocol/tests/test_compression.py::test_maybe_compress[zstd-bytes] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py SKIPPED [ 10%] 8580s protocol/tests/test_compression.py::test_maybe_compress[zstd-memoryview] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py SKIPPED [ 10%] 8580s protocol/tests/test_compression.py::test_maybe_compress_sample[None] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py PASSED [ 10%] 8580s protocol/tests/test_compression.py::test_maybe_compress_sample[zlib] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py PASSED [ 10%] 8580s protocol/tests/test_compression.py::test_maybe_compress_sample[lz4] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py SKIPPED [ 10%] 8580s protocol/tests/test_compression.py::test_maybe_compress_sample[snappy] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py SKIPPED [ 10%] 8580s protocol/tests/test_compression.py::test_maybe_compress_sample[zstd] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py SKIPPED [ 10%] 8580s protocol/tests/test_compression.py::test_maybe_compress_memoryviews[None] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py PASSED [ 10%] 8581s protocol/tests/test_compression.py::test_maybe_compress_memoryviews[zlib] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py PASSED [ 10%] 8581s protocol/tests/test_compression.py::test_maybe_compress_memoryviews[lz4] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py SKIPPED [ 10%] 8581s protocol/tests/test_compression.py::test_maybe_compress_memoryviews[snappy] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py SKIPPED [ 10%] 8581s protocol/tests/test_compression.py::test_maybe_compress_memoryviews[zstd] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py SKIPPED [ 10%] 8581s protocol/tests/test_compression.py::test_maybe_compress_auto <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py PASSED [ 10%] 8581s protocol/tests/test_compression.py::test_compression_thread_safety[None-bytes] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py SKIPPED [ 10%] 8581s protocol/tests/test_compression.py::test_compression_thread_safety[None-memoryview] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py SKIPPED [ 10%] 8581s protocol/tests/test_compression.py::test_compression_thread_safety[zlib-bytes] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py SKIPPED [ 10%] 8581s protocol/tests/test_compression.py::test_compression_thread_safety[zlib-memoryview] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py SKIPPED [ 10%] 8581s protocol/tests/test_compression.py::test_compression_thread_safety[lz4-bytes] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py SKIPPED [ 10%] 8581s protocol/tests/test_compression.py::test_compression_thread_safety[lz4-memoryview] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py SKIPPED [ 10%] 8581s protocol/tests/test_compression.py::test_compression_thread_safety[snappy-bytes] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py SKIPPED [ 10%] 8581s protocol/tests/test_compression.py::test_compression_thread_safety[snappy-memoryview] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py SKIPPED [ 10%] 8581s protocol/tests/test_compression.py::test_compression_thread_safety[zstd-bytes] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py SKIPPED [ 10%] 8581s protocol/tests/test_compression.py::test_compression_thread_safety[zstd-memoryview] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py SKIPPED [ 11%] 8581s protocol/tests/test_compression.py::test_large_messages[None] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py SKIPPED [ 11%] 8581s protocol/tests/test_compression.py::test_large_messages[zlib] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py SKIPPED [ 11%] 8581s protocol/tests/test_compression.py::test_large_messages[lz4] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py SKIPPED [ 11%] 8581s protocol/tests/test_compression.py::test_large_messages[snappy] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py SKIPPED [ 11%] 8581s protocol/tests/test_compression.py::test_large_messages[zstd] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py SKIPPED [ 11%] 8581s protocol/tests/test_compression.py::test_loads_without_deserialization_avoids_compression <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py PASSED [ 11%] 8581s protocol/tests/test_compression.py::test_compress_remote_comms <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py PASSED [ 11%] 8581s protocol/tests/test_compression.py::test_disable_compression_on_localhost[None] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py PASSED [ 11%] 8581s protocol/tests/test_compression.py::test_disable_compression_on_localhost[127.0.0.1] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py PASSED [ 11%] 8581s protocol/tests/test_compression.py::test_disable_compression_on_localhost[localhost] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py PASSED [ 11%] 8581s protocol/tests/test_highlevelgraph.py::test_combo_of_layer_types <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_highlevelgraph.py PASSED [ 11%] 8582s protocol/tests/test_highlevelgraph.py::test_blockwise <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_highlevelgraph.py PASSED [ 11%] 8582s protocol/tests/test_highlevelgraph.py::test_shuffle <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_highlevelgraph.py PASSED [ 11%] 8582s protocol/tests/test_highlevelgraph.py::test_array_annotations <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_highlevelgraph.py PASSED [ 11%] 8583s protocol/tests/test_highlevelgraph.py::test_dataframe_annotations <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_highlevelgraph.py PASSED [ 11%] 8583s protocol/tests/test_numpy.py::test_serialize <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 11%] 8583s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x0] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 11%] 8583s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x1] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 11%] 8583s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x2] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 11%] 8583s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x3] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 11%] 8583s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x4] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 11%] 8583s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x5] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 11%] 8583s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x6] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 11%] 8583s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x7] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 11%] 8583s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x8] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 11%] 8583s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x9] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 11%] 8583s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x10] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 11%] 8583s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x11] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 11%] 8583s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x12] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 11%] 8583s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x13] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 11%] 8583s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x14] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 12%] 8583s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x15] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 12%] 8583s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x16] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 12%] 8583s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x17] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 12%] 8583s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x18] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 12%] 8583s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x19] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 12%] 8583s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x20] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 12%] 8583s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x21] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 12%] 8583s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x22] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 12%] 8583s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x23] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 12%] 8583s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x24] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 12%] 8583s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x25] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 12%] 8583s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x26] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 12%] 8583s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x27] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 12%] 8583s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x28] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 12%] 8583s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x29] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 12%] 8583s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x30] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 12%] 8583s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x31] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 12%] 8583s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x32] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 12%] 8583s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x33] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 12%] 8583s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x34] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 12%] 8583s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x35] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 12%] 8583s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x36] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 12%] 8583s protocol/tests/test_numpy.py::test_dumps_numpy_writable[True] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 12%] 8583s protocol/tests/test_numpy.py::test_dumps_numpy_writable[False] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 12%] 8583s protocol/tests/test_numpy.py::test_serialize_numpy_ma_masked_array[x0] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 12%] 8583s protocol/tests/test_numpy.py::test_serialize_numpy_ma_masked_array[x1] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 12%] 8583s protocol/tests/test_numpy.py::test_serialize_numpy_ma_masked_array[x2] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 12%] 8583s protocol/tests/test_numpy.py::test_serialize_numpy_ma_masked_array[x3] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 12%] 8583s protocol/tests/test_numpy.py::test_serialize_numpy_ma_masked_array[x4] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 12%] 8583s protocol/tests/test_numpy.py::test_serialize_numpy_ma_masked_array[x5] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 12%] 8583s protocol/tests/test_numpy.py::test_serialize_numpy_ma_masked <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 12%] 8583s protocol/tests/test_numpy.py::test_dumps_serialize_numpy_custom_dtype <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py SKIPPED [ 13%] 8583s protocol/tests/test_numpy.py::test_memmap <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 13%] 8583s protocol/tests/test_numpy.py::test_dumps_serialize_numpy_large <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py SKIPPED [ 13%] 8583s protocol/tests/test_numpy.py::test_itemsize[f8-8] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 13%] 8583s protocol/tests/test_numpy.py::test_itemsize[i4-4] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 13%] 8583s protocol/tests/test_numpy.py::test_itemsize[c16-16] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 13%] 8583s protocol/tests/test_numpy.py::test_itemsize[b-1] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 13%] 8583s protocol/tests/test_numpy.py::test_itemsize[S3-3] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 13%] 8583s protocol/tests/test_numpy.py::test_itemsize[M8[us]-8] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 13%] 8583s protocol/tests/test_numpy.py::test_itemsize[M8[s]-8] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 13%] 8583s protocol/tests/test_numpy.py::test_itemsize[U3-12] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 13%] 8583s protocol/tests/test_numpy.py::test_itemsize[dt8-12] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 13%] 8583s protocol/tests/test_numpy.py::test_itemsize[dt9-4] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 13%] 8583s protocol/tests/test_numpy.py::test_itemsize[dt10-8] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 13%] 8583s protocol/tests/test_numpy.py::test_itemsize[dt11-88] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 13%] 8583s protocol/tests/test_numpy.py::test_itemsize[dt12-8] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 13%] 8583s protocol/tests/test_numpy.py::test_compress_numpy <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 13%] 8583s protocol/tests/test_numpy.py::test_compress_memoryview <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 13%] 8584s protocol/tests/test_numpy.py::test_dumps_large <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 13%] 8584s protocol/tests/test_numpy.py::test_zero_strided_numpy_array[True-x0] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 13%] 8584s protocol/tests/test_numpy.py::test_zero_strided_numpy_array[True-x1] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 13%] 8584s protocol/tests/test_numpy.py::test_zero_strided_numpy_array[True-x2] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 13%] 8584s protocol/tests/test_numpy.py::test_zero_strided_numpy_array[True-x3] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 13%] 8584s protocol/tests/test_numpy.py::test_zero_strided_numpy_array[False-x0] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 13%] 8584s protocol/tests/test_numpy.py::test_zero_strided_numpy_array[False-x1] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 13%] 8584s protocol/tests/test_numpy.py::test_zero_strided_numpy_array[False-x2] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 13%] 8584s protocol/tests/test_numpy.py::test_zero_strided_numpy_array[False-x3] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 13%] 8584s protocol/tests/test_numpy.py::test_non_zero_strided_array <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 13%] 8584s protocol/tests/test_numpy.py::test_serialize_writeable_array_readonly_base_object <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 13%] 8584s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df0] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 13%] 8584s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df1] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 13%] 8584s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df2] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 13%] 8584s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df3] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 14%] 8584s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df4] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 14%] 8584s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df5] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 14%] 8584s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df6] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 14%] 8584s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df7] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 14%] 8584s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df8] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 14%] 8584s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df9] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 14%] 8584s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df10] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 14%] 8584s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df11] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 14%] 8584s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df12] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 14%] 8584s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df13] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 14%] 8584s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df14] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 14%] 8584s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df15] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 14%] 8584s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df16] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 14%] 8584s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df17] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 14%] 8584s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df18] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 14%] 8584s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df19] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 14%] 8584s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df20] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 14%] 8584s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df21] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 14%] 8584s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df22] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 14%] 8584s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df23] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 14%] 8584s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df24] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 14%] 8584s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df25] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 14%] 8584s protocol/tests/test_pandas.py::test_dumps_pandas_writable <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 14%] 8584s protocol/tests/test_pickle.py::test_pickle_data[4] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pickle.py PASSED [ 14%] 8584s protocol/tests/test_pickle.py::test_pickle_data[5] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pickle.py PASSED [ 14%] 8584s protocol/tests/test_pickle.py::test_pickle_out_of_band[4] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pickle.py PASSED [ 14%] 8584s protocol/tests/test_pickle.py::test_pickle_out_of_band[5] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pickle.py PASSED [ 14%] 8584s protocol/tests/test_pickle.py::test_pickle_empty[4] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pickle.py PASSED [ 14%] 8584s protocol/tests/test_pickle.py::test_pickle_empty[5] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pickle.py PASSED [ 14%] 8584s protocol/tests/test_pickle.py::test_pickle_numpy[4] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pickle.py PASSED [ 14%] 8584s protocol/tests/test_pickle.py::test_pickle_numpy[5] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pickle.py PASSED [ 14%] 8584s protocol/tests/test_pickle.py::test_pickle_functions[4] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pickle.py PASSED [ 15%] 8584s protocol/tests/test_pickle.py::test_pickle_functions[5] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pickle.py PASSED [ 15%] 8584s protocol/tests/test_pickle.py::test_pickle_by_value_when_registered <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pickle.py PASSED [ 15%] 8584s protocol/tests/test_pickle.py::test_allow_pickle_if_registered_in_dask_serialize <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pickle.py PASSED [ 15%] 8584s protocol/tests/test_pickle.py::test_nopickle_nested <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pickle.py PASSED [ 15%] 8584s protocol/tests/test_pickle.py::test_pickle_functions_in_main <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pickle.py SKIPPED [ 15%] 8584s protocol/tests/test_pickle.py::test_pickle_zero_copy_read_only_flag[dask] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pickle.py PASSED [ 15%] 8584s protocol/tests/test_pickle.py::test_pickle_zero_copy_read_only_flag[pickle] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pickle.py PASSED [ 15%] 8584s protocol/tests/test_protocol.py::test_protocol <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol.py PASSED [ 15%] 8584s protocol/tests/test_protocol.py::test_small <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol.py PASSED [ 15%] 8584s protocol/tests/test_protocol.py::test_small_and_big <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol.py PASSED [ 15%] 8584s protocol/tests/test_protocol.py::test_large_bytes[bytes] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol.py PASSED [ 15%] 8584s protocol/tests/test_protocol.py::test_large_bytes[memoryview] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol.py PASSED [ 15%] 8584s protocol/tests/test_protocol.py::test_large_messages_map <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol.py PASSED [ 15%] 8584s protocol/tests/test_protocol.py::test_loads_deserialize_False <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol.py PASSED [ 15%] 8584s protocol/tests/test_protocol.py::test_dumps_loads_Serialize <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol.py PASSED [ 15%] 8584s protocol/tests/test_protocol.py::test_dumps_loads_Serialized <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol.py PASSED [ 15%] 8584s protocol/tests/test_protocol.py::test_preserve_header[serializers0] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol.py PASSED [ 15%] 8584s protocol/tests/test_protocol.py::test_preserve_header[serializers1] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol.py PASSED [ 15%] 8584s protocol/tests/test_protocol.py::test_sizeof_serialize[Serialize-Serialized0] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol.py PASSED [ 15%] 8584s protocol/tests/test_protocol.py::test_sizeof_serialize[Serialize-Serialized1] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol.py PASSED [ 15%] 8584s protocol/tests/test_protocol.py::test_sizeof_serialize[ToPickle-Pickled] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol.py PASSED [ 15%] 8584s protocol/tests/test_protocol.py::test_fallback_to_pickle <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol.py PASSED [ 15%] 8584s protocol/tests/test_protocol.py::test_large_payload[bytes] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol.py SKIPPED [ 15%] 8584s protocol/tests/test_protocol.py::test_large_payload[str] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol.py SKIPPED [ 15%] 8584s protocol/tests/test_protocol.py::test_large_payload[ext] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol.py SKIPPED [ 15%] 8584s protocol/tests/test_protocol_utils.py::test_pack_frames <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 15%] 8584s protocol/tests/test_protocol_utils.py::test_unpack_frames_remainder[456] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 15%] 8584s protocol/tests/test_protocol_utils.py::test_unpack_frames_remainder[] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 15%] 8584s protocol/tests/test_protocol_utils.py::test_unpack_frames_partial <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 15%] 8584s protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_empty <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 15%] 8584s protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_one <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 15%] 8584s protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_parts[slices0] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 16%] 8584s protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_parts[slices1] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 16%] 8584s protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_parts[slices2] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 16%] 8584s protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_parts[slices3] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 16%] 8584s protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_parts[slices4] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 16%] 8584s protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_parts[slices5] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 16%] 8584s protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_parts[slices6] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 16%] 8584s protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_parts[slices7] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 16%] 8584s protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_parts[slices8] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 16%] 8584s protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_parts[slices9] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 16%] 8584s protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_readonly_buffer <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 16%] 8584s protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_catch_non_memoryview <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 16%] 8584s protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_catch_gaps[slices0] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 16%] 8584s protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_catch_gaps[slices1] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 16%] 8584s protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_catch_gaps[slices2] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 16%] 8584s protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_catch_different_buffer <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 16%] 8584s protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_catch_different_non_contiguous <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 16%] 8584s protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_catch_multidimensional <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 16%] 8584s protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_catch_different_formats <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 16%] 8584s protocol/tests/test_serialize.py::test_dumps_serialize <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 16%] 8584s protocol/tests/test_serialize.py::test_serialize_bytestrings <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 16%] 8584s protocol/tests/test_serialize.py::test_serialize_empty_array <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 16%] 8584s protocol/tests/test_serialize.py::test_serialize_arrays[b] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 16%] 8584s protocol/tests/test_serialize.py::test_serialize_arrays[B] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 16%] 8584s protocol/tests/test_serialize.py::test_serialize_arrays[h] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 16%] 8584s protocol/tests/test_serialize.py::test_serialize_arrays[H] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 16%] 8584s protocol/tests/test_serialize.py::test_serialize_arrays[i] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 16%] 8584s protocol/tests/test_serialize.py::test_serialize_arrays[I] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 16%] 8584s protocol/tests/test_serialize.py::test_serialize_arrays[l] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 16%] 8584s protocol/tests/test_serialize.py::test_serialize_arrays[L] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 16%] 8584s protocol/tests/test_serialize.py::test_serialize_arrays[q] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 16%] 8584s protocol/tests/test_serialize.py::test_serialize_arrays[Q] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 16%] 8584s protocol/tests/test_serialize.py::test_serialize_arrays[f] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 17%] 8584s protocol/tests/test_serialize.py::test_serialize_arrays[d] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 17%] 8584s protocol/tests/test_serialize.py::test_Serialize <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 17%] 8584s protocol/tests/test_serialize.py::test_Serialized <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 17%] 8584s protocol/tests/test_serialize.py::test_nested_deserialize <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 17%] 8584s protocol/tests/test_serialize.py::test_serialize_iterate_collection <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 17%] 8584s protocol/tests/test_serialize.py::test_object_in_graph <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 17%] 8584s protocol/tests/test_serialize.py::test_scatter <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 17%] 8584s protocol/tests/test_serialize.py::test_inter_worker_comms <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 17%] 8584s protocol/tests/test_serialize.py::test_empty <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 17%] 8584s protocol/tests/test_serialize.py::test_empty_loads <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 17%] 8584s protocol/tests/test_serialize.py::test_empty_loads_deep <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 17%] 8585s protocol/tests/test_serialize.py::test_serialize_bytes[kwargs0] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 17%] 8586s protocol/tests/test_serialize.py::test_serialize_bytes[kwargs1] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 17%] 8586s protocol/tests/test_serialize.py::test_serialize_bytes_numpy[kwargs0] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 17%] 8586s protocol/tests/test_serialize.py::test_serialize_bytes_numpy[kwargs1] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 17%] 8586s protocol/tests/test_serialize.py::test_deserialize_bytes_zero_copy_read_only <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 17%] 8586s protocol/tests/test_serialize.py::test_deserialize_bytes_zero_copy_writeable <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 17%] 8586s protocol/tests/test_serialize.py::test_serialize_list_compress <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 17%] 8586s protocol/tests/test_serialize.py::test_malicious_exception <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 17%] 8586s protocol/tests/test_serialize.py::test_err_on_bad_deserializer <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 17%] 8586s protocol/tests/test_serialize.py::test_context_specific_serialization <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 17%] 8586s protocol/tests/test_serialize.py::test_context_specific_serialization_class <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 17%] 8586s protocol/tests/test_serialize.py::test_serialize_raises <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 17%] 8586s protocol/tests/test_serialize.py::test_different_compression_families <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 17%] 8586s protocol/tests/test_serialize.py::test_frame_split <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 17%] 8586s protocol/tests/test_serialize.py::test_check_dask_serializable[data0-False] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 17%] 8586s protocol/tests/test_serialize.py::test_check_dask_serializable[data1-False] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 17%] 8586s protocol/tests/test_serialize.py::test_check_dask_serializable[data2-False] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 17%] 8586s protocol/tests/test_serialize.py::test_check_dask_serializable[data3-False] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 17%] 8586s protocol/tests/test_serialize.py::test_check_dask_serializable[data4-False] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 17%] 8586s protocol/tests/test_serialize.py::test_check_dask_serializable[data5-True] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 18%] 8586s protocol/tests/test_serialize.py::test_check_dask_serializable[data6-True] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 18%] 8586s protocol/tests/test_serialize.py::test_check_dask_serializable[data7-True] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py XFAIL [ 18%] 8586s protocol/tests/test_serialize.py::test_check_dask_serializable[data8-True] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 18%] 8586s protocol/tests/test_serialize.py::test_check_dask_serializable[data9-True] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 18%] 8586s protocol/tests/test_serialize.py::test_check_dask_serializable[data10-True] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 18%] 8586s protocol/tests/test_serialize.py::test_check_dask_serializable[data11-True] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 18%] 8586s protocol/tests/test_serialize.py::test_check_dask_serializable[data12-True] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 18%] 8586s protocol/tests/test_serialize.py::test_serialize_lists[serializers0] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 18%] 8586s protocol/tests/test_serialize.py::test_serialize_lists[serializers1] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 18%] 8586s protocol/tests/test_serialize.py::test_serialize_lists[serializers2] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 18%] 8586s protocol/tests/test_serialize.py::test_serialize_lists[serializers3] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 18%] 8586s protocol/tests/test_serialize.py::test_deser_memoryview[data_in0] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 18%] 8586s protocol/tests/test_serialize.py::test_deser_memoryview[data_in1] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 18%] 8586s protocol/tests/test_serialize.py::test_ser_memoryview_object <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 18%] 8586s protocol/tests/test_serialize.py::test_ser_empty_1d_memoryview <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 18%] 8586s protocol/tests/test_serialize.py::test_ser_empty_nd_memoryview <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 18%] 8588s protocol/tests/test_serialize.py::test_large_pickled_object <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 18%] 8588s protocol/tests/test_serialize.py::test__is_msgpack_serializable <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 18%] 8588s protocol/tests/test_to_pickle.py::test_ToPickle <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_to_pickle.py PASSED [ 18%] 8588s protocol/tests/test_utils.py::test_host_array <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_utils.py PASSED [ 18%] 8588s protocol/tests/test_utils.py::test_host_array_from_buffers <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_utils.py PASSED [ 18%] 8588s protocol/tests/test_utils.py::test_host_array_from_buffers_numpy <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_utils.py PASSED [ 18%] 8588s protocol/tests/test_utils_test.py::test_get_host_array <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_utils_test.py PASSED [ 18%] 8589s shuffle/tests/test_buffer.py::test_memory_limit[big_payloads0] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_buffer.py PASSED [ 18%] 8589s shuffle/tests/test_buffer.py::test_memory_limit[big_payloads1] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_buffer.py PASSED [ 18%] 8590s shuffle/tests/test_buffer.py::test_memory_limit[big_payloads2] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_buffer.py PASSED [ 18%] 8590s shuffle/tests/test_buffer.py::test_memory_limit[big_payloads3] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_buffer.py PASSED [ 18%] 8590s shuffle/tests/test_buffer.py::test_memory_limit_blocked_exception <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_buffer.py PASSED [ 18%] 8590s shuffle/tests/test_comm_buffer.py::test_basic <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_comm_buffer.py PASSED [ 18%] 8590s shuffle/tests/test_comm_buffer.py::test_exceptions <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_comm_buffer.py PASSED [ 18%] 8590s shuffle/tests/test_comm_buffer.py::test_slow_send <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_comm_buffer.py PASSED [ 18%] 8590s shuffle/tests/test_comm_buffer.py::test_concurrent_puts <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_comm_buffer.py PASSED [ 19%] 8590s shuffle/tests/test_comm_buffer.py::test_concurrent_puts_error <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_comm_buffer.py PASSED [ 19%] 8590s shuffle/tests/test_core.py::test_mean_shard_size <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_core.py PASSED [ 19%] 8590s shuffle/tests/test_core.py::test_mean_shard_size_numpy <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_core.py PASSED [ 19%] 8590s shuffle/tests/test_disk_buffer.py::test_basic <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_disk_buffer.py PASSED [ 19%] 8590s shuffle/tests/test_disk_buffer.py::test_read_before_flush <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_disk_buffer.py PASSED [ 19%] 8590s shuffle/tests/test_disk_buffer.py::test_many[2] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_disk_buffer.py PASSED [ 19%] 8590s shuffle/tests/test_disk_buffer.py::test_many[100] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_disk_buffer.py PASSED [ 19%] 8591s shuffle/tests/test_disk_buffer.py::test_many[1000] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_disk_buffer.py PASSED [ 19%] 8591s shuffle/tests/test_disk_buffer.py::test_exceptions <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_disk_buffer.py PASSED [ 19%] 8591s shuffle/tests/test_disk_buffer.py::test_high_pressure_flush_with_exception <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_disk_buffer.py PASSED [ 19%] 8591s shuffle/tests/test_limiter.py::test_limiter_basic <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_limiter.py PASSED [ 19%] 8591s shuffle/tests/test_limiter.py::test_unlimited_limiter <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_limiter.py PASSED [ 19%] 8591s shuffle/tests/test_limiter.py::test_limiter_concurrent_decrease_releases_waiter <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_limiter.py PASSED [ 19%] 8591s shuffle/tests/test_limiter.py::test_limiter_statistics <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_limiter.py PASSED [ 19%] 8591s shuffle/tests/test_limiter.py::test_limiter_no_limit_no_statistics <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_limiter.py PASSED [ 19%] 8591s shuffle/tests/test_memory_buffer.py::test_basic <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_memory_buffer.py PASSED [ 19%] 8591s shuffle/tests/test_memory_buffer.py::test_read_before_flush <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_memory_buffer.py PASSED [ 19%] 8591s shuffle/tests/test_memory_buffer.py::test_many[2] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_memory_buffer.py PASSED [ 19%] 8591s shuffle/tests/test_memory_buffer.py::test_many[100] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_memory_buffer.py PASSED [ 19%] 8591s shuffle/tests/test_memory_buffer.py::test_many[1000] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_memory_buffer.py PASSED [ 19%] 8591s shuffle/tests/test_pickle.py::test_pickle <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_pickle.py PASSED [ 19%] 8591s shuffle/tests/test_pickle.py::test_pickle_numpy <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_pickle.py PASSED [ 19%] 8591s shuffle/tests/test_pickle.py::test_pickle_zero_copy <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_pickle.py PASSED [ 19%] 8591s shuffle/tests/test_read_write_lock.py::test_basic <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_read_write_lock.py PASSED [ 19%] 8592s shuffle/tests/test_read_write_lock.py::test_lock_timeout <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_read_write_lock.py PASSED [ 19%] 8592s shuffle/tests/test_read_write_lock.py::test_concurrent_reads_are_allowed <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_read_write_lock.py PASSED [ 19%] 8592s shuffle/tests/test_read_write_lock.py::test_read_blocks_write <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_read_write_lock.py PASSED [ 19%] 8592s shuffle/tests/test_read_write_lock.py::test_write_blocks_read <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_read_write_lock.py PASSED [ 19%] 8592s shuffle/tests/test_read_write_lock.py::test_write_blocks_write <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_read_write_lock.py PASSED [ 19%] 8592s shuffle/tests/test_read_write_lock.py::test_write_preferred_over_read <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_read_write_lock.py PASSED [ 19%] 8592s shuffle/tests/test_rechunk.py::test_lowlevel_rechunk[True-True-1] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 19%] 8592s shuffle/tests/test_rechunk.py::test_lowlevel_rechunk[True-True-10] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 20%] 8592s shuffle/tests/test_rechunk.py::test_lowlevel_rechunk[True-False-1] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 20%] 8592s shuffle/tests/test_rechunk.py::test_lowlevel_rechunk[True-False-10] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 20%] 8592s shuffle/tests/test_rechunk.py::test_lowlevel_rechunk[False-True-1] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 20%] 8593s shuffle/tests/test_rechunk.py::test_lowlevel_rechunk[False-True-10] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 20%] 8593s shuffle/tests/test_rechunk.py::test_lowlevel_rechunk[False-False-1] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 20%] 8593s shuffle/tests/test_rechunk.py::test_lowlevel_rechunk[False-False-10] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 20%] 8593s shuffle/tests/test_rechunk.py::test_rechunk_configuration[tasks-tasks] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 20%] 8593s shuffle/tests/test_rechunk.py::test_rechunk_configuration[tasks-p2p] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 20%] 8593s shuffle/tests/test_rechunk.py::test_rechunk_configuration[tasks-None] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 20%] 8593s shuffle/tests/test_rechunk.py::test_rechunk_configuration[p2p-tasks] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 20%] 8593s shuffle/tests/test_rechunk.py::test_rechunk_configuration[p2p-p2p] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 20%] 8594s shuffle/tests/test_rechunk.py::test_rechunk_configuration[p2p-None] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 20%] 8594s shuffle/tests/test_rechunk.py::test_rechunk_configuration[None-tasks] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 20%] 8594s shuffle/tests/test_rechunk.py::test_rechunk_configuration[None-p2p] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 20%] 8594s shuffle/tests/test_rechunk.py::test_rechunk_configuration[None-None] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 20%] 8595s shuffle/tests/test_rechunk.py::test_cull_p2p_rechunk_independent_partitions <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 20%] 8595s shuffle/tests/test_rechunk.py::test_cull_p2p_rechunk_overlapping_partitions <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 20%] 8595s shuffle/tests/test_rechunk.py::test_rechunk_2d[True] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 20%] 8595s shuffle/tests/test_rechunk.py::test_rechunk_2d[False] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 20%] 8596s shuffle/tests/test_rechunk.py::test_rechunk_4d[True] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 20%] 8596s shuffle/tests/test_rechunk.py::test_rechunk_4d[False] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 20%] 8596s shuffle/tests/test_rechunk.py::test_rechunk_expand <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 20%] 8596s shuffle/tests/test_rechunk.py::test_rechunk_expand2 <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 20%] 8605s shuffle/tests/test_rechunk.py::test_rechunk_method <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 20%] 8605s shuffle/tests/test_rechunk.py::test_rechunk_blockshape <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 20%] 8605s shuffle/tests/test_rechunk.py::test_dtype <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 20%] 8605s shuffle/tests/test_rechunk.py::test_rechunk_with_dict <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 20%] 8605s shuffle/tests/test_rechunk.py::test_rechunk_with_empty_input <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 20%] 8605s shuffle/tests/test_rechunk.py::test_rechunk_with_null_dimensions <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 20%] 8606s shuffle/tests/test_rechunk.py::test_rechunk_with_integer <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 20%] 8606s shuffle/tests/test_rechunk.py::test_rechunk_0d <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 20%] 8606s shuffle/tests/test_rechunk.py::test_rechunk_empty_array[arr0] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 21%] 8606s shuffle/tests/test_rechunk.py::test_rechunk_empty_array[arr1] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 21%] 8606s shuffle/tests/test_rechunk.py::test_rechunk_empty_array[arr2] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 21%] 8606s shuffle/tests/test_rechunk.py::test_rechunk_empty <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 21%] 8606s shuffle/tests/test_rechunk.py::test_rechunk_zero_dim_array <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 21%] 8606s shuffle/tests/test_rechunk.py::test_rechunk_zero_dim_array_II <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 21%] 8606s shuffle/tests/test_rechunk.py::test_rechunk_same <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 21%] 8606s shuffle/tests/test_rechunk.py::test_rechunk_same_fully_unknown <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 21%] 8607s shuffle/tests/test_rechunk.py::test_rechunk_same_fully_unknown_floats <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 21%] 8607s shuffle/tests/test_rechunk.py::test_rechunk_same_partially_unknown <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 21%] 8607s shuffle/tests/test_rechunk.py::test_rechunk_with_zero_placeholders <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 21%] 8607s shuffle/tests/test_rechunk.py::test_rechunk_minus_one <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 21%] 8607s shuffle/tests/test_rechunk.py::test_rechunk_warning <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 21%] 8607s shuffle/tests/test_rechunk.py::test_rechunk_unknown_from_pandas <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 21%] 8607s shuffle/tests/test_rechunk.py::test_rechunk_unknown_from_array <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 21%] 8608s shuffle/tests/test_rechunk.py::test_rechunk_with_fully_unknown_dimension[x0-chunks0] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 21%] 8608s shuffle/tests/test_rechunk.py::test_rechunk_with_fully_unknown_dimension[x1-chunks1] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 21%] 8608s shuffle/tests/test_rechunk.py::test_rechunk_with_fully_unknown_dimension[x2-chunks2] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 21%] 8610s shuffle/tests/test_rechunk.py::test_rechunk_with_fully_unknown_dimension[x3-chunks3] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 21%] 8612s shuffle/tests/test_rechunk.py::test_rechunk_with_fully_unknown_dimension[x4-chunks4] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 21%] 8613s shuffle/tests/test_rechunk.py::test_rechunk_with_fully_unknown_dimension[x5-chunks5] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 21%] 8614s shuffle/tests/test_rechunk.py::test_rechunk_with_fully_unknown_dimension[x6-chunks6] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 21%] 8614s shuffle/tests/test_rechunk.py::test_rechunk_with_fully_unknown_dimension[x7-chunks7] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 21%] 8614s shuffle/tests/test_rechunk.py::test_rechunk_with_fully_unknown_dimension[x8-chunks8] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 21%] 8614s shuffle/tests/test_rechunk.py::test_rechunk_with_fully_unknown_dimension[x9-chunks9] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 21%] 8614s shuffle/tests/test_rechunk.py::test_rechunk_with_fully_unknown_dimension[x10-chunks10] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 21%] 8615s shuffle/tests/test_rechunk.py::test_rechunk_with_fully_unknown_dimension[x11-chunks11] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 21%] 8615s shuffle/tests/test_rechunk.py::test_rechunk_with_partially_unknown_dimension[x0-chunks0] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 21%] 8615s shuffle/tests/test_rechunk.py::test_rechunk_with_partially_unknown_dimension[x1-chunks1] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 21%] 8616s shuffle/tests/test_rechunk.py::test_rechunk_with_partially_unknown_dimension[x2-chunks2] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 21%] 8619s shuffle/tests/test_rechunk.py::test_rechunk_with_partially_unknown_dimension[x3-chunks3] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 21%] 8623s shuffle/tests/test_rechunk.py::test_rechunk_with_partially_unknown_dimension[x4-chunks4] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 21%] 8626s shuffle/tests/test_rechunk.py::test_rechunk_with_partially_unknown_dimension[x5-chunks5] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 22%] 8626s shuffle/tests/test_rechunk.py::test_rechunk_with_partially_unknown_dimension[x6-chunks6] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 22%] 8627s shuffle/tests/test_rechunk.py::test_rechunk_with_partially_unknown_dimension[x7-chunks7] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 22%] 8627s shuffle/tests/test_rechunk.py::test_rechunk_with_partially_unknown_dimension[x8-chunks8] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 22%] 8627s shuffle/tests/test_rechunk.py::test_rechunk_with_partially_unknown_dimension[x9-chunks9] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 22%] 8627s shuffle/tests/test_rechunk.py::test_rechunk_with_partially_unknown_dimension[x10-chunks10] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 22%] 8628s shuffle/tests/test_rechunk.py::test_rechunk_with_partially_unknown_dimension[x11-chunks11] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 22%] 8628s shuffle/tests/test_rechunk.py::test_rechunk_with_fully_unknown_dimension_explicit[new_chunks0] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 22%] 8628s shuffle/tests/test_rechunk.py::test_rechunk_with_fully_unknown_dimension_explicit[new_chunks1] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 22%] 8629s shuffle/tests/test_rechunk.py::test_rechunk_with_fully_unknown_dimension_explicit[new_chunks2] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 22%] 8629s shuffle/tests/test_rechunk.py::test_rechunk_unknown_raises <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 22%] 8629s shuffle/tests/test_rechunk.py::test_rechunk_zero_dim <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 22%] 8629s shuffle/tests/test_rechunk.py::test_rechunk_empty_chunks <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 22%] 8629s shuffle/tests/test_rechunk.py::test_rechunk_avoid_needless_chunking <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 22%] 8629s shuffle/tests/test_rechunk.py::test_rechunk_auto_1d[100-1-10-expected0] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 22%] 8629s shuffle/tests/test_rechunk.py::test_rechunk_auto_1d[100-50-10-expected1] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 22%] 8630s shuffle/tests/test_rechunk.py::test_rechunk_auto_1d[100-100-10-expected2] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 22%] 8630s shuffle/tests/test_rechunk.py::test_rechunk_auto_1d[20-7-10-expected3] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 22%] 8630s shuffle/tests/test_rechunk.py::test_rechunk_auto_1d[20-chunks4-5-expected4] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 22%] 8630s shuffle/tests/test_rechunk.py::test_rechunk_auto_2d <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 22%] 8630s shuffle/tests/test_rechunk.py::test_rechunk_auto_3d <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 22%] 8630s shuffle/tests/test_rechunk.py::test_rechunk_auto_image_stack[100] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 22%] 8630s shuffle/tests/test_rechunk.py::test_rechunk_auto_image_stack[1000] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 22%] 8630s shuffle/tests/test_rechunk.py::test_rechunk_down <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 22%] 8630s shuffle/tests/test_rechunk.py::test_rechunk_zero <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 22%] 8630s shuffle/tests/test_rechunk.py::test_rechunk_bad_keys <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 22%] 8631s shuffle/tests/test_rechunk.py::test_rechunk_with_zero <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 22%] 8631s shuffle/tests/test_rechunk.py::test_split_axes_1 <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 22%] 8631s shuffle/tests/test_rechunk.py::test_split_axes_2 <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 22%] 8631s shuffle/tests/test_rechunk.py::test_split_axes_nan <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 22%] 8631s shuffle/tests/test_rechunk.py::test_split_axes_nan_single <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 22%] 8631s shuffle/tests/test_rechunk.py::test_split_axes_nan_long <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 22%] 8631s shuffle/tests/test_rechunk.py::test_split_axes_with_nonzero <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 23%] 8631s shuffle/tests/test_rechunk.py::test_split_axes_with_zero <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 23%] 8631s shuffle/tests/test_rechunk.py::test_preserve_writeable_flag <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 23%] 8631s shuffle/tests/test_rechunk.py::test_rechunk_in_memory_shards_dont_share_buffer <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 23%] 8631s shuffle/tests/test_rechunk.py::test_pick_worker_homogeneous_distribution[1] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 23%] 8631s shuffle/tests/test_rechunk.py::test_pick_worker_homogeneous_distribution[2] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 23%] 8631s shuffle/tests/test_rechunk.py::test_pick_worker_homogeneous_distribution[41] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 23%] 8631s shuffle/tests/test_rechunk.py::test_pick_worker_homogeneous_distribution[50] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 23%] 8631s shuffle/tests/test_rechunk.py::test_partial_rechunk_homogeneous_distribution <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py SKIPPED [ 23%] 8632s shuffle/tests/test_rechunk.py::test_partial_rechunk_taskgroups <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 23%] 8632s shuffle/tests/test_shuffle_plugins.py::test_installation_on_worker <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_shuffle_plugins.py PASSED [ 23%] 8632s shuffle/tests/test_shuffle_plugins.py::test_installation_on_scheduler <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_shuffle_plugins.py PASSED [ 23%] 8632s tests/test_active_memory_manager.py::test_no_policies <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 23%] 8632s tests/test_active_memory_manager.py::test_drop <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 23%] 8633s tests/test_active_memory_manager.py::test_start_stop <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 23%] 8633s tests/test_active_memory_manager.py::test_auto_start <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 23%] 8633s tests/test_active_memory_manager.py::test_add_policy <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 23%] 8634s tests/test_active_memory_manager.py::test_multi_start <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 23%] 8634s tests/test_active_memory_manager.py::test_not_registered <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 23%] 8635s tests/test_active_memory_manager.py::test_client_proxy_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 23%] 8635s tests/test_active_memory_manager.py::test_client_proxy_async <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 23%] 8635s tests/test_active_memory_manager.py::test_drop_not_in_memory <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 23%] 8636s tests/test_active_memory_manager.py::test_drop_with_waiter <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 23%] 8637s tests/test_active_memory_manager.py::test_double_drop <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 23%] 8637s tests/test_active_memory_manager.py::test_double_drop_stress <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 23%] 8637s tests/test_active_memory_manager.py::test_drop_from_worker_with_least_free_memory <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 23%] 8637s tests/test_active_memory_manager.py::test_drop_with_candidates <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 23%] 8638s tests/test_active_memory_manager.py::test_drop_with_empty_candidates <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 23%] 8638s tests/test_active_memory_manager.py::test_drop_from_candidates_without_key <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 23%] 8638s tests/test_active_memory_manager.py::test_drop_with_bad_candidates <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 23%] 8638s tests/test_active_memory_manager.py::test_drop_prefers_paused_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 23%] 8639s tests/test_active_memory_manager.py::test_drop_with_paused_workers_with_running_tasks_1 <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 24%] 8639s tests/test_active_memory_manager.py::test_drop_with_paused_workers_with_running_tasks_2 <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 24%] 8639s tests/test_active_memory_manager.py::test_drop_with_paused_workers_with_running_tasks_3_4[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 24%] 8639s tests/test_active_memory_manager.py::test_drop_with_paused_workers_with_running_tasks_3_4[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 24%] 8639s tests/test_active_memory_manager.py::test_drop_with_paused_workers_with_running_tasks_5 <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 24%] 8640s tests/test_active_memory_manager.py::test_replicate <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 24%] 8640s tests/test_active_memory_manager.py::test_replicate_not_in_memory <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 24%] 8640s tests/test_active_memory_manager.py::test_double_replicate_stress <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 24%] 8640s tests/test_active_memory_manager.py::test_replicate_to_worker_with_most_free_memory <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 24%] 8640s tests/test_active_memory_manager.py::test_replicate_with_candidates <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 24%] 8640s tests/test_active_memory_manager.py::test_replicate_with_empty_candidates <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 24%] 8641s tests/test_active_memory_manager.py::test_replicate_to_candidates_with_key <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 24%] 8641s tests/test_active_memory_manager.py::test_replicate_avoids_paused_workers_1 <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 24%] 8641s tests/test_active_memory_manager.py::test_replicate_avoids_paused_workers_2 <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 24%] 8641s tests/test_active_memory_manager.py::test_bad_measure <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 24%] 8641s tests/test_active_memory_manager.py::test_ReduceReplicas <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 24%] 8642s tests/test_active_memory_manager.py::test_ReduceReplicas_with_waiters[0-0-0-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 24%] 8642s tests/test_active_memory_manager.py::test_ReduceReplicas_with_waiters[1-0-0-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 24%] 8643s tests/test_active_memory_manager.py::test_ReduceReplicas_with_waiters[0-0-1-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 24%] 8643s tests/test_active_memory_manager.py::test_ReduceReplicas_with_waiters[2-0-0-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 24%] 8643s tests/test_active_memory_manager.py::test_ReduceReplicas_with_waiters[1-1-0-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 24%] 8644s tests/test_active_memory_manager.py::test_ReduceReplicas_with_waiters[1-1-1-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 24%] 8644s tests/test_active_memory_manager.py::test_ReduceReplicas_with_waiters[1-1-2-4] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 24%] 8645s tests/test_active_memory_manager.py::test_ReduceReplicas_with_waiters[2-1-1-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 24%] 8645s tests/test_active_memory_manager.py::test_ReduceReplicas_with_waiters[1-1-17-4] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 24%] 8645s tests/test_active_memory_manager.py::test_ReduceReplicas_with_waiters[17-1-1-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 24%] 8646s tests/test_active_memory_manager.py::test_ReduceReplicas_with_waiters[18-1-1-4] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 24%] 8646s tests/test_active_memory_manager.py::test_RetireWorker_amm_on_off[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 24%] 8646s tests/test_active_memory_manager.py::test_RetireWorker_amm_on_off[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 24%] 8646s tests/test_active_memory_manager.py::test_RetireWorker_no_extension <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 24%] 8646s tests/test_active_memory_manager.py::test_RetireWorker_no_remove <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 24%] 8646s tests/test_active_memory_manager.py::test_RetireWorker_with_ReduceReplicas[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 24%] 8646s tests/test_active_memory_manager.py::test_RetireWorker_with_ReduceReplicas[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 25%] 8647s tests/test_active_memory_manager.py::test_RetireWorker_all_replicas_are_being_retired <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 25%] 8647s tests/test_active_memory_manager.py::test_RetireWorker_no_recipients <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 25%] 8647s tests/test_active_memory_manager.py::test_RetireWorker_all_recipients_are_paused <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 25%] 8648s tests/test_active_memory_manager.py::test_RetireWorker_new_keys_arrive_after_all_keys_moved_away <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 25%] 8648s tests/test_active_memory_manager.py::test_RetireWorker_faulty_recipient <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 25%] 8648s tests/test_active_memory_manager.py::test_RetireWorker_mass <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 25%] 8648s tests/test_active_memory_manager.py::test_RetireWorker_incremental <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 25%] 8649s tests/test_active_memory_manager.py::test_dont_drop_actors <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 25%] 8649s tests/test_active_memory_manager.py::test_dont_replicate_actors <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 25%] 8649s tests/test_active_memory_manager.py::test_RetireWorker_with_actor[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 25%] 8649s tests/test_active_memory_manager.py::test_RetireWorker_with_actor[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 25%] 8649s tests/test_active_memory_manager.py::test_RetireWorker_with_actor_proxy <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 25%] 8649s tests/test_active_memory_manager.py::test_noamm_stress <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py SKIPPED [ 25%] 8649s tests/test_active_memory_manager.py::test_drop_stress <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py SKIPPED [ 25%] 8649s tests/test_active_memory_manager.py::test_ReduceReplicas_stress <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py SKIPPED [ 25%] 8649s tests/test_active_memory_manager.py::test_RetireWorker_stress[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py SKIPPED [ 25%] 8649s tests/test_active_memory_manager.py::test_RetireWorker_stress[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py SKIPPED [ 25%] 8650s tests/test_actor.py::test_client_actions[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 25%] 8650s tests/test_actor.py::test_client_actions[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 25%] 8650s tests/test_actor.py::test_worker_actions[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 25%] 8650s tests/test_actor.py::test_worker_actions[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 25%] 8650s tests/test_actor.py::test_Actor <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 25%] 8651s tests/test_actor.py::test_linear_access <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py XFAILges rather than 8651s rpc) [ 25%] 8651s tests/test_actor.py::test_exceptions_create <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 25%] 8651s tests/test_actor.py::test_exceptions_method <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 25%] 8651s tests/test_actor.py::test_gc <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 25%] 8652s tests/test_actor.py::test_track_dependencies <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 25%] 8652s tests/test_actor.py::test_future <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 25%] 8652s tests/test_actor.py::test_future_dependencies <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 25%] 8653s tests/test_actor.py::test_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 25%] 8655s tests/test_actor.py::test_timeout <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 25%] 8655s tests/test_actor.py::test_failed_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 26%] 8655s tests/test_actor.py::test_numpy_roundtrip <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 26%] 8655s tests/test_actor.py::test_numpy_roundtrip_getattr <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 26%] 8655s tests/test_actor.py::test_repr <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 26%] 8655s tests/test_actor.py::test_dir <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 26%] 8655s tests/test_actor.py::test_many_computations <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 26%] 8656s tests/test_actor.py::test_thread_safety <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 26%] 8656s tests/test_actor.py::test_Actors_create_dependencies <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 26%] 8656s tests/test_actor.py::test_load_balance <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 26%] 8656s tests/test_actor.py::test_load_balance_map <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 26%] 8656s tests/test_actor.py::test_compute <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 26%] 8658s tests/test_actor.py::test_compute_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 26%] 8658s tests/test_actor.py::test_actors_in_profile <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 26%] 8658s tests/test_actor.py::test_waiter <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 26%] 8658s tests/test_actor.py::test_worker_actor_handle_is_weakref <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 26%] 8660s tests/test_actor.py::test_worker_actor_handle_is_weakref_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 26%] 8661s tests/test_actor.py::test_worker_actor_handle_is_weakref_from_compute_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 26%] 8663s tests/test_actor.py::test_one_thread_deadlock <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 26%] 8664s tests/test_actor.py::test_one_thread_deadlock_timeout <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 26%] 8666s tests/test_actor.py::test_one_thread_deadlock_sync_client <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 26%] 8666s tests/test_actor.py::test_async_deadlock <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 26%] 8667s tests/test_actor.py::test_exception <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 26%] 8667s tests/test_actor.py::test_exception_async <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 26%] 8669s tests/test_actor.py::test_as_completed <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 26%] 8669s tests/test_actor.py::test_actor_future_awaitable <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 26%] 8669s tests/test_actor.py::test_actor_future_awaitable_deadlock <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 26%] 8669s tests/test_actor.py::test_serialize_with_pickle <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 26%] 8669s tests/test_actor.py::test_worker_client_async <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 26%] 8669s tests/test_actor.py::test_worker_client_separate_thread <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 26%] 8669s tests/test_actor.py::test_get_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 26%] 8669s tests/test_as_completed.py::test_as_completed_async <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_as_completed.py PASSED [ 26%] 8670s tests/test_as_completed.py::test_as_completed_timeout_async <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_as_completed.py PASSED [ 26%] 8672s tests/test_as_completed.py::test_as_completed_timeout_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_as_completed.py PASSED [ 27%] 8674s tests/test_as_completed.py::test_as_completed_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_as_completed.py PASSED [ 27%] 8675s tests/test_as_completed.py::test_as_completed_with_non_futures <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_as_completed.py PASSED [ 27%] 8677s tests/test_as_completed.py::test_as_completed_add <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_as_completed.py PASSED [ 27%] 8678s tests/test_as_completed.py::test_as_completed_update <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_as_completed.py PASSED [ 27%] 8680s tests/test_as_completed.py::test_as_completed_repeats <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_as_completed.py PASSED [ 27%] 8681s tests/test_as_completed.py::test_as_completed_is_empty <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_as_completed.py PASSED [ 27%] 8682s tests/test_as_completed.py::test_as_completed_cancel <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_as_completed.py PASSED [ 27%] 8684s tests/test_as_completed.py::test_as_completed_cancel_last <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_as_completed.py PASSED [ 27%] 8684s tests/test_as_completed.py::test_async_for_py2_equivalent <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_as_completed.py PASSED [ 27%] 8684s tests/test_as_completed.py::test_as_completed_error_async <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_as_completed.py PASSED [ 27%] 8686s tests/test_as_completed.py::test_as_completed_error <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_as_completed.py PASSED [ 27%] 8687s tests/test_as_completed.py::test_as_completed_with_results <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_as_completed.py PASSED [ 27%] 8687s tests/test_as_completed.py::test_as_completed_with_results_async <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_as_completed.py PASSED [ 27%] 8690s tests/test_as_completed.py::test_as_completed_with_results_no_raise <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_as_completed.py PASSED [ 27%] 8690s tests/test_as_completed.py::test_str <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_as_completed.py PASSED [ 27%] 8690s tests/test_as_completed.py::test_as_completed_with_results_no_raise_async <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_as_completed.py PASSED [ 27%] 8690s tests/test_as_completed.py::test_clear <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_as_completed.py PASSED [ 27%] 8690s tests/test_asyncio.py::test_rlock <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_asyncio.py PASSED [ 27%] 8690s tests/test_asyncio.py::test_rlock_nonreentrant <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_asyncio.py PASSED [ 27%] 8690s tests/test_asyncio.py::test_rlock_none <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_asyncio.py PASSED [ 27%] 8690s tests/test_asyncio.py::test_rlock_release_on_raise <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_asyncio.py PASSED [ 27%] 8690s tests/test_asyncprocess.py::test_simple <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_asyncprocess.py PASSED [ 27%] 8691s tests/test_asyncprocess.py::test_exitcode <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_asyncprocess.py PASSED [ 27%] 8692s tests/test_asyncprocess.py::test_sigint_from_same_process <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_asyncprocess.py PASSED [ 27%] 8692s tests/test_asyncprocess.py::test_sigterm_from_parent_process <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_asyncprocess.py PASSED [ 27%] 8692s tests/test_asyncprocess.py::test_terminate <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_asyncprocess.py PASSED [ 27%] 8692s tests/test_asyncprocess.py::test_close <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_asyncprocess.py PASSED [ 27%] 8693s tests/test_asyncprocess.py::test_exit_callback <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_asyncprocess.py PASSED [ 27%] 8694s tests/test_asyncprocess.py::test_child_main_thread <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_asyncprocess.py PASSED [ 27%] 8696s tests/test_asyncprocess.py::test_num_fds <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_asyncprocess.py PASSED [ 27%] 8696s tests/test_asyncprocess.py::test_terminate_after_stop <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_asyncprocess.py PASSED [ 27%] 8697s tests/test_asyncprocess.py::test_kill <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_asyncprocess.py PASSED [ 28%] 8698s tests/test_asyncprocess.py::test_asyncprocess_child_teardown_on_parent_exit <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_asyncprocess.py PASSED [ 28%] 8698s tests/test_batched.py::test_close_not_started <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_batched.py PASSED [ 28%] 8698s tests/test_batched.py::test_stress <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_batched.py SKIPPED [ 28%] 8698s tests/test_batched.py::test_large_traffic_jam <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_batched.py SKIPPED [ 28%] 8698s tests/test_cancelled_state.py::test_abort_execution_release <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 28%] 8698s tests/test_cancelled_state.py::test_abort_execution_reschedule <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 28%] 8698s tests/test_cancelled_state.py::test_abort_execution_add_as_dependency <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 28%] 8698s tests/test_cancelled_state.py::test_abort_execution_to_fetch <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 28%] 8699s tests/test_cancelled_state.py::test_worker_stream_died_during_comm <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 28%] 8699s tests/test_cancelled_state.py::test_flight_to_executing_via_cancelled_resumed <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 28%] 8699s tests/test_cancelled_state.py::test_executing_cancelled_error <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 28%] 8699s tests/test_cancelled_state.py::test_flight_cancelled_error <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 28%] 8699s tests/test_cancelled_state.py::test_in_flight_lost_after_resumed <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 28%] 8699s tests/test_cancelled_state.py::test_cancelled_error <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 28%] 8699s tests/test_cancelled_state.py::test_cancelled_error_with_resources <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 28%] 8699s tests/test_cancelled_state.py::test_cancelled_resumed_after_flight_with_dependencies <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 28%] 8699s tests/test_cancelled_state.py::test_cancelled_resumed_after_flight_with_dependencies_workerstate <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 28%] 8700s tests/test_cancelled_state.py::test_resumed_cancelled_handle_compute[True-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 28%] 8700s tests/test_cancelled_state.py::test_resumed_cancelled_handle_compute[True-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 28%] 8700s tests/test_cancelled_state.py::test_resumed_cancelled_handle_compute[False-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 28%] 8701s tests/test_cancelled_state.py::test_resumed_cancelled_handle_compute[False-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 28%] 8701s tests/test_cancelled_state.py::test_cancelled_handle_compute[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 28%] 8701s tests/test_cancelled_state.py::test_cancelled_handle_compute[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 28%] 8701s tests/test_cancelled_state.py::test_cancelled_task_error_rejected <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 28%] 8701s tests/test_cancelled_state.py::test_deadlock_cancelled_after_inflight_before_gather_from_worker[False-resumed] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 28%] 8702s tests/test_cancelled_state.py::test_deadlock_cancelled_after_inflight_before_gather_from_worker[False-cancelled] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 28%] 8702s tests/test_cancelled_state.py::test_deadlock_cancelled_after_inflight_before_gather_from_worker[True-resumed] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 28%] 8703s tests/test_cancelled_state.py::test_deadlock_cancelled_after_inflight_before_gather_from_worker[True-cancelled] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 28%] 8703s tests/test_cancelled_state.py::test_workerstate_executing_to_executing[executing] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 28%] 8703s tests/test_cancelled_state.py::test_workerstate_executing_to_executing[long-running] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 28%] 8703s tests/test_cancelled_state.py::test_workerstate_flight_to_flight <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 28%] 8703s tests/test_cancelled_state.py::test_workerstate_executing_skips_fetch_on_success[executing] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 29%] 8703s tests/test_cancelled_state.py::test_workerstate_executing_skips_fetch_on_success[long-running] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 29%] 8703s tests/test_cancelled_state.py::test_workerstate_executing_failure_to_fetch[executing] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 29%] 8703s tests/test_cancelled_state.py::test_workerstate_executing_failure_to_fetch[long-running] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 29%] 8703s tests/test_cancelled_state.py::test_workerstate_flight_skips_executing_on_success <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 29%] 8703s tests/test_cancelled_state.py::test_workerstate_flight_failure_to_executing[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 29%] 8703s tests/test_cancelled_state.py::test_workerstate_flight_failure_to_executing[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 29%] 8703s tests/test_cancelled_state.py::test_workerstate_resumed_fetch_to_cancelled_to_executing[executing] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 29%] 8703s tests/test_cancelled_state.py::test_workerstate_resumed_fetch_to_cancelled_to_executing[long-running] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 29%] 8703s tests/test_cancelled_state.py::test_workerstate_resumed_fetch_to_executing[executing] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 29%] 8703s tests/test_cancelled_state.py::test_workerstate_resumed_fetch_to_executing[long-running] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 29%] 8703s tests/test_cancelled_state.py::test_workerstate_resumed_waiting_to_flight <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 29%] 8703s tests/test_cancelled_state.py::test_execute_preamble_early_cancel[executing-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 29%] 8703s tests/test_cancelled_state.py::test_execute_preamble_early_cancel[executing-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 29%] 8703s tests/test_cancelled_state.py::test_execute_preamble_early_cancel[resumed-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 29%] 8704s tests/test_cancelled_state.py::test_execute_preamble_early_cancel[resumed-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 29%] 8704s tests/test_cancelled_state.py::test_cancel_with_dependencies_in_memory[ExecuteSuccessEvent-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 29%] 8704s tests/test_cancelled_state.py::test_cancel_with_dependencies_in_memory[ExecuteSuccessEvent-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 29%] 8704s tests/test_cancelled_state.py::test_cancel_with_dependencies_in_memory[ExecuteFailureEvent-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 29%] 8704s tests/test_cancelled_state.py::test_cancel_with_dependencies_in_memory[ExecuteFailureEvent-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 29%] 8704s tests/test_cancelled_state.py::test_cancel_with_dependencies_in_memory[RescheduleEvent-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 29%] 8704s tests/test_cancelled_state.py::test_cancel_with_dependencies_in_memory[RescheduleEvent-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 29%] 8704s tests/test_cancelled_state.py::test_secede_cancelled_or_resumed_workerstate[ExecuteSuccessEvent-False-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 29%] 8704s tests/test_cancelled_state.py::test_secede_cancelled_or_resumed_workerstate[ExecuteSuccessEvent-False-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 29%] 8704s tests/test_cancelled_state.py::test_secede_cancelled_or_resumed_workerstate[ExecuteSuccessEvent-True-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 29%] 8704s tests/test_cancelled_state.py::test_secede_cancelled_or_resumed_workerstate[ExecuteSuccessEvent-True-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 29%] 8704s tests/test_cancelled_state.py::test_secede_cancelled_or_resumed_workerstate[ExecuteFailureEvent-False-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 29%] 8704s tests/test_cancelled_state.py::test_secede_cancelled_or_resumed_workerstate[ExecuteFailureEvent-False-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 29%] 8704s tests/test_cancelled_state.py::test_secede_cancelled_or_resumed_workerstate[ExecuteFailureEvent-True-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 29%] 8704s tests/test_cancelled_state.py::test_secede_cancelled_or_resumed_workerstate[ExecuteFailureEvent-True-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 29%] 8704s tests/test_cancelled_state.py::test_secede_cancelled_or_resumed_workerstate[RescheduleEvent-False-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 29%] 8704s tests/test_cancelled_state.py::test_secede_cancelled_or_resumed_workerstate[RescheduleEvent-False-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 30%] 8704s tests/test_cancelled_state.py::test_secede_cancelled_or_resumed_workerstate[RescheduleEvent-True-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 30%] 8704s tests/test_cancelled_state.py::test_secede_cancelled_or_resumed_workerstate[RescheduleEvent-True-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 30%] 8704s tests/test_cancelled_state.py::test_secede_cancelled_or_resumed_scheduler <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 30%] 8704s tests/test_cancelled_state.py::test_workerstate_remove_replica_of_cancelled_task_dependency <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 30%] 8709s tests/test_chaos.py::test_KillWorker[sys.exit] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_chaos.py PASSED [ 30%] 8710s tests/test_chaos.py::test_KillWorker[graceful] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_chaos.py PASSED [ 30%] 8714s tests/test_chaos.py::test_KillWorker[segfault] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_chaos.py PASSED [ 30%] 8714s tests/test_client.py::test_submit <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 30%] 8714s tests/test_client.py::test_map <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 30%] 8714s tests/test_client.py::test_map_empty <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 30%] 8714s tests/test_client.py::test_map_keynames <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 30%] 8714s tests/test_client.py::test_map_retries <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 30%] 8715s tests/test_client.py::test_map_batch_size <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 30%] 8715s tests/test_client.py::test_custom_key_with_batches <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 30%] 8715s tests/test_client.py::test_compute_retries <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 30%] 8715s tests/test_client.py::test_compute_retries_annotations <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 30%] 8717s tests/test_client.py::test_retries_get <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 30%] 8717s tests/test_client.py::test_persist_retries <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 30%] 8717s tests/test_client.py::test_persist_retries_annotations <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 30%] 8717s tests/test_client.py::test_retries_dask_array <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 30%] 8718s tests/test_client.py::test_future_repr <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 30%] 8718s tests/test_client.py::test_future_tuple_repr <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 30%] 8718s tests/test_client.py::test_Future_exception <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 30%] 8719s tests/test_client.py::test_Future_exception_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 30%] 8720s tests/test_client.py::test_Future_release <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 30%] 8721s tests/test_client.py::test_Future_release_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 30%] 8723s tests/test_client.py::test_short_tracebacks[result] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 30%] 8724s tests/test_client.py::test_short_tracebacks[gather] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 30%] 8725s tests/test_client.py::test_short_tracebacks_async[await] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 30%] 8725s tests/test_client.py::test_short_tracebacks_async[result] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 30%] 8725s tests/test_client.py::test_short_tracebacks_async[gather] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 30%] 8725s tests/test_client.py::test_map_naming <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 31%] 8725s tests/test_client.py::test_submit_naming <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 31%] 8725s tests/test_client.py::test_exceptions <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 31%] 8725s tests/test_client.py::test_gc <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 31%] 8727s tests/test_client.py::test_thread <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 31%] 8729s tests/test_client.py::test_sync_exceptions <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 31%] 8729s tests/test_client.py::test_gather <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 31%] 8729s tests/test_client.py::test_gather_mismatched_client <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 31%] 8729s tests/test_client.py::test_gather_lost <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 31%] 8731s tests/test_client.py::test_gather_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 31%] 8731s tests/test_client.py::test_gather_strict <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 31%] 8732s tests/test_client.py::test_gather_skip <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 31%] 8732s tests/test_client.py::test_limit_concurrent_gathering <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 31%] 8732s tests/test_client.py::test_get <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 31%] 8734s tests/test_client.py::test_get_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 31%] 8735s tests/test_client.py::test_no_future_references <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 31%] 8737s tests/test_client.py::test_get_sync_optimize_graph_passes_through <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 31%] 8737s tests/test_client.py::test_gather_errors <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 31%] 8737s tests/test_client.py::test_wait <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 31%] 8737s tests/test_client.py::test_wait_first_completed <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 31%] 8737s tests/test_client.py::test_wait_timeout <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 31%] 8739s tests/test_client.py::test_wait_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 31%] 8740s tests/test_client.py::test_wait_informative_error_for_timeouts <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 31%] 8740s tests/test_client.py::test_garbage_collection <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 31%] 8741s tests/test_client.py::test_garbage_collection_with_scatter <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 31%] 8741s tests/test_client.py::test_recompute_released_key <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 31%] 8741s tests/test_client.py::test_long_tasks_dont_trigger_timeout <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 31%] 8741s tests/test_client.py::test_tokenize_on_futures <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 31%] 8741s tests/test_client.py::test_restrictions_submit <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 31%] 8741s tests/test_client.py::test_restrictions_ip_port <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 31%] 8741s tests/test_client.py::test_restrictions_map <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 31%] 8741s tests/test_client.py::test_restrictions_get <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 31%] 8741s tests/test_client.py::test_restrictions_get_annotate <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 32%] 8742s tests/test_client.py::test_remove_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 32%] 8742s tests/test_client.py::test_errors_dont_block <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 32%] 8742s tests/test_client.py::test_submit_quotes <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 32%] 8742s tests/test_client.py::test_map_quotes <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 32%] 8742s tests/test_client.py::test_two_consecutive_clients_share_results <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 32%] 8742s tests/test_client.py::test_submit_then_get_with_Future <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 32%] 8742s tests/test_client.py::test_aliases <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 32%] 8743s tests/test_client.py::test_aliases_2 <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 32%] 8743s tests/test_client.py::test_scatter <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 32%] 8743s tests/test_client.py::test_scatter_types <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 32%] 8743s tests/test_client.py::test_scatter_non_list <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 32%] 8743s tests/test_client.py::test_scatter_tokenize_local <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 32%] 8743s tests/test_client.py::test_scatter_singletons <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 32%] 8743s tests/test_client.py::test_scatter_typename <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 32%] 8743s tests/test_client.py::test_scatter_hash <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 32%] 8743s tests/test_client.py::test_scatter_hash_2 <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 32%] 8743s tests/test_client.py::test_get_releases_data <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 32%] 8745s tests/test_client.py::test_current <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 32%] 8746s tests/test_client.py::test_current_nested <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 32%] 8746s tests/test_client.py::test_current_nested_async <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 32%] 8746s tests/test_client.py::test_current_concurrent <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 32%] 8747s tests/test_client.py::test_context_manager_used_from_different_tasks <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 32%] 8748s tests/test_client.py::test_context_manager_used_from_different_threads <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 32%] 8749s tests/test_client.py::test_global_clients <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 32%] 8749s tests/test_client.py::test_exception_on_exception <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 32%] 8750s tests/test_client.py::test_get_task_prefix_states <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 32%] 8750s tests/test_client.py::test_get_nbytes <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 32%] 8750s tests/test_client.py::test_nbytes_determines_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 32%] 8750s tests/test_client.py::test_if_intermediates_clear_on_error <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 32%] 8750s tests/test_client.py::test_pragmatic_move_small_data_to_large_data <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 32%] 8750s tests/test_client.py::test_get_with_non_list_key <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 32%] 8750s tests/test_client.py::test_get_with_error <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 33%] 8752s tests/test_client.py::test_get_with_error_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 33%] 8752s tests/test_client.py::test_directed_scatter <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 33%] 8752s tests/test_client.py::test_scatter_direct <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 33%] 8752s tests/test_client.py::test_scatter_direct_2 <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 33%] 8752s tests/test_client.py::test_scatter_direct_numpy <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 33%] 8752s tests/test_client.py::test_scatter_direct_broadcast <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 33%] 8752s tests/test_client.py::test_scatter_direct_balanced <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 33%] 8753s tests/test_client.py::test_scatter_direct_broadcast_target <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 33%] 8753s tests/test_client.py::test_scatter_direct_empty <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 33%] 8753s tests/test_client.py::test_scatter_direct_spread_evenly <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 33%] 8754s tests/test_client.py::test_scatter_gather_sync[True-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 33%] 8756s tests/test_client.py::test_scatter_gather_sync[True-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 33%] 8757s tests/test_client.py::test_scatter_gather_sync[False-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 33%] 8759s tests/test_client.py::test_scatter_gather_sync[False-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 33%] 8759s tests/test_client.py::test_gather_direct <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 33%] 8759s tests/test_client.py::test_many_submits_spread_evenly <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 33%] 8759s tests/test_client.py::test_traceback <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 33%] 8759s tests/test_client.py::test_get_traceback <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 33%] 8759s tests/test_client.py::test_gather_traceback <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 33%] 8762s tests/test_client.py::test_traceback_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 33%] 8762s tests/test_client.py::test_upload_file <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 33%] 8762s tests/test_client.py::test_upload_file_refresh_delayed <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 33%] 8762s tests/test_client.py::test_upload_file_no_extension <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 33%] 8762s tests/test_client.py::test_upload_file_zip <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 33%] 8762s tests/test_client.py::test_upload_file_egg <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 33%] 8762s tests/test_client.py::test_upload_large_file <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 33%] 8764s tests/test_client.py::test_upload_file_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 33%] 8764s tests/test_client.py::test_upload_file_exception <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 33%] 8765s tests/test_client.py::test_upload_file_exception_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 33%] 8766s tests/test_client.py::test_upload_file_load <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 33%] 8766s tests/test_client.py::test_upload_file_new_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 33%] 8766s tests/test_client.py::test_multiple_clients <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 34%] 8766s tests/test_client.py::test_async_compute <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 34%] 8766s tests/test_client.py::test_async_compute_with_scatter <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 34%] 8767s tests/test_client.py::test_sync_compute <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 34%] 8767s tests/test_client.py::test_remote_scatter_gather <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 34%] 8767s tests/test_client.py::test_remote_submit_on_Future <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 34%] 8769s tests/test_client.py::test_start_is_idempotent <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 34%] 8769s tests/test_client.py::test_client_with_scheduler <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 34%] 8769s tests/test_client.py::test_allow_restrictions <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 34%] 8770s tests/test_client.py::test_bad_address <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 34%] 8770s tests/test_client.py::test_informative_error_on_cluster_type <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 34%] 8770s tests/test_client.py::test_long_error <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 34%] 8770s tests/test_client.py::test_map_on_futures_with_kwargs <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 34%] 8770s tests/test_client.py::test_badly_serialized_input_stderr <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 34%] 8771s tests/test_client.py::test_repr[str] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 34%] 8773s tests/test_client.py::test_repr[repr] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 34%] 8774s tests/test_client.py::test_repr[func2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 34%] 8774s tests/test_client.py::test_repr_async <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 34%] 8774s tests/test_client.py::test_repr_no_memory_limit <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 34%] 8774s tests/test_client.py::test_forget_simple <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 34%] 8776s tests/test_client.py::test_forget_complex <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 34%] 8776s tests/test_client.py::test_forget_in_flight <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 34%] 8776s tests/test_client.py::test_forget_errors <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 34%] 8776s tests/test_client.py::test_repr_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 34%] 8776s tests/test_client.py::test_multi_client <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 34%] 8778s tests/test_client.py::test_cleanup_after_broken_client_connection <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 34%] 8778s tests/test_client.py::test_multi_garbage_collection <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 34%] 8778s tests/test_client.py::test__broadcast <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 34%] 8778s tests/test_client.py::test__broadcast_integer <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 34%] 8778s tests/test_client.py::test__broadcast_dict <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 34%] 8778s tests/test_client.py::test_proxy <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 34%] 8778s tests/test_client.py::test_cancel <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 34%] 8779s tests/test_client.py::test_cancel_tuple_key <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 8779s tests/test_client.py::test_cancel_multi_client <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 8779s tests/test_client.py::test_cancel_before_known_to_scheduler <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 8779s tests/test_client.py::test_cancel_collection <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 8781s tests/test_client.py::test_cancel_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 8781s tests/test_client.py::test_future_type <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 8781s tests/test_client.py::test_traceback_clean <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 8781s tests/test_client.py::test_map_differnet_lengths <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 8782s tests/test_client.py::test_Future_exception_sync_2 <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 8782s tests/test_client.py::test_async_persist <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 8782s tests/test_client.py::test__persist <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 8784s tests/test_client.py::test_persist <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 8784s tests/test_client.py::test_long_traceback <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 8784s tests/test_client.py::test_wait_on_collections <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 8784s tests/test_client.py::test_futures_of_get <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 8784s tests/test_client.py::test_futures_of_class <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 8784s tests/test_client.py::test_futures_of_cancelled_raises <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 8784s tests/test_client.py::test_dont_delete_recomputed_results <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 35%] 8784s tests/test_client.py::test_balance_tasks_by_stacks <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 35%] 8785s tests/test_client.py::test_run <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 8785s tests/test_client.py::test_run_handles_picklable_data <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 8786s tests/test_client.py::test_run_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 8786s tests/test_client.py::test_run_coroutine <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 8788s tests/test_client.py::test_run_coroutine_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 8788s tests/test_client.py::test_run_exception <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 8789s tests/test_client.py::test_run_rpc_error <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 8791s tests/test_client.py::test_diagnostic_ui <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 8792s tests/test_client.py::test_diagnostic_nbytes_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 8792s tests/test_client.py::test_diagnostic_nbytes <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 8792s tests/test_client.py::test_worker_aliases <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 8794s tests/test_client.py::test_persist_get_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 8794s tests/test_client.py::test_persist_get <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 8796s tests/test_client.py::test_client_num_fds <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 8796s tests/test_client.py::test_startup_close_startup <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 8798s tests/test_client.py::test_startup_close_startup_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 8798s tests/test_client.py::test_badly_serialized_exceptions <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 8798s tests/test_client.py::test_rebalance <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 8798s tests/test_client.py::test_rebalance_workers_and_keys <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 8799s tests/test_client.py::test_rebalance_unprepared <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 8799s tests/test_client.py::test_rebalance_raises_on_explicit_missing_data <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 8799s tests/test_client.py::test_receive_lost_key <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 8799s tests/test_client.py::test_unrunnable_task_runs <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 8801s tests/test_client.py::test_add_worker_after_tasks <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 8801s tests/test_client.py::test_workers_register_indirect_data <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 8801s tests/test_client.py::test_submit_on_cancelled_future <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 8801s tests/test_client.py::test_replicate <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 8801s tests/test_client.py::test_replicate_tuple_keys <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 8802s tests/test_client.py::test_replicate_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 8802s tests/test_client.py::test_replicate_tree_branching <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 8802s tests/test_client.py::test_client_replicate <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 8802s tests/test_client.py::test_client_replicate_host <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 8804s tests/test_client.py::test_client_replicate_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 8804s tests/test_client.py::test_task_load_adapts_quickly <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 8804s tests/test_client.py::test_even_load_after_fast_functions <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 8805s tests/test_client.py::test_even_load_on_startup <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 8805s tests/test_client.py::test_contiguous_load <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 36%] 8805s tests/test_client.py::test_balanced_with_submit <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 8805s tests/test_client.py::test_balanced_with_submit_and_resident_data <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 8805s tests/test_client.py::test_scheduler_saturates_cores <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 8806s tests/test_client.py::test_scheduler_saturates_cores_random <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 8806s tests/test_client.py::test_cancel_clears_processing <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 8808s tests/test_client.py::test_default_get <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 8808s tests/test_client.py::test_get_scheduler_default_client_config_interleaving <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 8808s tests/test_client.py::test_ensure_default_client <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 8808s tests/test_client.py::test_set_as_default <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 8808s tests/test_client.py::test_get_foo <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 8808s tests/test_client.py::test_get_foo_lost_keys <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 8808s tests/test_client.py::test_bad_tasks_fail <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 37%] 8810s tests/test_client.py::test_get_processing_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 8811s tests/test_client.py::test_close_idempotent <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 8813s tests/test_client.py::test_get_returns_early <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 8813s tests/test_client.py::test_Client_clears_references_after_restart <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 37%] 8814s tests/test_client.py::test_get_stops_work_after_error <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 8816s tests/test_client.py::test_as_completed_list <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 8817s tests/test_client.py::test_as_completed_results <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 8819s tests/test_client.py::test_as_completed_batches[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 8822s tests/test_client.py::test_as_completed_batches[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 8824s tests/test_client.py::test_as_completed_next_batch <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 8824s tests/test_client.py::test_status <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 8824s tests/test_client.py::test_persist_optimize_graph <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 8824s tests/test_client.py::test_scatter_raises_if_no_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 8824s tests/test_client.py::test_reconnect <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 37%] 8825s tests/test_client.py::test_reconnect_timeout <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 8825s tests/test_client.py::test_idempotence <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 8827s tests/test_client.py::test_scheduler_info <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 8828s tests/test_client.py::test_write_scheduler_file <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 8830s tests/test_client.py::test_get_versions_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 8830s tests/test_client.py::test_get_versions_async <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 8830s tests/test_client.py::test_get_versions_rpc_error <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 8832s tests/test_client.py::test_threaded_get_within_distributed <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 8832s tests/test_client.py::test_lose_scattered_data <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 8832s tests/test_client.py::test_partially_lose_scattered_data <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 8833s tests/test_client.py::test_scatter_compute_lose <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 8833s tests/test_client.py::test_scatter_compute_store_lose <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 8833s tests/test_client.py::test_scatter_compute_store_lose_processing <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 8833s tests/test_client.py::test_serialize_future <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 8833s tests/test_client.py::test_serialize_future_without_client <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 8834s tests/test_client.py::test_temp_default_client <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 8834s tests/test_client.py::test_as_current <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 8835s tests/test_client.py::test_as_current_is_thread_local <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 8835s tests/test_client.py::test_as_current_is_task_local <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 8835s tests/test_client.py::test_persist_workers_annotate <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 8836s tests/test_client.py::test_persist_workers_annotate2 <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 8836s tests/test_client.py::test_persist_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 8836s tests/test_client.py::test_compute_workers_annotate <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 8836s tests/test_client.py::test_compute_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 8836s tests/test_client.py::test_compute_nested_containers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 8836s tests/test_client.py::test_scatter_type <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 8837s tests/test_client.py::test_retire_workers_2 <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 8837s tests/test_client.py::test_retire_many_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 8837s tests/test_client.py::test_weight_occupancy_against_data_movement <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 8837s tests/test_client.py::test_distribute_tasks_by_nthreads <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 8838s tests/test_client.py::test_add_done_callback <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 8838s tests/test_client.py::test_normalize_collection <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 8838s tests/test_client.py::test_normalize_collection_dask_array <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 8838s tests/test_client.py::test_normalize_collection_with_released_futures <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 38%] 8838s tests/test_client.py::test_auto_normalize_collection <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py XPASS [ 38%] 8840s tests/test_client.py::test_auto_normalize_collection_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py XPASS [ 38%] 8841s tests/test_client.py::test_interleave_computations <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 8841s tests/test_client.py::test_interleave_computations_map <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 38%] 8841s tests/test_client.py::test_scatter_dict_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 8841s tests/test_client.py::test_client_timeout <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 38%] 8841s tests/test_client.py::test_submit_list_kwargs <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 8841s tests/test_client.py::test_map_list_kwargs <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 8841s tests/test_client.py::test_recreate_error_delayed <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 8841s tests/test_client.py::test_recreate_error_futures <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 8842s tests/test_client.py::test_recreate_error_collection <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 8842s tests/test_client.py::test_recreate_error_array <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 39%] 8843s tests/test_client.py::test_recreate_error_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 8845s tests/test_client.py::test_recreate_error_not_error <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 8846s tests/test_client.py::test_recreate_task_delayed <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 8846s tests/test_client.py::test_recreate_task_futures <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 8846s tests/test_client.py::test_recreate_task_collection <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 8846s tests/test_client.py::test_recreate_task_array <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 8847s tests/test_client.py::test_recreate_task_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 8847s tests/test_client.py::test_retire_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 8847s tests/test_client.py::test_restart_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 39%] 8847s tests/test_client.py::test_restart_workers_no_nanny_raises <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 8847s tests/test_client.py::test_restart_workers_kill_timeout[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 39%] 8847s tests/test_client.py::test_restart_workers_kill_timeout[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 39%] 8847s tests/test_client.py::test_restart_workers_restart_timeout[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 39%] 8847s tests/test_client.py::test_restart_workers_restart_timeout[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 39%] 8847s tests/test_client.py::test_restart_workers_exception <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 39%] 8847s tests/test_client.py::test_restart_workers_by_name[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 39%] 8847s tests/test_client.py::test_restart_workers_by_name[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 39%] 8847s tests/test_client.py::test_robust_unserializable <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 8847s tests/test_client.py::test_robust_undeserializable <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 8847s tests/test_client.py::test_robust_undeserializable_function <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 8848s tests/test_client.py::test_fire_and_forget <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 8848s tests/test_client.py::test_fire_and_forget_err <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 8848s tests/test_client.py::test_close <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 8853s tests/test_client.py::test_threadsafe <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 8853s tests/test_client.py::test_threadsafe_get <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 39%] 8853s tests/test_client.py::test_threadsafe_compute <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 39%] 8853s tests/test_client.py::test_identity <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 8853s tests/test_client.py::test_get_client <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 8853s tests/test_client.py::test_get_client_no_cluster <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 8853s tests/test_client.py::test_serialize_collections <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 8853s tests/test_client.py::test_secede_simple <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 8853s tests/test_client.py::test_secede_balances <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 8853s tests/test_client.py::test_long_running_not_in_occupancy[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 8853s tests/test_client.py::test_long_running_not_in_occupancy[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 8853s tests/test_client.py::test_long_running_removal_clean[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 8853s tests/test_client.py::test_long_running_removal_clean[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 8853s tests/test_client.py::test_sub_submit_priority <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 8853s tests/test_client.py::test_get_client_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 8854s tests/test_client.py::test_serialize_collections_of_futures <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 8856s tests/test_client.py::test_serialize_collections_of_futures_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 8858s tests/test_client.py::test_dynamic_workloads_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 8858s tests/test_client.py::test_dynamic_workloads_sync_random <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 40%] 8858s tests/test_client.py::test_bytes_keys <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 8858s tests/test_client.py::test_unicode_ascii_keys <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 8858s tests/test_client.py::test_unicode_keys <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 8859s tests/test_client.py::test_use_synchronous_client_in_async_context <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 8861s tests/test_client.py::test_quiet_quit_when_cluster_leaves <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 8861s tests/test_client.py::test_call_stack_future <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 8862s tests/test_client.py::test_call_stack_all <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 8864s tests/test_client.py::test_call_stack_collections <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 8865s tests/test_client.py::test_call_stack_collections_all <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 8866s tests/test_client.py::test_profile <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 8867s tests/test_client.py::test_profile_disabled <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 8868s tests/test_client.py::test_profile_keys <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 8868s tests/test_client.py::test_client_with_name <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 8868s tests/test_client.py::test_future_defaults_to_default_client <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 8868s tests/test_client.py::test_future_auto_inform <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 8868s tests/test_client.py::test_client_async_before_loop_starts <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 8868s tests/test_client.py::test_nested_compute <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 40%] 8869s tests/test_client.py::test_task_metadata <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 8870s tests/test_client.py::test_logs <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 8871s tests/test_client.py::test_logs_from_worker_submodules <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 8871s tests/test_client.py::test_avoid_delayed_finalize <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 8871s tests/test_client.py::test_config_scheduler_address <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 8872s tests/test_client.py::test_warn_when_submitting_large_values <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 8872s tests/test_client.py::test_warn_when_submitting_large_values_memoryview <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 8872s tests/test_client.py::test_unhashable_function <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 8872s tests/test_client.py::test_client_name <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 8875s tests/test_client.py::test_client_doesnt_close_given_loop <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 8875s tests/test_client.py::test_quiet_scheduler_loss <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 41%] 8877s tests/test_client.py::test_dashboard_link <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 8877s tests/test_client.py::test_client_timeout_2 <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 8877s tests/test_client.py::test_turn_off_pickle[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 8877s tests/test_client.py::test_turn_off_pickle[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 8877s tests/test_client.py::test_de_serialization <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 8877s tests/test_client.py::test_de_serialization_none <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 8878s tests/test_client.py::test_client_repr_closed <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 8878s tests/test_client.py::test_client_repr_closed_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 41%] 8878s tests/test_client.py::test_nested_prioritization <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py XPASS [ 41%] 8878s tests/test_client.py::test_scatter_error_cancel <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 8878s tests/test_client.py::test_scatter_and_replicate_avoid_paused_workers[False-False-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 8879s tests/test_client.py::test_scatter_and_replicate_avoid_paused_workers[False-False-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 8879s tests/test_client.py::test_scatter_and_replicate_avoid_paused_workers[False-True-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 8880s tests/test_client.py::test_scatter_and_replicate_avoid_paused_workers[False-True-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 8880s tests/test_client.py::test_scatter_and_replicate_avoid_paused_workers[True-False-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 8880s tests/test_client.py::test_scatter_and_replicate_avoid_paused_workers[True-False-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 8881s tests/test_client.py::test_scatter_and_replicate_avoid_paused_workers[True-True-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 8881s tests/test_client.py::test_scatter_and_replicate_avoid_paused_workers[True-True-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 8881s tests/test_client.py::test_scatter_and_replicate_avoid_paused_workers[10-False-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 8882s tests/test_client.py::test_scatter_and_replicate_avoid_paused_workers[10-False-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 8882s tests/test_client.py::test_scatter_and_replicate_avoid_paused_workers[10-True-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 8883s tests/test_client.py::test_scatter_and_replicate_avoid_paused_workers[10-True-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 8883s tests/test_client.py::test_no_threads_lingering <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py XPASS [ 41%] 8883s tests/test_client.py::test_direct_async <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 8884s tests/test_client.py::test_direct_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 8884s tests/test_client.py::test_mixing_clients_same_scheduler <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 8884s tests/test_client.py::test_tuple_keys <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 8885s tests/test_client.py::test_multiple_scatter <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 8887s tests/test_client.py::test_map_large_kwargs_in_graph <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 8887s tests/test_client.py::test_retry <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 8887s tests/test_client.py::test_retry_dependencies <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 8887s tests/test_client.py::test_released_dependencies <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 8888s tests/test_client.py::test_profile_bokeh <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 42%] 8888s tests/test_client.py::test_get_mix_futures_and_SubgraphCallable <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 8888s tests/test_client.py::test_get_mix_futures_and_SubgraphCallable_dask_dataframe <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 8889s tests/test_client.py::test_direct_to_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 8889s tests/test_client.py::test_instances <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 8891s tests/test_client.py::test_wait_for_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 8891s tests/test_client.py::test_config_inherited_by_subprocess <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 8891s tests/test_client.py::test_futures_of_sorted <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 8893s tests/test_client.py::test_profile_server <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 8895s tests/test_client.py::test_profile_server_disabled <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 8895s tests/test_client.py::test_await_future <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 8895s tests/test_client.py::test_as_completed_async_for <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 8896s tests/test_client.py::test_as_completed_async_for_results <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 8896s tests/test_client.py::test_as_completed_async_for_cancel <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 8897s tests/test_client.py::test_client_sync_with_async_def <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 8897s tests/test_client.py::test_dont_hold_on_to_large_messages <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 42%] 8897s tests/test_client.py::test_run_on_scheduler_async_def <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 8897s tests/test_client.py::test_run_on_scheduler_async_def_wait <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 8897s tests/test_client.py::test_performance_report[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 42%] 8897s tests/test_client.py::test_performance_report[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 42%] 8897s tests/test_client.py::test_client_gather_semaphore_loop <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 42%] 8898s tests/test_client.py::test_as_completed_condition_loop <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 8898s tests/test_client.py::test_client_connectionpool_semaphore_loop <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 42%] 8898s tests/test_client.py::test_mixed_compression <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 42%] 8898s tests/test_client.py::test_get_task_metadata <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 8898s tests/test_client.py::test_get_task_metadata_multiple <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 8898s tests/test_client.py::test_register_worker_plugin_exception <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 8898s tests/test_client.py::test_log_event <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 8898s tests/test_client.py::test_log_event_multiple_clients <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 8898s tests/test_client.py::test_annotations_task_state <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 8899s tests/test_client.py::test_annotations_compute_time[compute] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 8899s tests/test_client.py::test_annotations_compute_time[persist] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 8899s tests/test_client.py::test_annotations_survive_optimization <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py XFAIL [ 43%] 8899s tests/test_client.py::test_annotations_priorities <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 8899s tests/test_client.py::test_annotations_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 8899s tests/test_client.py::test_annotations_retries <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 8899s tests/test_client.py::test_annotations_blockwise_unpack <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 8900s tests/test_client.py::test_annotations_resources <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 8900s tests/test_client.py::test_annotations_resources_culled <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 8900s tests/test_client.py::test_annotations_loose_restrictions <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 8900s tests/test_client.py::test_annotations_submit_map <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 8900s tests/test_client.py::test_annotations_global_vs_local <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 8900s tests/test_client.py::test_workers_collection_restriction <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 8900s tests/test_client.py::test_get_client_functions_spawn_clusters <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 43%] 8900s tests/test_client.py::test_computation_code_walk_frames <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 8900s tests/test_client.py::test_computation_ignore_ipython_frames[2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 43%] 8900s tests/test_client.py::test_computation_ignore_ipython_frames[3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 43%] 8900s tests/test_client.py::test_computation_store_annotations <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 8902s tests/test_client.py::test_computation_object_code_dask_compute <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 8904s tests/test_client.py::test_computation_object_code_dask_compute_no_frames_default <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 8905s tests/test_client.py::test_computation_object_code_not_available <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 43%] 8905s tests/test_client.py::test_computation_object_code_dask_persist <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 8905s tests/test_client.py::test_computation_object_code_client_submit_simple <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 8906s tests/test_client.py::test_computation_object_code_client_submit_list_comp <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 8906s tests/test_client.py::test_computation_object_code_client_submit_dict_comp <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 8906s tests/test_client.py::test_computation_object_code_client_map <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 8906s tests/test_client.py::test_computation_object_code_client_compute <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 8906s tests/test_client.py::test_upload_directory <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 44%] 8906s tests/test_client.py::test_duck_typed_register_plugin_raises <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 8906s tests/test_client.py::test_exception_text <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 8907s tests/test_client.py::test_async_task <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 8907s tests/test_client.py::test_async_task_with_partial <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 8907s tests/test_client.py::test_events_subscribe_topic <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 8907s tests/test_client.py::test_events_subscribe_topic_cancelled <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 8908s tests/test_client.py::test_events_all_servers_use_same_channel <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 8908s tests/test_client.py::test_events_unsubscribe_raises_if_unknown <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 8908s tests/test_client.py::test_log_event_warn <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 8910s tests/test_client.py::test_log_event_msgpack <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 8910s tests/test_client.py::test_log_event_warn_dask_warns <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 8912s tests/test_client.py::test_print_remote <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 8913s tests/test_client.py::test_print_manual <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 8914s tests/test_client.py::test_print_manual_bad_args <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 8915s tests/test_client.py::test_print_non_msgpack_serializable <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 8915s tests/test_client.py::test_print_local <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 8917s tests/test_client.py::test_forward_logging <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 8919s tests/test_client.py::test_dump_cluster_state_write_from_scheduler <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 8920s tests/test_client.py::test_dump_cluster_state_sync[msgpack-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 8922s tests/test_client.py::test_dump_cluster_state_sync[msgpack-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 8924s tests/test_client.py::test_dump_cluster_state_sync[yaml-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 8925s tests/test_client.py::test_dump_cluster_state_sync[yaml-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 8925s tests/test_client.py::test_dump_cluster_state_async[msgpack-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 8926s tests/test_client.py::test_dump_cluster_state_async[msgpack-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 8926s tests/test_client.py::test_dump_cluster_state_async[yaml-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 8926s tests/test_client.py::test_dump_cluster_state_async[yaml-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 8926s tests/test_client.py::test_dump_cluster_state_json[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 8926s tests/test_client.py::test_dump_cluster_state_json[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 8927s tests/test_client.py::test_dump_cluster_state_exclude_default <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 8928s tests/test_client.py::test_benchmark_hardware_no_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 8928s tests/test_client.py::test_wait_for_workers_updates_info <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 45%] 8928s tests/test_client.py::test_quiet_close_process[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 45%] 8928s tests/test_client.py::test_quiet_close_process[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 45%] 8928s tests/test_client.py::test_deprecated_loop_properties <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 45%] 8928s tests/test_client.py::test_fast_close_on_aexit_failure <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 45%] 8928s tests/test_client.py::test_wait_for_workers_n_workers_value_check[None-ValueError] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 45%] 8928s tests/test_client.py::test_wait_for_workers_n_workers_value_check[0-ValueError] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 45%] 8928s tests/test_client.py::test_wait_for_workers_n_workers_value_check[1.0-ValueError] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 45%] 8928s tests/test_client.py::test_wait_for_workers_n_workers_value_check[1-None] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 45%] 8928s tests/test_client.py::test_wait_for_workers_n_workers_value_check[2-None] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 45%] 8928s tests/test_client.py::test_unpacks_remotedata_namedtuple[PlainNamedTuple-args0-kwargs0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 45%] 8929s tests/test_client.py::test_unpacks_remotedata_namedtuple[NewArgsNamedTuple-args1-kwargs1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 45%] 8929s tests/test_client.py::test_unpacks_remotedata_namedtuple[NewArgsExNamedTuple-args2-kwargs2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 45%] 8929s tests/test_client.py::test_resolves_future_in_namedtuple[PlainNamedTuple-args0-kwargs0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 45%] 8929s tests/test_client.py::test_resolves_future_in_namedtuple[NewArgsNamedTuple-args1-kwargs1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 45%] 8929s tests/test_client.py::test_resolves_future_in_namedtuple[NewArgsExNamedTuple-args2-kwargs2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 45%] 8929s tests/test_client.py::test_resolves_future_in_dict <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 45%] 8930s tests/test_client.py::test_gather_race_vs_AMM[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 45%] 8930s tests/test_client.py::test_gather_race_vs_AMM[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 45%] 8931s tests/test_client_executor.py::test_submit <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client_executor.py PASSED [ 45%] 8933s tests/test_client_executor.py::test_as_completed <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client_executor.py PASSED [ 45%] 8935s tests/test_client_executor.py::test_wait <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client_executor.py PASSED [ 45%] 8936s tests/test_client_executor.py::test_cancellation <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client_executor.py PASSED [ 45%] 8939s tests/test_client_executor.py::test_cancellation_wait <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client_executor.py PASSED [ 45%] 8941s tests/test_client_executor.py::test_cancellation_as_completed <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client_executor.py PASSED [ 45%] 8941s tests/test_client_executor.py::test_map <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client_executor.py SKIPPED [ 45%] 8943s tests/test_client_executor.py::test_pure <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client_executor.py PASSED [ 45%] 8944s tests/test_client_executor.py::test_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client_executor.py PASSED [ 45%] 8946s tests/test_client_executor.py::test_unsupported_arguments <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client_executor.py PASSED [ 45%] 8948s tests/test_client_executor.py::test_retries <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client_executor.py PASSED [ 45%] 8952s tests/test_client_executor.py::test_shutdown_wait <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client_executor.py PASSED [ 45%] 8952s tests/test_client_executor.py::test_shutdown_nowait <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client_executor.py PASSED [ 45%] 8952s tests/test_cluster_dump.py::test_tuple_to_list[input0-expected0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cluster_dump.py PASSED [ 46%] 8952s tests/test_cluster_dump.py::test_tuple_to_list[input1-expected1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cluster_dump.py PASSED [ 46%] 8952s tests/test_cluster_dump.py::test_tuple_to_list[input2-expected2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cluster_dump.py PASSED [ 46%] 8952s tests/test_cluster_dump.py::test_tuple_to_list[foo-foo] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cluster_dump.py PASSED [ 46%] 8952s tests/test_cluster_dump.py::test_write_state_msgpack <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cluster_dump.py PASSED [ 46%] 8952s tests/test_cluster_dump.py::test_write_state_yaml <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cluster_dump.py PASSED [ 46%] 8952s tests/test_cluster_dump.py::test_cluster_dump_state <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cluster_dump.py PASSED [ 46%] 8953s tests/test_cluster_dump.py::test_cluster_dump_story <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cluster_dump.py PASSED [ 46%] 8953s tests/test_cluster_dump.py::test_cluster_dump_to_yamls <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cluster_dump.py PASSED [ 46%] 8953s tests/test_collections.py::test_lru <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_collections.py PASSED [ 46%] 8953s tests/test_collections.py::test_heapset <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_collections.py PASSED [ 46%] 8953s tests/test_collections.py::test_heapset_sorted_flag_left <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_collections.py PASSED [ 46%] 8953s tests/test_collections.py::test_heapset_sorted_flag_right <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_collections.py PASSED [ 46%] 8953s tests/test_collections.py::test_heapset_popright[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_collections.py PASSED [ 46%] 8953s tests/test_collections.py::test_heapset_popright[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_collections.py PASSED [ 46%] 8953s tests/test_collections.py::test_heapset_pickle <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_collections.py PASSED [ 46%] 8953s tests/test_collections.py::test_heapset_sort_duplicate <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_collections.py PASSED [ 46%] 8953s tests/test_collections.py::test_sum_mappings <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_collections.py PASSED [ 46%] 8953s tests/test_compatibility.py::test_randbytes <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_compatibility.py PASSED [ 46%] 8953s tests/test_compatibility.py::test_randbytes_seed <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_compatibility.py PASSED [ 46%] 8953s tests/test_computations.py::test_computations <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_computations.py PASSED [ 46%] 8953s tests/test_computations.py::test_computations_futures <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_computations.py PASSED [ 46%] 8953s tests/test_computations.py::test_computations_no_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_computations.py PASSED [ 46%] 8954s tests/test_computations.py::test_computations_no_resources <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_computations.py PASSED [ 46%] 8954s tests/test_computations.py::test_computations_long_running <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_computations.py PASSED [ 46%] 8954s tests/test_config.py::test_logging_default[config0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_config.py PASSED [ 46%] 8954s tests/test_config.py::test_logging_default[None] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_config.py PASSED [ 46%] 8955s tests/test_config.py::test_logging_simple_under_distributed <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_config.py PASSED [ 46%] 8955s tests/test_config.py::test_logging_simple <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_config.py PASSED [ 46%] 8956s tests/test_config.py::test_logging_extended <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_config.py PASSED [ 46%] 8957s tests/test_config.py::test_default_logging_does_not_override_basic_config <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_config.py PASSED [ 46%] 8957s tests/test_config.py::test_basic_config_does_not_override_default_logging <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_config.py PASSED [ 46%] 8957s tests/test_config.py::test_logging_mutual_exclusive <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_config.py PASSED [ 47%] 8958s tests/test_config.py::test_logging_file_config <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_config.py PASSED [ 47%] 8958s tests/test_config.py::test_schema <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_config.py PASSED [ 47%] 8958s tests/test_config.py::test_schema_is_complete <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_config.py PASSED [ 47%] 8958s tests/test_config.py::test_uvloop_event_loop <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_config.py SKIPPED [ 47%] 8958s tests/test_config.py::test_deprecations_on_set[args0-kwargs0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_config.py PASSED [ 47%] 8958s tests/test_config.py::test_deprecations_on_set[args1-kwargs1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_config.py PASSED [ 47%] 8958s tests/test_config.py::test_deprecations_on_set[args2-kwargs2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_config.py PASSED [ 47%] 8958s tests/test_config.py::test_deprecations_on_env_variables <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_config.py PASSED [ 47%] 8958s tests/test_config.py::test_deprecations_on_yaml[allowed-failures] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_config.py PASSED [ 47%] 8958s tests/test_config.py::test_deprecations_on_yaml[allowed_failures] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_config.py PASSED [ 47%] 8958s tests/test_core.py::test_async_task_group_initialization <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 47%] 8958s tests/test_core.py::test_async_task_group_call_soon_executes_task_in_background <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 47%] 8959s tests/test_core.py::test_async_task_group_call_later_executes_delayed_task_in_background <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 47%] 8959s tests/test_core.py::test_async_task_group_close_closes <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 47%] 8959s tests/test_core.py::test_async_task_group_close_does_not_cancel_existing_tasks <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 47%] 8959s tests/test_core.py::test_async_task_group_close_prohibits_new_tasks <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 47%] 8959s tests/test_core.py::test_async_task_group_stop_disallows_shutdown <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 47%] 8959s tests/test_core.py::test_async_task_group_stop_cancels_long_running <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 47%] 8959s tests/test_core.py::test_rpc_inputs <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 47%] 8959s tests/test_core.py::test_large_packets_tcp <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py SKIPPED [ 47%] 8959s tests/test_core.py::test_connect_raises <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 47%] 8959s tests/test_core.py::test_coerce_to_address <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 47%] 8959s tests/test_core.py::test_remove_cancels_connect_attempts <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 47%] 8959s tests/test_core.py::test_remove_cancels_connect_before_task_running <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 47%] 8959s tests/test_core.py::test_ticks <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py SKIPPED [ 47%] 8959s tests/test_core.py::test_tick_logging <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py SKIPPED [ 47%] 8959s tests/test_core.py::test_thread_id <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 47%] 8959s tests/test_core.py::test_expects_comm <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 47%] 8959s tests/test_core.py::test_async_listener_stop <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 47%] 8959s tests/test_core.py::test_large_payload <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py SKIPPED [ 47%] 8959s tests/test_counter.py::test_digest[Counter-] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_counter.py PASSED [ 48%] 8959s tests/test_counter.py::test_digest[None-] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_counter.py SKIPPED [ 48%] 8959s tests/test_counter.py::test_counter <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_counter.py PASSED [ 48%] 8960s tests/test_dask_collections.py::test_dask_array_collections <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_dask_collections.py PASSED [ 48%] 8960s tests/test_dask_collections.py::test_bag_groupby_tasks_default <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_dask_collections.py PASSED [ 48%] 8962s tests/test_dask_collections.py::test_bag_groupby_key_hashing <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_dask_collections.py PASSED [ 48%] 8964s tests/test_dask_collections.py::test_dataframe_set_index_sync[wait] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_dask_collections.py PASSED [ 48%] 8967s tests/test_dask_collections.py::test_dataframe_set_index_sync[] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_dask_collections.py PASSED [ 48%] 8968s tests/test_dask_collections.py::test_loc_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_dask_collections.py PASSED [ 48%] 8968s tests/test_dask_collections.py::test_loc <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_dask_collections.py PASSED [ 48%] 8969s tests/test_dask_collections.py::test_sparse_arrays <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_dask_collections.py SKIPPED [ 48%] 8969s tests/test_dask_collections.py::test_delayed_none <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_dask_collections.py PASSED [ 48%] 8971s tests/test_dask_collections.py::test_tuple_futures_arg[tuple] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_dask_collections.py PASSED [ 48%] 8972s tests/test_dask_collections.py::test_tuple_futures_arg[list] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_dask_collections.py PASSED [ 48%] 8972s tests/test_deadline.py::test_deadline <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_deadline.py PASSED [ 48%] 8972s tests/test_deadline.py::test_infinite_deadline <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_deadline.py PASSED [ 48%] 8973s tests/test_deadline.py::test_deadline_progress <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_deadline.py PASSED [ 48%] 8973s tests/test_deadline.py::test_deadline_expiration <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_deadline.py PASSED [ 48%] 8973s tests/test_deadline.py::test_deadline_expiration_async <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_deadline.py PASSED [ 48%] 8973s tests/test_diskutils.py::test_workdir_simple <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_diskutils.py PASSED [ 48%] 8973s tests/test_diskutils.py::test_two_workspaces_in_same_directory <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_diskutils.py PASSED [ 48%] 8974s tests/test_diskutils.py::test_workspace_process_crash <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_diskutils.py PASSED [ 48%] 8974s tests/test_diskutils.py::test_workspace_rmtree_failure <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_diskutils.py PASSED [ 48%] 8974s tests/test_diskutils.py::test_locking_disabled <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_diskutils.py PASSED [ 48%] 8974s tests/test_diskutils.py::test_workspace_concurrency <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_diskutils.py SKIPPED [ 48%] 8974s tests/test_diskutils.py::test_unwritable_base_dir <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_diskutils.py PASSED [ 48%] 8974s tests/test_events.py::test_event_on_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_events.py PASSED [ 48%] 8974s tests/test_events.py::test_default_event <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_events.py PASSED [ 48%] 8975s tests/test_events.py::test_set_not_set <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_events.py PASSED [ 48%] 8975s tests/test_events.py::test_set_not_set_many_events <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_events.py PASSED [ 48%] 8975s tests/test_events.py::test_timeout <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_events.py PASSED [ 48%] 8977s tests/test_events.py::test_event_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_events.py PASSED [ 48%] 8977s tests/test_events.py::test_event_types <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_events.py PASSED [ 49%] 8977s tests/test_events.py::test_serializable <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_events.py PASSED [ 49%] 8978s tests/test_events.py::test_two_events_on_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_events.py PASSED [ 49%] 8978s tests/test_events.py::test_unpickle_without_client <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_events.py PASSED [ 49%] 8978s tests/test_failed_workers.py::test_submit_after_failed_worker_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py SKIPPED [ 49%] 8978s tests/test_failed_workers.py::test_submit_after_failed_worker_async[False-False-closing] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py PASSED [ 49%] 8978s tests/test_failed_workers.py::test_submit_after_failed_worker_async[False-False-closed] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py PASSED [ 49%] 8979s tests/test_failed_workers.py::test_submit_after_failed_worker_async[False-True-closing] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py PASSED [ 49%] 8979s tests/test_failed_workers.py::test_submit_after_failed_worker_async[False-True-closed] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py PASSED [ 49%] 8979s tests/test_failed_workers.py::test_submit_after_failed_worker_async[True-False-closing] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py PASSED [ 49%] 8979s tests/test_failed_workers.py::test_submit_after_failed_worker_async[True-False-closed] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py PASSED [ 49%] 8979s tests/test_failed_workers.py::test_submit_after_failed_worker_async[True-True-closing] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py PASSED [ 49%] 8980s tests/test_failed_workers.py::test_submit_after_failed_worker_async[True-True-closed] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py PASSED [ 49%] 8980s tests/test_failed_workers.py::test_submit_after_failed_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py PASSED [ 49%] 8980s tests/test_failed_workers.py::test_gather_after_failed_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py SKIPPED [ 49%] 8980s tests/test_failed_workers.py::test_gather_then_submit_after_failed_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py SKIPPED [ 49%] 8982s tests/test_failed_workers.py::test_restart <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py PASSED [ 49%] 8986s tests/test_failed_workers.py::test_restart_cleared <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py PASSED [ 49%] 8989s tests/test_failed_workers.py::test_restart_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py PASSED [ 49%] 8995s tests/test_failed_workers.py::test_worker_doesnt_await_task_completion <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py PASSED [ 49%] 8998s tests/test_failed_workers.py::test_multiple_clients_restart <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py PASSED [ 49%] 9000s tests/test_failed_workers.py::test_restart_scheduler <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py PASSED [ 49%] 9003s tests/test_failed_workers.py::test_forgotten_futures_dont_clean_up_new_futures <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py PASSED [ 49%] 9003s tests/test_failed_workers.py::test_broken_worker_during_computation <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py SKIPPED [ 49%] 9006s tests/test_failed_workers.py::test_restart_during_computation <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py PASSED [ 49%] 9006s tests/test_failed_workers.py::test_worker_who_has_clears_after_failed_connection <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py SKIPPED [ 49%] 9007s tests/test_failed_workers.py::test_worker_same_host_replicas_missing <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py PASSED [ 49%] 9007s tests/test_failed_workers.py::test_restart_timeout_on_long_running_task <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py SKIPPED [ 49%] 9007s tests/test_failed_workers.py::test_worker_time_to_live <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py SKIPPED [ 49%] 9007s tests/test_failed_workers.py::test_worker_ttl_restarts_worker[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py SKIPPED [ 49%] 9007s tests/test_failed_workers.py::test_worker_ttl_restarts_worker[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py SKIPPED [ 49%] 9007s tests/test_failed_workers.py::test_restart_hung_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py SKIPPED [ 49%] 9007s tests/test_failed_workers.py::test_forget_data_not_supposed_to_have <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py PASSED [ 50%] 9009s tests/test_failed_workers.py::test_failing_worker_with_additional_replicas_on_cluster <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py PASSED [ 50%] 9010s tests/test_imports.py::test_can_import_distributed_in_background_thread <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_imports.py PASSED [ 50%] 9010s tests/test_init.py::test_version <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_init.py PASSED [ 50%] 9010s tests/test_itertools.py::test_ffill <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_itertools.py PASSED [ 50%] 9010s tests/test_jupyter.py::test_jupyter_cli <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_jupyter.py SKIPPED [ 50%] 9011s tests/test_locks.py::test_lock <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_locks.py PASSED [ 50%] 9012s tests/test_locks.py::test_timeout <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_locks.py PASSED [ 50%] 9012s tests/test_locks.py::test_acquires_with_zero_timeout <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_locks.py PASSED [ 50%] 9012s tests/test_locks.py::test_acquires_blocking <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_locks.py PASSED [ 50%] 9013s tests/test_locks.py::test_timeout_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_locks.py PASSED [ 50%] 9016s tests/test_locks.py::test_lock_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_locks.py PASSED [ 50%] 9016s tests/test_locks.py::test_lock_types <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_locks.py PASSED [ 50%] 9016s tests/test_locks.py::test_serializable <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_locks.py PASSED [ 50%] 9016s tests/test_locks.py::test_locks <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_locks.py PASSED [ 50%] 9016s tests/test_metrics.py::test_wall_clock[time] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_metrics.py PASSED [ 50%] 9016s tests/test_metrics.py::test_wall_clock[monotonic] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_metrics.py PASSED [ 50%] 9016s tests/test_metrics.py::test_monotonic <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_metrics.py SKIPPED [ 50%] 9016s tests/test_metrics.py::test_meter <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_metrics.py PASSED [ 50%] 9016s tests/test_metrics.py::test_meter_raise <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_metrics.py PASSED [ 50%] 9016s tests/test_metrics.py::test_meter_floor[kwargs0-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_metrics.py PASSED [ 50%] 9016s tests/test_metrics.py::test_meter_floor[kwargs1-0.1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_metrics.py PASSED [ 50%] 9016s tests/test_metrics.py::test_meter_floor[kwargs2--1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_metrics.py PASSED [ 50%] 9016s tests/test_metrics.py::test_context_meter <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_metrics.py PASSED [ 50%] 9016s tests/test_metrics.py::test_context_meter_raise <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_metrics.py PASSED [ 50%] 9016s tests/test_metrics.py::test_context_meter_nested <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_metrics.py PASSED [ 50%] 9016s tests/test_metrics.py::test_context_meter_decorator <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_metrics.py PASSED [ 50%] 9016s tests/test_metrics.py::test_context_meter_nested_floor <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_metrics.py PASSED [ 50%] 9016s tests/test_metrics.py::test_context_meter_pickle <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_metrics.py PASSED [ 50%] 9016s tests/test_metrics.py::test_context_meter_clear_callbacks <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_metrics.py PASSED [ 50%] 9016s tests/test_metrics.py::test_context_meter_clear_callbacks_raises <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_metrics.py PASSED [ 50%] 9016s tests/test_metrics.py::test_context_meter_allow_offload <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_metrics.py PASSED [ 50%] 9016s tests/test_metrics.py::test_delayed_metrics_ledger <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_metrics.py PASSED [ 51%] 9016s tests/test_metrics.py::test_context_meter_keyed <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_metrics.py PASSED [ 51%] 9016s tests/test_metrics.py::test_delayed_metrics_ledger_keyed <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_metrics.py PASSED [ 51%] 9017s tests/test_multi_locks.py::test_single_lock <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_multi_locks.py PASSED [ 51%] 9018s tests/test_multi_locks.py::test_timeout <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_multi_locks.py PASSED [ 51%] 9018s tests/test_multi_locks.py::test_timeout_wake_waiter <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_multi_locks.py PASSED [ 51%] 9018s tests/test_multi_locks.py::test_multiple_locks <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_multi_locks.py PASSED [ 51%] 9019s tests/test_multi_locks.py::test_num_locks <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_multi_locks.py PASSED [ 51%] 9021s tests/test_nanny.py::test_str <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 51%] 9022s tests/test_nanny.py::test_nanny_process_failure <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 51%] 9023s tests/test_nanny.py::test_run <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 51%] 9023s tests/test_nanny.py::test_no_hang_when_scheduler_closes <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py SKIPPED [ 51%] 9023s tests/test_nanny.py::test_close_on_disconnect <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py SKIPPED [ 51%] 9025s tests/test_nanny.py::test_nanny_worker_class <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 51%] 9026s tests/test_nanny.py::test_nanny_alt_worker_class <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 51%] 9026s tests/test_nanny.py::test_nanny_death_timeout <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py SKIPPED [ 51%] 9028s tests/test_nanny.py::test_random_seed <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 51%] 9033s tests/test_nanny.py::test_num_fds <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 51%] 9034s tests/test_nanny.py::test_nanny_timeout <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 51%] 9035s tests/test_nanny.py::test_throttle_outgoing_transfers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 51%] 9036s tests/test_nanny.py::test_scheduler_address_config <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 51%] 9036s tests/test_nanny.py::test_wait_for_scheduler <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py SKIPPED [ 51%] 9037s tests/test_nanny.py::test_environment_variable <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 51%] 9038s tests/test_nanny.py::test_environment_variable_by_config <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 51%] 9040s tests/test_nanny.py::test_environment_variable_config <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 51%] 9041s tests/test_nanny.py::test_environment_variable_pre_post_spawn <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 51%] 9042s tests/test_nanny.py::test_environment_variable_overlay <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 51%] 9043s tests/test_nanny.py::test_config_param_overlays <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 51%] 9044s tests/test_nanny.py::test_local_directory <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 51%] 9046s tests/test_nanny.py::test_unwriteable_dask_worker_space <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 51%] 9048s tests/test_nanny.py::test_mp_process_worker_no_daemon <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 51%] 9050s tests/test_nanny.py::test_mp_pool_worker_no_daemon <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 51%] 9051s tests/test_nanny.py::test_nanny_closes_cleanly <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 52%] 9051s tests/test_nanny.py::test_lifetime <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py SKIPPED [ 52%] 9054s tests/test_nanny.py::test_nanny_closes_cleanly_if_worker_is_terminated <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 52%] 9056s tests/test_nanny.py::test_config <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 52%] 9058s tests/test_nanny.py::test_nanny_port_range <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 52%] 9058s tests/test_nanny.py::test_nanny_closed_by_keyboard_interrupt[tcp] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py SKIPPED [ 52%] 9058s tests/test_nanny.py::test_nanny_closed_by_keyboard_interrupt[ucx] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py SKIPPED [ 52%] 9059s tests/test_nanny.py::test_worker_start_exception <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 52%] 9060s tests/test_nanny.py::test_failure_during_worker_initialization <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 52%] 9063s tests/test_nanny.py::test_environ_plugin <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 52%] 9066s tests/test_nanny.py::test_no_unnecessary_imports_on_worker[scipy] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 52%] 9067s tests/test_nanny.py::test_no_unnecessary_imports_on_worker[pandas] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py XFAIL [ 52%] 9067s tests/test_nanny.py::test_repeated_restarts <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py SKIPPED [ 52%] 9067s tests/test_nanny.py::test_restart_memory <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py SKIPPED [ 52%] 9067s tests/test_nanny.py::test_close_joins <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py SKIPPED [ 52%] 9071s tests/test_nanny.py::test_scheduler_crash_doesnt_restart <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 52%] 9071s tests/test_nanny.py::test_malloc_trim_threshold <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py SKIPPED [ 52%] 9073s tests/test_nanny.py::test_default_client_does_not_propagate_to_subprocess <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 52%] 9074s tests/test_nanny.py::test_worker_inherits_temp_config <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 52%] 9075s tests/test_nanny.py::test_log_event <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 52%] 9078s tests/test_nanny.py::test_nanny_plugin_simple <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 52%] 9080s tests/test_nanny.py::test_nanny_plugin_register_during_start_success[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 52%] 9082s tests/test_nanny.py::test_nanny_plugin_register_during_start_success[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 52%] 9082s tests/test_nanny.py::test_nanny_plugin_register_during_start_failure[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 52%] 9082s tests/test_nanny.py::test_nanny_plugin_register_during_start_failure[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 52%] 9083s tests/test_nanny.py::test_nanny_plugin_register_nanny_killed[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 52%] 9083s tests/test_nanny.py::test_nanny_plugin_register_nanny_killed[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 52%] 9085s tests/test_preload.py::test_worker_preload_file <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_preload.py PASSED [ 52%] 9086s tests/test_preload.py::test_worker_preload_config <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_preload.py PASSED [ 52%] 9088s tests/test_preload.py::test_worker_preload_module <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_preload.py PASSED [ 52%] 9088s tests/test_preload.py::test_worker_preload_click <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_preload.py PASSED [ 52%] 9088s tests/test_preload.py::test_worker_preload_click_async <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_preload.py PASSED [ 53%] 9088s tests/test_preload.py::test_web_preload <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_preload.py PASSED [ 53%] 9088s tests/test_preload.py::test_scheduler_startup <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_preload.py PASSED [ 53%] 9089s tests/test_preload.py::test_scheduler_startup_nanny <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_preload.py PASSED [ 53%] 9090s tests/test_preload.py::test_web_preload_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_preload.py PASSED [ 53%] 9090s tests/test_preload.py::test_client_preload_text <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_preload.py XFAIL [ 53%] 9091s tests/test_preload.py::test_client_preload_config <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_preload.py PASSED [ 53%] 9091s tests/test_preload.py::test_client_preload_click <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_preload.py XFAIL [ 53%] 9091s tests/test_preload.py::test_failure_doesnt_crash_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_preload.py PASSED [ 53%] 9092s tests/test_preload.py::test_failure_doesnt_crash_nanny <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_preload.py PASSED [ 53%] 9092s tests/test_preload.py::test_failure_doesnt_crash_client <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_preload.py PASSED [ 53%] 9092s tests/test_preload.py::test_client_preload_config_click <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_preload.py PASSED [ 53%] 9092s tests/test_priorities.py::test_submit[queue on worker] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_priorities.py PASSED [ 53%] 9092s tests/test_priorities.py::test_submit[queue on scheduler] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_priorities.py PASSED [ 53%] 9093s tests/test_priorities.py::test_map[queue on worker] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_priorities.py PASSED [ 53%] 9093s tests/test_priorities.py::test_map[queue on scheduler] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_priorities.py PASSED [ 53%] 9093s tests/test_priorities.py::test_compute[queue on worker] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_priorities.py PASSED [ 53%] 9093s tests/test_priorities.py::test_compute[queue on scheduler] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_priorities.py PASSED [ 53%] 9093s tests/test_priorities.py::test_persist[queue on worker] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_priorities.py PASSED [ 53%] 9093s tests/test_priorities.py::test_persist[queue on scheduler] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_priorities.py PASSED [ 53%] 9093s tests/test_priorities.py::test_annotate_compute[queue on worker] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_priorities.py PASSED [ 53%] 9094s tests/test_priorities.py::test_annotate_compute[queue on scheduler] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_priorities.py PASSED [ 53%] 9094s tests/test_priorities.py::test_annotate_persist[queue on worker] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_priorities.py PASSED [ 53%] 9094s tests/test_priorities.py::test_annotate_persist[queue on scheduler] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_priorities.py PASSED [ 53%] 9095s tests/test_priorities.py::test_repeated_persists_same_priority[queue on worker] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_priorities.py PASSED [ 53%] 9095s tests/test_priorities.py::test_repeated_persists_same_priority[queue on scheduler] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_priorities.py PASSED [ 53%] 9095s tests/test_priorities.py::test_last_in_first_out[queue on worker] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_priorities.py PASSED [ 53%] 9096s tests/test_priorities.py::test_last_in_first_out[queue on scheduler] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_priorities.py PASSED [ 53%] 9098s tests/test_profile.py::test_basic <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 53%] 9098s tests/test_profile.py::test_basic_low_level <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py SKIPPED [ 53%] 9098s tests/test_profile.py::test_merge <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 53%] 9098s tests/test_profile.py::test_merge_empty <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 53%] 9098s tests/test_profile.py::test_call_stack <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 54%] 9098s tests/test_profile.py::test_identifier <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 54%] 9098s tests/test_profile.py::test_watch <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 54%] 9099s tests/test_profile.py::test_watch_requires_lock_to_run <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 54%] 9099s tests/test_profile.py::test_info_frame_f_lineno[-1-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 54%] 9099s tests/test_profile.py::test_info_frame_f_lineno[0-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 54%] 9099s tests/test_profile.py::test_info_frame_f_lineno[1-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 54%] 9099s tests/test_profile.py::test_info_frame_f_lineno[11-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 54%] 9099s tests/test_profile.py::test_info_frame_f_lineno[12-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 54%] 9099s tests/test_profile.py::test_info_frame_f_lineno[21-4] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 54%] 9099s tests/test_profile.py::test_info_frame_f_lineno[22-4] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 54%] 9099s tests/test_profile.py::test_info_frame_f_lineno[23-4] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 54%] 9099s tests/test_profile.py::test_info_frame_f_lineno[24-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 54%] 9099s tests/test_profile.py::test_info_frame_f_lineno[25-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 54%] 9099s tests/test_profile.py::test_info_frame_f_lineno[26-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 54%] 9099s tests/test_profile.py::test_info_frame_f_lineno[27-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 54%] 9099s tests/test_profile.py::test_info_frame_f_lineno[100-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 54%] 9099s tests/test_profile.py::test_call_stack_f_lineno[-1-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 54%] 9099s tests/test_profile.py::test_call_stack_f_lineno[0-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 54%] 9099s tests/test_profile.py::test_call_stack_f_lineno[1-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 54%] 9099s tests/test_profile.py::test_call_stack_f_lineno[11-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 54%] 9099s tests/test_profile.py::test_call_stack_f_lineno[12-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 54%] 9099s tests/test_profile.py::test_call_stack_f_lineno[21-4] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 54%] 9099s tests/test_profile.py::test_call_stack_f_lineno[22-4] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 54%] 9099s tests/test_profile.py::test_call_stack_f_lineno[23-4] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 54%] 9099s tests/test_profile.py::test_call_stack_f_lineno[24-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 54%] 9099s tests/test_profile.py::test_call_stack_f_lineno[25-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 54%] 9099s tests/test_profile.py::test_call_stack_f_lineno[26-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 54%] 9099s tests/test_profile.py::test_call_stack_f_lineno[27-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 54%] 9099s tests/test_profile.py::test_call_stack_f_lineno[100-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 54%] 9099s tests/test_profile.py::test_builtin <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 54%] 9099s tests/test_publish.py::test_publish_simple <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_publish.py PASSED [ 54%] 9099s tests/test_publish.py::test_publish_non_string_key <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_publish.py PASSED [ 55%] 9099s tests/test_publish.py::test_publish_roundtrip <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_publish.py PASSED [ 55%] 9100s tests/test_publish.py::test_unpublish <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_publish.py PASSED [ 55%] 9101s tests/test_publish.py::test_unpublish_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_publish.py PASSED [ 55%] 9101s tests/test_publish.py::test_publish_multiple_datasets <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_publish.py PASSED [ 55%] 9103s tests/test_publish.py::test_unpublish_multiple_datasets_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_publish.py PASSED [ 55%] 9103s tests/test_publish.py::test_publish_bag <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_publish.py PASSED [ 55%] 9105s tests/test_publish.py::test_datasets_setitem <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_publish.py PASSED [ 55%] 9107s tests/test_publish.py::test_datasets_getitem <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_publish.py PASSED [ 55%] 9108s tests/test_publish.py::test_datasets_getitem_default <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_publish.py PASSED [ 55%] 9109s tests/test_publish.py::test_datasets_delitem <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_publish.py PASSED [ 55%] 9111s tests/test_publish.py::test_datasets_keys <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_publish.py PASSED [ 55%] 9112s tests/test_publish.py::test_datasets_contains <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_publish.py PASSED [ 55%] 9114s tests/test_publish.py::test_datasets_republish <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_publish.py PASSED [ 55%] 9115s tests/test_publish.py::test_datasets_iter <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_publish.py PASSED [ 55%] 9116s tests/test_publish.py::test_datasets_async <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_publish.py PASSED [ 55%] 9116s tests/test_publish.py::test_pickle_safe <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_publish.py PASSED [ 55%] 9116s tests/test_publish.py::test_deserialize_client <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_publish.py PASSED [ 55%] 9116s tests/test_publish.py::test_publish_submit_ordering <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_publish.py PASSED [ 55%] 9116s tests/test_pubsub.py::test_speed <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_pubsub.py PASSED [ 55%] 9117s tests/test_pubsub.py::test_client <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_pubsub.py PASSED [ 55%] 9117s tests/test_pubsub.py::test_timeouts <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_pubsub.py PASSED [ 55%] 9117s tests/test_pubsub.py::test_repr <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_pubsub.py PASSED [ 55%] 9117s tests/test_pubsub.py::test_basic <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_pubsub.py XPASS [ 55%] 9117s tests/test_queues.py::test_queue <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_queues.py PASSED [ 55%] 9118s tests/test_queues.py::test_queue_with_data <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_queues.py PASSED [ 55%] 9121s tests/test_queues.py::test_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_queues.py PASSED [ 55%] 9121s tests/test_queues.py::test_hold_futures <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_queues.py PASSED [ 55%] 9121s tests/test_queues.py::test_picklability <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_queues.py PASSED [ 55%] 9122s tests/test_queues.py::test_picklability_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_queues.py PASSED [ 55%] 9122s tests/test_queues.py::test_race <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_queues.py SKIPPED [ 55%] 9123s tests/test_queues.py::test_same_futures <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_queues.py PASSED [ 55%] 9123s tests/test_queues.py::test_get_many <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_queues.py PASSED [ 56%] 9123s tests/test_queues.py::test_Future_knows_status_immediately <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_queues.py PASSED [ 56%] 9123s tests/test_queues.py::test_erred_future <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_queues.py PASSED [ 56%] 9123s tests/test_queues.py::test_close <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_queues.py PASSED [ 56%] 9124s tests/test_queues.py::test_timeout <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_queues.py PASSED [ 56%] 9124s tests/test_queues.py::test_2220 <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_queues.py PASSED [ 56%] 9124s tests/test_queues.py::test_unpickle_without_client <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_queues.py PASSED [ 56%] 9125s tests/test_reschedule.py::test_scheduler_reschedule_warns <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_reschedule.py PASSED [ 56%] 9126s tests/test_reschedule.py::test_raise_reschedule[executing] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_reschedule.py PASSED [ 56%] 9126s tests/test_reschedule.py::test_raise_reschedule[long-running] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_reschedule.py PASSED [ 56%] 9126s tests/test_reschedule.py::test_cancelled_reschedule[executing] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_reschedule.py PASSED [ 56%] 9126s tests/test_reschedule.py::test_cancelled_reschedule[long-running] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_reschedule.py PASSED [ 56%] 9126s tests/test_reschedule.py::test_cancelled_reschedule_worker_state[executing] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_reschedule.py PASSED [ 56%] 9126s tests/test_reschedule.py::test_cancelled_reschedule_worker_state[long-running] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_reschedule.py PASSED [ 56%] 9126s tests/test_reschedule.py::test_reschedule_releases[executing] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_reschedule.py PASSED [ 56%] 9126s tests/test_reschedule.py::test_reschedule_releases[long-running] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_reschedule.py PASSED [ 56%] 9126s tests/test_reschedule.py::test_reschedule_cancelled[executing] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_reschedule.py PASSED [ 56%] 9126s tests/test_reschedule.py::test_reschedule_cancelled[long-running] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_reschedule.py PASSED [ 56%] 9126s tests/test_reschedule.py::test_reschedule_resumed[executing] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_reschedule.py PASSED [ 56%] 9126s tests/test_reschedule.py::test_reschedule_resumed[long-running] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_reschedule.py PASSED [ 56%] 9126s tests/test_resources.py::test_resource_submit <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 56%] 9127s tests/test_resources.py::test_submit_many_non_overlapping <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 56%] 9128s tests/test_resources.py::test_submit_many_non_overlapping_2 <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 56%] 9128s tests/test_resources.py::test_move <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 56%] 9128s tests/test_resources.py::test_dont_work_steal <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 56%] 9129s tests/test_resources.py::test_map <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 56%] 9129s tests/test_resources.py::test_persist <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 56%] 9129s tests/test_resources.py::test_compute <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 56%] 9129s tests/test_resources.py::test_get <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 56%] 9129s tests/test_resources.py::test_persist_multiple_collections <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 56%] 9129s tests/test_resources.py::test_resources_str <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 56%] 9132s tests/test_resources.py::test_minimum_resource <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 56%] 9132s tests/test_resources.py::test_constrained_vs_ready_priority_1[1-0-y-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 57%] 9132s tests/test_resources.py::test_constrained_vs_ready_priority_1[1-0-y-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 57%] 9132s tests/test_resources.py::test_constrained_vs_ready_priority_1[0-1-x-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 57%] 9132s tests/test_resources.py::test_constrained_vs_ready_priority_1[0-1-x-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 57%] 9132s tests/test_resources.py::test_constrained_vs_ready_priority_2[1-0-y-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 57%] 9132s tests/test_resources.py::test_constrained_vs_ready_priority_2[1-0-y-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 57%] 9132s tests/test_resources.py::test_constrained_vs_ready_priority_2[0-1-x-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 57%] 9132s tests/test_resources.py::test_constrained_vs_ready_priority_2[0-1-x-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 57%] 9132s tests/test_resources.py::test_constrained_tasks_respect_priority <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 57%] 9132s tests/test_resources.py::test_task_cancelled_and_readded_with_resources <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 57%] 9132s tests/test_resources.py::test_balance_resources <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py SKIPPED [ 57%] 9132s tests/test_resources.py::test_set_resources <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 57%] 9132s tests/test_resources.py::test_persist_collections <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 57%] 9132s tests/test_resources.py::test_dont_optimize_out <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py SKIPPED [ 57%] 9132s tests/test_resources.py::test_full_collections <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py SKIPPED [ 57%] 9132s tests/test_resources.py::test_collections_get[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py XFAIL [ 57%] 9134s tests/test_resources.py::test_collections_get[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 57%] 9134s tests/test_resources.py::test_resources_from_config <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 57%] 9135s tests/test_resources.py::test_resources_from_python_override_config <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 57%] 9135s tests/test_resources.py::test_cancelled_with_resources[executing-ExecuteSuccessEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 57%] 9135s tests/test_resources.py::test_cancelled_with_resources[executing-ExecuteFailureEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 57%] 9135s tests/test_resources.py::test_cancelled_with_resources[executing-RescheduleEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 57%] 9135s tests/test_resources.py::test_cancelled_with_resources[long-running-ExecuteSuccessEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 57%] 9135s tests/test_resources.py::test_cancelled_with_resources[long-running-ExecuteFailureEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 57%] 9135s tests/test_resources.py::test_cancelled_with_resources[long-running-RescheduleEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 57%] 9135s tests/test_resources.py::test_resumed_with_resources[executing-ExecuteSuccessEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 57%] 9135s tests/test_resources.py::test_resumed_with_resources[executing-ExecuteFailureEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 57%] 9135s tests/test_resources.py::test_resumed_with_resources[executing-RescheduleEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 57%] 9135s tests/test_resources.py::test_resumed_with_resources[long-running-ExecuteSuccessEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 57%] 9135s tests/test_resources.py::test_resumed_with_resources[long-running-ExecuteFailureEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 57%] 9135s tests/test_resources.py::test_resumed_with_resources[long-running-RescheduleEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 57%] 9135s tests/test_resources.py::test_resumed_with_different_resources[executing-ExecuteSuccessEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 57%] 9135s tests/test_resources.py::test_resumed_with_different_resources[executing-ExecuteFailureEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 58%] 9135s tests/test_resources.py::test_resumed_with_different_resources[executing-RescheduleEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 58%] 9135s tests/test_resources.py::test_resumed_with_different_resources[long-running-ExecuteSuccessEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 58%] 9135s tests/test_resources.py::test_resumed_with_different_resources[long-running-ExecuteFailureEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 58%] 9135s tests/test_resources.py::test_resumed_with_different_resources[long-running-RescheduleEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 58%] 9135s tests/test_scheduler.py::test_administration <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 58%] 9135s tests/test_scheduler.py::test_respect_data_in_memory <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 58%] 9135s tests/test_scheduler.py::test_recompute_released_results <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 58%] 9136s tests/test_scheduler.py::test_decide_worker_with_many_independent_leaves <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 58%] 9136s tests/test_scheduler.py::test_decide_worker_with_restrictions <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 58%] 9138s tests/test_scheduler.py::test_decide_worker_coschedule_order_neighbors[nthreads0-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 58%] 9140s tests/test_scheduler.py::test_decide_worker_coschedule_order_neighbors[nthreads0-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 58%] 9141s tests/test_scheduler.py::test_decide_worker_coschedule_order_neighbors[nthreads0-4] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 58%] 9142s tests/test_scheduler.py::test_decide_worker_coschedule_order_neighbors[nthreads1-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 58%] 9142s tests/test_scheduler.py::test_decide_worker_coschedule_order_neighbors[nthreads1-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 58%] 9143s tests/test_scheduler.py::test_decide_worker_coschedule_order_neighbors[nthreads1-4] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 58%] 9143s tests/test_scheduler.py::test_override_is_rootish <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 58%] 9143s tests/test_scheduler.py::test_decide_worker_rootish_while_last_worker_is_retiring <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py SKIPPED [ 58%] 9144s tests/test_scheduler.py::test_graph_execution_width <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 58%] 9145s tests/test_scheduler.py::test_forget_tasks_while_processing <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 58%] 9145s tests/test_scheduler.py::test_restart_while_processing <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py SKIPPED [ 58%] 9146s tests/test_scheduler.py::test_queued_release_multiple_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 58%] 9146s tests/test_scheduler.py::test_queued_paused_new_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 58%] 9146s tests/test_scheduler.py::test_queued_paused_unpaused[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 58%] 9147s tests/test_scheduler.py::test_queued_paused_unpaused[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 58%] 9147s tests/test_scheduler.py::test_queued_remove_add_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 58%] 9147s tests/test_scheduler.py::test_secede_opens_slot <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 58%] 9148s tests/test_scheduler.py::test_saturation_factor[2.5-expected_task_counts0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 58%] 9148s tests/test_scheduler.py::test_saturation_factor[2.0-expected_task_counts1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 58%] 9148s tests/test_scheduler.py::test_saturation_factor[1.1-expected_task_counts2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 58%] 9148s tests/test_scheduler.py::test_saturation_factor[1.0-expected_task_counts3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 58%] 9148s tests/test_scheduler.py::test_saturation_factor[0.1-expected_task_counts4] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 59%] 9149s tests/test_scheduler.py::test_saturation_factor[inf-expected_task_counts5] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 59%] 9149s tests/test_scheduler.py::test_saturation_factor[inf-expected_task_counts6] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 59%] 9149s tests/test_scheduler.py::test_bad_saturation_factor <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 59%] 9149s tests/test_scheduler.py::test_move_data_over_break_restrictions <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 59%] 9149s tests/test_scheduler.py::test_balance_with_restrictions <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 59%] 9149s tests/test_scheduler.py::test_no_valid_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 59%] 9150s tests/test_scheduler.py::test_no_valid_workers_loose_restrictions <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 59%] 9150s tests/test_scheduler.py::test_no_workers[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 59%] 9150s tests/test_scheduler.py::test_no_workers[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 59%] 9150s tests/test_scheduler.py::test_retire_workers_empty <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 59%] 9150s tests/test_scheduler.py::test_retire_workers_lock <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 59%] 9151s tests/test_scheduler.py::test_retire_workers_concurrently <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 59%] 9151s tests/test_scheduler.py::test_server_listens_to_other_ops <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 59%] 9151s tests/test_scheduler.py::test_remove_worker_from_scheduler <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 59%] 9151s tests/test_scheduler.py::test_remove_worker_by_name_from_scheduler <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 59%] 9152s tests/test_scheduler.py::test_clear_events_worker_removal <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 59%] 9152s tests/test_scheduler.py::test_clear_events_client_removal <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 59%] 9152s tests/test_scheduler.py::test_add_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 59%] 9152s tests/test_scheduler.py::test_blocked_handlers_are_respected <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 59%] 9152s tests/test_scheduler.py::test_scheduler_init_pulls_blocked_handlers_from_config <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 59%] 9152s tests/test_scheduler.py::test_feed <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 59%] 9152s tests/test_scheduler.py::test_feed_setup_teardown <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 59%] 9153s tests/test_scheduler.py::test_feed_large_bytestring <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 59%] 9153s tests/test_scheduler.py::test_delete_data <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 59%] 9153s tests/test_scheduler.py::test_delete <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 59%] 9153s tests/test_scheduler.py::test_dumps_function <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 59%] 9153s tests/test_scheduler.py::test_ready_remove_worker[1.0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 59%] 9154s tests/test_scheduler.py::test_ready_remove_worker[inf] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 59%] 9154s tests/test_scheduler.py::test_restart <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py SKIPPED [ 59%] 9154s tests/test_scheduler.py::test_restart_waits_for_new_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py SKIPPED [ 59%] 9154s tests/test_scheduler.py::test_restart_nanny_timeout_exceeded <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py SKIPPED [ 59%] 9155s tests/test_scheduler.py::test_restart_not_all_workers_return <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 60%] 9155s tests/test_scheduler.py::test_restart_worker_rejoins_after_timeout_expired <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 60%] 9155s tests/test_scheduler.py::test_restart_no_wait_for_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 60%] 9155s tests/test_scheduler.py::test_restart_some_nannies_some_not <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py SKIPPED [ 60%] 9155s tests/test_scheduler.py::test_restart_heartbeat_before_closing <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py SKIPPED [ 60%] 9155s tests/test_scheduler.py::test_broadcast <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 60%] 9155s tests/test_scheduler.py::test_broadcast_tls <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 60%] 9156s tests/test_scheduler.py::test_broadcast_nanny <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 60%] 9158s tests/test_scheduler.py::test_broadcast_on_error <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 60%] 9158s tests/test_scheduler.py::test_broadcast_deprecation <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 60%] 9158s tests/test_scheduler.py::test_worker_name <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 60%] 9158s tests/test_scheduler.py::test_coerce_address <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 60%] 9158s tests/test_scheduler.py::test_config_stealing <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 60%] 9158s tests/test_scheduler.py::test_config_no_stealing <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 60%] 9158s tests/test_scheduler.py::test_update_graph_culls <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 60%] 9158s tests/test_scheduler.py::test_io_loop <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 60%] 9158s tests/test_scheduler.py::test_story <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 60%] 9159s tests/test_scheduler.py::test_scatter_no_workers[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 60%] 9159s tests/test_scheduler.py::test_scatter_no_workers[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 60%] 9159s tests/test_scheduler.py::test_scheduler_sees_memory_limits <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 60%] 9159s tests/test_scheduler.py::test_retire_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 60%] 9160s tests/test_scheduler.py::test_retire_workers_n <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 60%] 9160s tests/test_scheduler.py::test_workers_to_close <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 60%] 9161s tests/test_scheduler.py::test_workers_to_close_grouped <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 60%] 9161s tests/test_scheduler.py::test_workers_to_close_never_close_long_running[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 60%] 9161s tests/test_scheduler.py::test_workers_to_close_never_close_long_running[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 60%] 9161s tests/test_scheduler.py::test_retire_workers_no_suspicious_tasks <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 60%] 9161s tests/test_scheduler.py::test_file_descriptors <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py SKIPPED [ 60%] 9161s tests/test_scheduler.py::test_learn_occupancy <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py SKIPPED [ 60%] 9161s tests/test_scheduler.py::test_learn_occupancy_2 <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py SKIPPED [ 60%] 9163s tests/test_scheduler.py::test_balance_many_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 60%] 9166s tests/test_scheduler.py::test_include_communication_in_occupancy <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 60%] 9166s tests/test_scheduler.py::test_nonempty_data_is_rejected <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 61%] 9166s tests/test_scheduler.py::test_worker_arrives_with_data_is_rejected <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 61%] 9168s tests/test_scheduler.py::test_run_on_scheduler_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 61%] 9168s tests/test_scheduler.py::test_run_on_scheduler <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 61%] 9168s tests/test_scheduler.py::test_allow_pickle_false <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 61%] 9169s tests/test_scheduler.py::test_close_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 61%] 9169s tests/test_scheduler.py::test_close_nanny <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py SKIPPED [ 61%] 9169s tests/test_scheduler.py::test_retire_workers_close <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 61%] 9169s tests/test_scheduler.py::test_retire_nannies_close <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py SKIPPED [ 61%] 9170s tests/test_scheduler.py::test_fifo_submission <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 61%] 9171s tests/test_scheduler.py::test_profile_metadata <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 61%] 9172s tests/test_scheduler.py::test_profile_metadata_timeout <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 61%] 9172s tests/test_scheduler.py::test_profile_metadata_keys <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 61%] 9173s tests/test_scheduler.py::test_statistical_profiling <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 61%] 9173s tests/test_scheduler.py::test_statistical_profiling_failure <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 61%] 9174s tests/test_scheduler.py::test_cancel_fire_and_forget <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 61%] 9174s tests/test_scheduler.py::test_log_tasks_during_restart <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py SKIPPED [ 61%] 9174s tests/test_scheduler.py::test_get_task_status <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 61%] 9174s tests/test_scheduler.py::test_deque_handler <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 61%] 9174s tests/test_scheduler.py::test_retries <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 61%] 9174s tests/test_scheduler.py::test_missing_data_errant_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 61%] 9175s tests/test_scheduler.py::test_dont_recompute_if_persisted <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 61%] 9175s tests/test_scheduler.py::test_dont_recompute_if_persisted_2 <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 61%] 9175s tests/test_scheduler.py::test_dont_recompute_if_persisted_3 <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 61%] 9175s tests/test_scheduler.py::test_dont_recompute_if_persisted_4 <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 61%] 9175s tests/test_scheduler.py::test_dont_forget_released_keys <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 61%] 9176s tests/test_scheduler.py::test_dont_recompute_if_erred <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 61%] 9176s tests/test_scheduler.py::test_closing_scheduler_closes_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 61%] 9176s tests/test_scheduler.py::test_resources_reset_after_cancelled_task <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 61%] 9176s tests/test_scheduler.py::test_gh2187 <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 61%] 9176s tests/test_scheduler.py::test_collect_versions <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 61%] 9176s tests/test_scheduler.py::test_idle_timeout <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py SKIPPED [ 61%] 9177s tests/test_scheduler.py::test_idle_timeout_no_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 62%] 9179s tests/test_scheduler.py::test_no_workers_timeout_disabled <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 62%] 9179s tests/test_scheduler.py::test_no_workers_timeout_without_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py SKIPPED [ 62%] 9179s tests/test_scheduler.py::test_no_workers_timeout_bad_restrictions <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py SKIPPED [ 62%] 9179s tests/test_scheduler.py::test_no_workers_timeout_queued <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 62%] 9179s tests/test_scheduler.py::test_no_workers_timeout_processing <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py SKIPPED [ 62%] 9180s tests/test_scheduler.py::test_bandwidth <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 62%] 9180s tests/test_scheduler.py::test_bandwidth_clear <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py SKIPPED [ 62%] 9180s tests/test_scheduler.py::test_workerstate_clean <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 62%] 9180s tests/test_scheduler.py::test_result_type <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 62%] 9181s tests/test_scheduler.py::test_close_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 62%] 9181s tests/test_scheduler.py::test_host_address <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 62%] 9181s tests/test_scheduler.py::test_dashboard_address <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py SKIPPED [ 62%] 9181s tests/test_scheduler.py::test_adaptive_target <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 62%] 9181s tests/test_scheduler.py::test_adaptive_target_empty_cluster[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 62%] 9181s tests/test_scheduler.py::test_adaptive_target_empty_cluster[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 62%] 9181s tests/test_scheduler.py::test_retire_names_str <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 62%] 9181s tests/test_scheduler.py::test_retire_workers_bad_params <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 62%] 9182s tests/test_scheduler.py::test_get_task_duration <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 62%] 9182s tests/test_scheduler.py::test_task_groups <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 62%] 9183s tests/test_scheduler.py::test_task_groups_update_start_stop <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 62%] 9183s tests/test_scheduler.py::test_task_group_done <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 62%] 9183s tests/test_scheduler.py::test_task_group_not_done_waiting <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 62%] 9183s tests/test_scheduler.py::test_task_group_not_done_noworker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 62%] 9183s tests/test_scheduler.py::test_task_group_not_done_queued <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 62%] 9184s tests/test_scheduler.py::test_task_group_not_done_processing <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 62%] 9184s tests/test_scheduler.py::test_task_prefix <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 62%] 9184s tests/test_scheduler.py::test_failing_task_increments_suspicious <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py SKIPPED [ 62%] 9184s tests/test_scheduler.py::test_task_group_non_tuple_key <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 62%] 9184s tests/test_scheduler.py::test_task_unique_groups <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 62%] 9186s tests/test_scheduler.py::test_task_group_on_fire_and_forget <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 62%] 9186s tests/test_scheduler.py::test_gather_failing_can_recover <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 62%] 9186s tests/test_scheduler.py::test_gather_failing_cnn_error <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 9187s tests/test_scheduler.py::test_gather_no_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 9187s tests/test_scheduler.py::test_gather_bad_worker[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 9187s tests/test_scheduler.py::test_gather_bad_worker[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 9187s tests/test_scheduler.py::test_too_many_groups <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 9188s tests/test_scheduler.py::test_worker_name_collision <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 9188s tests/test_scheduler.py::test_unknown_task_duration_config <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 9188s tests/test_scheduler.py::test_unknown_task_duration_config_2 <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 9188s tests/test_scheduler.py::test_retire_state_change <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 9188s tests/test_scheduler.py::test_configurable_events_log_length <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 9188s tests/test_scheduler.py::test_get_worker_monitor_info <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 9189s tests/test_scheduler.py::test_quiet_cluster_round_robin <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 9189s tests/test_scheduler.py::test_memorystate <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 9189s tests/test_scheduler.py::test_memorystate_sum <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[0-0-0-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[0-0-0-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[0-0-0-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[0-0-0-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[0-0-1-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[0-0-1-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[0-0-1-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[0-0-1-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[0-0-2-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[0-0-2-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[0-0-2-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[0-0-2-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[0-0-3-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[0-0-3-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[0-0-3-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[0-0-3-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[0-1-0-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[0-1-0-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[0-1-0-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[0-1-0-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[0-1-1-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[0-1-1-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[0-1-1-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[0-1-1-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[0-1-2-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[0-1-2-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[0-1-2-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[0-1-2-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[0-1-3-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[0-1-3-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[0-1-3-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[0-1-3-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[0-2-0-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[0-2-0-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[0-2-0-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[0-2-0-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[0-2-1-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[0-2-1-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[0-2-1-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[0-2-1-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[0-2-2-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[0-2-2-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[0-2-2-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[0-2-2-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[0-2-3-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[0-2-3-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[0-2-3-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[0-2-3-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[0-3-0-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[0-3-0-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[0-3-0-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[0-3-0-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[0-3-1-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[0-3-1-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[0-3-1-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[0-3-1-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[0-3-2-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[0-3-2-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[0-3-2-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[0-3-2-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[0-3-3-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[0-3-3-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[0-3-3-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[0-3-3-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[1-0-0-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[1-0-0-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[1-0-0-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[1-0-0-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[1-0-1-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[1-0-1-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[1-0-1-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[1-0-1-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[1-0-2-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[1-0-2-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[1-0-2-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[1-0-2-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[1-0-3-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[1-0-3-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[1-0-3-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[1-0-3-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[1-1-0-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[1-1-0-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[1-1-0-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[1-1-0-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[1-1-1-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[1-1-1-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[1-1-1-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[1-1-1-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[1-1-2-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[1-1-2-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[1-1-2-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[1-1-2-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[1-1-3-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[1-1-3-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[1-1-3-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[1-1-3-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[1-2-0-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[1-2-0-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[1-2-0-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[1-2-0-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[1-2-1-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[1-2-1-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[1-2-1-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[1-2-1-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[1-2-2-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[1-2-2-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[1-2-2-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[1-2-2-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[1-2-3-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[1-2-3-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[1-2-3-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[1-2-3-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[1-3-0-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[1-3-0-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[1-3-0-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[1-3-0-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[1-3-1-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[1-3-1-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[1-3-1-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[1-3-1-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[1-3-2-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[1-3-2-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[1-3-2-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[1-3-2-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[1-3-3-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[1-3-3-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[1-3-3-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[1-3-3-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[2-0-0-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[2-0-0-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[2-0-0-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[2-0-0-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[2-0-1-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[2-0-1-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[2-0-1-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[2-0-1-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[2-0-2-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[2-0-2-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[2-0-2-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[2-0-2-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[2-0-3-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[2-0-3-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[2-0-3-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[2-0-3-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[2-1-0-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[2-1-0-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[2-1-0-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[2-1-0-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[2-1-1-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[2-1-1-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[2-1-1-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[2-1-1-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[2-1-2-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[2-1-2-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[2-1-2-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[2-1-2-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[2-1-3-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[2-1-3-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[2-1-3-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[2-1-3-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[2-2-0-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[2-2-0-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[2-2-0-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[2-2-0-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[2-2-1-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[2-2-1-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[2-2-1-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[2-2-1-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[2-2-2-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[2-2-2-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[2-2-2-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[2-2-2-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[2-2-3-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[2-2-3-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[2-2-3-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[2-2-3-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[2-3-0-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[2-3-0-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[2-3-0-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[2-3-0-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[2-3-1-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[2-3-1-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[2-3-1-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[2-3-1-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[2-3-2-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[2-3-2-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[2-3-2-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[2-3-2-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[2-3-3-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[2-3-3-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[2-3-3-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[2-3-3-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[3-0-0-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[3-0-0-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[3-0-0-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[3-0-0-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[3-0-1-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[3-0-1-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[3-0-1-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[3-0-1-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[3-0-2-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[3-0-2-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[3-0-2-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[3-0-2-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[3-0-3-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[3-0-3-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[3-0-3-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[3-0-3-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[3-1-0-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[3-1-0-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[3-1-0-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[3-1-0-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[3-1-1-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[3-1-1-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[3-1-1-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[3-1-1-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[3-1-2-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[3-1-2-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[3-1-2-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[3-1-2-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[3-1-3-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[3-1-3-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[3-1-3-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[3-1-3-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[3-2-0-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[3-2-0-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[3-2-0-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[3-2-0-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[3-2-1-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[3-2-1-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[3-2-1-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[3-2-1-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[3-2-2-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[3-2-2-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[3-2-2-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[3-2-2-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[3-2-3-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[3-2-3-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[3-2-3-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[3-2-3-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[3-3-0-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[3-3-0-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[3-3-0-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[3-3-0-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[3-3-1-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[3-3-1-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[3-3-1-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[3-3-1-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[3-3-2-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[3-3-2-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[3-3-2-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[3-3-2-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[3-3-3-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[3-3-3-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[3-3-3-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 9189s tests/test_scheduler.py::test_memorystate_adds_up[3-3-3-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 9189s tests/test_scheduler.py::test_memorystate__to_dict <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 9189s tests/test_scheduler.py::test_memory <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py SKIPPED [ 71%] 9189s tests/test_scheduler.py::test_memory_no_zict <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 9189s tests/test_scheduler.py::test_memory_no_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 9189s tests/test_scheduler.py::test_infrequent_sysmon <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 9189s tests/test_scheduler.py::test_close_scheduler__close_workers_Worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 9189s tests/test_scheduler.py::test_close_scheduler__close_workers_Nanny <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py SKIPPED [ 71%] 9189s tests/test_scheduler.py::test_rebalance <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py SKIPPED [ 71%] 9190s tests/test_scheduler.py::test_rebalance_managed_memory <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 9190s tests/test_scheduler.py::test_rebalance_workers_and_keys <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 9190s tests/test_scheduler.py::test_rebalance_missing_data1 <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 9190s tests/test_scheduler.py::test_rebalance_missing_data2 <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 9190s tests/test_scheduler.py::test_rebalance_raises_missing_data3[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 9191s tests/test_scheduler.py::test_rebalance_raises_missing_data3[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py XFAIL subject to a race 9191s condition. This test assumes that the data is freed before 9191s the rebalance get_data requests come in but merely deleting 9191s the futures is not sufficient to guarantee this) [ 71%] 9191s tests/test_scheduler.py::test_rebalance_no_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 9191s tests/test_scheduler.py::test_rebalance_no_limit <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 9191s tests/test_scheduler.py::test_rebalance_no_recipients <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py SKIPPED [ 72%] 9191s tests/test_scheduler.py::test_rebalance_skip_recipient <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 9191s tests/test_scheduler.py::test_rebalance_skip_all_recipients <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 9191s tests/test_scheduler.py::test_rebalance_sender_below_mean <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py SKIPPED [ 72%] 9191s tests/test_scheduler.py::test_rebalance_least_recently_inserted_sender_min <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py SKIPPED [ 72%] 9191s tests/test_scheduler.py::test_gather_on_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 9192s tests/test_scheduler.py::test_gather_on_worker_bad_recipient <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 9192s tests/test_scheduler.py::test_gather_on_worker_bad_sender <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 9192s tests/test_scheduler.py::test_gather_on_worker_bad_sender_replicated[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 9192s tests/test_scheduler.py::test_gather_on_worker_bad_sender_replicated[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 9192s tests/test_scheduler.py::test_gather_on_worker_key_not_on_sender <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 9193s tests/test_scheduler.py::test_gather_on_worker_key_not_on_sender_replicated[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 9193s tests/test_scheduler.py::test_gather_on_worker_key_not_on_sender_replicated[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 9193s tests/test_scheduler.py::test_gather_on_worker_duplicate_task <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 9193s tests/test_scheduler.py::test_rebalance_dead_recipient <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 9194s tests/test_scheduler.py::test_delete_worker_data <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 9194s tests/test_scheduler.py::test_delete_worker_data_double_delete <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 9194s tests/test_scheduler.py::test_delete_worker_data_bad_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 9194s tests/test_scheduler.py::test_delete_worker_data_bad_task[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 9194s tests/test_scheduler.py::test_delete_worker_data_bad_task[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 9194s tests/test_scheduler.py::test_transition_counter <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 9194s tests/test_scheduler.py::test_transition_counter_max_scheduler <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py SKIPPED [ 72%] 9194s tests/test_scheduler.py::test_transition_counter_max_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 9196s tests/test_scheduler.py::test_disable_transition_counter_max <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 9197s tests/test_scheduler.py::test_worker_heartbeat_after_cancel <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 9197s tests/test_scheduler.py::test_set_restrictions <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 9197s tests/test_scheduler.py::test_avoid_paused_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 9198s tests/test_scheduler.py::test_Scheduler__to_dict <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 9198s tests/test_scheduler.py::test_TaskState__to_dict <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 9198s tests/test_scheduler.py::test_get_cluster_state <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 9198s tests/test_scheduler.py::test_get_cluster_state_worker_error <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 9198s tests/test_scheduler.py::test_dump_cluster_state[msgpack] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 9199s tests/test_scheduler.py::test_dump_cluster_state[yaml] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 9199s tests/test_scheduler.py::test_repr <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 9200s tests/test_scheduler.py::test_ensure_events_dont_include_taskstate_objects <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 9200s tests/test_scheduler.py::test_worker_state_unique_regardless_of_address <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 9200s tests/test_scheduler.py::test_scheduler_close_fast_deprecated <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 9201s tests/test_scheduler.py::test_runspec_regression_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 9202s tests/test_scheduler.py::test_KilledWorker_informative_message <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 9202s tests/test_scheduler.py::test_count_task_prefix <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 9202s tests/test_scheduler.py::test_transition_waiting_memory <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 9202s tests/test_scheduler.py::test_deadlock_resubmit_queued_tasks_fast[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 9203s tests/test_scheduler.py::test_deadlock_resubmit_queued_tasks_fast[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 9203s tests/test_scheduler.py::test_submit_dependency_of_erred_task <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 9203s tests/test_scheduler.py::test_tell_workers_when_peers_have_left <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 9203s tests/test_scheduler.py::test_client_desires_keys_creates_ts <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 9204s tests/test_scheduler.py::test_scatter_creates_ts <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 9204s tests/test_scheduler.py::test_refuse_to_schedule_huge_task[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 9204s tests/test_scheduler.py::test_refuse_to_schedule_huge_task[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 9205s tests/test_scheduler.py::test_html_repr <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 9205s tests/test_scheduler.py::test_resubmit_different_task_same_key_before_previous_is_done[same] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 9205s tests/test_scheduler.py::test_resubmit_different_task_same_key_before_previous_is_done[less] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 9205s tests/test_scheduler.py::test_resubmit_different_task_same_key_before_previous_is_done[more] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 9205s tests/test_scheduler.py::test_resubmit_different_task_same_key_after_previous_is_done[False-same] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 9206s tests/test_scheduler.py::test_resubmit_different_task_same_key_after_previous_is_done[False-less] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 9206s tests/test_scheduler.py::test_resubmit_different_task_same_key_after_previous_is_done[False-more] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 9206s tests/test_scheduler.py::test_resubmit_different_task_same_key_after_previous_is_done[True-same] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 9206s tests/test_scheduler.py::test_resubmit_different_task_same_key_after_previous_is_done[True-less] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 9206s tests/test_scheduler.py::test_resubmit_different_task_same_key_after_previous_is_done[True-more] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 9207s tests/test_scheduler.py::test_resubmit_different_task_same_key_many_clients <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 9207s tests/test_scheduler.py::test_resubmit_nondeterministic_task_same_deps[before0-123-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 9207s tests/test_scheduler.py::test_resubmit_nondeterministic_task_same_deps[123-after1-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 9207s tests/test_scheduler.py::test_resubmit_nondeterministic_task_same_deps[before2-after2-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 9207s tests/test_scheduler.py::test_resubmit_nondeterministic_task_different_deps[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 9208s tests/test_scheduler.py::test_resubmit_nondeterministic_task_different_deps[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 74%] 9208s tests/test_scheduler.py::test_resubmit_different_task_same_key_warns_only_once[10-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 74%] 9208s tests/test_scheduler.py::test_resubmit_different_task_same_key_warns_only_once[30-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 74%] 9208s tests/test_scheduler.py::test_fan_out_pattern_deadlock <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 74%] 9208s tests/test_scheduler.py::test_stimulus_from_erred_task <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 74%] 9208s tests/test_security.py::test_defaults <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 74%] 9208s tests/test_security.py::test_constructor_errors <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 74%] 9208s tests/test_security.py::test_attribute_error <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 74%] 9208s tests/test_security.py::test_from_config <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 74%] 9208s tests/test_security.py::test_min_max_version_from_config[None-None] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 74%] 9208s tests/test_security.py::test_min_max_version_from_config[None-1.2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 74%] 9208s tests/test_security.py::test_min_max_version_from_config[None-1.3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 74%] 9208s tests/test_security.py::test_min_max_version_from_config[1.2-None] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 74%] 9208s tests/test_security.py::test_min_max_version_from_config[1.2-1.2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 74%] 9208s tests/test_security.py::test_min_max_version_from_config[1.2-1.3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 74%] 9208s tests/test_security.py::test_min_max_version_from_config[1.3-None] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 74%] 9208s tests/test_security.py::test_min_max_version_from_config[1.3-1.2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 74%] 9208s tests/test_security.py::test_min_max_version_from_config[1.3-1.3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 74%] 9208s tests/test_security.py::test_min_max_version_config_errors[min-version] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 74%] 9208s tests/test_security.py::test_min_max_version_config_errors[max-version] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 74%] 9208s tests/test_security.py::test_invalid_min_version_from_config_errors <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 74%] 9208s tests/test_security.py::test_kwargs <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 74%] 9208s tests/test_security.py::test_min_max_version_kwarg_errors[tls_min_version] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 74%] 9208s tests/test_security.py::test_min_max_version_kwarg_errors[tls_max_version] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 74%] 9209s tests/test_security.py::test_repr_temp_keys <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 74%] 9209s tests/test_security.py::test_repr_local_keys <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 74%] 9209s tests/test_security.py::test_tls_config_for_role <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 74%] 9209s tests/test_security.py::test_connection_args <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 74%] 9209s tests/test_security.py::test_extra_conn_args_connection_args <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 74%] 9209s tests/test_security.py::test_listen_args <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 74%] 9209s tests/test_security.py::test_temporary_credentials <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 74%] 9212s tests/test_security.py::test_extra_conn_args_in_temporary_credentials <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 74%] 9212s tests/test_semaphore.py::test_semaphore_trivial <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_semaphore.py PASSED [ 75%] 9212s tests/test_semaphore.py::test_serializable <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_semaphore.py PASSED [ 75%] 9212s tests/test_semaphore.py::test_release_simple <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_semaphore.py PASSED [ 75%] 9212s tests/test_semaphore.py::test_acquires_with_timeout <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_semaphore.py PASSED [ 75%] 9212s tests/test_semaphore.py::test_timeout_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_semaphore.py PASSED [ 75%] 9213s tests/test_semaphore.py::test_release_semaphore_after_timeout <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_semaphore.py PASSED [ 75%] 9213s tests/test_semaphore.py::test_async_ctx <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_semaphore.py PASSED [ 75%] 9215s tests/test_semaphore.py::test_worker_dies <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_semaphore.py PASSED [ 75%] 9216s tests/test_semaphore.py::test_access_semaphore_by_name <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_semaphore.py PASSED [ 75%] 9216s tests/test_semaphore.py::test_close_async <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_semaphore.py PASSED [ 75%] 9218s tests/test_semaphore.py::test_close_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_semaphore.py PASSED [ 75%] 9218s tests/test_semaphore.py::test_release_once_too_many <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_semaphore.py PASSED [ 75%] 9218s tests/test_semaphore.py::test_release_once_too_many_resilience <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_semaphore.py PASSED [ 75%] 9218s tests/test_semaphore.py::test_retry_acquire <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_semaphore.py PASSED [ 75%] 9219s tests/test_semaphore.py::test_oversubscribing_leases <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_semaphore.py PASSED [ 75%] 9219s tests/test_semaphore.py::test_timeout_zero <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_semaphore.py PASSED [ 75%] 9219s tests/test_semaphore.py::test_getvalue <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_semaphore.py PASSED [ 75%] 9220s tests/test_semaphore.py::test_metrics <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_semaphore.py PASSED [ 75%] 9220s tests/test_semaphore.py::test_release_retry <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_semaphore.py PASSED [ 75%] 9220s tests/test_semaphore.py::test_release_failure <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_semaphore.py PASSED [ 75%] 9220s tests/test_semaphore.py::test_unpickle_without_client <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_semaphore.py PASSED [ 75%] 9220s tests/test_sizeof.py::test_safe_sizeof[obj0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_sizeof.py PASSED [ 75%] 9220s tests/test_sizeof.py::test_safe_sizeof[obj1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_sizeof.py PASSED [ 75%] 9220s tests/test_sizeof.py::test_safe_sizeof[obj2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_sizeof.py PASSED [ 75%] 9220s tests/test_sizeof.py::test_safe_sizeof_logs_on_failure <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_sizeof.py PASSED [ 75%] 9220s tests/test_spans.py::test_spans <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 75%] 9221s tests/test_spans.py::test_submit <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 75%] 9221s tests/test_spans.py::test_multiple_tags <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 75%] 9221s tests/test_spans.py::test_repeat_span <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 75%] 9221s tests/test_spans.py::test_default_span <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 75%] 9223s tests/test_spans.py::test_no_extension <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 75%] 9223s tests/test_spans.py::test_task_groups[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 75%] 9223s tests/test_spans.py::test_task_groups[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 76%] 9224s tests/test_spans.py::test_before_first_task_finished <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 76%] 9224s tests/test_spans.py::test_duplicate_task_group <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 76%] 9224s tests/test_spans.py::test_mismatched_span[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 76%] 9224s tests/test_spans.py::test_mismatched_span[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 76%] 9224s tests/test_spans.py::test_no_tags <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 76%] 9225s tests/test_spans.py::test_client_desires_keys_creates_ts <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 76%] 9225s tests/test_spans.py::test_client_desires_keys_creates_tg <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 76%] 9225s tests/test_spans.py::test_scatter_creates_ts <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 76%] 9225s tests/test_spans.py::test_scatter_creates_tg <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 76%] 9225s tests/test_spans.py::test_worker_metrics <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 76%] 9226s tests/test_spans.py::test_merge_by_tags <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 76%] 9226s tests/test_spans.py::test_merge_by_tags_metrics <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 76%] 9226s tests/test_spans.py::test_code <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 76%] 9227s tests/test_spans.py::test_no_code_by_default <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 76%] 9227s tests/test_spans.py::test_merge_all <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 76%] 9227s tests/test_spans.py::test_merge_nothing <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 76%] 9227s tests/test_spans.py::test_active_cpu_seconds_trivial <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 76%] 9227s tests/test_spans.py::test_active_cpu_seconds_not_done[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 76%] 9228s tests/test_spans.py::test_active_cpu_seconds_not_done[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 76%] 9228s tests/test_spans.py::test_active_cpu_seconds_change_nthreads <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 76%] 9229s tests/test_spans.py::test_active_cpu_seconds_merged <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 76%] 9229s tests/test_spans.py::test_spans_are_visible_from_tasks <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 76%] 9229s tests/test_spans.py::test_span_on_persist <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 76%] 9229s tests/test_spans.py::test_collections_metadata <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py XFAIL [ 76%] 9229s tests/test_spec.py::test_address_default_none <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spec.py PASSED [ 76%] 9229s tests/test_spec.py::test_child_address_persists <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spec.py PASSED [ 76%] 9229s tests/test_spill.py::test_psize <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spill.py PASSED [ 76%] 9229s tests/test_spill.py::test_spillbuffer <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spill.py PASSED [ 76%] 9229s tests/test_spill.py::test_disk_size_calculation <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spill.py PASSED [ 76%] 9229s tests/test_spill.py::test_spillbuffer_maxlim <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spill.py PASSED [ 76%] 9229s tests/test_spill.py::test_spillbuffer_fail_to_serialize <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spill.py PASSED [ 77%] 9229s tests/test_spill.py::test_spillbuffer_evict <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spill.py PASSED [ 77%] 9229s tests/test_spill.py::test_no_pop <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spill.py PASSED [ 77%] 9229s tests/test_spill.py::test_weakref_cache[60-SupportsWeakRef-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spill.py PASSED [ 77%] 9229s tests/test_spill.py::test_weakref_cache[60-NoWeakRef-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spill.py PASSED [ 77%] 9229s tests/test_spill.py::test_weakref_cache[110-SupportsWeakRef-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spill.py PASSED [ 77%] 9229s tests/test_spill.py::test_weakref_cache[110-NoWeakRef-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spill.py PASSED [ 77%] 9229s tests/test_spill.py::test_metrics <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spill.py PASSED [ 77%] 9229s tests/test_spill.py::test_compression_settings[zlib-100-500] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spill.py PASSED [ 77%] 9229s tests/test_spill.py::test_compression_settings[None-20000-20500] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spill.py PASSED [ 77%] 9229s tests/test_spill.py::test_str_collision <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spill.py PASSED [ 77%] 9230s tests/test_steal.py::test_work_stealing <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 77%] 9230s tests/test_steal.py::test_dont_steal_expensive_data_fast_computation <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 77%] 9231s tests/test_steal.py::test_steal_cheap_data_slow_computation <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 77%] 9231s tests/test_steal.py::test_steal_expensive_data_slow_computation <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py SKIPPED [ 77%] 9233s tests/test_steal.py::test_worksteal_many_thieves <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 77%] 9233s tests/test_steal.py::test_stop_plugin <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 77%] 9234s tests/test_steal.py::test_stop_in_flight <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 77%] 9235s tests/test_steal.py::test_allow_tasks_stolen_before_first_completes <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 77%] 9236s tests/test_steal.py::test_eventually_steal_unknown_functions <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 77%] 9236s tests/test_steal.py::test_steal_related_tasks <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py SKIPPED [ 77%] 9237s tests/test_steal.py::test_dont_steal_fast_tasks_compute_time <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 77%] 9238s tests/test_steal.py::test_dont_steal_fast_tasks_blocklist <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 77%] 9241s tests/test_steal.py::test_new_worker_steals <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 77%] 9243s tests/test_steal.py::test_work_steal_allow_other_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 77%] 9243s tests/test_steal.py::test_dont_steal_worker_restrictions <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 77%] 9243s tests/test_steal.py::test_steal_worker_restrictions <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 77%] 9244s tests/test_steal.py::test_dont_steal_host_restrictions <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 77%] 9244s tests/test_steal.py::test_steal_host_restrictions <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 77%] 9244s tests/test_steal.py::test_dont_steal_resource_restrictions <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 77%] 9245s tests/test_steal.py::test_steal_resource_restrictions <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 77%] 9245s tests/test_steal.py::test_steal_resource_restrictions_asym_diff <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 77%] 9247s tests/test_steal.py::test_balance_without_dependencies <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 78%] 9247s tests/test_steal.py::test_dont_steal_executing_tasks <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 78%] 9248s tests/test_steal.py::test_dont_steal_executing_tasks_2 <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 78%] 9249s tests/test_steal.py::test_dont_steal_few_saturated_tasks_many_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 78%] 9249s tests/test_steal.py::test_steal_when_more_tasks <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 78%] 9250s tests/test_steal.py::test_steal_more_attractive_tasks <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 78%] 9250s tests/test_steal.py::test_balance[don't move unnecessarily] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 78%] 9251s tests/test_steal.py::test_balance[balance] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 78%] 9251s tests/test_steal.py::test_balance[balance even if results in even] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 78%] 9251s tests/test_steal.py::test_balance[don't over balance] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 78%] 9251s tests/test_steal.py::test_balance[move from larger] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 78%] 9252s tests/test_steal.py::test_balance[move to smaller] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 78%] 9252s tests/test_steal.py::test_balance[choose easier first] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 78%] 9252s tests/test_steal.py::test_balance[spread evenly] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 78%] 9252s tests/test_steal.py::test_balance[move easier] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 78%] 9252s tests/test_steal.py::test_balance[be willing to move costly items] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 78%] 9253s tests/test_steal.py::test_balance[but don't move too many] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 78%] 9253s tests/test_steal.py::test_balance[no one clearly saturated] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 78%] 9253s tests/test_steal.py::test_balance[balance multiple saturated workers] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 78%] 9256s tests/test_steal.py::test_restart <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 78%] 9257s tests/test_steal.py::test_paused_workers_must_not_steal <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 78%] 9257s tests/test_steal.py::test_dont_steal_already_released <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 78%] 9258s tests/test_steal.py::test_dont_steal_long_running_tasks <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 78%] 9259s tests/test_steal.py::test_cleanup_repeated_tasks <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 78%] 9261s tests/test_steal.py::test_lose_task <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 78%] 9261s tests/test_steal.py::test_parse_stealing_interval[None-100] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 78%] 9261s tests/test_steal.py::test_parse_stealing_interval[500ms-500] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 78%] 9261s tests/test_steal.py::test_parse_stealing_interval[2-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 78%] 9266s tests/test_steal.py::test_balance_with_longer_task <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 78%] 9266s tests/test_steal.py::test_steal_concurrent_simple <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 78%] 9267s tests/test_steal.py::test_steal_reschedule_reset_in_flight_occupancy <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 78%] 9268s tests/test_steal.py::test_get_story <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 78%] 9268s tests/test_steal.py::test_steal_worker_dies_same_ip <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 79%] 9268s tests/test_steal.py::test_reschedule_concurrent_requests_deadlock <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 79%] 9268s tests/test_steal.py::test_correct_bad_time_estimate <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py SKIPPED [ 79%] 9269s tests/test_steal.py::test_steal_stimulus_id_unique <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 79%] 9269s tests/test_steal.py::test_steal_worker_state[executing] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 79%] 9269s tests/test_steal.py::test_steal_worker_state[long-running] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 79%] 9269s tests/test_steal.py::test_steal_very_fast_tasks <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py SKIPPED [ 79%] 9270s tests/test_steal.py::test_balance_expensive_tasks[not enough work to steal] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 79%] 9270s tests/test_steal.py::test_balance_expensive_tasks[enough work to steal] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 79%] 9271s tests/test_steal.py::test_balance_expensive_tasks[not enough work for increased cost] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 79%] 9271s tests/test_steal.py::test_balance_uneven_without_replica <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 79%] 9272s tests/test_steal.py::test_balance_eventually_steals_large_dependency_without_replica <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 79%] 9272s tests/test_steal.py::test_balance_even_with_replica <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 79%] 9274s tests/test_steal.py::test_balance_to_replica <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 79%] 9276s tests/test_steal.py::test_balance_multiple_to_replica <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 79%] 9277s tests/test_steal.py::test_balance_to_larger_dependency <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 79%] 9279s tests/test_steal.py::test_balance_prefers_busier_with_dependency <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 79%] 9282s tests/test_steal.py::test_trivial_workload_should_not_cause_work_stealing <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 79%] 9282s tests/test_stories.py::test_scheduler_story_stimulus_success <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_stories.py PASSED [ 79%] 9282s tests/test_stories.py::test_scheduler_story_stimulus_retry <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_stories.py PASSED [ 79%] 9283s tests/test_stories.py::test_client_story <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_stories.py PASSED [ 79%] 9283s tests/test_stories.py::test_client_story_failed_worker[ignore] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_stories.py PASSED [ 79%] 9283s tests/test_stories.py::test_client_story_failed_worker[raise] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_stories.py PASSED [ 79%] 9283s tests/test_stories.py::test_worker_story_with_deps <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_stories.py PASSED [ 79%] 9284s tests/test_stress.py::test_stress_1 <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_stress.py PASSED [ 79%] 9284s tests/test_stress.py::test_stress_gc[slowinc-100] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_stress.py SKIPPED [ 79%] 9284s tests/test_stress.py::test_stress_gc[inc-1000] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_stress.py SKIPPED [ 79%] 9289s tests/test_stress.py::test_cancel_stress <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_stress.py PASSED [ 79%] 9295s tests/test_stress.py::test_cancel_stress_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_stress.py PASSED [ 79%] 9295s tests/test_stress.py::test_stress_creation_and_deletion <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_stress.py SKIPPED [ 79%] 9297s tests/test_stress.py::test_stress_scatter_death <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_stress.py PASSED [ 79%] 9297s tests/test_stress.py::test_stress_steal <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_stress.py SKIPPED [ 79%] 9297s tests/test_stress.py::test_close_connections <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_stress.py SKIPPED [ 80%] 9297s tests/test_stress.py::test_no_delay_during_large_transfer <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_stress.py SKIPPED [ 80%] 9297s tests/test_stress.py::test_chaos_rechunk <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_stress.py SKIPPED [ 80%] 9297s tests/test_system.py::test_memory_limit <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_system.py PASSED [ 80%] 9297s tests/test_system.py::test_hard_memory_limit_cgroups <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_system.py PASSED [ 80%] 9297s tests/test_system.py::test_soft_memory_limit_cgroups <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_system.py PASSED [ 80%] 9297s tests/test_system.py::test_hard_memory_limit_cgroups2 <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_system.py PASSED [ 80%] 9297s tests/test_system.py::test_soft_memory_limit_cgroups2 <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_system.py PASSED [ 80%] 9297s tests/test_system.py::test_softest_memory_limit_cgroups2 <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_system.py PASSED [ 80%] 9297s tests/test_system.py::test_rlimit <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_system.py PASSED [ 80%] 9297s tests/test_system_monitor.py::test_SystemMonitor <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_system_monitor.py PASSED [ 80%] 9297s tests/test_system_monitor.py::test_maxlen_zero <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_system_monitor.py PASSED [ 80%] 9297s tests/test_system_monitor.py::test_count <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_system_monitor.py PASSED [ 80%] 9297s tests/test_system_monitor.py::test_range_query <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_system_monitor.py PASSED [ 80%] 9297s tests/test_system_monitor.py::test_disk_config <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_system_monitor.py PASSED [ 80%] 9297s tests/test_system_monitor.py::test_host_cpu <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_system_monitor.py PASSED [ 80%] 9297s tests/test_system_monitor.py::test_gil_contention <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_system_monitor.py SKIPPED [ 80%] 9297s tests/test_threadpoolexecutor.py::test_tpe <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_threadpoolexecutor.py PASSED [ 80%] 9297s tests/test_threadpoolexecutor.py::test_shutdown_timeout <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_threadpoolexecutor.py PASSED [ 80%] 9298s tests/test_threadpoolexecutor.py::test_shutdown_timeout_raises <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_threadpoolexecutor.py PASSED [ 80%] 9298s tests/test_threadpoolexecutor.py::test_shutdown_wait <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_threadpoolexecutor.py PASSED [ 80%] 9299s tests/test_threadpoolexecutor.py::test_secede_rejoin_busy <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_threadpoolexecutor.py PASSED [ 80%] 9299s tests/test_threadpoolexecutor.py::test_secede_rejoin_quiet <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_threadpoolexecutor.py PASSED [ 80%] 9299s tests/test_threadpoolexecutor.py::test_rejoin_idempotent <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_threadpoolexecutor.py PASSED [ 80%] 9299s tests/test_threadpoolexecutor.py::test_thread_name <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_threadpoolexecutor.py PASSED [ 80%] 9299s tests/test_tls_functional.py::test_basic <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_tls_functional.py PASSED [ 80%] 9299s tests/test_tls_functional.py::test_Queue <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_tls_functional.py PASSED [ 80%] 9300s tests/test_tls_functional.py::test_client_submit <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_tls_functional.py PASSED [ 80%] 9300s tests/test_tls_functional.py::test_gather <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_tls_functional.py PASSED [ 80%] 9300s tests/test_tls_functional.py::test_scatter <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_tls_functional.py PASSED [ 80%] 9302s tests/test_tls_functional.py::test_nanny <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_tls_functional.py PASSED [ 80%] 9302s tests/test_tls_functional.py::test_rebalance <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_tls_functional.py PASSED [ 80%] 9304s tests/test_tls_functional.py::test_work_stealing <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_tls_functional.py PASSED [ 81%] 9304s tests/test_tls_functional.py::test_worker_client <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_tls_functional.py PASSED [ 81%] 9305s tests/test_tls_functional.py::test_worker_client_gather <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_tls_functional.py PASSED [ 81%] 9305s tests/test_tls_functional.py::test_worker_client_executor <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_tls_functional.py PASSED [ 81%] 9309s tests/test_tls_functional.py::test_retire_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_tls_functional.py PASSED [ 81%] 9309s tests/test_tls_functional.py::test_security_dict_input <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_tls_functional.py PASSED [ 81%] 9309s tests/test_utils.py::test_All <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 81%] 9309s tests/test_utils.py::test_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 81%] 9309s tests/test_utils.py::test_sync_error <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 81%] 9309s tests/test_utils.py::test_sync_timeout <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 81%] 9309s tests/test_utils.py::test_sync_closed_loop <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 81%] 9309s tests/test_utils.py::test_sync_contextvars <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 81%] 9309s tests/test_utils.py::test_is_kernel <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py SKIPPED [ 81%] 9309s tests/test_utils.py::test_ensure_ip <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 81%] 9309s tests/test_utils.py::test_get_ip_interface <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 81%] 9309s tests/test_utils.py::test_get_mp_context <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 81%] 9309s tests/test_utils.py::test_truncate_exception <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 81%] 9309s tests/test_utils.py::test_get_traceback <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 81%] 9309s tests/test_utils.py::test_maybe_complex <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 81%] 9309s tests/test_utils.py::test_read_block <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 81%] 9309s tests/test_utils.py::test_seek_delimiter_endline <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 81%] 9309s tests/test_utils.py::test_ensure_memoryview[] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 81%] 9309s tests/test_utils.py::test_ensure_memoryview[data1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 81%] 9309s tests/test_utils.py::test_ensure_memoryview[1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 81%] 9309s tests/test_utils.py::test_ensure_memoryview[data3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 81%] 9309s tests/test_utils.py::test_ensure_memoryview[data4] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 81%] 9309s tests/test_utils.py::test_ensure_memoryview[data5] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 81%] 9309s tests/test_utils.py::test_ensure_memoryview[data6] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 81%] 9309s tests/test_utils.py::test_ensure_memoryview[data7] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 81%] 9309s tests/test_utils.py::test_ensure_memoryview[data8] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 81%] 9309s tests/test_utils.py::test_ensure_memoryview[data9] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 81%] 9309s tests/test_utils.py::test_ensure_memoryview[data10] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 81%] 9309s tests/test_utils.py::test_ensure_memoryview[data11] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 82%] 9309s tests/test_utils.py::test_ensure_memoryview[data12] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 82%] 9309s tests/test_utils.py::test_ensure_memoryview[data13] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 82%] 9309s tests/test_utils.py::test_ensure_memoryview[data14] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 82%] 9309s tests/test_utils.py::test_ensure_memoryview_ndarray[i8-12-shape0-strides0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 82%] 9309s tests/test_utils.py::test_ensure_memoryview_ndarray[i8-12-shape1-strides1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 82%] 9309s tests/test_utils.py::test_ensure_memoryview_ndarray[i8-12-shape2-strides2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 82%] 9309s tests/test_utils.py::test_ensure_memoryview_ndarray[i8-12-shape3-strides3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 82%] 9309s tests/test_utils.py::test_ensure_memoryview_ndarray[i8-12-shape4-strides4] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 82%] 9309s tests/test_utils.py::test_ensure_memoryview_pyarrow_buffer <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py SKIPPED [ 82%] 9309s tests/test_utils.py::test_nbytes <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 82%] 9309s tests/test_utils.py::test_open_port <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 82%] 9309s tests/test_utils.py::test_set_thread_state <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 82%] 9309s tests/test_utils.py::test_loop_runner <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 82%] 9309s tests/test_utils.py::test_two_loop_runners <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 82%] 9309s tests/test_utils.py::test_loop_runner_gen <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 82%] 9309s tests/test_utils.py::test_loop_runner_exception_in_start <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 82%] 9309s tests/test_utils.py::test_loop_runner_exception_in_teardown <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 82%] 9309s tests/test_utils.py::test_all_quiet_exceptions <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 82%] 9309s tests/test_utils.py::test_warn_on_duration <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 82%] 9309s tests/test_utils.py::test_logs <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 82%] 9309s tests/test_utils.py::test_is_valid_xml <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 82%] 9309s tests/test_utils.py::test_format_dashboard_link <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 82%] 9309s tests/test_utils.py::test_parse_ports <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 82%] 9309s tests/test_utils.py::test_run_in_executor_with_context <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 82%] 9309s tests/test_utils.py::test_run_in_executor_with_context_preserves_contextvars <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 82%] 9309s tests/test_utils.py::test_offload <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 82%] 9309s tests/test_utils.py::test_offload_preserves_contextvars <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 82%] 9309s tests/test_utils.py::test_no_default_deprecated <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 82%] 9309s tests/test_utils.py::test_iscoroutinefunction_unhashable_input <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 82%] 9309s tests/test_utils.py::test_iscoroutinefunction_nested_partial <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 82%] 9309s tests/test_utils.py::test_recursive_to_dict <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 83%] 9309s tests/test_utils.py::test_recursive_to_dict_no_nest <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 83%] 9309s tests/test_utils.py::test_log_errors <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 83%] 9309s tests/test_utils.py::test_log_errors_unroll_stack[0-test_utils] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 83%] 9309s tests/test_utils.py::test_log_errors_unroll_stack[1-a.b.c] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 83%] 9310s tests/test_utils.py::test_load_json_robust_timeout <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 83%] 9310s tests/test_utils.py::test_rate_limiter_filter <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 83%] 9310s tests/test_utils.py::test_tuple_comparable_lt[obj10-obj20-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 83%] 9310s tests/test_utils.py::test_tuple_comparable_lt[obj11-obj21-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 83%] 9310s tests/test_utils.py::test_tuple_comparable_lt[1-1-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 83%] 9310s tests/test_utils.py::test_tuple_comparable_lt[1-2-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 83%] 9310s tests/test_utils.py::test_tuple_comparable_lt[None-0-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 83%] 9310s tests/test_utils.py::test_tuple_comparable_lt[None-obj25-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 83%] 9310s tests/test_utils.py::test_tuple_comparable_eq[obj10-obj20-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 83%] 9310s tests/test_utils.py::test_tuple_comparable_eq[obj11-obj21-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 83%] 9310s tests/test_utils.py::test_tuple_comparable_eq[1-1-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 83%] 9310s tests/test_utils.py::test_tuple_comparable_eq[1-2-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 83%] 9310s tests/test_utils.py::test_tuple_comparable_eq[None-0-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 83%] 9310s tests/test_utils.py::test_tuple_comparable_eq[None-obj25-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 83%] 9310s tests/test_utils.py::test_tuple_comparable_error <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 83%] 9310s tests/test_utils_comm.py::test_pack_data <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_comm.py PASSED [ 83%] 9310s tests/test_utils_comm.py::test_subs_multiple <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_comm.py PASSED [ 83%] 9310s tests/test_utils_comm.py::test_gather_from_workers_missing_replicas <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_comm.py PASSED [ 83%] 9310s tests/test_utils_comm.py::test_gather_from_workers_permissive <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_comm.py PASSED [ 83%] 9311s tests/test_utils_comm.py::test_gather_from_workers_permissive_flaky <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_comm.py PASSED [ 83%] 9311s tests/test_utils_comm.py::test_gather_from_workers_busy <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_comm.py PASSED [ 83%] 9311s tests/test_utils_comm.py::test_gather_from_workers_serialization_error[pickle] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_comm.py PASSED [ 83%] 9311s tests/test_utils_comm.py::test_gather_from_workers_serialization_error[unpickle] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_comm.py PASSED [ 83%] 9311s tests/test_utils_comm.py::test_retry_no_exception <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_comm.py PASSED [ 83%] 9311s tests/test_utils_comm.py::test_retry0_raises_immediately <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_comm.py PASSED [ 83%] 9311s tests/test_utils_comm.py::test_retry_does_retry_and_sleep <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_comm.py PASSED [ 83%] 9311s tests/test_utils_comm.py::test_unpack_remotedata <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_comm.py PASSED [ 83%] 9311s tests/test_utils_perf.py::test_fractional_timer <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_perf.py PASSED [ 84%] 9311s tests/test_utils_perf.py::test_gc_diagnosis_cpu_time <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_perf.py SKIPPED [ 84%] 9312s tests/test_utils_perf.py::test_gc_diagnosis_rss_win <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_perf.py XFAIL [ 84%] 9314s tests/test_utils_test.py::test_bare_cluster <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 84%] 9315s tests/test_utils_test.py::test_gen_cluster <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 84%] 9315s tests/test_utils_test.py::test_gen_cluster_pytest_fixture <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 84%] 9315s tests/test_utils_test.py::test_gen_cluster_parametrized[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 84%] 9315s tests/test_utils_test.py::test_gen_cluster_multi_parametrized[a-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 84%] 9315s tests/test_utils_test.py::test_gen_cluster_multi_parametrized[b-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 84%] 9315s tests/test_utils_test.py::test_gen_cluster_parametrized_variadic_workers[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 84%] 9317s tests/test_utils_test.py::test_gen_cluster_set_config_nanny <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 84%] 9317s tests/test_utils_test.py::test_gen_cluster_cleans_up_client <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py SKIPPED [ 84%] 9317s tests/test_utils_test.py::test_gen_cluster_without_client <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 84%] 9317s tests/test_utils_test.py::test_gen_cluster_tls <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 84%] 9317s tests/test_utils_test.py::test_gen_cluster_validate <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 84%] 9317s tests/test_utils_test.py::test_gen_cluster_validate_override <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 84%] 9318s tests/test_utils_test.py::test_gen_test <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py XFAILn) [ 84%] 9318s tests/test_utils_test.py::test_gen_test_legacy_implicit <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py XFAIL [ 84%] 9318s tests/test_utils_test.py::test_gen_test_legacy_explicit <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py XFAIL [ 84%] 9318s tests/test_utils_test.py::test_gen_test_parametrized[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 84%] 9318s tests/test_utils_test.py::test_gen_test_double_parametrized[False-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 84%] 9318s tests/test_utils_test.py::test_gen_test_pytest_fixture <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 84%] 9318s tests/test_utils_test.py::test_gen_test_config <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 84%] 9318s tests/test_utils_test.py::test_gen_test_config_default <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 84%] 9318s tests/test_utils_test.py::test_new_config <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 84%] 9318s tests/test_utils_test.py::test_lingering_client <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 84%] 9320s tests/test_utils_test.py::test_lingering_client_2 <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 84%] 9321s tests/test_utils_test.py::test_tls_cluster <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 84%] 9321s tests/test_utils_test.py::test_tls_scheduler <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 84%] 9321s tests/test_utils_test.py::test__UnhashableCallable <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 84%] 9321s tests/test_utils_test.py::test_dump_cluster_state_timeout <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py SKIPPED [ 84%] 9321s tests/test_utils_test.py::test_assert_story <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 84%] 9321s tests/test_utils_test.py::test_assert_story_malformed_story[Missing payload, stimulus_id, ts] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 85%] 9321s tests/test_utils_test.py::test_assert_story_malformed_story[Missing (stimulus_id, ts)] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 85%] 9321s tests/test_utils_test.py::test_assert_story_malformed_story[Missing ts] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 85%] 9321s tests/test_utils_test.py::test_assert_story_malformed_story[ts is not a float] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 85%] 9321s tests/test_utils_test.py::test_assert_story_malformed_story[ts is in the future] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 85%] 9321s tests/test_utils_test.py::test_assert_story_malformed_story[ts is too old] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 85%] 9321s tests/test_utils_test.py::test_assert_story_malformed_story[stimulus_id is not a str] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 85%] 9321s tests/test_utils_test.py::test_assert_story_malformed_story[stimulus_id is an empty str] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 85%] 9321s tests/test_utils_test.py::test_assert_story_malformed_story[no payload] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 85%] 9321s tests/test_utils_test.py::test_assert_story_malformed_story[timestamps out of order] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 85%] 9322s tests/test_utils_test.py::test_assert_story_identity[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 85%] 9322s tests/test_utils_test.py::test_assert_story_identity[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 85%] 9322s tests/test_utils_test.py::test_dump_cluster_state <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 85%] 9322s tests/test_utils_test.py::test_dump_cluster_state_no_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 85%] 9323s tests/test_utils_test.py::test_dump_cluster_state_nannies <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 85%] 9324s tests/test_utils_test.py::test_dump_cluster_state_unresponsive_local_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 85%] 9324s tests/test_utils_test.py::test_dump_cluster_unresponsive_remote_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py SKIPPED [ 85%] 9325s tests/test_utils_test.py::test_check_process_leak <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 85%] 9328s tests/test_utils_test.py::test_check_process_leak_slow_cleanup <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 85%] 9328s tests/test_utils_test.py::test_check_process_leak_pre_cleanup[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 85%] 9328s tests/test_utils_test.py::test_check_process_leak_pre_cleanup[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 85%] 9328s tests/test_utils_test.py::test_check_process_leak_post_cleanup[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 85%] 9329s tests/test_utils_test.py::test_check_process_leak_post_cleanup[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 85%] 9331s tests/test_utils_test.py::test_start_failure_worker[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 85%] 9332s tests/test_utils_test.py::test_start_failure_worker[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 85%] 9333s tests/test_utils_test.py::test_start_failure_scheduler <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 85%] 9333s tests/test_utils_test.py::test_invalid_transitions <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 85%] 9333s tests/test_utils_test.py::test_invalid_worker_state <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 85%] 9333s tests/test_utils_test.py::test_raises_with_cause <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 85%] 9333s tests/test_utils_test.py::test_check_thread_leak <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py SKIPPED [ 85%] 9333s tests/test_utils_test.py::test_fail_hard[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 85%] 9333s tests/test_utils_test.py::test_fail_hard[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 85%] 9333s tests/test_utils_test.py::test_popen_write_during_terminate_deadlock <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 86%] 9343s tests/test_utils_test.py::test_popen_timeout <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 86%] 9343s tests/test_utils_test.py::test_popen_always_prints_output <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 86%] 9344s tests/test_utils_test.py::test_wait_for_state <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 86%] 9344s tests/test_utils_test.py::test_wait_for_stimulus <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 86%] 9344s tests/test_utils_test.py::test_ws_with_running_task[executing] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 86%] 9344s tests/test_utils_test.py::test_ws_with_running_task[long-running] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 86%] 9344s tests/test_utils_test.py::test_sizeof <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 86%] 9344s tests/test_utils_test.py::test_sizeof_error[12345.0-TypeError-Expected integer] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 86%] 9344s tests/test_utils_test.py::test_sizeof_error[-1-ValueError-larger than] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 86%] 9344s tests/test_utils_test.py::test_sizeof_error[0-ValueError-larger than] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 86%] 9344s tests/test_utils_test.py::test_sizeof_error[10-ValueError-larger than] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 86%] 9344s tests/test_utils_test.py::test_captured_logger <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 86%] 9344s tests/test_utils_test.py::test_captured_context_meter <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 86%] 9344s tests/test_variable.py::test_variable <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_variable.py PASSED [ 86%] 9345s tests/test_variable.py::test_delete_unset_variable <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_variable.py PASSED [ 86%] 9345s tests/test_variable.py::test_queue_with_data <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_variable.py PASSED [ 86%] 9346s tests/test_variable.py::test_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_variable.py PASSED [ 86%] 9347s tests/test_variable.py::test_hold_futures <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_variable.py PASSED [ 86%] 9347s tests/test_variable.py::test_timeout <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_variable.py PASSED [ 86%] 9349s tests/test_variable.py::test_timeout_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_variable.py PASSED [ 86%] 9349s tests/test_variable.py::test_cleanup <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_variable.py PASSED [ 86%] 9351s tests/test_variable.py::test_pickleable <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_variable.py PASSED [ 86%] 9351s tests/test_variable.py::test_timeout_get <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_variable.py PASSED [ 86%] 9351s tests/test_variable.py::test_race <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_variable.py SKIPPED [ 86%] 9351s tests/test_variable.py::test_Future_knows_status_immediately <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_variable.py PASSED [ 86%] 9352s tests/test_variable.py::test_erred_future <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_variable.py PASSED [ 86%] 9353s tests/test_variable.py::test_future_erred_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_variable.py PASSED [ 86%] 9354s tests/test_variable.py::test_variables_do_not_leak_client <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_variable.py PASSED [ 86%] 9354s tests/test_variable.py::test_unpickle_without_client <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_variable.py PASSED [ 86%] 9354s tests/test_versions.py::test_versions_match <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_versions.py PASSED [ 86%] 9354s tests/test_versions.py::test_version_mismatch[source-MISMATCHED] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_versions.py PASSED [ 86%] 9354s tests/test_versions.py::test_version_mismatch[source-MISSING] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_versions.py PASSED [ 87%] 9354s tests/test_versions.py::test_version_mismatch[source-KEY_ERROR] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_versions.py PASSED [ 87%] 9354s tests/test_versions.py::test_version_mismatch[source-NONE] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_versions.py PASSED [ 87%] 9354s tests/test_versions.py::test_version_mismatch[scheduler-MISMATCHED] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_versions.py PASSED [ 87%] 9354s tests/test_versions.py::test_version_mismatch[scheduler-MISSING] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_versions.py PASSED [ 87%] 9354s tests/test_versions.py::test_version_mismatch[scheduler-KEY_ERROR] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_versions.py PASSED [ 87%] 9355s tests/test_versions.py::test_version_mismatch[scheduler-NONE] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_versions.py PASSED [ 87%] 9355s tests/test_versions.py::test_version_mismatch[worker-1-MISMATCHED] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_versions.py PASSED [ 87%] 9355s tests/test_versions.py::test_version_mismatch[worker-1-MISSING] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_versions.py PASSED [ 87%] 9355s tests/test_versions.py::test_version_mismatch[worker-1-KEY_ERROR] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_versions.py PASSED [ 87%] 9355s tests/test_versions.py::test_version_mismatch[worker-1-NONE] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_versions.py PASSED [ 87%] 9355s tests/test_versions.py::test_scheduler_mismatched_irrelevant_package <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_versions.py PASSED [ 87%] 9355s tests/test_versions.py::test_scheduler_additional_irrelevant_package <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_versions.py PASSED [ 87%] 9355s tests/test_versions.py::test_python_mismatch[source] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_versions.py PASSED [ 87%] 9355s tests/test_versions.py::test_python_mismatch[scheduler] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_versions.py PASSED [ 87%] 9355s tests/test_versions.py::test_python_mismatch[worker-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_versions.py PASSED [ 87%] 9356s tests/test_versions.py::test_version_warning_in_cluster <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_versions.py PASSED [ 87%] 9356s tests/test_versions.py::test_python_version <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_versions.py PASSED [ 87%] 9356s tests/test_versions.py::test_version_custom_pkgs <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_versions.py PASSED [ 87%] 9356s tests/test_worker.py::test_worker_nthreads <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 87%] 9356s tests/test_worker.py::test_str <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 87%] 9356s tests/test_worker.py::test_identity <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 87%] 9356s tests/test_worker.py::test_worker_bad_args <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 87%] 9358s tests/test_worker.py::test_upload_file <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 87%] 9358s tests/test_worker.py::test_upload_file_pyc <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py SKIPPED [ 87%] 9359s tests/test_worker.py::test_upload_egg <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 87%] 9359s tests/test_worker.py::test_upload_pyz <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 87%] 9359s tests/test_worker.py::test_upload_large_file <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py SKIPPED [ 87%] 9359s tests/test_worker.py::test_broadcast <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 87%] 9359s tests/test_worker.py::test_worker_with_port_zero <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 87%] 9359s tests/test_worker.py::test_worker_port_range <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 87%] 9359s tests/test_worker.py::test_worker_waits_for_scheduler <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py SKIPPED [ 87%] 9359s tests/test_worker.py::test_worker_task_data <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 88%] 9359s tests/test_worker.py::test_error_message <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 88%] 9360s tests/test_worker.py::test_chained_error_message <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 88%] 9360s tests/test_worker.py::test_base_exception_in_task[BaseException-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py SKIPPED [ 88%] 9360s tests/test_worker.py::test_base_exception_in_task[BaseException-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py SKIPPED [ 88%] 9360s tests/test_worker.py::test_base_exception_in_task[SystemExit-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py SKIPPED [ 88%] 9360s tests/test_worker.py::test_base_exception_in_task[SystemExit-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py SKIPPED [ 88%] 9360s tests/test_worker.py::test_base_exception_in_task[KeyboardInterrupt-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py SKIPPED [ 88%] 9360s tests/test_worker.py::test_base_exception_in_task[KeyboardInterrupt-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py SKIPPED [ 88%] 9360s tests/test_worker.py::test_base_exception_in_task[CancelledError-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py SKIPPED [ 88%] 9360s tests/test_worker.py::test_base_exception_in_task[CancelledError-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py SKIPPED [ 88%] 9360s tests/test_worker.py::test_gather <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 88%] 9360s tests/test_worker.py::test_gather_missing_keys <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 88%] 9360s tests/test_worker.py::test_gather_missing_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 88%] 9360s tests/test_worker.py::test_gather_missing_workers_replicated[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py SKIPPED [ 88%] 9360s tests/test_worker.py::test_gather_missing_workers_replicated[True0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py SKIPPED [ 88%] 9360s tests/test_worker.py::test_gather_missing_workers_replicated[True1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py SKIPPED [ 88%] 9360s tests/test_worker.py::test_gather_missing_workers_replicated[True2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py SKIPPED [ 88%] 9360s tests/test_worker.py::test_gather_missing_workers_replicated[True3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py SKIPPED [ 88%] 9360s tests/test_worker.py::test_io_loop <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 88%] 9360s tests/test_worker.py::test_io_loop_alternate_loop <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 88%] 9361s tests/test_worker.py::test_access_key <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 88%] 9361s tests/test_worker.py::test_run_dask_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 88%] 9361s tests/test_worker.py::test_run_dask_worker_kwonlyarg <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 88%] 9361s tests/test_worker.py::test_run_coroutine_dask_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 88%] 9361s tests/test_worker.py::test_Executor <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 88%] 9361s tests/test_worker.py::test_close_on_disconnect <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 88%] 9362s tests/test_worker.py::test_memory_limit_auto <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 88%] 9362s tests/test_worker.py::test_inter_worker_communication <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 88%] 9362s tests/test_worker.py::test_clean <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 88%] 9362s tests/test_worker.py::test_message_breakup <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 88%] 9362s tests/test_worker.py::test_types <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 9363s tests/test_worker.py::test_system_monitor <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 9363s tests/test_worker.py::test_restrictions <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 9364s tests/test_worker.py::test_clean_nbytes <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 9366s tests/test_worker.py::test_gather_many_small[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 9367s tests/test_worker.py::test_gather_many_small[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 9367s tests/test_worker.py::test_multiple_transfers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 9367s tests/test_worker.py::test_share_communication <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py XFAIL [ 89%] 9368s tests/test_worker.py::test_dont_overlap_communications_to_same_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py XFAIL [ 89%] 9368s tests/test_worker.py::test_log_event <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 9368s tests/test_worker.py::test_log_exception_on_failed_task <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 9368s tests/test_worker.py::test_clean_up_dependencies <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 9368s tests/test_worker.py::test_hold_onto_dependents <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 9369s tests/test_worker.py::test_worker_death_timeout <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py XPASS [ 89%] 9369s tests/test_worker.py::test_stop_doing_unnecessary_work <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 9369s tests/test_worker.py::test_priorities <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 9371s tests/test_worker.py::test_heartbeats <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 9371s tests/test_worker.py::test_worker_dir[Worker] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 9371s tests/test_worker.py::test_worker_dir[Nanny] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 9372s tests/test_worker.py::test_default_worker_dir <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 9373s tests/test_worker.py::test_dataframe_attribute_error <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 9373s tests/test_worker.py::test_pid <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 9373s tests/test_worker.py::test_get_client <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 9375s tests/test_worker.py::test_get_client_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 9375s tests/test_worker.py::test_get_client_coroutine <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 9377s tests/test_worker.py::test_get_client_coroutine_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py XFAIL/distributed/pull/7339) [ 89%] 9377s tests/test_worker.py::test_global_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 9377s tests/test_worker.py::test_worker_fds <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 9377s tests/test_worker.py::test_service_hosts_match_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 9377s tests/test_worker.py::test_start_services <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 9379s tests/test_worker.py::test_scheduler_delay <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 9380s tests/test_worker.py::test_statistical_profiling <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 9380s tests/test_worker.py::test_statistical_profiling_2 <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py SKIPPED [ 90%] 9380s tests/test_worker.py::test_statistical_profiling_cycle <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 9380s tests/test_worker.py::test_get_current_task <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 9381s tests/test_worker.py::test_deque_handler <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 9381s tests/test_worker.py::test_scheduler_address_config <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 9381s tests/test_worker.py::test_wait_for_outgoing <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py SKIPPED [ 90%] 9381s tests/test_worker.py::test_prefer_gather_from_local_address <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 9382s tests/test_worker.py::test_avoid_oversubscription <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 9382s tests/test_worker.py::test_custom_metrics <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 9383s tests/test_worker.py::test_register_worker_callbacks <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 9383s tests/test_worker.py::test_register_worker_callbacks_err <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 9383s tests/test_worker.py::test_local_directory <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 9383s tests/test_worker.py::test_local_directory_make_new_directory <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 9385s tests/test_worker.py::test_host_address <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 9385s tests/test_worker.py::test_interface_async[Worker] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 9386s tests/test_worker.py::test_interface_async[Nanny] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 9386s tests/test_worker.py::test_protocol_from_scheduler_address[Worker] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py SKIPPED [ 90%] 9386s tests/test_worker.py::test_protocol_from_scheduler_address[Nanny] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py SKIPPED [ 90%] 9387s tests/test_worker.py::test_worker_listens_on_same_interface_by_default[Worker] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 9388s tests/test_worker.py::test_worker_listens_on_same_interface_by_default[Nanny] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 9388s tests/test_worker.py::test_close_gracefully <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py SKIPPED [ 90%] 9388s tests/test_worker.py::test_close_gracefully_no_suspicious_tasks <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py SKIPPED [ 90%] 9388s tests/test_worker.py::test_close_while_executing[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 9388s tests/test_worker.py::test_close_while_executing[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py SKIPPED [ 90%] 9388s tests/test_worker.py::test_close_async_task_handles_cancellation <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py SKIPPED [ 90%] 9388s tests/test_worker.py::test_lifetime <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py SKIPPED [ 90%] 9388s tests/test_worker.py::test_lifetime_stagger <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 9388s tests/test_worker.py::test_bad_metrics <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 9388s tests/test_worker.py::test_bad_startup <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 9388s tests/test_worker.py::test_update_latency <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 9388s tests/test_worker.py::test_workerstate_executing <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py SKIPPED [ 90%] 9388s tests/test_worker.py::test_shutdown_on_scheduler_comm_closed <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 9388s tests/test_worker.py::test_heartbeat_comm_closed <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 9388s tests/test_worker.py::test_heartbeat_missing <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 9388s tests/test_worker.py::test_heartbeat_missing_real_cluster <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 9388s tests/test_worker.py::test_heartbeat_missing_doesnt_restart <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py SKIPPED [ 91%] 9388s tests/test_worker.py::test_bad_local_directory <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 9388s tests/test_worker.py::test_taskstate_metadata <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 9389s tests/test_worker.py::test_executor_offload <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 9389s tests/test_worker.py::test_story <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 9389s tests/test_worker.py::test_stimulus_story <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 9389s tests/test_worker.py::test_worker_descopes_data <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 9390s tests/test_worker.py::test_gather_dep_one_worker_always_busy <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 9391s tests/test_worker.py::test_gather_dep_local_workers_first <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 9392s tests/test_worker.py::test_gather_dep_from_remote_workers_if_all_local_workers_are_busy <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 9392s tests/test_worker.py::test_worker_client_uses_default_no_close <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 9392s tests/test_worker.py::test_worker_client_closes_if_created_on_worker_one_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 9392s tests/test_worker.py::test_worker_client_closes_if_created_on_worker_last_worker_alive <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 9393s tests/test_worker.py::test_multiple_executors <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 9393s tests/test_worker.py::test_bad_executor_annotation <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 9393s tests/test_worker.py::test_process_executor <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 9393s tests/test_worker.py::test_process_executor_raise_exception <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 9394s tests/test_worker.py::test_worker_state_error_release_error_last <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 9394s tests/test_worker.py::test_worker_state_error_release_error_first <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 9394s tests/test_worker.py::test_worker_state_error_release_error_int <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 9395s tests/test_worker.py::test_worker_state_error_long_chain <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 9395s tests/test_worker.py::test_hold_on_to_replicas <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 9395s tests/test_worker.py::test_forget_dependents_after_release <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 9396s tests/test_worker.py::test_acquire_replicas <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 9396s tests/test_worker.py::test_acquire_replicas_same_channel <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 9397s tests/test_worker.py::test_acquire_replicas_many <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 9397s tests/test_worker.py::test_acquire_replicas_already_in_flight <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 9397s tests/test_worker.py::test_forget_acquire_replicas <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py SKIPPED [ 91%] 9397s tests/test_worker.py::test_remove_replicas_simple <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 9397s tests/test_worker.py::test_who_has_consistent_remove_replicas <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 9398s tests/test_worker.py::test_acquire_replicas_with_no_priority <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 9398s tests/test_worker.py::test_acquire_replicas_large_data <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 9398s tests/test_worker.py::test_missing_released_zombie_tasks <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 9398s tests/test_worker.py::test_missing_released_zombie_tasks_2 <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 9398s tests/test_worker.py::test_worker_status_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 9399s tests/test_worker.py::test_log_remove_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 9399s tests/test_worker.py::test_task_flight_compute_oserror <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 9399s tests/test_worker.py::test_gather_dep_cancelled_rescheduled <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 9400s tests/test_worker.py::test_gather_dep_do_not_handle_response_of_not_requested_tasks <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 9400s tests/test_worker.py::test_gather_dep_no_longer_in_flight_tasks <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 9402s tests/test_worker.py::test_get_data_cancelled_error <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 9402s tests/test_worker.py::test_Worker__to_dict <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 9402s tests/test_worker.py::test_extension_methods <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 9402s tests/test_worker.py::test_benchmark_hardware <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 9402s tests/test_worker.py::test_tick_interval <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py SKIPPED [ 92%] 9402s tests/test_worker.py::test_broken_comm <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py SKIPPED [ 92%] 9402s tests/test_worker.py::test_do_not_block_event_loop_during_shutdown <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 9403s tests/test_worker.py::test_reconnect_argument_deprecated <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 9403s tests/test_worker.py::test_worker_running_before_running_plugins <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 9403s tests/test_worker.py::test_execute_preamble_abort_retirement <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 9403s tests/test_worker.py::test_deprecation_of_renamed_worker_attributes <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 9405s tests/test_worker.py::test_forward_output <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 9405s tests/test_worker.py::test_offload_getdata <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 9406s tests/test_worker.py::test_startstops <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 9406s tests/test_worker.py::test_suppress_keyerror_for_cancelled_tasks[cancelled] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 9406s tests/test_worker.py::test_suppress_keyerror_for_cancelled_tasks[resumed] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 9408s tests/test_worker_client.py::test_submit_from_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_client.py PASSED [ 92%] 9408s tests/test_worker_client.py::test_submit_from_worker_async <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_client.py PASSED [ 92%] 9408s tests/test_worker_client.py::test_scatter_from_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_client.py PASSED [ 92%] 9408s tests/test_worker_client.py::test_scatter_singleton <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_client.py PASSED [ 92%] 9408s tests/test_worker_client.py::test_gather_multi_machine <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_client.py PASSED [ 92%] 9408s tests/test_worker_client.py::test_same_loop <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_client.py PASSED [ 93%] 9410s tests/test_worker_client.py::test_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_client.py PASSED [ 93%] 9411s tests/test_worker_client.py::test_async <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_client.py PASSED [ 93%] 9411s tests/test_worker_client.py::test_separate_thread_false <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_client.py PASSED [ 93%] 9411s tests/test_worker_client.py::test_client_executor <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_client.py PASSED [ 93%] 9411s tests/test_worker_client.py::test_local_client_warning <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_client.py PASSED [ 93%] 9412s tests/test_worker_client.py::test_closing_worker_doesnt_close_client <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_client.py PASSED [ 93%] 9413s tests/test_worker_client.py::test_timeout <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_client.py PASSED [ 93%] 9414s tests/test_worker_client.py::test_secede_without_stealing_issue_1262 <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_client.py PASSED [ 93%] 9414s tests/test_worker_client.py::test_compute_within_worker_client <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_client.py PASSED [ 93%] 9414s tests/test_worker_client.py::test_worker_client_rejoins <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_client.py PASSED [ 93%] 9414s tests/test_worker_client.py::test_submit_different_names <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_client.py XPASS [ 93%] 9415s tests/test_worker_client.py::test_secede_does_not_claim_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_client.py PASSED [ 93%] 9415s tests/test_worker_memory.py::test_parse_memory_limit_zero <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 93%] 9415s tests/test_worker_memory.py::test_resource_limit <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 93%] 9415s tests/test_worker_memory.py::test_parse_memory_limit_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 93%] 9415s tests/test_worker_memory.py::test_parse_memory_limit_worker_relative <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 93%] 9417s tests/test_worker_memory.py::test_parse_memory_limit_nanny <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 93%] 9417s tests/test_worker_memory.py::test_dict_data_if_no_spill_to_disk <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 93%] 9417s tests/test_worker_memory.py::test_worker_data_callable_local_directory <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 93%] 9417s tests/test_worker_memory.py::test_worker_data_callable_local_directory_kwargs <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 93%] 9417s tests/test_worker_memory.py::test_worker_data_callable_kwargs <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 93%] 9417s tests/test_worker_memory.py::test_workerstate_fail_to_pickle_execute_1[executing] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 93%] 9417s tests/test_worker_memory.py::test_workerstate_fail_to_pickle_execute_1[long-running] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 93%] 9417s tests/test_worker_memory.py::test_workerstate_fail_to_pickle_flight <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 93%] 9417s tests/test_worker_memory.py::test_fail_to_pickle_execute_2 <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 93%] 9417s tests/test_worker_memory.py::test_fail_to_pickle_spill <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 93%] 9418s tests/test_worker_memory.py::test_spill_target_threshold <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 93%] 9418s tests/test_worker_memory.py::test_spill_constrained <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 93%] 9418s tests/test_worker_memory.py::test_spill_spill_threshold <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 93%] 9418s tests/test_worker_memory.py::test_spill_hysteresis[False-10000000000-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 93%] 9419s tests/test_worker_memory.py::test_spill_hysteresis[0.7-0-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 93%] 9419s tests/test_worker_memory.py::test_spill_hysteresis[0.4-0-7] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 9419s tests/test_worker_memory.py::test_pause_executor_manual <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 9420s tests/test_worker_memory.py::test_pause_executor_with_memory_monitor <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 9420s tests/test_worker_memory.py::test_pause_prevents_deps_fetch <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 9420s tests/test_worker_memory.py::test_avoid_memory_monitor_if_zero_limit_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 9422s tests/test_worker_memory.py::test_avoid_memory_monitor_if_zero_limit_nanny <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 9422s tests/test_worker_memory.py::test_override_data_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 9423s tests/test_worker_memory.py::test_override_data_nanny <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 9424s tests/test_worker_memory.py::test_override_data_vs_memory_monitor <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 9424s tests/test_worker_memory.py::test_manual_evict_proto <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 9424s tests/test_worker_memory.py::test_nanny_terminate <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py SKIPPED [ 94%] 9424s tests/test_worker_memory.py::test_disk_cleanup_on_terminate[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py SKIPPED [ 94%] 9424s tests/test_worker_memory.py::test_disk_cleanup_on_terminate[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py SKIPPED [ 94%] 9424s tests/test_worker_memory.py::test_pause_while_spilling <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 9424s tests/test_worker_memory.py::test_release_evloop_while_spilling <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py SKIPPED [ 94%] 9424s tests/test_worker_memory.py::test_deprecated_attributes[Worker-memory_limit-123000000000.0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 9424s tests/test_worker_memory.py::test_deprecated_attributes[Worker-memory_target_fraction-0.789] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 9424s tests/test_worker_memory.py::test_deprecated_attributes[Worker-memory_spill_fraction-0.789] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 9424s tests/test_worker_memory.py::test_deprecated_attributes[Worker-memory_pause_fraction-0.789] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 9426s tests/test_worker_memory.py::test_deprecated_attributes[Nanny-memory_limit-123000000000.0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 9427s tests/test_worker_memory.py::test_deprecated_attributes[Nanny-memory_terminate_fraction-0.789] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 9427s tests/test_worker_memory.py::test_deprecated_memory_monitor_method_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 9429s tests/test_worker_memory.py::test_deprecated_memory_monitor_method_nanny <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 9429s tests/test_worker_memory.py::test_deprecated_params[memory_target_fraction] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 9429s tests/test_worker_memory.py::test_deprecated_params[memory_spill_fraction] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 9429s tests/test_worker_memory.py::test_deprecated_params[memory_pause_fraction] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 9429s tests/test_worker_memory.py::test_pause_while_idle <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 9430s tests/test_worker_memory.py::test_pause_while_saturated <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 9430s tests/test_worker_memory.py::test_worker_log_memory_limit_too_high <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 9430s tests/test_worker_memory.py::test_high_unmanaged_memory_warning <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 9430s tests/test_worker_memory.py::test_delete_spilled_keys <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 9431s tests/test_worker_metrics.py::test_task_lifecycle <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_metrics.py PASSED [ 95%] 9431s tests/test_worker_metrics.py::test_async_task <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_metrics.py PASSED [ 95%] 9431s tests/test_worker_metrics.py::test_custom_executor <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_metrics.py PASSED [ 95%] 9432s tests/test_worker_metrics.py::test_offload <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_metrics.py PASSED [ 95%] 9432s tests/test_worker_metrics.py::test_execute_failed <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_metrics.py PASSED [ 95%] 9432s tests/test_worker_metrics.py::test_cancelled_execute <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_metrics.py PASSED [ 95%] 9432s tests/test_worker_metrics.py::test_cancelled_flight <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_metrics.py PASSED [ 95%] 9432s tests/test_worker_metrics.py::test_gather_dep_busy <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_metrics.py PASSED [ 95%] 9434s tests/test_worker_metrics.py::test_gather_dep_no_task <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_metrics.py PASSED [ 95%] 9434s tests/test_worker_metrics.py::test_gather_dep_failed <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_metrics.py PASSED [ 95%] 9434s tests/test_worker_metrics.py::test_gather_dep_network_error <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_metrics.py PASSED [ 95%] 9434s tests/test_worker_metrics.py::test_memory_monitor <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_metrics.py PASSED [ 95%] 9435s tests/test_worker_metrics.py::test_user_metrics_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_metrics.py PASSED [ 95%] 9435s tests/test_worker_metrics.py::test_user_metrics_async <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_metrics.py PASSED [ 95%] 9435s tests/test_worker_metrics.py::test_user_metrics_fail <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_metrics.py PASSED [ 95%] 9435s tests/test_worker_metrics.py::test_user_metrics_weird <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_metrics.py PASSED [ 95%] 9437s tests/test_worker_metrics.py::test_do_not_leak_metrics <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_metrics.py PASSED [ 95%] 9438s tests/test_worker_metrics.py::test_reschedule <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_metrics.py PASSED [ 95%] 9439s tests/test_worker_metrics.py::test_send_metrics_to_scheduler <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_metrics.py PASSED [ 95%] 9439s tests/test_worker_metrics.py::test_no_spans_extension <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_metrics.py PASSED [ 95%] 9439s tests/test_worker_metrics.py::test_new_metrics_during_heartbeat <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_metrics.py PASSED [ 95%] 9441s tests/test_worker_metrics.py::test_delayed_ledger_is_not_reentrant <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_metrics.py PASSED [ 95%] 9441s tests/test_worker_metrics.py::test_int_metrics <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_metrics.py PASSED [ 95%] 9441s tests/test_worker_state_machine.py::test_instruction_match <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 95%] 9442s tests/test_worker_state_machine.py::test_TaskState_tracking <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 95%] 9442s tests/test_worker_state_machine.py::test_TaskState_get_nbytes <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 95%] 9442s tests/test_worker_state_machine.py::test_TaskState_eq <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 95%] 9442s tests/test_worker_state_machine.py::test_TaskState__to_dict <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 95%] 9442s tests/test_worker_state_machine.py::test_TaskState_repr <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 95%] 9442s tests/test_worker_state_machine.py::test_WorkerState__to_dict <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 95%] 9442s tests/test_worker_state_machine.py::test_WorkerState_pickle <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 95%] 9442s tests/test_worker_state_machine.py::test_pickle_exceptions[False-InvalidTransition-kwargs0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 95%] 9442s tests/test_worker_state_machine.py::test_pickle_exceptions[False-TransitionCounterMaxExceeded-kwargs1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 9442s tests/test_worker_state_machine.py::test_pickle_exceptions[False-InvalidTaskState-kwargs2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 9442s tests/test_worker_state_machine.py::test_pickle_exceptions[True-InvalidTransition-kwargs0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 9442s tests/test_worker_state_machine.py::test_pickle_exceptions[True-TransitionCounterMaxExceeded-kwargs1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 9442s tests/test_worker_state_machine.py::test_pickle_exceptions[True-InvalidTaskState-kwargs2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 9442s tests/test_worker_state_machine.py::test_slots[TaskState] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 9442s tests/test_worker_state_machine.py::test_slots[Instruction] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 9442s tests/test_worker_state_machine.py::test_slots[GatherDep] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 9442s tests/test_worker_state_machine.py::test_slots[Execute] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 9442s tests/test_worker_state_machine.py::test_slots[RetryBusyWorkerLater] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 9442s tests/test_worker_state_machine.py::test_slots[SendMessageToScheduler] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 9442s tests/test_worker_state_machine.py::test_slots[TaskFinishedMsg] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 9442s tests/test_worker_state_machine.py::test_slots[TaskErredMsg] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 9442s tests/test_worker_state_machine.py::test_slots[ReleaseWorkerDataMsg] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 9442s tests/test_worker_state_machine.py::test_slots[RescheduleMsg] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 9442s tests/test_worker_state_machine.py::test_slots[LongRunningMsg] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 9442s tests/test_worker_state_machine.py::test_slots[AddKeysMsg] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 9442s tests/test_worker_state_machine.py::test_slots[RequestRefreshWhoHasMsg] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 9442s tests/test_worker_state_machine.py::test_slots[StealResponseMsg] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 9442s tests/test_worker_state_machine.py::test_slots[StateMachineEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 9442s tests/test_worker_state_machine.py::test_slots[PauseEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 9442s tests/test_worker_state_machine.py::test_slots[UnpauseEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 9442s tests/test_worker_state_machine.py::test_slots[RetryBusyWorkerEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 9442s tests/test_worker_state_machine.py::test_slots[GatherDepDoneEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 9442s tests/test_worker_state_machine.py::test_slots[GatherDepSuccessEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 9442s tests/test_worker_state_machine.py::test_slots[GatherDepBusyEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 9442s tests/test_worker_state_machine.py::test_slots[GatherDepNetworkFailureEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 9442s tests/test_worker_state_machine.py::test_slots[GatherDepFailureEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 9442s tests/test_worker_state_machine.py::test_slots[RemoveWorkerEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 9442s tests/test_worker_state_machine.py::test_slots[ComputeTaskEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 9442s tests/test_worker_state_machine.py::test_slots[ExecuteDoneEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 9442s tests/test_worker_state_machine.py::test_slots[ExecuteSuccessEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 9442s tests/test_worker_state_machine.py::test_slots[ExecuteFailureEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 9442s tests/test_worker_state_machine.py::test_slots[RescheduleEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 9442s tests/test_worker_state_machine.py::test_slots[CancelComputeEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 9442s tests/test_worker_state_machine.py::test_slots[FindMissingEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 9442s tests/test_worker_state_machine.py::test_slots[RefreshWhoHasEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 9442s tests/test_worker_state_machine.py::test_slots[AcquireReplicasEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 9442s tests/test_worker_state_machine.py::test_slots[RemoveReplicasEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 9442s tests/test_worker_state_machine.py::test_slots[FreeKeysEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 9442s tests/test_worker_state_machine.py::test_slots[StealRequestEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 9442s tests/test_worker_state_machine.py::test_slots[UpdateDataEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 9442s tests/test_worker_state_machine.py::test_slots[SecedeEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 9442s tests/test_worker_state_machine.py::test_sendmsg_to_dict <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 9442s tests/test_worker_state_machine.py::test_merge_recs_instructions <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 9442s tests/test_worker_state_machine.py::test_event_to_dict_with_annotations <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 9442s tests/test_worker_state_machine.py::test_event_to_dict_without_annotations <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 9442s tests/test_worker_state_machine.py::test_computetask_to_dict <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 9442s tests/test_worker_state_machine.py::test_computetask_dummy <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 9442s tests/test_worker_state_machine.py::test_updatedata_to_dict <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 9442s tests/test_worker_state_machine.py::test_executesuccess_to_dict <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 9442s tests/test_worker_state_machine.py::test_executesuccess_dummy <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 9442s tests/test_worker_state_machine.py::test_executefailure_to_dict <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 9442s tests/test_worker_state_machine.py::test_executefailure_dummy <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 9442s tests/test_worker_state_machine.py::test_fetch_to_compute <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 9442s tests/test_worker_state_machine.py::test_fetch_via_amm_to_compute <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 9442s tests/test_worker_state_machine.py::test_lose_replica_during_fetch[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 9442s tests/test_worker_state_machine.py::test_lose_replica_during_fetch[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 9443s tests/test_worker_state_machine.py::test_fetch_to_missing_on_busy <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 9443s tests/test_worker_state_machine.py::test_new_replica_while_all_workers_in_flight <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 9443s tests/test_worker_state_machine.py::test_cancelled_while_in_flight <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 9443s tests/test_worker_state_machine.py::test_in_memory_while_in_flight <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 9443s tests/test_worker_state_machine.py::test_forget_data_needed <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 9444s tests/test_worker_state_machine.py::test_missing_handle_compute_dependency <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 9444s tests/test_worker_state_machine.py::test_missing_to_waiting <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 9444s tests/test_worker_state_machine.py::test_fetch_to_missing_on_refresh_who_has <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 9444s tests/test_worker_state_machine.py::test_fetch_to_missing_on_network_failure <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 9444s tests/test_worker_state_machine.py::test_deprecated_worker_attributes <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 9444s tests/test_worker_state_machine.py::test_aggregate_gather_deps[10000000-3-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 9444s tests/test_worker_state_machine.py::test_aggregate_gather_deps[10000000-3-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 9444s tests/test_worker_state_machine.py::test_aggregate_gather_deps[20000000-2-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 9444s tests/test_worker_state_machine.py::test_aggregate_gather_deps[20000000-2-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 9444s tests/test_worker_state_machine.py::test_aggregate_gather_deps[30000000-1-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 9444s tests/test_worker_state_machine.py::test_aggregate_gather_deps[30000000-1-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 9444s tests/test_worker_state_machine.py::test_aggregate_gather_deps[60000000-1-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 9444s tests/test_worker_state_machine.py::test_aggregate_gather_deps[60000000-1-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 9444s tests/test_worker_state_machine.py::test_gather_priority <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 9444s tests/test_worker_state_machine.py::test_task_acquires_resources[executing] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 9444s tests/test_worker_state_machine.py::test_task_acquires_resources[long-running] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 9444s tests/test_worker_state_machine.py::test_task_releases_resources[executing-ExecuteSuccessEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 9444s tests/test_worker_state_machine.py::test_task_releases_resources[executing-ExecuteFailureEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 9444s tests/test_worker_state_machine.py::test_task_releases_resources[executing-RescheduleEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 9444s tests/test_worker_state_machine.py::test_task_releases_resources[long-running-ExecuteSuccessEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 9444s tests/test_worker_state_machine.py::test_task_releases_resources[long-running-ExecuteFailureEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 9444s tests/test_worker_state_machine.py::test_task_releases_resources[long-running-RescheduleEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 9444s tests/test_worker_state_machine.py::test_task_with_dependencies_acquires_resources <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 9444s tests/test_worker_state_machine.py::test_resumed_task_releases_resources[executing-ExecuteSuccessEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 9444s tests/test_worker_state_machine.py::test_resumed_task_releases_resources[executing-ExecuteFailureEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 9444s tests/test_worker_state_machine.py::test_resumed_task_releases_resources[executing-RescheduleEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 9444s tests/test_worker_state_machine.py::test_resumed_task_releases_resources[long-running-ExecuteSuccessEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 9444s tests/test_worker_state_machine.py::test_resumed_task_releases_resources[long-running-ExecuteFailureEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 9444s tests/test_worker_state_machine.py::test_resumed_task_releases_resources[long-running-RescheduleEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 9445s tests/test_worker_state_machine.py::test_clean_log <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 9445s tests/test_worker_state_machine.py::test_running_task_in_all_running_tasks[executing] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 9445s tests/test_worker_state_machine.py::test_running_task_in_all_running_tasks[long-running] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 9445s tests/test_worker_state_machine.py::test_done_task_not_in_all_running_tasks[executing-ExecuteSuccessEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 9445s tests/test_worker_state_machine.py::test_done_task_not_in_all_running_tasks[executing-ExecuteFailureEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 9445s tests/test_worker_state_machine.py::test_done_task_not_in_all_running_tasks[executing-RescheduleEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 9445s tests/test_worker_state_machine.py::test_done_task_not_in_all_running_tasks[long-running-ExecuteSuccessEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 9445s tests/test_worker_state_machine.py::test_done_task_not_in_all_running_tasks[long-running-ExecuteFailureEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 9445s tests/test_worker_state_machine.py::test_done_task_not_in_all_running_tasks[long-running-RescheduleEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 9445s tests/test_worker_state_machine.py::test_done_resumed_task_not_in_all_running_tasks[executing-ExecuteSuccessEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 9445s tests/test_worker_state_machine.py::test_done_resumed_task_not_in_all_running_tasks[executing-ExecuteFailureEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 9445s tests/test_worker_state_machine.py::test_done_resumed_task_not_in_all_running_tasks[executing-RescheduleEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 9445s tests/test_worker_state_machine.py::test_done_resumed_task_not_in_all_running_tasks[long-running-ExecuteSuccessEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 9445s tests/test_worker_state_machine.py::test_done_resumed_task_not_in_all_running_tasks[long-running-ExecuteFailureEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 9445s tests/test_worker_state_machine.py::test_done_resumed_task_not_in_all_running_tasks[long-running-RescheduleEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 9445s tests/test_worker_state_machine.py::test_gather_dep_failure <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 9445s tests/test_worker_state_machine.py::test_recompute_erred_task <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 9445s tests/test_worker_state_machine.py::test_transfer_incoming_metrics <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 9445s tests/test_worker_state_machine.py::test_throttling_does_not_affect_first_transfer <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 9445s tests/test_worker_state_machine.py::test_message_target_does_not_affect_first_transfer_on_different_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 9445s tests/test_worker_state_machine.py::test_throttle_incoming_transfers_on_count_limit <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 9445s tests/test_worker_state_machine.py::test_throttling_incoming_transfer_on_transfer_bytes_same_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 9445s tests/test_worker_state_machine.py::test_throttling_incoming_transfer_on_transfer_bytes_different_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 9445s tests/test_worker_state_machine.py::test_do_not_throttle_connections_while_below_threshold <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 9445s tests/test_worker_state_machine.py::test_throttle_on_transfer_bytes_regardless_of_threshold <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 9445s tests/test_worker_state_machine.py::test_worker_nbytes[executing] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 9445s tests/test_worker_state_machine.py::test_worker_nbytes[long-running] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 9445s tests/test_worker_state_machine.py::test_fetch_count <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 9445s tests/test_worker_state_machine.py::test_task_counter <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 9445s tests/test_worker_state_machine.py::test_remove_worker_while_in_flight[fail] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 9445s tests/test_worker_state_machine.py::test_remove_worker_while_in_flight[success] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 9445s tests/test_worker_state_machine.py::test_remove_worker_while_in_flight[no-key] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 9445s tests/test_worker_state_machine.py::test_remove_worker_while_in_flight[busy] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 9445s tests/test_worker_state_machine.py::test_remove_worker_while_in_flight_unused_peer <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 9445s tests/test_worker_state_machine.py::test_remove_worker_while_in_fetch <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 9445s tests/test_worker_state_machine.py::test_remove_worker_unknown <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [100%] 9445s 9445s ============================= slowest 20 durations ============================= 9445s 10.02s call tests/test_utils_test.py::test_popen_timeout 9445s 8.74s call shuffle/tests/test_rechunk.py::test_rechunk_method 9445s 6.24s call tests/test_failed_workers.py::test_worker_doesnt_await_task_completion 9445s 5.78s call tests/test_stress.py::test_cancel_stress_sync 9445s 5.34s call cli/tests/test_dask_worker.py::test_error_during_startup[--nanny] 9445s 5.33s call tests/test_nanny.py::test_num_fds 9445s 5.23s call tests/test_stress.py::test_cancel_stress 9445s 5.17s call tests/test_steal.py::test_balance_with_longer_task 9445s 4.92s call tests/test_chaos.py::test_KillWorker[sys.exit] 9445s 4.72s call diagnostics/tests/test_progress.py::test_group_timing 9445s 4.11s call tests/test_nanny.py::test_scheduler_crash_doesnt_restart 9445s 4.02s call tests/test_chaos.py::test_KillWorker[segfault] 9445s 3.88s call diagnostics/tests/test_progress.py::test_AllProgress 9445s 3.70s call tests/test_tls_functional.py::test_retire_workers 9445s 3.68s call tests/test_failed_workers.py::test_restart_sync 9445s 3.67s call tests/test_nanny.py::test_environ_plugin 9445s 3.45s call shuffle/tests/test_rechunk.py::test_rechunk_with_partially_unknown_dimension[x3-chunks3] 9445s 3.33s call tests/test_steal.py::test_trivial_workload_should_not_cause_work_stealing 9445s 3.33s call shuffle/tests/test_rechunk.py::test_rechunk_with_partially_unknown_dimension[x4-chunks4] 9445s 3.31s call shuffle/tests/test_rechunk.py::test_rechunk_with_partially_unknown_dimension[x5-chunks5] 9445s =========================== short test summary info ============================ 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_ssh.py:9: could not import 'paramiko': No module named 'paramiko' 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_ucx.py:15: could not import 'ucp': No module named 'ucp' 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_ucx_config.py:22: could not import 'ucp': No module named 'ucp' 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/dashboard/tests/test_components.py:5: could not import 'bokeh': No module named 'bokeh' 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/dashboard/tests/test_scheduler_bokeh.py:11: could not import 'bokeh': No module named 'bokeh' 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/dashboard/tests/test_worker_bokeh.py:10: could not import 'bokeh': No module named 'bokeh' 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_old_ssh.py:7: could not import 'paramiko': No module named 'paramiko' 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_ssh.py:5: could not import 'asyncssh': No module named 'asyncssh' 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_cudf_diagnostics.py:20: could not import 'cudf': No module named 'cudf' 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_memray.py:5: could not import 'memray': No module named 'memray' 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_nvml.py:10: could not import 'pynvml': No module named 'pynvml' 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_progress_stream.py:5: could not import 'bokeh': No module named 'bokeh' 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_progress_widgets.py:14: could not import 'ipywidgets': No module named 'ipywidgets' 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_rmm_diagnostics.py:14: could not import 'dask_cuda': No module named 'dask_cuda' 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_arrow.py:5: could not import 'pyarrow': No module named 'pyarrow' 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_cupy.py:11: could not import 'cupy': No module named 'cupy' 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_h5py.py:8: could not import 'h5py': No module named 'h5py' 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_keras.py:5: could not import 'keras': No module named 'keras' 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_netcdf4.py:5: could not import 'netCDF4': No module named 'netCDF4' 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numba.py:11: could not import 'numba.cuda': No module named 'numba' 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_rmm.py:10: could not import 'numba.cuda': No module named 'numba' 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_scipy.py:8: could not import 'scipy': No module named 'scipy' 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_sparse.py:6: could not import 'sparse': No module named 'sparse' 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_torch.py:8: could not import 'torch': No module named 'torch' 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_graph.py:9: could not import 'pyarrow': No module named 'pyarrow' 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_merge.py:71: could not import 'pyarrow': No module named 'pyarrow' 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_merge_column_and_index.py:110: could not import 'pyarrow': No module named 'pyarrow' 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_metrics.py:71: could not import 'pyarrow': No module named 'pyarrow' 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_shuffle.py:195: could not import 'pyarrow': No module named 'pyarrow' 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_parse_stdout.py:14: could not import 'parse_stdout': No module named 'parse_stdout' 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py:75: could not import 'bokeh': No module named 'bokeh' 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py:107: could not import 'bokeh': No module named 'bokeh' 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py:154: could not import 'bokeh': No module named 'bokeh' 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py:291: could not import 'bokeh': No module named 'bokeh' 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py:497: need --runslow option to run 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py:509: need --runslow option to run 9445s SKIPPED [2] ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py:569: need --runslow option to run 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py:169: need --runslow option to run 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py:194: need --runslow option to run 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py:264: need --runslow option to run 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py:290: need --runslow option to run 9445s SKIPPED [2] ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py:309: need --runslow option to run 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py:345: need --runslow option to run 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py:368: need --runslow option to run 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py:375: need --runslow option to run 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py:383: need --runslow option to run 9445s SKIPPED [4] ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py:397: need --runslow option to run 9445s SKIPPED [4] ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py:431: need --runslow option to run 9445s SKIPPED [4] ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py:468: need --runslow option to run 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py:487: need --runslow option to run 9445s SKIPPED [2] ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py:525: need --runslow option to run 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py:536: need --runslow option to run 9445s SKIPPED [2] ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py:546: need --runslow option to run 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py:589: need --runslow option to run 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py:606: need --runslow option to run 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py:625: need --runslow option to run 9445s SKIPPED [2] ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py:639: need --runslow option to run 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py:726: need --runslow option to run 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_subprocess.py:77: need --runslow option to run 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_subprocess.py:91: Windows-specific error testing (distributed#7434) 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_eventstream.py:16: could not import 'bokeh': No module named 'bokeh' 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_install_plugin.py:143: need --runslow option to run 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_memory_sampler.py:49: need --runslow option to run 9445s SKIPPED [2] ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_memory_sampler.py:79: could not import 'matplotlib': No module named 'matplotlib' 9445s SKIPPED [2] ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_memory_sampler.py:108: need --runslow option to run 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_task_stream.py:140: could not import 'bokeh.models': No module named 'bokeh' 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_task_stream.py:151: could not import 'bokeh.models': No module named 'bokeh' 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_missing_bokeh.py:35: could not import 'bokeh': No module named 'bokeh' 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_missing_bokeh.py:59: could not import 'bokeh': No module named 'bokeh' 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py:86: could not import 'bokeh': No module named 'bokeh' 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py:324: could not import 'aiohttp': No module named 'aiohttp' 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py:437: could not import 'bokeh': No module named 'bokeh' 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py:478: could not import 'aiohttp': No module named 'aiohttp' 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py:498: could not import 'aiohttp': No module named 'aiohttp' 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py:521: could not import 'aiohttp': No module named 'aiohttp' 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py:543: could not import 'aiohttp': No module named 'aiohttp' 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py:564: could not import 'aiohttp': No module named 'aiohttp' 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/http/worker/tests/test_worker_http.py:149: could not import 'aiohttp': No module named 'aiohttp' 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/http/worker/tests/test_worker_http.py:162: could not import 'aiohttp': No module named 'aiohttp' 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/http/worker/tests/test_worker_http.py:233: Fails on 32-bit, seems to be large memory request 9445s SKIPPED [4] ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_collection_cuda.py:12: could not import 'cupy': No module named 'cupy' 9445s SKIPPED [4] ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_collection_cuda.py:44: could not import 'cudf': No module named 'cudf' 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py:125: could not import 'lz4': No module named 'lz4' 9445s SKIPPED [2] ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py:132: could not import 'lz4': No module named 'lz4' 9445s SKIPPED [2] ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py:132: could not import 'snappy': No module named 'snappy' 9445s SKIPPED [2] ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py:132: could not import 'zstandard': No module named 'zstandard' 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py:143: could not import 'lz4': No module named 'lz4' 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py:143: could not import 'snappy': No module named 'snappy' 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py:143: could not import 'zstandard': No module named 'zstandard' 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py:151: could not import 'lz4': No module named 'lz4' 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py:151: could not import 'snappy': No module named 'snappy' 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py:151: could not import 'zstandard': No module named 'zstandard' 9445s SKIPPED [10] ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py:168: need --runslow option to run 9445s SKIPPED [5] ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py:188: need --runslow option to run 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py:150: could not import 'numpy.core.test_rational': No module named 'numpy.core.test_rational' 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py:180: need --runslow option to run 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pickle.py:283: need --runslow option to run 9445s SKIPPED [3] ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol.py:213: need --runslow option to run 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py:1252: need --runslow option to run 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py:1296: need --runslow option to run 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py:1309: need --runslow option to run 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py:1331: need --runslow option to run 9445s SKIPPED [2] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py:1352: need --runslow option to run 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_batched.py:158: need --runslow option to run 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_batched.py:228: need --runslow option to run 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:853: need --runslow option to run 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:1726: need --runslow option to run 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:1860: unconditional skip 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:2078: unconditional skip 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:2653: unconditional skip 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:2672: Use fast random selection now 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:3303: unconditional skip 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:3586: need --runslow option to run 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:3651: need --runslow option to run 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:3763: need --runslow option to run 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:4586: need --runslow option to run 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:4689: Now prefer first-in-first-out 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:4719: need --runslow option to run 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:4855: could not import 'scipy': No module named 'scipy' 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:4998: need --runslow option to run 9445s SKIPPED [2] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:5041: need --runslow option to run 9445s SKIPPED [2] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:5061: need --runslow option to run 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:5088: need --runslow option to run 9445s SKIPPED [2] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:5101: need --runslow option to run 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:5289: need --runslow option to run 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:5308: need --runslow option to run 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:5603: need --runslow option to run 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:5845: need --runslow option to run 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:6046: need --runslow option to run 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:6163: unconditional skip 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:6377: could not import 'bokeh.plotting': No module named 'bokeh' 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:6726: known intermittent failure 9445s SKIPPED [2] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:6807: need --runslow option to run 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:6870: On Py3.10+ semaphore._loop is not bound until .acquire() blocks 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:6890: On Py3.10+ semaphore._loop is not bound until .acquire() blocks 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:6899: need --runslow option to run 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:7305: could not import 'bokeh': No module named 'bokeh' 9445s SKIPPED [2] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:7406: need --runslow option to run 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:7501: numpy >=1.25 can capture ufunc code 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:7645: need --runslow option to run 9445s SKIPPED [2] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:8396: need --runslow option to run 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client_executor.py:146: need --runslow option to run 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_config.py:356: could not import 'uvloop': No module named 'uvloop' 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py:602: need --runslow option to run 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py:1026: could not import 'crick': No module named 'crick' 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py:1035: could not import 'crick': No module named 'crick' 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py:1487: need --runslow option to run 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_counter.py:13: no crick library 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_dask_collections.py:221: could not import 'sparse': No module named 'sparse' 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_diskutils.py:224: need --runslow option to run 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py:41: need --runslow option to run 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py:117: need --runslow option to run 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py:128: need --runslow option to run 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py:286: need --runslow option to run 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py:357: need --runslow option to run 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py:441: need --runslow option to run 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py:453: need --runslow option to run 9445s SKIPPED [2] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py:474: need --runslow option to run 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py:520: need --runslow option to run 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_jupyter.py:47: need --runslow option to run 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_metrics.py:31: WindowsTime doesn't work with high accuracy base timer 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py:93: need --runslow option to run 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py:107: need --runslow option to run 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py:141: need --runslow option to run 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py:269: need --runslow option to run 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py:468: need --runslow option to run 9445s SKIPPED [2] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py:545: could not import 'ucp': No module named 'ucp' 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py:632: need --runslow option to run 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py:640: need --runslow option to run 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py:681: need --runslow option to run 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py:724: need --runslow option to run 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py:75: could not import 'stacktrace': No module named 'stacktrace' 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_queues.py:113: need --runslow option to run 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py:363: Skipped 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py:420: Should protect resource keys from optimization 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py:441: atop fusion seemed to break this 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py:305: Not relevant with queuing on; see https://github.com/dask/distributed/issues/7204 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py:440: need --runslow option to run 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py:1087: need --runslow option to run 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py:1115: need --runslow option to run 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py:1136: need --runslow option to run 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py:1228: need --runslow option to run 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py:1246: need --runslow option to run 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py:1638: need --runslow option to run 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py:1691: need --runslow option to run 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py:1708: need --runslow option to run 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py:1871: need --runslow option to run 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py:1911: need --runslow option to run 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py:2102: need --runslow option to run 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py:2361: need --runslow option to run 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py:2450: need --runslow option to run 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py:2471: need --runslow option to run 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py:2506: need --runslow option to run 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py:2549: need --runslow option to run 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py:2604: could not import 'bokeh': No module named 'bokeh' 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py:2980: need --runslow option to run 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py:3394: need --runslow option to run 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py:3573: need --runslow option to run 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py:3605: need --runslow option to run 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py:3748: need --runslow option to run 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py:3805: need --runslow option to run 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py:3825: need --runslow option to run 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py:4064: need --runslow option to run 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py:106: need --runslow option to run 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py:285: Skipped 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py:1287: executing heartbeats not considered yet 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py:1353: need --runslow option to run 9445s SKIPPED [2] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_stress.py:51: need --runslow option to run 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_stress.py:96: need --runslow option to run 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_stress.py:202: unconditional skip 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_stress.py:233: need --runslow option to run 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_stress.py:260: need --runslow option to run 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_stress.py:301: need --runslow option to run 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_system_monitor.py:111: could not import 'gilknocker': No module named 'gilknocker' 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py:167: could not import 'IPython': No module named 'IPython' 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py:357: could not import 'pyarrow': No module named 'pyarrow' 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_perf.py:86: need --runslow option to run 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py:149: This hangs on travis 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py:442: need --runslow option to run 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py:603: need --runslow option to run 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py:816: need --runslow option to run 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_variable.py:194: need --runslow option to run 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py:219: don't yet support uploading pyc files 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py:309: could not import 'crick': No module named 'crick' 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py:345: need --runslow option to run 9445s SKIPPED [8] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py:420: need --runslow option to run 9445s SKIPPED [5] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py:561: need --runslow option to run 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py:1207: need --runslow option to run 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py:1287: need --runslow option to run 9445s SKIPPED [2] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py:1476: could not import 'ucp': No module named 'ucp' 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py:1540: need --runslow option to run 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py:1572: need --runslow option to run 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py:1603: need --runslow option to run 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py:1630: need --runslow option to run 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py:1658: need --runslow option to run 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py:1725: need --runslow option to run 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py:1830: need --runslow option to run 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py:2729: need --runslow option to run 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py:3421: need --runslow option to run 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py:3451: need --runslow option to run 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py:871: need --runslow option to run 9445s SKIPPED [2] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py:883: need --runslow option to run 9445s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py:997: need --runslow option to run 9445s = 2884 passed, 306 skipped, 166 deselected, 16 xfailed, 7 xpassed in 993.49s (0:16:33) = 9446s *** END OF RUN 1: ALL TESTS RUN HAVE NOW PASSED/XFAILED *** 9446s pybuild-autopkgtest: error: pybuild --autopkgtest -i python{version} -p "3.13 3.12" returned exit code 13 9446s make: *** [/tmp/6oSueFR16k/run:4: pybuild-autopkgtest] Error 25 9446s pybuild-autopkgtest: error: /tmp/6oSueFR16k/run pybuild-autopkgtest returned exit code 2 9447s autopkgtest [23:13:55]: test pybuild-autopkgtest: -----------------------] 9452s autopkgtest [23:14:01]: test pybuild-autopkgtest: - - - - - - - - - - results - - - - - - - - - - 9452s pybuild-autopkgtest FAIL non-zero exit status 25 9456s autopkgtest [23:14:05]: @@@@@@@@@@@@@@@@@@@@ summary 9456s pytest FLAKY non-zero exit status 1 9456s pybuild-autopkgtest FAIL non-zero exit status 25